Training To Succeed Setting standards in Drone Search & Rescue Training

Elevating Proficiency and Performance: How Technical Rescue International's UAS Test Methods Revolutionize Pilot Training in High-Risk Environments

Darryl, having previously served in USAR & ISAR in the London Fire Brigade, is currently a Mountain Rescue UA Pilot in the Search & Rescue Aerial Association - Scotland, Scottish Mountain Rescue Training Support Officer and a Scottish Cave Rescue Organisation Training officer. Darryl is also the Drone/Robotics Lead for Technical Rescue International.

Technical Rescue International (TRI) specialises in the provision of technical rescue training and bespoke training packages for operations in high risk environments internationally. TRI deliver a suite of UAS discipline specific training courses focused on operations including structural fire, Urban Search & Rescue, Wildfire, Rural & Mountain Search & Rescue, Fire Investigation and Hazmat . All of TRI's UAS Instructors are operational UA Pilots.

TRI recently had the privilege to host, for their first time in Europe, the National Institute of Standards & Technology (NIST) (U.S. Department of Commerce), Intelligence System Division to adopt their UAS Test Methods that will not only change the way UA Search & Rescue Pilots are trained but will apply a standard to Pilot proficiency and performance evaluation.

The tests derived from the NIST Emergency Response Robots project, which encompassed the following overview:

Objective:

• Provide emergency responders a way to quantitatively measure whether robots are capable and reliable enough to perform operational tasks

• Encourage integration of onboard sensors and intelligent controls to improve remote operator capabilities.

Approach:

•Develop test methods that measure robot manoeuvring, mobility, sensors, energy, radio comms, dexterity, durability, logistics, autonomy, and operator proficiency.

Impacts

• Communicate operational needs to robot developers

• Enable users to understand emerging robot capabilities

• Guide robot purchasing and deployment decisions

• Focus training and measure operator proficiency.

Although the project covers over 50 test methods for robots of varying kinds, we will just focus on the test methods for small UAS.

What does all that mean?

In very simple terms it means that there is a proven, measurable way of testing the proficiency of the pilot and the capability of the UA. It also means that the pilot's skill can be developed and improved.

What do the tests physically look like?

A range of timber framed rigs, constructed with small 'buckets' with a sticker inside them showing a range of concentric rings.

What do I have to do to show proficiency?

You have to fly the UA along a set route, in a set sequence, identify where the concentric rings are broken (for example with the below sticker, top right, bottom, top right, left and so on until no more broken rings can be seen) in each bucket and within a fixed timeframe.

How will it change the way we deliver search and rescue UA training to pilots?

Ordinarily, we train pilots that are already qualified to fly a UA but what this gives them, is the fixed pattern of behaviour to respond with their motor skills required to manoeuvre the UA, in the most efficient way in a range of circumstances such as out in the open or in confined areas.

With internal flying, such as in a structural collapse environment for example, it gives the progression from flying in the open, to obstructed, then onto confined areas and this will teach pilots about their UA's capabilities, efficiency, manoeuvrability and stability in areas where airflow may be disrupted.

The theory behind the test methods

The rigs are constructed to utilise right angle triangles to localise the UA in space. For the UA camera to be in direct field of view of all of the concentric rings in each bucket, the Pilot has to direct the UA camera at the right angle. As can be seen in the below set of images, in the first, complete alignment has been achieved, in the second, the coloured ring cannot be fully observed and in the third, the first black ring cannot be observed. This would constitute a loss of points.

Once alignment has been achieved, acuity is tested. This involves the Pilot calling out where the concentric rings are broken which gains points for each ring correctly identified (for example in the images, left, bottom left, top left etc.). To acquire full points, the Pilot uses the zoom/exposure controls if available and if not, flies as close to the bucket as possible to see as many rings (that decrease in size) as possible.

Most of the test is in flight however, some of the tests incorporate the UA in a 'perch' position to replicate circumstances where the Pilot would want to land the drone, on a flat roof for example to observe without wasting power. The tests not only evaluate the Pilot but also identify performance between differing UA as not all of the rings may be seen depending on the capability.

To what standard are the performance levels?

There are four levels each with their own criteria which is recorded on a score sheet.

Proficient:

• Can do the complete task quickly and accurately

• Can tell or show others how to do the task.

Competent:

• Can do all parts of the task

• Needs only a spot check of completed work.

Partially proficient:

• Can do most parts of the task

• Needs only help on hardest parts

Limited:

• Can do simple parts of task

• Needs to be told or shown how to do most of task.

Are the tests really transferable to real life scenarios?

Let's take a look at an example, where at a structural collapse incident, a Pilot is tasked with searching inside the compartments of the structure. Initially, the Pilot would search externally (to reduce risk to the UA) by positioning the UA at differing angles to the opening (above, below and to each side) allowing the Pilot to observe as much of the inside of the compartment as possible without actually entering. In the image below, the buckets are positioned in a way that replicates this type of search procedure. The tests can be attributed to almost any type of search or other UA functions as the system is flexible and allows for facilitators to build scenarios that fit the work.

Are the tests stand-alone or incorporated into training scenarios?

As with any training or training course, a range of learning methods and tools are required to get the best from students. TRI use the test methods as a developmental tool within training courses so students are familiarised with the format after which they will complete the range of tests in their simplest form before completing them in the environment of the discipline they are working in (for example, in a simulated collapsed structure and rubble pile for USAR). The tests will give students the knowledge, muscle memory and confidence to then complete scenarios such as searching for simulated casualties, body parts or other clues.

There are a host of tests already devised for a range of scenarios and potential operational tasks or conditions such as:

• Vehicle inspection (law enforcement/ security/hazmat etc.)

• Wide area search

• Thermal imaging

• Night operations

• Payload delivery

Darryl Ashford-Smith

Darryl, having previously served in USAR & ISAR in the London Fire Brigade, is currently a Mountain Rescue UAS Pilot in the Search & Rescue Aerial Association-Scotland, Scottish Mountain Rescue Training Support Officer and a Scottish Cave Rescue Organisation Training officer. Darryl is also the Drone/Robotics Lead for Technical Rescue International.