Development and Validation of a Situational Judgement Test (SIT-UAS) for Unmanned Aircraft System Operators: Predicting Non-Technical Skills in Remote Piloting
The SIT-UAS is a reliable and valid tool for assessing judgement in UAS operations. It offers a practical, low-fidelity alternative for selection and training needs analysis.
The final 25-item SIT-UAS demonstrated good internal consistency (α = 0.84) and inter-rater agreement for scoring (Fleiss’ κ = 0.76). SIT-UAS scores correlated significantly with instructor-rated non-technical competence (r = 0.61, p < .001) and predicted simulator mission success (OR = 3.4 per SD increase). sit uas
Situational Judgement Test, Unmanned Aircraft Systems, non-technical skills, pilot selection, human factors. 1. Introduction The proliferation of UAS (drones) across civil, commercial, and military domains has increased demand for effective operator selection and training (ICAO, 2022). While technical proficiency in flight control is measurable, critical incidents often involve failures of judgement—e.g., prioritizing a visual fix over battery state, or misinterpreting controller handoffs.
Situational Judgement Tests (SJTs) present candidates with realistic, work-related scenarios and ask them to rate or choose among possible actions. SJTs predict job performance in many high-stakes professions (medicine, air traffic control) by assessing procedural knowledge and tacit decision-making rules (Lievens & Sackett, 2012). However, no validated SJT currently exists for UAS operators. Development and Validation of a Situational Judgement Test
Scenario: You are operating a UAS beyond visual line of sight. The ground control station displays a “Link Quality Low” warning, and you have not received a telemetry update for 12 seconds. Your mission objective is to survey a flooded area. What do you do?
A. Continue the mission, hoping the link recovers. B. Immediately initiate return-to-home (RTH). C. Climb to higher altitude to improve line of sight. D. Wait 30 seconds, then command RTH if no recovery. Introduction The proliferation of UAS (drones) across civil,
Correct (expert rated best): B (Immediate RTH – prioritizes safety over mission) Least effective: A (Continued flight risks loss of aircraft)