SlideShare a Scribd company logo
Human-Machine Interfaces for Increased UAS Pilot Situational Awareness Prepared for UAS 2010 June 14-18 Ricardo Lopez Graduate Student Researcher
Outline ,[object Object]
Situation Awareness
Autonomy vs. Automation
Classes of Unmanned Aircraft Systems
Hypothesis
Level of Autonomy
Autonomy Levels for Unmanned Systems (ALFUS) Framework
Total ALFUS Score
Decomposition of Human Independent Domain
ALFUS and Airspace
Experimental Design
External vs. Internal Pilot
Levels of Autonomy
Navigation Situation Awareness User Interface Baseline
Interface Environments
Results and Conclusions
Status and Future Work
Questions2
Situation Awareness ,[object Object],Within your environment Understand what you perceive Where you are Where you have been Where you are going Collision Alert!! 3
Situation Awareness From Toward a theory of situation awareness in dynamic systems., Endsley, M.R., 1995, Aldershot, England: Human Factors, copyright © 1995 by Human Factors and Ergonomics Society.
Autonomy vs. Automation ,[object Object],Automatic Autonomous ,[object Object],[object Object],[object Object]
What varies is their level of fidelity to achieve the system’s situation awareness needs based on the mission and the environment they are operating in.High Altitude Long Endurance Medium Altitude Long Endurance Mini/Micro 7
Hypothesis ,[object Object],Take Off En Route Taxi Landing Class D Class A Taxi Class D What, how, and how much gets displayed to the operator for them to interface with the system 8
What is the Autonomy Level For Unmanned Systems (ALFUS)? ,[object Object],Mission Complexity Human Independence Environmental Complexity 9
Total ALFUS Score ,[object Object],[object Object]

More Related Content

Similar to Human-Machine Interfaces for Increased UAS Pilot Situational Awareness

Ai in decision making capability on board unmanned aerial vehicle
Ai in decision making capability on board unmanned aerial vehicleAi in decision making capability on board unmanned aerial vehicle
Ai in decision making capability on board unmanned aerial vehicle
Dinesh More
 
Unmanned Aerial Vehicle - Aerial Robotics
Unmanned Aerial Vehicle - Aerial RoboticsUnmanned Aerial Vehicle - Aerial Robotics
Unmanned Aerial Vehicle - Aerial Robotics
Muhammad Aleem Siddiqui
 
Unit i introduction to avionics
Unit i introduction to avionicsUnit i introduction to avionics
Unit i introduction to avionics
ObliL
 
Avionics sai
Avionics saiAvionics sai
Avionics sai
Sai Shubhankar
 
AE8751-CAE347 AVIONICS (1).pptx
AE8751-CAE347 AVIONICS (1).pptxAE8751-CAE347 AVIONICS (1).pptx
AE8751-CAE347 AVIONICS (1).pptx
MRCrazylover1122
 
Software Architecture Evaluation of Unmanned Aerial Vehicles Fuzzy Based Cont...
Software Architecture Evaluation of Unmanned Aerial Vehicles Fuzzy Based Cont...Software Architecture Evaluation of Unmanned Aerial Vehicles Fuzzy Based Cont...
Software Architecture Evaluation of Unmanned Aerial Vehicles Fuzzy Based Cont...
Editor IJCATR
 
Software Architecture Evaluation of Unmanned Aerial Vehicles Fuzzy Based Cont...
Software Architecture Evaluation of Unmanned Aerial Vehicles Fuzzy Based Cont...Software Architecture Evaluation of Unmanned Aerial Vehicles Fuzzy Based Cont...
Software Architecture Evaluation of Unmanned Aerial Vehicles Fuzzy Based Cont...
Editor IJCATR
 
Mission planning and control for UAV's
Mission planning and control for UAV'sMission planning and control for UAV's
Mission planning and control for UAV's
Suthan Rajendran
 
TRAFFIC COLLISION AVOIDANCE SYSTEM(TCAS).pptx
TRAFFIC COLLISION AVOIDANCE SYSTEM(TCAS).pptxTRAFFIC COLLISION AVOIDANCE SYSTEM(TCAS).pptx
TRAFFIC COLLISION AVOIDANCE SYSTEM(TCAS).pptx
CyprianObota
 
Detection of Sensor Faults in Small Helicopter UAVs Using Observer/Kalman Fil...
Detection of Sensor Faults in Small Helicopter UAVs Using Observer/Kalman Fil...Detection of Sensor Faults in Small Helicopter UAVs Using Observer/Kalman Fil...
Detection of Sensor Faults in Small Helicopter UAVs Using Observer/Kalman Fil...
Angelo State University
 
Design and Structural Analysis for an Autonomous UAV System Consisting of Sla...
Design and Structural Analysis for an Autonomous UAV System Consisting of Sla...Design and Structural Analysis for an Autonomous UAV System Consisting of Sla...
Design and Structural Analysis for an Autonomous UAV System Consisting of Sla...
IOSR Journals
 
Design and Structural Analysis for an Autonomous UAV System Consisting of Sla...
Design and Structural Analysis for an Autonomous UAV System Consisting of Sla...Design and Structural Analysis for an Autonomous UAV System Consisting of Sla...
Design and Structural Analysis for an Autonomous UAV System Consisting of Sla...
IOSR Journals
 
System Architecture Study Global Hawk Unamanned Aerial System (UAS)
System Architecture Study Global Hawk Unamanned Aerial System (UAS)System Architecture Study Global Hawk Unamanned Aerial System (UAS)
System Architecture Study Global Hawk Unamanned Aerial System (UAS)
University of Southern California
 
RADAR, Mlat, ADS, Bird RADAR, Weather RADAR Guide
RADAR, Mlat, ADS, Bird RADAR, Weather RADAR GuideRADAR, Mlat, ADS, Bird RADAR, Weather RADAR Guide
RADAR, Mlat, ADS, Bird RADAR, Weather RADAR Guide
Afghanistan civil aviation institute
 
(CNS)Submited-Dr Donohue.ppt
(CNS)Submited-Dr Donohue.ppt(CNS)Submited-Dr Donohue.ppt
(CNS)Submited-Dr Donohue.ppt
AhwanPradhan1
 
Air Traffic Control Database Management System for Seamless Transit
Air Traffic Control Database Management System for Seamless TransitAir Traffic Control Database Management System for Seamless Transit
Air Traffic Control Database Management System for Seamless Transit
IRJET Journal
 
Honeywell Aerochallenge 2014
Honeywell Aerochallenge 2014Honeywell Aerochallenge 2014
Honeywell Aerochallenge 2014
Arushi Singh
 
PPt on AAI
PPt on AAIPPt on AAI
PPt on AAI
sneharai3886
 
Human Centered Automation: a philosophy for automation in aviation
Human Centered Automation: a philosophy for automation in aviationHuman Centered Automation: a philosophy for automation in aviation
Human Centered Automation: a philosophy for automation in aviation
Paula Azevedo Macedo
 
Automation of Air Traffic Management Using Fuzzy Logic Algorithm to Integrate...
Automation of Air Traffic Management Using Fuzzy Logic Algorithm to Integrate...Automation of Air Traffic Management Using Fuzzy Logic Algorithm to Integrate...
Automation of Air Traffic Management Using Fuzzy Logic Algorithm to Integrate...
IJECEIAES
 

Similar to Human-Machine Interfaces for Increased UAS Pilot Situational Awareness (20)

Ai in decision making capability on board unmanned aerial vehicle
Ai in decision making capability on board unmanned aerial vehicleAi in decision making capability on board unmanned aerial vehicle
Ai in decision making capability on board unmanned aerial vehicle
 
Unmanned Aerial Vehicle - Aerial Robotics
Unmanned Aerial Vehicle - Aerial RoboticsUnmanned Aerial Vehicle - Aerial Robotics
Unmanned Aerial Vehicle - Aerial Robotics
 
Unit i introduction to avionics
Unit i introduction to avionicsUnit i introduction to avionics
Unit i introduction to avionics
 
Avionics sai
Avionics saiAvionics sai
Avionics sai
 
AE8751-CAE347 AVIONICS (1).pptx
AE8751-CAE347 AVIONICS (1).pptxAE8751-CAE347 AVIONICS (1).pptx
AE8751-CAE347 AVIONICS (1).pptx
 
Software Architecture Evaluation of Unmanned Aerial Vehicles Fuzzy Based Cont...
Software Architecture Evaluation of Unmanned Aerial Vehicles Fuzzy Based Cont...Software Architecture Evaluation of Unmanned Aerial Vehicles Fuzzy Based Cont...
Software Architecture Evaluation of Unmanned Aerial Vehicles Fuzzy Based Cont...
 
Software Architecture Evaluation of Unmanned Aerial Vehicles Fuzzy Based Cont...
Software Architecture Evaluation of Unmanned Aerial Vehicles Fuzzy Based Cont...Software Architecture Evaluation of Unmanned Aerial Vehicles Fuzzy Based Cont...
Software Architecture Evaluation of Unmanned Aerial Vehicles Fuzzy Based Cont...
 
Mission planning and control for UAV's
Mission planning and control for UAV'sMission planning and control for UAV's
Mission planning and control for UAV's
 
TRAFFIC COLLISION AVOIDANCE SYSTEM(TCAS).pptx
TRAFFIC COLLISION AVOIDANCE SYSTEM(TCAS).pptxTRAFFIC COLLISION AVOIDANCE SYSTEM(TCAS).pptx
TRAFFIC COLLISION AVOIDANCE SYSTEM(TCAS).pptx
 
Detection of Sensor Faults in Small Helicopter UAVs Using Observer/Kalman Fil...
Detection of Sensor Faults in Small Helicopter UAVs Using Observer/Kalman Fil...Detection of Sensor Faults in Small Helicopter UAVs Using Observer/Kalman Fil...
Detection of Sensor Faults in Small Helicopter UAVs Using Observer/Kalman Fil...
 
Design and Structural Analysis for an Autonomous UAV System Consisting of Sla...
Design and Structural Analysis for an Autonomous UAV System Consisting of Sla...Design and Structural Analysis for an Autonomous UAV System Consisting of Sla...
Design and Structural Analysis for an Autonomous UAV System Consisting of Sla...
 
Design and Structural Analysis for an Autonomous UAV System Consisting of Sla...
Design and Structural Analysis for an Autonomous UAV System Consisting of Sla...Design and Structural Analysis for an Autonomous UAV System Consisting of Sla...
Design and Structural Analysis for an Autonomous UAV System Consisting of Sla...
 
System Architecture Study Global Hawk Unamanned Aerial System (UAS)
System Architecture Study Global Hawk Unamanned Aerial System (UAS)System Architecture Study Global Hawk Unamanned Aerial System (UAS)
System Architecture Study Global Hawk Unamanned Aerial System (UAS)
 
RADAR, Mlat, ADS, Bird RADAR, Weather RADAR Guide
RADAR, Mlat, ADS, Bird RADAR, Weather RADAR GuideRADAR, Mlat, ADS, Bird RADAR, Weather RADAR Guide
RADAR, Mlat, ADS, Bird RADAR, Weather RADAR Guide
 
(CNS)Submited-Dr Donohue.ppt
(CNS)Submited-Dr Donohue.ppt(CNS)Submited-Dr Donohue.ppt
(CNS)Submited-Dr Donohue.ppt
 
Air Traffic Control Database Management System for Seamless Transit
Air Traffic Control Database Management System for Seamless TransitAir Traffic Control Database Management System for Seamless Transit
Air Traffic Control Database Management System for Seamless Transit
 
Honeywell Aerochallenge 2014
Honeywell Aerochallenge 2014Honeywell Aerochallenge 2014
Honeywell Aerochallenge 2014
 
PPt on AAI
PPt on AAIPPt on AAI
PPt on AAI
 
Human Centered Automation: a philosophy for automation in aviation
Human Centered Automation: a philosophy for automation in aviationHuman Centered Automation: a philosophy for automation in aviation
Human Centered Automation: a philosophy for automation in aviation
 
Automation of Air Traffic Management Using Fuzzy Logic Algorithm to Integrate...
Automation of Air Traffic Management Using Fuzzy Logic Algorithm to Integrate...Automation of Air Traffic Management Using Fuzzy Logic Algorithm to Integrate...
Automation of Air Traffic Management Using Fuzzy Logic Algorithm to Integrate...
 

Human-Machine Interfaces for Increased UAS Pilot Situational Awareness

  • 1. Human-Machine Interfaces for Increased UAS Pilot Situational Awareness Prepared for UAS 2010 June 14-18 Ricardo Lopez Graduate Student Researcher
  • 2.
  • 5. Classes of Unmanned Aircraft Systems
  • 8. Autonomy Levels for Unmanned Systems (ALFUS) Framework
  • 10. Decomposition of Human Independent Domain
  • 15. Navigation Situation Awareness User Interface Baseline
  • 20.
  • 21. Situation Awareness From Toward a theory of situation awareness in dynamic systems., Endsley, M.R., 1995, Aldershot, England: Human Factors, copyright © 1995 by Human Factors and Ergonomics Society.
  • 22.
  • 23. What varies is their level of fidelity to achieve the system’s situation awareness needs based on the mission and the environment they are operating in.High Altitude Long Endurance Medium Altitude Long Endurance Mini/Micro 7
  • 24.
  • 25.
  • 26.
  • 27.
  • 28. By decomposing the Human Independence domain into: Communication, Navigation, and Surveillance, it becomes easier to isolate a baseline list of interfacesThe study will begin by testing the Navigation interfaces
  • 29.
  • 30. External = Direct Line of Sightwww.airforcetimes.com www.discoverymagazine.com
  • 31. Levels of Autonomy: Low/Manual Control Low or Manual Control Air vehicle will respond to all operator commands. Continuous and direct operator engagement of flight through the use of a primary flight control input device.
  • 32. Levels of Autonomy: Medium/Semi- Autonomous Medium/Semi-Autonomous Operator pre-loads flight plan (waypoints) and/or provides ad-hoc flight plan changes while in flight. Operator monitors and makes corrections based on navigation issues issues System will execute flight plan (as provided by the operator) and will annunciate any navigation (flight parameter) issues for correction by the operator
  • 33. Levels of Autonomy: High/Fully Autonomous High/Fully Autonomous Operator pre-loads flight plan (waypoints) and/or provides ad-hoc flight plan changes while in flight. Operator monitors air vehicle navigation status and changes System will execute flight plan (as provided by the operator) and address any navigation (flight parameter) issues autonomously
  • 34.
  • 35. Interface Environments Semi-Autonomous A combination of indicators and annunciators. The indicators would be for critical flight parameters (attitude, heading, airspeed) displayed at all times, while the annunciators will be for conditional status of non- critical flight parameters.
  • 36.
  • 37. Interface Environments Fully-Autonomous (Notional) Navigation indicators are prioritized annunciators for conditional status (color annunciators following aviation practices for caution, warning, fault, etc).
  • 38. Results Situation Awareness Rating Technique (SART) Values under the HMI environments are very close due to the isolation of Navigation SA without regard to communication and surveillance.
  • 39.
  • 40. Comparing the manual and semi-autonomous environments, the participants found that the primary flight display (heads up like display) contained the necessary information to gain SA; and hence the annunciators, which were meant to light up when a threshold was exceeded, were used very little or not at all.
  • 41.
  • 42.

Editor's Notes

  1. Research backgroundDefinitionsInterface EnvironmentsAdded benefit of using LOA for UAS introduction into NAS
  2. - Definition is from Dr. Endsley, I’m simplifying it in this pictorial representation of SA for UAS.
  3. 3 Levels of SA
  4. -It is important that we’re all talking in the same terms: Conversation with a professor from a prominent university who told me it was a mater of semantics; to which I disagreed.-We can think of it in terms of ADAPTABILITY (to changing environment and to changing mission)
  5. -Level of fidelity refers to the HMI based on the LOA.-This is not to say that the performance and physical parameters of the vehicle don’t play a part in the environment and the mission the systems performs in, only that it is not a driver for the HMI’s
  6. -The interfaces must be applicable to all phases of flight
  7. -How do we define a system to determine what interfaces the operator needs?-A three axis model to categorize unmanned systems
  8. -There are other models to determine a system’s autonomy. Dr. Sheridan’s being one of the most cited.-The problem with these efforts is that they are still not able to come to a consensus for quantifying the different levels.-You quantify by coming up with metrics to measure each capability with a scale to determine the weight of each.
  9. Useful vs necessary
  10. -There are different issues concerning situation awareness for external and internal pilots- Simple example: Imagine driving a remote control car, if it is moving away from you a controller input to the right would move that the vehicle moves to the right, but if the vehicle is moving towards you, a controller input to the right would cause the vehicle to move the the left in respect to the controller.-This study addresses internal pilots only
  11. -Manual: No different than a manned system only that the operator sits outside the vehicle-Semi-Autonomous: think Flight management system for waypoints. The system annunciates any indicators that require operator engagement-Fully Autonomous: Flight Plan with waypoints which are points of interest, the operator monitors the system. The vehicle performs the mission and adapts to any changes without operator input.
  12. -Forward Detection Device does not necessarily need to be a forward looking camera-Navigation indicator: Based studies by Dr. Drury from the Mitre Corporation which looked at situation awareness of UAV operators with and without moving maps
  13. -Pilot vs Operator-Manual: HMI are the same as in manned aircraft, with basic T configuration.-Semi-Autonomous: Critical vs non-critical flight parameters-Fully Autonomous: notional annunciator HMI environment
  14. CPDLC-Controller Pilot Data Link Communication