SlideShare a Scribd company logo
Automated Verification of an Onboard Mission
Planning and Execution System for UAVs
Christoph Torens, Florian Adolf
German Aerospace Center (DLR)
Institute of Flight Systems, Dept. Unmanned Aircraft
AIAA Infotech@Aerospace 2013
Aerospace V&V Methods
Boston, MA
ARTIS UAV Family
Autonomous Research Testbed for Intelligent Systems
miniARTIS (1.5kg) midiARTIS (14kg) maxiARTIS (25kg)
superARTIS (150kg)
www.DLR.de • Chart 2 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013
Prometheus (25kg)
Mission Planning and Execution (MiPlEx):
Example Mission Task
www.DLR.de • Chart 3 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013
MiPlEx: Verification & Validation Motivation
Planning and execution of complex behavior
UAV onboard autonomy increases software complexity
Higher system complexity makes verification more difficult
Safety critical domain
High testing costs / efforts
Compliance with standards
www.DLR.de • Chart 4 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013
Research
Research
Early
Error
Detection
Faster
Development
Cycles
Test Methodologies
Formal
Techniques
Static Tests
Unit Tests
Software-
in-the-
Loop
Hardware-
in-the-Loop
Flight Test
www.DLR.de • Chart 5 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013
CppCheck
Static
Asserts
Test Dimensions
www.DLR.de • Chart 6 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013
0
2
4
6
Test Effort
System Under Test
Scenario
Complexity
Coverage
Feedback Time
Automation
0
2
4
6
Test Effort
System Under Test
Scenario Complexity
Coverage
Feedback Time
Automation
0
2
4
6
Test Effort
System Under Test
Scenario
Complexity
Coverage
Feedback Time
Automation
Formal Techniques
• Studies have been done in research and industry
• Model-based tests evaluated for
ARTIS Mission Manager
• Model adaptation from existing
UML state charts
www.DLR.de • Chart 7 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013
Higher system complexity
Safety critical domain
High testing costs / efforts
0
2
4
6
Test Effort
System Under Test
Scenario
Complexity
Coverage
Feedback Time
Automation
Static Tests
• Static asserts
• BOOST concept checks
• CCCC, Cppcheck, CppLint
• Doxygen
www.DLR.de • Chart 8 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013
CppCheck
Static
Asserts
Safety critical domain
High testing costs / efforts
0
2
4
6
Test Effort
System Under Test
Scenario
Complexity
Coverage
Feedback Time
Automation
Unit Tests
• Tests recreate overall test structure
• Bottom to Top
• Basic and subsequently
higher level functions are tested
• Test dependency structure assures
minimal runtime in case of error
www.DLR.de • Chart 9 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013
Compliance with standards
0
2
4
6
Test Effort
System Under Test
Scenario
Complexity
Coverage
Feedback Time
Automation
Software-in-the-Loop Simulation
www.DLR.de • Chart 10 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013
Higher system complexity
High testing costs / efforts
3.8 million
assertions
273 test
cases
Runtime
> 6
hours
Software-in-the-Loop Simulation:
Online Exploration
www.DLR.de • Chart 11 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013
Sensor: Rotating LIDAR
Software-in-the-Loop Simulation
Automatic Benchmarking
Problem Specific
Benchmarks
Trajectory
length
Planning
time
Trajectory
time
Distance to
obstacles
Vehicle Specific
Benchmarks
Velocity
limits
Acceleration
limits
Turn rate
limits
www.DLR.de • Chart 12 > SCiA 2013 > Christoph Torens • Software Verification Considerations for the ARTIS Unmanned Rotorcraft > 1 / 8 / 2013
Mettler B., 2010
Automate Expert Evaluation
Score
0
2
4
6
Test Effort
System Under Test
Scenario
Complexity
Coverage
Feedback Time
Automation
Hardware-in-the-Loop Simulation
www.DLR.de • Chart 13 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013
High testing costs / efforts
0
2
4
6
Test Effort
System Under Test
Scenario
Complexity
Coverage
Feedback Time
Automation
Flight Tests
www.DLR.de • Chart 14 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013
Compliance with standards
0
2
4
6
Test Effort
System Under Test
Scenario
Complexity
Coverage
Feedback Time
Automation
Static Tests
SIL
MBT / MC
ARTIS Test Dimension Evaluation
• Evaluation of Test Methodology and Test Strategy
• Emphasis on automation and feedback time
• Great value from SIL Tests, Static Tests, Formal Methods
www.DLR.de • Chart 15 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013
0
2
4
6
Test Effort
System Under Test
Scenario
Complexity
Coverage
Feedback Time
Automation
Unit Tests
SIL
HIL
Flight Test
Thank you for your
attention!
Please feel free to ask
questions.
christoph.torens@dlr.de

More Related Content

What's hot

Network of Electronic Self-Navigating Transports Presentation (NEST)
Network of Electronic Self-Navigating Transports Presentation (NEST)Network of Electronic Self-Navigating Transports Presentation (NEST)
Network of Electronic Self-Navigating Transports Presentation (NEST)
David Wu
 
Autonomous Aircraft and Adequate V&V Considerations
Autonomous Aircraft and Adequate V&V ConsiderationsAutonomous Aircraft and Adequate V&V Considerations
Autonomous Aircraft and Adequate V&V Considerations
Florian-Michael Adolf
 
Unmanned Low-altitude Air Cargo, Towards Demonstration With A Specific Opera...
Unmanned Low-altitude Air Cargo,  Towards Demonstration With A Specific Opera...Unmanned Low-altitude Air Cargo,  Towards Demonstration With A Specific Opera...
Unmanned Low-altitude Air Cargo, Towards Demonstration With A Specific Opera...
Florian-Michael Adolf
 
Announcement of Results of xDR Challenge 2018
Announcement of Results of xDR Challenge 2018 Announcement of Results of xDR Challenge 2018
Announcement of Results of xDR Challenge 2018
Ryosuke Ichikari
 
Announcement of Results of xDR Challenge 2018
Announcement of Results of xDR Challenge 2018 Announcement of Results of xDR Challenge 2018
Announcement of Results of xDR Challenge 2018
Ryosuke Ichikari
 
2018 GIS in Business: Trials and Tribulations of Switching to esri's Mobile Apps
2018 GIS in Business: Trials and Tribulations of Switching to esri's Mobile Apps2018 GIS in Business: Trials and Tribulations of Switching to esri's Mobile Apps
2018 GIS in Business: Trials and Tribulations of Switching to esri's Mobile Apps
GIS in the Rockies
 
EMA TECHNOLOGY
EMA TECHNOLOGYEMA TECHNOLOGY
EMA TECHNOLOGY
Stanislav Nedoseka
 
Announcement of Results of xDR Challenge 2018
Announcement of Results of xDR Challenge 2018Announcement of Results of xDR Challenge 2018
Announcement of Results of xDR Challenge 2018
Ryosuke Ichikari
 
IRJET- Study of Real Time Kinematica Survey with Differential Global Position...
IRJET- Study of Real Time Kinematica Survey with Differential Global Position...IRJET- Study of Real Time Kinematica Survey with Differential Global Position...
IRJET- Study of Real Time Kinematica Survey with Differential Global Position...
IRJET Journal
 
UAVs: Understanding Unmanned Aerial Systems (UAS) and Potential Applications
UAVs: Understanding Unmanned Aerial Systems (UAS) and Potential ApplicationsUAVs: Understanding Unmanned Aerial Systems (UAS) and Potential Applications
UAVs: Understanding Unmanned Aerial Systems (UAS) and Potential Applications
American Society of Civil Engineers, Orange County Branch
 
Construction Tech Trends: Drones and UAV's
Construction Tech Trends: Drones and UAV'sConstruction Tech Trends: Drones and UAV's
Construction Tech Trends: Drones and UAV's
Bridgit
 
2014 PV Reliability, Operations & Maintenance Workshop: HelioSpec by DreamQii...
2014 PV Reliability, Operations & Maintenance Workshop: HelioSpec by DreamQii...2014 PV Reliability, Operations & Maintenance Workshop: HelioSpec by DreamQii...
2014 PV Reliability, Operations & Maintenance Workshop: HelioSpec by DreamQii...
Sandia National Laboratories: Energy & Climate: Renewables
 
Fleet management system mine excellence
Fleet management system  mine excellenceFleet management system  mine excellence
Fleet management system mine excellence
Mason Taylor
 
TULIPP H2020 Project presentation @ FPGA Network: Implementing Machine Vision...
TULIPP H2020 Project presentation @ FPGA Network: Implementing Machine Vision...TULIPP H2020 Project presentation @ FPGA Network: Implementing Machine Vision...
TULIPP H2020 Project presentation @ FPGA Network: Implementing Machine Vision...
Tulipp. Eu
 
IRJET- Traffic Survey and Signal Design at Kalwa-Court Naka Cross Road
IRJET- Traffic Survey and Signal Design at Kalwa-Court Naka Cross RoadIRJET- Traffic Survey and Signal Design at Kalwa-Court Naka Cross Road
IRJET- Traffic Survey and Signal Design at Kalwa-Court Naka Cross Road
IRJET Journal
 
Overview of Qiskit Ignis - Struggle with errors -
Overview of Qiskit Ignis   - Struggle with errors - Overview of Qiskit Ignis   - Struggle with errors -
Overview of Qiskit Ignis - Struggle with errors -
Shin Nishio
 
1st MoveIt! Community Meeting
1st MoveIt! Community Meeting1st MoveIt! Community Meeting
1st MoveIt! Community Meeting
moveitrobot
 
CWC-AE Cassidian Barracuda User Story
CWC-AE Cassidian Barracuda User StoryCWC-AE Cassidian Barracuda User Story
CWC-AE Cassidian Barracuda User Story
Curtiss-Wright Defense Solutions
 
Ahmed_Salah-El-Din_ instrument service engineer
Ahmed_Salah-El-Din_ instrument service engineerAhmed_Salah-El-Din_ instrument service engineer
Ahmed_Salah-El-Din_ instrument service engineerahmed salah
 
Observations to Information
Observations to InformationObservations to Information
Observations to Information
Simon Cox
 

What's hot (20)

Network of Electronic Self-Navigating Transports Presentation (NEST)
Network of Electronic Self-Navigating Transports Presentation (NEST)Network of Electronic Self-Navigating Transports Presentation (NEST)
Network of Electronic Self-Navigating Transports Presentation (NEST)
 
Autonomous Aircraft and Adequate V&V Considerations
Autonomous Aircraft and Adequate V&V ConsiderationsAutonomous Aircraft and Adequate V&V Considerations
Autonomous Aircraft and Adequate V&V Considerations
 
Unmanned Low-altitude Air Cargo, Towards Demonstration With A Specific Opera...
Unmanned Low-altitude Air Cargo,  Towards Demonstration With A Specific Opera...Unmanned Low-altitude Air Cargo,  Towards Demonstration With A Specific Opera...
Unmanned Low-altitude Air Cargo, Towards Demonstration With A Specific Opera...
 
Announcement of Results of xDR Challenge 2018
Announcement of Results of xDR Challenge 2018 Announcement of Results of xDR Challenge 2018
Announcement of Results of xDR Challenge 2018
 
Announcement of Results of xDR Challenge 2018
Announcement of Results of xDR Challenge 2018 Announcement of Results of xDR Challenge 2018
Announcement of Results of xDR Challenge 2018
 
2018 GIS in Business: Trials and Tribulations of Switching to esri's Mobile Apps
2018 GIS in Business: Trials and Tribulations of Switching to esri's Mobile Apps2018 GIS in Business: Trials and Tribulations of Switching to esri's Mobile Apps
2018 GIS in Business: Trials and Tribulations of Switching to esri's Mobile Apps
 
EMA TECHNOLOGY
EMA TECHNOLOGYEMA TECHNOLOGY
EMA TECHNOLOGY
 
Announcement of Results of xDR Challenge 2018
Announcement of Results of xDR Challenge 2018Announcement of Results of xDR Challenge 2018
Announcement of Results of xDR Challenge 2018
 
IRJET- Study of Real Time Kinematica Survey with Differential Global Position...
IRJET- Study of Real Time Kinematica Survey with Differential Global Position...IRJET- Study of Real Time Kinematica Survey with Differential Global Position...
IRJET- Study of Real Time Kinematica Survey with Differential Global Position...
 
UAVs: Understanding Unmanned Aerial Systems (UAS) and Potential Applications
UAVs: Understanding Unmanned Aerial Systems (UAS) and Potential ApplicationsUAVs: Understanding Unmanned Aerial Systems (UAS) and Potential Applications
UAVs: Understanding Unmanned Aerial Systems (UAS) and Potential Applications
 
Construction Tech Trends: Drones and UAV's
Construction Tech Trends: Drones and UAV'sConstruction Tech Trends: Drones and UAV's
Construction Tech Trends: Drones and UAV's
 
2014 PV Reliability, Operations & Maintenance Workshop: HelioSpec by DreamQii...
2014 PV Reliability, Operations & Maintenance Workshop: HelioSpec by DreamQii...2014 PV Reliability, Operations & Maintenance Workshop: HelioSpec by DreamQii...
2014 PV Reliability, Operations & Maintenance Workshop: HelioSpec by DreamQii...
 
Fleet management system mine excellence
Fleet management system  mine excellenceFleet management system  mine excellence
Fleet management system mine excellence
 
TULIPP H2020 Project presentation @ FPGA Network: Implementing Machine Vision...
TULIPP H2020 Project presentation @ FPGA Network: Implementing Machine Vision...TULIPP H2020 Project presentation @ FPGA Network: Implementing Machine Vision...
TULIPP H2020 Project presentation @ FPGA Network: Implementing Machine Vision...
 
IRJET- Traffic Survey and Signal Design at Kalwa-Court Naka Cross Road
IRJET- Traffic Survey and Signal Design at Kalwa-Court Naka Cross RoadIRJET- Traffic Survey and Signal Design at Kalwa-Court Naka Cross Road
IRJET- Traffic Survey and Signal Design at Kalwa-Court Naka Cross Road
 
Overview of Qiskit Ignis - Struggle with errors -
Overview of Qiskit Ignis   - Struggle with errors - Overview of Qiskit Ignis   - Struggle with errors -
Overview of Qiskit Ignis - Struggle with errors -
 
1st MoveIt! Community Meeting
1st MoveIt! Community Meeting1st MoveIt! Community Meeting
1st MoveIt! Community Meeting
 
CWC-AE Cassidian Barracuda User Story
CWC-AE Cassidian Barracuda User StoryCWC-AE Cassidian Barracuda User Story
CWC-AE Cassidian Barracuda User Story
 
Ahmed_Salah-El-Din_ instrument service engineer
Ahmed_Salah-El-Din_ instrument service engineerAhmed_Salah-El-Din_ instrument service engineer
Ahmed_Salah-El-Din_ instrument service engineer
 
Observations to Information
Observations to InformationObservations to Information
Observations to Information
 

Similar to Automated Verification of an Onboard Mission Planning and Execution System for UAVs

Commercial Drone Best Practices: How to Incorporate Data and Job Specs
Commercial Drone Best Practices: How to Incorporate Data and Job SpecsCommercial Drone Best Practices: How to Incorporate Data and Job Specs
Commercial Drone Best Practices: How to Incorporate Data and Job Specs
Colin Snow
 
Automated_Drones_-_Giant_Step_in_Mining_Value_Chain
Automated_Drones_-_Giant_Step_in_Mining_Value_ChainAutomated_Drones_-_Giant_Step_in_Mining_Value_Chain
Automated_Drones_-_Giant_Step_in_Mining_Value_ChainSean Jefferys
 
The Incredible Potential of Unmanned Aerial Systems Technology...and Why You ...
The Incredible Potential of Unmanned Aerial Systems Technology...and Why You ...The Incredible Potential of Unmanned Aerial Systems Technology...and Why You ...
The Incredible Potential of Unmanned Aerial Systems Technology...and Why You ...Northeast Arc Users Group Presentations
 
Driving Efficiency with Splunk Cloud at Gatwick Airport
Driving Efficiency with Splunk Cloud at Gatwick AirportDriving Efficiency with Splunk Cloud at Gatwick Airport
Driving Efficiency with Splunk Cloud at Gatwick Airport
Splunk
 
Best Practices to Secure Containerized Apps with Next-Gen WAF
Best Practices to Secure Containerized Apps with Next-Gen WAFBest Practices to Secure Containerized Apps with Next-Gen WAF
Best Practices to Secure Containerized Apps with Next-Gen WAF
DevOps.com
 
DLR @ Scilab Conference 2018
DLR @ Scilab Conference 2018DLR @ Scilab Conference 2018
DLR @ Scilab Conference 2018
Scilab
 
Monitoring klassisch oder Cloud
Monitoring klassisch oder CloudMonitoring klassisch oder Cloud
Monitoring klassisch oder Cloud
ConSol Consulting & Solutions Software GmbH
 
How Bluemix Helps NASA Innovate
How Bluemix Helps NASA InnovateHow Bluemix Helps NASA Innovate
How Bluemix Helps NASA Innovate
IBM
 
“Development of computer_based
“Development of computer_based“Development of computer_based
“Development of computer_basedinsan09
 
Automated LiDAR Data Quality Control
Automated LiDAR Data Quality ControlAutomated LiDAR Data Quality Control
Automated LiDAR Data Quality Control
MattBethel1
 
Wearable Photogrammetry - What to Wear for Work #COMIT2017
Wearable Photogrammetry - What to Wear for Work #COMIT2017Wearable Photogrammetry - What to Wear for Work #COMIT2017
Wearable Photogrammetry - What to Wear for Work #COMIT2017
Comit Projects Ltd
 
Application of Drones for Mining Ooperations
Application of Drones for Mining OoperationsApplication of Drones for Mining Ooperations
Application of Drones for Mining Ooperations
Dr. Alex Vyazmensky
 
Cloud-Based Process Management of Inspection Instruments
Cloud-Based Process Management of Inspection InstrumentsCloud-Based Process Management of Inspection Instruments
Cloud-Based Process Management of Inspection Instruments
Olympus IMS
 
Formal Methods for Dependable Neural Networks
Formal Methods for Dependable Neural Networks Formal Methods for Dependable Neural Networks
Formal Methods for Dependable Neural Networks
Chih-Hong Cheng
 
Controlling interests editors
Controlling interests editorsControlling interests editors
Controlling interests editors
eldhoev
 
Capturing the unseen from above: uavs as platforms for imaging techniques
Capturing the unseen from above: uavs as platforms for imaging techniquesCapturing the unseen from above: uavs as platforms for imaging techniques
Capturing the unseen from above: uavs as platforms for imaging techniques
Visual Resources Association
 
Testing Applications—For the Cloud and in the Cloud
Testing Applications—For the Cloud and in the CloudTesting Applications—For the Cloud and in the Cloud
Testing Applications—For the Cloud and in the Cloud
TechWell
 
Simplified vehicle ops
Simplified vehicle opsSimplified vehicle ops
Simplified vehicle ops
JanakaBiyanwala
 
AURA: Aerial Unpaved Roads Assessment System Demonstration - October 20, 2015
AURA: Aerial Unpaved Roads Assessment System Demonstration - October 20, 2015AURA: Aerial Unpaved Roads Assessment System Demonstration - October 20, 2015
AURA: Aerial Unpaved Roads Assessment System Demonstration - October 20, 2015
Michigan Tech Research Institute - AURA System
 
TechTalk_Cloud Performance Testing_0.6
TechTalk_Cloud Performance Testing_0.6TechTalk_Cloud Performance Testing_0.6
TechTalk_Cloud Performance Testing_0.6Sravanthi N
 

Similar to Automated Verification of an Onboard Mission Planning and Execution System for UAVs (20)

Commercial Drone Best Practices: How to Incorporate Data and Job Specs
Commercial Drone Best Practices: How to Incorporate Data and Job SpecsCommercial Drone Best Practices: How to Incorporate Data and Job Specs
Commercial Drone Best Practices: How to Incorporate Data and Job Specs
 
Automated_Drones_-_Giant_Step_in_Mining_Value_Chain
Automated_Drones_-_Giant_Step_in_Mining_Value_ChainAutomated_Drones_-_Giant_Step_in_Mining_Value_Chain
Automated_Drones_-_Giant_Step_in_Mining_Value_Chain
 
The Incredible Potential of Unmanned Aerial Systems Technology...and Why You ...
The Incredible Potential of Unmanned Aerial Systems Technology...and Why You ...The Incredible Potential of Unmanned Aerial Systems Technology...and Why You ...
The Incredible Potential of Unmanned Aerial Systems Technology...and Why You ...
 
Driving Efficiency with Splunk Cloud at Gatwick Airport
Driving Efficiency with Splunk Cloud at Gatwick AirportDriving Efficiency with Splunk Cloud at Gatwick Airport
Driving Efficiency with Splunk Cloud at Gatwick Airport
 
Best Practices to Secure Containerized Apps with Next-Gen WAF
Best Practices to Secure Containerized Apps with Next-Gen WAFBest Practices to Secure Containerized Apps with Next-Gen WAF
Best Practices to Secure Containerized Apps with Next-Gen WAF
 
DLR @ Scilab Conference 2018
DLR @ Scilab Conference 2018DLR @ Scilab Conference 2018
DLR @ Scilab Conference 2018
 
Monitoring klassisch oder Cloud
Monitoring klassisch oder CloudMonitoring klassisch oder Cloud
Monitoring klassisch oder Cloud
 
How Bluemix Helps NASA Innovate
How Bluemix Helps NASA InnovateHow Bluemix Helps NASA Innovate
How Bluemix Helps NASA Innovate
 
“Development of computer_based
“Development of computer_based“Development of computer_based
“Development of computer_based
 
Automated LiDAR Data Quality Control
Automated LiDAR Data Quality ControlAutomated LiDAR Data Quality Control
Automated LiDAR Data Quality Control
 
Wearable Photogrammetry - What to Wear for Work #COMIT2017
Wearable Photogrammetry - What to Wear for Work #COMIT2017Wearable Photogrammetry - What to Wear for Work #COMIT2017
Wearable Photogrammetry - What to Wear for Work #COMIT2017
 
Application of Drones for Mining Ooperations
Application of Drones for Mining OoperationsApplication of Drones for Mining Ooperations
Application of Drones for Mining Ooperations
 
Cloud-Based Process Management of Inspection Instruments
Cloud-Based Process Management of Inspection InstrumentsCloud-Based Process Management of Inspection Instruments
Cloud-Based Process Management of Inspection Instruments
 
Formal Methods for Dependable Neural Networks
Formal Methods for Dependable Neural Networks Formal Methods for Dependable Neural Networks
Formal Methods for Dependable Neural Networks
 
Controlling interests editors
Controlling interests editorsControlling interests editors
Controlling interests editors
 
Capturing the unseen from above: uavs as platforms for imaging techniques
Capturing the unseen from above: uavs as platforms for imaging techniquesCapturing the unseen from above: uavs as platforms for imaging techniques
Capturing the unseen from above: uavs as platforms for imaging techniques
 
Testing Applications—For the Cloud and in the Cloud
Testing Applications—For the Cloud and in the CloudTesting Applications—For the Cloud and in the Cloud
Testing Applications—For the Cloud and in the Cloud
 
Simplified vehicle ops
Simplified vehicle opsSimplified vehicle ops
Simplified vehicle ops
 
AURA: Aerial Unpaved Roads Assessment System Demonstration - October 20, 2015
AURA: Aerial Unpaved Roads Assessment System Demonstration - October 20, 2015AURA: Aerial Unpaved Roads Assessment System Demonstration - October 20, 2015
AURA: Aerial Unpaved Roads Assessment System Demonstration - October 20, 2015
 
TechTalk_Cloud Performance Testing_0.6
TechTalk_Cloud Performance Testing_0.6TechTalk_Cloud Performance Testing_0.6
TechTalk_Cloud Performance Testing_0.6
 

More from Florian-Michael Adolf

Meshing and Simplification of High Resolution Urban Surface Data for UAV Path...
Meshing and Simplification of High Resolution Urban Surface Data for UAV Path...Meshing and Simplification of High Resolution Urban Surface Data for UAV Path...
Meshing and Simplification of High Resolution Urban Surface Data for UAV Path...
Florian-Michael Adolf
 
Vision-Based Obstacle Recognition and Autonomous Flights through Gate Structu...
Vision-Based Obstacle Recognition and Autonomous Flights through Gate Structu...Vision-Based Obstacle Recognition and Autonomous Flights through Gate Structu...
Vision-Based Obstacle Recognition and Autonomous Flights through Gate Structu...
Florian-Michael Adolf
 
Asymmetric 2-Opt Scheduling for Roadmap-Based Task Planning in Urban Terrain
Asymmetric 2-Opt Scheduling for Roadmap-Based Task Planning in Urban TerrainAsymmetric 2-Opt Scheduling for Roadmap-Based Task Planning in Urban Terrain
Asymmetric 2-Opt Scheduling for Roadmap-Based Task Planning in Urban Terrain
Florian-Michael Adolf
 
Schichtenmodell zur integrierten Auftrags- und Bewegungsplanung an Bord tief ...
Schichtenmodell zur integrierten Auftrags- und Bewegungsplanung an Bord tief ...Schichtenmodell zur integrierten Auftrags- und Bewegungsplanung an Bord tief ...
Schichtenmodell zur integrierten Auftrags- und Bewegungsplanung an Bord tief ...
Florian-Michael Adolf
 
Mission Planning and Execution for the Unmanned Rotorcraft ARTIS
Mission Planning and Execution for the Unmanned Rotorcraft ARTISMission Planning and Execution for the Unmanned Rotorcraft ARTIS
Mission Planning and Execution for the Unmanned Rotorcraft ARTIS
Florian-Michael Adolf
 
Multi-Query Path Planning for Exploration Tasks with an Unmanned Rotorcraft
Multi-Query Path Planning for Exploration Tasks with an Unmanned RotorcraftMulti-Query Path Planning for Exploration Tasks with an Unmanned Rotorcraft
Multi-Query Path Planning for Exploration Tasks with an Unmanned Rotorcraft
Florian-Michael Adolf
 
Trajectory Time Reduction using Field of View-based Smoothing of Roadmap-base...
Trajectory Time Reduction using Field of View-based Smoothing of Roadmap-base...Trajectory Time Reduction using Field of View-based Smoothing of Roadmap-base...
Trajectory Time Reduction using Field of View-based Smoothing of Roadmap-base...
Florian-Michael Adolf
 
Evaluation Of The ARTIS Sampling-based Path Planner Using an Obstacle Field N...
Evaluation Of The ARTIS Sampling-based Path Planner Using an Obstacle Field N...Evaluation Of The ARTIS Sampling-based Path Planner Using an Obstacle Field N...
Evaluation Of The ARTIS Sampling-based Path Planner Using an Obstacle Field N...
Florian-Michael Adolf
 
An Unmanned Helicopter for Autonomous Flights in Urban Terrain
An Unmanned Helicopter for Autonomous Flights in Urban TerrainAn Unmanned Helicopter for Autonomous Flights in Urban Terrain
An Unmanned Helicopter for Autonomous Flights in Urban Terrain
Florian-Michael Adolf
 
MiPlEx - Online Task Planning for Exploration Tasks in Urban Terrain
MiPlEx - Online Task Planning for Exploration Tasks in Urban TerrainMiPlEx - Online Task Planning for Exploration Tasks in Urban Terrain
MiPlEx - Online Task Planning for Exploration Tasks in Urban Terrain
Florian-Michael Adolf
 

More from Florian-Michael Adolf (10)

Meshing and Simplification of High Resolution Urban Surface Data for UAV Path...
Meshing and Simplification of High Resolution Urban Surface Data for UAV Path...Meshing and Simplification of High Resolution Urban Surface Data for UAV Path...
Meshing and Simplification of High Resolution Urban Surface Data for UAV Path...
 
Vision-Based Obstacle Recognition and Autonomous Flights through Gate Structu...
Vision-Based Obstacle Recognition and Autonomous Flights through Gate Structu...Vision-Based Obstacle Recognition and Autonomous Flights through Gate Structu...
Vision-Based Obstacle Recognition and Autonomous Flights through Gate Structu...
 
Asymmetric 2-Opt Scheduling for Roadmap-Based Task Planning in Urban Terrain
Asymmetric 2-Opt Scheduling for Roadmap-Based Task Planning in Urban TerrainAsymmetric 2-Opt Scheduling for Roadmap-Based Task Planning in Urban Terrain
Asymmetric 2-Opt Scheduling for Roadmap-Based Task Planning in Urban Terrain
 
Schichtenmodell zur integrierten Auftrags- und Bewegungsplanung an Bord tief ...
Schichtenmodell zur integrierten Auftrags- und Bewegungsplanung an Bord tief ...Schichtenmodell zur integrierten Auftrags- und Bewegungsplanung an Bord tief ...
Schichtenmodell zur integrierten Auftrags- und Bewegungsplanung an Bord tief ...
 
Mission Planning and Execution for the Unmanned Rotorcraft ARTIS
Mission Planning and Execution for the Unmanned Rotorcraft ARTISMission Planning and Execution for the Unmanned Rotorcraft ARTIS
Mission Planning and Execution for the Unmanned Rotorcraft ARTIS
 
Multi-Query Path Planning for Exploration Tasks with an Unmanned Rotorcraft
Multi-Query Path Planning for Exploration Tasks with an Unmanned RotorcraftMulti-Query Path Planning for Exploration Tasks with an Unmanned Rotorcraft
Multi-Query Path Planning for Exploration Tasks with an Unmanned Rotorcraft
 
Trajectory Time Reduction using Field of View-based Smoothing of Roadmap-base...
Trajectory Time Reduction using Field of View-based Smoothing of Roadmap-base...Trajectory Time Reduction using Field of View-based Smoothing of Roadmap-base...
Trajectory Time Reduction using Field of View-based Smoothing of Roadmap-base...
 
Evaluation Of The ARTIS Sampling-based Path Planner Using an Obstacle Field N...
Evaluation Of The ARTIS Sampling-based Path Planner Using an Obstacle Field N...Evaluation Of The ARTIS Sampling-based Path Planner Using an Obstacle Field N...
Evaluation Of The ARTIS Sampling-based Path Planner Using an Obstacle Field N...
 
An Unmanned Helicopter for Autonomous Flights in Urban Terrain
An Unmanned Helicopter for Autonomous Flights in Urban TerrainAn Unmanned Helicopter for Autonomous Flights in Urban Terrain
An Unmanned Helicopter for Autonomous Flights in Urban Terrain
 
MiPlEx - Online Task Planning for Exploration Tasks in Urban Terrain
MiPlEx - Online Task Planning for Exploration Tasks in Urban TerrainMiPlEx - Online Task Planning for Exploration Tasks in Urban Terrain
MiPlEx - Online Task Planning for Exploration Tasks in Urban Terrain
 

Recently uploaded

CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
R&R Consult
 
block diagram and signal flow graph representation
block diagram and signal flow graph representationblock diagram and signal flow graph representation
block diagram and signal flow graph representation
Divya Somashekar
 
Cosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdfCosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdf
Kamal Acharya
 
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
thanhdowork
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Dr.Costas Sachpazis
 
ASME IX(9) 2007 Full Version .pdf
ASME IX(9)  2007 Full Version       .pdfASME IX(9)  2007 Full Version       .pdf
ASME IX(9) 2007 Full Version .pdf
AhmedHussein950959
 
Planning Of Procurement o different goods and services
Planning Of Procurement o different goods and servicesPlanning Of Procurement o different goods and services
Planning Of Procurement o different goods and services
JoytuBarua2
 
ethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.pptethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.ppt
Jayaprasanna4
 
MCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdfMCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdf
Osamah Alsalih
 
Student information management system project report ii.pdf
Student information management system project report ii.pdfStudent information management system project report ii.pdf
Student information management system project report ii.pdf
Kamal Acharya
 
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdfHybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
fxintegritypublishin
 
The role of big data in decision making.
The role of big data in decision making.The role of big data in decision making.
The role of big data in decision making.
ankuprajapati0525
 
Final project report on grocery store management system..pdf
Final project report on grocery store management system..pdfFinal project report on grocery store management system..pdf
Final project report on grocery store management system..pdf
Kamal Acharya
 
Fundamentals of Electric Drives and its applications.pptx
Fundamentals of Electric Drives and its applications.pptxFundamentals of Electric Drives and its applications.pptx
Fundamentals of Electric Drives and its applications.pptx
manasideore6
 
Immunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary AttacksImmunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary Attacks
gerogepatton
 
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang,  ICLR 2024, MLILAB, KAIST AI.pdfJ.Yang,  ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
MLILAB
 
power quality voltage fluctuation UNIT - I.pptx
power quality voltage fluctuation UNIT - I.pptxpower quality voltage fluctuation UNIT - I.pptx
power quality voltage fluctuation UNIT - I.pptx
ViniHema
 
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Sreedhar Chowdam
 
ML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptxML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptx
Vijay Dialani, PhD
 
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
H.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdfH.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdf
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
MLILAB
 

Recently uploaded (20)

CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
 
block diagram and signal flow graph representation
block diagram and signal flow graph representationblock diagram and signal flow graph representation
block diagram and signal flow graph representation
 
Cosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdfCosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdf
 
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
 
ASME IX(9) 2007 Full Version .pdf
ASME IX(9)  2007 Full Version       .pdfASME IX(9)  2007 Full Version       .pdf
ASME IX(9) 2007 Full Version .pdf
 
Planning Of Procurement o different goods and services
Planning Of Procurement o different goods and servicesPlanning Of Procurement o different goods and services
Planning Of Procurement o different goods and services
 
ethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.pptethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.ppt
 
MCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdfMCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdf
 
Student information management system project report ii.pdf
Student information management system project report ii.pdfStudent information management system project report ii.pdf
Student information management system project report ii.pdf
 
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdfHybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
 
The role of big data in decision making.
The role of big data in decision making.The role of big data in decision making.
The role of big data in decision making.
 
Final project report on grocery store management system..pdf
Final project report on grocery store management system..pdfFinal project report on grocery store management system..pdf
Final project report on grocery store management system..pdf
 
Fundamentals of Electric Drives and its applications.pptx
Fundamentals of Electric Drives and its applications.pptxFundamentals of Electric Drives and its applications.pptx
Fundamentals of Electric Drives and its applications.pptx
 
Immunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary AttacksImmunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary Attacks
 
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang,  ICLR 2024, MLILAB, KAIST AI.pdfJ.Yang,  ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
 
power quality voltage fluctuation UNIT - I.pptx
power quality voltage fluctuation UNIT - I.pptxpower quality voltage fluctuation UNIT - I.pptx
power quality voltage fluctuation UNIT - I.pptx
 
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
 
ML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptxML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptx
 
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
H.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdfH.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdf
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
 

Automated Verification of an Onboard Mission Planning and Execution System for UAVs

  • 1. Automated Verification of an Onboard Mission Planning and Execution System for UAVs Christoph Torens, Florian Adolf German Aerospace Center (DLR) Institute of Flight Systems, Dept. Unmanned Aircraft AIAA Infotech@Aerospace 2013 Aerospace V&V Methods Boston, MA
  • 2. ARTIS UAV Family Autonomous Research Testbed for Intelligent Systems miniARTIS (1.5kg) midiARTIS (14kg) maxiARTIS (25kg) superARTIS (150kg) www.DLR.de • Chart 2 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013 Prometheus (25kg)
  • 3. Mission Planning and Execution (MiPlEx): Example Mission Task www.DLR.de • Chart 3 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013
  • 4. MiPlEx: Verification & Validation Motivation Planning and execution of complex behavior UAV onboard autonomy increases software complexity Higher system complexity makes verification more difficult Safety critical domain High testing costs / efforts Compliance with standards www.DLR.de • Chart 4 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013 Research Research Early Error Detection Faster Development Cycles
  • 5. Test Methodologies Formal Techniques Static Tests Unit Tests Software- in-the- Loop Hardware- in-the-Loop Flight Test www.DLR.de • Chart 5 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013 CppCheck Static Asserts
  • 6. Test Dimensions www.DLR.de • Chart 6 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013 0 2 4 6 Test Effort System Under Test Scenario Complexity Coverage Feedback Time Automation 0 2 4 6 Test Effort System Under Test Scenario Complexity Coverage Feedback Time Automation
  • 7. 0 2 4 6 Test Effort System Under Test Scenario Complexity Coverage Feedback Time Automation Formal Techniques • Studies have been done in research and industry • Model-based tests evaluated for ARTIS Mission Manager • Model adaptation from existing UML state charts www.DLR.de • Chart 7 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013 Higher system complexity Safety critical domain High testing costs / efforts
  • 8. 0 2 4 6 Test Effort System Under Test Scenario Complexity Coverage Feedback Time Automation Static Tests • Static asserts • BOOST concept checks • CCCC, Cppcheck, CppLint • Doxygen www.DLR.de • Chart 8 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013 CppCheck Static Asserts Safety critical domain High testing costs / efforts
  • 9. 0 2 4 6 Test Effort System Under Test Scenario Complexity Coverage Feedback Time Automation Unit Tests • Tests recreate overall test structure • Bottom to Top • Basic and subsequently higher level functions are tested • Test dependency structure assures minimal runtime in case of error www.DLR.de • Chart 9 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013 Compliance with standards
  • 10. 0 2 4 6 Test Effort System Under Test Scenario Complexity Coverage Feedback Time Automation Software-in-the-Loop Simulation www.DLR.de • Chart 10 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013 Higher system complexity High testing costs / efforts 3.8 million assertions 273 test cases Runtime > 6 hours
  • 11. Software-in-the-Loop Simulation: Online Exploration www.DLR.de • Chart 11 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013 Sensor: Rotating LIDAR
  • 12. Software-in-the-Loop Simulation Automatic Benchmarking Problem Specific Benchmarks Trajectory length Planning time Trajectory time Distance to obstacles Vehicle Specific Benchmarks Velocity limits Acceleration limits Turn rate limits www.DLR.de • Chart 12 > SCiA 2013 > Christoph Torens • Software Verification Considerations for the ARTIS Unmanned Rotorcraft > 1 / 8 / 2013 Mettler B., 2010 Automate Expert Evaluation Score
  • 13. 0 2 4 6 Test Effort System Under Test Scenario Complexity Coverage Feedback Time Automation Hardware-in-the-Loop Simulation www.DLR.de • Chart 13 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013 High testing costs / efforts
  • 14. 0 2 4 6 Test Effort System Under Test Scenario Complexity Coverage Feedback Time Automation Flight Tests www.DLR.de • Chart 14 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013 Compliance with standards
  • 15. 0 2 4 6 Test Effort System Under Test Scenario Complexity Coverage Feedback Time Automation Static Tests SIL MBT / MC ARTIS Test Dimension Evaluation • Evaluation of Test Methodology and Test Strategy • Emphasis on automation and feedback time • Great value from SIL Tests, Static Tests, Formal Methods www.DLR.de • Chart 15 > Infotech 2013 > Christoph Torens • Automated V&V of an Onboard Mission Planning System for UAVs > 19 / 8 / 2013 0 2 4 6 Test Effort System Under Test Scenario Complexity Coverage Feedback Time Automation Unit Tests SIL HIL Flight Test
  • 16. Thank you for your attention! Please feel free to ask questions. christoph.torens@dlr.de