Your SlideShare is downloading. ×
0
User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters
User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters
User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters
User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters
User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters
User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters
User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters
User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters
User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters
User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters
User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters
User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters
User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters
User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters
User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters
User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters
User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters
User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters

736

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
736
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
25
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters Affligem, October 19, 2009 Elvina Motard Space Applications Services (Belgium) Jeremi Gancet Space Applications Services (Belgium) Amir M. Naghsh Sheffield Hallam University (UK) Chris R. Roast Sheffield Hallam University (UK)
  • 2. Outline
      • Introduction and background– the EU FP6 Guardians project
      • Fire-fighting context, setting and operations
      • The Guardians baseline setup
      • Direct Human Swarm Interactions (HSI)
      • Remote Human Swarm Interactions
      • Conclusion and future work
  • 3. 1. Introduction and background – the EU FP6 Guardians project
    • Guardians: EU-FP6 project, 2006-2010 (38 months)
    • => Group of unmanned assistant robots deployed in aggregative navigation supported by scent detection
    • => Swarm robotics
    • => Human-Robot Interactions / Human-Swarm Interactions
    • => Application domain: search & rescue, support to fire-fighting
    • => Main scenario: large warehouse fire
  • 4. 2. Fire-fighting context, setting and operations => Smoke – means heavy breathing apparatus, little to no vision, guidelines => Noise – means limited audio communication, establish protocols => Heat – physical stress => Touch – limited dexterity => 20 minutes maximum, risks to lives – mental stress
  • 5. 2. Fire-fighting context, setting and operations => Fire event: little information available a priori... => 1 st task: to assess the incident and the primary risks => Fire-fighters safety: high(est) priority! =>Organized into teams, then groups of 2 – 3 fire-fighters Incident Commander Operations Commander Sector Commander Fire-fighter Fire-fighter Fire-fighter Safety Officer ECO Zone 3 Zone 2 Zone 1 Sector 3 Sector 2 Sector 1
  • 6. 3. The Guardians baseline setup Incident Commander Operations Commander Fire-fighter Fire-fighter Fire-fighter Safety Officer ECO Zone 3 Zone 2 Zone 1 Sector 3 Sector 2 Sector 1 R R R R Coordinator Operator(s) Sensor Data Specialist(s) Sector Commander Guardians’ Base Station
  • 7. 4. Direct Human Swarm Interactions Incident Commander Operations Commander Fire-fighter Fire-fighter Fire-fighter Safety Officer ECO Zone 3 Zone 2 Zone 1 Sector 3 Sector 2 Sector 1 R R R Sector Commander R Coordinator Direct Human-Swarm Interactions Operator(s) Sensor Data Specialist(s) Guardians’ Base Station
  • 8. 4. Direct Human Swarm Interactions
    • Purpose: supporting local fire-fighters operations
    => Guidance / navigation (e.g. toward exit in case of increasing risk) => Informing fire-fighters about current ambient conditions in the vicinity (e.g. heat level, chemicals) => Small distance forward scouting
  • 9. 4. Direct Human Swarm Interactions
    • Light Array Visor: Baseline setup
  • 10. 4. Direct Human Swarm Interactions
    • Light Array Visor (LAV): version 1
    • => Phidgets toolkit
    • => Iterative development process:
      • Implementing the prototype
      • Followed by exploration sessions with Fire-fighters
    • => Analogical visual information
  • 11.
    • Light Array Visor (LAV): version 2
    4. Direct Human Swarm Interactions => Real operational fire-fighting helmet => Experimenting with a group of two fire-fighters => Logical commands encoding and display => Integration of internal measurement unit (IMU) => More stress (reporting, counting light flashes and memorising the mental map)
  • 12. 5. Remote Human Swarm Interactions Incident Commander Operations Commander Fire-fighter Fire-fighter Fire-fighter Safety Officer ECO Zone 3 Zone 2 Zone 1 Sector 3 Sector 2 Sector 1 R R R Sector Commander R Coordinator Operator(s) Sensor Data Specialist(s) Guardians’ Base Station Remote Human-Swarm Interactions
  • 13. 5. Remote Human Swarm Interactions
    • Purpose: remotely supervising robots and fire-fighters operations
    • => Integrated data for the global supervision of the situation
    • => Provides means to control the robots of the swarm:
      • High level commands / policy level control of groups of robots in the swarm
      • Individual robot control, in case of specific need
    • => Interface with decision makers in the fire-fighters hierarchy, thus allows to take informed decision
  • 14. 5. Remote Human Swarm Interactions
    • Base station baseline setup
  • 15. 5. Remote Human Swarm Interactions
    • Remote interaction: main user interface
    • Main visualization zone
    • Viewport navigation
    • Commands formulation area
    • Overall map view
    • Mission log
  • 16. 5. Remote Human Swarm Interactions Fire-fighter and robots 3D representation Robots sensors + video - joint visualization (ecological display paradigm) High level command generation wizard
  • 17. 6. Conclusion and future work
    • Direct HSI
    • - LAV2 more expressive for fire-fighters, although more stressful
    • - Further experiments planned with a number of swarm support scenarios
    Remote HSI - Operator role usability evaluation so far => further work to focus on Sensor Data Specialist and Coordinator roles - Multi-user, joint operations to be experimented and evaluated Interfaces design for fire-fighters support - Complex but valuable approach to integrate user inputs into the design and development process - Incremental usability evaluation process (formative feedback)
  • 18. Thanks! http://www.guardians-project.eu/

×