• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters
 

User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters

on

  • 1,234 views

 

Statistics

Views

Total Views
1,234
Views on SlideShare
1,229
Embed Views
5

Actions

Likes
0
Downloads
11
Comments
0

1 Embed 5

http://www.slideshare.net 5

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters Presentation Transcript

    • User interfaces for direct and remote HRI for a swarm of robots assisting fire-fighters Affligem, October 19, 2009 Elvina Motard Space Applications Services (Belgium) Jeremi Gancet Space Applications Services (Belgium) Amir M. Naghsh Sheffield Hallam University (UK) Chris R. Roast Sheffield Hallam University (UK)
    • Outline
        • Introduction and background– the EU FP6 Guardians project
        • Fire-fighting context, setting and operations
        • The Guardians baseline setup
        • Direct Human Swarm Interactions (HSI)
        • Remote Human Swarm Interactions
        • Conclusion and future work
    • 1. Introduction and background – the EU FP6 Guardians project
      • Guardians: EU-FP6 project, 2006-2010 (38 months)
      • => Group of unmanned assistant robots deployed in aggregative navigation supported by scent detection
      • => Swarm robotics
      • => Human-Robot Interactions / Human-Swarm Interactions
      • => Application domain: search & rescue, support to fire-fighting
      • => Main scenario: large warehouse fire
    • 2. Fire-fighting context, setting and operations => Smoke – means heavy breathing apparatus, little to no vision, guidelines => Noise – means limited audio communication, establish protocols => Heat – physical stress => Touch – limited dexterity => 20 minutes maximum, risks to lives – mental stress
    • 2. Fire-fighting context, setting and operations => Fire event: little information available a priori... => 1 st task: to assess the incident and the primary risks => Fire-fighters safety: high(est) priority! =>Organized into teams, then groups of 2 – 3 fire-fighters Incident Commander Operations Commander Sector Commander Fire-fighter Fire-fighter Fire-fighter Safety Officer ECO Zone 3 Zone 2 Zone 1 Sector 3 Sector 2 Sector 1
    • 3. The Guardians baseline setup Incident Commander Operations Commander Fire-fighter Fire-fighter Fire-fighter Safety Officer ECO Zone 3 Zone 2 Zone 1 Sector 3 Sector 2 Sector 1 R R R R Coordinator Operator(s) Sensor Data Specialist(s) Sector Commander Guardians’ Base Station
    • 4. Direct Human Swarm Interactions Incident Commander Operations Commander Fire-fighter Fire-fighter Fire-fighter Safety Officer ECO Zone 3 Zone 2 Zone 1 Sector 3 Sector 2 Sector 1 R R R Sector Commander R Coordinator Direct Human-Swarm Interactions Operator(s) Sensor Data Specialist(s) Guardians’ Base Station
    • 4. Direct Human Swarm Interactions
      • Purpose: supporting local fire-fighters operations
      => Guidance / navigation (e.g. toward exit in case of increasing risk) => Informing fire-fighters about current ambient conditions in the vicinity (e.g. heat level, chemicals) => Small distance forward scouting
    • 4. Direct Human Swarm Interactions
      • Light Array Visor: Baseline setup
    • 4. Direct Human Swarm Interactions
      • Light Array Visor (LAV): version 1
      • => Phidgets toolkit
      • => Iterative development process:
        • Implementing the prototype
        • Followed by exploration sessions with Fire-fighters
      • => Analogical visual information
      • Light Array Visor (LAV): version 2
      4. Direct Human Swarm Interactions => Real operational fire-fighting helmet => Experimenting with a group of two fire-fighters => Logical commands encoding and display => Integration of internal measurement unit (IMU) => More stress (reporting, counting light flashes and memorising the mental map)
    • 5. Remote Human Swarm Interactions Incident Commander Operations Commander Fire-fighter Fire-fighter Fire-fighter Safety Officer ECO Zone 3 Zone 2 Zone 1 Sector 3 Sector 2 Sector 1 R R R Sector Commander R Coordinator Operator(s) Sensor Data Specialist(s) Guardians’ Base Station Remote Human-Swarm Interactions
    • 5. Remote Human Swarm Interactions
      • Purpose: remotely supervising robots and fire-fighters operations
      • => Integrated data for the global supervision of the situation
      • => Provides means to control the robots of the swarm:
        • High level commands / policy level control of groups of robots in the swarm
        • Individual robot control, in case of specific need
      • => Interface with decision makers in the fire-fighters hierarchy, thus allows to take informed decision
    • 5. Remote Human Swarm Interactions
      • Base station baseline setup
    • 5. Remote Human Swarm Interactions
      • Remote interaction: main user interface
      • Main visualization zone
      • Viewport navigation
      • Commands formulation area
      • Overall map view
      • Mission log
    • 5. Remote Human Swarm Interactions Fire-fighter and robots 3D representation Robots sensors + video - joint visualization (ecological display paradigm) High level command generation wizard
    • 6. Conclusion and future work
      • Direct HSI
      • - LAV2 more expressive for fire-fighters, although more stressful
      • - Further experiments planned with a number of swarm support scenarios
      Remote HSI - Operator role usability evaluation so far => further work to focus on Sensor Data Specialist and Coordinator roles - Multi-user, joint operations to be experimented and evaluated Interfaces design for fire-fighters support - Complex but valuable approach to integrate user inputs into the design and development process - Incremental usability evaluation process (formative feedback)
    • Thanks! http://www.guardians-project.eu/