4. Typical Human – Computer Interaction (HCI)
High accuracy
High performance
+
- Illness-causes
Repetitive
College of Technology, VNU, Ha Noi
4
5. Gestures-Based HCI
Digitalize
Computer
Gestures
Commands
College of Technology, VNU, Ha Noi
5
6. Horse Archery
+
-
College of Technology, VNU, Ha Noi
6
7. Horse Archery
Hand gestures
-> Bow Controlling
Body vibration
-> Horse speed
College of Technology, VNU, Ha Noi
7
8. Horse Archery
• A 3D FPS Game. The character is an horsed-archer
• Using Gestures Based HCI:
• Hand gestures control the archer’s actions
• Body vibration defines horse speed
• A real sporty game: player takes real exercise while
playing game
College of Technology, VNU, Ha Noi
8
10. System Overview
LCD/Projector Screen
Camera 02
Vibration
Sensor
Game
Camera 01
Player
College of Technology, VNU, Ha Noi
10
11. Horse Archery System Techniques
Using Gestures Based HCI:
1. Hand gestures control the archer’s actions:
drawing bow, aiming, shooting,…
2. Body vibration defines horse speed
College of Technology, VNU, Ha Noi
11
12. 1. Hand Gestures Tracker
Using Infrared (IR) Signal
IR LEDs
IR Camera Computer System
Camera captures LEDs’ signal
College of Technology, VNU, Ha Noi
12
13. Infrared LEDs are attached to Gloves
Attached LEDs’ positions change
according to the movement of the
player’s hands.
By tracking the LEDs’ signal, computer
recognize these movements and create
appropriate commands
College of Technology, VNU, Ha Noi
13
14. Infrared Camera in use
Nintendo Wiimote
Advantages:
IR CAM
Good performance
High resolution
Built-in Bluetooth connection
College of Technology, VNU, Ha Noi
14
15. 2. Body Vibration Tracker
Computer System
Vibration Game
Sensor Attached to the Player
Player
College of Technology, VNU, Ha Noi
15
17. Implementation
• Programming Language: C#
• Framework: Microsoft XNA 3.0
• IDE: Microsoft Express C# 2008
• Library:
• WiimoteLib
Brian Peek - http://www.brianpeek.com/blog/pages/wiimotelib.aspx
• HeightmapCollisionPipeline
Microsoft XNA Community Game Platform - http://creators.xna.com
• 3D Billboard Particles
Nemo Krad
http://xna-uk.net/blogs/randomchaos/archive/2008/04/01/
3d-billboard-particles-tutorial-vi.aspx
College of Technology, VNU, Ha Noi
17
18. Screenshots
College of Technology, VNU, Ha Noi
18
19. Screenshots
College of Technology, VNU, Ha Noi
19
21. Discussion
• Advantages:
• A new way to play computer games
• Interesting and funny to play
• An attractive way to take exercise and reduce
stress
• Disadvantages:
• Limitations in current hardware implementation
College of Technology, VNU, Ha Noi
21
22. Future Developments
• Develop Multi-players game mode
• Extend the system to play other sporty games
• Improve the accuracy of current Horse Archery
implementation
College of Technology, VNU, Ha Noi
22