Research Group Seminar » Lightweight Hand Tracking for Real-Time 3D Gesture Control

  • 2,390 views
Uploaded on

This presentation is oriented towards stakeholders who don't have a computer vision respectively a computer graphics background. I try to explain the motivation for 3D gesture recognition, the …

This presentation is oriented towards stakeholders who don't have a computer vision respectively a computer graphics background. I try to explain the motivation for 3D gesture recognition, the problems, a solution, and its drawbacks.

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
2,390
On Slideshare
0
From Embeds
0
Number of Embeds
4

Actions

Shares
Downloads
0
Comments
0
Likes
2

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Lightweight Hand Tracking for Real-Time 3D Gesture Control
    Georg Hackenberg <hackenbe@in.tum.de >
  • 2. Introduction
    YouTube Video and Research Domain
  • 3. YouTube Video
    http://www.youtube.com/watch?v=Tw1mXjMshJE
  • 4. Research Domain
    Computer Vision
    Human-Computer Inter.
    Data structures
    Algorithms
    Interaction models
    Gestures
  • 5. Motivation
    iPhone, Virtual Reality, and Hollywood
  • 6. The iPhone Revolution
    Before June 2007
    Mouse
    Keyboard
    After June 2007
    Smartphones
    Tablet computers
  • 7. The VR Analogy
    Today
    Game controllers
    Joystricks
    Tomorrow
  • 8. Hollywood Visions
    Minority Report (2002)
    Iron Man (2008)
  • 9. Problem
    Publications, Issues, Goals, and Hardware
  • 10. Hand detection(color, depth, motion, other)
    Pose estimation(partial, full)
    Hand tracking
    Appearance based(blob, shape, filters, features)
    Model based(multi-cue, stereo, volume, filters)
    Gesture recognition(shape, motion, hmm, svm, ...)
    Related Work
  • 11. Open Issues
    Free operation
    Background
    Lighting
    Resource efficiency
    Lightweight
    Mobile
    Three-d operation
    Resolution
    Exploitation
    Interaction design
    Model
    Usability
  • 12. Project Goals
    Vision Algorithm
    Unconstrained
    Lightweight
    User Study
    Three-d interaction
    Usability evaluation
  • 13. Hardware Platform
    Dell Workstation
    MesaImaging Camera
  • 14. Solution
    Algorithm Structure, Data Flow, and Interaction Model
  • 15. Algorithm Structure
  • 16. Data Preparation
  • 17. Feature Classification
  • 18. Object Tracking
  • 19. Interaction Model
  • 20. Evaluation
    Concept, Quantitative Result, and Qualitative Results
  • 21. Evaluation Concept
    Quantitative
    Algorithm performance
    Runtime measurements
    Qualitative
    Interface performance
    Tasks & questionnaire
  • 22. Quantitative Results
  • 23. User Ratings
    Introduction
    Picture Assembly
    Scene Assembly
  • 24. Free Comments
    Positive themes
    Negative themes
  • 25. Conclusion
    System Review and Project Results
  • 26. System Review
  • 27. Project Results
    Positive
    Leightweight algorithm
    Positive feedback
    Industry response
    Research foundation
    Negative
    Quantitative evaluation
    Tracking robustness
    Gesture formulation
  • 28. The End.
    Thank you for listening.
    Questions?