Lightweight Hand Tracking for Real-Time 3D Gesture Control<br />Georg Hackenberg <hackenbe@in.tum.de ><br />
Introduction<br />YouTube Video and Research Domain<br />
YouTube Video<br />http://www.youtube.com/watch?v=Tw1mXjMshJE<br />
Research Domain<br />Computer Vision<br />Human-Computer Inter.<br />Data structures<br />Algorithms<br />Interaction mode...
Motivation<br />iPhone, Virtual Reality, and Hollywood<br />
The iPhone Revolution<br />Before June 2007<br />Mouse<br />Keyboard<br />After June 2007<br />Smartphones<br />Tablet com...
The VR Analogy<br />Today<br />Game controllers<br />Joystricks<br />Tomorrow<br />
Hollywood Visions<br />Minority Report (2002)<br />Iron Man (2008)<br />
Problem<br />Publications, Issues, Goals, and Hardware<br />
Hand detection(color, depth, motion, other)<br />Pose estimation(partial, full)<br />Hand tracking<br />Appearance based(b...
Open Issues<br />Free operation<br />Background<br />Lighting<br />Resource efficiency<br />Lightweight<br />Mobile<br />T...
Project Goals<br />Vision Algorithm<br />Unconstrained<br />Lightweight<br />User Study<br />Three-d interaction<br />Usab...
Hardware Platform<br />Dell Workstation<br />MesaImaging Camera<br />
Solution<br />Algorithm Structure, Data Flow, and Interaction Model<br />
Algorithm Structure<br />
Data Preparation<br />
Feature Classification<br />
Object Tracking<br />
Interaction Model<br />
Evaluation<br />Concept, Quantitative Result, and Qualitative Results<br />
Evaluation Concept<br />Quantitative<br />Algorithm performance<br />Runtime measurements<br />Qualitative<br />Interface ...
Quantitative Results<br />
User Ratings<br />Introduction<br />Picture Assembly<br />Scene Assembly<br />
Free Comments<br />Positive themes<br />Negative themes<br />
Conclusion<br />System Review and Project Results<br />
System Review<br />
Project Results<br />Positive<br />Leightweight algorithm<br />Positive feedback<br />Industry response<br />Research foun...
The End.<br />Thank you for listening.<br />Questions?<br />
Upcoming SlideShare
Loading in …5
×

Research Group Seminar » Lightweight Hand Tracking for Real-Time 3D Gesture Control

2,956 views

Published on

This presentation is oriented towards stakeholders who don't have a computer vision respectively a computer graphics background. I try to explain the motivation for 3D gesture recognition, the problems, a solution, and its drawbacks.

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,956
On SlideShare
0
From Embeds
0
Number of Embeds
1,537
Actions
Shares
0
Downloads
0
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Research Group Seminar » Lightweight Hand Tracking for Real-Time 3D Gesture Control

  1. 1. Lightweight Hand Tracking for Real-Time 3D Gesture Control<br />Georg Hackenberg <hackenbe@in.tum.de ><br />
  2. 2. Introduction<br />YouTube Video and Research Domain<br />
  3. 3. YouTube Video<br />http://www.youtube.com/watch?v=Tw1mXjMshJE<br />
  4. 4. Research Domain<br />Computer Vision<br />Human-Computer Inter.<br />Data structures<br />Algorithms<br />Interaction models<br />Gestures<br />
  5. 5. Motivation<br />iPhone, Virtual Reality, and Hollywood<br />
  6. 6. The iPhone Revolution<br />Before June 2007<br />Mouse<br />Keyboard<br />After June 2007<br />Smartphones<br />Tablet computers<br />
  7. 7. The VR Analogy<br />Today<br />Game controllers<br />Joystricks<br />Tomorrow<br />
  8. 8. Hollywood Visions<br />Minority Report (2002)<br />Iron Man (2008)<br />
  9. 9. Problem<br />Publications, Issues, Goals, and Hardware<br />
  10. 10. Hand detection(color, depth, motion, other)<br />Pose estimation(partial, full)<br />Hand tracking<br />Appearance based(blob, shape, filters, features)<br />Model based(multi-cue, stereo, volume, filters)<br />Gesture recognition(shape, motion, hmm, svm, ...)<br />Related Work<br />
  11. 11. Open Issues<br />Free operation<br />Background<br />Lighting<br />Resource efficiency<br />Lightweight<br />Mobile<br />Three-d operation<br />Resolution<br />Exploitation<br />Interaction design<br />Model<br />Usability<br />
  12. 12. Project Goals<br />Vision Algorithm<br />Unconstrained<br />Lightweight<br />User Study<br />Three-d interaction<br />Usability evaluation<br />
  13. 13. Hardware Platform<br />Dell Workstation<br />MesaImaging Camera<br />
  14. 14. Solution<br />Algorithm Structure, Data Flow, and Interaction Model<br />
  15. 15. Algorithm Structure<br />
  16. 16. Data Preparation<br />
  17. 17. Feature Classification<br />
  18. 18. Object Tracking<br />
  19. 19. Interaction Model<br />
  20. 20. Evaluation<br />Concept, Quantitative Result, and Qualitative Results<br />
  21. 21. Evaluation Concept<br />Quantitative<br />Algorithm performance<br />Runtime measurements<br />Qualitative<br />Interface performance<br />Tasks & questionnaire<br />
  22. 22. Quantitative Results<br />
  23. 23. User Ratings<br />Introduction<br />Picture Assembly<br />Scene Assembly<br />
  24. 24. Free Comments<br />Positive themes<br />Negative themes<br />
  25. 25. Conclusion<br />System Review and Project Results<br />
  26. 26. System Review<br />
  27. 27. Project Results<br />Positive<br />Leightweight algorithm<br />Positive feedback<br />Industry response<br />Research foundation<br />Negative<br />Quantitative evaluation<br />Tracking robustness<br />Gesture formulation<br />
  28. 28. The End.<br />Thank you for listening.<br />Questions?<br />

×