SlideShare a Scribd company logo
1 of 44
Hand Gesture Interface
    기술동향 및 전망
      < 코리아 모바일 UX 데이 2010 >

                  2010. 1. 22.

                    김동철

      Media System Lab.,Yonsei University
            Lab. http://msl.yonsei.ac.kr
            Blog. http://www.t9t9.com
           eMail. dongchul@gmail.com
Contents

1. 영화와 현실 속 Hand Gesture Interface

2. 업계 동향

3. 연구 동향

4. 향후 전망
Data Glove                                                       Vision
                                                                              based                                                          based




                                                           Hand Gesture Interface
[1] K G Derpains, “A review of Vision-based Hand Gestures”, Internal Report, Dept. of Computer Science.York University, Feb. 2004
[2] Pragati Garg, Naveen Aggarwal, Sanjeev Sofat, “Vision Based Hand Gesture Recognition”, World Academy of Science, Engineering and Technology 49 2009
Data Glove   Hybrid    Vision
  based      based     based




   Hand Gesture Interface
Data Glove        Hybrid         Vision
  based           based          based

                Accelerometer
 Flex Sensor                     Camera
                   Sensor

Accelerometer      IR LED       IR Camera
   Sensor

                 IR Camera      Stereo Cam
 Etc. Sensors

                 Controller     Depth Cam




     Hand Gesture Interface
Hand Posture

                                                                                                           Hand Gesture




[1] Pragati Garg, Naveen Aggarwal, Sanjeev Sofat, “Vision Based Hand Gesture Recognition”, World Academy of Science, Engineering and Technology 49 2009
영화와 현실 속 Hand Gesture Interface
Minority Report
Hand Gesture



Data Glove + LED




       Hand Posture




                                    Gesture Spotting




                      Minority Report
The Island
Data Glove




                          Hand Tracking




                              Air Touch Screen


             The Island
Iron Man
Hand Posture




                          Hand Tracking




               Iron Man
The Island                Minority Report     Iron Man




             Data Glove              Hybrid              Vision
Oblong G-Speak




SixthSense - A wearable gesture interface   Wiimote Project, Johnny Lee   Hand Gesture Interface Project


                                                   Hybrid
Oblong G-Speak
[1] http://oblong.com
[2] http://www.engadget.com/2008/11/14/oblongs-g-speak-the-minority-report-os-brought-to-life
Data Glove   Hybrid   Vision
Microsoft Natal                    Reactrix WAVEscape           Air Strike




                                                             dstrict See H 2.0
                                   GestureTek
Fraunhofer iPoint Presenter
                                                                                     Dvation SwingFlip
                                                Vision-based
Fraunhofer iPoint Presenter
[1] http://www.netzwelt.de/news/77305-pcs-steuern-film-ipoint-presenter-video.html
[2] http://www.hhi.fraunhofer.de/de/departments/interactive-media-human-factors/overview/ipoint-presenter
Hitachi Gesture TV

Toshiba Gesture TV




                       Toshiba Gesture Notebook




                                                  Samsung Gesture TV

Panasonic Gesture TV
                           Vision-based
                       Consumer Electronics
Wavelength
Data Glove   Hybrid   Vision
Interactive Glove   5DT Data Glove 14 Ultra     Pinch Glove




 5DT Data Glove 5        Cyber Glove          Muscle Interface



                      Data Gloves
Flex                                                                  Accelerometer
[1] http://createdigitalmusic.com/2005/08/08/hypersense-complex-gestural-gloves-for-music/http://www.electronics-lab.com/blog/?attachment_id=719
[2] http://www.hhi.fraunhofer.de/de/departments/interactive-media-human-factors/overview/ipoint-presenter
Depth Cam                           Stereo Cam   Controller   Single Cam




                                                       Hand Gesture Interface
                                                                업계동향
[1] http://en.wikipedia.org/wiki/Gesture_recognition
Time of Flight




                                                                 3DV Systems Zcam
[1] http://news.cnet.com/2300-1043_3-6222008-1.html
[2] http://www.thinglab.co.uk/scanning_product.php?URL_=product_digiscan_3dvsystems_zcam&SubCatID_=53
Microsoft Natal Project

[1] http://www.xbox.com/en-US/live/projectnatal/
[2] http://en.wikipedia.org/wiki/Project_Natal
Reactrix WAVEscape

[1] http://www.studybusiness.com/dir/dir/Download/Digital/1495.html
Sony
                                Nintendo Wii
                                                                 Motion Controller
[1] http://www.nintendo.com/wii
[2] http://en.wikipedia.org/wiki/PlayStation_Motion_Controller
Sony EyeToy            Sony EyePet

[1] http://www.us.playstation.com/PS2/Games/EyeToy_Play/ogs/
[2] http://www.eyepet.com/
EyeSight




                                                                                      Samsung W830

                                                                            EyeCall

[1] http://www.eyesight-tech.com/technology/
[2] http://www.jamster.co.uk/jcw/java/info.do?contentType=12&doc=22517399
[3] http://interaction.tistory.com/304
Microsoft Natal     Softkinetics
                                                                      Toshiba                          3DV Systems
                                                                                    Nintendo Wii
                  Reactrix                                           Panasonic                          Fraunhofer
                 GestureTek                                           Hitachi        Sony Motion
                                                                                      Controller      Oblong G-Speak
                                                                     Samsung                             Canesta
                                                                                     Sony EyeToy
                                                                                                         eyeSight


             Interactive Ad                                                  TV         Game            Interface


                                                        Hand Gesture Interface
                                                                                  업계동향
[1] http://images.businessweek.com/ss/07/11/1113_girlapproved/source/2.htm
Microsoft Natal
3DV Systems      GestureTek
 Softkinetics     Fraunhofer      Nintendo Wii   Sony EyeToy
   Canesta         Reactrix
                                  Sony Motion      Toshiba
  Panasonic     Oblong G-Speak     Controller      eyeSight
   Hitachi         Samsung


Depth Cam         Stereo Cam       Controller    Single Cam


                Hand Gesture Interface
                          업계동향
3D Hand                                               Appearance-
                                                                                                                                                          Skin Color Model
                                                                            Model-based                                               based
                                  Edge Map
                                                                                                                                                             Eigenspace
                                  3D Model
                                                                                                                                                          Haar like Features
                                 Parameter
                                                                                                                                                           Local Invariant
                                                                                                                                                             Features




                                                             Vision-based
                                                    Hand Gesture Interface 연구동향
[1] Pragati Garg, Naveen Aggarwal, Sanjeev Sofat, “Vision Based Hand Gesture Recognition”, World Academy of Science, Engineering and Technology 49 2009
Detection


  Hand
  Posture



 Tracking


  Hand
  Gesture



 Gesture
Recognition
The Research of
Hand Gesture Interface
Media System Lab.,Yonsei University

                              Air Pointing              Hand Gesture
                              Stereo vision tech        Optical flow based
                              2 Camera                  1 Camera
                              Grid Pointing             Left, Right Gestures




                              Touch Air                 Gesture Bar
                              IR camera based           IR distance sensor based
                              1 IR camera               4 IR sensors
                              Multi touch in air        Left, Right, Push Gestures
                              Touchless tech            Distance : ~1m
                              Distance : ~1m



                                                                                     iRing
                                                                                     IR blob sensor based
                                                                                     IR LED x 4
                              Hand Tracking                                          IR camera x 1
                              Skin color modeling                                    3D depth sensing
                              Template matching based                                Distance : ~1m
                              1 camera




                              Data Glove                                             iStick
                              Flex Sensors x 3                                       Controller
                              Accelerometer x 1                                      IR blob sensor based
                              IR LED x 3                                             IR LED x 1
                              Click button x 2                                       IR camera x 1
                                                                                     3D depth sensing
                                                                                     Distance : ~1m




[1] http://msl.yonsei.ac.kr
[2] http://hand.t9t9.com
Data Glove                Hybrid                   Vision
             Media System Lab.,Yonsei University
Touch Air
IR camera based
1 IR camera
Multi touch in air
Touchless tech
Distance : ~1m




                     Hand Tracking
                     Skin color modeling
                     Template matching based
                     1 camera
Swing Gesture
Optical flow based
1 Camera
Left, Right, Push Gestures
Hand Gesture Sensing with IR Ring
                                                          iRing
                                                          IR blob sensor based
                                                          IR LED x 4
                                                          IR camera x 1
                                                          3D depth sensing
                                                          Distance : ~1m




                                    Hand Gesture 3D Controller with IR Ring for AR
HMD                   Tracking & Gesture Recognition    Wrist PC




Lens Display



                         Hologram        Detection                       Sensor



                     Display          Vision                          Device

                            Hand Gesture Interface
                                    향후전망
Gesture PC
         HMD
                                     HMD PC + Hand Gesture Interface

                      Mobile


 3D Display
                                                                                        Holobook


                                                      Hologram Display


Microsoft Natal   Muscle Interface




    2010                             2015                                2020

                               Hand Gesture Interface
                                             향후전망
Q&A


                                   OpenCV.co.kr
msl.yonsei.ac.kr




 Google Wave               @T9T9
  Hand Gesture Interface              T9T9.com
Thank you

More Related Content

What's hot

Gesture Recognition Technology-Seminar PPT
Gesture Recognition Technology-Seminar PPTGesture Recognition Technology-Seminar PPT
Gesture Recognition Technology-Seminar PPTSuraj Rai
 
Gesture Based Computing
Gesture Based ComputingGesture Based Computing
Gesture Based ComputingNitin Goyal
 
Gesture Technology
Gesture TechnologyGesture Technology
Gesture TechnologyBugRaptors
 
Gesture recognition technology
Gesture recognition technology Gesture recognition technology
Gesture recognition technology Nagamani Gurram
 
Gesture recognition document
Gesture recognition documentGesture recognition document
Gesture recognition documentNikhil Jha
 
Gesture recognition technology
Gesture recognition technologyGesture recognition technology
Gesture recognition technologySahil Abbas
 
project presentation on mouse simulation using finger tip detection
project presentation on mouse simulation using finger tip detection project presentation on mouse simulation using finger tip detection
project presentation on mouse simulation using finger tip detection Sumit Varshney
 
Gesture recognition technology
Gesture recognition technologyGesture recognition technology
Gesture recognition technologyKompal Neutan
 
ppt of gesture recognition
ppt of gesture recognitionppt of gesture recognition
ppt of gesture recognitionAayush Agrawal
 
IRJET- Enhanced Look Based Media Player with Hand Gesture Recognition
IRJET-  	  Enhanced Look Based Media Player with Hand Gesture RecognitionIRJET-  	  Enhanced Look Based Media Player with Hand Gesture Recognition
IRJET- Enhanced Look Based Media Player with Hand Gesture RecognitionIRJET Journal
 
Hand Gesture Recognition Using OpenCV Python
Hand Gesture Recognition Using OpenCV Python Hand Gesture Recognition Using OpenCV Python
Hand Gesture Recognition Using OpenCV Python Arijit Mukherjee
 
Hand gesture recognition system for human computer interaction using contour ...
Hand gesture recognition system for human computer interaction using contour ...Hand gesture recognition system for human computer interaction using contour ...
Hand gesture recognition system for human computer interaction using contour ...eSAT Journals
 

What's hot (20)

Gesture Recognition Technology-Seminar PPT
Gesture Recognition Technology-Seminar PPTGesture Recognition Technology-Seminar PPT
Gesture Recognition Technology-Seminar PPT
 
Gesture Based Computing
Gesture Based ComputingGesture Based Computing
Gesture Based Computing
 
Gesture Technology
Gesture TechnologyGesture Technology
Gesture Technology
 
GESTURE prestation
GESTURE prestation GESTURE prestation
GESTURE prestation
 
Gesture recognition technology
Gesture recognition technology Gesture recognition technology
Gesture recognition technology
 
Gesture recognition document
Gesture recognition documentGesture recognition document
Gesture recognition document
 
Gesture recognition technology
Gesture recognition technologyGesture recognition technology
Gesture recognition technology
 
Gesture recognition technology
Gesture recognition technologyGesture recognition technology
Gesture recognition technology
 
project presentation on mouse simulation using finger tip detection
project presentation on mouse simulation using finger tip detection project presentation on mouse simulation using finger tip detection
project presentation on mouse simulation using finger tip detection
 
Gesture recognition technology
Gesture recognition technologyGesture recognition technology
Gesture recognition technology
 
ppt of gesture recognition
ppt of gesture recognitionppt of gesture recognition
ppt of gesture recognition
 
IRJET- Enhanced Look Based Media Player with Hand Gesture Recognition
IRJET-  	  Enhanced Look Based Media Player with Hand Gesture RecognitionIRJET-  	  Enhanced Look Based Media Player with Hand Gesture Recognition
IRJET- Enhanced Look Based Media Player with Hand Gesture Recognition
 
Gesture Recognition
Gesture RecognitionGesture Recognition
Gesture Recognition
 
Hand Gesture Recognition Using OpenCV Python
Hand Gesture Recognition Using OpenCV Python Hand Gesture Recognition Using OpenCV Python
Hand Gesture Recognition Using OpenCV Python
 
Sixth sensing robot
Sixth sensing robotSixth sensing robot
Sixth sensing robot
 
Gesture recognition
Gesture recognitionGesture recognition
Gesture recognition
 
gesture-recognition
gesture-recognitiongesture-recognition
gesture-recognition
 
Virtual Mouse
Virtual MouseVirtual Mouse
Virtual Mouse
 
Hand gesture recognition system for human computer interaction using contour ...
Hand gesture recognition system for human computer interaction using contour ...Hand gesture recognition system for human computer interaction using contour ...
Hand gesture recognition system for human computer interaction using contour ...
 
Nikppt
NikpptNikppt
Nikppt
 

Viewers also liked

Photos From Cairo
Photos From CairoPhotos From Cairo
Photos From Cairok_f_s
 
Communication & Challenging Conversations PCMA 2014 Montreal
Communication & Challenging Conversations PCMA 2014 MontrealCommunication & Challenging Conversations PCMA 2014 Montreal
Communication & Challenging Conversations PCMA 2014 MontrealMcKinley Solutions
 
10 Containment Tips:
10 Containment Tips:10 Containment Tips:
10 Containment Tips:Martyn Ryder
 
Verbal vs non verbal communication
Verbal vs non verbal communicationVerbal vs non verbal communication
Verbal vs non verbal communicationitaliyasantosh
 
Nonverbal Communication
Nonverbal CommunicationNonverbal Communication
Nonverbal CommunicationIvan Petković
 
Verbal vs non verbal communication.
Verbal vs non verbal communication.Verbal vs non verbal communication.
Verbal vs non verbal communication.srishti gwari
 
Human Relations Chapter 6
Human Relations Chapter 6Human Relations Chapter 6
Human Relations Chapter 6Luella Brien
 
Body Language
Body LanguageBody Language
Body Languageagoshen
 
Nonverbal Communication and Body Language 101 Rel_4.0
Nonverbal Communication and Body Language 101 Rel_4.0Nonverbal Communication and Body Language 101 Rel_4.0
Nonverbal Communication and Body Language 101 Rel_4.0Richard Gustafson
 
How to Listen With Your Eyes
How to Listen With Your EyesHow to Listen With Your Eyes
How to Listen With Your EyesJillayne Schlicke
 
Non – Verbal Communication
Non – Verbal CommunicationNon – Verbal Communication
Non – Verbal CommunicationTamil Vanan
 
Eyes. Psychology. Jennifer Lawrence (Mockingjay)
Eyes. Psychology. Jennifer Lawrence (Mockingjay)Eyes. Psychology. Jennifer Lawrence (Mockingjay)
Eyes. Psychology. Jennifer Lawrence (Mockingjay)Lilia XXIP
 
Verbal and nonverbal communication
Verbal and nonverbal communicationVerbal and nonverbal communication
Verbal and nonverbal communicationAmal Jith
 

Viewers also liked (20)

Hand Gesture Recognition
Hand Gesture RecognitionHand Gesture Recognition
Hand Gesture Recognition
 
Photos From Cairo
Photos From CairoPhotos From Cairo
Photos From Cairo
 
Communication & Challenging Conversations PCMA 2014 Montreal
Communication & Challenging Conversations PCMA 2014 MontrealCommunication & Challenging Conversations PCMA 2014 Montreal
Communication & Challenging Conversations PCMA 2014 Montreal
 
Communication
CommunicationCommunication
Communication
 
10 Containment Tips:
10 Containment Tips:10 Containment Tips:
10 Containment Tips:
 
Body language
Body languageBody language
Body language
 
Past Tense2
Past Tense2Past Tense2
Past Tense2
 
Verbal vs non verbal communication
Verbal vs non verbal communicationVerbal vs non verbal communication
Verbal vs non verbal communication
 
Nonverbal Communication
Nonverbal CommunicationNonverbal Communication
Nonverbal Communication
 
Verbal vs non verbal communication.
Verbal vs non verbal communication.Verbal vs non verbal communication.
Verbal vs non verbal communication.
 
Human Relations Chapter 6
Human Relations Chapter 6Human Relations Chapter 6
Human Relations Chapter 6
 
Body Language
Body LanguageBody Language
Body Language
 
Nonverbal Communication and Body Language 101 Rel_4.0
Nonverbal Communication and Body Language 101 Rel_4.0Nonverbal Communication and Body Language 101 Rel_4.0
Nonverbal Communication and Body Language 101 Rel_4.0
 
How to Listen With Your Eyes
How to Listen With Your EyesHow to Listen With Your Eyes
How to Listen With Your Eyes
 
Non verbal communication
Non verbal communicationNon verbal communication
Non verbal communication
 
Non – Verbal Communication
Non – Verbal CommunicationNon – Verbal Communication
Non – Verbal Communication
 
Eyes. Psychology. Jennifer Lawrence (Mockingjay)
Eyes. Psychology. Jennifer Lawrence (Mockingjay)Eyes. Psychology. Jennifer Lawrence (Mockingjay)
Eyes. Psychology. Jennifer Lawrence (Mockingjay)
 
Non Verbal Communication.Ppt%
Non Verbal Communication.Ppt%Non Verbal Communication.Ppt%
Non Verbal Communication.Ppt%
 
Verbal and nonverbal communication
Verbal and nonverbal communicationVerbal and nonverbal communication
Verbal and nonverbal communication
 
Chapter 3: Nonverbal communication
Chapter 3: Nonverbal communicationChapter 3: Nonverbal communication
Chapter 3: Nonverbal communication
 

Similar to Hand Gesture Interface Trends and Outlook

COSC 426 Lect. 8: AR Research Directions
COSC 426 Lect. 8: AR Research DirectionsCOSC 426 Lect. 8: AR Research Directions
COSC 426 Lect. 8: AR Research DirectionsMark Billinghurst
 
A Survey Paper on Controlling Computer using Hand Gestures
A Survey Paper on Controlling Computer using Hand GesturesA Survey Paper on Controlling Computer using Hand Gestures
A Survey Paper on Controlling Computer using Hand GesturesIRJET Journal
 
Virtual Mouse Control Using Hand Gestures
Virtual Mouse Control Using Hand GesturesVirtual Mouse Control Using Hand Gestures
Virtual Mouse Control Using Hand GesturesIRJET Journal
 
Controlling Computer using Hand Gestures
Controlling Computer using Hand GesturesControlling Computer using Hand Gestures
Controlling Computer using Hand GesturesIRJET Journal
 
Sixth Sense Technology
Sixth Sense TechnologySixth Sense Technology
Sixth Sense TechnologyPrakhar Gore
 
Virtual Automation using Mixed Reality and Leap Motion Control
Virtual Automation using Mixed Reality and Leap Motion ControlVirtual Automation using Mixed Reality and Leap Motion Control
Virtual Automation using Mixed Reality and Leap Motion ControlIRJET Journal
 
COSC 426 Lect. 1 - Introduction to AR
COSC 426 Lect. 1 - Introduction to ARCOSC 426 Lect. 1 - Introduction to AR
COSC 426 Lect. 1 - Introduction to ARMark Billinghurst
 
IRJET-Augmented Reality based Platform to Share Virtual Worlds
IRJET-Augmented Reality based Platform to Share Virtual WorldsIRJET-Augmented Reality based Platform to Share Virtual Worlds
IRJET-Augmented Reality based Platform to Share Virtual WorldsIRJET Journal
 
Follow Me Robot Technology
Follow Me Robot TechnologyFollow Me Robot Technology
Follow Me Robot Technologyijsrd.com
 
IRJET- A Review on Iot Based Sign Language Conversion
IRJET-  	  A Review on Iot Based Sign Language ConversionIRJET-  	  A Review on Iot Based Sign Language Conversion
IRJET- A Review on Iot Based Sign Language ConversionIRJET Journal
 
426 lecture1: Introduction to AR
426 lecture1: Introduction to AR426 lecture1: Introduction to AR
426 lecture1: Introduction to ARMark Billinghurst
 
Robotic Virtual Telepresence with Raspberry pi
Robotic Virtual Telepresence with Raspberry piRobotic Virtual Telepresence with Raspberry pi
Robotic Virtual Telepresence with Raspberry piIRJET Journal
 
IRJET - Touchless Technology
IRJET - Touchless TechnologyIRJET - Touchless Technology
IRJET - Touchless TechnologyIRJET Journal
 
Tx company presentation_2018
Tx company presentation_2018Tx company presentation_2018
Tx company presentation_2018Yuichiro Hikosaka
 
Tx company presentation_jp_2018_en_linkedin
Tx company presentation_jp_2018_en_linkedinTx company presentation_jp_2018_en_linkedin
Tx company presentation_jp_2018_en_linkedinYuichiro Hikosaka
 
IRJET-Peerless Home Area Network for Guesstimating in Smart Grid
IRJET-Peerless Home Area Network for Guesstimating in Smart GridIRJET-Peerless Home Area Network for Guesstimating in Smart Grid
IRJET-Peerless Home Area Network for Guesstimating in Smart GridIRJET Journal
 

Similar to Hand Gesture Interface Trends and Outlook (20)

COSC 426 Lect. 8: AR Research Directions
COSC 426 Lect. 8: AR Research DirectionsCOSC 426 Lect. 8: AR Research Directions
COSC 426 Lect. 8: AR Research Directions
 
Jithu
JithuJithu
Jithu
 
A Survey Paper on Controlling Computer using Hand Gestures
A Survey Paper on Controlling Computer using Hand GesturesA Survey Paper on Controlling Computer using Hand Gestures
A Survey Paper on Controlling Computer using Hand Gestures
 
AR(mobas2012)s
AR(mobas2012)sAR(mobas2012)s
AR(mobas2012)s
 
Virtual Mouse Control Using Hand Gestures
Virtual Mouse Control Using Hand GesturesVirtual Mouse Control Using Hand Gestures
Virtual Mouse Control Using Hand Gestures
 
Controlling Computer using Hand Gestures
Controlling Computer using Hand GesturesControlling Computer using Hand Gestures
Controlling Computer using Hand Gestures
 
Sixth Sense Technology
Sixth Sense TechnologySixth Sense Technology
Sixth Sense Technology
 
Virtual Automation using Mixed Reality and Leap Motion Control
Virtual Automation using Mixed Reality and Leap Motion ControlVirtual Automation using Mixed Reality and Leap Motion Control
Virtual Automation using Mixed Reality and Leap Motion Control
 
COSC 426 Lect. 1 - Introduction to AR
COSC 426 Lect. 1 - Introduction to ARCOSC 426 Lect. 1 - Introduction to AR
COSC 426 Lect. 1 - Introduction to AR
 
IRJET-Augmented Reality based Platform to Share Virtual Worlds
IRJET-Augmented Reality based Platform to Share Virtual WorldsIRJET-Augmented Reality based Platform to Share Virtual Worlds
IRJET-Augmented Reality based Platform to Share Virtual Worlds
 
Follow Me Robot Technology
Follow Me Robot TechnologyFollow Me Robot Technology
Follow Me Robot Technology
 
IRJET- A Review on Iot Based Sign Language Conversion
IRJET-  	  A Review on Iot Based Sign Language ConversionIRJET-  	  A Review on Iot Based Sign Language Conversion
IRJET- A Review on Iot Based Sign Language Conversion
 
426 lecture1: Introduction to AR
426 lecture1: Introduction to AR426 lecture1: Introduction to AR
426 lecture1: Introduction to AR
 
Robotic Virtual Telepresence with Raspberry pi
Robotic Virtual Telepresence with Raspberry piRobotic Virtual Telepresence with Raspberry pi
Robotic Virtual Telepresence with Raspberry pi
 
IRJET - Touchless Technology
IRJET - Touchless TechnologyIRJET - Touchless Technology
IRJET - Touchless Technology
 
Content-Centric Embedded
Content-Centric EmbeddedContent-Centric Embedded
Content-Centric Embedded
 
Tx company presentation_2018
Tx company presentation_2018Tx company presentation_2018
Tx company presentation_2018
 
Tx company presentation_jp_2018_en_linkedin
Tx company presentation_jp_2018_en_linkedinTx company presentation_jp_2018_en_linkedin
Tx company presentation_jp_2018_en_linkedin
 
Phidget sensors
Phidget sensorsPhidget sensors
Phidget sensors
 
IRJET-Peerless Home Area Network for Guesstimating in Smart Grid
IRJET-Peerless Home Area Network for Guesstimating in Smart GridIRJET-Peerless Home Area Network for Guesstimating in Smart Grid
IRJET-Peerless Home Area Network for Guesstimating in Smart Grid
 

Recently uploaded

MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesManik S Magar
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfIngrid Airi González
 
Landscape Catalogue 2024 Australia-1.pdf
Landscape Catalogue 2024 Australia-1.pdfLandscape Catalogue 2024 Australia-1.pdf
Landscape Catalogue 2024 Australia-1.pdfAarwolf Industries LLC
 
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...itnewsafrica
 
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)Mark Simos
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxfnnc6jmgwh
 
Dynamical Context introduction word sensibility orientation
Dynamical Context introduction word sensibility orientationDynamical Context introduction word sensibility orientation
Dynamical Context introduction word sensibility orientationBuild Intuit
 
Why Agile? - A handbook behind Agile Evolution
Why Agile? - A handbook behind Agile EvolutionWhy Agile? - A handbook behind Agile Evolution
Why Agile? - A handbook behind Agile EvolutionDEEPRAJ PATHAK
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observabilityitnewsafrica
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch TuesdayIvanti
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesBernd Ruecker
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI AgeCprime
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Farhan Tariq
 
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...Karmanjay Verma
 
Kuma Meshes Part I - The basics - A tutorial
Kuma Meshes Part I - The basics - A tutorialKuma Meshes Part I - The basics - A tutorial
Kuma Meshes Part I - The basics - A tutorialJoão Esperancinha
 
React Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkReact Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkPixlogix Infotech
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityIES VE
 

Recently uploaded (20)

MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdf
 
Landscape Catalogue 2024 Australia-1.pdf
Landscape Catalogue 2024 Australia-1.pdfLandscape Catalogue 2024 Australia-1.pdf
Landscape Catalogue 2024 Australia-1.pdf
 
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
 
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
 
Dynamical Context introduction word sensibility orientation
Dynamical Context introduction word sensibility orientationDynamical Context introduction word sensibility orientation
Dynamical Context introduction word sensibility orientation
 
Why Agile? - A handbook behind Agile Evolution
Why Agile? - A handbook behind Agile EvolutionWhy Agile? - A handbook behind Agile Evolution
Why Agile? - A handbook behind Agile Evolution
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch Tuesday
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architectures
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI Age
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...
 
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
 
Kuma Meshes Part I - The basics - A tutorial
Kuma Meshes Part I - The basics - A tutorialKuma Meshes Part I - The basics - A tutorial
Kuma Meshes Part I - The basics - A tutorial
 
React Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkReact Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App Framework
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a reality
 

Hand Gesture Interface Trends and Outlook

  • 1. Hand Gesture Interface 기술동향 및 전망 < 코리아 모바일 UX 데이 2010 > 2010. 1. 22. 김동철 Media System Lab.,Yonsei University Lab. http://msl.yonsei.ac.kr Blog. http://www.t9t9.com eMail. dongchul@gmail.com
  • 2. Contents 1. 영화와 현실 속 Hand Gesture Interface 2. 업계 동향 3. 연구 동향 4. 향후 전망
  • 3. Data Glove Vision based based Hand Gesture Interface [1] K G Derpains, “A review of Vision-based Hand Gestures”, Internal Report, Dept. of Computer Science.York University, Feb. 2004 [2] Pragati Garg, Naveen Aggarwal, Sanjeev Sofat, “Vision Based Hand Gesture Recognition”, World Academy of Science, Engineering and Technology 49 2009
  • 4. Data Glove Hybrid Vision based based based Hand Gesture Interface
  • 5. Data Glove Hybrid Vision based based based Accelerometer Flex Sensor Camera Sensor Accelerometer IR LED IR Camera Sensor IR Camera Stereo Cam Etc. Sensors Controller Depth Cam Hand Gesture Interface
  • 6. Hand Posture Hand Gesture [1] Pragati Garg, Naveen Aggarwal, Sanjeev Sofat, “Vision Based Hand Gesture Recognition”, World Academy of Science, Engineering and Technology 49 2009
  • 7. 영화와 현실 속 Hand Gesture Interface
  • 9. Hand Gesture Data Glove + LED Hand Posture Gesture Spotting Minority Report
  • 11. Data Glove Hand Tracking Air Touch Screen The Island
  • 13. Hand Posture Hand Tracking Iron Man
  • 14. The Island Minority Report Iron Man Data Glove Hybrid Vision
  • 15. Oblong G-Speak SixthSense - A wearable gesture interface Wiimote Project, Johnny Lee Hand Gesture Interface Project Hybrid
  • 16. Oblong G-Speak [1] http://oblong.com [2] http://www.engadget.com/2008/11/14/oblongs-g-speak-the-minority-report-os-brought-to-life
  • 17. Data Glove Hybrid Vision
  • 18. Microsoft Natal Reactrix WAVEscape Air Strike dstrict See H 2.0 GestureTek Fraunhofer iPoint Presenter Dvation SwingFlip Vision-based
  • 19. Fraunhofer iPoint Presenter [1] http://www.netzwelt.de/news/77305-pcs-steuern-film-ipoint-presenter-video.html [2] http://www.hhi.fraunhofer.de/de/departments/interactive-media-human-factors/overview/ipoint-presenter
  • 20. Hitachi Gesture TV Toshiba Gesture TV Toshiba Gesture Notebook Samsung Gesture TV Panasonic Gesture TV Vision-based Consumer Electronics
  • 22. Data Glove Hybrid Vision
  • 23. Interactive Glove 5DT Data Glove 14 Ultra Pinch Glove 5DT Data Glove 5 Cyber Glove Muscle Interface Data Gloves
  • 24. Flex Accelerometer [1] http://createdigitalmusic.com/2005/08/08/hypersense-complex-gestural-gloves-for-music/http://www.electronics-lab.com/blog/?attachment_id=719 [2] http://www.hhi.fraunhofer.de/de/departments/interactive-media-human-factors/overview/ipoint-presenter
  • 25. Depth Cam Stereo Cam Controller Single Cam Hand Gesture Interface 업계동향 [1] http://en.wikipedia.org/wiki/Gesture_recognition
  • 26. Time of Flight 3DV Systems Zcam [1] http://news.cnet.com/2300-1043_3-6222008-1.html [2] http://www.thinglab.co.uk/scanning_product.php?URL_=product_digiscan_3dvsystems_zcam&SubCatID_=53
  • 27. Microsoft Natal Project [1] http://www.xbox.com/en-US/live/projectnatal/ [2] http://en.wikipedia.org/wiki/Project_Natal
  • 29. Sony Nintendo Wii Motion Controller [1] http://www.nintendo.com/wii [2] http://en.wikipedia.org/wiki/PlayStation_Motion_Controller
  • 30. Sony EyeToy Sony EyePet [1] http://www.us.playstation.com/PS2/Games/EyeToy_Play/ogs/ [2] http://www.eyepet.com/
  • 31. EyeSight Samsung W830 EyeCall [1] http://www.eyesight-tech.com/technology/ [2] http://www.jamster.co.uk/jcw/java/info.do?contentType=12&doc=22517399 [3] http://interaction.tistory.com/304
  • 32. Microsoft Natal Softkinetics Toshiba 3DV Systems Nintendo Wii Reactrix Panasonic Fraunhofer GestureTek Hitachi Sony Motion Controller Oblong G-Speak Samsung Canesta Sony EyeToy eyeSight Interactive Ad TV Game Interface Hand Gesture Interface 업계동향 [1] http://images.businessweek.com/ss/07/11/1113_girlapproved/source/2.htm
  • 33. Microsoft Natal 3DV Systems GestureTek Softkinetics Fraunhofer Nintendo Wii Sony EyeToy Canesta Reactrix Sony Motion Toshiba Panasonic Oblong G-Speak Controller eyeSight Hitachi Samsung Depth Cam Stereo Cam Controller Single Cam Hand Gesture Interface 업계동향
  • 34. 3D Hand Appearance- Skin Color Model Model-based based Edge Map Eigenspace 3D Model Haar like Features Parameter Local Invariant Features Vision-based Hand Gesture Interface 연구동향 [1] Pragati Garg, Naveen Aggarwal, Sanjeev Sofat, “Vision Based Hand Gesture Recognition”, World Academy of Science, Engineering and Technology 49 2009
  • 35. Detection Hand Posture Tracking Hand Gesture Gesture Recognition
  • 36. The Research of Hand Gesture Interface Media System Lab.,Yonsei University Air Pointing Hand Gesture Stereo vision tech Optical flow based 2 Camera 1 Camera Grid Pointing Left, Right Gestures Touch Air Gesture Bar IR camera based IR distance sensor based 1 IR camera 4 IR sensors Multi touch in air Left, Right, Push Gestures Touchless tech Distance : ~1m Distance : ~1m iRing IR blob sensor based IR LED x 4 Hand Tracking IR camera x 1 Skin color modeling 3D depth sensing Template matching based Distance : ~1m 1 camera Data Glove iStick Flex Sensors x 3 Controller Accelerometer x 1 IR blob sensor based IR LED x 3 IR LED x 1 Click button x 2 IR camera x 1 3D depth sensing Distance : ~1m [1] http://msl.yonsei.ac.kr [2] http://hand.t9t9.com
  • 37. Data Glove Hybrid Vision Media System Lab.,Yonsei University
  • 38. Touch Air IR camera based 1 IR camera Multi touch in air Touchless tech Distance : ~1m Hand Tracking Skin color modeling Template matching based 1 camera
  • 39. Swing Gesture Optical flow based 1 Camera Left, Right, Push Gestures
  • 40. Hand Gesture Sensing with IR Ring iRing IR blob sensor based IR LED x 4 IR camera x 1 3D depth sensing Distance : ~1m Hand Gesture 3D Controller with IR Ring for AR
  • 41. HMD Tracking & Gesture Recognition Wrist PC Lens Display Hologram Detection Sensor Display Vision Device Hand Gesture Interface 향후전망
  • 42. Gesture PC HMD HMD PC + Hand Gesture Interface Mobile 3D Display Holobook Hologram Display Microsoft Natal Muscle Interface 2010 2015 2020 Hand Gesture Interface 향후전망
  • 43. Q&A OpenCV.co.kr msl.yonsei.ac.kr Google Wave @T9T9 Hand Gesture Interface T9T9.com