• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Gesture recognition with Jnect, EMF-IncQuery, Esper and GEF3D
 

Gesture recognition with Jnect, EMF-IncQuery, Esper and GEF3D

on

  • 2,391 views

This presentation is about a tech demo for EclipseCon Europe 2012. We connect Microsoft Kinect with Eclipse technologies using: ...

This presentation is about a tech demo for EclipseCon Europe 2012. We connect Microsoft Kinect with Eclipse technologies using:
- the Jnect plugin for processing Kinect Data
- the Eclipse Modeling Framework as the underlying live model representation format
- EMF-IncQuery for realtime pattern matching to recognize static gestures
- the Esper complex event processor to recognize gesture sequences in the event stream generated by IncQuery.

More details at http://viatra.inf.mit.bme.hu/incquery/demos/jnect

Statistics

Views

Total Views
2,391
Views on SlideShare
834
Embed Views
1,557

Actions

Likes
2
Downloads
9
Comments
0

10 Embeds 1,557

http://incquery.net 841
http://viatra.inf.mit.bme.hu 491
http://eclipse.org 96
https://www.inf.mit.bme.hu 53
http://www.eclipse.org 51
http://www.inf.mit.bme.hu 19
https://viatra.inf.mit.bme.hu 3
https://twitter.com 1
http://incquery.net. 1
https://www.google.de 1
More...

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Gesture recognition with Jnect, EMF-IncQuery, Esper and GEF3D Gesture recognition with Jnect, EMF-IncQuery, Esper and GEF3D Presentation Transcript

    • “STANDING  QUERIES”   Real2me  gesture  recogni2on  with  Eclipse  technologies   István  DÁVID,  István  RÁTH hDp://viatra.inf.mit.bme.hu/incquery/demos/jnect   Budapest  University  of  Technology  and  Economics Fault  Tolerant  Systems  Research  GroupBudapest  University  of  Technology  and  EconomicsDepartment  of  Measurement  and  Informa<on  Systems
    • Overview User  moving  in  front  of  the  sensor PaDern  match   EMF   setX(…) deltas no2fica2on EMF-­‐ Esper   Live  EMF   IncQuery   complex   model paDern   event  Kinect matcher processorsensor data Recognized gesture  sequences
    • Overview User  moving  in  front  of  the  sensor PaDern  match   EMF   setX(…) deltas no2fica2on EMF-­‐ Esper   Live  EMF   IncQuery   complex   model paDern   event  Kinect matcher processorsensor data Full  model   update  at  ~20   Recognized FPS gesture  sequences
    • Overview User  moving  in  front  of  the  sensor PaDern  match   EMF   setX(…) deltas no2fica2on EMF-­‐ Esper   Live  EMF   IncQuery   complex   model PaBern  Y()  { paDern   event  Kinect matcher processorsensor data Full  model   update  at  ~20   Recognized FPS gesture  sequences }
    • Overview User  moving  in  front  of  the  sensor PaDern  match   EMF   setX(…) deltas no2fica2on EMF-­‐ Esper   Live  EMF   IncQuery   complex   model paDern   event  Kinect matcher processorsensor data Full  model   update  at  ~20   Recognized FPS gesture  sequences
    • Overview Event  PaBern  YMCA User  moving  in  front  of  the  sensor SELECT  *  FROM  paDern[  every((Y)  -­‐>              (M)  -­‐>   EMF   PaDern  match   deltas setX(…) no2fica2on        (C)  -­‐>     EMF-­‐ Esper              (A)   Live  EMF   IncQuery   complex   WHERE  2mer:within(10  sec))] model paDern   event  Kinect matcher processorsensor data Full  model   update  at  ~20   Recognized FPS gesture  sequences
    • Overview User  moving  in  front  of  the  sensor PaDern  match   EMF   setX(…) deltas no2fica2on EMF-­‐ Esper   Live  EMF   IncQuery   complex   model paDern   event  Kinect matcher processorsensor data Full  model   update  at  ~20   Recognized FPS gesture  sequences
    • Overview User  moving  in  front  of  the  sensor PaDern  match   EMF   setX(…) deltas no2fica2on EMF-­‐ Esper   Live  EMF   IncQuery   complex   model paDern   event  Kinect matcher processorsensor data Full  model   update  at  ~20   Recognized FPS gesture  sequences
    • Overview User  moving  in  front  of  the  sensor CEP  output PaDern  match   EMF   setX(…) no2fica2on PaDern  matcher  output deltas EMF-­‐ Esper   Live  EMF   IncQuery   complex   model paDern   event  Kinect matcher processorsensor data GEF3D-­‐based   visualiza2on Full  model   update  at  ~20   Recognized FPS gesture  sequences
    • EMF-­‐IncQuery§ High  performance  incremental  paDern  matcher o Provides  on-­‐the-­‐fly  model  query  evalua2on  performance  for   complex  queries  over  very  large  EMF  instance  models o Typical  use  cases:  on-­‐the-­‐fly  valida2on,  view  maintenance/ abstract  databinding,  derived  edges/aDributes,  …§ Coming  in  the  following  weeks  to  Eclipse  Modeling§ Version  0.6.7  available  from o The  Eclipse  Marketplace o hDp://viatra.inf.mit.bme.hu/incquery§ Featured  at  EclipseCon  Europe  2012: Fast,  Faster  and  Super-­‐fast  Model  Queries (Ed  Willink  and  István  Ráth)