• Save
201004 - Natural User Interfaces
Upcoming SlideShare
Loading in...5
×

Like this? Share it with your network

Share
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
1,691
On Slideshare
1,432
From Embeds
259
Number of Embeds
5

Actions

Shares
Downloads
0
Comments
0
Likes
2

Embeds 259

http://www.artofwa.com.au 162
http://javiergs.com 87
http://www.slideshare.net 8
http://webcache.googleusercontent.com 1
http://translate.googleusercontent.com 1

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Natural  User  Interface  (NUI):   A  new  era  for  the   Human  Computer  Interac:on   Arizona  State  University  
  • 2. 1.     THE  COMPUTER  FROM  THE  HUMAN  POINT  OF  VIEW  
  • 3. It  is  a  box  
  • 4. …  with  a  lot  of  things  inside      C  /  C++      Java      PHP      Ajax      Drupal      Security      3D  Games      AI  
  • 5. …  and  networking      IPv6      Protocols      Security      Wi-­‐Max      Internet  
  • 6. …  a  complete  virtual  world      Cloud            compuPng      Web  2.0      Parallel          compuPng      VirtualizaPon      Ubiquitous      compuPng  
  • 7. computers   •   They  are  intelligent  things   •   They  are  able  to  communicate            among  them   •   They  get  smaller  and  smaller        everyday  
  • 8. 2.     THE  HUMAN  FROM  THE  COMPUTER  POINT  OF  VIEW  
  • 9. in  black  and  white      Inert      With  out  emoPons  
  • 10. in  color   EYES   FINGERS  
  • 11. 3.     WHAT  IS  INTERACTION?    
  • 12. to  have  a  rela:onship…  
  • 13. this  is  interac:on  !  
  • 14. 4.     NATURAL  INTERFACES  
  • 15. context  
  • 16. introduc:on   What  is  Natural?        Opposite  to  ArPficial  (produced  by  the  human).   What  is  an  interface?        Physical  and  funcPonal  connecPon      between  two  independent  devices  or  systems.  
  • 17. introduc:on  
  • 18. what  is  natural  ?   1.  EmoPons                Face-­‐based  emoPon  recogniPon   2.    Thoughts              Brain-­‐Computer  Interface   3.  Symbols                Pa^ern  recogniPon   4.      Movements          MoPon  capture  
  • 19. 1.     Iden:fying  emo:ons  
  • 20. vision  -­‐  based   ?  
  • 21. facial  analysis     Based  on  a  MIT  Media  Lab  project  soVware  MindReader  API  that  enables  the   real  Pme  analysis,  tagging  and  inference  of  cogniPve  affecPve  mental  states   from  facial  video.       This  framework  combines  vision-­‐based  processing  of  the  face  with  predicPons   of  mental  state  models  to  interpret  the  meaning  underlying  head  and  facial   signals  overPme.       (Ekman  and  Friesen  1978)  –  Facial  Ac:on  Coding  System,  46  ac:ons  (plus  head   movements).     Standard  to  systemaPcally  categorize  the  physical  expression  of  emoPons,  and  it   has  proven  useful  to  psychologists  and  to  animators.  
  • 22. mindreader  API  
  • 23. mindreader  API  
  • 24. Uses      InteresPng      Agreeing      Concentrated      Disagreeing      Thinking      Unsecure  
  • 25. 2.     Telepathy  with  the  computer  
  • 26. Web  
  • 27. web  5.0  
  • 28. how  does  it  works  ?  
  • 29. comercial  product  
  • 30. how  much  it  cost  ?  
  • 31. summary      cogniPve  states.          NEUTRAL,  PUSH,  PULL,  LIFT,  DROP,  LEFT,  RIGHT,  ROTATE_LEFT,          ROTATE_RIGHT  ,  ROTATE_CLOCKWISE,  ROTATE_COUNTER_CLOCKWISE,          ROTATE_FORWARDS    ROTATE_REVERSE,    DISAPPEAR        expressive  states.          BLINK,  WINK_LEFT,  WINK_RIGHT,  HORIEYE,  EYEBROW,  FURROW,              SMILE,  CLENCH,  LAUGH,  SMIRK_LEFT,  SMIRK_RIGHT        affecPve  emoPonal  states        EXCITEMENT,  MEDITATION,  FRUSTRATION,  ENGAGEMENT,  BOREDOM    
  • 32. 3.   Symbols  
  • 33. symbols   pa^ern  recogniPon  
  • 34. reac:vision.sourceforge.net  
  • 35. 4.   Mo:on  capture  
  • 36. Natal  project   picture:  Microsok  Project  Natal  
  • 37. Processing.org   Processing  is  an  “open  source”  programming  language  and  an  environment  for   people  who  wants  to  program  with  images,  animaPons  and  interacPon.   Processing  is  free  and  it  available  for  GNU/Linux,  Mac  OS  X,  and  Windows.     Processing  is  a  project  leaded  by  Ben  Fry  and  Casey  Reas.  It  has  been  evolved   from  the  ideas  of  groups  such  as  Aestethics  and  CompuPng  Lab  at  the  MIT.  
  • 38. 5.     CONCLUSION  
  • 39. summary