201004 - Natural User Interfaces

1,414
-1

Published on

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,414
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
0
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

201004 - Natural User Interfaces

  1. 1. Natural  User  Interface  (NUI):   A  new  era  for  the   Human  Computer  Interac:on   Arizona  State  University  
  2. 2. 1.     THE  COMPUTER  FROM  THE  HUMAN  POINT  OF  VIEW  
  3. 3. It  is  a  box  
  4. 4. …  with  a  lot  of  things  inside      C  /  C++      Java      PHP      Ajax      Drupal      Security      3D  Games      AI  
  5. 5. …  and  networking      IPv6      Protocols      Security      Wi-­‐Max      Internet  
  6. 6. …  a  complete  virtual  world      Cloud            compuPng      Web  2.0      Parallel          compuPng      VirtualizaPon      Ubiquitous      compuPng  
  7. 7. computers   •   They  are  intelligent  things   •   They  are  able  to  communicate            among  them   •   They  get  smaller  and  smaller        everyday  
  8. 8. 2.     THE  HUMAN  FROM  THE  COMPUTER  POINT  OF  VIEW  
  9. 9. in  black  and  white      Inert      With  out  emoPons  
  10. 10. in  color   EYES   FINGERS  
  11. 11. 3.     WHAT  IS  INTERACTION?    
  12. 12. to  have  a  rela:onship…  
  13. 13. this  is  interac:on  !  
  14. 14. 4.     NATURAL  INTERFACES  
  15. 15. context  
  16. 16. introduc:on   What  is  Natural?        Opposite  to  ArPficial  (produced  by  the  human).   What  is  an  interface?        Physical  and  funcPonal  connecPon      between  two  independent  devices  or  systems.  
  17. 17. introduc:on  
  18. 18. what  is  natural  ?   1.  EmoPons                Face-­‐based  emoPon  recogniPon   2.    Thoughts              Brain-­‐Computer  Interface   3.  Symbols                Pa^ern  recogniPon   4.      Movements          MoPon  capture  
  19. 19. 1.     Iden:fying  emo:ons  
  20. 20. vision  -­‐  based   ?  
  21. 21. facial  analysis     Based  on  a  MIT  Media  Lab  project  soVware  MindReader  API  that  enables  the   real  Pme  analysis,  tagging  and  inference  of  cogniPve  affecPve  mental  states   from  facial  video.       This  framework  combines  vision-­‐based  processing  of  the  face  with  predicPons   of  mental  state  models  to  interpret  the  meaning  underlying  head  and  facial   signals  overPme.       (Ekman  and  Friesen  1978)  –  Facial  Ac:on  Coding  System,  46  ac:ons  (plus  head   movements).     Standard  to  systemaPcally  categorize  the  physical  expression  of  emoPons,  and  it   has  proven  useful  to  psychologists  and  to  animators.  
  22. 22. mindreader  API  
  23. 23. mindreader  API  
  24. 24. Uses      InteresPng      Agreeing      Concentrated      Disagreeing      Thinking      Unsecure  
  25. 25. 2.     Telepathy  with  the  computer  
  26. 26. Web  
  27. 27. web  5.0  
  28. 28. how  does  it  works  ?  
  29. 29. comercial  product  
  30. 30. how  much  it  cost  ?  
  31. 31. summary      cogniPve  states.          NEUTRAL,  PUSH,  PULL,  LIFT,  DROP,  LEFT,  RIGHT,  ROTATE_LEFT,          ROTATE_RIGHT  ,  ROTATE_CLOCKWISE,  ROTATE_COUNTER_CLOCKWISE,          ROTATE_FORWARDS    ROTATE_REVERSE,    DISAPPEAR        expressive  states.          BLINK,  WINK_LEFT,  WINK_RIGHT,  HORIEYE,  EYEBROW,  FURROW,              SMILE,  CLENCH,  LAUGH,  SMIRK_LEFT,  SMIRK_RIGHT        affecPve  emoPonal  states        EXCITEMENT,  MEDITATION,  FRUSTRATION,  ENGAGEMENT,  BOREDOM    
  32. 32. 3.   Symbols  
  33. 33. symbols   pa^ern  recogniPon  
  34. 34. reac:vision.sourceforge.net  
  35. 35. 4.   Mo:on  capture  
  36. 36. Natal  project   picture:  Microsok  Project  Natal  
  37. 37. Processing.org   Processing  is  an  “open  source”  programming  language  and  an  environment  for   people  who  wants  to  program  with  images,  animaPons  and  interacPon.   Processing  is  free  and  it  available  for  GNU/Linux,  Mac  OS  X,  and  Windows.     Processing  is  a  project  leaded  by  Ben  Fry  and  Casey  Reas.  It  has  been  evolved   from  the  ideas  of  groups  such  as  Aestethics  and  CompuPng  Lab  at  the  MIT.  
  38. 38. 5.     CONCLUSION  
  39. 39. summary  

×