Your SlideShare is downloading. ×
Natural	
  User	
  Interface	
  (NUI):	
  
                   A	
  new	
  era	
  for	
  the	
  
       Human	
  Computer	
...
1.	
  	
  

THE	
  COMPUTER	
  FROM	
  THE	
  HUMAN	
  POINT	
  OF	
  VIEW	
  
It	
  is	
  a	
  box	
  
…	
  with	
  a	
  lot	
  of	
  things	
  inside	
  




                       	
  C	
  /	
  C++	
  

                   ...
…	
  and	
  networking	
  



    	
  IPv6	
  

    	
  Protocols	
  

    	
  Security	
  

    	
  Wi-­‐Max	
  

   ...
…	
  a	
  complete	
  virtual	
  world	
  



                	
  Cloud	
  	
  	
  
               	
  	
  	
  compuPng	
...
computers	
  




• 	
  They	
  are	
  intelligent	
  things	
  

• 	
  They	
  are	
  able	
  to	
  communicate	
  	
  	
...
2.	
  	
  

THE	
  HUMAN	
  FROM	
  THE	
  COMPUTER	
  POINT	
  OF	
  VIEW	
  
in	
  black	
  and	
  white	
  




 	
  Inert	
  

 	
  With	
  out	
  emoPons	
  
in	
  color	
  




              EYES	
  




FINGERS	
  
3.	
  	
  

WHAT	
  IS	
  INTERACTION?	
  	
  
to	
  have	
  a	
  rela:onship…	
  
this	
  is	
  interac:on	
  !	
  
4.	
  	
  

NATURAL	
  INTERFACES	
  
context	
  
introduc:on	
  



What	
  is	
  Natural?	
  

 	
  	
  Opposite	
  to	
  ArPficial	
  (produced	
  by	
  the	
  human).	
...
introduc:on	
  
what	
  is	
  natural	
  ?	
  



1.  EmoPons	
  
	
  	
  	
  	
  	
  	
  	
  Face-­‐based	
  emoPon	
  recogniPon	
  



...
1.	
  	
  
Iden:fying	
  emo:ons	
  
vision	
  -­‐	
  based	
  




  ?	
  
facial	
  analysis	
  



  Based	
  on	
  a	
  MIT	
  Media	
  Lab	
  project	
  soVware	
  MindReader	
  API	
  that	
 ...
mindreader	
  API	
  
mindreader	
  API	
  
Uses	
  




 	
  InteresPng	
  

 	
  Agreeing	
  

 	
  Concentrated	
  

 	
  Disagreeing	
  

 	
  Thinking	
  

...
2.	
  	
  
Telepathy	
  with	
  the	
  computer	
  
Web	
  
web	
  5.0	
  
how	
  does	
  it	
  works	
  ?	
  
comercial	
  product	
  
how	
  much	
  it	
  cost	
  ?	
  
summary	
  



 	
  cogniPve	
  states.	
  	
  

	
  	
  	
  NEUTRAL,	
  PUSH,	
  PULL,	
  LIFT,	
  DROP,	
  LEFT,	
  RIG...
3.	
  
Symbols	
  
symbols	
  




pa^ern	
  recogniPon	
  
reac:vision.sourceforge.net	
  
4.	
  
Mo:on	
  capture	
  
Natal	
  project	
  




picture:	
  Microsok	
  Project	
  Natal	
  
Processing.org	
  



Processing	
  is	
  an	
  “open	
  source”	
  programming	
  language	
  and	
  an	
  environment	
 ...
5.	
  	
  

CONCLUSION	
  
summary	
  
201004 - Natural User Interfaces
Upcoming SlideShare
Loading in...5
×

201004 - Natural User Interfaces

1,338

Published on

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,338
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
0
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Transcript of "201004 - Natural User Interfaces"

  1. 1. Natural  User  Interface  (NUI):   A  new  era  for  the   Human  Computer  Interac:on   Arizona  State  University  
  2. 2. 1.     THE  COMPUTER  FROM  THE  HUMAN  POINT  OF  VIEW  
  3. 3. It  is  a  box  
  4. 4. …  with  a  lot  of  things  inside      C  /  C++      Java      PHP      Ajax      Drupal      Security      3D  Games      AI  
  5. 5. …  and  networking      IPv6      Protocols      Security      Wi-­‐Max      Internet  
  6. 6. …  a  complete  virtual  world      Cloud            compuPng      Web  2.0      Parallel          compuPng      VirtualizaPon      Ubiquitous      compuPng  
  7. 7. computers   •   They  are  intelligent  things   •   They  are  able  to  communicate            among  them   •   They  get  smaller  and  smaller        everyday  
  8. 8. 2.     THE  HUMAN  FROM  THE  COMPUTER  POINT  OF  VIEW  
  9. 9. in  black  and  white      Inert      With  out  emoPons  
  10. 10. in  color   EYES   FINGERS  
  11. 11. 3.     WHAT  IS  INTERACTION?    
  12. 12. to  have  a  rela:onship…  
  13. 13. this  is  interac:on  !  
  14. 14. 4.     NATURAL  INTERFACES  
  15. 15. context  
  16. 16. introduc:on   What  is  Natural?        Opposite  to  ArPficial  (produced  by  the  human).   What  is  an  interface?        Physical  and  funcPonal  connecPon      between  two  independent  devices  or  systems.  
  17. 17. introduc:on  
  18. 18. what  is  natural  ?   1.  EmoPons                Face-­‐based  emoPon  recogniPon   2.    Thoughts              Brain-­‐Computer  Interface   3.  Symbols                Pa^ern  recogniPon   4.      Movements          MoPon  capture  
  19. 19. 1.     Iden:fying  emo:ons  
  20. 20. vision  -­‐  based   ?  
  21. 21. facial  analysis     Based  on  a  MIT  Media  Lab  project  soVware  MindReader  API  that  enables  the   real  Pme  analysis,  tagging  and  inference  of  cogniPve  affecPve  mental  states   from  facial  video.       This  framework  combines  vision-­‐based  processing  of  the  face  with  predicPons   of  mental  state  models  to  interpret  the  meaning  underlying  head  and  facial   signals  overPme.       (Ekman  and  Friesen  1978)  –  Facial  Ac:on  Coding  System,  46  ac:ons  (plus  head   movements).     Standard  to  systemaPcally  categorize  the  physical  expression  of  emoPons,  and  it   has  proven  useful  to  psychologists  and  to  animators.  
  22. 22. mindreader  API  
  23. 23. mindreader  API  
  24. 24. Uses      InteresPng      Agreeing      Concentrated      Disagreeing      Thinking      Unsecure  
  25. 25. 2.     Telepathy  with  the  computer  
  26. 26. Web  
  27. 27. web  5.0  
  28. 28. how  does  it  works  ?  
  29. 29. comercial  product  
  30. 30. how  much  it  cost  ?  
  31. 31. summary      cogniPve  states.          NEUTRAL,  PUSH,  PULL,  LIFT,  DROP,  LEFT,  RIGHT,  ROTATE_LEFT,          ROTATE_RIGHT  ,  ROTATE_CLOCKWISE,  ROTATE_COUNTER_CLOCKWISE,          ROTATE_FORWARDS    ROTATE_REVERSE,    DISAPPEAR        expressive  states.          BLINK,  WINK_LEFT,  WINK_RIGHT,  HORIEYE,  EYEBROW,  FURROW,              SMILE,  CLENCH,  LAUGH,  SMIRK_LEFT,  SMIRK_RIGHT        affecPve  emoPonal  states        EXCITEMENT,  MEDITATION,  FRUSTRATION,  ENGAGEMENT,  BOREDOM    
  32. 32. 3.   Symbols  
  33. 33. symbols   pa^ern  recogniPon  
  34. 34. reac:vision.sourceforge.net  
  35. 35. 4.   Mo:on  capture  
  36. 36. Natal  project   picture:  Microsok  Project  Natal  
  37. 37. Processing.org   Processing  is  an  “open  source”  programming  language  and  an  environment  for   people  who  wants  to  program  with  images,  animaPons  and  interacPon.   Processing  is  free  and  it  available  for  GNU/Linux,  Mac  OS  X,  and  Windows.     Processing  is  a  project  leaded  by  Ben  Fry  and  Casey  Reas.  It  has  been  evolved   from  the  ideas  of  groups  such  as  Aestethics  and  CompuPng  Lab  at  the  MIT.  
  38. 38. 5.     CONCLUSION  
  39. 39. summary  

×