Ar techniques@sergi grau

1,113 views

Published on

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,113
On SlideShare
0
From Embeds
0
Number of Embeds
7
Actions
Shares
0
Downloads
11
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Ar techniques@sergi grau

  1. 1. Augmented  reality  techniques Sergi  Grau  Carrión   http://sergigrau.cat   @sergi_grau
  2. 2. Adapted  milgram's  VR-­‐AR   continuum http://en.wikipedia.org/wiki/File:Adapted_milgrams_VR-­‐AR_continuum.png
  3. 3. Virtual  reality  -­‐  Immersive http://www.youtube.com/watch?v=yf0sllpZx3w
  4. 4. Virtual  reality  -­‐  Immersive http://www.youtube.com/watch?v=WYG7xGFByJ8
  5. 5. Virtual  reality  -­‐  Semi  immersive http://www.youtube.com/watch?v=7MVyT1lgGGQ
  6. 6. Adapted  milgram's  VR-­‐AR   continuum http://en.wikipedia.org/wiki/File:Adapted_milgrams_VR-­‐AR_continuum.png
  7. 7. Augmented  reality Started  in  1957  (Roosevelt  home)
  8. 8. Augmented  reality http://www.youtube.com/watch?v=DjevdT5XpFw
  9. 9. Augmented  reality
  10. 10. Augmented  reality
  11. 11. Augmented  reality
  12. 12. Augmented  reality See-­‐through
  13. 13. Augmented  reality Monitor  based
  14. 14. Augmented  reality
  15. 15. Augmented  reality
  16. 16. Augmented  reality
  17. 17. Adapted  milgram's  VR-­‐AR   continuum http://en.wikipedia.org/wiki/File:Adapted_milgrams_VR-­‐AR_continuum.png
  18. 18. TUI
  19. 19. TUI http://www.ted.com/talks/david_merrill_demos_siftables_the_smart_blocks.html
  20. 20. TUI https://vimeo.com/82277562
  21. 21. Adapted  Virtuality-­‐Reality   continuum http://en.wikipedia.org/wiki/File:Adapted_milgrams_VR-­‐AR_continuum.png
  22. 22. Augmented  Reality Capture  real  world   Computer  Vision Capture  virtual  world   Computer  Graphics http://wearables.unisa.edu.au
  23. 23. Diminished  reality http://www.youtube.com/watch?v=FgTq-­‐AgYlTE
  24. 24. Diminished  reality http://tangible.media.mit.edu/project/focalspace/
  25. 25. Ingredients  for  successful  AR  
  26. 26. http://www.youtube.com/watch?v=yDjHbLjtL-­‐c
  27. 27. Environment  analysis + Realistic  augmentation
  28. 28. Environment  analysis Real-­‐time  3D  tracking  of  user  viewpoint  w.r.t.  World • • • • • Geolocalization   Electro-­‐magnetic   Acoustic   Inertial   Vision-­‐based  (active  or  passive)
  29. 29. Image-­‐based  3D  tracking Inside-­‐out
  30. 30. Image-­‐based  3D  tracking Outside-­‐in
  31. 31. OpenCV http://www.youtube.com/watch?v=Z43_hCM74rU
  32. 32. Color  tracking
  33. 33. Hand  tracking http://www.youtube.com/watch?v=B4dwu3si9x0
  34. 34. Hand  Tracking http://www.youtube.com/watch?v=CYJjQgV0mZY
  35. 35. Optical  Flow Optical  Flow http://www.youtube.com/watch?v=5rR_9YIcg_s
  36. 36. Optical  Flow http://www.youtube.com/watch?v=1D93RmW_eN4
  37. 37. Optical  Flow http://www.youtube.com/watch?v=C95bngCOv9Q
  38. 38. Optical  Flow http://www.youtube.com/watch?v=0L34HsXXU00
  39. 39. Face  tracking http://www.youtube.com/watch?v=JyBMxeVCQkc
  40. 40. Head  tracking
  41. 41. Face  tracking http://www.youtube.com/watch?v=h9kPI7_vhAU
  42. 42. Face  tracking
  43. 43. Face  tracking
  44. 44. Face  substitution http://auduno.github.io/clmtrackr/examples/facesubstitution.html
  45. 45. Image-­‐based  3D  reconstruction Computer  vision  is  good  at  location  features:   Points   Regions   Textures   Contours   ...
  46. 46. Image-­‐based  3D  reconstruction
  47. 47. Geometry 3D  reconstruction:  what  is  where? Semantic:  augmentation  of  context   Object  recognition   Interpretation  of  content
  48. 48. 3D  reconstruction  of  regions Based  on  planar  equations.   – Hypothesis:  world  is  piece-­‐wise  planar 3D  registration  by  Iterative  Closest  Point  (ICP)
  49. 49. ARToolkit http://www.youtube.com/watch?v=VR12e7WnkxU
  50. 50. ARToolkit http://www.youtube.com/watch?v=YWG4nhdsySE
  51. 51. ARToolkit
  52. 52. ARToolkit Fast  and  cheap  6D  marker  tracking   Easy  calibration  routine:   – Measure  camera  properties:   • Center  point  of  the  camera  image.   • The  lens  distortion.   • Camera  focal  length.   ! ! ! Virtual  objects  appear  only  when  complete  markers  are   visible.
  53. 53. Image  processing
  54. 54. Image  processing
  55. 55. Image  processing
  56. 56. Image  processing
  57. 57. Image  processing
  58. 58. Pattern  matching
  59. 59. Feature  tracking:  SIFT
  60. 60. Markerless  tracking
  61. 61. Depth  cameras Infer  depth  for  ALL  pixels
  62. 62. Depth  cameras Zcam  (3DV  Systems)  2007  –  1.3Megapixel  60fps
  63. 63. ZCam
  64. 64. Kinect http://www.youtube.com/watch?v=YTBvjLGDluY
  65. 65. Kinect http://www.youtube.com/watch?v=NqjopQmqWAE
  66. 66. Kinect
  67. 67. Kinect
  68. 68. Kinect
  69. 69. Motion  capture http://people.csail.mit.edu/rywang/handtracking/handtracking.mov
  70. 70. Motion  capture
  71. 71. Markless  motion  capture http://vimeo.com/33323400
  72. 72. http://structure.io
  73. 73. http://structure.io
  74. 74. Depth  Cameras Solves  the  “where”  but  not  the  “what”:     objects  must  still  be  identified  (segmented)
  75. 75. Realistic  augmentation
  76. 76. Environment  analysis + Realistic  augmentation
  77. 77. Realistic  augmentation ! 2  components:       Geometric  coherency       Lighting  coherency    
  78. 78. CG  Blending
  79. 79. Approximate  real  world  to  simulate  interaction Virtual  in  front  of  real Virtual  behind  real
  80. 80. Light  coherency http://www.kevinkarsch.com/publications/sa11.html
  81. 81. Light  coherency
  82. 82. Light  coherence http://www.youtube.com/watch?v=P3roYysI6pM
  83. 83. Light  probe Aim:  Capture  light  coming  from  light  sources  in  real  world
  84. 84. Light  probe
  85. 85. Light  probe Half-­‐life  2
  86. 86. Light  coherence http://www.youtube.com/watch?v=ihhKLex2Na8
  87. 87. Light  coherence http://handheldar.icg.tugraz.at/
  88. 88. Camera  effects
  89. 89. AR  Hardware
  90. 90. Lumus  DK-­‐40  AR  Glasses Oculus  Rift  ‘Crystal  Cove’ Heapsylon  Sensoria  Fitness  socks LG  Lifeband  Touch Edison-­‐  Intel‘s  Development  Board Sony’s  ‘wearable  HDTV’ Sony  SmartBand Pebble
  91. 91. Google  Glasses
  92. 92. ORA  Glasses http://optinvent.com/
  93. 93. Epson  Moverio  BT-­‐100
  94. 94. Meta  Pro  Glasses
  95. 95. Lumus  HUD  Display
  96. 96. Telepathy  One
  97. 97. NTT  DOCOMO
  98. 98. http://www.reconinstruments.com
  99. 99. vrAse
  100. 100. Reevu  Intelligent  Helmet’s  heads  up  display
  101. 101. Intel  RealSense  3D  camera Creative  Senz3D
  102. 102. SeeSpace  InAir
  103. 103.  i-­‐Air  Touch  Technology
  104. 104. Interaction  and  Collaboration
  105. 105. http://www.youtube.com/watch?v=RlHOhYF_jqM
  106. 106. Interaction  and  Collaboration
  107. 107. http://www.youtube.com/watch?v=Y3TzhXYF0Lg
  108. 108. Augmented  reality  techniques Sergi  Grau  Carrión   http://sergigrau.cat   @sergi_grau

×