Bokode: ankit mohan, grace woo, shinsaku hiura, quinn smithwick, ramesh raskar camera culture group, MIT media lab imperce...
 
 
ideal barcode invisible  to the  human eye ; easily  decodable  by a  machine. Bokode
visible light barcodes space [UPC Code, QR Code, Data Matrix Code, Shot Code, Microsoft Tag, …] angle Bokode  –  this pape...
barcode ( spatial) camera sensor
camera sensor barcode ( space)
<ul><li>image much smaller; </li></ul><ul><li>refocus if distance changes </li></ul>camera sensor barcode ( space)
sensor Bokode ( angle) camera
<ul><li>“ ahh… circle of confusion    circle of information” </li></ul><ul><li>- Kurt Akeley </li></ul>camera Bokode ( an...
Bokode f b generate  directionally encoded information
Bokode camera f b capture  directionally encoded information f c
<ul><li>magnification =  f c  /f b  (microscope) ; </li></ul><ul><li>focus always at infinity </li></ul>Bokode camera f b ...
Bokode: any barcode pattern datamatrix code (42,245,123)
tiled datamatrix codes
identity  from Bokode id = (42,245,123)
prototype – assembled
prototype – exploded led:  120 °  view angle, 1350mcd  pattern:  15µm resolution lenslet:  f=8mm, Φ=3mm cost:  ~$5
capturing Bokodes focus blur (85mm f/1.8; infinity focus) motion blur (50mm f/8; ~2cm motion)
street-view tagging
capturing Bokodes cell-phone camera close to the Bokode (10,000+ bytes of data)
 
<ul><li>smaller aperture    less of Bokode imaged </li></ul>Bokode camera f b f c
<ul><li>smaller aperture    less of Bokode imaged </li></ul>Bokode camera f b f c
Bokode camera f b f c less distance    more of Bokode imaged
less distance    more of Bokode imaged  Bokode camera f b f c
Bokode f b Bokode image depends on camera angle camera
Bokode f b f c Bokode image depends on camera angle camera
camera x y id=42 x=9 y=5 id=42 x=9 y=6 id=42 x=9 y=7 id=42 x=7 y=5 id=42 x=7 y=6 id=42 x=7 y=7 id=42,x=8,y=7 id=42,x=8,y=5
digital angle  from Bokode id = (42, 10,7 )
 
traditional AR markers ARToolKit [ Kato and Billinghurst 1999] ARTag [ Fiala 2005] skew of marker
angle estimation robustness
 
retro-reflector for passive Bokode
wide field of view Bokode via Krill eye compound superposition optics  [Hiura et al. 2009]
<ul><li>overlapping Bokodes </li></ul><ul><li>auto-exposure / motion blur </li></ul><ul><li>angular range (+/-20°) </li></...
barcode RFID Bokode encoding spatial rf modulation angular decoder camera dedicated reader camera geometry no no yes physi...
user interaction applications
tabletop/surface interaction <ul><li>stylus based interaction </li></ul><ul><li>identity </li></ul><ul><li>position </li><...
multi-user interaction Bokode laser pointers
<ul><li>barcodes using angular coding & decoding </li></ul><ul><li>generating Bokodes </li></ul><ul><li>capturing Bokodes ...
acknowledgements meng  heng touch, donald eng,  daniel taub  paula aguilera, eugene wu andy lippman masahiko inami frank m...
<ul><li>barcodes using angular coding & decoding </li></ul><ul><li>generating Bokodes </li></ul><ul><li>capturing Bokodes ...
Upcoming SlideShare
Loading in …5
×

Bokode Siggraph 2009

32,205 views

Published on

http://bokode.com

We present a new low-cost optical design so that the tags can be shrunk to 3mm visible diameter, and unmodified ordinary cameras several meters away can be set up to decode the identity plus the relative distance and angle. The design exploits the bokeh effect of ordinary cameras lenses, which maps rays exiting from an out of focus scene point into a disk like blur on the camera sensor. We show that an off-the-shelf camera can capture Bokode features of 2.5 microns from a distance of over 4 meters. We use intelligent binary coding to estimate the relative distance and angle to the camera, and show potential for applications in augmented reality and motion capture.

Published in: Technology, Business
0 Comments
6 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
32,205
On SlideShare
0
From Embeds
0
Number of Embeds
31,237
Actions
Shares
0
Downloads
98
Comments
0
Likes
6
Embeds 0
No embeds

No notes for slide
  • jointly
  • Hold it up
  • Mention that it works upto ~2 meters with a bokode mask of 15µm resolution and a 85/1.8 lens
  • Mention that it works upto ~2 meters with a bokode mask of 15µm resolution and a 85/1.8 lens
  • Perspective skew
  • Jointly generate and capture 2 microns  4 meters away
  • 2 microns  4 meters away
  • Bokode Siggraph 2009

    1. 1. Bokode: ankit mohan, grace woo, shinsaku hiura, quinn smithwick, ramesh raskar camera culture group, MIT media lab imperceptible visual tags for camera based interaction from a distance
    2. 4. ideal barcode invisible to the human eye ; easily decodable by a machine. Bokode
    3. 5. visible light barcodes space [UPC Code, QR Code, Data Matrix Code, Shot Code, Microsoft Tag, …] angle Bokode – this paper standard camera focused at infinity + time [IR remote, Sony ID CAM]
    4. 6. barcode ( spatial) camera sensor
    5. 7. camera sensor barcode ( space)
    6. 8. <ul><li>image much smaller; </li></ul><ul><li>refocus if distance changes </li></ul>camera sensor barcode ( space)
    7. 9. sensor Bokode ( angle) camera
    8. 10. <ul><li>“ ahh… circle of confusion  circle of information” </li></ul><ul><li>- Kurt Akeley </li></ul>camera Bokode ( angle) sensor
    9. 11. Bokode f b generate directionally encoded information
    10. 12. Bokode camera f b capture directionally encoded information f c
    11. 13. <ul><li>magnification = f c /f b (microscope) ; </li></ul><ul><li>focus always at infinity </li></ul>Bokode camera f b f c infinity-corrected microscope
    12. 14. Bokode: any barcode pattern datamatrix code (42,245,123)
    13. 15. tiled datamatrix codes
    14. 16. identity from Bokode id = (42,245,123)
    15. 17. prototype – assembled
    16. 18. prototype – exploded led: 120 ° view angle, 1350mcd pattern: 15µm resolution lenslet: f=8mm, Φ=3mm cost: ~$5
    17. 19. capturing Bokodes focus blur (85mm f/1.8; infinity focus) motion blur (50mm f/8; ~2cm motion)
    18. 20. street-view tagging
    19. 21. capturing Bokodes cell-phone camera close to the Bokode (10,000+ bytes of data)
    20. 23. <ul><li>smaller aperture  less of Bokode imaged </li></ul>Bokode camera f b f c
    21. 24. <ul><li>smaller aperture  less of Bokode imaged </li></ul>Bokode camera f b f c
    22. 25. Bokode camera f b f c less distance  more of Bokode imaged
    23. 26. less distance  more of Bokode imaged Bokode camera f b f c
    24. 27. Bokode f b Bokode image depends on camera angle camera
    25. 28. Bokode f b f c Bokode image depends on camera angle camera
    26. 29. camera x y id=42 x=9 y=5 id=42 x=9 y=6 id=42 x=9 y=7 id=42 x=7 y=5 id=42 x=7 y=6 id=42 x=7 y=7 id=42,x=8,y=7 id=42,x=8,y=5
    27. 30. digital angle from Bokode id = (42, 10,7 )
    28. 32. traditional AR markers ARToolKit [ Kato and Billinghurst 1999] ARTag [ Fiala 2005] skew of marker
    29. 33. angle estimation robustness
    30. 35. retro-reflector for passive Bokode
    31. 36. wide field of view Bokode via Krill eye compound superposition optics [Hiura et al. 2009]
    32. 37. <ul><li>overlapping Bokodes </li></ul><ul><li>auto-exposure / motion blur </li></ul><ul><li>angular range (+/-20°) </li></ul><ul><li>thickness  holographic Bokode </li></ul>limitations / future work 25° 20° 15° 10° 0°
    33. 38. barcode RFID Bokode encoding spatial rf modulation angular decoder camera dedicated reader camera geometry no no yes physical size ~ cm ~ cm ~ mm cost ~ free ~ $0.05 ~ $0.05 (currently $5) range ~ cm ~ cm ~ m (with large aperture lens) line of sight yes no yes
    34. 39. user interaction applications
    35. 40. tabletop/surface interaction <ul><li>stylus based interaction </li></ul><ul><li>identity </li></ul><ul><li>position </li></ul><ul><li>angle </li></ul>
    36. 41. multi-user interaction Bokode laser pointers
    37. 42. <ul><li>barcodes using angular coding & decoding </li></ul><ul><li>generating Bokodes </li></ul><ul><li>capturing Bokodes </li></ul><ul><li>digital angle + pose </li></ul><ul><li>AR, motion capture, UI </li></ul>conclusions
    38. 43. acknowledgements meng heng touch, donald eng, daniel taub paula aguilera, eugene wu andy lippman masahiko inami frank moss
    39. 44. <ul><li>barcodes using angular coding & decoding </li></ul><ul><li>generating Bokodes </li></ul><ul><li>capturing Bokodes </li></ul><ul><li>digital angle + pose </li></ul><ul><li>AR, motion capture, UI </li></ul>http://bokode.com

    ×