RFIG/Bokode talk at RFID Journal 2010

2,562 views

Published on

RFIG/Bokode talk at RFID Journal 2010

1 Comment
3 Likes
Statistics
Notes
  • thank you
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total views
2,562
On SlideShare
0
From Embeds
0
Number of Embeds
7
Actions
Shares
0
Downloads
58
Comments
1
Likes
3
Embeds 0
No embeds

No notes for slide
  • jointly
  • Hold it up
  • Mention that it works upto ~2 meters with a bokode mask of 15µm resolution and a 85/1.8 lens
  • Perspective skew
  • Jointly generate and capture 2 microns  4 meters away
  • 2 microns  4 meters away
  • Mention that it works upto ~2 meters with a bokode mask of 15µm resolution and a 85/1.8 lens
  • RFIG/Bokode talk at RFID Journal 2010

    1. 1. Bokode: Ankit Mohan Camera Culture Group, MIT Media Lab Imperceptible Visual Tags for Camera Based Interaction From a Distance
    2. 2. Camera Culture Ramesh Raskar We focus on creating tools to better capture and share visual information http://www.cameraculture.info
    3. 3. location of tagged books in a library <ul><ul><ul><li>Id : list of books in RF range </li></ul></ul></ul><ul><li>no precise location data </li></ul><ul><li>are books in sorted order? which book is upside down? </li></ul>
    4. 4. RFI G = RF Id + Geometry Find tag location using handheld Projector Photosensing Wireless Tags Many geometric ops Interactive stabilized projection location of photosensitive tags using a hand-held projector
    5. 5. RFIG prototype setup Tag Modified Projector
    6. 6. RFI G = RF Id + Geometry
    7. 7. custom designed projector <ul><li>500 Hz </li></ul><ul><li>27° fov </li></ul><ul><ul><li>0.1° angular resolution </li></ul></ul><ul><ul><li>~5mm @ 3m accuracy </li></ul></ul>
    8. 8. Prakash: motion capture by space labelling
    9. 11. ideal barcode invisible to the human eye ; easily decodable by a machine. Bokode
    10. 12. visible light barcodes space [UPC Code, QR Code, Data Matrix Code, Shot Code, Microsoft Tag, …] angle Bokode – this paper standard camera focused at infinity + time [IR remote, Sony ID CAM]
    11. 13. barcode ( spatial) camera sensor
    12. 14. camera sensor barcode ( space)
    13. 15. <ul><li>image much smaller; </li></ul><ul><li>refocus if distance changes </li></ul>camera sensor barcode ( space)
    14. 16. sensor Bokode ( angle) camera
    15. 17. <ul><li>“ ahh… circle of confusion  circle of information” </li></ul><ul><li>- Kurt Akeley </li></ul>camera Bokode ( angle) sensor
    16. 18. Bokode f b generate directionally encoded information
    17. 19. Bokode camera f b capture directionally encoded information f c
    18. 20. <ul><li>magnification = f c /f b (microscope) ; </li></ul><ul><li>focus always at infinity </li></ul>Bokode camera f b f c infinity-corrected microscope
    19. 21. Bokode: any barcode pattern datamatrix code (42,245,123)
    20. 22. tiled datamatrix codes
    21. 23. identity from Bokode id = (42,245,123)
    22. 24. prototype – assembled
    23. 25. prototype – exploded led: 120 ° view angle, 1350mcd pattern: 15µm resolution lenslet: f=8mm, Φ=3mm cost: ~$5
    24. 26. capturing Bokodes focus blur (85mm f/1.8; infinity focus) motion blur (50mm f/8; ~2cm motion)
    25. 27. street-view tagging
    26. 28. capturing Bokodes cell-phone camera close to the Bokode (10,000+ bytes of data)
    27. 29. Bokode f b Bokode image depends on camera angle camera
    28. 30. Bokode f b f c Bokode image depends on camera angle camera
    29. 31. camera x y id=42 x=9 y=5 id=42 x=9 y=6 id=42 x=9 y=7 id=42 x=7 y=5 id=42 x=7 y=6 id=42 x=7 y=7 id=42,x=8,y=7 id=42,x=8,y=5
    30. 32. digital angle from Bokode id = (42, 10,7 )
    31. 34. traditional AR markers ARToolKit [ Kato and Billinghurst 1999] ARTag [ Fiala 2005] skew of marker
    32. 35. angle estimation robustness
    33. 37. retro-reflector for passive Bokode
    34. 38. wide field of view Bokode via Krill eye compound superposition optics [Hiura et al. 2009]
    35. 39. <ul><li>overlapping Bokodes </li></ul><ul><li>auto-exposure / motion blur </li></ul><ul><li>angular range (+/-20°) </li></ul><ul><li>thickness  holographic Bokode </li></ul>limitations / future work 25° 20° 15° 10° 0°
    36. 40. barcode RFID Bokode encoding spatial rf modulation angular decoder camera dedicated reader camera geometry no no yes physical size ~ cm ~ cm ~ mm cost ~ free ~ $0.05 ~ $0.05 (currently $5) range ~ cm ~ cm ~ m (with large aperture lens) line of sight yes no yes
    37. 41. user interaction applications
    38. 42. tabletop/surface interaction <ul><li>stylus based interaction </li></ul><ul><li>identity </li></ul><ul><li>position </li></ul><ul><li>angle </li></ul>
    39. 43. multi-user interaction Bokode laser pointers
    40. 44. near field communication Bokode camera cell phone 1 Bokode camera cell phone 2
    41. 45. <ul><li>barcodes using angular coding & decoding </li></ul><ul><li>generating Bokodes </li></ul><ul><li>capturing Bokodes </li></ul><ul><li>digital angle + pose </li></ul><ul><li>AR, motion capture, UI </li></ul>conclusions
    42. 46. acknowledgements meng heng touch, donald eng, daniel taub grace woo shinsaku hiura quinn smithwick ramesh raskar
    43. 47. <ul><li>Collaborators Welcome! </li></ul>http://bokode.com
    44. 48. <ul><li>barcodes using angular coding & decoding </li></ul><ul><li>generating Bokodes </li></ul><ul><li>capturing Bokodes </li></ul><ul><li>digital angle + pose </li></ul><ul><li>AR, motion capture, UI </li></ul>http://bokode.com
    45. 49. barcode RFID Bokode encoding spatial rf modulation angular decoder camera dedicated reader camera geometry ~ no yes physical size ~ cm ~ cm ~ mm cost ~ free ~ $0.05 ~ $0.05 (currently $5) range ~ cm ~ cm ~ m (with large aperture lens) line of sight yes no yes
    46. 50. http://bokode.com
    47. 51. Barcodes markers that assist machines in understanding the real world
    48. 52. <ul><li>smaller aperture  less of Bokode imaged </li></ul>Bokode camera f b f c
    49. 53. <ul><li>smaller aperture  less of Bokode imaged </li></ul>Bokode camera f b f c
    50. 54. Bokode camera f b f c less distance  more of Bokode imaged
    51. 55. less distance  more of Bokode imaged Bokode camera f b f c

    ×