The document describes a new technology called Radio Frequency Identification and Geometry (RFIG) that uses photosensing RFID tags and projectors to allow interaction with tagged objects. The tags can sense light and also communicate via radio frequency, allowing their precise locations to be determined using projected patterns. This enables geometric operations and multi-view analysis. The tags and a handheld projector together provide interactive projection capabilities like desktop-like interaction and image stabilization. Potential applications include augmented reality, product tracking, and interactive displays without fixed infrastructure.

1. Ramesh Raskar, Paul Beardsley, Jeroen van Baar, Yao Wang, Paul Dietz, Johnny Lee, Darren Leigh, Thomas Willwacher Mitsubishi Electric Research Labs (MERL), Cambridge, MA R F I G Lamps : Interacting with a Self-describing World via Photosensing Wireless Tags and Projectors

2. Radio Frequency Identification Tags (RFID) microchip Antenna No batteries, Small size, Cost few cents

3. Warehousing Routing Library Baggage handling Currency Livestock tracking

4. Conventional Passive RFID

6. Where are boxes with Products close to Expiry Date ?

7. Conventional RF tag Photo-sensing RF tag

8. Photosensor ? Compatible with RFID size and power needs Projector ? Directional transfer, AR with Image overlay

9. b . Tags respond with date and precise (x,y) pixel location, Projector beams ‘Ok’ at that location a . Photosensing RFID tags are queried via RF c . Multiple users can simultaneously work from a distance without RF collision

11. RFID (Radio Frequency Identification) RFI G (Radio Frequency Id and Geometry )

12. Prototype Tag RF tag + photosensor

26. Change Detection without fixed camera, in any lighting condition Compare with new coordinates from a different view Record coordinates of tags from one view Before After

27. Texture Adaptation

29. Desktop-like Interaction Selecting tags

30. Support for handheld projection

32. Image Quasi-Stabilization Eliminate hand jitter using inertial sensors+camera

33. Absolute Stabilization Image stays registered with world features

34. Image Stabilization

35. Interactive Projection (Also in Emerging Technologies Booth)

36. Adaptive Projection ‘ Paste’ : Geometric and Photometric compensation

37. Prototype Handheld Projector

42. Find tag location using handheld Projector Photosensing Wireless Tags Many geometric ops R F I R F I D Interactive stabilized projection (Radio Frequency Id & Geometry ) G

43. (End of Presentation)