Multitouch: FTIR Jason Morrison [email_address] Matthew Kampschmidt [email_address]

More Multitouch from Jeff Han Even More Multitouch!

More Multitouch from Jeff Han

Even More Multitouch!

What is FTIR?

What is FTIR? Frustrated Total Internal Reflection

Frustrated Total Internal Reflection

What is FTIR? Frustrated Total Internal Reflection Say what, now?

Frustrated Total Internal Reflection

Say what, now?

http://cs.nyu.edu/~jhan/ftirsense/

… and multitouch? What’s FTIR got to do with that?

The Basic Idea Build a table Rear-project an image on it Mount infrared LEDs for FTIR Infrared camera to track fingers

Build a table

Rear-project an image on it

Mount infrared LEDs for FTIR

Infrared camera to track fingers

http://digitalstratum.com/programming/ftir_build

http://digitalstratum.com/programming/ftir_build

http://digitalstratum.com/programming/ftir_build

Related developments Single touch Gesturing More expensive multitouch iPhone

Single touch

Gesturing

More expensive multitouch

iPhone

FTIR hits a sweet spot: Cheap, large format, multi-user installations

Table Construction Acrylic or polycarbonate Input Infrared LEDs Compliant surface Infrared camera Output Digital projector Diffusal surface

Acrylic or polycarbonate

Input

Infrared LEDs

Compliant surface

Infrared camera

Output

Digital projector

Diffusal surface

Enabling Technology Direct tactile UI Intuitive gestures, ZUIs Concurrent multiple users Can be used right now! (kind of)

Direct tactile UI

Intuitive gestures, ZUIs

Concurrent multiple users

Can be used right now! (kind of)

Areas for Development Hardware questions Compliant surface LED interface optimization

Hardware questions

Compliant surface

LED interface optimization

Areas for Development Software development Blob detection: Touchlib is good, GPGPU is better? Libraries Tools (VVVV, processing) Bridges (FLOSC) Abstractions

Software development

Blob detection: Touchlib is good, GPGPU is better?

Libraries

Tools (VVVV, processing)

Bridges (FLOSC)

Abstractions

Areas for Development Gesture standards Fingerworks http://www.fingerworks.com/userguides.html Community http :// nuigroup.com/forums/viewthread/95/

Gesture standards

Fingerworks http://www.fingerworks.com/userguides.html

Community http :// nuigroup.com/forums/viewthread/95/

Other interactive tables http://www.iua.upf.es/mtg/reacTable/ http :// www.whitenoiseaudio.com/touchlib/

http://www.iua.upf.es/mtg/reacTable/

http :// www.whitenoiseaudio.com/touchlib/

Questions? Jason Morrison [email_address] Matthew Kampschmidt [email_address]