YAGBUX is a project I've done at Télécom Saint-Etienne (tse) last year. It was about creating a gesture based web interface. Moving a finger (or two) moves a spot on screen that activates a "hover" on some areas or click them.

1. Gesture-based tha
t ro
cks
web
navigation*
*Navigation web gestuelle
but at

2. Interaction Designers answer 3
questions:
How do you do?
How do you feel?
How do you know?
Bill Verplank

3. Interaction design

4. How do you do ... ?
button
handle

5. How do you do ... ?
Precision
button
Express
handle
ion

6. How do you feel ... ?
cool
hot
Marshall McLuhan theory

7. How do you know ... ?
maps
paths

9. Web Today
navigation

10. what about using this ?

11. Let’s rock !

12. M a te r i a l s
Obje c t ive s C om p u te r
x1
We b c am
Li ve mot io n trac ki ng x1
Ad o b e F l a s
h
on a fl ash obje ct Ti me x100 ® x1
L o ng iTu ne s h o u rs
De te ct ho ve ri ng p l ay l i s t x1
on mul ti ple bu tt on s
Cl ic ks !

13. 1
Open

14. 2
write YAGBUXpoc.as
YAGBUXcamera.as YAGBUXbutton.as YAGBUXcursor.as

15. ept
Conc
Proo f Of
poc =
YAGBUXpoc.as
Main file
you can create buttons on the fly
// cursors // ,
and specify a region for a cursor

16. YAGBUXcamera.as
sets up a Web cam
for capturing motion

17. YAGBUXcursor.as
sets up a cursor
that follows the motion in
YAGBUXcamera

18. YAGBUXbutton.as
sets up events for an invisible
hotspot per YAGBUXcursor

19. 3
write again...

20. 4
say hello to your screen !

21. That’s it !
by Lahmam.com - made with love on a mac

22. Demo time !
YAGBUX yet another gesture based user experience
Publicis & Hal Riney concept
Dontclick.it