PACER: Fine-grained Interactive Paper via Camera-touch Hybrid Gestures on a Cell Phone

PACER: Fine-grained Interactive Paper via Camera-touch Hybrid Gestures on a Cell Phone Chunyuan Liao, Qiong Liu, Bee Liew, Lynn Wilcox FX Palo Alto Laboratory ACM CHI Conference Atlanta, GA, U.S.A. 4/15/2010

Scenario One I should email Jenny about this interesting article, especial the pulses in this curve

Scenario Two I want to search for the definition of θ in this book

Typical Solutions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Problems ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Video Demo ,[object Object],[object Object],http://www.youtube.com/watch?v=HEwwx1spujk

Paper vs. Cell phones ,[object Object],High display quality Flexible spatial arrangement Instant accessibility High robustness Dynamic rendering Rich digital interaction Digital communication Lower display quality Small display size Inconvenient input Lower robustness Static display No computation capability No digital communication + Computer-like UX on paper to put paper and digital media on more equal footing for smooth integration

The State of the Art ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Computer-like UX: PACER

Overview of PACER ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Camera phone + normal printouts Gestures for fine-grained interaction +

Architecture of the PACER system ,[object Object],[object Object],[object Object]

Overview of the PACER Interface Physical-digital Interaction Mapping Fine-grained Command System ,[object Object],[object Object],[object Object],[object Object],Application +

Content-based Physical-Digital Interaction Mapping ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Feature Extraction Feature Matching image registration

Highlights (1): Semi-Real-Time Processing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

PACER Gestures ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Pointer Underline Bracket Vertical Bar Lasso Marquee Path Free-form

Highlights (2): Loose Registration ,[object Object],[object Object],[object Object],[object Object],[object Object],displaced overlay illegible content

Highlights (2): Loose Registration ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],perfect overlay

Highlights (3): Hand Jitter Handling ,[object Object],[object Object],[object Object],[object Object],Filter (Zoom-and-pick [Forlines,05]) Beautification ( REXplorer [Kratz,09] ) Snap-to-object Physical pointer Logical pointer

Highlights (4): Hybrid Gestures ,[object Object],[object Object],[object Object]

Highlights (4): Hybrid Gestures ,[object Object],[object Object],[object Object],[object Object]

Video Demo ,[object Object],http://www.youtube.com/watch?v=E9hR5D_mQvs

Video Demo of PACER Applications ,[object Object],[object Object],[object Object],[object Object],[object Object],http://www.youtube.com/watch?v=PNqUcC0YZ78

Preliminary User study (1) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Tracking tag

Preliminary User study (2) ,[object Object],[object Object],[object Object],[object Object],[object Object],Motion blur Out of range Shadow

Preliminary User study (3) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Preliminary User study (4) ,[object Object],[object Object],[object Object],Participant-initiated two-handed interaction

Conclusion & future work ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Thank You! ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

PACER: Fine-grained Interactive Paper via Camera-touch Hybrid Gestures on a Cell Phone

Recommended

Recommended

More Related Content

Viewers also liked

Viewers also liked (8)

Similar to PACER: Fine-grained Interactive Paper via Camera-touch Hybrid Gestures on a Cell Phone

Similar to PACER: Fine-grained Interactive Paper via Camera-touch Hybrid Gestures on a Cell Phone (20)

Recently uploaded

Recently uploaded (20)

PACER: Fine-grained Interactive Paper via Camera-touch Hybrid Gestures on a Cell Phone