This document discusses transferring sensing abilities between the physical and virtual worlds in three ways: 1) Reversing the original sensing function so that input becomes output and vice versa. 2) Transferring sensing to another sense, like an installation that transfers gazed objects to related sounds. 3) Extending sensing to support developing abilities, like an eye-tracking drawing assistant that helps with proportion, perspective, and style based on gaze patterns. The overall goal is to explore creating amazing works using a cyber-physical system through reversing, transferring, and extending original sensory experiences between the physical and virtual.

1. Transferring Sensing to a Mixed Virtual and
Physical Experience
Yi-Ching (Janet) Huang
National Taiwan University
2014.09.01

2. Our eyes help us perceive and understand
the visual world

4. Can we use different ways to sense what we see?
1. reverse the original sensing
2. transfer to another sense
3. extend sensing and support developing ability

5. Reverse the original function
input
output

6. Scopophobic Kitties in Wonderland
Stories Behind the Scene of a Gaze Contingent Environment

7. hide
show

10. ’
’
’
Eye Tracking in Physical Space

11. reactive region 30˚
Pilot Studies

13. Transfer sensing

14. Seeing Aural
An Installation Transferring the Materials You Gaze to Sounds You Hear

17. Can we help an artists create art
works in a proper way?

18. Gaze-Based Drawing Assistant

21. Help proportion and perspective, and preserve drawing style
subject #1 subject #2 subject #3

22. support visual memory aideye gaze pattern

23. • A Cyber-Physical system enables various possibilities
for creating amazing works.
• We explored a mixed virtual and physical experience
by reversing, transferring and extending the original
sense ability.

24. Thanks & QA