Culture meet network 2010 hung

1,084 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,084
On SlideShare
0
From Embeds
0
Number of Embeds
136
Actions
Shares
0
Downloads
10
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Culture meet network 2010 hung

  1. 1. Speaker: Yi-Ping Hung (洪一平) Professor and Director Graduate Institute of Networking and Multimedia National Taiwan University Joint Research Fellow Institute of Information Science Academia Sinica
  2. 2. OUTLINE Introduction Digitization of Museum Collections Interactive Systems for Virtual Exhibition  Stereoscopic Kiosk  Magic Crystal Ball  Interactive Multi-Resolution Tabletop Displays  Turning Rust into Gold 2
  3. 3. INTERACTION between Human and Machine Input Method Output Method Card Punch Machine Line Printer keyboard CRT Screen Mouse LCD Screen Finger Touch Touch Screen Other interaction methods, such as speech, gesture, bio-signals, etc. 3
  4. 4. Touch-Control Handheld Devices iPhone  iPadApple Computer, 2007 Apple Computer, 2010
  5. 5. Hand Gesture Recognition Microsoft Kinect  SixthSensecontroller-free gaming and entertainment WUW – Wear Ur World – A Waerableexperience for the Xbox 360, E3 2009. Gesture Interface, SIGCHI 2009 6 http://www.youtube.com/watch?v=qC3H3JOt vSs
  6. 6. Intangible Displays FogScreen  Heliodisplay http://www.fogscreen.com http://www.heliodisplay.eu/tech.htm
  7. 7. Related Work─ Bio-Signal, Brainwave8
  8. 8. OUTLINE Introduction Digitization of Museum Collections Interactive Systems for Virtual Exhibition  Stereoscopic Kiosk  Magic Crystal Ball  Interactive Multi-Resolution Tabletop Displays  Turning Rust into Gold 9
  9. 9. Digitization of 2D Museum CollectionsNational Palace Museum  Chinese Paintings  Chinese Calligraphies 10
  10. 10. Digitization of 2D Museum Collections  Reprographic Scanner  GigaPixel Camera 11
  11. 11. Digitization of 3D Museum ArtifactsHistorical Museum of Academia Sinica  3D Collection of Shoung dynasty National Museum of History, Taipei  Tricolors of Tang dynasty 12
  12. 12. Digitization of 3D Museum ArtifactsNational Palace Museum  5 artifacts selected for virtual exhibition 13
  13. 13. Object Movies Image-Based Rendering Equipments for images acquisition  Texnai, Nodal Ninja, PeaceRiver Studios  14
  14. 14. Acquisition of Object MoviesObject-centric representation CO 3D configuration of views 15
  15. 15. OUTLINE Introduction Digitization of Museum Collections Interactive Systems for Virtual Exhibition  Stereoscopic Kiosk  Magic Crystal Ball  Interactive Multi-Resolution Tabletop Displays  Turning Rust into Gold 16
  16. 16. Integration of Object Movies with Panoramas  Augmented Reality Based on Cuboid Structure ○ Chen, Yu, Hung, ICCV’99  Augment a Panorama with Object Movies  Hung, et al, JVCA 2002Yi-Ping Hung, et al, “Augmenting Panoramas with Object Movies ……,”Journal of Visualization and Computer Animation (JVCA), 2002. 17
  17. 17. Interactive 3D Virtual Exhibition Design a Stereoscopic Kiosk for Virtual Exhibition 3D Virtual ExhibitionViewer Sync. Stereo Object Movies 18
  18. 18. Stereoscopic Kiosk• Contains two screens ─ the upper one with touch panel ─ the lower one with micropol for stereoscopic view 19
  19. 19. Stereoscopic Kiosk F@imp 2004 (Festival Audiovisuel International Musees et Patrimoine) 20 20
  20. 20.  Daily Exhibition at the National Palace Museum 2004/10 – 2005/10 21
  21. 21. OUTLINE Introduction Digitization of Museum Collections Interactive Systems for Virtual Exhibition  Stereoscopic Kiosk  Magic Crystal Ball  Interactive Multi-Resolution Tabletop Displays  Turning Rust into Gold 22
  22. 22. Magic Crystal Ball(魔幻水晶球)─ Magical Visual Experience─ Intuitive Manipulation • VRST 2007
  23. 23. System Archetecture Transparent Glass Ball Fresnel Lens Touch Screen Reflection Mirror Two IR Cameras IR Illuminators Strain Gauge Sensors Cantilever beam structure LCDDisplay Detection Module Module
  24. 24. Hand Gesture Recognition Cover the spherical ball with two cameras Side viewWith one camera With two cameras
  25. 25. IRON MAN 27 /65
  26. 26. Virtual Panel2D Planar Intangible Screen LCD ScreenVirtual Panel Fresnel Lens IR Cameras
  27. 27. OUTLINE Introduction Digitization of Museum Collections Interactive Systems for Virtual Exhibition  Stereoscopic Kiosk  Magic Crystal Ball  Interactive Multi-Resolution Tabletop Displays  Turning Rust into Gold 30
  28. 28. Interactive Multi-resolution TableTop Display(i-m-Top) ─Rear Projection ─Multi-Touch ─Multi-Resolution• “i-m-Top: An Interactive Multi-Resolution Tabletop System Accommodating To Multi-Resolution Human Vision”, IEEE Tabletops andInteractive Surfaces, Amsterdam, IEEE Tabletop 2008.• To Move or Not to Move: A Comparison between Steerable and Fixed Regions of High-Resolution Projection in Multi-ResolutionTabletop Systems, ACM SIGCHI 2009 31
  29. 29. Motivation for Multi-resolution Human Visual System: Multi-resolution  Fovea region: acute visual details  Peripheral region: coarse visual details
  30. 30. Related Works Focus + Context Baudisch, P., Good, N., and Stewart, P. "Focus Plus Context Screens: Combining Display Technology with Visualization Techniques." In proceedings of ACM UIST 01, Orlando, FL, November 2002
  31. 31. Related Works  Escritoire  A multi-resolution tabletop display system with front-projection  Interact by two pens  Fovea area is fixedMark Ashdown, Peter Robinson, “Experiences Implementing and Using Personal Projected Displays,” University of CambridgeProcams’03 "
  32. 32. i-m-Top System 96 ppi 24 ppi 56” Steerable Mirror Fovea Projector IR Camera x 2 Peripheral Projector IR Illuminator x4
  33. 33. Some Applications Museum Painting Browser Map Browser Photo Browser
  34. 34. Map Touring with Tangible WidgetLCD Screen (Panorama view) Tangible object (You) im-Top (map view)
  35. 35. Tangible Widgets for Virtual Exhibitionof Museum Collections 38
  36. 36. Yongzheng Exhibition-- National Palace Museum-- Oct 2009 ~ Jan 2010 39
  37. 37. Beyond-Surface Interaction with Infrared Projection Three Applications 40
  38. 38. IDEA: Using an Invisible Projection i-m-Lamp Location & Orientation -- 6 DOF i-m-FlashlightColorProjector IR Projector i-m-View Mirror Mirror IR Camera 41
  39. 39. i-m-Lamp Project high-resolution content on the surface, mimicking the use of a desk lamp. 42
  40. 40. i-m-Flashlight A mobile version of i-m-Lamp, facilitating information explorations and cooperative tasks. 43
  41. 41. i-m-View An intuitive tool to view 3D content or augmented information from different perspectives. 44
  42. 42.  Demo  Emerging Tech in SIGGRAPH 2010 Publication  UIST 2010 Press Coverages:  New Scientist  Engadget  GearLog  Reuters  International and domestic TV 45
  43. 43. OUTLINE Introduction Digitization of Museum Collections Interactive Systems for Virtual Exhibition  Stereoscopic Kiosk  Magic Crystal Ball  Interactive Multi-Resolution Tabletop Displays  Turning Rust into Gold 46
  44. 44. Turning Rust into Gold The Mao-Kung Ting  One of the most precious artifacts in the National Palace Museum, Taipei  Dating back to 800 B.C.  Having 500-character inscription cast inside How to reveal the great nature of this artwork? How to set up the connection between museum visitors and this artwork?
  45. 45. Why Breath-Aware Sensor? The Power of the Breath  Breathing is a function in our bodies that we can do both consciously and unconsciously  Breathing is a bridge between mind and body  Yoga, meditation, Qi-Gong, Tai-Ji, … all focus on breathing  Be fully conscious of each breath ○ make you healthier and enlightened ○ enlightened: feel oneness with Being
  46. 46. Respiration Detectors Which Method for Respiration Detection ?  Optoelectronic Plethysmography (OEP)  Respiratory Inductive Plethysmography (RIP)  Heart Rate Variability (HRV)  Ultra Wide Band (UWB)
  47. 47. Respiration DetectionComparison of Different Respiration Detection Methods OEP RIP HRV UWB Attached Attached Attached Attached Non- to body markers to to invasive Body skin Accuracy High Median Median Low Least Detectors Detectors LessLimitation mobility attached attached mobility to to the body fingers
  48. 48. Turning Rust into Gold 點蝕成金 K. T. Creativity Award 2009: is now demonstrated in the NPM LOHAS Exhibitat the Future Museum, located at the Taiwan Taoyuan International Airport.
  49. 49. National Palace Museum -- Future Museum Location: Taiwan Taoyuan International Airport LOHAS Exhibition, April/2010 –April/2011
  50. 50. Thanks

×