MPEG-VMedia Context and Control<br />N107{82,83,85,86} – Text of ISO/IEC 23006-[1-4] CD<br />Christian Timmerer<br />Klage...
MPEG-V System Architecture<br />2009/07/03<br />Christian Timmerer, Klagenfurt University, Austria<br />2<br />Media conte...
Control Information<br />2009/07/03<br />Christian Timmerer, Klagenfurt University, Austria<br />3<br />Sensory Device Cap...
 light (color, flash), heating, cooling, wind, vibration
 scent, fog, water sprayer, color correction
kinestetic, tactile</li></ul>Fundamental Input to any Control Device (aka Adaptation Engine)<br />User Sensory Preferences...
 light (color, flash), heating, cooling, wind, vibration
 scent, fog, water sprayer, color correction
kinestetic, tactile</li></li></ul><li>Avatar Characteristics<br />Appearance<br />Contains the high level description of t...
What is MPEG Sensory Information?<br />UMA = Universal Multimedia Access<br />Access to content anywhere, anytime, any dev...
Concept of MPEG-V Sensory Information<br />2009/07/03<br />Christian Timmerer, Klagenfurt University, Austria<br />6<br />
MPEG-V Sensory InformationSystem Architecture<br />2009/07/03<br />Christian Timmerer, Klagenfurt University, Austria<br /...
Committee Draft Structure<br />Sensory Effect Description Language<br />Basic building blocks: GeneralInformation, Declara...
Demo Setup<br />2009/07/03<br />Christian Timmerer, Klagenfurt University, Austria<br />9<br />Wall-washer / Light<br />Di...
Upcoming SlideShare
Loading in …5
×

MPEG-V: Media Context and Control

3,371 views

Published on

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
3,371
On SlideShare
0
From Embeds
0
Number of Embeds
148
Actions
Shares
0
Downloads
78
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

MPEG-V: Media Context and Control

  1. 1. MPEG-VMedia Context and Control<br />N107{82,83,85,86} – Text of ISO/IEC 23006-[1-4] CD<br />Christian Timmerer<br />Klagenfurt University (UNIKLU)  Faculty of Technical Sciences (TEWI)<br />Department of Information Technology (ITEC)  Multimedia Communication (MMC)<br />http://research.timmerer.com  http://blog.timmerer.com  mailto:christian.timmerer@itec.uni-klu.ac.at<br />
  2. 2. MPEG-V System Architecture<br />2009/07/03<br />Christian Timmerer, Klagenfurt University, Austria<br />2<br />Media context and control<br />Pt. 1: Architecture<br />Pt. 2: Control Information<br />Pt. 3: Sensory Information<br />Pt. 4: Avatar Information<br />
  3. 3. Control Information<br />2009/07/03<br />Christian Timmerer, Klagenfurt University, Austria<br />3<br />Sensory Device Capabilities asext. of dia:TerminalCapability<br /><ul><li> unit, max/minIntensity, numOfLevels, delay, position
  4. 4. light (color, flash), heating, cooling, wind, vibration
  5. 5. scent, fog, water sprayer, color correction
  6. 6. kinestetic, tactile</li></ul>Fundamental Input to any Control Device (aka Adaptation Engine)<br />User Sensory Preferences asext. of dia:UserCharacteristics<br /><ul><li> adaptability, max/minIntensity
  7. 7. light (color, flash), heating, cooling, wind, vibration
  8. 8. scent, fog, water sprayer, color correction
  9. 9. kinestetic, tactile</li></li></ul><li>Avatar Characteristics<br />Appearance<br />Contains the high level description of the appearance and may refer a media containing the exact geometry and texture<br />Haptics Properties<br />Contains the high level description of the haptics properties<br />Animation<br />Contains the description of a set of animation sequences that the avatar is able to perform and may refer to several medias containing the exact (geometric transformations) animation parameters<br />Communication Skills<br />Contains a set of descriptors providing information on the different modalities an avatar is able to communicate<br />Personality<br />Contains a set of descriptors defining the personality of the avatar<br />Control<br />Contains a set of descriptors defining possible place-holders for sensors on body skeleton and face feature points <br />2009/07/03<br />Christian Timmerer, Klagenfurt University, Austria<br />4<br />
  10. 10. What is MPEG Sensory Information?<br />UMA = Universal Multimedia Access<br />Access to content anywhere, anytime, any device == addressing QoS issues<br />Technical feasible thanks to standards ➙ MPEG-21 DIA<br />UME = Universal Multimedia Experience<br />User-centric approach – takes into account the user<br />Quality of Multimedia Experience<br />Sensorial, e.g., sharpness, brightness<br />Perceptual, e.g., what/where is the content<br />Emotional, e.g., feeling, sensation<br />MPEG-V Sensory Information<br />Consumption of multimedia assets may stimulate also other senses, e.g., olfaction, mechanoreception, or thermoception<br />Achieved by annotating the media resources with sensory effects<br />➙enhanced, worthwhile, and informative user experience, giving the user the sensation of being part of the actual media <br />2009/07/03<br />Christian Timmerer, Klagenfurt University, Austria<br />5<br />N9113<br />N10785<br />
  11. 11. Concept of MPEG-V Sensory Information<br />2009/07/03<br />Christian Timmerer, Klagenfurt University, Austria<br />6<br />
  12. 12. MPEG-V Sensory InformationSystem Architecture<br />2009/07/03<br />Christian Timmerer, Klagenfurt University, Austria<br />7<br />Native representation➙ standardized representation<br />Authoring<br />Packaging<br />Scope of Standardization<br />Delivery<br />Standardized representation➙ device capabilities &<br /> user preferences<br />Adaptation<br />
  13. 13. Committee Draft Structure<br />Sensory Effect Description Language<br />Basic building blocks: GeneralInformation, Declaration, Effect, GroupOfEffects, Parameter, ReferenceEffect<br />Common attributes: XSI (timing), activate, duration, fade, alt, priority, intensity, adaptType, adaptRange<br />Sensory Effect Vocabulary<br />Light (colored, flash), temperature, wind, vibration<br />Water sprayer, scent, fog, shadow, color correction<br />Kinesthetic, tactile<br />2009/07/03<br />Christian Timmerer, Klagenfurt University, Austria<br />8<br />
  14. 14. Demo Setup<br />2009/07/03<br />Christian Timmerer, Klagenfurt University, Austria<br />9<br />Wall-washer / Light<br />Display<br />Light<br />Light<br />Fan<br />Fan<br />Speaker<br />Speaker<br />Vibration Bar<br />Subwoofer<br />
  15. 15. Demo Video with Effects<br />2009/07/03<br />Christian Timmerer, Klagenfurt University, Austria<br />10<br />
  16. 16. Kinesthetic / Tactile Effects<br />2009/07/03<br />Christian Timmerer, Klagenfurt University, Austria<br />11<br />♬♩♪♫ <br />abcdefg<br />Haptic Texture<br />Force<br />Haptic interaction<br />Audio<br />Viewers<br />Television<br />Touch or exploration<br />Manipulation<br />Following movements<br />Dynamics<br />Feeling haptic effects<br />Video<br />Text<br />3D CG model<br />
  17. 17. Kinesthetic / Tactile Effects (cont’d)<br />2009/07/03<br />Christian Timmerer, Klagenfurt University, Austria<br />12<br />Active interactions<br />Passive interactions<br />
  18. 18. MPEG-V SI References<br />N10782, Text of ISO/IEC 23006-1 CD<br />N10783, Text of ISO/IEC 23006-2 CD<br />N10785, Text of ISO/IEC 23006-3 CD<br />N10786, Text of ISO/IEC 23006-4 CD<br />Ad-hoc Group<br />metaverse@lists.uni-klu.ac.at<br />http://lists.uni-klu.ac.at/mailman/listinfo/metaverse<br />Some selected publications<br />J. Cha, I. Oakley, Y.-S. Ho, Y. Kim, J. Ryu, “A Framework of Haptic Broadcasting”, IEEE Multimedia, in print, Sept-Oct. 2009<br />J. Cha, S.-Y. Kim, Y.-S. Ho, J. Ryu, “3D Video Player System with Haptic Interaction based on Depth Image-Based Representation”, IEEE Transactions on Consumer Electronics, Vol. 52, No.2, pp.477-484, May 2006 <br />M. Waltl, C. Timmerer, H. Hellwagner, A Test-Bed for Quality of Multimedia Experience Evaluation of Sensory Effects, Proceedings of the First International Workshop on Quality of Multimedia Experience (QoMEX 2009), San Diego, USA, July 29-31, 2009.<br />2009/07/03<br />Christian Timmerer, Klagenfurt University, Austria<br />13<br />
  19. 19. Thank you for your attention<br />... questions, comments, etc. are welcome …<br />Ass.-Prof. Dipl.-Ing. Dr. Christian Timmerer<br />Klagenfurt University, Department of Information Technology (ITEC)<br />Universitätsstrasse 65-67, A-9020 Klagenfurt, AUSTRIA<br />christian.timmerer@itec.uni-klu.ac.at<br />http://research.timmerer.com/<br />Tel: +43/463/2700 3621 Fax: +43/463/2700 3699<br />© Copyright: Christian Timmerer<br />14<br />2009/07/03<br />Christian Timmerer, Klagenfurt University, Austria<br />

×