Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Sensory Effect Dataset and Test Setups

2,253 views

Published on

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

Sensory Effect Dataset and Test Setups

  1. 1. SENSORY EFFECT DATASET AND TEST SETUPSMarkus Waltl, Christian Timmerer, Benjamin Rainer, Hermann HellwagnerMultimedia Communication (MMC) Research Group, Institute of Information Technology (ITEC) Alpen-Adria-Universität Klagenfurt, Klagenfurt, Austria E-mail: firstname.lastname@itec.uni-klu.ac.at Acknowledgments. This work was supported in part by the EC in the context of the ALICANTE (FP7-ICT-248652), SocialSensor (FP7-ICT-287975), and QUALINET (COST IC 1003) projects and partly performed in the Lakeside Labs research cluster at AAU.
  2. 2. OUTLINE Motivation and Context Sensory Effect Dataset  Sensory Effect Metadata Generation  Dataset Review Process Test Setups [Evaluations see prev. QoMEX papers] Conclusion 15 July 2012 Sensory Effect Dataset 2
  3. 3. MOTIVATION From traditional multimedia to sensory-enriched multimedia  E.g., wind, vibration, and light effects  Goal: increasing the Quality of Experience Lack of common test content for performing subjective quality assessments 15 July 2012 Sensory Effect Dataset 3
  4. 4. CONTEXT MPEG-V (ISO/IEC 23005): interoperability between virtual worlds and the real world Seven parts: (1) architecture, (2) control information, (3) sensory information, (4) virtual world object char., (5) data formats for interaction dev., (6) common types and tools, (7) conformance + ref. software Part 3 Sensory Information  Sensory Effect Description Language (SEDL)  Sensory Effect Vocabulary (SEV) Sensory Effect Metadata (SEM)  May be associated to any kind of multimedia content (e.g., movies, music, Web sites, games)  Steer sensory devices like fans, vibration chairs, lamps, etc. via an appropriate mediation device 15 July 2012 Sensory Effect Dataset 4
  5. 5. MPEG-V: MEDIAEFFECT DATASET SENSORY CONTEXT AND CONTROL Currently, no common content for evaluations of sensory effects available 76 video sequences from 5 genres  38 action  12 documentary  8 sports  5 news  13 commercial Enriched with light, wind, and vibration ~1.6GB, available under NDA 15 July 2012 Sensory Effect Dataset 5
  6. 6. SENSORY EFFECT METADATA GENERATION Video sequences enriched with sensory effects using the Sensory Effect Video Annotation (SEVino) tool Advantages  Easy to use  Platform independent  Support all formats and codecs (from VLC)  Create MPEG-V- compliant SEM descriptions 15 July 2012 Sensory Effect Dataset 6
  7. 7. DATASET REVIEW PROCESS15 July 2012 Sensory Effect Dataset 7
  8. 8. TEST SETUPS Evaluations with sensory effects need special devices, e.g., ambient light, fans, vibration chairs Three setups using amBX system and Cyborg Gaming Lights Setups have been used in user studies or evaluated internally 15 July 2012 Sensory Effect Dataset 8
  9. 9. TEST SETUPS15 July 2012 Sensory Effect Dataset 9
  10. 10. TEST SETUPS15 July 2012 Sensory Effect Dataset 10
  11. 11. TEST SETUPS15 July 2012 Sensory Effect Dataset 11
  12. 12. CONCLUSIONS Sensory effect dataset can be used to perform assessments with enriched multimedia content Provides a number of test sequences from various genres in different bit-rates and resolutions Most sequences from the dataset were already used in user studies Proposed a number of test setups that can be used for performing QoE evaluations accompanied by sensory effects 15 July 2012 Sensory Effect Dataset 12
  13. 13. SENSORY EXPERIENCE LAB http://selab.itec.aau.at/ Software and Services Standardization Publications Media Funding15 July 2012 Sensory Effect Dataset 13
  14. 14. THANK YOU FOR YOUR ATTENTION 15 July 2012 Sensory Effect Dataset 14

×