Sensory Effect Dataset and Test Setups

2,126 views
1,960 views

Published on

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
2,126
On SlideShare
0
From Embeds
0
Number of Embeds
1,122
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Sensory Effect Dataset and Test Setups

  1. 1. SENSORY EFFECT DATASET AND TEST SETUPSMarkus Waltl, Christian Timmerer, Benjamin Rainer, Hermann HellwagnerMultimedia Communication (MMC) Research Group, Institute of Information Technology (ITEC) Alpen-Adria-Universität Klagenfurt, Klagenfurt, Austria E-mail: firstname.lastname@itec.uni-klu.ac.at Acknowledgments. This work was supported in part by the EC in the context of the ALICANTE (FP7-ICT-248652), SocialSensor (FP7-ICT-287975), and QUALINET (COST IC 1003) projects and partly performed in the Lakeside Labs research cluster at AAU.
  2. 2. OUTLINE Motivation and Context Sensory Effect Dataset  Sensory Effect Metadata Generation  Dataset Review Process Test Setups [Evaluations see prev. QoMEX papers] Conclusion 15 July 2012 Sensory Effect Dataset 2
  3. 3. MOTIVATION From traditional multimedia to sensory-enriched multimedia  E.g., wind, vibration, and light effects  Goal: increasing the Quality of Experience Lack of common test content for performing subjective quality assessments 15 July 2012 Sensory Effect Dataset 3
  4. 4. CONTEXT MPEG-V (ISO/IEC 23005): interoperability between virtual worlds and the real world Seven parts: (1) architecture, (2) control information, (3) sensory information, (4) virtual world object char., (5) data formats for interaction dev., (6) common types and tools, (7) conformance + ref. software Part 3 Sensory Information  Sensory Effect Description Language (SEDL)  Sensory Effect Vocabulary (SEV) Sensory Effect Metadata (SEM)  May be associated to any kind of multimedia content (e.g., movies, music, Web sites, games)  Steer sensory devices like fans, vibration chairs, lamps, etc. via an appropriate mediation device 15 July 2012 Sensory Effect Dataset 4
  5. 5. MPEG-V: MEDIAEFFECT DATASET SENSORY CONTEXT AND CONTROL Currently, no common content for evaluations of sensory effects available 76 video sequences from 5 genres  38 action  12 documentary  8 sports  5 news  13 commercial Enriched with light, wind, and vibration ~1.6GB, available under NDA 15 July 2012 Sensory Effect Dataset 5
  6. 6. SENSORY EFFECT METADATA GENERATION Video sequences enriched with sensory effects using the Sensory Effect Video Annotation (SEVino) tool Advantages  Easy to use  Platform independent  Support all formats and codecs (from VLC)  Create MPEG-V- compliant SEM descriptions 15 July 2012 Sensory Effect Dataset 6
  7. 7. DATASET REVIEW PROCESS15 July 2012 Sensory Effect Dataset 7
  8. 8. TEST SETUPS Evaluations with sensory effects need special devices, e.g., ambient light, fans, vibration chairs Three setups using amBX system and Cyborg Gaming Lights Setups have been used in user studies or evaluated internally 15 July 2012 Sensory Effect Dataset 8
  9. 9. TEST SETUPS15 July 2012 Sensory Effect Dataset 9
  10. 10. TEST SETUPS15 July 2012 Sensory Effect Dataset 10
  11. 11. TEST SETUPS15 July 2012 Sensory Effect Dataset 11
  12. 12. CONCLUSIONS Sensory effect dataset can be used to perform assessments with enriched multimedia content Provides a number of test sequences from various genres in different bit-rates and resolutions Most sequences from the dataset were already used in user studies Proposed a number of test setups that can be used for performing QoE evaluations accompanied by sensory effects 15 July 2012 Sensory Effect Dataset 12
  13. 13. SENSORY EXPERIENCE LAB http://selab.itec.aau.at/ Software and Services Standardization Publications Media Funding15 July 2012 Sensory Effect Dataset 13
  14. 14. THANK YOU FOR YOUR ATTENTION 15 July 2012 Sensory Effect Dataset 14

×