Your SlideShare is downloading. ×
Overview of Selected Current MPEG Activities
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Overview of Selected Current MPEG Activities

2,130
views

Published on

Published in: Technology

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
2,130
On Slideshare
0
From Embeds
0
Number of Embeds
10
Actions
Shares
0
Downloads
71
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide
  • Efficient delivery of mediaover packet based networks in adaptive progressive download/streaming fashion Enable content and network adaptive and flexible error protection and recoveryCross-layer optimization to improve the Quality of Service/ExperienceSupport integrated services with multiple components and/or hybrid delivery environmentSupport efficient signaling, delivery and utilization of multiple content protection and rights management tools.Support of efficient content forwarding and retransmission.
  • Transcript

    • 1. Overview of SelectedCurrent MPEG Activities
      Christian Timmerer
      Klagenfurt University (UNIKLU)  Faculty of Technical Sciences (TEWI)
      Department of Information Technology (ITEC)  Multimedia Communication (MMC)
      http://research.timmerer.com  http://blog.timmerer.com  mailto:christian.timmerer@itec.uni-klu.ac.at
      A report from the 91st MPEG meeting, Kyoto, Japan
      January 2010
    • 2. Outline
      Background / Introduction
      MPEG, who the f*** is MPEG?
      Benefits for using MPEG technologies and contributing to MPEG
      Selected Current MPEG Activities
      Req: MVS, MMT, AIT
      Sys: MPEG-M/-U/-V
      Vid: 3DVC, HVC
      Aud: SAOC
      Conclusions
      January 2010
      2
      Christian Timmerer, Klagenfurt University, Austria
    • 3. Moving Picture Experts Group (MPEG)
      January 2010
      Christian Timmerer, Klagenfurt University, Austria
      4-3
      “Digital Content
      Coding”
      (MPEG-1,2,4)
      MPEG Family of Standards: Applications and Technologies
      • MPEG Standards Evolution:
      • 4. Coding  Content Description Transactions
      “Media Content
      Description”
      (MPEG-7)
      Video
      Storage
      Streaming
      • Applications
      Broadband
      Object-based
      Manipulation
      • Technologies
      “Transactions of
      Digital Items”
      (MPEG-21)
      Media
      Logging
      Repurposing
      Enterprise
      Content
      Mgmt
      • Automatic indexing
      • 7. Multimedia search engines
      • 8. Content-based retrieval
      • 9. Personalization & summarization
      Content
      Adaptation
      E-Commerce
      Of Digital
      Content
      • MPEG-1,2,4: have fueled tremendous growth in digital media content
      • 10. MPEG-7: makes digital content searchable (value in the metadata!)
      • 11. MPEG-21: transactions of digital items
      Flexible
      Business
      Models
      • Rights management
      • 12. Media mining and decision support
      © John R. Smith, Tutorial at WWW’04
    • 13. Moving Picture Experts Group (MPEG)
      January 2010
      Christian Timmerer, Klagenfurt University, Austria
      4
      MPEG Family of Standards: The Success Story continues …
      “Umbrella” standards – Multimedia Application Formats
      (MPEG-A)
      PhotoPlayer
      Broadcasting
      • MPEG Standards Evolution:
      • 14. Framework Integration  Tool SetsMiddleware Immersive User Experience Platform
      Metadata Coding
      Tools – MPEG System, Video, Audio
      (MPEG-B/-C/-D)
      Music Player
      Archival
      Streaming
      • Applications
      Multimedia Middleware
      (MPEG-E/-M)
      Streaming
      Streaming in Heterogeneous Environments
      Object-based Manipulation
      Surround Sound
      Surveillance
      • Technologies
      Content Sharing, the smart way
      Immersive User Experience
      (MPEG-U/-V)
      Video Tool Library
      Multi-DeviceRendering + Interaction
      • Combination of Standards / Profiles / Levels for applications
      • 15. Payload / file / delivery formats
      Multimedia Value Chain
      Tiny, Fast Application Deployments
      Platform
      (Advanced IPTV Terminal)
      Media Value Networks
      • Generic coding tools
      TV-Everywhere
      PaymentCashing
      • Architecture
      • 16. Application Programming Interfaces
      • 17. Resource / quality management
      • 18. Fault / integrity management
      • 19. Protocol payload formats
      Virtual Worlds
      Streaming
      Interactive Personalized TV
      Internet-TV
      • Widgets & Advanced User Interaction
      • 20. Sensory Information
      • 21. Virtual World Object Characteristics
      Mobile-TV
      • MPEG-A: value combinations of existing standards
      • 22. MPEG-B/-C/-D: have fueled tremendous growth in digital media content
      • 23. MPEG-E/-M: make standards accessible enabling tiny applications
      • 24. MPEG-U/-V: increase the Quality of Experience
      • 25. Elementary / Aggregated Services
      • 26. APIs, Protocols, Payload Formats
    • Why using MPEG and contributing to MPEG?
      Why using MPEG standards?
      Leading edge SDO for multimedia coding and systems
      Open IPR, world, access (public), meeting, interface, use
      On-going support
      Reference software and conformance bitstreamsavailable
      Why contributing to MPEG standards?
      Direct, tough feedback from the experts ➪ improve
      Visibility of your research results ➪ impact
      Good networking, contact to industry ➪ research project(s) (proposals)
      Patents / Licensing ➪ $$$
      January 2010
      Christian Timmerer, Klagenfurt University, Austria
      5
    • 27. Mobile Visual Search (MVS)
      January 2010
      Christian Timmerer, Klagenfurt University, Austria
      6
      Requirements
      Applications:
      • SnapTell service by Amazon/A9
      • 28. Point & Find service by Nokia
      • 29. kooaba application by kooaba ltd
      • 30. Google Goggles application by Google
      Scope: Bitstream enabling efficient transmission of local image features in mobile visual search and mobile augmented reality applications.
      Goals:
      • Interoperability between visual search applications and visual database servers
      • 31. Improve performance of mobile visual search applications
      • 32. Facilitate efficient implementation of visual search functionality on mobile phones
      http://www.chiariglione.org/mpeg/working_documents.htm#Explorations
    • 33. MPEG Media Transport (MMT)
      January 2010
      Christian Timmerer, Klagenfurt University, Austria
      7
      Requirements
      Multimedia Applications
      Objectives
      Efficient delivery of media
      Enable content and network adaptive
      Enable cross-layer optimization
      Support integrated services
      Support DRM tools
      Support content forwarding and retransmission
      Multimedia Applications
      MPEG Media Transport (MMT)
      MPEG Media Transport (MMT)
      MPEG Media Transport (MMT)
      Data Link Interface
      Timeline
      Call for Proposal in its next meeting in April 2010
      Evaluation of submissions in its July 2010 meeting
      Phase I: Application layer protocols to be finalized by the first quarter of 2011
      http://www.chiariglione.org/mpeg/working_documents.htm#Explorations
    • 34. Advanced IPTV Terminal (AIT)
      January 2010
      Christian Timmerer, Klagenfurt University, Austria
      8
      Requirements
      Aim: definition of elementary services with corresponding set of protocols and APIs to enable any user in an AIT value chain to access those services in an interoperable fashion. The service definition and its composition is also within the scope of AIT.
      An AIT value chain is a collection of Users, including Creators, End Users and Service Providers .
      Service: a set of content and functions to be offered to a User within the AIT value chain.
      Elementary Service: a service for which protocols and APIs are defined within AIT.
      Aggregated Service: two or more elementary services.
      http://www.chiariglione.org/mpeg/working_documents.htm#Explorations
    • 35. AIT: Elementary Services
      January 2010
      Christian Timmerer, Klagenfurt University, Austria
      9
      Requirements
    • 36. MPEG-M: MPEG-Extensible Middleware (MXM)
      A set of APIs to access possibly all MPEG technologies
      Simple methods to call complex functionalities inside MXM engines
      “Thin” applications because the complexity is in the MXM engines
      Replacement of MXM engines with better performing ones at no cost
      Creation of a global market of MXM Engines, MXM Applications and MXM Devices
      January 2010
      Christian Timmerer, Klagenfurt University, Austria
      10
      Systems
      http://mxm.wg11.sc29.org/
      • Part 1 – MXM Architecture and Technologies
      • 37. Part 2 – MXM Application Programming Interfaces (APIs)
      • 38. Part 3 – MXM Reference Software
      • 39. Part 4 – MXM Protocols: specifies a set of protocols enabling distributed applications to exchange information related to content items and parts thereof, including rights and protection information
    • MPEG-U: Rich Media User Interfaces (RMUI)
      January 2010
      Christian Timmerer, Klagenfurt University, Austria
      11
      Systems
      Objectives
      Enable one to consistently deliver a rich experience across consumer electronics and mobile devices
      Broad range of app domains (home network, broadcast, Web, mobile)
      Update UI continuously
      Integration w/ media types (audio, video, text, 2D and 3D graphics)
      Use Cases
      Remote UI and customized/personalized UI
      UI aggregation from different applications
      Widget Communication, downloadable widget,secured widget
      Multimodal widget
      http://www.chiariglione.org/mpeg/working_documents.htm#MPEG-U
      http://www.chiariglione.org/mpeg/technologies/mpeg-u/mpu-widgets/index.htm
    • 40. MPEG-V: Media Context and Control (MCC)
      January 2010
      Christian Timmerer, Klagenfurt University, Austria
      12
      Systems
      System Architecture
      Pt. 1: Architecture
      Pt. 2: Control Information
      Pt. 3: Sensory Information
      Pt. 4: Virtual World Object Characteristics
      Pt. 5: Data Formats for Interaction Devices
      Pt. 6: Common Types and Tools
      Pt. 7: Conformance and Reference Software
      http://www.chiariglione.org/mpeg/working_documents.htm#MPEG-V
    • 41. 3D Video Coding (3DVC)
      Timeline
      Done: Test material defined
      Final depth maps + preliminary anchor coding for new sequences (until April 2010)
      Final Anchor coding for new sequences (until July 2010)
      Draft CfP (April 2010), internal
      Preliminary and Final CfP (July/Oct. 2010)
      January 2010
      Christian Timmerer, Klagenfurt University, Austria
      13
      Video
      State of the art:
      • ISO/IEC 23002-3 (MPEG-C Pt. 3): 2D+Depth
      • 42. Backward compatible w/ legacy devices
      • 43. Agnostic of coding formats
      • 44. Limited depth range (doesn’t handle occlusions)
      • 45. ISO/IEC 14496-10 Amd: Multiview Video Coding (MVC)
      • 46. Direct coding of multiple views
      • 47. Exploits inter-camera redundancy
      • 48. Rate of MVC encoded video is proportional to the number of views
      http://www.chiariglione.org/mpeg/working_documents.htm#Explorations
    • 49. High-performance Video Coding (HVC)
      Final CfP issued jointly: MPEG + VCEG
      Timeline
      01/22-02/15: formal registration period (33 pre-registered)
      02/22: coded test material shall be available at the test site
      03/02: Start of subjective tests
      04/12-13: registration/submission of documents
      04/17: subjective test results available
      04/17-23: evaluation of proposals at standardization meeting
      Test classes(* … only PSNR evaluation)
      Class A*: Cropped areas of size 2560x1600 (30fps):
      Class B: 1920x1080p 24 fps & 1920x1080p 50-60 fps
      Class C: 832x480p 30-60 fps (WVGA)
      Class D: 416x240p 30-60 fps (WQVGA)
      Class E: 1280x720p 60fps
      Testing fee: 8900 CHF plus 7.6% VAT
      Test coordinator: VittorioBaroncini (FUB)
      January 2010
      Christian Timmerer, Klagenfurt University, Austria
      14
      Video
      Applications
      ➪ Everything but nothing new!?
      ➪ Just more performance!?
      Requirements
      ➪ Compression Performance
      ➪ Picture formats (8Kx4K)
      ➪ Color spaces + sampling
      ➪ Frame rates
      ➪ Scanning modes
      ➪ Complexity
      ➪ Low delay
      ➪ Random access, trick modes
      ➪ Error resilience
      ➪ Buffer models
      ➪ Interface to system layers
      ➪ Scalable Video Coding
      http://www.chiariglione.org/mpeg/working_documents.htm#Explorations
    • 50. Spatial Audio Object Coding (SAOC)
      January 2010
      Christian Timmerer, Klagenfurt University, Austria
      15
      Audio
      Transmission of high-quality multi-channel audio signals
      @bitrates previously used for mono/stereo signals
      Backward compatibility with existing receivers
      MPEG-4 Object-Based Audio Representation
      • Bitrate & computational decoding complexity grows approximately proportionally with the number of transmitted objects
      • 51. Structural complexity of the decoder can be an obstacle to implementation in many real-world applications
      Spatial Audio Object Coding (SAOC)
      • High compression efficiency due to using a downmix signal plus accompanying parametric side information
      • 52. Backward compatibility with respect to existing trans- mission structures
      http://www.chiariglione.org/mpeg/working_documents.htm#MPEG-D
    • 53. Conclusions
      What is MPEG and what are they doing (right now)?
      SDO in the area of multimedia coding & systems
      MVS, MMT, AIT, MXM, RMUI, MCC, 3DVC, HVC, SAOC, etc.
      Long time commitment but sustainability
      Next meeting: 19-23 April 2010, Dresden (not that far away)
      January 2010
      Christian Timmerer, Klagenfurt University, Austria
      16
    • 54. Thank you for your attention
      ... questions, comments, etc. are welcome …
      Ass.-Prof. Dipl.-Ing. Dr. Christian Timmerer
      Klagenfurt University, Department of Information Technology (ITEC)
      Universitätsstrasse 65-67, A-9020 Klagenfurt, AUSTRIA
      christian.timmerer@itec.uni-klu.ac.at
      http://research.timmerer.com/
      Tel: +43/463/2700 3621 Fax: +43/463/270099 3621
      © Copyright: Christian Timmerer
      17
      January 2010
      Christian Timmerer, Klagenfurt University, Austria