Accelerating Media Business Developments


Published on

An Overview of MPEG-M: MPEG Extensible Middleware

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Accelerating Media Business Developments

  1. 1.<br /><br /><br />Accelerating Media Business Developments<br />MPEG-M: MPEG Extensible Middleware<br />Christian Timmerer<br />Klagenfurt University (UNI-KLU)  Faculty of Technical Sciences (TEWI)<br />Department of Information Technology (ITEC)  Multimedia Communication (MMC)<br />  <br />Acknowledgments<br />L. Chiariglione, F. Chiariglione<br />M. Preda, M. Eberhard, I. Arsov, A. Defino<br />Workshop on New Multimedia Technologies and ApplicationsXidian University, China<br />October 31, 2009<br />
  2. 2. What if …<br />… one does not need to have in-depth knowledge of specific MPEG technologies / standards?<br />… one is able to start with application/business development as soon as some (reference) software becomes available?<br />… one is able to exchange applications’ underlying (reference) software with optimized one at no cost?<br />2009/10/31<br />Christian Timmerer, Klagenfurt University, Austria<br />2<br />
  3. 3. 2009/10/31<br />Christian Timmerer, Klagenfurt University, Austria<br />3<br />
  4. 4. Outline<br />Introduction – Overview<br />Architecture<br />Application Programming Interface (API)<br />Example Instantiations<br />Fully Interoperable Streaming<br />[Including MPEG-4 3D Graphics<br />Sharing Protected Contents]<br />[Conclusions – References]<br />2009/10/31<br />Christian Timmerer, Klagenfurt University, Austria<br />4<br />
  5. 5. Introduction – Overview<br />A set of APIs to access possibly all MPEG technologies<br />Simple methods to call complex functionalities inside MXM engines<br />“Thin” applications because the complexity is in the MXM engines<br />Replacement of MXM engines with better performing ones at no cost<br />Creation of a global market of MXM Engines, MXM Applications and MXM Devices<br />2009/10/31<br />Christian Timmerer, Klagenfurt University, Austria<br />5<br />
  6. 6. Introduction – Overview (cont’d)<br />The MXM standard – ISO/IEC 23006 – is subdivided in four parts:<br />Part 1 - MXM Architecture and Technologies specifies the MXM architecture and references the technologies that are part of an MXM implementation;<br />Part 2 - MXM Application Programming Interfaces (APIs): specifies the MXM APIs;<br />Part 3 - MXM Conformance and Reference Software: specifies conformance tests and the software implementation of the standard<br />Part 4 – MXM Protocols: specifies a set of protocols enabling distributed applications to exchange information related to content items and parts thereof, including rights and protection information<br />2009/10/31<br />Christian Timmerer, Klagenfurt University, Austria<br />6<br />
  7. 7. MXM Application 1<br />MXM Application 2<br />MXM<br />Engine<br />APIs‏<br />MXM Device<br />MPEG21 File <br />Engine<br />Digital Item<br />Engine<br />REL <br />Engine<br />IPMP<br />Engine<br />Other<br />Engines<br />Security<br />Engine<br />Scene<br />Engine<br />Content<br />Metadata<br />Engine<br />Media<br />Framework<br />Engine<br />OS<br />Drivers, Accelerators, Controllers, etc.<br />HW<br />7<br />2009/10/31<br />Christian Timmerer, Klagenfurt University, Austria<br />
  8. 8. MXM Application 3<br />MXM Application 1<br />MXM Application 2<br />MXM<br />Orchestrator<br />API‏<br />MXM Device<br />MPEG21 File <br />Engine<br />Digital Item<br />Engine<br />REL <br />Engine<br />IPMP<br />Engine<br />Orchestrator<br />Engine<br />Other<br />Engines<br />Security<br />Engine<br />Scene<br />Engine<br />Content<br />Metadata<br />Engine<br />Media<br />Framework<br />Engine<br />OS<br />Drivers, Accelerators, Controllers, etc.<br />HW<br />8<br />2009/10/31<br />Christian Timmerer, Klagenfurt University, Austria<br />
  9. 9. MXM Protocols<br />License<br />Provider<br />Device<br />Content<br />Identific.<br />Device<br />Content<br />Creation<br />Device<br />End-User<br />Device<br />Content<br />Provider<br />Device<br />DRM Tool<br />Provider<br />Device<br />9<br />2009/10/31<br />Christian Timmerer, Klagenfurt University, Austria<br />
  10. 10. MXM Application<br />MXM Application<br />MXM<br />OS<br />MXM<br />OS<br />Computing Platform<br />Computing Platform<br />Enabling MXM Apps to communicate<br />10<br />2009/10/31<br />Christian Timmerer, Klagenfurt University, Austria<br />
  11. 11. An Impressive Number of Standards…<br />MPEG-7 Visual<br />Advanced Audio Coding<br />LASeR<br />MDS<br />Event Reporting<br />Reconfigurable Video Coding<br />BIFS<br />HE AAC<br />IPMPX<br />Digital Item Processing<br />Digital Item Declaration<br />File Format<br />Audio Lossless Coding<br />Intellectual Property Management and Protection<br />Media Value Chain Ontology<br />Rights Expression Language<br />Digital Item Identification<br />XML IPMP messages<br />Digital Item Streaming<br />IPMP Components<br />Digital Item Adaptation<br />MPQF<br />11<br />2009/10/31<br />Christian Timmerer, Klagenfurt University, Austria<br />
  12. 12. Motivation of providing API<br />MPEG specifications: huge amount of technology<br />157 standards in ISO/IEC 14496 (MPEG-4) family<br />43 standards in ISO/IEC 15938 (MPEG-7) family<br />33 standards in ISO/IEC 21000 (MPEG-21) family<br />…<br />Around 11 000 pages, 1,5 m high when printed<br />However, majority of people developing MPEG related applications do not need to know that is inside the boxes, but only how to use it<br />2009/10/31<br />12<br />Christian Timmerer, Klagenfurt University, Austria<br />
  13. 13. The MXM Approach<br />1. Creating wrapping libraries, called engines<br />2. Opening the engines at ESSENTIAL points only<br />3. Documenting the IN/OUT points in another …<br /> MPEG standard: 23006-2 MXM API<br />- only 37 pages , <br />- around 500 methods<br />2009/10/31<br />13<br />Christian Timmerer, Klagenfurt University, Austria<br />
  14. 14. List of MXM Engines<br />ContentProtocolEngine<br />ContentSearchEngine<br />DIAEngine<br />DIDEngine<br />DISEngine<br />DomainEngine<br />EREngine<br />IPMPEngine<br />IPMPToolProtocolEngine<br />LicenseProtocolEngine<br />MediaFrameworkEngine<br />MetadataEngine<br />MPEG21FileEngine<br />MVCOEngine<br />OrchestratorEngine<br />RELEngine<br />RenderingEngine<br />SecurityEngine<br />14<br />2009/10/31<br />Christian Timmerer, Klagenfurt University, Austria<br />
  15. 15. MXM APIs of Each Engine have been Divided into…<br />Creation e.g. <br />Encode a raw audio track<br />Create an MPEG-7 metadata description <br />Access e.g. <br />Get data from a Digital Item<br />Decode a video <br />Editing e.g. <br />Add an elementary stream to a multiplexed content<br />Engine-specific e.g. <br />RELEngine: authorise(license, query)<br />LicenseProtocolEngine: requestLicense(licenseID, serviceURL) <br />15<br />2009/10/31<br />Christian Timmerer, Klagenfurt University, Austria<br />
  16. 16. Fully Interoperable Streaming ofMedia Resources in Heterogeneous Environments<br />2009/10/31<br />Christian Timmerer, Klagenfurt University, Austria<br />16<br />
  17. 17. Join the MXM Development Team!<br />Why you should join<br />Plenty of interesting work still has to be done<br />Enough space for student projects, master thesis, PhD thesis, etc.<br />You can choose between Java, C++ or start a new implementation in another language!<br />It gives you visibility on a broad set of MPEG technologies<br />Web site, blog, reflector, and soon more utilities<br />Friendly and collaborative environment <br />17<br />2009/10/31<br />Christian Timmerer, Klagenfurt University, Austria<br />
  18. 18. Thank you for your attention!<br />... questions, comments, etc. are welcome …<br />Ass.-Prof. Dipl.-Ing. Dr. Christian Timmerer<br />Klagenfurt University, Department of Information Technology (ITEC)<br />Universitätsstrasse 65-67, A-9020 Klagenfurt, AUSTRIA<br /><br /><br />Tel: +43/463/2700 3621 Fax: +43/463/2700 3699<br />© Copyright: Christian Timmerer<br />18<br />2009/10/31<br />Christian Timmerer, Klagenfurt University, Austria<br /><br /><br /><br />