Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Accelerating Media Business Developments, MPEG-M: MPEG Extensible Middleware


Published on

The MXM presentation as presented during FIA Stockholm

  • Be the first to comment

  • Be the first to like this

Accelerating Media Business Developments, MPEG-M: MPEG Extensible Middleware

  1. 1.<br /><br /><br />Accelerating Media Business Developments<br />MPEG-M: MPEG Extensible Middleware<br />Christian Timmerer, FilippoChiariglione, Marius Preda<br />Klagenfurt University (UNI-KLU)  Faculty of Technical Sciences (TEWI)<br />Department of Information Technology (ITEC)  Multimedia Communication (MMC)<br />  <br />Acknowledgments<br />L. Chiariglione, M. Eberhard, I. Arsov, A. Difino<br />
  2. 2. What if …<br /><ul><li>… one does not need to have in-depth knowledge of specific MPEG technologies / standards?
  3. 3. … one is able to start with application/business development as soon as some (reference) software becomes available?
  4. 4. … one is able to exchange applications’ underlying (reference) software with optimized one at no cost?</li></ul>2009/11/23-24<br />Christian Timmerer, Klagenfurt University, Austria<br />2<br />
  5. 5. 2009/11/23-24<br />Christian Timmerer, Klagenfurt University, Austria<br />3<br />
  6. 6. Outline<br />Vision<br />Overview<br />Architecture<br />Application Programming Interface (API)<br />Example Instantiations<br />Fully Interoperable Streaming<br />Including MPEG-4 3D Graphics in 3rd-Party Apps<br />Sharing Protected Contents<br />2009/11/23-24<br />Christian Timmerer, Klagenfurt University, Austria<br />4<br />
  7. 7. The MXM Vision<br /><ul><li>MPEG-21 Multimedia Framework
  8. 8. From Framework to Platform respecting
  9. 9. Creator and rights holders rights to exploit their works
  10. 10. End user wish to fully enjoy the benefits of digital media
  11. 11. Various value-chain player interest to provide products and services</li></ul>➪ DMP has specified Interoperable DRM Platform (IDP)<br />2009/11/23-24<br />Christian Timmerer, Klagenfurt University, Austria<br />5<br />“every human is potentially an element of a network involving billions of content providers, value adders, packagers, service providers, resellers, consumers ...” <br />Framework<br />Platform<br />. . .<br />
  12. 12. The MXM Vision (cont’d)<br /><ul><li>From Platform to Middleware enabling
  13. 13. APIs + protocols in a platform-independent way + … (see the following slides)</li></ul>➪ MPEG Extensible Middleware (MXM)<br />What’s next?<br /><ul><li>From Middleware to Terminal enabling
  14. 14. ITU-T: definition of IPTV infrastructure and components
  15. 15. MPEG: development of enabling technologies for, e.g., IPTV</li></ul>➪ Advanced IPTV Terminal (AIT)<br />2009/11/23-24<br />Christian Timmerer, Klagenfurt University, Austria<br />6<br />. . .<br />Middleware<br />Terminal<br />
  16. 16. Overview<br /><ul><li>A set of APIs to access possibly all MPEG technologies
  17. 17. Simple methods to call complex functionalities inside MXM engines
  18. 18. “Thin” applications because the complexity is in the MXM engines
  19. 19. Replacement of MXM engines with better performing ones at no cost
  20. 20. Creation of a global market of MXM Engines, MXM Applications and MXM Devices</li></ul>2009/11/23-24<br />Christian Timmerer, Klagenfurt University, Austria<br />7<br />
  21. 21. Overview (cont’d)<br />The MXM standard – ISO/IEC 23006 – is subdivided in four parts:<br /><ul><li>Part 1 - MXM Architecture and Technologies specifies the MXM architecture and references the technologies that are part of an MXM implementation;
  22. 22. Part 2 - MXM Application Programming Interfaces (APIs): specifies the MXM APIs;
  23. 23. Part 3 - MXM Conformance and Reference Software: specifies conformance tests and the software implementation of the standard
  24. 24. Part 4 – MXM Protocols: specifies a set of protocols enabling distributed applications to exchange information related to content items and parts thereof, including rights and protection information</li></ul>2009/11/23-24<br />Christian Timmerer, Klagenfurt University, Austria<br />8<br />
  25. 25. MXM Application 1<br />MXM Application 2<br />MXM<br />Engine<br />APIs‏<br />MXM Device<br />MPEG21 File <br />Engine<br />Digital Item<br />Engine<br />REL <br />Engine<br />IPMP<br />Engine<br />Other<br />Engines<br />Security<br />Engine<br />Scene<br />Engine<br />Content<br />Metadata<br />Engine<br />Media<br />Framework<br />Engine<br />OS<br />Drivers, Accelerators, Controllers, etc.<br />HW<br />9<br />2009/11/23-24<br />Christian Timmerer, Klagenfurt University, Austria<br />
  26. 26. MXM Application 3<br />MXM Application 1<br />MXM Application 2<br />MXM<br />Orchestrator<br />API‏<br />MXM Device<br />MPEG21 File <br />Engine<br />Digital Item<br />Engine<br />REL <br />Engine<br />IPMP<br />Engine<br />Orchestrator<br />Engine<br />Other<br />Engines<br />Security<br />Engine<br />Scene<br />Engine<br />Content<br />Metadata<br />Engine<br />Media<br />Framework<br />Engine<br />OS<br />Drivers, Accelerators, Controllers, etc.<br />HW<br />10<br />2009/11/23-24<br />Christian Timmerer, Klagenfurt University, Austria<br />
  27. 27. MXM Protocols<br />License<br />Provider<br />Device<br />Content<br />Identific.<br />Device<br />Content<br />Creation<br />Device<br />End-User<br />Device<br />Content<br />Provider<br />Device<br />DRM Tool<br />Provider<br />Device<br />11<br />2009/11/23-24<br />Christian Timmerer, Klagenfurt University, Austria<br />
  28. 28. MXM Application<br />MXM Application<br />MXM<br />OS<br />MXM<br />OS<br />Computing Platform<br />Computing Platform<br />Enabling MXM Apps to communicate<br />12<br />2009/11/23-24<br />Christian Timmerer, Klagenfurt University, Austria<br />
  29. 29. An Impressive Number of Standards…<br />MPEG-7 Visual<br />Advanced Audio Coding<br />LASeR<br />MDS<br />Event Reporting<br />Reconfigurable Video Coding<br />BIFS<br />HE AAC<br />IPMPX<br />Digital Item Processing<br />Digital Item Declaration<br />File Format<br />Audio Lossless Coding<br />Intellectual Property Management and Protection<br />Media Value Chain Ontology<br />Rights Expression Language<br />Digital Item Identification<br />XML IPMP messages<br />Digital Item Streaming<br />IPMP Components<br />Digital Item Adaptation<br />MPQF<br />13<br />2009/11/23-24<br />Christian Timmerer, Klagenfurt University, Austria<br />
  30. 30. Motivation of providing API<br />MPEG specifications: huge amount of technology<br />157 standards in ISO/IEC 14496 (MPEG-4) family<br />43 standards in ISO/IEC 15938 (MPEG-7) family<br />33 standards in ISO/IEC 21000 (MPEG-21) family<br />…<br />Around 11 000 pages, 1,5 m high when printed<br />However, majority of people developing MPEG related applications do not need to know that is inside the boxes, but only how to use it<br />2009/11/23-24<br />14<br />Christian Timmerer, Klagenfurt University, Austria<br />
  31. 31. The MXM Approach<br />1. Creating wrapping libraries, called engines<br />2. Opening the engines at ESSENTIAL points only<br />3. Documenting the IN/OUT points in another …<br /> MPEG standard: 23006-2 MXM API<br />- only 37 pages , <br />- around 500 methods<br />2009/11/23-24<br />15<br />Christian Timmerer, Klagenfurt University, Austria<br />
  32. 32. List of MXM Engines<br /><ul><li>ContentProtocolEngine
  33. 33. ContentSearchEngine
  34. 34. DIAEngine
  35. 35. DIDEngine
  36. 36. DISEngine
  37. 37. DomainEngine
  38. 38. EREngine
  39. 39. IPMPEngine
  40. 40. IPMPToolProtocolEngine
  41. 41. LicenseProtocolEngine
  42. 42. MediaFrameworkEngine
  43. 43. MetadataEngine
  44. 44. MPEG21FileEngine
  45. 45. MVCOEngine
  46. 46. OrchestratorEngine
  47. 47. RELEngine
  48. 48. RenderingEngine
  49. 49. SecurityEngine</li></ul>16<br />2009/11/23-24<br />Christian Timmerer, Klagenfurt University, Austria<br />
  50. 50. MXM APIs of Each Engine have been Divided into…<br /><ul><li>Creation e.g.
  51. 51. Encode a raw audio track
  52. 52. Create an MPEG-7 metadata description
  53. 53. Access e.g.
  54. 54. Get data from a Digital Item
  55. 55. Decode a video
  56. 56. Editing e.g.
  57. 57. Add an elementary stream to a multiplexed content
  58. 58. Engine-specific e.g.
  59. 59. RELEngine: authorise(license, query)
  60. 60. LicenseProtocolEngine: requestLicense(licenseID, serviceURL) </li></ul>17<br />2009/11/23-24<br />Christian Timmerer, Klagenfurt University, Austria<br />
  61. 61. Fully Interoperable Streaming ofMedia Resources in Heterogeneous Environments<br />2009/11/23-24<br />Christian Timmerer, Klagenfurt University, Austria<br />18<br />
  62. 62. Including MPEG-4 3D graphics in 3rd-Party Application<br />Including mp3, jpeg, mp4 video in third party applications is nowadays a beginner job. <br />The complexity of such codecs is hidden behind a very simple communication interface once the content is decoded: matrix of pixels for images and wave samples for audio. <br />Transposing the same principle in Computer Graphics world is a challenge due to the variety of representation forms and also the complexity and heterogeneity of data to be transferred<br />2009/11/23-24<br />Christian Timmerer, Klagenfurt University, Austria<br />19<br />By using the MXM 3DGraphicsEngine and its set of APIs, the complex integration work is simplified.<br />With only some lines of code, Ogre3D, a very well known 3D graphics rendering engine, is transformed into an MPEG-4 3D graphics player. <br />
  63. 63. Sharing Protected Content<br />2009/11/23-24<br />Christian Timmerer, Klagenfurt University, Austria<br />20<br />Client:<br />MXM-based C++ client as Firefox plug-in <br />Server:<br />MXM-based Java server<br />Protocols:<br />MXM Protocols over SOAP and XMPP<br /><br />
  64. 64. Join the MXM Development Team!<br />Why you should join<br />Plenty of interesting work still has to be done<br />Enough space for student projects, master thesis, PhD thesis, etc.<br />You can choose between Java, C++ or start a new implementation in another language!<br />It gives you visibility on a broad set of MPEG technologies<br />Web site, blog, reflector, and soon more utilities<br />Friendly and collaborative environment <br />21<br />2009/11/23-24<br />Christian Timmerer, Klagenfurt University, Austria<br />
  65. 65. Thank you for your attention!<br />... questions, comments, etc. are welcome …<br />Ass.-Prof. Dipl.-Ing. Dr. Christian Timmerer<br />Klagenfurt University, Department of Information Technology (ITEC)<br />Universitätsstrasse 65-67, A-9020 Klagenfurt, AUSTRIA<br /><br /><br />Tel: +43/463/2700 3621 Fax: +43/463/2700 3699<br />© Copyright: Christian Timmerer<br />22<br />2009/11/23-24<br />Christian Timmerer, Klagenfurt University, Austria<br /><br /><br /><br />