• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Accelerating Media Business Developments, MPEG-M: MPEG Extensible Middleware
 

Accelerating Media Business Developments, MPEG-M: MPEG Extensible Middleware

on

  • 3,356 views

The MXM presentation as presented during FIA Stockholm http://www.fi-stockholm.eu/

The MXM presentation as presented during FIA Stockholm http://www.fi-stockholm.eu/

Statistics

Views

Total Views
3,356
Views on SlideShare
2,428
Embed Views
928

Actions

Likes
0
Downloads
18
Comments
0

5 Embeds 928

http://mxm.wg11.sc29.org 914
http://translate.googleusercontent.com 6
http://feeds.feedburner.com 4
http://www.slideshare.net 3
http://health.medicbd.com 1

Accessibility

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Accelerating Media Business Developments, MPEG-M: MPEG Extensible Middleware Accelerating Media Business Developments, MPEG-M: MPEG Extensible Middleware Presentation Transcript

    • http://mxm.wg11.sc29.org/
      mxm@lists.uni-klu.ac.at
      http://wg11.sc29.org/mxmsvn/repos
      Accelerating Media Business Developments
      MPEG-M: MPEG Extensible Middleware
      Christian Timmerer, FilippoChiariglione, Marius Preda
      Klagenfurt University (UNI-KLU)  Faculty of Technical Sciences (TEWI)
      Department of Information Technology (ITEC)  Multimedia Communication (MMC)
      http://research.timmerer.com  http://blog.timmerer.com  mailto:christian.timmerer@itec.uni-klu.ac.at
      Acknowledgments
      L. Chiariglione, M. Eberhard, I. Arsov, A. Difino
    • What if …
      • … one does not need to have in-depth knowledge of specific MPEG technologies / standards?
      • … one is able to start with application/business development as soon as some (reference) software becomes available?
      • … one is able to exchange applications’ underlying (reference) software with optimized one at no cost?
      2009/11/23-24
      Christian Timmerer, Klagenfurt University, Austria
      2
    • 2009/11/23-24
      Christian Timmerer, Klagenfurt University, Austria
      3
    • Outline
      Vision
      Overview
      Architecture
      Application Programming Interface (API)
      Example Instantiations
      Fully Interoperable Streaming
      Including MPEG-4 3D Graphics in 3rd-Party Apps
      Sharing Protected Contents
      2009/11/23-24
      Christian Timmerer, Klagenfurt University, Austria
      4
    • The MXM Vision
      • MPEG-21 Multimedia Framework
      • From Framework to Platform respecting
      • Creator and rights holders rights to exploit their works
      • End user wish to fully enjoy the benefits of digital media
      • Various value-chain player interest to provide products and services
      ➪ DMP has specified Interoperable DRM Platform (IDP)
      2009/11/23-24
      Christian Timmerer, Klagenfurt University, Austria
      5
      “every human is potentially an element of a network involving billions of content providers, value adders, packagers, service providers, resellers, consumers ...”
      Framework
      Platform
      . . .
    • The MXM Vision (cont’d)
      • From Platform to Middleware enabling
      • APIs + protocols in a platform-independent way + … (see the following slides)
      ➪ MPEG Extensible Middleware (MXM)
      What’s next?
      • From Middleware to Terminal enabling
      • ITU-T: definition of IPTV infrastructure and components
      • MPEG: development of enabling technologies for, e.g., IPTV
      ➪ Advanced IPTV Terminal (AIT)
      2009/11/23-24
      Christian Timmerer, Klagenfurt University, Austria
      6
      . . .
      Middleware
      Terminal
    • Overview
      • A set of APIs to access possibly all MPEG technologies
      • Simple methods to call complex functionalities inside MXM engines
      • “Thin” applications because the complexity is in the MXM engines
      • Replacement of MXM engines with better performing ones at no cost
      • Creation of a global market of MXM Engines, MXM Applications and MXM Devices
      2009/11/23-24
      Christian Timmerer, Klagenfurt University, Austria
      7
    • Overview (cont’d)
      The MXM standard – ISO/IEC 23006 – is subdivided in four parts:
      • Part 1 - MXM Architecture and Technologies specifies the MXM architecture and references the technologies that are part of an MXM implementation;
      • Part 2 - MXM Application Programming Interfaces (APIs): specifies the MXM APIs;
      • Part 3 - MXM Conformance and Reference Software: specifies conformance tests and the software implementation of the standard
      • Part 4 – MXM Protocols: specifies a set of protocols enabling distributed applications to exchange information related to content items and parts thereof, including rights and protection information
      2009/11/23-24
      Christian Timmerer, Klagenfurt University, Austria
      8
    • MXM Application 1
      MXM Application 2
      MXM
      Engine
      APIs‏
      MXM Device
      MPEG21 File
      Engine
      Digital Item
      Engine
      REL
      Engine
      IPMP
      Engine
      Other
      Engines
      Security
      Engine
      Scene
      Engine
      Content
      Metadata
      Engine
      Media
      Framework
      Engine
      OS
      Drivers, Accelerators, Controllers, etc.
      HW
      9
      2009/11/23-24
      Christian Timmerer, Klagenfurt University, Austria
    • MXM Application 3
      MXM Application 1
      MXM Application 2
      MXM
      Orchestrator
      API‏
      MXM Device
      MPEG21 File
      Engine
      Digital Item
      Engine
      REL
      Engine
      IPMP
      Engine
      Orchestrator
      Engine
      Other
      Engines
      Security
      Engine
      Scene
      Engine
      Content
      Metadata
      Engine
      Media
      Framework
      Engine
      OS
      Drivers, Accelerators, Controllers, etc.
      HW
      10
      2009/11/23-24
      Christian Timmerer, Klagenfurt University, Austria
    • MXM Protocols
      License
      Provider
      Device
      Content
      Identific.
      Device
      Content
      Creation
      Device
      End-User
      Device
      Content
      Provider
      Device
      DRM Tool
      Provider
      Device
      11
      2009/11/23-24
      Christian Timmerer, Klagenfurt University, Austria
    • MXM Application
      MXM Application
      MXM
      OS
      MXM
      OS
      Computing Platform
      Computing Platform
      Enabling MXM Apps to communicate
      12
      2009/11/23-24
      Christian Timmerer, Klagenfurt University, Austria
    • An Impressive Number of Standards…
      MPEG-7 Visual
      Advanced Audio Coding
      LASeR
      MDS
      Event Reporting
      Reconfigurable Video Coding
      BIFS
      HE AAC
      IPMPX
      Digital Item Processing
      Digital Item Declaration
      File Format
      Audio Lossless Coding
      Intellectual Property Management and Protection
      Media Value Chain Ontology
      Rights Expression Language
      Digital Item Identification
      XML IPMP messages
      Digital Item Streaming
      IPMP Components
      Digital Item Adaptation
      MPQF
      13
      2009/11/23-24
      Christian Timmerer, Klagenfurt University, Austria
    • Motivation of providing API
      MPEG specifications: huge amount of technology
      157 standards in ISO/IEC 14496 (MPEG-4) family
      43 standards in ISO/IEC 15938 (MPEG-7) family
      33 standards in ISO/IEC 21000 (MPEG-21) family

      Around 11 000 pages, 1,5 m high when printed
      However, majority of people developing MPEG related applications do not need to know that is inside the boxes, but only how to use it
      2009/11/23-24
      14
      Christian Timmerer, Klagenfurt University, Austria
    • The MXM Approach
      1. Creating wrapping libraries, called engines
      2. Opening the engines at ESSENTIAL points only
      3. Documenting the IN/OUT points in another …
      MPEG standard: 23006-2 MXM API
      - only 37 pages ,
      - around 500 methods
      2009/11/23-24
      15
      Christian Timmerer, Klagenfurt University, Austria
    • List of MXM Engines
      • ContentProtocolEngine
      • ContentSearchEngine
      • DIAEngine
      • DIDEngine
      • DISEngine
      • DomainEngine
      • EREngine
      • IPMPEngine
      • IPMPToolProtocolEngine
      • LicenseProtocolEngine
      • MediaFrameworkEngine
      • MetadataEngine
      • MPEG21FileEngine
      • MVCOEngine
      • OrchestratorEngine
      • RELEngine
      • RenderingEngine
      • SecurityEngine
      16
      2009/11/23-24
      Christian Timmerer, Klagenfurt University, Austria
    • MXM APIs of Each Engine have been Divided into…
      • Creation e.g.
      • Encode a raw audio track
      • Create an MPEG-7 metadata description
      • Access e.g.
      • Get data from a Digital Item
      • Decode a video
      • Editing e.g.
      • Add an elementary stream to a multiplexed content
      • Engine-specific e.g.
      • RELEngine: authorise(license, query)
      • LicenseProtocolEngine: requestLicense(licenseID, serviceURL) 
      17
      2009/11/23-24
      Christian Timmerer, Klagenfurt University, Austria
    • Fully Interoperable Streaming ofMedia Resources in Heterogeneous Environments
      2009/11/23-24
      Christian Timmerer, Klagenfurt University, Austria
      18
    • Including MPEG-4 3D graphics in 3rd-Party Application
      Including mp3, jpeg, mp4 video in third party applications is nowadays a beginner job.
      The complexity of such codecs is hidden behind a very simple communication interface once the content is decoded: matrix of pixels for images and wave samples for audio.
      Transposing the same principle in Computer Graphics world is a challenge due to the variety of representation forms and also the complexity and heterogeneity of data to be transferred
      2009/11/23-24
      Christian Timmerer, Klagenfurt University, Austria
      19
      By using the MXM 3DGraphicsEngine and its set of APIs, the complex integration work is simplified.
      With only some lines of code, Ogre3D, a very well known 3D graphics rendering engine, is transformed into an MPEG-4 3D graphics player.
    • Sharing Protected Content
      2009/11/23-24
      Christian Timmerer, Klagenfurt University, Austria
      20
      Client:
      MXM-based C++ client as Firefox plug-in
      Server:
      MXM-based Java server
      Protocols:
      MXM Protocols over SOAP and XMPP
      http://www.smartrm.com
    • Join the MXM Development Team!
      Why you should join
      Plenty of interesting work still has to be done
      Enough space for student projects, master thesis, PhD thesis, etc.
      You can choose between Java, C++ or start a new implementation in another language!
      It gives you visibility on a broad set of MPEG technologies
      Web site, blog, reflector, and soon more utilities
      Friendly and collaborative environment 
      21
      2009/11/23-24
      Christian Timmerer, Klagenfurt University, Austria
    • Thank you for your attention!
      ... questions, comments, etc. are welcome …
      Ass.-Prof. Dipl.-Ing. Dr. Christian Timmerer
      Klagenfurt University, Department of Information Technology (ITEC)
      Universitätsstrasse 65-67, A-9020 Klagenfurt, AUSTRIA
      christian.timmerer@itec.uni-klu.ac.at
      http://research.timmerer.com/
      Tel: +43/463/2700 3621 Fax: +43/463/2700 3699
      © Copyright: Christian Timmerer
      22
      2009/11/23-24
      Christian Timmerer, Klagenfurt University, Austria
      http://mxm.wg11.sc29.org/
      mxm@lists.uni-klu.ac.at
      http://wg11.sc29.org/mxmsvn/repos