Accelerating Media Business Developments, MPEG-M: MPEG Extensible Middleware

http://mxm.wg11.sc29.org/
mxm@lists.uni-klu.ac.at
http://wg11.sc29.org/mxmsvn/repos
Accelerating Media Business Developments
MPEG-M: MPEG Extensible Middleware
Christian Timmerer, FilippoChiariglione, Marius Preda
Klagenfurt University (UNI-KLU)  Faculty of Technical Sciences (TEWI)
Department of Information Technology (ITEC)  Multimedia Communication (MMC)
http://research.timmerer.com  http://blog.timmerer.com  mailto:christian.timmerer@itec.uni-klu.ac.at
Acknowledgments
L. Chiariglione, M. Eberhard, I. Arsov, A. Difino

What if …
… one does not need to have in-depth knowledge of specific MPEG technologies / standards?
… one is able to start with application/business development as soon as some (reference) software becomes available?
… one is able to exchange applications’ underlying (reference) software with optimized one at no cost?
2009/11/23-24
Christian Timmerer, Klagenfurt University, Austria
2

2009/11/23-24
3

Outline
Vision
Overview
Architecture
Application Programming Interface (API)
Example Instantiations
Fully Interoperable Streaming
Including MPEG-4 3D Graphics in 3rd-Party Apps
Sharing Protected Contents
2009/11/23-24
4

The MXM Vision
MPEG-21 Multimedia Framework
From Framework to Platform respecting
Creator and rights holders rights to exploit their works
End user wish to fully enjoy the benefits of digital media
Various value-chain player interest to provide products and services
➪ DMP has specified Interoperable DRM Platform (IDP)
2009/11/23-24
5
“every human is potentially an element of a network involving billions of content providers, value adders, packagers, service providers, resellers, consumers ...”
Framework
Platform
. . .

The MXM Vision (cont’d)
From Platform to Middleware enabling
APIs + protocols in a platform-independent way + … (see the following slides)
➪ MPEG Extensible Middleware (MXM)
What’s next?
From Middleware to Terminal enabling
ITU-T: definition of IPTV infrastructure and components
MPEG: development of enabling technologies for, e.g., IPTV
➪ Advanced IPTV Terminal (AIT)
2009/11/23-24
6
. . .
Middleware
Terminal

Overview
A set of APIs to access possibly all MPEG technologies
Simple methods to call complex functionalities inside MXM engines
“Thin” applications because the complexity is in the MXM engines
Replacement of MXM engines with better performing ones at no cost
Creation of a global market of MXM Engines, MXM Applications and MXM Devices
2009/11/23-24
7

Overview (cont’d)
The MXM standard – ISO/IEC 23006 – is subdivided in four parts:
Part 1 - MXM Architecture and Technologies specifies the MXM architecture and references the technologies that are part of an MXM implementation;
Part 2 - MXM Application Programming Interfaces (APIs): specifies the MXM APIs;
Part 3 - MXM Conformance and Reference Software: specifies conformance tests and the software implementation of the standard
Part 4 – MXM Protocols: specifies a set of protocols enabling distributed applications to exchange information related to content items and parts thereof, including rights and protection information
2009/11/23-24
8

MXM Application 1
MXM Application 2
MXM
Engine
APIs‏
MXM Device
MPEG21 File
Engine
Digital Item
Engine
REL
Engine
IPMP
Engine
Other
Engines
Security
Engine
Scene
Engine
Content
Metadata
Engine
Media
Framework
Engine
OS
Drivers, Accelerators, Controllers, etc.
HW
9
2009/11/23-24

MXM Application 3
MXM Application 1
MXM Application 2
MXM
Orchestrator
API‏
MXM Device
MPEG21 File
Engine
Digital Item
Engine
REL
Engine
IPMP
Engine
Orchestrator
Engine
Other
Engines
Security
Engine
Scene
Engine
Content
Metadata
Engine
Media
Framework
Engine
OS
Drivers, Accelerators, Controllers, etc.
HW
10
2009/11/23-24

MXM Protocols
License
Provider
Device
Content
Identific.
Device
Content
Creation
Device
End-User
Device
Content
Provider
Device
DRM Tool
Provider
Device
11
2009/11/23-24

MXM Application
MXM Application
MXM
OS
MXM
OS
Computing Platform
Computing Platform
Enabling MXM Apps to communicate
12
2009/11/23-24

An Impressive Number of Standards…
MPEG-7 Visual
Advanced Audio Coding
LASeR
MDS
Event Reporting
Reconfigurable Video Coding
BIFS
HE AAC
IPMPX
Digital Item Processing
Digital Item Declaration
File Format
Audio Lossless Coding
Intellectual Property Management and Protection
Media Value Chain Ontology
Rights Expression Language
Digital Item Identification
XML IPMP messages
Digital Item Streaming
IPMP Components
Digital Item Adaptation
MPQF
13
2009/11/23-24

Motivation of providing API
MPEG specifications: huge amount of technology
157 standards in ISO/IEC 14496 (MPEG-4) family
…
Around 11 000 pages, 1,5 m high when printed
However, majority of people developing MPEG related applications do not need to know that is inside the boxes, but only how to use it
2009/11/23-24
14

The MXM Approach
1. Creating wrapping libraries, called engines
2. Opening the engines at ESSENTIAL points only
3. Documenting the IN/OUT points in another …
MPEG standard: 23006-2 MXM API
- only 37 pages ,
- around 500 methods
2009/11/23-24
15

List of MXM Engines
ContentProtocolEngine
ContentSearchEngine
DIAEngine
DIDEngine
DISEngine
DomainEngine
EREngine
IPMPEngine
IPMPToolProtocolEngine
LicenseProtocolEngine
MediaFrameworkEngine
MetadataEngine
MPEG21FileEngine
MVCOEngine
OrchestratorEngine
RELEngine
RenderingEngine
SecurityEngine
16
2009/11/23-24

MXM APIs of Each Engine have been Divided into…
Creation e.g.
Encode a raw audio track
Create an MPEG-7 metadata description
Access e.g.
Get data from a Digital Item
Decode a video
Editing e.g.
Add an elementary stream to a multiplexed content
Engine-specific e.g.
RELEngine: authorise(license, query)
LicenseProtocolEngine: requestLicense(licenseID, serviceURL)
17
2009/11/23-24

Fully Interoperable Streaming ofMedia Resources in Heterogeneous Environments
2009/11/23-24
18

Including MPEG-4 3D graphics in 3rd-Party Application
Including mp3, jpeg, mp4 video in third party applications is nowadays a beginner job.
The complexity of such codecs is hidden behind a very simple communication interface once the content is decoded: matrix of pixels for images and wave samples for audio.
Transposing the same principle in Computer Graphics world is a challenge due to the variety of representation forms and also the complexity and heterogeneity of data to be transferred
2009/11/23-24
19
By using the MXM 3DGraphicsEngine and its set of APIs, the complex integration work is simplified.
With only some lines of code, Ogre3D, a very well known 3D graphics rendering engine, is transformed into an MPEG-4 3D graphics player.

Sharing Protected Content
2009/11/23-24
20
Client:
MXM-based C++ client as Firefox plug-in
Server:
MXM-based Java server
Protocols:
MXM Protocols over SOAP and XMPP
http://www.smartrm.com

Join the MXM Development Team!
Why you should join
Plenty of interesting work still has to be done
Enough space for student projects, master thesis, PhD thesis, etc.
You can choose between Java, C++ or start a new implementation in another language!
It gives you visibility on a broad set of MPEG technologies
Web site, blog, reflector, and soon more utilities
Friendly and collaborative environment 
21
2009/11/23-24

Thank you for your attention!
... questions, comments, etc. are welcome …
Ass.-Prof. Dipl.-Ing. Dr. Christian Timmerer
Klagenfurt University, Department of Information Technology (ITEC)
Universitätsstrasse 65-67, A-9020 Klagenfurt, AUSTRIA
christian.timmerer@itec.uni-klu.ac.at
http://research.timmerer.com/
Tel: +43/463/2700 3621 Fax: +43/463/2700 3699
© Copyright: Christian Timmerer
22
2009/11/23-24
http://mxm.wg11.sc29.org/
mxm@lists.uni-klu.ac.at
http://wg11.sc29.org/mxmsvn/repos

http://mxm.wg11.sc29.org	465
http://feeds.feedburner.com	4
http://www.slideshare.net	3
http://translate.googleusercontent.com	3
http://health.medicbd.com	1

Accelerating Media Business Developments, MPEG-M: MPEG Extensible Middleware

by Alpen-Adria-Universität Klagenfurt on Nov 26, 2009

Accessibility

Categories

Tags

Upload Details

Usage Rights

5 Embeds 476

Statistics

Accelerating Media Business Developments, MPEG-M: MPEG Extensible Middleware — Presentation Transcript