The MXM vision


       Leonardo Chiariglione
Presentation to MXM developers’ day
        London, 2009/06/30
The drivers of
          the “digital future” dream/1
      First: the digital future dream
          Digital audio and video will mean more network, more
             services, more equipment, more users

      Telcos:
          Video commmunication in addition to speech (sure)
          TV on telcos’ network (maybe)
          Driver of the new optical infrastructure
      Broadcasters
          Better pictures and audio
          More pictures and audio
The MXM vision                                         09/06/30
                                                                  2
The drivers of
           the “digital future” dream/2
      CE manufacturers
          More devices for more services

      IT manufacturers
          More servers to manage and serve digital assets
      IC manufacturers
          More and more intelligent silicon

      Telco manufacturers
          More and more intelligent network equipment


The MXM vision                                           09/06/30
                                                                    3
MPEG the octopus
     1. Video compression
     2. Audio compression
     3. 3D Graphics compression
     4. Systems layer
     5. Media composition
     6. Transport
     7. Media description
     8. IPMP
The lMXM vision                   09/06/30
                                             4
Multimedia Framework
      Speech at 49th MPEG meeting, October 1999
         “Every human is potentially an element of a network involving
             billions of content providers, value adders, packagers, service
             providers, resellers, consumers ...”

         Looks like web 2.0 ante litteram – but it is not (partly)

      MPEG-21 “Multimedia framework” is the suite of
         ISO/IEC standards providing the technologies that help
         realise the vision of diffuse trading of digital content
      MPEG-21 is multi-year project involving hundreds of
         experts at the global level
The MXM vision                                                  09/06/30
                                                                               5
MPEG-21 fundamentals
      Digital Item: a structured digital object with a standard
         representation, identification and metadata
      User: any Creator, End User or Intermediary that
         makes use of Digital Items in the MPEG-21 framework
         or interacts with other Users



                             Transaction/Use/Relationship
                 User A         Digital Item (Content)    User B
                          Authorisation/Value Exchange



The MXM vision                                              09/06/30
                                                                       6
Some MPEG-21 technologies
     Technology                    Purpose
     Digital Item                  XML structure for Resources, Metadata etc.
     Digital Item Identification   Identification of DIs and components
     IPMP Components               Rights Management and Protection Tools
     Rights Expression Language    Language to express machine readable rights
     Rights Data Dictionary        Semantics of verbs used in REL
     Digital Item Adaptation       Information describing adaptation
     Event Reporting               Request and communication of ERs
     Digital Item File Format      File Format for DIs
     Digital Item Streaming        Streaming Format for DIs
     And more…


The The MXM vision                                               09/06/30
                                                                                 7
From framework to platform
      The Digital Media Project (DMP) was established on 1st
         December 2003 with the mission to
      …promote continuing successful development,
         deployment and use of digital media that respect
          Creator and rights holders rights to exploit their works
          End user wish to fully enjoy the benefits of digital media
          Various value-chain player interest to provide products
             and services
      DMP has specified an “Interoperable DRM Platform” by
          Adopting most MPEG-21 technologies
          Adding a few that were missing
          Making an OSS implementation (Chillout®)

The MXM vision                                            09/06/30
                                                                        8
Interoperable DRM Platform
           (IDP) specification v. 3.2
     #
     1    Value-Chain Functions and Requirements
     2    Architecture
     3    Interoperable DRM Platform
     4    Use Cases and Value Chains
     5    Registration and Certification Authorities
     6    Terminology
     7    Reference Software
     8    End-to-end Conformance
     9    Mapping of Traditional Rights and Usages to the Digital Space

The MXM vision                                            09/06/30
                                                                          9
A digital media value chain
                           License                            7              Domain             Domain
                           Provider                                           Mgmt             Identific.
                           Device                                            Device             Device
                                     4                                                       12
                                                 6
                                   Role
                   1            Verification                                 10
                                 Device
                            2                     4
                                      4                   9
                       1
      Content              Content             Content
                                    5                             End-User   End-User         End-User
      Identific.           Creation            Provider
                                                                   Device     Device           Device
       Device              Device              Device

                   1        3             8                                  11


                           IPMP Tool                                          Device
                            Provider                                         Identific.
                             Device                                           Device
The MXM vision                                                                            09/06/30
                                                                                                            10
Chillout®
                                 Chillout software

      Devices

       LPD        CPD   TPD   CCD    EUD   DMD     RVD   DID     DoID     CID



     Libraries

                 P2P          Auxiliary          Core     Media Framework




                              OS + Java platform + dependencies

The MXM vision                                                 09/06/30
                                                                           11
From platform to middleware
            MXM Application 1                  MXM Application 2                    MXM Application 3
                     MXM                                                MXM
                  Application                                          Engine
                     A
                     API                                                A
                                                                        APIs
                                                    MXM Device


                            Orches-         MPEG21           Digital
                             trator          File             Item               REL           IPMP
                            Engine          Engine           Engine             Engine        Engine


         M3W
        Pts 2-7
                                                              Media
                            Security        Content          Frame-             Scene
                                            Metadata                                           Other
                             Engine                           work              Engine        Engines
                                             Engine          Engine




                                                       OS

                                Drivers, Accelerators, Controllers, etc.
         09/06/08                CEDEO.net – Status report and prospects
                                 La proposta di Digital Media in Italia
                                                       HW                          12
                                                                                 2009/05/08              12



The MXM vision                                                                           09/06/30
                                                                                                        12
A global market thanks to the
             MXM standard
      MXM applications run on all MXM devices thanks to
         the standard MXM application API
      MXM devices play MXM applications thanks to the
         standard MXM architecture
      MXM components are competitively produced thanks
         to the standard MXM components APIs
      Innovative business models are deployed because
         media-handling value chains are ease to design and
         implement

TheThe MXM vision                                  09/06/30
                                                              13
From Middleware to Terminal
      ITU-T SG 16 and MPEG, considering that
          The ITU-T has been working on the definition of IPTV
           infrastructure and components
          MPEG has been working to develop enabling
           technologies, some of which that can be used for IPTV
           services

      have agreed on a joint project aimed at developing a
         common standard for “Advanced IPTV Terminal” (AIT)




The MXM vision                                         2009/06/30
                                                                    14
A vision for AIT
      Give users the ability to seamlessly
            Create
            Publish
            Distribute
            Access
            Pay/cash
            Process
            Re-distribute
            Consume

         governed Advanced IPTV Services

The MXM vision                                2009/06/30
                                                           15
The benefits of
             Advanced IPTV Terminal
      With an AIT standard a user in a value chain can
          Perform the functions required by his role with an AIT available
             from the market
            Compose his own User Interface with User Interfaces of other
             value chain users
            Be apprised of how his service/content is being used in a value
             chain
            Concurrently access and consume services from different
             service and connectivity providers
            Perform transactions with any payment service provider
            Consume governed content from any content/service provider

      De-verticalisation of delivery, DRM and payment
                                                                           16
                                                              2009/06/30
The MXM vision
Open Media Marketplace
     (DMP)                                       Identify
                                                   User
                                                            Identify
                                                            Content
 1. Identify User
                                      Render                               Manage
 2. Identify Content                  Content                              Resource

 3. Manage Resource
 4. Edit Resource          Convert
                            Unit
                                                                                      Edit
                                                                                    Resource
 5. Manage Metadata
 6. Deliver Content
 7. Record Event          Record                User           User                   Manage
                          Default                A              B                     Metadata
 8. Host Site
 9. Negotiate Rights
 10. Promote Entity         Record                                                  Deliver
                            Xaction                                                 Content
 11. Record Transaction
 12. Record Default
                                      Promote                              Record
 13. Render Content                    Entity                              Event

 14. Convert Unit                               Negotiate   Host
                                                 Rights     Site

The MXM vision                                                  09/06/30
                                                                                    17
To know more…
         mpeg.chiariglione.org
                 chillout.dmpf.org
                  www.dmpf.org
                   www.dmin.it
The MXM vision                    09/06/30
                                             18

The MPEG Extensible Middleware Vision

  • 1.
    The MXM vision Leonardo Chiariglione Presentation to MXM developers’ day London, 2009/06/30
  • 2.
    The drivers of the “digital future” dream/1  First: the digital future dream  Digital audio and video will mean more network, more services, more equipment, more users  Telcos:  Video commmunication in addition to speech (sure)  TV on telcos’ network (maybe)  Driver of the new optical infrastructure  Broadcasters  Better pictures and audio  More pictures and audio The MXM vision 09/06/30 2
  • 3.
    The drivers of the “digital future” dream/2  CE manufacturers  More devices for more services  IT manufacturers  More servers to manage and serve digital assets  IC manufacturers  More and more intelligent silicon  Telco manufacturers  More and more intelligent network equipment The MXM vision 09/06/30 3
  • 4.
    MPEG the octopus 1. Video compression 2. Audio compression 3. 3D Graphics compression 4. Systems layer 5. Media composition 6. Transport 7. Media description 8. IPMP The lMXM vision 09/06/30 4
  • 5.
    Multimedia Framework  Speech at 49th MPEG meeting, October 1999  “Every human is potentially an element of a network involving billions of content providers, value adders, packagers, service providers, resellers, consumers ...”  Looks like web 2.0 ante litteram – but it is not (partly)  MPEG-21 “Multimedia framework” is the suite of ISO/IEC standards providing the technologies that help realise the vision of diffuse trading of digital content  MPEG-21 is multi-year project involving hundreds of experts at the global level The MXM vision 09/06/30 5
  • 6.
    MPEG-21 fundamentals  Digital Item: a structured digital object with a standard representation, identification and metadata  User: any Creator, End User or Intermediary that makes use of Digital Items in the MPEG-21 framework or interacts with other Users Transaction/Use/Relationship User A Digital Item (Content) User B Authorisation/Value Exchange The MXM vision 09/06/30 6
  • 7.
    Some MPEG-21 technologies Technology Purpose Digital Item XML structure for Resources, Metadata etc. Digital Item Identification Identification of DIs and components IPMP Components Rights Management and Protection Tools Rights Expression Language Language to express machine readable rights Rights Data Dictionary Semantics of verbs used in REL Digital Item Adaptation Information describing adaptation Event Reporting Request and communication of ERs Digital Item File Format File Format for DIs Digital Item Streaming Streaming Format for DIs And more… The The MXM vision 09/06/30 7
  • 8.
    From framework toplatform  The Digital Media Project (DMP) was established on 1st December 2003 with the mission to  …promote continuing successful development, deployment and use of digital media that respect  Creator and rights holders rights to exploit their works  End user wish to fully enjoy the benefits of digital media  Various value-chain player interest to provide products and services  DMP has specified an “Interoperable DRM Platform” by  Adopting most MPEG-21 technologies  Adding a few that were missing  Making an OSS implementation (Chillout®) The MXM vision 09/06/30 8
  • 9.
    Interoperable DRM Platform (IDP) specification v. 3.2 # 1 Value-Chain Functions and Requirements 2 Architecture 3 Interoperable DRM Platform 4 Use Cases and Value Chains 5 Registration and Certification Authorities 6 Terminology 7 Reference Software 8 End-to-end Conformance 9 Mapping of Traditional Rights and Usages to the Digital Space The MXM vision 09/06/30 9
  • 10.
    A digital mediavalue chain License 7 Domain Domain Provider Mgmt Identific. Device Device Device 4 12 6 Role 1 Verification 10 Device 2 4 4 9 1 Content Content Content 5 End-User End-User End-User Identific. Creation Provider Device Device Device Device Device Device 1 3 8 11 IPMP Tool Device Provider Identific. Device Device The MXM vision 09/06/30 10
  • 11.
    Chillout® Chillout software Devices LPD CPD TPD CCD EUD DMD RVD DID DoID CID Libraries P2P Auxiliary Core Media Framework OS + Java platform + dependencies The MXM vision 09/06/30 11
  • 12.
    From platform tomiddleware MXM Application 1 MXM Application 2 MXM Application 3 MXM MXM Application Engine A API A APIs MXM Device Orches- MPEG21 Digital trator File Item REL IPMP Engine Engine Engine Engine Engine M3W Pts 2-7 Media Security Content Frame- Scene Metadata Other Engine work Engine Engines Engine Engine OS Drivers, Accelerators, Controllers, etc. 09/06/08 CEDEO.net – Status report and prospects La proposta di Digital Media in Italia HW 12 2009/05/08 12 The MXM vision 09/06/30 12
  • 13.
    A global marketthanks to the MXM standard  MXM applications run on all MXM devices thanks to the standard MXM application API  MXM devices play MXM applications thanks to the standard MXM architecture  MXM components are competitively produced thanks to the standard MXM components APIs  Innovative business models are deployed because media-handling value chains are ease to design and implement TheThe MXM vision 09/06/30 13
  • 14.
    From Middleware toTerminal  ITU-T SG 16 and MPEG, considering that  The ITU-T has been working on the definition of IPTV infrastructure and components  MPEG has been working to develop enabling technologies, some of which that can be used for IPTV services  have agreed on a joint project aimed at developing a common standard for “Advanced IPTV Terminal” (AIT) The MXM vision 2009/06/30 14
  • 15.
    A vision forAIT  Give users the ability to seamlessly  Create  Publish  Distribute  Access  Pay/cash  Process  Re-distribute  Consume governed Advanced IPTV Services The MXM vision 2009/06/30 15
  • 16.
    The benefits of Advanced IPTV Terminal  With an AIT standard a user in a value chain can  Perform the functions required by his role with an AIT available from the market  Compose his own User Interface with User Interfaces of other value chain users  Be apprised of how his service/content is being used in a value chain  Concurrently access and consume services from different service and connectivity providers  Perform transactions with any payment service provider  Consume governed content from any content/service provider  De-verticalisation of delivery, DRM and payment 16 2009/06/30 The MXM vision
  • 17.
    Open Media Marketplace (DMP) Identify User Identify Content 1. Identify User Render Manage 2. Identify Content Content Resource 3. Manage Resource 4. Edit Resource Convert Unit Edit Resource 5. Manage Metadata 6. Deliver Content 7. Record Event Record User User Manage Default A B Metadata 8. Host Site 9. Negotiate Rights 10. Promote Entity Record Deliver Xaction Content 11. Record Transaction 12. Record Default Promote Record 13. Render Content Entity Event 14. Convert Unit Negotiate Host Rights Site The MXM vision 09/06/30 17
  • 18.
    To know more… mpeg.chiariglione.org chillout.dmpf.org www.dmpf.org www.dmin.it The MXM vision 09/06/30 18