Presentation given on May 25th 2011 during the Seminar of the WorldDMB TC

1. MPEG-4 BIFS and MPEG-2 TS: Latest developments for digital radio services Cyril Concolato 25/05/2011

2. Chronology of MPEG-4 BIFS new dev. for Digital Radio Services Requirement Phase (July 2008 – July 2009) V0 July 2008, V1 Oct. 2008, V2 Feb. 2009, V3 Apr. 2009, V4 July 2009 (N10856) Development Phase (Feb. 2009 – Apr. 2010) WD1.0 Feb.2009, CfP Apr. 2009, PDAM July 2009, FPDAM Oct. 2009, Study Jan. 2010, FDAM Apr. 2010 (N11251) Published as ISO/IEC 14496-11:2005/Amd 7:2010 Dec. 2010 Reference & Conf. Soft (Jan. 2011 – now) 14496-4:2004/AMD 40 (N11716) 14496-5:2001/AMD 30 (N11720) page 1

3. Requirements Backward compatibility with Core2D Maximize quality while minimizing bit rate Avoid modifications of T-DMB transport layers Minimize the additional implementation costs Provide new features for Vector Graphics enhancements Text handling Scene layout Adaptation Navigation Delivery of images Scene state management Integration with external data sources page 2

4. Content of the Amendment New tools CacheTexture EnvironmentTest KeyNavigator Storage ExtendedReplace & ExternalReplace (To/From) Updates Minor modifications Layout Node with "justify" alignment Valuator Node for concatenation of strings XCore2D profile definition page 3

5. The CacheTexture Node Transport of images within the BIFS stream: without a separate elementary stream without OD signaling With native image encoding (no base64) Cache optional page 4

6. The EnvironmentTest Node Detecting environment parameters Aspect ratio, display w/h, dpi, automotive … Code points available for other SDO and triggering scene events for adaptation page 5

7. The KeyNavigator Node Removes the need for some complex Conditional + Routes logic + InputSensor page 6

8. The Storage Node Ability to save user preferences and restore them after radio station change page 7

9. Demos page 8

10. New Updates ExtendedReplace XREPLACE LABEL.emissiveColor BY LABEL2.emissiveColor ReplaceFromExternalData Use data located outside the BIFS engine Identified by a ‘free-form’ string REPLACE T.string BY "urn:…:epg:title" ReplaceToExternalData Reports data outside the BIFS engine REPLACE “urn:user:pref:…:value” BY V.outSFBool page 9

11. XCore2D Scene Graph Profile definition XCore2D = Core2D + CacheTexture / EnvironmentTest / KeyNavigator CompositeTexture2D (cache of vectorgraphics) Layer2D Layout (onlytextchildren) TransformMatrix2D Viewport WorldInfo PROTO Extended updates page 10

12. XCore2D Graphics Profile Definition XCore2D = Core2D + Curve2D / XCurve2D Ellipse LineProperties / XLineProperties LinearGradient / RadialGradient page 11

13. Extensions for simplified carriage of MPEG-4 over MPEG-2 Chronology of 13818-1:2007/Amd.8 WD1.0, Daegu, Jan. 2011 WD2.0, Geneva, Mar. 2011 Provides DVB/ATSC/ISDB backward-compatible services Carriage of A/V data w/o SL, with PES http://www.youtube.com/watch?v=Bmer91TZhCo Improvesefficiency of carriage Use BIFS URL like: « PID://xxx » No need for OD declaration Removesthe need for OD stream (in some cases) Declaration of OD within the PMT Use of the MPEG-2 TS « ODUpdateDescriptor » PredefinedSLConfig value for SL-section in PMT Enable use of other MPEG-4 data (fonts, …) Ability to carry any MPEG-4 Systems streamwithin ISO/IEC-14496 sections page 12

14. Existingcarriage page 13 Object Description Stream Program Association Table ObjectDescriptor { ES_Descriptor { ES_ID=0x0013 streamType = “mpeg4-audio“ DecoderSpecificInfo=… } } ObjectDescriptor { ES_Descriptor { ES_ID=0x0014 streamType = “mpeg4-video“ DecoderSpecificInfo=… } } … { … program_number=0x0001 program_map_PID=0x0100 … } CRC_32 ISO_IEC_14496_Section ISO_IEC_14496_Section BIFS Stream OD Stream TS paquet PID=0x0000 TS paquet PID=0x0112 TS paquet PID=0x0111 MPEG-2 Transport Stream TS paquet PID=0x0100 TS paquet PID=0x0113 Initial Object Descriptor … ES_Descriptor { ES_ID=0x0011 streamType = “bifs“ DecoderSpecificInfo=… } ES_Descriptor { ES_ID=0x0012 streamType = “od “ } streamType = 0x13 elementary_PID = 0X0112 2nd_descriptor_loop { SL_Descriptor { ES_ID = 0X0012} } streamType = 0x12 elementary_PID = 0X0113 2nd_descriptor_loop { SL_Descriptor { ES_ID = 0X0013} } streamType = 0x12 elementary_PID = 0X0114 2nd_descriptor_loop { SL_Descriptor { ES_ID = 0X0014} } … TS Program MAP Section PES Packet stream_id=“1111 1010" … Program_stream_info_length 1st_descriptor_loop { IOD_Descriptor {} } { streamType = 0x13 elementary_PID = 0X0111 2nd_descriptor_loop { SL_Descriptor { ES_ID = 0X0011} } MPEG-4 Audio AAC stream

15. Backward-compatible carriage page 14 Scene Program Association Table … { … program_number=0x0001 program_map_PID=0x0100 … } CRC_32 ISO_IEC_14496_Section Movie Texture Audio Source BIFS Stream URL = "pid://0x0113" URL = "pid://0x0114" TS packetPID=0x0000 TS packetPID=0x0111 MPEG-2 Transport Stream TS packet PID=0x0114 TS packet PID=0x0113 TS packetPID=0x0100 Initial Object Descriptor … ES_Descriptor { ES_ID=0x0011 streamType = “bifs“ DecoderSpecificInfo=… } streamType = 0x11 elementary_PID = 0X0113 streamType = 0x1B elementary_PID = 0X0114 TS Program MAP Section PES Packet PES Packet … Program_stream_info_length 1st_descriptor_loop { IOD_Descriptor {} } { streamType = 0x13 elementary_PID = 0X0111 2nd_descriptor_loop { SL_Descriptor { ES_ID = 0X0011} } MPEG-4 Video AVC stream MPEG-4 Audio AAC stream

16. Other MPEG documents One pager on BIFS for digital radio, March 2011, N11958. New edition (4th) of MPEG-4 Systems: 14496-1:2010 Integration of corrigendum, and amendments page 15

17. Contactcyril.concolato@telecom-paristech.fr page 16