Your SlideShare is downloading. ×

1

2,140
views

Published on


0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
2,140
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
15
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N10520 Maui, HI –April 2009 Source: Leonardo Chiariglione Title: Report of 88th meeting Status Report of 88th meeting............................................................................................................9 1 Opening..................................................................................................................................9 2 Roll call of participants..........................................................................................................9 3 Approval of agenda................................................................................................................9 4 Allocation of contributions....................................................................................................9 5 Communications from Convenor...........................................................................................9 6 Report of previous meeting....................................................................................................9 7 Processing of NB Position Papers..........................................................................................9 8 Work plan management ......................................................................................................10 8.1 Media coding.................................................................................................................10 8.1.1 AAC family of profiles...........................................................................................10 8.1.2 HD-AAC Profile.....................................................................................................10 8.1.3 AVC Constrained Baseline Profile.........................................................................10 8.1.4 AFX 3rd edition......................................................................................................10 8.1.5 Scalable-complexity 3D mesh compression...........................................................10 8.1.6 Open Font Format extensions.................................................................................10 8.1.7 Video Tool Library.................................................................................................11 8.1.8 Spatial Audio Object Coding..................................................................................11 8.1.9 Unified Speech and Audio Coding.........................................................................11 8.1.10 Media Context and Control...................................................................................11 8.1.11 3D Video Coding..................................................................................................11 8.1.12 High-Performance Video Coding.........................................................................11 8.2 Composition coding......................................................................................................12 8.2.1 Interactive Digital Radio.........................................................................................12 8.2.2 LASeR Adaptation..................................................................................................12 8.2.3 Presentation of Structured Information...................................................................12 8.2.4 Advanced User Interaction......................................................................................12 8.3 Description coding........................................................................................................12 8.3.1 Video Signature Descriptors...................................................................................12 8.3.2 Extraction and Matching of Image Signature Tools...............................................12 8.3.3 Query format...........................................................................................................13 8.4 Systems support............................................................................................................13 8.4.1 MPEG-4 Systems 4th edition..................................................................................13 8.4.2 Registration Authority and systems extensions......................................................13 1
  • 2. 8.5 IPMP.............................................................................................................................13 8.5.1 Protection of Presentation Element.........................................................................13 8.6 Digital Item...................................................................................................................13 8.6.1 Presentation of Digital Item....................................................................................13 8.7 Transport and File formats............................................................................................13 8.7.1 Carriage of MVC in MPEG-2 Systems...................................................................13 8.7.2 Miscellaneous additions to File Format..................................................................14 8.7.3 AVC File Format extensions for MVC...................................................................14 8.7.4 MPEG Media Transport..........................................................................................14 8.8 Multimedia architecture................................................................................................14 8.8.1 MXM Architecture..................................................................................................14 8.8.2 MXM API...............................................................................................................14 8.8.3 Advanced IPTV Terminal.......................................................................................14 8.8.4 Rich Media UI Framework.....................................................................................14 8.9 Application formats.......................................................................................................15 8.9.1 Musical Slide Show Application Format................................................................15 8.9.2 Media Streaming Application Format.....................................................................15 8.9.3 DMB AF Harmonization of MPEG-2 TS storage..................................................15 8.9.4 Interactive Music Application Format....................................................................15 8.10 Protocols......................................................................................................................15 8.10.1 MXM Protocols.....................................................................................................15 8.11 Reference implementation..........................................................................................15 8.11.1 AAC-ELD Reference Software............................................................................15 8.11.2 MVC Reference Software.....................................................................................15 8.11.3 Synthesized Texture Reference Software.............................................................16 8.11.4 Image Signature Tools Reference Software..........................................................16 8.11.5 Professional Archival Application Format Reference Software...........................16 8.11.6 DMB Application Format Reference Software...................................................16 8.11.7 Stereoscopic Video Application Format Reference Software..............................16 8.11.8 MXM Reference Software....................................................................................16 8.12 Conformance...............................................................................................................17 8.12.1 MPEG-4 Video bitstreams....................................................................................17 8.12.2 MVC Conformance...............................................................................................17 8.12.3 BSAC Conformance for Broadcasting..................................................................17 8.12.4 Image Signature Tools Conformance...................................................................17 8.12.5 Professional Archival Application Format Conformance.....................................17 8.12.6 DMB Application Format Conformance.............................................................17 8.12.7 Stereoscopic Video Application Format Conformance........................................17 8.12.8 MXM Conformance..............................................................................................18 8.13 Maintenance................................................................................................................18 8.13.1 Systems coding standards.....................................................................................18 8.13.2 Video coding standards.........................................................................................18 8.13.3 Audio coding standards.........................................................................................18 9 Organisation of this meeting ...............................................................................................18 9.1 Tasks for subgroups......................................................................................................18 9.2 Joint meetings...............................................................................................................21 10 WG management ...............................................................................................................21 10.1 Terms of reference......................................................................................................21 10.2 Editors.........................................................................................................................21 10.3 Liaisons ......................................................................................................................21 2
  • 3. 10.4 Ad hoc groups.............................................................................................................23 10.5 Asset management......................................................................................................24 10.6 IPR management.........................................................................................................24 10.7 Work plan....................................................................................................................24 11 Administrative matters ......................................................................................................24 11.1 Responses to National Bodies.....................................................................................24 11.2 Schedule of future MPEG meetings............................................................................24 12 Promotional activities........................................................................................................25 13 Resolutions of this meeting................................................................................................25 14 A.O.B.................................................................................................................................25 15 Closing...............................................................................................................................25 Annex A – Attendance list.....................................................................................................26 Annex B – Agenda.................................................................................................................32 Annex C – Input contributions...............................................................................................35 Annex D – Output documents................................................................................................54 Annex E – Requirements report.............................................................................................61 16 Requirements documents approved at this meeting...........................................................61 17 MPEG-7 Query Format......................................................................................................61 18 MPEG-4 Video..................................................................................................................61 19 LASeR................................................................................................................................61 20 MPEG-V: Information exchange with virtual worlds........................................................61 21 MAF...................................................................................................................................61 22 MPEG-User Interface Framework.....................................................................................62 Explorations ..........................................................................................................................62 22.1 Interactive Radio.........................................................................................................62 22.2 3D Video Coding........................................................................................................62 22.3 High Performance Video Coding (HVC)....................................................................62 22.4 Advanced IPTV Terminal...........................................................................................62 22.5 Pervasive AV Scene Coding.......................................................................................62 22.6 MPEG Media Transport..............................................................................................62 Annex F – Systems report.......................................................................................................64 1 Opening of the Meeting.......................................................................................................64 1.1 Approval of the agenda.................................................................................................64 1.2 Goals for the week........................................................................................................64 2 General issues......................................................................................................................68 2.1 List of standards under development............................................................................68 Pr.....................................................................................................................................68 Description......................................................................................................................68 2.2 Standing Documents....................................................................................................70 2.3 Mailing Lists Reminder................................................................................................72 2.4 Demonstrations.............................................................................................................72 3 General Input Documents....................................................................................................73 3.1 General Technical Issues..............................................................................................73 3.1.1 AHG reports............................................................................................................73 3.1.2 Contributions...........................................................................................................73 3.1.3 Liaisons...................................................................................................................74 3.2 FAQ...............................................................................................................................74 3.3 AOB..............................................................................................................................74 4 MPEG-2 Systems (13818-1) ..............................................................................................75 4.1 Topics............................................................................................................................75 3
  • 4. 4.1.1 ISO/IEC 13818-1:2007 AMD4 Transport of MVC................................................75 4.1.2 ISO/IEC 13818-1:2007 COR X Minor Corrections...............................................75 4.2 Contributions.................................................................................................................75 4.3 Action Points.................................................................................................................75 5 MPEG-4 System (14496-1) ...............................................................................................76 5.1 Topics............................................................................................................................76 5.1.1 ISO/IEC 14496-1:200X AMD 4 RA and Usage of LASeR in MPEG-4 Systems. 76 5.1.2 ISO/IEC 14496-1:200X 4th edition........................................................................76 5.2 Contributions.................................................................................................................76 5.3 Action Points.................................................................................................................76 6 MPEG-4 Conformance (14496-4) .....................................................................................77 6.1 Topics............................................................................................................................77 6.1.1 ISO/IEC 14496-4:2007 AMD37 File Format Conformance..................................77 6.2 Contributions.................................................................................................................77 6.3 Action Points.................................................................................................................77 7 MPEG-4 Reference Software (14496-5) ............................................................................77 7.1 Topics............................................................................................................................77 7.1.1 ISO/IEC 14496-5:2007 AMD 23 Sythesized Texture Reference Software...........77 7.2 Contributions.................................................................................................................77 7.3 Action Points.................................................................................................................77 8 MPEG-4 BIFS (14496-11) .................................................................................................77 8.1 Topics............................................................................................................................77 8.1.1 ISO/IEC 14496-11:2002 AMD X Digital Radio Profile........................................77 8.2 Contributions.................................................................................................................77 8.3 Action Points.................................................................................................................78 9 MPEG-4 ISO Base File Format (14496-12) ......................................................................78 9.1 14496-12/COR 2 Usage of brands and box order in sample entry...............................78 9.1.1 ISO/IEC 14496-12:2008 COR 2 Usage of brands and box order in sample entry. 78 9.1.2 ISO/IEC 14496-12:2008 AMD 1 General improvements......................................78 9.1.3 ISO/IEC 14496-12:2008 COR 3 Minor Corrections..............................................78 9.2 Contributions.................................................................................................................78 9.2.1 m16263 Summary of Voting on ISO/IEC 14496-12:2008/FPDAM 1...................78 9.2.2 m16367 Clarification of track header in ISO media file format.............................78 9.2.3 m16359 Minor or editorial errors in the Part 12 amendment.................................78 9.2.4 m16392 Adaptive Progressive Download...............................................................78 9.2.5 m16393 File format sub-track selection and switching..........................................79 9.3 Action Points.................................................................................................................79 10 MPEG-4 File Format (14496-14) ....................................................................................79 10.1 Topics .........................................................................................................................79 10.1.1 ISO/IEC 14496-14:2003 AMD 1 Handling of MPEG-4 Audio enhancement layers ................................................................................................................................79 10.2 Contributions...............................................................................................................79 10.3 Action Points...............................................................................................................79 11 MPEG-4 AVC File Format (14496-15) ...........................................................................79 11.1 Topics .........................................................................................................................79 11.1.1 ISO/IEC 14496-15:2004/FPDAM 3 MVC File Format ......................................79 11.2 Contributions...............................................................................................................80 11.2.1 m16361 Extractors in the MVC file format..........................................................80 11.2.2 m16426 On MVC File Format..............................................................................80 11.2.3 m16444 Comments to the MVC file format draft.................................................80 4
  • 5. 11.2.4 m16445 A proposal to MVC file format...............................................................80 11.3 Action Points...............................................................................................................81 12 LASeR & SAF (14496-20) ...............................................................................................81 12.1 Topics..........................................................................................................................81 12.1.1 ISO/IEC 14496-20:2008 AMD 2 Adaptation.......................................................81 12.1.2 ISO/IEC 14496-20:2008 AMD 3 PSI...................................................................81 12.2 Contributions...............................................................................................................81 12.3 Action Points...............................................................................................................83 13 Open Font Format (14496-22) ..........................................................................................83 13.1 Topics..........................................................................................................................83 13.1.1 ISO/IEC 14496-22:200X AMD 1 Full Unicode Character Repertoire Supports. 83 13.2 Contributions...............................................................................................................83 13.3 Action Points...............................................................................................................84 14 MPEG Query Format (15938-12) .....................................................................................84 14.1 Topics..........................................................................................................................84 14.1.1 ISO/IEC 15938-12:200X AMD 1 MPQF Conf. and Ref. SW..............................84 14.2 Contributions...............................................................................................................84 14.3 Action Points...............................................................................................................84 15 MPEG-21 DID (21000-2)..................................................................................................85 15.1 Topics..........................................................................................................................85 15.1.1 ISO/IEC 21000-2:200X AMD X PSI support......................................................85 15.2 Contributions...............................................................................................................85 15.3 Action Points...............................................................................................................85 16 MPEG-21 IPMP Components (21000-4)...........................................................................85 16.1 Topics..........................................................................................................................85 16.1.1 ISO/IEC 21000-4:200x AMD X Protection of Presentation element...................85 16.2 Contributions...............................................................................................................85 16.3 Action Points...............................................................................................................85 17 Media Value Chain Ontology (21000-19).........................................................................86 17.1 Topics..........................................................................................................................86 17.1.1 ISO/IEC 21000-19 Media Value Chain Ontology................................................86 17.2 Contributions...............................................................................................................86 17.3 Action Points...............................................................................................................86 18 Musical Slide Show AF (23000-4)....................................................................................86 18.1 Topics..........................................................................................................................86 18.1.1 ISO/IEC 23000-4 AMD 2 Conf. and Ref. SW for MSSAF..................................86 18.2 Contributions...............................................................................................................86 18.3 Action Points...............................................................................................................86 19 Media Streaming AF (23000-5).........................................................................................86 19.1 Topics..........................................................................................................................86 19.1.1 ISO/IEC 23000-5 2nd edition...............................................................................86 19.2 Contributions...............................................................................................................87 19.3 Action Points...............................................................................................................87 20 Professional Archival AF (23000-6)..................................................................................87 20.1 Topics..........................................................................................................................87 20.1.1 ISO/IEC 23000-6 AMD1 PA-AF Conf. and Ref. SW..........................................87 20.2 Contributions...............................................................................................................87 20.3 Action Points...............................................................................................................87 21 DMB AF (23000-9)...........................................................................................................88 21.1 Topics..........................................................................................................................88 5
  • 6. 21.1.1 ISO/IEC 23000-9 AMD1 DMB AF Conf. and Ref. SW......................................88 21.1.2 ISO/IEC 23000-9 AMD2 DMB AF Harmonization of MPEG-2 TS Storage......88 21.2 Contributions...............................................................................................................88 21.3 Action Points...............................................................................................................88 22 Video Surveillance AF (23000-10)....................................................................................88 22.1 Topics..........................................................................................................................88 22.1.1 ISO/IEC 23000-10 AMD1 VS AF Conf. and Ref. SW........................................88 22.2 Contributions...............................................................................................................88 22.3 Action Points...............................................................................................................88 23 Stereoscopic Video AF (23000-11)...................................................................................89 23.1 Topics..........................................................................................................................89 23.1.1 ISO/IEC 23000-11 AMD1 SV AF Conf. and Ref. SW........................................89 23.1.2 ISO/IEC 23000-11 COR1 SV AF Signaling of voice codecs...............................89 23.2 Contributions...............................................................................................................89 23.3 Action Points...............................................................................................................89 24 Interactive Music AF (23000-12)......................................................................................89 24.1 Topics..........................................................................................................................89 24.1.1 ISO/IEC 23000-12 Interactive Music AF.............................................................89 24.2 Contributions...............................................................................................................89 24.3 Action Points...............................................................................................................90 25 MPEG-V Architecture (23005-1)......................................................................................90 25.1 Topics..........................................................................................................................90 25.1.1 ISO/IEC 23005-1 MPEG-V Architecture.............................................................90 25.2 Contributions...............................................................................................................90 25.3 Action Points...............................................................................................................91 26 Control Information (23005-2)..........................................................................................91 26.1 Topics..........................................................................................................................91 26.1.1 ISO/IEC 23005-2 Control Information.................................................................91 26.2 Contributions...............................................................................................................91 26.3 Action Points...............................................................................................................92 27 Sensory Information (23005-3)..........................................................................................92 27.1 Topics..........................................................................................................................92 27.1.1 ISO/IEC 23005-3 Sensory Information................................................................92 27.2 Contributions...............................................................................................................92 27.3 Action Points...............................................................................................................94 28 Avatar Information (23005-4)............................................................................................94 28.1 Topics..........................................................................................................................94 28.1.1 ISO/IEC 23005-4 Avatar Information..................................................................94 28.2 Contributions...............................................................................................................94 28.3 Action Points...............................................................................................................94 29 MXM (23006 & 29116-1)..................................................................................................94 29.1 Topics..........................................................................................................................94 29.1.1 ISO/IEC 23006-1 MXM Architecture..................................................................94 29.1.2 ISO/IEC 23006-2 API...........................................................................................94 29.1.3 ISO/IEC 23006-3 Conf. and Ref. SW...................................................................94 29.1.4 ISO/IEC 29116-1 2nd edition MXM Protocols....................................................94 29.2 Contributions...............................................................................................................95 29.3 Action Points...............................................................................................................97 30 MPEG Rich Media UI Framework (???)...........................................................................97 30.1 Topics..........................................................................................................................97 6
  • 7. 30.1.1 Widgets.................................................................................................................97 30.1.2 Communication.....................................................................................................97 30.1.3 Conf. and Ref. SWTopics.....................................................................................97 30.2 Contributions...............................................................................................................97 30.3 Action Points...............................................................................................................98 31 Exploration.........................................................................................................................99 31.1 AIT..............................................................................................................................99 31.1.1 Topics....................................................................................................................99 31.1.2 Contributions.........................................................................................................99 31.1.3 Action Points.......................................................................................................100 31.2 MMT.........................................................................................................................100 31.2.1 Topics..................................................................................................................100 31.2.2 Contributions.......................................................................................................100 31.2.3 Action Points.......................................................................................................101 32 Liaison..............................................................................................................................101 33 Resolutions of Systems....................................................................................................102 Cf. WG11 resolution.....................................................................................................102 34 Action Plan.......................................................................................................................102 Annex G – Video report.......................................................................................................103 1 MPEG-4 Part 2 Video........................................................................................................103 2 Development of AVC .......................................................................................................103 3 MPEG-7 Visual .................................................................................................................105 3.1 MPEG-7 Visual related work......................................................................................105 3.2 Output documents related to MPEG-7 Visual ...........................................................106 4 23002 MPEG-C Video Technologies................................................................................107 4.1 23001-4 and 23002-4 Reconfigurable Video Coding (RVC).....................................107 4.1.1 General status of work..........................................................................................107 4.2 Assignment of output documents & editors................................................................108 4.3 Review of input contributions.....................................................................................108 4.4 Output Document Processing......................................................................................109 4.4.1 CE description update (Editor: Kazuo-san)..........................................................109 4.5 RVC-related schedule of the 88th meeting.................................................................110 5 Explorations – 3D Video....................................................................................................110 6 Explorations – High-Performance Video Coding..............................................................113 Annex H – Audio report.......................................................................................................116 1 Opening of the meeting......................................................................................................124 2 Administrative matters.......................................................................................................124 2.1 Communications from the Chair.................................................................................124 2.2 Approval of agenda and allocation of contributions...................................................124 2.3 Creation of Task Groups.............................................................................................124 2.4 Approval of previous meeting report..........................................................................124 2.5 Review of AHG reports..............................................................................................124 2.6 Joint meetings.............................................................................................................124 2.7 Received National Body Comments and Liaison matters..........................................124 2.8 Plenary Discussion......................................................................................................125 2.8.1 Profiles and 960/1024 transform lengths..............................................................125 2.8.2 Miscellaneous........................................................................................................125 3 Record of AhG meetings....................................................................................................125 3.1 AhG Meeting on SAOC and USAC Sunday 1000-1700...........................................125 3.1.1 SAOC....................................................................................................................125 7
  • 8. 3.1.2 USAC....................................................................................................................127 4 Task group activities..........................................................................................................130 4.1 Joint meetings.............................................................................................................130 4.2 Task Group discussions..............................................................................................130 4.2.1 MPEG-2, MPEG-4, MPEG-26 Audio, Audio Conformance, reference software 130 4.2.2 MPEG-D Spatial Audio Object Coding................................................................131 4.2.3 MPEG-D Unified Speech and Audio....................................................................131 4.2.4 Exploration: Meta-Data.........................................................................................135 5 Audio closing plenary discussions.....................................................................................136 6 Meeting deliverables..........................................................................................................136 6.1 Responses to Liaison and NB comments....................................................................136 6.2 Recommendations for final plenary............................................................................136 6.3 Establishment of Ad-hoc Groups................................................................................136 6.4 Approval of output documents....................................................................................136 6.5 Press statement............................................................................................................136 7 Future activities..................................................................................................................136 7.1 Schedule of future meetings........................................................................................136 7.2 Agenda for next meeting.............................................................................................136 7.3 All other business........................................................................................................136 7.4 Closing of the meeting ...............................................................................................136 Annex A Participants............................................................................................................137 Annex B Audio Contributions and Schedule........................................................................138 Task Groups.........................................................................................................................142 Annex C Output Documents.................................................................................................143 Annex D Agenda for the 89th MPEG Audio Meeting..........................................................144 Annex I – 3DG report..........................................................................................................145 1 Opening of the meeting......................................................................................................145 1.1 Approval of the agenda...............................................................................................145 1.2 Goals for the week......................................................................................................145 1.3 Standards from 3DGC.................................................................................................145 1.4 Room allocation..........................................................................................................146 1.5 Allocation of contributions.........................................................................................147 1.6 Attendance list.............................................................................................................151 2 General issues....................................................................................................................151 2.1 General discussion......................................................................................................151 2.1.1 Reference Software...............................................................................................151 2.1.2 Web site.................................................................................................................151 3 Current Voting...................................................................................................................151 4 AFX (14496-16) related activities.....................................................................................152 4.1 AhG on AFX activities...............................................................................................152 4.2 Scalable Complexity 3D Mesh Compression (14496-16 Amd.4)..............................152 4.2.1 Scene partitioning (14496-11 Amd.6)..................................................................154 4.3 Maintenance................................................................................................................154 4.3.1 FAMC Conformance and Reference Software.....................................................154 4.3.2 AFX 3rd Edition....................................................................................................154 4.4 Dataset and benchmarking..........................................................................................154 4.5 Software......................................................................................................................154 4.6 Promotions..................................................................................................................154 4.6.1 Web Site................................................................................................................154 4.7 Future..........................................................................................................................155 8
  • 9. 4.7.1 MPEG-V - Information Exchange with Virtual Worlds (formally Metaverse)....155 4.7.2 MXM ....................................................................................................................155 4.7.3 Future directions of 3D Graphics Compression....................................................156 5 3D Graphics Compression Model (14496-25) activities...................................................156 5.1 Software and conformance..........................................................................................156 6 Liaison................................................................................................................................157 7 Output documents and Resolutions of 3DGC....................................................................157 7.1 Part 16 Animation Framework eXtension (AFX) ......................................................157 7.1.1 The 3DG subgroup recommends approval of the following documents..............157 7.2 Promotion ...................................................................................................................157 7.2.1 The 3DG subgroup recommends approval of the following documents..............157 7.3 Establishment of 3DGC Ad-Hoc Groups....................................................................157 8 Closing of the Meeting.......................................................................................................158 Report of 88th meeting 1 Opening The 88th MPEG Meeting was held from 20 to 24 April 2009 at The Westin Maui Resort & Spa Maui, HI, US. 2 Roll call of participants Annex 1 provides the list of participants 3 Approval of agenda The agenda adopted is provided by Annex 2 4 Allocation of contributions Annex 3 provides the list of input documents 5 Communications from Convenor There was no specific communication 6 Report of previous meeting This was approved 7 Processing of NB Position Papers Papers were presented and, where appropriate, responses provided. 9
  • 10. 8 Work plan management 8.1 Media coding 8.1.1 AAC family of profiles The following document was approved 10652 WD on AAC family of profiles 8.1.2 HD-AAC Profile The following document was approved Study on ISO/IEC 14496-3:2009/ FPDAM 1:200x, HD-AAC Profile, MPEG 10651 Surround Signalling 8.1.3 AVC Constrained Baseline Profile The following document was approved 10540 Study Text of ISO/IEC 14496-10:200X/FPDAM 1 8.1.4 AFX 3rd edition The following document was approved 10530 ISO/IEC 14496-16 3rd Edition 8.1.5 Scalable-complexity 3D mesh compression The following documents were approved 10528 Study Text of ISO/IEC 14496-16:2006/PDAM4 (Scalable Complexity 3D Mesh Compression) 10529 Description of AFX CE and explorations 8.1.6 Open Font Format extensions The following documents were approved Request for ISO/IEC 14496-22:200X AMD 1 Support for many-to-one range 10627 mapping Text of ISO/IEC 14496-22:200X/PDAM 1 Support for many-to-one range 10587 mapping 10
  • 11. 8.1.7 Video Tool Library The following document was approved 10551 Description of Core Experiments in RVC 8.1.8 Spatial Audio Object Coding The following documents were approved 10659 Study on ISO/IEC FCD 23003-2:200x, Spatial Audio Object Coding 10660 Status and Workplan on SAOC Core Experiments 8.1.9 Unified Speech and Audio Coding The following documents were approved 10661 WD3 of USAC 10662 Workplan for USAC CEs 10663 Workplan on MPEG USAC Reference Encoder 10664 MPEG Audio CE methodology 10669 MPEG Audio Test Material for Core Experiments 8.1.10 Media Context and Control The following documents were approved 10526 MPEG-V Extended Call for Proposals 10616 WD 2.0 of Architecture 10617 WD 2.0 of Control Information 10618 WD 2.0 of Sensory Information 10619 WD 2.0 of Avatar Information 10672 WD 1.0 of Reference Software 10673 WD 1.0 of Conformance 8.1.11 3D Video Coding The following documents were approved 10570 Applications and Requirements for 3DV 10552 Description of Exploration Experiments in 3D Video Coding 10649 Evaluation and Testing of 3D Video Coding 8.1.12 High-Performance Video Coding The following document was approved 1055 Call for Evidence on High-Performance Video Coding 3 11
  • 12. 8.2 Composition coding 8.2.1 Interactive Digital Radio The following documents were approved 10576 Requirements v3.0 for a new BIFS profile to support Interactive Digital Radio 10568 Call for Proposal on additional BIFS technologies for Interactive Services for Digital Radio 8.2.2 LASeR Adaptation The following documents were approved 10682 LASeR Requirements 10582 Study of ISO/EC 14496-20:2008 LASeR & SAF/FPDAM 2 Adaptation 10585 Updated Workplan for service example of LASeR Adaptation & PMSI 8.2.3 Presentation of Structured Information The following documents were approved 10583 DoC on ISO/IEC 14496-20:2008 LASeR & SAF/PDAM 3 PMSI 10584 Text of ISO/IEC 14496-20:2008 LASeR & SAF/FPDAM 3 PMSI 10585 Updated Workplan for service example of LASeR Adaptation & PMSI 8.2.4 Advanced User Interaction The following document was approved 10586 TuC for ISO/IEC 14496-20:2000 LASeR & SAF AMD 4 Advanced User Interaction 8.3 Description coding 8.3.1 Video Signature Descriptors The following documents were approved 10566 Request for 15938-3:2000/Amd.4 10542 WD 1.0 of 15938-3/Amd.4 Video Signature Descriptors 10543 MPEG-7 Visual XM 35 10544 Description of Core Experiments in Video Signature Description development 8.3.2 Extraction and Matching of Image Signature Tools The following documents were approved 10549 Disposition of Comments on ISO/IEC 15938-8:2002/PDAM 5 10550 Text of ISO/IEC 15938-8:2002/DAM 5 Extraction and Matching of Image Signature Tools 12
  • 13. 8.3.3 Query format The following documents were approved 10525 Enhanced MPEG-7 Query Format Requirements 10588 WD 4.0 of ISO/IEC 15938-12:200X AMD 1 MPQF Conf. and Ref. SW 10589 WD 1.0 of ISO/IEC 15938-12:200X AMD 2 Semantic Enhancement 8.4 Systems support 8.4.1 MPEG-4 Systems 4th edition The following document was approved 10574 WD of ISO/IEC 14496-1 4th Edition 8.4.2 Registration Authority and systems extensions The following document was approved 10575 WD of ISO/IEC 14496-1 PDAM4 Registration Authority and systems extensions 8.5 IPMP 8.5.1 Protection of Presentation Element The following documents were approved 10592 Request for ISO/IEC 21000-4 AMD 2 Protection of Presentation Element 10593 Text of ISO/IEC 21000-4 PDAM 2 Protection of Presentation Element 8.6 Digital Item 8.6.1 Presentation of Digital Item The following documents were approved 10590 Request for ISO/IEC 21000-2 AMD 1 Presentation of Digital Item 10591 Text of ISO/IEC 21000-2 PDAM 1 Presentation of Digital Item 8.7 Transport and File formats 8.7.1 Carriage of MVC in MPEG-2 Systems The following documents were approved 10572 Study of ISO/IEC 13818-1:2007/FPDAM4 Transport of MVC 10573 WD 2.0 of ISO/IEC 13818-1:2007 DCOR X 13
  • 14. 8.7.2 Miscellaneous additions to File Format The following documents were approved 10579 DoC on ISO/IEC 14496-12:2008/FPDAM 1 General Improvements 10580 Text of ISO/IEC 14496-12:2008/FDAM 1 General Improvements 8.7.3 AVC File Format extensions for MVC The following document was approved 10581 Study of ISO/IEC 14496-15:2004/FPDAM 3 MVC File Format 8.7.4 MPEG Media Transport The following document was approved 10571 Workshop on MMT (MPEG Media Transport) – Call for Contributions 8.8 Multimedia architecture 8.8.1 MXM Architecture The following document was approved 10620 Study of ISO/IEC CD 23006-1 MxM Architecture and Technologies 8.8.2 MXM API The following documents were approved 10621 Study of ISO/IEC CD 23006-2 MXM APIs First ideas on normative APIs compliant to MXM framework for future MPEG 10623 standards 8.8.3 Advanced IPTV Terminal The following documents were approved 10569 Draft Advanced IPTV Terminal (AIT) Requirements 10570 Context and Objectives for Advanced IPTV Terminal 8.8.4 Rich Media UI Framework The following documents were approved 10626 WD MPEG Rich Media UI 10690 Proposal for support of MPEG Rich Media UI in WC3 Widget Recommendation 14
  • 15. 10670 MPEG comments on WC3 Widget Recommendation 8.9 Application formats 8.9.1 Musical Slide Show Application Format The following document was approved 10594 Text of ISO/IEC 23000-4 MSSAF/FDAM2 Conf. & Ref. SW for Protected MSSAF 8.9.2 Media Streaming Application Format The following document was approved 10595 Text of ISO/IEC CD 23000-5 MSAF 2nd edition 8.9.3 DMB AF Harmonization of MPEG-2 TS storage The following document was approved Study of ISO/IEC 23000-9:2008/PDAM2 DMB AF Harmonization of MPEG-2 TS 10612 storage 8.9.4 Interactive Music Application Format The following document was approved 10615 Study of ISO/IEC CD 23000-12 Interactive Music AF 8.10 Protocols 8.10.1 MXM Protocols The following document was approved 10625 Study of ISO/IEC CD 29116-1 2nd edition MXM Protocols 8.11 Reference implementation 8.11.1 AAC-ELD Reference Software The following documents were approved 10653 DoC on ISO/IEC 14496-5:2001/FPDAM 24, MPEG-4 AAC ELD 10654 ISO/IEC 14496-5:2001/FDAM 24, MPEG-4 AAC ELD 8.11.2 MVC Reference Software The following document was approved 15
  • 16. 10538 Study Text of ISO/IEC 14496-5:2001/FPDAM 15 Reference Software for Multiview Video Coding 8.11.3 Synthesized Texture Reference Software The following documents were approved 10576 DoC on ISO/IEC 14496-5:2001/PDAM 23 Synthesized Texture Reference SW 10577 Text of ISO/IEC 14496-5:2001/FPDAM 23 Synthesized Texture Reference SW 8.11.4 Image Signature Tools Reference Software The following documents were approved 10545 Disposition of Comments on ISO/IEC 15938-6:2003/PDAM 3 10546 Text of ISO/IEC 15938-6:2003/FPDAM 3 Reference Software for Image Signature Tools 8.11.5 Professional Archival Application Format Reference Software The following documents were approved 10596 Study of ISO/IEC 23000-6 PA-AF/PDAM1 Conf. and Ref. SW 10597 Workplan for ISO/IEC 23000-6 PA-AF Conformance and Reference Software 8.11.6 DMB Application Format Reference Software The following documents were approved 10598 Study of ISO/IEC 23000-9:2008/FPDAM1 DMB AF Conf. And Ref. Soft. 10599 Workplan for ISO/IEC 23000-9:2008/FPDAM1 DMB AF Conf. And Ref. Soft. 8.11.7 Stereoscopic Video Application Format Reference Software The following documents were approved 10628 Request for ISO/IEC 23000-11 AMD 1 Stereoscopic Video AF Ref. Soft and Conf. 10613 Text of ISO/IEC 23000-11 PDAM 1 Stereoscopic Video AF Ref. Soft and Conf. 10614 Workplan for Stereoscopic Video Application Format Ref. Soft and Conf. 8.11.8 MXM Reference Software The following documents were approved 10622 Study of ISO/IEC CD 23006-3 MXM Conf. & Ref. SW 10683 MXM Development Roadmap for Engines and Applications 10624 MXM Developer’s Day: Call for Participation 16
  • 17. 8.12 Conformance 8.12.1 MPEG-4 Video bitstreams The following document was approved 10537 First Ideas on New MPEG-4 Video Bitstream Repository Structure 8.12.2 MVC Conformance The following document was approved 10535 Study Text of ISO/IEC 14496-4:2004/FPDAM 38 Multiview Video Coding Conformance Testing 8.12.3 BSAC Conformance for Broadcasting The following documents were approved 10655 Request for Amendment, 14496-26:2009/PDAM 2 10656 ISO/IEC 14496-26:2009/PDAM 2, BSAC Conformance for Broadcasting 8.12.4 Image Signature Tools Conformance The following documents were approved 10547 Disposition of Comments on ISO/IEC 15938-7:2003/PDAM 5 10548 Text of ISO/IEC 15938-7:2003/FPDAM 5 Conformance Testing for Image Signature Tools 8.12.5 Professional Archival Application Format Conformance The following documents were approved 10596 Study of ISO/IEC 23000-6 PA-AF/PDAM1 Conf. and Ref. SW 10597 Workplan for ISO/IEC 23000-6 PA-AF Conformance and Reference Software 8.12.6 DMB Application Format Conformance The following documents were approved 10598 Study of ISO/IEC 23000-9:2008/FPDAM1 DMB AF Conf. And Ref. Soft. 10599 Workplan for ISO/IEC 23000-9:2008/FPDAM1 DMB AF Conf. And Ref. Soft. 8.12.7 Stereoscopic Video Application Format Conformance The following documents were approved 10628 Request for ISO/IEC 23000-11 AMD 1 Stereoscopic Video AF Ref. Soft and Conf. 10613 Text of ISO/IEC 23000-11 PDAM 1 Stereoscopic Video AF Ref. Soft and Conf. 17
  • 18. 10614 Workplan for Stereoscopic Video Application Format Ref. Soft and Conf. 8.12.8 MXM Conformance The following document was approved 10622 Study of ISO/IEC CD 23006-3 MXM Conf. & Ref. SW 8.13 Maintenance 8.13.1 Systems coding standards The following document was approved 10578 Text of ISO/IEC 14496-5:2001/AMD14:2009/DCOR 1 OFF Ref. SW 8.13.2 Video coding standards The following documents were approved 10534 Defect Report on ISO/IEC 14496-2:2004 10534 Defect Report on ISO/IEC 14496-2:2004 10541 Defect Report on ISO/IEC 14496-10:200X 8.13.3 Audio coding standards The following documents were approved 10650 ISO/IEC 14496-3:2009/DCOR 1:200X Byte Alignment 10657 Study on ISO/IEC 14496-26:2009/DCOR 1, ALS, SLS and AAC updates 10658 Study on ISO/IEC 23003-1:2007/DCOR 2, Misc. Corrections 9 Organisation of this meeting 9.1 Tasks for subgroups Requirements Std Pt Amd 4 1 -- New BIFS Profile for Digital Radio 1 V Haptics U User Interface framework Loudness metadata Advanced IPTV Terminal HVC - CfE 3DV – Vision, Applications, Requirements MMT Pervasive AV scene coding New standard areas 18
  • 19. • Audio for HVC Contribution to press release • CfE • CfP BIFS for DR • CfP on Haptics for MPEG-V • MMT workshop Systems Std Pt Amd 2 1 4 Carriage of MVC 4 RA 4 37 FF conformance 23 Synthesised texture RS ? SVC FF RS 1 ? New BIFS Profile for Digital Radio 1 1 1 Miscellanea 2 Cor.2 Usage of brands etc. 1 3 MVC File Format 5 2 2 Adaptation technologies for Laser 0 3 Presentation and Modification of Structured Information TuC for advanced input interface 2 Open Font Format 2 7 1 Amd1 C and RS 2 21 2 Amd PDI 4 Amd Protection of presentation element 1 MVCO 9 A 4 2 Protected Musical Slide Show MAF RS & C 5 2nd Ed Media Streaming MAF 6 1 Professional Archival AF RS & C 9 Cor 1 DMB MAF 9 1 DMB MAF RS & C 9 2 DMB MPEG-2 TS storage 1 1 Video Surveillance AF RS & C 0 1 Cor1 Stereoscopic video AF 1 1 Stereoscopic video AF RS & C 1 Interactive music AF 2 M 1 MXM Architecture 2 MXM API 3 MXM RS & C V 1 Architecture 2 Control Information 19
  • 20. 3 Sensory information 4 Avatar information U Rich Media Widgets Communication Reference Software and Conformance X Advanced IPTV Terminal Update MPEG technology web page • Contribution to press release • PMSI & PDI Video 4 2 Cor 4 1 1 Constrained BL profile & suppl. enhanc. info. + Stereo 0 High Profile Cor 1 Miscellanea 7 3 4 Video Signature Tools 6 Image Signature Tools RS 7 Image Signature Tools C 8 Image Signature Tools Matching and feature extraction A 3 2 Photo Player Conformance C 4 1 Video Tool Library Conformance & RS 2 Video Tool Library extensions 3DV/FTV HVC 4 4 38 MVC Conformance 15 MVC RS Update MPEG technology web page Contribution to press release • Audio 4 3 1 SLS profile 3 960/1024 4 36 AAC-ELD conformance 5 24 AAC-ELD Reference Software 2 Conformance 6 D 2 Spatial Audio Object Coding 3 USAC New audio issues (HVC) Contribution to press release • 3DG 4 1 3rd Ed 6 4 Scalable complexity 3DMC 2 3DG Conformance 7 1 3D Graphics Compression model Conformance 5 22 3D Graphics Compression model Reference Software 20
  • 21. 25 Scene partitioning RS 27 Scalability complexity 3DMC RS 3DG vision V Information exchange with virtual worlds Reconfigurable Graphics coding Contribution to press release • 9.2 Joint meetings The following joint meetings were held Groups What Day Time Where S, R AIT Mon 16:00-18:00 Req V, R Prof/Lev, 3DV Apps Tue 09:00-10:00 Req 3, V, R RGC Tue 14:00-15:00 3DG 3, S MPEG-V Tue 15:00-16:00 3DG 3, S MXM Tue 16:00-17:00 3DG S, R MMT Wed 14:00-16:00 Req S, R AIT Wed 16:00-18:00 Req R, S MPEG-V Thu 09:00-10:00 Req S, V Carriage of MVC over MP2 Thu 09:00-11:00 Sys R, V, A Pervasive AV Thu 10:00-11:00 Req R, V HVC Thu 15:00-17:00 Vid 10 WG management 10.1 Terms of reference The following document was approved 10600 Terms of reference 10.2 Editors The following documents were approved 10604 Editors of MPEG standards 10694 Editors nominated for an ISO/IEC certificate of appreciation 10.3 Liaisons The following documents were approved 1068 Liaison statement to ITU-T SG 16 Q.6/16 9 1063 Liaison statement to JTC 1/SGSN 1 21
  • 22. 1063 Liaison statement to ITU-T SG 16 on rights information interoperability 2 1069 Liaison statement to IEC TC 100 on rights information interoperability 1 1063 Liaison statement to IEC TC 100 on Multimedia Gateway in Home Networks 3 1063 Liaison statement to IEC TC 9 5 1063 Liaison statement to SGDCMP on DRM technologies in MPEG 6 1063 Liaison statement to IEC TC 100 on Multimedia home server systems - 7 Conceptual model for domain management 1063 Liaison statement to JTC 1/SC 34/WG 2 on Open Font Format reference 8 software 1063 Liaison statement to IEC TC 100 on Transmission of time code in the ancillary 9 data space 1064 Liaison statement to ITU-T SG 16 on Advanced IPTV Terminal 0 1064 Liaison statement to JTC 1/SC 34/WG 2 on media types of ISO/IEC 14496-22 1 1064 Liaison statement to W3C on MPEG Rich Media UI 2 1068 Liaison statement to UPnP on MPEG Rich Media UI 5 1068 Liaison statement to DLNA on MPEG Rich Media UI 6 1064 Liaison statement to JTC 1 SWG-ARM on Professional Archival AF 3 1064 Liaison statement to EBU on MPEG URI Assets 4 1064 Liaison statement to W3C on MXM 5 1064 Liaison statement to ATSC on Carriage of SVC over MPEG-2 TS 6 1064 Liaison statement to SC6 on extended Call for Proposal on MPEG-V 7 1064 Liaison statement to SC25 on extended Call for Proposal on MPEG-V 8 1063 Liaison statement to IEEE TC on Haptics on extended Call for Proposal on 4 MPEG-V 1068 Template Liaison statement on MPEG Media Transport workshop 7 1068 Template Liaison statement on MXM Developer’s Day 8 1055 Liaison statement to ITU-T SG9 re 3D Video Coding 4 1055 Liaison statement to IEC TC100 re IEC DTS 62592 5 1055 Liaison statement to SC37 re Biometric Data Interchange 22
  • 23. 6 1055 Liaison statement to IEC TC100 re IEC CD 62087 7 1055 Liaison statement to CEA re 3D Video Coding 8 1055 Liaison statement to ITU-T SG16 Q.6/16 re AVC Development 9 1066 Response to IEC TC-100 on IEC CDV 62571 5 1061 List of Organisations with which MPEG entertains liaisons 1 10.4 Ad hoc groups The following document was approved 10519 List of ad hoc groups established at the Maui, HI MPEG meeting Specifically The following documents were approved 1052 Adhoc on MPEG Modern Transport (MMT) 7 1056 AHG on 3D Video Coding 3 1053 AHG on 3DGC documents, software maintenance and core experiments 3 1067 AHG on Advanced IPTV Terminal 9 1067 AHG on Application Format 7 1066 AHG on Audio Standards Maintenance 7 1056 AHG on AVC Development 5 1067 AHG on Font Format Representation 8 1056 AHG on High-Performance Video Coding 4 1056 AHG on Maintenance of MPEG-4 Visual related Documents, Reference 0 Software and Conformance 1067 AHG on MPEG File Formats 6 1056 AHG on MPEG-7 Visual 2 1068 AHG on MPEG-V 1 1068 AHG on MXM 0 23
  • 24. 1056 AHG on Reconfigurable Video Coding 1 1066 AHG on SAOC, USAC and MetaData 8 1067 AHG on Scene Representation 5 10.5 Asset management The following documents were approved 10605 Schema assets 10606 Software assets 10607 Conformance assets 10608 Content assets 10609 URI assets and MIME types 10.6 IPR management The following documents were approved 10610 Standards under development for which a call for patent statements is issued 10693 Proposal to improve the Software Copyright Disclaimer 10.7 Work plan The following documents were approved 10601 MPEG Standards 10602 Table of unpublished FDISs 10603 Work plan and time line 11 Administrative matters 11.1 Responses to National Bodies The following documents were approved 10692 Responses to National Bodies 10666 Response to Swedish NB on 960 and 1024 block lengths 11.2 Schedule of future MPEG meetings The following meeting schedule was approved # City Country y mm dd-dd y 8 Maui, HI US 0 04 20-24 8 9 24
  • 25. 8 London UK 0 06-0 29-03 9 9 7 9 Xian CN 0 10 26-30 0 9 9 Kyoto JP 1 01 18-22 1 0 9 ? DE 1 04 19-23 2 0 9 Geneva CH 1 07 ??-?? 3 0 9 Torino IT 1 10 11-15 4 0 9 ? ? 1 01 ??-?? 5 1 12 Promotional activities The following documents were approved 10532 MPEG 3D Graphics FAQ v22 10629 MPEG DRM Vision 10684 MPEG Technologies for DRM 10531 MPEG 3D Graphics Vision 10522 Maui, HI press release 13 Resolutions of this meeting These were approved 14 A.O.B There was no other business 15 Closing The meeting closed at 2009/04/24T20:00 25
  • 26. Annex A – Attendance list FirstName LastName Company Country Jeong-Hwan Ahn Samsung Electronics Republic of Korea Kohtaro Asai Mitsubishi Electric Corporation Japan Cheung Auyeung Sony Electronics Inc. USA Gun Bang ETRI Republic of Korea Vittorio Baroncini Fondazione Ugo Bordoni Italy Gero Bäse Siemens Germany Seung Kwon Beack ETRI Republic of Korea Bruno Bessette VoiceAge Corporation Canada Lazar Bivolarski Droplet Technology, Inc., USA Miroslaw Bober Mitsubishi Electric United Kingdom Frank Bossen NTT DOCOMO, Inc. Switzerland Paul Brasnett Mitsubishi Electric United Kingdom Bernard Brower ITT USA Fons Bruls Philips The Netherlands Tim Bruylants Vrije Universiteit Brussel Belgium Madhukar Budagavi Texas Instruments Inc. USA Jihun Cha ETRI Republic of Korea Lekha Chaisorn Institute for Infocomm Research Singapore Ti Eu Chan Institute for Infocomm Research Singapore Lulin Chen Omneon Video Networks USA Ying Chen Qualcomm Inc. USA Hong Kong Applied Science and Technology Ka Man, Carmen Cheng Research Institute Co. Ltd China Leonardo Chiariglione CEDEO.net Italy Maeng-Sub Cho ETRI Republic of Korea Bumsuk Choi ETRI Republic of Korea Byeong Ho Choi KETI Republic of Korea Haechul Choi ETRI Republic of Korea Jin Soo Choi ETRI Republic of Korea Kiho Choi Hanyang University Republic of Korea Miran Choi ETRI Republic of Korea YungHo Choi Konkuk University Republic of Korea Keiichi Chono NEC Corporation Japan Takeshi Chujoh Toshiba Corporation Japan Sungmoon Chun ECT Inc., Republic of Korea Leszek Cieplinski Mitsubishi Electric United Kingdom Cyril Concolato Telecom Paris Tech France Giovanni Cordara Telecom Italia Lab Italy Marzia Corvaglia CNIT - unit of Brescia Italy Leon Denis Vrije Universiteit Brussel Belgium François Devaux intoPIX Belgium Mario Doeller University of Passau Germany 26
  • 27. Stefan Döhla Fraunhofer IIS Germany Marek Domanski Poznan University of Technology Poznan Yujie Dun Xi'an Jiaotong University China Touradj Ebrahimi EPFL Switzerland Scott Foshee Adobe Systems USA Edouard Francois Thomson Inc France Per Frôjdh Ericsson Sweden Toshiaki Fujii Tokyo Institute of Technology Japan Takahiro Fukuhara Sony Japan Ralf Geiger Fraunhofer IIS Germany Jean H.A. Gelissen Philips Research The Netherlands Sebastian Gerke Fraunhofer HHI Germany Daniele Giusto University Cagliari Italy Philippe Gournay VoiceAge Corporation Canada Kate Grant Nine Tiles United Kingdom Bernhard Grill Fraunhofer IIS Germany Marc GuezVucher SCPP France Jong-Ki Han Sejong University Republic of Korea Woo-Jin Han Samsung Electronics Republic of Korea Miska Hannuksela Nokia Finland Noboru Harada NTT Japan Oliver Hellmuth Fraunhofer IIS Germany Brian Heng Broadcom USA Jürgen Herre Fraunhofer IIS Germany Arianne T. Hinds Ricoh | IBM InfoPrint Solutions Company USA Jeff Huang Qualcomm Inc. USA Tie Jun Huang Peking University China Young Huh KERI Republic of Korea Sungjin Hur ETRI Republic of Korea Walt Husak Dolby Laboratories USA SeoYoung Hwang Samsung Republic of Korea Faisal Ishtiaq Motorola USA Kota Iwamoto NEC Corporation Japan Euee S Jang Hanyang University Republic of Korea Inseon Jang ETRI Republic of Korea Sung-Kwan Je ETRI Republic of Korea Byeong Moon Jeon LG Electronics Republic of Korea Byeungwoo Jeon SKKU Republic of Korea Dong Seok Jeong Inha University Republic of Korea Hong Jiang Intel Corporation USA Jukyong Jin Inha University Republic of Korea Sanghyun Joo ETRI Republic of Korea Hari Kalva Florida Atlantic University USA Kyeongok Kang ETRI Republic of Korea Sandeep Kanumuri DOCOMO Communications Laboratories USA, Inc. USA Mukta Kar Cable Labs USA 27
  • 28. Marta Karczewicz Kimihiko Kazui Fujitsu Laboratories Ltd. Japan Kei Kikuiri NTT DOCOMO, Inc. Japan Daeyeon Kim Sejong University Republic of Korea Daiyong Kim Hanyang University Republic of Korea Dongwon Kim Sejong University Republic of Korea Hae Kwang Kim Sejong University Korea Hui Yong Kim ETRI Republic of Korea Hyungyu Kim Hanyang University Republic of Korea Kil Joong Kim Seoul National University Bundang Hospital Republic of Korea Kioh Kim Sejong University Republic of Korea Kyuheon Kim Kyunghee Univ. Republic of Korea Sang-Kyun Kim Myongji University Republic of Korea Seonghoon Kim Varo Vision Co., Ltd. Republic of Korea Yeongmi Kim Gwangju Institute of Science and Technology Republic of Korea Youngseop Kim Dankook University Republic of Korea Kristofer Kjoerling Dolby Sweden Sweden Takuyo Kogure Panasonic Japan Panos Kudumakis Queen Mary University of London United Kingdom Chaker Larabi University of Poitiers France Jean Le Feuvre Telecom Paris Tech France Daniel Lee eBay USA Gunhee Lee Kyunghee Univ. Republic of Korea Gwo Giun (Chris) Lee National Cheng Kung University Taiwan Hyunkook Lee LG Electronics Republic of Korea Jaejoon Lee Samsung Electronics Republic of Korea Jaeseong Lee Yonsei University Republic of Korea Jangwon Lee Kyunghee Univ. Republic of Korea Ju Ock Lee Sejong University Republic of Korea Kangchan Lee ETRI Republic of Korea Seung Wook Lee ETRI Republic of Korea Sunyoung Lee Hanyang University Republic of Korea Taejin Lee ETRI Republic of Korea Wonsuk Lee ETRI Republic of Korea Yung-Lyul Lee Sejong University Republic of Korea Vladimir Levantovsky Monotype Imaging USA Shangwen Li Zhejiang University China Tilman Liebchen LG Electronics Germany ChongSoon Lim Panasonic Singapore Laboratories Singapore Taebeom Lim KETI Republic of Korea Youngkwon Lim net&tv Inc. Republic of Korea Christophe Lucarz EPFL Switzerland Ajay Luthra Motorola USA Shohei Matsuo Nippon Telegraph and Telephone (NTT) Corporation Japan Marco Mattavelli EPFL Switzerland Ken McCann ZetaCast, representing Samsung United Kingdom 28
  • 29. Jim Meany Boeing USA Keiji Mitsubuchi Digital Hollywood Graduate School Japan JooHee Moon Sejong University Republic of Korea Francisco Morán Burgos Universidad Politècnica de Madrid Spain Takehiro Moriya NTT Japan Karsten Müller Fraunhofer HHI Germany Markus Multrus Fraunhofer IIS Germany Tokumichi Murakami Mitsubishi Electric Corporation Japan Sang-il Na ETRI Republic of Korea Nobuhiko Naka NTT DOCOMO, Inc. Japan Takayuki Nakachi NTT Japan Sam Narasimhan Motorola USA Ambarish Natu Analog Devices Inc Australia Max Neuendorf Fraunhofer IIS Germany Nhut Nguyen Samsung Telecom America USA Takahiro Nishi Panasonic Japan Toshiyuki Nomura NEC Corporation Japan Takeshi Norimatsu Panasonic Corporation Japan Ryoma Oami NEC Corporation Japan Shigetaka Ogawa ICT-Link Japan Yukiko Ogura IPSJ/ITSCJ Japan Eunmi Oh Samsung Electronics Republic of Korea Seoung-Jun Oh Kwangwoon University Republic of Korea Weon Geun OH ETRI Republic of Korea Jens-Rainer Ohm RWTH Aachen Germany Werner Oomen Philips Applied Technologies Netherlands Joern Ostermann Leibniz Universiüt Hannover Germany Hochong Park Kwangwoon University Republic of Korea Hyoungmee Park Sejong University Republic of Korea Je-Ho Park Dankook University Republic of Korea JeongHoon Park Samsung Electronics Republic of Korea Jiho Park KETI Republic of Korea Kyungmo Park Samsung Republic of Korea Mincheol Park Sejong University Republic of Korea Youngcheol Park Yonsei University Republic of Korea Stephane Pateux Orange Labs France Wen-Hsiao Peng ITRI/NCTU Taiwan Pierrick Philippe Orange Labs France Marius Preda Institut TELECOM France Francoise Preteux Institut Telecom France Heiko Purnhagen Dolby Sweden Sweden Schuyler Quackenbush Audio Research Labs USA Majid Rabbani Eastman Kodak USA Ivana Radulovic Ericsson Sweden Mickael Raulet INSA/IETR of Rennes France Yuriy Reznik Qualcomm Inc. USA 29
  • 30. Jeha Ryu Gwangju Institute of Science and Technology Republic of Korea Satoru Sakazume Victor Company of Japan, Limited Japan Gen Sasaki MegaChips Corporation Japan Junichi Sato Shikino High-Tech Co.,Ltd. Japan Andreas Schneider Dolby germany GmbH Germany Stephan Schreiner Fraunhofer IIS Germany Shun-ichi Sekiguchi Mitsubishi Electric Corporation Japan Takanori Senoh NICT Japan Chan-Won Seo Sejong University Republic of Korea Jeong-Hoon Seo Sejong University Republic of Korea Jeongil Seo ETRI Republic of Korea Shinya Shimizu NTT Japan Hwa Seon Shin KETI Republic of Korea Haiyan Shu Institute for Infocomm Research Singapore David Singer Apple USA Iraj Sodagar Microsoft USA Joel Sole Thomson USA Kyoung Soo Son Hanyang University Republic of Korea Jaeyeon Song Samsung Republic of Korea Sperschneide Ralph r Fraunhofer IIS Germany Dale Stolitzka Analog Devices Inc USA Kazuo Sugimoto Mitsubishi Electric Corporation Japan Doug Suh KHU Republic of Korea Jung Suk Suh Samsung Electronics Co., Ltd. Korea Gary Sullivan Microsoft USA Huifang Sun Mitsubishi Electric Research Labs USA Jaewon Sung LG Electronics Republic of Korea Teruhiko Suzuki Sony Corp Japan Yoshinori Suzuki NTT DOCOMO, Inc. Japan Herve Taddei Huawei Technologies Germany Seishi Takamura NTT Cyber Space Labs., NTT Corporation Japan TK Tan NTT DOCOMO, Inc. Japan Masayuki Tanimoto Nagoya University Japan Akiyuki Tanizawa Toshiba Corporation Japan Frederik Temmermans Vrije Universiteit Brussel Belgium Andrew Tescher Microsoft USA Dong Tian Thomson Inc USA Christian Timmerer Klagenfurt University Austria Yasuaki Tokumo Sharp Corporation Japan Yoshihide Tonomura NTT Japan Alexandros Tourapis Dolby Laboratories USA Cong Thang Truong ETRI Republic of Korea Chun-Jen Tsai ITRI/NCTU Taiwan Yi-Shin Tung MStar Semiconductor, Inc Taiwan Kemal Ugur Nokia Finland 30
  • 31. Juha Vartiainen SFS Finland Anthony Vetro Mitsubishi Electric Research Labs USA Xin Wang ContentGuard, Inc. USA Ye-Kui Wang Huawei Technologies USA Menno Wildeboer Nagoya University Japan Steffen Wittmann Panasonic Germany Oliver Wuebbolt Thomson Inc Germany Minjie Xie Huawei Technologies (USA) USA Akio Yamada NEC Corporation USA Tomoo Yamakage Toshiba Corporation Japan Tomoyuki Yamamoto Sharp Corporation Japan Jeong Ju Yoo ETRI Republic of Korea Young-Joe Yoo Sejong University Republic of Korea Kyoungro Yoon Konkuk University Republic of Korea Tomonobu Yoshino KDDI Corp. Japan Haoping Yu Huawei Technologies USA Kugjin Yun ETRI Republic of Korea Aidong Zhang Huawei Technologies China Yin Zhao Zhejiang University China Huan Zhou Panasonic Singapore Laboratories Singapore Yongwei Zhu Institute for Infocomm Research Singapore 31
  • 32. Annex B – Agenda Item 1 Opening 2 Roll call of participants 3 Approval of agenda 4 Allocation of contributions 5 Communications from Convenor 6 Report of previous meeting 7 Processing of NB Position Papers 8 Work plan management 1 Media coding 1HD-AAC Profile 2New Profile for ALS 3Constrained Baseline Profile 4Multiview Field High Profile 4 5960 frame length in MPEG-4 AAC 6AFX 3rd edition 7Multiresolution profile 8Scalable-complexity 3D mesh compression 9Open Font Format extensions 10Media Value Chain Ontology 11Codec Configuration Representation 12Video Tool Library 13Spatial Audio Object Coding 14Unified Speech and Audio Coding 15Interfaces with Virtual Worlds 163D Video Coding 17High-Performance Video Coding 18New directions in future audio coding 2 Composition coding 1Interactive Digital Radio 2LASeR Adaptation 4Presentation of Structured Information 3 Description coding 1Video Signature Tools 2Metadata driven post processing of audio signals 3Audio description coding standards 4Extraction and Matching of Image Signature Tools 4 Systems support 5 IPMP 6 Digital Item 7 Transport and File formats 1Carriage of SVC in MPEG-2 Systems 2Carriage of MVC in MPEG-2 Systems 3Miscellaneous additions to File Format 4AVC File Format extensions for MVC 8 Multimedia architecture 1Interfaces with virtual worlds 2MXM Architecture and API 32
  • 33. 3MXM API 4Advanced IPTV Terminal 5Rich Media UI Framework 9 Application formats 1Media Streaming AF 2DMB AF Harmonization of MPEG-2 TS storage 3Interactive Music Application Format 10 Protocols 1MXM Protocols 11 Reference implementation 1AAC-ELD Reference Software 2MVC Reference Software 3File Format Reference Software 4Geometry and Shadow Reference Software 53D Graphics Compression Model Reference Software 6Scene Partitioning Reference Software 7Image Signature Tools Reference Software 8Protected Musical Slide Show MAF Reference Software 9Musical Slide Show MAF Reference Software 10Professional Archival MAF Reference Software 11Video Surveillance MAF Reference Software 12MXM Reference Software 12 Conformance 1MVC Conformance 2MPEG-4 Audio Conformance 3AAC-ELD, OAFI and additional AAC Conformance 4File Format Conformance 5Scene Partitioning Conformance 6MultiResolution Profile Conformance 73D Graphics Compression Model Conformance 8Image Signature Tools Conformance 9Photo Player MAF Conformance 10Musical Slide Show MAF Conformance 11Professional Archival MAF Conformance 12Video Surveillance MAF Conformance 13Video Tool Library Conformance 14MXM Conformance 13 Maintenance 1Systems coding standards 2Video coding standards 3Audio coding standards 43DG coding standards 5Visual description coding standards 6Audio description coding standards 7MPEG-21 standards 8MPEG-A standards 14 Work plan and time line 9 Organisation of this meeting 1 Tasks for subgroups 2 Joint meetings 10 WG management 1 Terms of reference 2 Officers 33
  • 34. 3 Editors 4 Liaisons 5 Work item assignment 6 Ad hoc groups 7 Asset management 1Reference software 2Conformance 3Test material 4URI 8 IPR management 9 Work plan 11 Administrative matters 1 Responses to National Bodies 2 Schedule of future MPEG meetings 3 Promotional activities 12 Resolutions of this meeting 13 A.O.B 14 Closing 34
  • 35. Annex C – Input contributions No. Source Title m16237 Webmaster Maui document register Ad Hoc Group on 3DGC documents, m16238 Francisco Morán Burgos, Patrick Gioia software maintenance and core experiments Ad Hoc Group on Maintenance of m16239 Yi-Shin Tung, Teruhiko Suzuki MPEG-4 Visual related Documents, Reference Software and Conformance Euee S. Jang, Marco Mattavelli, Kazuo Ad Hoc Group on Reconfigurable m16240 Sugimoto Video Coding Miroslaw Bober, Paul Brasnett, Ryoma m16241 Ad Hoc Group on MPEG-7 Visual Oami m16242 Karsten Müller, Anthony Vetro Ad Hoc Group on 3D Video Coding Jens-Rainer Ohm, Jörn Ostermann, Vittorio Ad Hoc Group on High-Performance m16243 Baroncini, Ajay Luthra, Jason Suh, T.K. Video Coding Tan m16244 Gary Sullivan, Jens-Rainer Ohm Ad Hoc Group on AVC Development Ad Hoc Group on Audio Standards m16245 R. Sperschneider Maintenance Ad Hoc Group on SAOC, USAC and m16246 S. Quackenbush, Pierrick Philippe MetaData Young-Kwon Lim, Jaeyeon Song, Cyril m16247 Ad Hoc Group on Scene Representation Concolato m16248 David Singer Ad Hoc Group on MPEG File Formats Kyuheon Kim, Hui Yong Kim, Noboru m16249 Ad Hoc Group on Application Format Harada Jean Gelissen, Sanghyun Joo, Christian Ad Hoc Group on MPEG-V (including m16250 Timmerer previous RoSE activities) Ad Hoc Group on Font Format m16251 Vladimir Levantovsky Representation Ad Hoc Group on Advanced IPTV m16252 Xin Wang, Young Kwon Lim Terminal Filippo Chiariglione, Christian Timmerer, m16253 Ad Hoc Group on MXM Victor Rodriguez, Marius Preda 35
  • 36. Liaison Statement from ITU-T SG 9 m16254 ITU-T SG 9 via SC 29 Secretariat [SC 29 N 10125] Liaison Statement from JTC 1/SGSN m16255 JTC 1/SGSN via SC 29 Secretariat [SC 29 N 10126] Table of Replies on ISO/IEC m16256 ITTF via SC 29 Secretariat 14496-4:2004/FDAM 31 [SC 29 N 10127] m16257 IEC TC 100 via SC 29 Secretariat IEC DTS 62592 [SC 29 N 10130] ISO/IEC FCD 29109-2 [SC 29 N m16258 SC 37 via SC 29 Secretariat 10152] ISO/IEC FCD 29109-4 [SC 29 N m16259 SC 37 via SC 29 Secretariat 10153] Table of Replies on ISO/IEC m16260 ITTF via SC 29 Secretariat 14496-11:2005/FDAM 6 [SC 29 N 10155] Liaison Statement from IEC TC 100 m16261 IEC TC 100 via SC 29 Secretariat [SC 29 N 10157] Summary of Voting on ISO/IEC m16262 SC 29 Secretariat 23000-4:200X/FPDAM 2 [SC 29 N 10158] Summary of Voting on ISO/IEC m16263 SC 29 Secretariat 14496-12:2008/FPDAM 1 Summary of Voting on ISO/IEC FCD m16264 SC 29 Secretariat 23003-2 Table of Replies on ISO/IEC m16265 ITTF via SC 29 Secretariat 14496-4:2004/FDAM 32 Table of Replies on ISO/IEC m16266 ITTF via SC 29 Secretariat 14496-5:2001/FDAM 14 Table of Replies on ISO/IEC m16267 ITTF via SC 29 Secretariat 23000-3:2007/FDAM 1 Table of Replies on ISO/IEC FDIS m16268 ITTF via SC 29 Secretariat 14496-25 Table of Replies on ISO/IEC m16269 ITTF via SC 29 Secretariat 15938-3:2002/FDAM 3 Table of Replies on ISO/IEC m16270 ITTF via SC 29 Secretariat 21000-8:2008/FDAM 1 Table of Replies on ISO/IEC m16271 ITTF via SC 29 Secretariat 23000-7:2008/FDAM 1 36
  • 37. Table of Replies on ISO/IEC FDIS m16272 ITTF via SC 29 Secretariat 23004-8 Table of Replies on ISO/IEC m16273 ITTF via SC 29 Secretariat 14496-10:2008/FDAM 1 Table of Replies on ISO/IEC m16274 ITTF via SC 29 Secretariat 23000-4:200X/FDAM 1 Table of Replies on ISO/IEC FDIS m16275 ITTF via SC 29 Secretariat 23000-6 Table of Replies on ISO/IEC m16276 ITTF via SC 29 Secretariat 14496-5:2001/FDAM 21 Table of Replies on ISO/IEC FDIS m16277 ITTF via SC 29 Secretariat 23000-10 Summary of Voting on ISO/IEC m16278 SC 29 Secretariat 14496-5:2001/FPDAM 24 Summary of Voting on ISO/IEC m16279 SC 29 Secretariat 15938-6:2003/PDAM 3 Summary of Voting on ISO/IEC m16280 SC 29 Secretariat 15938-7:2003/PDAM 5 Summary of Voting on ISO/IEC TR m16281 SC 29 Secretariat 15938-8:2002/PDAM 5 Liaison Statement from ITU-T SG 16 to m16282 ITU-T SG 16 via SC 29 Secretariat IEC TC 100 m16283 Jean Le Feuvre Editor's review of 14496-20 FPDAM2 MPEG4 Simple Profile, Levels 7, 8, 9 Madhukar Budagavi m16284 and MPEG4 Advanced Simple Profile, Minhua Zhou Levels 6, 7, 8, 9 Minhua Zhou Proposed text changes for ISO/IEC m16285 Madhukar Budagavi 14496-2 (MPEG-4 part 2) m16286 SC 37 via SC29 Secretariat SC 37's CDs m16287 IEC TC 100 via SC 29 Secretariat IEC CDV 62514 [SC 29N 10185] Miran Choi Euisok Chung Use Cases for Advanced IPTV m16288 Myung-Gil Jang Terminal Yunkeun Lee m16289 USNB DELETED m16290 USNB DELETED USNB Contribution: Request for new m16291 Andy Tescher for USNB levels 37
  • 38. m16292 IEC TC 100 via SC 29 Secretariat IEC CD 62087 [SC 29 N 10210] Termination of Liaison between ISO m16293 SC 29 Secretariat TC 46 and SC 29 Request for Internal Liaison between m16294 SC 29 Secretariat SC 29 and IEC TC 9 Revisions of Applications & m16295 Anthony Vetro Requirements on 3D Video Coding Jean-Pierre Evain m16296 On Usage of the MPEG URI Assets Christian Timmerer Swedish NB comment in response to m16297 Swedish NB via SC 29 Secretariat Resolution 3.1.2 in N10312 Information on JTC1 Study Group on m16298 SC29 Secretariat Digital Content Management and Protection m16299 ralph.sperschneider@iis.fraunhofer.de Defect report on ISO/IEC14496-26 Minor Corrections to SEDL and the Markus Waltl m16300 Usage of Schematron for SEDL Christian Timmerer Conformance An API for Sensory Effect Metadata Markus Waltl m16301 compliant to the MPEG Extensible Christian Timmerer Middleware (MXM) Liaison Statement from CEA [SC 29 N m16302 CEA via SC 29 Secretariat 10248] m16303 IEC TC 100 via SC 29 Secretariat CD of IEC TS 62579 Liaison Statement from JTC 1/SC m16304 SC 34 via SC 29 Secretariat 34/WG 2 [SC 29 N 10235] Sergio Arnaldo IndexedRegionSet: Efficient m16305 Francisco Morán Representation of Meshes with Multiple Marcos Avilés Textures m16306 Leonardo Chiariglione The MPEG DRM vision Christian Timmerer Michael Eberhard Ingo Kofler On MPEG Modern Transport over m16307 Robert Kuschnig Networks Michael Ransburg Michael Sablatschan Hermann Hellwagner Christian Timmerer Updated DIA APIs and Implementation m16308 Michael Eberhard for MXM 38
  • 39. Jonas Engdegård Heiko Purnhagen Cornelia Falch Leonid Terentiev Report on corrections for the MPEG m16309 Andreas Hölzer SAOC FCD text Oliver Hellmuth Johannes Hilpert Jeroen Koppens Leonid Terentiev Jürgen Herre Clarifications regarding the enhanced m16310 Cornelia Falch Karaoke/Solo processing mode Oliver Hellmuth Heiko Purnhagen Dolby Listening Test Results for USAC m16311 Kristofer Kjörling CE on AVQ-based LPC Heiko Purnhagen Dolby Listening Test Results for USAC m16312 Kristofer Kjörling CE on Phase Coding in MPS Christian Timmerer Mark Stuart Nicola Capovilla Input on the Advanced IPTV Terminal m16313 Fabrizio Rovati (AIT) Architecture Jari Ahola Njål Borch Franc Kozamernik Kristofer Kjörling Progress report on harmonic transposer m16314 Max Neuendorf CE for the USAC work item Andreas Schneider Toshiyuki Nomura proposed clarification on byte m16315 Heiko Purnhagen alignments in LOAS streams Holger Hoerich Philippe Gournay Bruno Bessette CE Report on LPC Quantization for m16316 Roch Lefebvre USAC Redwan Salami Yongzhe Wang Results of Exploration Experiments in m16317 Philipp Merkle 3D Video Coding for Dog Data Set Karsten Müller Ivana Radulovic 3DTV Exploration Experiments on m16318 Per Fröjdh Pantomime data set Po-Lin Lai Dong Tian m16319 MPEG 3DV EEs on Leaving_Laptop Patrick Lopez Paul Kerbiriou m16320 Dong Tian On 2D + Depth SEI Message 39
  • 40. Po-Lin Lai Fons Bruls Lincoln Lobo Wiebe de Haan Stefan Bayer Proposed Additions to and Corrections m16321 Markus Multrus of the USAC Reference Software Fraunhofer IIS Listeningtest Results on Markus Multrus m16322 USAC CE for AVQ-based LPC Ralf Geiger Quantizer Max Neuendorf Report on Merge of sys2 Technology m16323 Taejin Lee into RM0: SBR Improvements Max Neuendorf Comments on new USAC reference m16324 Markus Multrus bitstreams Nikolaus Rettelbach Philippe Gournay VoiceAge Test Report for USAC CE on m16325 Roch Lefebvre Unvoiced Coding Carmen CHENG m16326 Yan HUO 3DV results on Dog sequence Yu LIU Doug Young Suh m16327 For realization of MANE Yongju Cho Olgierd Stankiewicz Results of Exploration Experiments in m16328 Krzysztof Wegner 3D Video Coding, described in Krzysztof Klimaszewski w10360, for Alt Moabit sequence. ChongSoon Lim Reference Software And Test Results m16329 Steffen Wittmann For Multiview Field High Profile Takahiro Nishi ChongSoon Lim Contribution of Stereoscopic Test m16330 Steffen Wittmann sequence Takahiro Nishi ChongSoon Lim Steffen Wittmann Takahiro Nishi Standardization of a new MVC profile Ajay Luthra as specified in Working Draft 1 of ISO/ m16331 Anthony Vetro IEC 14496-10:200X/Amd.2 Multiview Shun-ichi Sekiguchi Field High Profile (N10344) Shinya Shimizu Stéphane Pateux An efficient dataflow design for Jérôme Gorin m16332 implementing MPEG-4 AVC decoder Mickaël Raulet in the RVC framework 40
  • 41. Mickaël Raulet FU Parametrization and FU code m16333 Matthieu Wipliez generation Jörn W. Janneck Proposed new Architecture of Metadata m16334 Stephan Schreiner Driven Audio Post-Processing m16335 removed removed m16336 Jean H.A. Gelissen MPEG-V WD Contributions Fast Array Encoder (FAE): an efficient Khaled Mamou m16337 extension to the QBCR compression Faouzi Ghorbel technique Herve Taddei Huawei Core Experiment proposal for m16338 Dejun Zhang USAC Minjie Xie Werner Oomen Philips Listening Test Results for m16339 Jeroen Koppens USAC CE on Phase Coding in MPS USNB Contribution: Comments on m16340 Andy Tescher for USNB MMT (N10496) IEC NP: Transmission of time code in m16341 IEC TC 100 via SC 29 Secretariat the ancillary data space IEC NP: Terrestrial digital multimedia broadcasting (T-DMB) receivers -- Part m16342 IEC TC 100 via SC 29 Secretariat 2: Interactive data services using BIFS (IEC 62516-2) m16343 IEC TC 100 via SC 29 Secretariat IEC CDV 62571 Some issues regarding the 2nd edition Filippo Chiariglione m16344 of Media Streaming Application Format Tiejun Huang (MSAF) Benefits from the use of Presentation of Filippo Chiariglione m16345 Digital Items and Event Reporting in Tiejun Huang MSAF Proposed text of ISO/IEC Filippo Chiariglione m16346 21000-4:200x AMD1 ? Protection of Tiejun Huang Presentation element Proposal to change the title of ISO/IEC Filippo Chiariglione m16347 21000-2:2005 AMD1 to ?Presentation Tiejun Huang of Digital Item? Filippo Chiariglione Proposal for MXM engine and API of m16348 Tiejun Huang Presentation of Digital Item m16349 Filippo Chiariglione Proposed text of ISO/IEC 23000-5 2nd 41
  • 42. Edition CD Media Streaming Tiejun Huang Application Format Seo-Young Hwang Kyungmo Park m16350 user interaction method on 14496-20 Jaeyeon Song Young-Kwon Lim m16351 Seo-Young Hwang study text on LASeR PDAM3 Kyungmo Park Giovanni Gordara Response to the call for technologies m16352 Cyril Concolato for MPEG RUIF Jean Le Feuvre Jean-Claude Dufourd m16353 Jaeyeon song environments on MMT Marc Gauvin Jaime Delgado m16354 21000-19 FCD revision Victor Rodriguez Miran Choi Marc Gauvin Jaime Delgado m16355 Editors Notes on MVCO Review Victor Rodriguez Miran Choi Takanori Senoh Kenji Yamamoto Report of 3D/FTV Exploration m16356 Ryutaro Oi Experiment with Champagne Tower Tomoyuki Mishina Makoto Okui Takanori Senoh Proposal of Depth Map Estimation Kenji Yamamoto Method in Response to Call for 3D Test m16357 Ryutaro Oi Material: Depth Maps & Tomoyuki Mishina Supplementary Information Makoto Okui Yasuaki Tokumo Shin-ya Hasegawa Study on MPEG-V Sensory m16358 Takuya Iwanami Information Shuichi Watanabe Minor or editorial errors in the Part 12 m16359 David Singer amendment Shin-ya Hasegawa Study on representation of m16360 Yasuaki Tokumo characteristics for MPEG-V Sensory Takuya Iwanami Devices Anthony Vetro m16361 Extractors in the MVC file format David Singer 42
  • 43. m16362 David Singer On Modern Media Transport (MMT) Jeongil Seo Test Sequence Proposal for SAOC m16363 Kyeongok Kang Verification Test Kevin SeungChul Ham Proposal of the template of draft Kangchan Lee m16364 Advanced IPTV Terminal(AIT) Seungyun Lee Requirements Kangchan Lee Proposal of conceptual diagram for m16365 Seungyun Lee advanced IPTV Terminal Proposal to detect dependent view m16366 Teruhiko Suzuki boundary in MVC Clarification of track header in ISO m16367 Teruhiko Suzuki media file format B.S. Choi m16368 Sensory Device Capability Metadata SangHyun Joo Noboru Harada Houari Proposed update to the PA-AF Hendry m16369 reference software and description of Yutaka Kamamoto the PA-AF APIs Takehiro Moriya Munchurl Kim Sung-Kwan Je Proposal for the MPEG-7 Visual m16370 Sang-Il Na Extension, VCE-x: the ROI Signature Weon-Geun Oh Sung-Kwan Je Preliminary feasibility test result for Weon-Geun Oh m16371 MPEG-7 Visual Extension, VCE-x : the Sang-Il Na ROI signature Won-Keun Yang Tomonobu Yoshino Performance Evaluation of Spatially m16372 Sei Naito Adaptive Macroblock Size Selection Shigeyuki Sakazawa Scheme for HVC Test Sequences Hosang Sung Report on Unvoiced Speech Coding for m16373 Eunmi Oh USAC Miyoung Kim JungHoe Kim Julien Robilliard Report on Phase Coding in MPEG m16374 Eunmi Oh Surround for USAC Bernhard Grill m16375 Keiichi Chono Requests on Coding conditions in Call Hirofumi Aoki for Evidence on High-Performance Junji Tajime Video Coding (HVC) 43
  • 44. Yuzo Senda JungHoe Kim Julien Robilliard Proposed Changes to WD2 for Phase m16376 Eunmi Oh Coding Bernhard Grill Sang-Kyun Kim Jin-Seo Kim The modified ColorCorrection sensory m16377 Maeng-Sub Cho effect for spatio-temporal moving Bon-Ki Koo regions Yong Soo Joo Sang-Kyun Kim Jin-Seo Kim Modifications of m16378 Maeng-Sub Cho ColorCorrectionParameter Type of Bon-Ki Koo MPEG-V Part3 Sensory Information Yong Soo Joo Sang-Kyun Kim Jin-Seo Kim Basic description languaues for Sensory m16379 Maeng-Sub Cho Device Capabilities of MPEG-V Part2 Bon-Ki Koo Control Information Yong Soo Joo Sang-Kyun Kim Jin-Seo Kim Basic description languaues for Sensory m16380 Maeng-Sub Cho Device Commands of MPEG-V Part2 Bon-Ki Koo Control Information Yong Soo Joo Sang-Kyun Kim Jin-Seo Kim Basic description languaues for User m16381 Maeng-Sub Cho Sensory Preferences of MPEG-V Part2 Bon-Ki Koo Control Information Yong Soo Joo SangHyun Joo Modified MPEG-V System m16382 JongHyun Jang Architecture Taejin Lee Max Neuendorf Jeremie Lecomte Report on Merge of sys2 Technology m16383 Minje Kim into RM0: TCX Improvements Seungkwon Beack Kyeongok Kang Bernhard Grill m16384 Juergen Herre for GNB Details of NB Position on SAOC Ballot B. S. Choi m16385 User Sensory Preference Metadata Sang Hyun Joo m16386 Inseon Jang Proposal of dynamic preset for IM AF 44
  • 45. Jeongil Seo Hui Yong Kim Kyeongok Kang Kevin SeungChul Ham Inseon Jang Hui Yong Kim Editor's study on ISO/IEC 23000-12 m16387 Jeongil Seo CD Interactive music application Laurent Primaux format Owen Lagadec Seok Lee Jaejoon Lee Ilsoon Lim 3DV EE1 & EE2 Results on Newspaper m16388 Jin Young Lee sequence Ho-Cheon Wey Du-Sik Park Masayuki Tanimoto Toshiaki Fujii Error-resilient Free-viewpoint Image m16389 Mehrdad Panahpour Tehrani Generation for FTV Hisayoshi Furihata Menno Wildeboer Masayuki Tanimoto Toshiaki Fujii Depth Estimation Reference Software m16390 Mehrdad Panahpour Tehrani (DERS) 3.0 Kazuyoshi Suzuki Menno Wildeboer Masayuki Tanimoto Toshiaki Fujii Mehrdad Panahpour Tehrani Semi-automatic Depth Estimation for m16391 Norishige Fukushima FTV Kazuyoshi Suzuki Menno Wildeboer Per Fröjdh m16392 Torbjörn Einarsson Adaptive Progressive Download Clinton Priddle Per Fröjdh File format sub-track selection and m16393 Andrey Norkin switching Clinton Priddle Cheon Lee EE1: Results of Depth Estimation on m16394 Yo-Sung Ho 'Pantomime? Sequence Cheon Lee EE2: Results of View Synthesis on m16395 Jiho Park 'Pantomime? Sequence Yo-Sung Ho1 m16396 Eun-Kyung Lee 3-D Test Sequence - Multiview Video 45
  • 46. Yo-Sung Ho and Depth Map Kei Kikuiri Core Experiment Proposal on the eSBR m16397 Kousuke Tsujino module of USAC Nobuhiko Naka Hussein Aman-Allah AVC Entropy Coding and Bitstream m16398 Ihab Amer Generation for the MPEG RVC Marco Mattavelli Encoding Tools Seungwook Lee Bonki Koo m16399 Kyoungsoo Son CE Report on SC3DMC Ver 4.0 Daiyong Kim Euee S. Jang Yin Zhao 3DV EE3 on Champagne_tower m16400 Lu Yu sequences Kyoungsoo Son Seungwook Lee Bonki Koo Algorithm descriptions of attribute data m16401 Daiyong Kim on SC3DMC Euee S. Jang Seungwook Lee Bonki Koo QBCR and SVA bitstream syntax m16402 Kyoungsoo Son update Daiyong Kim Euee S. Jang Seungwook Lee Bonki Koo Kyoungsoo Son m16403 A study on RVC based Graphics codec Daiyong Kim Mingxiao Chen Euee S. Jang Daiyong Kim Kyoungsoo Son m16404 Seungwook Lee Update and current status of SC3DMC Bonki Koo Euee S. Jang Yin Zhao Lu Yu LDV Reference Software for View m16405 Fons Bruls Synthesis Lincoln Lobo Gun Bang 3DV/FTV EE results of depth Gi Mun Um m16406 estimation and view synthesis on Namho Hur "lovebird1" sequence Jinwoong Kim m16407 Yin Zhao Perceptual measurement for evaluating 46
  • 47. Lu Yu quality of view synthesis Jihun Cha Injae Lee Responses to LASeR PDAM3 Editor?s m16408 Young-kwon Lim Note Han-Kyu Lee Jinwoo Hong Ihab Amer Advances in the CE: Development of m16409 Marco Mattavelli RVC Encoding Tools m16410 KNB KNB Comment on 14496-20 PDAM3 Gun Bang Jaeho Lee Depth Estimation algorithm in m16411 Namho Hur SADERS1.0 Jinwoong Kim Jihun Cha Injae Lee Utilization of LASeR on Rich Media UI m16412 Young-kwon Lim Framework Han-Kyu Lee Jinwoo Hong Karim Maarouf AVC Intra Prediction, Transform and m16413 Ihab Amer Quantization for the MPEG RVC Marco Mattavelli Encoding Tools Weon-Geun Oh Ju-Kyong Jin Response to the Core Experiments on m16414 Sang-il Na Video Signature Tools Hae-Kwang Kim Dong-Seok Jeong m16415 Cyril Concolato Editor's Text of 14496-1 4th edition Min-Jeong Lee Cross verification result for ETRI m16416 Heung-Kyu Lee VCE-7 proposal Jaewon Sung Improving view synthesis results based m16417 Byeong-Moon Jeon on depth quality measure Jaewon Sung 3DV EE results on Newspaper m16418 Byeong-Moon Jeon sequence fons bruls Philips response to new Call for 3DV m16419 rene klein gunnewiek Test Material: Arrive book & Mobile patrick van de walle fons bruls rene klein gunnewiek Philips & Zhejiang Uni response to new m16420 patrick van de walle Call for 3DV Test Material: Yin Zhao Champagne Tower Lu Yu 47
  • 48. fons bruls Philips (in coop with 3D4YOU) rene klein gunnewiek m16421 response to new Call for 3DV Test patrick van de walle Material: Beergarden rene van de vleuten Philips 1st 3DV synthesis results using fons bruls new test material for Arrive book, m16422 rene klein gunnewiek Mobile, Beergarden & Champagne patrick van de walle Tower m16423 fons bruls Philips 3DV EE results Truong Cong Thang Yongju Cho Proposed Scenario and Requirements m16424 Jung Won Kang for Advanced IPTV Terminal Jeong-Ju Yoo Blagica Jovanova m16425 Marius Preda Avatar Characteristics Françoise Preteux m16426 Miska M. Hannuksela On MVC File Format Ivica Arsov m16427 Integrated MXM API for 3D Graphics Marius Preda Sairus Patel Proposal for a new amendment of m16428 Vladimir Levantovsky ISO/IEC 14496-22 ?Open Font Format? Aritz Sanchez A Video Signature based on Robust m16429 Sebastian Gerke Region Detectors Patrick Ndjiki-Nya Paul Brasnett Kota Iwamoto Proposal on MPEG-7 Video Signature m16430 Stavros Paschalakis Tools Ryoma Oami Miroslaw Bober Ehab Asaad Hanna AVC Inter-frame Prediction for the m16431 Ihab Amer MPEG RVC Encoding Tools Marco Mattavelli Sehoon Yea Results of Exploration Experiments in m16432 Zafer Arican 3D Video for Lovebird2 Anthony Vetro m16433 Schuyler Quackenbush 87th MPEG Audio Report m16434 Schuyler Quackenbush Draft Revised Audio CE Methodology Khaled Mamou Titus Zaharia m16435 TFAN bitstream syntax update Marius Preda Françoise PRETEUX 48
  • 49. Khaled Mamou m16436 FAE software description Faouzi Ghorbel Sehoon Yea Verification of Test Results For m16437 Anthony Vetro Multiview Field High Profile (m16329) Shun-ichi Sekiguchi On design of transforms for high- Yuriy A. Reznik m16438 resolution / high-performance video Ravi K. Chivukula coding Jeremie Lecomte Guillaume Fuchs Proposed improvements to WD2 of m16439 Max Neuendorf USAC Ralf Geiger Markus Multrus Jeha Ryu Haptic Movie system and Service m16440 Yeongmi Kim Scenario for MPEG-V Yuriy A. Reznik Fast SBR filterbanks for AAC-ELD, m16441 Ravi K. Chivukula HE-AAC, and USAC. Jeha Ryu Representation of Tactile Movie m16442 Yeongmi Kim Control Information for MPEG-V Yuriy A. Reznik On complexity of size 960 transform in m16443 Ravi K. Chivukula AAC family of codecs Ye-Kui Wang m16444 Comments to the MVC file format draft Miska Hannuksela m16445 Ye-Kui Wang A proposal to MVC file format Sungyong Yoon Core experiment proposal on arithmetic m16446 Hyunkook Lee coding Younghee Choi Proposal for using the existing tools for Wonsuk Lee m16447 generic metadata APIs of metadata Seungyun Lee engine on MXM APIs Analysis on partition and transform Tomoyuki Yamamoto m16448 selection in the context of extended Tomohiro Ikai block sizes Sung-Kwan Je Proposal for a New Standard Item in m16449 Sang-Il Na MPEG-7 Visual descriptors, ROI Weon-Geun Oh Signature m16450 Hyungyu Kim MPEG-4 ASP Decoder Description and Sowon Kim a Case Study of the Decoder Design Minsoo Park Process in the RVC framework Hwa Seon Shin Byeongho Choi 49
  • 50. Chungku Yie Euee S. Jang Shangwen Li m16451 delete Lu Yu Hui Yong Kim BWS Conformance file contribution Yong Han Kim m16452 and SW update for ISO/IEC Munchrul Kim 23000-9/Amd.1 Houari Sabirin Hui Yong Kim m16453 Yong Han Kim * Withrawn * Munchurl Kim Hui Yong Kim Study on ISO/IEC 23000-9 PDAM2 m16454 Myung Seok Ki (DMB-AF Harmonization on MPEG-2 Yong Han Kim TS) Sung Jin Hur A Proposal for Multimedia Application m16455 Wan Choi Interface for Collaborative Work Julien Robilliard Fraunhofer Listening Test Results for m16456 Matthias Neusinger USAC CE on Phase Coding in MPS Johannes Hilpert Sung Jin Hur Use Case of Multimedia Application m16457 Wan Choi Interface Laurent Primaux iKlax improvement Proposal on m16458 Owen Lagadec ISO/IEC 23000-12 CD IM AF Emmanuel Bouix Updated Text of ISO/IEC 23000-11 Next generation Broadcasting m16459 Stereoscopic Video AF Conformance Forum(Korea) and Reference Software Additional results of Exploration Olgierd Stankiewicz Experiments in 3D Video Coding, m16460 Krzysztof Wegner described in w10360, for Alt Moabit Krzysztof Klimaszewski sequence. Contribution of a Basic Interpreter Ruben Tous m16461 Module to ISO/IEC 15938-12/Amd.1 Jaime Delgado MPEG Query Format Ref. Soft & Conf. High Definition Test Sequences for Steffen Kamp m16462 High-Performance Video Coding Mathias Wien (HVC) AVC Anchor Streams for Evaluation of Steffen Kamp m16463 High-Performance Video Coding Mathias Wien (HVC) m16464 tjhuang@pku.edu.cn Requirements Input on Pervasive AV 50
  • 51. on behalf of experts from 18 bodies Scene Coding Bojan JOVESKI Mihai MITREA BiFS-based solution and its deployment m16465 Pieter SIMOENS within the FP7 MobiThin project: event Iain-James MARSHALL handling and streaming Françoise PRETEUX Walid Hachicha Optimized implementation of the m16466 Khaled Mammou TFAN encoder Titus Zaharia Liaison Statement from EBU [SC 29 N m16467 EBU via SC 29 Secretariat 10254] m16468 French NB via SC 29 Secretariat French NB Contribution on JVT Daiyong Kim Kyoungsoo Son Comparison result of conformance test m16469 Seungwook Lee on the SVN Bonki Koo Euee S. Jang Gwo Giun (Chris) Lee FU network of inverse scan, inverse m16470 He-Yuan Lin quantization and inverse transform in Jia-Wei Liang AVC High Profile Shinya Shimizu 3DV/FTV EE Report on Doorflower m16471 Hideaki Kimata sequence Shun-ichi Sekiguchi Yoshihisa Yamada Information on new test material for m16472 Yoshiaki Kato HVC study Kohtaro Asai Tokumichi Murakami Shun-ichi Sekiguchi Kazuo Sugimoto Yoshihisa Yamada Additional coding performance m16473 Yoshiaki Kato evaluation of extended MB size Kohtaro Asai Tokumichi Murakami Copy of m16461 (Contribution of a Ruben Tous Basic Interpreter Module to ISO/IEC m16474 Jaime Delgado 15938-12/Amd.1 MPEG Query Format Ref. Soft & Conf.) Marzia Corvaglia Fabrizio Guerrini A proposal for Video Signature Tool m16475 Riccardo Leonardi and Video Fingerprinting Eliana Rossi Pierangelo Migliorati 51
  • 52. Liaison Statement from DRM [SC 29 N m16476 DRM via SC 29 Secretariat 10262] Liaison Statement from Liaison m16477 WorldDMB Forum via SC 29 Secretariat Statement from WorldDMB Forum [SC 29 N 10263] m16478 Marius Preda Editor Comments on AFX 3rd Edition Jungyoup Yang Kwanghyun Won Additional Experimental Result of m16479 Byeungwoo Jeon MVOP with HD Sequences Su Nyeon Kim Evaluation of Video Signature Based m16480 Sebastian Possos on Tomography Alexis Michael Tourapis Athanasios Leontaris m16481 JM Reference Software Enhancements Peshala Pahalawatta Yan Ye Hwa Seon Shin Sung Moon Chun Status and Future Plan of Video Tool m16482 Hyungyu Kim Library (VTL) Byeongho Choi Euee S. Jang David Oyarzun m16483 Avatar Definition Markup Language Jean H.A. Gelissen (editor) m16484 ... Withrawn KNB Comment on High Performance m16485 KNB Video Coding Mario Doeller MPEG Query Format Semantic m16486 Florian Stegmaier Requirements Gero Bäse Mario Döller Introducing Semantic Retrieval in m16487 Florian Stegmaier MPQF Gero Bäse m16488 TTA via SC 29 Secretariat Liaison Statement from TTA m16489 SC 34 via SC 29 Secretariat Liaison Statement from SC 34/WG 2 Khaled Mamou CE Report on SC3DMC: FAE versus m16490 Faouzi Ghorbel QBCR, QBCR BP and QBCR AC m16491 3GPP SA4 via SC 29 Secretariat Liaison Statement from 3GPP SA4 m16492 ITU-T SG 16 via SC 29 Secretariat Liaison statement from ITU-T SG 16 m16493 Mark Callow Guide to the MPEG Subversion 52
  • 53. Itaru kaneko Repository Richard Clark Sebastian Possos Verification of the Proposed MPEG-7 m16494 Hari Kalva Video Signature Tools 53
  • 54. Annex D – Output documents No. Source Title w10517 Convener List of Documents from the 88th Meeting in Maui, Hawaii, USA w10518 Convener Resolutions of the 88th Meeting in Maui, Hawaii, USA w10519 Convener List of AHGs Established at the 88th Meeting in Maui, Hawaii, USA w10520 Convener Report of the 88th Meeting in Maui, Hawaii, USA w10521 Convener Guidelines for Electronic Distribution of MPEG M and N Documents w10522 Convener Press Release of the 88th Meeting in Maui, Hawaii, USA w10523 Convener Meeting Notice of the 89th Meeting in London, UK w10524 Convener Guide for WG 11 Meeting Hosts w10525 Requirements Enhanced MPEG-7 Query Format Requirements w10526 Requirements MPEG-V Extended Call for Proposals w10527 Convener Adhoc on MPEG Modern Transport (MMT) Study Text of ISO/IEC 14496-16:2006/PDAM4 (Scalable w10528 3DGC Complexity 3D Mesh Compression) w10529 3DGC Description of AFX CE and explorations w10530 3DGC ISO/IEC 14496-16 3rd Edition w10531 3DGC MPEG 3D Graphics Vision w10532 3DGC MPEG 3D Graphics FAQ v22 AHG on 3DGC documents, software maintenance and core w10533 3DGC experiments w10534 Video Defect Report on ISO/IEC 14496-2:2004 Study Text of ISO/IEC 14496-4:2004/FPDAM 38 Multiview Video w10535 Video Coding Conformance Testing w10536 Video Defect Report on ISO/IEC 14496-4:2004 w10537 Video First Ideas on New MPEG-4 Video Bitstream Repository Structure Study Text of ISO/IEC 14496-5:2001/FPDAM 15 Reference w10538 Video Software for Multiview Video Coding w10539 Video Working Draft of Reference Software for Stereo High Profile w10540 Video Study Text of ISO/IEC 14496-10:200X/FPDAM 1 54
  • 55. w10541 Video Defect Report on ISO/IEC 14496-10:200X w10542 Video WD 1.0 of 15938-3/Amd.4 Video Signature Descriptors w10543 Video MPEG-7 Visual XM 35 Description of Core Experiments in Video Signature Description w10544 Video development w10545 Video Disposition of Comments on ISO/IEC 15938-6:2003/PDAM 3 Text of ISO/IEC 15938-6:2003/FPDAM 3 Reference Software for w10546 Video Image Signature Tools w10547 Video Disposition of Comments on ISO/IEC 15938-7:2003/PDAM 5 Text of ISO/IEC 15938-7:2003/FPDAM 5 Conformance Testing for w10548 Video Image Signature Tools w10549 Video Disposition of Comments on ISO/IEC 15938-8:2002/PDAM 5 Text of ISO/IEC 15938-8:2002/DAM 5 Extraction and Matching of w10550 Video Image Signature Tools w10551 Video Description of Core Experiments in RVC w10552 Video Description of Exploration Experiments in 3D Video Coding w10553 Video Call for Evidence on High-Performance Video Coding w10554 Convener Liaison statement to ITU-T SG9 re 3D Video Coding w10555 Convener Liaison statement to IEC TC100 re IEC DTS 62592 w10556 Convener Liaison statement to SC37 re Biometric Data Interchange w10557 Convener Liaison statement to IEC TC100 re IEC CD 62087 w10558 Convener Liaison statement to CEA re 3D Video Coding w10559 Convener Liaison statement to ITU-T SG16 re AVC Development AHG on Maintenance of MPEG-4 Visual related Documents, w10560 Convener Reference Software and Conformance w10561 Convener AHG on Reconfigurable Video Coding w10562 Convener AHG on MPEG-7 Visual w10563 Convener AHG on 3D Video Coding w10564 Convener AHG on High-Performance Video Coding w10565 Convener AHG on AVC Development w10566 Video Request for ISO/IEC 15938-3:2000/Amd.4 Requirements v3.0 for a new BIFS profile to support Interactive w10567 Requirements Digital Radio 55
  • 56. Call for Proposal on additional BIFS technologies for Interactive w10568 Requirements Services for Digital Radio w10569 Requirements Draft Advanced IPTV Terminal (AIT) Requirements w10570 Requirements Applications and Requirements for 3DV Workshop on MMT (MPEG Modern Transport) - Call for w10571 Requirements Contributions w10572 Systems Study of ISO/IEC 13818-1:2007/FPDAM4 Transport of MVC w10573 Systems WD 2.0 of ISO/IEC 13818-1:2007 DCOR X w10574 Systems Text of ISO/IEC CD 14496-1 4th Edition WD of ISO/IEC 14496-1 PDAM4 Registration Authority and systems w10575 Systems extensions DoC on ISO/IEC 14496-5:2001/PDAM 23 Synthesized Texture w10576 Systems Reference SW Text of ISO/IEC 14496-5:2001/FPDAM 23 Synthesized Texture w10577 Systems Reference SW w10578 Systems Text of ISO/IEC 14496-5:2001/AMD14:2009/DCOR 1 OFF Ref. SW w10579 Systems DoC on ISO/IEC 14496-12:2008/FPDAM 1 General Improvements w10580 Systems Text of ISO/IEC 14496-12:2008/FDAM 1 General Improvements w10581 Systems Study of ISO/IEC 14496-15:2004/FPDAM 3 MVC File Format Study of ISO/EC 14496-20:2008 LASeR & SAF/FPDAM 2 w10582 Systems Adaptation w10583 Systems DoC on ISO/EC 14496-20:2008 LASeR & SAF/PDAM 3 PMSI w10584 Systems Text of ISO/EC 14496-20:2008 LASeR & SAF/FPDAM 3 PMSI Updated Workplan for service example of LASeR Adaptation & w10585 Systems PMSI TuC for ISO/IEC 14496-20:2000 LASeR & SAF AMD 4 Advanced w10586 Systems User Interaction Text of ISO/IEC 14496-22:200X/PDAM 1 Support for many-to-one w10587 Systems range mapping WD 4.0 of ISO/IEC 15938-12:200X AMD 1 MPQF Conf. and Ref. w10588 Systems SW w10589 Systems WD 1.0 of ISO/IEC 15938-12:200X AMD 2 Semantic Enhancement w10590 Systems Request for ISO/IEC 21000-2 AMD 1 Presentation of Digital Item w10591 Systems Text of ISO/IEC 21000-2 PDAM 1 Presentation of Digital Item 56
  • 57. Request for ISO/IEC 21000-4 AMD 2 Protection of Presentation w10592 Systems Element Text of ISO/IEC 21000-4 PDAM 2 Protection of Presentation w10593 Systems Element Text of ISO/IEC 23000-4 MSSAF/FDAM2 Conf. & Ref. SW for w10594 Systems Protected MSSAF w10595 Systems Text of ISO/IEC CD 23000-5 MSAF 2nd edition w10596 Systems Study of ISO/IEC 23000-6 PA-AF/PDAM1 Conf. and Ref. SW Workplan for ISO/IEC 23000-6 PA-AF Conformance and Reference w10597 Systems Software Study of ISO/IEC 23000-9:2008/FPDAM1 DMB AF Conf. And Ref. w10598 Systems Soft. Workplan for ISO/IEC 23000-9:2008/FPDAM1 DMB AF Conf. And w10599 Systems Ref. Soft. w10600 Convener Terms of reference w10601 Convener MPEG Standards w10602 Convener Unpublished standards at FDIS level w10603 Convener MPEG work plan and time line w10604 Convener MPEG Standard Editors w10605 Convener Schema assets updates w10606 Convener Software assets w10607 Convener Conformance assets w10608 Convener Content assets w10609 Convener URI assets Standards under development for which a call for patent statements is w10610 Convener issued w10611 Convener List of Organisations with which MPEG entertains liaisons Study of ISO/IEC 23000-9:2008/PDAM2 DMB AF Harmonization of w10612 Systems MPEG-2 TS storage Text of ISO/IEC 23000-11 PDAM 1 Stereoscopic Vide AF Ref. Soft w10613 Systems and Conf. Workplan for Stereoscopic Video Application Format Ref. Soft and w10614 Systems Conf. w10615 Systems Study of ISO/IEC CD 23000-12 Interactive Music AF 57
  • 58. w10616 Systems WD 2.0 of Architecture w10617 Systems WD 2.0 of Control Information w10618 Systems WD 2.0 of Sensory Information w10619 Systems WD 2.0 of Avatar Information w10620 Systems Study of ISO/IEC CD 23006-1 MxM Architecture and Technologies w10621 Systems Study of ISO/IEC CD 23006-2 MXM APIs w10622 Systems Study of ISO/IEC CD 23006-3 MXM Conf. & Ref. SW First ideas on normative APIs compliant to MXM framework for w10623 Systems future MPEG standards w10624 Systems MXM Developer's Day: Call for Participation w10625 Systems Study of ISO/IEC CD 29116-1 2nd edition MXM Protocols w10626 Systems WD MPEG Rich Media UI Request for ISO/IEC CD 14496-22:200X AMD 1 Support for many- w10627 Systems to-one range mapping Request for ISO/IEC 23000-11 AMD 1 Stereoscopic Video AF Ref. w10628 Systems Soft and Conf. w10629 Systems MPEG DRM Vision w10630 Systems Guide to the MPEG Subversion Repository w10631 Convener Liaison statement to JTC 1/SGSN Liaison statement to ITU-T SG 16 on rights information w10632 Convener interoperability Liaison statement to IEC TC 100 on Multimedia Gateway in Home w10633 Convener Networks Liaison statement to IEEE TC on Haptics on extended Call for w10634 Convener Proposal on MPEG-V w10635 Convener Liaison statement to IEC TC 9 w10636 Convener Liaison statement to SGDCMP on DRM technologies in MPEG Liaison statement to IEC TC 100 on Multimedia home server systems w10637 Convener - Conceptual model for domain management Liaison statement to JTC 1/SC 34/WG 2 on Open Font Format w10638 Convener reference software Liaison statement to IEC TC 100 on Transmission of time code in the w10639 Convener ancillary data space w10640 Convener Liaison statement to TTA on New BIFS Profile for Digital Radio 58
  • 59. Liaison statement to JTC 1/SC 34/WG 2 on media types of ISO/IEC w10641 Convener 14496-22 w10642 Convener Liaison statement to W3 C on MPEG Rich Media UI w10643 Convener Liaison statement to JTC 1 SWG-ARM on Professional Archival AF w10644 Convener Liaison statement to EBU on MPEG URI Assets w10645 Convener Liaison statement to W3C on MXM w10646 Convener Liaison statement to ATSC on Carriage of SVC over MPEG-2 TS w10647 Convener Liaison statement to SC6 on extended Call for Proposal on MPEG-V w10648 Convener Liaison statement to SC25 on extended Call for Proposal on MPEG-V w10649 Video Evaluation and Testing of 3D Video Coding w10650 Audio ISO/IEC 14496-3:2009/DCOR 1:200X Byte Alignment Study on ISO/IEC 14496-3:2009/ FPDAM 1:200x, HD-AAC Profile, w10651 Audio MPEG Surround Signaling w10652 Audio WD on AAC family of profiles w10653 Audio DoC on ISO/IEC 14496-5:2001/FPDAM 24, MPEG-4 AAC ELD w10654 Audio ISO/IEC 14496-5:2001/FDAM 24, MPEG-4 AAC ELD w10655 Audio Request for Amendment, 14496-26:2009/PDAM 2 ISO/IEC 14496-26:2009/PDAM 2, BSAC Conformance for w10656 Audio Broadcasting Study on ISO/IEC 14496-26:2009/DCOR 1, ALS, SLS and AAC w10657 Audio updates w10658 Audio Study on ISO/IEC 23003-1:2007/DCOR 2, Misc. Corrections w10659 Audio Study on ISO/IEC FCD 23003-2:200x, Spatial Audio Object Coding w10660 Audio Status and Workplan on SAOC Core Experiments w10661 Audio WD3 of USAC w10662 Audio Workplan for USAC CEs w10663 Audio Workplan on MPEG USAC Reference Encoder w10664 Audio MPEG Audio CE methodology w10665 Convener Response to IEC TC-100 on IEC CDV 62571 w10666 Convener Response to Swedish NB on 960 and 1024 block lengths w10667 Convener AHG on Audio Standards Maintenance w10668 Convener AHG on SAOC, USAC and MetaData 59
  • 60. w10669 Audio MPEG Audio Test Material for Core Experiments w10670 Systems MPEG comments on W3C Widget Recommendation w10671 Requirements Context and Objectives for Advanced IPTV Terminal w10672 Systems WD 1.0 of Reference Software w10673 Systems WD 1.0 of Conformance w10674 Systems Request for ISO/IEC 14496-22:200X AMD 1 w10675 Convener AHG on Scene Representation w10676 Convener AHG on MPEG File Formats w10677 Convener AHG on Application Format w10678 Convener AHG on Font Format Representation w10679 Convener AHG on Advanced IPTV Terminal w10680 Convener AHG on MXM w10681 Convener AHG on MPEG-V w10682 Requirements LASER Requirements w10683 Systems MXM Development Roadmap for Engines and Applications w10684 Systems MPEG Technologies for DRM w10685 Convener Liaison statement to UPnP on MPEG Rich Media UI w10686 Convener Liaison statement to DLNA on MPEG Rich Media UI w10687 Convener Template Liaison statement on Modern Media Transport workshop w10688 Convener Template Liaison statement on MXM DevDay's w10689 Convener Liaison statement to ITU-T Q.6/16 Proposal for support of MPEG Rich Media UI in W3C Widget w10690 Systems Recommendation Liaison statement to IEC TC 100 on rights information w10691 Convener interoperability w10692 Convener Response to NB comments w10693 Convener Proposal to improve the Software Copyright Disclaimer w10694 Convener Editors nominated for an ISO/IEC Certificate of Appreciation 60
  • 61. Annex E – Requirements report Source: Jörn Ostermann, Chair 16 Requirements documents approved at this meeting No. Title 10525 Enhanced MPEG-7 Query Format Requirements 10526 MPEG-V Extended Call for Proposals 10527 Adhoc on MPEG Modern Transport (MMT) 10567 Requirements v3.0 for a new BIFS profile to support Interactive Digital Radio Call for Proposal on additional BIFS technologies for Interactive Services for 10568 Digital Radio 10569 Draft Advanced IPTV Terminal (AIT) Requirements 10570 Applications and Requirements for 3DV 10571 Workshop on MMT(MPEG Modern Transport) – Call for Contributions 10671 Context and Objectives for Advanced IPTV Terminal 10682 LASER Requirements 17 MPEG-7 Query Format The current MPEG-7 query format does not allow to include semantics in the query. A new requirement (N10525) was added in order to enable semantics in queries using RDF and OWL. 18 MPEG-4 Video A request to add levels to MPEG-4 Video Simple and Advanced Simple Profiles were brought to MPEG. Especially, a request for 1080p@30/60/120 was formulated. Due to no support for new levels in the ASP profile and only one organization interested in extending the Simple Profile, no action was taken. 19 LASeR Currently, LASeR terminals are not able to read from multi touch screens or sensors like gravity, wind and motion sensors. Furthermore, haptic interfaces cannot be controlled. Since these interfaces and sensors become prevalent, a new requirement was added for LASeR (N10682). 20 MPEG-V: Information exchange with virtual worlds After evaluating the response to the Call for Proposals (N10239), MPEG identified the need for technology in the areas of emotions of avatars, objects belonging to avatars, and haptics. Based on Requirements for MPEG-V Version 3.2 (N10498), an Extended Call for Proposals was issued (N10526). 21 MAF No input on the topic of Advanced Surveillance AF was received. 61
  • 62. 22 MPEG-User Interface Framework In response to the Call for Proposals N10232, MPEG received input from one organisation. The technical work started in the Systems subgroup. Explorations 22.1 Interactive Radio Requirements for Interactive Radio were updated as captured in N10567 Requirements v3.0 for a new BIFS profile to support Interactive Digital Radio. Contrary to prior beliefs, it now appears that there is a need for new technology. MPEG issued a Call for Proposals at the 88th meeting (N10568) to be answered by the 89th meeting. Topics include image caching, image delivery, navigation and scene state management. 22.2 3D Video Coding Following the vision to enable both advanced stereoscopic display processing and improved support for auto-stereoscopic N-view displays as outlined in N10357 Vision on 3D Video Coding, MPEG aligned its applications and requirements document accordingly (N10570). 22.3 High Performance Video Coding (HVC) HVC targets mobile services, IPTV, and Ultra High Definition (UHD) displays with a focus on coding efficiency considering codec complexity as well. The current target is to increase coding efficiency by 25% at low complexity and 50% at full complexity. MPEG foresees that the reduction of complexity will be achieved by turning off some tools required to reach the full performance in terms of coding efficiency. A Call for Evidence on High Performance Video Coding (N10553) was issued. 22.4 Advanced IPTV Terminal N10569 Draft Advanced IPTV Terminal (AIT) Requirements and N10671 Context and Objectives for Advanced IPTV Terminal was developed. Several use cases, their requirements and potential technical solutions are provided. It appears that there is a lack of technologies related to social networking and simple editing functions for audio and video. 22.5 Pervasive AV Scene Coding MPEG was informed that the performance of the state of the art video coders for certain applications like surveillance or soap operas is not sufficient. The common feature of these applications appears to be that pan/tile cameras are located at fixed locations. Currently, evidence is lacking that the performance of video codecs developed for these scenarios will outperform significantly AVC or other codecs. 22.6 MPEG Media Transport According to N10496 issued at the 87th meeting, there is a need for a transport and file format friendly stream format. Error resilience of current MPEG streams might not be optimal. The potential gains of joint optimization of coding and transport are not known. Conversions 62
  • 63. between different transport mechanisms like from MPEG-2 Transport Stream to MPEG Program Stream are not straight forward or defined. Furthermore, MPEG does not provide any hint on how to adapt content to different networks. Contributions to this meeting verified that all the topics above should be investigated further. In order to understand the current technology used and the new technologies currently developed for future use of transporting media over networks, MPEG will host a Workshop on MPEG Media Transport (N10571) on 09/07/01 at its next meeting. Experts will be invited to present their work. An adhoc group (N10527) was established to prepare the workshop as well as to work on an applications and requirements document on MMT. 63
  • 64. Annex F– Systems report Source: Young-Kwon Lim, Chair 1 Opening of the Meeting 1.1 Approval of the agenda 1.2 Goals for the week The main outputs of the meeting from the Systems Sub-group perspective are: No. Title TBP Available 13818-1 MPEG-2 Systems 10572 Study of ISO/IEC 13818-1:2007/FPDAM4 Transport of MVC No 09/05/08 10573 WD 2.0 of ISO/IEC 13818-1:2007 DCOR X No 09/05/08 14496-1 MPEG-4 Systems 10574 WD of ISO/IEC 14496-1 4th Edition No 09/04/24 WD of ISO/IEC 14496-1 PDAM4 Registration Authority and No 09/04/24 10575 systems extensions 14496-5 Reference Software DoC on ISO/IEC 14496-5:2001/PDAM 23 Synthesized Texture No 09/04/24 10576 Reference SW Text of ISO/IEC 14496-5:2001/FPDAM 23 Synthesized Texture No 09/05/08 10577 Reference SW Text of ISO/IEC 14496-5:2001/AMD14:2009/DCOR 1 OFF Ref. No 09/04/24 10578 SW 14496-12 ISO File Format 10579 DoC on ISO/IEC 14496-12:2008/FPDAM 1 General Improvements No 09/04/24 10580 Text of ISO/IEC 14496-12:2008/FDAM 1 General Improvements No 09/05/08 14496-15 AVC File Format 10581 Study of ISO/IEC 14496-15:2004/FPDAM 3 MVC File Format No 09/05/08 14496-20 LASeR& SAF Study of ISO/EC 14496-20:2008 LASeR & SAF/FPDAM 2 No 09/04/24 10582 Adaptation 10583 DoC on ISO/EC 14496-20:2008 LASeR & SAF/PDAM 3 PMSI No 09/04/24 10584 Text of ISO/EC 14496-20:2008 LASeR & SAF/FPDAM 3 PMSI No 09/04/24 Updated Workplan for service example of LASeR Adaptation & No 09/04/24 10585 PMSI TuC for ISO/IEC 14496-20:2000 LASeR & SAF AMD 4 Advanced No 09/04/24 10586 User Interaction 14496-22 Open Font Format Request for ISO/IEC 14496-22:200X AMD 1 Support for many-to- 10627 No 09/04/24 one range mapping 64
  • 65. 10587 Text of ISO/IEC 14496-22:200X/PDAM 1 Support for many-to- No 09/04/24 one range mapping 15938-12 MPEG Query Format WD 4.0 of ISO/IEC 15938-12:200X AMD 1 MPQF Conf. and Ref. No 09/04/24 10588 SW WD 1.0 of ISO/IEC 15938-12:200X AMD 2 Semantic No 09/04/24 10589 Enhancement 21000-2 Digital Item Declaration 10590 Request for ISO/IEC 21000-2 AMD 1 Presentation of Digital Item No 09/04/24 10591 Text of ISO/IEC 21000-2 PDAM 1 Presentation of Digital Item No 09/04/24 21000-4 IPMP Component Request for ISO/IEC 21000-4 AMD 2 Protection of Presentation No 09/04/24 10592 Element Text of ISO/IEC 21000-4 PDAM 2 Protection of Presentation No 09/04/24 10593 Element 23000-4 Musical Slide Show Application Format 10594 Text of ISO/IEC 23000-4 MSSAF/FDAM2 Conf. & Ref. SW for No 09/04/24 Protected MSSAF 23000-5 Media Streaming Application Format 10595 Text of ISO/IEC CD 23000-4 MSAF 2nd edition No 09/05/08 23000-6 Professional Archival Application Format 10596 Study of ISO/IEC 23000-6 PA-AF/PDAM1 Conf. and Ref. SW No 09/05/15 Workplan for ISO/IEC 23000-6 PA-AF Conformance and No 09/04/24 10597 Reference Software 23000-9 Digital Multimedia Broadcasting Application Format Study of ISO/IEC 23000-9:2008/FPDAM1 DMB AF Conf. And No 09/05/29 10598 Ref. Soft. Workplan for ISO/IEC 23000-9:2008/FPDAM1 DMB AF Conf. No 09/04/24 10599 And Ref. Soft. 10612 Study of ISO/IEC 23000-9:2008/PDAM2 DMB AF Harmonization No 09/04/24 of MPEG-2 TS storage 23000-11 Stereoscopic Video Application Format Request for ISO/IEC 23000-11 AMD 1 Stereoscopic Video AF Ref. 10628 No 09/04/24 Soft and Conf. Text of ISO/IEC 23000-11 PDAM 1 Stereoscopic Vide AF Ref. Soft No 09/04/24 10613 and Conf. Workplan for Stereoscopic Video Application Format Ref. Soft No 09/04/24 10614 and Conf. 23000-12 Interactive Music AF 10615 Study of ISO/IEC CD 23000-12 Interactive Music AF No 09/05/29 23005 – MPEG-V Representation of Context and Control Information 10616 WD 2.0 of Architecture Yes 09/05/08 10617 WD 2.0 of Control Information Yes 09/05/08 10618 WD 2.0 of Sensory Information Yes 09/05/08 10619 WD 2.0 of Avatar Information Yes 09/05/08 10672 WD 1.0 of Reference Software No 09/04/24 10673 WD 1.0 of Conformance No 09/04/24 23006 – MPEG eXtensible Middleware 65
  • 66. First ideas on normative APIs compliant to MXM framework for No 09/04/24 10623 future MPEG standards 10624 MXM Developer’s Day : Call for Participation Yes 09/04/24 23006 -1 MXM Architecture and Technologies Study of ISO/IEC CD 23006-1 MxM Architecture and Yes 09/05/08 10620 Technologies 23006 -2 MXM Application Programming Interface 10621 Study of ISO/IEC CD 23006-2 MXM APIs Yes 09/05/08 23006 -3 MXM Reference Software and Conformance 10622 Study of ISO/IEC CD 23006-3 MXM Conf. & Ref. SW Yes 09/05/08 10683 MXM Development Roadmap for Engines and Applications No 09/04/24 Supplemental Media Technologies – MPEG eXtensible Middleware 10625 Study of ISO/IEC CD 29116-1 2nd edition MXM Protocols Yes 09/05/08 23007– MPEG-U (MPEG Rich Media UI Framework) 10626 WD MPEG Rich Media UI Framework Yes 09/04/24 Proposal for support of MPEG Rich Media UI in WC3 Widget Yes 09/04/24 10690 Recommendation 10670 MPEG comments on WC3 Widget Recommendation Yes 09/04/24 Assets and Standing Documents 10605 MPEG Schema Assets Updates Yes 09/04/24 10609 MPEG URIs and MIME Types Yes 09/04/24 SVN support 10630 Guide to the MPEG Subversion Repository No 09/04/24 Liaison 10631 Liaison statement to JTC 1/SGSN No 09/04/24 Liaison statement to ITU-T SG 16 on rights information No 09/04/24 10632 interoperability Liaison statement to IEC TC 100 on rights information 10691 interoperability Liaison statement to IEC TC 100 on Multimedia Gateway in No 09/04/24 10633 Home Networks 10635 Liaison statement to IEC TC 9 No 09/04/24 10636 Liaison statement to SGDCMP on DRM technologies in MPEG No 09/04/24 Liaison statement to IEC TC 100 on Multimedia home server No 09/04/24 10637 systems - Conceptual model for domain management Liaison statement to JTC 1/SC 34/WG 2 on Open Font Format No 09/04/24 10638 reference software Liaison statement to IEC TC 100 on Transmission of time code in No 09/04/24 10639 the ancillary data space 10640 Liaison statement to ITU-T SG 16 on Advanced IPTV Terminal No 09/04/24 Liaison statement to JTC 1/SC 34/WG 2 on media types of No 09/04/24 10641 ISO/IEC 14496-22 10642 Liaison statement to W3 C on MPEG Rich Media UI Framework No 09/04/24 10685 Liaison statement to UPnP on MPEG Rich Media UI No 09/04/24 10686 Liaison statement to DLNA on MPEG Rich Media UI No 09/04/24 Liaison statement to JTC 1 SWG-ARM on Professional Archival No 09/04/24 10643 AF 10644 Liaison statement to EBU on MPEG URI Assets No 09/04/24 10645 Liaison statement to W3C on MXM No 09/04/24 66
  • 67. 10646 Liaison statement to ATSC on Carriage of SVC over MPEG-2 TS No 09/04/24 Liaison statement to SC6 on extended Call for Proposal on MPEG- No 09/04/24 10647 V Liaison statement to SC25 on extended Call for Proposal on No 09/04/24 10648 MPEG-V Liaison statement to IEEE TC on Haptics on extended Call for No 09/04/24 10634 Proposal on MPEG-V 10687 Template Liaison statement on MPEG Media Transport workshop No 09/04/24 10688 Template Liaison statement on MXM Developer’s Day No 09/04/24 Promotion 10629 MPEG DRM Vision Yes 09/04/24 10684 MPEG Technologies for DRM Yes 09/05/08 67
  • 68. 2 General issues 2.1 List of standards under development P Edit Projec Description CfP WD CD FCD FDIS t . t 2 1 200 AMD Transport of MVC 08/1 09/0 09/07 7 4 0 2 2 1 200 CORX Miscellaneous 09/0 7 2 4 1 200 AMD -RA 09/0 x 4 -Use of LASeR in MPEG-2 & 7 MPEG-4 Systems 4 4 200 AMD File Format Conf. 08/0 08/1 09/0 09/07 4 37 4 0 2 4 5 200 AMD AVC File Format Ref. Soft TBS 1 xx 4 5 200 AMD SVC File Format Ref. Soft TBS 1 xx 4 5 200 AMD Synth. Texture Ref. Soft 08/0 09/0 09/10 1 23 4 4 4 1 200 AMD Digital Radio BIFS Profile 09/0 09/1 10/0 10/10 1 5 7 2 0 4 4 1 200 AMD General Improvements 08/0 08/1 09/04 2 8 1 4 0 4 1 200 COR2 Brands & box orders 08/1 09/02 2 8 0 4 1 200 COR3 Minor corrections to IOS FF 09/0 09/07 2 8 2 4 1 200 AMD Handling of MPEG-4 audio 09/0 09/0 10/01 4 3 1 enhancement layers 2 7 4 1 200 COR3 Minor corrections to AVC FF 08/0 09/02 5 8 7 4 1 200 AMD MVC File Format 08/0 08/1 09/0 09/07 5 x 3 4 0 2 4 2 200 AMD Scene Adaptation 08/0 09/0 09/07 0 X 2 7 2 4 2 200 AMD PASI 08/0 08/1 09/0 09/10 0 X 3 7 0 4 4 2 200 2nd Ed. Open Font Format 08/0 08/0 09/02 2 8 1 7 7 1 200 COR1 MPQF minor corrections 08/0 08/0 09/02 2 8 . 1 7 2 2 200 AMD PASI support 08/1 09/0 1 x X. 0 4 2 1 200 1st Ed. Media Value Chain Ontology 08/0 08/1 09/0 09/10 1 9 x 7 0 4 A 4 200 AMD Prot. MSSAF Conf. & Soft 08/0 08/1 09/04 68
  • 69. x 2 4 0 A 5 200 2nd Ed. MS AF 08/0 09/0 09/0 09/10 x 1 2 4 A 6 200 AMD PA-AF Conf. & Ref. SW 08/0 09/0 09/07 x 1 7 2 A 8 200 AMD PVP AF Soft. And Conf. TBS x 1 A 9 200 AMD DMB AF Soft. And Conf. 09/0 09/07 x 1 2 A 9 200 AMD DMB AF MPEG-2 Storage 09/0 09/0 10/01 x 2 2 7 A 1 200 AMD VS Conf. & Ref. SW 08/0 09/0 09/07 0 x 1 7 2 A 1 200 1st Ed. SVAF Ref. Soft. And Conf. 09/0 1 x 2 A 1 200 COR1 SVAF signaling of voice codecs 09/0 09/07 1 x 2 A 1 200 1st Ed. Interactive Music AF 09/0 09/0 10/01 2 x 2 7 B 2 200 AMD FRU Ref. Soft. And Conf. x 1 E 8 200 1st Ed. Ref. Soft. and Conformance 07/0 07/0 08/0 08/10 x 1 7 4 V 1 200 200x Architecture 09/0 09/0 09/1 10/04 x 2 7 0 V 2 200 200x Control Information 09/0 09/0 09/1 10/04 x 2 7 0 V 3 200 200x Sensory Information 09/0 09/0 09/1 10/04 x 2 7 0 V 4 200 200x Avatar Characteristics 09/0 09/0 09/1 10/04 x 2 7 0 M 1 200 1st ed. MxM Architecture 08/0 09/0 09/1 10/04 x 7 2 0 M 2 200 200x MxM APIs 08/0 09/0 09/1 10/04 x 7 2 0 M 3 200 200x MxM Conf. & Ref. SW 08/0 09/0 09/1 10/04 x 7 2 0 ? 1 200 2nd Ed. MxM Protocols 09/0 09/1 10/04 x 2 0 U 1 200 200x. Package, Delivery and 08/1 09/0 09/0 09/1 10/04 x Presentation of Widget 0 4 7 0 U 2 200 200x Widget Communication 08/1 09/0 09/0 09/1 10/04 x 0 4 7 0 U 3 200 200x Conf. & Ref. SW 08/1 09/0 09/0 09/1 10/04 x 0 4 7 0 69
  • 70. 2.2 Standing Documents Pr Pt Documents No. Meeting 1 1 MPEG-1 White Paper – Multiplex Format N7675 05/07 Nice 1 1 MPEG-1 White Paper – Terminal Architecture N7676 05/07 Nice 1 1 MPEG-1 White Paper – Multiplexing and N7677 05/07 Nice Synchronization 2 1 MPEG-2 White Paper – Multiplex Format N7678 05/07 Nice 2 1 MPEG-2 White Paper – Terminal Architecture N7679 05/07 Nice 2 1 MPEG-2 White Paper – Multiplexing and N7680 05/07 Nice Synchronization 2 11 MPEG-2 White Paper – MPEG-2 IPMP N7503 05/07 Poznan 4 1 MPEG-4 White Paper – MPEG-4 Systems N7504 05/07 Poznan 4 1 MPEG-4 White Paper – Terminal Architecture N7610 05/10 Nice 4 1 MPEG-4 White Paper – M4MuX N7921 06/01 Bangkok 4 1 MPEG-4 White Paper – OCI N8148 06/04 Montreux 4 6 MPEG-4 White Paper – DMIF N8149 06/04 Montreux 4 11 MPEG-4 White Paper – BIFS N7608 05/10 Nice 4 12 MPEG-4 White Paper – ISO File Format N8150 06/04 Montreux 4 14 MPEG-4 White Paper – MP4 File Format N7923 06/01 Bangkok 4 15 MPEG-4 White Paper – AVC FF N7924 06/01 Bangkok 4 13 White Paper on MPEG-4 IPMP N7505 05/07 Poznan 4 13 MPEG IPMP Extensions Overview N6338 04/03 München 4 17 White Paper on Streaming Text N7515 05/07 Poznan 4 18 White Paper on Font Compression and Streaming N7508 05/07 Poznan 4 20 Presentation Material on LASER N6969 05/01 Hong- Kong 4 20 White Paper on LASeR N7507 05/07 Poznan 4 22 White Paper on Open Font Format N7519 05/07 Poznan 7 1 MPEG-7 White Paper - MPEG-7 Systems N7509 05/07 Poznan 7 1 MPEG-7 White Paper – Terminal Architecture N8151 06/04 Montreux 21 9 MPEG-21 White Paper – MPEG-21 File Format N7925 06/01 Bangkok A X MPEG Application Format Overview N9421 07/10 Shenzhen A X MAF Overview Document N9840 08/04 Archamps A X MAF Overview Presentation N9841 08/04 Archamps B X MPEG-B White Paper – BinXML N7922 06/01 Bangkok E X MPEG Multimedia Middleware Context and N6335 04/03 München Objectives E X 1rst M3W White paper N7510 05/07 Poznan E X 2nd M3W White Paper : Architecture N8152 06/04 Montreux 70
  • 71. E X Tutorial on M3W N8153 06/04 Monreux E X M3W White Paper : Multimedia Middleware N8687 06/10 Hanzhou Architecture E X M3W White Paper : Multimedia API N8688 06/10 Hanzhou E X M3W White Paper : Component Model N8689 06/10 Hanzhou E X M3W White Paper : Resource and Quality N8690 06/10 Hanzhou Management E X M3W White Paper : Component Download N8691 06/10 Hanzhou E X M3W White Paper : Fault Management N8692 06/10 Hanzhou E X M3W White Paper : System Integrity N8693 06/10 Hanzhou Management 71
  • 72. 2.3 Mailing Lists Reminder Kindly Topic Information Hosted by General Reflector : gen-sys@lists.uni-klu.ac.at Klagenfur Systems Subscribe: http://lists.uni-klu.ac.at/mailman/listinfo/gen-sys t List Archive: http://lists.uni-klu.ac.at/mailman/private/gen-sys/ University Reflector : mp4-sys@lists.uni-klu.ac.at Klagenfur File Subscribe: http://lists.uni-klu.ac.at/mailman/listinfo/mp4-sys t Format Archive: http://lists.uni-klu.ac.at/mailman/private/mp4-sys/ University Reflector : mpeg-laser@lists.uni-klu.ac.at Klagenfur Subscribe: http://lists.uni-klu.ac.at/mailman/listinfo/mpeg- LASeR t laser University Archive: http://lists.uni-klu.ac.at/pipermail/mpeg-laser/ Reflector : maf-sys@lists.uni-klu.ac.at Klagenfur MAF Subscribe: http://lists.uni-klu.ac.at/mailman/listinfo/maf-sys t Archive: http://lists.uni-klu.ac.at/mailman/private/maf-sys/ University Reflector: isoff-transport@lists.uni-klu.ac.at ISO File Subscribe: http://lists.uni-klu.ac.at/mailman/listinfo/isoff- Klagenfur Format transport t Transpo Archive: http://lists.uni-klu.ac.at/mailman/private/isoff- University rt transport/ Reflector: jiptv@lists.uni-klu.ac.at Klagenfur AIT Subscribe: http://lists.uni-klu.ac.at/mailman/listinfo/jiptv t Archive: http://lists.uni-klu.ac.at/mailman/private/jiptv/ University Reflector: metaverse@lists.uni-klu.ac.at Klagenfur Metaver Subscribe: http://lists.uni- t se klu.ac.at/mailman/listinfo/metaverse University Archive: http://lists.uni-klu.ac.at/mailman/private/metaverse/ Reflector: mxm@lists.uni-klu.ac.at Klagenfur MXM Subscribe: http://lists.uni-klu.ac.at/mailman/listinfo/mxm t Archive: http://lists.uni-klu.ac.at/mailman/listinfo/mxm University 2.4 Demonstrations 72
  • 73. 3 General Input Documents 3.1 General Technical Issues 3.1.1 AHG reports Session Numbe Title Source r General m16247 Ad Hoc Group on Scene Representation Young-Kwon Lim, Jaeyeon Song, Cyril Concolato General m16248 Ad Hoc Group on MPEG File Formats David Singer General m16249 Ad Hoc Group on Application Format Kyuheon Kim, Hui Yong Kim, Noboru Harada General m16250 Ad Hoc Group on MPEG-V (including previous Jean Gelissen, RoSE activities) Sanghyun Joo, Christian Timmerer General m16251 Ad Hoc Group on Font Format Representation Vladimir Levantovsky General m16252 Ad Hoc Group on Advanced IPTV Terminal Xin Wang, Young Kwon Lim General m16253 Ad Hoc Group on MXM Filippo Chiariglione, Christian Timmerer, Victor Rodriguez, Marius Preda All AHG reports are accepted. 3.1.2 Contributions Session Numbe Title Source r General m16272 Table of Replies on ISO/IEC FDIS 23004-8 ITTF via SC 29 Secretariat General m16271 Table of Replies on ISO/IEC ITTF via SC 29 23000-7:2008/FDAM 1 Secretariat General m16267 Table of Replies on ISO/IEC ITTF via SC 29 23000-3:2007/FDAM 1 Secretariat General m16274 Table of Replies on ISO/IEC ITTF via SC 29 23000-4:200X/FDAM 1 Secretariat General m16275 Table of Replies on ISO/IEC FDIS 23000-6 ITTF via SC 29 Secretariat General m16277 Table of Replies on ISO/IEC FDIS 23000-10 ITTF via SC 29 Secretariat General m16270 Table of Replies on ISO/IEC ITTF via SC 29 73
  • 74. 21000-8:2008/FDAM 1 Secretariat General m16296 On Usage of the MPEG URI Assets Jean-Pierre Evain Christian Timmerer General m16306 The MPEG DRM vision Leonardo Chiariglione m16272, m16271, m16267, m16274, m16275, m16277, m16270 Ballot results are reviewed. All standards are approved. m16296 EBU metadata specification maintenance page have recently been updated with the audio and visual profiles as defined in our URI assets. EBU would like to receive notifications concerning updates of it. Informing EBU classification schemes is extending the list of “Genre” and “Role” originally defined in MPEG-7 m16306 This document contains short introduction about IPMP as an enabler of DRM in MPEG and the list of relevant technologies. It is agreed to produce an output document describing vision based on this input contribution and another document containing detailed descriptions about each technologies separately. 3.1.3 Liaisons Session Numbe Title Source r General m16255 Liaison Statement from JTC 1/SGSN [SC 29 N JTC 1/SGSN via 10126] SC 29 Secretariat General m16282 Liaison Statement from ITU-T SG 16 to IEC TC ITU-T SG 16 via 100 SC 29 Secretariat General m16287 IEC CDV 62514 [SC 29N 10185] IEC TC 100 via SC 29 Secretariat General m16293 Termination of Liaison between ISO TC 46 and SC 29 Secretariat SC 29 General m16294 Request for Internal Liaison between SC 29 and SC 29 Secretariat IEC TC 9 General m16298 Information on JTC1 Study Group on Digital SC29 Secretariat Content Management and Protection General m16303 CD of IEC TS 62579 IEC TC 100 via SC 29 Secretariat General m16304 Liaison Statement from JTC 1/SC 34/WG 2 [SC SC 34 via SC 29 29 N 10235] Secretariat General m16341 IEC NP: Transmission of time code in the IEC TC 100 via ancillary data space SC 29 Secretariat General m16488 Liaison Statement from TTA TTA via SC 29 Secretariat General m16489 Liaison Statement from SC 34/WG 2 SC 34 via SC 29 Secretariat 3.2 FAQ The FAQ were updated as needed. 3.3 AOB None. 74
  • 75. 4 MPEG-2 Systems (13818-1) 4.1 Topics 4.1.1 ISO/IEC 13818-1:2007 AMD4 Transport of MVC 4.1.2 ISO/IEC 13818-1:2007 COR X Minor Corrections 4.2 Contributions Session Numbe Title Source r MPEG-2 m16366 Proposal to detect dependent view boundary in Teruhiko Suzuki MVC • The AVC base layer stream for SVC and MVC should be defined separately instead of a single definition (AVC video sub-bitstream that uses ‘either or’) to avoid confusion in the STD sections. • We also need to clarify the difference between MVC base view only stream from a combined stream (MVC base + 1 view - called MVC base view video sub-bitstream) and how to signal this to an MVC decoder. • Even though AVC precludes use of stream_type = 0x1F (SVC enhancement) and stream_type = 0x20 (MVC view enhancement) to enhance the same base layer stream (as the NAL unit type 14 differs between SVC and MVC) within a program (PMT or PSM), system should allow applications to use base layer specific to SVC and base layer specific to MVC within same program. • We should add text to MVC extension descriptor saying that if this is absent for stream_type = 0x1B, then this is an MVC base layer stream with no additional views. • Rx is not defined for enhancement layers in STD for MVC. This needs to be the re- assembled level based value if HRD is present or level based value from Annex A if HRD is absent. • Extending the hierarchy descriptor has made it very complex as it is used for MPEG-2, SVC and MVC. In addition, it may be difficult to check backward compatibility for all cases. The suggestion is to look at using a new hierarchy descriptor for MVC and combine the MVC extension descriptor with this new descriptor. • Re-name DRD NAL Unit to VDRD (View or Dependency Representation Delimiter) and add it for use with MVC enhancements. • Suggestion to video group to delete use of prefix NAL unit for base layer of MVC as this allows applications to add additional views to a base layer that was deployed earlier without the prefix NUT 4.3 Action Points 75
  • 76. 5 MPEG-4 System (14496-1) 5.1 Topics 5.1.1 ISO/IEC 14496-1:200X AMD 4 RA and Usage of LASeR in MPEG-4 Systems 5.1.2 ISO/IEC 14496-1:200X 4th edition 5.2 Contributions Session Numbe Title Source r General m16415 Editor's Text of 14496-1 4th edition Cyril Concolato m16415 Proposed text for new edition of ISO/IEC 14496-1. Three amendments (Profile and Level indication for Text, Profile and Level indication for 3D Compression, objectTypeIndication for JPEG200 support) and two corrigenda It is agreed to remove redundant definitions and abbreviations regarding file format. It is needed to include short description on text stream, and etc. Seo-Young Hwang is appointed as new reviewer 5.3 Action Points 76
  • 77. 6 MPEG-4 Conformance (14496-4) 6.1 Topics 6.1.1 ISO/IEC 14496-4:2007 AMD37 File Format Conformance 6.2 Contributions None 6.3 Action Points 7 MPEG-4 Reference Software (14496-5) 7.1 Topics 7.1.1 ISO/IEC 14496-5:2007 AMD 23 Sythesized Texture Reference Software 7.2 Contributions None 7.3 Action Points 8 MPEG-4 BIFS (14496-11) 8.1 Topics 8.1.1 ISO/IEC 14496-11:2002 AMD X Digital Radio Profile 8.2 Contributions Session Numbe Title Source r General m16465 BiFS-based solution and its deployment within Bojan JOVESKI the FP7 MobiThin project: event handling and Mihai MITREA streaming Pieter SIMOENS Iain-James MARSHALL Françoise PRETEUX 77
  • 78. m16465 Not presented. 8.3 Action Points 9 MPEG-4 ISO Base File Format (14496-12) 9.1 14496-12/COR 2 Usage of brands and box order in sample entry 9.1.1 ISO/IEC 14496-12:2008 COR 2 Usage of brands and box order in sample entry 9.1.2 ISO/IEC 14496-12:2008 AMD 1 General improvements 9.1.3 ISO/IEC 14496-12:2008 COR 3 Minor Corrections 9.2 Contributions Session Numbe Title Source r File m16263 Summary of Voting on ISO/IEC 14496-12:2008/ SC 29 Secretariat Format FPDAM 1 File m16359 Minor or editorial errors in the Part 12 David Singer Format amendment File m16367 Clarification of track header in ISO media file Teruhiko Suzuki Format format File m16392 Adaptive Progressive Download Per Fröjdh Format Torbjörn Einarsson Clinton Priddle File m16393 File format sub-track selection and switching Per Fröjdh Format Andrey Norkin Clinton Priddle 9.2.1 m16263 Summary of Voting on ISO/IEC 14496-12:2008/FPDAM 1 Thank you to the NBs for these detailed, helpful, comments. We also reviewed the editor’s comments, notes, and other arcana in the document. 9.2.2 m16367 Clarification of track header in ISO media file format Thank you, but we hope that this was covered in DCOR3, which is out for ballot. Comments on DCOR3 to improve its clarity would, of course, be welcome. 9.2.3 m16359 Minor or editorial errors in the Part 12 amendment Thank you, the editors will deal with these. 9.2.4 m16392 Adaptive Progressive Download Thank you. This seems to relate to Modern Media Transport. There are some concerns here: for example, this presumes an intelligent HTTP server (really, an adaptive media server that happens to use HTTP for transport, rather than a general HTTP server). This proposal isn’t oriented towards the client choosing which parts it wants, and doing byte-range requests for the areas of the file it wants (as covered in academic papers, such as http://www.zju.edu.cn/jzus/2006/A06S1/A06S118.pdf). When doing byte-range requests, there is of course the (minor?) issue that the byte-range read by the client issues for the moov 78
  • 79. and each moof box has to be estimated. Also, under this proposal the bytes received could be written as a file and constitute a valid MP4 file, whereas byte-range scatter-gather results in an incomplete (unrecordable) file, or at least a file that would need padding bytes to keep everything in the same place. Do we need to add functionality to the ISO file format for HTTP-streaming, or is it time for a stream format that is ISO file friendly (which we’ll discuss tomorrow)? 3GPP SA4 is working in this area as well; we should make sure we communicate appropriately. On this and the following contribution, some delegates asked for time to study both the use cases and the proposal, and the proponent graciously agreed to re-present these in the next meeting. 9.2.5 m16393 File format sub-track selection and switching This is an interesting and detailed proposal, thank you. We wonder about using multiple tracks and (for example) extractors, but the response is that a given SVC track cannot easily stop you from switching to the base layer. The proposal straddles media-specific and file- format general, in that what constitutes the sub-track needs media-specific definition. Should this be covered in e.g. the tier definitions? We wonder how often this arises in practice, and the use cases. Some asked whether SVC layer switching should be also used for program content selection switching; aren’t program selection and layer selection more properly orthogonal? Some felt that this was OK if it brought coding efficiency. On this and the preceding contribution, some delegates asked for time to study both the use cases and the proposal, and the proponent graciously agreed to re-present these in the next meeting. 9.3 Action Points 10 MPEG-4 File Format (14496-14) 10.1 Topics 10.1.1 ISO/IEC 14496-14:2003 AMD 1 Handling of MPEG-4 Audio enhancement layers 10.2 Contributions 10.3 Action Points 11 MPEG-4 AVC File Format (14496-15) 11.1 Topics 11.1.1 ISO/IEC 14496-15:2004/FPDAM 3 MVC File Format 79
  • 80. 11.2 Contributions Session Numbe Title Source r File m16361 Extractors in the MVC file format Anthony Vetro Format David Singer File m16426 On MVC File Format Miska M. Format Hannuksela File m16444 Comments to the MVC file format draft Ye-Kui Wang Format Miska Hannuksela File m16445 A proposal to MVC file format Ye-Kui Wang Format 11.2.1 m16361 Extractors in the MVC file format We will try this in the study. We need to document the relationship between operating point and mvc2 tracks, and also if the mvc2 tracks are dense (in the sense that all views are decoded). We need to have three sample entry types to satisfy different usage models: • mvc1 - pure mvc data, maybe using aggregators • mvc2 - mvc and extractors and aggregators • mvc3 –only: extractors and aggregators, i.e. no VCL NAL units The editors should try making a single common definition for avc2. We do indeed need an informative section on these ‘usage models’ that will attempt to relay our hard-won understanding to future readers. That text should cover something like: “The support for MVC includes a number of tools, and there are various ‘models’ of how they might be used. In particular, an MVC stream can be placed in tracks in a number of ways, among which are the following: 1. all the views in one track, labeled with sample groups; 2. each view in its own track, labeled in the sample entries; 3. a hybrid, one track with the whole set, and other one-view tracks for some or all of the independent views; 4. the expected operating points each in a track (e.g. the AVC base, a stereo pair, a multiview scene).” 11.2.2 m16426 On MVC File Format Thank you. We agree with this but note that there is no 7.3.4, but the box should be in section 8. Also note that method_count == 1 means the old sample to group box should be used. Into the study. 11.2.3 m16444 Comments to the MVC file format draft Thank you for the very careful detailed read and comments. We’re not sure we need to put in restrictions on the use of parameter set tracks (they are linked from the video tracks that need them, after all). We agree, the ‘text to be deleted’ should move ( at least partly) to F.1, along with the new information proposed above. The ‘scal’ track reference would be better as a track group, but it’s also better the same as SVC which we can’t change to use track groups. We should use this as the basis for the study text. 11.2.4 m16445 A proposal to MVC file format This allows the identification of a converted view as the needed base view; this means that that view is stored in the file twice (once as a non-base-view and once as a base view). If the use case is purely for servers, we could use hint tracks with ‘fat’ hint samples – but it is not. 80
  • 81. We could use a combination of data copy-and-rewrite and extractors (or copies) to do some of this. Hm, we might not have dealt with the case that a set of tracks contain the same view coded as base and nonbase, or that that set of tracks contains several apparently base views. Nor do the view declarations in a track indicate whether a view is coded as a base. We need to label virtual base views, and make sure that either extractors point at them, or this box (or something like it), and that they are not used other than in the track they are in, or tracks that explicitly get them by extraction or by this reference. Then we can include this as well. Editors to find a way to label “in this track this is view N transcoded as a base view” in the sample entry… 11.3 Action Points 12 LASeR & SAF (14496-20) 12.1 Topics 12.1.1 ISO/IEC 14496-20:2008 AMD 2 Adaptation 12.1.2 ISO/IEC 14496-20:2008 AMD 3 PSI 12.2 Contributions Session Numbe Title Source r Scene m16283 Editor's review of 14496-20 FPDAM2 Jean Le Feuvre Scene m16351 study text on LASeR PDAM3 Seo-Young Hwang Scene m16408 Responses to LASeR PDAM3 Editor’s Note Jihun Cha Injae Lee Young-kwon Lim Han-Kyu Lee Jinwoo Hong Scene m16410 KNB Comment on 14496-20 PDAM3 KNB Scene m16350 user interaction method on 14496-20 Seo-Young Hwang Kyungmo Park Jaeyeon Song Young-Kwon Lim M16283: Discussion on the SDL syntax: some feedback from Expway received. It should be BiM Compatible but there is no guarantee. The BiM experts are not interested in thoroughly checking the BiM encoding. Editor's notes: 'on specific conditions' is not defined. Proposal to change it to "up to the implementation". Accepted. minSize on grouping elements. Accepted. Mistakes in LASeR ML. Corrected version uploaded. We need to produce a study and have a resolution for NB to consider the study as ballot text. 81
  • 82. M16351: This contribution is not a study. Proposal of a new 'entry' attribute on the externalReference element of PSI. Notion of "entrance node" to factorize multiple accesses to the same subtree. Semantics need to be clarified to describe the behavior of nested externalReference elements and default behavior if not present. Need to restrict the value of the attribute to point to element. Question whether the entry attribute should be on the 'externalReference' element or on the 'g' element? The same question applies to the update attribute also. Attribute accepted. Discussion on the externalReference element: choices are keep it or spread its attribute on containers. If we keep the element, its content is not rendered by a regular SVG player. But it's not a problem, one can always use defs and use elements. Plus, in terms of processing it keeps the processing of all containers as is. And it keeps the LASeR and SVG specs separate. So, we resolve to keep the LASeR externalReference element and add the 'entry' attribute. M16408: Answers to the editor's note + new proposals. Editor's Notes: - The name PSI creates confusion with MPEG-2 PSI Proposal to change the activity, the name of the amendment to "Presentation and Alteration of Structured Information". Comments on the 'alteration' word. The name 'Modification' is preferred to 'Alteration'. Accepted for both the activity name and the scheme (mpeg-pmsi). - Catch internal events and not only external resources using PSI Generalization of the resourceUpdate event. Accepted. Comment on the difference between Structured Information and general signal (like phone call notification). We need to clarify if events like 'phone call notification' can be treated as Structured Information. If yes, the phone call notification structure should be clearly defined with a schema. The usage of PSI for events depends on the complexity of the information being carried in the event. The question is what is the threshold. We cannot remove the externalValueEvent unless we make a corrigendum. The externalValueEvent is more efficient for events carrying a single value while the proposal is able to carry complex events. The specification should have a note indicating the difference between the two types of events. The example in the presentation shows that the usage of the resourceUpdate event is not clear. Update of psi referenced text is automatic and can be changed using the update attribute. However, the event can be used to trigger script, navigation or animation, as usual. We have 2 options for the event: typed event or xmlUpdateEvent with string value. One participant prefers the XML event and the others have no objection. Resolve to use the xmlUpdateEvent. Discussion on the clarification of what happens when the PSI scheme points to a Node Set. Resolved to use the first node in the Node Set. - Applicable media types The problem is to define a fragment identifier scheme for all XML documents because the name of the scheme may be in conflict with the name of a scheme defined by the specification owning the media type of the XML document. However, this case is very unlikely. We will fix the problem if it arises. We could minimize this probability by calling the scheme mpeg- pmsi(). Accepted. 82
  • 83. Proposals: - LASeR importData element The problem is that text in tref cannot be edited and saved because tref is a 1.1 element and the editable attribute is a 1.2 attribute. Chances that the editable attribute is added to the tref element are high. We prefer that solution. The importData element is refused but the problem is solved. - LASeR Drag element Defines a new element to monitor new types of events (slide, rotations) and modifies the transform attribute of the parent. The element is very similar to the animateMotion element. We could put the proposal in a TuC for a new amd on Advanced Interactions. M16410: KNB comment. Accepted. M16350: Description of latest trends in user interaction: touch sensor, motion sensor, g-sensor, haptic, … Presents needs for new scene description tools to support these new interaction sensor. Proposal to start a new activity. The contribution highlights a potential relationship with MPEG-V Part 3 (RoSE) and with ISO TC159. We could liaise with TC159 to inform them about our wish to work in this area and to welcome their input/comments. Accepted. We create a TuC on Advanced User Interactions with the Drag element and the study of current trends. We welcome contributions on the requirements for this activity and on the technical elements. 12.3 Action Points 13 Open Font Format (14496-22) 13.1 Topics 13.1.1 ISO/IEC 14496-22:200X AMD 1 Full Unicode Character Repertoire Supports 13.2 Contributions . Session Numbe Title Source r General m16266 Table of Replies on ISO/IEC ITTF via SC 29 14496-5:2001/FDAM 14 Secretariat General m16428 Proposal for a new amendment of ISO/IEC Sairus Patel 14496-22 ?Open Font Format? Vladimir Levantovsky m16266 FDAM passed final ballot m16248 Proposal to overcome 64K limit. Accepted for PDAM. 83
  • 84. 13.3 Action Points 14 MPEG Query Format (15938-12) 14.1 Topics 14.1.1 ISO/IEC 15938-12:200X AMD 1 MPQF Conf. and Ref. SW. 14.2 Contributions Session Numbe Title Source r General m16461 Contribution of a Basic Interpreter Module to Ruben Tous ISO/IEC 15938-12/Amd.1 MPEG Query Format Jaime Delgado Ref. Soft & Conf. General m16486 MPEG Query Format Semantic Requirements Mario Doeller Florian Stegmaier Gero Bäse General m16487 Introducing Semantic Retrieval in MPQF Mario Döller Florian Stegmaier Gero Bäse m16461 Proposed software for MPEG Query Format Ref. Soft. This will be integrated into the Ref. Soft.. m16486 & m16487 The integration of semantic retrieval concepts into the current version of MPQF by using basic technologies in the fields of defining and retrieving semantic information based on RDF/OWL developed by W3C is proposed. In order to facilitate semantic retrieval in MPQF only minor adaptations of the existing standard are necessary. Additionally the SPARQL query type and expressions describing semantic relations are to be included: - adding a query type for SPARQL queries, - adding semantic expressions, - extending affected parts such as OutputDescription, QFDeclaration and - extending the Data Model. 14.3 Action Points 84
  • 85. 15 MPEG-21 DID (21000-2) 15.1 Topics 15.1.1 ISO/IEC 21000-2:200X AMD X PSI support 15.2 Contributions Session Numbe Title Source r General m16347 Proposal to change the title of ISO/IEC Filippo 21000-2:2005 AMD1 to ?Presentation of Digital Chiariglione Item? Tiejun Huang m16347 It is proposed to name the ISO/IEC 21000-2:2005 AMD1 as “Presentation of Digital Item”. Accepted. 15.3 Action Points 16 MPEG-21 IPMP Components (21000-4) 16.1 Topics 16.1.1 ISO/IEC 21000-4:200x AMD X Protection of Presentation element 16.2 Contributions Session Numbe Title Source r General m16346 Proposed text of ISO/IEC 21000-4:200x Filippo AMD1 ? Protection of Presentation element Chiariglione Tiejun Huang m16346 Proposed IPMP DIDL element <ipmpdidl:Presentation> for Presentation element. Accepted for PDAM. 16.3 Action Points 85
  • 86. 17 Media Value Chain Ontology (21000-19) 17.1 Topics 17.1.1 ISO/IEC 21000-19 Media Value Chain Ontology 17.2 Contributions Session Numbe Title Source r MVCO m16354 21000-19 FCD revision Marc Gauvin Jaime Delgado Victor Rodriguez Miran Choi MVCO m16355 Editors Notes on MVCO Review Marc Gauvin Jaime Delgado Victor Rodriguez Miran Choi m16354 & m16355 Not presented. 17.3 Action Points 18 Musical Slide Show AF (23000-4) 18.1 Topics 18.1.1 ISO/IEC 23000-4 AMD 2 Conf. and Ref. SW for MSSAF 18.2 Contributions Session Numbe Title Source r MAF m16262 Summary of Voting on ISO/IEC 23000-4:200X/ SC 29 Secretariat FPDAM 2 [SC 29 N 10158] m16262 No disapproval 18.3 Action Points 19 Media Streaming AF (23000-5) 19.1 Topics 19.1.1 ISO/IEC 23000-5 2nd edition 86
  • 87. 19.2 Contributions Session Numbe Title Source r MAF m16344 Some issues regarding the 2nd edition of MediaFilippo Streaming Application Format (MSAF) Chiariglione Tiejun Huang MAF m16345 Benefits from the use of Presentation of Digital Filippo Items and Event Reporting in MSAF Chiariglione Tiejun Huang MAF m16349 Proposed text of ISO/IEC 23000-5 2nd Edition Filippo CD Media Streaming Application Format Chiariglione Tiejun Huang M16344: Reviewed. Provides the summary of the changes for the 2nd Edition CD. M16345: Reviewed. Proposed to put as normative references LASeR (ISO/IEC 14496-20) and Event Reporting (ISO/IEC 21000-15). It is recommended  Edition of text of ISO/IEC 23000-5 2nd Edition CD Media Streaming Application Format with LASeR (ISO/IEC 14496-20) and Event Reporting (ISO/IEC 21000-15) as references M16349: The editorial changes have been reviewed. The text is going to be promoted. 19.3 Action Points 20 Professional Archival AF (23000-6) 20.1 Topics 20.1.1 ISO/IEC 23000-6 AMD1 PA-AF Conf. and Ref. SW 20.2 Contributions Session Numbe Title Source r MAF m16369 Proposed update to the PA-AF reference Noboru Harada software and description of the PA-AF APIs Houari Hendry Yutaka Kamamoto Takehiro Moriya Munchurl Kim M16369: Produce the study with normative changes It is recommends  update the PA-AF reference software and description 20.3 Action Points 87
  • 88. 21 DMB AF (23000-9) 21.1 Topics 21.1.1 ISO/IEC 23000-9 AMD1 DMB AF Conf. and Ref. SW 21.1.2 ISO/IEC 23000-9 AMD2 DMB AF Harmonization of MPEG-2 TS Storage 21.2 Contributions Session Numbe Title Source r MAF m16452 BWS Conformance file contribution and SW Hui Yong Kim update for ISO/IEC 23000-9/Amd.1 Yong Han Kim Munchrul Kim Houari Sabirin MAF m16454 Study on ISO/IEC 23000-9 PDAM2 (DMB-AF Hui Yong Kim Harmonization on MPEG-2 TS) Myung Seok Ki Yong Han Kim M16452: Reviewed and promoted for the approval M16454: Reviewed by FF group and promoted for the approval. It is recommended to produce Study on ISO/IEC 23000-9 PDAM2 (DMB-AF Harmonization on MPEG-2 TS) with editorial changes 21.3 Action Points 22 Video Surveillance AF (23000-10) 22.1 Topics 22.1.1 ISO/IEC 23000-10 AMD1 VS AF Conf. and Ref. SW 22.2 Contributions None. 22.3 Action Points 88
  • 89. 23 Stereoscopic Video AF (23000-11) 23.1 Topics 23.1.1 ISO/IEC 23000-11 AMD1 SV AF Conf. and Ref. SW 23.1.2 ISO/IEC 23000-11 COR1 SV AF Signaling of voice codecs 23.2 Contributions Session Numbe Title Source r MAF m16459 Updated Text of ISO/IEC 23000-11 Stereoscopic Next generation Video AF Conformance and Reference Software Broadcasting Forum(Korea) M16459: Reviewed and showed the demonstration of the current Ref. SW. It is recommended  To update Text of ISO/IEC 23000-11 Stereoscopic Video AF Conformance and Reference Software.  To update the change of the Workplan for the Ref. SW 23.3 Action Points 24 Interactive Music AF (23000-12) 24.1 Topics 24.1.1 ISO/IEC 23000-12 Interactive Music AF 24.2 Contributions Session Numbe Title Source r MAF m16386 Proposal of dynamic preset for IM AF Inseon Jang Jeongil Seo Hui Yong Kim Kyeongok Kang Kevin SeungChul Ham MAF m16387 Editor's study on ISO/IEC 23000-12 CD Inseon Jang Interactive music application format Hui Yong Kim Jeongil Seo Laurent Primaux 89
  • 90. Owen Lagadec MAF m16458 iKlax improvement Proposal on ISO/IEC Laurent Primaux 23000-12 CD IM AF Owen Lagadec Emmanuel Bouix M16386: Put the extra two preset functionalities such as dynamic volume preset and dynamic object preset, which provide the 3D audio effect. Accepted. M16387: Reviewed. Annex A and B are going to be merged into one Annex due to that both Annex A and B cover a mode usage in the IM AF, which shall be reflected during the editorial period of the output document. . Terms are changed from ‘constraint’ to ‘rule’, which shall be reflected to the output document during the editorial period. Rule checking will be revisited for clear usage in the next meeting. M16458: . Group box modification for controlling elements in a box is accepted such as group_activation_elements_number and group_reference_volume are added. group_activation_elements_number – is an integer that indicates the number of elements which must be switched on when the group is switched on. This number, according to the order of the elements in elements_ID, determines which elements will be switched on. group_reference_volume - is an integer that indicates the index corresponding to the reference volume gain of the group (this is the volume gain that must be set on the element when it is switched on). . Simplification of both selection and mixing constraint are accepted. It is recommends  To produce study on ISO/IEC 23000-12 CD Interactive music application format with the above changes 24.3 Action Points  Revisit the checking rule in the next meeting 25 MPEG-V Architecture (23005-1) 25.1 Topics 25.1.1 ISO/IEC 23005-1 MPEG-V Architecture 25.2 Contributions Session Numbe Title Source r MPEG-V m16382 Modified MPEG-V System Architecture SangHyun Joo JongHyun Jang m16382: — Proposes a new architecture (cf. Fig. 3 in the contribution) 90
  • 91. — Technical inputs from sensor network group/activity will be appreciated. Proponents are kindly asked to provide such inputs. — After intensive discussions it has been found by the group that the “blue ellipses” in the architecture needs to be updated. 25.3 Action Points 26 Control Information (23005-2) 26.1 Topics 26.1.1 ISO/IEC 23005-2 Control Information 26.2 Contributions Session Numbe Title Source r MPEG-V m16379 Basic description languaues for Sensory Device Sang-Kyun Kim Capabilities of MPEG-V Part2 Control Jin-Seo Kim Information Maeng-Sub Cho Bon-Ki Koo Yong Soo Joo MPEG-V m16380 Basic description languaues for Sensory Device Sang-Kyun Kim Commands of MPEG-V Part2 Control Jin-Seo Kim Information Maeng-Sub Cho Bon-Ki Koo Yong Soo Joo MPEG-V m16381 Basic description languaues for User Sensory Sang-Kyun Kim Preferences of MPEG-V Part2 Control Jin-Seo Kim Information Maeng-Sub Cho Bon-Ki Koo Yong Soo Joo MPEG-V m16360 Study on representation of characteristics for Shin-ya Hasegawa MPEG-V Sensory Devices Yasuaki Tokumo Takuya Iwanami MPEG-V m16368 Sensory Device Capability Metadata B.S. Choi SangHyun Joo MPEG-V m16385 User Sensory Preference Metadata B. S. Choi Sang Hyun Joo m16379, Proposed schema for device capabilities aligned with sensory effects. Schema is consisted of Base attribute and specific attributes for each effect types m16380, Proposed schema for sensory device commands aligned with each sensory effect. Schema is consisted of Base attribute and specific attributes for each effect types. 91
  • 92. m16381 Proposed schema for user sensory preferences aligned with each sensory effect. Schema is consisted of Base attribute and specific attributes for each effect types. m16360 Proposed schema for device capabilities Base attributes include minimum intensity, preparation time, and used position in addition to previous contributions. Proposed to include expected capability as a part of sensory effect metadata by using schema for device capability. question about how to signal “preambles” question about what is an appropriate schema of “preambles” m16368 question about position : we don’t know propagation matrix of device. so, position cannot give meaningful information to RoSE engine unless there is universal physical law can be applied to this. delayTime : the time difference between the time the device started and the time when the device reaches its maximum intensity  need to be harmonized with m16360 minIntensity : this does not needed for some device types. so, it will not be part of base attribute but specific attributes for some device types which need this. some attributes need to improve. try to keep consistency among different devices use “device capability type” instead of “device type” m16385 Similar to m16368 26.3 Action Points 27 Sensory Information (23005-3) 27.1 Topics 27.1.1 ISO/IEC 23005-3 Sensory Information 27.2 Contributions Session Numbe Title Source r MPEG-V m16300 Minor Corrections to SEDL and the Usage of Markus Waltl Schematron for SEDL Conformance Christian Timmerer MPEG-V m16301 An API for Sensory Effect Metadata compliant Markus Waltl to the MPEG Extensible Middleware (MXM) Christian Timmerer MPEG-V m16358 Study on MPEG-V Sensory Information Yasuaki Tokumo 92
  • 93. Shin-ya Hasegawa Takuya Iwanami Shuichi Watanabe MPEG-V m16377 The modified ColorCorrection sensory effect for Sang-Kyun Kim spatio-temporal moving regions Jin-Seo Kim Maeng-Sub Cho Bon-Ki Koo Yong Soo Joo MPEG-V m16378 Modifications of ColorCorrectionParameter Sang-Kyun Kim Type of MPEG-V Part3 Sensory Information Jin-Seo Kim Maeng-Sub Cho Bon-Ki Koo Yong Soo Joo MPEG-V m16440 Haptic Movie system and Service Scenario for Jeha Ryu MPEG-V Yeongmi Kim MPEG-V m16442 Representation of Tactile Movie Control Jeha Ryu Information for MPEG-V Yeongmi Kim MPEG-V m16336 MPEG-V WD Contributions Jean H.A. Gelissen m16300  Minor corrections  accepted  min occurrence of GroupOfEffect should be 2.  Add “ReferenceEffect” element to reference some effects already defined  Additional validation rules to verify schema validation  accepted  Schematron (ISO standard) to define computer readable description to check additional (semantic) validation rules for schema  WD for conformance m16301  MXM compliant APIs for Sensory Effect Metadata access and creation automatically generated from schema by JAXB  Proposed to define set of MXM compliant APIs as a normative part of reference software WD for reference software m16358  modified semantics of “activate” : if it is true then previous intensity shall be kept  rejected because this can be described as a sequence of intensity changes for single effect.  modified semantics of “fade-in” and “fade-out” : fade-in shall reach its non-zero intensity and fade-out shall reach zero  further study is need to agree on final semantics of “fade-in” and “fade-out”, could be included in WD as a study item  modified semantics of “autoExtraction” to represent “auto with hint” by using MPEG-7 localization scheme  accepted m16377, m16378: — Include a ReferenceRegion (similar to autoExtraction) where color correction shall be applied: okay but may share the same syntax as for autoExtraction but with different semantics — Intensity not defined but for this effect it is just 0 or 1, i.e., 0 means not applied / not activated and 1 means activated. Need to check how to implement that in the standard. — Minor corrections to ColorCorrectionParameterType: okay! m16440, m16442: 93
  • 94. — Addressing the sense of touch… okay, nice! — Needs to be aligned with current formatting/style of sensory information — Needs help in editing the working draft – willing to become a co-editor? Need to check where and how to include this in the current WD. m16336: Similar to m16440/m16442 and proponents are urged to propose it as a formal response to the Call for Proposals… 27.3 Action Points  Another call for proposal on missing parts such as haptic, tactile, emotions, and so on. 28 Avatar Information (23005-4) 28.1 Topics 28.1.1 ISO/IEC 23005-4 Avatar Information 28.2 Contributions Session Numbe Title Source r MPEG-V m16425 Avatar Characteristics Blagica Jovanova Marius Preda Françoise Preteux MPEG-V m16483 Avatar Definition Markup Language David Oyarzun Jean H.A. Gelissen (editor) m16425 & m16483 reviewed by 3DG. Accepted for WD. Agreed to have further harmonization. 28.3 Action Points 29 MXM (23006 & 29116-1) 29.1 Topics 29.1.1 ISO/IEC 23006-1 MXM Architecture 29.1.2 ISO/IEC 23006-2 API 29.1.3 ISO/IEC 23006-3 Conf. and Ref. SW 29.1.4 ISO/IEC 29116-1 2nd edition MXM Protocols 94
  • 95. 29.2 Contributions Session Numbe Title Source r MXM m16447 Proposal for using the existing tools for generic Wonsuk Lee metadata APIs of metadata engine on MXM Seungyun Lee APIs MXM m16348 Proposal for MXM engine and API of Filippo Presentation of Digital Item Chiariglione Tiejun Huang MXM m16308 Updated DIA APIs and Implementation for Christian MXM Timmerer Michael Eberhard MXM m16427 Integrated MXM API for 3D Graphics Ivica Arsov Marius Preda MXM m16455 A Proposal for Multimedia Application Interface Sung Jin Hur for Collaborative Work Wan Choi MXM m16457 Use Case of Multimedia Application Interface Sung Jin Hur Wan Choi m16477: — Has been reviewed during the AhG meeting on Sunday and is reflected in the AhG report. See recommendation 5 of the AhG report. — In particular, WG11 will add to the native MPEG-7 API a generic API for media description supporting the set of tags that is common across a number of metadata sets that is being identified by W3C Media Annotation Working Group. — WG11 should be able to implement a significant subset of the generic API by the end of 2009. — WG11 should send a liaison statement to W3C communicating our intention to base the generic API on the work that W3C is doing and have a first implementation by the end of 2009. m16348: — The input has been acknowledged by WG11 and WG11 is willing to include the proposed engines into the MXM standard. — However, the timeline proposed in 16344 lags MXM by one meeting. This means that the two proposed engines (i.e., engines for the Presentation of Digital Item (PDI) and Protection of Presentation element (PPE)) could not be part of the MXM standard. This is not an isolated case. Therefore, the three following possibilities can be considered: o Delay MXM FDIS by one meeting o Develop the two engines as reference software of the two proposed amendments o Add the two engines (and possibly other engines) to a new edition of MXM m16308: — Accepted and WG11 will provide a SVN account for Klagenfurt University m16427: — Proposes some changes to the media framework engine incorporating Graphics3D engine — Accepted and appreciated. 95
  • 96. Other related input documents: — m16301: What are the pros and cons regarding the policy of having MPEG reference software in the form of an MXM engine if applicable? o Pros:  Easy development of applications that exercise the reference software because the new engine can be easily integrated with the other existing engines.  Easy reuse of the engine by other developers of MPEG standards (or even by the industry) thanks to the existence of the interfaces.  This would follow a common trend in the standardization environment.  Facilitate the upgrade of service provisioning. o Cons:  Additional effort to specify and implement the API. o Notes:  Need to be clear about the normative value of the API.  By developing an API the designers have to pay more attention to the requirements of the technology. — m16313: o The example mapping between NextShare functionalities and MXM engines is very useful and should be adopted by AIT. o Shall the MXM standard only contain engines for MPEG technologies or shall it also contain engines for non-MPEG technologies (P2P delivery, access to payment system, social networks, …)? — m16455, m16457: Interesting contribution as they reflect what WG11 is already undertaking as part of the MXM project. We encourage to bring details on: o Identification of multimedia application; o Classification of multimedia application; o Multimedia application discovery; o Multimedia application instantiation; o Multimedia application access; o Multimedia application execution environment; o Multimedia application composition. — License: o Presented in Busan and became an output document + resolution asking NBs to respond o No input in Lausanne o License was submitted to Open Source Initiative (OSI). o Some open source extremists raised concerns. o We are unable to handle the concerns because MPEG experts have no time to dedicate to the matter. o The following two possibilities have been identified:  Adopt the Mozilla license (which is open source, and the starting point of the MXM license) for the MXM layer and reference external code.  Continue adopting the MPEG copyright disclaimer o In both cases, if the external code is from MPEG, the existing reference software maybe modified retaining the original MPEG copyright disclaimer. o In order to keep it simple, we propose to adopt the MPEG copyright disclaimer. — SVN account: o The MXM repository is now available. I have updated the Guide to the MPEG Subversion Repository to include the new repository and submitted it as input 96
  • 97. document m16483 for Maui. The most important part of the update is in Section 4.1. If you want to see all the differences, use svn. You can find the document here in the repository. I have also updated the Administrators Resources at http://wg11.sc29.org/svnadmin/index.xalter. o The URL of the repository is http://wg11.sc29.org/mxmsvn/repos. It can be browsed with a web-browser or checked-out to an SVN client. Users 'sc29wg11' and 'mxmpubro' have read-only access. MPEG-member accounts have read-write access to the main svn repository and read-only access to mxmsvn by default. Upon request member accounts can be upgraded to read- write access of mxmsvn. Non-MPEG-members have read-write access to mxmsvn and no access to svn or the MPEG committee web site. o The public read-only account is the aforementioned 'mxmpubro' whose password is 'mpegmxmro'. o Filippo's and Emiliano's acounts have been upgraded to have mxmsvn read- write access. 29.3 Action Points 30 MPEG Rich Media UI Framework (???) 30.1 Topics 30.1.1 Widgets 30.1.2 Communication 30.1.3 Conf. and Ref. SWTopics 30.2 Contributions Session Numbe Title Source r Scene m16412 Utilization of LASeR on Rich Media UI Jihun Cha Framework Injae Lee Young-kwon Lim Han-Kyu Lee Jinwoo Hong Scene m16352 Response to the call for technologies for MPEG Kyungmo Park RUIF Giovanni Gordara Cyril Concolato Jean Le Feuvre Jean-Claude Dufourd m16352 Proposal based on W3C widget. Accepted for working draft.  Overview  Based on ongoing W3C recommendation  Widely accepted widget format  Agnostic to scene representation format 97
  • 98.  Mandating to use “zip” for “packaging” format  Extensibility for MPEG media types  Extensibility for multiple transport  Extensibility for non-Web domains  Widget representation format  Manifest (configuration file)  metadata, localization (language), icon  one scene description and associated resources  an optional additional scene description and associated resources  description about communication capabilities  Widget packaging format  ISO Base Media File Format for media centric widgets  Supporting unpackaged delivery  Guidelines for streaming and broadcast environments  Widget Manager  Concept of entity managing widgets  Normative Behavior  Widget Packaging Formats  Widget Representation Format (manifest)  Widget Localization  Widget Life Cycle Handling  Widget Communication Handling  Widget Individual Rendering  Widget Life Cycle  Loading of widget  Parsing widget  Showing something except simplified or full version of scene representation  Independent Activation/Deactivation of full or simplified version  Independent Show/Hide of full or simplified version  Dynamic binding/unbinding of external communication entities  Widget Communications  external communication entity  identified by type  described by “interface”  interface  Demonstrations  GPAC based implementation  Widget representation based on BIFS with SVG icons  Pushing widget to different devices (uPnP & DLNA)  Communication between devices (different representation)  Questions?  What is the status of widget in W3C?  WD. Three CRs are targeting June. packaging and configuration, digital signature (informative in MPEG), and APIs and Events.  What is the relationship between W3C widget and MPEG UIF?  W3C widget is subset of MPEG UIF.  Do we need to mandate to use “zip”?  Yes, to be compliant to “W3C widget package format”  Can we have multiple icons?  No. But you can have multiple “localized” representation including icons.  Can we use different languages for simplified version?  Yes. But it would be better to use same language for synchronization and so on.  How do we find “entry point” for unpackaged format  In that case, manifest will be used as an entry point.  Is it mandatory to list all external communication required by the widget in the manifest?  It is not clear because it is under draft. We could make it mandatory in MPEG. m16412 Proposal to use LASeR for UI Framework. Accepted to incoporate 30.3 Action Points 98
  • 99. 31 Exploration 31.1 AIT 31.1.1 Topics 1. Advanced IPTV Terminal 31.1.2 Contributions Session Numbe Title Source r AIT m16313 Input on the Advanced IPTV Terminal (AIT) Christian Architecture Timmerer Mark Stuart Nicola Capovilla Fabrizio Rovati Jari Ahola Njål Borch Franc Kozamernik AIT m16364 Proposal of the template of draft Advanced IPTV Kangchan Lee Terminal(AIT) Requirements Seungyun Lee AIT m16365 Proposal of conceptual diagram for advanced Kangchan Lee IPTV Terminal Seungyun Lee AIT m16424 Proposed Scenario and Requirements for Truong Cong Advanced IPTV Terminal Thang Yongju Cho Jung Won Kang Jeong-Ju Yoo AIT m16350 LASeR in IPTV Seo-Young Hwang AIT m16288 Use Cases for Advanced IPTV Terminals Miran Choi Euisok Chung Myung-Gil Jang Yunkeun Lee m16288: Use Cases for Advanced IPTV Terminal IPTV Speech Interface for VOD and QA Services Advertisement, what you see, what you want Over the Language Barrier m16424: Proposed Scenario and Requirements for Advanced IPTV Terminal Adaptive service discovery and delivery in heterogonous environments m16364: Proposal of the template of draft Advanced IPTV Terminal (AIT) Requirements Outline of the Requirements document Need to link User Cases with Requirements m16365: Proposal of conceptual diagram for advanced IPTV Terminal Architectural context diagram for IPTV terminal m16313: Input on the Advanced IPTV Terminal (AIT) Architecture NextShare from P2P-next.org New architectural functionalities: p2p? m16327 : Realization of MANE (Media Aware Network Element) 99
  • 100. New transport layer format and functionality  Requirements Group 31.1.3 Action Points 31.2 MMT 31.2.1 Topics  Transport- and file format friendly stream format  Cross layer optimization between video and transport layer  Error resilience for MPEG streams  Conversion between transport mechanisms  Content adaptation to different networks 31.2.2 Contributions Session Numbe Title Source r MMT m16327 For realization of MANE Doug Young Suh Yongju Cho MMT m16353 Environments on MMT Jaeyeon song MMT m16392 Adaptive Progressive Download Per Fröjdh Torbjörn Einarsson Clinton Priddle MMT m16362 On Modern Media Transport (MMT) David Singer MMT m16307 On MPEG Modern Transport over Network Christian Timmerer Michael Eberhard Ingo Kofler Robert Kuschnig Michael Ransburg Michael Sablatschan Hermann Hellwagner m16307  File Format  P2P traffic is increasing but no SDO feeling responsible. (IETF is considering PPSP as an exploration activity)  De-facto standard such as BitTorrent does not support P2P (video) streaming.  MPEG-21 DID provides support for P2P systems e.g., fragment identifier can be used to refer parts of content which can be used to integrate one file at the receiver side.  Propose to start working towards a file format explicitly support P2P streaming and associated metadata  Cross-Layer Optimizations  Preferred approached to achieve cross-layer design is jointly optimizing parameters at each layers. 100
  • 101.  ENTHRONE cross-layer model describes the relationship between QoS metrics at different levels and Cross-Laer adaptation decision-taking engine solves optimization problem.  Propose to improve metadata to describe cross-layer model to close interoperability gaps  Context and Content aware Networks  context describes the environment and metadata describe content  mismatch between context and content may require adaptation  Not only media aware clients but also media aware network are becoming more and more important  Propose to work on generic interface between the coding layer and delivery layer m16327  AVC and SVC standards assumed media aware network element deciding discard or forwarding packets.  MANE has two roles such as identification of each packet for extraction and context aware adaptation m16353  Broadcasting and mobile convergence  supporting of generic mechanism to identify streams when hand-over between networks is happened  QoE  more metadata to support better QoE m16362  Use cases and environment  one-to-one over IP is predominant  “punch-in” is needed to for live stream  RTP-UDP and MPEG-2 TS over UDP both contain a “blast and hope” assumption while TCP aware congestion  Supporting content protection is necessary  Metadata is becoming increasingly important m16392  HTTP streaming with MP4 files requires new mechanism for live & adaptive service scenario The past and the future of multimedia transport  On the current multimedia transport : m16353, m16362, m16392  On the emerging transport : m16307, m16327 31.2.3 Action Points 32 Liaison Cf. Liaison output. 101
  • 102. 33 Resolutions of Systems Cf. WG11 resolution. 34 Action Plan N° What Who When Status Trace 1. 102
  • 103. Annex G – Video report Source: Jens Ohm and Gary Sullivan, Chairs 1 MPEG-4 Part 2 Video The video and requirements subgroups received a request for new levels 7 (matching 1080/30p), 8 (1080/60p) and 9 (1080/120p) for Simple Profile and levels 6 (720/60p) as well as 7-9 for Advanced Simple Profile. The NB of US also gave support for levels 7&8 in Simple, whereas the engagement for the remaining requested profiles was less evident. Video and Requirements requested for more evidence about the use cases, as well as more company support before any action could be taken in these matters. Two more issues were raised on 14496-2, which are – Divergence between software and text in vertical field MV conversion. Probably, most current implementations have followed the software definition on this (diverging from the text part in both Momusys and Microsoft software), which is also implemented in the current conformance streams. The recommendation is to change the text according to the software operation. – Clarification of scaling in quarter-pel MC where the operation is currently only expressed as textual description; it is recommended to add pseudo code similar to the style in other parts of the text. A defect report was issued on this to allow further study on the best solutions, and further improve the proposed text changes when a corrigendum is issued. Another defect report was issued on 14496-4 video conformance, where a report was made about illegal level definitions in three Simple Profile streams. In addition, it is planned to perform an action of re-structuring the video conformance (organize the sets of streams by profiles/levels instead of the number of amendment by which they were first defined). A document which formulates some first ideas about such a possible new structure was issued (N10537). Documents reviewed: m16284 MPEG4 Simple Profile, Levels 7, 8, 9 and MPEG4 Advanced Simple Madhukar Budagavi Profile, Levels 6, 7, 8, 9 Minhua Zhou m16285 Proposed text changes for ISO/IEC 14496-2 (MPEG-4 part 2) Minhua Zhou Madhukar Budagavi m16291 USNB Contribution: Request for new levels Andy Tescher for USNB Documents approved: No. Title TBP Available 10534 Defect Report on ISO/IEC 14496-2:2004 N 09/04/24 10536 Defect Report on ISO/IEC 14496-4:2004 N 09/04/24 10537 First Ideas on New MPEG-4 Video Bitstream Repository N 09/04/24 Structure 2 Development of AVC 103
  • 104. The video subgroup and the Sunday AHG on AVC development discussed the issues related to the ongoing development of AVC amendments and the corrigendum work related to fifth edition. The most relevant work items in this context were – Study of FPDAM1 (Constrained Baseline, SEI): Some minor changes related to the frame packing arrangement SEI message: Clarification of relationship with aspect ratio, introduction of a row interleaving method – Stereo High Profile: This new profile, which restricts MVC to 2 views but includes interlaced, is strongly supported by 5 companies. Software implementation was done in both JM and MVC reference software, and consistency was shown by cross-checks. In the case off usage for stereo progressive, it is a subset of multiview high profile (using same profile_idc, and introducing constrained_set5_flag for signaling usage of interlaced). The Stereo High Profile is also included in the Study of FPDAM1, and NBs are asked to comment on this. This includes the option of not promoting it into FDAM by July, and start a separate amendment on Stereo High. The video subgroup however recommends to issue this new profile as early as possible, such that possibly a new edition of AVC could be issued after the finalization of Amd.1 and Cor.1. – New version of defect report (planning DCOR1 by July) was also issued. This now also includes a number of corrigendum items related to non-MVC parts of edition 5. Some of the issues that were resolved as a result of the discussion are also explained in the VCEG liaison N10559, but more effort and discussion with VCEG will be necessary until the DCOR can be issued. – Study documents were issued for the FPDAMs on MVC software and conformance (both intended tom reach FDAM status by July) – Integration of AVC related code bases was further discussed. From the implementation of the new Stereo High Profile in both JM and JMVC, it appears realistic that the two code bases could be unified. It must however carefully be checked whether the memory management of JM is sufficient for the purpose of a full MVC (Multiview high with larger number of views) implementation. Unification of JM and JSVM would also be desirable by the longer term, but so far, no effort was made on exploring this possibility. Documents reviewed: m16320 On 2D + Depth SEI Message Dong Tian Follows JVT-AD017 (JVT Geneva Jan 09), now joint proposal of Po-Lin Lai Thomson and Philips. Fons Bruls Supports side-by-side of video-plus-depth (both at same resolution), Lincoln Lobo note: It is certainly not necessary here to allow both options, i.e. it can Wiebe de Haan always be assumed that the image is left and depth is right. stereo-plus depth (left/right images and depth maps at top/bottom of 4-split frame), and LDV (same as before, but foreground/background and their depth maps at top/bottom. Would be useful to combine it with horizontal squeezing as in the current SEI message from FPDAM1.This could be signaled by sample aspect ratio. Clarification of sample aspect ratio needed there (e.g. horizontal squeezing side by side 2:1, vertical squeezing 1:2), also for the current SEI message in FPDAM1. No support to the proposal than by the proponents. m16329 Reference Software And Test Results For Multiview Field High Profile ChongSoon Lim Implementation for stereo interlaced MVC in both JM and MVC Steffen Wittmann reference software. Results brought for three sequences (Trapeze, Takahiro Nishi Tunnel SD, BMX HD). BR reduction between 3 and 10 percent compared to simulcast, between 5 and 25 compared to MVC frame- based coding (field based coding was not tested). Software needs more improvement, proponents would do that. Potentially this could still be included in the FDAM of MVC software. Still to be decided whether the track of JM or MVC ref software should be followed. (recommendation) m16330 Contribution of Stereoscopic Test sequence ChongSoon Lim BMX sequence: Copyright conditions provided. Steffen Wittmann Takahiro Nishi m16331 Standardization of a new MVC profile as specified in Working Draft 1 of ChongSoon Lim ISO/IEC 14496-10:200X/Amd.2 Multiview Field High Profile (N10344) Steffen Wittmann 104
  • 105. Support by 5 companies. No change relative to the previous WD. Takahiro Nishi Agreement that this shall be done. More discussion needed whether it Ajay Luthra could still be included in Amd.1 (then FDAM either July or October) as Anthony Vetro a Study of FPDAM, or whether this should become a separate Shun-ichi Sekiguchi amendment (then PDAM now or July, FPDAM October, FDAM 10/04) Shinya Shimizu Stéphane Pateux m16437 Verification of Test Results For Multiview Field High Profile (m16329) Sehoon Yea Confirm that results of M16329 match. Anthony Vetro Shun-ichi Sekiguchi m16481 JM Reference Software Enhancements Alexis Michael Tourapis Adopt this, i.e. Karsten Sühring will publish as JM16 after appropriate Athanasios Leontaris checking. Peshala Pahalawatta Yan Ye m16492 Liaison statement from ITU-T SG 16 ITU-T SG 16 via SC 29 Technical: Various issues related to AVC corrigendum. Issue of Stereo Secretariat High Profile: How to make this (in progressive mode) compatible with Multiview High Documents approved: No. Title TBP Available 10540 Study Text of ISO/IEC 14496-10:200X/FPDAM 1 N 09/04/24 10541 Defect Report on ISO/IEC 14496-10:200X N 09/05/31 10535 Study Text of ISO/IEC 14496-4:2004/FPDAM 38 Multiview N 09/05/15 Video Coding Conformance Testing 10538 Study Text of ISO/IEC 14496-5:2001/FPDAM 15 Reference N 09/05/15 Software for Multiview Video Coding 10539 Working Draft of Reference Software for Stereo High Profile N 09/04/24 10559 Liaison statement to ITU-T SG16 Q.6/16 re AVC Development N 09/04/24 3 MPEG-7 Visual 3.1 MPEG-7 Visual related work The MPEG-7 breakout group was active during the whole week. Input documents related to the Visual part in 15938-3 are listed in the table below. m16279 Summary of Voting on ISO/IEC 15938-6:2003/PDAM 3 SC 29 Secretariat m16280 Summary of Voting on ISO/IEC 15938-7:2003/PDAM 5 SC 29 Secretariat m16281 Summary of Voting on ISO/IEC TR 15938-8:2002/PDAM 5 SC 29 Secretariat m16335 Proposal for a complementary evaluation process of MPEG-7 Video Marzia Corvaglia Signature Tool. Riccardo Leonardi m16370 Proposal for the MPEG-7 Visual Extension, VCE-x: the ROI Sung-Kwan Je Signature Sang-Il Na Weon-Geun Oh m16371 Preliminary feasibility test result for MPEG-7 Visual Extension, VCE-x Sung-Kwan Je : the ROI signature Weon-Geun Oh Sang-Il Na Won-Keun Yang m16414 Response to the Core Experiments on Video Signature Tools Weon-Geun Oh Ju-Kyong Jin Sang-il Na Hae-Kwang Kim Dong-Seok Jeong m16416 Cross verification result for ETRI VCE-7 proposal Min-Jeong Lee Heung-Kyu Lee m16429 A Video Signature based on Robust Region Detectors Aritz Sanchez sebastian.gerke Patrick.Ndjiki-Nya m16430 Proposal on MPEG-7 Video Signature Tools Paul Brasnett Kota Iwamoto Stavros Paschalakis Ryoma Oami Miroslaw Bober m16449 Proposal for a New Standard Item in MPEG-7 Visual descriptors, ROI Sung-Kwan Je 105
  • 106. Signature Sang-Il Na Weon-Geun Oh m16475 A proposal for Video Signature Tool and Video Fingerprinting Marzia Corvaglia Fabrizio Guerrini Riccardo Leonardi Eliana Rossi Pierangelo Migliorati m16480 Evaluation of Video Signature Based on Tomography Sebastian Possos The main activity during the week was the evaluation of the results of Core Experiments. Unfortunately, there was some inconsistency due to the late detection of cases where the used video decoder crashed and produced black frames with an information message, which in one class of experiments could bias the results. Some of the experiments needed to be re-done, such that results partially arrived only after the official document update deadline. Even though, only M16414 and M16430 were able to provide complete CE results during the meeting; other parties were not able to finalize their computations (for which the flaw described above did not play any role). From the results available, better performance was observed from the contribution M16430. In fact, this is a merging of two original CfP proposals, using a ternary frame signature from regions of interest, from which “words” and "bags of words" (histograms) of the signature values are constructed. It was therefore decided to adopt this method for WD, and include the related matching procedures in the XM. As in the case of Image Signature Descriptor, the method is closely coupled to the underlying image processing algorithm, such that extraction needs to be specified as a normative part. It is further recommended to shift the issuing of PDAM4 into the July meeting, which still will allow to produce FPDAM by October. Software, conformance and matching tools for the Image Signature Descriptor were also progressed as the respective FPDAM / DAM texts. With regard to the conformance, it is raised in one NB comment that the aspect of normative extraction method should have implication on the conformance definition (e.g. allowing a certain margin of divergence when extracting the descriptor from image data), which will be considered in the FPDAM text. 3.2 Output documents related to MPEG-7 Visual No. Title TBP Available 15938-3 Visual 10566 Request for 15938-3:2000/Amd.4 N 09/04/24 10542 WD 1.0 of 15938-3/Amd.4 Video Signature Descriptors N 09/05/08 10543 MPEG-7 Visual XM 35 N 09/05/15 10544 Description of Core Experiments in Video Signature Description N 09/04/24 development 10545 Disposition of Comments on ISO/IEC 15938-6:2003/PDAM 3 N 09/04/24 10546 Text of ISO/IEC 15938-6:2003/FPDAM 3 Reference Software N 09/05/08 for Image Signature Tools 10547 Disposition of Comments on ISO/IEC 15938-7:2003/PDAM 5 N 09/04/24 10548 Text of ISO/IEC 15938-7:2003/FPDAM 5 Conformance Testing N 09/06/12 for Image Signature Tools 10549 Disposition of Comments on ISO/IEC 15938-8:2002/PDAM 5 N 09/04/24 10550 Text of ISO/IEC 15938-8:2002/DAM 5 Extraction and Matching N 09/05/08 of Image Signature Tools 106
  • 107. 4 23002 MPEG-C Video Technologies 4.1 23001-4 and 23002-4 Reconfigurable Video Coding (RVC) 4.1.1 General status of work The two parts related to RVC (ISO/IEC 23001-4 Codec Configuration Representation in MPEG-B and ISO/IEC FCD 23002-4 Video Tool Library in MPEG-C) were progressed into FDIS status in Lausanne, but some final editing work was dedicated in Maui, in particular to guarantee a 1:1 matching between the textual description in the FDIS and the software implementation in Amd.1 which together with the conformance gives the “anchor” reference of normative FU input/output behavior. In particular, a number of inconsistencies were detected in the implementation of the AVC BP de-blocking filter, which needs to be split into two functional units to provide correct operation and timing. Regarding conformance definitions in PDAM1, intense discussions were performed during the week and it was concluded that the currently defined conformance at the FU level is not sufficient to describe the normative behaviour, but interoperation of FUs, synchronization and timing is potentially even more relevant. It would however be too early to include any draft text on this in a Study of PDAM. Instead, a Core Experiment was started, which is expected to bring more clarification about viable solutions. It is still the understanding that RVC is still in "phase 1", which is re-implementation of existing decoder conformance points • MPEG-4 SP and MPEG-4 AVC CBP in FDIS • MPEG-2 MP, MPEG-4 ASP, AVC HP and SVC to follow in Amd.2. Due to ongoing investigation about best way of defining CABAC related parsers in the RVC/ BSDL context, as well as due to the time that needed to be spent on the finalization of text and software/conformance issues, the progress on Amd.2 is slower than expected, such that issuing the PDAM will certainly be delayed by at least one more meeting cycle. "Phase 2" could open up more options that were previously discussed in the RVC context, in particular • Possible simplification of standards development by adding new FUs. Whereas this approach sounds attractive, it appears clear that a real simplification (by adding / exchanging single FU modules) would only be given for cases where a preceding standard is fully implemented in RVC schema – it needs to be clarified whether RVC- based encoders are necessary in this context as well. First investigations on this were reported and will be continued in Core Experiments. • downloadable (on the fly) decoder solutions More of this will be discussed and provided in the expected update of the vision document, which will be discussed in the AHG reflector. The main activity (besides discussion of vision) until next meeting will be the conduction of Core Experiments related to – RVC Encoding Tools – RVC Conformance Testing (will be updated after 4 weeks) – Re-usability of tokens and parametrization – RVC-BSDL extension, in particular with relation to CABAC 107
  • 108. 4.2 Assignment of output documents & editors  Editors Documents Editors RVC Core Experiments Kazuo-san  Output documents No. Title P.A. Editing period Description of Core Experiments N 4 weeks in RVC 4.3 Review of input contributions  On-going issues Doc. Category Title Authors No. m16332 MPEG-B An efficient dataflow design for Jérôme Gorin, Mickaël Raulet Video implementing MPEG-4 AVC decoder in the RVC framework Notes  “a new way to test the efficiency and the reliability of the CAL tools, especially Synthesizing tools, by modelling one of the most complex decoder provided by MPEG”  Deblocking filter needs to be checked.  Bitstream parser needs verified.  What is described in VTL FDIS is explained in detail as a report.  [Recommendation] Offline meeting (Tuesday Afternoon) to solve the deblocking filter problem. m16450 MPEG-C MPEG-4 ASP Decoder Hyungyu Kim, Sowon Kim, Minsoo Video Description and a Case Study of Park the Decoder Design Process in Hwa Seon Shin, Byeongho Choi, the RVC framework Chungku Yie, Euee S. Jang Notes  ECMAScript-based ASP parser description is proposed.  Design process including conformance testing is proposed.  [Recommendation] Include the proposed design process into PDAM1 (Study) m16482 MPEG-C Status and Future Plan of Video Hwa Seon Shin, Sung Moon Chun, Video Tool Library (VTL) Hyungyu Kim, Byeongho Choi, Euee S. Jang Notes  Status of the current VTL descriptions of FU is given.  [Recommendation] Start a CE on Token definition (HS, Christophe, Mikael, Chris) m16470 All FU network of inverse scan, Gwo Giun (Chris) Lee, He-Yuan General/All inverse quantization and inverse Lin, Jia-Wei Liang, Ming-Jiun Wang transform in AVC High Profile Notes  [Recommendation] conduct crosschecking (HYU) and accept it in VTL (WD). 108
  • 109. m1633 FU parameterization and FU M. Raulet, M. Wiplize and J. W. 3 code generation Janneck Notes  A report on duplication and parameterization of FUs  [Recommendation] Start a CE on the reusability of token and parameterization  Core Experiment on Encoding Tools Doc. Category Title Authors No. m16398 MPEG-C AVC Entropy Coding and Hussein Aman-Allah, Ihab Amer, Video Bitstream Generation for the Marco Mattavelli MPEG RVC Encoding Tools Notes  Outline of AVC Entropy coding modules in high level.  Status report  [Recommendation] the encoding tools should demonstrate the efficiency and usefulness in a generic way to be applicable to many applications.  [Recommendation] update CE description to specify the objectives of the work. (Marco) m16409 MPEG-C Advances in the CE: Ihab Amer, Marco Mattavelli Video Development of RVC Encoding Tools Notes  Status report m16413 MPEG-C AVC Intra Prediction, Transform Karim Maarouf, Ihab Amer, Marco Video and Quantization for the MPEG Mattavelli RVC Encoding Tools Notes  Outline of AVC intra prediction, transform and quantization is given.  Status report m16431 MPEG-C AVC Inter-frame Prediction for Ehab Asaad Hanna, Ihab Amer, Video the MPEG RVC Encoding Tools Marco Mattavelli Notes - Status report  RVC for Graphics Doc. Category Title Authors No. m16403 MPEG-C A study on RVC based Graphics Seungwook Lee, Bonki Koo, Video codec Kyoungsoo Son, Daiyong Kim, Mingxiao Chen, Euee S. Jang 4.4 Output Document Processing 4.4.1 CE description update (Editor: Kazuo-san) - CE 3 (RVC Encoding tools) update  Update on the objective of this CE will be integrated. - CE 4 (RVC Conformance Testing)  Existing two codecs (MPEG-4 SP, MPEG-4 AVC ConstrainedBP) will be checked first during the conformance testing CE till the next meeting. - CE 5 (Reusability of tokens and parameterization)  Update of the CE description discussed and updated - CE 6 (RVC-BSDL extensions) 109
  • 110.  Update of the CE description discussed and updated 4.5 RVC-related schedule of the 88th meeting Day Topic Room Time Status Monday Video Plenary (planning of this Video 14 - 15 DONE week) RVC time allocation Wilcox 16 -1615 DONE Review of input contributions (on- Wilcox 1615 – DONE going issues) 1930 RVC output decision Wilcox 1730 - 18 DONE Tuesday RVC Conformance Wilcox 930 – 12 DONE Joint meeting with 3DG on RGC 3DG 14 - 15 DONE (Pioneer) Core Experiments (Encoding Wilcox 15 – 17 DONE Tools) RVC Conformance (cont’d) Wilcox 17 – 1720 DONE Review of Input contribution Wilcox 1720 - DONE (M16333) 1640 Wednesday CE update review Wilcox 1430 – DONE 1530 RVC Conformance (cont’d) Wilcox 1530 – 17 DONE RVC Vision Wilcox 17 - 18 DONE Thursday CE update review Wilcox 13 – 1530 DONE Friday Video Plenary Video DONE Output Document: No. Title TBP Available 10551 Description of Core Experiments in RVC N 09/04/24 5 Explorations – 3D Video The goal of 3D video is to generate interpolated views from available videos of multiview camera configurations. The target application is mostly seen for upcoming generations of various (auto-) stereoscopic displays, either requiring multiple views internally or providing means for baseline adjustment. In the new format, only a low number (≥1) of video sequences shall be transmitted, but rendering of additional views would be enabled by associated depth information. In the exploration experiments preceding the Maui meeting, further progress was made in improving (automatic) depth estimation and view rendering / interpolation. Two approaches were investigated, namely layered depth video (including background video plus depth) and stereo/multiview plus depth, both of which seem to be conceptually working and suitable for producing anchors in an upcoming CfP. However, according to the subjective viewing judgements that were again performed in Maui, deficiencies in synthesis quality are mainly caused by false depth estimation. 110
  • 111. Following the Call for test material and depth maps that had been issued in Lausanne, responses were received which in particular provide hand-generated depth maps either for sequences from the existing test set, or along with new sequences (2). Even though more effrt seems to be necessary in this, satisfactory view synthesis results are now achieved for the cases of 8 sequences in total (previously only 3), including cases of high depth variation and extremely localized content for which automatic algorithms typically fail. As also the depth maps look more smooth and natural, it is concluded that for the first time it is reasonable to perform the second step in anchor preparation for a CfP, which is coding experiments, using AVC/MVC for both video and depth map coding. Main achievements in this activity have been review of technical developments from the exploration experiments, further clarification about the vision, applications and requirements, and planning of next steps. The planned exploration experiments are therefore solely designed for the purpose of CfP preparation: – EE1: Depth map generation; goal: Improving semi-automatic methods, get good/better depth maps for LDV rendering and multi-view based rendering – EE4: Coding experiments; goal: Find best data rate points (video, depth) for upcoming CfP If the results are satisfying, a draft CfP could be issued in July. To further progress on this, a document “Evaluation and Testing of 3D Video Coding” (N10649) was produced, which – Describes viewing methodologies for stereoscopic and autostereoscopic displays, and an expert viewing method – Has the goal to get a "measurable" video quality on a more granular scale (not binary or ternary decision as in the viewing performed so far for the purpose of evaluating the performance of depth estimation and view synthesis algorithms). Further, the document “Applications and Requirements of 3D Video Coding” was slightly updated (N10570). Documents reviewed in AHG (see AHG report) m16295 Revisions of Applications & Requirements on 3D Video Coding Anthony Vetro m16317 Results of Exploration Experiments in 3D Video Coding for Dog Yongzhe Wang Data Set Philipp Merkle Karsten Müller m16318 3DTV Exploration Experiments on Pantomime data set Ivana Radulovic Per Fröjdh m16319 MPEG 3DV EEs on Leaving_Laptop Po-Lin Lai Dong Tian Patrick Lopez Paul Kerbiriou m16326 3DV results on Dog sequence Carmen CHENG Yan HUO Yu LIU m16328 Results of Exploration Experiments in 3D Video Coding, Olgierd Stankiewicz described in w10360, for Alt Moabit sequence. Krzysztof Wegner Krzysztof Klimaszewski m16356 Report of 3D/FTV Exploration Experiment with Champagne Takanori Senoh Tower Kenji Yamamoto Ryutaro Oi Tomoyuki Mishina Makoto Okui m16357 Proposal of Depth Map Estimation Method in Response to Call Takanori Senoh for 3D Test Material: Depth Maps & Supplementary Information Kenji Yamamoto Ryutaro Oi Tomoyuki Mishina Makoto Okui m16388 3DV EE1 & EE2 Results on Newspaper sequence Seok Lee Jaejoon Lee Ilsoon Lim Jin Young Lee Ho-Cheon Wey 111
  • 112. Du-Sik Park m16389 Error-resilient Free-viewpoint Image Generation for FTV Masayuki Tanimoto Toshiaki Fujii Mehrdad Panahpour Tehrani Hisayoshi Furihata Menno Wildeboer m16390 Depth Estimation Reference Software (DERS) 3.0 Masayuki Tanimoto Toshiaki Fujii Mehrdad Panahpour Tehrani Kazuyoshi Suzuki Menno Wildeboer m16391 Semi-automatic Depth Estimation for FTV Masayuki Tanimoto Toshiaki Fujii Mehrdad Panahpour Tehrani Norishige Fukushima Kazuyoshi Suzuki Menno Wildeboer m16394 EE1: Results of Depth Estimation on 'Pantomime? Sequence Cheon Lee Yo-Sung Ho m16395 EE2: Results of View Synthesis on 'Pantomime? Sequence Cheon Lee Jiho Park Yo-Sung Ho1 m16396 3-D Test Sequence - Multiview Video and Depth Map Eun-Kyung Lee Yo-Sung Ho m16400 3DV EE3 on Champagne_tower sequences Yin Zhao Lu Yu m16405 LDV Reference Software for View Synthesis Yin Zhao Lu Yu Fons Bruls Lincoln Lobo m16406 3DV/FTV EE results of depth estimation and view synthesis on Gun Bang "lovebird1" sequence Gi Mun Um Namho Hur Jinwoong Kim m16407 PSPNR measurement for evaluating view synthesis quality Yin Zhao Lu Yu m16411 Depth Estimation algorithm in SADERS1.0 Gun Bang Jaeho Lee Namho Hur Jinwoong Kim m16417 Improving view synthesis results based on depth quality measure Jaewon Sung Byeong-Moon Jeon m16418 3DV EE results on Newspaper sequence Jaewon Sung Byeong-Moon Jeon m16419 Philips response to new Call for 3DV Test Material: Arrive book & fons bruls Mobile rene klein gunnewiek patrick van de walle m16420 Philips & Zhejiang Uni response to new Call for 3DV Test fons bruls Material: Champagne Tower rene klein gunnewiek patrick van de walle Yin Zhao Lu Yu m16421 Philips (in coop with 3D4YOU) response to new Call for 3DV fons bruls Test Material: Beergarden rene klein gunnewiek patrick van de walle rene van de vleuten m16422 Philips 1st 3DV synthesis results using new test material for fons bruls Arrive book, Mobile, Beergarden & Champagne Tower rene klein gunnewiek patrick van de walle m16423 Philips 3DV EE results fons bruls m16432 Results of Exploration Experiments in 3D Video for Lovebird2 Sehoon Yea Zafer Arican Anthony Vetro m16460 Additional results of Exploration Experiments in 3D Video Olgierd Stankiewicz Coding, described in w10360, for Alt Moabit sequence. Krzysztof Wegner Krzysztof Klimaszewski m16471 3DV/FTV EE Report on Doorflower sequence Shinya Shimizu Hideaki Kimata Output documents: No. Title TBP Available 112
  • 113. 1057 Applications and Requirements of 3D Video Coding N 09/04/24 0 1055 Description of Exploration Experiments in 3D Video Coding N 09/04/24 2 1064 Evaluation and Testing of 3D Video Coding N 09/04/24 9 6 Explorations – High-Performance Video Coding A large quantity of video material is already distributed in digital over broadcast channels, digital networks and packaged media. More and more of this material will be distributed with increased resolution and quality demand. Technology evolution will soon make possible the capture and display of video material with a quantum leap in quality (temporal and spatial resolution, color fidelity, amplitude resolution). Networks are already finding it difficult to carry HDTV resolution and data rates economically to the end user. Therefore, further data rate increase will put additional pressure on the networks. Therefore a new generation of video compression technology that has sufficiently higher compression capability than the existing AVC standard in its best configuration (the High Profile), is needed. A study has been started on the feasibility of HVC, which is mainly intended for high quality applications, and a Call for Evidence is under preparation. Before the Maui meeting, AVC anchors that shall be compared against prospective new technologies were provided as announced in the Draft Call for Evidence (see m16462, m16463). First investigations on the anchors were made (see m16375, m16463) and continued during the week. As some of the AVC anchors already seemed to be at subjectively transparent quality, it was decided to adapt the QP values for some of the test cases. Further, as one input contribution reported that the search ranges of motion estimation might be insufficient for some of the cases, the corresponding parameters were also changed. One contribution for an additional set of test sequences (1920x1080, 24fps, 10 bit RGB) was received (m16472). Usage conditions in the context of standards development are clarified. After further review of those sequences, including initial results of AVC anchor encoding, three additional sequences were selected for the class B (1080 HD) category. It was further decided to remove the previous sequences (same as class A UHD but downsampled, which did not seem to give relevant additional information) from the test set, and retain the corresponding sequences only fo the class A case. Further, for classes A and C, the sequences “Crowd Run” and “Mobisode1” were removed, because they seemed to be redundant in terms of noise and scene characteristics with “Park Joy” and “Mobisode2”, respectively. It is out of question, however, though the current set of sequences may be appropriate for the ongoing Call for Evidence for an initial guess on existence of improved compression technology, it is certainly not good enough for a CfP and following standards development. In particular, material from state-of-the-art 720/60p and 1080/60p cameras, as well as more diversity in the category A (UHD) would be needed. After the testing cases are settled, the Call for Evidence was issued with responses expected for July. This includes description of the expert viewing methodology which will be applied in London. 6 input documents were registered that present or discuss technical approaches of improved- compression video coding (m16372, m16438, m16448, m16451, m16473, m16479). Comments are included in the list below. 113
  • 114. m16372 High Definition Test Sequences for High-Performance Video Coding Tomonobu Yoshino (HVC) Sei Naito Shigeyuki Sakazawa Documentation how the test sequences were produced (including cropping and downsampling) m16375 AVC Anchor Streams for Evaluation of High-Performance Video Keiichi Chono Coding (HVC) Hirofumi Aoki Junji Tajime Documentation how the AVC anchors were encoded. Some initial Yuzo Senda findings: QP22 may be too close to transparent for UHD cases; People on Street 5 sec may be too short; motion range may be too low for Park Joy; for WQVGA, difficult to see coding artifacts in case of Keiba, coding artifacts difficult to see in some cases due to high speed of global motion. The two Mobisode sequences may be redundant in terms of their properties. m16438 Requests on Coding conditions in Call for Evidence on High- Yuriy A. Reznik Performance Video Coding (HVC) Ravi K. Chivukula Significant reduction of rate if motion vector range is increased for Keiba. Same may be true for Park Joy. Further discussion on settings after visual review of the results. m16448 Information on new test material for HVC study Tomoyuki Yamamoto COSME 1920x1080/24p 4:4:4 sequence, provided under clear copyright Tomohiro Ikai conditions for development of standards; to be reviewed during the week. m16462 Performance Evaluation of Spatially Adaptive Macroblock Size Steffen Kamp Selection Scheme for HVC Test Sequences Mathias Wien Refers to previous contribution M16082 where fixed (larger) MB size was used. Now, local update of MB size within frames. “Control unit” 64x64, which can be subdivided into 32x32 or 16x16 MBs. Tested on UHD (2560x1600) test sequences from CfE. Most effect in Park Joy (approx. 30% average bitrate reduction). Other sequences small or no improvement. Only IPPP investigated. Results were made with different search range for each of the different MB sizes. Note: Current document is without PSNR figures. Will be updated. m16463 On design of transforms for high-resolution / high-performance video Steffen Kamp coding Mathias Wien To be presented later during the week. m16472 Analysis on partition and transform selection in the context of extended Yoshihisa Yamada block sizes Yoshiaki Kato Kohtaro Asai MB sizes up to 64x64; transform size up to 16x16 (also 16x8 and 8x16; Tokumichi Murakami in some cases 16x1 is used). Larger partitions are typically more often used when QP becomes higher. Based on statistics, certain transform sizes are disabled in combination with certain MB sizes. Only IPPP coding. 0.3% average bitrate reduction, but is is claimed that complexity is reduced. m16473 Additional coding performance evaluation of extended MB size Kazuo Sugimoto Extended MB size to maximum 32x32, motion partitioning 32x16 and Yoshihisa Yamada Yoshiaki Kato 16x32 additionally. P picture only. For UHD sequences, relevant gain is Kohtaro Asai observed only for traffic (13%), other sequences low gain, on average Tokumichi Murakami around 3-4%. Claimed that 2 out of 4 sequences are film-scan sources that may prevent good inter coding. Gain for other 1080p and 720p sequences higher (10-15% average). m16479 Additional Experimental Result of MVOP with HD Sequences Jungyoup Yang Motion vector coding with optimum predictor: New results for 720p and Kwanghyun Won Byeungwoo Jeon 1080p sequences. Decoder decides on optimum motion vector to be used Su Nyeon Kim for prediction, but flag is used to signal that the median should be used instead. 5 candidates (3 spatial neighbors, co-located MB in previous frame, median). Template matching is used to determine the optimum. Experiments with only CAVLC, IPPP. Average for 720p 8.7%, for 1080p 7.8% (much less for Crowd Run and Park Joy). Usually, the performance goes up with increased spatial resolution. 114
  • 115. Output documents: No. Title TBP Available 10553 Call for Evidence on High-Performance Video Coding Y 09/04/24 115
  • 116. Annex H – Audio report Source: Schuyler Quackenbush, Chair, Audio Subgroup Report of 88th meeting............................................................................................................9 1 Opening..................................................................................................................................9 2 Roll call of participants..........................................................................................................9 3 Approval of agenda................................................................................................................9 4 Allocation of contributions....................................................................................................9 5 Communications from Convenor...........................................................................................9 6 Report of previous meeting....................................................................................................9 7 Processing of NB Position Papers..........................................................................................9 8 Work plan management ......................................................................................................10 8.1 Media coding.................................................................................................................10 8.1.1 AAC family of profiles...........................................................................................10 8.1.2 HD-AAC Profile.....................................................................................................10 8.1.3 AVC Constrained Baseline Profile.........................................................................10 8.1.4 AFX 3rd edition......................................................................................................10 8.1.5 Scalable-complexity 3D mesh compression...........................................................10 8.1.6 Open Font Format extensions.................................................................................10 8.1.7 Video Tool Library.................................................................................................11 8.1.8 Spatial Audio Object Coding..................................................................................11 8.1.9 Unified Speech and Audio Coding.........................................................................11 8.1.10 Media Context and Control...................................................................................11 8.1.11 3D Video Coding..................................................................................................11 8.1.12 High-Performance Video Coding.........................................................................11 8.2 Composition coding......................................................................................................12 8.2.1 Interactive Digital Radio.........................................................................................12 8.2.2 LASeR Adaptation..................................................................................................12 8.2.3 Presentation of Structured Information...................................................................12 8.2.4 Advanced User Interaction......................................................................................12 8.3 Description coding........................................................................................................12 8.3.1 Video Signature Descriptors...................................................................................12 8.3.2 Extraction and Matching of Image Signature Tools...............................................12 8.3.3 Query format...........................................................................................................13 8.4 Systems support............................................................................................................13 8.4.1 MPEG-4 Systems 4th edition..................................................................................13 8.4.2 Registration Authority and systems extensions......................................................13 8.5 IPMP.............................................................................................................................13 8.5.1 Protection of Presentation Element.........................................................................13 8.6 Digital Item...................................................................................................................13 8.6.1 Presentation of Digital Item....................................................................................13 8.7 Transport and File formats............................................................................................13 8.7.1 Carriage of MVC in MPEG-2 Systems...................................................................13 116
  • 117. 8.7.2 Miscellaneous additions to File Format..................................................................14 8.7.3 AVC File Format extensions for MVC...................................................................14 8.7.4 MPEG Media Transport..........................................................................................14 8.8 Multimedia architecture................................................................................................14 8.8.1 MXM Architecture..................................................................................................14 8.8.2 MXM API...............................................................................................................14 8.8.3 Advanced IPTV Terminal.......................................................................................14 8.8.4 Rich Media UI Framework.....................................................................................14 8.9 Application formats.......................................................................................................15 8.9.1 Musical Slide Show Application Format................................................................15 8.9.2 Media Streaming Application Format.....................................................................15 8.9.3 DMB AF Harmonization of MPEG-2 TS storage..................................................15 8.9.4 Interactive Music Application Format....................................................................15 8.10 Protocols......................................................................................................................15 8.10.1 MXM Protocols.....................................................................................................15 8.11 Reference implementation..........................................................................................15 8.11.1 AAC-ELD Reference Software............................................................................15 8.11.2 MVC Reference Software.....................................................................................15 8.11.3 Synthesized Texture Reference Software.............................................................16 8.11.4 Image Signature Tools Reference Software..........................................................16 8.11.5 Professional Archival Application Format Reference Software...........................16 8.11.6 DMB Application Format Reference Software...................................................16 8.11.7 Stereoscopic Video Application Format Reference Software..............................16 8.11.8 MXM Reference Software....................................................................................16 8.12 Conformance...............................................................................................................17 8.12.1 MPEG-4 Video bitstreams....................................................................................17 8.12.2 MVC Conformance...............................................................................................17 8.12.3 BSAC Conformance for Broadcasting..................................................................17 8.12.4 Image Signature Tools Conformance...................................................................17 8.12.5 Professional Archival Application Format Conformance.....................................17 8.12.6 DMB Application Format Conformance.............................................................17 8.12.7 Stereoscopic Video Application Format Conformance........................................17 8.12.8 MXM Conformance..............................................................................................18 8.13 Maintenance................................................................................................................18 8.13.1 Systems coding standards.....................................................................................18 8.13.2 Video coding standards.........................................................................................18 8.13.3 Audio coding standards.........................................................................................18 9 Organisation of this meeting ...............................................................................................18 9.1 Tasks for subgroups......................................................................................................18 9.2 Joint meetings...............................................................................................................21 10 WG management ...............................................................................................................21 10.1 Terms of reference......................................................................................................21 10.2 Editors.........................................................................................................................21 10.3 Liaisons ......................................................................................................................21 10.4 Ad hoc groups.............................................................................................................23 10.5 Asset management......................................................................................................24 10.6 IPR management.........................................................................................................24 10.7 Work plan....................................................................................................................24 11 Administrative matters ......................................................................................................24 11.1 Responses to National Bodies.....................................................................................24 11.2 Schedule of future MPEG meetings............................................................................24 12 Promotional activities........................................................................................................25 117
  • 118. 13 Resolutions of this meeting................................................................................................25 14 A.O.B.................................................................................................................................25 15 Closing...............................................................................................................................25 Annex A – Attendance list.....................................................................................................26 Annex B – Agenda.................................................................................................................32 Annex C – Input contributions...............................................................................................35 Annex D – Output documents................................................................................................54 Annex E – Requirements report.............................................................................................61 16 Requirements documents approved at this meeting...........................................................61 17 MPEG-7 Query Format......................................................................................................61 18 MPEG-4 Video..................................................................................................................61 19 LASeR................................................................................................................................61 20 MPEG-V: Information exchange with virtual worlds........................................................61 21 MAF...................................................................................................................................61 22 MPEG-User Interface Framework.....................................................................................62 Explorations ..........................................................................................................................62 22.1 Interactive Radio.........................................................................................................62 22.2 3D Video Coding........................................................................................................62 22.3 High Performance Video Coding (HVC)....................................................................62 22.4 Advanced IPTV Terminal...........................................................................................62 22.5 Pervasive AV Scene Coding.......................................................................................62 22.6 MPEG Media Transport..............................................................................................62 Annex F – Systems report.......................................................................................................64 1 Opening of the Meeting.......................................................................................................64 1.1 Approval of the agenda.................................................................................................64 1.2 Goals for the week........................................................................................................64 2 General issues......................................................................................................................68 2.1 List of standards under development............................................................................68 Pr.....................................................................................................................................68 Description......................................................................................................................68 2.2 Standing Documents....................................................................................................70 2.3 Mailing Lists Reminder................................................................................................72 2.4 Demonstrations.............................................................................................................72 3 General Input Documents....................................................................................................73 3.1 General Technical Issues..............................................................................................73 3.1.1 AHG reports............................................................................................................73 3.1.2 Contributions...........................................................................................................73 3.1.3 Liaisons...................................................................................................................74 3.2 FAQ...............................................................................................................................74 3.3 AOB..............................................................................................................................74 4 MPEG-2 Systems (13818-1) ..............................................................................................75 4.1 Topics............................................................................................................................75 4.1.1 ISO/IEC 13818-1:2007 AMD4 Transport of MVC................................................75 4.1.2 ISO/IEC 13818-1:2007 COR X Minor Corrections...............................................75 4.2 Contributions.................................................................................................................75 4.3 Action Points.................................................................................................................75 5 MPEG-4 System (14496-1) ...............................................................................................76 5.1 Topics............................................................................................................................76 5.1.1 ISO/IEC 14496-1:200X AMD 4 RA and Usage of LASeR in MPEG-4 Systems. 76 5.1.2 ISO/IEC 14496-1:200X 4th edition........................................................................76 5.2 Contributions.................................................................................................................76 5.3 Action Points.................................................................................................................76 118
  • 119. 6 MPEG-4 Conformance (14496-4) .....................................................................................77 6.1 Topics............................................................................................................................77 6.1.1 ISO/IEC 14496-4:2007 AMD37 File Format Conformance..................................77 6.2 Contributions.................................................................................................................77 6.3 Action Points.................................................................................................................77 7 MPEG-4 Reference Software (14496-5) ............................................................................77 7.1 Topics............................................................................................................................77 7.1.1 ISO/IEC 14496-5:2007 AMD 23 Sythesized Texture Reference Software...........77 7.2 Contributions.................................................................................................................77 7.3 Action Points.................................................................................................................77 8 MPEG-4 BIFS (14496-11) .................................................................................................77 8.1 Topics............................................................................................................................77 8.1.1 ISO/IEC 14496-11:2002 AMD X Digital Radio Profile........................................77 8.2 Contributions.................................................................................................................77 8.3 Action Points.................................................................................................................78 9 MPEG-4 ISO Base File Format (14496-12) ......................................................................78 9.1 14496-12/COR 2 Usage of brands and box order in sample entry...............................78 9.1.1 ISO/IEC 14496-12:2008 COR 2 Usage of brands and box order in sample entry. 78 9.1.2 ISO/IEC 14496-12:2008 AMD 1 General improvements......................................78 9.1.3 ISO/IEC 14496-12:2008 COR 3 Minor Corrections..............................................78 9.2 Contributions.................................................................................................................78 9.2.1 m16263 Summary of Voting on ISO/IEC 14496-12:2008/FPDAM 1...................78 9.2.2 m16367 Clarification of track header in ISO media file format.............................78 9.2.3 m16359 Minor or editorial errors in the Part 12 amendment.................................78 9.2.4 m16392 Adaptive Progressive Download...............................................................78 9.2.5 m16393 File format sub-track selection and switching..........................................79 9.3 Action Points.................................................................................................................79 10 MPEG-4 File Format (14496-14) ....................................................................................79 10.1 Topics .........................................................................................................................79 10.1.1 ISO/IEC 14496-14:2003 AMD 1 Handling of MPEG-4 Audio enhancement layers ................................................................................................................................79 10.2 Contributions...............................................................................................................79 10.3 Action Points...............................................................................................................79 11 MPEG-4 AVC File Format (14496-15) ...........................................................................79 11.1 Topics .........................................................................................................................79 11.1.1 ISO/IEC 14496-15:2004/FPDAM 3 MVC File Format ......................................79 11.2 Contributions...............................................................................................................80 11.2.1 m16361 Extractors in the MVC file format..........................................................80 11.2.2 m16426 On MVC File Format..............................................................................80 11.2.3 m16444 Comments to the MVC file format draft.................................................80 11.2.4 m16445 A proposal to MVC file format...............................................................80 11.3 Action Points...............................................................................................................81 12 LASeR & SAF (14496-20) ...............................................................................................81 12.1 Topics..........................................................................................................................81 12.1.1 ISO/IEC 14496-20:2008 AMD 2 Adaptation.......................................................81 12.1.2 ISO/IEC 14496-20:2008 AMD 3 PSI...................................................................81 12.2 Contributions...............................................................................................................81 12.3 Action Points...............................................................................................................83 13 Open Font Format (14496-22) ..........................................................................................83 13.1 Topics..........................................................................................................................83 13.1.1 ISO/IEC 14496-22:200X AMD 1 Full Unicode Character Repertoire Supports. 83 13.2 Contributions...............................................................................................................83 119
  • 120. 13.3 Action Points...............................................................................................................84 14 MPEG Query Format (15938-12) .....................................................................................84 14.1 Topics..........................................................................................................................84 14.1.1 ISO/IEC 15938-12:200X AMD 1 MPQF Conf. and Ref. SW..............................84 14.2 Contributions...............................................................................................................84 14.3 Action Points...............................................................................................................84 15 MPEG-21 DID (21000-2)..................................................................................................85 15.1 Topics..........................................................................................................................85 15.1.1 ISO/IEC 21000-2:200X AMD X PSI support......................................................85 15.2 Contributions...............................................................................................................85 15.3 Action Points...............................................................................................................85 16 MPEG-21 IPMP Components (21000-4)...........................................................................85 16.1 Topics..........................................................................................................................85 16.1.1 ISO/IEC 21000-4:200x AMD X Protection of Presentation element...................85 16.2 Contributions...............................................................................................................85 16.3 Action Points...............................................................................................................85 17 Media Value Chain Ontology (21000-19).........................................................................86 17.1 Topics..........................................................................................................................86 17.1.1 ISO/IEC 21000-19 Media Value Chain Ontology................................................86 17.2 Contributions...............................................................................................................86 17.3 Action Points...............................................................................................................86 18 Musical Slide Show AF (23000-4)....................................................................................86 18.1 Topics..........................................................................................................................86 18.1.1 ISO/IEC 23000-4 AMD 2 Conf. and Ref. SW for MSSAF..................................86 18.2 Contributions...............................................................................................................86 18.3 Action Points...............................................................................................................86 19 Media Streaming AF (23000-5).........................................................................................86 19.1 Topics..........................................................................................................................86 19.1.1 ISO/IEC 23000-5 2nd edition...............................................................................86 19.2 Contributions...............................................................................................................87 19.3 Action Points...............................................................................................................87 20 Professional Archival AF (23000-6)..................................................................................87 20.1 Topics..........................................................................................................................87 20.1.1 ISO/IEC 23000-6 AMD1 PA-AF Conf. and Ref. SW..........................................87 20.2 Contributions...............................................................................................................87 20.3 Action Points...............................................................................................................87 21 DMB AF (23000-9)...........................................................................................................88 21.1 Topics..........................................................................................................................88 21.1.1 ISO/IEC 23000-9 AMD1 DMB AF Conf. and Ref. SW......................................88 21.1.2 ISO/IEC 23000-9 AMD2 DMB AF Harmonization of MPEG-2 TS Storage......88 21.2 Contributions...............................................................................................................88 21.3 Action Points...............................................................................................................88 22 Video Surveillance AF (23000-10)....................................................................................88 22.1 Topics..........................................................................................................................88 22.1.1 ISO/IEC 23000-10 AMD1 VS AF Conf. and Ref. SW........................................88 22.2 Contributions...............................................................................................................88 22.3 Action Points...............................................................................................................88 23 Stereoscopic Video AF (23000-11)...................................................................................89 23.1 Topics..........................................................................................................................89 23.1.1 ISO/IEC 23000-11 AMD1 SV AF Conf. and Ref. SW........................................89 23.1.2 ISO/IEC 23000-11 COR1 SV AF Signaling of voice codecs...............................89 23.2 Contributions...............................................................................................................89 120
  • 121. 23.3 Action Points...............................................................................................................89 24 Interactive Music AF (23000-12)......................................................................................89 24.1 Topics..........................................................................................................................89 24.1.1 ISO/IEC 23000-12 Interactive Music AF.............................................................89 24.2 Contributions...............................................................................................................89 24.3 Action Points...............................................................................................................90 25 MPEG-V Architecture (23005-1)......................................................................................90 25.1 Topics..........................................................................................................................90 25.1.1 ISO/IEC 23005-1 MPEG-V Architecture.............................................................90 25.2 Contributions...............................................................................................................90 25.3 Action Points...............................................................................................................91 26 Control Information (23005-2)..........................................................................................91 26.1 Topics..........................................................................................................................91 26.1.1 ISO/IEC 23005-2 Control Information.................................................................91 26.2 Contributions...............................................................................................................91 26.3 Action Points...............................................................................................................92 27 Sensory Information (23005-3)..........................................................................................92 27.1 Topics..........................................................................................................................92 27.1.1 ISO/IEC 23005-3 Sensory Information................................................................92 27.2 Contributions...............................................................................................................92 27.3 Action Points...............................................................................................................94 28 Avatar Information (23005-4)............................................................................................94 28.1 Topics..........................................................................................................................94 28.1.1 ISO/IEC 23005-4 Avatar Information..................................................................94 28.2 Contributions...............................................................................................................94 28.3 Action Points...............................................................................................................94 29 MXM (23006 & 29116-1)..................................................................................................94 29.1 Topics..........................................................................................................................94 29.1.1 ISO/IEC 23006-1 MXM Architecture..................................................................94 29.1.2 ISO/IEC 23006-2 API...........................................................................................94 29.1.3 ISO/IEC 23006-3 Conf. and Ref. SW...................................................................94 29.1.4 ISO/IEC 29116-1 2nd edition MXM Protocols....................................................94 29.2 Contributions...............................................................................................................95 29.3 Action Points...............................................................................................................97 30 MPEG Rich Media UI Framework (???)...........................................................................97 30.1 Topics..........................................................................................................................97 30.1.1 Widgets.................................................................................................................97 30.1.2 Communication.....................................................................................................97 30.1.3 Conf. and Ref. SWTopics.....................................................................................97 30.2 Contributions...............................................................................................................97 30.3 Action Points...............................................................................................................98 31 Exploration.........................................................................................................................99 31.1 AIT..............................................................................................................................99 31.1.1 Topics....................................................................................................................99 31.1.2 Contributions.........................................................................................................99 31.1.3 Action Points.......................................................................................................100 31.2 MMT.........................................................................................................................100 31.2.1 Topics..................................................................................................................100 31.2.2 Contributions.......................................................................................................100 31.2.3 Action Points.......................................................................................................101 32 Liaison..............................................................................................................................101 33 Resolutions of Systems....................................................................................................102 121
  • 122. Cf. WG11 resolution.....................................................................................................102 34 Action Plan.......................................................................................................................102 Annex G – Video report.......................................................................................................103 1 MPEG-4 Part 2 Video........................................................................................................103 2 Development of AVC .......................................................................................................103 3 MPEG-7 Visual .................................................................................................................105 3.1 MPEG-7 Visual related work......................................................................................105 3.2 Output documents related to MPEG-7 Visual ...........................................................106 4 23002 MPEG-C Video Technologies................................................................................107 4.1 23001-4 and 23002-4 Reconfigurable Video Coding (RVC).....................................107 4.1.1 General status of work..........................................................................................107 4.2 Assignment of output documents & editors................................................................108 4.3 Review of input contributions.....................................................................................108 4.4 Output Document Processing......................................................................................109 4.4.1 CE description update (Editor: Kazuo-san)..........................................................109 4.5 RVC-related schedule of the 88th meeting.................................................................110 5 Explorations – 3D Video....................................................................................................110 6 Explorations – High-Performance Video Coding..............................................................113 Annex H – Audio report.......................................................................................................116 1 Opening of the meeting......................................................................................................124 2 Administrative matters.......................................................................................................124 2.1 Communications from the Chair.................................................................................124 2.2 Approval of agenda and allocation of contributions...................................................124 2.3 Creation of Task Groups.............................................................................................124 2.4 Approval of previous meeting report..........................................................................124 2.5 Review of AHG reports..............................................................................................124 2.6 Joint meetings.............................................................................................................124 2.7 Received National Body Comments and Liaison matters..........................................124 2.8 Plenary Discussion......................................................................................................125 2.8.1 Profiles and 960/1024 transform lengths..............................................................125 2.8.2 Miscellaneous........................................................................................................125 3 Record of AhG meetings....................................................................................................125 3.1 AhG Meeting on SAOC and USAC Sunday 1000-1700...........................................125 3.1.1 SAOC....................................................................................................................125 3.1.2 USAC....................................................................................................................127 4 Task group activities..........................................................................................................130 4.1 Joint meetings.............................................................................................................130 4.2 Task Group discussions..............................................................................................130 4.2.1 MPEG-2, MPEG-4, MPEG-26 Audio, Audio Conformance, reference software 130 4.2.2 MPEG-D Spatial Audio Object Coding................................................................131 4.2.3 MPEG-D Unified Speech and Audio....................................................................131 4.2.4 Exploration: Meta-Data.........................................................................................135 5 Audio closing plenary discussions.....................................................................................136 6 Meeting deliverables..........................................................................................................136 6.1 Responses to Liaison and NB comments....................................................................136 6.2 Recommendations for final plenary............................................................................136 6.3 Establishment of Ad-hoc Groups................................................................................136 6.4 Approval of output documents....................................................................................136 6.5 Press statement............................................................................................................136 7 Future activities..................................................................................................................136 7.1 Schedule of future meetings........................................................................................136 7.2 Agenda for next meeting.............................................................................................136 122
  • 123. 7.3 All other business........................................................................................................136 7.4 Closing of the meeting ...............................................................................................136 Annex A Participants............................................................................................................137 Annex B Audio Contributions and Schedule........................................................................138 Task Groups.........................................................................................................................142 Annex C Output Documents.................................................................................................143 Annex D Agenda for the 89th MPEG Audio Meeting..........................................................144 Annex I – 3DG report..........................................................................................................145 1 Opening of the meeting......................................................................................................145 1.1 Approval of the agenda...............................................................................................145 1.2 Goals for the week......................................................................................................145 1.3 Standards from 3DGC.................................................................................................145 1.4 Room allocation..........................................................................................................146 1.5 Allocation of contributions.........................................................................................147 1.6 Attendance list.............................................................................................................151 2 General issues....................................................................................................................151 2.1 General discussion......................................................................................................151 2.1.1 Reference Software...............................................................................................151 2.1.2 Web site.................................................................................................................151 3 Current Voting...................................................................................................................151 4 AFX (14496-16) related activities.....................................................................................152 4.1 AhG on AFX activities...............................................................................................152 4.2 Scalable Complexity 3D Mesh Compression (14496-16 Amd.4)..............................152 4.2.1 Scene partitioning (14496-11 Amd.6)..................................................................154 4.3 Maintenance................................................................................................................154 4.3.1 FAMC Conformance and Reference Software.....................................................154 4.3.2 AFX 3rd Edition....................................................................................................154 4.4 Dataset and benchmarking..........................................................................................154 4.5 Software......................................................................................................................154 4.6 Promotions..................................................................................................................154 4.6.1 Web Site................................................................................................................154 4.7 Future..........................................................................................................................155 4.7.1 MPEG-V - Information Exchange with Virtual Worlds (formally Metaverse)....155 4.7.2 MXM ....................................................................................................................155 4.7.3 Future directions of 3D Graphics Compression....................................................156 5 3D Graphics Compression Model (14496-25) activities...................................................156 5.1 Software and conformance..........................................................................................156 6 Liaison................................................................................................................................157 7 Output documents and Resolutions of 3DGC....................................................................157 7.1 Part 16 Animation Framework eXtension (AFX) ......................................................157 7.1.1 The 3DG subgroup recommends approval of the following documents..............157 7.2 Promotion ...................................................................................................................157 7.2.1 The 3DG subgroup recommends approval of the following documents..............157 7.3 Establishment of 3DGC Ad-Hoc Groups....................................................................157 8 Closing of the Meeting.......................................................................................................158 123
  • 124. 1 Opening of the meeting The MPEG Audio Subgroup meeting was held during the 88th meeting of WG11, April 20-24, 2009, Maui, HI, USA. The list of participants is given in 7.4. 2 Administrative matters 2.1 Communications from the Chair The Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary. 2.2 Approval of agenda and allocation of contributions The agenda and schedule for the meeting was discussed, edited and approved. It shows the documents contributed to this meeting and presented to the Audio Subgroup, either in the task groups or in Audio plenary. The Chair brought relevant documents from Requirements, Systems to the attention of the group. It was revised in the course of the week to reflect the progress of the meeting, and the final version is shown in 7.4. 2.3 Creation of Task Groups Task groups were convened for the duration of the MPEG meeting, as shown in 7.4. Results of task group activities are reported below. 2.4 Approval of previous meeting report The 87th Audio Subgroup meeting report was registered as a contribution, and was approved. 2.5 Review of AHG reports There were no requests to review any of the AHG reports. 2.6 Joint meetings There were no joint meetings. Groups What Where Day Time 2.7 Received National Body Comments and Liaison matters The NB Comments and Liaison documents for the meeting that require a response are as shown below. No. From Title Response Swedish NB via Swedish NB comment in response to Kjörling m16297 SC 29 Resolution 3.1.2 in N10312 Secretariat m16343 IEC TC 100 IEC CDV 62571: Digital Audiobook File Quackenbush Format and Player Requirements [IEC 100/1543/CDV] M16467 EBU Liaison Statement from EBU [SC 29 N No response 10254] m16476 DRM Audio Liaison Statement from DRM [SC No response 29 N 10255] m16477 WorldDMB Audio Liaison Statement from WorldDMB No response Forum Forum [SC 29 N 10256] m16491 3GPP Liaison Statement from 3GPP SA4 No response 124
  • 125. 2.8 Plenary Discussion 2.8.1 Profiles and 960/1024 transform lengths Kristofer Kjörling, Dolby, presented Swedish NB comment in response to Resolution 3.1.2 in m16297 Swedish NB via SC 29 Secretariat N10312 The group then reviewed the following Liaison contributions: m16467 EBU Liaison Statement from EBU [SC 29 N 10254] m16476 DRM Audio Liaison Statement from DRM [SC 29 N 10255] m16477 WorldDMB Audio Liaison Statement from WorldDMB Forum [SC Forum 29 N 10256] M16491 3GPP Liaison Statement from 3GPP SA4 The Liaisons can be summarized as: EBU requires that 960 continue to be supported in the MPEG specifications. The best long- term solution would to be for devices to support both 960 and 1024. However, they concede that since many devices implement only 1024, a restricted set of profiles might be appropriate. DRM specifies MPEG-4 AAC with SBR and PS with 960 in combination with MPEG-4 Error Resilience bitstream format. The best long-term solution would to be for devices to support both 960 and 1024. WorldDMB notes that one of its systems specifies HE-AAC V2 at 960 while another specifies HE-AAC V2 at 1024. The best long-term solution would to be for devices to support both 960 and 1024. 3GPP only mandates 1024 in their aacPlus specifications. They are not impacted by whether or not 960 is mandated in an MPEG profile. Discussion Yuriy Resnik, Qualcomm, noted that the Liaison referenced only one of several 3GPP specifications. One proposal for going forward is to: • No longer mandate support for 960 in AAC, HE-AAC and HE-AAC V2 profiles. • Create a new profile “AAC Grand Alliance” that is a single profile that mandates AAC, SBR and PS tools that operate at 960 and 1024 transform lengths. Ralph Sperschneider, FhG, noted that the latter profile is exactly the HE-AAC V2 profile. Yuriy Reznik, Qualcomm, noted that 3GPP2 references MPEG-4 AAC profile and MPEG-4 HE-AAC profile (3gpp2 C.S0046-0 and C.S0045-A). 2.8.2 Miscellaneous The Chair raised the following issues in order to assess interest and to schedule task group break-outs for later in the week: • SAOC timetable • Normative start-up and shut-down of audio coders, e.g. AAC, HE-AAC as described in N8837. • SVN repository for audio 3 Record of AhG meetings 3.1 AhG Meeting on SAOC and USAC Sunday 1000-1700 3.1.1 SAOC Oliver Hellmuth, FhG, presented This contribution presents information requested by LG at the 87thTerentiev The points Leonid meeting. discussed were:Clarifications regarding the enhanced Karaoke/Solo Jürgen Herre m16310 processing mode Cornelia Falch Oliver Hellmuth 125
  • 126. • Combining regular mode and Enhanced Karaoke/Solo mode (EKS). • Decoder processing in regular vs. EKS mode (wrt prediction or energy based decoding). • Mapping of residual signals to objects. The Chair noted that language clarifying the topic of the last bullet item should be included into the FCD text. Jeongil Seo, ETRI, asked a number of questions aimed at better understanding the limitations of the current specification. This discussion will be continued via e-mail since one FhG expert, Leonid Terentiev, was unable to attend this meeting. Heiko Purnhagen, Dolby, presented Jonas Engdegård Heiko Purnhagen Cornelia Falch Leonid Terentiev m16309 Report on corrections for the MPEG SAOC FCD text Andreas Hölzer Oliver Hellmuth Johannes Hilpert Jeroen Koppens This contribution presented a number of editorial corrections or technical clarifications to the FCD text. In addition, it proposes to draft changes to MPEG-2 AAC and MPEG-4 Audio and MPEG Surround (on carriage of SAOC in the core coder bitstreams or in MPEG Surround bitstreams) for use as amendments to MPEG-2 AAC, MPEG-4 Audio and MPEG Surround. It was the consensus of the group to put the editorial corrections or technical clarifications into the FCD text and, secondly, to draft text for use in amending MPEG-2 AAC, MPEG-4 Audio and MPEG Surround. Jeongil Seo, ETRI, presented Jeongil Seo m16363 Test Sequence Proposal for SAOC Verification Test Kyeongok Kang Kevin SeungChul Ham This contribution makes available to MPEG for use in the Verification Test of SAOC several items from the Korean Music 2.0 project. These will be made available to the Verification Test Encoding Administrator to construct Reference rendering and SAOC rendering waveforms. Juergen Herre, FhG, presented m16384 Details of NB Position on SAOC Ballot Juergen Herre for GNB This contribution gives details on the German NB position on the SAOC FCD ballot (which closed March 14, 2009). The ballot comment requests the usual correction of errors and clarification of text, plus requests that a number of technical changes be incorporated into the SAOC FDIS. These are • Definition of profiles and levels • Control of requests for “extreme” rendering that may result in artefacts in the processed signal. • Expand the specification to support low-delay encoding multiple objects that are rendered as a multichannel signal. The contribution further indicates technical changes that are required, editorial changes that are recommended and technical changes that are desirable. The Chair noted that transport of SAOC in base audio coder bitstreams is covered in the previous contribution. The Chair also noted that it would be very desirable to have the results of the formal Verification Test available at the same MPEG meeting that the FDIS text is approved. Jeongil Seo, ETRI, acknowledged that there is additional work to be done, but that more that two meetings delay impact the personal music mix applications for SAOC in the marketplace. 126
  • 127. The Chair requested that a workplan be drafted for approval at this meeting that organizes the first components of the work requested by the German NB. 3.1.2 USAC Max Neuendorf, FhG, presented Max Neuendorf m16324 Comments on new USAC reference bitstreams Markus Multrus This contribution reported on the results of integrating the new arithmetic codebooks into the proponent USAC encoder and the RM decoder (denoted here as the Reference Quality System, or RQS). It notes that, at the previous MPEG meeting, the CE demonstrated a bitsavings, when averaged over all signals, due to using the new arithmetic coding tables. When this bitsavings was fed back into the bit reservoir, the wLPT tool was selected more often that TCX tool wrt the previous arithmetic tables. Hence it was not possible to maintain a bit-identical decoded waveform in the RQS. The Chair asked whether, in creating a lossless decoding, the new tables strictly obeyed the bit buffer requirements. Max Neuendorf confirmed that this was the case. Eunmi Oh, Samsung, noted that informal listening done at Samsung suggested that some items sounded worse as a result of this change. Herve Taddei, Huawei Technologies, noted that listening tests in their lab also concluded that the new tables resulted in a slight degradation in audio quality. It was agreed that Samsung and Huawei will give details on what test items were judged to be degraded. The Chair requested that FhG report at the next MPEG meeting any new information or insight gained in the use of the new arithmetic tables. Max Neuendorf, FhG, presented Report on Merge of sys2 Technology into RM0: SBR Max Neuendorf m16323 Improvements Taejin Lee The contribution reported on incorporating technology from Sys2 into the RM. Listening tests were presented that showed that the performance of the new RQS had a higher mean score than the RM0 system, but not better at the 95% level of significance. However, the enhancements related only to the encoder implementation. There was considerable discussion as to how such enhancements would be incorporated into the RQS. The Chair noted that what was of paramount importance was simply that all CE proponents have access to the same RQS. Taejin Lee, ETRI, presented Report on Merge of sys2 Technology into RM0: TCX Taejin Lee m16383 Improvements Max Neuendorf This contribution proposes to change the window shape for frames using TCX encoding. It presented listening test results for the proposed changes, in which a test over 6 items showed better performance wrt RM0. It was noted that, for these items and at 12 kb/s mono, the encoder was modified such that only TCX mode was used. ETRI proposes to do additional work and bring a complete CE proposal to the next MPEG meeting. Chair noted that the CE process requires an independent listening test report cross- check. The Chair further noted that ETRI has the burden of bringing evidence that is sufficiently compelling on the merit of their technology, and that they should use this week to understand the concerns of the group. Heiko Purnhagen, Dolby, presented Dolby Listening Test Results for USAC CE on Phase Heiko Purnhagen m16312 Coding in MPS Kristofer Kjörling The contribution presented listening test results at 32 kb/s stereo which showed a tendency in the mean for the performance of RM+CE to be better than the performance of RM. The presenter suggested that more conclusive results could be achieved if the data from all test results were pooled. Werner Oomen, Philips, presented 127
  • 128. Philips Listening Test Results for USAC CE on Phase Werner Oomen m16339 Coding in MPS Jeroen Koppens The contribution presented listening test results at 24 kb/s stereo. The results showed a tendency in the mean for the performance of RM+CE to be better than the performance of RM. The presenter also suggested that more conclusive results could be achieved if the data from all test results were pooled. Markus Multrus, FhG, presented Julien Robilliard Fraunhofer Listening Test Results for USAC CE on m16456 Matthias Neusinger Phase Coding in MPS Johannes Hilpert The listening test showed results at 24 kb/s and 32 kb/s stereo. The results showed that the mean performance of RM+CE is better than the mean performance of RM at the 95% level of confidence when averaged over all test items. When looking at each test items, none performed worse and some performed better at the 95% level of confidence. Eunmi Oh, Samsung, presented JungHoe Kim Report on Phase Coding in MPEG Surround for Julien Robilliard m16374 USAC Eunmi Oh Bernhard Grill The contribution described the proposed technology and presented listening test data. A summary of the technology follows: • can select fine or coarse phase quantization tables • decoder applies smoothing to unwrapped phase and uses linear interpolation in magnitude/phase domain The technology provides the following performance: • at 32 kb/s the IPD rate is 0.479 kb/s • at 24 kb/s the IPD rate is 0.271 kb/s The Samsung listening test result showed clear improvement for several items at the 95% level of significance for both bit rates and a clear improvement when scores for all items are pooled together. Kristofer Kjörling, Dolby, expressed some concern with the details of the decoding process, specifically that the phase smoothing component of the proposed technology was not discussed in previous contributions. Heiko Purnhagen, Dolby, and Werver Oomen, Philips, expressed similar concerns. The Chair asked Samsung, Dolby and Philips experts to have an off-line discussion and report back to the group on how best to proceed. Heiko Purnhagen, Dolby, presented Dolby Listening Test Results for USAC CE on AVQ- Heiko Purnhagen m16311 based LPC Kristofer Kjörling The contribution presented listening test results at 16 kb/s mono that showed no statistically significant differences between RM and RM+CE at the 95% level of significance. Markus Multrus, FhG, presented Fraunhofer IIS Listeningtest Results on USAC CE for Markus Multrus m16322 AVQ-based LPC Quantizer Ralf Geiger The contribution presented listening test results at 16 kb/s mono. The test included a 7.0 kHz LPF anchor and the two codecs comprising the VC (i.e. AMR-WB+ and HE-AAC) and showed no statistically significant differences between RM and RM+CE at the 95% level of significance. Philippe Gournay, VoiceAge, presented Philippe Gournay Bruno Bessette m16316 CE Report on LPC Quantization for USAC Roch Lefebvre Redwan Salami 128
  • 129. The contribution reviewed the CE technology, which is to replace the RM0 quantizer (based on trained codebooks) with an algebraic vector quantizer (AVQ). The advantages of AVQ are: • it uses less ROM (19456 32-bit words for RM0 vs 4096 32-bit words (first stage) and 1150 16-bit words (for the AVQ quantizer). • permits better control of spectral distortion (i.e. fewer outliers) The contribution presented objective data on spectral distortion for the AVQ coded excitation. The AVQ quantizer showed an order of magnitude fewer outliers (more that 1.5 dB spectral distortion) than the RM0 trained VQ quantizer. It is the consensus of the group to incorporate this technology into the USAC WD. Philippe Gournay, VoiceAge, presented VoiceAge Test Report for USAC CE on Unvoiced Philippe Gournay m16325 Coding Roch Lefebvre The contribution reports listening test results for two operating modes: 12 kb/s mono and 16 kb/s mono. Analysis of difference scores indicates that, at 12 kb/s mono, one test item is worse for the CE technology (at the 95 % level of significance), while at 16 kb/s there is no statistical differences. Single-sided tests of the differences between scores showed that for one item (es01) at 12 kb/s mono the hypothesis that the mean of the two systems were the same was rejected. The presenter acknowledged that the proposed technology is able to save bits, which is quite valuable. However, it may be that the hypothesis of modelling unvoiced speech by linear filtered Gaussian noise is not appropriate. Eunmi Oh, Samsung, presented Hosang Sung m16373 Report on Unvoiced Speech Coding for USAC Eunmi Oh Miyoung Kim The contribution presented the proposed CE technology, which consists of • Gaussian codebook of excitation vectors and gain factor for Low Energy segments (LEN) • Gaussian codebook of excitation vectors, gain factor and an additional LP filter for Unvoiced segments (UV) It reviewed the bit savings possible by using the CE technology • UV 408 bits saved per superframe (as compared to LPD mode) • LEN 88 bits saved per superframe (as compared to LPD mode) The contribution noted that the experiment could product bit-identical results, (except for UV and LEN coded segments), but because saved bits were fed back to the bit reservoir, the entire decoded waveform was different. It showed that the fraction of frames that are UV mode are a significant minority, with LEN quite a bit less. At 12 kb/s, the bitrate savings was as large as 0.92 kb/s, with 5 items larger than 0.5 kb/s savings. At 16 kb/s, the bitrate savings was as large as 1.15 kb/s, with 5 items larger than 0.5 kb/s savings. It presented a listening test results for 12 kb/s mono and 16 kb/s mono. At 12 kb/s an analysis of difference between RM and RM+CE, RM+CE showed better performance for two items, at the 95% level of significance. At 16 kb/s an analysis of difference between RM and RM+CE, RM+CE showed better performance for one items, at the 95% level of significance. The presenter noted that these results are quite different from those in the previous contribution. Samsung and VoiceAge will investigate the reason for these differences and report back at the next meeting. Samsung plans to bring more information to the next meeting that will make the CE a complete proposal and cross-check. 129
  • 130. 4 Task group activities 4.1 Joint meetings There were none. 4.2 Task Group discussions 4.2.1 MPEG-2, MPEG-4, MPEG-26 Audio, Audio Conformance, reference software Yuriy A. Reznik, Qualcomm, presented Yuriy A. Reznik m16441 Fast SBR filterbanks for AAC-ELD, HE-AAC, and USAC. Ravi K. Chivukula This contribution presents fast implementations for SBR filterbanks. Qualcomm will make software for the implementations available to MPEG. Yuriy A. Reznik, Qualcomm, presented m16443 On complexity of size 960 transform in AAC and related Yuriy A. Reznik codecs Ravi K. Chivukula This contribution presents information on the complexity of 960 length MDCT (as compared to 1024 length transform). The contribution concludes that there exist quite fast forms of a 960 length MDCT such that, when considering a count of multiplies and adds, the 960 length is less complex than the 1024 length by nearly a factor of 2. Ralph Sperschneider, FhG, presented m16299 Defect report on ISO/IEC14496-26 ralph.sperschneider@iis.fraunhofer.de This contribution presents two issues that need correction in the new MPEG-4 part 26, Audio Conformance: • al15 should not have an independently switched coupling channel (but it does). It is proposed to remove this sequence. • For the PNS conformance test procedure, the analysis window must be made dependent on the frame length. This change impacts both the standard text which describes the conformance test procedure and the related conformance testing software. It was the consensus of the Audio Subgroup to issue a Study on 14496-26/DCOR 1 that contains these changes. 960/1024 frame length discussion Kristofer Kjörling, Dolby, presented • Define a new profile “Common AAC Profile” (which is equivalent to what is currently HE-AAC v2) • For three existing profiles (…). “Streams conforming to this profile shall not used the 960 length MDCT transform. For maximum interoperability decoders should support the Common AAC Profile in preference to this profile. The Chair will seek guidance from the Convenor as to whether the planned actions are appropriate. Kristofer Kjörling, Dolby, will bring additional information concerning which fielded products explicitly claim conformance to one of the family of MPEG-4 AAC profiles and the whether the fielded products using AAC or HE-AAC technology support both block lengths. Andreas Schneider, Dolby, presented proposed clarification on byte alignments in LOAS m16315 Toshiyuki Nomura streams The contribution notes that MPEG-4 defines two functions for byte alignment: • ByteAlign() • byte_alignment() It is very desirable that • there be only one function for byte alignment • that it is unambiguous which bit is the reference bit for byte alignment • that what is specified in the textual description is the same as what is implemented in the reference source code The contribution proposes to issue a DCOR against MPEG-4 Audio to • byte align to the first bit in the raw data block • use only one function to do so The contribution proposes to issue a DCOR against MPEG-4 Reference Software to • align software to text 130
  • 131. It was the consensus of the Audio Subgroup to DCOR against MPEG-4 Audio and to incorporate any needed changes to MPEG-4 Reference Software into ISO/IEC 14496-5:2001/FDAM 24, MPEG-4 AAC ELD. 4.2.2 MPEG-D Spatial Audio Object Coding It was confirmed that a response to the German NB could be to incorporate the requested technology into SAOC over the course of the next two MPEG meetings and to re-issue the SAOC FCD shortly after the 89th MPEG meeting. 4.2.3 MPEG-D Unified Speech and Audio Markus Multrus, FhG, presented Proposed Additions to and Corrections of the USAC Stefan Bayer m16321 Reference Software Markus Multrus This contribution proposes to add a software implementation of the Time Warped MDCT module for the encoder. As a second point, it identifies a bug in • the buffer reset/update flag • TW-MDCT incorrect delay handling These bugs have no impact on the RM0 bitstreams since RM0 never used these modes. Finally, it notes that there are currently two MDCT implementations in the RM0 code base. It proposes to merge these two such that only one code base is used. It was the consensus of the Audio Subgroup to accept these corrections and additions into the RM reference software. The Chair presented m16434 Draft Revised Audio CE Methodology Schuyler Quackenbush The Chair highlighted areas of the document that need study and input from the group. It was agreed in principal that it is of paramount importance that the revised document serve USAC, but that it also be as generic as possible while at the same time carry forward the minimum of “special case conditions” for old work items (e.g. lossless coding). Kristofer Kjörling, Dolby, presented Progress report on harmonic transposer CE for the Kristofer Kjörling m16314 USAC work item Max Neuendorf The contribution reports on status of this CE. The proponents expect to have a complete CE submitted to the next MPEG meeting. Kei Kikuiri, NTT DoCoMo, presented Kei Kikuiri Core Experiment Proposal on the eSBR module of m16397 Kousuke Tsujino USAC Nobuhiko Naka This contribution describes a CE to add a new tool to the eSBR module. It notes that, currently, the eSBR module can only adjust the temporal enveolope in the SBR sample domain with a granularity of 2 subband samples. This is not as fine a granularity as is provided in the LP time-domain coding tool and may be an issue when coding speech signals. What is proposed is enhanced Temporal Envelope Shape, similar to what is present in MPEG Surround. A listening test shows the performance of the new tool. It showed improvement for 1 of 4 speech items in the test at the 95% level of significance. It reports that the TES tool requires an additional 2 bits per SBR envelope per channel (approximately 90 bps), and has some modest increase in complexity. The control of TES was done as a stand-alone module that operated on the RM0 bitstreams. The Chair asked the group which operating modes and test items should be used to assess the performance of this CE. The Chair asked for which test items was Beta different from zero (i.e. the TES tool was active). Hyunkook Lee, LG, presented Sungyong Yoon m16446 Core experiment proposal on arithmetic coding Hyunkook Lee Younghee Choi 131
  • 132. This contribution proposes a CE in which the USAC global gain and differential scale factors are coded using arithmetic entropy coding rather than Huffman entropy coding. It reported an average bitrate savings of 0.39 percent. The Chair asked what fraction of the reported gain is due to compressing the 8-bit PCM global gain. A question was raised as to the corpus that was used to train the arithmetic coder. The Chair suggested that, in the workplan, that the CE proponent supplies a corpus of material to the RM proponent to encode and then supply the resulting bitstreams to the CE proponent. Kristofer Kjörling, Dolby, noted that there is potentially room for major improvements in the signal processing in USAC. The proposal will be discussed again during the week when additional information is available (i.e. 1) exclude global gain and 2) reset between coding scale factors and spectral coefficient. Further discussion Later in the week, Hyunkook Lee, LG, presented additional information on their CE. He showed a detailed performance table, and the average over all test items and operating modes is shown here: 1 Item 2 G 3 S 4 S 5 All F F O n a l n y d S p e c t r a l 6 Average 7 0 8 0 9 0 10 0.4 compres . . 0% sion 0 1 gain 9 8 % % Kristofer Kjörling, Dolby, noted that the proposal appears to offer limited compression advantage, and hence does not recommend any action at this time. The Chair noted suggested that the group should consider • whether global gain should remain a 8-bit PCM value • whether there should be a reset between SF and Spectral entropy coding • the extent that it is advantageous to have one and only one entropy coder (i.e. arithmetic coding) • whether channel errors should be considered when changing bitstream elements It was the consensus of the Audio Subgroup to study the above questions (bullet items) as part of the workplan on this CE. An additional element of the workplan is that LG will give RM proponent a training corpus to encode at 9 operating modes with bitstreams returned to LG. Herve Taddei, Huawei, presented Herve Taddei m16338 Huawei Core Experiment proposal for USAC Dejun Zhang 132
  • 133. Minjie Xie This contribution proposes a pulse indexing technique for coding the excitation in the ACELP coding mode. The proposed technology is lossless and shows a bit savings of 32 to 64 bits per super-frame. It proposes to use the pulse indexing tool when there are more than 5 pulses per track, which typically occurs in the higher bitrates where ACELP is employed. Phillipe Gournay VoiceAge, noted that a savings of 64 bits per superframe corresponds to a bitrate savings of much less than 3 kb/s. He further noted that the current RM0 bitstreams either do not ever use the modes cited in the contribution. The Chair suggested it would be very desirable to report the bitrate savings as weighted by the relative frequency that the coding mode occurred in the RM0 bitstreams. What the group suggests as additional information can be captured in the Workplan. Additional discussion Herve Taddei, Huawei, presented additional information on the performance of this proposed tool. Philip Gournay, VoiceAge, noted that the proposed complexity reduction is modest when put in the context of the complexity of the entire decoder. The Chair noted that it would be very useful information to show the benefits delivered by the proposed tool in the context of operating the USAC system over the test set at some operating mode (bitrate for mono or stereo). Bernhard Grill, FhG, noted that if these modes are never used then removing them would give an even bigger complexity reduction. Kristofer Kjörling, Dolby, commented that the proposed CE is improving on a mode that is not used at any time for the set of operating modes and test items. It was agree that the RM proponent will run the USAC RQE from 12 to 64 at 4kbps increments for the CfP test set and report the relative frequency of the AMR-WB+ coding modes. This will be captured in the USAC Workplan. Ralf Geiger, FhG, presented Jeremie Lecomte Max Neuendorf m16439 Proposed improvements to WD2 of USAC Ralf Geiger Markus Multrus The contribution proposes a new method for handling the transitions between wLPT (i.e. TCX) mode in LPF to FD coding modes. Currently transitions from LPD to FD have an overhead of 128 samples and necessitate at 1152 length MDCT, which is more complex than a 1024 MDCT. LPD (ACELP) to FD requires a 128 sample overhead for overlap. This transition is not affected by the proposal. LPD (TXC) to FD discards 128 samples and overlaps 128 samples. The discarded 128 samples are not needed if the TDAC would actually work (i.e. TDAC by the frequency domain data). The contribution shows that by exchanging the order of MDCT and LP filtering, a proper TDAC overlap can be achieved. A listening test at 24 kb/s mono for test items that actually entailed a TCX to FD transition showed no audible difference at the 95% level of significance. It was noted that these transitions occur infrequently. In those frames affected, it showed an average a bit savings of 2.5%, and overall showed a savings of 500 bits per second. In a similar sense of the comment made by the Chair for m16338, Huawei suggested that it would be very desirable to report the bitrate savings as weighted by the relative frequency that the coding mode occurred in the RM0 bitstreams. Experts noted that, with this contribution, the transition from LPD to FD can be done in a critically sampled way, but that the transition from FD to LPD is still done in a non-critically sampled way. Kristofer Kjörling, Dolby, noted that a solution that permits the T/F coefficients to remain in critically sampled mode would be very desirable, even if bitrate savings were modest. This topic will continue to be discussed. Further discussion 133
  • 134. Max Neuendorf, FhG, presented new information on the relative frequency of this window transition for the 9 operating modes when coding the CfP items. On average, there were approximately 10 such transitions for each operating mode for the set of concatenated items. Juergen Herre, FhG, noted that a CEs cannot necessarily be judged on compression efficiency alone, but rather there may be an engineering design issue (i.e. “clean design”) that may also play a factor. Herve Taddei, Huawei, urged the group to insure that all CEs are treated fairly and judged using the same decision criterion. The Chair noted that he very much agreed with this comment. Eunmi Oh, Samsung, presented JungHoe Kim Julien Robilliard m16376 Proposed Changes to WD2 for Phase Coding Eunmi Oh Bernhard Grill This contribution relates to previously presented contributions m16312, m16339, m16456, m16374. First the presenter showed additional listening test results when all listening test sites are averaged together. The pooled results showed that the performance of RM+CE, at the 95% level of significance: • at 24 kb/s stereo, six items were better than RM, one was worse and the overall average was better • at 32 kb/s stereo, seven items were better than RM, none were worse and the overall average was better The contribution presents WD changes needed for the Phase Coding CE (syntax tables and decoding semantics text). Kristofer Kjörling, Dolby, noted that the syntax in the contribution shows MPEG Surround pilot-based coding apparently used with IPD parameters. The presenter will check whether this is intentional or is an editing error. The Chair verified that the following issues must be addressed before experts can make a final decision on this CE: • clarify pilot-based syntax • clarify whether syntax and sematics are consistent (e.g. bsIPDdataMode[][]) • experts at Philips and Dolby will assess whether smoothing gives benefit for a critical item Further discussion Eunmi Oh, Samsung, presented additional information about the above bullet items: • pilot-based syntax: it was clarified that pilot-base coding is not used in phase coding, so that this syntax item will be set to zero. • whether syntax and sematics are consistent: a number of inconsistencies were identified and corrected. • assess whether smoothing gives benefit for an example critical item: It was decided to retain smoothing and to add an additional threshold that selects between fine and coarse quantization tables. Heiko Purnhagen, Dolby, requested that he have access to the bitstreams and decoder to verify performance of the technology. It was agreed to make the bitstreams for 24 kb/s stereo and 32 kb/s stereo and the associated decoder executable available to Dolby and Philips no later than May 1 so that experts at one or both companies can perform “sanity cross-check.” It is the consensus of the Audio Subgroup to accept this CE into the RM pending a positive outcome of the bitstream/decoder cross-check. Workplan for MPEG Reference Encoder Software The Chair drafted text for a Workplan for MPEG Reference Encoder Software. Max Nuendorf, FhG, indicated that the software supplied in m16321 had all signal flow modules 134
  • 135. present, such that if appropriate control software modules are added the software could achieve the quality of a Reference Quality Encoder. This software will be committed to the SVN server as the first item in the workplan. To organize tasks in the AhG period, a table of USAC encoder control modules was made. For each module in the table, companies stated their commitment to supply improved versions of that module on or before the time of a given MPEG meeting. SVN Repository and USAC Software The Chair constructed an directory tree for the MPEG Audio software in a form that facilitated committing it to the MPEG SVN server. In this framework: • The location of MPEG-1, -2 and -4 -7 Reference Software indicated in a “ReadMe.txt” file, since it exists as tar archive “snapshots” on an external ftp server. • The USAC Reference Software is on the SNV server In the “Workplan for MPEG Reference Encoder Software” there is a milestone to commit test vectors (i.e. conformance bitstreams and reference waveforms) to the SVN server so that there is a framework to confirm the correct operation of the normative decoder. Audio CE Methodology for USAC Juergen Herre, FhG, presented his edited version of the CE Methodology, as did Heiko Purnhagen, Dolby. These two versions were merged in a break-out and reviewed by the group. An additional round of editing and review was done Thursday afternoon. 4.2.4 Exploration: Meta-Data Stephan Schreiner, FhG, presented Proposed new Architecture of Metadata Driven Audio m16334 Stephan Schreiner Post-Processing This contribution discusses conventional practice in the audio industry. One step is mastering, which indicates application of e.g. compression, equalization or balance and level adjustment In one conventional practice, a stereo mix is produced and mastering is applied to that mix. In another, an intermediate step is introduced of producing stem mixes (“stems”), e.g. of similar sounds, mastering is applied to the stems and then the result is used to produce a final stereo signal. Post-processing is “mastering on the playback side” which can be done in the decoder or player. When considering this in practice, the contribution suggests that there may be an advantage to adopting the Stem-Mastering methodology. The contribution notes opportunities for standardization might be: • metadata bitstream syntax • separator/discriminator data (i.e. re-create “stems”) • manipulators (e.g. compression functions) • profiles appropriate to classes of applications Hyunkook Lee, LG, asked if it is necessary to transmit the stem signals if it is expected that the metadata would manipulate the stem signals. He further noted that mastering engineers would typically wish to use proprietary, state-of-the-art dynamics processors (e.g. compressors). Pierrick, Philippe, Orange Labs, noted that one of the figures in the contribution looks surprisingly like the Interactive Music MAF, and asked if this work it is the intention to extend this MAF. Kristofer Kjörling, Dolby, noted that a broadcaster that aggregates for broadcast will do significant post-processing (e.g. level adjustment, time-stretching, program insertion), and metadata should serve that purpose. He further noted that each National Body that has broadcasting members should try to submit information on current practice. Kate Grant, Nine Tiles, noted that IEC 62379 specifies ways to support audio metadata in the broadcasting chain. 135
  • 136. Mukta Kar, CableLabs, noted that metadata should have a low datarate, be linked and synchronized to the audio representation and be easily accessible (e.g. easy to extract from compressed bitstream or available as a readily accessible side-information stream). He noted that audio might learn about current practice in e.g. ATSC specification. 5 Audio closing plenary discussions 6 Meeting deliverables 6.1 Responses to Liaison and NB comments The responses to Liaison and NB comments were prepared and approved. 6.2 Recommendations for final plenary The Audio recommendations were presented and approved. 6.3 Establishment of Ad-hoc Groups The following ad-hoc groups were established by the Audio subgroup: No. Title Mtg 10667 AHG on Audio Standards Maintenance No AHG on Unified Speech and Audio Coding and Spatial Audio Yes 10668 Object Coding 6.4 Approval of output documents All output documents, shown in 7.4, were presented in Audio plenary and were approved. 6.5 Press statement There was no Audio contribution to the press statement. 7 Future activities 7.1 Schedule of future meetings Ad Hoc group meetings are indicated in Section 6.3. Unless otherwise indicated, Ad Hoc group meetings will be held at the location of the next MPEG meeting on the weekend preceding that meeting. 7.2 Agenda for next meeting The agenda for the next MPEG meeting is shown in Annex F. 7.3 All other business There was none. 7.4 Closing of the meeting The 88th Audio Subgroup meeting was adjourned Friday at 12:30! 136
  • 137. Annex AParticipants First Name Last Name Country Affiliation Bruno Bessette CA Voiceage Corporation Ti Eu Chan SG I2R Yujie Dun CN XJTU Ralf Geiger DE Fraunhofer IIS VoiceAge Corp. / Univ. of Philippe Gournay Canada Sherbrooke Bernhard Grill DE Fraunhofer IIS Oliver Hellmuth DE Fraunhofer IIS Jürgen Herre DE Fraunhofer IIS Jeff Huang USA Qualcomm Inc. Kyeong Ok Kang Korea ETRI Kei Kikuiri JP NTT DOCOMO Kristofer Kjörling SE Dolby Hyunkook Lee KR LG electronics Taejin Lee KR ETRI Tilman Liebchen DE LG Electronics Takehiro Moriya JP NTT Markus Multrus DE Fraunhofer IIS Max Neuendorf DE Fraunhofer IIS Toshiyuki Nomura JP NEC Takeshi Norimatsu JP Panasonic Eunmi Oh KR Samsung Philips Applied Werner Oomen NL Technologies Pierrick Philippe FR France Telecom R&D Heiko Purnhagen SE Dolby Schuyler Quackenbush USA ARL Andreas Schneider DE Dolby Stephan Schreiner Germany Fraunhofer IIS Jeongil Seo KR ETRI Haiyan SHU Singapore I2R Ralph Sperschneider DE Fraunhofer IIS Herve Taddei DE Huawei Technologies Oliver Wuebbolt DE Thomson Minjie Xie USA Huawei Panasonic Singapore Huan Zhou SG Laboratories 137
  • 138. Annex BAudio Contributions and Schedule Day / Time Task Group Sunday 1000-1800 AhG: SAOC and USAC 1000-1130 SAOC Leonid Terentiev Clarifications regarding the enhanced Karaoke/Solo Jürgen Herre m16310 processing mode Cornelia Falch Oliver Hellmuth Jonas Engdegård Heiko Purnhagen Cornelia Falch Leonid Terentiev m16309 Report on corrections for the MPEG SAOC FCD text Andreas Hölzer Oliver Hellmuth Johannes Hilpert Jeroen Koppens Jeongil Seo m16363 Test Sequence Proposal for SAOC Verification Test Kyeongok Kang Kevin SeungChul Ham m16384 Details of NB Position on SAOC Ballot Juergen Herre for GNB 1130-1300 USAC Discussion on CE acceptance process Max Neuendorf m16324 Comments on new USAC reference bitstreams Markus Multrus Report on Merge of sys2 Technology into RM0: SBR Max Neuendorf m16323 Improvements Taejin Lee Report on Merge of sys2 Technology into RM0: TCX Taejin Lee m16383 Improvements Max Neuendorf 1300-1400 Lunch Dolby Listening Test Results for USAC CE on Phase Heiko Purnhagen m16312 Coding in MPS Kristofer Kjörling Philips Listening Test Results for USAC CE on Werner Oomen m16339 Phase Coding in MPS Jeroen Koppens Julien Robilliard Fraunhofer Listening Test Results for USAC CE on m16456 Matthias Neusinger Phase Coding in MPS Johannes Hilpert JungHoe Kim Report on Phase Coding in MPEG Surround for Julien Robilliard m16374 USAC Eunmi Oh Bernhard Grill Dolby Listening Test Results for USAC CE on AVQ- Heiko Purnhagen m16311 based LPC Kristofer Kjörling Fraunhofer IIS Listeningtest Results on USAC CE for Markus Multrus m16322 AVQ-based LPC Quantizer Ralf Geiger Philippe Gournay Bruno Bessette m16316 CE Report on LPC Quantization for USAC Roch Lefebvre Redwan Salami VoiceAge Test Report for USAC CE on Unvoiced Philippe Gournay m16325 Coding Roch Lefebvre Hosang Sung m16373 Report on Unvoiced Speech Coding for USAC Eunmi Oh Miyoung Kim Review of AhG Report and Presentation Schuyler Quackenbush 1800- Chairs Meeting 138
  • 139. Monday 0900-1230 MPEG Plenary 1300-1400 Lunch 1400-1430 Audio Plenary Welcome Report on Sunday Chairs meeting Review main tasks for the week General documents m16433 87th MPEG Audio Report S. Quackenbush m16245 Ad Hoc Group on Audio Standards Maintenance R. Sperschneider m16246 Ad Hoc Group on SAOC, USAC S. Quackenbush NB Position Papers Swedish NB comment in response to Resolution m16297 Swedish NB via SC 29 Secretariat 3.1.2 in N10312 1430-1500 Plenary Items Profiles and 960/1024 xform lengths SAOC timetable Normative start-up and shut-down SVN repository for audio 1630-1800 MPEG-2, MPEG-4 and MPEG-26 Fast SBR filterbanks for AAC-ELD, HE-AAC, and Yuriy A. Reznik m16441 USAC. Ravi K. Chivukula On complexity of size 960 transform in AAC and Yuriy A. Reznik m16443 related codecs Ravi K. Chivukula ralph.sperschneider@iis.fraunhofer. m16299 Defect report on ISO/IEC14496-26 de Proposed Additions to and Corrections of the USAC Stefan Bayer m16321 Reference Software Markus Multrus m16434 Draft Revised Audio CE Methodology Schuyler Quackenbush 1800- HoD Meeting Tuesday 0900-1000 USAC Progress report on harmonic transposer CE for the Kristofer Kjörling m16314 USAC work item Max Neuendorf Kei Kikuiri Core Experiment Proposal on the eSBR module of m16397 Kousuke Tsujino USAC Nobuhiko Naka Sungyong Yoon m16446 Core experiment proposal on arithmetic coding Hyunkook Lee Younghee Choi Herve Taddei m16338 Huawei Core Experiment proposal for USAC Dejun Zhang Minjie Xie Jeremie Lecomte Max Neuendorf m16439 Proposed improvements to WD2 of USAC Ralf Geiger Markus Multrus 1100-1200 Workplan on MPEG Reference Encoder 1200-1400 Lunch 139
  • 140. 1400-1500 960/1024 frame length 1430-1500 Maintenance proposed clarification on byte alignments in LOAS m16315 Toshiyuki Nomura streams 1500-1800 USAC JungHoe Kim Julien Robilliard m16376 Proposed Changes to WD2 for Phase Coding Eunmi Oh Bernhard Grill 1800- Chairs Meeting Wednesday 0900-1100 MPEG Plenary 1130-1230 Exploration: Metadata Proposed new Architecture of Metadata Driven Audio m16334 Stephan Schreiner Post-Processing 1230-1400 Lunch 1400-1430 SVN breakout (SQ, MM, YR, PP, HT, MN) MPEG Reference Encoder Software 1430-1600 Revised CE Methodology 1800-2100 Social Aloha Pavilion and Ko’ala Thursday 0900-1200 Open Issues Pulse indexing in ACELP MPEG Reference Encoder Software Revised CE Methodology 1200-1400 Lunch Arithmetic coding of SFs Transitions of wLPT to FD Phase coding in MPEG Surround 960/1024 issues 1800- Chairs Meeting Friday 0900-1300 Audio plenary Remarks on Thursday Chairs meeting Recommendations for final plenary Establishment of new Ad-hoc groups AhG Mandates Get document numbers 1000 Approve Responses to NB comments and Liaison Approval of output documents Title: N10xxx 1030 File: w10xxx (short title).doc (NOT *.docx!) Zip: w10xxx.zip Review of Audio presentation to MPEG plenary Agenda for next meeting A.O.B. Closing of the Audio meeting 140
  • 141. 1300-1400 Lunch 1400- MPEG Plenary 141
  • 142. Task Groups 1. MPEG-2 and MPEG-4 Audio, MPEG Audio Conformance, MPEG reference software 2. MPEG-D Spatial Audio Object Coding 3. MPEG-D Unified Speech and Audio Coding 4. Exploration: Meta-Data 142
  • 143. Annex COutput Documents No. Title TBP Available 14496-3 Audio 10650 ISO/IEC 14496-3:2009/DCOR 1:200X Byte Alignment No 09/04/24 Study on ISO/IEC 14496-3:2009/ FPDAM 1:200x, HD-AAC No 09/04/24 10651 Profile, MPEG Surround Signaling 10652 WD on AAC family of profiles No 09/04/24 14496-5 Reference Software 10653 DoC on ISO/IEC 14496-5:2001/FPDAM 24, MPEG-4 AAC ELD No 09/04/24 10654 ISO/IEC 14496-5:2001/FDAM 24, MPEG-4 AAC ELD No 09/05/24 14496-26 Audio Conformance 10655 Request for Amendment, 14496-26:2009/PDAM 2 No 09/04/24 ISO/IEC 14496-26:2009/PDAM 2, BSAC Conformance for No 09/04/24 10656 Broadcasting Study on ISO/IEC 14496-26:2009/DCOR 1, ALS, SLS and AAC No 09/04/24 10657 updates 23003-1 MPEG Surround 1065 Study on ISO/IEC 23003-1:2007/DCOR 2, Misc. Corrections No 09/04/24 8 23003-2 SAOC 1065 Study on ISO/IEC FCD 23003-2:200x, Spatial Audio Object No 09/04/24 9 Coding 1066 Status and Workplan on SAOC Core Experiments No 09/04/24 0 23003-3 Unified Speech and Audio Coding 10661 WD3 of USAC No 09/05/24 10662 Workplan for USAC CEs No 09/04/24 10663 Workplan on MPEG USAC Reference Encoder No 09/04/24 10664 MPEG Audio CE methodology No 09/04/24 10669 MPEG Audio Test Material for Core Experiments No 09/04/24 Liaison Statements 10665 Response to IEC TC-100 on IEC CDV 62571 No 09/04/24 Responses to National Bodies 10666 Response to Swedish NB on 960 and 1024 block lengths No 09/04/24 143
  • 144. Annex DAgenda for the 89th MPEG Audio Meeting Agenda Item 1. Opening of the meeting 2. Administrative matters 2.1. Communications from the Chair 2.2. Approval of agenda and allocation of contributions 2.3. Review of task groups and mandates 2.4. Approval of previous meeting report 2.5. Review of AhG reports 2.6. Joint meetings 2.7. Received national body comments and liaison matters 3. Plenary issues 4. Task group activities 4.1. MPEG-1, MPEG-2, MPEG-4, and MPEG-26 4.2. Spatial Audio Object Coding 4.3. Unified Speech and Audio Coding 4.4. Exploration: Meta-Data 5. Discussion of unallocated contributions 6. Meeting deliverables 6.1. Responses to Liaison and NB comments 6.2. Recommendations for final plenary 6.3. Establishment of new Ad-hoc groups 6.4. Approval of output documents 6.5. Press statement 7. Future activities 8. Agenda for next meeting 9. A.O.B 10. Closing of the meeting 144
  • 145. Annex I – 3DG report Source: Marius Preda, Chair 1 Opening of the meeting 1.1 Approval of the agenda The agenda is approved. 1.2 Goals for the week The goals of this week are: Review SC-3DMC contributions and issue the associated study of CD (and CE?!) Discuss the software and conformance for SC-3DMC Discuss FAMC, Scene Partitioning RefSoftware and Conformance (?!) Status of software implementation in MP25 (especially the IC integration issues) Commit the last version of the reference software (IM1) on the SVN Check the code for the hierarchical compression mode for 3DMC Finish 14496-27 Check the validity and re-generate when necessary conformance data for 3DGC AFX 3rd Edition Investigate future developments of MPEG 3D Graphics Compression Review new representation (IndexedRegionSet) and codec (SIM) Review RGC (reconfigurable graphics codec) contribution 3D Graphics MXM Engine Avatar characteristics Review Liaisons Review the votes 1.3 Standards from 3DGC 4 5 2001 Amd.22 3DG Compr. Model 06/07 08/01 08/07 09/02 3 RefSof 4 4 200 Cor.7 (Audio & 3DG) 09/02 09/07 3 x 4 5 200 Amd.2 Scene partitioning 08/10 09/02 09/07 3 1 5 RefSof 4 5 200 Amd.2 XXXXXXXXX 09/04 09/10 10/04 3 x 6 145
  • 146. 4 5 200 Amd.2 Scalable compl. 09/02 09/07 10/01 3 x 7 3DMC RS 4 1 200 Amd.4 Scalable complexity 08/01 08/10 09/02 09/07 10/01 3 6 6 3D mesh coding 4 1 200 3rd Ed. AFX 07/10 09/04 3 6 x 4 2 200 Amd.1 Scene partitioning 08/10 09/02 09/07 3 7 x conformance 4 2 200 Amd.2 Scalable compl. 09/02 09/07 10/01 3 7 x 3DMC conformance 1.4 Room allocation 3DGC: Pioneer 146
  • 147. 1.5 Allocation of contributions 147
  • 148. 148
  • 149. N° Title Schedule D1 Monday D1 MPEG Plenary 09:00~11:30 Lunch Break 13:00~14:00 3DG Plenary 14:00~15:00 Roll call, Agenda, Goals, FAQ, etc., Marius Preda Report of AHG on 3DGC documents, experiments and m16238 Patrick Gioia, Francisco Moran software maintenance Results of voting Marius Preda 15:00 – Scalable Complexity 3D Mesh Encoding (SC-3DMC) 18:00 CE Report on SC3DMC Ver 4.0 Seungwook Lee, Bonki Koo, Daiyong Kim, m16399 Kyoungsoo Son, Euee S. Jang Seungwook Lee, Bonki Koo, Kyoungsoo m16401 Algorithm descriptions of attribute data on SC3DMC Son, Daiyong Kim, Euee S. Jang Daiyong Kim, Kyoungsoo Son, Seungwook m16404 Update and current status of SC3DMC Lee, Bonki Koo, Euee S. Jang Walid Hachicha, Khaled Mammou, Titus m16466 Optimized implementation of the TFAN encoder Zaharia Khaled Mamou, Titus Zaharia, Marius m16435 TFAN bitstream syntax update Preda, Françoise PRETEUX D2 Tuesday D2 Scalable Complexity 3D Mesh Encoding (SC-3DMC) 09:00~12:00 Fast Array Encoder (FAE): an efficient extension to the QBCR m16337 Khaled Mamou, Faouzi Ghorbel compression technique m16436 FAE software description Khaled Mamou, Faouzi Ghorbel CE Report on SC3DMC: FAE versus QBCR, QBCR BP and m16490 QBCR AC Khaled Mamou, Faouzi Ghorbel Seungwook Lee, Bonki Koo, Kyoungsoo m16402 QBCR and SVA bitstream syntax update Son, Daiyong Kim, Euee S. Jang Wrap-up on SC-3DMC Lunch Break 12:00~14:00 Seungwook Lee, Bonki Koo, Kyoungsoo Joint with Video on RGC 14:00 – m16403 Son, Daiyong Kim, Mingxiao Chen, Euee S. 15:00 Jang Joint with System on MPEG-V Blagica Jovanova, Marius Preda, Françoise 15:00 – m16425 Avatar Characteristics Preteux 16:00 Joint with Systems on MXM 16:00 – m16427 149 Ivica Arsov, Marius Preda Integrated API for 3D Graphics 17:00 IndexedRegionSet: Efficient Representation of Meshes with Sergio Arnaldo, Francisco Morán, Marcos 17:00 – m16305 Multiple Textures Avilés 17:15
  • 150. 150
  • 151. 1.6 Attendance list Name Country Company Marius Preda France Institut TELECOM Francisco Morán Burgos Spain UPM Seung Wook Lee Korea ETRI Euee S. Jang Korea Hanyang Univ. Byoungjun Kim Korea Hanyang Univ. D.Y. Kim Korea Hanyang Univ. Jeong-Hwan Ahn Korea Samsung Leon Denis Belgium VUB 2 General issues 2.1 General discussion 2.1.1 Reference Software It is recalled that the source code of both decoder AND encoder should be provided as part of the Reference Software for all technologies to be adopted in MPEG standards. Moreover, not providing the complete software for a published technology shall conduct to the removal of the corresponding technical specification from the standard. Currently almost all the AFX tools published in the second edition are supported by both encoder and decoder implementation. Only exception is the MeshGrid tool for the standalone decoder; however commitment was renewed by VUB, represented during this meeting by Leon Denis. 2.1.2 Web site OrangeLabs announced interrupting the maintenance of the group web-site. A call for volunteers is now issued. In the meantime 3DGC contributors are kindly asked to check the web-site and provide comments on the current version of the web-site. 3 Current Voting 151
  • 152. Document title DoC Editor of DoC No vote submitted for this meeting. 4 AFX (14496-16) related activities 4.1 AhG on AFX activities Title Report of AHG on 3DGC documents, experiments and software maintenance Authors Patrick Gioia, Francisco Moran Summary Resolution Accepted 4.2 Scalable Complexity 3D Mesh Compression (14496-16 Amd.4) Title CE Report on SC3DMC Ver 4.0 Authors Seungwook Lee, Bonki Koo, Daiyong Kim, Kyoungsoo Son, Euee S. Jang Objectives: - speed up the decoding of QBCR, solution consists in reading more bits at the time - add more parameter control on top of QBCR: delta prediction, entropy coding - encode attributes: two proposals: one for normal and one for texture Summary coordinates The normal encoding includes two prediction methods: difference and XOR and two binarization (BP and AC) The texture coordinates compression considers regular and not regular patches. The method is too complex for QBCR and SVA. Resolution Accept the proposed method for attributes encoding. Accept the delta prediction. Title Algorithm descriptions of attribute data on SC3DMC Authors Seungwook Lee, Bonki Koo, Kyoungsoo Son, Daiyong Kim, Euee S. Jang Summary Resolution See previous resolution Title Update and current status of SC3DMC Authors Daiyong Kim, Kyoungsoo Son, Seungwook Lee, Bonki Koo, Euee S. Jang Summary Resolution See previous resolution Title Optimized implementation of the TFAN encoder Authors Walid Hachicha, Khaled Mammou, Titus Zaharia Summary This contribution explains the dependency between encoder parameters and 152
  • 153. proposes to replace the exhaustive research for the optimal configuration with a near-optimal but faster approach. The contribution does not affect the bitstream syntax being related to the encoder. - accept the optimization as part of the RefSoft (Encoder side) Resolution - add the formula for computing k in the Informative Annex on TFAN encoder Title TFAN bitstream syntax update Authors Khaled Mamou, Titus Zaharia, Marius Preda, Françoise PRETEUX Summary Editorial changes are proposed for TFAN. - change the bitstream syntax for ensuring its byte-alignment Resolution - introduce a detailed annex on the arithmetic decoder Fast Array Encoder (FAE): an efficient extension to the QBCR compression Title technique Authors Khaled Mamou, Faouzi Ghorbel There extensions over the original QBCR are presented: - prediction of the current values with respect to up to 7 temporal neighbors Summary - a 4-bit alignment for speeding up the reading process - an AC combined with Exponential Golomb code Resolution see below Title CE Report on SC3DMC: FAE versus QBCR, QBCR BP and QBCR AC Authors Khaled Mamou, Faouzi Ghorbel - the proposed extension of QBCR (called FAE) shows an average gain of 30-40% over QBCR, 10-20% over QBCR BP and equivalent compression Summary results to QBCR AC - FAE AC offers the best compression performances with an average gain (in terms of bitrates) of 10-30% w.r.t FAE - introduce the 7th order prediction in QBCR - introduce mixed entropy encoding (AC+ExpGK) for QBCR and SVA Resolution - evaluate the BPC and 4-byte binarization for QBCR - maintain the fixed length binarization for QBCR in no prediction mode Title Wrap-up on SC-3DMC Authors all Summary 1. Updates for the textual specifications (study text): - introduce the different prediction modes for QBCR - new header structure: Resolution 2. Updates for CE: - add AC+ExpGK for QBCR and SVA - compare AC+ExpGK with BPC for coordinates and attributes - evaluate BPC over 4-bits binarization for QBCR 153
  • 154. 4.2.1 Scene partitioning (14496-11 Amd.6) SP is followed as a joint activity between Systems and 3DGC. The technology is integrated in Part 11. There was no joint meeting with Systems on this topic during this meeting. SP activity on conformance and reference software continued. 4.3 Maintenance 4.3.1 FAMC Conformance and Reference Software FNB reports on a problem related to FAMC reference software, namely the usage of little endian convention when writing the bitstream. This conducts to errors in parsing the FAMC bitstream when encapsulated in MP4. Resolution: issue a corrigendum on FAMC ref soft and conformance and ask the contributors to update the software and regenerate the bitstreams. 4.3.2 AFX 3rd Edition The document was updated during the week. Publication of the current version as FDIS (an editing period of 4 weeks is accepted). 4.4 Dataset and benchmarking For Scalable Complexity 3D Mesh Coding, the www.MyMultimediaWorld.com will be used for benchmarking. 4.5 Software Title Current status of MeshGrid compression software Authors Leon Denis A presentation of the current implementation (including a GUI) of MeshGrid Summary was demonstrated by VUB representatives. Some bugs still occur. The encoder was committed on the SVN Resolution Continue the work on standalone version of the MG decoder 4.6 Promotions 4.6.1 Web Site Title Status of www.mpeg-3dgc.com Authors Summary The web site is not more maintained by OrangeLab. Action Point: Transfer the web-site to other location and call for volunteers for Resolution maintanace. 154
  • 155. 4.7 Future 4.7.1 MPEG-V - Information Exchange with Virtual Worlds (formally Metaverse) Title Joint meeting with Systems on MPEG-V, Avatar Characteristics Authors Blagica Jovanova, Marius Preda, Françoise Preteux A rich schema for avatar metadata is proposed and all the elements are Summary documented. The XSD is accepted as it is. Update the WD of MPEG-V Avatar Characteristics Resolution accordingly. Title Avatar Characteristics updates Authors Jeong-Hwan Summary 1. Add FaceControlFeatureType as the set of outlines (HeadOutline, EyeOutline, LeftEarOutline, RightEarOutline, NoseOutline, UpperMouthLipOutline, LowerMouthLipOutline) 2. Define a new type OutlineType as three 3D points (left, middle, right) 3. Create BodyControlFeatureType based on SkeletonType. 4. Group BodyControlFeatureType and FaceControlFeatureType in AvatarControlType. Resolution 5. Add in element Moves the value FreeDirection (Move to arbitrary direction) 6. Add in type Appearance a new element called PhysicalCondition with two elements (BodyStrength from -3 to 3 and Flexibility with three levels (Low, medium, high) 7. Add in new element type in AvatarType called AvatarModel (1: Human, 2: Animal with 4 legs, 3: Bird, 4: Robot with Wheels, 5-255: undefined) 4.7.2 MXM Title Integrated API for 3D Graphics AuthorsIvica Arsov, Marius Preda A new version of the Graphics3D API, integrated in MediaFrameworkAPI is Summary presented Resolution Accepted. 155
  • 156. 4.7.3 Future directions of 3D Graphics Compression TitleJoint meeting with video on RVC Seungwook Lee, Bonki Koo, Kyoungsoo Son, Daiyong Kim, Mingxiao Chen, Authors Euee S. Jang A study on RVC based Graphics codec The main idea is to create a codec built on the graphics primitives' levels and not Summary on node definition. A preliminary list of graphics primitives was proposed. - start from the graphics primitives, identify the codecs we have already, identify the FU for each codec. - mandate in 3DGC AhG Resolution - a new Exploration on identifying the functional units to be documented in the CE document Title IndexedRegionSet: Efficient Representation of Meshes with Multiple Textures Authors Sergio Arnaldo, Francisco Morán, Marcos Avilés Summary A new representation of meshes is proposed Resolution Continue the exploration to identify the added value of the new representation Title Scalable Intra-band Mesh coding (SIMc) Authors Leon Denis Summary Resolution Continue the exploration for providing evidences of better compression results. 5 3D Graphics Compression Model (14496-25) activities 5.1 Software and conformance Title Comparison result of conformance test on the SVN Authors Daiyong Kim, Kyoungsoo Son, Seungwook Lee, Bonki Koo, Euee S. Jang All the bitstreams are classified with respect to their availability and corrected- Summary ness with respect to the last version of the RefSoft Resolution Contact the providers of the broken bitstreams and ask for new version. 156
  • 157. 6 Liaison Title Authors Summary Resolution 7 Output documents and Resolutions of 3DGC 7.1 Part 16 Animation Framework eXtension (AFX) 7.1.1 The 3DG subgroup recommends approval of the following documents No. Title TBP Available 14496-16 Animation Framework eXtension (AFX) 1052 Study Text of ISO/IEC 14496-16:2006/PDAM4 (Scalable No 09/04/24 8 Complexity 3D Mesh Compression) 1052 Description of AFX CE and explorations No 09/04/24 9 1053 ISO/IEC 14496-16 3rd Edition Yes 09/05/24 0 1053 MPEG 3D Graphics FAQ v22 Yes 09/04/24 2 7.2 Promotion 7.2.1 The 3DG subgroup recommends approval of the following documents No. Title TBP Available Promotion 1053 MPEG 3D Graphics Vision Yes 09/04/24 1 7.3 Establishment of 3DGC Ad-Hoc Groups 10533 AHG on 3DGC documents, software maintenance and core experiments Mandate: 1. Conduct the experiments in Scalable Complexity Mesh Compression 2. Coordinate 3DGC related conformance and reference software 3. Maintain and edit 3DGC documents 4. Coordinate editing of the www.mpeg-3dgc.com web site 5. Coordinate exploration activities related to RGC 157
  • 158. Chairman: Francisco Morán Burgos Duration: Until 89th Meeting Meetings Sunday before 89th meeting Reflector: mpeg-3dgc AT gti. ssr. upm. es Subscribe: https://mx.gti.ssr.upm.es/mailman/listinfo/mpeg-3dgc 8 Closing of the Meeting See you in London. 158

×