09a video compstream_intro_trd_23-nov-2005v0_2


Published on

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

09a video compstream_intro_trd_23-nov-2005v0_2

  1. 1. Video Compression and Streaming Brussels, November 23rd, 2005 G. Briand et al
  2. 2. <ul><li>Foreword (G. Briand – Thomson R&D France) </li></ul><ul><li>High end video encoding (H. Denieul – Nextream) </li></ul><ul><li>Versatile video decoding (JM Moutain – STM) </li></ul>
  3. 3. Outline <ul><li>Foreword </li></ul><ul><li>Context, standardization </li></ul><ul><li>Video compression and streaming in Medianet </li></ul><ul><ul><li>Rational and objectives </li></ul></ul><ul><ul><li>Main achievements </li></ul></ul><ul><li>Conclusion </li></ul>
  4. 4. Introduction (1/2 ) <ul><li>Tremendous explosion in R&D in the video compression field in the last 30 years </li></ul><ul><li>Video compression is now everywhere : </li></ul><ul><ul><li>TV broadcasting over cable, satellite or terrestrial networks, </li></ul></ul><ul><ul><li>CD-ROM, DVD, PC video storage, </li></ul></ul><ul><ul><li>Videophone and teleconferencing, </li></ul></ul><ul><ul><li>Internet streaming (VoD, IPTV), </li></ul></ul><ul><ul><li>Video over mobiles. </li></ul></ul>
  5. 5. Introduction (2/2) <ul><li>Some figures </li></ul><ul><ul><li>Uncompressed video -> big amount of data </li></ul></ul><ul><ul><ul><li>Color picture 800x320 pix, 24 bits/pix -> 6.3 Mbits </li></ul></ul></ul><ul><ul><ul><li>SDTV 720x480, 30Hz, 16 bits/pix -> 166 Mbit/s </li></ul></ul></ul><ul><ul><ul><li>HDTV 1920x1080, 30Hz, 16 bits/pix -> 1Gbit/s </li></ul></ul></ul><ul><ul><li>Communication and storage capacities limits </li></ul></ul><ul><ul><ul><li>Cable or satellite bandwidth : 38 Mbit/s </li></ul></ul></ul><ul><ul><ul><li>ADSL : 1 to 8 Mbit/s </li></ul></ul></ul><ul><ul><ul><li>DVD capacity : 5 to 8 GB </li></ul></ul></ul>
  6. 6. Standardization (1/2) Video codecs H.264/SVC SMPTE/VC1 2000’s 1990’s 1980’s 1970’s 1960’s Transform Coding 6 5/ 80 MC Prediction 72 / 89 Entropy Coding 49 / 76 H.261 MPEG-1 H.262/MPEG62 MPEG4 ASP H.263 H.264/AVC DVCPRO 1950’s DPCM 52 / 80 Technologies Standards Videophone 56Kb/s – 2Mb/s CD-ROM 1-1.5Mb/s Digital TV, DVD 4 to 80 Mb/s Camcorder, VTR 25 to 50 Mb/s Videophone 30 Kb/s Video streaming & post-prod 30 Kb/s to 600Mb/s Convergence of all video applications, digital cinema 30 Kb/s to 600Mb/s Wavelet 85/--
  7. 7. Standardization (2/2) DVB Transport 2001 1995 1997 1999 2003 2005 2007 2009 DVB-S DVB-C DVB-S2 DVB-T DVB-H DVB-IPI in progress Satellite TV Cable Mobile TV Terrestrial TV IPTV
  8. 8. Bit rate evolution Mbit/s 2001 0 1 2 3 4 5 6 1995 1997 1999 2003 2005 2007 MPEG-2 1 st generation encoders 1 st generation encoders 2 nd generation encoders MPEG-4/H.264 AVC MPEG-4 ASP C. Ratio from 4:2:2 166 28 <ul><li>Bit rate evolution for SDTV Broadcast </li></ul>3 rd generation encoders (advanced Pre-processing) 2 nd generation encoders (Stat-Mux + Rate control improvements) 2009
  9. 9. R&D process <ul><li>A virtuous cycle </li></ul>New applications Video compression research Lower bit rates Silicon technology evolution (ICs, DSPs)
  10. 10. Video compression and streaming in Medianet Rational <ul><li>Video is still a cumbersome media especially for new broadband access networks and with emerging HDTV </li></ul><ul><ul><li>Need for more compression efficiency </li></ul></ul><ul><li>Diversification of video formats, video coding standards, video quality requirements </li></ul><ul><ul><li>Need for more flexibility in codecs </li></ul></ul><ul><li>Heterogeneity of networks in terms of QoS, applications and services </li></ul><ul><ul><li>Need for better adaptation of video bitstreams </li></ul></ul>
  11. 11. Video compression and streaming in Medianet Objectives (1/2) <ul><li>Propose versatile platform architectures for video encoding and decoding </li></ul><ul><ul><li>New architecture models for codec platforms </li></ul></ul><ul><ul><li>Supporting a diversity of video coding standards and particularly the new MPEG-4 AVC/H.264 </li></ul></ul><ul><ul><li>Supporting multiple video formats </li></ul></ul><ul><ul><li>Targeting a diversity of applications </li></ul></ul><ul><li>Develop corresponding algorithm s for efficient video compression and video enhancement </li></ul><ul><ul><li>Algorithm studies covering new tools offered by MPEG-4 AVC/H.264 </li></ul></ul><ul><ul><li>Appropriate algorithms for error concealment and post-processing </li></ul></ul>
  12. 12. Video compression and streaming in Medianet Objectives (2/2) <ul><li>Propose new network adaptation concepts and algorithm for efficient video streaming over heterogeneous IP based networks </li></ul><ul><ul><li>For Unicast and Multicast applications, </li></ul></ul><ul><ul><li>Fully compliant with the new MPEG-4 AVC/H.264 video compression standard </li></ul></ul><ul><ul><li>Introduce new concepts of Video Playout in case of low QoS </li></ul></ul><ul><li>Propose standards evolution for improved video streaming </li></ul><ul><ul><li>Focusing on scalability of the bitstreams </li></ul></ul><ul><ul><li>While preserving compression efficiency </li></ul></ul>
  13. 13. Video compression and streaming in Medianet Tasks/ Partners over the streaming chain - Extension of H.264 for improved streaming Fraunhofer HHI - MP4 file format - Adaptive streaming - Unicast, Multicast Fraunhofer HHI, Thomson R&D Real time encoder - Advanced encoder architectures - MPEG-4 AVC/H.264 compression algorithm Nextream, Thomson R&D - Advanced decoder architectures - Post-processing - Erreur concealment Integrated receiver STMicroelectronics Univ. Bristol Off line MPEG-4 AVC/H.264 encoding Streaming Server for MPEG-4 AVC/H.264 MPEG-4AVC/H.264 decoding IP Network Adaptive Playout Politecnico Di Milano
  14. 14. Video compression and streaming in Medianet Outcomes (1/4) <ul><li>Advanced architectures for video encoding and decoding ( STMicroelectronics, Nextream, Thomson R&D) </li></ul><ul><ul><li>Common requirements between STM and Nextream </li></ul></ul><ul><ul><li>Particularly targeting next generation of MPEG-4 AVC/H.264 codecs </li></ul></ul><ul><ul><li>Flexible and reconfigurable architectures </li></ul></ul><ul><ul><ul><li>New concepts of SoC architecture introduced : mix of RISC and VLIW processors, new bus infrastructures </li></ul></ul></ul><ul><ul><ul><li>Highly programmable , open to firmware evolution to cope multi-standard, multi-format applications </li></ul></ul></ul><ul><ul><ul><li>Scalable generic architectures targeting many applications from studio production equipments to light platforms for mobile services </li></ul></ul></ul>
  15. 15. <ul><li>Algorithms for efficient video compression and video enhancement ( Thomson R&D, STMicroelectronics, Bristol University) </li></ul><ul><ul><li>Trade-offs between performance and complexity, studied in conjunction with architecture teams </li></ul></ul><ul><ul><li>Video encoding </li></ul></ul><ul><ul><ul><li>Based on MPEG-4 AVC/H.264 : 6 to10 times more complex than MPEG-2 standard </li></ul></ul></ul><ul><ul><ul><li>HVS pre-analysis tools for Region of Interest based encoding </li></ul></ul></ul>Video compression and streaming in Medianet Outcomes (2/4) <ul><ul><li>Post-processing </li></ul></ul><ul><ul><ul><li>New solutions for artefacts reduction and removal in the context of H.264 </li></ul></ul></ul><ul><ul><li>Error-concealment </li></ul></ul><ul><ul><ul><li>Particularly focused on new H.264 entropy coding solutions : CAVLC, CABAC </li></ul></ul></ul>Mbit/s 2001 0 1 2 3 4 2003 2005 2007 MPEG-2 2 nd generation encoders MPEG-4/H.264 AVC 3 rd generation encoders 1st generation encoders 2009
  16. 16. <ul><li>Efficient video streaming over heterogeneous IP based networks </li></ul><ul><ul><li>(Fraunhofer HHI, Thomson R&D, Politecnico di Milano) </li></ul></ul><ul><li>Covering Unicast & Multicast applications </li></ul><ul><ul><li>Unicast : full H.264 AVC streaming system with dynamic data rate adaptation for best effort networks – temporal scalability and bit stream switching – adaptive video playout </li></ul></ul><ul><ul><li>Multicast : using H.264 AVC transrating for adaptation to local network characteristics </li></ul></ul>Video compression and streaming in Medianet Outcomes (3/4)
  17. 17. <ul><li>Video coding evolution for improved streaming ( Fraunhofer HHI) </li></ul><ul><ul><li>Propose scalability tools upon H.264 AVC </li></ul></ul><ul><ul><li>Re-use of most H.264 tools </li></ul></ul><ul><ul><li>Temporal and SNR (quality) scalability preserving coding efficiency </li></ul></ul><ul><ul><li>Successful submission to MPEG-21 SVC (Scalable Video Coding). </li></ul></ul><ul><ul><li>Fraunhofer/HHI algorithm taken as a reference for further core experiments within JVT/H.264 SVC consortium. </li></ul></ul><ul><ul><li>Promising for future streaming system: simple adaptation to different bit-rates on a bit-stream level </li></ul></ul>Video compression and streaming in Medianet Outcomes (4/4 )
  18. 18. Conclusion <ul><li>Outcomes summary </li></ul><ul><ul><li>Advanced architectures for next generation of encoding-decoding IC’s, 2006-2007 </li></ul></ul><ul><ul><li>Improve video processing algorithms differentiating our offering - compression performance, add-ons for IC decoders </li></ul></ul><ul><ul><li>Fully compliant MPEG-4 AVC/H.264 end to end streaming chain coping with a large range of QoS – Unicast and Multicast </li></ul></ul><ul><ul><li>SVC coding scheme with efficient scalability tools opening-up to new concepts and strategies for future video streaming applications </li></ul></ul><ul><li>Dissemination </li></ul><ul><ul><li>Participation to Navshp in CG-4 </li></ul></ul><ul><ul><li>~15 participations to conferences, papers, trade fairs </li></ul></ul><ul><ul><li>Contribution to standardisation : focus on H.264/SVC and DVB-IPI </li></ul></ul>