Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

JPEG2000 Alliance IBC 2009


Published on

Getting Better Broadcast Picture Quality With JPEG2000

  • Be the first to comment

  • Be the first to like this

JPEG2000 Alliance IBC 2009

  1. 1. Getting Better Broadcast Picture Quality with JPEG2000
  2. 2. Alliance Members
  3. 3. Your Panelists <ul><li>Brian Campanotti </li></ul><ul><ul><li>CTO </li></ul></ul><ul><ul><li>Front Porch Digital </li></ul></ul><ul><li>John Dale </li></ul><ul><ul><li>Vice President Product Management </li></ul></ul><ul><ul><li>Media Links </li></ul></ul><ul><li>Siegfried Foessel Ph.D. </li></ul><ul><ul><li>Head of Group Digital Cinema </li></ul></ul><ul><ul><li>Fraunhofer Institute </li></ul></ul><ul><li>Andrew Lambrecht </li></ul><ul><ul><li>Segment Marketing Manager </li></ul></ul><ul><ul><li>Analog Devices </li></ul></ul><ul><li>Théodore Marescaux Ph.D. </li></ul><ul><ul><li>Video Business Manager </li></ul></ul><ul><ul><li>Barco </li></ul></ul><ul><li>Jean-Francois Nivart </li></ul><ul><ul><li>CEO </li></ul></ul><ul><ul><li>intoPIX </li></ul></ul><ul><li>Hal Reisiger </li></ul><ul><ul><li>President and CEO </li></ul></ul><ul><ul><li>Fast Forward Video </li></ul></ul><ul><li>Brian Stevenson </li></ul><ul><ul><li>Director, Product Management </li></ul></ul><ul><ul><li>Digital Rapids </li></ul></ul>
  4. 4. JPEG2000 Alliance <ul><li>Who </li></ul><ul><li>a consortium of technology leaders </li></ul><ul><li>Goal </li></ul><ul><li>JPEG2000 development into a leading compression standard </li></ul><ul><li>JPEG2000 widespread acceptance and deployment </li></ul><ul><li>How </li></ul><ul><li>educate and create awareness about the benefits of JPEG2000 </li></ul><ul><li>support of the compression standard for the benefit of the media and video industries </li></ul><ul><li>promote interoperability between standards and system devices </li></ul><ul><li>promote the development of tools by members and industry peers </li></ul>
  5. 5. About JPEG2000 <ul><li>License free </li></ul><ul><li>Open standard </li></ul><ul><li>Lossy and lossless compression </li></ul><ul><li>Error Resilient </li></ul><ul><li>Precise and adjustable bit rate control </li></ul><ul><li>Scalable </li></ul><ul><li>Low latency </li></ul><ul><li>Constant quality through multiple generations </li></ul><ul><li>Supports 4K resolution (and greater) </li></ul><ul><li>Up to 32-bits per component </li></ul><ul><li>Symmetric encode and decode </li></ul>
  6. 6. Mathematically Lossless Compression <ul><li>It enables a reduction in storage requirement of, on average, 1:2 while still being able to recover the exact original image information. </li></ul><ul><li>Extremely important feature in fields such as digital archiving, cinema acquisition and medical imaging. </li></ul><ul><li>Unique advantage in comparison to JPEG, MPEG2, MPEG4 </li></ul>
  7. 7. Scalability <ul><li>JPEG2000 is able to extract multiple versions out of a single compressed file </li></ul><ul><li>This scalability provides </li></ul><ul><ul><li>Easy proxy generation </li></ul></ul><ul><ul><li>Region of Interest </li></ul></ul><ul><ul><li>Bandwidth optimization and adaptive transmission </li></ul></ul>
  8. 8. Low Latency <ul><li>Intra-frame allows every frame to be encoded independently allowing latency of less than 1 frame </li></ul><ul><li>In comparison, inter-frame encoding formats (e.g. MPEG2, MPEG4) need to work with Groups of Pictures (GOP) that require a longer processing time </li></ul><ul><li>Low latency is a critical consideration in many applications </li></ul>
  9. 9. Constant Quality Through Multiple Generations <ul><li>Successive encoding-decoding passes are usually required throughout the Broadcast and Digital Cinema post-production processing chain </li></ul><ul><li>JPEG2000 provides a constant image quality throughout the production process </li></ul>
  10. 10. Related Standards Bodies <ul><li>Core Standards </li></ul><ul><ul><li>JPEG committee, part of ISO/IEC </li></ul></ul><ul><li>Theatrical movie distribution and playback </li></ul><ul><ul><li>Digital Cinema Initiatives, LLC (DCI) </li></ul></ul><ul><ul><li>JPEG </li></ul></ul><ul><ul><li>ITU </li></ul></ul><ul><ul><li>SMPTE </li></ul></ul><ul><li>Broadcast/transport standards & interoperability </li></ul><ul><ul><li>VSF </li></ul></ul><ul><ul><li>SMPTE </li></ul></ul><ul><ul><li>MPEG </li></ul></ul><ul><ul><li>EBU </li></ul></ul>
  11. 11. JPEG2000 ISO/IEC Standards <ul><li>ISO/IEC 15444-1: JPEG2000 Part 1, Core Coding System </li></ul><ul><li>ISO/IEC 15444-2: JPEG2000 Part 2, Extensions </li></ul><ul><li>ISO/IEC 15444-3: JPEG2000 Part 3, Motion JPEG2000 </li></ul><ul><li>ISO/IEC 15444-4: JPEG2000 Part 4, Conformance Testing </li></ul><ul><li>ISO/IEC 15444-5: JPEG2000 Part 5, Reference Software </li></ul><ul><li>ISO/IEC 15444-6: JPEG2000 Part 6, Compound Image Format </li></ul><ul><li>ISO/IEC 15444-8: JPEG2000 Part 8, JPSEC Image Security </li></ul><ul><li>ISO/IEC 15444-9: JPEG2000 Part 9, JPIP Interactivity Tools (APIs and Protocols) </li></ul><ul><li>ISO/IEC 15444-10: JPEG2000 Part 10, JP3D 3-Dimensional Data </li></ul><ul><li>ISO/IEC 15444-11: JPEG2000 Part 11, JPWL Wireless Applications </li></ul><ul><li>ISO/IEC 15444-12: JPEG2000 Part 12, ISO Media Format </li></ul><ul><li>ISO/IEC 15444-13: JPEG2000 Part 13, Entry Level Encoder </li></ul>
  12. 12. VSF JPEG2000 Activity Group <ul><li>Mission </li></ul><ul><li>Create a recommendation for standardization of real time transport of JPEG2000 for Contribution over IP Networks </li></ul><ul><li>Real time service encapsulating JPEG2000 compressed video, audio, time codes & closed captioning in a program stream </li></ul><ul><li>Encapsulation into MPEG2TS and the IP/RTP structure for final transport </li></ul><ul><li>Utilize a single RTP stream for video/ audio/ancillary </li></ul><ul><li>CBR & VBR streams supported </li></ul><ul><li>Streams up to 1800Mbps supported </li></ul><ul><li>Two solutions/efforts: </li></ul><ul><li>MPEG2TS/SMPTE2022 initially thought to be faster to market and with backwards compatibility with legacy MPEG2TS equipment </li></ul><ul><ul><li>Recommendation development is ongoing, must work with JPEG and MPEG to complete a standard </li></ul></ul><ul><li>MXF Wrapping over RTP with RTP/Payload Header & FEC </li></ul><ul><ul><li>VSF work for native uncompressed video should be usable for this effort </li></ul></ul><ul><ul><li>EBU will pursue this activity </li></ul></ul>
  13. 13. Standardization <ul><li>Liaison with JTC for Working Draft on Amendment 4 for 15444-1:2004, Profiles for Broadcast Applications </li></ul><ul><li>JPEG PES with header has been defined </li></ul><ul><li>MPEG working on JPEG2000 as PES </li></ul>
  14. 14. Standardization <ul><li>Establish a liaison with MPEG in order to exchange information regarding work that MPEG is doing in Working Draft 1.0: Transport of ISO/IEC 15444-1/AMD4 on mapping of JPEG-2000 into MPEG-2 transport streams </li></ul><ul><li>Utilize the output of that work to complete VSF/SMPTE document development regarding transport of JPEG2000 over IP. </li></ul><ul><li>This work will ultimately create a JPEG2000 PES within a MPEG2TS </li></ul><ul><li>Transport will be robust over a wide range of network performance by application of IP encapsulation and FEC (SMPTE 2022- # FEC) </li></ul>
  15. 15. Interoperability
  16. 16. Common JPEG2000 Applications <ul><li>Surveillance cameras and DVRs </li></ul><ul><li>Digital Cinema </li></ul><ul><li>Broadcast </li></ul><ul><li>Post Production </li></ul><ul><li>Archiving </li></ul><ul><li>Medical Imaging </li></ul><ul><li>Military and Aerospace </li></ul><ul><li>Digital Signage </li></ul><ul><li>Wireless Video </li></ul>
  17. 17. Digital Cinema Workflow
  18. 18. What Can I do with JPEG2000 in Broadcast? <ul><li>High-quality compression of contribution video feed </li></ul><ul><li>Studio-to-affiliate video transfer </li></ul><ul><li>Intra-studio video </li></ul><ul><li>High quality storage and playback of multiple feeds </li></ul><ul><li>Little degradation over many multiple compression cycles </li></ul>
  19. 19. End-to-end video <ul><li>Input contribution HD-SDI format (SMPTE 292) </li></ul><ul><li>JPEG2000 in contribution, mastering, mezzanine </li></ul><ul><li>Usage models in venue, studio and network </li></ul><ul><li>Combine video, audio and metadata for transport </li></ul><ul><ul><li>Video compressed with JPEG2000 </li></ul></ul><ul><ul><li>Audio compressed or not, variety of options </li></ul></ul><ul><ul><li>Metadata in various forms and formats </li></ul></ul>Studio
  20. 20. Broadcast Applications <ul><li>- Cameras, Camcorders </li></ul><ul><li>- Recorders </li></ul><ul><li>- Multichannel Recorders and viewers </li></ul>- Video Routers and Gateways <ul><li>Recorders, Multichannel recorders/viewers </li></ul><ul><li>Non-linear editors </li></ul><ul><li>Control Room Displays </li></ul><ul><li>Transcoders </li></ul>Studio
  21. 21. What to do with JPEG2000?  Networked Video
  22. 22. Multi-viewer Systems: Resolution Scalability <ul><li>Features </li></ul><ul><ul><li>Encoded sources available on visualization network </li></ul></ul><ul><ul><li>Sources are combined in a multi-viewer </li></ul></ul><ul><li>Benefits </li></ul><ul><ul><li>Freely combine JPEG 2000 streams </li></ul></ul><ul><ul><li>Leverage JPEG 2000 resolution scalability </li></ul></ul>
  23. 23. Desktop Monitoring: Low Latency, High Quality & Resolution Scalability <ul><li>Features </li></ul><ul><ul><li>Encoded sources available on visualization network </li></ul></ul><ul><ul><li>All frames are viewable/editable (intra-frame coding) </li></ul></ul><ul><ul><li>A regular PC can decode the video sub-resolutions </li></ul></ul><ul><li>Benefits </li></ul><ul><ul><li>Video is being shown at high quality </li></ul></ul><ul><ul><li>Resolution can be matched to view size/compute power </li></ul></ul><ul><ul><li>Video is being shown at low latency </li></ul></ul><ul><ul><li> Monitor network sources from desktop ! </li></ul></ul>
  24. 24. Euro 2008 in HD 2 HD feeds, 200 Mbps 3 SD feeds, 25 Mbps OC12 DTM network (GE ports) Vienna JPEG2000 HDSDI HDSDI JPEG2000 JPEG2000 HDSDI SDI JPEG2000 Stockholm JPEG2000 HDSDI HDSDI JPEG2000 JPEG2000 HDSDI SDI JPEG2000 Copenhagen JPEG2000 HDSDI HDSDI JPEG2000 JPEG2000 HDSDI SDI JPEG2000 TV2 Bergen HDSDI HDSDI JPEG2000 HDSDI SDI JPEG2000 SDI JPEG2000 SDI JPEG2000 JPEG2000 JPEG2000
  25. 25. TV2 Euro 2008 Post Processing JPEG2000 Decoder JPEG2000 Encoder 1080i to 720p Converter JPEG2000 Decoder JPEG2000 Encoder Ad insertion JPEG2000 Decoder MPEG-4 AVC encoder Satellite JPEG2000 Decoder JPEG2000 Encoder Beauty Expert commentary JPEG2000 Encoder HDSDI Vienna Bergen Oslo Bergen Nittedal
  26. 26. Multiple generation performance Degradation < 0.7 dB for 5 th generation Less than 1 LSB at 10 bits resolution
  27. 27. JPEG2000 as a Preservation Master <ul><li>JPEG2000 is fast becoming the defacto standard for preservation quality content archiving </li></ul><ul><li>Media and entertainment companies have been slow to adopt but the opposite is true for archivists </li></ul><ul><li>Limited “interoperability” between typical broadcast devices and “large file sizes” are considered barriers True preservation presents different challenges than traditional file based operations in media organizations </li></ul>
  28. 28. Effective Content Migration Video/Film Masters Solo Migration Engine DIVArchive CSM Data Tape Lossless MXF Wrapped JPEG2000 MXF Wrapped IMX50 MPEG2I QT Wrapped DV25 High Resolution Frame Based Migration Metadata Windows Media MPEG4 AVC Flash Video Proxy Resolution Preservation Package
  29. 29. Storage Efficiencies <ul><li>Archive Package average approx 180Mbps with all target essence formats (preservation, interoperable and proxy) </li></ul><ul><li>Formats can be added/removed depending on specific goals </li></ul><ul><li>A single LTO4 data tape provides: </li></ul><ul><ul><li>800GB of storage capacity </li></ul></ul><ul><ul><li>10 hours of source content Archive Package storage </li></ul></ul><ul><ul><li>€ 30 street price! </li></ul></ul><ul><li>Many goals are simultaneously accomplished: </li></ul><ul><ul><li>JPEG2000 for long term content preservation (LOSSLESS!) </li></ul></ul><ul><ul><li>MPEG2/DV for broadcast device interoperability </li></ul></ul><ul><ul><li>MPEG4/WM9/FLV/etc for proxy browsing/web/mobile </li></ul></ul>
  30. 30. Content Migration Goals <ul><li>Preservation </li></ul><ul><li>Remastering </li></ul><ul><li>Transcoding </li></ul><ul><li>Broadcast </li></ul><ul><li>Repurposing </li></ul><ul><li>Transcoding </li></ul><ul><li>Desktop Access </li></ul><ul><li>Monetization </li></ul><ul><li>Repurposing </li></ul>Lossless MXF Wrapped JPEG2000 Data Tape Preservation Storage Data Tape Preserve MXF Wrapped IMX50 MPEG2I QT Wrapped DV25 Video Servers Digital Newsroom Post Production Utilize Windows Media MPEG4 AVC Access Desktop Browsing <ul><li>Desktop Access </li></ul><ul><li>Monetization </li></ul><ul><li>Repurposing </li></ul>
  31. 31. JPEG2000 vs. MPEG4/H.264 JPEG2000 MPEG4/H.264 Wavelet-based – no Blocking Artifacts DCT-based -- Blocking artifacts Symmetrical – Encode and decode are the same Asymmetrical – encoding is expensive <ul><li>I-Frame only </li></ul><ul><ul><li>Errors only affect one frame </li></ul></ul><ul><ul><li>Easy error concealment </li></ul></ul><ul><ul><li>Trick modes don’t change bit rate </li></ul></ul><ul><li>I-frame and P-frame/B-frame </li></ul><ul><ul><li>Errors affect entire GOP </li></ul></ul><ul><ul><li>Difficult to conceal errors </li></ul></ul><ul><ul><li>Trick modes increase bit rate </li></ul></ul>JPEG2000 encoding is naturally tolerant of errors; errors only affect one frame Errors can affect entire GOP Low latency – Single Frame Complexity of compression results in higher latency <ul><li>Precise and adjustable bit rate control </li></ul><ul><ul><li>Can be adjusted on a frame-by-frame basis to adjust for varying conditions </li></ul></ul><ul><li>No bit rate control </li></ul><ul><ul><li>Can’t lower bit rate if necessary; </li></ul></ul><ul><ul><li>Trick modes raise the bitrate. </li></ul></ul>
  32. 32. JPEG2000 is Ideal for Wireless Video JPEG 2000 H.264 MPEG2 MPEG4 Motion JPEG2000 for Wireless Applications, Dufaux and Ebrahimi, 2003 ** NOTE: Coding efficiency advantage of H.264 is for low bit rate coding and would result in decreased quality; higher quality high bit rate coding would not provide H.264 with a coding efficiency advantage Artifacts Error Resilience Complexity Scalability Latency Coding Efficiency**
  33. 33. Highlights <ul><li>JPEG2000 is a mature technology </li></ul><ul><li>JPEG2000 is accepted as a high quality video encoding technology </li></ul><ul><li>JPEG2000 is used in a wide variety of broadcast applications </li></ul><ul><li>Industry activities are ongoing to insure interoperability between different manufacturers’ equipment </li></ul>
  34. 34. Q&A
  35. 35. <ul><li>Thank you for your time, </li></ul><ul><li>we hope you found it to be </li></ul><ul><li>informative and productive! </li></ul>