Analysis of BSDL-based content adaptation for JPEG 2000 and HD Photo (JPEG XR)

VIE’08 Workshop on Scalable Coded Media Beyond Compression July 29, 2008 Xi’an, China Analysis of BSDL-based Content Adaptation for JPEG 2000 and HD Photo (JPEG XR) Wesley De Neve , Seungji Yang, Davy Van Deursen, Changick Kim, Yong Man Ro and Rik Van de Walle Ghent University – IBBT (Ghent, Belgium) Information and Communications University (Daejeon, South Korea)

Overview ,[object Object],[object Object],[object Object],[object Object],[object Object]

Introduction: Universal Multimedia Access mobile devices Content Adaptation for Universal Multimedia Access (UMA) IPTV laptop heterogeneous networks, dynamic conditions scalable media content (e.g., SVC, JPEG 2000, …) diverse set of devices, user preferences need for adaptation of scalable media content to the capabilities of networks and devices video still images audio

Context HD Photo ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Algorithm for Lossless and Scalable Coding in HD Photo 1 2 4 3 picture (24-bits RGB) index table spatial tile 1 spatial tile 2 spatial tile 4 header spatial tile 3 intercomponent transform (YCoCg-R) intracomponent transform (4x4 PCT) prediction of 4x4 blocks of transform coefficients adaptive coefficient scanning context-based Huffman coding coded bitstream

Adaptivity Provisions in HD Photo ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],reduction of spatial resolution by a factor 2 in each direction reduction of spatial resolution by a factor 4 in each direction index table spatial tile 1 spatial tile 2 spatial tile 4 header spatial tile 3 bitstream DC tile lowpass tile highpass tile flexbits tile 1 2 4 3 picture 1 2 4 3 1 2 4 3 (52 dB => 40 dB) 1 2 4 3

Basic Idea of BSD-Based Content Adaptation Bitstream Syntax Description (BSD) Compressed image < bitstream url = "breeze .hdp " > < header > 0 24 </ header > < index > 24 67 </ index > < tile > 91 746 </ tile > < tile > 837 903 </ tile > < tile > 1740 857 </ tile > < tile > 2597 1103 </ tile > </ bitstream > 1 2 4 3

BSD-Based Content Adaptation Using BSDL Beschrijvingsgedreven aanpassing van mediabronnen Wesley De Neve Publieke doctoraatsverdediging – Gent – 7 februari 2007 ,[object Object],scalable bitstream 1. compressed bitstream explanatory notes: transformed BSD BSD transformation with STX 4. BSD transformation with STX BSD BintoBSD Parser 3. BSD generation with BintoBSD 2. BS Schema for a media format MPEG-21 BS Schema ,[object Object],adapted bitstream BSDtoBin Parser 5. adapted bitstream generation with BSDtoBin 1 2 4 3 1 2 4 3

Motivation for BSD-based Content Adaptation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Application Scenario ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Creation of Scalable Bitstreams for HD Photo & JPEG 2000 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

BSD Creation for HD Photo ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],BFlavor scalable bitstream BSD BintoBSD Parser 1 2 4 3 < bitstream url = "breeze .hdp " > < header > 0 24 </ header > < index > 24 67 </ index > < tile > 91 746 </ tile > < tile > 837 903 </ tile > < tile > 1740 857 </ tile > < tile > 2597 1103 </ tile > </ bitstream > problem: representing and accessing HD Photo’s index table BSDL: DOM and XPath BFlavor: arrays and indexing

BSD Creation for JPEG 2000 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],BFlavor scalable bitstream BSD BintoBSD Parser 1 2 4 3 < bitstream url = "breeze .jp2 " > < header > 0 24 </ header > < index > 24 67 </ index > < tile > 91 746 </ tile > < tile > 837 903 </ tile > < tile > 1740 857 </ tile > < tile > 2597 1103 </ tile > </ bitstream > limited XPath handling (parsing is start code driven, not based on an index table)

BSD Transformation for HD Photo & JPEG 2000 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],transformed BSD BSD transformation with STX < bitstream url = "breeze .hdp " > < header > 0 24 </ header > < index > 24 67 </ index > < tile > 91 746 </ tile > < tile > 837 903 </ tile > < tile > 1740 857 </ tile > < tile > 2597 1103 </ tile > </ bitstream > BSD < bitstream url = "breeze .hdp " > < header > 0 24 </ header > < index > 24 67 </ index > < tile > 91 746 </ tile > < tile > 837 903 </ tile > < tile > 1740 857 </ tile > < tile > 2597 1103 </ tile > </ bitstream > problem: bitstream reordering needed for exploiting spatial scalability in our system (from progression by quality to progression by spatial resolution)

Adapted Bitstream Creation for HD Photo & JPEG 2000 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],BSDtoBin Parser < bitstream url = "breeze .hdp " > < header > 0 24 </ header > < index > 24 67 </ index > < tile > 91 746 </ tile > < tile > 837 903 </ tile > < tile > 1740 857 </ tile > < tile > 2597 1103 </ tile > </ bitstream > transformed BSD 1 2 4 3 adapted bitstream problem: bitstream reordering needed for exploiting spatial scalability in our system (from progression by quality to progression by spatial resolution)

Conclusions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Analysis of BSDL-based content adaptation for JPEG 2000 and HD Photo (JPEG XR)

Recommended

Recommended

More Related Content

Similar to Analysis of BSDL-based content adaptation for JPEG 2000 and HD Photo (JPEG XR)

Similar to Analysis of BSDL-based content adaptation for JPEG 2000 and HD Photo (JPEG XR) (20)

More from Wesley De Neve

More from Wesley De Neve (20)

Recently uploaded

Recently uploaded (20)

Analysis of BSDL-based content adaptation for JPEG 2000 and HD Photo (JPEG XR)