Your SlideShare is downloading. ×
Analysis of BSDL-based content adaptation for JPEG 2000 and HD Photo (JPEG XR)
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Analysis of BSDL-based content adaptation for JPEG 2000 and HD Photo (JPEG XR)

725
views

Published on

Analysis of BSDL-based content adaptation for JPEG 2000 and HD Photo (JPEG XR). …

Analysis of BSDL-based content adaptation for JPEG 2000 and HD Photo (JPEG XR).

Paper presented at the VIE 2008 conference in Xian, China.

http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=4743514&tag=1

Published in: Technology

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
725
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. VIE’08 Workshop on Scalable Coded Media Beyond Compression July 29, 2008 Xi’an, China Analysis of BSDL-based Content Adaptation for JPEG 2000 and HD Photo (JPEG XR) Wesley De Neve , Seungji Yang, Davy Van Deursen, Changick Kim, Yong Man Ro and Rik Van de Walle Ghent University – IBBT (Ghent, Belgium) Information and Communications University (Daejeon, South Korea)
  • 2. Overview
    • Introduction
    • HD Photo / JPEG XR
    • MPEG-21 BSDL
    • Experimental Results
    • Conclusions
  • 3. Overview
    • Introduction
    • HD Photo / JPEG XR
    • MPEG-21 BSDL
    • Experimental Results
    • Conclusions
  • 4. Introduction: Universal Multimedia Access mobile devices Content Adaptation for Universal Multimedia Access (UMA) IPTV laptop heterogeneous networks, dynamic conditions scalable media content (e.g., SVC, JPEG 2000, …) diverse set of devices, user preferences need for adaptation of scalable media content to the capabilities of networks and devices video still images audio
  • 5. Overview
    • Introduction
    • HD Photo / JPEG XR
    • MPEG-21 BSDL
    • Experimental Results
    • Conclusions
  • 6. Context HD Photo
    • Developed by Microsoft Research
      • natively supported by Windows Vista
      • first widespread scalable coding format
    • Adopted for standardization by JPEG
      • will likely be known as JPEG Extended Range (JPEG XR)
    • Design goals
      • aims at low-complexity encoding and decoding
        • low power and memory consumption
      • is feature-driven
        • support for lossless, scalable, and high-dynamic range coding
      • aims at bridging the gap between RAW and JPEG in digital cameras
  • 7. Algorithm for Lossless and Scalable Coding in HD Photo 1 2 4 3 picture (24-bits RGB) index table spatial tile 1 spatial tile 2 spatial tile 4 header spatial tile 3 intercomponent transform (YCoCg-R) intracomponent transform (4x4 PCT) prediction of 4x4 blocks of transform coefficients adaptive coefficient scanning context-based Huffman coding coded bitstream
  • 8. Adaptivity Provisions in HD Photo
    • Adaptitivy provisions in the compressed domain
      • ROI extraction: by removing spatial tiles
      • quality scalability: by removing all flexbits frequency tiles
      • spatial scalability ~ embedded thumbnail functionality
        • by removing flexbits and highpass frequency tiles
        • by removing flexbits, highpass, and lowpass frequency tiles
    reduction of spatial resolution by a factor 2 in each direction reduction of spatial resolution by a factor 4 in each direction index table spatial tile 1 spatial tile 2 spatial tile 4 header spatial tile 3 bitstream DC tile lowpass tile highpass tile flexbits tile 1 2 4 3 picture 1 2 4 3 1 2 4 3 (52 dB => 40 dB) 1 2 4 3
  • 9. Overview
    • Introduction
    • HD Photo / JPEG XR
    • MPEG-21 BSDL
    • Experimental Results
    • Conclusions
  • 10. Basic Idea of BSD-Based Content Adaptation Bitstream Syntax Description (BSD) Compressed image < bitstream url = &quot;breeze .hdp &quot; > < header > 0 24 </ header > < index > 24 67 </ index > < tile > 91 746 </ tile > < tile > 837 903 </ tile > < tile > 1740 857 </ tile > < tile > 2597 1103 </ tile > </ bitstream > 1 2 4 3
  • 11. BSD-Based Content Adaptation Using BSDL Beschrijvingsgedreven aanpassing van mediabronnen Wesley De Neve Publieke doctoraatsverdediging – Gent – 7 februari 2007
      • < bitstream url = &quot;breeze .hdp &quot; > < header_data > 0 24 </ header_data > < index > 24 67 </ index > < tile > 91 746 </ tile > < tile > 837 903 </ tile > < tile > 1740 857 </ tile > < tile > 2597 1103 </ tile > </ bitstream >
    scalable bitstream 1. compressed bitstream explanatory notes: transformed BSD BSD transformation with STX 4. BSD transformation with STX BSD BintoBSD Parser 3. BSD generation with BintoBSD 2. BS Schema for a media format MPEG-21 BS Schema
      • < bitstream url = &quot;breeze .hdp &quot; > < header_data > 0 24 </ header_data > < index > 24 67 </ index > < tile > 91 746 </ tile > < tile > 837 903 </ tile > < tile > 1740 857 </ tile > < tile > 2597 1103 </ tile > </ bitstream >
    adapted bitstream BSDtoBin Parser 5. adapted bitstream generation with BSDtoBin 1 2 4 3 1 2 4 3
  • 12. Motivation for BSD-based Content Adaptation
    • BSDs are high level
      • only contain information required for content adaptation
      • conceal the complexity of a scalable coding format
      • conceal the complexity of bitstream parsing (I/O operations)
    • BSDs are XML-based
      • reuse of already existing XML software for content adaptation
      • straightforward integration with other metadata standards
    • BSDs are compliant with BSDL
      • description tool part of the MPEG-21 Multimedia Framework
      • allows for standardized and format-independent content adaptation
  • 13. Overview
    • Introduction
    • HD Photo / JPEG XR
    • MPEG-21 BSDL
    • Experimental Results
    • Conclusions
  • 14. Application Scenario
    • Static client-server scenario
      • content server
        • allows downloading digital images in two different formats
          • JPEG 2000 and HD Photo (JPEG XR)
        • coded in a lossless and scalable manner
      • heterogeneous clients
    • Common adaptivity provisions in the compressed domain
      • quality scalability (lossless-to-lossy degradation)
      • spatial scalability
      • arbitrary cropping or interactive ROI extraction
    • Further customization: responsibility clients
  • 15. Creation of Scalable Bitstreams for HD Photo & JPEG 2000
    • File size overhead versus tile size
      • varying test content: breeze, kungfu, night, plane, waves
      • characteristics: 24-bits RGB @ 1920x1072
      • coding constraints
        • adaptivity provisions need to be provided with a file size overhead less than 5%
    • Observation regarding encoding strategy
      • tile size HD Photo: 4x4 macroblocks (64x64 pixels)
      • tile size JPEG 2000: 12x12 macroblocks (192x192 pixels)
  • 16. BSD Creation for HD Photo
    • Breeze: 1920x1072, 2677 KB, 4x4 tile size, 2040 tiles
    • BintoBSD for HD Photo
      • execution time: 221.6 s ~ 9.2 tiles/s
      • memory consumption: 3.6 MB
      • uncompressed BSD size: 698 KB
      • compressed BSD size: 32 KB
    • BFlavor for HD Photo
      • execution time: 1.6 s ~ 1250 tiles/s
      • memory consumption: 0.8 MB
    BFlavor scalable bitstream BSD BintoBSD Parser 1 2 4 3 < bitstream url = &quot;breeze .hdp &quot; > < header > 0 24 </ header > < index > 24 67 </ index > < tile > 91 746 </ tile > < tile > 837 903 </ tile > < tile > 1740 857 </ tile > < tile > 2597 1103 </ tile > </ bitstream > problem: representing and accessing HD Photo’s index table BSDL: DOM and XPath BFlavor: arrays and indexing
  • 17. BSD Creation for JPEG 2000
    • Breeze: 1920x1072, 2547 KB, 12x12 tile size, 60 tiles
    • BintoBSD for JPEG 2000
      • execution time: 4.2 s ~ 14.3 tiles/s
      • memory consumption: 1.4 MB
      • uncompressed BSD size: 690 KB
      • compressed BSD size: 28 KB
    • BFlavor for JPEG 2000
      • execution time: 3.0 s ~ 20.0 tiles/s
      • memory consumption: 0.6 MB
    BFlavor scalable bitstream BSD BintoBSD Parser 1 2 4 3 < bitstream url = &quot;breeze .jp2 &quot; > < header > 0 24 </ header > < index > 24 67 </ index > < tile > 91 746 </ tile > < tile > 837 903 </ tile > < tile > 1740 857 </ tile > < tile > 2597 1103 </ tile > </ bitstream > limited XPath handling (parsing is start code driven, not based on an index table)
  • 18. BSD Transformation for HD Photo & JPEG 2000
    • STX for HD Photo
      • execution time: < 1.8 s
      • memory consumption: < 2 MB
    • STX for JPEG 2000
      • execution time: < 4.3 s
      • memory consumption: < 2 MB
    transformed BSD BSD transformation with STX < bitstream url = &quot;breeze .hdp &quot; > < header > 0 24 </ header > < index > 24 67 </ index > < tile > 91 746 </ tile > < tile > 837 903 </ tile > < tile > 1740 857 </ tile > < tile > 2597 1103 </ tile > </ bitstream > BSD < bitstream url = &quot;breeze .hdp &quot; > < header > 0 24 </ header > < index > 24 67 </ index > < tile > 91 746 </ tile > < tile > 837 903 </ tile > < tile > 1740 857 </ tile > < tile > 2597 1103 </ tile > </ bitstream > problem: bitstream reordering needed for exploiting spatial scalability in our system (from progression by quality to progression by spatial resolution)
  • 19. Adapted Bitstream Creation for HD Photo & JPEG 2000
    • BSDtoBin for HD Photo
      • execution time: < 1.3 s
      • memory consumption: < 2 MB
    • BSDtoBin for JPEG 2000
      • execution time: < 7 s
      • memory consumption: < 2 MB
    BSDtoBin Parser < bitstream url = &quot;breeze .hdp &quot; > < header > 0 24 </ header > < index > 24 67 </ index > < tile > 91 746 </ tile > < tile > 837 903 </ tile > < tile > 1740 857 </ tile > < tile > 2597 1103 </ tile > </ bitstream > transformed BSD 1 2 4 3 adapted bitstream problem: bitstream reordering needed for exploiting spatial scalability in our system (from progression by quality to progression by spatial resolution)
  • 20. Overview
    • Introduction
    • HD Photo / JPEG XR
    • MPEG-21 BSDL
    • Experimental Results
    • Conclusions
  • 21. Conclusions
    • Discussed the integration of JPEG 2000 and HD Photo in a format-independent adaptation system using MPEG-21 BSDL and STX
      • comes with additional system complexity, measured in terms of file and BSD overhead, execution times, and memory consumption
    • A maximum degree of adaptivity can be achieved with a feasible complexity by choosing an appropriate tile size during encoding
      • HD Photo: tile size of 64x64 pixels
      • JPEG 2000: tile size of 192x192 pixels (bitstream reordering...)
    • Future work
      • further reduction of the computational complexity
      • design of a unified adaptation framework for format-independent and format-specific adaptation and delivery of scalable content
  • 22. Thank you! Any questions?

×