Choosing the Best IP for Compressing Images & Video

Choosing the Best IP for Compressing Images and Video CAST, Inc. +1 201.391.8300 [email_address] www.cast-inc.com

Selecting the Best IP
Algorithms
Image Quality
Formats
Hardware
Area
Speed
Memory
System Integration
Application Requirements
Evaluation
Expertise
JPEG JPEG-LS JPEG 2000 Lossless JPEG H.264 Motion JPEG

Compression Algorithms
Lossy discards image data but looks good enough
Lossless discards no image data
Near-Lossless visually identical, or numerically acceptable data loss

JPEG
Good quality < 20:1
Moderate quality 20:1 – 50:1
Poor quality > 50:1
JPEG 2000
Good up to 80:1
H.264
Best for > 50:1
Image Quality: Lossy

LJPEG
Compresses 2:1
Not good for text, computer graphics
JPEG-LS
2.3:1
Usually best
JPEG 2000
2.1:1
Flexible (lossy, too)
Image Quality: Lossless

Input Format: Image Types
Still images vs. motion video
Still images — JPEG, LJPEG, JPEG-LS, JPEG 2000
Motion video — Motion JPEG, H.264
H.264 Motion Estimation
Predicts where motion will occur
Represents motion, not entire frame: fewer bits

Input Format: Data Factors
Number of bits/pixel
JPEG — 8
LJPEG — up to 16
JPEG-LS — up to 16
JPEG 2000 — up to 16
Number of pixels: frame size
Representation method
CGA 320 x 200 64,000 pixels QSXGA 2560 x 2048 5,242,880 pixels

Input Format: Subsampling
Eye more sensitive to changes in brightness ( luma ) than color ( chroma )
Can use just some of the chroma info (a subsample ) to compress an image
Encoders use different subsample formats
JPEG — 4:4:4, 4:2:2, 4:1:1, 4:2:0, grayscale
LJPEG — 4:4:4, grayscale
JPEG-LS — 4:4:4, 4:2:2, 4:1:1, 4:2:0, grayscale
JPEG 2000 — 4:4:4, 4:2:2, 4:1:1, 4:2:0, grayscale
H.264 — 4:2:0
Color Space Notation Y:C b :C r Y = luma value C b :C r together = chroma value Can include fewer chroma values in various ways. Another popular color space is similar: Y:U:V

Hardware & Algorithm Trade-Offs
Area
Speed
Memory
System Integration

Area
JPEG 2000 Parameters
No. of Entropy Encoders
Filter Types & Levels
Quantization Tables
Block Size
Whole Frame or Tiles

Speed
JPEG fastest on the market, 1 clock/sample
JPEG 2000 1.4 clocks/sample, depending on configuration
H.264 2.5 clocks/sample
LJPEG and JPEG-LS very fast, 1 clock/sample
Max clock rate of the technology limits the frame size and fps

Memory
Dependent on frame size
H.264 can use SDRAM, DDR or DDR2 (more flexible than MPEG4)
JPEG 2000 large demands, but can reduce by tiling (at expense of speed)
WVGA 480 x 854 1024 x 768 1080p 1920 x 1080

Integration
Latency
Time from first input sample to first compressed output
CPU required?
Core may have a CPU for configuration, or read from input stream
Memory Interface
Best not embedded in compression core to allow flexibility

Rate Control
Error Resilience
Special Features
Multiple Resolutions
Quality Layers
Rectangular Regions of Interest

Rate Control
Trades off transmission bit rate and video quality
Essential for applications with constrained channel bandwidth or storage capacity
Must:
Guarantee channel will never be overflowed
Maximize quality for even very low bit rates
Be adaptable to any type of scene or motion
Provide a fast response to changes in video characteristics
Allow simple system integration
Hardware Bit Rate Control is best

Multiple Resolution Levels
JPEG 2000 can store Images at multiple resolutions
Thumbnails quickly pulled from storage and analyzed
Higher resolution images then requested from storage for in-depth analysis
Excellent for reconnaissance & surveillance
From: http://www.centurionalarm.com/j2kvsmpeg4vsjpegvsh264.pdf

Error Resilience
JPEG Restart markers, but works on blocks
JPEG-LS None
JPEG 2000 Packet headers in stream, other features
H.264 Reference frame errors extend to dependent frames; CAST adds multiple slices to increase error resilience

Quality Layers with JPEG 2000
Military applications: thermal IR & satellite imagery
Multiple layers with different compression ratios
Original Lossless 710 Kbytes 20 Quality Layers 8:1 Compression 88.76Kbytes 10 Quality Layers 16:1 Compression 44.28 Kbytes 5 Quality Layers 256:1 Compression 2774 bytes 1 Quality Layer

Rectangular Regions of Interest
Specify an area is more important than the rest of the image
Vary quality of the region and the background per:
Desired compression ratio
Relative importance of the region
50:1 Compression Region: no special importance 50:1 Compression Region: slightly important 50:1 Compression Region: moderately important 50:1 Compression Region: extremely important

Image & Video IP Evaluation
Get a Bit Accurate Model ( BAM ) to run your images
Try a Prototype Board with the IP in hardware
Get references in your market sector (military is tough)
Study representative synthesis results for area and max operating frequency
Make sure you will have access to compression engineers

CAST Compression Reference Design System
Complete FPGA System Board:
Learn compression
Evaluate our cores with your media
Get a system head start
Combines multiple cores and essential software

Vendor Expertise
CAST :
Delivering IP for 16 Years
Privately-held, independent
1,000 sales to 600 customers
Expert Development Partners
Extreme Customer Focus
24/7, fast-response culture
Global team of 100 people
Airborne Reconnaissance Audio/Video Platform Broadcast Equipment Camera Module Cell Phone Camera Image Processing Chip Digital Still Camera Digital Video Recorder Earth Observation Satellite High-Definition Monitor High-Resolution Airborne Reconnaissance Sensor High-Speed Video Camera Imaging Chips Military - Classified Mobile Camera SoC Mobile Digital Video Recorder Platform Mobile Phone SIM Card Multiple Kill Vehicle Office Class Copier/printer Prototype 3D Camera Satellite - Classified Satellite Camera and Measurement Device Security and Surveillance Camera Security LCD Monitor SoC-on-panel Display Surveillance Camera Technology Proof-of-Concept Camera TV Surveillance Camera Display USB Module Video Compression Video Conferencing System Video Image Acquisition System for the Military Video Surveillance for Road Tolling Weather Satellites Wireless Rear-view Camera X-ray Dental Project Some Customer Multimedia Applications

CAST Broad IP Cores Line Multimedia JPEG JPEG Scalado Speedtags JPEG Ext. 12-bit JPEG Lossless JPEG-LS JPEG 2000 H.264 Video Audio: I2S, SPDIF Image Conversion System IP Subsystems 8051/USB, 8051/MAC SoC Platforms ARM, eASIC AMBA Infrastructure Replacements Processors, Bit Slices Controllers, Peripherals, Timers, UARTs, TTL Parts Encryption AES DES, Triple DES MD5 SHA-1, SHA-256 Communications Consumer IR Controllers Synchronous UARTS SDLC, HDLC Interfaces PCI & PCI Express Ethernet MACs USB & OTG CAN, LIN, I2C, SPI ECP Memory & Peripherals Memory Controllers DDR1/2 SDRAM SDIO Host SDR mobile SDRAM NAND flash Serial flash Storage Controllers ATA/IDE Interface Device Controllers Smart Card Reader, TV Display, Hi-Res Processors 8-bit: 8051 fast, tiny, entry Z80, C6502 16-bit: 68000, 80186xl, 80186ec, 387L 32-bit 68000 AHB DSP: 32025, 32025TX See more at www.cast-inc.com

CAST Image & Video IP Cores Multimedia JPEG JPEG Scalado Speedtags JPEG Ext. 12-bit JPEG Lossless JPEG-LS JPEG 2000 H.264 Video Audio: I2S, SPDIF Image Conversion Cameras, Printers, Copiers, etc. Pro Video, Medical Imaging Best Lossless Surveillance, Medical Imaging Replacing MPEG4 Fast Cameras High Quality Imaging Block to Raster Raster to Block Downscaling Color Space Conversion

Choosing the Best IP for Compressing Images & Video

by CAST, Inc. on Apr 30, 2010

Accessibility

Categories

Tags

Upload Details

Usage Rights

2 Embeds 18

Statistics

Choosing the Best IP for Compressing Images & Video — Presentation Transcript

http://www.slideshare.net	10
http://castcores.blogspot.com	8