Video Compression Standards
History & Introduction
Champ Yen
champ.yen@gmail.com
“
Outline
▷ some concepts
▷ MPEG-1/MPEG-2(H.262)
▷ MPEG4
▷ H.264 (MPEG4 part 10)
▷ HEVC/H.265
▷ Q&A
Concepts
What is data compression?
lossy & lossless compression
Information Entropy
But What does Xi mean in Video Coding!?
Huffman Coding
Frame color format
http://commons.wikimedia.org/wiki/Category:YUV
http://forum.doom9.org/showthread.php?t=167832
YUV444 YUV422 YUV420
Basic Sequence/Frame Structure
http://ride.chiariglione.org/MP1_inside.php
Motion Compensation
quality criteria: PSNR
Video Decoding Flow
Entropy
Decode
inverse
Quantization
inverse
Transform
Inter / Intra
Prediction
coef.
data
coef.
data
predicted
frame
residual
decoded
frame
sum &
postproc
reference
frame
reference
frame
reference
frame
01011000101111
pred.
info.
Video Encoding Flow
Entropy
Encode
Quantization Transform
Inter / Intra
Prediction
coef.
data
coef.
data
predicted
frame
residual
source
frame
substract
reference
frame
reference
frame
reference
frame
01011000101111
pred.
info.
inverse
Quantization
inverse
Transform
coef.
data
sum &
postproc
residual
key-points of Video Coding
▷ Entropy Coding
▷ Coding Unit
▷ Quantization
▷ Transformation
▷ Inter/Intra Prediction
▷ Post-Processing
MPEG-1/2
MPEG-1/2 overview
MPEG1/2 - DCT
http://xiph.org/~xiphmont/demo/daala/demo1.shtml
http://commons.wikimedia.org/wiki/File:DCT-8x8.png
https://vsr.informatik.tu-chemnitz.de/~jan/MPEG/HTML/mpeg_tech.html
MPEG1/2 - Quantization
Quantization Matrix
http://en.wikipedia.org/wiki/MPEG-1
MPEG1/2 - zigzag scan
MPEG1/2 I/P/B frames
MPEG1/2 - Bitstream
MPEG-4
MPEG4 - block mode & inter prediction
MPEG4 - DC/AC prediction
MPEG4 vs MPEG1/2
H.264
H.264/AVC - block mode
H.264 intra-prediction
H.264 inter-prediction
½
¼
H.264 - MV prediction
H.264 - integer transform
http://mrutyunjayahiremath.blogspot.tw/2010/10/frq-transformation-and-quantization.html
What are the advantages of integer transformation?
H.264 - deblocking
Arithmetic Coding Concept
H.264 - CABAC
H.264 - NAL (Network Abstract Layer)
http://gentlelogic.blogspot.tw/2011/11/exploring-h264-part-2-h264-bitstream.html
Comparisons
HEVC/H.265
HEVC - Frame Structure
HEVC - block mode
CU - Coding Unit
PU - Prediction Unit
TU - Transform Unit
HEVC - intra prediction
HEVC - ⅛-pixel inter prediction
HEVC - MV prediction
HEVC - SAO
http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6324411
The concept of SAO is to reduce mean sample distortion of a region by first classifying the region samples
into multiple categories with selected classifier, obtaining an offset for each category, and then addig the offset
to each sample of the category, where the classifier index and the offset of the region are coded in the
bitstream.
Miscs
Summary
▷ how to predict the frame
▷ extract temporal/spatial
redundant
▷ more and more fine-grained
▷ new ideas/tools
Development Workflow
H.264 JM: http://iphome.hhi.de/suehring/tml/
HEVC HM: http://hevc.hhi.fraunhofer.de/
Modified
Reference
Software
Proprietary
Implementation
Analyze
Tool
verification
data
golden
data
test cases
bitstreams
References
● An Overview of MPEG-2
http://literature.agilent.com/litweb/pdf/5966-1031E.pdf
● MPEG-4 natural video coding An overview
http://www.img.lx.it.pt/~fp/cav/Additional_material/MPEG4_video.pdf
● Overview of the H.264/AVC Video Coding Standard
http://654lab.webstarts.com/uploads/csvt_overview.pdf
● MPEG Video Compression Basics
http://www.springer.com/cda/content/document/cda_downloaddocument/9781441961839-c1.pdf
● http://www-i6.informatik.rwth-aachen.de/web/Misc/Coding/365/li/material/notes/Chap4/Chap4.3/Chap4.3.html
● H.264 and MPEG-4 Video Compression, Iain E. G. Richardson
● H.264 Specification
http://www.itu.int/rec/T-REC-H.264
● Overview of the High Efficiency Video Coding (HEVC) Standard
http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=6316136
● HEVC Specification
http://www.itu.int/rec/T-REC-H.265
“
Q & A
Thanks

Video Compression Standards - History & Introduction