Intra-coding using non-linear prediction, KLT and Texture Synthesis...

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Institut für Informationsverarbeitung
Intra-coding using non-linear
prediction, KLT and Texture
Synthesis
AV1 encoders ope...

Decoder Runtimes
2
Thorsten Laude
laude@tnt.uni-hannover.de
Relative factors to HM, i.e. HM=1
0
2
4
6
8
10
12
14
JEM AV1 J...

Encoder Runtimes
3
Thorsten Laude
laude@tnt.uni-hannover.de
Relative factors to HM, i.e. HM=1
0
10
20
30
40
50
60
JEM AV1 ...

Runtime-memory Complexity
4
Thorsten Laude
laude@tnt.uni-hannover.de

Trade-off Coding Efficiency vs. Complexity
5
Thorsten Laude
laude@tnt.uni-hannover.de
Better
Better

Institut für Informationsverarbeitung
Contour-based Multidirectional
Intra Coding for HEVC
Thorsten Laude and Jörn Osterma...

Prediction process
• 33 angular modes, DC, planar
• Extrapolation base: right column of left
block, bottom row of top bloc...

Limitations of HEVC intra prediction
• Only one direction for angular modes
• Only one adjacent sample column/row as
extra...

Contour-based Multidirectional
Intra Coding
(CoMIC)
9
Thorsten Laude
laude@tnt.uni-hannover.de

Reconstructed
samples
• Available at
encoder and
decoder
Contour
extraction
• Detection
• Parameterization
Contour
extrapo...

Contour
detection
Contour
parameterization
Contour
extrapolation
Contour-based Multidirectional Intra Coding
11
Thorsten L...

Contour
detection
Contour
parameterization
Contour
extrapolation
Contour-based Multidirectional Intra Coding
12
Thorsten L...

Contour
detection
Contour
parameterization
Contour
extrapolation
Contour-based Multidirectional Intra Coding
13
Thorsten L...

Contour
detection
Contour
parameterization
Contour
extrapolation
Contour-based Multidirectional Intra Coding
14
Thorsten L...

Contour
detection
Contour
parameterization
Contour
extrapolation
Contour-based Multidirectional Intra Coding
15
Thorsten L...

Contour
detection
Contour
parameterization
Contour
extrapolation
Contour-based Multidirectional Intra Coding
16
Thorsten L...

Comparison with state-of-the art of Liu et al.1
Contour-based Multidirectional Intra Coding
17
Thorsten Laude
laude@tnt.un...

Stand alone codec: Comparison with state-of-the art of Liu et al.1
(anchor: JPEG)
Contour-based Multidirectional Intra Cod...

Additional coding mode in HEVC (HM-16.3)
Contour-based Multidirectional Intra Coding
19
Thorsten Laude
laude@tnt.uni-hanno...

• Separation of structural and texture
parts
• Contour extrapolation
• All information available at decoder
 no signallin...

Institut für Informationsverarbeitung
Scene-based KLT for Intra
Coding in HEVC
Yiqun Li and Jörn Ostermann

General Idea
22
Yiqun Liu
Yiqun.Liu@tnt.uni-hannover.de
Transform Coding
Original Luminance
Prediction Error
 Input: Pred...

Outline
General Idea
HM / JEM
Karhunen Loeve Transform
Conclusion
23
Yiqun Liu
Yiqun.Liu@tnt.uni-hannover.de

HM / JEM
24
Yiqun Liu
Yiqun.Liu@tnt.uni-hannover.de
DCT / DST
Benefit:
 Fixed coefficients
 Sensitivity of eyes
Drawback...

HM / JEM
25
Yiqun Liu
Yiqun.Liu@tnt.uni-hannover.de
Signal dependent transform (SDT)
Procedure:
 Construct ref. patch wit...

Karhunen Loeve Transform
26
Yiqun Liu
Yiqun.Liu@tnt.uni-hannover.de
General Idea
HM / JEM
Karhunen Loeve Transform
Conclus...

Karhunen Loeve Transform
Desired Transform
Energy compaction
 Data dependent
⇒ Karhunen Loeve Transform (KLT)
Efficiency
...

Karhunen Loeve Transform
Desired Transform: Indicator Prediction Mode (PM)
(a) PM26 (b) PM18
Average absolute error of 8×8...

Karhunen Loeve Transform
Desired Transform: QP Dependency
Average absolute error of 8×8 TUs (PM 10) from PartyScene
QP-bas...

Karhunen Loeve Transform
Desired Transform: TU size
TU Size
 Coverage
 Complexity
TU size
Distribution of TUs in Class B...

Karhunen Loeve Transform
Yiqun Liu
Yiqun.Liu@tnt.uni-hannover.de
Desired Transform: Scene
(a) Basketball PM26 (b) BQMall P...

Karhunen Loeve Transform
Structure
Block diagram of the hybrid encoder with KLT
Yiqun Liu
Yiqun.Liu@tnt.uni-hannover.de 13

Karhunen Loeve Transform
Simulation
Test sequences:
 JCT-VC
 1920×1080:
 BasketballDrive, Kimono, Cactus,
ParkScene, BQ...

Karhunen Loeve Transform
34
Yiqun Liu
Yiqun.Liu@tnt.uni-hannover.de
Simulation Result
0 5 10 15
Scene−based
20 25
Kimono
C...

Karhunen Loeve Transform
35
Yiqun Liu
Yiqun.Liu@tnt.uni-hannover.de
BasketballDrill, -25.00%
RaceHorses, -2.16%
BQMall, -0...

Karhunen Loeve Transform
Performance in directions
BasketballDrill, -25.00% 0 6 10 14 18 22
Intra prediction modes
26 30 3...

Karhunen Loeve Transform
Performance in directions
BQMall, -0.37% 0 6 10 14 18 22
Intra prediction modes
26 30 34
0
250
20...

Karhunen Loeve Transform
Performance in directions
BQMall, -0.37% 0 6 10 14 18 22
Intra prediction modes
26 30 34
0
250
20...

Karhunen Loeve Transform
Yiqun Liu
Yiqun.Liu@tnt.uni-hannover.de
Simulation Result
Kimono
0 5 10 15
Scene−based
20 25
Cact...

Karhunen Loeve Transform
Yiqun Liu
Yiqun.Liu@tnt.uni-hannover.de
Kimono
0 5 10 15 20 25
Simulation Result Diagonal
BDBR. v...

Karhunen Loeve Transform
Yiqun Liu
Yiqun.Liu@tnt.uni-hannover.de
Distribution of TUs on frame
BasketballDrill, 1st frame, ...

Karhunen Loeve Transform
Yiqun Liu
Yiqun.Liu@tnt.uni-hannover.de
Distribution of TUs on frame
BasketballDrill, 1st frame, ...

Conclusion
Yiqun Liu
Yiqun.Liu@tnt.uni-hannover.de
General Idea
HM / JEM
Karhunen Loeve Transform
Conclusion
20

Scene-based KLT
 Based on QP, TU-size, PM and scenes
 Average gain 5.49%, maximum at 25.00%
 Diagonal direction brings ...

Institut für Informationsverarbeitung
Texture Synthesis
Bastain Wandt, Thorsten Laude, Bodo
Rosenhahn, Jörn Ostermann
pdf

Goal1
Penalty1
Penalty3
Penalty4
Texture Synthesis
46
Dipl.-Ing. Bastian Wandt
wandt@tnt.uni-hannover.de

Zusammenfassung
• AV1 has unseen level of encoder complexity
• Scene-based KLT 5%
• Non-linear intra prediction 0.5%
• Tex...

Share Slideshare

LinkedIn
Facebook
Twitter

Embed

Size (px)

Show related Slideshows at end

WordPress Shortcode

Link

Share
Email

2024 Trend Updates: What Really Wor... by Search Engine Jou... 1011447 views
Storytelling For The Web: Integrate... by Chiara Aliotta 919244 views
Artificial Intelligence, Data and C... by OECD Directorate ... 820562 views
How to Leverage AI to Boost Employe... by SocialHRCamp 342424 views
2024 State of Marketing Report – by... by Marius Sescu 195380 views
Everything You Need To Know About C... by Expeed Software 218594 views

View on Slideshare

1 of 47 Ad

View on Slideshare

1 of 47 Ad