SlideShare a Scribd company logo
Versatile Video Coding:
Compression Tools for UHD and 360◦ Video
INSA Rennes, France
23.11.2018
Priv.Doz. Dr.-Ing. habil. Mathias Wien
Lehrstuhl für Bildverarbeitung
RWTH Aachen University
wien@lfb.rwth-aachen.de
Outline I
1. Introduction
1.1 Context and Standardization Scope
2. VVC Development
2.1 Call for Proposals
2.2 Selected Coding Tools
3. VVC Standardization Status
3.1 VVC Working Draft and Test Model 1
3.2 VVC Working Draft and Test Model 2
3.3 VVC Working Draft and Test Model 3
4. Summary and Outlook
2 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Video coding standardization organisations
• ISO/IEC MPEG = “Moving Picture Experts Group”
(ISO/IEC JTC 1/SC 29/WG 11 = International Standardization Organization and International Electrotechnical
Commission, Joint Technical Committee 1, Subcommittee 29, Working Group 11)
• ITU-T VCEG = “Visual Coding Experts Group”
(ITU-T SG16/Q6 = International Telecommunications Union – Telecommunications Standardization Sector, Study
Group 16, Working Party 3, Question 6)
• JVT = “Joint Video Team” collaborative team of MPEG & VCEG, responsible for developing AVC
(discontinued in 2009)
• JCT-VC = “Joint Collaborative Team on Video Coding” team of MPEG & VCEG, responsible for developing
HEVC
(established January 2010)
• JVET = “Joint Video Experts Team” exploring potential for new technology beyond HEVC
(established Oct. 2015 as Joint Video Exploration Team, renamed Apr. 2018)
3 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
History of international video coding standardization (1985 – 2020)
4 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Specification Scope
source pre-processing encoding
transmission
decodingpost-processingdisplay
• No specification of encoder
– Profiles and levels
– Constraints by application
– Constraints on bitstream
• No specification of transport
• Common practice: Reference encoder
implementation
– Demonstration of coding performance
– Verification of specification conformance
• Focus of specification is on decoder
– Parsing process
– Bitstream syntax
– Decoding process
5 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Hybrid Video Coding Concept
Decoder
CTB
input picture
+
−
TR+Q
TB
iTR+iQ TB
+
Intra
PB
Entropy
Coding
bitstream
Deblk. Slice
Loop
Filter
Slice
rec. picture
Inter
PB
Buffer n pics
ME
PB
CTB – Coding Tree Block
ME – Motion Estimation
PB – Prediction Block
Q – Quantization
TB – Transform Block
TR – Transform
• Encoder includes decoder
• Basis of every standard since H.261
6 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Performance History of Standard Generations
7 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Contents
2. VVC Development
2.1 Call for Proposals
2.2 Selected Coding Tools
7 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Steps towards next generation standard – Versatile Video Coding (VVC)
• Experimental software “Joint Exploration Model“ (JEM) developed by JVET
– Intended to investigate potential for better compression beyond HEVC
– Was initially started extending HEVC software by additional compression tools, or replace existing tools
(see previous section)
• Substantial benefit was shown over HEVC, both in subjective quality and objective metrics
– Proven in "Call for Evidence" (July 2017) JVET-F1002, JVET-G1004 [1, 2]
– JEM was however not designed for becoming a standard (regarding all design tradeoffs)
– Call for Proposals was issued by MPEG and VCEG (October 2017), JVET-H1002 [3]
• Call for Proposals very successful (responses received by April 2018)
– 32 companies in 21 proponent groups responded
– 46 category-specific submissions: 22 in SDR, 12 each in HDR and 360◦ video
– All responses clearly better than HEVC, some evidently better than JEM
– This marked the starting point for VVC development
8 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Steps towards next generation standard – Versatile Video Coding (VVC)
• What does "Versatile" stand for?
• VVC should be usable for many types of data
– SDR and HDR up to extreme high resolutions
– All kind of camera generated content
– Computer generated content
– Non-camera video modalities e. g. medical data
– 360◦, lightfield, depth, and volumetric video
• VVC should support flexible random and localized access
• VVC should be easily configurable for various application needs
• The core of VVC should consist of minimum amount of necessary and well-understood building blocks
9 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Joint Call for Proposals (CfP) on Video Compression with Capability beyond HEVC
• Document JVET-H1002 [3]
• Test categories
– Standard dynamic range (SDR): 5 UHD and 5 HD sequences
– High dynamic range (HDR): 3 HLG and 5 PQ sequences
– 360◦ video (360): 5 sequences in ERP format
• Constraint sets
– Constraint set 1 (C1): Random access configuration
– Max 1.1s random access intervals, structural delay max 16 pictures
– Constraint set 2 (C2): Low delay configuration only evaluated for SDR HD sequences
– No picture reordering between input and output
• Encoding constraints
– No pre-processing, post-processing only within the coding loop
– Static quantizer setting with one-time change to meet target bitrate
– Relevant optimization methods to be reported
10 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
VVC CfP Test Sequences
11 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
VVC CfP Responses
• Category-specific submissions (total 46):
– SDR: 22 submissions (8 of which are registered only in this category)
– HDR: 12 submissions
– 360◦: 12 submissions (2 of which are registered only in this category)
For all categories: HEVC anchors (HM) and JEM anchors
• Proposals
– Described in JVET input documents JVET-J0011...JVET-J0033
– Participation of 32 institutions
12 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
CfP Performance Analysis
• Submissions had to provide coded/decoded sequences
– 4 rate points each, two constraint conditions "low delay" (LD) and "random access" (RA)
– SDR: 5× HD (both LD and RA), 5× UHD-4K (only RA)
– HDR: 5× HD (PQ grading), 3x UHD-4K (HLG grading)
– 360◦: 5 sequences 6K/8K for the full panorama
• Double stimulus test with two hidden anchors HEVC-HM and JEM
– Rate points defined with lowest rate was typically less than "fair" quality for HEVC, but still possible to code
– Quality was judged to be distinguishable when confidence intervals were non-overlapping
• Evaluation: Three ways of judging benefit:
– Mean MOS over all test cases (28×4 test points: 23×4 C1, 5×4 C2 )
– Count cases where a proposal was visually better/worse than JEM
– Count cases where a proposal was visually better than HEVC (HEVC at higher rate point)
• Reports: Input subjective test JVET-J0080 [27], output CfP results JVET-J1003 [28]
13 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
CfP Performance Analysis
• Measured by objective performance (PSNR), best performers report > 40% bit rate reduction compared to
HEVC, > 10% compared to JEM (for SDR case)
– Similar ranges for HDR and 360◦
– Obviously, proposals with more elements show better performance
– Some proposals showed similar performance as JEM with significant complexity/run time reduction
– 2 proposals used some degree of subjective optimization, not measurable by PSNR
Results of subjective tests generally show similar (or even better) tendency
– Benefit over HEVC very clear
– Benefit over JEM visible at various points
– Proposals with subjective optimization also showing benefit in some cases
14 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
CfP Performance Analysis
• JVET-J1003 [28]:
Report of subjective
evaluation contains
28 plots as shown,
one per sequence
• Count significant
cases of
positive/negative
benefit with
non-overlapping
confidence interval
against JEM
15 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
CfP Performance Analysis
• "Mean" and
"significance-count"
method suggested
at least 7 proposals
that were obviously
better than JEM
16 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
CfP Performance Analysis
• Similar tendency in
HDR and 360◦
categories
• Mostly same coding
tools as in SDR
provide good
benefit
17 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
CfP Performance Analysis: Comparison to HEVC
• The subjective quality of best performing proposals is always equal or sometimes better ( 1/3 of cases) than
HEVC at next higher rate point, over all categories (with approx. 40% less rate)
• The subjective quality of best performing proposals is always equal or sometimes better ( 1/5 of cases) than
HEVC at 2nd higher rate point, in SDR-UHD category (with approx. 65% less rate)
• Though it is not always the same proposal that performs best at a given rate point, it can be anticipated that
merits of different proposals can be combined
• 50% (or more) bit rate reduction with same quality will probably be achievable by the new standard
18 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
CfP Analysis: What is proposed?
• New elements (some come with high complexity):
– Decoder side estimation for mode/MV derivation and sample prediction both in intra and inter coding (JEM)
– Finer partitioning: Asymmetric, geometric
– Neural networks for prediction, loop filtering, upsampling, (encoder control)
– Additional elements using template matching
– Intra block copy / current picture referencing
– Additional non-linear, de-noising and statistics-based loop filters
– Additional linear and non-linear elements in prediction
• HDR specific:
– New adaptive reshaping and quantization, also in-loop
– HDR-specific modifications of existing tools, e. g. deblocking
• 360-video specific:
– Variants of projection formats, geometry-corrected face boundary padding
– Modification and disabling of existing tools at face boundaries
19 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
RWTH Proposal: Geometric Partitioning (GEO)
Figure from JVET-J0023 [16] Work by Max Bläser
20 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
RWTH Proposal: GEO Partitioning Coding and Prediction
Figures from JVET-J0023 [16]
21 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
GEO: Shape-Adaptive DCT for Geometric Partitions
Figure from JVET-J0023 [16]
• No transform-tree in JEM 7.0 → localization of residual error for larger blocks required
• ∆SA-DCT adapted from MPEG-4 software for blocks up to 128×128
• Currently floating point implementation - integer transform targeted
• SA-DCT signaled as additional transform choice next to full block DCT (→ 4 total GEO transform modes)
• Coding of transform coefficients (TSBs, significance flags) with regard to shape
22 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
GEO: Coding Example
Figure from JVET-J0023 [16]
• Visual improvements at object boundaries
– Sharper contours
– Less staircase-effect
– More background details
• Objective gains (BD-rate savings)
– Against HEVC: ∼33% on C1, ∼25% on C2
– Against JEM: ∼0.8% for both, C1 and C2
23 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
GEO: Coding Example
Figure from JVET-J0023 [16]
• Visual improvements at object boundaries
– Sharper contours
– Less staircase-effect
– More background details
• Objective gains (BD-rate savings)
– Against HEVC: ∼33% on C1, ∼25% on C2
– Against JEM: ∼0.8% for both, C1 and C2
24 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
RWTH Proposal: 360◦ Geometry-Corrected Prediction
Figure from JVET-J0023 [16] Work by Johannes Sauer
25 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
RWTH Proposal: 360◦ Geometry-Corrected Prediction
Figure from JVET-J0023 [16]
• Approach can be transferred to other formats
26 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
RWTH Proposal: 360◦ Corrected Deblocking
• Reference samples of blocks at face boundaries
changed
– Original: Samples from top or left block are used
– Modified: Samples are chosen according to 3D
cube geometry
• Approach can be transferred to other coding formats
Figure from JVET-J0023 [16]
27 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
RWTH Proposal: 360◦ Coding Example
Figure from JVET-J0023 [16]
• Objective gains (BD-rate savings)
– Against HEVC: ∼31% E2E WS-PSNR
– Against JEM: ∼1.6% (same projection
format)
28 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Contents
3. VVC Standardization Status
3.1 VVC Working Draft and Test Model 1
3.2 VVC Working Draft and Test Model 2
3.3 VVC Working Draft and Test Model 3
28 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
VVC Working Draft and Test Model 1
• VVC Working Draft 1 / Test Model 1 (VTM1): basic approach
built on "reduced HEVC" starting point
• VTM Block structure
– Unified tree (coding block unites prediction and transform)
– CTU size 128×128, rectangular blocks (dyadic sizes), smallest luma size 4×4
– Maximum transform size 64×64
• VTM: Some removed elements of HEVC:
– Mode dependent transform (DST-VII), mode dependent scan
– Strong intra smoothing
– Sign data hiding in transform coding
– Unnecessary high-level syntax (e. g. VPS)
– Tiles and wavefronts
– Quantization weighting
29 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Benchmark Set and its role
• Benchmark Set (BMS) was defined in addition to VTM, including the following well-known JEM tools:
– 65 intra prediction modes
– Coefficient coding
– AMT + 4×4 NSST
– Affine motion
– Geometry based adaptive loop filter
– Subblock merge candidate (ATMVP)
– Adaptive motion vector precision
– Decoder motion vector refinement
– LM Chroma mode
• Purpose: Testing benefit of technology against better performing set
– Holding extra potential features which are not yet decided upon
– Superset of VTM; should have significant gain over the VTM
– Unveils in CEs whether gains are independent, or how much gain remains when a tool is combined with a set
of more performant tools
– Can be a common basis for further CE tests of modified versions of features
– Not necessarily ultra-low complexity, but encoder needs to be runnable in reasonable amount of time
30 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Quad/binary/ternary partitioning
• The only fundamental new element of version 1
• Simple multi-type tree split, can be alternated
Figures from JVET-J1001 [29]
31 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Performance of VTM1 compared to HEVC
Figures from JVET-K0003 [30]
32 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Contents
1. Introduction
1.1 Context and Standardization Scope
2. VVC Development
2.1 Call for Proposals
2.2 Selected Coding Tools
3. VVC Standardization Status
3.1 VVC Working Draft and Test Model 1
3.2 VVC Working Draft and Test Model 2
3.3 VVC Working Draft and Test Model 3
4. Summary and Outlook
32 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
New elements of WD2 / VTM2
• QT/BT/TT no longer “placeholder”
• Remove unnecessary partitioning restrictions
• Implicit splitting at picture boundaries
• Separate trees for intra slices
• Position Dependent Prediction Combination
• Cross Component Linear Model
• 87 intra modes (wide angles included), 3 MPM, TU binarization
• Affine MC (4×4 fixed subblock size, 4/6 parameter model switching at CU level)
• Affine MV coding
– list construction contains inheritance and derivation spatial/temporal
– improved difference coding
• Adaptive motion vector resolution (AMVR)
• Subblock MC (4×4) from ATMVP merge, 8×8 granularity motion vector storage [High precision]
33 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
New elements of WD2 / VTM2
• Multiple transform selection (all are DCT/DST types) for intra and inter
• Increase max QP from 51 to 63
• Modified entropy coding supporting dependent quantization
• Sign data hiding reinvoked from HEVC
• Adaptive loop filter
– 4×4 classification based (gradient strength & orientation) for luma
– 7×7 luma, 5×5 chroma filters)
– enabling flag at CTU level
• Basic high-level syntax (SPS, PPS, slice)
• Update of BMS contains
– Generalized Bi prediction (kind of local weighted prediction)
– Decoder-side estimation: BIO, simplified bilateral matching
– Current picture referencing (aka intra block copy)
34 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
VTM2: Wide angular modes
• For rectangular blocks, prediction directions with angles beyond 45/135 degrees are reasonable
• This can be implemented by adding modes at both ends
• VTM2 uses a total of 85 directional intra modes now (plus DC and planar)
Figure from JVET-K0500 [31]
35 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
VTM2: Dependent quantization
• Alternating between two quantizers based on state transition rule allows to select an optimum sequence of
reconstruction values (e.g. by trellis-like search)
• Decoder needs to implement the sequential state transition rule
• CABAC contexts needs to be modified as well for this case
(greater than 0/1/2/... would have different meaning depending on Q0/Q1)
Figures from JVET-K0071 [32]
36 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Performance of VTM2 compared to HEVC
Figures from JVET-L0003 [33]
37 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Contents
1. Introduction
1.1 Context and Standardization Scope
2. VVC Development
2.1 Call for Proposals
2.2 Selected Coding Tools
3. VVC Standardization Status
3.1 VVC Working Draft and Test Model 1
3.2 VVC Working Draft and Test Model 2
3.3 VVC Working Draft and Test Model 3
4. Summary and Outlook
37 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
VVC Working Draft and Test Model 3
• Executive summary
– Coding tools
Improvements of coding efficiency, simplification, practicality and unification of design
– High level syntax – some basic agreements
"Slice" concept gone – tiles offer more flexibility for various aspects such as localized access and parallelism
Signalling mechanisms for tool usage to enable sub-profiles, including external subprofiles, whole-bitstream
constraints
– BMS no longer necessary - VTM has come close in performance
38 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
New elements of WD3 / VTM3 [1/2]
Meeting report JVET-L1000 [34]
• Partitioning
– QT-BT-TT stabilization
• Intra Prediction
– Multi-reference line intra prediction
– Intra DCTIF / Gaussian interpolation filter
– Cross-component linear model prediction (CCLM)
– Current picture referencing
• Inter Prediction
– Affine modes stabilization
– Triangular partitions (more details to follow)
– Combine merge and intra
– History-based MV prediction
– Bi-directional optical flow (BIO)
39 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
New elements of WD3 / VTM3 [2/2]
Meeting report JVET-L1000 [34]
• Residual Coding
– Transform matrices with 8bit coefficients (compatible with HEVC)
• Loop filters
– Adding SAO from HEVC
• High-Level Syntax
– There will be no slices anymore
– POC signalling
– Sign data hiding
40 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Inter Prediction: Triangular partitions
• Concept proposed in JVET-J0020 [13]
• Applicable to Merge and Skip blocks
• Minimum block size 8×8
Figures from JVET-L0124 [35]
41 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Contents
4. Summary and Outlook
41 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Summary and Outlook
• Call for Proposals demonstrated availability of significant compression benefit
– HEVC out-performed by virtually all proposals
– Subjective results suggest initial rate savings of 40+% over HEVC at starting point
• Versatile Video Coding (VVC): Third Working Draft and Test Model defined
– Started from reduced initial tool set
– Step-by-step integration of tools
– Evaluation of concurring variants of tools
– Consideration of algorithmic complexity
– Further fast progress expected, goal: finalization 2020
• Main focus on SDR/HDR content at this development stage
– Core experiments (CEs 1-12) on Partitioning, Adaptive loop filter, Intra prediction and mode coding, Inter
prediction and MV coding, Arithmetic coding engine, Transforms and transform signalling, Quantization and
coefficient coding, Screen content coding tools, Decoder side MV derivation, Combined and multi-hypothesis
prediction, Deblocking, Mapping for HDR content
– Core experiment CE13 on coding tools for omnidirectional video
42 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Thank you for your attention
Any questions?
Contents
5. Links and Further Information
43 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Links and Further Information
• Document archives (publicly accessible)
– JVET / VVC:
http://phenix.it-sudparis.eu/jvet
http://ftp3.itu.ch/av-arch/jvet-site
– JCT-VC / HEVC:
http://phenix.it-sudparis.eu/jct
http://ftp3.itu.ch/av-arch/jctvc-site
• VTM Software: https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/
• VTM Trac: https://jvet.hhi.fraunhofer.de/trac/vvc/
44 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Contents
6. Acronyms
44 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Acronyms I
ABT – Asymmetric binary tree
AF INTER – Affine motion vector derivation inter mode
AF MERGE – Affine motion vector derivation merge mode
AFP – Adaptive frame packing
AHG – Ad-hoc group
AI – All intra (JCT-VC CTC)
ALF – Adaptive loop filter
ALTR – Adaptive long-term reference
AMT – Adaptive multiple core transform (also EMT)
AMVP – Advanced motion vector prediction
AMVR – Adaptive motion vector resolution
AQS – Adaptive quantization step size scaling
ATMVP – Alternative temporal motion vector prediction
BDIP – Bi-directional intra prediction
BDSNR – Bjøntegaard Delta PSNR
BD-rate – Bjøntegaard Delta rate
BLA – Broken link access
CABAC – Context adaptive binary arithmetic coding
CB – Coding block
CF – Combined filter (intra prediction)
CCIP – Cross-component intra prediction
CCLM – Cross-component linear model prediction
CNNLF – Convolution neural network loop filter
CPMV – Control point motion vector
CRA – Clean random access
45 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Acronyms II
CU – Coding unit
CVS – Coded Video Sequence
CVSG – Coded Video Sequence Group
DMVD – Decoder side motion vector derivation
DMVR – Decoder-side motion vector refinement
DRA – Dynamic range adaptation
EAC – Enhanced angular cubemap
EMT – Explicit multiple core transforms (also AMT)
EOTF – Electro-optical transfer function
GEO – Geometric partitioning
GRL – Givens rotation layer
HAC – Hybrid angular cubemap
HWT – Hadamart-Walsh transform
HyGT – Hypercube-Givens transform
IBC – Intra block copy
IDR – Instantaneous decoder refresh
IPR – Inter prediction refinement
JEM – Joint exploration model (JVET test model)
LAMVR – Locally adaptive motion vector resolution
LGT – Layered Givens transform
LIC – Local illumination compensation
LIP – Linear intra prediction
LM – Linear model prediction
LPS – Least probably symbol
MAP – Merge assistant prediction
MBF – Multiple boundary filtering
46 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Acronyms III
MCP – Modified cubemap projection
MDCS – Mode-dependent coefficient scanning
MDIS – Mode-dependent intra reference sample smoothing
MDNSST – Mode-dependent non-separable secondary transforms
Merge – Merge Mode (MV prediction)
MFLM – Multiple filter linear model prediction
MIP – Multi-line intra prediction
MIP – Multi-combined intra prediction
MMLM – Multi-Model Cross-component linear model prediction
MBLM – Multiple neighbor linear model
MPCR – Motion predictor candidate refinement
MRIP – Multi-reference intra prediction
MRM – Motion refinement mode
MTT – Multi-type tree
MV – Motion vector
NAL – Network abstraction layer
NLMLF – Non-local mean loop filter
NLSF – Non-local structure-based filter
NSF – Noise suppression filter
NSST – Non-separable secondary transforms
OBMC – Overlapped block motion compensation
OETF – Opto-electrical transfer function
PB – Prediction block
PDPC – Position dependent intra prediction combination for planar mode
PMMVD – Pattern matched motion vector derivation
PMVD – Pattern matched motion vector derivation
47 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Acronyms IV
PMVR – Pattern-matched motion vector refinement
PU – Prediction unit
QP – Quantization parameter
QT – Quad-tree
QTBTT – Quad-tree plus binary tree and ternary tree (also QTBTTT)
RADL – Random access decodable leading picture
RAP – Random access point
RASL – Random access skipped leading picture
RBSP – Raw byte sequence payload
RC-ALF – Reduced-complexity adaptive loop filter
RQT – Residual quad-tree
RSP – Rotated sphere projection
RST – Reduced secondary transform
SAO – Sample adaptive offset
SDP – Signal dependent transform
SODB – String of data bits
SHVC – Scalable high efficiency video coding
SRCC – Scan region-based coefficient coding
STMVP – Spatial-temporal motion vector prediction
STSA – Stepwise temporal sub-layer access
SUCO – Split unit coding order
SVT – Spatial varying transform
TB – Transform block
TD-RSP – Residual signs prediction in transform domain
TMM – Template matchted merge mode
TMVP – Temporal motion vector predictor
48 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Acronyms V
TSA – Temporal sub-layer access
TSR – Transform syntax reorder
TU – Transform unit
UMVE – Ultimate motion vector expression
UWP – Unequal weight planar prediction
WPP – Wavefront parallel processing
XGA – Extended Graphics Array 1024×768
XYZ – XYZ color space, also color format
YCbCr – Color format with luma and two chroma components
YUV – XYZ color format
49 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Literature I
[1] Mathias Wien et al. Joint Call for Evidence on Video Compression with Capability beyond HEVC. Tech. rep. JVET-F1002. Hobart, AU, 6th meeting: Joint Video Exploration Team (JVET)
of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Oct. 18, 2017. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/6_Hobart/wg11/JVET-F1002-v1.zip.
[2] Vittorio Baroncini et al. Results of the Joint Call for Evidence on Video Compression with Capability beyond HEVC. Tech. rep. JVET-G1004. Torino, IT, 7th meeting: Joint Video
Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, July 21, 2017. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/7_Torino/wg11/JVET-G1004-v2.zip.
[3] Andrew Segall et al. Joint Call for Proposals on Video Compression with Capability beyond HEVC. Tech. rep. JVET-H1002. Macao, CN, 8th meeting: Joint Video Experts Team (JVET)
of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Oct. 18, 2017. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/8_Macau/wg11/JVET-H1002-v6.zip.
[4] Zhao Wang et al. Description of SDR video coding technology proposal by DJI and Peking University. Doc. JVET–J0011. San Diego, CA, USA, 10th meeting: Joint Video Experts Team
(JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0012-v2.zip.
[5] Rickard Sjöberg et al. Description of SDR and HDR video coding technology proposal by Ericsson and Nokia. Doc. JVET-J0012. San Diego, CA, USA, 10th meeting: Joint Video
Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0012-v2.zip.
[6] Jung Won Kang et al. Description of SDR video coding technology proposal by ETRI and Sejong University. Doc. JVET-J0013. San Diego, CA, USA, 10th meeting: Joint Video Experts
Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0013-v3.zip.
[7] M. Albrecht et al. Description of SDR, HDR, and 360◦ video coding technology proposal by Fraunhofer HHI. Doc. JVET-J0014. San Diego, CA, USA, 10th meeting: Joint Video Experts
Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0014-v4.zip.
[8] Xiaoyu Xiu et al. Description of SDR, HDR, and 360◦ video coding technology proposal by InterDigital Communications and Dolby Laboratories. Doc. JVET-J0015. San Diego, CA, USA,
10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0015-v3.zip.
50 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Literature II
[9] Kei Kawamura, Yoshitaka Kidani, and Sei Naito. Description of SDR video coding technology proposal by KDDI. Doc. JVET-J0016. San Diego, CA, USA, 10th meeting: Joint Video
Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0016-v4.zip.
[10] Moonmo Koo et al. Description of SDR video coding technology proposal by LG Electronics. Doc. JVET-J0017. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of
ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0017-v2.zip.
[11] Chih-Wei Hsu et al. Description of SDR video coding technology proposal by MediaTek. Doc. JVET-J0018. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of
ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0018-v2.zip.
[12] Jian-Liang Lin et al. Description of 360◦ video coding technology proposal by MediaTek. Doc. JVET-J0019. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of
ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0019-v3.zip.
[13] Tadamasa Toma et al. Description of SDR video coding technology proposal by Panasonic. Doc. JVET-J0020. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of
ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0020-v2.zip.
[14] Y. Chen et al. Description of SDR, HDR and 360◦ video coding technology proposal by Qualcomm and Technicolor – low and high complexity versions. Doc. JVET-J0021. San Diego,
CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0021-v5.zip.
[15] Philippe Bordes et al. Description of SDR, HDR and 360◦ video coding technology proposal by Qualcomm and Technicolor – medium complexity version. Doc. JVET-J0022. San Diego,
CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0022-v3.zip.
[16] Max Blaeser, Johannes Sauer, and Mathias Wien. Description of SDR and 360◦ video coding technology proposal by RWTH Aachen University. Doc. JVET-J0023. San Diego, CA,
USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0023-v3.zip.
51 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Literature III
[17] Sri Nitchith Akula et al. Description of SDR, HDR and 360◦ video coding technology proposal considering mobile application scenario by Samsung, Huawei, GoPro, and HiSilicon. Doc.
JVET-J0024. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0024-v5.zip.
[18] Huanbang Chen et al. Description of SDR, HDR and 360◦ video coding technology proposal considering mobile application scenario by Huawei, GoPro, HiSilicon, and Samsung. Doc.
JVET-J0025. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0025-v4.zip.
[19] Kiran Misra et al. Description of SDR and HDR video coding technology proposal by Sharp and Foxconn. Doc. JVET-J0026. San Diego, CA, USA, 10th meeting: Joint Video Experts
Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0026-v11.zip.
[20] Shunsuke Iwamura et al. Description of SDR and HDR video coding technology proposal by NHK and Sharp. Doc. JVET-J0027. San Diego, CA, USA, 10th meeting: Joint Video Experts
Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0027-v5.zip.
[21] Teruhiko Suzuki, Masaru Ikeda, and Karl Sharman. Description of SDR and HDR video coding technology proposal by Sony. Doc. JVET-J0028. San Diego, CA, USA, 10th meeting:
Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0028-v2.zip.
[22] Xiang Li et al. Description of SDR video coding technology proposal by Tencent. Doc. JVET-J0029. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG
16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0029-v4.zip.
[23] Alexandre Gabriel and Emmanuel Thomas. Description of 360◦ video coding technology proposal by TNO. Doc. JVET-J0030. San Diego, CA, USA, 10th meeting: Joint Video Experts
Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0030-v2.zip.
[24] David Bull, Fan Zhang, and Mariana Afonso. Description of SDR video coding technology proposal by University of Bristol. Doc. JVET-J0031. San Diego, CA, USA, 10th meeting: Joint
Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0031-v3.zip.
52 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Literature IV
[25] Feng Wu et al. Description of SDR video coding technology proposal by University of Science and Technology of China, Peking University, Harbin Institute of Technology, and Wuhan
University (IEEE 1857.10 Study Group). Doc. JVET-J0032. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG
11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0032-v4.zip.
[26] Yule Sun et al. Description of 360◦ video coding technology proposal by Zhejiang University. Doc. JVET-J0033. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of
ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0033-v3.zip.
[27] Vittorio Baroncini. Results of Subjective Testing of Responses to the Joint CfP on Video Compression Technology with Capability beyond HEVC. Doc. JVET-J0080. 10th meeting, San
Diego, CA, USA: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0080-v2.zip.
[28] Vittorio Baronchini, Jens-Rainer Ohm, and Gary Sullivan. Report of results from the Call for Proposals on Video Compression with Capability beyond HEVC. Doc. JVET-J1003. San
Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/current_document.php?id=3540.
[29] Benjamin Bross. Versatile Video Coding (Draft 1). Doc. JVET-J1001. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC
1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J1001-v2.zip.
[30] Frank Bossen, Xiang Li, and Karsten Suehring. JVET AHG report: Test model software development (AHG3). Doc. JVET-K1001. Ljubljana, SI, 11th meeting: Joint Video Experts Team
(JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, July 18, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/11_Ljubljana/wg11/JVET-K0003-v2.zip.
[31] Fabien Racapé et al. CE3-related: Wide-angle intra prediction for non-square blocks. Doc. JVET-K0500. Ljubljana, SI, 11th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16
WP 3 and ISO/IEC JTC 1/SC 29/WG 11, July 18, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/11_Ljubljana/wg11/JVET-K0500-v6.zip.
[32] Heiko Schwarz et al. CE7: Transform Coefficient Coding and Dependent Quantization (Tests 7.1.2, 7.2.1). Doc. JVET-K0071. Ljubljana, SI, 11th meeting: Joint Video Experts Team
(JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, July 18, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/11_Ljubljana/wg11/JVET-K0071-v2.zip.
[33] Frank Bossen, Xiang Li, and Karsten Suehring. JVET AHG report: Test model software development (AHG3). Doc. JVET-L0003. Macao, CN, 12th meeting: Joint Video Experts Team
(JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Oct. 3, 2018. URL:
http://phenix.int-evry.fr/jvet/doc_end_user/documents/12_Macao/wg11/JVET-L0003-v1.zip.
53 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
Literature V
[34] Gary J. Sullivan and Jens-Rainer Ohm. Meeting report of the 12th meeting of the Joint Video Exploration Team (JVET), Macao, CN, 3–12 October 2018. Doc. JVET-L1000. Macao, CN,
12th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Oct. 2018. URL:
https://www.itu.int/wftp3/av-arch/jvet-site/2018_10_L_Macao/JVET-L_Notes_dB.docx.
[35] Ru-Ling Liao and Chong Soon Lim. CE10.3.1.b: Triangular prediction unit mode. Doc. JVET-L0124. Macao, CN, 12th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3
and ISO/IEC JTC 1/SC 29/WG 11, Oct. 3, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/12_Macao/wg11/JVET-L0124-v6.zip.
54 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes

More Related Content

What's hot

H.264 video compression standard.
H.264 video compression standard.H.264 video compression standard.
H.264 video compression standard.
Axis Communications
 
VVC tutorial at ICME 2020 together with Benjamin Bross
VVC tutorial at ICME 2020 together with Benjamin BrossVVC tutorial at ICME 2020 together with Benjamin Bross
VVC tutorial at ICME 2020 together with Benjamin Bross
Mathias Wien
 
An Introduction to Versatile Video Coding (VVC) for UHD, HDR and 360 Video
An Introduction to  Versatile Video Coding (VVC) for UHD, HDR and 360 VideoAn Introduction to  Versatile Video Coding (VVC) for UHD, HDR and 360 Video
An Introduction to Versatile Video Coding (VVC) for UHD, HDR and 360 Video
Dr. Mohieddin Moradi
 
Introduction to H.264 Advanced Video Compression
Introduction to H.264 Advanced Video CompressionIntroduction to H.264 Advanced Video Compression
Introduction to H.264 Advanced Video Compression
Iain Richardson
 
An Overview of High Efficiency Video Codec HEVC (H.265)
An Overview of High Efficiency Video Codec HEVC (H.265)An Overview of High Efficiency Video Codec HEVC (H.265)
An Overview of High Efficiency Video Codec HEVC (H.265)
Varun Ravi
 
AV1: the next generation video codec
AV1: the next generation video codecAV1: the next generation video codec
AV1: the next generation video codec
Ting-Li Chou
 
H.264 video standard
H.264 video standardH.264 video standard
H.264 video standard
Sajan Sahu
 
Mpegts introduction
Mpegts introductionMpegts introduction
Mpegts introduction
frankyao23
 
Dvb Serviceinformation
Dvb ServiceinformationDvb Serviceinformation
Dvb Serviceinformationgeeksrik
 
Introduction to Video Compression Techniques - Anurag Jain
Introduction to Video Compression Techniques - Anurag JainIntroduction to Video Compression Techniques - Anurag Jain
Introduction to Video Compression Techniques - Anurag JainVideoguy
 
Versatile Video Coding – Video Compression beyond HEVC: Coding Tools for SDR ...
Versatile Video Coding – Video Compression beyond HEVC: Coding Tools for SDR ...Versatile Video Coding – Video Compression beyond HEVC: Coding Tools for SDR ...
Versatile Video Coding – Video Compression beyond HEVC: Coding Tools for SDR ...
Förderverein Technische Fakultät
 
Video Coding Standard
Video Coding StandardVideo Coding Standard
Video Coding StandardVideoguy
 
Getting the most out of H.264
Getting the most out of H.264Getting the most out of H.264
Getting the most out of H.264
Iain Richardson
 
Thinking about IP migration
Thinking about IP migration Thinking about IP migration
Thinking about IP migration
Dr. Mohieddin Moradi
 
High Efficiency Video Codec
High Efficiency Video CodecHigh Efficiency Video Codec
High Efficiency Video Codec
Tejus Adiga M
 
VVC tutorial at ICIP 2020 together with Benjamin Bross
VVC tutorial at ICIP 2020 together with Benjamin BrossVVC tutorial at ICIP 2020 together with Benjamin Bross
VVC tutorial at ICIP 2020 together with Benjamin Bross
Mathias Wien
 
Bitmovin AV1/VVC Presentation_Streaming Media East by Christian Feldmann
Bitmovin AV1/VVC Presentation_Streaming Media East by Christian FeldmannBitmovin AV1/VVC Presentation_Streaming Media East by Christian Feldmann
Bitmovin AV1/VVC Presentation_Streaming Media East by Christian Feldmann
Bitmovin Inc
 
HDR and WCG Video Broadcasting Considerations
HDR and WCG Video Broadcasting ConsiderationsHDR and WCG Video Broadcasting Considerations
HDR and WCG Video Broadcasting Considerations
Dr. Mohieddin Moradi
 
HDR and WCG Principles-Part 1
HDR and WCG Principles-Part 1HDR and WCG Principles-Part 1
HDR and WCG Principles-Part 1
Dr. Mohieddin Moradi
 

What's hot (20)

H.264 video compression standard.
H.264 video compression standard.H.264 video compression standard.
H.264 video compression standard.
 
VVC tutorial at ICME 2020 together with Benjamin Bross
VVC tutorial at ICME 2020 together with Benjamin BrossVVC tutorial at ICME 2020 together with Benjamin Bross
VVC tutorial at ICME 2020 together with Benjamin Bross
 
An Introduction to Versatile Video Coding (VVC) for UHD, HDR and 360 Video
An Introduction to  Versatile Video Coding (VVC) for UHD, HDR and 360 VideoAn Introduction to  Versatile Video Coding (VVC) for UHD, HDR and 360 Video
An Introduction to Versatile Video Coding (VVC) for UHD, HDR and 360 Video
 
Introduction to H.264 Advanced Video Compression
Introduction to H.264 Advanced Video CompressionIntroduction to H.264 Advanced Video Compression
Introduction to H.264 Advanced Video Compression
 
An Overview of High Efficiency Video Codec HEVC (H.265)
An Overview of High Efficiency Video Codec HEVC (H.265)An Overview of High Efficiency Video Codec HEVC (H.265)
An Overview of High Efficiency Video Codec HEVC (H.265)
 
AV1: the next generation video codec
AV1: the next generation video codecAV1: the next generation video codec
AV1: the next generation video codec
 
H.264 video standard
H.264 video standardH.264 video standard
H.264 video standard
 
Mpegts introduction
Mpegts introductionMpegts introduction
Mpegts introduction
 
Dvb Serviceinformation
Dvb ServiceinformationDvb Serviceinformation
Dvb Serviceinformation
 
Introduction to Video Compression Techniques - Anurag Jain
Introduction to Video Compression Techniques - Anurag JainIntroduction to Video Compression Techniques - Anurag Jain
Introduction to Video Compression Techniques - Anurag Jain
 
Versatile Video Coding – Video Compression beyond HEVC: Coding Tools for SDR ...
Versatile Video Coding – Video Compression beyond HEVC: Coding Tools for SDR ...Versatile Video Coding – Video Compression beyond HEVC: Coding Tools for SDR ...
Versatile Video Coding – Video Compression beyond HEVC: Coding Tools for SDR ...
 
Video Coding Standard
Video Coding StandardVideo Coding Standard
Video Coding Standard
 
Getting the most out of H.264
Getting the most out of H.264Getting the most out of H.264
Getting the most out of H.264
 
Thinking about IP migration
Thinking about IP migration Thinking about IP migration
Thinking about IP migration
 
High Efficiency Video Codec
High Efficiency Video CodecHigh Efficiency Video Codec
High Efficiency Video Codec
 
VVC tutorial at ICIP 2020 together with Benjamin Bross
VVC tutorial at ICIP 2020 together with Benjamin BrossVVC tutorial at ICIP 2020 together with Benjamin Bross
VVC tutorial at ICIP 2020 together with Benjamin Bross
 
intro_dgital_TV
intro_dgital_TVintro_dgital_TV
intro_dgital_TV
 
Bitmovin AV1/VVC Presentation_Streaming Media East by Christian Feldmann
Bitmovin AV1/VVC Presentation_Streaming Media East by Christian FeldmannBitmovin AV1/VVC Presentation_Streaming Media East by Christian Feldmann
Bitmovin AV1/VVC Presentation_Streaming Media East by Christian Feldmann
 
HDR and WCG Video Broadcasting Considerations
HDR and WCG Video Broadcasting ConsiderationsHDR and WCG Video Broadcasting Considerations
HDR and WCG Video Broadcasting Considerations
 
HDR and WCG Principles-Part 1
HDR and WCG Principles-Part 1HDR and WCG Principles-Part 1
HDR and WCG Principles-Part 1
 

Similar to Versatile Video Coding: Compression Tools for UHD and 360° Video

VVC tutorial at VCIP 2020 together with Benjamin Bross
VVC tutorial at VCIP 2020 together with Benjamin BrossVVC tutorial at VCIP 2020 together with Benjamin Bross
VVC tutorial at VCIP 2020 together with Benjamin Bross
Mathias Wien
 
THE H.264/MPEG4 AND ITS APPLICATIONS
THE H.264/MPEG4 AND ITS APPLICATIONSTHE H.264/MPEG4 AND ITS APPLICATIONS
THE H.264/MPEG4 AND ITS APPLICATIONS
GIST (Gwangju Institute of Science and Technology)
 
Comparison of compression efficiency between HEVC and VP9 based on subjective...
Comparison of compression efficiency between HEVC and VP9 based on subjective...Comparison of compression efficiency between HEVC and VP9 based on subjective...
Comparison of compression efficiency between HEVC and VP9 based on subjective...
Touradj Ebrahimi
 
PCS 2019 Panel on Emerging Video Coding Standards: Overview on the Emerging V...
PCS 2019 Panel on Emerging Video Coding Standards: Overview on the Emerging V...PCS 2019 Panel on Emerging Video Coding Standards: Overview on the Emerging V...
PCS 2019 Panel on Emerging Video Coding Standards: Overview on the Emerging V...
Mathias Wien
 
Trends and Recent Developments in Video Coding Standardization
Trends and Recent Developments in Video Coding StandardizationTrends and Recent Developments in Video Coding Standardization
Trends and Recent Developments in Video Coding Standardization
Mathias Wien
 
What’s new in MPEG?
What’s new in MPEG?What’s new in MPEG?
What’s new in MPEG?
Alpen-Adria-Universität
 
Tutorial High Efficiency Video Coding Coding - Tools and Specification.pdf
Tutorial High Efficiency Video Coding Coding - Tools and Specification.pdfTutorial High Efficiency Video Coding Coding - Tools and Specification.pdf
Tutorial High Efficiency Video Coding Coding - Tools and Specification.pdf
ssuserc5a4dd
 
IEEEGlobecom'22-OL-RICHTER.pdf
IEEEGlobecom'22-OL-RICHTER.pdfIEEEGlobecom'22-OL-RICHTER.pdf
IEEEGlobecom'22-OL-RICHTER.pdf
Reza Farahani
 
Islem Mansri.pdf
Islem Mansri.pdfIslem Mansri.pdf
Islem Mansri.pdf
Islem Mansri
 
Advanced Mechanisms for Delivering High-Quality Digital Content
Advanced Mechanisms for Delivering High-Quality Digital ContentAdvanced Mechanisms for Delivering High-Quality Digital Content
Advanced Mechanisms for Delivering High-Quality Digital Content
Mikołaj Leszczuk
 
Paper id 2120148
Paper id 2120148Paper id 2120148
Paper id 2120148IJRAT
 
Immersive Video Delivery: From Omnidirectional Video to Holography
Immersive Video Delivery: From Omnidirectional Video to HolographyImmersive Video Delivery: From Omnidirectional Video to Holography
Immersive Video Delivery: From Omnidirectional Video to Holography
Alpen-Adria-Universität
 
Video coding technology proposal by
Video coding technology proposal by Video coding technology proposal by
Video coding technology proposal by Videoguy
 
Video coding technology proposal by
Video coding technology proposal by Video coding technology proposal by
Video coding technology proposal by Videoguy
 
Video coding technology proposal by
Video coding technology proposal by Video coding technology proposal by
Video coding technology proposal by Videoguy
 
Video coding technology proposal by
Video coding technology proposal by Video coding technology proposal by
Video coding technology proposal by Videoguy
 
PERFORMANCE EVALUATION OF H.265/MPEG-HEVC, VP9 AND H.264/MPEGAVC VIDEO CODING
PERFORMANCE EVALUATION OF H.265/MPEG-HEVC, VP9 AND H.264/MPEGAVC VIDEO CODINGPERFORMANCE EVALUATION OF H.265/MPEG-HEVC, VP9 AND H.264/MPEGAVC VIDEO CODING
PERFORMANCE EVALUATION OF H.265/MPEG-HEVC, VP9 AND H.264/MPEGAVC VIDEO CODING
ijma
 
Algorithm of standard videocodec H.264
Algorithm of standard videocodec H.264 Algorithm of standard videocodec H.264
Algorithm of standard videocodec H.264
chintapallisantoshkumar
 
[IJET-V1I2P1] Authors :Imran Ullah Khan ,Mohd. Javed Khan ,S.Hasan Saeed ,Nup...
[IJET-V1I2P1] Authors :Imran Ullah Khan ,Mohd. Javed Khan ,S.Hasan Saeed ,Nup...[IJET-V1I2P1] Authors :Imran Ullah Khan ,Mohd. Javed Khan ,S.Hasan Saeed ,Nup...
[IJET-V1I2P1] Authors :Imran Ullah Khan ,Mohd. Javed Khan ,S.Hasan Saeed ,Nup...
IJET - International Journal of Engineering and Techniques
 
Next generation image compression standards: JPEG XR and AIC
Next generation image compression standards: JPEG XR and AICNext generation image compression standards: JPEG XR and AIC
Next generation image compression standards: JPEG XR and AIC
Touradj Ebrahimi
 

Similar to Versatile Video Coding: Compression Tools for UHD and 360° Video (20)

VVC tutorial at VCIP 2020 together with Benjamin Bross
VVC tutorial at VCIP 2020 together with Benjamin BrossVVC tutorial at VCIP 2020 together with Benjamin Bross
VVC tutorial at VCIP 2020 together with Benjamin Bross
 
THE H.264/MPEG4 AND ITS APPLICATIONS
THE H.264/MPEG4 AND ITS APPLICATIONSTHE H.264/MPEG4 AND ITS APPLICATIONS
THE H.264/MPEG4 AND ITS APPLICATIONS
 
Comparison of compression efficiency between HEVC and VP9 based on subjective...
Comparison of compression efficiency between HEVC and VP9 based on subjective...Comparison of compression efficiency between HEVC and VP9 based on subjective...
Comparison of compression efficiency between HEVC and VP9 based on subjective...
 
PCS 2019 Panel on Emerging Video Coding Standards: Overview on the Emerging V...
PCS 2019 Panel on Emerging Video Coding Standards: Overview on the Emerging V...PCS 2019 Panel on Emerging Video Coding Standards: Overview on the Emerging V...
PCS 2019 Panel on Emerging Video Coding Standards: Overview on the Emerging V...
 
Trends and Recent Developments in Video Coding Standardization
Trends and Recent Developments in Video Coding StandardizationTrends and Recent Developments in Video Coding Standardization
Trends and Recent Developments in Video Coding Standardization
 
What’s new in MPEG?
What’s new in MPEG?What’s new in MPEG?
What’s new in MPEG?
 
Tutorial High Efficiency Video Coding Coding - Tools and Specification.pdf
Tutorial High Efficiency Video Coding Coding - Tools and Specification.pdfTutorial High Efficiency Video Coding Coding - Tools and Specification.pdf
Tutorial High Efficiency Video Coding Coding - Tools and Specification.pdf
 
IEEEGlobecom'22-OL-RICHTER.pdf
IEEEGlobecom'22-OL-RICHTER.pdfIEEEGlobecom'22-OL-RICHTER.pdf
IEEEGlobecom'22-OL-RICHTER.pdf
 
Islem Mansri.pdf
Islem Mansri.pdfIslem Mansri.pdf
Islem Mansri.pdf
 
Advanced Mechanisms for Delivering High-Quality Digital Content
Advanced Mechanisms for Delivering High-Quality Digital ContentAdvanced Mechanisms for Delivering High-Quality Digital Content
Advanced Mechanisms for Delivering High-Quality Digital Content
 
Paper id 2120148
Paper id 2120148Paper id 2120148
Paper id 2120148
 
Immersive Video Delivery: From Omnidirectional Video to Holography
Immersive Video Delivery: From Omnidirectional Video to HolographyImmersive Video Delivery: From Omnidirectional Video to Holography
Immersive Video Delivery: From Omnidirectional Video to Holography
 
Video coding technology proposal by
Video coding technology proposal by Video coding technology proposal by
Video coding technology proposal by
 
Video coding technology proposal by
Video coding technology proposal by Video coding technology proposal by
Video coding technology proposal by
 
Video coding technology proposal by
Video coding technology proposal by Video coding technology proposal by
Video coding technology proposal by
 
Video coding technology proposal by
Video coding technology proposal by Video coding technology proposal by
Video coding technology proposal by
 
PERFORMANCE EVALUATION OF H.265/MPEG-HEVC, VP9 AND H.264/MPEGAVC VIDEO CODING
PERFORMANCE EVALUATION OF H.265/MPEG-HEVC, VP9 AND H.264/MPEGAVC VIDEO CODINGPERFORMANCE EVALUATION OF H.265/MPEG-HEVC, VP9 AND H.264/MPEGAVC VIDEO CODING
PERFORMANCE EVALUATION OF H.265/MPEG-HEVC, VP9 AND H.264/MPEGAVC VIDEO CODING
 
Algorithm of standard videocodec H.264
Algorithm of standard videocodec H.264 Algorithm of standard videocodec H.264
Algorithm of standard videocodec H.264
 
[IJET-V1I2P1] Authors :Imran Ullah Khan ,Mohd. Javed Khan ,S.Hasan Saeed ,Nup...
[IJET-V1I2P1] Authors :Imran Ullah Khan ,Mohd. Javed Khan ,S.Hasan Saeed ,Nup...[IJET-V1I2P1] Authors :Imran Ullah Khan ,Mohd. Javed Khan ,S.Hasan Saeed ,Nup...
[IJET-V1I2P1] Authors :Imran Ullah Khan ,Mohd. Javed Khan ,S.Hasan Saeed ,Nup...
 
Next generation image compression standards: JPEG XR and AIC
Next generation image compression standards: JPEG XR and AICNext generation image compression standards: JPEG XR and AIC
Next generation image compression standards: JPEG XR and AIC
 

Recently uploaded

Architectural Portfolio Sean Lockwood
Architectural Portfolio Sean LockwoodArchitectural Portfolio Sean Lockwood
Architectural Portfolio Sean Lockwood
seandesed
 
CME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional ElectiveCME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional Elective
karthi keyan
 
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
H.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdfH.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdf
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
MLILAB
 
TECHNICAL TRAINING MANUAL GENERAL FAMILIARIZATION COURSE
TECHNICAL TRAINING MANUAL   GENERAL FAMILIARIZATION COURSETECHNICAL TRAINING MANUAL   GENERAL FAMILIARIZATION COURSE
TECHNICAL TRAINING MANUAL GENERAL FAMILIARIZATION COURSE
DuvanRamosGarzon1
 
road safety engineering r s e unit 3.pdf
road safety engineering  r s e unit 3.pdfroad safety engineering  r s e unit 3.pdf
road safety engineering r s e unit 3.pdf
VENKATESHvenky89705
 
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang,  ICLR 2024, MLILAB, KAIST AI.pdfJ.Yang,  ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
MLILAB
 
HYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generationHYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generation
Robbie Edward Sayers
 
Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
Massimo Talia
 
ASME IX(9) 2007 Full Version .pdf
ASME IX(9)  2007 Full Version       .pdfASME IX(9)  2007 Full Version       .pdf
ASME IX(9) 2007 Full Version .pdf
AhmedHussein950959
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
MdTanvirMahtab2
 
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
obonagu
 
The Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdfThe Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdf
Pipe Restoration Solutions
 
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
AJAYKUMARPUND1
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Dr.Costas Sachpazis
 
Student information management system project report ii.pdf
Student information management system project report ii.pdfStudent information management system project report ii.pdf
Student information management system project report ii.pdf
Kamal Acharya
 
ethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.pptethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.ppt
Jayaprasanna4
 
Final project report on grocery store management system..pdf
Final project report on grocery store management system..pdfFinal project report on grocery store management system..pdf
Final project report on grocery store management system..pdf
Kamal Acharya
 
WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234
AafreenAbuthahir2
 
ethical hacking in wireless-hacking1.ppt
ethical hacking in wireless-hacking1.pptethical hacking in wireless-hacking1.ppt
ethical hacking in wireless-hacking1.ppt
Jayaprasanna4
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
R&R Consult
 

Recently uploaded (20)

Architectural Portfolio Sean Lockwood
Architectural Portfolio Sean LockwoodArchitectural Portfolio Sean Lockwood
Architectural Portfolio Sean Lockwood
 
CME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional ElectiveCME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional Elective
 
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
H.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdfH.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdf
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
 
TECHNICAL TRAINING MANUAL GENERAL FAMILIARIZATION COURSE
TECHNICAL TRAINING MANUAL   GENERAL FAMILIARIZATION COURSETECHNICAL TRAINING MANUAL   GENERAL FAMILIARIZATION COURSE
TECHNICAL TRAINING MANUAL GENERAL FAMILIARIZATION COURSE
 
road safety engineering r s e unit 3.pdf
road safety engineering  r s e unit 3.pdfroad safety engineering  r s e unit 3.pdf
road safety engineering r s e unit 3.pdf
 
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang,  ICLR 2024, MLILAB, KAIST AI.pdfJ.Yang,  ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
 
HYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generationHYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generation
 
Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
 
ASME IX(9) 2007 Full Version .pdf
ASME IX(9)  2007 Full Version       .pdfASME IX(9)  2007 Full Version       .pdf
ASME IX(9) 2007 Full Version .pdf
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
 
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
 
The Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdfThe Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdf
 
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
 
Student information management system project report ii.pdf
Student information management system project report ii.pdfStudent information management system project report ii.pdf
Student information management system project report ii.pdf
 
ethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.pptethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.ppt
 
Final project report on grocery store management system..pdf
Final project report on grocery store management system..pdfFinal project report on grocery store management system..pdf
Final project report on grocery store management system..pdf
 
WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234
 
ethical hacking in wireless-hacking1.ppt
ethical hacking in wireless-hacking1.pptethical hacking in wireless-hacking1.ppt
ethical hacking in wireless-hacking1.ppt
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
 

Versatile Video Coding: Compression Tools for UHD and 360° Video

  • 1. Versatile Video Coding: Compression Tools for UHD and 360◦ Video INSA Rennes, France 23.11.2018 Priv.Doz. Dr.-Ing. habil. Mathias Wien Lehrstuhl für Bildverarbeitung RWTH Aachen University wien@lfb.rwth-aachen.de
  • 2. Outline I 1. Introduction 1.1 Context and Standardization Scope 2. VVC Development 2.1 Call for Proposals 2.2 Selected Coding Tools 3. VVC Standardization Status 3.1 VVC Working Draft and Test Model 1 3.2 VVC Working Draft and Test Model 2 3.3 VVC Working Draft and Test Model 3 4. Summary and Outlook 2 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 3. Video coding standardization organisations • ISO/IEC MPEG = “Moving Picture Experts Group” (ISO/IEC JTC 1/SC 29/WG 11 = International Standardization Organization and International Electrotechnical Commission, Joint Technical Committee 1, Subcommittee 29, Working Group 11) • ITU-T VCEG = “Visual Coding Experts Group” (ITU-T SG16/Q6 = International Telecommunications Union – Telecommunications Standardization Sector, Study Group 16, Working Party 3, Question 6) • JVT = “Joint Video Team” collaborative team of MPEG & VCEG, responsible for developing AVC (discontinued in 2009) • JCT-VC = “Joint Collaborative Team on Video Coding” team of MPEG & VCEG, responsible for developing HEVC (established January 2010) • JVET = “Joint Video Experts Team” exploring potential for new technology beyond HEVC (established Oct. 2015 as Joint Video Exploration Team, renamed Apr. 2018) 3 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 4. History of international video coding standardization (1985 – 2020) 4 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 5. Specification Scope source pre-processing encoding transmission decodingpost-processingdisplay • No specification of encoder – Profiles and levels – Constraints by application – Constraints on bitstream • No specification of transport • Common practice: Reference encoder implementation – Demonstration of coding performance – Verification of specification conformance • Focus of specification is on decoder – Parsing process – Bitstream syntax – Decoding process 5 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 6. Hybrid Video Coding Concept Decoder CTB input picture + − TR+Q TB iTR+iQ TB + Intra PB Entropy Coding bitstream Deblk. Slice Loop Filter Slice rec. picture Inter PB Buffer n pics ME PB CTB – Coding Tree Block ME – Motion Estimation PB – Prediction Block Q – Quantization TB – Transform Block TR – Transform • Encoder includes decoder • Basis of every standard since H.261 6 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 7. Performance History of Standard Generations 7 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 8. Contents 2. VVC Development 2.1 Call for Proposals 2.2 Selected Coding Tools 7 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 9. Steps towards next generation standard – Versatile Video Coding (VVC) • Experimental software “Joint Exploration Model“ (JEM) developed by JVET – Intended to investigate potential for better compression beyond HEVC – Was initially started extending HEVC software by additional compression tools, or replace existing tools (see previous section) • Substantial benefit was shown over HEVC, both in subjective quality and objective metrics – Proven in "Call for Evidence" (July 2017) JVET-F1002, JVET-G1004 [1, 2] – JEM was however not designed for becoming a standard (regarding all design tradeoffs) – Call for Proposals was issued by MPEG and VCEG (October 2017), JVET-H1002 [3] • Call for Proposals very successful (responses received by April 2018) – 32 companies in 21 proponent groups responded – 46 category-specific submissions: 22 in SDR, 12 each in HDR and 360◦ video – All responses clearly better than HEVC, some evidently better than JEM – This marked the starting point for VVC development 8 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 10. Steps towards next generation standard – Versatile Video Coding (VVC) • What does "Versatile" stand for? • VVC should be usable for many types of data – SDR and HDR up to extreme high resolutions – All kind of camera generated content – Computer generated content – Non-camera video modalities e. g. medical data – 360◦, lightfield, depth, and volumetric video • VVC should support flexible random and localized access • VVC should be easily configurable for various application needs • The core of VVC should consist of minimum amount of necessary and well-understood building blocks 9 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 11. Joint Call for Proposals (CfP) on Video Compression with Capability beyond HEVC • Document JVET-H1002 [3] • Test categories – Standard dynamic range (SDR): 5 UHD and 5 HD sequences – High dynamic range (HDR): 3 HLG and 5 PQ sequences – 360◦ video (360): 5 sequences in ERP format • Constraint sets – Constraint set 1 (C1): Random access configuration – Max 1.1s random access intervals, structural delay max 16 pictures – Constraint set 2 (C2): Low delay configuration only evaluated for SDR HD sequences – No picture reordering between input and output • Encoding constraints – No pre-processing, post-processing only within the coding loop – Static quantizer setting with one-time change to meet target bitrate – Relevant optimization methods to be reported 10 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 12. VVC CfP Test Sequences 11 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 13. VVC CfP Responses • Category-specific submissions (total 46): – SDR: 22 submissions (8 of which are registered only in this category) – HDR: 12 submissions – 360◦: 12 submissions (2 of which are registered only in this category) For all categories: HEVC anchors (HM) and JEM anchors • Proposals – Described in JVET input documents JVET-J0011...JVET-J0033 – Participation of 32 institutions 12 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 14. CfP Performance Analysis • Submissions had to provide coded/decoded sequences – 4 rate points each, two constraint conditions "low delay" (LD) and "random access" (RA) – SDR: 5× HD (both LD and RA), 5× UHD-4K (only RA) – HDR: 5× HD (PQ grading), 3x UHD-4K (HLG grading) – 360◦: 5 sequences 6K/8K for the full panorama • Double stimulus test with two hidden anchors HEVC-HM and JEM – Rate points defined with lowest rate was typically less than "fair" quality for HEVC, but still possible to code – Quality was judged to be distinguishable when confidence intervals were non-overlapping • Evaluation: Three ways of judging benefit: – Mean MOS over all test cases (28×4 test points: 23×4 C1, 5×4 C2 ) – Count cases where a proposal was visually better/worse than JEM – Count cases where a proposal was visually better than HEVC (HEVC at higher rate point) • Reports: Input subjective test JVET-J0080 [27], output CfP results JVET-J1003 [28] 13 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 15. CfP Performance Analysis • Measured by objective performance (PSNR), best performers report > 40% bit rate reduction compared to HEVC, > 10% compared to JEM (for SDR case) – Similar ranges for HDR and 360◦ – Obviously, proposals with more elements show better performance – Some proposals showed similar performance as JEM with significant complexity/run time reduction – 2 proposals used some degree of subjective optimization, not measurable by PSNR Results of subjective tests generally show similar (or even better) tendency – Benefit over HEVC very clear – Benefit over JEM visible at various points – Proposals with subjective optimization also showing benefit in some cases 14 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 16. CfP Performance Analysis • JVET-J1003 [28]: Report of subjective evaluation contains 28 plots as shown, one per sequence • Count significant cases of positive/negative benefit with non-overlapping confidence interval against JEM 15 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 17. CfP Performance Analysis • "Mean" and "significance-count" method suggested at least 7 proposals that were obviously better than JEM 16 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 18. CfP Performance Analysis • Similar tendency in HDR and 360◦ categories • Mostly same coding tools as in SDR provide good benefit 17 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 19. CfP Performance Analysis: Comparison to HEVC • The subjective quality of best performing proposals is always equal or sometimes better ( 1/3 of cases) than HEVC at next higher rate point, over all categories (with approx. 40% less rate) • The subjective quality of best performing proposals is always equal or sometimes better ( 1/5 of cases) than HEVC at 2nd higher rate point, in SDR-UHD category (with approx. 65% less rate) • Though it is not always the same proposal that performs best at a given rate point, it can be anticipated that merits of different proposals can be combined • 50% (or more) bit rate reduction with same quality will probably be achievable by the new standard 18 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 20. CfP Analysis: What is proposed? • New elements (some come with high complexity): – Decoder side estimation for mode/MV derivation and sample prediction both in intra and inter coding (JEM) – Finer partitioning: Asymmetric, geometric – Neural networks for prediction, loop filtering, upsampling, (encoder control) – Additional elements using template matching – Intra block copy / current picture referencing – Additional non-linear, de-noising and statistics-based loop filters – Additional linear and non-linear elements in prediction • HDR specific: – New adaptive reshaping and quantization, also in-loop – HDR-specific modifications of existing tools, e. g. deblocking • 360-video specific: – Variants of projection formats, geometry-corrected face boundary padding – Modification and disabling of existing tools at face boundaries 19 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 21. RWTH Proposal: Geometric Partitioning (GEO) Figure from JVET-J0023 [16] Work by Max Bläser 20 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 22. RWTH Proposal: GEO Partitioning Coding and Prediction Figures from JVET-J0023 [16] 21 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 23. GEO: Shape-Adaptive DCT for Geometric Partitions Figure from JVET-J0023 [16] • No transform-tree in JEM 7.0 → localization of residual error for larger blocks required • ∆SA-DCT adapted from MPEG-4 software for blocks up to 128×128 • Currently floating point implementation - integer transform targeted • SA-DCT signaled as additional transform choice next to full block DCT (→ 4 total GEO transform modes) • Coding of transform coefficients (TSBs, significance flags) with regard to shape 22 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 24. GEO: Coding Example Figure from JVET-J0023 [16] • Visual improvements at object boundaries – Sharper contours – Less staircase-effect – More background details • Objective gains (BD-rate savings) – Against HEVC: ∼33% on C1, ∼25% on C2 – Against JEM: ∼0.8% for both, C1 and C2 23 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 25. GEO: Coding Example Figure from JVET-J0023 [16] • Visual improvements at object boundaries – Sharper contours – Less staircase-effect – More background details • Objective gains (BD-rate savings) – Against HEVC: ∼33% on C1, ∼25% on C2 – Against JEM: ∼0.8% for both, C1 and C2 24 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 26. RWTH Proposal: 360◦ Geometry-Corrected Prediction Figure from JVET-J0023 [16] Work by Johannes Sauer 25 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 27. RWTH Proposal: 360◦ Geometry-Corrected Prediction Figure from JVET-J0023 [16] • Approach can be transferred to other formats 26 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 28. RWTH Proposal: 360◦ Corrected Deblocking • Reference samples of blocks at face boundaries changed – Original: Samples from top or left block are used – Modified: Samples are chosen according to 3D cube geometry • Approach can be transferred to other coding formats Figure from JVET-J0023 [16] 27 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 29. RWTH Proposal: 360◦ Coding Example Figure from JVET-J0023 [16] • Objective gains (BD-rate savings) – Against HEVC: ∼31% E2E WS-PSNR – Against JEM: ∼1.6% (same projection format) 28 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 30. Contents 3. VVC Standardization Status 3.1 VVC Working Draft and Test Model 1 3.2 VVC Working Draft and Test Model 2 3.3 VVC Working Draft and Test Model 3 28 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 31. VVC Working Draft and Test Model 1 • VVC Working Draft 1 / Test Model 1 (VTM1): basic approach built on "reduced HEVC" starting point • VTM Block structure – Unified tree (coding block unites prediction and transform) – CTU size 128×128, rectangular blocks (dyadic sizes), smallest luma size 4×4 – Maximum transform size 64×64 • VTM: Some removed elements of HEVC: – Mode dependent transform (DST-VII), mode dependent scan – Strong intra smoothing – Sign data hiding in transform coding – Unnecessary high-level syntax (e. g. VPS) – Tiles and wavefronts – Quantization weighting 29 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 32. Benchmark Set and its role • Benchmark Set (BMS) was defined in addition to VTM, including the following well-known JEM tools: – 65 intra prediction modes – Coefficient coding – AMT + 4×4 NSST – Affine motion – Geometry based adaptive loop filter – Subblock merge candidate (ATMVP) – Adaptive motion vector precision – Decoder motion vector refinement – LM Chroma mode • Purpose: Testing benefit of technology against better performing set – Holding extra potential features which are not yet decided upon – Superset of VTM; should have significant gain over the VTM – Unveils in CEs whether gains are independent, or how much gain remains when a tool is combined with a set of more performant tools – Can be a common basis for further CE tests of modified versions of features – Not necessarily ultra-low complexity, but encoder needs to be runnable in reasonable amount of time 30 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 33. Quad/binary/ternary partitioning • The only fundamental new element of version 1 • Simple multi-type tree split, can be alternated Figures from JVET-J1001 [29] 31 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 34. Performance of VTM1 compared to HEVC Figures from JVET-K0003 [30] 32 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 35. Contents 1. Introduction 1.1 Context and Standardization Scope 2. VVC Development 2.1 Call for Proposals 2.2 Selected Coding Tools 3. VVC Standardization Status 3.1 VVC Working Draft and Test Model 1 3.2 VVC Working Draft and Test Model 2 3.3 VVC Working Draft and Test Model 3 4. Summary and Outlook 32 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 36. New elements of WD2 / VTM2 • QT/BT/TT no longer “placeholder” • Remove unnecessary partitioning restrictions • Implicit splitting at picture boundaries • Separate trees for intra slices • Position Dependent Prediction Combination • Cross Component Linear Model • 87 intra modes (wide angles included), 3 MPM, TU binarization • Affine MC (4×4 fixed subblock size, 4/6 parameter model switching at CU level) • Affine MV coding – list construction contains inheritance and derivation spatial/temporal – improved difference coding • Adaptive motion vector resolution (AMVR) • Subblock MC (4×4) from ATMVP merge, 8×8 granularity motion vector storage [High precision] 33 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 37. New elements of WD2 / VTM2 • Multiple transform selection (all are DCT/DST types) for intra and inter • Increase max QP from 51 to 63 • Modified entropy coding supporting dependent quantization • Sign data hiding reinvoked from HEVC • Adaptive loop filter – 4×4 classification based (gradient strength & orientation) for luma – 7×7 luma, 5×5 chroma filters) – enabling flag at CTU level • Basic high-level syntax (SPS, PPS, slice) • Update of BMS contains – Generalized Bi prediction (kind of local weighted prediction) – Decoder-side estimation: BIO, simplified bilateral matching – Current picture referencing (aka intra block copy) 34 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 38. VTM2: Wide angular modes • For rectangular blocks, prediction directions with angles beyond 45/135 degrees are reasonable • This can be implemented by adding modes at both ends • VTM2 uses a total of 85 directional intra modes now (plus DC and planar) Figure from JVET-K0500 [31] 35 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 39. VTM2: Dependent quantization • Alternating between two quantizers based on state transition rule allows to select an optimum sequence of reconstruction values (e.g. by trellis-like search) • Decoder needs to implement the sequential state transition rule • CABAC contexts needs to be modified as well for this case (greater than 0/1/2/... would have different meaning depending on Q0/Q1) Figures from JVET-K0071 [32] 36 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 40. Performance of VTM2 compared to HEVC Figures from JVET-L0003 [33] 37 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 41. Contents 1. Introduction 1.1 Context and Standardization Scope 2. VVC Development 2.1 Call for Proposals 2.2 Selected Coding Tools 3. VVC Standardization Status 3.1 VVC Working Draft and Test Model 1 3.2 VVC Working Draft and Test Model 2 3.3 VVC Working Draft and Test Model 3 4. Summary and Outlook 37 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 42. VVC Working Draft and Test Model 3 • Executive summary – Coding tools Improvements of coding efficiency, simplification, practicality and unification of design – High level syntax – some basic agreements "Slice" concept gone – tiles offer more flexibility for various aspects such as localized access and parallelism Signalling mechanisms for tool usage to enable sub-profiles, including external subprofiles, whole-bitstream constraints – BMS no longer necessary - VTM has come close in performance 38 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 43. New elements of WD3 / VTM3 [1/2] Meeting report JVET-L1000 [34] • Partitioning – QT-BT-TT stabilization • Intra Prediction – Multi-reference line intra prediction – Intra DCTIF / Gaussian interpolation filter – Cross-component linear model prediction (CCLM) – Current picture referencing • Inter Prediction – Affine modes stabilization – Triangular partitions (more details to follow) – Combine merge and intra – History-based MV prediction – Bi-directional optical flow (BIO) 39 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 44. New elements of WD3 / VTM3 [2/2] Meeting report JVET-L1000 [34] • Residual Coding – Transform matrices with 8bit coefficients (compatible with HEVC) • Loop filters – Adding SAO from HEVC • High-Level Syntax – There will be no slices anymore – POC signalling – Sign data hiding 40 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 45. Inter Prediction: Triangular partitions • Concept proposed in JVET-J0020 [13] • Applicable to Merge and Skip blocks • Minimum block size 8×8 Figures from JVET-L0124 [35] 41 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 46. Contents 4. Summary and Outlook 41 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 47. Summary and Outlook • Call for Proposals demonstrated availability of significant compression benefit – HEVC out-performed by virtually all proposals – Subjective results suggest initial rate savings of 40+% over HEVC at starting point • Versatile Video Coding (VVC): Third Working Draft and Test Model defined – Started from reduced initial tool set – Step-by-step integration of tools – Evaluation of concurring variants of tools – Consideration of algorithmic complexity – Further fast progress expected, goal: finalization 2020 • Main focus on SDR/HDR content at this development stage – Core experiments (CEs 1-12) on Partitioning, Adaptive loop filter, Intra prediction and mode coding, Inter prediction and MV coding, Arithmetic coding engine, Transforms and transform signalling, Quantization and coefficient coding, Screen content coding tools, Decoder side MV derivation, Combined and multi-hypothesis prediction, Deblocking, Mapping for HDR content – Core experiment CE13 on coding tools for omnidirectional video 42 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 48. Thank you for your attention Any questions?
  • 49. Contents 5. Links and Further Information 43 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 50. Links and Further Information • Document archives (publicly accessible) – JVET / VVC: http://phenix.it-sudparis.eu/jvet http://ftp3.itu.ch/av-arch/jvet-site – JCT-VC / HEVC: http://phenix.it-sudparis.eu/jct http://ftp3.itu.ch/av-arch/jctvc-site • VTM Software: https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/ • VTM Trac: https://jvet.hhi.fraunhofer.de/trac/vvc/ 44 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 51. Contents 6. Acronyms 44 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 52. Acronyms I ABT – Asymmetric binary tree AF INTER – Affine motion vector derivation inter mode AF MERGE – Affine motion vector derivation merge mode AFP – Adaptive frame packing AHG – Ad-hoc group AI – All intra (JCT-VC CTC) ALF – Adaptive loop filter ALTR – Adaptive long-term reference AMT – Adaptive multiple core transform (also EMT) AMVP – Advanced motion vector prediction AMVR – Adaptive motion vector resolution AQS – Adaptive quantization step size scaling ATMVP – Alternative temporal motion vector prediction BDIP – Bi-directional intra prediction BDSNR – Bjøntegaard Delta PSNR BD-rate – Bjøntegaard Delta rate BLA – Broken link access CABAC – Context adaptive binary arithmetic coding CB – Coding block CF – Combined filter (intra prediction) CCIP – Cross-component intra prediction CCLM – Cross-component linear model prediction CNNLF – Convolution neural network loop filter CPMV – Control point motion vector CRA – Clean random access 45 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 53. Acronyms II CU – Coding unit CVS – Coded Video Sequence CVSG – Coded Video Sequence Group DMVD – Decoder side motion vector derivation DMVR – Decoder-side motion vector refinement DRA – Dynamic range adaptation EAC – Enhanced angular cubemap EMT – Explicit multiple core transforms (also AMT) EOTF – Electro-optical transfer function GEO – Geometric partitioning GRL – Givens rotation layer HAC – Hybrid angular cubemap HWT – Hadamart-Walsh transform HyGT – Hypercube-Givens transform IBC – Intra block copy IDR – Instantaneous decoder refresh IPR – Inter prediction refinement JEM – Joint exploration model (JVET test model) LAMVR – Locally adaptive motion vector resolution LGT – Layered Givens transform LIC – Local illumination compensation LIP – Linear intra prediction LM – Linear model prediction LPS – Least probably symbol MAP – Merge assistant prediction MBF – Multiple boundary filtering 46 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 54. Acronyms III MCP – Modified cubemap projection MDCS – Mode-dependent coefficient scanning MDIS – Mode-dependent intra reference sample smoothing MDNSST – Mode-dependent non-separable secondary transforms Merge – Merge Mode (MV prediction) MFLM – Multiple filter linear model prediction MIP – Multi-line intra prediction MIP – Multi-combined intra prediction MMLM – Multi-Model Cross-component linear model prediction MBLM – Multiple neighbor linear model MPCR – Motion predictor candidate refinement MRIP – Multi-reference intra prediction MRM – Motion refinement mode MTT – Multi-type tree MV – Motion vector NAL – Network abstraction layer NLMLF – Non-local mean loop filter NLSF – Non-local structure-based filter NSF – Noise suppression filter NSST – Non-separable secondary transforms OBMC – Overlapped block motion compensation OETF – Opto-electrical transfer function PB – Prediction block PDPC – Position dependent intra prediction combination for planar mode PMMVD – Pattern matched motion vector derivation PMVD – Pattern matched motion vector derivation 47 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 55. Acronyms IV PMVR – Pattern-matched motion vector refinement PU – Prediction unit QP – Quantization parameter QT – Quad-tree QTBTT – Quad-tree plus binary tree and ternary tree (also QTBTTT) RADL – Random access decodable leading picture RAP – Random access point RASL – Random access skipped leading picture RBSP – Raw byte sequence payload RC-ALF – Reduced-complexity adaptive loop filter RQT – Residual quad-tree RSP – Rotated sphere projection RST – Reduced secondary transform SAO – Sample adaptive offset SDP – Signal dependent transform SODB – String of data bits SHVC – Scalable high efficiency video coding SRCC – Scan region-based coefficient coding STMVP – Spatial-temporal motion vector prediction STSA – Stepwise temporal sub-layer access SUCO – Split unit coding order SVT – Spatial varying transform TB – Transform block TD-RSP – Residual signs prediction in transform domain TMM – Template matchted merge mode TMVP – Temporal motion vector predictor 48 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 56. Acronyms V TSA – Temporal sub-layer access TSR – Transform syntax reorder TU – Transform unit UMVE – Ultimate motion vector expression UWP – Unequal weight planar prediction WPP – Wavefront parallel processing XGA – Extended Graphics Array 1024×768 XYZ – XYZ color space, also color format YCbCr – Color format with luma and two chroma components YUV – XYZ color format 49 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 57. Literature I [1] Mathias Wien et al. Joint Call for Evidence on Video Compression with Capability beyond HEVC. Tech. rep. JVET-F1002. Hobart, AU, 6th meeting: Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Oct. 18, 2017. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/6_Hobart/wg11/JVET-F1002-v1.zip. [2] Vittorio Baroncini et al. Results of the Joint Call for Evidence on Video Compression with Capability beyond HEVC. Tech. rep. JVET-G1004. Torino, IT, 7th meeting: Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, July 21, 2017. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/7_Torino/wg11/JVET-G1004-v2.zip. [3] Andrew Segall et al. Joint Call for Proposals on Video Compression with Capability beyond HEVC. Tech. rep. JVET-H1002. Macao, CN, 8th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Oct. 18, 2017. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/8_Macau/wg11/JVET-H1002-v6.zip. [4] Zhao Wang et al. Description of SDR video coding technology proposal by DJI and Peking University. Doc. JVET–J0011. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0012-v2.zip. [5] Rickard Sjöberg et al. Description of SDR and HDR video coding technology proposal by Ericsson and Nokia. Doc. JVET-J0012. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0012-v2.zip. [6] Jung Won Kang et al. Description of SDR video coding technology proposal by ETRI and Sejong University. Doc. JVET-J0013. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0013-v3.zip. [7] M. Albrecht et al. Description of SDR, HDR, and 360◦ video coding technology proposal by Fraunhofer HHI. Doc. JVET-J0014. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0014-v4.zip. [8] Xiaoyu Xiu et al. Description of SDR, HDR, and 360◦ video coding technology proposal by InterDigital Communications and Dolby Laboratories. Doc. JVET-J0015. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0015-v3.zip. 50 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 58. Literature II [9] Kei Kawamura, Yoshitaka Kidani, and Sei Naito. Description of SDR video coding technology proposal by KDDI. Doc. JVET-J0016. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0016-v4.zip. [10] Moonmo Koo et al. Description of SDR video coding technology proposal by LG Electronics. Doc. JVET-J0017. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0017-v2.zip. [11] Chih-Wei Hsu et al. Description of SDR video coding technology proposal by MediaTek. Doc. JVET-J0018. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0018-v2.zip. [12] Jian-Liang Lin et al. Description of 360◦ video coding technology proposal by MediaTek. Doc. JVET-J0019. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0019-v3.zip. [13] Tadamasa Toma et al. Description of SDR video coding technology proposal by Panasonic. Doc. JVET-J0020. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0020-v2.zip. [14] Y. Chen et al. Description of SDR, HDR and 360◦ video coding technology proposal by Qualcomm and Technicolor – low and high complexity versions. Doc. JVET-J0021. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0021-v5.zip. [15] Philippe Bordes et al. Description of SDR, HDR and 360◦ video coding technology proposal by Qualcomm and Technicolor – medium complexity version. Doc. JVET-J0022. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0022-v3.zip. [16] Max Blaeser, Johannes Sauer, and Mathias Wien. Description of SDR and 360◦ video coding technology proposal by RWTH Aachen University. Doc. JVET-J0023. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0023-v3.zip. 51 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 59. Literature III [17] Sri Nitchith Akula et al. Description of SDR, HDR and 360◦ video coding technology proposal considering mobile application scenario by Samsung, Huawei, GoPro, and HiSilicon. Doc. JVET-J0024. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0024-v5.zip. [18] Huanbang Chen et al. Description of SDR, HDR and 360◦ video coding technology proposal considering mobile application scenario by Huawei, GoPro, HiSilicon, and Samsung. Doc. JVET-J0025. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0025-v4.zip. [19] Kiran Misra et al. Description of SDR and HDR video coding technology proposal by Sharp and Foxconn. Doc. JVET-J0026. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0026-v11.zip. [20] Shunsuke Iwamura et al. Description of SDR and HDR video coding technology proposal by NHK and Sharp. Doc. JVET-J0027. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0027-v5.zip. [21] Teruhiko Suzuki, Masaru Ikeda, and Karl Sharman. Description of SDR and HDR video coding technology proposal by Sony. Doc. JVET-J0028. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0028-v2.zip. [22] Xiang Li et al. Description of SDR video coding technology proposal by Tencent. Doc. JVET-J0029. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0029-v4.zip. [23] Alexandre Gabriel and Emmanuel Thomas. Description of 360◦ video coding technology proposal by TNO. Doc. JVET-J0030. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0030-v2.zip. [24] David Bull, Fan Zhang, and Mariana Afonso. Description of SDR video coding technology proposal by University of Bristol. Doc. JVET-J0031. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0031-v3.zip. 52 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 60. Literature IV [25] Feng Wu et al. Description of SDR video coding technology proposal by University of Science and Technology of China, Peking University, Harbin Institute of Technology, and Wuhan University (IEEE 1857.10 Study Group). Doc. JVET-J0032. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0032-v4.zip. [26] Yule Sun et al. Description of 360◦ video coding technology proposal by Zhejiang University. Doc. JVET-J0033. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0033-v3.zip. [27] Vittorio Baroncini. Results of Subjective Testing of Responses to the Joint CfP on Video Compression Technology with Capability beyond HEVC. Doc. JVET-J0080. 10th meeting, San Diego, CA, USA: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J0080-v2.zip. [28] Vittorio Baronchini, Jens-Rainer Ohm, and Gary Sullivan. Report of results from the Call for Proposals on Video Compression with Capability beyond HEVC. Doc. JVET-J1003. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/current_document.php?id=3540. [29] Benjamin Bross. Versatile Video Coding (Draft 1). Doc. JVET-J1001. San Diego, CA, USA, 10th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 10, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/10_San%20Diego/wg11/JVET-J1001-v2.zip. [30] Frank Bossen, Xiang Li, and Karsten Suehring. JVET AHG report: Test model software development (AHG3). Doc. JVET-K1001. Ljubljana, SI, 11th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, July 18, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/11_Ljubljana/wg11/JVET-K0003-v2.zip. [31] Fabien Racapé et al. CE3-related: Wide-angle intra prediction for non-square blocks. Doc. JVET-K0500. Ljubljana, SI, 11th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, July 18, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/11_Ljubljana/wg11/JVET-K0500-v6.zip. [32] Heiko Schwarz et al. CE7: Transform Coefficient Coding and Dependent Quantization (Tests 7.1.2, 7.2.1). Doc. JVET-K0071. Ljubljana, SI, 11th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, July 18, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/11_Ljubljana/wg11/JVET-K0071-v2.zip. [33] Frank Bossen, Xiang Li, and Karsten Suehring. JVET AHG report: Test model software development (AHG3). Doc. JVET-L0003. Macao, CN, 12th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Oct. 3, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/12_Macao/wg11/JVET-L0003-v1.zip. 53 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes
  • 61. Literature V [34] Gary J. Sullivan and Jens-Rainer Ohm. Meeting report of the 12th meeting of the Joint Video Exploration Team (JVET), Macao, CN, 3–12 October 2018. Doc. JVET-L1000. Macao, CN, 12th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Oct. 2018. URL: https://www.itu.int/wftp3/av-arch/jvet-site/2018_10_L_Macao/JVET-L_Notes_dB.docx. [35] Ru-Ling Liao and Chong Soon Lim. CE10.3.1.b: Triangular prediction unit mode. Doc. JVET-L0124. Macao, CN, 12th meeting: Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Oct. 3, 2018. URL: http://phenix.int-evry.fr/jvet/doc_end_user/documents/12_Macao/wg11/JVET-L0124-v6.zip. 54 of 43 VVC: Coding Tools for UHD and 360 | Mathias Wien | Lehrstuhl für Bildverarbeitung | RWTH Aachen University | 23.11.2018 | INSA Rennes