SlideShare a Scribd company logo
1 of 6
Download to read offline
Brief Overview on the Emerging
Versatile Video Coding Standard
… as seen by an individual
Picture Coding Symposium 2019, Ningbo, China
Mathias Wien
Lehrstuhl für Bildverarbeitung
RWTH Aachen University
wien@lfb.rwth-aachen.de
Versatile Video Coding | Panel on Emerging Video Codecs | Picture Coding Symposium 2019 | Ningbo, China
15.11.2019 | Mathias Wien | Institute of Imaging and Computer Vision | RWTH Aachen University
2
• Joint Video Experts Team of ISO/IEC MPEG and ITU-T VCEG, est. in
Oct. 2015 as Joint Video Exploration Team, renamed Apr. 2018 at CfP eval.
• Joint Exploration Model: 7 iterations
 Investigating coding tools enhanced relative to HEVC test model HM
• Call for Evidence (CfE), issued Apr. 2017, evaluated in Jul. 2017
 Significant improvement for JEM and independent submissions
• Call for Proposls (CfP), issued Oct. 2017, evaluated in Apr. 2018
at10th JVET meeting
 Kick-off for VVC, definition of name, VVC draft 1 and test model 1 (VTM1)
Evolution towards VVC
Evolution of JVET docs and participants
Versatile Video Coding | Panel on Emerging Video Codecs | Picture Coding Symposium 2019 | Ningbo, China
15.11.2019 | Mathias Wien | Institute of Imaging and Computer Vision | RWTH Aachen University
3
• Entropy Coding
 CABAC
 Multi-hypothesis probability estimation
• Coding structures
 4 × 4 to 128 × 128 Coding Unit (CU) size
 Quad+ternary+binary tree partitioning
 Dual-tree (separate trees for luma/chroma)
 Partial coverage of prediction regions by transforms (SBT,ISP)
• Inter Coding
 16th-sample prec. for derived MVs | Locally adaptive MV
resolution: signaling at ¼, 1, 4 sample precision
 8-tap DCTIF + alt. 6-tap switched IF for ½ sample, 6-tap for affine
subblock MC
 Block-level CU weights, Triangular prediction with merge
 Combined inter/intra prediction (CIIP)
 Affine prediction refinement with optical flow (PROF),
Bi-directional optical flow prediction (BDOF)
 Subblock-based temporal merge, affine MV control point MVP,
decoder-side MV refinement, history-based MVP, symmetrical
MVD, Merge mode with MVD (MMVD)
• Intra Coding
 DC, planar, 67 intra prediction directions signaled, 93 after wide
angle mapping | signaling: 6 most probable modes + remainder
 Matrix-based intra prediction
 Multi reference lines intra prediction
 Intra subpartitions (ISP)
 Position-dependent intra prediction sample filtering
 Cross-component linear prediction
• Residual Coding
 DCT2 4×4-64×64, multi-transform selection (DST7/DCT8, ≤32),
inter: subblock transform (SBT), low-frequency non-separable
transform (LFNST), transform skip, 4:4:4 adaptive colour transform
 Coefficient coding: HEVC + parity-based binarization for dependent
quantization (DQ)
• Loop Filters
 Deblocking filter, sample adaptive offset (SAO)
 Adaptive loop filter (ALF), luma mapping with chroma scaling
VVC Coding Tools in a Nutshell
MV/MVP/MVD: motion vector / predictor / difference | DCTIF: Discrete
cosine transform derived interpolation filter | DST: Discrete sine transform
Versatile Video Coding | Panel on Emerging Video Codecs | Picture Coding Symposium 2019 | Ningbo, China
15.11.2019 | Mathias Wien | Institute of Imaging and Computer Vision | RWTH Aachen University
4
• Parameter sets
 Video parameter set, sequence parameter set,
picture parameter set (VPS, SPS, PPS)
 Adaptation parameter set (APS), picture header
• Picture types
 IDR, CRA, RADL, RASL, Trail, STSA
 Gradual decoding refresh (GDR)
• Picture partitioning
 Slices, tiles
 Subpictures, raster-scan slices of multiple tiles,
rectangular slices within tiles
• Screen content coding
 Palette mode for 4:4:4
 Intra block copy (IBC)
 Residual coding for transform skip
 Block-based Delta PCM (BDPCM)
• More versatility
 Reference picture resampling (RPR)
 Spatial, quality and temporal scalability
 Bitstream extraction and merging without
VCL NAL unit rewriting
 Film grain synthesis SEI message
VVC Versatility Aspects
IDR: instantaneous decoding refresh | CRA: clean random access | RADL/RASL: random access decodable/skipped leading pic. | STSA: step-wise temporal sublayer access
Versatile Video Coding | Panel on Emerging Video Codecs | Picture Coding Symposium 2019 | Ningbo, China
15.11.2019 | Mathias Wien | Institute of Imaging and Computer Vision | RWTH Aachen University
5
• Assessment according to JVET Common Testing Conditions [JVET-M1010]
 Rate-distortion performance, encoder / decoder run-time of VVC reference software implementation
• Systematic evaluation throughout standardization project
 All Intra, Random Access, Low Delay B configurations
 Comparison to HEVC reference software HM: Comparable rate-distortion based encoder implementations
Versatile Video Coding – Compression Performance
Thanks for your attention!
Mathias Wien
Lehrstuhl für Bildverarbeitung
RWTH Aachen University
wien@lfb.rwth-aachen.de

More Related Content

What's hot

Comparison of compression efficiency between HEVC and VP9 based on subjective...
Comparison of compression efficiency between HEVC and VP9 based on subjective...Comparison of compression efficiency between HEVC and VP9 based on subjective...
Comparison of compression efficiency between HEVC and VP9 based on subjective...Touradj Ebrahimi
 
HTTP Adaptive Streaming – Where Is It Heading?
HTTP Adaptive Streaming – Where Is It Heading?HTTP Adaptive Streaming – Where Is It Heading?
HTTP Adaptive Streaming – Where Is It Heading?Alpen-Adria-Universität
 
Chris Varekamp (Philips Group Innovation, Research): Depth estimation, Proces...
Chris Varekamp (Philips Group Innovation, Research): Depth estimation, Proces...Chris Varekamp (Philips Group Innovation, Research): Depth estimation, Proces...
Chris Varekamp (Philips Group Innovation, Research): Depth estimation, Proces...AugmentedWorldExpo
 
High Efficiency Video Codec
High Efficiency Video CodecHigh Efficiency Video Codec
High Efficiency Video CodecTejus Adiga M
 
Bitmovin AV1/VVC Presentation_Streaming Media East by Christian Feldmann
Bitmovin AV1/VVC Presentation_Streaming Media East by Christian FeldmannBitmovin AV1/VVC Presentation_Streaming Media East by Christian Feldmann
Bitmovin AV1/VVC Presentation_Streaming Media East by Christian FeldmannBitmovin Inc
 
Tutorial on Point Cloud Compression and standardisation
Tutorial on Point Cloud Compression and standardisationTutorial on Point Cloud Compression and standardisation
Tutorial on Point Cloud Compression and standardisationRufael Mekuria
 
HEVC / H265 Hands-On course
HEVC / H265 Hands-On courseHEVC / H265 Hands-On course
HEVC / H265 Hands-On courseYoss Cohen
 
MPEG Immersive Media
MPEG Immersive MediaMPEG Immersive Media
MPEG Immersive MediaITU
 
Development of a 4K H.265/ HEVC HW Encoder
Development of a 4K H.265/ HEVC HW EncoderDevelopment of a 4K H.265/ HEVC HW Encoder
Development of a 4K H.265/ HEVC HW EncoderIMTC
 
Jiri ece-01-03 adaptive temporal averaging and frame prediction based surveil...
Jiri ece-01-03 adaptive temporal averaging and frame prediction based surveil...Jiri ece-01-03 adaptive temporal averaging and frame prediction based surveil...
Jiri ece-01-03 adaptive temporal averaging and frame prediction based surveil...Ijripublishers Ijri
 
Quality Optimization of Live Streaming Services over HTTP with Reinforcement ...
Quality Optimization of Live Streaming Services over HTTP with Reinforcement ...Quality Optimization of Live Streaming Services over HTTP with Reinforcement ...
Quality Optimization of Live Streaming Services over HTTP with Reinforcement ...Alpen-Adria-Universität
 
ITU-T Study Group 16 Meeting Achievements
ITU-T Study Group 16 Meeting AchievementsITU-T Study Group 16 Meeting Achievements
ITU-T Study Group 16 Meeting AchievementsITU
 
HEVC VIDEO CODEC By Vinayagam Mariappan
HEVC VIDEO CODEC By Vinayagam MariappanHEVC VIDEO CODEC By Vinayagam Mariappan
HEVC VIDEO CODEC By Vinayagam MariappanVinayagam Mariappan
 
A Journey Towards Fully Immersive Media Access
A Journey Towards Fully Immersive Media AccessA Journey Towards Fully Immersive Media Access
A Journey Towards Fully Immersive Media AccessAlpen-Adria-Universität
 

What's hot (20)

Comparison of compression efficiency between HEVC and VP9 based on subjective...
Comparison of compression efficiency between HEVC and VP9 based on subjective...Comparison of compression efficiency between HEVC and VP9 based on subjective...
Comparison of compression efficiency between HEVC and VP9 based on subjective...
 
HTTP Adaptive Streaming – Where Is It Heading?
HTTP Adaptive Streaming – Where Is It Heading?HTTP Adaptive Streaming – Where Is It Heading?
HTTP Adaptive Streaming – Where Is It Heading?
 
Chris Varekamp (Philips Group Innovation, Research): Depth estimation, Proces...
Chris Varekamp (Philips Group Innovation, Research): Depth estimation, Proces...Chris Varekamp (Philips Group Innovation, Research): Depth estimation, Proces...
Chris Varekamp (Philips Group Innovation, Research): Depth estimation, Proces...
 
High Efficiency Video Codec
High Efficiency Video CodecHigh Efficiency Video Codec
High Efficiency Video Codec
 
Bitmovin AV1/VVC Presentation_Streaming Media East by Christian Feldmann
Bitmovin AV1/VVC Presentation_Streaming Media East by Christian FeldmannBitmovin AV1/VVC Presentation_Streaming Media East by Christian Feldmann
Bitmovin AV1/VVC Presentation_Streaming Media East by Christian Feldmann
 
Tutorial on Point Cloud Compression and standardisation
Tutorial on Point Cloud Compression and standardisationTutorial on Point Cloud Compression and standardisation
Tutorial on Point Cloud Compression and standardisation
 
HEVC / H265 Hands-On course
HEVC / H265 Hands-On courseHEVC / H265 Hands-On course
HEVC / H265 Hands-On course
 
HEVC intra coding
HEVC intra codingHEVC intra coding
HEVC intra coding
 
MPEG Immersive Media
MPEG Immersive MediaMPEG Immersive Media
MPEG Immersive Media
 
Resampling
ResamplingResampling
Resampling
 
Tactile Internet with Human-in-the-Loop
Tactile Internet with Human-in-the-LoopTactile Internet with Human-in-the-Loop
Tactile Internet with Human-in-the-Loop
 
HEVC overview main
HEVC overview mainHEVC overview main
HEVC overview main
 
Feature hevc
Feature hevcFeature hevc
Feature hevc
 
Development of a 4K H.265/ HEVC HW Encoder
Development of a 4K H.265/ HEVC HW EncoderDevelopment of a 4K H.265/ HEVC HW Encoder
Development of a 4K H.265/ HEVC HW Encoder
 
Jiri ece-01-03 adaptive temporal averaging and frame prediction based surveil...
Jiri ece-01-03 adaptive temporal averaging and frame prediction based surveil...Jiri ece-01-03 adaptive temporal averaging and frame prediction based surveil...
Jiri ece-01-03 adaptive temporal averaging and frame prediction based surveil...
 
H.264 vs HEVC
H.264 vs HEVCH.264 vs HEVC
H.264 vs HEVC
 
Quality Optimization of Live Streaming Services over HTTP with Reinforcement ...
Quality Optimization of Live Streaming Services over HTTP with Reinforcement ...Quality Optimization of Live Streaming Services over HTTP with Reinforcement ...
Quality Optimization of Live Streaming Services over HTTP with Reinforcement ...
 
ITU-T Study Group 16 Meeting Achievements
ITU-T Study Group 16 Meeting AchievementsITU-T Study Group 16 Meeting Achievements
ITU-T Study Group 16 Meeting Achievements
 
HEVC VIDEO CODEC By Vinayagam Mariappan
HEVC VIDEO CODEC By Vinayagam MariappanHEVC VIDEO CODEC By Vinayagam Mariappan
HEVC VIDEO CODEC By Vinayagam Mariappan
 
A Journey Towards Fully Immersive Media Access
A Journey Towards Fully Immersive Media AccessA Journey Towards Fully Immersive Media Access
A Journey Towards Fully Immersive Media Access
 

Similar to PCS 2019 Panel on Emerging Video Coding Standards: Overview on the Emerging Versatile Video Coding Standard

Machine Learning approaches at video compression
Machine Learning approaches at video compression Machine Learning approaches at video compression
Machine Learning approaches at video compression Roberto Iacoviello
 
Tutorial High Efficiency Video Coding Coding - Tools and Specification.pdf
Tutorial High Efficiency Video Coding Coding - Tools and Specification.pdfTutorial High Efficiency Video Coding Coding - Tools and Specification.pdf
Tutorial High Efficiency Video Coding Coding - Tools and Specification.pdfssuserc5a4dd
 
Design and Analysis of Quantization Based Low Bit Rate Encoding System
Design and Analysis of Quantization Based Low Bit Rate Encoding SystemDesign and Analysis of Quantization Based Low Bit Rate Encoding System
Design and Analysis of Quantization Based Low Bit Rate Encoding Systemijtsrd
 
Immersive Video Delivery: From Omnidirectional Video to Holography
Immersive Video Delivery: From Omnidirectional Video to HolographyImmersive Video Delivery: From Omnidirectional Video to Holography
Immersive Video Delivery: From Omnidirectional Video to HolographyAlpen-Adria-Universität
 
Jiri ece-01-03 adaptive temporal averaging and frame prediction based surveil...
Jiri ece-01-03 adaptive temporal averaging and frame prediction based surveil...Jiri ece-01-03 adaptive temporal averaging and frame prediction based surveil...
Jiri ece-01-03 adaptive temporal averaging and frame prediction based surveil...Ijripublishers Ijri
 
Insight toolkit을 이용한 삼차원 흉부 CT 영상분석 및 폐결절 검출 시스템
Insight toolkit을 이용한 삼차원 흉부 CT 영상분석 및 폐결절 검출 시스템Insight toolkit을 이용한 삼차원 흉부 CT 영상분석 및 폐결절 검출 시스템
Insight toolkit을 이용한 삼차원 흉부 CT 영상분석 및 폐결절 검출 시스템Wookjin Choi
 
Aruna Ravi - M.S Thesis
Aruna Ravi - M.S ThesisAruna Ravi - M.S Thesis
Aruna Ravi - M.S ThesisArunaRavi
 
Research and activity report
Research and activity reportResearch and activity report
Research and activity reportMarco Cagnazzo
 
1 state of-the-art and trends in scalable video
1 state of-the-art and trends in scalable video1 state of-the-art and trends in scalable video
1 state of-the-art and trends in scalable videoYogananda Patnaik
 
Are you Digitized Files Really OK? Levels of QC and Film Digitization (SCHALL...
Are you Digitized Files Really OK? Levels of QC and Film Digitization (SCHALL...Are you Digitized Files Really OK? Levels of QC and Film Digitization (SCHALL...
Are you Digitized Files Really OK? Levels of QC and Film Digitization (SCHALL...FIAT/IFTA
 
Introduction to Video Compression Techniques - Anurag Jain
Introduction to Video Compression Techniques - Anurag JainIntroduction to Video Compression Techniques - Anurag Jain
Introduction to Video Compression Techniques - Anurag JainVideoguy
 
Distributed Adaptation Decision-Taking Framework and Scalable Video Coding Tu...
Distributed Adaptation Decision-Taking Framework and Scalable Video Coding Tu...Distributed Adaptation Decision-Taking Framework and Scalable Video Coding Tu...
Distributed Adaptation Decision-Taking Framework and Scalable Video Coding Tu...mgrafl
 
Video Compression Using Block By Block Basis Salience Detection
Video Compression Using Block By Block Basis Salience DetectionVideo Compression Using Block By Block Basis Salience Detection
Video Compression Using Block By Block Basis Salience DetectionIRJET Journal
 
Paper id 2120148
Paper id 2120148Paper id 2120148
Paper id 2120148IJRAT
 
VVC HLS overview .pdf
VVC HLS overview .pdfVVC HLS overview .pdf
VVC HLS overview .pdfKaramSingh80
 
H04011 04 5361
H04011 04 5361H04011 04 5361
H04011 04 5361IJMER
 

Similar to PCS 2019 Panel on Emerging Video Coding Standards: Overview on the Emerging Versatile Video Coding Standard (20)

THE H.264/MPEG4 AND ITS APPLICATIONS
THE H.264/MPEG4 AND ITS APPLICATIONSTHE H.264/MPEG4 AND ITS APPLICATIONS
THE H.264/MPEG4 AND ITS APPLICATIONS
 
Machine Learning approaches at video compression
Machine Learning approaches at video compression Machine Learning approaches at video compression
Machine Learning approaches at video compression
 
Tutorial High Efficiency Video Coding Coding - Tools and Specification.pdf
Tutorial High Efficiency Video Coding Coding - Tools and Specification.pdfTutorial High Efficiency Video Coding Coding - Tools and Specification.pdf
Tutorial High Efficiency Video Coding Coding - Tools and Specification.pdf
 
Design and Analysis of Quantization Based Low Bit Rate Encoding System
Design and Analysis of Quantization Based Low Bit Rate Encoding SystemDesign and Analysis of Quantization Based Low Bit Rate Encoding System
Design and Analysis of Quantization Based Low Bit Rate Encoding System
 
Immersive Video Delivery: From Omnidirectional Video to Holography
Immersive Video Delivery: From Omnidirectional Video to HolographyImmersive Video Delivery: From Omnidirectional Video to Holography
Immersive Video Delivery: From Omnidirectional Video to Holography
 
Jiri ece-01-03 adaptive temporal averaging and frame prediction based surveil...
Jiri ece-01-03 adaptive temporal averaging and frame prediction based surveil...Jiri ece-01-03 adaptive temporal averaging and frame prediction based surveil...
Jiri ece-01-03 adaptive temporal averaging and frame prediction based surveil...
 
Insight toolkit을 이용한 삼차원 흉부 CT 영상분석 및 폐결절 검출 시스템
Insight toolkit을 이용한 삼차원 흉부 CT 영상분석 및 폐결절 검출 시스템Insight toolkit을 이용한 삼차원 흉부 CT 영상분석 및 폐결절 검출 시스템
Insight toolkit을 이용한 삼차원 흉부 CT 영상분석 및 폐결절 검출 시스템
 
A04840107
A04840107A04840107
A04840107
 
Aruna Ravi - M.S Thesis
Aruna Ravi - M.S ThesisAruna Ravi - M.S Thesis
Aruna Ravi - M.S Thesis
 
Research and activity report
Research and activity reportResearch and activity report
Research and activity report
 
1 state of-the-art and trends in scalable video
1 state of-the-art and trends in scalable video1 state of-the-art and trends in scalable video
1 state of-the-art and trends in scalable video
 
Are you Digitized Files Really OK? Levels of QC and Film Digitization (SCHALL...
Are you Digitized Files Really OK? Levels of QC and Film Digitization (SCHALL...Are you Digitized Files Really OK? Levels of QC and Film Digitization (SCHALL...
Are you Digitized Files Really OK? Levels of QC and Film Digitization (SCHALL...
 
Introduction to Video Compression Techniques - Anurag Jain
Introduction to Video Compression Techniques - Anurag JainIntroduction to Video Compression Techniques - Anurag Jain
Introduction to Video Compression Techniques - Anurag Jain
 
Distributed Adaptation Decision-Taking Framework and Scalable Video Coding Tu...
Distributed Adaptation Decision-Taking Framework and Scalable Video Coding Tu...Distributed Adaptation Decision-Taking Framework and Scalable Video Coding Tu...
Distributed Adaptation Decision-Taking Framework and Scalable Video Coding Tu...
 
Video Compression Using Block By Block Basis Salience Detection
Video Compression Using Block By Block Basis Salience DetectionVideo Compression Using Block By Block Basis Salience Detection
Video Compression Using Block By Block Basis Salience Detection
 
Paper id 2120148
Paper id 2120148Paper id 2120148
Paper id 2120148
 
VVC HLS overview .pdf
VVC HLS overview .pdfVVC HLS overview .pdf
VVC HLS overview .pdf
 
Real time SHVC decoder
Real time SHVC decoderReal time SHVC decoder
Real time SHVC decoder
 
Shahid presentation
Shahid presentation Shahid presentation
Shahid presentation
 
H04011 04 5361
H04011 04 5361H04011 04 5361
H04011 04 5361
 

Recently uploaded

Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
A Glance At The Java Performance Toolbox
A Glance At The Java Performance ToolboxA Glance At The Java Performance Toolbox
A Glance At The Java Performance ToolboxAna-Maria Mihalceanu
 
Infrared simulation and processing on Nvidia platforms
Infrared simulation and processing on Nvidia platformsInfrared simulation and processing on Nvidia platforms
Infrared simulation and processing on Nvidia platformsYoss Cohen
 
Which standard is best for your content?
Which standard is best for your content?Which standard is best for your content?
Which standard is best for your content?Rustici Software
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxfnnc6jmgwh
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...Nikki Chapple
 
Kuma Meshes Part I - The basics - A tutorial
Kuma Meshes Part I - The basics - A tutorialKuma Meshes Part I - The basics - A tutorial
Kuma Meshes Part I - The basics - A tutorialJoão Esperancinha
 
QMMS Lesson 2 - Using MS Excel Formula.pdf
QMMS Lesson 2 - Using MS Excel Formula.pdfQMMS Lesson 2 - Using MS Excel Formula.pdf
QMMS Lesson 2 - Using MS Excel Formula.pdfROWELL MARQUINA
 
Why Agile? - A handbook behind Agile Evolution
Why Agile? - A handbook behind Agile EvolutionWhy Agile? - A handbook behind Agile Evolution
Why Agile? - A handbook behind Agile EvolutionDEEPRAJ PATHAK
 
Landscape Catalogue 2024 Australia-1.pdf
Landscape Catalogue 2024 Australia-1.pdfLandscape Catalogue 2024 Australia-1.pdf
Landscape Catalogue 2024 Australia-1.pdfAarwolf Industries LLC
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Farhan Tariq
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#Karmanjay Verma
 
Laying the Data Foundations for Artificial Intelligence!
Laying the Data Foundations for Artificial Intelligence!Laying the Data Foundations for Artificial Intelligence!
Laying the Data Foundations for Artificial Intelligence!Memoori
 
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...BookNet Canada
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfIngrid Airi González
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Mark Goldstein
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityIES VE
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch TuesdayIvanti
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integrationmarketing932765
 

Recently uploaded (20)

Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
A Glance At The Java Performance Toolbox
A Glance At The Java Performance ToolboxA Glance At The Java Performance Toolbox
A Glance At The Java Performance Toolbox
 
Infrared simulation and processing on Nvidia platforms
Infrared simulation and processing on Nvidia platformsInfrared simulation and processing on Nvidia platforms
Infrared simulation and processing on Nvidia platforms
 
Which standard is best for your content?
Which standard is best for your content?Which standard is best for your content?
Which standard is best for your content?
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
 
Kuma Meshes Part I - The basics - A tutorial
Kuma Meshes Part I - The basics - A tutorialKuma Meshes Part I - The basics - A tutorial
Kuma Meshes Part I - The basics - A tutorial
 
QMMS Lesson 2 - Using MS Excel Formula.pdf
QMMS Lesson 2 - Using MS Excel Formula.pdfQMMS Lesson 2 - Using MS Excel Formula.pdf
QMMS Lesson 2 - Using MS Excel Formula.pdf
 
Why Agile? - A handbook behind Agile Evolution
Why Agile? - A handbook behind Agile EvolutionWhy Agile? - A handbook behind Agile Evolution
Why Agile? - A handbook behind Agile Evolution
 
Landscape Catalogue 2024 Australia-1.pdf
Landscape Catalogue 2024 Australia-1.pdfLandscape Catalogue 2024 Australia-1.pdf
Landscape Catalogue 2024 Australia-1.pdf
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#
 
Laying the Data Foundations for Artificial Intelligence!
Laying the Data Foundations for Artificial Intelligence!Laying the Data Foundations for Artificial Intelligence!
Laying the Data Foundations for Artificial Intelligence!
 
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdf
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a reality
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch Tuesday
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
 

PCS 2019 Panel on Emerging Video Coding Standards: Overview on the Emerging Versatile Video Coding Standard

  • 1. Brief Overview on the Emerging Versatile Video Coding Standard … as seen by an individual Picture Coding Symposium 2019, Ningbo, China Mathias Wien Lehrstuhl für Bildverarbeitung RWTH Aachen University wien@lfb.rwth-aachen.de
  • 2. Versatile Video Coding | Panel on Emerging Video Codecs | Picture Coding Symposium 2019 | Ningbo, China 15.11.2019 | Mathias Wien | Institute of Imaging and Computer Vision | RWTH Aachen University 2 • Joint Video Experts Team of ISO/IEC MPEG and ITU-T VCEG, est. in Oct. 2015 as Joint Video Exploration Team, renamed Apr. 2018 at CfP eval. • Joint Exploration Model: 7 iterations  Investigating coding tools enhanced relative to HEVC test model HM • Call for Evidence (CfE), issued Apr. 2017, evaluated in Jul. 2017  Significant improvement for JEM and independent submissions • Call for Proposls (CfP), issued Oct. 2017, evaluated in Apr. 2018 at10th JVET meeting  Kick-off for VVC, definition of name, VVC draft 1 and test model 1 (VTM1) Evolution towards VVC Evolution of JVET docs and participants
  • 3. Versatile Video Coding | Panel on Emerging Video Codecs | Picture Coding Symposium 2019 | Ningbo, China 15.11.2019 | Mathias Wien | Institute of Imaging and Computer Vision | RWTH Aachen University 3 • Entropy Coding  CABAC  Multi-hypothesis probability estimation • Coding structures  4 × 4 to 128 × 128 Coding Unit (CU) size  Quad+ternary+binary tree partitioning  Dual-tree (separate trees for luma/chroma)  Partial coverage of prediction regions by transforms (SBT,ISP) • Inter Coding  16th-sample prec. for derived MVs | Locally adaptive MV resolution: signaling at ¼, 1, 4 sample precision  8-tap DCTIF + alt. 6-tap switched IF for ½ sample, 6-tap for affine subblock MC  Block-level CU weights, Triangular prediction with merge  Combined inter/intra prediction (CIIP)  Affine prediction refinement with optical flow (PROF), Bi-directional optical flow prediction (BDOF)  Subblock-based temporal merge, affine MV control point MVP, decoder-side MV refinement, history-based MVP, symmetrical MVD, Merge mode with MVD (MMVD) • Intra Coding  DC, planar, 67 intra prediction directions signaled, 93 after wide angle mapping | signaling: 6 most probable modes + remainder  Matrix-based intra prediction  Multi reference lines intra prediction  Intra subpartitions (ISP)  Position-dependent intra prediction sample filtering  Cross-component linear prediction • Residual Coding  DCT2 4×4-64×64, multi-transform selection (DST7/DCT8, ≤32), inter: subblock transform (SBT), low-frequency non-separable transform (LFNST), transform skip, 4:4:4 adaptive colour transform  Coefficient coding: HEVC + parity-based binarization for dependent quantization (DQ) • Loop Filters  Deblocking filter, sample adaptive offset (SAO)  Adaptive loop filter (ALF), luma mapping with chroma scaling VVC Coding Tools in a Nutshell MV/MVP/MVD: motion vector / predictor / difference | DCTIF: Discrete cosine transform derived interpolation filter | DST: Discrete sine transform
  • 4. Versatile Video Coding | Panel on Emerging Video Codecs | Picture Coding Symposium 2019 | Ningbo, China 15.11.2019 | Mathias Wien | Institute of Imaging and Computer Vision | RWTH Aachen University 4 • Parameter sets  Video parameter set, sequence parameter set, picture parameter set (VPS, SPS, PPS)  Adaptation parameter set (APS), picture header • Picture types  IDR, CRA, RADL, RASL, Trail, STSA  Gradual decoding refresh (GDR) • Picture partitioning  Slices, tiles  Subpictures, raster-scan slices of multiple tiles, rectangular slices within tiles • Screen content coding  Palette mode for 4:4:4  Intra block copy (IBC)  Residual coding for transform skip  Block-based Delta PCM (BDPCM) • More versatility  Reference picture resampling (RPR)  Spatial, quality and temporal scalability  Bitstream extraction and merging without VCL NAL unit rewriting  Film grain synthesis SEI message VVC Versatility Aspects IDR: instantaneous decoding refresh | CRA: clean random access | RADL/RASL: random access decodable/skipped leading pic. | STSA: step-wise temporal sublayer access
  • 5. Versatile Video Coding | Panel on Emerging Video Codecs | Picture Coding Symposium 2019 | Ningbo, China 15.11.2019 | Mathias Wien | Institute of Imaging and Computer Vision | RWTH Aachen University 5 • Assessment according to JVET Common Testing Conditions [JVET-M1010]  Rate-distortion performance, encoder / decoder run-time of VVC reference software implementation • Systematic evaluation throughout standardization project  All Intra, Random Access, Low Delay B configurations  Comparison to HEVC reference software HM: Comparable rate-distortion based encoder implementations Versatile Video Coding – Compression Performance
  • 6. Thanks for your attention! Mathias Wien Lehrstuhl für Bildverarbeitung RWTH Aachen University wien@lfb.rwth-aachen.de