AV1: The nextAV1: The next
generation videogeneration video
codeccodec
David Chou
We are UmboWe are Umbo
Computer VisionComputer Vision
We buildWe build
autonomous videoautonomous video
security systemsecurity system
Why we should careWhy we should care
about codec?about codec?
Machine Learning on the CloudMachine Learning on the Cloud
Video qualityVideo quality
Bandwidth consumptionBandwidth consumption
Storage sizeStorage size
History of VideoHistory of Video
CodecsCodecs
H.265 IP MessH.265 IP Mess
Alliance for Open MediaAlliance for Open Media
(AOM)(AOM)
AV1AV1
AOMedia Video 1AOMedia Video 1
AV1: StatusAV1: Status
AV1 aims to be a video format for theAV1 aims to be a video format for the
web that is bothweb that is both state of the artstate of the art andand
royalty freeroyalty free
AV1 is meant to succeed itsAV1 is meant to succeed its
predecessor VP9 and compete withpredecessor VP9 and compete with
HEVC/H.265.HEVC/H.265.
AV1 is a combination of Google'sAV1 is a combination of Google's ,,
Mozilla'sMozilla's and Cisco'sand Cisco's
Released at 2018/03/28Released at 2018/03/28
VP10VP10
DaalaDaala ThorThor
AV1: Development ProcessAV1: Development Process
Coding tools are added as experiments into the AV1
codebase.
The hardware team reviews the experiments to
ensure it can be implemented in hardware.
Each experiment also needs to pass an IP review to
ensure no IPs are violated.
Once reviews are passed the experiment can be
enabled by default.
AV1: ContainerAV1: Container
Audio: OpusAudio: Opus
Container: webm, mkv, mp4Container: webm, mkv, mp4
WebRTC:WebRTC:
VP8, VP9, H.264,VP8, VP9, H.264, AV1AV1
AV1: Profiles/LevelsAV1: Profiles/Levels
Profiles Color sampling Bit depth
Main 4:2:0 8, 10
High 4:2:0, 4:4:4 8, 10
Professional 4:2:0, 4:2:2, 4:4:4 8, 10, 12
Levels Mbps Examples
2.0 1.5 426x240@30fps
4.1 20.0 1920x1080@60fps
5.3 60.0 3840x2160@120fps
6.3 160.0 7680x4320@120fps
AV1: Software AdoptionAV1: Software Adoption
Reference implementation:Reference implementation:
Another Rust implementation:Another Rust implementation:
Browser supportBrowser support
Chrome:Chrome:
Firefox:Firefox:
FFMPEG:FFMPEG:
VLC:VLC:
Gstreamer:Gstreamer:
libaom-av1libaom-av1
rav1erav1e
v69v69
v55v55
v4.0v4.0
v3.0v3.0
v1.14v1.14
AV1: Hardware AdoptionAV1: Hardware Adoption
Early hardware support will be softwareEarly hardware support will be software
running on non-CPU hardware.running on non-CPU hardware.
CUDA, OpenCLCUDA, OpenCL
Fixed-function hardware will take 12–18Fixed-function hardware will take 12–18
months after bitstream freezemonths after bitstream freeze
March - Auguest 2019March - Auguest 2019
Google's codec group is developing aGoogle's codec group is developing a
free AV1 HW decoderfree AV1 HW decoder
AV1 Coding Tool OverviewAV1 Coding Tool Overview
More block sizes
Prediction blocks
from 128x128 down to 4x4
Rectangular blocks:
1:2, 2:1 and 1:4, 4:1 ratio
Transform sizes
from 64x64 down to 4x4
Rectangular transforms:
1:2, 2:1 and 1:4, 4:1 ratios
More transform type
4 transform types
DCT, ADST, FlipADST, Identity
More prediction modes
Intra:
56 directions
Chroma from luma
prediction
Inter:
Expanded reference list
Compound mode
New adaptive multi-symbol
entropy coding
Spatial and temporal
scalability
 https://vimeo.com/269067164/description https://youtu.be/yKEDf5-2sT4
AV1 vs Other CodecsAV1 vs Other Codecs
BitmovinBitmovin
“ This scientific evaluation puts AV1 to the test against
industry standard codecs and shows that AV1 is able to
outperform VP9 and even HEVC by up to 40%
https://goo.gl/61oeXa
https://goo.gl/o7Usv7
Moscow StateMoscow State
UniversityUniversity
“ AV1 has extremely high encoding quality inapproachable
to other encoders and extremely low encoding speed due to
lack of speed optimization.
https://goo.gl/zyNxxB
FacebookFacebook
“ Users watching AV1 content will enjoy better quality at
the same bit rate or see 30% to 50% less buffering at the
same quality compared with VP9 or H.264/AVC content.
https://bit.ly/2KOO13C
AV1 RoadmapAV1 Roadmap
ConclusionsConclusions
AV1 is able to outperform VP9 and H.265AV1 is able to outperform VP9 and H.265
Still needs lots of optimizationStill needs lots of optimization
Product adoption would be expectedProduct adoption would be expected
Hardware support is criticalHardware support is critical
H.265 royalty fee issuesH.265 royalty fee issues
Any Question?Any Question?
We are hiringWe are hiring
https://umbocv.ai/join_ushttps://umbocv.ai/join_us

AV1: the next generation video codec

  • 1.
    AV1: The nextAV1:The next generation videogeneration video codeccodec David Chou
  • 2.
    We are UmboWeare Umbo Computer VisionComputer Vision We buildWe build autonomous videoautonomous video security systemsecurity system
  • 3.
    Why we shouldcareWhy we should care about codec?about codec?
  • 4.
    Machine Learning onthe CloudMachine Learning on the Cloud Video qualityVideo quality Bandwidth consumptionBandwidth consumption Storage sizeStorage size
  • 6.
    History of VideoHistoryof Video CodecsCodecs
  • 8.
  • 10.
    Alliance for OpenMediaAlliance for Open Media (AOM)(AOM)
  • 11.
  • 12.
    AV1: StatusAV1: Status AV1aims to be a video format for theAV1 aims to be a video format for the web that is bothweb that is both state of the artstate of the art andand royalty freeroyalty free AV1 is meant to succeed itsAV1 is meant to succeed its predecessor VP9 and compete withpredecessor VP9 and compete with HEVC/H.265.HEVC/H.265. AV1 is a combination of Google'sAV1 is a combination of Google's ,, Mozilla'sMozilla's and Cisco'sand Cisco's Released at 2018/03/28Released at 2018/03/28 VP10VP10 DaalaDaala ThorThor
  • 13.
    AV1: Development ProcessAV1:Development Process Coding tools are added as experiments into the AV1 codebase. The hardware team reviews the experiments to ensure it can be implemented in hardware. Each experiment also needs to pass an IP review to ensure no IPs are violated. Once reviews are passed the experiment can be enabled by default.
  • 14.
    AV1: ContainerAV1: Container Audio:OpusAudio: Opus Container: webm, mkv, mp4Container: webm, mkv, mp4 WebRTC:WebRTC: VP8, VP9, H.264,VP8, VP9, H.264, AV1AV1
  • 15.
    AV1: Profiles/LevelsAV1: Profiles/Levels ProfilesColor sampling Bit depth Main 4:2:0 8, 10 High 4:2:0, 4:4:4 8, 10 Professional 4:2:0, 4:2:2, 4:4:4 8, 10, 12 Levels Mbps Examples 2.0 1.5 426x240@30fps 4.1 20.0 1920x1080@60fps 5.3 60.0 3840x2160@120fps 6.3 160.0 7680x4320@120fps
  • 16.
    AV1: Software AdoptionAV1:Software Adoption Reference implementation:Reference implementation: Another Rust implementation:Another Rust implementation: Browser supportBrowser support Chrome:Chrome: Firefox:Firefox: FFMPEG:FFMPEG: VLC:VLC: Gstreamer:Gstreamer: libaom-av1libaom-av1 rav1erav1e v69v69 v55v55 v4.0v4.0 v3.0v3.0 v1.14v1.14
  • 17.
    AV1: Hardware AdoptionAV1:Hardware Adoption Early hardware support will be softwareEarly hardware support will be software running on non-CPU hardware.running on non-CPU hardware. CUDA, OpenCLCUDA, OpenCL Fixed-function hardware will take 12–18Fixed-function hardware will take 12–18 months after bitstream freezemonths after bitstream freeze March - Auguest 2019March - Auguest 2019 Google's codec group is developing aGoogle's codec group is developing a free AV1 HW decoderfree AV1 HW decoder
  • 18.
    AV1 Coding ToolOverviewAV1 Coding Tool Overview
  • 19.
    More block sizes Predictionblocks from 128x128 down to 4x4 Rectangular blocks: 1:2, 2:1 and 1:4, 4:1 ratio Transform sizes from 64x64 down to 4x4 Rectangular transforms: 1:2, 2:1 and 1:4, 4:1 ratios More transform type 4 transform types DCT, ADST, FlipADST, Identity More prediction modes Intra: 56 directions Chroma from luma prediction Inter: Expanded reference list Compound mode New adaptive multi-symbol entropy coding Spatial and temporal scalability  https://vimeo.com/269067164/description https://youtu.be/yKEDf5-2sT4
  • 20.
    AV1 vs OtherCodecsAV1 vs Other Codecs
  • 21.
    BitmovinBitmovin “ This scientificevaluation puts AV1 to the test against industry standard codecs and shows that AV1 is able to outperform VP9 and even HEVC by up to 40% https://goo.gl/61oeXa https://goo.gl/o7Usv7
  • 26.
    Moscow StateMoscow State UniversityUniversity “AV1 has extremely high encoding quality inapproachable to other encoders and extremely low encoding speed due to lack of speed optimization. https://goo.gl/zyNxxB
  • 29.
    FacebookFacebook “ Users watchingAV1 content will enjoy better quality at the same bit rate or see 30% to 50% less buffering at the same quality compared with VP9 or H.264/AVC content. https://bit.ly/2KOO13C
  • 31.
  • 33.
    ConclusionsConclusions AV1 is ableto outperform VP9 and H.265AV1 is able to outperform VP9 and H.265 Still needs lots of optimizationStill needs lots of optimization Product adoption would be expectedProduct adoption would be expected Hardware support is criticalHardware support is critical H.265 royalty fee issuesH.265 royalty fee issues
  • 34.
    Any Question?Any Question? Weare hiringWe are hiring https://umbocv.ai/join_ushttps://umbocv.ai/join_us