AV1: the next generation video codec

1. AV1: The nextAV1: The next
generation videogeneration video
codeccodec
David Chou

2. We are UmboWe are Umbo
Computer VisionComputer Vision
We buildWe build
autonomous videoautonomous video
security systemsecurity system

3. Why we should careWhy we should care
about codec?about codec?

4. Machine Learning on the CloudMachine Learning on the Cloud
Video qualityVideo quality
Bandwidth consumptionBandwidth consumption
Storage sizeStorage size

6. History of VideoHistory of Video
CodecsCodecs

8. H.265 IP MessH.265 IP Mess

10. Alliance for Open MediaAlliance for Open Media
(AOM)(AOM)

11. AV1AV1
AOMedia Video 1AOMedia Video 1

12. AV1: StatusAV1: Status
AV1 aims to be a video format for theAV1 aims to be a video format for the
web that is bothweb that is both state of the artstate of the art andand
royalty freeroyalty free
AV1 is meant to succeed itsAV1 is meant to succeed its
predecessor VP9 and compete withpredecessor VP9 and compete with
HEVC/H.265.HEVC/H.265.
AV1 is a combination of Google'sAV1 is a combination of Google's ,,
Mozilla'sMozilla's and Cisco'sand Cisco's
Released at 2018/03/28Released at 2018/03/28
VP10VP10
DaalaDaala ThorThor

13. AV1: Development ProcessAV1: Development Process
Coding tools are added as experiments into the AV1
codebase.
The hardware team reviews the experiments to
ensure it can be implemented in hardware.
Each experiment also needs to pass an IP review to
ensure no IPs are violated.
Once reviews are passed the experiment can be
enabled by default.

14. AV1: ContainerAV1: Container
Audio: OpusAudio: Opus
Container: webm, mkv, mp4Container: webm, mkv, mp4
WebRTC:WebRTC:
VP8, VP9, H.264,VP8, VP9, H.264, AV1AV1

15. AV1: Profiles/LevelsAV1: Profiles/Levels
Profiles Color sampling Bit depth
Main 4:2:0 8, 10
High 4:2:0, 4:4:4 8, 10
Professional 4:2:0, 4:2:2, 4:4:4 8, 10, 12
Levels Mbps Examples
2.0 1.5 426x240@30fps
4.1 20.0 1920x1080@60fps
5.3 60.0 3840x2160@120fps
6.3 160.0 7680x4320@120fps

16. AV1: Software AdoptionAV1: Software Adoption
Reference implementation:Reference implementation:
Another Rust implementation:Another Rust implementation:
Browser supportBrowser support
Chrome:Chrome:
Firefox:Firefox:
FFMPEG:FFMPEG:
VLC:VLC:
Gstreamer:Gstreamer:
libaom-av1libaom-av1
rav1erav1e
v69v69
v55v55
v4.0v4.0
v3.0v3.0
v1.14v1.14

17. AV1: Hardware AdoptionAV1: Hardware Adoption
Early hardware support will be softwareEarly hardware support will be software
running on non-CPU hardware.running on non-CPU hardware.
CUDA, OpenCLCUDA, OpenCL
Fixed-function hardware will take 12–18Fixed-function hardware will take 12–18
months after bitstream freezemonths after bitstream freeze
March - Auguest 2019March - Auguest 2019
Google's codec group is developing aGoogle's codec group is developing a
free AV1 HW decoderfree AV1 HW decoder

18. AV1 Coding Tool OverviewAV1 Coding Tool Overview

19. More block sizes
Prediction blocks
from 128x128 down to 4x4
Rectangular blocks:
1:2, 2:1 and 1:4, 4:1 ratio
Transform sizes
from 64x64 down to 4x4
Rectangular transforms:
1:2, 2:1 and 1:4, 4:1 ratios
More transform type
4 transform types
DCT, ADST, FlipADST, Identity
More prediction modes
Intra:
56 directions
Chroma from luma
prediction
Inter:
Expanded reference list
Compound mode
New adaptive multi-symbol
entropy coding
Spatial and temporal
scalability
https://vimeo.com/269067164/description https://youtu.be/yKEDf5-2sT4

20. AV1 vs Other CodecsAV1 vs Other Codecs

21. BitmovinBitmovin
“ This scientific evaluation puts AV1 to the test against
industry standard codecs and shows that AV1 is able to
outperform VP9 and even HEVC by up to 40%
https://goo.gl/61oeXa
https://goo.gl/o7Usv7

26. Moscow StateMoscow State
UniversityUniversity
“ AV1 has extremely high encoding quality inapproachable
to other encoders and extremely low encoding speed due to
lack of speed optimization.
https://goo.gl/zyNxxB

29. FacebookFacebook
“ Users watching AV1 content will enjoy better quality at
the same bit rate or see 30% to 50% less buffering at the
same quality compared with VP9 or H.264/AVC content.
https://bit.ly/2KOO13C

31. AV1 RoadmapAV1 Roadmap

33. ConclusionsConclusions
AV1 is able to outperform VP9 and H.265AV1 is able to outperform VP9 and H.265
Still needs lots of optimizationStill needs lots of optimization
Product adoption would be expectedProduct adoption would be expected
Hardware support is criticalHardware support is critical
H.265 royalty fee issuesH.265 royalty fee issues

34. Any Question?Any Question?
We are hiringWe are hiring
https://umbocv.ai/join_ushttps://umbocv.ai/join_us