The International Multimedia Telecommunications Consortium
Development of a 4K H.265/
HEVC HW Encoder
9th October 2013
Oliver.Gunasekara@NGCodec.com
CEO & Co-Founder NGCodec Inc.
1Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
Why NGCodec?
2Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
Video Sucks!
3Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
4Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
5Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
Realism!
~20 years to the Holodeck
6Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
Video Quality Components
7Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
Resolution
8Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
Colorimetry
8-­‐bit
10-­‐bit
X
Y
Z
CIE XYZ (1931)
UHDTV (Rec 2020) Gamut
HDTV (Rec 709) Gamut
SDTV (Rec 601) Gamut
9Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
More Video Components
Stereoscopy
LatencyHigh	
  frame	
  rate
200	
  degrees	
  field	
  of	
  view
10Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
Codec, Bit-rate, Bandwidth
11Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
12Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
Watch the video online
http://ngcodec.com/imtc2013
13Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
Implementation Challenges
14Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
Today vs Tomorrow
0x
1x
2x
3x
4x
Pixels (M) FPS Colour depthCodec
Today (H.264 1080p30 8-bit)
Tomorrow (H.265 2160p60 10-bit)
40x
Complexity
15Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
Hardware Implementation Challenges
Being able to do 4K cost effectively (Multi-core)
Reference	
  
frame	
  
cache
HEVC,	
  AVC	
  
1080p60	
  
encoder	
  
elements
HEVC	
  
1080p60	
  
encoder	
  
elements
Video	
  frame	
  
distribuFon
Memory	
  interface
HEVC	
  
1080p60	
  
encoder	
  
elements
HEVC	
  
1080p60	
  
encoder	
  
elements
Control	
  register	
  	
  interface
Rate	
  control	
  
micro-­‐
processor
NAL	
  and	
  
VQ	
  micro-­‐
processor
1	
  engine,	
  no	
  WPP	
  for	
  1080p
4	
  engines	
  with	
  WPP	
  for	
  4K	
  resoluFon
Engine	
  1
Engine	
  2
Engine	
  3
Engine	
  4
WPP	
  Processing	
  of	
  4K	
  (2160p)	
  frame
16Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
Hardware Implementation Challenges (II)
Larger blocks/Mode decision/Block partitioning
CB0 CB1
CB2 CB3
CB4
CB5 CB6
CB0 CB1 CB2 CB3
CB4 CB5 CB6
H.264 H.265
17Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
Hardware Implementation Challenges (III)
Intra prediction
HEVC/H.265AVC/H.264
18Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
4K
4K H.265 Video Conference
4K	
  UHD
19Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
4K
PC Software H.265 Encoding
Maximum resolution 480p30 8-bit
4K	
  UHD
20Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
FPGA H.265 Encoding
Maximum resolution 2160p30 10-bit
4K	
  UHD
21Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
Conclusions
Very challenging but possible to deliver 50%
Diversity of encoder solutions, SW/FPGA/SoC
1080p30 can be everywhere <1Mbps
UHD 4K 10-bit is coming quickly
Scalability extensions coming in 2014
$965.99	
  Seiki	
  50”	
  UHD	
  LED	
  	
  TV
4K	
  UHD
22Saturday, October 5, 13
The International Multimedia Telecommunications Consortium
Thank you – Q&A + Downloads
Free	
  H.265	
  bit	
  streams/Demo
http://ngcodec.com/hevc-bitstreamshttp://ngcodec.com/imtc2013
Slides	
  &	
  Video
23Saturday, October 5, 13

Development of a 4K H.265/ HEVC HW Encoder

  • 1.
    The International MultimediaTelecommunications Consortium Development of a 4K H.265/ HEVC HW Encoder 9th October 2013 Oliver.Gunasekara@NGCodec.com CEO & Co-Founder NGCodec Inc. 1Saturday, October 5, 13
  • 2.
    The International MultimediaTelecommunications Consortium Why NGCodec? 2Saturday, October 5, 13
  • 3.
    The International MultimediaTelecommunications Consortium Video Sucks! 3Saturday, October 5, 13
  • 4.
    The International MultimediaTelecommunications Consortium 4Saturday, October 5, 13
  • 5.
    The International MultimediaTelecommunications Consortium 5Saturday, October 5, 13
  • 6.
    The International MultimediaTelecommunications Consortium Realism! ~20 years to the Holodeck 6Saturday, October 5, 13
  • 7.
    The International MultimediaTelecommunications Consortium Video Quality Components 7Saturday, October 5, 13
  • 8.
    The International MultimediaTelecommunications Consortium Resolution 8Saturday, October 5, 13
  • 9.
    The International MultimediaTelecommunications Consortium Colorimetry 8-­‐bit 10-­‐bit X Y Z CIE XYZ (1931) UHDTV (Rec 2020) Gamut HDTV (Rec 709) Gamut SDTV (Rec 601) Gamut 9Saturday, October 5, 13
  • 10.
    The International MultimediaTelecommunications Consortium More Video Components Stereoscopy LatencyHigh  frame  rate 200  degrees  field  of  view 10Saturday, October 5, 13
  • 11.
    The International MultimediaTelecommunications Consortium Codec, Bit-rate, Bandwidth 11Saturday, October 5, 13
  • 12.
    The International MultimediaTelecommunications Consortium 12Saturday, October 5, 13
  • 13.
    The International MultimediaTelecommunications Consortium Watch the video online http://ngcodec.com/imtc2013 13Saturday, October 5, 13
  • 14.
    The International MultimediaTelecommunications Consortium Implementation Challenges 14Saturday, October 5, 13
  • 15.
    The International MultimediaTelecommunications Consortium Today vs Tomorrow 0x 1x 2x 3x 4x Pixels (M) FPS Colour depthCodec Today (H.264 1080p30 8-bit) Tomorrow (H.265 2160p60 10-bit) 40x Complexity 15Saturday, October 5, 13
  • 16.
    The International MultimediaTelecommunications Consortium Hardware Implementation Challenges Being able to do 4K cost effectively (Multi-core) Reference   frame   cache HEVC,  AVC   1080p60   encoder   elements HEVC   1080p60   encoder   elements Video  frame   distribuFon Memory  interface HEVC   1080p60   encoder   elements HEVC   1080p60   encoder   elements Control  register    interface Rate  control   micro-­‐ processor NAL  and   VQ  micro-­‐ processor 1  engine,  no  WPP  for  1080p 4  engines  with  WPP  for  4K  resoluFon Engine  1 Engine  2 Engine  3 Engine  4 WPP  Processing  of  4K  (2160p)  frame 16Saturday, October 5, 13
  • 17.
    The International MultimediaTelecommunications Consortium Hardware Implementation Challenges (II) Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 CB5 CB6 CB0 CB1 CB2 CB3 CB4 CB5 CB6 H.264 H.265 17Saturday, October 5, 13
  • 18.
    The International MultimediaTelecommunications Consortium Hardware Implementation Challenges (III) Intra prediction HEVC/H.265AVC/H.264 18Saturday, October 5, 13
  • 19.
    The International MultimediaTelecommunications Consortium 4K 4K H.265 Video Conference 4K  UHD 19Saturday, October 5, 13
  • 20.
    The International MultimediaTelecommunications Consortium 4K PC Software H.265 Encoding Maximum resolution 480p30 8-bit 4K  UHD 20Saturday, October 5, 13
  • 21.
    The International MultimediaTelecommunications Consortium FPGA H.265 Encoding Maximum resolution 2160p30 10-bit 4K  UHD 21Saturday, October 5, 13
  • 22.
    The International MultimediaTelecommunications Consortium Conclusions Very challenging but possible to deliver 50% Diversity of encoder solutions, SW/FPGA/SoC 1080p30 can be everywhere <1Mbps UHD 4K 10-bit is coming quickly Scalability extensions coming in 2014 $965.99  Seiki  50”  UHD  LED    TV 4K  UHD 22Saturday, October 5, 13
  • 23.
    The International MultimediaTelecommunications Consortium Thank you – Q&A + Downloads Free  H.265  bit  streams/Demo http://ngcodec.com/hevc-bitstreamshttp://ngcodec.com/imtc2013 Slides  &  Video 23Saturday, October 5, 13