SlideShare a Scribd company logo
1 of 29
Don’t Just Go IP, Go IT!
Kieran Kunhya – kierank@obe.tv
@openbroadcastsy - #NABShow
What I’ll talk about
today• IT in Live Broadcast Television (orders of
magnitude differences for latency/bitrate
compared to OTT).
• History of IT in Live Broadcast
• IP/IT Technical challenges
• Using IT equipment in live broadcast
Who are we?
• Central London based company
• Build broadcast hardware and
software using IT equipment
• Written entirely in-house
• Video contribution and general
processing.
• Involved in early multivendor IP
deployments.
Traditional hardware architecture
• Single or limited function
cards with onboard
FPGAs or DSPs doing
majority of work.
• Smaller CPU to perform
control aspects.
A true software architecture
Standard CPU performs all non-
physical data processing
ASI
SDI
MADI
AES/EB
U
IP
etc.
ASI
SDI
MADI
AES/EB
U
IP
etc.
A true software architecture
Standard CPU performs all non-
physical data processing
ASI
SDI
MADI
AES/EB
U
IP
etc.
ASI
SDI
MADI
AES/EB
U
IP
etc.
Technological
changes• Intel Nehalem (2008/09)
• Realtime 1080i encoding
• Only possible with overclocking
before
• Low cost SDI/ASI boards
• Full 10-bit, VANC
• Commodity hardware
Everything available next-day!
Myth 1: IT hardware is too large and too
power hungry
Units reside in street
furniture outside Downing
Street, Buckingham Palace
etc. Low depth (200mm)
chassis, low power CPU.
Encode/decode, ASI
processing, Intercom.
Myth 2: IT hardware isn’t powerful enough
And another 17 more
cropped out!
• Huge processing power available
• 432 CPUs (small supercomputer)
• Costs falling dramatically
• Powerful enough for example to do high-
bitrate VC-2 encoding/decoding, very
high density H.264 decoding, ASI
processing.
• ~2-3x less rackspace for equivalent
functionality compared to hardware
• Processing power for new functions
Standards in software
contextSMPTE 2022-6 – SDI over IP
• Samples spanning packets (awkward)
• Costly CRC
• SDI frame tedious to construct
TR-03 – separate RTP streams for video/audio
• Samples no longer span packets (RFC4175)
• Soon SMPTE 2110
• Will this actually be possible in software?
Pixel formats
Only YUV 4:2:2 domain (as example)!
• Planar 10b – main working format
• Planar 8b - preview quality
• UYVY 10b (16-bit aligned) – SDI
datastream
• Apple v210 – hardware
• Contiguous 10-bit – 2022-6/TR-03 packing
Tricky to work
with in software.
Handwritten (no intrinsics!) SIMD for every mapping (and
others).
• 5-15x speed improvements compared to C
• Do it once, make it fast once and for all (until new
CPU…)
• Generic conversion library a difficult problem
• Intermediate pixel format(s) always a compromise
• Add special cases until you’ve done them all!
Pixel formats
One does not
simply…Bypass the operating system
DPDK, Netmap, Registered I/O
A presentation in itself. See
BBC R&D at UKNOF:
https://www.youtube.com/watch?v=yL
L8wl8YUwA
Kernel Bypass
No network stack – You are the network stack
• Craft Ethernet, IP, UDP headers yourself
• No ARP, hardcoded MAC
• Handle most of this in userspace
• Lets you do pixel processing directly to/from
Network Card memory.
Packet Spacing
(1)
THE million dollar
question
• Left unspecified in SMPTE 2022-6
• Hardware can do this with ~ns precision (measured
with HFT equipment), but what about software?
Packet Spacing
(2)• Varies by NIC vendor, measured two, both bimodal
• Some implementations require “fake-packets”
• More research needed!
• Fractional Framerates 2.0 if
constraints too tight
IT-based live production
today
• Dual-capable, SDI/ASI/AES and IP
• Make it look the same to end-users, buttons,
SNMP etc.
• Incremental improvements like a web
browser
• Allow users to understand multifunctionality
• Integrate seamlessly (e.g MPEG-TS)
IT-based live production tomorrow
• A BIG COMPUTE RESOURCE
• Live and offline on the same CPU
• Remote kit can be processing low-priority batch
jobs
• Flash override on live broadcasts
• Possible today but no orchestrator
(microservices?)
• FIMS too old (SOAP/XML…)
• Control network and CPU resources
Decode
MPEG-TS
multicast
Orchestrator goes and finds
CPU resources somewhere,
onsite or otherwise.
Spin me up
a
multiviewer
Transcode
this file
Not possible
with SDI
because SDI
associated with
a connector on a
machine.
The V-word,
Virtualisation• OS provides priorities to run multiple applications
already
• Many vendors on Windows (often without good
reason)
• Getting > 1Gbps of data out of VM nontrivial.
• Live migration of complex, stateful broadcast
applications not easy. (Not a web server…)
• Complexity may outweigh benefits.
Using IT networks for contribution
• Trend towards using generic, unmanaged, IP networks for broadcast
contribution.
• Regular in News (including cellular)
• Growing use for Sport and Channel contribution
• Important for any Cloud workflows (e.g Amazon Web Services)
• Packet loss and Jitter (relative to traditional metrics)
• Do it properly, using UDP. TCP not suited.
• Variations on three main techniques.
Using IT networks for contribution
(1)• SMPTE 2022-1/2 FEC
• XOR based matrix (adds 2 * matrix latency)
• Basic but wide support (albeit many broken
implementations)
Row FEC Column FEC
Using IT networks for contribution
(2)• Retransmits (aka ARQ)
• Receiver requests
sender to transmit a
copy of lost packet.
• Affected by round-trip
latency
• Negative
acknowledgment
Sender Receive
r
Using IT networks for contribution
(3)• Dual-pathing (SMPTE 2022-7)
• Hitless Switching
Path1
Path2
Out
Example of IT and Generic IP at
Scale• Deluxe Broadcast Delivery
Network
• Using software-based
infrastructure for encoding,
delivery and decoding.
• Transported using multiple IP
connections
• Delivered NFL European
Feed (inc SuperBowl) at
40Mbit/s
Example of IT and Generic IP at
Scale (2)• Three nights of the One
Show on BBC1 delivered
using public internet (~5m
viewers)
• Reverse vision video on
same unit.
• Next step (in UK), long-
form programming
delivered over cellular?
Summary
• IT equipment is on-air in the live broadcast chain today
• The advent of IP-based production provides an opportunity
to use multifunction IT equipment and gain massive
flexibility.
• Standards need to reflect this
• The use of generic connectivity is increasing, and not just for
financial reasons.
• Going to be some very high-profile announcements in
coming months
Q&A
Find me on SL5624

More Related Content

What's hot

Kordik fundamental guidtoindustrialnetworking -v_imp
Kordik fundamental guidtoindustrialnetworking -v_impKordik fundamental guidtoindustrialnetworking -v_imp
Kordik fundamental guidtoindustrialnetworking -v_imp
amsubramanyam
 
QNAP Surveillance Solutions
QNAP Surveillance SolutionsQNAP Surveillance Solutions
QNAP Surveillance Solutions
CK Chen
 
2+ipt+configuring cisco-cme
2+ipt+configuring cisco-cme2+ipt+configuring cisco-cme
2+ipt+configuring cisco-cme
Yves Jean Louis
 

What's hot (18)

Ip live production
Ip live productionIp live production
Ip live production
 
Installation Issues for Converged AV/IT Systems
Installation Issues for Converged AV/IT SystemsInstallation Issues for Converged AV/IT Systems
Installation Issues for Converged AV/IT Systems
 
Technology at the cutting edge of broadcasting
Technology at the cutting edge of broadcastingTechnology at the cutting edge of broadcasting
Technology at the cutting edge of broadcasting
 
Kordik fundamental guidtoindustrialnetworking -v_imp
Kordik fundamental guidtoindustrialnetworking -v_impKordik fundamental guidtoindustrialnetworking -v_imp
Kordik fundamental guidtoindustrialnetworking -v_imp
 
QNAP Surveillance Solutions
QNAP Surveillance SolutionsQNAP Surveillance Solutions
QNAP Surveillance Solutions
 
Tackling 400 MHz Timing Closure
Tackling 400 MHz Timing ClosureTackling 400 MHz Timing Closure
Tackling 400 MHz Timing Closure
 
Video-over-IP for AV
Video-over-IP for AVVideo-over-IP for AV
Video-over-IP for AV
 
AVB intro
AVB introAVB intro
AVB intro
 
IPv6 implementation for end users
IPv6 implementation for end usersIPv6 implementation for end users
IPv6 implementation for end users
 
MAP-E as IPv4 over IPv6 Technology
MAP-E as IPv4 over IPv6 TechnologyMAP-E as IPv4 over IPv6 Technology
MAP-E as IPv4 over IPv6 Technology
 
SMPTE Toronto Presentation - Open-Source Software In Broadcasting: The Power ...
SMPTE Toronto Presentation - Open-Source Software In Broadcasting: The Power ...SMPTE Toronto Presentation - Open-Source Software In Broadcasting: The Power ...
SMPTE Toronto Presentation - Open-Source Software In Broadcasting: The Power ...
 
IPv4 over IPv6 in the Venue, APRICOT-APAN 2015 Fukuoka
IPv4 over IPv6 in the Venue, APRICOT-APAN 2015 FukuokaIPv4 over IPv6 in the Venue, APRICOT-APAN 2015 Fukuoka
IPv4 over IPv6 in the Venue, APRICOT-APAN 2015 Fukuoka
 
Software defined networking: Primer
Software defined networking: PrimerSoftware defined networking: Primer
Software defined networking: Primer
 
QNAP Quick Guide For IP Video Surveillance
QNAP Quick Guide For IP Video Surveillance QNAP Quick Guide For IP Video Surveillance
QNAP Quick Guide For IP Video Surveillance
 
2+ipt+configuring cisco-cme
2+ipt+configuring cisco-cme2+ipt+configuring cisco-cme
2+ipt+configuring cisco-cme
 
IBM System Networking Portfolio Update, June 2014
IBM System Networking Portfolio Update, June 2014IBM System Networking Portfolio Update, June 2014
IBM System Networking Portfolio Update, June 2014
 
Broadcast day-2007-tandberg-ipxasi
Broadcast day-2007-tandberg-ipxasiBroadcast day-2007-tandberg-ipxasi
Broadcast day-2007-tandberg-ipxasi
 
IPv6 Deployment In Enterprise Networks
IPv6 Deployment In Enterprise NetworksIPv6 Deployment In Enterprise Networks
IPv6 Deployment In Enterprise Networks
 

Similar to Don't just go IP - Go IT

Microsofts Configurable Cloud
Microsofts Configurable CloudMicrosofts Configurable Cloud
Microsofts Configurable Cloud
Chris Genazzio
 
Srikanth_PILLI_CV_latest
Srikanth_PILLI_CV_latestSrikanth_PILLI_CV_latest
Srikanth_PILLI_CV_latest
Srikanth Pilli
 

Similar to Don't just go IP - Go IT (20)

Moving to software-based production workflows and containerisation of media a...
Moving to software-based production workflows and containerisation of media a...Moving to software-based production workflows and containerisation of media a...
Moving to software-based production workflows and containerisation of media a...
 
Parallel Rendering of Webpages
Parallel Rendering of WebpagesParallel Rendering of Webpages
Parallel Rendering of Webpages
 
Stable Feed and Lower Costs with Use of 5G and Satellite Stable Feed and Lowe...
Stable Feed and Lower Costs with Use of 5G and Satellite Stable Feed and Lowe...Stable Feed and Lower Costs with Use of 5G and Satellite Stable Feed and Lowe...
Stable Feed and Lower Costs with Use of 5G and Satellite Stable Feed and Lowe...
 
Designing an 4K/UHD1 HDR OB Truck as 12G-SDI or IP-based
Designing an 4K/UHD1 HDR OB Truck as 12G-SDI or IP-basedDesigning an 4K/UHD1 HDR OB Truck as 12G-SDI or IP-based
Designing an 4K/UHD1 HDR OB Truck as 12G-SDI or IP-based
 
Approaching hyperconvergedopenstack
Approaching hyperconvergedopenstackApproaching hyperconvergedopenstack
Approaching hyperconvergedopenstack
 
DaVinci DM8168 SuperHD Image Capture Solution
DaVinci DM8168 SuperHD Image Capture SolutionDaVinci DM8168 SuperHD Image Capture Solution
DaVinci DM8168 SuperHD Image Capture Solution
 
Embedded Systems Online Training | Imagine life
Embedded Systems Online Training | Imagine lifeEmbedded Systems Online Training | Imagine life
Embedded Systems Online Training | Imagine life
 
Named Data Networking Operational Aspects - IoT as a Use-case
Named Data Networking Operational Aspects - IoT as a Use-caseNamed Data Networking Operational Aspects - IoT as a Use-case
Named Data Networking Operational Aspects - IoT as a Use-case
 
Ch 17
Ch 17Ch 17
Ch 17
 
7 reasons why video conferencing world will never
7 reasons why video conferencing world will never7 reasons why video conferencing world will never
7 reasons why video conferencing world will never
 
Microsofts Configurable Cloud
Microsofts Configurable CloudMicrosofts Configurable Cloud
Microsofts Configurable Cloud
 
Lagopus presentation on 14th Annual ON*VECTOR International Photonics Workshop
Lagopus presentation on 14th Annual ON*VECTOR International Photonics WorkshopLagopus presentation on 14th Annual ON*VECTOR International Photonics Workshop
Lagopus presentation on 14th Annual ON*VECTOR International Photonics Workshop
 
Window server 2008
Window server 2008Window server 2008
Window server 2008
 
Hai Tao at AI Frontiers: Deep Learning For Embedded Vision System
Hai Tao at AI Frontiers: Deep Learning For Embedded Vision SystemHai Tao at AI Frontiers: Deep Learning For Embedded Vision System
Hai Tao at AI Frontiers: Deep Learning For Embedded Vision System
 
Raspberry pi
Raspberry piRaspberry pi
Raspberry pi
 
SDI to IP 2110 Transition Part 2
SDI to IP 2110 Transition Part 2SDI to IP 2110 Transition Part 2
SDI to IP 2110 Transition Part 2
 
IoT fun with Raspberry Pi and .NET
IoT fun with Raspberry Pi and .NETIoT fun with Raspberry Pi and .NET
IoT fun with Raspberry Pi and .NET
 
Srikanth_PILLI_CV_latest
Srikanth_PILLI_CV_latestSrikanth_PILLI_CV_latest
Srikanth_PILLI_CV_latest
 
Seminario utovrm
Seminario utovrmSeminario utovrm
Seminario utovrm
 
SCFE 2020 OpenCAPI presentation as part of OpenPWOER Tutorial
SCFE 2020 OpenCAPI presentation as part of OpenPWOER TutorialSCFE 2020 OpenCAPI presentation as part of OpenPWOER Tutorial
SCFE 2020 OpenCAPI presentation as part of OpenPWOER Tutorial
 

More from Kieran Kunhya

More from Kieran Kunhya (7)

Baby Demuxed's First Assembly Language Function
Baby Demuxed's First Assembly Language FunctionBaby Demuxed's First Assembly Language Function
Baby Demuxed's First Assembly Language Function
 
AVX512 assembly language in FFmpeg
AVX512 assembly language in FFmpegAVX512 assembly language in FFmpeg
AVX512 assembly language in FFmpeg
 
Private 5G Networks at the Queen's Funeral and Elsewhere
Private 5G Networks at the Queen's Funeral and ElsewherePrivate 5G Networks at the Queen's Funeral and Elsewhere
Private 5G Networks at the Queen's Funeral and Elsewhere
 
IBC 2022 IP Showcase - Timestamps in ST 2110: What They Mean and How to Measu...
IBC 2022 IP Showcase - Timestamps in ST 2110: What They Mean and How to Measu...IBC 2022 IP Showcase - Timestamps in ST 2110: What They Mean and How to Measu...
IBC 2022 IP Showcase - Timestamps in ST 2110: What They Mean and How to Measu...
 
5G for onboard racing car video
5G for onboard racing car video5G for onboard racing car video
5G for onboard racing car video
 
Ground-Cloud-Cloud-Ground - NAB 2022 IP Showcase
Ground-Cloud-Cloud-Ground - NAB 2022 IP ShowcaseGround-Cloud-Cloud-Ground - NAB 2022 IP Showcase
Ground-Cloud-Cloud-Ground - NAB 2022 IP Showcase
 
How to explain ST 2110 to a six year old.
How to explain ST 2110 to a six year old.How to explain ST 2110 to a six year old.
How to explain ST 2110 to a six year old.
 

Recently uploaded

Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night StandCall Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Stand
amitlee9823
 
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 

Recently uploaded (20)

Call for Papers - International Journal of Intelligent Systems and Applicatio...
Call for Papers - International Journal of Intelligent Systems and Applicatio...Call for Papers - International Journal of Intelligent Systems and Applicatio...
Call for Papers - International Journal of Intelligent Systems and Applicatio...
 
Double Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torqueDouble Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torque
 
Intze Overhead Water Tank Design by Working Stress - IS Method.pdf
Intze Overhead Water Tank  Design by Working Stress - IS Method.pdfIntze Overhead Water Tank  Design by Working Stress - IS Method.pdf
Intze Overhead Water Tank Design by Working Stress - IS Method.pdf
 
University management System project report..pdf
University management System project report..pdfUniversity management System project report..pdf
University management System project report..pdf
 
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete RecordCCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
 
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdfONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
 
Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night StandCall Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Stand
 
Thermal Engineering -unit - III & IV.ppt
Thermal Engineering -unit - III & IV.pptThermal Engineering -unit - III & IV.ppt
Thermal Engineering -unit - III & IV.ppt
 
Java Programming :Event Handling(Types of Events)
Java Programming :Event Handling(Types of Events)Java Programming :Event Handling(Types of Events)
Java Programming :Event Handling(Types of Events)
 
PVC VS. FIBERGLASS (FRP) GRAVITY SEWER - UNI BELL
PVC VS. FIBERGLASS (FRP) GRAVITY SEWER - UNI BELLPVC VS. FIBERGLASS (FRP) GRAVITY SEWER - UNI BELL
PVC VS. FIBERGLASS (FRP) GRAVITY SEWER - UNI BELL
 
Thermal Engineering Unit - I & II . ppt
Thermal Engineering  Unit - I & II . pptThermal Engineering  Unit - I & II . ppt
Thermal Engineering Unit - I & II . ppt
 
Call Girls Wakad Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Wakad Call Me 7737669865 Budget Friendly No Advance BookingCall Girls Wakad Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Wakad Call Me 7737669865 Budget Friendly No Advance Booking
 
UNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its PerformanceUNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its Performance
 
Double rodded leveling 1 pdf activity 01
Double rodded leveling 1 pdf activity 01Double rodded leveling 1 pdf activity 01
Double rodded leveling 1 pdf activity 01
 
KubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghlyKubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghly
 
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
 
The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...
The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...
The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...
 
The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...
The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...
The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...
 
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
 
Booking open Available Pune Call Girls Pargaon 6297143586 Call Hot Indian Gi...
Booking open Available Pune Call Girls Pargaon  6297143586 Call Hot Indian Gi...Booking open Available Pune Call Girls Pargaon  6297143586 Call Hot Indian Gi...
Booking open Available Pune Call Girls Pargaon 6297143586 Call Hot Indian Gi...
 

Don't just go IP - Go IT

  • 1. Don’t Just Go IP, Go IT! Kieran Kunhya – kierank@obe.tv @openbroadcastsy - #NABShow
  • 2. What I’ll talk about today• IT in Live Broadcast Television (orders of magnitude differences for latency/bitrate compared to OTT). • History of IT in Live Broadcast • IP/IT Technical challenges • Using IT equipment in live broadcast
  • 3. Who are we? • Central London based company • Build broadcast hardware and software using IT equipment • Written entirely in-house • Video contribution and general processing. • Involved in early multivendor IP deployments.
  • 4. Traditional hardware architecture • Single or limited function cards with onboard FPGAs or DSPs doing majority of work. • Smaller CPU to perform control aspects.
  • 5. A true software architecture Standard CPU performs all non- physical data processing ASI SDI MADI AES/EB U IP etc. ASI SDI MADI AES/EB U IP etc.
  • 6. A true software architecture Standard CPU performs all non- physical data processing ASI SDI MADI AES/EB U IP etc. ASI SDI MADI AES/EB U IP etc.
  • 7. Technological changes• Intel Nehalem (2008/09) • Realtime 1080i encoding • Only possible with overclocking before • Low cost SDI/ASI boards • Full 10-bit, VANC • Commodity hardware Everything available next-day!
  • 8. Myth 1: IT hardware is too large and too power hungry Units reside in street furniture outside Downing Street, Buckingham Palace etc. Low depth (200mm) chassis, low power CPU. Encode/decode, ASI processing, Intercom.
  • 9. Myth 2: IT hardware isn’t powerful enough And another 17 more cropped out! • Huge processing power available • 432 CPUs (small supercomputer) • Costs falling dramatically • Powerful enough for example to do high- bitrate VC-2 encoding/decoding, very high density H.264 decoding, ASI processing. • ~2-3x less rackspace for equivalent functionality compared to hardware • Processing power for new functions
  • 10. Standards in software contextSMPTE 2022-6 – SDI over IP • Samples spanning packets (awkward) • Costly CRC • SDI frame tedious to construct TR-03 – separate RTP streams for video/audio • Samples no longer span packets (RFC4175) • Soon SMPTE 2110 • Will this actually be possible in software?
  • 11. Pixel formats Only YUV 4:2:2 domain (as example)! • Planar 10b – main working format • Planar 8b - preview quality • UYVY 10b (16-bit aligned) – SDI datastream • Apple v210 – hardware • Contiguous 10-bit – 2022-6/TR-03 packing Tricky to work with in software.
  • 12. Handwritten (no intrinsics!) SIMD for every mapping (and others). • 5-15x speed improvements compared to C • Do it once, make it fast once and for all (until new CPU…) • Generic conversion library a difficult problem • Intermediate pixel format(s) always a compromise • Add special cases until you’ve done them all! Pixel formats
  • 13.
  • 14. One does not simply…Bypass the operating system DPDK, Netmap, Registered I/O A presentation in itself. See BBC R&D at UKNOF: https://www.youtube.com/watch?v=yL L8wl8YUwA
  • 15. Kernel Bypass No network stack – You are the network stack • Craft Ethernet, IP, UDP headers yourself • No ARP, hardcoded MAC • Handle most of this in userspace • Lets you do pixel processing directly to/from Network Card memory.
  • 16. Packet Spacing (1) THE million dollar question • Left unspecified in SMPTE 2022-6 • Hardware can do this with ~ns precision (measured with HFT equipment), but what about software?
  • 17. Packet Spacing (2)• Varies by NIC vendor, measured two, both bimodal • Some implementations require “fake-packets” • More research needed! • Fractional Framerates 2.0 if constraints too tight
  • 18. IT-based live production today • Dual-capable, SDI/ASI/AES and IP • Make it look the same to end-users, buttons, SNMP etc. • Incremental improvements like a web browser • Allow users to understand multifunctionality • Integrate seamlessly (e.g MPEG-TS)
  • 19. IT-based live production tomorrow • A BIG COMPUTE RESOURCE • Live and offline on the same CPU • Remote kit can be processing low-priority batch jobs • Flash override on live broadcasts • Possible today but no orchestrator (microservices?) • FIMS too old (SOAP/XML…) • Control network and CPU resources
  • 20. Decode MPEG-TS multicast Orchestrator goes and finds CPU resources somewhere, onsite or otherwise. Spin me up a multiviewer Transcode this file Not possible with SDI because SDI associated with a connector on a machine.
  • 21. The V-word, Virtualisation• OS provides priorities to run multiple applications already • Many vendors on Windows (often without good reason) • Getting > 1Gbps of data out of VM nontrivial. • Live migration of complex, stateful broadcast applications not easy. (Not a web server…) • Complexity may outweigh benefits.
  • 22. Using IT networks for contribution • Trend towards using generic, unmanaged, IP networks for broadcast contribution. • Regular in News (including cellular) • Growing use for Sport and Channel contribution • Important for any Cloud workflows (e.g Amazon Web Services) • Packet loss and Jitter (relative to traditional metrics) • Do it properly, using UDP. TCP not suited. • Variations on three main techniques.
  • 23. Using IT networks for contribution (1)• SMPTE 2022-1/2 FEC • XOR based matrix (adds 2 * matrix latency) • Basic but wide support (albeit many broken implementations) Row FEC Column FEC
  • 24. Using IT networks for contribution (2)• Retransmits (aka ARQ) • Receiver requests sender to transmit a copy of lost packet. • Affected by round-trip latency • Negative acknowledgment Sender Receive r
  • 25. Using IT networks for contribution (3)• Dual-pathing (SMPTE 2022-7) • Hitless Switching Path1 Path2 Out
  • 26. Example of IT and Generic IP at Scale• Deluxe Broadcast Delivery Network • Using software-based infrastructure for encoding, delivery and decoding. • Transported using multiple IP connections • Delivered NFL European Feed (inc SuperBowl) at 40Mbit/s
  • 27. Example of IT and Generic IP at Scale (2)• Three nights of the One Show on BBC1 delivered using public internet (~5m viewers) • Reverse vision video on same unit. • Next step (in UK), long- form programming delivered over cellular?
  • 28. Summary • IT equipment is on-air in the live broadcast chain today • The advent of IP-based production provides an opportunity to use multifunction IT equipment and gain massive flexibility. • Standards need to reflect this • The use of generic connectivity is increasing, and not just for financial reasons. • Going to be some very high-profile announcements in coming months
  • 29. Q&A Find me on SL5624

Editor's Notes

  1. Feel free to ask difficult questions at the end. Tweeting is especially encouraged.
  2. Plenty of IT in OTT. Just because you write 1mbit/s OTT software, doesn’t make you qualified even to work with 10Mbps, let alone 100 or 1Gigabit. Building a road-car is not the same as building an F1 car. Hopefully something for everyone
  3. SpaceX are vertically integrated (metal comes in, rockets come out). Parts and software built in-house. Do things that commentators said was not possible. Homage in a lot of places
  4. Some manufacturers reflash fixed-function hardware on the fly. In a few cases the boards do a little more than just convert physical to digital. Exception that proves the rule. All of these things at the same time Note, no GPUs. I’ll address the V-word later.
  5. Could do trickery such as reuse of motion vectors Not an SDI frontend to an analogue chipset like some boards. Unthinkable a short time ago.
  6. I’d like to dispel some myths
  7. Pixels spanning packets makes things awkward RFC written by software people so doesn’t have this constraint.
  8. All of these pixel formats are specific to broadcast industry.
  9. That’s not a percentage sign, that’s a times. A big sudoku puzzle.
  10. Interop presentation, let’s look at technical reality
  11. People understanding that upgrading live broadcast chains weekly is not something to be afraid of. Just because PTP is a thing, doesn’t mean you should use it, or it will be available
  12. Used to be financial, starting to become flexibility above costs.
  13. Broadcast quality, 30-40Mbps, this isn’t Skype.