Advertisement
Advertisement

More Related Content

Advertisement
Advertisement

RTMP: how did we get to now? (Demuxed 2019)

  1. RTMP How did we get to now? Sarah Allen Veriskope @ultrasaurus October 23, 2019
  2. Internet Explorer 83.9% Netscape Navigator. 12.6% Opera 0.14% Flash 99.8% (bundled with IE & Netscape) timeline data: www.evolutionoftheweb.combrowser stats: TheCounter Q4 2000
  3. 50K 100K 200K
  4. two-way audio/video… < 100K of code
  5. Streaming Low-latency Two-way (mux, demux) Data Privacy 2002 Key Features
  6. 2002 Protocol Audio = 8, Video = 9, Data = 18, SharedObject (Sync) = 19, Command = 20 ------------------------------------------------------------------------- | | | | | | |Msg type |Payload Len |timestamp |Stream ID | Payload | | 1 Byte | 3 bytes | 3 bytes | 3 bytes | Size = Payload Len | | | | | | | -------------------------------------------------------------------------
  7. 2002 Protocol ------------------------------------------------------------------------- | | | | | | |Msg type |Payload Len |timestamp |Stream ID | Payload | | 1 Byte | 3 bytes | 4 bytes | 3 bytes | Size = Payload Len | | | | odd order| | | ------------------------------------------------------------------------- Audio = 8, Video = 9, Data = 18, SharedObject (Sync) = 19, Command = 20
  8. 2002 Protocol 0 1 2 3 4 5 6 7 +-+-+-+-+-+-+-+-+ |fmt| cs id | +-+-+-+-+-+-+-+-+ 0 1 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ |fmt| 0 | cs id - 64 | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ |fmt| 1 | cs id - 64 | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ Chunk Basic Header 1 byte 2 bytes 3 bytes Hint: 2^6 = 64
  9. Asymptotic Traffic Flow in a Hyperbolic Network: Non-uniform Traffic, Baryshnikov, Tucci 2002 Protocol
  10. Now?
  11. Streaming Low-latency Two-way (mux, demux) Data Privacy 2019

Editor's Notes

  1. today I will share the untold story of the origins of RTMP How does something like this become a de-facto standard? And who am I to say so? long before I worked on Flash, CoSA, digital video off CD-ROM, QuickTime, AE, Macr
  2. browser landscape. yellow line - a range of time in late 2000, ideas behind RTMP. highlights IE 5.5… first version of Internet Explorer to support CSS easy hate on Flash… but 200K code, small download drives adoption
  3. Flash PM, Troy Evans, added his vacation photo to Flash Player install
  4. Jon - wrote most of player, created a prototype of a new project, he called “tincan” Slavik’s story https://sundanceltd.com/front-door-camera/
  5. 10 stories about what we wanted this protocol to do
  6. The “Front Door Cam” story described what is now part of a Smart Home This isn’t just an app today, there’s a “connected video doorbell” market
  7. The live classroom story described a mix of multimedia, recorded video and live
  8. the now-ubiquitous customer server agent on a webpage… we wanted to support text messaging too
  9. Nascar Drive which launched in 2016 matches the “race car” story. Interactivity included fast switching of video feeds I am watching a car race, there are cameras at each turn and in the cars. I value the editing and filtering provided by the TV crew but I also have a favorite driver I want to watch closely…
  10. So, in order to support these kinds of communications app, the protocol needed …
  11. prioritize audio, low-latency delivery to support multiparty interaction (140 ms) two-way streaming, enough info to delegate mux/demux to server or client. For data — time-based data streams… application control messages & request/response RTMP is really more of a peer-to-peer protocol, with a common server architecture. Privacy has always been a critical concern, and at first was only added to the client, but later secure transport was added when RTMP became a layered protocol before the initial launch
  12. Core message format — allowing for audio, video, and three kinds of data 3 bytes - 4.66 hours
  13. 4 bytes - 7.1 week “odd order” - consumer adoption > a pretty spec… Later - ok for time to roll over… supporting always-on streams, OTT / Elemental
  14. Other things we did that seem wacky, were carefully designed
  15. notable constraint in the design of RTMP was the Web itself TCP, not UDP, not enough, beta testing, SSL, HTTP tunneling, such firewalls still exist This is a 2005 visualization of the Internet IP addresses — or an Internet map. It’s an example of data visualization for a network. Each line joins two IP addresses, with the length representing the delay between them. Less than 30% of reachable addresses were used to construct this Internet map, based on 2005 data (wikipedia via https://www.acculation.com/blog/2015/01/30/internet-map-network-data-visualization/)
  16. Prepping for the launch Kevin Lynch had an idea…
  17. Doug Engelbart who had built a platform with similar capabilities in 1968 “Mother of all Demos” — Valerie Liberty tracked him down and he agreed to join the launch I went down to Doug’s house in Atherton to set up Flash, Camera and Mic on his very old 386
  18. Video - Bill Paxton, later an early adobe engineer https://web.archive.org/web/20020719172146if_/http://www.impossibilities.com:80/blog/ff2002nyc/
  19. Doug joined Kevin on-stage — live via web video… https://web.archive.org/web/20020719172146if_/http://www.impossibilities.com:80/blog/ff2002nyc/
  20. launch: 30% By September > half by the end of the following year - 90%
  21. Phillip Kerman’s Stampede Stockyards was one of the first live data apps Live, online cattle auctions
  22. Redbull Reevolution – around 2005/2006 – Sync’d video to data and stats
  23. ZED uncut had people use their webcam to join a “wall’ of viewers was broadcast on live TV.
  24. Desperate Housewives….
  25. and Lost… Full Episode streaming transformed how we all we all watch television
  26. Adobe wins an Emmy for Flash Video in 2006… With the award for Streaming Media Architecture & Components National Academy of Television Arts and Sciences recognizes the software's pivotal role in bringing television content to the Internet.
  27. Between 2002 and 2007, Adobe created an ecosystem…. Flywheel effect… ~2010, open source and proprietary software filled each niche with diverse offerings, such that there’s no dependency on a single vendor
  28. 500M ip cameras…
  29. Challenges today
  30. SmartHome largest growth segment for IoT… appliances with video sensors expected to have huge growth today: smart refrigerator (3) —- Samsung Family Hub refrigerator https://www.bestbuy.com/site/samsung-technology/samsung-family-hub-refrigerator/pcmcat748301896069.c?id=pcmcat748301896069
  31. Thinking about the future of RTMP, maybe it looks something like this If you have any interest in talking about past, present or future of RTMP, come find me!
Advertisement