SlideShare a Scribd company logo
1 of 99
Mobile Movies with
                          HTTP Live Streaming
                             Chris Adamson • @invalidname
                                      CocoaConf
                             Aug 10, 2012 • Columbus, OH




                             Sides and code available on my blog:
                                http://www.subfurther.com/blog

Saturday, August 11, 12
So Many Streaming
                               Apps!




Saturday, August 11, 12
So Many Streaming
                               Apps!




Saturday, August 11, 12
Netflix




Saturday, August 11, 12
Flixter




Saturday, August 11, 12
ABC




Saturday, August 11, 12
PBS




Saturday, August 11, 12
NBC Olympics Live
                               Extra




Saturday, August 11, 12
DirecTV




Saturday, August 11, 12
UStream




Saturday, August 11, 12
Crunchyroll




Saturday, August 11, 12
TwitchTV




Saturday, August 11, 12
Oh, and it can be embedded
                      in the <video> tag




Saturday, August 11, 12
Sounds good? How
                          do I get in on that?




Saturday, August 11, 12
What You'll Learn

                 • What streaming is (and isn't)

                 • Setting up HLS on the server

                 • Using HLS streams in iOS apps

                 • Real-world deployment




Saturday, August 11, 12
HLS: What It Is (and
                                isn't)




Saturday, August 11, 12
Good Ol' Broadcast




Saturday, August 11, 12
Broadcast Media

                 • Always live on some channel (a band of EM
                   spectrum).

                 • Every client tuned to that channel sees the
                   same thing, at the same time.

                 • One-way, one-to-many model.




Saturday, August 11, 12
Internet
                 • Generally one-to-one (host to host).

                      • Multicast IP is an exception, but is rare on
                        the public Internet.

                 • Two-way communication over sockets.

                 • Routing can take many hops, via multiple
                   transport media (wire, wifi, cellular, etc.).


Saturday, August 11, 12
Impedence Mismatch!




Saturday, August 11, 12
Ye Olde Streaming
                 • Client makes socket connection and keeps it
                   open for duration of program.

                 • Server sends media at playback speed (plus
                   buffering).

                      • Shoutcast: MP3 files served slowly over HTTP.

                 • Typically use a special port number and
                   special server software.


Saturday, August 11, 12
Streaming Problems
                 • Difficult and expensive to scale.

                 • Special port numbers routinely blocked by
                   businesses, ISPs, firewalls, etc.

                 • Competing standards: Real Player, Windows
                   Media, QuickTime (all with their own plugins).

                          • No wonder Flash won.

                 • Good luck holding a socket connection on cellular.


Saturday, August 11, 12
What If…
                 • We didn't need an always-on socket
                   connection?

                 • We could just run over port 80?

                 • We could just adopt industry standards like H.
                   264 and AAC instead of cooking custom
                   codecs?



Saturday, August 11, 12
HTTP Live Streaming
                 • Serves media as a series of short flat files, via
                   HTTP, usually on port 80.

                 • Any web server will do.

                 • Client software reassembles the data into a
                   continuous media stream.

                 • Spec does not specify contents, but Apple uses
                   H.264 and AAC, just like all their media apps.


Saturday, August 11, 12
Serving up HLS


                 • Client URL is an .m3u8 playlist file

                 • Playlist points to the media segment files




Saturday, August 11, 12
Saturday, August 11, 12
The HLS playlist
      #EXTM3U
      #EXT-X-TARGETDURATION:10
      #EXT-X-VERSION:3
      #EXT-X-MEDIA-SEQUENCE:0
      #EXT-X-PLAYLIST-TYPE:VOD
      #EXTINF:9.975,!
      fileSequence0.ts
      #EXTINF:9.975,!
      fileSequence1.ts
      #EXTINF:9.975,!
      fileSequence2.ts
      #EXTINF:9.9767,!
      fileSequence3.ts
      #EXTINF:9.975,!

      [...]

      #EXT-X-ENDLIST

Saturday, August 11, 12
The HLS playlist
      #EXTM3U                       Format: .m3u8 format,
      #EXT-X-TARGETDURATION:10
      #EXT-X-VERSION:3
                                    just a list of files to play
      #EXT-X-MEDIA-SEQUENCE:0
      #EXT-X-PLAYLIST-TYPE:VOD
      #EXTINF:9.975,!
      fileSequence0.ts
      #EXTINF:9.975,!
      fileSequence1.ts
      #EXTINF:9.975,!
      fileSequence2.ts
      #EXTINF:9.9767,!
      fileSequence3.ts
      #EXTINF:9.975,!

      [...]

      #EXT-X-ENDLIST

Saturday, August 11, 12
The HLS playlist
      #EXTM3U                       Format: .m3u8 format,
      #EXT-X-TARGETDURATION:10
      #EXT-X-VERSION:3
                                    just a list of files to play
      #EXT-X-MEDIA-SEQUENCE:0
      #EXT-X-PLAYLIST-TYPE:VOD      Metadata tags describe
      #EXTINF:9.975,!
      fileSequence0.ts              the contents
      #EXTINF:9.975,!
      fileSequence1.ts
      #EXTINF:9.975,!
      fileSequence2.ts
      #EXTINF:9.9767,!
      fileSequence3.ts
      #EXTINF:9.975,!

      [...]

      #EXT-X-ENDLIST

Saturday, August 11, 12
The HLS playlist
      #EXTM3U                       Format: .m3u8 format,
      #EXT-X-TARGETDURATION:10
      #EXT-X-VERSION:3
                                    just a list of files to play
      #EXT-X-MEDIA-SEQUENCE:0
      #EXT-X-PLAYLIST-TYPE:VOD      Metadata tags describe
      #EXTINF:9.975,!
      fileSequence0.ts              the contents
      #EXTINF:9.975,!
      fileSequence1.ts
      #EXTINF:9.975,!               Each segment file
      fileSequence2.ts
      #EXTINF:9.9767,!
                                    preceded by metadata
      fileSequence3.ts              (e.g., duration)
      #EXTINF:9.975,!

      [...]

      #EXT-X-ENDLIST

Saturday, August 11, 12
The HLS playlist
      #EXTM3U                       Format: .m3u8 format,
      #EXT-X-TARGETDURATION:10
      #EXT-X-VERSION:3
                                    just a list of files to play
      #EXT-X-MEDIA-SEQUENCE:0
      #EXT-X-PLAYLIST-TYPE:VOD      Metadata tags describe
      #EXTINF:9.975,!
      fileSequence0.ts              the contents
      #EXTINF:9.975,!
      fileSequence1.ts
      #EXTINF:9.975,!               Each segment file
      fileSequence2.ts
      #EXTINF:9.9767,!
                                    preceded by metadata
      fileSequence3.ts              (e.g., duration)
      #EXTINF:9.975,!

      [...]                        If no end tag, client
      #EXT-X-ENDLIST               refreshes periodically
Saturday, August 11, 12
Web Demo




Saturday, August 11, 12
<video src="prog_index.m3u8" width="640" height="480"
                   controls autoplay>No video tag support</video>
Saturday, August 11, 12
How is this better than
                        a flat .m4v file?
                 • Streams can provide variants for different
                   bandwidths (as we’ll see…)

                 • Segments make it easier to scrub into the
                   video

                 • Streams can be live video




Saturday, August 11, 12
The “Live” in HLS
                 • A playlist is a live stream if it doesn’t have an
                   #EXT-X-ENDLIST tag

                 • Live playlist will generally just contain the last
                   minute or so of segments

                 • Client will refresh playlist every minute or so,
                   download whatever segments it doesn’t already
                   have, queue them locally

                 • “Live” isn’t really “live” (often a minute behind)

Saturday, August 11, 12
Serving up HLS




Saturday, August 11, 12
Saturday, August 11, 12
Saturday, August 11, 12
Saturday, August 11, 12
Saturday, August 11, 12
Saturday, August 11, 12
mediafilesegmenter
                 • Splits an A/V file into segment files, creates
                   the .m3u8 playlist

                 • Source must be .mov or .m4v with H.264 video,
                   AAC audio

                 • Output segments will be MPEG-2 Transport Stream
                   (.ts) files, or .aac if audio-only

                 • Segment paths are relative, use -b to prepend URL
                   stub


Saturday, August 11, 12
Technical Note TN2224
        The following audio and video formats are supported:

        • Video: H.264 Baseline Profile Level 3.0 (iPhone/iPod Touch),
          Main Profile Level 3.1 (iPad 1,2)

        • Audio: HE-AAC or AAC-LC up to 48 kHz, stereo audio OR
          MP3 (MPEG-1 Audio Layer 3) 8 kHz to 48 kHz, stereo audio

        Note: iPhone 3G supports Baseline Profile Level 3.1. If your
        app runs on older iPhones, however, you should use H.264
        Baseline Profile 3.0 for compatibility.


Saturday, August 11, 12
Yuna:HTTP Live Streaming tests cadamson$ mediafilesegmenter
             -f basic source/IMG_0251.MOV
             Jun 24 2012 10:01:24.203: Using floating point is not
             backward compatible to iOS 4.1 or earlier devices
             Jun 24 2012 10:01:24.204: Processing file /Users/cadamson/
             Documents/HTTP Live Streaming tests/source/IMG_0251.MOV
             Jun 24 2012 10:01:24.338: Finalized /Users/cadamson/
             Documents/HTTP Live Streaming tests/basic/fileSequence0.ts
             Jun 24 2012 10:01:24.375: segment bitrate 3.78028e+06 is
             new max
             Jun 24 2012 10:01:24.468: Finalized /Users/cadamson/
             Documents/HTTP Live Streaming tests/basic/fileSequence1.ts
             Jun 24 2012 10:01:24.554: Finalized /Users/cadamson/
             Documents/HTTP Live Streaming tests/basic/fileSequence2.ts
             Jun 24 2012 10:01:24.631: Finalized /Users/cadamson/
             Documents/HTTP Live Streaming tests/basic/fileSequence3.ts
             Jun 24 2012 10:01:24.717: Finalized /Users/cadamson/
             Documents/HTTP Live Streaming tests/basic/fileSequence4.ts




Saturday, August 11, 12
Demo




Saturday, August 11, 12
Variant Playlists
                 • One bitrate does not fit all: Mac on Ethernet
                   versus iPhone on Edge.

                 • Solution: encode your video at multiple bitrates,
                   offer metadata in playlist about what's
                   available, let client figure out which to use.

                 • HLS clients automatically switch to best variant
                   for current network conditions, switch on the fly.



Saturday, August 11, 12
variantplaylistcreator
                 • Creates a playlist that itself points to playlists
                   created with mediafilesegmenter.

                      • Each entry contains metadata describing the
                        bitrate and encoding of the variant.

                 • Tool takes argument pairs: file or URL of a
                   variant .m3u8, and metadata .plist created with
                   mediafilesegmenter -I flag

                 • First entry in variant playlist is default; client will try
                   this one first

Saturday, August 11, 12
Encoding the variants




Saturday, August 11, 12
TN2224
                          Recommendations




Saturday, August 11, 12
Creating variants
            Yuna:HTTP Live Streaming tests cadamson$
            mediafilesegmenter -I -f variants/
            broadband/ source/IMG_0254_Broadband.m4v

           Yuna:HTTP Live Streaming tests cadamson$
           mediafilesegmenter -I -f variants/wifi
           source/IMG_0254_WiFi.m4v

            Yuna:HTTP Live Streaming tests cadamson$
            mediafilesegmenter -I -f variants/
            cellular source/IMG_0254_Cellular.m4v


Saturday, August 11, 12
Creating variant playlist
          Yuna:HTTP Live Streaming tests cadamson$
          variantplaylistcreator -o variants/
          variants.m3u8 variants/broadband/
          prog_index.m3u8 source/
          IMG_0254_Broadband.plist variants/wifi/
          prog_index.m3u8 source/
          IMG_0254_WiFi.plist variants/cellular/
          prog_index.m3u8 source/
          IMG_0254_Cellular.plist



Saturday, August 11, 12
Demo




Saturday, August 11, 12
That's Great, but…
                          How do we keep people from stealing our stream?




Saturday, August 11, 12
Encryption
                 • HLS encrypts files, not transport.

                 • Easy to scale: still serving flat files, but now
                   they're useless without decryption keys.

                 • Serving the keys still needs to be secure.

                 • Necessary, but not sufficient, for DRM.



Saturday, August 11, 12
Encrypting a playlist
    Yuna:HTTP Live Streaming tests cadamson$ mediafilesegmenter -
    I -k keys -f encrypted/cellular source/IMG_0426_Cellular.m4v
    Jun 24 2012 18:59:47.115: Using new key/iv rotation period;
    this is not backward compatible to iOS 3.1.* or earlier
    devices.  Use the "-encrypt-iv=sequence" option for
    compatibility with those devices.
    Jun 24 2012 18:59:47.115: Using floating point is not
    backward compatible to iOS 4.1 or earlier devices
    Jun 24 2012 18:59:47.115: Processing file /Users/cadamson/
    Documents/HTTP Live Streaming tests/source/
    IMG_0426_Cellular.m4v
    Jun 24 2012 18:59:47.152: changing IV
    Jun 24 2012 18:59:47.160: Finalized /Users/cadamson/
    Documents/HTTP Live Streaming tests/encrypted/cellular/
    fileSequence0.ts
    Jun 24 2012 18:59:47.160: segment bitrate 271257 is new max


Saturday, August 11, 12
Encrypted .ts files




Saturday, August 11, 12
Encrypted .ts files




Saturday, August 11, 12
Encrypted .ts files




Saturday, August 11, 12
Encrypted .ts files




Saturday, August 11, 12
Protect those keys




                          /www/protected


                                           /www/hls



Saturday, August 11, 12
Demo




Saturday, August 11, 12
Live Streaming

                 • mediastreamsegmenter mostly works like the
                   file version, but takes its input from UDP
                   stream or a Unix pipe

                 • How the heck do you create a UDP A/V
                   stream?




Saturday, August 11, 12
VLC streams .ts/UDP




                          http://stackoverflow.com/questions/3846145
Saturday, August 11, 12
VLC streams .ts/UDP

      mediastreamsegmenter -s 3 -D -f /Library/
      WebServer/Documents/httplivestreaming/live
      127.0.0.1:1234




                          http://stackoverflow.com/questions/3846145
Saturday, August 11, 12
Demo (Or Not)




Saturday, August 11, 12
Client-side HLS




Saturday, August 11, 12
Opening an HLS
                             stream

                 • Provide the .m3u8 URL to
                   MPMoviePlayerController or AVPlayer

                 • Add the movie view or layer to your UI,
                   customizing size or scaling if necessary




Saturday, August 11, 12
MPMoviePlayerController

   // create new movie player
   self.moviePlayer = [[MPMoviePlayerController alloc]
   ! ! ! ! ! ! ! ! initWithContentURL:streamURL];
   [self.moviePlayer prepareToPlay];
   [self.moviePlayer.view setFrame:
   ! ! ! ! ! ! ! self.movieContainerView.bounds];
   [self.movieContainerView addSubview:
   ! ! ! ! ! ! ! ! self.moviePlayer.view];
   self.moviePlayer.scalingMode =
   ! ! ! ! ! ! ! ! MPMovieScalingModeFill;




Saturday, August 11, 12
MPMovieScalingMode
                         AspectFit




Saturday, August 11, 12
MPMovieScalingMode
                         AspectFill




Saturday, August 11, 12
MPMovieScalingMode 
                            Fill




Saturday, August 11, 12
Accessing Encrypted
                               Streams
                 • Media Player and AV Foundation can use
                   NSURLCredentials that you've provided

                 • Place credentials in NSURLCredentialStorage

                 • Server can provide the keys securely(*) with
                   HTTP Basic or Digest authentication, an
                   HTTPS script, etc.

                            * - For various values of "secure"

Saturday, August 11, 12
Setting credentials (1)

       NSURLProtectionSpace *protectionSpace =
       ! [[NSURLProtectionSpace alloc]
       ! ! initWithHost:host
       ! ! port:port
       ! ! protocol:protocol
       ! ! realm:realm
       ! ! authenticationMethod:
       ! ! ! NSURLAuthenticationMethodDefault];




Saturday, August 11, 12
Setting credentials (2)

          NSURLCredential *credential =
          ! [NSURLCredential credentialWithUser:username
          ! ! ! ! ! ! ! ! !         password:password
          ! ! ! ! ! ! ! ! ! ! ! persistence:
          ! ! ! NSURLCredentialPersistenceForSession];

          [[NSURLCredentialStorage
          ! sharedCredentialStorage]
          ! ! setDefaultCredential:credential
          ! !    forProtectionSpace:protectionSpace];



Saturday, August 11, 12
Streaming in the Real
                            World
                          It's not all about iPhones…




Saturday, August 11, 12
Streaming Clients
                 • Mobile Devices: iPhone, iPad, iPod Touch…
                   plus Android, Windows Mobile, etc.

                 • Mac and Windows PCs

                 • Over-the-top (OTT) boxes: Apple TV, Roku

                 • Game consoles



Saturday, August 11, 12
Let's Get Practical

                 • What devices do you have to be on?

                 • What devices will you get for free?

                 • How to encode and deliver to the devices you
                   need?




Saturday, August 11, 12
HLS Alternatives
                 • Flash still rules on the desktop/browser
                   space, thanks in part to Mozilla's obstinance
                   about H.264 in <video> (irony alert: H.264 is
                   the de facto standard for Flash video)

                 • Adobe Dynamic Streaming and Microsoft
                   Smooth Streaming are highly similar to HLS:
                   bitrate-adaptive streams over HTTP



Saturday, August 11, 12
MPEG-DASH
                 • Attempt at a standardized approach to HTTP
                   adaptive-bitrate streaming. ISO/IEC 23009-1.




                              http://xkcd.com/927/
Saturday, August 11, 12
Emerging Consensus

                 • Flash for PCs

                 • HTTP Live Streaming for iOS

                 • Plus whatever other devices you need to
                   support




Saturday, August 11, 12
Real-World HLS

                 • Can you competently encode all your media
                   at all the variant bitrates you need?

                 • Do you have a way to QC all your streams?

                 • Can you handle the server load?




Saturday, August 11, 12
Content Delivery
                             Networks




         http://en.wikipedia.org/wiki/Content_delivery_network
Saturday, August 11, 12
Content Delivery
                             Networks
                 • CDNs host your media on edge servers that are
                   closer to your clients. Less strain on your
                   servers and the backbones.

                 • Examples: Akamai, Limelight, EdgeCast

                 • Big media companies may have their own CDN

                 • Most already know how to do HLS



Saturday, August 11, 12
Buy or Build




Saturday, August 11, 12
Outsourcing HLS




                          Ads from "Streaming Media" June/July 2012
Saturday, August 11, 12
Outsourcing HLS




                          Ads from "Streaming Media" June/July 2012
Saturday, August 11, 12
Outsourcing HLS




                          Ads from "Streaming Media" June/July 2012
Saturday, August 11, 12
Outsourcing HLS




                          Ads from "Streaming Media" June/July 2012
Saturday, August 11, 12
Outsourcing HLS




                          Ads from "Streaming Media" June/July 2012
Saturday, August 11, 12
Outsourcing HLS




                          Ads from "Streaming Media" June/July 2012
Saturday, August 11, 12
Outsourcing HLS




                          Ads from "Streaming Media" June/July 2012
Saturday, August 11, 12
Outsourcing HLS




                          Ads from "Streaming Media" June/July 2012
Saturday, August 11, 12
Outsourcing HLS




                          Ads from "Streaming Media" June/July 2012
Saturday, August 11, 12
Outsourcing HLS




                          Ads from "Streaming Media" June/July 2012
Saturday, August 11, 12
Outsourcing HLS




                          Ads from "Streaming Media" June/July 2012
Saturday, August 11, 12
Outsourcing HLS




                          Ads from "Streaming Media" June/July 2012
Saturday, August 11, 12
Outsourcing HLS




                          Ads from "Streaming Media" June/July 2012
Saturday, August 11, 12
Takeaways
                 • HLS is a very practical streaming solution

                 • Only part of the picture if you're multi-platform

                 • Encoding and serving correctly requires some
                   care and expertise

                 • Client-side software requirements are fairly
                   simple


Saturday, August 11, 12
Q&A
                          Slides and code will be available on my blog:
                                  http://www.subfurther.com/blog
                              http://www.slideshare.net/invalidname

                                         @invalidname




Saturday, August 11, 12

More Related Content

More from Chris Adamson

Building A Streaming Apple TV App (CocoaConf San Jose, Nov 2016)
Building A Streaming Apple TV App (CocoaConf San Jose, Nov 2016)Building A Streaming Apple TV App (CocoaConf San Jose, Nov 2016)
Building A Streaming Apple TV App (CocoaConf San Jose, Nov 2016)Chris Adamson
 
Firebase: Totally Not Parse All Over Again (Unless It Is)
Firebase: Totally Not Parse All Over Again (Unless It Is)Firebase: Totally Not Parse All Over Again (Unless It Is)
Firebase: Totally Not Parse All Over Again (Unless It Is)Chris Adamson
 
Building A Streaming Apple TV App (CocoaConf DC, Sept 2016)
Building A Streaming Apple TV App (CocoaConf DC, Sept 2016)Building A Streaming Apple TV App (CocoaConf DC, Sept 2016)
Building A Streaming Apple TV App (CocoaConf DC, Sept 2016)Chris Adamson
 
Video Killed the Rolex Star (CocoaConf San Jose, November, 2015)
Video Killed the Rolex Star (CocoaConf San Jose, November, 2015)Video Killed the Rolex Star (CocoaConf San Jose, November, 2015)
Video Killed the Rolex Star (CocoaConf San Jose, November, 2015)Chris Adamson
 
Video Killed the Rolex Star (CocoaConf Columbus, July 2015)
Video Killed the Rolex Star (CocoaConf Columbus, July 2015)Video Killed the Rolex Star (CocoaConf Columbus, July 2015)
Video Killed the Rolex Star (CocoaConf Columbus, July 2015)Chris Adamson
 
Revenge of the 80s: Cut/Copy/Paste, Undo/Redo, and More Big Hits (CocoaConf C...
Revenge of the 80s: Cut/Copy/Paste, Undo/Redo, and More Big Hits (CocoaConf C...Revenge of the 80s: Cut/Copy/Paste, Undo/Redo, and More Big Hits (CocoaConf C...
Revenge of the 80s: Cut/Copy/Paste, Undo/Redo, and More Big Hits (CocoaConf C...Chris Adamson
 
Core Image: The Most Fun API You're Not Using, CocoaConf Atlanta, December 2014
Core Image: The Most Fun API You're Not Using, CocoaConf Atlanta, December 2014Core Image: The Most Fun API You're Not Using, CocoaConf Atlanta, December 2014
Core Image: The Most Fun API You're Not Using, CocoaConf Atlanta, December 2014Chris Adamson
 
Stupid Video Tricks, CocoaConf Seattle 2014
Stupid Video Tricks, CocoaConf Seattle 2014Stupid Video Tricks, CocoaConf Seattle 2014
Stupid Video Tricks, CocoaConf Seattle 2014Chris Adamson
 
Stupid Video Tricks, CocoaConf Las Vegas
Stupid Video Tricks, CocoaConf Las VegasStupid Video Tricks, CocoaConf Las Vegas
Stupid Video Tricks, CocoaConf Las VegasChris Adamson
 
Core Image: The Most Fun API You're Not Using (CocoaConf Columbus 2014)
Core Image: The Most Fun API You're Not Using (CocoaConf Columbus 2014)Core Image: The Most Fun API You're Not Using (CocoaConf Columbus 2014)
Core Image: The Most Fun API You're Not Using (CocoaConf Columbus 2014)Chris Adamson
 
Stupid Video Tricks (CocoaConf DC, March 2014)
Stupid Video Tricks (CocoaConf DC, March 2014)Stupid Video Tricks (CocoaConf DC, March 2014)
Stupid Video Tricks (CocoaConf DC, March 2014)Chris Adamson
 
Introduction to the Roku SDK
Introduction to the Roku SDKIntroduction to the Roku SDK
Introduction to the Roku SDKChris Adamson
 
Get On The Audiobus (CocoaConf Atlanta, November 2013)
Get On The Audiobus (CocoaConf Atlanta, November 2013)Get On The Audiobus (CocoaConf Atlanta, November 2013)
Get On The Audiobus (CocoaConf Atlanta, November 2013)Chris Adamson
 
Get On The Audiobus (CocoaConf Boston, October 2013)
Get On The Audiobus (CocoaConf Boston, October 2013)Get On The Audiobus (CocoaConf Boston, October 2013)
Get On The Audiobus (CocoaConf Boston, October 2013)Chris Adamson
 
Glitch-Free A/V Encoding (CocoaConf Boston, October 2013)
Glitch-Free A/V Encoding (CocoaConf Boston, October 2013)Glitch-Free A/V Encoding (CocoaConf Boston, October 2013)
Glitch-Free A/V Encoding (CocoaConf Boston, October 2013)Chris Adamson
 
iOS Media APIs (MobiDevDay Detroit, May 2013)
iOS Media APIs (MobiDevDay Detroit, May 2013)iOS Media APIs (MobiDevDay Detroit, May 2013)
iOS Media APIs (MobiDevDay Detroit, May 2013)Chris Adamson
 
Core Audio in iOS 6 (CocoaConf San Jose, April 2013)
Core Audio in iOS 6 (CocoaConf San Jose, April 2013) Core Audio in iOS 6 (CocoaConf San Jose, April 2013)
Core Audio in iOS 6 (CocoaConf San Jose, April 2013) Chris Adamson
 
Core Audio in iOS 6 (CocoaConf DC, March 2013)
Core Audio in iOS 6 (CocoaConf DC, March 2013)Core Audio in iOS 6 (CocoaConf DC, March 2013)
Core Audio in iOS 6 (CocoaConf DC, March 2013)Chris Adamson
 
Mobile Movies with HTTP Live Streaming (CocoaConf DC, March 2013)
Mobile Movies with HTTP Live Streaming (CocoaConf DC, March 2013)Mobile Movies with HTTP Live Streaming (CocoaConf DC, March 2013)
Mobile Movies with HTTP Live Streaming (CocoaConf DC, March 2013)Chris Adamson
 

More from Chris Adamson (20)

Building A Streaming Apple TV App (CocoaConf San Jose, Nov 2016)
Building A Streaming Apple TV App (CocoaConf San Jose, Nov 2016)Building A Streaming Apple TV App (CocoaConf San Jose, Nov 2016)
Building A Streaming Apple TV App (CocoaConf San Jose, Nov 2016)
 
Firebase: Totally Not Parse All Over Again (Unless It Is)
Firebase: Totally Not Parse All Over Again (Unless It Is)Firebase: Totally Not Parse All Over Again (Unless It Is)
Firebase: Totally Not Parse All Over Again (Unless It Is)
 
Building A Streaming Apple TV App (CocoaConf DC, Sept 2016)
Building A Streaming Apple TV App (CocoaConf DC, Sept 2016)Building A Streaming Apple TV App (CocoaConf DC, Sept 2016)
Building A Streaming Apple TV App (CocoaConf DC, Sept 2016)
 
Video Killed the Rolex Star (CocoaConf San Jose, November, 2015)
Video Killed the Rolex Star (CocoaConf San Jose, November, 2015)Video Killed the Rolex Star (CocoaConf San Jose, November, 2015)
Video Killed the Rolex Star (CocoaConf San Jose, November, 2015)
 
Video Killed the Rolex Star (CocoaConf Columbus, July 2015)
Video Killed the Rolex Star (CocoaConf Columbus, July 2015)Video Killed the Rolex Star (CocoaConf Columbus, July 2015)
Video Killed the Rolex Star (CocoaConf Columbus, July 2015)
 
Revenge of the 80s: Cut/Copy/Paste, Undo/Redo, and More Big Hits (CocoaConf C...
Revenge of the 80s: Cut/Copy/Paste, Undo/Redo, and More Big Hits (CocoaConf C...Revenge of the 80s: Cut/Copy/Paste, Undo/Redo, and More Big Hits (CocoaConf C...
Revenge of the 80s: Cut/Copy/Paste, Undo/Redo, and More Big Hits (CocoaConf C...
 
Core Image: The Most Fun API You're Not Using, CocoaConf Atlanta, December 2014
Core Image: The Most Fun API You're Not Using, CocoaConf Atlanta, December 2014Core Image: The Most Fun API You're Not Using, CocoaConf Atlanta, December 2014
Core Image: The Most Fun API You're Not Using, CocoaConf Atlanta, December 2014
 
Stupid Video Tricks, CocoaConf Seattle 2014
Stupid Video Tricks, CocoaConf Seattle 2014Stupid Video Tricks, CocoaConf Seattle 2014
Stupid Video Tricks, CocoaConf Seattle 2014
 
Stupid Video Tricks, CocoaConf Las Vegas
Stupid Video Tricks, CocoaConf Las VegasStupid Video Tricks, CocoaConf Las Vegas
Stupid Video Tricks, CocoaConf Las Vegas
 
Core Image: The Most Fun API You're Not Using (CocoaConf Columbus 2014)
Core Image: The Most Fun API You're Not Using (CocoaConf Columbus 2014)Core Image: The Most Fun API You're Not Using (CocoaConf Columbus 2014)
Core Image: The Most Fun API You're Not Using (CocoaConf Columbus 2014)
 
Stupid Video Tricks (CocoaConf DC, March 2014)
Stupid Video Tricks (CocoaConf DC, March 2014)Stupid Video Tricks (CocoaConf DC, March 2014)
Stupid Video Tricks (CocoaConf DC, March 2014)
 
Stupid Video Tricks
Stupid Video TricksStupid Video Tricks
Stupid Video Tricks
 
Introduction to the Roku SDK
Introduction to the Roku SDKIntroduction to the Roku SDK
Introduction to the Roku SDK
 
Get On The Audiobus (CocoaConf Atlanta, November 2013)
Get On The Audiobus (CocoaConf Atlanta, November 2013)Get On The Audiobus (CocoaConf Atlanta, November 2013)
Get On The Audiobus (CocoaConf Atlanta, November 2013)
 
Get On The Audiobus (CocoaConf Boston, October 2013)
Get On The Audiobus (CocoaConf Boston, October 2013)Get On The Audiobus (CocoaConf Boston, October 2013)
Get On The Audiobus (CocoaConf Boston, October 2013)
 
Glitch-Free A/V Encoding (CocoaConf Boston, October 2013)
Glitch-Free A/V Encoding (CocoaConf Boston, October 2013)Glitch-Free A/V Encoding (CocoaConf Boston, October 2013)
Glitch-Free A/V Encoding (CocoaConf Boston, October 2013)
 
iOS Media APIs (MobiDevDay Detroit, May 2013)
iOS Media APIs (MobiDevDay Detroit, May 2013)iOS Media APIs (MobiDevDay Detroit, May 2013)
iOS Media APIs (MobiDevDay Detroit, May 2013)
 
Core Audio in iOS 6 (CocoaConf San Jose, April 2013)
Core Audio in iOS 6 (CocoaConf San Jose, April 2013) Core Audio in iOS 6 (CocoaConf San Jose, April 2013)
Core Audio in iOS 6 (CocoaConf San Jose, April 2013)
 
Core Audio in iOS 6 (CocoaConf DC, March 2013)
Core Audio in iOS 6 (CocoaConf DC, March 2013)Core Audio in iOS 6 (CocoaConf DC, March 2013)
Core Audio in iOS 6 (CocoaConf DC, March 2013)
 
Mobile Movies with HTTP Live Streaming (CocoaConf DC, March 2013)
Mobile Movies with HTTP Live Streaming (CocoaConf DC, March 2013)Mobile Movies with HTTP Live Streaming (CocoaConf DC, March 2013)
Mobile Movies with HTTP Live Streaming (CocoaConf DC, March 2013)
 

Recently uploaded

Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXTarek Kalaji
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 
Governance in SharePoint Premium:What's in the box?
Governance in SharePoint Premium:What's in the box?Governance in SharePoint Premium:What's in the box?
Governance in SharePoint Premium:What's in the box?Juan Carlos Gonzalez
 
UiPath Clipboard AI: "A TIME Magazine Best Invention of 2023 Unveiled"
UiPath Clipboard AI: "A TIME Magazine Best Invention of 2023 Unveiled"UiPath Clipboard AI: "A TIME Magazine Best Invention of 2023 Unveiled"
UiPath Clipboard AI: "A TIME Magazine Best Invention of 2023 Unveiled"DianaGray10
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationIES VE
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...Daniel Zivkovic
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-pyJamie (Taka) Wang
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfJamie (Taka) Wang
 
UiPath Studio Web workshop series - Day 5
UiPath Studio Web workshop series - Day 5UiPath Studio Web workshop series - Day 5
UiPath Studio Web workshop series - Day 5DianaGray10
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 

Recently uploaded (20)

Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBX
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 
Governance in SharePoint Premium:What's in the box?
Governance in SharePoint Premium:What's in the box?Governance in SharePoint Premium:What's in the box?
Governance in SharePoint Premium:What's in the box?
 
UiPath Clipboard AI: "A TIME Magazine Best Invention of 2023 Unveiled"
UiPath Clipboard AI: "A TIME Magazine Best Invention of 2023 Unveiled"UiPath Clipboard AI: "A TIME Magazine Best Invention of 2023 Unveiled"
UiPath Clipboard AI: "A TIME Magazine Best Invention of 2023 Unveiled"
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-py
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
 
UiPath Studio Web workshop series - Day 5
UiPath Studio Web workshop series - Day 5UiPath Studio Web workshop series - Day 5
UiPath Studio Web workshop series - Day 5
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 

Mobile Movies with HTTP Live Streaming (CocoaConf Columbus, Aug '12)

  • 1. Mobile Movies with HTTP Live Streaming Chris Adamson • @invalidname CocoaConf Aug 10, 2012 • Columbus, OH Sides and code available on my blog: http://www.subfurther.com/blog Saturday, August 11, 12
  • 2. So Many Streaming Apps! Saturday, August 11, 12
  • 3. So Many Streaming Apps! Saturday, August 11, 12
  • 8. NBC Olympics Live Extra Saturday, August 11, 12
  • 13. Oh, and it can be embedded in the <video> tag Saturday, August 11, 12
  • 14. Sounds good? How do I get in on that? Saturday, August 11, 12
  • 15. What You'll Learn • What streaming is (and isn't) • Setting up HLS on the server • Using HLS streams in iOS apps • Real-world deployment Saturday, August 11, 12
  • 16. HLS: What It Is (and isn't) Saturday, August 11, 12
  • 18. Broadcast Media • Always live on some channel (a band of EM spectrum). • Every client tuned to that channel sees the same thing, at the same time. • One-way, one-to-many model. Saturday, August 11, 12
  • 19. Internet • Generally one-to-one (host to host). • Multicast IP is an exception, but is rare on the public Internet. • Two-way communication over sockets. • Routing can take many hops, via multiple transport media (wire, wifi, cellular, etc.). Saturday, August 11, 12
  • 21. Ye Olde Streaming • Client makes socket connection and keeps it open for duration of program. • Server sends media at playback speed (plus buffering). • Shoutcast: MP3 files served slowly over HTTP. • Typically use a special port number and special server software. Saturday, August 11, 12
  • 22. Streaming Problems • Difficult and expensive to scale. • Special port numbers routinely blocked by businesses, ISPs, firewalls, etc. • Competing standards: Real Player, Windows Media, QuickTime (all with their own plugins). • No wonder Flash won. • Good luck holding a socket connection on cellular. Saturday, August 11, 12
  • 23. What If… • We didn't need an always-on socket connection? • We could just run over port 80? • We could just adopt industry standards like H. 264 and AAC instead of cooking custom codecs? Saturday, August 11, 12
  • 24. HTTP Live Streaming • Serves media as a series of short flat files, via HTTP, usually on port 80. • Any web server will do. • Client software reassembles the data into a continuous media stream. • Spec does not specify contents, but Apple uses H.264 and AAC, just like all their media apps. Saturday, August 11, 12
  • 25. Serving up HLS • Client URL is an .m3u8 playlist file • Playlist points to the media segment files Saturday, August 11, 12
  • 27. The HLS playlist #EXTM3U #EXT-X-TARGETDURATION:10 #EXT-X-VERSION:3 #EXT-X-MEDIA-SEQUENCE:0 #EXT-X-PLAYLIST-TYPE:VOD #EXTINF:9.975,! fileSequence0.ts #EXTINF:9.975,! fileSequence1.ts #EXTINF:9.975,! fileSequence2.ts #EXTINF:9.9767,! fileSequence3.ts #EXTINF:9.975,! [...] #EXT-X-ENDLIST Saturday, August 11, 12
  • 28. The HLS playlist #EXTM3U Format: .m3u8 format, #EXT-X-TARGETDURATION:10 #EXT-X-VERSION:3 just a list of files to play #EXT-X-MEDIA-SEQUENCE:0 #EXT-X-PLAYLIST-TYPE:VOD #EXTINF:9.975,! fileSequence0.ts #EXTINF:9.975,! fileSequence1.ts #EXTINF:9.975,! fileSequence2.ts #EXTINF:9.9767,! fileSequence3.ts #EXTINF:9.975,! [...] #EXT-X-ENDLIST Saturday, August 11, 12
  • 29. The HLS playlist #EXTM3U Format: .m3u8 format, #EXT-X-TARGETDURATION:10 #EXT-X-VERSION:3 just a list of files to play #EXT-X-MEDIA-SEQUENCE:0 #EXT-X-PLAYLIST-TYPE:VOD Metadata tags describe #EXTINF:9.975,! fileSequence0.ts the contents #EXTINF:9.975,! fileSequence1.ts #EXTINF:9.975,! fileSequence2.ts #EXTINF:9.9767,! fileSequence3.ts #EXTINF:9.975,! [...] #EXT-X-ENDLIST Saturday, August 11, 12
  • 30. The HLS playlist #EXTM3U Format: .m3u8 format, #EXT-X-TARGETDURATION:10 #EXT-X-VERSION:3 just a list of files to play #EXT-X-MEDIA-SEQUENCE:0 #EXT-X-PLAYLIST-TYPE:VOD Metadata tags describe #EXTINF:9.975,! fileSequence0.ts the contents #EXTINF:9.975,! fileSequence1.ts #EXTINF:9.975,! Each segment file fileSequence2.ts #EXTINF:9.9767,! preceded by metadata fileSequence3.ts (e.g., duration) #EXTINF:9.975,! [...] #EXT-X-ENDLIST Saturday, August 11, 12
  • 31. The HLS playlist #EXTM3U Format: .m3u8 format, #EXT-X-TARGETDURATION:10 #EXT-X-VERSION:3 just a list of files to play #EXT-X-MEDIA-SEQUENCE:0 #EXT-X-PLAYLIST-TYPE:VOD Metadata tags describe #EXTINF:9.975,! fileSequence0.ts the contents #EXTINF:9.975,! fileSequence1.ts #EXTINF:9.975,! Each segment file fileSequence2.ts #EXTINF:9.9767,! preceded by metadata fileSequence3.ts (e.g., duration) #EXTINF:9.975,! [...] If no end tag, client #EXT-X-ENDLIST refreshes periodically Saturday, August 11, 12
  • 33. <video src="prog_index.m3u8" width="640" height="480" controls autoplay>No video tag support</video> Saturday, August 11, 12
  • 34. How is this better than a flat .m4v file? • Streams can provide variants for different bandwidths (as we’ll see…) • Segments make it easier to scrub into the video • Streams can be live video Saturday, August 11, 12
  • 35. The “Live” in HLS • A playlist is a live stream if it doesn’t have an #EXT-X-ENDLIST tag • Live playlist will generally just contain the last minute or so of segments • Client will refresh playlist every minute or so, download whatever segments it doesn’t already have, queue them locally • “Live” isn’t really “live” (often a minute behind) Saturday, August 11, 12
  • 36. Serving up HLS Saturday, August 11, 12
  • 42. mediafilesegmenter • Splits an A/V file into segment files, creates the .m3u8 playlist • Source must be .mov or .m4v with H.264 video, AAC audio • Output segments will be MPEG-2 Transport Stream (.ts) files, or .aac if audio-only • Segment paths are relative, use -b to prepend URL stub Saturday, August 11, 12
  • 43. Technical Note TN2224 The following audio and video formats are supported: • Video: H.264 Baseline Profile Level 3.0 (iPhone/iPod Touch), Main Profile Level 3.1 (iPad 1,2) • Audio: HE-AAC or AAC-LC up to 48 kHz, stereo audio OR MP3 (MPEG-1 Audio Layer 3) 8 kHz to 48 kHz, stereo audio Note: iPhone 3G supports Baseline Profile Level 3.1. If your app runs on older iPhones, however, you should use H.264 Baseline Profile 3.0 for compatibility. Saturday, August 11, 12
  • 44. Yuna:HTTP Live Streaming tests cadamson$ mediafilesegmenter -f basic source/IMG_0251.MOV Jun 24 2012 10:01:24.203: Using floating point is not backward compatible to iOS 4.1 or earlier devices Jun 24 2012 10:01:24.204: Processing file /Users/cadamson/ Documents/HTTP Live Streaming tests/source/IMG_0251.MOV Jun 24 2012 10:01:24.338: Finalized /Users/cadamson/ Documents/HTTP Live Streaming tests/basic/fileSequence0.ts Jun 24 2012 10:01:24.375: segment bitrate 3.78028e+06 is new max Jun 24 2012 10:01:24.468: Finalized /Users/cadamson/ Documents/HTTP Live Streaming tests/basic/fileSequence1.ts Jun 24 2012 10:01:24.554: Finalized /Users/cadamson/ Documents/HTTP Live Streaming tests/basic/fileSequence2.ts Jun 24 2012 10:01:24.631: Finalized /Users/cadamson/ Documents/HTTP Live Streaming tests/basic/fileSequence3.ts Jun 24 2012 10:01:24.717: Finalized /Users/cadamson/ Documents/HTTP Live Streaming tests/basic/fileSequence4.ts Saturday, August 11, 12
  • 46. Variant Playlists • One bitrate does not fit all: Mac on Ethernet versus iPhone on Edge. • Solution: encode your video at multiple bitrates, offer metadata in playlist about what's available, let client figure out which to use. • HLS clients automatically switch to best variant for current network conditions, switch on the fly. Saturday, August 11, 12
  • 47. variantplaylistcreator • Creates a playlist that itself points to playlists created with mediafilesegmenter. • Each entry contains metadata describing the bitrate and encoding of the variant. • Tool takes argument pairs: file or URL of a variant .m3u8, and metadata .plist created with mediafilesegmenter -I flag • First entry in variant playlist is default; client will try this one first Saturday, August 11, 12
  • 49. TN2224 Recommendations Saturday, August 11, 12
  • 50. Creating variants Yuna:HTTP Live Streaming tests cadamson$ mediafilesegmenter -I -f variants/ broadband/ source/IMG_0254_Broadband.m4v Yuna:HTTP Live Streaming tests cadamson$ mediafilesegmenter -I -f variants/wifi source/IMG_0254_WiFi.m4v Yuna:HTTP Live Streaming tests cadamson$ mediafilesegmenter -I -f variants/ cellular source/IMG_0254_Cellular.m4v Saturday, August 11, 12
  • 51. Creating variant playlist Yuna:HTTP Live Streaming tests cadamson$ variantplaylistcreator -o variants/ variants.m3u8 variants/broadband/ prog_index.m3u8 source/ IMG_0254_Broadband.plist variants/wifi/ prog_index.m3u8 source/ IMG_0254_WiFi.plist variants/cellular/ prog_index.m3u8 source/ IMG_0254_Cellular.plist Saturday, August 11, 12
  • 53. That's Great, but… How do we keep people from stealing our stream? Saturday, August 11, 12
  • 54. Encryption • HLS encrypts files, not transport. • Easy to scale: still serving flat files, but now they're useless without decryption keys. • Serving the keys still needs to be secure. • Necessary, but not sufficient, for DRM. Saturday, August 11, 12
  • 55. Encrypting a playlist Yuna:HTTP Live Streaming tests cadamson$ mediafilesegmenter - I -k keys -f encrypted/cellular source/IMG_0426_Cellular.m4v Jun 24 2012 18:59:47.115: Using new key/iv rotation period; this is not backward compatible to iOS 3.1.* or earlier devices.  Use the "-encrypt-iv=sequence" option for compatibility with those devices. Jun 24 2012 18:59:47.115: Using floating point is not backward compatible to iOS 4.1 or earlier devices Jun 24 2012 18:59:47.115: Processing file /Users/cadamson/ Documents/HTTP Live Streaming tests/source/ IMG_0426_Cellular.m4v Jun 24 2012 18:59:47.152: changing IV Jun 24 2012 18:59:47.160: Finalized /Users/cadamson/ Documents/HTTP Live Streaming tests/encrypted/cellular/ fileSequence0.ts Jun 24 2012 18:59:47.160: segment bitrate 271257 is new max Saturday, August 11, 12
  • 60. Protect those keys /www/protected /www/hls Saturday, August 11, 12
  • 62. Live Streaming • mediastreamsegmenter mostly works like the file version, but takes its input from UDP stream or a Unix pipe • How the heck do you create a UDP A/V stream? Saturday, August 11, 12
  • 63. VLC streams .ts/UDP http://stackoverflow.com/questions/3846145 Saturday, August 11, 12
  • 64. VLC streams .ts/UDP mediastreamsegmenter -s 3 -D -f /Library/ WebServer/Documents/httplivestreaming/live 127.0.0.1:1234 http://stackoverflow.com/questions/3846145 Saturday, August 11, 12
  • 65. Demo (Or Not) Saturday, August 11, 12
  • 67. Opening an HLS stream • Provide the .m3u8 URL to MPMoviePlayerController or AVPlayer • Add the movie view or layer to your UI, customizing size or scaling if necessary Saturday, August 11, 12
  • 68. MPMoviePlayerController // create new movie player self.moviePlayer = [[MPMoviePlayerController alloc] ! ! ! ! ! ! ! ! initWithContentURL:streamURL]; [self.moviePlayer prepareToPlay]; [self.moviePlayer.view setFrame: ! ! ! ! ! ! ! self.movieContainerView.bounds]; [self.movieContainerView addSubview: ! ! ! ! ! ! ! ! self.moviePlayer.view]; self.moviePlayer.scalingMode = ! ! ! ! ! ! ! ! MPMovieScalingModeFill; Saturday, August 11, 12
  • 69. MPMovieScalingMode AspectFit Saturday, August 11, 12
  • 70. MPMovieScalingMode AspectFill Saturday, August 11, 12
  • 71. MPMovieScalingMode  Fill Saturday, August 11, 12
  • 72. Accessing Encrypted Streams • Media Player and AV Foundation can use NSURLCredentials that you've provided • Place credentials in NSURLCredentialStorage • Server can provide the keys securely(*) with HTTP Basic or Digest authentication, an HTTPS script, etc. * - For various values of "secure" Saturday, August 11, 12
  • 73. Setting credentials (1) NSURLProtectionSpace *protectionSpace = ! [[NSURLProtectionSpace alloc] ! ! initWithHost:host ! ! port:port ! ! protocol:protocol ! ! realm:realm ! ! authenticationMethod: ! ! ! NSURLAuthenticationMethodDefault]; Saturday, August 11, 12
  • 74. Setting credentials (2) NSURLCredential *credential = ! [NSURLCredential credentialWithUser:username ! ! ! ! ! ! ! ! !         password:password ! ! ! ! ! ! ! ! ! ! ! persistence: ! ! ! NSURLCredentialPersistenceForSession]; [[NSURLCredentialStorage ! sharedCredentialStorage] ! ! setDefaultCredential:credential ! ! forProtectionSpace:protectionSpace]; Saturday, August 11, 12
  • 75. Streaming in the Real World It's not all about iPhones… Saturday, August 11, 12
  • 76. Streaming Clients • Mobile Devices: iPhone, iPad, iPod Touch… plus Android, Windows Mobile, etc. • Mac and Windows PCs • Over-the-top (OTT) boxes: Apple TV, Roku • Game consoles Saturday, August 11, 12
  • 77. Let's Get Practical • What devices do you have to be on? • What devices will you get for free? • How to encode and deliver to the devices you need? Saturday, August 11, 12
  • 78. HLS Alternatives • Flash still rules on the desktop/browser space, thanks in part to Mozilla's obstinance about H.264 in <video> (irony alert: H.264 is the de facto standard for Flash video) • Adobe Dynamic Streaming and Microsoft Smooth Streaming are highly similar to HLS: bitrate-adaptive streams over HTTP Saturday, August 11, 12
  • 79. MPEG-DASH • Attempt at a standardized approach to HTTP adaptive-bitrate streaming. ISO/IEC 23009-1. http://xkcd.com/927/ Saturday, August 11, 12
  • 80. Emerging Consensus • Flash for PCs • HTTP Live Streaming for iOS • Plus whatever other devices you need to support Saturday, August 11, 12
  • 81. Real-World HLS • Can you competently encode all your media at all the variant bitrates you need? • Do you have a way to QC all your streams? • Can you handle the server load? Saturday, August 11, 12
  • 82. Content Delivery Networks http://en.wikipedia.org/wiki/Content_delivery_network Saturday, August 11, 12
  • 83. Content Delivery Networks • CDNs host your media on edge servers that are closer to your clients. Less strain on your servers and the backbones. • Examples: Akamai, Limelight, EdgeCast • Big media companies may have their own CDN • Most already know how to do HLS Saturday, August 11, 12
  • 84. Buy or Build Saturday, August 11, 12
  • 85. Outsourcing HLS Ads from "Streaming Media" June/July 2012 Saturday, August 11, 12
  • 86. Outsourcing HLS Ads from "Streaming Media" June/July 2012 Saturday, August 11, 12
  • 87. Outsourcing HLS Ads from "Streaming Media" June/July 2012 Saturday, August 11, 12
  • 88. Outsourcing HLS Ads from "Streaming Media" June/July 2012 Saturday, August 11, 12
  • 89. Outsourcing HLS Ads from "Streaming Media" June/July 2012 Saturday, August 11, 12
  • 90. Outsourcing HLS Ads from "Streaming Media" June/July 2012 Saturday, August 11, 12
  • 91. Outsourcing HLS Ads from "Streaming Media" June/July 2012 Saturday, August 11, 12
  • 92. Outsourcing HLS Ads from "Streaming Media" June/July 2012 Saturday, August 11, 12
  • 93. Outsourcing HLS Ads from "Streaming Media" June/July 2012 Saturday, August 11, 12
  • 94. Outsourcing HLS Ads from "Streaming Media" June/July 2012 Saturday, August 11, 12
  • 95. Outsourcing HLS Ads from "Streaming Media" June/July 2012 Saturday, August 11, 12
  • 96. Outsourcing HLS Ads from "Streaming Media" June/July 2012 Saturday, August 11, 12
  • 97. Outsourcing HLS Ads from "Streaming Media" June/July 2012 Saturday, August 11, 12
  • 98. Takeaways • HLS is a very practical streaming solution • Only part of the picture if you're multi-platform • Encoding and serving correctly requires some care and expertise • Client-side software requirements are fairly simple Saturday, August 11, 12
  • 99. Q&A Slides and code will be available on my blog: http://www.subfurther.com/blog http://www.slideshare.net/invalidname @invalidname Saturday, August 11, 12