In this workshop, participants will learn how to build and deploy a solution capable of ingest and delivery of live 360 degree immersive video. We will build infrastructure using Amazon EC2 Spot Instances, Amazon S3, and Amazon CloudFront, and learn how video can be transcoded for adaptive bitrate-based OTT streaming. We will also record the live video and transcode it using Amazon Elastic Transcoder along with Amazon S3 event notifications. Finally, we will host and deploy an HTML5 web player capable of displaying and panning the 360 degree content. Bring a laptop, and have an AWS account with IAM admin privileges that includes full access to Amazon EC2, EC2 Spot Instances, AWS CloudFormation, Amazon S3 and Amazon CloudFront. An Android or iOS tablet is optional.

1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Build a 360° Immersive Media Video
Solution on AWS
N o v e m b e r 2 7 , 2 0 1 7
M A E 4 0 5

2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Workshop Agenda – 2.5 Hours
• Immersive Landscape
• Capture and Distribution
• Lab 1 – Live Streaming Service
• Lab 2 – VOD Recording
• Lab 3 – Caching and CDN

3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Where Are Immersive Experiences?
•News
•Film
•Music and Sports
•Social Media
•Tourism
•Advertising
•Architecture
•Real Estate
•Education
•Healthcare

4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
VR Industry Landscape

5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Immersive ExperiencesAccessibility
Immersion
360° Video
Augmented Reality
Virtual Reality
Immersive Video
• An emerging medium
• The first “VR” experience for
many audiences
• A stepping stone to mass VR
• Easy to produce, challenging
to distribute and monetize
Flat Video

6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Immersive Capture and
Distribution

7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Stages of Streaming
Process
Transcode
Transform
Package
DRM
Capture
Film
Encode
Stitch
Edit
Deliver
Originate
Cache
Authenticate

8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Omnidirectional Capture
• Number of sensors
• Mono (2D) and/or Stereo (3D)
• Resolution/FPS/Field-of-Vision
• Stitching/Encoding/Streaming
• Image Stabilization
• Audio Capture Capabilities
• Battery Life/Drain
• Onboard Storage

9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Got Depth?
Monoscopic (2D)
• Single recording per FoV
• Most common
• Cost-effective
Stereoscopic (3D)
• Two recordings per FoV
• Gives sense of depth
• Often lower resolution
• More expensive “The early bird catches the worm” – 1900 E.R.
McCollister

10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Equirectangular Projection
deformation
wasted bits

11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Equirectangular Projection
deformation
wasted bits

12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
360˚Stitching & Transformation
Equirectangular
Widely used and supported
Easy to process
Low pixel density where it counts
Cubemap, Pyramid, Barrel
Smaller file sizes
Streaming Optimizations
Higher Resolution = HMD viewing
Poor ecosystem support

13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What about audio?

14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Contribution Considerations
• Bandwidth constraints?
• Managed or unmanaged
network?
• Packet loss? Alternate
paths?
• Latency a consideration?
• Cost?
• Codec support?
ProcessCapture
Protocol Ecosys Latency Commercials
RTMP (TCP) High Med “Free”
HLS (TCP) Med High “Free”
RTP (UDP + FEC) Low Low Open
Contribution

15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Adaptive Bitrate Streaming
4K
SD
manifest
10s 10s 10s 10s 10s
HD
client

16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Live Media Processing on AWS
• Web/App Server
• Reverse Proxy
• NGINX-RTMP
• Swiss-army encoder
• Live / VOD
• Transmux / re-package
FFmpeg

17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Delivery
• High resolution = high bandwidth
• View-dependent adaptive streaming
can help
• Strongly consider your own cache tier
• Always use a CDN
• Always use HTTP protocols (HLS/DASH) Deliver

18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Client – Mozilla A-Frame and hls.js
…
<a-scene>
<a-assets timeout="10000">
<video id="video" src="autoplay loop"></video>
</a-assets>
<a-videosphere src="#video"></a-videosphere>
</a-scene>
…

19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Stages of Streaming
Process
Transcode
Transform
Package
DRM
Capture
Film
Encode
Stitch
Edit
Deliver
Originate
Cache
Authenticate

20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Hands-On Lab

21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What Are We Building?
360˚Monocular Live Streaming Service with
Sphere Projection Client
amzn.to/immersive

22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Lab 0 – Launch Architecture
amzn.to/immersive

23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Demo While We Wait
amzn.to/immersive

24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Lab 1 – Live Streaming Service

25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Lab 2 – Video-on-Demand

26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Lab 3 – Reliability and Load Testing

27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Full Architecture

28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cleanup Steps
1. Delete objects in S3 Buckets
2. Delete stack in CloudFormation
Please fill out your survey!
… and pick up stickers in the back

29. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Key Takeaways – Immersive Video
• Stepping stone on the road to mass virtual reality adoption
• Unique experience that has wide-ranging application, not just
within the entertainment industry
• Challenges in capture, projection, and distribution domains
• Combines well-known technologies in a new way
• La Carte Projection Map c.100AD
• Stereoscopic Image c.1838
• Ambisonic Audio c.1970
• Video Streaming