4K video is fast setting the minimum bar for content capture, be it consumer, prosumer, professional, episodic or theatrical. This in turn is leading to more demanding infrastructure requirements for media production, management and distribution. Consumers now have a variety of viewing devices and expect an optimal viewing experience for all of them, regardless of screen size or bandwidth availability. Media companies need to deliver on that consumer expectation while at the same time optimizing for costs. They need to produce content for the highest quality viewing experience, but have the ability to deliver to a wide variety of quality levels. They need an infrastructure that scales automatically and just works, whether it is a full 4K production workflow, subsequent archive and content management, or a multi-device streaming. In addition to discussing the way in which an agile cloud infrastructure can meet the demands of a 4K workflow, this session will cover cutting edge technologies like remote application visualization and server-less workflow automation that can greatly help today's media companies in the race to serve their gadget savvy consumer.

1. 4K Media Workflows on AWS
Usman Shakeel
Principal Solutions Architect Lead (M&E)
Amazon Web Services

2. Content has gravity – and getting heavier…
4K at pro-res 4444 over a TB
HD at 422HQ ~ 80 GB
(A 60 min length)
What does this mean for …
Near term storage
Archive storage
Content

3. Content has gravity – and getting heavier…
Affiliate Delivery
Consumer Delivery
10X of normal bandwidth usage today !
Can networks handle the peak usage
4K streaming?
Media Average Bit Rate
1080P 4K
Blu-Ray 24 Mbps
iTunes 5 Mbps
YouTube 3 Mbps 6 Mbps
Netflix 6 Mbps 16 Mbps
Content

4. and carries weight over to processing …
Limits of physical Infrastructure
How many 4K titles per server?
• Max Storage per server
• Max Bandwidth per server
HVEC, VP9 Encoding
• Require more processing cores Content

5. Where is the problem?
More Bandwidth
$$$$$
More Powerful
Compute
$$$$$
Way more Storage
$$$$$
Some Progress
(ABR, HVEC, VP10)

6. Does it matter?
Screen Size
Limited number of 4K mobile devices
Viewing Distance
HDMI 2.0

7. and there is more …

8. Where is the sliding scale on my Infrastructure?

9. A Concept - The Content Lake
Inspired from Data Lake (Coined by James Dixon in 2010)
A single store of all of digital content that you create and acquire
in any form or factor
•Don’t assume any resolutions/formats (for now or future)
•It is up to the consumer (application consuming the content) to use the
appropriate infrastructure for processing

10. Amazon S3 : the Content Lake
• Durable, cost-effective and fast
• Highly scalable front-end
– Multi-part uploads (parallel writes)
– Range-gets (parallel reads)
• Use Amazon S3 with on-premises
storage in a hybrid model
• No Storage capacity Upper-bounds
• Secure

11. Hydrating the Content Lake
Amazon S3
AWS Import/
ExportAmazon S3
(multi-part Upload)
AWS Storage
Gateway
Direct Connect
N x 1G | 10G
Massively Scalable Front-end

12. Edge Locations
Availability Zone
Region
Dallas (2)
St.Louis
Miami
JacksonvilleLos Angeles (2)
Seattle
Ashburn (3)
Newark
New York (3)
Dublin
London (2)
Amsterdam (2)
Stockholm
Frankfurt (2)Paris (2)
Singapore(2)
Hong Kong (2)
Tokyo (2)
Sao Paulo
South Bend
San Jose
Palo Alto
Hayward
Osaka
Milan
Sydney
Madrid
Seoul
Mumbai
Chennai
Regional Lakes …

13. Content Life-Cycle
Amazon Glacier (Life Cycle Policies)
Amazon S3
Near-term Storage
Long Term Archive
Both tiers
accessible through
a single API
Oldest content
trickles down to
glacier
automatically to
save cost

14. Consuming the Content Lake

15. Amazon S3
Amazon S3 (range-gets)
Direct Connect
N x 1G | 10G
Massively Scalable S3 Front-end
EBS
Instance
Store
c
Massively Scalable
Compute on AWS Cloud
On-Prem Apps
Consuming the Content Lake

16. Compute Intensive
Intel ES-2666 v3 (Haswell)
optimized specifically for EC2
Memory Intensive
Lowest price point per GiB of RAM
GPUs
1,536 CUDA cores
4GB of video memory
Enhanced Networking
Higher PPS, Lower network jitter, low latency
IO Intensive
SSD Storage, EBS Optimized
High Storage
24 x 2000 GiB per instance
Massively Scalable Compute Layer
Amazon S3
c4g2
m3
HVEC Encode
GPU Transcode
HD
i2
Package
Queues (orchestrated by Amazon SWF)
Content Lake
Task Specific

17. • Spot Instances
(no charge if spot is terminated)
• Reserved Instances
• Pay for only what you use
• Buy for your need
– Short term/Long term
– Real-time/Batch workloads
• AWS Marketplace
– Pay for what licenses you use
Cost Effective Compute
VS. $2.80/hr

18. Launch a CloudFormation stack
with all the infrastructure
resources for a specific project
Autoscale the stack as
appropriate
AMI
CloudFormation
Template
CloudFormation
Terminate
Template
Automated Infrastructure Layers based
on Project Scope

19. AWS Ecosystem (License included in hourly* pricing)
INGEST STORE MANAGE SECUREPROCESS
CREATE
MONETIZE
INTEGRATEDELIVER

20. Scalable Affiliate delivery on AWS

21. Traditional multi-hop satellite distribution
First HopSecond Hop
Field Source / EncoderHeadend / ProcessingAffiliate Spoke / Decoder

22. Multi-hop Affiliate distribution with AWS
First Hop
Field Source / EncoderHeadend / ProcessingAffiliate Spoke
Ingest
Fan Out
Egress
Scale Out
Multi-Region, Multi-AZ
Cellular
Internet
Amazon
Direct Connect
Secure VPN
Internet
Amazon S3
Amazon Glacier
Amazon Route53

23. c4
g2m3
High Capacity Egress
GPU Transcode
Ingest
Multi-path distribution
Encoder
Broadcast
Decode
Low Bitrate
Proxy
 Fan out / fan in
 Size workflow to compute
 Flexible multi-format
HLS w/ Cloudfront CDN
MPEG-UDP w/FEC
Amazon
Direct Connect
Content Lake

25. AWS Import/ Export
S3 multi-part API
For Source, Renditions, Metadata Sidecar Files
Ingest
AWS Elastic
Beanstalk
DAM
Web Service
CloudFront
Distribution
Amazon
DynamoDB
Amazon
CloudSearch
DAM Catalog
Rendition Workers
EC2 ASG
Amazon SNS Topic
Amazon SQS Queue
Rendition Jobs
Amazon SQS Queue
Metadata Processing Jobs
S3 Notification
Elastic Transcoder
Proxy / Thumbnail
Generation
Processing
Metadata Workers
EC2 ASG
A Simple DAM at AWS

26. AWS Import/ Export
S3 multi-part API
For Source, Renditions, Metadata Sidecar Files
Ingest
AWS Elastic
Beanstalk
DAM
Web Service
CloudFront
Distribution
Amazon
DynamoDB
Amazon
CloudSearch
DAM Catalog
Rendition Workers
EC2 ASG
Amazon SNS Topic
Amazon SQS Queue
Rendition Jobs
Amazon SQS Queue
Metadata Processing Jobs
S3 Notification
Elastic Transcoder
Proxy / Thumbnail
Generation
Processing
Metadata Workers
EC2 ASG
A Simple DAM at AWS (Cost)
$
$

27. AWS Import/ Export
S3 multi-part API
For Source, Renditions, Metadata Sidecar Files
Ingest
AWS Elastic
Beanstalk
DAM
Web Service
CloudFront
Distribution
Amazon
DynamoDB
Amazon
CloudSearch
DAM Catalog
Rendition Workers
EC2 ASG
Amazon SNS Topic
Amazon SQS Queue
Rendition Jobs
Amazon SQS Queue
Metadata Processing Jobs
S3 Notification
Elastic Transcoder
Proxy / Thumbnail
Generation
Processing
Metadata Workers
EC2 ASG
A Simple DAM at AWS (Using Spot)
0.$
0.$

28. AWS Import/ Export
S3 multi-part API
For Source, Renditions, Metadata Sidecar Files
Ingest
AWS Elastic
Beanstalk
DAM
Web Service
CloudFront
Distribution
S3 Notification
Elastic Transcoder
Proxy / Thumbnail
Generation
Processing
Lambda
Metadata
Extract & Persist
Amazon
DynamoDB
Amazon
CloudSearch
DAM Catalog
Server-less Applications using AWS Lambda
0.0$

29. yeah more science…
Remote application visualization for
production tools, VFX modeling
Content stays in the Cloud
Powerful workstations in the cloud when needed
Amazon S3
GPU
Content Lake
Amazon
Appstream
Remote
Dumb Terminal
Amazon EC2

31. The Content Lake on AWS
Process
User Delivery/ConsumptionVFX/Production
On-Prem Apps
Archive
Content Lake
Partner/Affiliate/
Service Provider

32. The Content Lake on AWS
EBS
Instance
Store
Amazon Glacier (Life Cycle Policies)
Amazon S3
Amazon EBS/EC2 Instance Store
Process
User Delivery/ConsumptionVFX/Production
On-Prem Apps
Archive
Partner/Affiliate/
Service Provider
Content Access
Transfer

33. The Content Lake on AWS
EBS
Instance
Store
Amazon Glacier (Life Cycle Policies) Amazon EBS/EC2 Instance Store
Process
Partner/Affiliate/
Service Provider
User Delivery/ConsumptionVFX/Production
On-Prem Apps
Archive
Amazon Glacier (Life Cycle Policies) Amazon EBS/EC2 Instance Store
c
c
Direct Connect
Content Access
Transfer
Disposable Infrastructure
Autoscaling
Workload specific
Amazon S3

34. South Lower Hall: SL9016
http://aws.amazon.com/digital-media/
Come check out…
Presentation Theater, Meet the AWS experts, cool demos
and Solutions Ecosystem
Thank you