Dickson Yue, Solutions Architect, AWS - Media and CloudFront services - Customer Workflow Use cases - Building Intelligent Media Solutions

1. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Dickson Yue
Solutions Architect, Amazon Web Services
Bonus Session: Innovating Media
Workflows with AWS Cloud

2. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Agenda
Media and CloudFront services
Customer Workflow Use cases
Building Intelligent Media Solutions
Amazon
CloudFront
Amazon
S3

3. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
CORPORATE
COMMUNICATIONS
MARKETING
EVENTS
GAMING SURVEILLANCE
Video is found everywhere
LIVE & VOD PAY TV
DISPLAY DEVICES

4. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
I will go Serverless!!

5. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon
Lambda
WORKFLOW
Origination
JUST IN TIME
PACKAGING
Amazon
CloudFront
CDN
Amazon
CloudFront
CDN
Amazon
S3
VOD ORIGIN
AWS Elemental
Live
ON-PREMISES
ENCODINGSOURCE
STORAGE
LIVE VIDEO
PROCESSING
AWS Elemental
MediaLive
AWS Elemental
MediaPackage
JUST-IN-TIME
PACKAGING & ORIGIN
AWS Elemental
MediaStore
MEDIA-OPTIMIZED
STORAGE & ORIGIN
AWS Elemental
MediaTailor
PERSONALIZATION &
MONETIZATION
AWS Elemental
MediaConvert
FILE-BASED
PROCESSING
AWS
Media Services

6. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon
Lambda
WORKFLOW
Origination
JUST IN TIME
PACKAGING
Amazon
CloudFront
CDN
Amazon
CloudFront
CDN
Amazon
S3
VOD ORIGIN
AWS Elemental
Live
ON-PREMISES
ENCODING
Live Channel
SOURCE
Managed
Network
DISTRIBUTION
DEVICES
File-based
Media
STORAGE
Amazon
S3
STORAGE
LIVE VIDEO
PROCESSING
AWS Elemental
MediaLive
AWS Elemental
MediaPackage
JUST-IN-TIME
PACKAGING & ORIGIN
AWS Elemental
MediaStore
MEDIA-OPTIMIZED
STORAGE & ORIGIN
AWS Elemental
MediaTailor
PERSONALIZATION &
MONETIZATION
AWS Elemental
MediaConvert
FILE-BASED
PROCESSING
AWS
Media Services
Live
?

7. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon
Lambda
WORKFLOW
Origination
JUST IN TIME
PACKAGING
Amazon
CloudFront
CDN
Amazon
CloudFront
CDN
Amazon
S3
VOD ORIGIN
AWS Elemental
Live
ON-PREMISES
ENCODING
Live Channel
SOURCE
Managed
Network
DISTRIBUTION
DEVICES
File-based
Media
STORAGE
Amazon
S3
STORAGE
LIVE VIDEO
PROCESSING
AWS Elemental
MediaLive
AWS Elemental
MediaPackage
JUST-IN-TIME
PACKAGING & ORIGIN
AWS Elemental
MediaStore
MEDIA-OPTIMIZED
STORAGE & ORIGIN
AWS Elemental
MediaTailor
PERSONALIZATION &
MONETIZATION
AWS Elemental
MediaConvert
FILE-BASED
PROCESSING
AWS
Media Services
Broadcast live with the push of a button
Scale to deliver any number of live
channels
Encode broadcast-quality live video

8. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon
Lambda
WORKFLOW
Origination
JUST IN TIME
PACKAGING
Amazon
CloudFront
CDN
Amazon
CloudFront
CDN
Amazon
S3
VOD ORIGIN
AWS Elemental
Live
ON-PREMISES
ENCODING
Live Channel
SOURCE
Managed
Network
DISTRIBUTION
DEVICES
File-based
Media
STORAGE
Amazon
S3
STORAGE
LIVE VIDEO
PROCESSING
AWS Elemental
MediaLive
AWS Elemental
MediaPackage
JUST-IN-TIME
PACKAGING & ORIGIN
AWS Elemental
MediaStore
MEDIA-OPTIMIZED
STORAGE & ORIGIN
AWS Elemental
MediaTailor
PERSONALIZATION &
MONETIZATION
AWS Elemental
MediaConvert
FILE-BASED
PROCESSING
AWS
Media Services
Deliver video from one source to many
devices
Protect valuable content with advanced
DRM capabilities
Enable a DVR experience

9. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon
Lambda
WORKFLOW
Origination
JUST IN TIME
PACKAGING
Amazon
CloudFront
CDN
Amazon
CloudFront
CDN
Amazon
S3
VOD ORIGIN
AWS Elemental
Live
ON-PREMISES
ENCODING
Live Channel
SOURCE
Managed
Network
DISTRIBUTION
DEVICES
File-based
Media
STORAGE
Amazon
S3
STORAGE
LIVE VIDEO
PROCESSING
AWS Elemental
MediaLive
AWS Elemental
MediaPackage
JUST-IN-TIME
PACKAGING & ORIGIN
AWS Elemental
MediaStore
MEDIA-OPTIMIZED
STORAGE & ORIGIN
AWS Elemental
MediaTailor
PERSONALIZATION &
MONETIZATION
AWS Elemental
MediaConvert
FILE-BASED
PROCESSING
AWS
Media Services
t = now
t = now-1hr
t = {start}

10. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon
Lambda
WORKFLOW
Origination
JUST IN TIME
PACKAGING
Amazon
CloudFront
CDN
Amazon
CloudFront
CDN
Amazon
S3
VOD ORIGIN
AWS Elemental
Live
ON-PREMISES
ENCODING
Live Channel
SOURCE
Managed
Network
DISTRIBUTION
DEVICES
File-based
Media
STORAGE
Amazon
S3
STORAGE
LIVE VIDEO
PROCESSING
AWS Elemental
MediaLive
AWS Elemental
MediaPackage
JUST-IN-TIME
PACKAGING & ORIGIN
AWS Elemental
MediaStore
MEDIA-OPTIMIZED
STORAGE & ORIGIN
AWS Elemental
MediaTailor
PERSONALIZATION &
MONETIZATION
AWS Elemental
MediaConvert
FILE-BASED
PROCESSING
AWS
Media Services

11. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon
Lambda
WORKFLOW
Origination
JUST IN TIME
PACKAGING
Amazon
CloudFront
CDN
Amazon
CloudFront
CDN
Amazon
S3
VOD ORIGIN
AWS Elemental
Live
ON-PREMISES
ENCODING
Live Channel
SOURCE
Managed
Network
DISTRIBUTION
DEVICES
File-based
Media
STORAGE
Amazon
S3
STORAGE
LIVE VIDEO
PROCESSING
AWS Elemental
MediaLive
AWS Elemental
MediaPackage
JUST-IN-TIME
PACKAGING & ORIGIN
AWS Elemental
MediaStore
MEDIA-OPTIMIZED
STORAGE & ORIGIN
AWS Elemental
MediaTailor
PERSONALIZATION &
MONETIZATION
AWS Elemental
MediaConvert
FILE-BASED
PROCESSING
AWS
Media Services
Amazon
CloudFront

12. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
• Leading OTT player
• Indian Movies, Shows and Live TV
• 50 millions registered users
• Users in 5 continents
• Content served on Mobile,
connected TVs, SetTop Boxes
• (Coming Soon..!) Non-Indian content

13. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
“We are looking to AWS Elemental MediaLive to give us tremendous scale, elasticity, and flexibility within
our video processing and delivery infrastructure and AWS Elemental MediaPackage to support
functionalities such as channel delay, seven-day catch-up, and start-over.”
-S Mohan, Co-Founder & CEO for Spuul
AWS Elemental
MediaLive
LIVE VIDEO PROCESSING
AWS Elemental
MediaPackage
ORIGINATION AND
JUST-IN-TIME PACKAGING
CDN
Amazon
CloudFrontLive Channel
SOURCE DISPLAY DEVICES
Multiple OTT Devices
SPUUL

14. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon
Lambda
WORKFLOW
Origination
JUST IN TIME
PACKAGING
Amazon
CloudFront
CDN
Amazon
CloudFront
CDN
Amazon
S3
VOD ORIGIN
AWS Elemental
Live
ON-PREMISES
ENCODING
Live Channel
SOURCE
Managed
Network
DISTRIBUTION
DEVICES
File-based
Media
STORAGE
LIVE VIDEO
PROCESSING
AWS Elemental
MediaLive
AWS Elemental
MediaPackage
JUST-IN-TIME
PACKAGING & ORIGIN
AWS Elemental
MediaStore
MEDIA-OPTIMIZED
STORAGE & ORIGIN
AWS Elemental
MediaTailor
PERSONALIZATION &
MONETIZATION
AWS Elemental
MediaConvert
FILE-BASED
PROCESSING
AWS
Media Services
VoD
?

15. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon
Lambda
WORKFLOW
Origination
JUST IN TIME
PACKAGING
Amazon
CloudFront
CDN
Amazon
CloudFront
CDN
Amazon
S3
VOD ORIGIN
AWS Elemental
Live
ON-PREMISES
ENCODING
Live Channel
SOURCE
Managed
Network
DISTRIBUTION
DEVICES
File-based
Media
STORAGE
Amazon
S3
STORAGE
LIVE VIDEO
PROCESSING
AWS Elemental
MediaLive
AWS Elemental
MediaPackage
JUST-IN-TIME
PACKAGING & ORIGIN
AWS Elemental
MediaStore
MEDIA-OPTIMIZED
STORAGE & ORIGIN
AWS Elemental
MediaTailor
PERSONALIZATION &
MONETIZATION
AWS Elemental
MediaConvert
FILE-BASED
PROCESSING
AWS
Media Services
Durability, Availability & Scalability
Lifecycle management
Broad integration
S3 as your content lake
Amazon
S3

16. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon
Lambda
WORKFLOW
Origination
JUST IN TIME
PACKAGING
Amazon
CloudFront
CDN
Amazon
CloudFront
CDN
Amazon
S3
VOD ORIGIN
AWS Elemental
Live
ON-PREMISES
ENCODING
Live Channel
SOURCE
Managed
Network
DISTRIBUTION
DEVICES
File-based
Media
STORAGE
Amazon
S3
STORAGE
LIVE VIDEO
PROCESSING
AWS Elemental
MediaLive
AWS Elemental
MediaPackage
JUST-IN-TIME
PACKAGING & ORIGIN
AWS Elemental
MediaStore
MEDIA-OPTIMIZED
STORAGE & ORIGIN
AWS Elemental
MediaTailor
PERSONALIZATION &
MONETIZATION
AWS Elemental
MediaConvert
FILE-BASED
PROCESSING
AWS
Media Services
Build video-on-demand workflows in
minutes not months
Deliver broadcast-grade quality video

17. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon
Lambda
WORKFLOW
Origination
JUST IN TIME
PACKAGING
Amazon
CloudFront
CDN
Amazon
CloudFront
CDN
Amazon
S3
VOD ORIGIN
AWS Elemental
Live
ON-PREMISES
ENCODING
Live Channel
SOURCE
Managed
Network
DISTRIBUTION
DEVICES
File-based
Media
STORAGE
Amazon
S3
STORAGE
LIVE VIDEO
PROCESSING
AWS Elemental
MediaLive
AWS Elemental
MediaPackage
JUST-IN-TIME
PACKAGING & ORIGIN
AWS Elemental
MediaStore
MEDIA-OPTIMIZED
STORAGE & ORIGIN
AWS Elemental
MediaTailor
PERSONALIZATION &
MONETIZATION
AWS Elemental
MediaConvert
FILE-BASED
PROCESSING
AWS
Media Services
Integrate with other AWS services
Amazon
Lambda
Amazon
S3

18. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon
Lambda
WORKFLOW
Origination
JUST IN TIME
PACKAGING
Amazon
CloudFront
CDN
Amazon
CloudFront
CDN
Amazon
S3
VOD ORIGIN
AWS Elemental
Live
ON-PREMISES
ENCODING
Live Channel
SOURCE
Managed
Network
DISTRIBUTION
DEVICES
File-based
Media
STORAGE
Amazon
S3
STORAGE
LIVE VIDEO
PROCESSING
AWS Elemental
MediaLive
AWS Elemental
MediaPackage
JUST-IN-TIME
PACKAGING & ORIGIN
AWS Elemental
MediaStore
MEDIA-OPTIMIZED
STORAGE & ORIGIN
AWS Elemental
MediaTailor
PERSONALIZATION &
MONETIZATION
AWS Elemental
MediaConvert
FILE-BASED
PROCESSING
AWS
Media Services
Amazon
CloudFront

19. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
132 Points of Presence
121 Edge Locations
11 Regional Edge Caches
59 cities across 26 countries
Hong Kong, China (3);
Amazon
CloudFront

20. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
How CloudFront Delivers Video Content
CloudFront
Edge
Locations
Regional
Edge
Cache
ISP Nameserver
1.2.3.4
Origins
Live
AWS Elemental
MediaPackage
JUST-IN-TIME
PACKAGING & ORIGIN
Amazon
S3
STORAGE
VoD
Viewers
Request a HLS stream
www.example.com/out/index.m3u8
/*.m3u8 max-age=2
/*.ts max-age=31536000
Amazon
CloudFront

21. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon
Lambda
WORKFLOW
Origination
JUST IN TIME
PACKAGING
Amazon
CloudFront
CDN
Amazon
CloudFront
CDN
Amazon
S3
VOD ORIGIN
AWS Elemental
Live
ON-PREMISES
ENCODING
Live Channel
SOURCE
DISTRIBUTION
DEVICES
File-based
Media
STORAGE
Amazon
S3
STORAGE
LIVE VIDEO
PROCESSING
AWS Elemental
MediaLive
AWS Elemental
MediaPackage
JUST-IN-TIME
PACKAGING & ORIGIN
AWS Elemental
MediaConvert
FILE-BASED
PROCESSING
AWS
Media Services

22. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Personize and Monetize with targeted
advertising

23. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
De live r u n iqu e a d s t o
vie we rs
P ro vid e b ro a d cast -
gra d e a d
e xp e rie nce
I m p ro ve t ra ckin g o f
a d vie ws
AWS Elemental MediaTailor
Personalize and monetize internet video content

24. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon
Lambda
WORKFLOW
Origination
JUST IN TIME
PACKAGING
Amazon
CloudFront
CDN
Amazon
CloudFront
CDN
Amazon
S3
VOD ORIGIN
AWS Elemental
Live
ON-PREMISES
ENCODING
Live Channel
SOURCE
Managed
Network
DISTRIBUTION
DEVICES
File-based
Media
STORAGE
Amazon
S3
STORAGE
LIVE VIDEO
PROCESSING
AWS Elemental
MediaLive
AWS Elemental
MediaPackage
JUST-IN-TIME
PACKAGING & ORIGIN
AWS Elemental
MediaTailor
PERSONALIZATION &
MONETIZATION
AWS Elemental
MediaConvert
FILE-BASED
PROCESSING
AWS
Media Services

25. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
“We used the AWS Elemental MediaTailor
service, which allows us to deliver
targeted ads that are seamlessly inserted
into the main content, for a great viewer
experience. I am confident that AWS
Elemental Media Services are the path to
use the cloud for live streaming at scale.”
- BA Winston, Global Head of Video
Playback and Delivery for Amazon Video
AWS ELEMENTAL CLOUD REGION
Venue
SOURCE
AWS Elemental
Live
AWS Elemental
Delta
AWS Elemental
MediaTailor
PERSONALIZATION AND
MONETIZATION SERVICE DISPLAY DEVICES
DASH, HLS, Smooth
Multi-CDN
DISTRIBUTION
Internal Ad
Server
Ad Server
ADS Proxy
PROXY
AWS ELEMENTAL CLOUD REGION
AWS Elemental
Server
Amazon
S3
Stitch & deliver
personized
manifest
Get ad info for each user Report ad plays
Amazon Prime Video – American Football

26. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Ecosystem and Applications

27. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
AWS Media Services Launch Partner Ecosystem
CDN
Amazon
CloudFront
3RD Party CDN
DIGITAL RIGHTS
MANAGEMENT
AWS Elemental
Media Services
INTEGRATED VIDEO
PROCESSING AND DELIVERY
VIDEO QC
MEDIA LOGISTICSMAM / DAM
AD TECH

28. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Approaches to Building Video Workflows

29. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Building Intelligent Media Solutions

30. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon Rekognition Video
Analyze activity and recognize people in stored and live video
Object and activity
detection
Pathing
Face recognitionUnsafe video
detection
Celebrity
recognition
Facial
Analysis

31. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

32. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon Rekognition Video
Use case: Video search index
Video Amazon S3 AWS Lambda Amazon Rekognition Video
Amazon Elasticsearch Amazon DynamoDB
1. Video is uploaded
and stored to S3
2. Amazon Rekognition Video
creates metadata for celebrities,
emotions, key topics in video with
time segments for search
4. Lambda also pushes
the metadata and confidence
scores into Elasticsearch
3. The output is persisted as
metadata into DynamoDB
to ensure durability

33. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.

34. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Sports Highlights and Player Activity Pathing
Amazon S3 Face collectionRekognition
1. Store images of recognized people 2. Index individuals into a collection
Amazon S3 Rekognition Video
3. Store video files
4. Path player activity on
screen and recognize
individual faces
Videos AWS Lambda
7. Summarize Info
on screen detail
DynamoDB
API Gateway
6. Retrieve additional
person’s info
5. Face Match,
analysis and Label
Detection

35. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
The Royal Wedding

36. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Sample ML Use Cases in M&E
Automate the creation of rich metadata index (object, scene, activity, faces etc.), extracted from audio visual
content and integrated into digital and media asset management systems
AWS SERVICES TO BUILD USE CASE: REKOGNITION, SAGEMAKER, TRANSCRIBE, COMPREHEND
Media Metadata
Tagging
Automated captions, transcription and translation of audio content
AWS SERVICES TO BUILD USE CASE: TRANSCRIBE, TRANSLATE, COMPREHEND
Closed Captioning
Detect potentially inappropriate content to avoid compliance issues in global markets, and to increase brand
safety for advertisers
AWS SERVICES TO BUILD USE CASE: REKOGNITION, TRANSCRIBE, SAGEMAKER
Automated
Compliance Marking
Identify objects and emotion in content that enables users to integrate personalized ads into subscriber video
streams
AWS SERVICES TO BUILD USE CASE: SPARK/EMR, SAGEMAKER, MEDIATAILOR
Ad Personalization

37. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Identify and path player activity in the field or identify the precise timecodes when actors enter and leave a
scene, both visually and in spoken dialog (off-screen voice)
AWS SERVICES TO BUILD USE CASE: REKOGNITION, TRANSCRIBE
Player/ Actor
identification &
activity pathing
Translate transcripts and metadata. Improve localization workflows and search experience
AWS SERVICES TO BUILD USE CASE: TRANSLATE
Language
Translation
Analysis disparate data and enable the consumer to make personalized content choices and the business to
predict behavior
AWS SERVICES TO BUILD USE CASE: SAGEMAKER
Content
Recommendations
Detect and pixelate faces captured incidentally to preserve the privacy of non-persons of interest in news feeds
and security footage
AWS SERVICES TO BUILD USE CASE: REKOGNITION, TRANSCRIBE, SAGEMAKER
Automated
Redaction
Sample ML Use Cases in M&E

38. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon
Lambda
WORKFLOW
Origination
JUST IN TIME
PACKAGING
Amazon
CloudFront
CDN
Amazon
CloudFront
CDN
Amazon
S3
VOD ORIGIN
AWS Elemental
Live
ON-PREMISES
ENCODING
Live Channel
SOURCE
Managed
Network
DISTRIBUTION
DEVICES
File-based
Media
STORAGE
Amazon
S3
STORAGE
LIVE VIDEO
PROCESSING
AWS Elemental
MediaLive
AWS Elemental
MediaPackage
JUST-IN-TIME
PACKAGING & ORIGIN
AWS Elemental
MediaStore
MEDIA-OPTIMIZED
STORAGE & ORIGIN
AWS Elemental
MediaTailor
PERSONALIZATION &
MONETIZATION
AWS Elemental
MediaConvert
FILE-BASED
PROCESSING
AWS
Media Services

39. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Thank you!