Media Processing Workflows
using AWS Step Functions
and Machine Learning on
Amazon Web Services
Andy	Katz
Sr.	Product	Manager,	Amazon	Web	Services
Storage Compute Database Networking CDN AI/ML
CustomNative Partner
AWS Core Services
AWS Media & Entertainment Solutions
AWS core services provide a foundation on which you can build native, partner, &
customized solutions
2
Orchestration
AWS stack for media workflows
Store once, deliver anywhere
Ingest/Create Store Process Deliver
AWS
Direct Connect
AWS
Import/ Export
AWS
Storage Gateway
AWS
Snowball
S3 Transfer
Acceleration
AWS Elemental
MediaLive
Amazon EBS
Amazon S3
Amazon
CloudFront
Route 53
AWS WAF
AWS Elemental
MediaTailor
Amazon VPC
Lambda
Amazon EC2
Amazon
Rekognition
Amazon
Lex
Amazon
Polly
Amazon
Machine Learning
Amazon
RDS
Amazon
DynamoDB
Amazon Elastic
Transcoder
Amazon
CloudSearch
Amazon SQS
AWS
Step Functions
Amazon SNSAmazon
Transcribe
Amazon
Comprehend
Amazon
Translate
AWS Elemental
MediaStore
AWS Elemental
MediaPackage
AWS Elemental
MediaConvert
AWS Elemental
MediaLive
Amazon Glacier
Amazon EFS
The Amazon machine learning stack
Platform Services
Application Services
Frameworks & Interfaces
Caffe2 CNTK
Apache
MXNet
PyTorch TensorFlow Torch Keras Gluon
AWS Deep Learning AMIs
Amazon SageMaker AWS DeepLens
Rekognition Transcribe Translate Polly Comprehend LexRekognition Transcribe Comprehend
Amazon Rekognition
Deep learning-based image and video analysis
Object, Scene &
Activity Recognition
Facial
Recognition
Facial Analysis Person Tracking
Unsafe Content
Detection
Celebrity
Recognition
Text in Images
Visualize	in	the	
Console
Define	in	JSON Monitor	
Executions
Amazon	Confidential
AWS Step Functions: Visual Workflows
“I want try/catch/finally”
“I want to select tasks based on data”
“I want to retry failed tasks”
A
B C
A
?
“I want to sequence tasks”
BA
“I want to run tasks in parallel”
CBA
Is this you?
Task
Choice
Fail
Parallel
Mountains
People
Snow
AWS Step Functions
Makes it easy to coordinate components of distributed applications
using visual workflows
Customers
• Automate	daily,	weekly	
monthly	tasks
• Coordinate	components	of	
distributed	applications
• Build	microservices
Serverless image recognition & processing
Snow
People
Mountains
Configure workflows in JSON
{
"Comment": "Image Processing workflow",
"StartAt": "ExtractImageMetadata",
"States": {
"ExtractImageMetadata": {
"Type": "Task",
"Resource": "arn:aws:lambda:us-west-2:0...",
"InputPath": "$",
"ResultPath": "$.extractedMetadata",
"Next": "ImageTypeCheck",
"Catch": [ {
"ErrorEquals": [ "ImageIdentifyError"],
"Next": "NotSupportedImageType"
} ],
"Retry": [ {
"ErrorEquals": [ "States.ALL"],
"IntervalSeconds": 1,
"MaxAttempts": 2,
"BackoffRate": 1.5 }, ...
Working App
12
https://aws.amazon.com/step-functions/getting-started/
New! Video-on-Demand on AWS Solution
• Features:
• Serverless architecture
• 1080p through 270p HLS and DASH
outputs
• 4K, HD and SD H.265 MP4 outputs
• SNS notifications on ingest encoding and
complete
• Workflow details and asset metadata stored
in DynamoDB
• Error handling
• Options for source Archiving to Glacier
Workflow driven by AWS Step Functions
Ingest Publish
S3
Process
MediaConvert
Regional/Account
Custom API Endpoint
AWS media analytics solution
Amazon Transcribe
Automatic conversion of speech into accurate, grammatically correct text
Support for
telephony audio
Timestamp
generation
Intelligent punctuation &
formatting
Recognize multiple
speakers
Custom
vocabulary
Multiple
languages
Amazon Comprehend
Discover insights and relationships in text
Entities
Key Phrases
Language
Sentiment
Amazon
Comprehend
Media analytics Step Functions state machine
AWS Answers
https://aws.amazon.com/answers/
• AWS Answers:
• Best	practices
• Prescriptive	design	patterns
• Ready-made	solutions
• Strategic	guidance
• Solution Resources:
• Implementation	Guide
• CloudFormation	Template
• Source	Code
Thank you!
AWS	Media	&	Entertainment:	https://aws.amazon.com/digital-media/
AWS	Elemental	Video	Solutions:	https://aws.amazon.com/digital-media/aws-managed-
video-services/
AWS	Answers	Video	on	Demand	Solution:	https://aws.amazon.com/answers/media-
entertainment/video-on-demand-on-aws/
AWS	Step	Functions:	https://aws.amazon.com/step-functions/

Media Processing Workflows using AWS Step Functions and Machine Learning on Amazon Web Services