tweet #reinvent
Possibilities for Media Processing Workloads on AWS                        Hybrid                          or             ...
Problem: Timeline overruns to support PS3 launchSolution: AWS’s Scale, 1200 virtual machines on-demandBenefits: 17,000 tit...
Workflow                            Controller              RTMPLive StreamMediaFiles                                     ...
You start streaming  Capacity   Deficit                                 Hourly PeaksSteady State 3:00 am 4:00 am 5:00 am 6...
You start streaming  Capacity   Deficit                                 Hourly Peaks                                      ...
CloudWatch     CloudformationSQS SNS                            CloudSearch                SWF          SES               ...
Workflow Controller                                                                         Amazon Machine Image (AMI)    ...
Vanilla OS > Deploy your code > Create a Custom AMI          on Linux or Windows EC2Use pre-built AMIs from AWS Marketplac...
Ephemeral StorageInstance storeSequential I/OLimited storageCan be used as temporary storage at processing nodeEBS (Elasti...
Workflow Controller                                                                                       AMI             ...
Aspera On-demand   Direct to S3
Workflow Controller                                                                                         AMI           ...
SNS            SQS           SWFWorkflow Controller                                                                       ...
Amazon SWFTranscode WorkerTranscode WorkerTranscode Worker (Spot)                            Transcode                    ...
Amazon SWF                                            SlicerTranscode Worker                                              ...
computenetwork                              memory                          local storage          I/O
SNS               SQS         SWFWorkflow Controller                                                                     A...
S3 API               Object                     Lifecycle         Amazon S3               Amazon Glacier
S3FS
Processing Node            s3sync                               Processing NodeAmazon S3                     Gluster      ...
Amazon CloudFront                                  SNS              SQS         SWFWorkflow Controller                    ...
YOU                                Account Management                                Network Configuration                ...
AWS CertificationsSOC 1ISO 27001 CertificationPCI Level 1 Service ProviderFedRAMP (FISMA moderate & low)GovCloudMPAA Best ...
Transcoding              Media Servers                              DRM
NewAwesome Device!
SNS             SQS         SWFWorkflow Controller                                                                 Auto Sc...
re:Invent SessionsDocumentation
We are sincerely eager to      tweet #reinvent hear your feedback on thispresentation and on re:Invent. Please fill out an...
MED203 Scalable Media Processing - AWS re: Invent 2012
MED203 Scalable Media Processing - AWS re: Invent 2012
MED203 Scalable Media Processing - AWS re: Invent 2012
MED203 Scalable Media Processing - AWS re: Invent 2012
MED203 Scalable Media Processing - AWS re: Invent 2012
MED203 Scalable Media Processing - AWS re: Invent 2012
MED203 Scalable Media Processing - AWS re: Invent 2012
MED203 Scalable Media Processing - AWS re: Invent 2012
MED203 Scalable Media Processing - AWS re: Invent 2012
MED203 Scalable Media Processing - AWS re: Invent 2012
MED203 Scalable Media Processing - AWS re: Invent 2012
Upcoming SlideShare
Loading in...5
×

MED203 Scalable Media Processing - AWS re: Invent 2012

3,898

Published on

This session walks through approaches for large-scale media processing scenarios. We cover hybrid and cloud-based transcoding, file transfer, media preparation, and media management. We expect attendees to come away with an understanding of best practices for architecting and deploying hybrid and cloud-based systems for media processing.

0 Comments
4 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
3,898
On Slideshare
0
From Embeds
0
Number of Embeds
7
Actions
Shares
0
Downloads
0
Comments
0
Likes
4
Embeds 0
No embeds

No notes for slide

Transcript of "MED203 Scalable Media Processing - AWS re: Invent 2012"

  1. 1. tweet #reinvent
  2. 2. Possibilities for Media Processing Workloads on AWS Hybrid or 100% cloud environment
  3. 3. Problem: Timeline overruns to support PS3 launchSolution: AWS’s Scale, 1200 virtual machines on-demandBenefits: 17,000 titles (80 TB of data) transcoded in days,able to support launch
  4. 4. Workflow Controller RTMPLive StreamMediaFiles Content DeliveryPhysicalMedia TranscodersCamera HD-SDI Store input streams Store output profile and file Corporate Data center
  5. 5. You start streaming Capacity Deficit Hourly PeaksSteady State 3:00 am 4:00 am 5:00 am 6:00 am 7:00 am 8:00 am 9:00 am 10:00 am 11:00 am 12:00 pm 1:00 pm 2:00 pm 3:00 pm 4:00 pm 5:00 pm 6:00 pm 7:00 pm 8:00 pm
  6. 6. You start streaming Capacity Deficit Hourly Peaks Inadequate Wasted Capacity CapacitySteady State 3:00 am 4:00 am 5:00 am 6:00 am 7:00 am 8:00 am 9:00 am 10:00 am 11:00 am 12:00 pm 1:00 pm 2:00 pm 3:00 pm 4:00 pm 5:00 pm 6:00 pm 7:00 pm 8:00 pm
  7. 7. CloudWatch CloudformationSQS SNS CloudSearch SWF SES EMR API EC2 RDS Your Applications EBS CloudFront S3 9 Regions Multiple Availability Zones per region
  8. 8. Workflow Controller Amazon Machine Image (AMI) Transcoders Store output profile and file EC2 (Transcoders) Store input Elastic Block Store streams Corporate Data Center AWS Cloud
  9. 9. Vanilla OS > Deploy your code > Create a Custom AMI on Linux or Windows EC2Use pre-built AMIs from AWS Marketplace or the vendor
  10. 10. Ephemeral StorageInstance storeSequential I/OLimited storageCan be used as temporary storage at processing nodeEBS (Elastic Block Store)Persistent store1 TB volumesProvisioned IOPs EBS volumesEBS optimized InstancesMultiple EBS volumes stripe
  11. 11. Workflow Controller AMI Transcoders AWS Direct Connect Store output profile and file EC2 EBS (Transcoders) Store input streams Corporate Data Center AWS Cloud
  12. 12. Aspera On-demand Direct to S3
  13. 13. Workflow Controller AMI Auto Scaling Transcoders AWS Direct Connect Store output profile and file Reserved/Spot Instance EBS Instances Store input streams Corporate Data Center AWS Cloud
  14. 14. SNS SQS SWFWorkflow Controller Auto Scaling AMI AWS Direct Connect Transcoders Store output profile and file Store input Reserved/Spot Transcode streams Instances Queue Corporate Data Center AWS Cloud
  15. 15. Amazon SWFTranscode WorkerTranscode WorkerTranscode Worker (Spot) Transcode QueueTranscode Worker (Spot) Input files in S3
  16. 16. Amazon SWF SlicerTranscode Worker CMSTranscode WorkerTranscode Worker (Spot) Transcode QueueTranscode Worker (Spot) Input files in S3
  17. 17. computenetwork memory local storage I/O
  18. 18. SNS SQS SWFWorkflow Controller Auto Scaling AMI Transcode Reserved/Spot Queue Instances EBS Transcoders S3 for input files Corporate Data Center AWS Direct Connect AWS Cloud
  19. 19. S3 API Object Lifecycle Amazon S3 Amazon Glacier
  20. 20. S3FS
  21. 21. Processing Node s3sync Processing NodeAmazon S3 Gluster Processing Node
  22. 22. Amazon CloudFront SNS SQS SWFWorkflow Controller Delivery Auto Scaling AMI Transcode Queue Reserved/Spot Instances EBS Transcoders S3 for input files Corporate Data Center AWS Direct AWS Cloud Connect
  23. 23. YOU Account Management Network Configuration OS Firewalls Security Groups Application Operating SystemVirtualization InfrastructureNetwork InfrastructurePhysical InfrastructurePhysical SecurityFacilities
  24. 24. AWS CertificationsSOC 1ISO 27001 CertificationPCI Level 1 Service ProviderFedRAMP (FISMA moderate & low)GovCloudMPAA Best Practices ComplianceCustomer are running Sarbanes-Oxley (SOX), HIPAA (healthcare),FISMA (US Federal Government), DIACAP MAC III Sensitive ATO,International Traffic in Arms Regulations (ITAR)
  25. 25. Transcoding Media Servers DRM
  26. 26. NewAwesome Device!
  27. 27. SNS SQS SWFWorkflow Controller Auto Scaling AMI Transcode Reserved/Spot Queue Instances EBS Transcoders AWS Direct S3 Corporate Data Center AWS Cloud Connect
  28. 28. re:Invent SessionsDocumentation
  29. 29. We are sincerely eager to tweet #reinvent hear your feedback on thispresentation and on re:Invent. Please fill out an evaluation form when you have a chance.

×