Your SlideShare is downloading. ×
AWS Summit 2013 | Auckland - Scalable Media Processing on the Cloud
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

AWS Summit 2013 | Auckland - Scalable Media Processing on the Cloud

415

Published on

In this session, see how you can utilize AWS to manage your end-to-end media process. This includes ingest, storage, transcoding, DRM wrapping and finally delivery.

In this session, see how you can utilize AWS to manage your end-to-end media process. This includes ingest, storage, transcoding, DRM wrapping and finally delivery.

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
415
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Scalable Media Processing & Delivery in the CloudSimon ElishaPrincipal Solutions Architect, AWS
  • 2. Media EvolutionHow Cloud Scalability can beuseful for media workflows…Media workflows in the CloudReally…
  • 3. Media EvolutionAnalog VCD DVD 720p 1080p (3D) 2K 4KSIZEUSERSFORMAT IngestionStorageProcessingDelivery
  • 4. Media is getting Harder…
  • 5. Media is getting Harder…
  • 6. Media is getting Harder…
  • 7. Media is getting Harder…
  • 8. We need tools that can scale for Media…
  • 9. ManagedservicesSecureHigh availabilityMassive scale
  • 10. Media StorageAmazon S3Your files- Faster access to massive compute capabilities- Many external products (hourly or BYOL)- Access to other processing vendors withouthaving to move files around- Scalable Media Delivery (piece of cake!)
  • 11. Media Storage (in the Cloud)Amazon S3 Amazon GlacierObject lifecycle policiesSingle API access (regardlessof the storage class)>Durability>>Scale>>>Cost
  • 12. Media Storage (Hybrid)Amazon S3HTTPSAWS StorageGatewayCorporate Data CenterUsersClient On-Premises Storage
  • 13. Media IngestAWS Import/ExportAmazon S3(multi-part Upload)AWS StorageGateway ServiceAWS DirectConnect
  • 14. Media IngestS3 BucketS3 clientS3 ServersideS3 multi-part UploadFiles
  • 15. Media IngestS3 BucketEC2 InstanceRunning AsperaFilesAspera on-Demand ServerFASPInstance RAMFASP Gateway
  • 16. Media IngestS3 BucketEC2 InstancesRunning Aspera farmFilesEIPEIPEIPElasticNetworkInterfaceElasticNetworkInterface
  • 17. Media ProcessingEC2 InstanceI/O
  • 18. Media ProcessingAMIEBSInstanceStoreEC2 Instance
  • 19. Media ProcessingAMIEBSInstanceStoreEC2 Instances
  • 20. Media ProcessingAMIEBSInstanceStoreSteady State TranscodersEBSInstanceStoreSpot TranscodersTranscodeQueue
  • 21. Media ProcessingAMIEBSInstanceStoreSteady State TranscodersTranscodeQueueEBSInstanceStoreSpot TranscodersAuto ScalingCloudWatchalarm
  • 22. Media ProcessingTimeCapacityLaunch of new device1000’s of transcoders
  • 23. Media ProcessingElasticCLOUD capacityTraditionalIT capacityYour needsTimeCapacity
  • 24. SPOT & More Complex Workflows – Transcode PartTranscodeQueueTranscode WorkerTranscode WorkerTranscode Worker (Spot)Transcode Worker (Spot)Input files in S3
  • 25. SPOT & More Complex Workflows – Slicer PartTranscodeQueueTranscode WorkerTranscode WorkerTranscode Worker (Spot)Transcode Worker (Spot)Input files in S3SlicerCMS
  • 26. Media WorkflowSNSSQS SWF
  • 27. ProcessingQueueAmazon SWFTranscode WorkerTranscode Worker (Spot)Input files in S3SlicerCMSMedia WorkflowAWS Import/ExportDRM WrapperDRM Wrapper (Spot)SNSStreaming Server
  • 28. ProcessingQueueAmazon SWFTranscode WorkerTranscode Worker (Spot)Input files in S3SlicerCMSMedia WorkflowAWS Import/ExportDRM WrapperDRM Wrapper (Spot)SNSStreaming Server
  • 29. Amazon SWFInput and output in S3Media WorkflowAWS Import/ExportDRM WrapperDRM Wrapper (Spot)SNSStreaming ServerAmazon Elastic Transcoder
  • 30. Input andoutput in S3Media TranscodingAmazon Elastic Transcoder• Video transcoding in the cloud• Familiar development in AWS SDKsfor Python, Node.js, Java, .NET,PHP, and Ruby• Supports H.264, AAC, MP4,MPEG-2, FLV, 3GP, HLS, VP8,Vorbis, and AVI• Free Usage Tier
  • 31. Media Delivery (in the Cloud)Amazon S3RTMP Streaming orDownload DistributionProcessed Media Files>Pay as you go>>Performance>>>CostHTTP/HTTPSAmazon CloudFront
  • 32. Media Delivery (Hybrid)CloudFront Custom OriginCorporate Data CenterUsersClient On-Premises StorageAmazon CloudFrontServer
  • 33. CDNEdge LocationsDallas (2)St.LouisMiamiJacksonvilleLos Angeles (2)Palo AltoSeattleAshburn (2)NewarkNew York (3)DublinLondon (2) Amsterdam (2)StockholmFrankfurt (2)Paris (2)Singapore (2)Hong Kong (2)Tokyo (2)Sao PauloSouth BendSan JoseOsakaMilanSydneyHaywardMadrid
  • 34. Media Delivery (Streaming)HDS/HLS/SmoothStreamingAmazon CloudFrontEBSInstanceStoreEC2 Streaming InstanceAmazon S3
  • 35. Media ReportingAmazon CloudFrontAccess LogsAmazon S3EMRAmazonRedshiftBusinessSmarts
  • 36. Media WorkloadsRegion GovCloud RegionSnapshotAMIS3 bucketAWS CloudFormationSnapshotAMIS3 bucketS3 CopySnapshot copyAMI CopyStack
  • 37. Webcasting with AWSScott JudsonCTO, Future TechJordan GreigSolutions Architect, Future Tech
  • 38. Who are we?• Mission critical live video streaming from any camera to any deviceanywhere• Established in 2009• Focus on live video technology• Global customer base• Market validation with Funeral Homes
  • 39. Why we chose AWS?• Cost effective– Pay as you grow– No upfront capital expense– Spot instances– Cost effective• High compute instances for videotranscoding– Hgh CPU XL, 8 cores• Scalable, low cost storage– S3– EBS– Glacier
  • 40. Why we chose AWS?• Datacenters & PoP’s in coremarkets– US, UK, APAC• Link existing onpremiseinfrastructure with cloud– VPC– VPN connectivity• Ability to scale to the n– Vertical & horizontal autoscaling• Global CDN– Pay as you go– Global reach throughout United States,Europe, Asia, and South America.• Load testing– Ability to scale up huge infrastructure tostress test application
  • 41. What we useAmazon EC2Amazon VPCAmazon S3 Amazon GlacierDynamoDB Amazon RDSCloudWatch Amazon SES
  • 42. Architecture
  • 43. WorkflowSite sends streamto local PoPLocal PoPaggregatesstreams via VPNgatewayUser schedulesevent in portalResourcemanager bids forspot instanceTranscoder pullsstream from siteCDN broadcastsstream to anydeviceStream is saved toS3 for archiveStream is saved toglacier atexpiration date
  • 44. =zMedia can be made Scalable…>> Secure>> Flexible>> Managed>> Highly Available>> CheapYour Media In the Cloud Peace of mind
  • 45. Webcasting with AWSScott Judson Jordan GreigCTO Solutions Architect@dvint1 @jordangreig
  • 46. ARCHITECTURE CENTERhttp://aws.amazon.com/architectureTECHNICAL ARTICLEShttp://aws.amazon.com/articlesPODCASThttp://aws.amazon.com/podcastBLOGhttp://aws.typepad.com

×