SlideShare a Scribd company logo
1 of 37
Download to read offline
Delivering on the Promise of
the Cloud for Digital Media
Aspera OnDemand

Bhavik Vyas | Director of Cloud Solutions & Partnerships | 14 th June 2012
ASPERA SOFTWARE INC



Creating next-generation transport technologies that move
the world’s digital assets at maximum speed, regardless of
    file size, transfer distance and network conditions.




           Distribute        Collaborate   Automate
                                                      14


                             Transport
Aspera Corporate Overview




Headquarters: Emeryville, CA

Founded: 2004

Ownership: Privately Held

Employees: ~100

Patents: Issued and pending in over 32 countries

Customers: over 1,200 customers, over 10,000 licenses deployed

Markets Served: Media and Entertainment, Federal Government, Life Sciences, Healthcare, Cloud
  Computing, Software and Gaming, Financial Services, Legal, eDiscovery, Engineering, Technology,
  Telecommunications, Service Providers, Architecture and Design, Enterprise IT

Creators of the fasp™ protocol
    • Innovative, patented, highly efficient bulk data transport technology
    • Unique and core to Aspera’s high-performance file transfer software suite
    • Outperforms software and hardware WAN acceleration solutions
    • Ranked first in every WAN transfer throughput benchmark
THE CLOUD IS REAL
THE MEDIA CLOUD?... IT’S HERE.




                               Thursday, March 8, 2012, New York, NY

 Aspera, Amazon Web Services and Zencoder teamed up for a special event at New York City’s Tribeca
Grand Hotel on Thursday, March 8th, 2012. During this afternoon of presentations by industry experts,
        attendees experienced what is now possible in the cloud for digital media companies.
ASPERA PRODUCT & TECHNOLOGY PORTFOLIO




    DISTRIBUTE                          COLLABORATE                              AUTOMATE




  Complete portfolio of               Global person-to-person                Web-based application
 servers and clients for                 and project-based                  and SDK for creating and
high-speed data delivery                   exchange and                     managing automated file-
    and distribution.                   collaboration of files                 based workflows.
                                          and directories.




                                         TRANSPORT

           Our unique, patented faspTM transport technologies provide unparalleled speed,
               efficiency, and bandwidth control over any size, distance, and network.
ASPERA’S BIG-DATA MARKETS
VIDEO IS BIG-DATA…VERY BIG-DATA.
HOW BIG? BIG.




                                             STANDARD FORMATS

                               CD                   DVD                Blu-ray
                             .75 GB                4.7 GB              25 GB
                                             COMPRESSED VIDEO

    FORMAT                     SD                 720p HD            1080p HD
Stream rate (Mbps)             1.5                   5                   8
 1 hour of content            .7 GB                2.3 GB              3.6 GB
                                            UNCOMPRESSED VIDEO

    FORMAT                     SD                 720p HD            1080p HD
Stream rate (Mbps)             125                  553                 1290
 1 hour of content           56 GB                249 GB              581 GB
                                            UNCOMPRESSED VIDEO

    FORMAT              Digital Cinema 2K     Digital Cinema 4K   3D Cinema Stream
Stream rate (Mbps)            1900                  3800                5730
 1 hour of content           855 GB               1710 GB             2579 GB

                     A single digital cinema production can be 800K–1M 2K/4K frames
FIRST MAJOR BOTTLENECKS: WAN TRANSFER
TCP PERFORMANCE: BOUND BY DESIGN




                          TCP powers:
                           • FTP
                           • SCP
                           • RSYNC
                           • HTTP
                           • CIFS
                           • NFS




                                    (
                   Throughput µ 1 RTT *    p   )
                   RTT = round trip time
                    p = packet loss rate
BIG-DATA and WAN TRANSFER WITH TCP




TCP WAS DESIGNED IN THE EARLY 80’S
 •   When data was small & bandwidth was limited
 •   Fantastic for reliable data delivery
 •   Not fast enough for big-data

TCP IS THE ENGINE THAT DRIVES
 •   FTP, HTTP & HTTPS
 •   RSYNC, SCP
 •   CIFS & NFS

TCP DOES NOT LIKE NETWORK LATENCY/ RTT
 •   Geographic distance increases latency
 •   Network congestion increases latency

TCP DOES NOT LIKE PACKET LOSS
 •   Loss is caused by congestion
 •   Different network capacity
 •   Wireless and satellite communications
ASPERA FASP: HIGH-PERFORMANCE DATA TRANSPORT




Maximum transfer speed
    •   Line-rate transfer performance
    •   Transfer performance scales with bandwidth
Uncompromising security and reliability
    •   Secure, user/endpoint authentication
    •   AES-128 cryptography in transit and at-rest

Congestion Avoidance and Policy Control
    •   Automatic, full utilization of available bandwidth
    •   On-the-fly prioritization and bandwidth allocation
Scalable management, monitoring and control
    •   Real-time progress, performance and bandwidth utilization
    •   Detailed transfer history, logging, and manifest
Low Overhead
    •   Optimal end-to-end throughput efficiency
    •   High performance with large files or large sets of small files
Enterprise-class File Transfer
    •   Transfers up to thousands of times faster than FTP
    •   Precise and predictable transfer times
SECOND MAJOR BOTTLENECKS: LOCAL HTTP I/O




1st Bottleneck - WAN




                        2nd Bottleneck — Data Center
GETTING BIG-DATA IN/OUT OF S3
SOLUTION: ASPERA ON-DEMAND DIRECT-TO-S3




    client        cargo downloader




point-to-point      mobile apps




connect plug-in
OVERCOMING BOTH BOTTLENECKS



      #1 — TRANSFER DATA TO EC2 OVER WAN                 EFFECTIVE THROUGHPUT

• HTTP transfer over WAN (single stream)
                                                                  <10 Mbps
• Typical internet conditions
  • 50–250ms latency & 0.1–3% packet loss
                                                              <10 to 100 Mbps
• 15 parallel http streams
                                                                 up to 1Gbps
• Aspera fasp transfer over WAN to EC2
                                                        (per EC2 Extra Large Instance)



       #2 — TRANSFER DATA FROM EC2 TO S3                EFFECTIVE THROUGHPUT
• Single HTTP stream                                          Up to 100 Mbps
• 15 parallel http streams
     • Must use S3 Multipart API
     • Must chuck data on r/w
                                                                Up to 1Gbps

• Aspera S3 Proxy                                               Up to 1Gbps
  • With parallel I/O http streams                      (per EC2 Extra Large Instance)


 #1 + #2 — WAN TRANSFER: ON-PREM TO/FROM TO
                                                        EFFECTIVE THROUGHPUT
                     S3

• Aspera On Demand for AWS                                      Up to 1Gbps
  • With parallel I/O http streams                      (per EC2 Extra Large Instance)
MEDIA INGEST AND STORAGE ARCHITECTURE




                                        18
BIG-DATA: ACCESSED & DELIVERED BY ASPERA




      File transfer
ASPERA SOFTWARE PRODUCT & TECHNOLOGY PORTFOLIO


               Distribute                                              Collaborate                                              Automate




Complete portfolio of servers and clients for high-      Global person-to-person and project-based               Web-based application and SDK for creating and
speed data delivery and distribution.                    exchange and collaboration of files and directories.    managing automated file-based workflows.

Enterprise and Connect Server                            faspex™ Server                                          Orchestrator
• Universal file transfer server and web-based           • Secure digital delivery and collaborative file        • Intuitive graphical workflow designer
  interface and directory listing                          transfers with remote users and partners              • File processing decision tree and flow
Client and Point-to-point                                • Web, email, mobile client options                     • Rich and flexible plug-in architecture for third-
• Uni- and bi-directional transfer clients               • Comprehensive administration, user                      party process integration
Connect                                                    management & access control                           • Comprehensive library of plug-ins for
• Web browser plug-in                                    faspex™ Multi-Server / HA                                 transcoding, A/V, QC, archive, notifications
Mobile                                                   • Automated bi-directional relays between sites         • High volume processing
• High-speed transfer for mobile devices
                                                         • 3-tier architecture with support for clustering, HA   • Detailed dashboard, workflow, and step-level
Sync                                                                                                               progress reporting.
• Highly scalable, multidirectional file replication     Cargo
                                                         • Automated package downloads                           • Open development framework for designing
  and synchronization
                                                                                                                   and integrating automation pipelines




                                                                        Transport
   Our unique, patented transport technologies provide unparalleled speed, efficiency, concurrency and bandwidth control over any size,
                                                           distance, and network
fasp™                                             fasp3™                             Aspera On-Demand S3|Direct
Patented, file-based bulk data transport          Next-gen fasp for any block-data High-speed transfer direct to cloud storage (S3)
fasp-AIR™                                         fasp-MC™                           Console transport management
3G, LTE and Wi-Fi networks                        fasp for delivery over multicast   web-based management, monitoring, and reporting
OPEN PLATFORM 3RD PARTY LIBRARY



Transcoding    Video Quality Control      Ad Insertion &
                                       Advertising Planning




                  Watermarking
                                         IT Management



                   File Transfer            Antivirus




                    Encryption
ASPERA -AWS CASE STUDIES




                        •   Internationally disperse venues and broadcasters
   International        •   Contribution, processing and AWS S3 cloud archive
 Sports Tournament
                        •   Automated processing, routing, notifications and delivery




                        •   Business critical, revenue generating system
    High Volume         •   Thousands of content and metadata files per hour
Broadcast Operations    •   Lights-out, hands-off, 7x24x365
INTERNATIONAL SPORTS TOURNAMENT




                                                                      Globally-Dispersed
                                                                        Broadcasters




                                                                               People’s
                                                                                Homes



        Media Centers at the Sports Venues




  International
Sports Tournament
INTERNATIONAL SPORTS TOURNAMENT
                                             – ASPERA FASP™ TRANSFERS




                                            International Data/Broadcast Center




                                                                                    •HD
                                                                                  •Metadata

                              fasp
                    HD + Metadata                                                                                  fasp


  Sports Venue
  Media Center
                                                                                                               Broadcasters


                                                            •Low-Res Proxies
                                                            •Audio                            Globally-Dispersed
                                                  fasp      •Metadata                            Broadcasters




                                                                                                     People’
                                                                                                        s
                                      Content                                                        Homes
                                     Web Portal


  International
Sports Tournament
INTERNATIONAL SPORTS TOURNAMENT – WORKFLOW
                                   ORCHESTRATION


                               International Data/Broadcast Center
                                On-going:                        On-going:
                                • R/T monitoring                 • Cloud monitoring
                                • Notifications                  • HA management


                                                1. Detect arrival
                                                2. Notify Operations

                                   Aspera Orchestrator: Controlled                                              fasp
                      fasp
                                Processing and Distribution Workflow




                                                                                                       fasp
               HD + Metadata
                                               3. Stage for processing
Sports Venue                                   4. Detect processed content
Media Center                                   5. Transfer HD to AWS
                                               6. Transfer Low-Res to Portal
                                                                                           Globally-Dispersed
                                                                                             Broadcasters




                                                                                                  People’
                                                          fasp




                                                                                                     s
                                                                                                  Homes
                                                                       Aspera Faspex API
                                                                       call for remote
                                     Content                           package creation
                                       Web                             and distribution
   International                      Portal
 Sports Tournament
NETFLIX & THE CLOUD
Netflix
           Post    Netflix
Vendors                       Cloud     CDN’s
          Houses   Staging
                             Encoding
   Tens of TB arriving each month

   Even bigger spikes before a new region launch

   Files up to hundreds of GB in size

   Multiple vendors and post houses delivering to us
    from across the world
   Proprietary hardware is painful
   And doesn’t scale well
   And doesn’t scale quickly!
   Vendors claim delivery when they haven’t
    delivered
more encoding as each axis grows



            2012
                   Content Catalog




            2007

                                            Device Ecosystem
                                     2007                      2012
   At Netflix
     For better business agility
     For unpredictable business growth
     We want to use clouds, not build them
      ▪ Our raison d’etre is movies, not datacenters
   In Encoding Operations
     For response to spikes of content
      ▪ Big launch days
      ▪ Entire region launches
      ▪ New device launches (Wii, PS3, iPad etc)
     Vast unified pool of resources
   No cloud quite like AWS at the moment
     Literally thousands of machines can be
     transcoding at any one time
   Amazon is also a great Netflix partner
   Open to multiple clouds when they can meet
    our scale requirements
   Direct delivery into Amazon S3 Cloud
   100% scalable
   One less hop
   We could build something suitable
     But is our time best spent here?
     And how much time would we need to try and
     shift an industry in this area?
   Buying makes more sense
     Focus: We aren’t the only company with this need
     Talent density: We spend money to license the
     technology, but we gain even more talent and
     bandwidth to solve Netflix specific problems
   Industry recognized digital delivery
    technology
   Excellent core product
     Optimized for huge file transfers under adverse
      network conditions
     Built in monitoring and controls
     Extensive structured logging for diagnosing issues
   Strong and responsive support team
   Worrying about disk space
   Months of lag time to scale out
   Distracting IT with proprietary hardware
   Building for spikes instead of averages



      We get to spend more time growing and less
      time worrying about the logistics of growth
14




             QUESTIONS?
             bhavik@asperasoft.com




Distribute               Collaborate   Automate

More Related Content

What's hot

Ruby conf2010 OpenPaaS
Ruby conf2010 OpenPaaSRuby conf2010 OpenPaaS
Ruby conf2010 OpenPaaS
Derek Collison
 
AKUDA Labs: Pulsar
AKUDA Labs: PulsarAKUDA Labs: Pulsar
AKUDA Labs: Pulsar
AKUDA Labs
 
Portrait of the Developer As "The Artist" - English Version
Portrait of the Developer As "The Artist" - English VersionPortrait of the Developer As "The Artist" - English Version
Portrait of the Developer As "The Artist" - English Version
Patrick Chanezon
 
Cloud Foundry Japan Community Meetup
Cloud Foundry Japan Community MeetupCloud Foundry Japan Community Meetup
Cloud Foundry Japan Community Meetup
Patrick Chanezon
 
HDFS Selective Wire Encryption
HDFS Selective Wire EncryptionHDFS Selective Wire Encryption
HDFS Selective Wire Encryption
Konstantin V. Shvachko
 

What's hot (20)

Netflix on Cloud - combined slides for Dev and Ops
Netflix on Cloud - combined slides for Dev and OpsNetflix on Cloud - combined slides for Dev and Ops
Netflix on Cloud - combined slides for Dev and Ops
 
The Lean Cloud for Startups with AWS - Architectural Best Practices & Automat...
The Lean Cloud for Startups with AWS - Architectural Best Practices & Automat...The Lean Cloud for Startups with AWS - Architectural Best Practices & Automat...
The Lean Cloud for Startups with AWS - Architectural Best Practices & Automat...
 
OSCON Data 2011 -- NoSQL @ Netflix, Part 2
OSCON Data 2011 -- NoSQL @ Netflix, Part 2OSCON Data 2011 -- NoSQL @ Netflix, Part 2
OSCON Data 2011 -- NoSQL @ Netflix, Part 2
 
Ruby conf2010 OpenPaaS
Ruby conf2010 OpenPaaSRuby conf2010 OpenPaaS
Ruby conf2010 OpenPaaS
 
#lspe: Dynamic Scaling
#lspe: Dynamic Scaling #lspe: Dynamic Scaling
#lspe: Dynamic Scaling
 
Google Compute and MapR
Google Compute and MapRGoogle Compute and MapR
Google Compute and MapR
 
Networking in the Cloud Age (LISA 2012 Tutorial)
Networking in the Cloud Age (LISA 2012 Tutorial)Networking in the Cloud Age (LISA 2012 Tutorial)
Networking in the Cloud Age (LISA 2012 Tutorial)
 
Netflix Architecture Tutorial at Gluecon
Netflix Architecture Tutorial at GlueconNetflix Architecture Tutorial at Gluecon
Netflix Architecture Tutorial at Gluecon
 
Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...
Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...
Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...
 
From 0 to syncing
From 0 to syncingFrom 0 to syncing
From 0 to syncing
 
AKUDA Labs: Pulsar
AKUDA Labs: PulsarAKUDA Labs: Pulsar
AKUDA Labs: Pulsar
 
Portrait of the Developer As "The Artist" - English Version
Portrait of the Developer As "The Artist" - English VersionPortrait of the Developer As "The Artist" - English Version
Portrait of the Developer As "The Artist" - English Version
 
Netflix Edge Engineering Open House Presentations - June 9, 2016
Netflix Edge Engineering Open House Presentations - June 9, 2016Netflix Edge Engineering Open House Presentations - June 9, 2016
Netflix Edge Engineering Open House Presentations - June 9, 2016
 
Cloud Foundry Japan Community Meetup
Cloud Foundry Japan Community MeetupCloud Foundry Japan Community Meetup
Cloud Foundry Japan Community Meetup
 
Fraud Detection Architecture
Fraud Detection ArchitectureFraud Detection Architecture
Fraud Detection Architecture
 
HDFS Selective Wire Encryption
HDFS Selective Wire EncryptionHDFS Selective Wire Encryption
HDFS Selective Wire Encryption
 
Spotify: Horizontal Scalability for Great Success
Spotify: Horizontal Scalability for Great SuccessSpotify: Horizontal Scalability for Great Success
Spotify: Horizontal Scalability for Great Success
 
Scalable Media Workflows in the Cloud
Scalable Media Workflows in the CloudScalable Media Workflows in the Cloud
Scalable Media Workflows in the Cloud
 
AWS re:Invent presentation: Unmeltable Infrastructure at Scale by Loggly
AWS re:Invent presentation: Unmeltable Infrastructure at Scale by Loggly AWS re:Invent presentation: Unmeltable Infrastructure at Scale by Loggly
AWS re:Invent presentation: Unmeltable Infrastructure at Scale by Loggly
 
(NET409) How Twilio Migrated Its Services from EC2-Classic to EC2-VPC
(NET409) How Twilio Migrated Its Services from EC2-Classic to EC2-VPC(NET409) How Twilio Migrated Its Services from EC2-Classic to EC2-VPC
(NET409) How Twilio Migrated Its Services from EC2-Classic to EC2-VPC
 

Viewers also liked

How to Extend your Datacenter into the Cloud - 2nd Watch - Webinar
How to Extend your Datacenter into the Cloud - 2nd Watch - WebinarHow to Extend your Datacenter into the Cloud - 2nd Watch - Webinar
How to Extend your Datacenter into the Cloud - 2nd Watch - Webinar
Amazon Web Services
 

Viewers also liked (7)

Accelerating Your Connection to the Cloud
Accelerating Your Connection to the CloudAccelerating Your Connection to the Cloud
Accelerating Your Connection to the Cloud
 
AWS Introduction - Ryland
AWS Introduction - RylandAWS Introduction - Ryland
AWS Introduction - Ryland
 
ARC205 Building Web-scale Applications Architectures with AWS - AWS re: Inven...
ARC205 Building Web-scale Applications Architectures with AWS - AWS re: Inven...ARC205 Building Web-scale Applications Architectures with AWS - AWS re: Inven...
ARC205 Building Web-scale Applications Architectures with AWS - AWS re: Inven...
 
How to Extend your Datacenter into the Cloud - 2nd Watch - Webinar
How to Extend your Datacenter into the Cloud - 2nd Watch - WebinarHow to Extend your Datacenter into the Cloud - 2nd Watch - Webinar
How to Extend your Datacenter into the Cloud - 2nd Watch - Webinar
 
Implementing FISMA Moderate Applications on AWS
Implementing FISMA Moderate Applications on AWSImplementing FISMA Moderate Applications on AWS
Implementing FISMA Moderate Applications on AWS
 
BDT101 Big Data with Amazon Elastic MapReduce - AWS re: Invent 2012
BDT101 Big Data with Amazon Elastic MapReduce - AWS re: Invent 2012BDT101 Big Data with Amazon Elastic MapReduce - AWS re: Invent 2012
BDT101 Big Data with Amazon Elastic MapReduce - AWS re: Invent 2012
 
Big Data and the Cloud a Best Friend Story
Big Data and the Cloud a Best Friend StoryBig Data and the Cloud a Best Friend Story
Big Data and the Cloud a Best Friend Story
 

Similar to Delivering on the promise of the cloud for digital media, aspera on demand

Hp aspera-big data cloud-v2
Hp aspera-big data cloud-v2Hp aspera-big data cloud-v2
Hp aspera-big data cloud-v2
dkumiaspera
 
(MED305) Achieving Consistently High Throughput for Very Large Data Transfers...
(MED305) Achieving Consistently High Throughput for Very Large Data Transfers...(MED305) Achieving Consistently High Throughput for Very Large Data Transfers...
(MED305) Achieving Consistently High Throughput for Very Large Data Transfers...
Amazon Web Services
 
Building high performance microservices in finance with Apache Thrift
Building high performance microservices in finance with Apache ThriftBuilding high performance microservices in finance with Apache Thrift
Building high performance microservices in finance with Apache Thrift
RX-M Enterprises LLC
 
Ip, the internet & its impact on the maritime industry paul jolley-v1-2012
Ip, the internet & its impact on the maritime industry paul jolley-v1-2012Ip, the internet & its impact on the maritime industry paul jolley-v1-2012
Ip, the internet & its impact on the maritime industry paul jolley-v1-2012
Wire & Ether Communications
 

Similar to Delivering on the promise of the cloud for digital media, aspera on demand (20)

Hp aspera-big data cloud-v2
Hp aspera-big data cloud-v2Hp aspera-big data cloud-v2
Hp aspera-big data cloud-v2
 
(MED305) Achieving Consistently High Throughput for Very Large Data Transfers...
(MED305) Achieving Consistently High Throughput for Very Large Data Transfers...(MED305) Achieving Consistently High Throughput for Very Large Data Transfers...
(MED305) Achieving Consistently High Throughput for Very Large Data Transfers...
 
AWS re:Invent - Med305 Achieving consistently high throughput for very large ...
AWS re:Invent - Med305 Achieving consistently high throughput for very large ...AWS re:Invent - Med305 Achieving consistently high throughput for very large ...
AWS re:Invent - Med305 Achieving consistently high throughput for very large ...
 
IBM Aspera overview
IBM Aspera overview IBM Aspera overview
IBM Aspera overview
 
Shoot the Bird: Linear Broadcast Distribution on AWS by Usman Shakeel of Amaz...
Shoot the Bird: Linear Broadcast Distribution on AWS by Usman Shakeel of Amaz...Shoot the Bird: Linear Broadcast Distribution on AWS by Usman Shakeel of Amaz...
Shoot the Bird: Linear Broadcast Distribution on AWS by Usman Shakeel of Amaz...
 
Html5 web sockets - Brad Drysdale - London Web 2011-10-20
Html5 web sockets - Brad Drysdale - London Web 2011-10-20Html5 web sockets - Brad Drysdale - London Web 2011-10-20
Html5 web sockets - Brad Drysdale - London Web 2011-10-20
 
IBM Aspera for High Speed Data Migration to Your AWS Cloud - DEM06-S - Anahei...
IBM Aspera for High Speed Data Migration to Your AWS Cloud - DEM06-S - Anahei...IBM Aspera for High Speed Data Migration to Your AWS Cloud - DEM06-S - Anahei...
IBM Aspera for High Speed Data Migration to Your AWS Cloud - DEM06-S - Anahei...
 
Building high performance microservices in finance with Apache Thrift
Building high performance microservices in finance with Apache ThriftBuilding high performance microservices in finance with Apache Thrift
Building high performance microservices in finance with Apache Thrift
 
Billions of Messages in Real Time: Why Paypal & LinkedIn Trust an Engagement ...
Billions of Messages in Real Time: Why Paypal & LinkedIn Trust an Engagement ...Billions of Messages in Real Time: Why Paypal & LinkedIn Trust an Engagement ...
Billions of Messages in Real Time: Why Paypal & LinkedIn Trust an Engagement ...
 
IBM Aspera for high-speed data migration to your AWS Cloud - DEM02-S - New Yo...
IBM Aspera for high-speed data migration to your AWS Cloud - DEM02-S - New Yo...IBM Aspera for high-speed data migration to your AWS Cloud - DEM02-S - New Yo...
IBM Aspera for high-speed data migration to your AWS Cloud - DEM02-S - New Yo...
 
Netflix Massively Scalable, Highly Available, Immutable Infrastructure
Netflix Massively Scalable, Highly Available, Immutable InfrastructureNetflix Massively Scalable, Highly Available, Immutable Infrastructure
Netflix Massively Scalable, Highly Available, Immutable Infrastructure
 
An Introduction to FileCatalyst
An Introduction to FileCatalystAn Introduction to FileCatalyst
An Introduction to FileCatalyst
 
Nokta techpresentation
Nokta techpresentationNokta techpresentation
Nokta techpresentation
 
PLNOG 8: Kazimierz Jantas - Innowacyjne rozwiązania dla IT
PLNOG 8: Kazimierz Jantas - Innowacyjne rozwiązania dla IT PLNOG 8: Kazimierz Jantas - Innowacyjne rozwiązania dla IT
PLNOG 8: Kazimierz Jantas - Innowacyjne rozwiązania dla IT
 
Stream processing on mobile networks
Stream processing on mobile networksStream processing on mobile networks
Stream processing on mobile networks
 
Scale Your Load Balancer from 0 to 1 million TPS on Azure
Scale Your Load Balancer from 0 to 1 million TPS on AzureScale Your Load Balancer from 0 to 1 million TPS on Azure
Scale Your Load Balancer from 0 to 1 million TPS on Azure
 
Accelerate file transfers with a software defined media network
Accelerate file transfers with a software defined media network Accelerate file transfers with a software defined media network
Accelerate file transfers with a software defined media network
 
Ip, the internet & its impact on the maritime industry paul jolley-v1-2012
Ip, the internet & its impact on the maritime industry paul jolley-v1-2012Ip, the internet & its impact on the maritime industry paul jolley-v1-2012
Ip, the internet & its impact on the maritime industry paul jolley-v1-2012
 
Silver Peak presentation used during the SWITCHPOINT NV/SA Quarterly Experien...
Silver Peak presentation used during the SWITCHPOINT NV/SA Quarterly Experien...Silver Peak presentation used during the SWITCHPOINT NV/SA Quarterly Experien...
Silver Peak presentation used during the SWITCHPOINT NV/SA Quarterly Experien...
 
5G Cellular D2D RDMA Clusters
5G Cellular D2D RDMA Clusters5G Cellular D2D RDMA Clusters
5G Cellular D2D RDMA Clusters
 

More from Amazon Web Services

Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
Amazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
Amazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
Amazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
Amazon Web Services
 

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Recently uploaded

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 

Recently uploaded (20)

JavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuideJavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate Guide
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Design and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data ScienceDesign and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data Science
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
Stronger Together: Developing an Organizational Strategy for Accessible Desig...
Stronger Together: Developing an Organizational Strategy for Accessible Desig...Stronger Together: Developing an Organizational Strategy for Accessible Desig...
Stronger Together: Developing an Organizational Strategy for Accessible Desig...
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Less Is More: Utilizing Ballerina to Architect a Cloud Data Platform
Less Is More: Utilizing Ballerina to Architect a Cloud Data PlatformLess Is More: Utilizing Ballerina to Architect a Cloud Data Platform
Less Is More: Utilizing Ballerina to Architect a Cloud Data Platform
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 

Delivering on the promise of the cloud for digital media, aspera on demand

  • 1. Delivering on the Promise of the Cloud for Digital Media Aspera OnDemand Bhavik Vyas | Director of Cloud Solutions & Partnerships | 14 th June 2012
  • 2. ASPERA SOFTWARE INC Creating next-generation transport technologies that move the world’s digital assets at maximum speed, regardless of file size, transfer distance and network conditions. Distribute Collaborate Automate 14 Transport
  • 3. Aspera Corporate Overview Headquarters: Emeryville, CA Founded: 2004 Ownership: Privately Held Employees: ~100 Patents: Issued and pending in over 32 countries Customers: over 1,200 customers, over 10,000 licenses deployed Markets Served: Media and Entertainment, Federal Government, Life Sciences, Healthcare, Cloud Computing, Software and Gaming, Financial Services, Legal, eDiscovery, Engineering, Technology, Telecommunications, Service Providers, Architecture and Design, Enterprise IT Creators of the fasp™ protocol • Innovative, patented, highly efficient bulk data transport technology • Unique and core to Aspera’s high-performance file transfer software suite • Outperforms software and hardware WAN acceleration solutions • Ranked first in every WAN transfer throughput benchmark
  • 5. THE MEDIA CLOUD?... IT’S HERE. Thursday, March 8, 2012, New York, NY Aspera, Amazon Web Services and Zencoder teamed up for a special event at New York City’s Tribeca Grand Hotel on Thursday, March 8th, 2012. During this afternoon of presentations by industry experts, attendees experienced what is now possible in the cloud for digital media companies.
  • 6. ASPERA PRODUCT & TECHNOLOGY PORTFOLIO DISTRIBUTE COLLABORATE AUTOMATE Complete portfolio of Global person-to-person Web-based application servers and clients for and project-based and SDK for creating and high-speed data delivery exchange and managing automated file- and distribution. collaboration of files based workflows. and directories. TRANSPORT Our unique, patented faspTM transport technologies provide unparalleled speed, efficiency, and bandwidth control over any size, distance, and network.
  • 9. HOW BIG? BIG. STANDARD FORMATS CD DVD Blu-ray .75 GB 4.7 GB 25 GB COMPRESSED VIDEO FORMAT SD 720p HD 1080p HD Stream rate (Mbps) 1.5 5 8 1 hour of content .7 GB 2.3 GB 3.6 GB UNCOMPRESSED VIDEO FORMAT SD 720p HD 1080p HD Stream rate (Mbps) 125 553 1290 1 hour of content 56 GB 249 GB 581 GB UNCOMPRESSED VIDEO FORMAT Digital Cinema 2K Digital Cinema 4K 3D Cinema Stream Stream rate (Mbps) 1900 3800 5730 1 hour of content 855 GB 1710 GB 2579 GB A single digital cinema production can be 800K–1M 2K/4K frames
  • 10. FIRST MAJOR BOTTLENECKS: WAN TRANSFER
  • 11. TCP PERFORMANCE: BOUND BY DESIGN TCP powers: • FTP • SCP • RSYNC • HTTP • CIFS • NFS ( Throughput µ 1 RTT * p ) RTT = round trip time p = packet loss rate
  • 12. BIG-DATA and WAN TRANSFER WITH TCP TCP WAS DESIGNED IN THE EARLY 80’S • When data was small & bandwidth was limited • Fantastic for reliable data delivery • Not fast enough for big-data TCP IS THE ENGINE THAT DRIVES • FTP, HTTP & HTTPS • RSYNC, SCP • CIFS & NFS TCP DOES NOT LIKE NETWORK LATENCY/ RTT • Geographic distance increases latency • Network congestion increases latency TCP DOES NOT LIKE PACKET LOSS • Loss is caused by congestion • Different network capacity • Wireless and satellite communications
  • 13. ASPERA FASP: HIGH-PERFORMANCE DATA TRANSPORT Maximum transfer speed • Line-rate transfer performance • Transfer performance scales with bandwidth Uncompromising security and reliability • Secure, user/endpoint authentication • AES-128 cryptography in transit and at-rest Congestion Avoidance and Policy Control • Automatic, full utilization of available bandwidth • On-the-fly prioritization and bandwidth allocation Scalable management, monitoring and control • Real-time progress, performance and bandwidth utilization • Detailed transfer history, logging, and manifest Low Overhead • Optimal end-to-end throughput efficiency • High performance with large files or large sets of small files Enterprise-class File Transfer • Transfers up to thousands of times faster than FTP • Precise and predictable transfer times
  • 14. SECOND MAJOR BOTTLENECKS: LOCAL HTTP I/O 1st Bottleneck - WAN 2nd Bottleneck — Data Center
  • 16. SOLUTION: ASPERA ON-DEMAND DIRECT-TO-S3 client cargo downloader point-to-point mobile apps connect plug-in
  • 17. OVERCOMING BOTH BOTTLENECKS #1 — TRANSFER DATA TO EC2 OVER WAN EFFECTIVE THROUGHPUT • HTTP transfer over WAN (single stream) <10 Mbps • Typical internet conditions • 50–250ms latency & 0.1–3% packet loss <10 to 100 Mbps • 15 parallel http streams up to 1Gbps • Aspera fasp transfer over WAN to EC2 (per EC2 Extra Large Instance) #2 — TRANSFER DATA FROM EC2 TO S3 EFFECTIVE THROUGHPUT • Single HTTP stream Up to 100 Mbps • 15 parallel http streams • Must use S3 Multipart API • Must chuck data on r/w Up to 1Gbps • Aspera S3 Proxy Up to 1Gbps • With parallel I/O http streams (per EC2 Extra Large Instance) #1 + #2 — WAN TRANSFER: ON-PREM TO/FROM TO EFFECTIVE THROUGHPUT S3 • Aspera On Demand for AWS Up to 1Gbps • With parallel I/O http streams (per EC2 Extra Large Instance)
  • 18. MEDIA INGEST AND STORAGE ARCHITECTURE 18
  • 19. BIG-DATA: ACCESSED & DELIVERED BY ASPERA File transfer
  • 20. ASPERA SOFTWARE PRODUCT & TECHNOLOGY PORTFOLIO Distribute Collaborate Automate Complete portfolio of servers and clients for high- Global person-to-person and project-based Web-based application and SDK for creating and speed data delivery and distribution. exchange and collaboration of files and directories. managing automated file-based workflows. Enterprise and Connect Server faspex™ Server Orchestrator • Universal file transfer server and web-based • Secure digital delivery and collaborative file • Intuitive graphical workflow designer interface and directory listing transfers with remote users and partners • File processing decision tree and flow Client and Point-to-point • Web, email, mobile client options • Rich and flexible plug-in architecture for third- • Uni- and bi-directional transfer clients • Comprehensive administration, user party process integration Connect management & access control • Comprehensive library of plug-ins for • Web browser plug-in faspex™ Multi-Server / HA transcoding, A/V, QC, archive, notifications Mobile • Automated bi-directional relays between sites • High volume processing • High-speed transfer for mobile devices • 3-tier architecture with support for clustering, HA • Detailed dashboard, workflow, and step-level Sync progress reporting. • Highly scalable, multidirectional file replication Cargo • Automated package downloads • Open development framework for designing and synchronization and integrating automation pipelines Transport Our unique, patented transport technologies provide unparalleled speed, efficiency, concurrency and bandwidth control over any size, distance, and network fasp™ fasp3™ Aspera On-Demand S3|Direct Patented, file-based bulk data transport Next-gen fasp for any block-data High-speed transfer direct to cloud storage (S3) fasp-AIR™ fasp-MC™ Console transport management 3G, LTE and Wi-Fi networks fasp for delivery over multicast web-based management, monitoring, and reporting
  • 21. OPEN PLATFORM 3RD PARTY LIBRARY Transcoding Video Quality Control Ad Insertion & Advertising Planning Watermarking IT Management File Transfer Antivirus Encryption
  • 22. ASPERA -AWS CASE STUDIES • Internationally disperse venues and broadcasters International • Contribution, processing and AWS S3 cloud archive Sports Tournament • Automated processing, routing, notifications and delivery • Business critical, revenue generating system High Volume • Thousands of content and metadata files per hour Broadcast Operations • Lights-out, hands-off, 7x24x365
  • 23. INTERNATIONAL SPORTS TOURNAMENT Globally-Dispersed Broadcasters People’s Homes Media Centers at the Sports Venues International Sports Tournament
  • 24. INTERNATIONAL SPORTS TOURNAMENT – ASPERA FASP™ TRANSFERS International Data/Broadcast Center •HD •Metadata fasp HD + Metadata fasp Sports Venue Media Center Broadcasters •Low-Res Proxies •Audio Globally-Dispersed fasp •Metadata Broadcasters People’ s Content Homes Web Portal International Sports Tournament
  • 25. INTERNATIONAL SPORTS TOURNAMENT – WORKFLOW ORCHESTRATION International Data/Broadcast Center On-going: On-going: • R/T monitoring • Cloud monitoring • Notifications • HA management 1. Detect arrival 2. Notify Operations Aspera Orchestrator: Controlled fasp fasp Processing and Distribution Workflow fasp HD + Metadata 3. Stage for processing Sports Venue 4. Detect processed content Media Center 5. Transfer HD to AWS 6. Transfer Low-Res to Portal Globally-Dispersed Broadcasters People’ fasp s Homes Aspera Faspex API call for remote Content package creation Web and distribution International Portal Sports Tournament
  • 26. NETFLIX & THE CLOUD
  • 27. Netflix Post Netflix Vendors Cloud CDN’s Houses Staging Encoding
  • 28. Tens of TB arriving each month  Even bigger spikes before a new region launch  Files up to hundreds of GB in size  Multiple vendors and post houses delivering to us from across the world
  • 29. Proprietary hardware is painful  And doesn’t scale well  And doesn’t scale quickly!  Vendors claim delivery when they haven’t delivered
  • 30. more encoding as each axis grows 2012 Content Catalog 2007 Device Ecosystem 2007 2012
  • 31. At Netflix  For better business agility  For unpredictable business growth  We want to use clouds, not build them ▪ Our raison d’etre is movies, not datacenters  In Encoding Operations  For response to spikes of content ▪ Big launch days ▪ Entire region launches ▪ New device launches (Wii, PS3, iPad etc)  Vast unified pool of resources
  • 32. No cloud quite like AWS at the moment  Literally thousands of machines can be transcoding at any one time  Amazon is also a great Netflix partner  Open to multiple clouds when they can meet our scale requirements
  • 33. Direct delivery into Amazon S3 Cloud  100% scalable  One less hop
  • 34. We could build something suitable  But is our time best spent here?  And how much time would we need to try and shift an industry in this area?  Buying makes more sense  Focus: We aren’t the only company with this need  Talent density: We spend money to license the technology, but we gain even more talent and bandwidth to solve Netflix specific problems
  • 35. Industry recognized digital delivery technology  Excellent core product  Optimized for huge file transfers under adverse network conditions  Built in monitoring and controls  Extensive structured logging for diagnosing issues  Strong and responsive support team
  • 36. Worrying about disk space  Months of lag time to scale out  Distracting IT with proprietary hardware  Building for spikes instead of averages We get to spend more time growing and less time worrying about the logistics of growth
  • 37. 14 QUESTIONS? bhavik@asperasoft.com Distribute Collaborate Automate