SlideShare a Scribd company logo
503
Service Temporarily Unavailable

The server is temporarily unable
 to service your request due to
maintenance downtime or capacity
problems. Please try again later.
503
Service Temporarily Unavailable

The server is temporarily unable
 to service your request due to
maintenance downtime or capacity
problems. Please try again later.
Content Delivery
Do-It-Yourself Headaches
                                      Bandwidth
                                       capacity

              Uptime

                                                  Download
                                                   speed



        Concurrent
        connections




             Acceptable
              latency
                          ?                   Audit
                                                      Access
                                                      control




                                              logs
                          Customer
                          locations
OFFLOAD static content
• reduce your compute demand and costs
• improve end-user experience
• increase reliability and durability


              +
ENTIRE SITE via CloudFront
• minimize client-server chatter (keep it at the edge)
• reduce server-database traffic (cache the common
  calls)
• speed up mobile app response (persistent connections)

              +
LOAD BALANCE from the start
• uninterrupted growth and evolution
• ready for massive scale, high reliability
• stateless and redundant array
                                              Availability Zone




                                              Availability Zone
REAL-TIME reaction response
•   notification of pending news flash (with audible alarm)
•   on-demand ramp up of capacity (6 mins.)
•   subscriber alert push delivered
•   mass response traffic handled (followed by ramp down)
http://guidebook.com/getit/
$52 / hr day
       14
                                              Daily CPU load


       12
       10
        8
Load




        6                                      25% savings
        4
        2
        0
            1   2   3   4   5   6   7   8   9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
                                                       $15 / hr night
                                                    Hour



            Optimize by the time of day
DATABASE smarts
•   enhance reliability, ensure data safety
•   optimal performance, minimize load
•   scale out and share work
•
                                              Availability Zone
    cost reduction




                                              Availability Zone
A/B TEST experiment, evolve
• inexpensive idea validation
• seamless switch over and versioning
• rapid dev / test agility
What is                         ?
            is a global byte-sized content-based application platform that
enables fast and seamless consumption of information from any mobile device



       ACTIVE USERS                        APPS           MONTHLY TRANSACTIONS




                  Try it: text @wiki internet to 898932
The beginning…
January 2011 -
A two member engineering team sets out to create an initial prototype
                       for the product….



        Concept                Code                Infrastructure




                  Try it: text @movies to 898932
What we needed…

Seamless scaling

No upfront investment

Rapid experimentation

Focus on building product rather than running operations




                      Try it: text @nasdaq Amazon to 898932
The Answer


Try it: text @weather to 898932
The benefits AWS provided…

Quick & fast deployment allowed validating ideas/hypothesis

Scale up/out without any hassles

No costs on IT staff-management

Agile, test-driven environment, ability to quickly view and compare results




                       Try it: text @linkedin to 898932
txtWeb architecture overview …


                                            txtWeb
                                                     3rd party apps
End    Cellular     SMS
user   service     gateway




                  Try it: text @goog to 898932
Early days with AWS…
February 2011 -
                            Series of architectural + performance A/B tests


                  Lots of EC2 servers                                 Small Amazon RDS server




                         Try it: text @imdb Inception to 898932
And then…

     Fewer EC2 servers                  Large Amazon RDS server




           Try it: text @fb to 898932
Surprising workloads…
                                                                             1,400,000

                                                                                                                            12 servers
                                                                             1,200,000
March-April 2011 – The cricket World Cup brought in a
surge of requests to our platform in no time, from 10,000                    1,000,000
to 1,000,000 requests/day (100x more)




                                                            Requests / day
                                                                              800,000

                                                                              600,000

                                                                              400,000

                                                                              200,000
                                                                                               2 servers
                                                                                    0
                                                                                    December         January          February      March
                                                                                                               2011




                          Try it: text @tweetbytes to 898932
Elastic needs…                                                                                                                                   30,000


                          8           Number of Servers        Load
                                                                                                                                                             25,000




                          6                                                                                                                                  20,000
Number of EC2 instances




                                                                                                                                                                      Peak requests / minute
                                                                                                                                                             15,000
                          4


                                                                                                                                                             10,000


                          2
                                                                                                                                                             5,000




                          0                                                                                                                                  0
                              0   1   2   3     4    5     6    7     8   9     10      11     12    13    14   15   16   17   18   19   20   21   22   23
                                                                              Hour of the day (March 2011)



                                                         Try it: text @cricket to 898932
100   server hours per day using elastic scaling
                       vs.

  192 server hours per day without
   = 48% cost savings




  Try it: text @clues to 898932
Amazon
                                                       Route53


End        Cellular     Operator        SMS
user       service                   aggregator




                                                                      EC2                         EC2
                      CloudWatch    Auto Scaling
                         alarm         trigger                   Availability Zone 1         Availability Zone 2


                                                                        Auto Scaling group                            3rd party apps


                      CloudWatch




                        Amazon S3                                                                            Elasti
                          S3           EMR                  DDB                        RDS
                                                                                                             Cache
 Corporate data
     center


                         Try it: text @sportkit to 898932
Architectural changes …
  Increased load on database                     Introduced Amazon ElastiCache layer in
                                                 May 2011


  Increased write-heavy needs                    Transactional data logged into Amazon
                                                 DynamoDB


       Auto Scaling metrics                      Published CloudWatch custom metric used to
                                                 trigger Auto Scaling




                  Try it: text @word to 898932
We are sincerely eager to
 hear your feedback on this
presentation and on re:Invent.

 Please fill out an evaluation
   form when you have a
            chance.

More Related Content

What's hot

Xs sho niboshi
Xs sho niboshiXs sho niboshi
Xs sho niboshi
The Linux Foundation
 
Ram chinta hug-20120922-v1
Ram chinta hug-20120922-v1Ram chinta hug-20120922-v1
Ram chinta hug-20120922-v1
Ram Chinta
 
Choosing Your Windows Azure Platform Strategy
Choosing Your Windows Azure Platform StrategyChoosing Your Windows Azure Platform Strategy
Choosing Your Windows Azure Platform Strategy
drmarcustillett
 
Leveraging the azure cloud for your mobile apps
Leveraging the azure cloud for your mobile appsLeveraging the azure cloud for your mobile apps
Leveraging the azure cloud for your mobile apps
Marcel de Vries
 
Leverage Azure and SQL Azure to build SaaS applications
Leverage Azure and SQL Azure to build SaaS applications Leverage Azure and SQL Azure to build SaaS applications
Leverage Azure and SQL Azure to build SaaS applications
Common Sense
 
Windows Azure Uzerinden Alinabilen Hizmetler
Windows Azure Uzerinden Alinabilen HizmetlerWindows Azure Uzerinden Alinabilen Hizmetler
Windows Azure Uzerinden Alinabilen Hizmetler
Mustafa
 
another day, another billion packets
another day, another billion packetsanother day, another billion packets
another day, another billion packets
Amazon Web Services
 
Another Day, Another Billion Packets
Another Day, Another Billion PacketsAnother Day, Another Billion Packets
Another Day, Another Billion Packets
Amazon Web Services
 
OSCON Data 2011 -- NoSQL @ Netflix, Part 2
OSCON Data 2011 -- NoSQL @ Netflix, Part 2OSCON Data 2011 -- NoSQL @ Netflix, Part 2
OSCON Data 2011 -- NoSQL @ Netflix, Part 2
Sid Anand
 
Windows Azure Design Patterns
Windows Azure Design PatternsWindows Azure Design Patterns
Windows Azure Design Patterns
David Pallmann
 
Games + Amazon = Love - Presentation quo vadis 2011
Games + Amazon = Love - Presentation quo vadis 2011Games + Amazon = Love - Presentation quo vadis 2011
Games + Amazon = Love - Presentation quo vadis 2011
Thomas Lobinger
 
AWS for Start-ups - Architectural Best Practices & Automating Your Infrastruc...
AWS for Start-ups - Architectural Best Practices & Automating Your Infrastruc...AWS for Start-ups - Architectural Best Practices & Automating Your Infrastruc...
AWS for Start-ups - Architectural Best Practices & Automating Your Infrastruc...
Amazon Web Services
 
AWS Update | London - Performance Update and Provisioned IOPS
AWS Update | London - Performance Update and Provisioned IOPSAWS Update | London - Performance Update and Provisioned IOPS
AWS Update | London - Performance Update and Provisioned IOPS
Amazon Web Services
 
1 Introduction at CloudStack Developer Day
1 Introduction at CloudStack Developer Day 1 Introduction at CloudStack Developer Day
1 Introduction at CloudStack Developer Day
Kimihiko Kitase
 
Netflix in the cloud 2011
Netflix in the cloud 2011Netflix in the cloud 2011
Netflix in the cloud 2011
Adrian Cockcroft
 
Another Day, Another Billion Packets
Another Day, Another Billion PacketsAnother Day, Another Billion Packets
Another Day, Another Billion Packets
Amazon Web Services
 
AWS Summit Auckland 2014 | Running your First Application on AWS
AWS Summit Auckland 2014 | Running your First Application on AWSAWS Summit Auckland 2014 | Running your First Application on AWS
AWS Summit Auckland 2014 | Running your First Application on AWS
Amazon Web Services
 
CloudFest Denver Windows Azure Design Patterns
CloudFest Denver Windows Azure Design PatternsCloudFest Denver Windows Azure Design Patterns
CloudFest Denver Windows Azure Design Patterns
David Pallmann
 
Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...
Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...
Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...
Adrian Cockcroft
 
MetaCDN: Enabling High Performance, Low Cost Content Storage and Delivery via...
MetaCDN: Enabling High Performance, Low Cost Content Storage and Delivery via...MetaCDN: Enabling High Performance, Low Cost Content Storage and Delivery via...
MetaCDN: Enabling High Performance, Low Cost Content Storage and Delivery via...
James Broberg
 

What's hot (20)

Xs sho niboshi
Xs sho niboshiXs sho niboshi
Xs sho niboshi
 
Ram chinta hug-20120922-v1
Ram chinta hug-20120922-v1Ram chinta hug-20120922-v1
Ram chinta hug-20120922-v1
 
Choosing Your Windows Azure Platform Strategy
Choosing Your Windows Azure Platform StrategyChoosing Your Windows Azure Platform Strategy
Choosing Your Windows Azure Platform Strategy
 
Leveraging the azure cloud for your mobile apps
Leveraging the azure cloud for your mobile appsLeveraging the azure cloud for your mobile apps
Leveraging the azure cloud for your mobile apps
 
Leverage Azure and SQL Azure to build SaaS applications
Leverage Azure and SQL Azure to build SaaS applications Leverage Azure and SQL Azure to build SaaS applications
Leverage Azure and SQL Azure to build SaaS applications
 
Windows Azure Uzerinden Alinabilen Hizmetler
Windows Azure Uzerinden Alinabilen HizmetlerWindows Azure Uzerinden Alinabilen Hizmetler
Windows Azure Uzerinden Alinabilen Hizmetler
 
another day, another billion packets
another day, another billion packetsanother day, another billion packets
another day, another billion packets
 
Another Day, Another Billion Packets
Another Day, Another Billion PacketsAnother Day, Another Billion Packets
Another Day, Another Billion Packets
 
OSCON Data 2011 -- NoSQL @ Netflix, Part 2
OSCON Data 2011 -- NoSQL @ Netflix, Part 2OSCON Data 2011 -- NoSQL @ Netflix, Part 2
OSCON Data 2011 -- NoSQL @ Netflix, Part 2
 
Windows Azure Design Patterns
Windows Azure Design PatternsWindows Azure Design Patterns
Windows Azure Design Patterns
 
Games + Amazon = Love - Presentation quo vadis 2011
Games + Amazon = Love - Presentation quo vadis 2011Games + Amazon = Love - Presentation quo vadis 2011
Games + Amazon = Love - Presentation quo vadis 2011
 
AWS for Start-ups - Architectural Best Practices & Automating Your Infrastruc...
AWS for Start-ups - Architectural Best Practices & Automating Your Infrastruc...AWS for Start-ups - Architectural Best Practices & Automating Your Infrastruc...
AWS for Start-ups - Architectural Best Practices & Automating Your Infrastruc...
 
AWS Update | London - Performance Update and Provisioned IOPS
AWS Update | London - Performance Update and Provisioned IOPSAWS Update | London - Performance Update and Provisioned IOPS
AWS Update | London - Performance Update and Provisioned IOPS
 
1 Introduction at CloudStack Developer Day
1 Introduction at CloudStack Developer Day 1 Introduction at CloudStack Developer Day
1 Introduction at CloudStack Developer Day
 
Netflix in the cloud 2011
Netflix in the cloud 2011Netflix in the cloud 2011
Netflix in the cloud 2011
 
Another Day, Another Billion Packets
Another Day, Another Billion PacketsAnother Day, Another Billion Packets
Another Day, Another Billion Packets
 
AWS Summit Auckland 2014 | Running your First Application on AWS
AWS Summit Auckland 2014 | Running your First Application on AWSAWS Summit Auckland 2014 | Running your First Application on AWS
AWS Summit Auckland 2014 | Running your First Application on AWS
 
CloudFest Denver Windows Azure Design Patterns
CloudFest Denver Windows Azure Design PatternsCloudFest Denver Windows Azure Design Patterns
CloudFest Denver Windows Azure Design Patterns
 
Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...
Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...
Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...
 
MetaCDN: Enabling High Performance, Low Cost Content Storage and Delivery via...
MetaCDN: Enabling High Performance, Low Cost Content Storage and Delivery via...MetaCDN: Enabling High Performance, Low Cost Content Storage and Delivery via...
MetaCDN: Enabling High Performance, Low Cost Content Storage and Delivery via...
 

Viewers also liked

2013 Yesmail Email Design Lookbook
2013 Yesmail Email Design Lookbook2013 Yesmail Email Design Lookbook
2013 Yesmail Email Design Lookbook
Yes Lifecycle Marketing
 
Mobile Networks as an enabler for scalable development
Mobile Networks as an enabler for scalable developmentMobile Networks as an enabler for scalable development
Mobile Networks as an enabler for scalable development
SIANI
 
Mobile Ux Scalability
Mobile Ux ScalabilityMobile Ux Scalability
Mobile Ux Scalability
mattheweperry74
 
Email Design Lookbook 2014
Email Design Lookbook 2014Email Design Lookbook 2014
Email Design Lookbook 2014
Yes Lifecycle Marketing
 
Implementing a Scalable Mobile Strategy
Implementing a Scalable Mobile StrategyImplementing a Scalable Mobile Strategy
Implementing a Scalable Mobile Strategy
Tim Wright
 
Scalability
ScalabilityScalability
Scalability
felho
 
ARC202 Architecting for High Availability - AWS re: Invent 2012
ARC202 Architecting for High Availability - AWS re: Invent 2012ARC202 Architecting for High Availability - AWS re: Invent 2012
ARC202 Architecting for High Availability - AWS re: Invent 2012
Amazon Web Services
 

Viewers also liked (7)

2013 Yesmail Email Design Lookbook
2013 Yesmail Email Design Lookbook2013 Yesmail Email Design Lookbook
2013 Yesmail Email Design Lookbook
 
Mobile Networks as an enabler for scalable development
Mobile Networks as an enabler for scalable developmentMobile Networks as an enabler for scalable development
Mobile Networks as an enabler for scalable development
 
Mobile Ux Scalability
Mobile Ux ScalabilityMobile Ux Scalability
Mobile Ux Scalability
 
Email Design Lookbook 2014
Email Design Lookbook 2014Email Design Lookbook 2014
Email Design Lookbook 2014
 
Implementing a Scalable Mobile Strategy
Implementing a Scalable Mobile StrategyImplementing a Scalable Mobile Strategy
Implementing a Scalable Mobile Strategy
 
Scalability
ScalabilityScalability
Scalability
 
ARC202 Architecting for High Availability - AWS re: Invent 2012
ARC202 Architecting for High Availability - AWS re: Invent 2012ARC202 Architecting for High Availability - AWS re: Invent 2012
ARC202 Architecting for High Availability - AWS re: Invent 2012
 

Similar to MBL303 Scalable Mobile and Web Apps - AWS re: Invent 2012

What's New with Amazon DynamoDB - SRV311 - Atlanta AWS Summit
What's New with Amazon DynamoDB - SRV311 - Atlanta AWS SummitWhat's New with Amazon DynamoDB - SRV311 - Atlanta AWS Summit
What's New with Amazon DynamoDB - SRV311 - Atlanta AWS Summit
Amazon Web Services
 
Desktop Private Cloud
Desktop Private CloudDesktop Private Cloud
Desktop Private Cloud
Paul Morse
 
AWS Customer Presentation - SOASTA
AWS Customer Presentation - SOASTAAWS Customer Presentation - SOASTA
AWS Customer Presentation - SOASTA
Amazon Web Services
 
AWS CLOUD 2018- Amazon DynamoDB기반 글로벌 서비스 개발 방법 (김준형 솔루션즈 아키텍트)
AWS CLOUD 2018- Amazon DynamoDB기반 글로벌 서비스 개발 방법 (김준형 솔루션즈 아키텍트)AWS CLOUD 2018- Amazon DynamoDB기반 글로벌 서비스 개발 방법 (김준형 솔루션즈 아키텍트)
AWS CLOUD 2018- Amazon DynamoDB기반 글로벌 서비스 개발 방법 (김준형 솔루션즈 아키텍트)
Amazon Web Services Korea
 
What's New with Amazon DynamoDB - SRV311 - Chicago AWS Summit
What's New with Amazon DynamoDB - SRV311 - Chicago AWS SummitWhat's New with Amazon DynamoDB - SRV311 - Chicago AWS Summit
What's New with Amazon DynamoDB - SRV311 - Chicago AWS Summit
Amazon Web Services
 
ALOHA Load Balancer - Rackable Appliance
ALOHA Load Balancer - Rackable ApplianceALOHA Load Balancer - Rackable Appliance
ALOHA Load Balancer - Rackable Appliance
EXCELIANCE
 
Cloud Architectures - Jinesh Varia - GrepTheWeb
Cloud Architectures - Jinesh Varia - GrepTheWebCloud Architectures - Jinesh Varia - GrepTheWeb
Cloud Architectures - Jinesh Varia - GrepTheWeb
jineshvaria
 
Ibm cloud nativenetflixossfinal
Ibm cloud nativenetflixossfinalIbm cloud nativenetflixossfinal
Ibm cloud nativenetflixossfinal
aspyker
 
Netflix0SS Services on Docker
Netflix0SS Services on DockerNetflix0SS Services on Docker
Netflix0SS Services on Docker
Docker, Inc.
 
"Production-ready Serverless Java Applications in 3 weeks" at AWS Community D...
"Production-ready Serverless Java Applications in 3 weeks" at AWS Community D..."Production-ready Serverless Java Applications in 3 weeks" at AWS Community D...
"Production-ready Serverless Java Applications in 3 weeks" at AWS Community D...
Vadym Kazulkin
 
Satrtup Bootcamp - Scale on AWS
Satrtup Bootcamp - Scale on AWSSatrtup Bootcamp - Scale on AWS
Satrtup Bootcamp - Scale on AWS
Idan Tohami
 
Serverless on AWS : Understanding the hard parts at Serverless Meetup Dusseld...
Serverless on AWS : Understanding the hard parts at Serverless Meetup Dusseld...Serverless on AWS : Understanding the hard parts at Serverless Meetup Dusseld...
Serverless on AWS : Understanding the hard parts at Serverless Meetup Dusseld...
Vadym Kazulkin
 
QConSF-MicroServices-IPC-Netflix-Sudhir-2014.pptx
QConSF-MicroServices-IPC-Netflix-Sudhir-2014.pptxQConSF-MicroServices-IPC-Netflix-Sudhir-2014.pptx
QConSF-MicroServices-IPC-Netflix-Sudhir-2014.pptx
VimalKumar143058
 
Service Discovery and Registration in a Microservices Architecture
Service Discovery and Registration in a Microservices ArchitectureService Discovery and Registration in a Microservices Architecture
Service Discovery and Registration in a Microservices Architecture
PLUMgrid
 
OpenStack Boston User Group, OpenStack overview
OpenStack Boston User Group, OpenStack overviewOpenStack Boston User Group, OpenStack overview
OpenStack Boston User Group, OpenStack overview
Open Stack
 
Cloud - Two examples
Cloud - Two examplesCloud - Two examples
Cloud - Two examples
sorenpeter
 
Aws and Alfresco Solutions
Aws and Alfresco SolutionsAws and Alfresco Solutions
Aws and Alfresco Solutions
Alfresco Software
 
AWS Cloud Kata | Taipei - Getting to Scale
AWS Cloud Kata | Taipei - Getting to ScaleAWS Cloud Kata | Taipei - Getting to Scale
AWS Cloud Kata | Taipei - Getting to Scale
Amazon Web Services
 
AWS Summit London 2014 | Scaling on AWS for the First 10 Million Users (200)
AWS Summit London 2014 | Scaling on AWS for the First 10 Million Users (200)AWS Summit London 2014 | Scaling on AWS for the First 10 Million Users (200)
AWS Summit London 2014 | Scaling on AWS for the First 10 Million Users (200)
Amazon Web Services
 
EMEA OpenStack Day, July 13th 2011 in London - Jim Curry intro
EMEA OpenStack Day, July 13th 2011 in London - Jim Curry introEMEA OpenStack Day, July 13th 2011 in London - Jim Curry intro
EMEA OpenStack Day, July 13th 2011 in London - Jim Curry intro
Open Stack
 

Similar to MBL303 Scalable Mobile and Web Apps - AWS re: Invent 2012 (20)

What's New with Amazon DynamoDB - SRV311 - Atlanta AWS Summit
What's New with Amazon DynamoDB - SRV311 - Atlanta AWS SummitWhat's New with Amazon DynamoDB - SRV311 - Atlanta AWS Summit
What's New with Amazon DynamoDB - SRV311 - Atlanta AWS Summit
 
Desktop Private Cloud
Desktop Private CloudDesktop Private Cloud
Desktop Private Cloud
 
AWS Customer Presentation - SOASTA
AWS Customer Presentation - SOASTAAWS Customer Presentation - SOASTA
AWS Customer Presentation - SOASTA
 
AWS CLOUD 2018- Amazon DynamoDB기반 글로벌 서비스 개발 방법 (김준형 솔루션즈 아키텍트)
AWS CLOUD 2018- Amazon DynamoDB기반 글로벌 서비스 개발 방법 (김준형 솔루션즈 아키텍트)AWS CLOUD 2018- Amazon DynamoDB기반 글로벌 서비스 개발 방법 (김준형 솔루션즈 아키텍트)
AWS CLOUD 2018- Amazon DynamoDB기반 글로벌 서비스 개발 방법 (김준형 솔루션즈 아키텍트)
 
What's New with Amazon DynamoDB - SRV311 - Chicago AWS Summit
What's New with Amazon DynamoDB - SRV311 - Chicago AWS SummitWhat's New with Amazon DynamoDB - SRV311 - Chicago AWS Summit
What's New with Amazon DynamoDB - SRV311 - Chicago AWS Summit
 
ALOHA Load Balancer - Rackable Appliance
ALOHA Load Balancer - Rackable ApplianceALOHA Load Balancer - Rackable Appliance
ALOHA Load Balancer - Rackable Appliance
 
Cloud Architectures - Jinesh Varia - GrepTheWeb
Cloud Architectures - Jinesh Varia - GrepTheWebCloud Architectures - Jinesh Varia - GrepTheWeb
Cloud Architectures - Jinesh Varia - GrepTheWeb
 
Ibm cloud nativenetflixossfinal
Ibm cloud nativenetflixossfinalIbm cloud nativenetflixossfinal
Ibm cloud nativenetflixossfinal
 
Netflix0SS Services on Docker
Netflix0SS Services on DockerNetflix0SS Services on Docker
Netflix0SS Services on Docker
 
"Production-ready Serverless Java Applications in 3 weeks" at AWS Community D...
"Production-ready Serverless Java Applications in 3 weeks" at AWS Community D..."Production-ready Serverless Java Applications in 3 weeks" at AWS Community D...
"Production-ready Serverless Java Applications in 3 weeks" at AWS Community D...
 
Satrtup Bootcamp - Scale on AWS
Satrtup Bootcamp - Scale on AWSSatrtup Bootcamp - Scale on AWS
Satrtup Bootcamp - Scale on AWS
 
Serverless on AWS : Understanding the hard parts at Serverless Meetup Dusseld...
Serverless on AWS : Understanding the hard parts at Serverless Meetup Dusseld...Serverless on AWS : Understanding the hard parts at Serverless Meetup Dusseld...
Serverless on AWS : Understanding the hard parts at Serverless Meetup Dusseld...
 
QConSF-MicroServices-IPC-Netflix-Sudhir-2014.pptx
QConSF-MicroServices-IPC-Netflix-Sudhir-2014.pptxQConSF-MicroServices-IPC-Netflix-Sudhir-2014.pptx
QConSF-MicroServices-IPC-Netflix-Sudhir-2014.pptx
 
Service Discovery and Registration in a Microservices Architecture
Service Discovery and Registration in a Microservices ArchitectureService Discovery and Registration in a Microservices Architecture
Service Discovery and Registration in a Microservices Architecture
 
OpenStack Boston User Group, OpenStack overview
OpenStack Boston User Group, OpenStack overviewOpenStack Boston User Group, OpenStack overview
OpenStack Boston User Group, OpenStack overview
 
Cloud - Two examples
Cloud - Two examplesCloud - Two examples
Cloud - Two examples
 
Aws and Alfresco Solutions
Aws and Alfresco SolutionsAws and Alfresco Solutions
Aws and Alfresco Solutions
 
AWS Cloud Kata | Taipei - Getting to Scale
AWS Cloud Kata | Taipei - Getting to ScaleAWS Cloud Kata | Taipei - Getting to Scale
AWS Cloud Kata | Taipei - Getting to Scale
 
AWS Summit London 2014 | Scaling on AWS for the First 10 Million Users (200)
AWS Summit London 2014 | Scaling on AWS for the First 10 Million Users (200)AWS Summit London 2014 | Scaling on AWS for the First 10 Million Users (200)
AWS Summit London 2014 | Scaling on AWS for the First 10 Million Users (200)
 
EMEA OpenStack Day, July 13th 2011 in London - Jim Curry intro
EMEA OpenStack Day, July 13th 2011 in London - Jim Curry introEMEA OpenStack Day, July 13th 2011 in London - Jim Curry intro
EMEA OpenStack Day, July 13th 2011 in London - Jim Curry intro
 

More from Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
Amazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
Amazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
Amazon Web Services
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Amazon Web Services
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
Amazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
Amazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Amazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
Amazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Amazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
Amazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
Amazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
Amazon Web Services
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
Amazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
Amazon Web Services
 

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

MBL303 Scalable Mobile and Web Apps - AWS re: Invent 2012

  • 1.
  • 2.
  • 3. 503 Service Temporarily Unavailable The server is temporarily unable to service your request due to maintenance downtime or capacity problems. Please try again later.
  • 4. 503 Service Temporarily Unavailable The server is temporarily unable to service your request due to maintenance downtime or capacity problems. Please try again later.
  • 6. Do-It-Yourself Headaches Bandwidth capacity Uptime Download speed Concurrent connections Acceptable latency ? Audit Access control logs Customer locations
  • 7.
  • 8. OFFLOAD static content • reduce your compute demand and costs • improve end-user experience • increase reliability and durability +
  • 9.
  • 10. ENTIRE SITE via CloudFront • minimize client-server chatter (keep it at the edge) • reduce server-database traffic (cache the common calls) • speed up mobile app response (persistent connections) +
  • 11.
  • 12. LOAD BALANCE from the start • uninterrupted growth and evolution • ready for massive scale, high reliability • stateless and redundant array Availability Zone Availability Zone
  • 13.
  • 14. REAL-TIME reaction response • notification of pending news flash (with audible alarm) • on-demand ramp up of capacity (6 mins.) • subscriber alert push delivered • mass response traffic handled (followed by ramp down)
  • 16.
  • 17. $52 / hr day 14 Daily CPU load 12 10 8 Load 6 25% savings 4 2 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 $15 / hr night Hour Optimize by the time of day
  • 18.
  • 19. DATABASE smarts • enhance reliability, ensure data safety • optimal performance, minimize load • scale out and share work • Availability Zone cost reduction Availability Zone
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.
  • 25. A/B TEST experiment, evolve • inexpensive idea validation • seamless switch over and versioning • rapid dev / test agility
  • 26.
  • 27.
  • 28.
  • 29.
  • 30. What is ? is a global byte-sized content-based application platform that enables fast and seamless consumption of information from any mobile device ACTIVE USERS APPS MONTHLY TRANSACTIONS Try it: text @wiki internet to 898932
  • 31. The beginning… January 2011 - A two member engineering team sets out to create an initial prototype for the product…. Concept Code Infrastructure Try it: text @movies to 898932
  • 32. What we needed… Seamless scaling No upfront investment Rapid experimentation Focus on building product rather than running operations Try it: text @nasdaq Amazon to 898932
  • 33. The Answer Try it: text @weather to 898932
  • 34. The benefits AWS provided… Quick & fast deployment allowed validating ideas/hypothesis Scale up/out without any hassles No costs on IT staff-management Agile, test-driven environment, ability to quickly view and compare results Try it: text @linkedin to 898932
  • 35. txtWeb architecture overview … txtWeb 3rd party apps End Cellular SMS user service gateway Try it: text @goog to 898932
  • 36. Early days with AWS… February 2011 - Series of architectural + performance A/B tests Lots of EC2 servers Small Amazon RDS server Try it: text @imdb Inception to 898932
  • 37. And then… Fewer EC2 servers Large Amazon RDS server Try it: text @fb to 898932
  • 38. Surprising workloads… 1,400,000 12 servers 1,200,000 March-April 2011 – The cricket World Cup brought in a surge of requests to our platform in no time, from 10,000 1,000,000 to 1,000,000 requests/day (100x more) Requests / day 800,000 600,000 400,000 200,000 2 servers 0 December January February March 2011 Try it: text @tweetbytes to 898932
  • 39. Elastic needs… 30,000 8 Number of Servers Load 25,000 6 20,000 Number of EC2 instances Peak requests / minute 15,000 4 10,000 2 5,000 0 0 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 Hour of the day (March 2011) Try it: text @cricket to 898932
  • 40. 100 server hours per day using elastic scaling vs. 192 server hours per day without = 48% cost savings Try it: text @clues to 898932
  • 41. Amazon Route53 End Cellular Operator SMS user service aggregator EC2 EC2 CloudWatch Auto Scaling alarm trigger Availability Zone 1 Availability Zone 2 Auto Scaling group 3rd party apps CloudWatch Amazon S3 Elasti S3 EMR DDB RDS Cache Corporate data center Try it: text @sportkit to 898932
  • 42. Architectural changes … Increased load on database Introduced Amazon ElastiCache layer in May 2011 Increased write-heavy needs Transactional data logged into Amazon DynamoDB Auto Scaling metrics Published CloudWatch custom metric used to trigger Auto Scaling Try it: text @word to 898932
  • 43.
  • 44. We are sincerely eager to hear your feedback on this presentation and on re:Invent. Please fill out an evaluation form when you have a chance.