SlideShare a Scribd company logo
1 of 17
SCALING UP WITH AWS
GROWING PAINS OF A STARTUP COMPANY

Galed Friedmann
Head of Operations
ONAVO




        COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
ONAVO IS 100% CLOUD BASED
» Over 150 instances world wide
  › US East, EU West, South America, Singapore
» Plenty of AWS services in use
  › EC2 S3 RDS       IAM   EMR
  › SES     SNS   SQS
  › CloudWatch  Route53 CloudFront

                          COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
BASIC ARCHITECTURE




                COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
THE GROWING PAINS
» Continuously growing
  › Adding more resources all the time
» Handling sudden increases
  › “We’re on TechCrunch, bring up more servers!”
» Maintaining a 99.99% uptime

                            COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
UTILIZING RESOURCES




                 COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
AUTO SCALING
» Maintains the desired amount of instances
  › Replaces unhealthy instances
» Allows scaling up and down based on
  CloudWatch metrics
» Completely automated
  › Assumes your application is automated
                           COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
BECOMING FULLY AUTOMATED
» Instance Store backed
  › Pre-bundled AMIs with everything
» Configuration
» Sharing
  › No persistent storage, but data needs to be shared
» Exporting
  › No persistent storage, but data needs to be saved
                                COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
AUTOMATING CONFIGURATION
» Puppet
  › Keeping configuration
    up to date
  › Share resources
  › Deploy changes
    instantly



      Configuration   Sharing   Exporting   COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
LOAD BALANCER NEEDS TO KNOW
 » Life is easy with Auto Scaling & ELB
      › We’re not using ELB
 » Puppet keeps the LB up to date
Oct 18 00:34:58 puppet-agent[6841]:
(/Stage[main]/Loadbalancer::Loadbalancer/Export::Expiringhost[proxy21]/Host[stable_host21]/ip) ip
changed '0.0.0.1' to '10.207.110.184'
Oct 18 00:34:58 puppet-agent[6841]: Finished catalog run in 2.87 seconds


              Configuration   Sharing   Exporting       COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
SHARED CONFIGURATION
» Basic information needs to be shared
  › Authentication details
  › Compression on/off
  › Desired compression level
» Are there any off the shelf solutions?


      Configuration   Sharing   Exporting   COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
REDIS TO THE RESCUE!
» Advanced key-value store
» In memory data sets, atomic operations
» Easy to implement master-slave replication




       Configuration   Sharing   Exporting   COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
LOG COLLECTION
» Logs need to be collected and processed in order to
  display users’ savings
» Flume – distributed, reliable and available service for
  moving large amounts of log data.




        Configuration   Sharing   Exporting   COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
DECIDING ON SCALING POLICIES
» Scale up quickly
  › You want to prepare for the worst
» Scale down slowly
  › Prevent fluctuations
» Get the most out of the resource
  › Maintain 80-90% utilization
                             COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
PUTTING IT ALL TOGETHER




                 COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
SUMMARY
» AWS have great building blocks
» Auto Scaling
  › Reduces operational costs
  › Assists in utilizing your resources effectively
» Prepare your automation and handle all use
  cases
» It’s worth it.
                                   COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
THANK YOU
» galed@onavo.com
» @galedfriedmann




                    COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.

More Related Content

What's hot

NEW LAUNCH! AWS PrivateLink: Bringing SaaS Solutions into Your VPCs and Your ...
NEW LAUNCH! AWS PrivateLink: Bringing SaaS Solutions into Your VPCs and Your ...NEW LAUNCH! AWS PrivateLink: Bringing SaaS Solutions into Your VPCs and Your ...
NEW LAUNCH! AWS PrivateLink: Bringing SaaS Solutions into Your VPCs and Your ...Amazon Web Services
 
GPSTEC319-Build Once Deploy Many Architecting and Building Automated Reusable...
GPSTEC319-Build Once Deploy Many Architecting and Building Automated Reusable...GPSTEC319-Build Once Deploy Many Architecting and Building Automated Reusable...
GPSTEC319-Build Once Deploy Many Architecting and Building Automated Reusable...Amazon Web Services
 
Serverless computing henry been - continuous deployment of azure functions
Serverless computing   henry been - continuous deployment of azure functionsServerless computing   henry been - continuous deployment of azure functions
Serverless computing henry been - continuous deployment of azure functionsHenry Been
 
ABD215_Serverless Data Prep with AWS Glue
ABD215_Serverless Data Prep with AWS GlueABD215_Serverless Data Prep with AWS Glue
ABD215_Serverless Data Prep with AWS GlueAmazon Web Services
 
DatamindsConnect2019 Azure Key Vault, Azure Dev Ops and Azure Data Factory ho...
DatamindsConnect2019 Azure Key Vault, Azure Dev Ops and Azure Data Factory ho...DatamindsConnect2019 Azure Key Vault, Azure Dev Ops and Azure Data Factory ho...
DatamindsConnect2019 Azure Key Vault, Azure Dev Ops and Azure Data Factory ho...Erwin de Kreuk
 
GPSTEC304_Shipping With PorpoiseA K8s Story
GPSTEC304_Shipping With PorpoiseA K8s StoryGPSTEC304_Shipping With PorpoiseA K8s Story
GPSTEC304_Shipping With PorpoiseA K8s StoryAmazon Web Services
 
SRV312_Taking Serverless to the Edge
SRV312_Taking Serverless to the EdgeSRV312_Taking Serverless to the Edge
SRV312_Taking Serverless to the EdgeAmazon Web Services
 
STG305_Deep Dive on Backup to the AWS Cloud
STG305_Deep Dive on Backup to the AWS CloudSTG305_Deep Dive on Backup to the AWS Cloud
STG305_Deep Dive on Backup to the AWS CloudAmazon Web Services
 
Living on the Edge with AWS Greengrass
Living on the Edge with AWS GreengrassLiving on the Edge with AWS Greengrass
Living on the Edge with AWS GreengrassForrest Brazeal
 
NY Startup Day: Welcome & Keynote
NY Startup Day: Welcome & KeynoteNY Startup Day: Welcome & Keynote
NY Startup Day: Welcome & KeynoteAmazon Web Services
 
Introduction: Security & AWS Storage
Introduction: Security & AWS StorageIntroduction: Security & AWS Storage
Introduction: Security & AWS StorageAmazon Web Services
 
Using Amazon CloudFront for Improved Response Time
Using Amazon CloudFront  for Improved Response TimeUsing Amazon CloudFront  for Improved Response Time
Using Amazon CloudFront for Improved Response Timeehwinter
 
Containers on AWS: What You Missed at re:Invent 2017 - AWS Online Tech Talks
Containers on AWS: What You Missed at re:Invent 2017 - AWS Online Tech TalksContainers on AWS: What You Missed at re:Invent 2017 - AWS Online Tech Talks
Containers on AWS: What You Missed at re:Invent 2017 - AWS Online Tech TalksAmazon Web Services
 
STG307_Deep Dive on Amazon Elastic File System (Amazon EFS)
STG307_Deep Dive on Amazon Elastic File System (Amazon EFS)STG307_Deep Dive on Amazon Elastic File System (Amazon EFS)
STG307_Deep Dive on Amazon Elastic File System (Amazon EFS)Amazon Web Services
 
DevOps on AWS: Advanced Techniques for Amazon EC2 Deployments on AWS
DevOps on AWS: Advanced Techniques for Amazon EC2 Deployments on AWSDevOps on AWS: Advanced Techniques for Amazon EC2 Deployments on AWS
DevOps on AWS: Advanced Techniques for Amazon EC2 Deployments on AWSAmazon Web Services
 
CON307_Building Effective Container Images
CON307_Building Effective Container ImagesCON307_Building Effective Container Images
CON307_Building Effective Container ImagesAmazon Web Services
 
Moving Viadeo to AWS (2015)
Moving Viadeo to AWS (2015)Moving Viadeo to AWS (2015)
Moving Viadeo to AWS (2015)Julien SIMON
 
STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...
STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...
STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...Amazon Web Services
 
DEV326_DevOps Essentials An Introductory Workshop on CICD Practices
DEV326_DevOps Essentials An Introductory Workshop on CICD PracticesDEV326_DevOps Essentials An Introductory Workshop on CICD Practices
DEV326_DevOps Essentials An Introductory Workshop on CICD PracticesAmazon Web Services
 

What's hot (20)

NEW LAUNCH! AWS PrivateLink: Bringing SaaS Solutions into Your VPCs and Your ...
NEW LAUNCH! AWS PrivateLink: Bringing SaaS Solutions into Your VPCs and Your ...NEW LAUNCH! AWS PrivateLink: Bringing SaaS Solutions into Your VPCs and Your ...
NEW LAUNCH! AWS PrivateLink: Bringing SaaS Solutions into Your VPCs and Your ...
 
GPSTEC319-Build Once Deploy Many Architecting and Building Automated Reusable...
GPSTEC319-Build Once Deploy Many Architecting and Building Automated Reusable...GPSTEC319-Build Once Deploy Many Architecting and Building Automated Reusable...
GPSTEC319-Build Once Deploy Many Architecting and Building Automated Reusable...
 
Serverless computing henry been - continuous deployment of azure functions
Serverless computing   henry been - continuous deployment of azure functionsServerless computing   henry been - continuous deployment of azure functions
Serverless computing henry been - continuous deployment of azure functions
 
ABD215_Serverless Data Prep with AWS Glue
ABD215_Serverless Data Prep with AWS GlueABD215_Serverless Data Prep with AWS Glue
ABD215_Serverless Data Prep with AWS Glue
 
DatamindsConnect2019 Azure Key Vault, Azure Dev Ops and Azure Data Factory ho...
DatamindsConnect2019 Azure Key Vault, Azure Dev Ops and Azure Data Factory ho...DatamindsConnect2019 Azure Key Vault, Azure Dev Ops and Azure Data Factory ho...
DatamindsConnect2019 Azure Key Vault, Azure Dev Ops and Azure Data Factory ho...
 
GPSTEC304_Shipping With PorpoiseA K8s Story
GPSTEC304_Shipping With PorpoiseA K8s StoryGPSTEC304_Shipping With PorpoiseA K8s Story
GPSTEC304_Shipping With PorpoiseA K8s Story
 
SRV312_Taking Serverless to the Edge
SRV312_Taking Serverless to the EdgeSRV312_Taking Serverless to the Edge
SRV312_Taking Serverless to the Edge
 
STG305_Deep Dive on Backup to the AWS Cloud
STG305_Deep Dive on Backup to the AWS CloudSTG305_Deep Dive on Backup to the AWS Cloud
STG305_Deep Dive on Backup to the AWS Cloud
 
Living on the Edge with AWS Greengrass
Living on the Edge with AWS GreengrassLiving on the Edge with AWS Greengrass
Living on the Edge with AWS Greengrass
 
NY Startup Day: Welcome & Keynote
NY Startup Day: Welcome & KeynoteNY Startup Day: Welcome & Keynote
NY Startup Day: Welcome & Keynote
 
Introduction: Security & AWS Storage
Introduction: Security & AWS StorageIntroduction: Security & AWS Storage
Introduction: Security & AWS Storage
 
Using Amazon CloudFront for Improved Response Time
Using Amazon CloudFront  for Improved Response TimeUsing Amazon CloudFront  for Improved Response Time
Using Amazon CloudFront for Improved Response Time
 
Containers on AWS: What You Missed at re:Invent 2017 - AWS Online Tech Talks
Containers on AWS: What You Missed at re:Invent 2017 - AWS Online Tech TalksContainers on AWS: What You Missed at re:Invent 2017 - AWS Online Tech Talks
Containers on AWS: What You Missed at re:Invent 2017 - AWS Online Tech Talks
 
STG307_Deep Dive on Amazon Elastic File System (Amazon EFS)
STG307_Deep Dive on Amazon Elastic File System (Amazon EFS)STG307_Deep Dive on Amazon Elastic File System (Amazon EFS)
STG307_Deep Dive on Amazon Elastic File System (Amazon EFS)
 
Kubernetes on AWS
Kubernetes on AWSKubernetes on AWS
Kubernetes on AWS
 
DevOps on AWS: Advanced Techniques for Amazon EC2 Deployments on AWS
DevOps on AWS: Advanced Techniques for Amazon EC2 Deployments on AWSDevOps on AWS: Advanced Techniques for Amazon EC2 Deployments on AWS
DevOps on AWS: Advanced Techniques for Amazon EC2 Deployments on AWS
 
CON307_Building Effective Container Images
CON307_Building Effective Container ImagesCON307_Building Effective Container Images
CON307_Building Effective Container Images
 
Moving Viadeo to AWS (2015)
Moving Viadeo to AWS (2015)Moving Viadeo to AWS (2015)
Moving Viadeo to AWS (2015)
 
STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...
STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...
STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...
 
DEV326_DevOps Essentials An Introductory Workshop on CICD Practices
DEV326_DevOps Essentials An Introductory Workshop on CICD PracticesDEV326_DevOps Essentials An Introductory Workshop on CICD Practices
DEV326_DevOps Essentials An Introductory Workshop on CICD Practices
 

Similar to Onavo aws summit 2012

Advanced Deployment Best Practices with AWS CodeDeploy (DEV404-R2) - AWS re:I...
Advanced Deployment Best Practices with AWS CodeDeploy (DEV404-R2) - AWS re:I...Advanced Deployment Best Practices with AWS CodeDeploy (DEV404-R2) - AWS re:I...
Advanced Deployment Best Practices with AWS CodeDeploy (DEV404-R2) - AWS re:I...Amazon Web Services
 
A real-life account of moving 100% to a public cloud
A real-life account of moving 100% to a public cloudA real-life account of moving 100% to a public cloud
A real-life account of moving 100% to a public cloudJulien SIMON
 
Airline DR - AWS Case Study
Airline DR - AWS Case StudyAirline DR - AWS Case Study
Airline DR - AWS Case StudyCodelattice
 
Running Oracle Databases on Amazon RDS - DAT313 - re:Invent 2017
Running Oracle Databases on Amazon RDS - DAT313 - re:Invent 2017Running Oracle Databases on Amazon RDS - DAT313 - re:Invent 2017
Running Oracle Databases on Amazon RDS - DAT313 - re:Invent 2017Amazon Web Services
 
Disaster recovery sites on AWS: minimal costs maximum efficiency
Disaster recovery sites on AWS: minimal costs maximum efficiencyDisaster recovery sites on AWS: minimal costs maximum efficiency
Disaster recovery sites on AWS: minimal costs maximum efficiencyAmazon Web Services
 
AWS Summit Stockholm 2014 – T3 – disaster recovery on AWS
AWS Summit Stockholm 2014 – T3 – disaster recovery on AWSAWS Summit Stockholm 2014 – T3 – disaster recovery on AWS
AWS Summit Stockholm 2014 – T3 – disaster recovery on AWSAmazon Web Services
 
Scaling on AWS for the First 10 Million Users (ARC206) | AWS re:Invent 2013
Scaling on AWS for the First 10 Million Users (ARC206) | AWS re:Invent 2013Scaling on AWS for the First 10 Million Users (ARC206) | AWS re:Invent 2013
Scaling on AWS for the First 10 Million Users (ARC206) | AWS re:Invent 2013Amazon Web Services
 
Partner Solutions: Veritas Technologies - Unique Ways Veritas can Supercharge...
Partner Solutions: Veritas Technologies - Unique Ways Veritas can Supercharge...Partner Solutions: Veritas Technologies - Unique Ways Veritas can Supercharge...
Partner Solutions: Veritas Technologies - Unique Ways Veritas can Supercharge...Amazon Web Services
 
Disaster Recovery Sites on AWS: Minimal Cost, Maximum Efficiency
Disaster Recovery Sites on AWS: Minimal Cost, Maximum EfficiencyDisaster Recovery Sites on AWS: Minimal Cost, Maximum Efficiency
Disaster Recovery Sites on AWS: Minimal Cost, Maximum EfficiencyAmazon Web Services
 
Opinionated re:Invent recap with AWS Heroes & Builders
Opinionated re:Invent recap with AWS Heroes & BuildersOpinionated re:Invent recap with AWS Heroes & Builders
Opinionated re:Invent recap with AWS Heroes & BuildersDaniel Zivkovic
 
Webinar Development & Test
Webinar Development & TestWebinar Development & Test
Webinar Development & TestAWS Germany
 
[db tech showcase Tokyo 2018] #dbts2018 #B31 『1,2,3 and Done! 3 easy ways to ...
[db tech showcase Tokyo 2018] #dbts2018 #B31 『1,2,3 and Done! 3 easy ways to ...[db tech showcase Tokyo 2018] #dbts2018 #B31 『1,2,3 and Done! 3 easy ways to ...
[db tech showcase Tokyo 2018] #dbts2018 #B31 『1,2,3 and Done! 3 easy ways to ...Insight Technology, Inc.
 
Aws webinar may 2013 designing for failure
Aws webinar may 2013   designing for failureAws webinar may 2013   designing for failure
Aws webinar may 2013 designing for failureAmazon Web Services
 
REPEAT_1_Deep_dive_on_new_features_in_Amazon_RDS_for_SQL_Server_DAT364-R1(1).pdf
REPEAT_1_Deep_dive_on_new_features_in_Amazon_RDS_for_SQL_Server_DAT364-R1(1).pdfREPEAT_1_Deep_dive_on_new_features_in_Amazon_RDS_for_SQL_Server_DAT364-R1(1).pdf
REPEAT_1_Deep_dive_on_new_features_in_Amazon_RDS_for_SQL_Server_DAT364-R1(1).pdfAkashGoel82
 

Similar to Onavo aws summit 2012 (20)

Advanced Deployment Best Practices with AWS CodeDeploy (DEV404-R2) - AWS re:I...
Advanced Deployment Best Practices with AWS CodeDeploy (DEV404-R2) - AWS re:I...Advanced Deployment Best Practices with AWS CodeDeploy (DEV404-R2) - AWS re:I...
Advanced Deployment Best Practices with AWS CodeDeploy (DEV404-R2) - AWS re:I...
 
A real-life account of moving 100% to a public cloud
A real-life account of moving 100% to a public cloudA real-life account of moving 100% to a public cloud
A real-life account of moving 100% to a public cloud
 
Airline DR - AWS Case Study
Airline DR - AWS Case StudyAirline DR - AWS Case Study
Airline DR - AWS Case Study
 
Running Oracle Databases on Amazon RDS - DAT313 - re:Invent 2017
Running Oracle Databases on Amazon RDS - DAT313 - re:Invent 2017Running Oracle Databases on Amazon RDS - DAT313 - re:Invent 2017
Running Oracle Databases on Amazon RDS - DAT313 - re:Invent 2017
 
Disaster recovery sites on AWS: minimal costs maximum efficiency
Disaster recovery sites on AWS: minimal costs maximum efficiencyDisaster recovery sites on AWS: minimal costs maximum efficiency
Disaster recovery sites on AWS: minimal costs maximum efficiency
 
AWS Summit Stockholm 2014 – T3 – disaster recovery on AWS
AWS Summit Stockholm 2014 – T3 – disaster recovery on AWSAWS Summit Stockholm 2014 – T3 – disaster recovery on AWS
AWS Summit Stockholm 2014 – T3 – disaster recovery on AWS
 
Scaling on AWS for the First 10 Million Users (ARC206) | AWS re:Invent 2013
Scaling on AWS for the First 10 Million Users (ARC206) | AWS re:Invent 2013Scaling on AWS for the First 10 Million Users (ARC206) | AWS re:Invent 2013
Scaling on AWS for the First 10 Million Users (ARC206) | AWS re:Invent 2013
 
Oracle on AWS
Oracle on AWSOracle on AWS
Oracle on AWS
 
Partner Solutions: Veritas Technologies - Unique Ways Veritas can Supercharge...
Partner Solutions: Veritas Technologies - Unique Ways Veritas can Supercharge...Partner Solutions: Veritas Technologies - Unique Ways Veritas can Supercharge...
Partner Solutions: Veritas Technologies - Unique Ways Veritas can Supercharge...
 
Exadata Cloud Service Overview(v2)
Exadata Cloud Service Overview(v2) Exadata Cloud Service Overview(v2)
Exadata Cloud Service Overview(v2)
 
Apex day 1.0 oracle cloud news_andrej valach
Apex day 1.0 oracle cloud news_andrej valachApex day 1.0 oracle cloud news_andrej valach
Apex day 1.0 oracle cloud news_andrej valach
 
Disaster Recovery Sites on AWS: Minimal Cost, Maximum Efficiency
Disaster Recovery Sites on AWS: Minimal Cost, Maximum EfficiencyDisaster Recovery Sites on AWS: Minimal Cost, Maximum Efficiency
Disaster Recovery Sites on AWS: Minimal Cost, Maximum Efficiency
 
Oracle on AWS
Oracle on AWSOracle on AWS
Oracle on AWS
 
Opinionated re:Invent recap with AWS Heroes & Builders
Opinionated re:Invent recap with AWS Heroes & BuildersOpinionated re:Invent recap with AWS Heroes & Builders
Opinionated re:Invent recap with AWS Heroes & Builders
 
Webinar Development & Test
Webinar Development & TestWebinar Development & Test
Webinar Development & Test
 
[db tech showcase Tokyo 2018] #dbts2018 #B31 『1,2,3 and Done! 3 easy ways to ...
[db tech showcase Tokyo 2018] #dbts2018 #B31 『1,2,3 and Done! 3 easy ways to ...[db tech showcase Tokyo 2018] #dbts2018 #B31 『1,2,3 and Done! 3 easy ways to ...
[db tech showcase Tokyo 2018] #dbts2018 #B31 『1,2,3 and Done! 3 easy ways to ...
 
Cost Optimisation on AWS
Cost Optimisation on AWSCost Optimisation on AWS
Cost Optimisation on AWS
 
Cost Optimisation on AWS
Cost Optimisation on AWSCost Optimisation on AWS
Cost Optimisation on AWS
 
Aws webinar may 2013 designing for failure
Aws webinar may 2013   designing for failureAws webinar may 2013   designing for failure
Aws webinar may 2013 designing for failure
 
REPEAT_1_Deep_dive_on_new_features_in_Amazon_RDS_for_SQL_Server_DAT364-R1(1).pdf
REPEAT_1_Deep_dive_on_new_features_in_Amazon_RDS_for_SQL_Server_DAT364-R1(1).pdfREPEAT_1_Deep_dive_on_new_features_in_Amazon_RDS_for_SQL_Server_DAT364-R1(1).pdf
REPEAT_1_Deep_dive_on_new_features_in_Amazon_RDS_for_SQL_Server_DAT364-R1(1).pdf
 

More from Newvewm

Entrepreneur un slideshow v6
Entrepreneur un slideshow v6Entrepreneur un slideshow v6
Entrepreneur un slideshow v6Newvewm
 
The Inevitable Cloud Outage
The Inevitable Cloud OutageThe Inevitable Cloud Outage
The Inevitable Cloud OutageNewvewm
 
Newvem's Utilization Heat Map
Newvem's Utilization Heat MapNewvem's Utilization Heat Map
Newvem's Utilization Heat MapNewvewm
 
Hitting Your Cloud’s Usage Sweet Spot
Hitting Your Cloud’s Usage Sweet SpotHitting Your Cloud’s Usage Sweet Spot
Hitting Your Cloud’s Usage Sweet SpotNewvewm
 
Cloudpreneurs - McKinsey Reveals Fast Growth of Cloud Adoption
Cloudpreneurs - McKinsey Reveals Fast Growth of Cloud AdoptionCloudpreneurs - McKinsey Reveals Fast Growth of Cloud Adoption
Cloudpreneurs - McKinsey Reveals Fast Growth of Cloud AdoptionNewvewm
 
ClickSoftware AWS Customer Case
ClickSoftware AWS Customer CaseClickSoftware AWS Customer Case
ClickSoftware AWS Customer CaseNewvewm
 
SaaS as a Security Hazard - Google Apps Security Example
SaaS as a Security Hazard - Google Apps Security ExampleSaaS as a Security Hazard - Google Apps Security Example
SaaS as a Security Hazard - Google Apps Security ExampleNewvewm
 
Cloud security management by newvem
Cloud security management by newvemCloud security management by newvem
Cloud security management by newvemNewvewm
 
Hadoop & MapReduce
Hadoop & MapReduceHadoop & MapReduce
Hadoop & MapReduceNewvewm
 
Monitoring Your AWS Cloud Infrastructure
Monitoring Your AWS Cloud InfrastructureMonitoring Your AWS Cloud Infrastructure
Monitoring Your AWS Cloud InfrastructureNewvewm
 
OneHourTranslation - AWS Cloud Case Study
OneHourTranslation - AWS Cloud Case StudyOneHourTranslation - AWS Cloud Case Study
OneHourTranslation - AWS Cloud Case StudyNewvewm
 
Secure Your AWS Cloud Data by Porticor
Secure Your AWS Cloud Data by PorticorSecure Your AWS Cloud Data by Porticor
Secure Your AWS Cloud Data by PorticorNewvewm
 

More from Newvewm (12)

Entrepreneur un slideshow v6
Entrepreneur un slideshow v6Entrepreneur un slideshow v6
Entrepreneur un slideshow v6
 
The Inevitable Cloud Outage
The Inevitable Cloud OutageThe Inevitable Cloud Outage
The Inevitable Cloud Outage
 
Newvem's Utilization Heat Map
Newvem's Utilization Heat MapNewvem's Utilization Heat Map
Newvem's Utilization Heat Map
 
Hitting Your Cloud’s Usage Sweet Spot
Hitting Your Cloud’s Usage Sweet SpotHitting Your Cloud’s Usage Sweet Spot
Hitting Your Cloud’s Usage Sweet Spot
 
Cloudpreneurs - McKinsey Reveals Fast Growth of Cloud Adoption
Cloudpreneurs - McKinsey Reveals Fast Growth of Cloud AdoptionCloudpreneurs - McKinsey Reveals Fast Growth of Cloud Adoption
Cloudpreneurs - McKinsey Reveals Fast Growth of Cloud Adoption
 
ClickSoftware AWS Customer Case
ClickSoftware AWS Customer CaseClickSoftware AWS Customer Case
ClickSoftware AWS Customer Case
 
SaaS as a Security Hazard - Google Apps Security Example
SaaS as a Security Hazard - Google Apps Security ExampleSaaS as a Security Hazard - Google Apps Security Example
SaaS as a Security Hazard - Google Apps Security Example
 
Cloud security management by newvem
Cloud security management by newvemCloud security management by newvem
Cloud security management by newvem
 
Hadoop & MapReduce
Hadoop & MapReduceHadoop & MapReduce
Hadoop & MapReduce
 
Monitoring Your AWS Cloud Infrastructure
Monitoring Your AWS Cloud InfrastructureMonitoring Your AWS Cloud Infrastructure
Monitoring Your AWS Cloud Infrastructure
 
OneHourTranslation - AWS Cloud Case Study
OneHourTranslation - AWS Cloud Case StudyOneHourTranslation - AWS Cloud Case Study
OneHourTranslation - AWS Cloud Case Study
 
Secure Your AWS Cloud Data by Porticor
Secure Your AWS Cloud Data by PorticorSecure Your AWS Cloud Data by Porticor
Secure Your AWS Cloud Data by Porticor
 

Onavo aws summit 2012

  • 1. SCALING UP WITH AWS GROWING PAINS OF A STARTUP COMPANY Galed Friedmann Head of Operations
  • 2. ONAVO COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
  • 3. ONAVO IS 100% CLOUD BASED » Over 150 instances world wide › US East, EU West, South America, Singapore » Plenty of AWS services in use › EC2 S3 RDS IAM EMR › SES SNS SQS › CloudWatch Route53 CloudFront COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
  • 4. BASIC ARCHITECTURE COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
  • 5. THE GROWING PAINS » Continuously growing › Adding more resources all the time » Handling sudden increases › “We’re on TechCrunch, bring up more servers!” » Maintaining a 99.99% uptime COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
  • 6. UTILIZING RESOURCES COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
  • 7. AUTO SCALING » Maintains the desired amount of instances › Replaces unhealthy instances » Allows scaling up and down based on CloudWatch metrics » Completely automated › Assumes your application is automated COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
  • 8. BECOMING FULLY AUTOMATED » Instance Store backed › Pre-bundled AMIs with everything » Configuration » Sharing › No persistent storage, but data needs to be shared » Exporting › No persistent storage, but data needs to be saved COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
  • 9. AUTOMATING CONFIGURATION » Puppet › Keeping configuration up to date › Share resources › Deploy changes instantly Configuration Sharing Exporting COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
  • 10. LOAD BALANCER NEEDS TO KNOW » Life is easy with Auto Scaling & ELB › We’re not using ELB » Puppet keeps the LB up to date Oct 18 00:34:58 puppet-agent[6841]: (/Stage[main]/Loadbalancer::Loadbalancer/Export::Expiringhost[proxy21]/Host[stable_host21]/ip) ip changed '0.0.0.1' to '10.207.110.184' Oct 18 00:34:58 puppet-agent[6841]: Finished catalog run in 2.87 seconds Configuration Sharing Exporting COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
  • 11. SHARED CONFIGURATION » Basic information needs to be shared › Authentication details › Compression on/off › Desired compression level » Are there any off the shelf solutions? Configuration Sharing Exporting COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
  • 12. REDIS TO THE RESCUE! » Advanced key-value store » In memory data sets, atomic operations » Easy to implement master-slave replication Configuration Sharing Exporting COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
  • 13. LOG COLLECTION » Logs need to be collected and processed in order to display users’ savings » Flume – distributed, reliable and available service for moving large amounts of log data. Configuration Sharing Exporting COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
  • 14. DECIDING ON SCALING POLICIES » Scale up quickly › You want to prepare for the worst » Scale down slowly › Prevent fluctuations » Get the most out of the resource › Maintain 80-90% utilization COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
  • 15. PUTTING IT ALL TOGETHER COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
  • 16. SUMMARY » AWS have great building blocks » Auto Scaling › Reduces operational costs › Assists in utilizing your resources effectively » Prepare your automation and handle all use cases » It’s worth it. COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
  • 17. THANK YOU » galed@onavo.com » @galedfriedmann COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.

Editor's Notes

  1. Show how big we are now, and how many services we’re usingSpread across multiple regions
  2. Same amount of servers running all the time.During peak times – we don’t have enough resources available and sometimes need to add moreDuring low times – we have too many servers that are doing nothing
  3. Instance store – because we bring instances up and down automatically we do not need persistent storage
  4. When a new instance goes up the first thing it does is to get the latest configuration files from Puppet and change anything that have been updated since the AMI was last made.Changes that we want to deploy to our currently running instances are being deployed instantly
  5. ELB is great, our application needed some more functionalities from the LB and ELB did not suite our needs.