SCALING UP WITH AWSGROWING PAINS OF A STARTUP COMPANYGaled FriedmannHead of Operations
ONAVO        COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
ONAVO IS 100% CLOUD BASED» Over 150 instances world wide  › US East, EU West, South America, Singapore» Plenty of AWS serv...
BASIC ARCHITECTURE                COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
THE GROWING PAINS» Continuously growing  › Adding more resources all the time» Handling sudden increases  › “We’re on Tech...
UTILIZING RESOURCES                 COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
AUTO SCALING» Maintains the desired amount of instances  › Replaces unhealthy instances» Allows scaling up and down based ...
BECOMING FULLY AUTOMATED» Instance Store backed  › Pre-bundled AMIs with everything» Configuration» Sharing  › No persiste...
AUTOMATING CONFIGURATION» Puppet  › Keeping configuration    up to date  › Share resources  › Deploy changes    instantly ...
LOAD BALANCER NEEDS TO KNOW » Life is easy with Auto Scaling & ELB      › We’re not using ELB » Puppet keeps the LB up to ...
SHARED CONFIGURATION» Basic information needs to be shared  › Authentication details  › Compression on/off  › Desired comp...
REDIS TO THE RESCUE!» Advanced key-value store» In memory data sets, atomic operations» Easy to implement master-slave rep...
LOG COLLECTION» Logs need to be collected and processed in order to  display users’ savings» Flume – distributed, reliable...
DECIDING ON SCALING POLICIES» Scale up quickly  › You want to prepare for the worst» Scale down slowly  › Prevent fluctuat...
PUTTING IT ALL TOGETHER                 COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
SUMMARY» AWS have great building blocks» Auto Scaling  › Reduces operational costs  › Assists in utilizing your resources ...
THANK YOU» galed@onavo.com» @galedfriedmann                    COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
Upcoming SlideShare
Loading in …5
×

Onavo aws summit 2012

707 views

Published on

During the Amazon AWS Summit 2012 in Tel Aviv (Israel) Galed Friedmann - Head of Operations at Onavo - went on stage to talk about his company's experience using Amazon AWS services.

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
707
On SlideShare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
18
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Show how big we are now, and how many services we’re usingSpread across multiple regions
  • Same amount of servers running all the time.During peak times – we don’t have enough resources available and sometimes need to add moreDuring low times – we have too many servers that are doing nothing
  • Instance store – because we bring instances up and down automatically we do not need persistent storage
  • When a new instance goes up the first thing it does is to get the latest configuration files from Puppet and change anything that have been updated since the AMI was last made.Changes that we want to deploy to our currently running instances are being deployed instantly
  • ELB is great, our application needed some more functionalities from the LB and ELB did not suite our needs.
  • Onavo aws summit 2012

    1. 1. SCALING UP WITH AWSGROWING PAINS OF A STARTUP COMPANYGaled FriedmannHead of Operations
    2. 2. ONAVO COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
    3. 3. ONAVO IS 100% CLOUD BASED» Over 150 instances world wide › US East, EU West, South America, Singapore» Plenty of AWS services in use › EC2 S3 RDS IAM EMR › SES SNS SQS › CloudWatch Route53 CloudFront COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
    4. 4. BASIC ARCHITECTURE COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
    5. 5. THE GROWING PAINS» Continuously growing › Adding more resources all the time» Handling sudden increases › “We’re on TechCrunch, bring up more servers!”» Maintaining a 99.99% uptime COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
    6. 6. UTILIZING RESOURCES COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
    7. 7. AUTO SCALING» Maintains the desired amount of instances › Replaces unhealthy instances» Allows scaling up and down based on CloudWatch metrics» Completely automated › Assumes your application is automated COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
    8. 8. BECOMING FULLY AUTOMATED» Instance Store backed › Pre-bundled AMIs with everything» Configuration» Sharing › No persistent storage, but data needs to be shared» Exporting › No persistent storage, but data needs to be saved COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
    9. 9. AUTOMATING CONFIGURATION» Puppet › Keeping configuration up to date › Share resources › Deploy changes instantly Configuration Sharing Exporting COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
    10. 10. LOAD BALANCER NEEDS TO KNOW » Life is easy with Auto Scaling & ELB › We’re not using ELB » Puppet keeps the LB up to dateOct 18 00:34:58 puppet-agent[6841]:(/Stage[main]/Loadbalancer::Loadbalancer/Export::Expiringhost[proxy21]/Host[stable_host21]/ip) ipchanged 0.0.0.1 to 10.207.110.184Oct 18 00:34:58 puppet-agent[6841]: Finished catalog run in 2.87 seconds Configuration Sharing Exporting COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
    11. 11. SHARED CONFIGURATION» Basic information needs to be shared › Authentication details › Compression on/off › Desired compression level» Are there any off the shelf solutions? Configuration Sharing Exporting COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
    12. 12. REDIS TO THE RESCUE!» Advanced key-value store» In memory data sets, atomic operations» Easy to implement master-slave replication Configuration Sharing Exporting COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
    13. 13. LOG COLLECTION» Logs need to be collected and processed in order to display users’ savings» Flume – distributed, reliable and available service for moving large amounts of log data. Configuration Sharing Exporting COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
    14. 14. DECIDING ON SCALING POLICIES» Scale up quickly › You want to prepare for the worst» Scale down slowly › Prevent fluctuations» Get the most out of the resource › Maintain 80-90% utilization COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
    15. 15. PUTTING IT ALL TOGETHER COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
    16. 16. SUMMARY» AWS have great building blocks» Auto Scaling › Reduces operational costs › Assists in utilizing your resources effectively» Prepare your automation and handle all use cases» It’s worth it. COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
    17. 17. THANK YOU» galed@onavo.com» @galedfriedmann COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.

    ×