Amazon Web Services for Application Hosting | SugarCon 2011


Published on

In this presentation, Jeff Barr will introduce the principal Amazon Web Services from a business and technical point of view. Jeff will review the economics of cloud-based solutions, and will discuss the Elastic Compute Cloud (EC2), the Simple Storage Service (S3), and the Relational Database Service (RDS). Jeff will also discuss the ins and outs of hosting complex applications on AWS.

Presented by Jeff Barr, Senior Web Services Evangelist, Amazon Web Services, at SugarCon 2011.

Published in: Technology
1 Comment
  • Here I would like to introduce our new application - DNS30 Professional Edition, User Interface to Amazon Route 53 services which is going to release very soon. We also have online interface for this application.
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • This is a real usage graph from one of our financial services customers during the last week of April (They have asked to remain anonymous for competitive reasons). Firms on Wall Street are finding EC2 an ideal environment to run many of their dailymission critical grid computing and cpu bound applications for a couple key reasons: 1/ Flexibilitythe ability to instantly access hundreds/thousands of cores increases the amount of data they can process, improving the overall quality of their models. and 2/ Cost efficiencies, as they can complete more of their processing for less total spend (Not paying for infrastructure during times of the day and weekends when its not needed)This wall street firm in particular has a nightly business process where they upload the day’s market trading data into S3, and then run proprietary ‘risk management’ algorithms. This lasts ~10 hours during week nights, where they ramp up to the equivalent 3000 m1.smalls. During the day and on weekends, they maintain a base of roughly 300 cores, to handle their always on work loads.
  • A couple of nights ago one of our customers—Animoto—saw a monster spike in traffic. Animoto has a product that helps you create web videos with music and graphics. They launched a Facebook app that lets people tell their friends when they’ve uploaded a video that includes that friend. You can see the spike in traffic that this new app caused. The X axis represents time elapsed and the Y axis represents the EC2 instances launched. Because they were using AWS, Animoto didn’t have to do a thing—AWS took care of everything.
  • Amazon Web Services is a set of primitive building blocks to enable developers to build applications and, ultimately, businesses, on our battle-tested infrastructure. So what kinds of building blocks do developers need? First, you need compute resources. The Elastic Compute Cloud, or EC2, allows developers to rent virtual computers, running in our data centers, and pay for them by the hour. Provision as many as you need – 1, 10, 1000, for as long as you need them, and you pay only for what you use (starting at 10 cents/hour). Next, you probably need somewhere to durably store and retrieve data. The Simple Storage Service, is, well, a simple storage service that allows to store and retrieve objects in the cloud using simple put and get API calls.You might need to index and query for that data, or create other structured data that you want to query, which is what we built SimpleDB.
  • On the application platforms point, good to mention:Microsoft .NETIBM WebSphereRubyPHPOracle Fusion MiddlewareJBossAlso a good place to mention IBM AMIs (bring your own license or pay by the hour)
  • Amazon Web Services for Application Hosting | SugarCon 2011

    1. 1. Amazon Web Services<br />Jeff Barr, Senior Evangelist<br />@jeffbarr<br />
    2. 2. My Background<br />Based in Seattle, WA<br />Education:<br />BS in Computer Science, The American University, 1985<br />Graduate student in Digital Media, University of Washington, 2010<br />Background:<br />Microsoft Visual Studio team<br />Consulting to startups and VC’s<br />Amazon employee since 2002<br />Author, “Host Your Web Site in the Cloud”<br />Email:<br />Twitter: @jeffbarr<br />AWS – Confidential - Copyright © 2011, Amazon Web Services LLC or its affiliates. All rights reserved.<br />
    3. 3. The Cloud is Suddenly Everywhere<br />
    4. 4. What is Cloud Computing?<br />An analogy: think of electricity services…<br />You simply plug into a vast electrical grid managed by experts to get a low cost, reliable power supply – available to you with much greater efficiency than you could generate on your own.<br />Power is a utility service - available to you on-demand and you pay only for what you use.<br />
    5. 5. What is Cloud Computing?<br />Cloud Computing is also a utility service - giving you access to technology resources managed by experts and available on-demand.<br />You simply access these services <br />over the internet, with no up-front costs and you pay only for the resources you use.<br />
    6. 6. Attributes of Cloud Computing <br />No capital expenditure<br />Pay as you go and pay only for what you use<br />True elastic capacity; Scale up and down<br />Improves time to market<br />You get to focus your engineering resources on what differentiates you vs. managing the undifferentiated infrastructure resources <br />
    7. 7. What is Amazon Web Services?<br />Amazon Web Services is a cloud computing platform that provides <br />flexible, scalable, and cost-effective technology infrastructure for businesses of all sizes around the world…<br />…utilizing the knowledge, expertise, and tools used to run’s global web properties for over a decade. <br />
    8. 8. AWS Global Reach<br />AWS Regions<br />US East (Northern Virginia)<br />US West (Northern California)<br />Europe (Dublin)<br />Asia Pacific (Singapore)<br />Asia Pacific (Tokyo)<br />US East (Northern Virginia)<br />Availability Zone A<br />Availability Zone B<br />Availability Zone C<br />Availability Zone D<br />
    9. 9. Why Are People So Excited?<br />
    10. 10. The Dirty Little Secret<br />70%<br />30%<br />YourBusiness<br />Managing All of the “Undifferentiated Heavy Lifting”<br />On-PremiseInfrastructure<br />
    11. 11. AWS Goal: Flip This Equation<br />70%<br />30%<br />Managing All of the “Undifferentiated Heavy Lifting”<br />YourBusiness<br />On-PremiseInfrastructure<br />More Time to Focus onYour Business<br />Configuring Your Cloud Assets<br />AWSCloud-BasedInfrastructure<br />30%<br />70%<br />
    12. 12. Predicting Infrastructure Usage<br />Actual Usage<br />CustomerDissatisfaction<br />Predicted Usage<br />Compute Power<br />Waste<br />Time<br />
    13. 13. Example: Wall Street App on Amazon EC2<br />3000 -<br />Number of EC2 Instances<br />300 CPU’s on weekends<br />300 -<br />Thursday<br />4/23/2009<br />Friday<br />4/24/2009<br />Sunday<br />4/26/2009<br />Monday<br />4/27/2009<br />Tuesday<br />4/28/2009<br />Saturday<br />4/25/2009<br />Wednesday<br />4/22/2009<br />
    14. 14. Example: Video App on Amazon EC2<br />Scaled to peak of <br />5,000 instances in 3 days<br />Number of EC2 Instances<br />Launch of Facebook modification<br />4/12/2008<br />4/14/2008<br />4/15/2008<br />4/16/2008<br />4/18/2008<br />4/19/2008<br />4/20/2008<br />4/17/2008<br />4/13/2008<br />
    15. 15. The Bottom Line Benefit<br />The AWS Cloud turns capital expenses into variable costs while preserving flexibility and enhancing the scalability, availability, and security of IT infrastructure resources.<br />
    16. 16. <ul><li>Web site hosting
    17. 17. Application hosting/SaaS hosting
    18. 18. Internal IT application hosting
    19. 19. Content delivery and media distribution
    20. 20. High performance computing, batch data processing, and large scale analytics
    21. 21. Storage, backup, and disaster recovery
    22. 22. Development and test environments</li></ul>Common Use Cases<br />
    23. 23. Amazon Web Services<br />Cloud-Powered Applications<br />Monitoring<br />Amazon CloudWatch<br />Management<br />AWS Management Console<br />AWS Elastic Beanstalk<br />Tools<br />AWS Toolkit for Eclipse<br />Java, PHP, Ruby, Python, .Net Developer Centers<br />Network<br />Virtual Private Cloud<br />Route 53<br />Content Delivery<br />Amazon CloudFront<br />Messaging<br />Amazon Simple Queue Service (SQS)<br />Amazon Simple Notification Service (SNS)<br />Amazon Simple Email Service (SES)<br />Parallel Processing<br />Amazon Elastic MapReduce<br />Compute<br />Amazon Elastic Compute Cloud (EC2)<br />Storage<br />Amazon Simple Storage Service (S3)<br />Database<br />Amazon RDS<br />Amazon SimpleDB<br />Third-Party Offerings<br />Identity and Access Management<br />Metering and Billing<br />
    24. 24. AWS IN DETAIL!<br />
    25. 25. Amazon Elastic Compute Cloud<br />Amazon EC2: on-demand compute power<br />Obtain and boot new server instances in minutes<br />Quickly scale capacity up or down<br />Eleven instance types<br />Hourly billing<br />Key features:<br />Support for Windows, Linux, FreeBSD, and OpenSolaris<br />Supports all major web and application platforms<br />Deploy across Availability Zones for reliability<br />
    26. 26. Region<br />Availability Zone<br />Amazon EC2 Architecture<br />Amazon Machine Image (AMI)<br />Ephemeral Storage<br />EC2 Instance<br />Elastic Block Storage<br />CloudWatch<br />Security Group(s)<br />Auto Scaling<br />Amazon S3<br />Elastic IP Address<br />EBS Snapshot<br />EBS Snapshot<br />Load Balancing<br />
    27. 27. Amazon EC2 Pricing Options<br />On-DemandInstances<br />ReservedInstances<br />SpotInstances<br />Pay as you go for compute power<br />Pay only for what you use, no up-front commitments or long-term contracts<br />Unix/Linux instances start at $0.02/hour USD in the US East Region<br />Pay a low up-front fee and receive a significant discount on the hourly pricing for that instance<br />1- or 3-year terms<br />Helps ensure that compute capacity is available when it is needed<br />Enables you to bid on unused Amazon EC2 capacity<br />Spot Price is based on supply/demand and is determined automatically<br />If the Spot Price is below your bid, your instances will start<br />If the Spot Price rises above your bid, your instances will stop<br />
    28. 28. Amazon EC2 Instance Specs<br />All prices subject to change<br />
    29. 29. Amazon Relational Database Service<br />Provision a new relational database in seconds<br />MySQL (5.1 and 5.5) - Now<br />Oracle (11G) - Soon<br />Offload common administrative tasks to AWS<br />OS upgrades<br />DB upgrades and patches<br />Scaling CPU and storage<br />Backups & Restores<br />Use your existing code and tools<br />Pay only for what you use, no up-front commitments<br />Single and Multi-AZ<br />Read Replicas<br />
    30. 30. RDS in Action<br />
    31. 31. RDS in Action<br />
    32. 32. Hosting applications on AWS<br />
    33. 33.<br />AWS Management Console<br />
    34. 34. AWS CloudFormation Stack Creation<br />Define a JSON template of AWS Resources to provision (EC2 instances, AZ lists, AMIs, EIP, RDS, etc)<br />Parameterization supported<br />Use CLI, API, or Management Console to register and create an AWS stack<br />Service automatically determines interdependencies<br />AWS resources get created across tiers and AZs forming a CloudFormation Stack<br />AMAZON CONFIDENTIAL<br />
    35. 35. JSON Template<br />
    36. 36. Amazon Virtual Private Cloud - VPC<br />Create an isolated set of EC2 instances in the AWS cloud<br />Divide your IP address range into one or more public or private subnets<br />Control inbound and outbound access to and from individual subnets using stateless Network Access Control Lists<br />Protect your Instances with stateful filters for inbound and outbound traffic using Security Groups<br />Bridge your VPC and your onsite IT infrastructure with an encrypted VPN connection<br />Use Network Addess Translation (NAT)<br />
    37. 37.
    38. 38.
    39. 39.
    40. 40. Other Cloud Hosting Ideas<br />Easy scaling:<br />Geographies<br />CPU power<br />RAM<br />Bandwidth<br />Storage<br />Servers on Demand:<br />Development<br />Test Servers<br />Demo / Trial Use<br />Backup:<br /><ul><li>Snapshot EC2
    41. 41. Snapshot RDS
    42. 42. Data to S3</li></ul>Disaster Recovery:<br /><ul><li>Hot Spare
    43. 43. Geographic Redundancy</li></li></ul><li>For More Information<br />AWS Web Site:<br />AWS Blog:<br />Email:<br />Twitter: @jeffbarr<br />
    44. 44. Thank YOU!<br />