Journey Through the AWS Cloud; Development and Test

9,383 views
9,362 views

Published on

The second in our 'Journey' series of webinars, this complimentary presentation discusses the use of AWS as a development and test environment. The flexible and pay as you go nature of AWS makes it perfect for compute environments that need to be spun up quickly and disposed of when not needed, and placing this power at the fingertips of developers means you can make step changes in productivity as you progress applications through the dev/test cycle

Published in: Technology
1 Comment
5 Likes
Statistics
Notes
  • Youtube of webinar can be found here: http://www.youtube.com/watch?v=DU3yilHrDBU&feature=youtu.be
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total views
9,383
On SlideShare
0
From Embeds
0
Number of Embeds
4,565
Actions
Shares
0
Downloads
145
Comments
1
Likes
5
Embeds 0
No embeds

No notes for slide

Journey Through the AWS Cloud; Development and Test

  1. 1. Journey through the Cloud: Development & Test Ryan Shuttleworth – Technical Evangelist @ryanAWS
  2. 2. Journey through the cloudCommon use cases & stepping stones into the AWS cloud Learning from customer journeys Best practices to bootstrap your projects
  3. 3. Development & test Explore AWS benefits with a ‘non-production’ use caseCreate agility in development & test whilst ‘learning cloud’ Exercise elasticity and automation to real advantage
  4. 4. AgendaWhy AWS for development & test?AWS services that can be employedCommon dev-test patternsWhere to go next
  5. 5. Why AWS for development & test?
  6. 6. SaaS Functional Test Agile environments Continuous endurancePerformance BusinessUnit User applications Mobileapplications Load Integration
  7. 7. Common traitsDisposable Numerous
  8. 8. Projects start and stop frequentlyRequired for short period of timeGolden masters preferredDisposable Numerous
  9. 9. Projects start and stop frequently Many environments support an appRequired for short period of time Preservation of known configurationsGolden masters preferred Overlapping development cyclesDisposable Numerous
  10. 10. Projects start and stop frequently Many environments support an appRequired for short period of time Preservation of known configurationsGolden masters preferred Overlapping development cyclesDevelopment & test in the cloud
  11. 11. Development & test in the cloud
  12. 12. Take lots of it when you need it Unlimited elastic capacity Development & test in the cloud
  13. 13. Take lots of it when you need it Throw it away when you don’t Unlimited elastic capacity Cost optimization Development & test in the cloud
  14. 14. Take lots of it when you need it Throw it away when you don’t Unlimited elastic capacity Cost optimization Development & test in the cloud Preserve it for future reference Durable imaging & storage
  15. 15. Take lots of it when you need it The elastic datacenter Spinning up environments as you need them Packaged applications Development and test frameworks in AWS Testing at scale Rolling out to production
  16. 16. Take lots of it when you need it The elastic datacenter Spinning up environments as you need them Packaged applications Development and test frameworks in AWS Testing at scale Rolling out to production
  17. 17. Freeze dried essentials…Generic image Custom building block
  18. 18. Extend on-premise environments…
  19. 19. with Amazon VPC…
  20. 20. Populate as demand dictates…
  21. 21. Connect over dedicated links…
  22. 22. And turn it off when you are done
  23. 23. Take lots of it when you need itThrow it away when you don’tPreserve it for future reference
  24. 24. Take lots of it when you need it The elastic datacenter Spinning up environments as you need them Packaged applications Development and test frameworks in AWS Testing at scale Rolling out to production
  25. 25. “…AWS seemed to be the best solution available to allow a small, independent company to rapidly develop and test acompletely new infrastructure, and host it. We also loved the flexibility that AWSallowed us, when spinning up smaller test environments, for beta trials, QA,localization, and during development. The low initial cost was also crucial.” Alex Evans, CTO
  26. 26. Do it yourself Beanstalk CloudFormation Spinning up environments in a way that suits you AMIs, snapshots, boostrappingUsing core AWS features to setup an environment to meet your needs Use console or enact through simple scripting
  27. 27. Do it yourself Beanstalk CloudFormation Spinning up environments in a way that suits you AMIs, snapshots, Managed standard boostrapping containersUsing core AWS features to set Give development & testup an environment to meet your environments to developers needs direct from IDEs Use console or enact through Configure containers to meet simple scripting your needs through properties
  28. 28. Do it yourself Beanstalk CloudFormation Spinning up environments in a way that suits you AMIs, snapshots, Managed standard Declaratively defined boostrapping containers to your requirementsUsing core AWS features to set Give development & test Take full control of complexup an environment to meet your environments to developers environments using Cloud needs direct from IDEs Formation template language Use console or enact through Configure containers to meet Generate environment simple scripting your needs through properties specifications as you build software
  29. 29. Do it yourself Beanstalk CloudFormation Spinning up environments in a way that suits you AMIs, snapshots, Managed standard Declaratively defined boostrapping containers to your requirementsUsing core AWS features to set Give development & test Take full control of complexup an environment to meet your environments to developers environments using Cloud needs direct from IDEs Formation template language Use console or enact through Configure containers to meet Generate environment simple scripting your needs through properties specifications as you build software
  30. 30. Do it yourself Beanstalk CloudFormation Quickly deploy and manage apps in AWS…
  31. 31. Do it yourself Beanstalk CloudFormation …into a range of containers .Net Java PHP Python
  32. 32. Do it yourself Beanstalk CloudFormation Application package is deployed into Beanstalk
  33. 33. Do it yourself Beanstalk CloudFormation Which creates the container in EC2 User Application Application Service HTTP Service Language Interpreter Operating System Host
  34. 34. Do it yourself Beanstalk CloudFormation Beanstalk takes care of the environment…
  35. 35. Do it yourself Beanstalk CloudFormation …adding Elastic Load Balancer…
  36. 36. Do it yourself Beanstalk CloudFormation …Auto Scaling groups
  37. 37. Do it yourself Beanstalk CloudFormation …and launching instances
  38. 38. Do it yourself Beanstalk CloudFormation …all wired into the Beanstalk framework
  39. 39. Do it yourself Beanstalk CloudFormation …and published under a CNAME
  40. 40. Do it yourself Beanstalk CloudFormation …with logs and app versions held in S3
  41. 41. Do it yourself Beanstalk CloudFormation Spinning up environments in a way that suits you AMIs, snapshots, Managed standard Declaratively defined boostrapping containers to your requirementsUsing core AWS features to set Give development & test Take full control of complexup an environment to meet your environments to developers environments using Cloud needs direct from IDEs Formation template language Use console or enact through Configure containers to meet Generate environment simple scripting your needs through properties specifications as you build software
  42. 42. Do it yourself Beanstalk CloudFormation CloudFormation components & terminology CloudFormation Template Stack JSON formatted file Framework Configured AWS services Parameter definition Stack creation Comprehensive service support Resource creation Stack updates Service event aware Configuration actions Error detection and rollback Customisable
  43. 43. Do it yourself Beanstalk CloudFormation The benefit of templated environments Procedural definition Create it programmatically Template
  44. 44. Do it yourself Beanstalk CloudFormation The benefit of templated environments Procedural definition Known configuration Create it programmatically Store stack configuration in Template source control
  45. 45. Do it yourself Beanstalk CloudFormation The benefit of templated environments Procedural definition Known configuration Create it programmatically Store stack configuration in Template source control Parameter driven Dynamic and user-driven templates
  46. 46. Do it yourself Beanstalk CloudFormation The benefit of templated environments Procedural definition Known configuration Create it programmatically Store stack configuration in Template source control Parameter driven Collaboration Dynamic and user-driven Share templates with ease as templates just files
  47. 47. Take lots of it when you need it The elastic datacenter Spinning up environments as you need them Packaged applications Development and test frameworks in AWS Testing at scale Rolling out to production
  48. 48. Packaged applicationsEase the infrastructure burden when rolling out and testing upgrades/modifications
  49. 49. http://aws.amazon.com/sap/ Certification of SAP BusinessObjects business intelligence solutions and SAP Rapid Deployment Solutions (RDS) on Linux & Windows Server 2008 R2Certification of SAP Business All-in-One on Linux & Windows Server 2008 R2Certified database engines for production SAP deployments: MaxDB, DB2, MS SQL Server 2008 R2
  50. 50. Platform and applicationtemplates now availableReduce implementation times fromdays to minutes and include OracleEnterprise Linux, Oracle Database11gR2, Oracle E-Business Suite,Oracle JD Edwards Enterprise One,and Oracle PeopleSoft.
  51. 51. Take lots of it when you need it The elastic datacenter Spinning up environments as you need them Packaged applications Development and test frameworks in AWS Testing at scale Rolling out to production
  52. 52. Frameworks & environments AWS is open and flexible – build your dev-test systems Source control Project managementLeverage EC2 to run popular source Add integrated project control systems management and issue tracking Workstations Build servers Enable standard build Use EC2 horsepower to drive build developer/test workstations servers and continuous integration
  53. 53. Take lots of it when you need it The elastic datacenter Spinning up environments as you need them Packaged applications Development and test frameworks in AWS Testing at scale Rolling out to production
  54. 54. Testing at scale Create environments to support specific test types Unit & regression Load & performance Scale up and parallel run unit and Utilize spot market for generatingregression plans in a fraction of the load and test how applications time perform with auto-scaling A/B Security Run A/B scenario testing with Create sandboxes for aggressive replica stacks security testing
  55. 55. 1 instance for 100 hours =100 instances for 1 hour
  56. 56. Small instance = $8
  57. 57. Take lots of it when you need it The elastic datacenter Spinning up environments as you need them Packaged applications Development and test frameworks in AWS Testing at scale Rolling out to production
  58. 58. Elastic Load BalancerAuto Scaling Group V1 Amazon Relational Database Service (RDS)
  59. 59. Elastic Load BalancerAuto Scaling Auto Scaling Group Group V1 V2 Amazon Relational Database Service (RDS)
  60. 60. Elastic Load BalancerAuto Scaling Auto Scaling Group Group V1 V2 Amazon Relational Database Service (RDS)
  61. 61. Elastic Load BalancerAuto Scaling Auto Scaling Group Group V1 V2 Amazon Relational Database Service (RDS)
  62. 62. Elastic LoadBalancer Auto Scaling Group V2 Amazon Relational Database Service (RDS)
  63. 63. Take lots of it when you need it Throw it away when you don’t Unlimited elastic capacity Cost optimization Development & test in the cloud Preserve it for future reference Durable imaging & storage
  64. 64. Take lots of it when you need it Throw it away when you don’t Unlimited elastic capacity Cost optimization Development & test in the cloud Preserve it for future reference Durable imaging & storage
  65. 65. Instance types On-demand instances Reserved instances Spot instances Unix/Linux instances start at 1- or 3-year terms Bid on unused EC2 capacity $0.02/hour Pay low up-front fee, receive significant hourly Spot Price based on supply/demand, Pay as you go for compute power discount determined automatically Low cost and flexibility Low Cost / Predictability Cost / Large Scale, dynamic workload handling Pay only for what you use, no up-front Helps ensure compute capacity is available commitments or long-term contracts when needed Use Cases: Use Cases: Use Cases: Applications with short term, spiky, or Applications with steady state or predictable Applications with flexible start and end times unpredictable workloads; usage Applications only feasible at very low compute Application development or testing Applications that require reserved capacity, prices including disaster recovery
  66. 66. Turn it off when not in use Daily CPU Load 14 12 10 Load 8 6 4 2 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Hour
  67. 67. Turn it off when not in use Daily CPU Load 14 12 10 Load 8 6 4 25% Savings 2 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Hour
  68. 68. Turn it off when not in use Auto-scaling Auto-scaling by schedule by schedule 14 12 10 Load 8 6 4 2 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Hour
  69. 69. Take lots of it when you need it Throw it away when you don’t Unlimited elastic capacity Cost optimization Development & test in the cloud Preserve it for future reference Durable imaging & storage
  70. 70. Take lots of it when you need it Throw it away when you don’t Unlimited elastic capacity Cost optimization Development & test in the cloud Preserve it for future reference Durable imaging & storage
  71. 71. Disposable environments can be recreatedDispose for cost optimization, but preserve critical configurations
  72. 72. Disposable environments can be recreated Dispose for cost optimization, but preserve critical configurations AMIs Create a catalog of AMIs foreach iteration of an application Stored in S3
  73. 73. Disposable environments can be recreated Dispose for cost optimization, but preserve critical configurations AMIs Snapshots Create a catalog of AMIs for Save disk images with ‘frozen’each iteration of an application data sets and attach to instances Stored in S3 when needed
  74. 74. Disposable environments can be recreated Dispose for cost optimization, but preserve critical configurations AMIs Snapshots Templates Create a catalog of AMIs for Save disk images with ‘frozen’ Source control infrastructureeach iteration of an application data sets and attach to instances templates with every Stored in S3 when needed application version
  75. 75. Disposable environments can be recreated Dispose for cost optimization, but preserve critical configurations AMIs Snapshots Templates Create a catalog of AMIs for Save disk images with ‘frozen’ Source control infrastructureeach iteration of an application data sets and attach to instances templates with every Stored in S3 when needed application version Roll back and recreate an environment for any given application version
  76. 76. “The AWS Cloud brings business agility as Shell is able to deploy services much more quickly” Johan Krebers Vice President of ArchitectureThe Story The BenefitsGlobal oil and gas company No minimum commitment up front and pay per use brings significant savingsUsing AWS since 2010 Fast provisioning within minutes for manyOperationalising their cloud strategy applicationsShell Foundation Platform – an IT framework – is Elasticity – the ability to expand and contract ITAWS approved infrastructure as neededCore operational applications running in productionon AWSDevelopment and test environments running onAWS
  77. 77. Where to go next
  78. 78. http://aws.typepad.comhttp://aws.amazon.com/whitepapers
  79. 79. Summary
  80. 80. The cloud makes development & test easyYou can make extensive savings by leveraging elasticityProvides unique toolsets to help you create and manage environmentsLet’s you perform at scale and agility beyond traditional physical environments
  81. 81. aws.amazon.com get started on the free tier

×