Amazon Web Services, Technical Workshop, Berlin, January 2012

1,578 views

Published on

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,578
On SlideShare
0
From Embeds
0
Number of Embeds
9
Actions
Shares
0
Downloads
27
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Amazon Web Services, Technical Workshop, Berlin, January 2012

  1. 1. TECH WORKSHOP Johannes Borch – Solutions ArchitectAuthor: Carlos Conde – Solutions Architect
  2. 2. #1 AWS Technical Review#2 Cloud-Powered CI#4 Q&A Session
  3. 3. Core Principles
  4. 4. « Everything fails all the time »Werner Vogels – CTO of Amazon
  5. 5. When you turn off your cloudresources, you actually stop paying for them
  6. 6. Technical Review
  7. 7. Amazon EC2On-demand instances with admin access
  8. 8. Amazon Machine Images Pre-configured server Image
  9. 9. YOUR CODE3rd PARTYLIBRARIES CORESERVICESOPERATING SYSTEM AMI
  10. 10. YOUR CODE YOUR CODE3rd PARTY 3rd PARTYLIBRARIES LIBRARIES CORE CORESERVICES SERVICESOPERATING OPERATING SYSTEM SYSTEM AMI AMI
  11. 11. YOUR CODE YOUR CODE YOUR CODE3rd PARTY 3rd PARTY 3rd PARTYLIBRARIES LIBRARIES LIBRARIES CORE CORE CORESERVICES SERVICES SERVICESOPERATING OPERATING OPERATING SYSTEM SYSTEM SYSTEM AMI AMI AMI
  12. 12. VM ImportEasily import virtual machine images from your existing environment to Amazon EC2 instances • VMware ESX VMDK images • Citrix Xen VHD images • Microsoft Hyper-V VHD images for Microsoft Windows Server 2003 (R2) and 2008 (R1 & R2)
  13. 13. Instance-Store vs. EBS-Store
  14. 14. 32bits64bits
  15. 15. US East Region (N. VA) EU West Region (IRE) Japan Region (Tokyo)Availability Availability Availability Availability Zone A Zone B Zone A Zone B Availability Availability Zone A Zone BAvailability Availability Availability Zone C Zone D Zone C US West 1 Region (N. CA) APAC Region (Singapore) US West 2 Region (Oregon)Availability Availability Availability Availability Availability Availability Zone A Zone B Zone A Zone B Zone A Zone B
  16. 16. Amazon Route 53 On-demand DNS service + Elastic IPDynamic IP addresses for EC2 instances
  17. 17. Horizontal Scaling
  18. 18. Amazon CloudWatch Monitoring for AWS resources
  19. 19. Auto ScalingAutomatically scale up/down EC2 capacity
  20. 20. Elastic Load BalancingDistributes incoming traffic to EC2 instances
  21. 21. 6 am
  22. 22. 10 am
  23. 23. 10 am
  24. 24. 10 am
  25. 25. 7 pm
  26. 26. 7 pm
  27. 27. 7 pm
  28. 28. without elasticity you cant accelerate
  29. 29. High Availability
  30. 30. Media Storage & Distribution
  31. 31. Amazon S3Simple Storage Service
  32. 32. 1b Tb
  33. 33. 99.999999999% durability
  34. 34. Amazon S3 GrowthTotal Number of Objects Stored in Amazon S3 566 Billion 262 Billion 102 Billion 40 Billion 2.9 Billion 14 Billion
  35. 35. Tip: MFA Delete
  36. 36. Amazon CloudFront Flexible content delivery network
  37. 37. US West 1 US West 2 US East Europe West Asia Pacific Asia Pacific(N. California) (Oregon) (N. Virginia) (Dublin) (Singapore) (Tokyo) AWS Regions AWS Edge Locations (CloudFront & Route 53)
  38. 38. DEMO
  39. 39. Data Storage
  40. 40. Data StorageRelational Databases
  41. 41. Amazon RDSRelational Database Service
  42. 42. Backups
  43. 43. [[ console screenshot ]]RDS automated backups
  44. 44. [[ console screenshot ]]RDS DB snapshots
  45. 45. Restore
  46. 46. [[ console screenshot ]]RDS DB snapshots
  47. 47. [[ console screenshot ]]RDS snapshot restore
  48. 48. RDS Read-Replicas For read-heavy applications
  49. 49. RDS Multi-AZSecondary replica in another Availability Zone
  50. 50. RDBMS on EC2 Special use cases
  51. 51. [[ console screenshot ]]restore EBS from snapshot
  52. 52. Amazon ElastiCacheMemcached compatible in-memory cache
  53. 53. Data Storage"NoSQL" Databases
  54. 54. Amazon SimpleDBNoSQL database, key-value model
  55. 55. DomainID Category Name Color Size Make Model Yearitem01 Clothes Shirt Siamese small, medium, largeitem02 Clothes Sweater Blue, large 2006, Yellow, 2007 Pinkitem03 Car parts Emissions O2 Audi S4 2000, sensor 2001, 2002
  56. 56. ItemID Category Name Color Size Make Model Yearitem01 Clothes Shirt Siamese small, medium, largeitem02 Clothes Sweater Blue, large 2006, Yellow, 2007 Pinkitem03 Car parts Emissions O2 Audi S4 2000, sensor 2001, 2002
  57. 57. AttributesID Category Name Color Size Make Model Yearitem01 Clothes Shirt Siamese small, medium, largeitem02 Clothes Sweater Blue, large 2006, Yellow, 2007 Pinkitem03 Car parts Emissions O2 Audi S4 2000, sensor 2001, 2002
  58. 58. ValuesID Category Name Color Size Make Model Yearitem01 Clothes Shirt Siamese small, medium, largeitem02 Clothes Sweater Blue, large 2006, Yellow, 2007 Pinkitem03 Car parts Emissions O2 Audi S4 2000, sensor 2001, 2002
  59. 59. Amazon DynamoDB Fully managed NoSQL database
  60. 60. Low Latency ADMIN Massive and Seamless Scalability Durable and AvailablePredictable Performance Zero Administration
  61. 61. Average reads<5ms, writes<10ms
  62. 62. DEMO
  63. 63. Best Practices
  64. 64. Design for Failure • Elastic IP addresses • Multiple Azs • Snapshot EBS volumes
  65. 65. Multiple AWS accounts • Production • Development
  66. 66. AWS IAMIdentity and Access Management
  67. 67. 145Identity & Access Management (IAM)IAM offers greater security, flexibility,and control when using AWS, including:• Integration with your corporate directory• Create and manage user groups• Assign Permissions to Users and Groups• Manage Passwords
  68. 68. Use multi-factorauthenticationfor admins
  69. 69. Loose Coupling Adopt SOA principles
  70. 70. Create Independent components Design everything as a Black Box Think in terms of services Load-balance clustersAmazon SQS as Buffers Tight Coupling Controller A Controller B Controller C Q Q Q Loose Coupling using Queues Controller A Controller B Controller C
  71. 71. Amazon SQSSimple Queue Service
  72. 72. Use notificationsYou need to know when somethings wrong
  73. 73. Amazon CloudWatch Monitoring for AWS resources + Amazon SNS Simple Notification Service
  74. 74. Tip – Instance Optimizer Free Memory Free CPU PUT 2 weeks Free HDD At 1-min intervals Amazon CloudWatch Alarm Instance Custom Metrics “You could save a bunch of money by switching to a small instance, Click on CloudFormation Script to Save”
  75. 75. Implement Elasticity … In all your components
  76. 76. AutomateAWS is a programmable datacenter
  77. 77. App Vending MachinePre-configuredIT security-blessedauto-scalableauto-backupmulti-AZfull-controlone-click deployableenterprise apps
  78. 78. APIs / CLIScript your IT infrastructure
  79. 79. Java, Ruby, Python, PHP, .Net…res = ec2.runInstances new RunInstancesRequest([ imageId: "ami-00754474", keyName: "aws-sa-ww-key", instanceType: "m1.small", securityGroups: ["httpssh"], minCount: 1, maxCount: 1, userData: "AWSWeb.war".bytes.encodeBase64().toString() ])…
  80. 80. CLIPROMPT> ec2-run-instances ami-b232d0db -n 3 --availability-zone us-east-1a
  81. 81. HTTPhttps://ec2.amazonaws.com/?Action=RunInstances&ImageId=ami-60a54009&MaxCount=3&MinCount=1&Placement.AvailabilityZone=us-east-1b&Monitoring.Enabled=true&AUTHPARAMS
  82. 82. AWS CloudFormation Template-based provisioning service
  83. 83. Test & PrototypeOn-demand, pay as you go testing and prototyping
  84. 84. Data-based decision makingDrive your development by users feedback
  85. 85. "Hadoop is a reliable storage and data analysis system" HDFS MapReduce
  86. 86. MapReduce
  87. 87. (map ‘( )) ( )(reduce ‘( ))
  88. 88. Each input to a map is a list of <key, value> pairs(<a, > , <o, > , <p, > , …)Each output of a map is a list of <key, value> pairs(<a’, >, <o’, >, <p’, >, …)Each input to a reduce is a <key, value-list>(<a’, >, …)Reduced into a list of values
  89. 89. Deploying a Hadoop cluster is hardhttp://eddie.niese.net/20090313/dont-pity-incompetence/
  90. 90. Amazon Elastic MapReduceHadoop + The AWS Cloud
  91. 91. Data Warehouse (Batch Processing)Data Warehouse Data Warehouse (Steady State) (Steady State) Shrink to Expand to 9 instances 25 instances
  92. 92. Reducing Costs with Spot Instances Scenario #1 Scenario #2 Job Flow Job Flow Duration: Duration: 7 Hours 14 Hours Cost : #2: Cost with Spot 4 instances *14 hrs * $0.50 = $28 4 instances *7 hrs * $0.50 = $13 + 5 instances * 7 hrs * $0.25 = $8.75 Total = $21.75 Time Savings: 50% Cost Savings: ~22%
  93. 93. AWS is a set of infrastructure building blocks
  94. 94. Amazon Web Services is all about FLEXIBILITY
  95. 95. « Want to increase innovation? Lower the cost of failure » Joi Ito
  96. 96. AWS lowers the cost of innovation Testing a new idea is cheap
  97. 97. Resources
  98. 98. Architecture Centeraws.amazon.com/architecture
  99. 99. Articles & Tutorialsaws.amazon.com/articles
  100. 100. Videos & Webinarsaws.amazon.com/resources/webinars
  101. 101. FREE TIER!aws.amazon.com/free
  102. 102. Plat_forms web development contestUlrich Stärk, Freie Universität Berlin – Plat_forms web development contest:Der Wettbewerb wird am 03. und 04.04.2012 in den Räumen des Henry-Ford-Baus der Freien Universität Berlin stattfinden;der 02.04. wird als Anreise- und Aufbautag genutzt: https://www.plat-forms.org/Plat_Forms ist ein Experiment um die Eigenschaften verschiedenerWebentwicklungsplattformen (Java, .NET, PHP, Ruby, Perl, usw.)wissenschaftlich zu untersuchen, bei dem Teams professionellerSoftwareentwickler gegeneinander antreten
  103. 103. Q &A
  104. 104. THANK YOUaws.amazon.com

×