Architecting for the Cloud: Demo and Best Practicses - Janakiram MSV

2,626 views
2,449 views

Published on

Published in: Technology, Business
1 Comment
4 Likes
Statistics
Notes
  • Hello Janakiram, Excellent presentation. I really liked it. It is very clear and crisp. But obviously things have changed now (may2015) since you put this out (dec.2011). Is there an updated version to this that you are coming up or has anybody else in AWS already done that. If so, please either point me to your updated preso and/or to other resources that will reflect the most current set of services/solutions. Thanks,. Ravi Sutrave (rsutrave@yahoo.com)
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total views
2,626
On SlideShare
0
From Embeds
0
Number of Embeds
15
Actions
Shares
0
Downloads
0
Comments
1
Likes
4
Embeds 0
No embeds

No notes for slide

Architecting for the Cloud: Demo and Best Practicses - Janakiram MSV

  1. 1. Architec(ng  for  the  Cloud:   Demo  and  Best  Prac(ces     Janakiram  MSV   Technology  Evangelist   Amazon  Web  Services  
  2. 2. ARCHITECTINGFOR THE CLOUDDemo and Best Practices Janakiram MSV AWS Technology Evangelist, India
  3. 3. Agenda
  4. 4. Introduction Intro
  5. 5. } Introduction Seven Principles Intro 1 2 3 4 5 6 7
  6. 6. Introduction Seven Principles Conclusions Intro 1 2 3 4 5 6 7 End
  7. 7. Introduction Intro 1 2 3 4 5 6 7 End
  8. 8. The Cloud Architect Physical vs. Cloud Scalability How to access the Cloud Costs
  9. 9. Storage in the Physical world DAS (Direct-Attached Storage) SAN (Storage Area Network) NAS (Network-Attached Storage)
  10. 10. Storage in the Cloud EC2 (Local Instance Store) EBS (Elastic Block Store) S3 (Simple Storage Service) SimpleDB, SQS, etc.
  11. 11. Understanding Durability Designed for a Durability of: With 10,000 objects, 99.999999999 % on average, you lose one every 10,000,000 years S3 (Simple Storage Service)
  12. 12. Scalability Large Medium Small
  13. 13. Scale Up / Scale Out Scale Out (horizontally)
  14. 14. Scale Up / Scale Out Scale Up (vertically)
  15. 15. Demo #1: Scaling up EC2
  16. 16. Web Software Command Resource Management Libraries Line Management Console and SDK Interface Tools Amazon Web Services API
  17. 17. Cost is affected by Architecture EC2 instances (Generic, High-CPU, High-Mem) Data compression Backup strategy
  18. 18. Cost is affected by Architecture EC2 instances (Generic, High-CPU, High-Mem) Data compression Backup strategy, example: Amazon S3: High Durability / Reduced Durability 99.99999999999% 99.99% from 0.140 from 0.093 US$ / GB / month US$ / GB / month
  19. 19. EC2 instances: Small vs Medium 1 ECU = 1.2 GHz Xeon Small Medium Elastic Compute Unit 1 5X 5 RAM 1.7 GB 1.7 GB Storage 160 GB 2.2X 350 GB Hourly cost (US$) 0.085 2X 0.170
  20. 20. Demo #2: EC2 instance types
  21. 21. The Cloud Architect Physical vs. Cloud Scalability How to access the Cloud Costs
  22. 22. Acronyms! Launch EC2 with EBS behind ELB with your domain on Route 53 and your videos on CloudFront, backup to S3 and your DB on RDS with Multi-AZ.
  23. 23. Design for Failure and nothing will fail Intro 1 2 3 4 5 6 7 End
  24. 24. Design for Failure and nothing will fail
  25. 25. Design for Failure and nothing will fail Backup/Restore strategy Become impervious to reboot/relaunch Move in-memory sessions to data store Use Availability Zones (AZ), distribute EC2 Use Elastic Load Balancer Use Relational Database Service + Multi-AZ Use Elastic IP
  26. 26. The AWS global infrastructure
  27. 27. Regions Region: set of multiple Data Centers US West-2 US East AP Japan EU West US West-1 AP Singapore
  28. 28. Regions Region: set of multiple Data Centers US West-2 GovCloud US East AP Japan EU West US West-1 AP Singapore
  29. 29. Availability Zones (AZ) Distinct locations, insulated from failures US West-2 A B US East A B AP Japan A B A B C A B C C D EU West US West-1 A B AP Singapore
  30. 30. Availability Zones (AZ) Distinct locations, insulated from failures Low latency connectivity within same region US West-2 A B US East A B AP Japan A B A B C A B C C D EU West US West-1 A B AP Singapore
  31. 31. In addition to this...
  32. 32. Amazon CloudFront + Route 53 Content Delivery Network (CDN) + DNS Seattle Amsterdam New York London Newark Stockholm Palo Alto Dublin Tokyo Frankfurt Paris Los Angeles Ashburn Jacksonville Hong Kong Dallas St.Louis Miami Singapore Sao Paulo
  33. 33. Multi-AZ US West-2 A B US East A B AP Japan A B A B C A B C C D EU West US West-1 A B AP Singapore
  34. 34. Multi-AZ ap-southeast-1a ap-southeast-1b EC2 EC2 EC2 EC2 A B AP Singapore AP Singapore
  35. 35. Multi-AZ with RDS ap-southeast-1a ap-southeast-1b Master DB RDS RDS Standby Replica Auto Sync AP Singapore
  36. 36. Demo #3: RDS with Multi-AZ
  37. 37. Decouple Intro 1 2 3 4 5 6 7 End
  38. 38. Simple Queue Service Reliable, highly scalable Queue Unlimited Queues / Messages Lock / Unlock Messages Also available externally
  39. 39. Example: video encoding Sequential A B C D Input Store Encode Publish
  40. 40. Example: video encoding Asynchronous A B C D Input Store Encode Publish M M M M M M M M M M M SQS Queue SQS Queue SQS Queue
  41. 41. Example: video encoding Easier to scale! C C B B C C C A B C D Input Store Encode Publish M M M M M M M M M M M SQS Queue SQS Queue SQS Queue
  42. 42. Elasticity Intro 1 2 3 4 5 6 7 End
  43. 43. Elastic Warfare
  44. 44. Elasticity with Amazon EC2 Cloudwatch EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 Amazon Web Services Your Application(s)
  45. 45. Elasticity with Amazon EC2 Cloudwatch EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 Amazon Web EC2 EC2 Services Your Application(s)
  46. 46. Elasticity with Amazon EC2 Cloudwatch EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 Amazon Web EC2 EC2 Services EC2 Your Application(s) EC2
  47. 47. Elasticity with Amazon EC2 Cloudwatch EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 Amazon Web EC2 EC2 Services Your Application(s)
  48. 48. Elasticity Scaling: Cyclic / Event-based / AutoScaling CloudWatch metrics Scale everything (servers, storage, etc) Use Management Tools whenever possible Bootstrap your instances
  49. 49. Elasticity Scaling: Cyclic / Event-based / AutoScaling CloudWatch metrics Scale everything (servers, storage, etc) Use Management Tools whenever possible Bootstrap your instances Scaling out Scaling up EC2 EBS (from 1 to 5 servers) (from 20 GB to 100 GB)
  50. 50. Demo #4: Setting up Autoscaling Demo #5: Watch EC2 autoscaling EBS scaling up
  51. 51. Dynamic and Static Intro 1 2 3 4 5 6 7 End
  52. 52. Dynamic and Static Keep dynamic data closer to EC2. E.g.: use same AZ for data-intensive applications Keep static data closer to end-user E.g.: use CloudFront to distribute content Tools: Custom AMI (Amazon Machine Image),bootstrap EC2 instances, Elastic IP
  53. 53. Remapping an Elastic IP ec2-50-16-126-161.compute-1.amazonaws.com web 1 107.20.243.251 web 2
  54. 54. Demo #6: Scaling up EC2
  55. 55. Think Parallel Intro 1 2 3 4 5 6 7 End
  56. 56. Mumbai Dabbawallas
  57. 57. Think Parallel Elastic Map Reduce (EMR): Hadoop cluster Multi-part upload for Amazon S3 Elastic Load Balancing
  58. 58. Demo #7: Elastic Load Balancing
  59. 59. Don t fear constraints Intro 1 2 3 4 5 6 7 End
  60. 60. Heroes don’t fear constraints
  61. 61. Don t fear constraints Need Better Database performance? Sharding / Multiple Read-Only / Clustering
  62. 62. Don t fear constraints Need Better Database performance? Sharding / Multiple Read-Only / Clustering Need More RAM? Shared Distributed cache (Memcached)
  63. 63. Don t fear constraints Need Better Database performance? Sharding / Multiple Read-Only / Clustering Need More RAM? Shared Distributed cache (Memcached) Need Faster disks? Multiple EBS in Raid configuration
  64. 64. Multi-AZ for RDS ap-southeast-1a ap-southeast-1b Master DB RDS RDS Standby Replica (as shown earlier)
  65. 65. RDS Read Replica ap-southeast-1a ap-southeast-1b RDS RDS Master Standby Read RDS Queries Replica RDS 1 Replica 2
  66. 66. Security Intro 1 2 3 4 5 6 7 End
  67. 67. Security
  68. 68. Security Certifications: ISO 27001, PCI-DSS level 1, etc. Physical / Network Security Encryption: SSL Endpoints, Encrypted FS EC2: Instance Isolation, Security Groups IAM: Identity Access Management VPC: Virtual Private Cloud
  69. 69. Security groups Admin Console (107.3.8.123) RDS-servers RDS Public Internet RDS RDS 80 22 1521 web-servers app-servers DB-servers EC2 EC2 EC2 any EC2 22 EC2 EC2 EC2 EC2 EC2 1521
  70. 70. Demo #8: Security Groups
  71. 71. IAM: Identity Access Management Manage Users / Groups Manage security credentials Control access to API Control access to specific resources Control access based on environment variables Cost: zero.
  72. 72. Net Networking Security Internet Internet AWS Direct Connect Amazon Virtual Private Dedicated Instances Cloud (VPC) Dedicated connection between Create and connect your Run your applications in a singleyour IT infrastructure and the isolated AWS resources and tenant model within the AWS AWS datacenters your IT infrastructure via a infrastructure secure VPN connection
  73. 73. Conclusions Intro 1 2 3 4 5 6 7 End
  74. 74. Seven principles: recap 1. Design for failure and nothing will fail 2. Decouple 3. Elasticity 4. Dynamic and Static 5. Think Parallel 6. Don t fear constraints 7. Security
  75. 75. ARCHITECTINGFOR THE CLOUD
  76. 76. Additional resources Architecture on AWS: http://aws.amazon.com/architecture White paper: Cloud Architecture http://j.mp/aws-architecture This presentation: http://slidesha.re/aws-architecting-cloud
  77. 77. Janakiram MSV AWS Technology Evangelist, India jmsv@amazon.com Twitter: @janakiramm

×