Your SlideShare is downloading. ×
Architecting for the Cloud: Demo and Best Practicses - Janakiram MSV
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Saving this for later?

Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime - even offline.

Text the download link to your phone

Standard text messaging rates apply

Architecting for the Cloud: Demo and Best Practicses - Janakiram MSV

2,068
views

Published on

Published in: Technology, Business

0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
2,068
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
3
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Architec(ng  for  the  Cloud:   Demo  and  Best  Prac(ces     Janakiram  MSV   Technology  Evangelist   Amazon  Web  Services  
  • 2. ARCHITECTINGFOR THE CLOUDDemo and Best Practices Janakiram MSV AWS Technology Evangelist, India
  • 3. Agenda
  • 4. Introduction Intro
  • 5. } Introduction Seven Principles Intro 1 2 3 4 5 6 7
  • 6. Introduction Seven Principles Conclusions Intro 1 2 3 4 5 6 7 End
  • 7. Introduction Intro 1 2 3 4 5 6 7 End
  • 8. The Cloud Architect Physical vs. Cloud Scalability How to access the Cloud Costs
  • 9. Storage in the Physical world DAS (Direct-Attached Storage) SAN (Storage Area Network) NAS (Network-Attached Storage)
  • 10. Storage in the Cloud EC2 (Local Instance Store) EBS (Elastic Block Store) S3 (Simple Storage Service) SimpleDB, SQS, etc.
  • 11. Understanding Durability Designed for a Durability of: With 10,000 objects, 99.999999999 % on average, you lose one every 10,000,000 years S3 (Simple Storage Service)
  • 12. Scalability Large Medium Small
  • 13. Scale Up / Scale Out Scale Out (horizontally)
  • 14. Scale Up / Scale Out Scale Up (vertically)
  • 15. Demo #1: Scaling up EC2
  • 16. Web Software Command Resource Management Libraries Line Management Console and SDK Interface Tools Amazon Web Services API
  • 17. Cost is affected by Architecture EC2 instances (Generic, High-CPU, High-Mem) Data compression Backup strategy
  • 18. Cost is affected by Architecture EC2 instances (Generic, High-CPU, High-Mem) Data compression Backup strategy, example: Amazon S3: High Durability / Reduced Durability 99.99999999999% 99.99% from 0.140 from 0.093 US$ / GB / month US$ / GB / month
  • 19. EC2 instances: Small vs Medium 1 ECU = 1.2 GHz Xeon Small Medium Elastic Compute Unit 1 5X 5 RAM 1.7 GB 1.7 GB Storage 160 GB 2.2X 350 GB Hourly cost (US$) 0.085 2X 0.170
  • 20. Demo #2: EC2 instance types
  • 21. The Cloud Architect Physical vs. Cloud Scalability How to access the Cloud Costs
  • 22. Acronyms! Launch EC2 with EBS behind ELB with your domain on Route 53 and your videos on CloudFront, backup to S3 and your DB on RDS with Multi-AZ.
  • 23. Design for Failure and nothing will fail Intro 1 2 3 4 5 6 7 End
  • 24. Design for Failure and nothing will fail
  • 25. Design for Failure and nothing will fail Backup/Restore strategy Become impervious to reboot/relaunch Move in-memory sessions to data store Use Availability Zones (AZ), distribute EC2 Use Elastic Load Balancer Use Relational Database Service + Multi-AZ Use Elastic IP
  • 26. The AWS global infrastructure
  • 27. Regions Region: set of multiple Data Centers US West-2 US East AP Japan EU West US West-1 AP Singapore
  • 28. Regions Region: set of multiple Data Centers US West-2 GovCloud US East AP Japan EU West US West-1 AP Singapore
  • 29. Availability Zones (AZ) Distinct locations, insulated from failures US West-2 A B US East A B AP Japan A B A B C A B C C D EU West US West-1 A B AP Singapore
  • 30. Availability Zones (AZ) Distinct locations, insulated from failures Low latency connectivity within same region US West-2 A B US East A B AP Japan A B A B C A B C C D EU West US West-1 A B AP Singapore
  • 31. In addition to this...
  • 32. Amazon CloudFront + Route 53 Content Delivery Network (CDN) + DNS Seattle Amsterdam New York London Newark Stockholm Palo Alto Dublin Tokyo Frankfurt Paris Los Angeles Ashburn Jacksonville Hong Kong Dallas St.Louis Miami Singapore Sao Paulo
  • 33. Multi-AZ US West-2 A B US East A B AP Japan A B A B C A B C C D EU West US West-1 A B AP Singapore
  • 34. Multi-AZ ap-southeast-1a ap-southeast-1b EC2 EC2 EC2 EC2 A B AP Singapore AP Singapore
  • 35. Multi-AZ with RDS ap-southeast-1a ap-southeast-1b Master DB RDS RDS Standby Replica Auto Sync AP Singapore
  • 36. Demo #3: RDS with Multi-AZ
  • 37. Decouple Intro 1 2 3 4 5 6 7 End
  • 38. Simple Queue Service Reliable, highly scalable Queue Unlimited Queues / Messages Lock / Unlock Messages Also available externally
  • 39. Example: video encoding Sequential A B C D Input Store Encode Publish
  • 40. Example: video encoding Asynchronous A B C D Input Store Encode Publish M M M M M M M M M M M SQS Queue SQS Queue SQS Queue
  • 41. Example: video encoding Easier to scale! C C B B C C C A B C D Input Store Encode Publish M M M M M M M M M M M SQS Queue SQS Queue SQS Queue
  • 42. Elasticity Intro 1 2 3 4 5 6 7 End
  • 43. Elastic Warfare
  • 44. Elasticity with Amazon EC2 Cloudwatch EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 Amazon Web Services Your Application(s)
  • 45. Elasticity with Amazon EC2 Cloudwatch EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 Amazon Web EC2 EC2 Services Your Application(s)
  • 46. Elasticity with Amazon EC2 Cloudwatch EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 Amazon Web EC2 EC2 Services EC2 Your Application(s) EC2
  • 47. Elasticity with Amazon EC2 Cloudwatch EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 Amazon Web EC2 EC2 Services Your Application(s)
  • 48. Elasticity Scaling: Cyclic / Event-based / AutoScaling CloudWatch metrics Scale everything (servers, storage, etc) Use Management Tools whenever possible Bootstrap your instances
  • 49. Elasticity Scaling: Cyclic / Event-based / AutoScaling CloudWatch metrics Scale everything (servers, storage, etc) Use Management Tools whenever possible Bootstrap your instances Scaling out Scaling up EC2 EBS (from 1 to 5 servers) (from 20 GB to 100 GB)
  • 50. Demo #4: Setting up Autoscaling Demo #5: Watch EC2 autoscaling EBS scaling up
  • 51. Dynamic and Static Intro 1 2 3 4 5 6 7 End
  • 52. Dynamic and Static Keep dynamic data closer to EC2. E.g.: use same AZ for data-intensive applications Keep static data closer to end-user E.g.: use CloudFront to distribute content Tools: Custom AMI (Amazon Machine Image),bootstrap EC2 instances, Elastic IP
  • 53. Remapping an Elastic IP ec2-50-16-126-161.compute-1.amazonaws.com web 1 107.20.243.251 web 2
  • 54. Demo #6: Scaling up EC2
  • 55. Think Parallel Intro 1 2 3 4 5 6 7 End
  • 56. Mumbai Dabbawallas
  • 57. Think Parallel Elastic Map Reduce (EMR): Hadoop cluster Multi-part upload for Amazon S3 Elastic Load Balancing
  • 58. Demo #7: Elastic Load Balancing
  • 59. Don t fear constraints Intro 1 2 3 4 5 6 7 End
  • 60. Heroes don’t fear constraints
  • 61. Don t fear constraints Need Better Database performance? Sharding / Multiple Read-Only / Clustering
  • 62. Don t fear constraints Need Better Database performance? Sharding / Multiple Read-Only / Clustering Need More RAM? Shared Distributed cache (Memcached)
  • 63. Don t fear constraints Need Better Database performance? Sharding / Multiple Read-Only / Clustering Need More RAM? Shared Distributed cache (Memcached) Need Faster disks? Multiple EBS in Raid configuration
  • 64. Multi-AZ for RDS ap-southeast-1a ap-southeast-1b Master DB RDS RDS Standby Replica (as shown earlier)
  • 65. RDS Read Replica ap-southeast-1a ap-southeast-1b RDS RDS Master Standby Read RDS Queries Replica RDS 1 Replica 2
  • 66. Security Intro 1 2 3 4 5 6 7 End
  • 67. Security
  • 68. Security Certifications: ISO 27001, PCI-DSS level 1, etc. Physical / Network Security Encryption: SSL Endpoints, Encrypted FS EC2: Instance Isolation, Security Groups IAM: Identity Access Management VPC: Virtual Private Cloud
  • 69. Security groups Admin Console (107.3.8.123) RDS-servers RDS Public Internet RDS RDS 80 22 1521 web-servers app-servers DB-servers EC2 EC2 EC2 any EC2 22 EC2 EC2 EC2 EC2 EC2 1521
  • 70. Demo #8: Security Groups
  • 71. IAM: Identity Access Management Manage Users / Groups Manage security credentials Control access to API Control access to specific resources Control access based on environment variables Cost: zero.
  • 72. Net Networking Security Internet Internet AWS Direct Connect Amazon Virtual Private Dedicated Instances Cloud (VPC) Dedicated connection between Create and connect your Run your applications in a singleyour IT infrastructure and the isolated AWS resources and tenant model within the AWS AWS datacenters your IT infrastructure via a infrastructure secure VPN connection
  • 73. Conclusions Intro 1 2 3 4 5 6 7 End
  • 74. Seven principles: recap 1. Design for failure and nothing will fail 2. Decouple 3. Elasticity 4. Dynamic and Static 5. Think Parallel 6. Don t fear constraints 7. Security
  • 75. ARCHITECTINGFOR THE CLOUD
  • 76. Additional resources Architecture on AWS: http://aws.amazon.com/architecture White paper: Cloud Architecture http://j.mp/aws-architecture This presentation: http://slidesha.re/aws-architecting-cloud
  • 77. Janakiram MSV AWS Technology Evangelist, India jmsv@amazon.com Twitter: @janakiramm