Architecting for the Cloud: demo and best practices, by Simone Brunozzi (2011 AWS Tour Australia)

100,038 views

Published on

Architecting for the Cloud: Demo and best practices.

Follow Simone Brunozzi on Twitter: @simon

Presentation recorded on July 14th, 2011, in Sydney during the 2011 AWS Tour Australia.

For the video (including audio), go here: http://www.slideshare.net/AmazonWebServices/video-architecting-for-the-cloud-demo-and-best-practices

Published in: Technology
28 Comments
319 Likes
Statistics
Notes
No Downloads
Views
Total views
100,038
On SlideShare
0
From Embeds
0
Number of Embeds
15,607
Actions
Shares
0
Downloads
1
Comments
28
Likes
319
Embeds 0
No embeds

No notes for slide
  • DAS Direct-Attached Storage (e.g. plain Hard Disk)SAN Storage Area Network (e.g. Disk arrays)NAS Network-Attached Storage
  • DAS Direct-Attached Storage (e.g. plain Hard Disk)SAN Storage Area Network (e.g. Disk arrays)NAS Network-Attached Storage
  • DAS Direct-Attached Storage (e.g. plain Hard Disk)SAN Storage Area Network (e.g. Disk arrays)NAS Network-Attached Storage
  • Add resources - performance should improve proportionallyOperationally efficient - price equal to costresilient - failure doesn't stop the servicemore cost-effective as it grows
  • 00-scale-up-ec2
  • 02_ec2-instance-types
  • 03_ec2-multi-az_rds-multi-az
  • 05_ec2-autoscaling_ebs-scale-up
  • 06_elastic-ip
  • 07_elastic-load-balancing
  • 09_security-groups
  • The earliest surviving written work is De architectura, by Roman architect Vitruvius in the early 1st century CE. firmitas, utilitas, venustasDurability – it should stand up robustly and remain in good condition.Utility – it should be useful and function well for the people using it. Beauty, it should delight people, raise their spirits
  • The earliest surviving written work is De architectura, by Roman architect Vitruvius in the early 1st century CE. firmitas, utilitas, venustasDurability – it should stand up robustly and remain in good condition.Utility – it should be useful and function well for the people using it. Beauty, it should delight people, raise their spirits
  • The earliest surviving written work is De architectura, by Roman architect Vitruvius in the early 1st century CE. firmitas, utilitas, venustasDurability – it should stand up robustly and remain in good condition.Utility – it should be useful and function well for the people using it. Beauty, it should delight people, raise their spirits
  • The earliest surviving written work is De architectura, by Roman architect Vitruvius in the early 1st century CE. firmitas, utilitas, venustasDurability – it should stand up robustly and remain in good condition.Utility – it should be useful and function well for the people using it. Beauty, it should delight people, raise their spirits
  • Architecting for the Cloud: demo and best practices, by Simone Brunozzi (2011 AWS Tour Australia)

    1. ARCHITECTING FOR THE CLOUD Demo and Best Practices Simone Brunozzi AWS Technology Evangelist, APACFriday, July 15, 2011
    2. Twitter : #awstour @simon AgendaFriday, July 15, 2011
    3. Twitter : #awstour @simon Introduction IntroFriday, July 15, 2011
    4. Twitter : #awstour @simon Introduction Seven Principles} IntroFriday, July 15, 2011 1 2 3 4 5 6 7
    5. Twitter : #awstour @simon Introduction Seven Principles Conclusions Intro 1 2 3 4 5 6 7 EndFriday, July 15, 2011
    6. Introduction Intro 1 2 3 4 5 6 7 EndFriday, July 15, 2011
    7. Architecting for the CloudFriday, July 15, 2011
    8. The Cloud Architect Physical vs. Cloud Scalability Interface CostsFriday, July 15, 2011
    9. Storage in the Physical world DAS (Direct-Attached Storage) SAN (Storage Area Network) NAS (Network-Attached Storage)Friday, July 15, 2011
    10. Storage in the Cloud EC2 (Local Instance Store) EBS (Elastic Block Store) S3 (Simple Storage Service) SimpleDB, SQS, etc.Friday, July 15, 2011
    11. Understanding Durability Designed for a Durability of: 99.999999999 % S3 (Simple Storage Service)Friday, July 15, 2011
    12. Scalability Large Medium SmallFriday, July 15, 2011
    13. A Truly Scalable System Maintains performance Operationally efficient Resilient Cost-effectiveFriday, July 15, 2011
    14. Scale Up / Scale Out Scale Out (horizontally)Friday, July 15, 2011
    15. Scale Up / Scale Out Scale Up (vertically)Friday, July 15, 2011
    16. First example: Scaling up EC2Friday, July 15, 2011
    17. This is a videoFriday, July 15, 2011
    18. Web Management Https (encrypted) Console Multi-Factor Auth (MFA) Amazon Web Services APIFriday, July 15, 2011
    19. Web Software Management Libraries Console and SDK Java, PHP, Ruby, Python, .NET Eclipse Toolkit Mobile: Android, iOS Amazon Web Services APIFriday, July 15, 2011
    20. Web Software Command Management Libraries Line Console and SDK Interface Amazon Web Services APIFriday, July 15, 2011
    21. Web Software Command Resource Management Libraries Line Management Console and SDK Interface Tools Puppet Chef PyChef Fabric Cuisine Etc. Amazon Web Services APIFriday, July 15, 2011
    22. Web Software Command Resource Management Libraries Line Management Console and SDK Interface Tools Amazon Web Services APIFriday, July 15, 2011
    23. Cost is affected by Architecture EC2 instances (Generic, High-CPU, High-Mem) Data compression Backup strategy, example: Amazon S3: High Durability / Reduced Durability 99.99999999999% 99.99% 0.140 0.093 US$ / GB / month US$ / GB / monthFriday, July 15, 2011
    24. EC2 instances: Small vs Medium 1 ECU = 1.2 GHz Xeon Small Medium Elastic Compute Unit 1 5X 5 RAM 1.7 GB 1.7 GB Storage 160 GB 2.2X 350 GB Hourly cost (US$) 0.085 2X 0.170Friday, July 15, 2011
    25. This is a videoFriday, July 15, 2011
    26. The Cloud Architect Physical vs. Cloud Scalability Interface CostsFriday, July 15, 2011
    27. When you use AWS, you can... Launch EC2 with EBS behind ELB with your domain on Route 53 and your videos on Cloudfront, backup to S3 and your DB on RDS with Multi-AZ. (so, sorry for the many acronyms)Friday, July 15, 2011
    28. Design for Failure and nothing will fail Intro 1 2 3 4 5 6 7 EndFriday, July 15, 2011
    29. Design for Failure and nothing will failFriday, July 15, 2011
    30. Design for Failure and nothing will fail Backup/Restore strategy Become impervious to reboot/relaunch Move in-memory sessions to data store Use Availability Zones (AZ), distribute EC2 Use Elastic Load Balancer Use Relational Database Service + Multi-AZ Use Elastic IPFriday, July 15, 2011
    31. The AWS global infrastructureFriday, July 15, 2011
    32. Regions Region: set of multiple Data Centers US West US East AP Japan EU West AP SingaporeFriday, July 15, 2011
    33. Availability Zones (AZ) Distinct locations, insulated from failures Low latency connectivity within same region US West US East A B AP Japan A B A B C A B C C D EU West A B AP SingaporeFriday, July 15, 2011
    34. In addition to this...Friday, July 15, 2011
    35. Amazon Cloudfront + Route 53 Content Delivery Network (CDN) + DNS Seattle Amsterdam New York London Newark Stockholm Palo Alto Dublin Tokyo Frankfurt Paris Los Angeles Ashburn Jacksonville Hong Kong Dallas St.Louis Miami SingaporeFriday, July 15, 2011
    36. Multi-AZ US West US East A B AP Japan A B A B C A B C C D EU West A B AP SingaporeFriday, July 15, 2011
    37. Multi-AZ ap-southeast-1a ap-southeast-1b EC2 EC2 EC2 EC2 AP SingaporeFriday, July 15, 2011
    38. Multi-AZ with RDS ap-southeast-1a ap-southeast-1b Master DB RDS RDS Standby Replica Auto Sync AP SingaporeFriday, July 15, 2011
    39. This is a videoFriday, July 15, 2011
    40. Decouple Intro 1 2 3 4 5 6 7 EndFriday, July 15, 2011
    41. Simple Queue Service Reliable, highly scalable Queue Unlimited Queues / Messages Lock / Unlock Messages Also available externallyFriday, July 15, 2011
    42. Example: video encoding Sequential A B C D Input Store Encode PublishFriday, July 15, 2011
    43. Example: video encoding Asynchronous A B C D Input Store Encode Publish M M M M M M M M MMM SQS Queue SQS Queue SQS QueueFriday, July 15, 2011
    44. Example: video encoding Easier to scale! C C B B CC C A B C D Input Store Encode Publish M M M M M M M M MMM SQS Queue SQS Queue SQS QueueFriday, July 15, 2011
    45. Elasticity Intro 1 2 3 4 5 6 7 EndFriday, July 15, 2011
    46. “Elastic” Honey BeesFriday, July 15, 2011
    47. “Elastic” Honey Bees Waggle dance Bee hive Food Water HousingFriday, July 15, 2011
    48. Elasticity with Amazon EC2 Cloudwatch EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 Amazon Web EC2 EC2 Services Your Application(s)Friday, July 15, 2011
    49. Elasticity with Amazon EC2 Cloudwatch EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 Amazon Web EC2 EC2 Services Your Application(s)Friday, July 15, 2011
    50. Elasticity with Amazon EC2 Cloudwatch EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 Amazon Web EC2 EC2 Services Your Application(s)Friday, July 15, 2011
    51. Elasticity with Amazon EC2 Cloudwatch EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 Amazon Web EC2 EC2 Services EC2 Your Application(s) EC2Friday, July 15, 2011
    52. Elasticity with Amazon EC2 Cloudwatch EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 EC2 Amazon Web EC2 EC2 Services Your Application(s)Friday, July 15, 2011
    53. Elasticity Scaling: Cyclic / Event-based / AutoScaling CloudWatch metrics Scale everything (servers, storage, etc) Use Management Tools whenever possible Bootstrap your instancesFriday, July 15, 2011
    54. Elasticity Scaling: Cyclic / Event-based / AutoScaling CloudWatch metrics Scale everything (servers, storage, etc) Use Management Tools whenever possible Bootstrap your instances Scaling out Scaling up EC2 EBS (from 1 to 5 servers) (from 20 GB to 100 GB)Friday, July 15, 2011
    55. This is a videoFriday, July 15, 2011
    56. Dynamic and Static Intro 1 2 3 4 5 6 7 EndFriday, July 15, 2011
    57. Dynamic and Static Keep dynamic data closer to EC2. E.g.: use same AZ for data-intensive applications Keep static data closer to end-user E.g.: use Cloudfront to distribute content Tools: Custom AMI (Amazon Machine Image), Elastic IPFriday, July 15, 2011
    58. This is a videoFriday, July 15, 2011
    59. Remapping an Elastic IP ec2-50-16-126-161.compute-1.amazonaws.com web 1 107.20.243.251 web 2Friday, July 15, 2011
    60. Think Parallel Intro 1 2 3 4 5 6 7 EndFriday, July 15, 2011
    61. High speed train: Shinkansen One engine per car!Friday, July 15, 2011
    62. Think Parallel Elastic Map Reduce (EMR) Multi-part upload for Amazon S3 Elastic Load BalancingFriday, July 15, 2011
    63. This is a videoFriday, July 15, 2011
    64. Don’t fear constraints Intro 1 2 3 4 5 6 7 EndFriday, July 15, 2011
    65. 1502: Leonardo Da Vinci’s bridge id II: B ay ez S u l t an ib le !" po ss " ImFriday, July 15, 2011
    66. After 499 years, in 2001Friday, July 15, 2011
    67. Bridge CloudFriday, July 15, 2011
    68. Don’t fear constraints Need Better Database performance? Sharding / Multiple Read-Only / Clustering Need More RAM? Shared Distributed cache (Memcached) Need Faster disks? Multiple EBS in Raid configurationFriday, July 15, 2011
    69. Multi-AZ for RDS ap-southeast-1a ap-southeast-1b Master DB RDS RDS Standby Replica (as shown earlier)Friday, July 15, 2011
    70. RDS Read Replica ap-southeast-1a ap-southeast-1b RDS RDS Master Standby Read RDS Queries Replica RDS 1 Replica 2Friday, July 15, 2011
    71. Security Intro 1 2 3 4 5 6 7 EndFriday, July 15, 2011
    72. SecurityFriday, July 15, 2011
    73. Security Certifications: ISO 27001, PCI-DSS level 1, etc. Physical / Network Security Encryption: SSL Endpoints, Encrypted FS EC2: Instance Isolation Security Groups IAM: Identity Access Management VPC: Virtual Private CloudFriday, July 15, 2011
    74. Security groups my Computer (107.3.8.123) RDS-servers RDS RDS internet RDS 80 22 1521 web-servers app-servers DB-servers EC2 EC2 EC2 any EC2 22 EC2 EC2 EC2 EC2 EC2 1521Friday, July 15, 2011
    75. This is a videoFriday, July 15, 2011
    76. IAM: Identity Access Management Manage Users / Groups Manage security credentials Control access to API Control access to specific resources Control access based on environment variables Cost: zero.Friday, July 15, 2011
    77. VPC: Virtual Private Cloud Your AWS Cloud Company Public EC2 EC2 locallocal Internet EC2 EC2 EC2 EC2 local local EC2 local 3 2 NAT EC2 EC2 Direct Virtual Private Cloud EC2 Private EC2 EC2 VPN EC2 EC2 EC2 1Friday, July 15, 2011
    78. Conclusions Intro 1 2 3 4 5 6 7 EndFriday, July 15, 2011
    79. De Architectura, 1st century C.E.Friday, July 15, 2011
    80. De Architectura, 1st century C.E. Firmitas Durability (Redundancy, Replication) Utilitas Utility (efficient use of resources) Venustas Beauty (Pleasure, Meaning, Satisfaction) Automation It works FocusFriday, July 15, 2011
    81. The “beauty” of Cloud Computing Automation It works FocusFriday, July 15, 2011
    82. The “beauty” of Cloud Computing CloudFormation Provision AWS resources in an orderly fashion Elastic Beanstalk Deploy applications in the Cloud Simple Email Service (SES) Highly scalable, cost-effective email-sending serviceFriday, July 15, 2011
    83. Seven principles: recap 1. Design for failure and nothing will fail 2. Decouple 3. Elasticity 4. Dynamic and Static 5. Think Parallel 6. Don’t fear constraints 7. SecurityFriday, July 15, 2011
    84. ARCHITECTING FOR THE CLOUDFriday, July 15, 2011
    85. Simone Brunozzi AWS Technology Evangelist, APAC Cardcloud.com/simone Twitter: @simon #awstourFriday, July 15, 2011

    ×