AWS Summit Berlin 2013 - Building web scale applications with AWS
•Download as PPTX, PDF•
1 like•2,557 views
AWS provides a platform that is ideally suited for deploying highly available and reliable systems that can scale with a minimal amount of human interaction. This talk describes a set of architectural patterns that support highly available services that are also scalable, low cost, low latency and allow for agile development practices. We walk through the various architectural decisions taken for each tier and explain our choices for appropriate AWS services and building blocks to ensure the security, scale, availability and reliability of the application.
Recommended
More Related Content
What's hot
What's hot (20)
Similar to AWS Summit Berlin 2013 - Building web scale applications with AWS
Similar to AWS Summit Berlin 2013 - Building web scale applications with AWS (20)
More from AWS Germany
More from AWS Germany (20)
Recently uploaded
Recently uploaded (20)
AWS Summit Berlin 2013 - Building web scale applications with AWS
- 1. Ryan Shuttleworth, Technical Evangelist Building Web-Scale Applications with AWS
- 2. What’s a web scale application? Three principles to build upon Layering the cake: Data Application Total Jobs Group – their story What are we going to cover?
- 3. What do web scale apps have in common?
- 4. Actual demand Predicted demand Customer dissatisfaction Waste Demand Time Elastic capacity No need to guess capacity requirements and over-provisionElastic Capacity
- 5. Elastic capacity Demand Time Elastic capacity No need to guess capacity requirements and over-provisionElastic Capacity
- 6. Built on a global footprint 9 Regions 25 Availability Zones Continuous Expansion Built across regional availability zones
- 7. Relational Database Service Database-as-a-Service No need to install or manage database instances Scalable and fault tolerant configurations DynamoDB Provisioned throughput NoSQL database Fast, predictable performance Fully distributed, fault tolerant architecture Use RDS for databases Use DynamoDB for high performance key- value DB Architected using services
- 8. Amazon SQS Processing task/processing trigger Processing results Amazon SQS Reliable, highly scalable, queue service for storing messages as they travel between instances Task A Task B (Auto-scaling) Task C 2 3 1 Simple Workflow Reliably coordinate processing steps across applications Integrate AWS and non-AWS resources Manage distributed state in complex systems Push inter-process workflows into the cloud with SWF Reliable message queuing without additional software Architected using services
- 9. Cloud Search Elastic search engine based upon Amazon A9 search engine Fully managed service with sophisticated feature set Scales automatically Document Server Results Search Server Don’t install search software, use CloudSearch Process large volumes of data cost effectively with EMR Elastic MapReduce Elastic Hadoop cluster Integrates with S3 & DynamoDB Leverage Hive & Pig analytics scripts Integrates with instance types such as spot Architected using services
- 10. Three principles to build upon…
- 11. Scale 1
- 22. Data Web scale data Object storage
- 23. Data You put it in S3 AWS stores with 99.999999999% durability Highly scalable web access to objects Multiple redundant copies in a region
- 24. What is S3? Highly scalable data storage Access via APIs A web store, not a file system Fast Highly available & durable Economical Data
- 25. Data
- 26. Data Web scale data Object storage
- 27. Data Web scale data Object storage Relational data
- 28. Data Master/Slave Horizontal Scaling Reasonably simple to implement Leverage PIOPs for raw performance Easy to change instances sizes Has an upper limit
- 29. Data hash ring Sharded Horizontal Scaling More complex at the application layer No practical limit on scalability Operation complexity/sophistication Shard by function or key space RDBMS or NoSQL A B C D
- 30. Data Web scale data Object storage Relational data
- 31. Data Web scale data Object storage Relational data NoSQL
- 32. Data Horizontal Scaling - Fully Managed DynamoDB Provisioned throughput NoSQL database Fast, predictable performance Fully distributed, fault tolerant architecture Considerations for non-uniform data
- 33. Data DynamoDB Provisioned read/write performance per table Predictable high performance scaled via console or API Dial it up
- 37. Data Application Loose coupling sets you free! The looser they're coupled, the bigger they scale Independent components Design everything as a black box Decouple interactions Load-balance clusters
- 38. Data Application Amazon SQS Processing task/processing trigger Processing results Amazon SQS Reliable, highly scalable, queue service for storing messages as they travel between instances
- 39. Data Application Controller A Controller B Controller C Tight Coupling
- 40. Data Application Controller A Controller B Controller C Controller A Controller B Controller C Tight Coupling Loose Coupling Q Q Q
- 41. Data Application Auto Scaling Automatic resizing of compute clusters based on demand Trigger auto- scaling policy Feature Details Control Define minimum and maximum instance pool sizes and when scaling and cool down occurs. Integrated to Amazon CloudWatch Use metrics gathered by CloudWatch to drive scaling. Instance types Run Auto Scaling for On-Demand and Spot Instances. Compatible with VPC.
- 44. Data Application State store should be: Performant Scalable Reliable
- 45. Data Application Trigger auto- scaling policy Where should state reside?
- 46. Data Application Trigger auto- scaling policy Where should state reside? Not here
- 47. Data Application Trigger auto- scaling policy Where should state reside? Not here Session state service State must reside OUTSIDE the scope of the elements you wish to scale
- 48. Data Application Where should state reside?Performant Scalable Reliable
- 49. Data Application Load Balancing Feature Details Available Load balance across instances in multiple Availability Zones Health checks Automatically checks health of instances and takes them in or out of service Session stickiness Route requests to the same instance Secure sockets layer Supports SSL offload from web and application servers with flexible cipher support Monitoring Publishes metrics to CloudWatch Elastic Load Balancing Create highly scalable applications Distribute load across EC2 instances in multiple availability zones
- 50. Data Application Load Balancing Distribution Route53 Region A Route53 Region B Request Route53 Global DNS service
- 51. Data Application Load Balancing Distribution Route53 Region A Route53 Region B 16ms 92ms Request Route53 Global DNS service
- 52. Data Application Load Balancing Distribution Route53 Region A Route53 Region B 16ms 92ms Request Route53 Global DNS service
- 53. Data Application Load Balancing Distribution Route53 Region A Route53 Region B 16ms 92ms Request Region A DNS entry Route53 Global DNS service
- 54. Data Application Load Balancing Distribution London Paris NY Served from S3 /images/* 3 Served from EC2 *.php 2 Single CNAME www.mysite.com 1 CloudFront World-wide content distribution network
- 55. Data Application Load Balancing Distribution ResponseTime ServerLoad ResponseTime Server Load ResponseTime Server Load No CDN CDN for Static Content CDN for Static & Dynamic Content CloudFront World-wide content distribution network
- 60. Data Application Load Balancing Distribution Management Automation & management Web scale enabler
- 61. OpsWorks Elastic Beanstalk CloudFormation EC2 Data Application Load Balancing Distribution Management
- 62. OpsWorks Elastic Beanstalk CloudFormation EC2 control convenience Data Application Load Balancing Distribution Management
- 63. Summary Use these techniques (and many others) as appropriate Awareness of the options is the first step to good design Scaling is the ability to move the bottlenecks around to the least expensive part of the architecture AWS makes this easier – so your application is not a victim of its own success Summary
- 64. Thank you