AWS 101 Lunch and Learn Jan 2013

  • 1,823 views
Uploaded on

Developing applications on Amazon Web Services (AWS) or moving your business into the cloud is more straightforward than you think. Whether you are a developer eager to learn new skills, a solutions …

Developing applications on Amazon Web Services (AWS) or moving your business into the cloud is more straightforward than you think. Whether you are a developer eager to learn new skills, a solutions architect who wants to solve existing technology problems, the IT professional who wants access to cost-effective, on-demand computing resources, this workshop is for you.

More in: Business
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
  • Amazon WS will change the world of business . The potential and possibilities of elastic computing power coupled with the reference model available on a global basis are endless. Access to Industry standard RBD's, APi's for everything and answering the main problem topic of security so skilfully and totally resolved. Love it
    Are you sure you want to
    Your message goes here
No Downloads

Views

Total Views
1,823
On Slideshare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
76
Comments
1
Likes
3

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. AWS 101Lunch & Learn Ryan Shuttleworth Technical Evangelist @ryanAWS
  • 2. Agenda12:00 - 12:45 Presentation – AWS 101 Introducing the concepts behind AWS such as utility computing and elasticity12:45 - 13:00 Working lunch13:00 - 14:00 Presentation and Demonstration Live demonstration and interactive walkthrough
  • 3. What we are going to cover Keypairs Amazon Machine Images Security groups S3 EC2 instances CloudFront Metadata service Elastic Load balancer Autoscaling RDS Feel free to follow along on your laptops
  • 4. background
  • 5. Consumer Seller IT Infrastructure Business Business Business Tens of millions of Sell on Amazon Cloud computing active customer websites infrastructure for accounts hosting web-scale Use Amazon solutions technology for your own retail website Eight countries: Hundreds of US, UK, Germany, Leverage Amazon’s thousands of Japan, France, massive fulfillment registeredCanada, China, Italy center network customers in over 190 countries
  • 6. About AmazonHow did Amazon…Web Services Deep experience in building and ? operating global web scale systems …get into cloud computing?
  • 7. Over 10 years in the makingEnablement of sellers on AmazonInternal need for scalable deployment environmentEarly forays proved developers were hungry for more
  • 8. AWS Mission Enable businesses and developers to use webservices* to build scalable,sophisticated applications. *What people now call “the cloud”
  • 9. Not excess capacity!
  • 10. Each day AWS adds the equivalent servercapacity to power Amazon when it was a global, $5B enterprise
  • 11. Each day AWS adds the equivalent servercapacity to power Amazon when it was a global, $5B enterprise 2003 $5.2B retail business 7,800 employees A whole lot of servers
  • 12. Objects in S3 1.3 Trillion 835k peak transactions per second
  • 13. EMR Jobs 3.7 M clusters launched since May 20104,000,0003,500,0003,000,0002,500,0002,000,0001,500,0001,000,000 500,000 0
  • 14. Utility computing
  • 15. Utility computingOn demand Pay as you goUniform Available
  • 16. Utility computingOn demand Pay as you goUniform Available
  • 17. Utility computing
  • 18. Utility computingOn demand Pay as you go Compute Scaling Security CDN Backup DNS Database Storage Load Balancing Workflow Monitoring NetworkingUniform Messaging Available
  • 19. On a global footprint Region US-WEST (N. California) EU-WEST (Ireland) GOV CLOUD ASIA PAC (Tokyo) US-EAST (Virginia)US-WEST (Oregon) ASIA PAC (Singapore) SOUTH AMERICA (Sao Paulo) ASIA PAC (Sydney)
  • 20. On a global footprint Availability Zone
  • 21. On a global footprint Edge Locations London(2) Seattle South Bend New York (3) Amsterdam (2) Newark Stockholm Dublin Palo Alto Tokyo (2)San Jose Frankfurt(2) Paris(2) Ashburn(2) Milan Madrid Osaka Los Angeles (2) Jacksonville Dallas(2) Hong Kong St.Louis Miami Singapore(2) Sydney Sao Paulo
  • 22. At the end of a web serviceec2-run-instances ami-b232d0db ec2-run-instances ami-b232d0db --instance-count 3 --instance-count 5 --availability-zone eu-west-1a --availability-zone eu-west-1c --instance-type m1.small --instance-type m1.medium
  • 23. At the end of a web service ec2-run-instances ami-b232d0db --instance-count 2 --availability-zone us-east-1d --instance-type m1.xlarge ec2-run-instances ami-b232d0db --instance-count 2 --availability-zone us-east-1b --instance-type m1.xlarge
  • 24. At the end of a web service as-create-auto-scaling-group MyGroup ec2-authorize default -p 80 --launch-configuration MyConfig --availability-zones eu-west-1c --min-size 2 --max-size 200 elb-create-lb myLoadBalancer
  • 25. and rich console services
  • 26. Elasticity
  • 27. Elastic capacity Traditional IT capacityCapacity Time Your IT needs
  • 28. Elastic capacityOn and Off Fast GrowthVariable peaks Predictable peaks
  • 29. Elastic capacity WASTEOn and Off Fast GrowthVariable peaks Predictable peaks CUSTOMER DISSATISFACTION
  • 30. Elastic capacityCapacity Traditional IT capacity Elastic cloud capacity Time Your IT needs
  • 31. Elastic capacityOn and Off Fast GrowthVariable peaks Predictable peaks
  • 32. 503Service Temporarily UnavailableThe server is temporarily unable to service your request due tomaintenance downtime or capacityproblems. Please try again later.
  • 33. 503Service Temporarily UnavailableThe server is temporarily unable to service your request due tomaintenance downtime or capacityproblems. Please try again later.
  • 34. From one instance…
  • 35. …to thousands
  • 36. Time: +00h <10 coresElastic Capacity
  • 37. Time: +24h >1500 coresElastic Capacity
  • 38. Time: +72h <10 coresElastic Capacity
  • 39. Time: +120h >600 coresElastic Capacity
  • 40. 40 servers to 5000 in 3 days EC2 scaled to peak of 5000 instances Number of EC2 Instances “Techcrunched” Launch of Facebook modification Steady state of ~40 instances 4/12/2008 4/13/2008 4/14/2008 4/15/2008 4/16/2008 4/17/2008 4/18/2008 4/19/2008 4/20/2008
  • 41. The Toolbox
  • 42. Reference Model Deployment & Administration App Services Compute Storage Database Networking AWS Global Infrastructure
  • 43. Global infrastructure Deployment & Administration App ServicesCompute Storage Database Regions An independent collection of AWS resources in a Networking defined geography A solid foundation for meeting location-dependent AWS Global Infrastructure privacy and compliance requirements
  • 44. Global infrastructure Deployment & Administration App ServicesCompute Storage Database Availability Zones Designed as independent failure zones Networking Physically separated within a typical metropolitan region AWS Global Infrastructure
  • 45. Global infrastructure Deployment & Administration App ServicesCompute Storage Database Edge Locations To deliver content to end users with lower latency Networking A global network of edge locations Supports global DNS infrastructure (Route53) and AWS Global Infrastructure Cloud Front CDN
  • 46. Networking Deployment & Administration App ServicesCompute Storage Database Direct Connect Dedicated connection between your IT Networking infrastructure and the AWS datacenters Extend your network infrastructure and VLANs AWS Global Infrastructure into AWS
  • 47. Networking Internet Deployment & Administration App ServicesCompute Storage Database VPN Connection A Hardware VPN connection connects amazon Networking environment to your datacenter Internet Protocol security (IPsec) VPN connection AWS Global Infrastructure Commonly used hardware supported
  • 48. Networking Internet Deployment & Administration App ServicesCompute Storage Database Virtual Private Cloud Private, isolated section of the AWS Cloud Networking Launch resources in a virtual network that you define complete control over your virtual networking AWS Global Infrastructure environment
  • 49. Networking Route 53 Highly available and scalable Domain Name System Extremely reliable and cost effective Feature Details Global Supported from AWS global edge locations for fast and reliable domain name resolution Scalable Automatically scales based upon query volumes Latency based routing Supports resolution of endpoints based upon latency, Deployment & Administration enabling multi-region application delivery Integrated Integrates with other AWS services allowing Route 53 to front load balancers, S3 and EC2 App Services Secure Integrates with IAM giving fine grained control over DNS record accessCompute Storage Database Networking AWS Global Infrastructure
  • 50. Compute Vertical Elastic Compute Cloud (EC2) Scaling Basic unit of compute capacity From $0.02/hr Range of CPU, memory & local disk options 13 Instance types available, from micro to cluster compute Feature Details Flexible Run windows or linux distributions Deployment & Administration Scalable Wide range of instance types from micro to cluster compute App Services Machine Images Configurations can be saved as machine images (AMIs) from which new instances can be created Full control Full root or administrator rightsCompute Storage Database Secure Full firewall control via Security Groups Monitoring Publishes metrics to Cloud Watch Networking Inexpensive On-demand, Reserved and Spot instance types AWS Global Infrastructure VM Import/Export Import and export VM images to transfer configurations in and out of EC2
  • 51. Compute Trigger auto- scaling policyas-create-auto-scaling-group MyGroup --launch-configuration MyConfig --availability-zones eu-west-1a --min-size 4 --max-size 200 Deployment & Administration Auto-scaling Automatic re-sizing of compute clusters based upon App Services demandCompute Storage Database Feature Details Control Define minimum and maximum instance pool sizes and when scaling and cool down occurs Networking Integrated to Use metrics gathered by CloudWatch to drive scaling CloudWatch Instance types Run auto scaling for on-demand instances and spot. Compatible with VPC AWS Global Infrastructure
  • 52. ComputeElastic Load BalancingCreate highly scalable applicationsDistribute load across EC2 instances in multipleavailability zones Deployment & Administration Feature Details Auto-scaling Automatically scales to handle request volume App Services Available Load balance across instances in multiple availability zonesCompute Storage Database Health checks Automatically checks health of instances and takes them in or out of service Session stickiness Route requests to the same instance Networking Secure sockets layer Supports SSL offload from web and application servers with flexible cipher support Monitoring Publishes metrics to Cloud Watch AWS Global Infrastructure
  • 53. Storage S3 - Durable storage, any object 99.999999999% durability of objects Unlimited storage of objects of any type Feature Details Up to 5TB size per object Flexible object store Buckets act like drives, folder structures within Access control Granular control over object permissions Deployment & Administration Server-side encryption 256bit AES encryption of objects Multi-part uploads Improved throughput & control App Services Object versioning Archive old objects and version new ones Object expiry Automatically remove old objectsCompute Storage Database Access logging Full audit log of bucket/object actions Networking Web content hosting Serve content as web site with built in page handling Notifications Receive notifications on key events AWS Global Infrastructure Import/Export Physical device import/export service
  • 54. Storage Elastic Block Store High performance block storage device 1GB to 1TB in size Mount as drives to instances Feature Details High performance file Mount EBS as drives and format as required system Deployment & Administration Flexible size Volumes from 1GB to 1TB in size Secure Private to your instances App Services Available Replicated within an Availability ZoneCompute Storage Database Backups Volumes can be snapshotted for point in time restore Monitoring Detailed metrics captured via Cloud Watch Networking AWS Global Infrastructure
  • 55. Database Relational Database Service Database-as-a-Service No need to install or manage database instances Scalable and fault tolerant configurations Deployment & Administration Feature Details Platform support Create MySQL, SQL Server and Oracle RDBMS App Services Preconfigured Get started instantly with sensible default settings Automated patching Keep your database platform up to date automaticallyCompute Storage Database Backups Automatic backups and point in time recovery and full DB backups Backups Volumes can be snapshotted for point in time restore Networking Failover Automated failover to slave hosts in event of a failure AWS Global Infrastructure Replication Easily create read-replicas of your data and seamlessly replicate data across availability zones
  • 56. Database DynamoDB Provisioned throughput NoSQL database Fast, predictable performance Fully distributed, fault tolerant architecture Feature Details Deployment & Administration Provisioned throughput Dial up or down provisioned read/write capacity Predictable Average single digit millisecond latencies from SSD performance backed infrastructure App Services Strong consistency Be sure you are reading the most up to date values Fault tolerant Data replicated across availability zonesCompute Storage Database Monitoring Integrated to Cloud Watch Networking Secure Integrates with AWS Identity and Access Management (IAM) Elastic MapReduce Integrates with Elastic MapReduce for complex analytics on large datasets AWS Global Infrastructure
  • 57. Application ServicesAmazon SQS Processing resultsReliable, highly scalable, queueservice for storing messages as they Amazon SQStravel between instances Deployment & Administration Processing task/processing trig App Services Feature DetailsCompute Storage Database Reliable Messages stored redundantly across multiple availability zones Simple Simple APIs to send and receive messages Networking Scalable Unlimited number of messages Secure Authentication of queues to ensure controlled access AWS Global Infrastructure
  • 58. Application ServicesSimple Workflow 1Reliably coordinate processing stepsacross applications Task A 2Integrate AWS and non-AWS resourcesManage distributed state in complexsystems Task B 3 (Auto-scaling) Deployment & Administration Task C App Services Feature Details Process state Maintain application state across complex workflows in a reliable and available mannerCompute Storage Database Tracking Tracks executions and log process for audit purposes Consistency Ensures processing tasks are executed and duplicity of Networking events does not occur Simple Simple Decider and Task programming model for rapid integration AWS Global Infrastructure
  • 59. Application Services DocumentCloud Search ServerElastic search engine based uponAmazon A9 search engineFully managed service withsophisticated feature set SearchScales automatically Server Deployment & Administration Results App Services Feature Details Auto-scaling Automatically scales based upon request volumes and data volumesCompute Storage Database High performance In memory operation means consistently low latency for search results Networking Sophisticated features Support for faceting, stemming, synonyms, stop words and custom rank expressions Low cost Elastic service, pay for what you use AWS Global Infrastructure
  • 60. Application ServicesCloudFront 3 Served from S3 /images/*World-wide content distributionnetworkEasily distribute content to end userswith low latency, high data transferspeeds, and no commitments. London 2 Served from EC2 *.php Paris Deployment & Administration 1 Single CNAME NY www.mysite.com App Services Feature DetailsCompute Storage Database Fast Multiple world-wide edge locations to serve content as close to your users as possible Integrated with other Works seamlessly with S3 and EC2 origin servers services Networking Dynamic content Supports static and dynamic content from origin servers Streaming Supports rtmp from S3 and includes support for live AWS Global Infrastructure streaming from Adobe FMS and Microsoft Media Server
  • 61. Deployment & Admin Elastic Beanstalk One-click deployment from Eclipse, Visual Studio and Git Rapid deployment of applications All AWS resources automatically created Deployment & Administration Feature Details Platform support Containers for Java, .net and PHP App Services Resource creation Creates load balancer, instances, autoscaling and monitoring automaticallyCompute Storage Database Monitoring & Logs Integrated with Cloud Watch and consolidates server logs Versioning Manage versions of applications and easily rollback deployments Networking Notifications Receive alerts on key events Full resource access Access all underlying AWS resources as necessary AWS Global Infrastructure
  • 62. Deployment & Admin Cloud Formation Automate creation of ‘stacks’ in a repeatable way Scripting framework for AWS resource creation Deployment & Administration Feature Details Platform support Support for AWS resources from EC2 to IAM App Services Resource creation Creates AWS resources behind the scenes and reports on progressCompute Storage Database Declarative Specify stacks in JSON format and source control your environments Customizable Drive stack creation with paramaters Networking AWS Global Infrastructure
  • 63. Deployment & Admin Identity & Access Management Granular control of user rights with AWS Automated granting of EC2 service rights Software Developer Kits Comprehensive support of programming models for Deployment & Administration using AWS services App ServicesCompute Storage Database Networking AWS Global Infrastructure
  • 64. + others Simple Email ServiceSimple Notification Service ElastiCache Elastic MapReduce CloudWatch …
  • 65. Introducing Amazon Redshift Data Warehousing the AWS Way Easily and rapidly analyze Automated deployment & petabytes of data administration1/10 the cost of traditional data Compatible with popular BI tools warehouses
  • 66. Your Analytics AWS Data PipelineOrchestration service for data-driven workflowsCreate automated and scheduled data flowsPre-integrated with AWS data sourcesEasily connect with 3rd party & on-premises sources
  • 67. NEW! Amazon Elastic Transcoder
  • 68. Security &Compliance
  • 69. Shared responsibility Foundation ServicesAmazon Compute Storage Database Networking Availability Zones AWS Global Edge Locations Infrastructure Regions
  • 70. Shared responsibility Customer Data Platform, Applications, Identity & Access ManagementYou Operating System, Network & Firewall Configuration Client-side Data Encryption & Data Server-side Encryption Network Traffic Protection Integrity Authentication (File System and/or Data) (Encryption/Integrity/Identity) Foundation ServicesAmazon Compute Storage Database Networking Availability Zones AWS Global Edge Locations Infrastructure Regions
  • 71. Security standards Certifications Physical Security HW, SW, NetworkSOC 1 Type 2 (formerly Datacenters in Systematic change SAS-70) nondescript facilities management ISO 27001 Physical access strictly Phased updates controlled deployment PCI DSS for EC2, S3, EBS, VPC, RDS, ELB, Must pass two-factor Safe storage IAM authentication at least decommission twice for floor access FISMA Moderate Automated monitoring Compliant Controls Physical access logged and self-audit and audited HIPAA & ITAR Advanced networkCompliant Architecture protection http://aws.amazon.com/security
  • 72. So what arewe going to do today?
  • 73. InstanceAvailability Zone Region
  • 74. Instance S3Availability Zone Region
  • 75. Cloud FrontInstance S3Availability Zone Region
  • 76. Cloud FrontInstance S3 RDSAvailability Zone Region
  • 77. Elastic Load Cloud Balancer Front Instance Instance S3 RDS Availability Zone Region
  • 78. Elastic Load Cloud Balancer Front Instance Instance S3 Auto scaling Group RDS Availability Zone Region
  • 79. Go grab some lunch, comeback and we’ll crack on
  • 80. Elastic Load Cloud Balancer Front Instance Instance S3 Auto scaling Group RDS Availability Zone Region
  • 81. EC2launch an instance
  • 82. bootstrapping passing data to an instance
  • 83. Instance User request data
  • 84. Instance User Meta-data request data service
  • 85. Instance User Meta-data request data service Instance
  • 86. Shell script in user-data will be executed on launch:#!/bin/shyum -y install httpd php mysql php-mysqlchkconfig httpd on/etc/init.d/httpd start
  • 87. key pairs secure access
  • 88. Public Key Inserted by Amazon into each EC2 instance that you launch EC2 InstanceComms securedwith private key Private Key Downloaded and stored by you
  • 89. security groups instance firewalling
  • 90. Name Description Security Group Protocol Port 22 (SSH) Port rangePort 80 IP Address, range,(HTTP) or another security group instance
  • 91. ELBelastic load balancer
  • 92. Elastic Load BalancerInstance Instance Instance Instance Instance InstanceAvailability Zone Availability Zone Availability Zone Region
  • 93. auto-scaling elastic server pool
  • 94. Launch Configuration Auto-Scaling Group Auto-Scaling Policy Describes what Auto Auto Scaling managed Parameters forScaling will create when grouping of EC2 performing an Auto adding instances Scaling action Instances Automatic health check to Scale Up/Down and by AMI how much Instance Type maintain pool size Security Group ChangeInCapacity (+/- #) Instance Key Pair Automatically scale the number of instances by ExactCapacity (#) policy – Min, Max, Desired ChangeInPercent (+/- %) Only one active launch configuration at a time Cool Down (seconds) Automatic Integration withAuto Scaling will terminate ELB Policy can be triggered by instances with old launch CloudWatch events configuration first Automatic distribution & rolling update balancing across AZs
  • 95. Create a launch configuration:as-create-launch-config --image-id ami-50348c51 --instance-type t1.micro --key apac-tok --group Web Servers’ --launch-config 101-launch-config
  • 96. Create an auto-scaling group:as-create-auto-scaling-group 101-as-group --availability-zones ap-northeast-1a --launch-configuration 101-launch-config --load-balancers myELB --max-size 5 --min-size 1
  • 97. Create an auto-scaling policy (scale up):as-put-scaling-policy 101ScaleUpPolicy --auto-scaling-group 101-as-group --adjustment=1 --type ChangeInCapacity --cooldown 300
  • 98. Create an auto-scaling policy (scale down):as-put-scaling-policy 101ScaleDownPolicy --auto-scaling-group 101-as-group "--adjustment=-1" --type ChangeInCapacity --cooldown 300
  • 99. aws.amazon.com