AWS Road Trip 2013 - Presentation
•
4 likes•6,557 views
This presentation was delivered 14 times (in various forms) by AWS Evangelist Jeff Barr as part of his 2013 AWS Road Trip. After introducing AWS, it covers the basics of S3, EC2, RDS, DynamoDB, Elastic Block Storage, Auto Scaling, Elastic Load Balancing, Redshift, the AWS Trusted Advisor, and more.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (20)
Similar to AWS Road Trip 2013 - Presentation
Similar to AWS Road Trip 2013 - Presentation (20)
More from Amazon Web Services
More from Amazon Web Services (20)
Recently uploaded
Recently uploaded (20)
AWS Road Trip 2013 - Presentation
- 1. Amazon Web Services Jeff Barr – Principal Evangelist @jeffbarr / #awsroadtrip
- 2. #awsroadtrip @jeffbarr Introduction Evangelist = “Enthusiastic technical communicator” Amazon.com employee since 2002 BS, Computer Science, 1985 Masters of Communication in Digital Media, 2013 AWS Blog AWS Report – Video podcast “Host Your Web Site in the Cloud”
- 3. #awsroadtrip @jeffbarr I Love User Groups! Motivated guests Time to have an in-depth discussion Ask lots of questions, dive deep, don’t be shy Tweets, photos, etc - @jeffbarr / #awsroadtrip AWS credits, stickers, t-shirts, and more
- 4. #awsroadtrip @jeffbarr My Road Trip 14/14 User Groups Cloud Powered Follow my trip at http://awsroadtrip.com AWS Road Trip Website Contour Video Waze Map & Nav MapBox Map Site Red Lion Hotels 20/20 Nights 5550/5550 Miles foursquare Yelp Dropbox
- 5. #awsroadtrip @jeffbarr Agenda Amazon Web Services Background AWS And You AWS Overview New & Cool AWS Services & Features Getting Started With AWS Wrap Up
- 6. #awsroadtrip @jeffbarr AWS Mission Enable businesses and developers to use web services* to build scalable, sophisticated applications. *What people now call “the cloud”
- 7. #awsroadtrip @jeffbarr Our Goal Handle the undifferentiated heavy lifting so that you can focus on your application and your business!
- 8. Each day AWS adds the equivalent server capacity to power Amazon when it was a global, $5B enterprise $5.2B retail business 7,800 employees A whole lot of servers 2003
- 9. #awsroadtrip @jeffbarr Amazon S3 Over the Years Q4 2006 2.9 Billion Objects Q4 2007 14 Billion Objects Q4 2008 40 Billion Objects Q4 2009 102 Billion Objects Q4 2010 262 Billion Objects Q4 2011 762 Billion Objects Q1 2012 905 Billion Objects Q3 2012 1.3 Trillion Objects Q1 2013 2 Trillion Objects 1.1 Million Requests / Second
- 10. AWS Elastic MapReduce 0 500,000 1,000,000 1,500,000 2,000,000 2,500,000 3,000,000 3,500,000 4,000,000 3.7 M clusters launched since May 2010
- 11. #awsroadtrip @jeffbarr Hundreds of Thousands of Customers in 190 Countries
- 12. #awsroadtrip @jeffbarr Free steak campaign Facebook page Mars exploration operations Consumer social app Gene sequencing Marketing web site Interactive TV apps Financial markets analytics Web site & media sharing Disaster recovery Media streaming Web and mobile apps Every Conceivable Use Case
- 13. #awsroadtrip @jeffbarr Creative Cloud Marketing Cloud Digital Publishing Suite PhoneGap TypeKit Acrobat.com EchoSign Revel AWS at Adobe Behind it all: One common platform for shared services
- 14. Red Lion Hotels Hospitality & Leisure Build Hyper-Local Web & Mobile Apps on AWS Build Scalable Test Environment Migrate TicketsWest Reduced Costs; Better Scaling 47 Hotels in US & Canada Partner Support (2nd Watch)
- 15. NASA / JPL & AWS Mission-critical Projects Mars Rover Image processing Video Streaming for Landing Scale up as needed Highly Parallel Processing Whole World Watching One-Time Event
- 16. #awsroadtrip @jeffbarr Daily Mars Rover Data Processing Window (2 hours) Serial Process UploadPlan Pre-cloud: Parallel Process UploadPlan Cloud: Increase available mission planning time from 15 minutes to 105 minutes! NASA – Mission Data Processing
- 17. #awsroadtrip @jeffbarr AWS and You!
- 18. #awsroadtrip @jeffbarr Learn AWS – Architecture and APIs Build Applications Distribute Apps on the AWS Marketplace Become an AWS ISV or Solution Partner Become an AWS Certified Solutions Architect Join the AWS Team Attend AWS re:Invent in Las Vegas
- 19. #awsroadtrip @jeffbarr • First Exam: AWS Certified Solutions Architect - Associate Level • More exams coming: Solutions Architect, Systems Operators and Developers across proficiency levels (Associate, Professional, Master) • Exams delivered at Kryterion testing center (over 750 locations worldwide) AWS Certification Program aws.amazon.com/certification
- 20. #awsroadtrip @jeffbarr AWS re:Invent Coming to Las Vegas in November Pre-registration opening soon 2012 event attracted more than 6000 attendees Talks, exhibits, netwo rking, training
- 22. #awsroadtrip @jeffbarr Utility Computing On demand Pay as you go Uniform Available
- 23. #awsroadtrip @jeffbarr On demand Pay as you go Uniform Available Utility Computing
- 25. #awsroadtrip @jeffbarr Compute Storage Security Scaling Database Networking Monitoring Messaging Workflow DNS Load Balancing Backup CDN On demand Pay as you go Uniform Available Utility Computing
- 28. #awsroadtrip @jeffbarr Services for Any Workload Compute Networking Storage & CDN Amazon EC2 Amazon Elastic MapReduce Amazon Elastic Load Balancer Amazon Route 53 Amazon Virtual Private Cloud AWS Direct Connect Amazon S3 Amazon Glacier Amazon EBS AWS Import/Export Amazon CloudFront Database App Services Management Amazon RDS Amazon DynamoDB Amazon ElastiCache Amazon Redshift Amazon CloudSearch Amazon SWF Amazon SQS (Queues) Amazon SNS (Notifications) Amazon SES (Email) Amazon Elastic Transcoder AWS IAM Amazon CloudWatch AWS Elastic Beanstalk AWS CloudFormation AWS Data Pipeline AWS OpsWorks AWS CloudHSM AWS Trusted Advisor AWS Marketplace
- 29. #awsroadtrip @jeffbarr On a Global Footprint Region US-WEST (N. California) EU-WEST (Ireland) ASIA PAC (Tokyo) ASIA PAC (Singapore) US-WEST (Oregon) SOUTH AMERICA (Sao Paulo) US-EAST (Virginia) GOV CLOUD ASIA PAC (Sydney)
- 30. #awsroadtrip @jeffbarr Edge Locations Dallas(2) St.Louis Miami JacksonvilleLos Angeles (2) Palo Alto Seattle Ashburn(2) Newark New York (2) Dublin London(2) Amsterdam Stockholm Frankfurt(2) Paris(2) Singapore(2) Hong Kong Tokyo Sao Paulo South Bend San Jose Osaka Milan Seoul Sydney On a global footprint
- 31. #awsroadtrip @jeffbarr Amazon S3 Storage for the Internet 99.999999999% Durability Design Private or Public $0.095/ GB / Month (US East) Low Latency Backup, Image Hosting, Website Hosting Redundancy, Encr yption, Versioning
- 32. #awsroadtrip @jeffbarr Host a Static Website S3 Static Hosting + Route 53 DNS Simple and Very Scalable Log Files and Analytics
- 33. #awsroadtrip @jeffbarr Amazon Glacier Secure & Durable Storage Data Archiving & Backup For Data That’s Accessed Infrequently $0.01 / GB / Month (US East) Retrieve Data In 3-5 Hours Integrated With S3 Third Party Support
- 34. #awsroadtrip @jeffbarr Provision and boot new servers in minutes Boot from AMI (Amazon Machine Image) Your choice of Linux or Windows Quickly scale capacity up or down Deploy across Regions and Availability Zones for flexibility & reliability Choose between 18 different instance types Amazon EC2
- 35. #awsroadtrip @jeffbarr 256 128 64 32 16 8 4 2 1 1 2 4 8 16 32 64 128 256 High I/O 4XL 60.5 GB 35 EC2 Compute Units 16 virtual cores 2*1024 GB SSD-based local instance storage EC2 Compute Units Memory(GB) Small 1.7 GB, 1 EC2 Compute Unit 1 virtual core Micro 613 MB Up to 2 ECUs (for short bursts) Large 7.5 GB 4 EC2 Compute Units 2 virtual cores $0.32/0.46 Hi-Mem XL 17.1 GB 6.5 EC2 Compute Units 2 virtual cores Hi-Mem 2XL 34.2 GB 13 EC2 Compute Units 4 virtual cores Hi-Mem 4XL 68.4 GB 26 EC2 Compute Units 8 virtual cores High-CPU Med 1.7 GB 5 EC2 Compute Units 2 virtual cores High-CPU XL 7 GB 20 EC2 Compute Units 8 virtual cores Medium 3.7 GB, 2 EC2 Compute Units 1 virtual core M3 XL 15 GB 13 EC2 Compute Units 4 virtual cores EBS storage only M3 2XL 30 GB 26 EC2 Compute Units 8 virtual cores EBS storage only Extra Large 15 GB 8 EC2 Compute Units 4 virtual cores 10 GB Inter-Instance Network Cluster GPU 4XL 22 GB 33.5 EC2 Compute Units, 2 x NVIDIA Tesla “Fermi” M2050 GPUs Cluster Compute 4XL 23 GB 33.5 EC2 Compute Units Cluster Compute 8XL 60.5 GB 88 EC2 Compute Units High Storage 8XL 117 GB 35 EC2 Compute Units, 24 * 2 TB ephemeral drives 10 GB Ethernet Hi-Mem Cluster Compute 8XL 244 GB 88 EC2 Compute Units 16 virtual cores 240 GB SSD
- 36. #awsroadtrip @jeffbarr EC2 Pricing / Payment Options AWS Free Usage Tier On- Demand Pricing Reserved Instances Spot Market For new customers (one year) 750 hours / month Linux 750 hours / month Windows And much more… Pay published rates for EC2 By the hour $0.02 / hour Micro $4.60 / hour High Storage 8XL Make low, one-time payment Receive significant discount on hourly charge Low, medium, high utilization Reserved Instance Marketplace Place bids for compute time One-shot or recurring Price changes based on supply and demand For distributed, fa ult-tolerant tasks 750 hours of Amazon EC2 Linux Micro Instance usage 750 hours of Amazon EC2 Microsoft Windows Server Micro Instance 750 hours of an Elastic Load Balancer 30 GB of Amazon Elastic Block Storage 5 GB of Amazon S3 standard storage 100 MB of storage, 5 units of write capacity, and 10 units of read capacity for Amazon DynamoDB 25 Amazon SimpleDB Machine Hours and 1 GB of Storage 1,000 Amazon SWF workflow executions can be initiated for free 100,000 Requests of Amazon Simple Queue Service 100,000 Requests, 100,000 HTTP notifications and 1,000 email notifications for Amazon Simple Notification Service 10 Amazon Cloudwatch metrics, 10 alarms, and 1,000,000 API requests 15 GB of bandwidth out aggregated across all AWS services* 750 hours of Amazon RDS for SQL Server Micro DB Instance usage 20 GB of database storage 10 million I/Os 20 GB of backup storage for your automated database backups and any user-initiated DB Snapshots Savings Light Medium Heavy 1 Year <= 30% <= 39% <= 45% 3 Year <= 49% <= 59% <= 65% Breakeven Point Light Medium Heavy 1 Year >= 28% >= 41% >= 56% 3 Year >= 11% >= 19% >= 35%
- 37. #awsroadtrip @jeffbarr EC2 Server Access
- 38. #awsroadtrip @jeffbarr Virtual firewall Control access to instance Default configuration: no access EC2 Security Group
- 39. #awsroadtrip @jeffbarr Fixed IP address Map to any EC2 instance in a Region Retain address after switching instances EC2 Elastic IP Address
- 40. #awsroadtrip @jeffbarr Tracks and stores AWS and user-defined metrics 2 week retention period Detect issues Raise alerts Amazon CloudWatch
- 41. #awsroadtrip @jeffbarr Distribute traffic to an array of EC2 instances Part of scaling architecture Configure ports and health checks Traffic goes to healthy instances EC2 Elastic Load Balancer
- 42. #awsroadtrip @jeffbarr Control number of running EC2 instances Scale up or down as needed Drive decisions based on CloudWatch metrics • CPU load • Network traffic Auto-scaling group • Instance collection • Actions (rules) EC2 Auto Scaling
- 43. #awsroadtrip @jeffbarr Virtual disk volumes 1 GB – 1 TB per volume Create and attach to EC2 instance Format and write data Snapshot and restore Provision desired IOPS (up to 4000 per volume) EC2 Elastic Block Store
- 44. #awsroadtrip @jeffbarr Relational Database Service
- 45. #awsroadtrip @jeffbarr DynamoDB is a fully managed NoSQL database service that provides extremely fast and predictable performance with seamless scalability Amazon DynamoDB
- 46. #awsroadtrip @jeffbarr DynamoDB Highlights Low Latency Massive & Seamless Scalability Predictable Performance SSD- based storage nodes Average reads < 5ms, writes < 10ms No table size or throughput limits Live repartitioning for changes to storage and throughput Provisioned throughput model Durable & Available Consistent, disk- only writes Alter throughput as needed Redundant & self- healing
- 47. #awsroadtrip @jeffbarr DynamoDB Provisioned Throughput
- 48. #awsroadtrip @jeffbarr AWS Trusted Advisor Inspects AWS Environment; Makes Recommendations Using Aggregated AWS Operational History From Hundreds of Thousands of Customers Reduce Costs Close Security Gaps Increase Performance
- 49. #awsroadtrip @jeffbarr Elastic Transcoding Service Transcode Video Files Scalable and Cost- Effective S3 to S3 HTTP Live Streaming (HLS) WebM (VP8 Video, Ogg Audio) MPEG2-TS (H.264 Video, AAC Audio) Multiple Outputs / Job Bit Rate Optimization Aspect Ratio & Sizing Policies
- 50. #awsroadtrip @jeffbarr Amazon Redshift Fully Managed Petabyte-Scale Data Warehouse 1/10th the Cost of Most Existing Solutions Use Existing Business Intelligence Tools More than 1000 customers Adding > 100 customers / week 2 TB & 16 TB Nodes Up to 100 16 TB Nodes / Cluster AES-256 encryption in hardware For data, metadata, S3 backups http://aws.amazon.com /redshift/partners
- 51. #awsroadtrip @jeffbarr Getting Started With AWS
- 52. #awsroadtrip @jeffbarr Use MFA (Optional, highly recommended) Getting Started With AWS Create account at aws.amazon.com You will need a credit card (even for the free usage tier) Set a billing alert (optional, highly recommended)
- 53. #awsroadtrip @jeffbarr Host a static website Host a dynamic website Launch a Marketplace application Build a cloud application using the AWS APIs and SDKs
- 54. #awsroadtrip @jeffbarr Host a Static Website S3 Static Hosting + Route 53 DNS Simple and Very Scalable Log Files and Analytics
- 55. #awsroadtrip @jeffbarr Host a Dynamic Website From Simple to Complex Load Balancer and >= 2 EC2 Instances The Sky is the Limit! http://awsofa.info/
- 56. #awsroadtrip @jeffbarr Launch a Marketplace App
- 57. #awsroadtrip @jeffbarr Build a Cloud App Use the AWS SDKs Java Ruby PHP .Net IOS Android Node.JS AWS Toolkit for Eclipse Python AWS Toolkit for Visual Studio
- 59. #awsroadtrip @jeffbarr Please Take My Survey awsroadtrip.com/survey
- 60. #awsroadtrip @jeffbarr Thanks for Coming! Follow My Journey…
Editor's Notes
- So in 2006 Amazon Web Services was born. It's mission was clear: to enable businesses and developers to use web services to scalable sophisticated applications. It's interesting to note that what we called Web Services, has now morphed into a common term 'the Cloud'. Amazon Web Services is and always has been a distinct and individual Amazon organisation.
- Back in 2006, our first step into the cloud was launched. We called in Amazon S3 – the Simple Storage Service.The launch announcement was very simple – no exaggerated claims, and just simply the facts.Our customers have found S3 to be very useful.We’ve been tracking the growth year over year.From 2.9 billion, to 14, to 40, to 102, to 262, to 762, to 905 billion in early 2012.As of the 3rd quarter of 2012, Amazon S3 now stores 1.3 trillion objects.We process up to 835,000 requests per second for these objects.
- Over ten years ago, the technical teams supporting Amazon were moving from providing software and hardware capabilities to a service orientated approach - that is packaging things in an easy to consume way so that deployments by parts of the business were easier, faster and more scalable. As Amazon opened up the it's internal services to third party sellers, and we published simple web services such as our catalog search, it became apparent very quickly that developers were hungry for more, and that Amazon had developed significant technical know-how that could be packaged for others to use. We asked ourselves 'what if we could package everything we do and offer it to others over the web?'. 'What if other businesses could leverage the scale and reach of Amazon.com?'
- To help understand why Amazon Web Services and Cloud Computing are changing IT delivery, a nice comparison to make is that of a utility like electricity. When electricity was discovered businesses would generate their own, using steam generators to power factories. When electricity was brought together under a national system of supply, it was no longer necessary for everyone to generate their own and buy and maintain their generators, you could simply tap into the grid and use what you needed, paying only for what you did use, and be assured that the electricity you consumed was consistent and always available.
- Utility computing brings those same benefits to the deliver of IT - the factories of many businesses.
- By taking the services delivered from traditional data centers and wrapping them all in a consistent programming interface, or API,
- services that are normally expensive to manage or difficult to use become available on-demand, in a uniform and available way, and only paid for when used. Just like electricity.This is what AWS does. It takes away the hard work from providing infrastructure IT services and makes them available to anyone on a pay as you go basis.
- And just like an electricity grid, where you would not wire every factory to the same power station, the AWS infrastructure is global, with multiple regions around the globe from which services are available. This means you have control over things like where you applications run, where you data is stored, and where best to serve your customers from.
- And the whole footprint is supported by many edge locations, places from which content can be served to your customers for the fast possible response times.
- Over ten years ago, the technical teams supporting Amazon were moving from providing software and hardware capabilities to a service orientated approach - that is packaging things in an easy to consume way so that deployments by parts of the business were easier, faster and more scalable. As Amazon opened up the it's internal services to third party sellers, and we published simple web services such as our catalog search, it became apparent very quickly that developers were hungry for more, and that Amazon had developed significant technical know-how that could be packaged for others to use. We asked ourselves 'what if we could package everything we do and offer it to others over the web?'. 'What if other businesses could leverage the scale and reach of Amazon.com?'