This document summarizes a presentation about Amazon Web Services (AWS) given by Rob Gillen. It introduces the main AWS products like EC2, S3, SQS, and others. It discusses the major AWS outage in April 2011 and lessons learned from companies that were affected and survived versus those that were affected and did not survive. It also provides recommendations for building highly available and fault tolerant systems on AWS, such as replicating data across availability zones and using queues to isolate system components.

1. Hands On WithAmazon Web ServicesStirTrek 2011May 2011 Rob Gillen Cloud Computing Research rob@gillenfamily.net

2. Today Introduction Amazon Web Services Offerings EC2, S3, SQS, SDB and other TLAs Discussion of recent AWS Outage Applications on AWS Questions

3. Who am I? Software development background 11+ Years with Planet: Senior Developer/Solutions Architect Federal, Commercial, Foreign, Non-Profit 4+ Years at Oak Ridge National Laboratory Software Solutions Architect Cloud Computing/HPC Research

4. AWS Products Elastic Compute Cloud Elastic Map Reduce Auto Scaling Cloud Front SimpleDB Relational Database Service Simple Storage Svc Elastic Block Storage Simple Queue Service Simple Notification Service CloudWatch Virtual Private Cloud Elastic Load Balancing Import/Export

5. Amazon S3 Concepts Objects: Opaque data to be stored (1 byte … 5 Gigabytes) Authentication and access controls Buckets: Object container – any number of objects 100 buckets per account / buckets are “owned” Keys: Unique object identifier within bucket Up to 1024 bytes long Flat object storage model Standards-Based Interfaces: REST and SOAP URL-Addressability – every object has a URL

6. Amazon SQS Concepts Queues: Named message container Persistent Messages: Up to 256KB of data per message Peek / Lock access model Scalable: Unlimited number of queues per account Unlimited number of messages per queue

7. Amazon EC2 Concepts Amazon Machine Image (AMI): Bootable root disk Pre-defined or user-built Catalog of user-built AMIs OS: Fedora, Centos, Gentoo, Debian, Ubuntu, Windows Server App Stack: LAMP, mpiBLAST, Hadoop Instance: Running copy of an AMI Launch in less than 2 minutes Start/stop programmatically Network Security Model: Explicit access control Security groups Inter-service bandwidth is free

8. EBS Boot vs. S3 Boot S3 (original) Image copied from S3 to Ephemeral disks Lower IO charges during runtime Target: farm of identical machines EBS (newer) Auto Saving (sort of) Performance Ephemeral disks not used Potential higher IO charges Target: single machines Be certain you understand Shutdown & Termination and the ramifications of such

9. Tooling Command Line Browser Plug-ins 3rd Party Tools Broad SDK Support AWS Management Console

10. CloudBerry Explorer

11. AWS Management Console

12. Stock Windows Instances

13. Machine Setup Walkthrough

30. What Happened Incorrect Network Change == Replication Storm for EC2 “Affected Availability Zone” Actually affected *multiple* AZs (initially) "Each availability zone runs on its own physically distinct, independent infrastructure, and is engineered to be highly reliable. Common points of failures like generators and cooling equipment are not shared across Availability Zones. Additionally, they are physically separate, such that even extremely uncommon disasters such as fires, tornados or flooding would only affect a single Availability Zone." http://aws.amazon.com/ec2/faqs/#How_isolated_are_Availability_Zones_from_one_another

31. Regions and AZs

32. My AZ != Your AZ

33. Fallout Survivors NetFlix (Chaos Monkey) SmugMug (Avoids EBS) Recovery.gov, Treasury.gov, others ShareThis Casualties Reddit, Foursquare, Quora, Hootsuite OpenEI.org

34. Building Blocks for HA Use Elastic IP Addresses for consistent and re-mappable routes Use multiple Amazon EC2 Availability Zones Replicate data across multiple Azs Example: Amazon RDS in Multi-AZ mode Use Amazon EBS for persistent file systems Take EBS snapshots and use S3 for backup

35. Build Loosely-Coupled Systems Use independent components Design everything as a black box Load balance and scale clusters Think about graceful degradation Use queues to isolate components

36. Articles of Interest Amazon: http://aws.amazon.com/message/65648/ ShareThis: http://blog.sharethis.com/2011/04/27/aws-outage-sharethis-survives/ http://tipsforsocialmedia.blogspot.com/2011/04/amazon-ec2-troubles-bring-down-reddit.html EC2 Disabled http://ec2disabled.com/ Medical Malpractice https://forums.aws.amazon.com/thread.jspa?threadID=65649 NetFlix http://techblog.netflix.com/2011/04/lessons-netflix-learned-from-aws-outage.html http://techblog.netflix.com/2010/12/5-lessons-weve-learned-using-aws.html

37. Cloud Applications

38. Computer Forensics

39. Forensic Toolkit 3 Cloud Formation Define deployment environment Bill on Behalf Of Selectable Instance Size

40. Challenge – What to do with mounds of data? What is in there? Are there any threats? What am I missing? How do I connect the “dots”? How do I find the relevant information I need?

41. Trees Forest Can’t See the for the Traditionally, search methods are used to find information at high volume levels But, those methods won’t get you here easily

42. Keyword Methods Document 1 The Army needs sensor technology to help find improvised explosive devices Vector Space Model Term List Army Sensor Technology Help Find Improvise Explosive Device ORNL develop homeland Defense Mitre won contract Weight Terms Document 2 ORNL has developed sensor technology for homeland defense Document 3 Mitre has won a contract to develop homeland defense sensors for explosive devices An index into the document list Term Frequency – Inverse Document Frequency

43. Textual Clustering Vector Space Model Cluster Analysis Similarity Matrix D1 D2 D3 Documents to Documents Most similar documents TFIDF Euclidean distance Time Complexity O(n2Log n)

44. Example: Sign of the Crescent1 41 Short intelligence reports about a multi-prong terrorist attack Example: Report Date: 1 April, 2003. FBI: Abdul Ramazi is the owner of the Select Gourmet Foods shop in Springfield Mall, Springfield, VA. [Phone number 703-659-2317]. First Union National Bank lists Select Gourmet Foods as holding account number 1070173749003. Six checks totaling $35,000 have been deposited in this account in the past four months and are recorded as having been drawn on accounts at the Pyramid Bank of Cairo, Egypt and the Central Bank of Dubai, United Arab Emirates. Both of these banks have just been listed as possible conduits in money laundering schemes 1Intelligence Analysis Case Study by F. J. Hughes, Joint Military Intelligence College

45. Piranha Cluster View Report Date: 1 April, 2003. FBI: Abdul Ramazi is the owner of the Select Gourmet Foods shop in Springfield Mall, Springfield, VA. [Phone number 703-659-2317]. First Union National Bank lists Select Gourmet Foods as holding account number 1070173749003. Six checks totaling $35,000 have been deposited in this account in the past four months and are recorded as having been drawn on accounts at the Pyramid Bank of Cairo, Egypt and the Central Bank of Dubai, United Arab Emirates. Both of these banks have just been listed as possible conduits in money laundering schemes

46. Term network with document links 1) Report Date: 1 April, 2003. FBI: Abdul Ramaziis the owner of the Select Gourmet Foods shop in Springfield Mall, Springfield, VA. [Phone number 703-659-2317]. First Union National Bank lists Select Gourmet Foods as holding account number 1070173749003. Six checks totaling $35,000 have been deposited in this account in the past four months and are recorded as having been drawn on accounts at the Pyramid Bank of Cairo, Egypt and the Central Bank of Dubai, United Arab Emirates. Both of these banks have just been listed as possible conduits in money laundering schemes.

47. Split Tree Over Nodes/Queues

48. Fault Tolerance

52. Component Overview

54. Topics Queue Interactions Blob Interactions Simple DB Interactions

55. Q & A rob@gillenfamily.net http://rob.gillenfamily.net Please Rate This Talk: http://spkr8.com/t/7409