The Cloud as a Platform

Amazon’s Three BusinessesConsumer (Retail) Seller IT Infrastructure Business Business BusinessTens of millions of Sell on Amazon Cloud computingactive customer websites infrastructure foraccounts hosting web-scale Use Amazon solutionsSeven countries: technology for yourUS, UK, Germany, own retail website Hundreds ofJapan, France, thousands ofCanada, China Leverage Amazon’s registered customers massive fulfillment center network

The Cloud

KEY BENEFITS TO RUNNING IN THE AWS CLOUD Lowers Cost Increases Agility Eliminates Capital Reduces Time to Market Investment Removes constraints Reduces Operational Costs Removes the “Heavy Foundation for Lifting” 21st Century Leverages Scalability, Reliability and Security Architectures

The pace of innovation in 2009 » Amazon EC2 with Windows Server 2008, » AWS Multi-Factor Authentication Spot Instances, » Virtual Private Cloud Boot from Amazon EBS » Reserved Instances in EU Region » Lower Reserved Instance Pricing » Amazon CloudFront Streaming » Elastic MapReduce » Amazon VPC enters Unlimited Beta » SQS in EU Region » AWS Region in Northern California » International Support for AWS Import/Export » Amazon RDS » New SimpleDB Features » High-Memory Instances » FPS General Availability » AWS Security Center » Lower EC2 Pricing » Amazon SNS » Amazon EC2 with Windows » Amazon Elastic MapReduce » Amazon CloudFront » Amazon EC2 in EU Region in Europe Private Content » AWS Toolkit for Eclipse » SAS70 Type II Audit » Amazon EC2 Reserved » AWS SDK for .NET Instances » AWS Import/Export » Amazon EC2 Reserved Instances » EBS Shared Snapshots » New CloudFront Feature with Windows, Extra Large High» Lower pricing tiers for » SimpleDB in EU Region » Monitoring, Auto Scaling & Memory Instances Amazon CloudFront » Monitoring, Auto Scaling & Elastic Load Balancing » Amazon S3 Versioning Feature» AWS Management Console Elastic Load Balancing in EU » Consolidated Billing for AWS » Lower pricing for Outbound Data Transfer

And pace accelerates in 2010…. »Free Monitoring EC2 » Amazon SNS » RDS Reserved »Amazon Route 53 » Combined AWS Data Transfer » CloudFront Default Root »PCI DSS Level 1 Certification Savings » Startup Challenge 2010 »Mobile SDKs (Android, iPhone) » Amazon EMR Bootstrap Actions » CloudFront Invalidation »Large Object S3 Support » Amazon ELB Session Stickiness »Florida POP » Amazon RDS in EU »Import/Export APAC » New Singapore Region » AWS Elastic Beanstalk » CloudFront HTTPS » Amazon RDS Read Replicas » Amazon Simple Email Service » NYC Edge Location » Suse EC2 Linux » Improved AWS Support “Bronze” » Lowers Pricing HTTP » Amazon SNS Console » Amazon CloudWatch Console » EMR JobFlow Debugging » AWS Import Export GA » Amazon SNS » Amazon ELB HTTPS » VM Connector » Simple DB Consistent Reads » Amazon S3 Console » AWS Free Tier » Tokyo Region » Simple DB Conditional Puts » Amazon EBS CloudWatch » EMR Resizing Cluster » AWS Support JP » New VPC » Amazon SQS Longer » Amazon S3 Lowered Pricing » Dedicated » AWS Java SDK retention, Free Tier » CloudFront GA, SLA Instances » Windows BYOL Amazon S3 Bucket Policies » S3 Multipart » Windows » Singapore Pop » Amazon VPC IP Address » GPGPU Instance Types 2008 R2 » CloudFront » Cluster Compute Instances » ISO27001/2 Certification Private Streaming » Amazon S3 RRS » Lowered Pricing EC2 Notifications » AWS IAM » AWS CloudFormation» Amazon EC2 Reserved Instances » Amazon VPC Console » Amazon S3 Static Websites » VPC in EU with Windows, Extra Large High » Micro Instances » AWS IAM Website Login » Amazon RDS in US-west Memory Instances » Paris Edge Location » Amazon CloudFront Access » Amazon Linux AMI» Amazon S3 Versioning Feature » Amazon EC2 Tagging, Logs» Consolidated Billing for AWS Filtering, Idempotency, » Amazon RDS Multi-AZ» Lower pricing for Outbound Data » Oracle Certified AWS » Amazon S3 RRS Transfer » AWS PHP SDK » Amazon RDS Console

Each day, AWS addsthe equivalent server capacity to power Amazon when it was a global, $2.76B enterprise (circa 2000)

The “Living” AWS Cloud Tools to access services Cross Service features High-level building blocks Low-level building blocks

#1Flexibilityand the power of choice

Flexibility is the key Can use any Programming Model, Language or Operating System or Database Can use any service individually or in any combination Can use as much or as little and only pay for what was consumed Can use any existing System Management Tools and extend the datacenter into the Cloud

Flexibility with Certified Licenses - BYOL Microsoft Exchange Server, Microsoft SharePoint Server, Microsoft SQL Standard Server, Microsoft SQL Enterprise Server, Microsoft Lync Server, Microsoft System Center servers, and Microsoft Dynamics CRM through License Mobility Software Assurance Oracle fully supports Oracle E-Business Suite, Oracle’s PeopleSoft Enterprise, Oracle’s Siebel CRM, Oracle Fusion Middleware, Oracle Database, and Oracle Linux on the portion of AWS EC2 which uses Oracle VM. IBM DB2, Informix, Lotus® Forms Turbo, WebSphere® Application Server, WebSphere® sMash, WebSphere Portal Server, Lotus® Web Content Management Standard Edition , InfoSphere Information Server, Lotus Domino®, Lotus Web Content Management Standard Edition®, Tivoli Monitoring® SAP® solutions, including SAP® Rapid Deployment solutions and SAP® BusinessObjects™ solutions,

US West US East Asia Pacific Asia Pacific Europe West (Northern (Northern Region Region (Dublin) California) Virginia) (Singapore) (Japan)Amazon CloudFront Ashburn, Dallas, Los Angeles, Miami, Newark, Palo Alto, Seattle, St. Louis,Edge Locations Amsterdam, Dublin, Frankfurt, London, Hong Kong, Singapore, Tokyo, New York, Paris

The Cloud

The Cloud as a Platform

Platform that provides foundationto build innovation solutions on topPlatform that provides abstractionto hide underlying layers (hardware and software)Platform that is self-service

The Cloud as a Platform

The Cloud as a Platform For Computation

Wall Street & Amazon EC2 3000 CPU’s for one firm’s risk management processes 3000-- Number of EC2 Instances 300 CPU’s on weekends 300 -- Wednesday Thursday Friday Saturday Sunday Monday Tuesday 4/22/2009 4/23/2009 4/24/2009 4/25/2009 4/26/2009 4/27/2009 4/28/2009

1 Job, 1 Machine, 500 hours500 Hours$1500 To rack and stack on-premise1 Job, 500 Machines, 1 hour One Hour$260 For 3 years (reserved 100% utilized)

“TimesMachine” from NYTimes • 1851-1922 Articles • TIFF -> PDF • Input: 11 Million Articles (4TB of data) • What did he do ? – 100 EC2 Instances for 24 hours – Input: All data on S3 – Output: 1.5 TB of Data – Hadoop, iText, JetS3t

Source: http://qcontokyo.com/pdf/adriancockroft.pdf

#2Elasticityis thefundamentalpropertyof the cloud

Elasticity + Auto ScalingInfrastructureCost $ Large You just lost Capital customers Expenditure Predicted Demand Opportunity Traditional Cost Hardware Wastage Actual Demand Cloud Automated Elasticity time

AWS Lowers it’s pricing Again!• Apr 22, 2008 - AWS Lowers Data Transfer Costs• Oct 09, 2008 - New Tiered Pricing for Amazon S3 Storage• Jan 28, 2009 - New Lower Pricing Tiers for Amazon CloudFront• Aug 20, 2009 - New Lower Prices for Amazon EC2 Reserved Instances• Sep 30, 2009 - New Lower Price for Windows Instances with Authentication Services• Oct 27, 2009 - Announcing Lower Amazon EC2 Instance Pricing• Dec 08, 2009 - New S3 Pricing Tiers, Lower EC2 Pricing and Free Inbound Data Transfer promotion• Feb 01, 2010 - New Lower Pricing for Outbound Data Transfer• Jun 07, 2010 - Amazon CloudFront Lowers Prices with HTTPS Support• Sep 01, 2010 - New Lower Prices for High Memory Double and Quadruple XL Instances• Oct 05, 2010 - Lower High Memory DB Instance Prices for Amazon RDS• Nov 01, 2010 - Amazon S3 Reduces Storage Pricing• Jan 06, 2011 - New Plans, Lower Pricing in AWS Premium Support• May 18, 2011 - New Lower Prices for Amazon CloudWatch Monitoring• June 1, 2011 – Free Inbound Data Transfer and Lower Outbound Tiers• Sept 27, 2011 – Amazon Route53 lowers the pricing for Hosted Zones Free inbound data transfer in all regions!!

Automate Using Cloud APIsDeployment

Build a Web application thatsleeps at nightor shrinks itself when there are no users accessing it

Build a Web application thatFollows the Sun and leverages the true power ofon-demand elasticity and globally dispersed regions

US West Traffic US East Traffic Europe Traffic Asia Traffic Geo IP/Directional DNS Server ELB ELB ELB ELB Web Web Web Web Web Web Web Web Web Web Web Web Web Web Web Web App Web App Web App Web App Web App Web App Web App Web App Web App App App App App App App App App App App App App App App App Auto Scaling group : Auto Scaling group : Auto Scaling group : Auto Scaling group : Web App Tier Web App Tier Web App Tier Web App Tier RDS RDS RDS RDS Maste Maste Maste Maste r r r rUS-West US-East EU-West AP-SOUTHEAST RDS RDS RDS RDS Multi-AZ Multi-AZ Multi-AZ Multi-AZ US-West-1b US-East-1b EU-West-1b AP-SOUTHEAST-1b Software-based Data Replicator

Elasticity + Automation +price reductions = cost-savings

The Cloud as a Platform For Computation

The Cloud as a Platform For Computation For Research and Development

Time to provision a server in an enterprise350,000 Minutes (7-8 Months)$1000 To rack and stack on-premiseTime to provision a server in the cloud <5 Minutes$260 For 3 years (reserved 100% utilized)

E4 Clients Sends commands Polls for commands (Mac, Linux, Arena Windows UI, Server MindStorm Robot iPhone, JoySticks ) controlled by Arena ServerOpen Social Gadgets API EndpointShowing imagesalmost in real time ELB Version Aware Lookups RESTFul RESTFul API API Equinox Equinox Amazon Server Server SimpleDB Conditional Puts Domains Auto-scaling group Amazon S3 Consistent Reads -Registration 4images Every Sec -Scores From Camera -Commands EBS -Game EBS Queue CloudWatch Availability Zone 1 -Logging Availability Zone 2 Amazon Web Services

New ways to purchase EC2 Instances Cloud HPC: Cluster Compute Instance 2 Xeon quad-core + 2 tesla NVIDIA GPGPU + 22GB + 10G non-blocking Ethernet

Bid for unused EC2 Capacity using Spot Instances

Case Study: Optimizing Video Transcoding Workloads (On-demand + Spot + Reserved) Free Offering Premium Offering – Optimize for reducing cost – Optimized for Faster response times – Acceptable Delay Limits – No DelaysImplementation Implementation – Set Persistent Requests – Invest in RIs – Use on-demand Instances, if delay – Use on-demand for Elasticity Maximum Bid Price Maximum Bid Price < On-demand Rate >= On-demand Rate Get your set reduced price for Get Instant Capacity for higher price your workload

The Cloud as a Platform For Computation For Research and Development

The Cloud as a Platform For Computation For Research and Development For New Generation Apps

Casual Online Games “Gamification”

Scale: 50 servers to 5000 servers in 3 days Amazon EC2 easily scaled to handle additional traffic Peak of 5000 instances Number of EC2 Instances “Techcrunched” Launch of Facebook modification. Steady state of ~40 instances 4/12/2008 4/13/2008 4/14/2008 4/15/2008 4/16/2008 4/17/2008 4/18/2008 4/19/2008 4/20/2008

The Cloud as a Platform For Computation For Research and Development For New Generation Apps

The Cloud as a Platform For Computation For Research and Development For New Generation Apps For Internal Corporate IT

Enterprise IT

Let go of (physical) controlbut retain your ownership

Building a Cloud Strategy Cloud Benefits Build a New Zero upfront investment Cloud-Ready applications Design On-demand provisioning Cloud Strategy “No-brainer to Instant scalability move” Apps Existing Auto scaling and elasticity Applications Planned Phased Pay as you go Migration Startup Removes undifferentiated or heavy lifting SMB Firm Developer productivity orLarge Enterprise Automation

Migrating existing IT assets to the cloud • List all your IT assets Dash board • Identify upward and downward dependencies Web CRM Auth • Start classifying your IT assets into different categories: – Applications with Top Secret, Secret, or Public data sets LDAP ServiceDB – Applications with low, medium and high compliance requirements Search – Applications that are internal-only, OLAP Engine partner-only or customer-facing – Applications with low, medium and high coupling ERP Report logs – Applications with strict, relaxed licensing

Pick the Low-hanging fruits first Dash board Results Process Process Auth Service ServiceBilling Search Service Service ERP Report logs

Amazon Virtual Private Cloud (VPC) Customer’s isolated AWS resources Amazon Subnets VPC Router VPN Gateway Amazon Web Services Secure VPN Connection Cloud (IPSEC) Customer’s Network

The New Amazon Virtual Private Cloud (VPC)

VPC is part of the Autodesk internal network

The Automation You Always Meant to Build Provision and attach 1TB of storage in 2 minutes (from the back of an auto-rickshaw in India).10 new Linux servers in 2minutes (while sitting bythe pool on a nice day). Monitoring server resources from an iPhone (in a bar).

As of November 2010, Amazon.com’sWeb Server Fleet is serving all the traffic from Amazon EC2

App Vending MachinePre-configuredIT security-blessedauto-scalableauto-backupmulti-AZfull-controlone-click deployableenterprise apps

The Cloud as a Platform For Computation For Research and Development For New Generation Apps For Internal Corporate IT

The Cloud as a Platform For Computation For Research and Development For New Generation Apps For Internal Corporate IT For Storage

Amazon S3 Momentum 2 years ago 52 Billion Peak Requests: 70,000 per second 18 Billion 5 Billion 200 Million Q1 2006 Q1 2007 Q1 2008 Q1 2009 Q4 2008 Total Number of Objects Stored in Amazon S3

The Cloud Scales: Amazon S3 Growth 449 Billion Consistently Peaks at 200,000+ Requests per second 262 Billion 102 Billion 40 Billion 2.9 Billion 14 Billion Q4 2006 Q4 2007 Q4 2008 Q4 2009 Q4 2010 Q2 2011 Total Number of Objects Stored in Amazon S3

Smugmug > 2PB of Media

The Cloud as a Platform For Computation For Research and Development For New Generation Apps For Internal Corporate IT For Storage

The Cloud as a Platform For Computation For Research and Development For New Generation Apps For Internal Corporate IT For Storage For Integration

#3Redefining Cloud Security

In the Cloud, Security is a Shared ResponsibilitySAS 70 Type II Audit Encrypt data in transitISO 27001/2 Certification Encrypt data at restPCI DSS 2.0 Level 1-5 Protect your AWS CredentialsHIPAA/SOX Compliance Rotate your keysFISMA A&A Low Infrastructure Application Secure your application Security SecurityHow we secure our How can you secure yourinfrastructure application and what is your responsibility? Services Security Enforce IAM policiesWhat security options Use MFA, VPC, Leverage S3and features are available bucket policies, EC2 Securityto you? groups, EFS in EC2 Etc..

Industry-specific clouds : GovCloud – US Recovery.gov and Treasury.gov First government-wide system to move to the cloud Savings of over $750,000 in current budget cycle “Cloud computing strikes me as a perfect tool to help achieve greater transparency and accountability. Moving to the cloud allows us to provide better service at lower costs. I hope this development will inspire other government entities to accelerate their own efforts. The American taxpayers would be the winners.’’ - Earl E. Devaney, the Board’s Chairman.

Recovery.gov Cloud Architecture

Build security in every layer Old World New World

The Cloud as a Platform For Computation For Research and Development For New Generation Apps For Internal Corporate IT For Storage For Integration

The Cloud as a Platform For Computation For Research and Development For New Generation Apps For Internal Corporate IT For Storage For Integration For Platforms

The “Living and Evolving” AWS Cloud Tools to access services Cross Service features High-level building blocks Low-level building blocks

The “Living and Evolving” AWS Cloud Tools to access services Cross Service features High-level Infrastructure building blocks Low-level Infrastructure building blocks

Drupal PHP Platform Ruby/Rails/Java Platform Cloud Services Mathematica Platform for Mathematica Voice Platform Mobile Trading Platform Geospatial PlatformLocation-based App Platform

Internet as theOperating Systemof Services

The Cloud as a Platform For Computation For Research and Development For New Generation Apps For Internal Corporate IT For Storage For Collaboration For Platforms

The Cloud as a Platform For Realizing your ideas

#5Start Playing Nowand invest early

Its Free to Get Started – AWS Free Tier• Amazon EC2, Amazon ELB, Amazon EBS• Amazon S3• Amazon SimpleDB• Amazon SQS• Amazon SES• Amazon SNS• Amazon CloudWatch• Free Inbound Data Transfer• Outbound Data Transfer

#1Flexibility is very important when you choose the cloudand AWS provides the flexibility you need#2Elasticity, Cost reduction and Agility are the mainreasons to move to the cloud and AWS provides all three#3In the Cloud, Security is shared responsibility. AWSprovides the certifications, features and guidance#4The Cloud is much more than its services.Its all about the Ecosystem#5Start playing with it now. Talk to us. Be the leader inBrazil

Thank you! Jinesh Variajvaria@amazon.com Twitter:@jinman

http://aws.amazon.com

http://www.linkedin.com	22
http://www.slideshare.net	14
http://www.techgig.com	6
http://www.lmodules.com	2

The Cloud as a Platform

by jineshvaria

Accessibility

Categories

Upload Details

Usage Rights

4 Embeds 44

Statistics

The Cloud as a Platform Presentation Transcript