2011 State of the Cloud: A Year's Worth of Innovation in 30 Minutes - Jinesh Varia UP Con Keynote

A Year’s Worth of InnovationThe State of the Cloud Jinesh Varia

2011: A Year’s Worth of InnovationGrowth and New Services Customers Expansion and Features and Partners

AWS’ Growth and Expansion in 2011 Growth and Expansion

Each day, AWS adds theequivalent server capacity to power Amazon when it was a global, $2.76B enterprise (circa 2000)

In 2011, 3 new regionsNew Asia Pacific Region New low-cost US West GovCloud Region forIn Tokyo, Japan Region in Oregon Government Applications

US-Persons-only AccessFISMA Moderate Compliant ControlsData Isolation (Service & IAM Controls)Network Isolation (VPC required, FIPS 140-2 Compliantendpoints, AWS Direct Connect Optional)Virtual Machine Isolation (Dedicated instances optional) AWS GovCloud-US Designed for US Government Customers

Global Infrastructure for Global Enterprises GovCloud US West US East Europe Asia Asia(US ITAR Region) (Northern (Northern West Pacific Pacific California) Virginia) (Dublin) Region Region (Singapore) (Tokyo) AWS Regions AWS Edge Locations

AWS Regions and Availability Zones

Amazon S3 Growth 566 Billion Peak Requests: 370,000+ per second 262 Billion 102 Billion 40 Billion2.9 Billion 14 Billion Q4 2006 Q4 2007 Q4 2008 Q4 2009 Q4 2010 Q3 2011 Total Number of Objects Stored in Amazon S3

Amazon CloudFront Growth

Content Distribution: Amazon CloudFront• Global content delivery network• Added 7 new locations in 2011• 21 edge locations across the globe• Self-service sign up, easy administration• Built using Amazon.com’s highly reliable infrastructure Use Cases Key Features • Video and Rich Media • RTMP Streaming (Adobe FMS) • Online Gaming • HTTPS Delivery • Interactive Agencies • Private Content for HTTP & Streaming • Software Downloads • Programmatic Invalidation • Static Websites • Detailed Logs for HTTP & Streaming • Default Root Object

2011: A Year’s Worth of InnovationGrowth and New Services Expansion and Features

Compute New& Big Data Services & Tools “This is where the cloud really shines”Storage & SecurityNetworking

NewServices

In 2011, 14 Major Updates in theAWS Management Console (Web Interface)

The AWS Cloud Tools to access services Cross Service features High-level building blocks Low-level building blocks

New Instance Types AmazonEC2 New ways of Monitoring Compute

New Instance Type: “The Beast”Micro Standard High High CPU Cluster Cluster Memory Compute GPUt1.micro m1.small m2.xlarge c1.medium cc1.4xlarge cg1.4xlarge m1.large m2.2xlarge c1.xlarge cc2.8xlarge m1.xlarge m2.4xlargeIn 2011, cc2.8xlarge was launched: Linpak Test2 Xeon Processors with 8 hardware cores = 88 ECUs 1064 cc2 instance cluster60.6 GB RAM and 3.37 TB of instance storage generated 240 teraFLOPS10GigE Full Bisection bandwidth non-blocking IO ranks #42 in Top500Hardware Assisted Virtualization (HVM) at $2.40/Hour Supercomputers List

New Operating Systems

New Purchasing Options On-demand Reserved Spot Instances Instances Instances• Pay as you go • Onetime • Requested upfront + Pay Bid Price and as you go Pay as you go• Starts from • $56 for 1 • $0.005 /Hour 0.02/Hour year term as of today at and then 9 AM $0.01/Hour For Steady For Time- For Spiky State insensitive Workloads Workloads workloads

New Purchasing Options On-demand Reserved Savings over Spot Instances Instances on-demand Instances• Pay as you go Heavy 41% - 1 year • Requested Utilization 58% - 3 Year Bid Price and Pay as you go Medium 34% - 1 Year• Starts from Utilization 49% - 3 Year • $0.005 /Hour 0.02/Hour as of today at Light 28% - 1 Year 9 AM Utilization 34% - 3 Year For Steady For Time- For Spiky State insensitive Workloads Workloads workloads

The Big Data Cloud Stack - Analytics Amazon S3 Upload large datasets or log Amazon S3 Data files directly InputSource Data Output Data Task Amazon Elastic Node MapReduce Amazon SimpleDB MapperCode/ Reducer Service Name Task MetadataScripts HiveQL Node Node Pig Latin Cascading Runs multiple JobFlow Core HiveQL Steps Node Pig Latin Query Core Node HDFS BI JDBC/ODBC Apps Amazon Elastic MapReduce Hadoop Cluster

This is where the cloud really shines Amazon Cluster Spot Elastic Expand/ Hadoop Elastic Compute Instance Shrink Super MapReduce HPC s computerYour On-demand Each VM = Cost savings Expand or ElasticDistributed Infrastructure 2 Xeon 8-core by Mix-n- Shrink a SuperProcessing (Cloud) + 60.6 GB RAM match running ComputerFramework Automation 10G Ethernet instances cluster 2 GPGPUs (On-demand, Spot, Reserved) The 2011 Elastic Supercomputer

New Ways to Import existing VMs Windows Server 2008 APIs Buckets VM ImportVMware ESX VMDK service Root Data Volume Volume SnapshotsCitrix XenServer VHDMicrosoft Hyper-V VHD Amazon EBS Availability Zone #1

New Ways to Import/Export Data EBS Snapshot Also, No inbound data transfer charges

New Features in 2011: Auto Scaling andElastic Load Balancing, CloudFormation • Elastic Load Balancing • Amazon CloudWatch – IPv6 Support – CloudWatch Alarms – SSL Support – CloudWatch Custom Metrics – Sticky Sessions • Messaging • Auto Scaling – SMS Support for Amazon SNS – Amazon SNS Notifications – SQS Batch Operations – Auto Scaling policies • AWS CloudFormation – Auto Scaling by Schedule – Validate Stack – Auto Scaling Suspend/resume – Update Stack – Recurrent Scaling Operations – Chef/Puppet – Cloud-init – Instance Addition Control – Embedded Stacks – Metadata

www.yourApp.com media.yourApp.com (Static data) Amazon Route 53 Amazon Hosted Zone CloudFront Elastic Load Balancer Amazon EC2 Amazon InstancesCloudWatch AlarmsAmazon SNS Amazon S3 Auto Scaling Group BucketNotifications Amazon App Tier SimpleDB DomainsAmazon SES Email ElastiCache Tier AZ-1 Amazon RDS AZ-1 Region

www.yourApp.com media.yourApp.com (Static data) Amazon Route 53 Amazon Hosted Zone CloudFront Elastic Load Balancer Amazon EC2 Amazon InstancesCloudWatch Alarms AWS Amazon S3Amazon SNS Auto Scaling Group CloudFormation BucketNotifications JSON Template Amazon App Tier SimpleDB DomainsAmazon SES Email ElastiCache Tier AZ-1 Amazon RDS AZ-1 Region

This is where the cloud really shines Update Stack AWS Version Control CloudFormation JSON Template

Amazon VPCNetwork

Enterprises are using thecloud as an extensionof their datacenters

10G DirectConnect Amazon VPC Corporate LocationData Center

Amazon Virtual Private Cloud (VPC)• Create a logically isolated environment in Amazon’s highly scalable infrastructure• Specify your private IP address range into one or more public or private subnets• Control inbound and outbound access to and from individual subnets using stateless Network Access Control Lists• Protect your Instances with stateful filters for inbound and outbound traffic using Security Groups• Attach an Elastic IP address to any instance in your VPC so it can be reached directly from the Internet• Bridge your VPC and your onsite IT infrastructure with an industry standard encrypted VPN connection• Use a wizard to easily create your VPC in 4 different topologies• Elastic Load Balancing and Spot Instances in VPC

Corporatedata center Availability Zone 1 DirectConnect Location 10G Private Router Subnet Customer VPN Gateway Gateway CorporateHeadquarters Internet Public Subnet Gateway Amazon VPC Availability Zone 2Branch Offices This is where the cloud Amazon S3 Amazon SimpleDB Amazon SES AWS Region Amazon SQS really shines

New Database Options Self-Managed Managed Databases Database Server Amazon Relational Amazon SimpleDB on Amazon EC2 Database Service (RDS) NoSQL Database Your choice of Oracle (11g) or MySQL Non-relational model;database running on (5.x) indices and queries Amazon EC2 Bring Your Own Flexible Licensing: BYOL Zero admin overheadLicense (BYOL) or or on-demand LicenseOn-demand for SQL Included Server

GovCloud US Security

In the cloud, security is a shared responsibilitySAS 70 Type II Audit Encrypt data in transitISO 27001/2 Certification Encrypt data at restPCI DSS 2.0 Level 1-5 Protect your AWS CredentialsHIPAA/SOX Compliance Rotate your keysFISMA A&A Moderate Infrastructure Application Secure your applicationFIPS 140-2 Security SecurityHow we secure our How can you secure yourinfrastructure application and what is your responsibility? Services Security Enforce IAM policiesWhat security options Use MFA, VPC, Leverage S3and features are available bucket policies, EC2 Securityto you? groups, EFS in EC2 Etc..

Identity and Access Management : GA AWS Identity And Access Management • User management • Policy-based granular access control • Web login to individual users • Identity Federation Multi-Factor Authentication • Device • Virtual MFA General Availability

Example: Set your permissions using the IAM Console

Amazon S3 Server-Side Encryption Amazon S3 Your PUT Encrypt Key Data Data Generator AES-256 Encrypted Encrypt Data Key Encrypted Key Store Encrypted Data Store S3 Key Managementat no additional cost

Dedicated Instances On-demand Reserved Spot Dedicated Instances Instances Instances Instances• Pay as you go • Onetime • Requested • Standard and upfront + Pay Bid Price and Reserved as you go Pay as you go • Multi-Tenant• Starts from • $56 for 1 • $0.005 /Hour Single 0.02/Hour year term as of today at Customer and then 9 AM • $10/Region + $0.01/Hour 0.105/Hour For Steady For Time- For Regulatory For Spiky State insensitive and Compliant Workloads Workloads workloads Workloads

Android, iOS, GemaltoWindows, Blackberry

The AWS Cloud Tools to access services Cross Service features High-level building blocks Low-level building blocks

Cloud Customers in 190 Countries

Large Partner Ecosystem System Integrators Independent Software Vendors

Enterprise Software in the cloud - BYOL Microsoft Exchange Server, Microsoft SharePoint Server, Microsoft SQL Standard Server, Microsoft SQL Enterprise Server, Microsoft Lync Server, Microsoft System Center servers, and Microsoft Dynamics CRM through License Mobility Software Assurance Oracle fully supports Oracle E-Business Suite, Oracle’s PeopleSoft Enterprise, Oracle’s Siebel CRM, Oracle Fusion Middleware, Oracle Database, and Oracle Linux on the portion of AWS EC2 which uses Oracle VM. IBM DB2, Informix, Lotus® Forms Turbo, WebSphere® Application Server, WebSphere® sMash, WebSphere Portal Server, Lotus® Web Content Management Standard Edition , InfoSphere Information Server, Lotus Domino®, Lotus Web Content Management Standard Edition®, Tivoli Monitoring® SAP® solutions, including SAP® Rapid Deployment solutions and SAP® BusinessObjects™ solutions

2011: Year of Cloud Maturity

2012 > 2011

Thank you! Jinesh Variajvaria@amazon.com Twitter:@jinman

http://softwarestrategiesblog.com	3212
http://lonewolflibrarian.wordpress.com	203
http://paper.li	150
http://cloudspring.com	66
http://localhost	23
http://feeds.feedburner.com	19
http://blog.naver.com	11
http://a0.twimg.com	9
http://lcolumbus.wordpress.com	6
http://www.twylah.com	4
http://us-w1.rockmelt.com	4
http://translate.googleusercontent.com	3
http://bsf.redbrickhq.com	2
http://www.library.ceu.hu	1
http://172.16.0.55	1
http://www.onlydoo.com	1
http://115.112.206.134	1

2011 State of the Cloud: A Year's Worth of Innovation in 30 Minutes - Jinesh Varia UP Con Keynote

by Amazon Web Services

Accessibility

Categories

Upload Details

Usage Rights

17 Embeds 3,716

Statistics