Architecting Solutions Leveraging The Cloud

Architecting Solutions Leveraging the Cloud
David Chou
david.chou@microsoft.com
blogs.msdn.com/dachou

Application Models
Web Hosting
Massive scale infrastructure
Burst & overflow capacity
Temporary, ad-hoc sites
Application Hosting
Hybrid applications
Composite applications
Automated agents / jobs
Media Hosting & Processing
CGI rendering
Content transcoding
Media streaming
Distributed Storage
External backup and storage
High Performance Computing
Parallel & distributed processing
Massive modeling & simulation
Advanced analytics
Information Sharing
Reference data
Common data repositories
Knowledge discovery & mgmt
Collaborative Processes
Multi-enterprise integration
B2B& e-commerce
Supply chain management
Health & life sciences
Domain-specific services

Case Study
About
kbb.com, established 1995; vehicle data aggregation and publication service provider
14M UU/month
Multiple physical data centers
Solution
Cloud-based overflow capacity
Windows Azure Web Role
SQL Azure database
Benefits
~$100,000 savings / year in hosting costs alone
Retire failover data center (27 Web servers & 9 SQL Servers)
<1% code changes needed for application compatibility
6 weeks down to 6 minutes to add server capacity

Case Study
About
Legacy call-center application for order processing and fulfillment
On-premise systems integration with ERP and master data management
Solution
Cloud-based Web-enablement of on-premise assets
Windows Azure Web Role
Web services integration via on-premise ESB endpoints
Benefits
“In a matter of weeks, we were able to see the fruits of our efforts very rapidly.“ – Kevin Flowers, Dir. Enabling Technologies
“The resilience and reliability of this platform is some of the benefits that we are seeing.” – EsatSezer, SVP & CIO

Case Study
About
Complex Monte Carlo simulations to calculate financial risks
Daily risk analysis load equivalent to processing 4 trillion US Stocks
Existing on-premise HPC implementation
Solution
Massively scalable compute leveraging cloud capacity
Deployed on 2K Windows Azure instances; 10K+ in 2010
Windows Azure Worker Role
Windows Azure Blob and Queue
AppFabric Service Bus
Benefits
Elastic scaling to effectively meet customer demands
Turning elements of its peak load infrastructure from a fixed cost to a variable cost

Case Study
About
Web-based ERP and accounting software to help mid-sized businesses automate customized business processes
Business needs:
Launch a SaaSoffering which includes on demand infrastructure and billing
Maintain a 24/7 production environment
Minimize development efforts for both on-premise and SaaS offerings
Technical implementation
Web – IIS 7, ASP.NET 3.5
Server – SQL Server 2005/2008, Windows Server 2003/2008
Tools – Visual Studio 2008, .NET Framework 3.5
Solution
Cloud-based SaaS deployment
Windows Azure
SQL Azure
Benefits
Application migration completed in 3 weeks with 2 developers
Customers can implement solution without investing in on-premise infrastructure; can save ~$8,000 for startup costs

Case Study
About
Online service providing productivity tools to help students conduct research, write better papers, and get help on-demand
Technical implementation
Client – Windows Mobile 6
Web – IIS 6, ASP.NET 3.5
Server – Windows Server 2003, SQL Server 2005
Services – Bing Search, Windows Live Messenger Web Toolkit
Tools – Visual Studio 2008, .NET Framework 3.5, .NET Compact Framework 3.5
Solution
Hybrid cloud application
Cloud-based extensions and services mash-ups with on-premise implementation
Windows Azure application
.NET Services service bus, access control, & workflows
Benefits
$500,000 savings in dev. costs
40% faster time-to-market
More effective development
Cost-effective scalability and enhanced availability

Application Patterns
Cloud Web Application
User
Silverlight
Application
Web Browser
Mobile
Browser
WPF
Application
ASP.NET
(Web Role)
Web Svc
(Web Role)
Jobs
(Worker Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
Private Cloud
Public Cloud Services
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
Enterprise Application
Application
Service
Enterprise Web Svc
Data
Service
Table Storage
Service
Blob Storage
Service
Queue
Service
Enterprise Data
Storage
Service
Identity
Service
Enterprise Identity
Service Bus
Access Control Service
Workflow
Service
User
Data
Application
Data
Reference Data

Composite Services Application
User
Silverlight
Application
Web Browser
Mobile
Browser
WPF
Application
ASP.NET
(Web Role)
Web Svc
(Web Role)
Jobs
(Worker Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
Private Cloud
Public Services
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
Application
Service
Enterprise Web Svc
Data
Service
Table Storage
Service
Blob Storage
Service
Queue
Service
Enterprise Data
Storage
Service
Identity
Service
Enterprise Identity
Service Bus
Workflow
Service
User
Data
Application Data
Reference Data

Cloud Agent Application
User
Silverlight
Application
Web Browser
Mobile
Browser
WPF
Application
ASP.NET
(Web Role)
Web Svc
(Web Role)
Jobs
(Worker Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
Private Cloud
Public Services
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
Application
Service
Enterprise Web Svc
Data
Service
Table Storage
Service
Blob Storage
Service
Queue
Service
Enterprise Data
Storage
Service
Identity
Service
Enterprise Identity
Service Bus
Workflow
Service
User
Data
Application Data
Reference Data

B2B Integration Application
User
Silverlight
Application
Web Browser
Mobile
Browser
WPF
Application
ASP.NET
(Web Role)
Web Svc
(Web Role)
Jobs
(Worker Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
Private Cloud
Public Services
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
Application
Service
Enterprise Web Svc
Data
Service
Table Storage
Service
Blob Storage
Service
Queue
Service
Enterprise Data
Storage
Service
Identity
Service
Enterprise Identity
Service Bus
Workflow
Service
User
Data
Application Data
Reference Data

Grid / Parallel Computing Application
User
Silverlight
Application
Web Browser
Mobile
Browser
WPF
Application
ASP.NET
(Web Role)
Web Svc
(Web Role)
Jobs
(Worker Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
Private Cloud
Public Services
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
Application
Service
Enterprise Web Svc
Data
Service
Table Storage
Service
Blob Storage
Service
Queue
Service
Enterprise Data
Storage
Service
Identity
Service
Enterprise Identity
Service Bus
Workflow
Service
User
Data
Application Data
Reference Data

Hybrid Enterprise Application
User
Silverlight
Application
Web Browser
Mobile
Browser
WPF
Application
ASP.NET
(Web Role)
Web Svc
(Web Role)
Jobs
(Worker Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
Private Cloud
Public Services
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
ASP.NET
(Web Role)
Application
Service
Enterprise Web Svc
Data
Service
Table Storage
Service
Blob Storage
Service
Queue
Service
Enterprise Data
Storage
Service
Identity
Service
Enterprise Identity
Service Bus
Workflow
Service
User
Data
Application Data
Reference Data

Internet-Scale Application
2007 stats:
+20 petabytes of data processed / day by +100K MapReduce jobs
1 petabyte sort took ~6 hours on ~4K servers replicated onto ~48K disks
+200 GFS clusters, each at 1-5K nodes, handling +5 petabytes of storage
~40 GB/sec aggregate read/write throughput across the cluster
+500 servers for each search query < 500ms
Scaling the process:
MapReduce: parallel processing framework
BigTable: structured hash database
Google File System: massively scalable distributed storage

Internet-Scale Application
2009 stats:
+200B pageviews/month
>3.9T feed actions/day
+300M active users
>1B chat mesgs/day
100M search queries/day
>6B minutes spent/day (ranked #2 on Internet)
+20B photos, +2B/month growth
600,000 photos served / sec
25TB log data / day processed thru Scribe
120M queries /sec on memcache
Scaling the “relational” data:
Keeps data normalized, randomly distributed, accessed at high volumes
Uses “shared nothing” architecture

Internet-Scale Application Architecture
Design
Horizontal scaling
Service-oriented composition
Eventual consistency
Fault tolerant (expect failures)
Security
Claims-based authentication & access control
Federated identity
Data encryption & key mgmt.
Management
Policy-driven automation
Aware of application lifecycles
Handle dynamic data schema and configuration changes
Data & Content
De-normalization
Logical partitioning
Distributed in-memory cache
Diverse data storage options (persistent & transient, relational & unstructured, text & binary, read & write, etc.)
Processes
Loosely coupled components
Parallel & distributed processing
Asynchronous distributed communication
Idempotent (handle duplicity)
Isolation (separation of concerns)

Thank you
david.chou@microsoft.com
blogs.msdn.com/dachou
© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Architecting Solutions Leveraging The Cloud

by David Chou on Dec 04, 2009

Accessibility

Categories

Tags

Upload Details

Usage Rights

2 Embeds 13

Statistics

Architecting Solutions Leveraging The Cloud — Presentation Transcript

http://blogs.msdn.com	9
http://www.slideshare.net	4