Patterns For Moving To The Cloud

Simon Guest Senior Director, Technical Strategy Microsoft Corporation Session Code: ARC308

You are an IT Architect

Your boss (the CIO) has asked you to “move the company to the cloud”

Heard of cloud computing, and you’ve been through the “Azure” intro sessions, but unsure where to start

Do I have to move everything to the cloud?

What applications work best in the cloud?

Goal of the next 55 minutes:

Cover some of the differences between on premises , hosted , and the cloud

Look at the popular types of applications that are driving cloud computing

Share a set of patterns that you can take away and apply for your own thinking

Introduce terminology and a way of visually diagramming these patterns for cloud computing

Less about the style of an application, more about where an application “lives”

On-premises, hosted, and cloud

Application runs on-premises Buy my own hardware, and manage my own data center Application runs at a hoster Pay someone to host my application using hardware that I specify Application runs using cloud platform Pay someone for a pool of computing resources that can be applied to a set of applications

Application runs

on-premises

Bring my own machines, connectivity, software, etc.

Complete control and responsibility

Upfront capital costs for the infrastructure

Application runs at a hoster

Rent machines, connectivity, software

Less control, but fewer responsibilities

Lower capital costs, but pay for fixed capacity, even if idle

Cloud computing is a pay-per-use model for enabling available, convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, services) that can be rapidly provisioned and released with minimal management effort or service provider interaction. [National Institute of Standards and Technology] http://news.cnet.com/8301-19413_3-10237274-240.html Application runs on-premises Buy my own hardware, and manage my own data center Application runs at a hoster Pay someone to host my application using hardware that I specify Application runs using cloud platform Pay someone for a pool of computing resources that can be applied to a set of applications

Application runs

on-premises

Application runs on-premises Buy my own hardware, and manage my own data center Application runs at a hoster Pay someone to host my application using hardware that I specify Application runs using cloud platform Pay someone for a pool of computing resources that can be applied to a set of applications

Application runs

on-premises

Application runs using cloud platform

Shared,

multi-tenant environment

Offers pool of computing resources, abstracted from infrastructure

Pay as you go

Application runs on-premises Application runs at a hoster Application runs using cloud platform “ Packaged” Application An application that I buy “off the shelf” and run myself “ Home Built” Application An application that I develop and run myself Hosted “ Home Built” An application that I develop myself, but run at a hoster Hosted “ Packaged” An application that I buy “off the shelf” and then run at a hoster Cloud Platform An application that I develop myself, that I run in the cloud “ Software as a Service” A hosted application that I buy from a vendor

“ CRM and Email are commodity services. We have few customizations, and it should be cheaper for someone else to run these.” Application runs on-premises Application runs at a hoster Application runs using cloud platform “ Packaged” Application “ Home Built” Application Hosted “ Home Built” Hosted “ Packaged” Cloud Platform “ Software as a Service” CRM / Email Clinical Trial MRI Imaging HR Application Viral Marketing Molecule Research

“ This is a viral marketing website. It has a small chance of being really big, but we’re not sure!” “ How difficult is it to move these to a software as a service model?” Application runs on-premises Application runs at a hoster Application runs using cloud platform “ Packaged” Application “ Home Built” Application Hosted “ Home Built” Hosted “ Packaged” Cloud Platform “ Software as a Service” CRM / Email Clinical Trial MRI Imaging HR Application Molecule Research Viral Marketing

“ This application runs at full capacity for short periods of time at the end of each month.” In case it is successful, we’re interested to see if the cloud would help us scale better.” Application runs on-premises Application runs at a hoster Application runs using cloud platform “ Packaged” Application “ Home Built” Application Hosted “ Home Built” Hosted “ Packaged” Cloud Platform “ Software as a Service” CRM / Email Clinical Trial MRI Imaging HR Application Viral Marketing Molecule Research

“ MRI images are very large and exponentially growing. Is there a better way of storing these?” “ Can the cloud help us in providing compute power on an as needed basis?” Application runs on-premises Application runs at a hoster Application runs using cloud platform “ Packaged” Application “ Home Built” Application Hosted “ Home Built” Hosted “ Packaged” Cloud Platform “ Software as a Service” CRM / Email Clinical Trial MRI Imaging HR Application Viral Marketing Molecule Research

“ Does the cloud give me the storage I’m after?” “ We need to share results from our H1N1 trials with government entities.” Application runs on-premises Application runs at a hoster Application runs using cloud platform “ Packaged” Application “ Home Built” Application Hosted “ Home Built” Hosted “ Packaged” Cloud Platform “ Software as a Service” CRM / Email Clinical Trial HR Application Viral Marketing Molecule Research MRI Imaging

“ I can’t afford to maintain this old HR application written in VB – it’s driving me mad!” “… but due to regulatory issues, I can’t store my data off premise.” “ Does the cloud provide anything for inter-organization communication?” Application runs on-premises Application runs at a hoster Application runs using cloud platform “ Packaged” Application “ Home Built” Application Hosted “ Home Built” Hosted “ Packaged” Cloud Platform “ Software as a Service” CRM / Email Clinical Trial MRI Imaging HR Application Viral Marketing Molecule Research

“ A good solution could be to find a suitable packaged application here.” Application runs on-premises Application runs at a hoster Application runs using cloud platform “ Packaged” Application “ Home Built” Application Hosted “ Home Built” Hosted “ Packaged” Cloud Platform “ Software as a Service” CRM / Email Clinical Trial MRI Imaging HR Application Viral Marketing Molecule Research

We see a shift to the “right”, but what patterns emerge here?

Pattern 1: Transference

Taking an existing on-premises application and moving it to the cloud

Application runs on-premises Application runs at a hoster Application runs using cloud platform “ Packaged” Application “ Home Built” Application Hosted “ Home Built” Hosted “ Packaged” Cloud Platform “ Software as a Service” CRM / Email Clinical Trial MRI Imaging HR Application Viral Marketing Molecule Research

Drivers? Economic, Consolidation, Prototyping

Pattern 2: Scale and Multi-Tenancy

Creating an application that has the ability to handle web load without requiring the full capital investment from day one

Drivers? Prototyping, Risk Mitigation

Pattern 3: Burst Compute

Creating an application that has the ability to handle additional compute on an as-needed basis

Drivers? Economic (avoiding over capacity)

Pattern 4: Elastic Storage

Creating an application that has the ability to grow exponentially from a storage perspective

Drivers? Economic (avoiding over capacity), Management

Pattern 5: Inter-Org Communications

Creating an application that has the ability to communicate between organizations using a pre-defined infrastructure

Drivers? Infrastructure Management

What do we need to start to dig deeper into some of the patterns?

First need to cover some building blocks

Building Blocks

Building Blocks Physical, Dedicated Single service on dedicated hardware Physical, Shared Multiple services sharing same hardware Virtual, Single Single instance virtual image Virtual, Scalable Virtual “fabric” for applications

Building Blocks

Building Blocks File Flat file, page-based (e.g. HTML/ASPX), server affinity Relational Relational database, transactional, finite Table Storage for structured entities, scalable data Blob Storage for large data items, typically media files, no server affinity

Building Blocks

Building Blocks Async Queue or Bus Asynchronous, reliable messaging, publish/subscribe model Peer to Peer Node registration, directory, presence awareness

Building Blocks

Building Blocks Authentication Username / Password or Claims based Role Based Authorization Role-checking and Authorization

Building Blocks

Building Blocks Event Based Triggered based on events (e.g. document upload) Worker Based Persistent workflow, always active (e.g. monitoring service)

Building Blocks

Building Blocks Presentation Web Role Business Logic Worker Role

Building Blocks

Building Blocks Static Static content, HTML etc Dynamic Dynamic created pages, ASPX, PHP, etc. Client interaction through AJAX, JavaScript Rich Internet Application High visual interaction through browser plug in, some offline support Streaming Optimized for content delivery, videos etc.

Building Blocks

Building Blocks Web Services SOAP based, WS-I compliant, WS-* REST CRUD access to services using HTTP constructs RSS Syndication services for subscriptions VoiceXML Mobile Application Speech API SIP Session Initiation Protocol – IM Clients SMTP Email inbound and outbound delivery SMS Mobile inbound and outbound text messaging

Building Blocks

Building Blocks Browser Consumer of web based content, HTML etc., including RIA plug in Office Office Suite, including Email and RSS reader capability Client Application Rich (Smart) client applications installed locally on machine Gadgets Locally installed, desktop based Instant Messaging Locally installed Instant Messaging client

Building Blocks

Building Blocks Browser Consumer of web based content, HTML etc., including RIA plug in Office Office Suite, including Email and RSS reader capability Client Application Rich (Smart) client applications installed locally on machine SMS / IM Text messaging and IM using Mobile Device Speech Speech enabled interface

Building Blocks

Building Blocks Devices Dedicated devices Consoles Games Consoles

Building Blocks

Building Blocks Err… Didn’t you just build a marketing diagram? :-)

Building Blocks Use these blocks to explore the detail of the five patterns

Patterns for Moving to the Cloud Pattern 1: Transference

Exchange Lifecycle – Exchange 4.0 and Office 97 RPC JET Database

Exchange Lifecycle – Exchange 5.0 and Office 97 JET Database Active Directory for Account Storage

Exchange Lifecycle – Exchange 5.0 SP1 and Office XP Support for Outlook Web Access

Exchange Lifecycle – Exchange 2003 and Office 2003 Support for RPC over HTTPS

Exchange Lifecycle – Exchange 2007 and Office 2007 Support for Speech and Mobile

Patterns for Moving to the Cloud Moving Exchange to Hoster/Cloud

Exchange Lifecycle – Exchange 2007 and Office 2007

Exchange Lifecycle – Exchange 2007 and Office 2007 Same pattern applies, different provider

Patterns for Moving to the Cloud Hang on! That looked too simple!

Exchange Lifecycle – Exchange 2007 and Office 2007 Made assumption that Identity Provider moved to the cloud also

Patterns for Moving to the Cloud How do we solve this?

Exchange Lifecycle – Exchange 2007 and Office 2007 We could use replication, but difficult to manage

Patterns for Moving to the Cloud Need a system similar to your speaker badge! Registration Desk Door person Attendee Speaker Crew Main Hall Attendee Speaker Crew Speaker Rm Speaker Crew Bill Veghte Green Room Crew Joe Pharma Attendee Joe Pharma Passport Agency

Exchange Lifecycle – Exchange 2007 and Office 2007 Local AD STS (Secure Token Service)

Exchange Lifecycle – Exchange 2007 and Office 2007 Local AD STS (Secure Token Service) Passport Agency Registration Desk Door person

Exchange Lifecycle – Exchange 2007 and Office 2007 Local AD STS (Secure Token Service) Where’s your badge(token)? Errr… Don’t have one Go get one and come back

Exchange Lifecycle – Exchange 2007 and Office 2007 Local AD STS (Secure Token Service) Can I have a badge (token) please? Where’s your ID? Here: [email_address] Pwd: 123 Hang on This guy ok? Yeah, he’s good Here’s your badge (token)

Exchange Lifecycle – Exchange 2007 and Office 2007 Local AD STS (Secure Token Service) Where’s your badge(token)? Here you are Looks good – come on in!

Patterns for Moving to the Cloud Why is this important for cloud computing?

Patterns for Moving to the Cloud Disgruntled ex-employees!

Exchange Lifecycle – Exchange 2007 and Office 2007 Local AD STS (Secure Token Service) Where’s your badge(token)? Errr… Don’t have one Go get one and come back

Exchange Lifecycle – Exchange 2007 and Office 2007 Local AD STS (Secure Token Service) Can I have a badge (token) please? Where’s your ID? Here: [email_address] Pwd: 123 Hang on This guy ok? No way! We fired him an hour ago! No cigar for you!

Patterns for Moving to the Cloud Takeaways from Pattern #1

Patterns for Moving to the Cloud Transference is about moving on premises applications to the cloud

Patterns for Moving to the Cloud Largely the on-premise application goes across as is

Patterns for Moving to the Cloud Need to watch out for customizations that the hoster/cloud does not support

Patterns for Moving to the Cloud Relies on claims based identity (unless you are going to manage multiple identity stores)

Patterns for Moving to the Cloud Pattern 2: Scale and Multi-Tenancy

“ Viral” Web Site, Hosted On Premises We are only getting a few users per month – let’s put it on this machine with these other applications Things seem to be picking up (and the users of the other applications are complaining)

“ Viral” Web Site, Hosted On Premises Let’s move it to a dedicated box instead

“ Viral” Web Site, Hosted On Premises Wow, things are really taking off! Can we borrow that machine over there? And that load balancer?

“ Viral” Web Site, Hosted by Hoster This is beyond our operations control – let’s move to a hoster instead

“ Viral” Web Site, Hosted by Hoster More users, more machines, more service packs/patches

Patterns for Moving to the Cloud Opposite pattern here is predicting the growth of the web site

Patterns for Moving to the Cloud What does this look like in the cloud?

“ Viral” Web Site – Hosted using Azure Only a few users per month? Let’s start off with 1 x instance, we’ll pay as we go

“ Viral” Web Site – Hosted using Azure This is starting to take off… Let’s increase to 2 x instances

Patterns for Moving to the Cloud

<?xml version="1.0"?>

<ServiceConfiguration serviceName="Web" xmlns="http://schemas.microsoft.com/ServiceHosting/2008/10/ServiceConfiguration">

<Role name="WebRole">

<Instances count=“2” />

<ConfigurationSettings>

<Setting name="AccountName" value="primesolvrstorage"/>

</ConfigurationSettings>

</Role>

</ServiceConfiguration>

“ Viral” Web Site – Hosted using Azure This is starting to take off… Let’s increase to 5 x instances

Patterns for Moving to the Cloud

<?xml version="1.0"?>

<ServiceConfiguration serviceName="Web" xmlns="http://schemas.microsoft.com/ServiceHosting/2008/10/ServiceConfiguration">

<Role name="WebRole">

<Instances count=“5” />

<ConfigurationSettings>

<Setting name="AccountName" value="primesolvrstorage"/>

</ConfigurationSettings>

</Role>

</ServiceConfiguration>

“ Viral” Web Site – Hosted using Azure Actually, we were wrong – this isn’t going to make us millionaires Let’s turn it off!

Patterns for Moving to the Cloud The cloud is not only for mega-scale applications

Patterns for Moving to the Cloud Architecture lets you start very small, yet expand when needed

Patterns for Moving to the Cloud Not all of those great ideas are going to work out!

Patterns for Moving to the Cloud Pattern 3: Burst Compute

Configuring a Worker Role using Azure Let’s create 5 x worker roles

Configuring a Worker Role using Azure Cannot (and should not) consume worker roles directly

Configuring a Worker Role using Azure Need to expose through presentation (web role)

Configuring a Worker Role using Azure How do you pass data from the presentation (web role) to the business logic (worker role) to process?

PrimeSolvr Implementation Larry Clarkin and Wade Wegner Sr. Architect Evangelists, Central Region Microsoft Corporation

PrimeSolvr Application User passes a number to be checked if prime

PrimeSolvr Application The data is stored in a table

PrimeSolvr Application A “pointer” to the data is placed on the queue

PrimeSolvr Application The worker role is configured to monitor the queue Picks up the job and processes

PrimeSolvr Application The result is placed within a table The presentation reads the table (and displays) on the next client request

Patterns for Moving to the Cloud Sure, but how does this scale again?

PrimeSolvr Application Multiple instances – scale to the number of Web users Multiple instances – scale to the pipeline of incoming requests

Show config here

Show config here

Patterns for Moving to the Cloud Try it out now! http://primesolvr.cloudapp.net/

Patterns for Moving to the Cloud Anti pattern to expose worker role (business logic) directly

Patterns for Moving to the Cloud Passing data to worker role? Store in blob or table and pass pointer in queue

Patterns for Moving to the Cloud Returning result to web role? Store in blob or table, wait for web to refresh

Patterns for Moving to the Cloud Pattern 4: Elastic Storage

Patterns for Moving to the Cloud Storage for the last few decades

File Storage over the Decades File Server Direct through RPC, NFS, etc.

File Storage over the Decades Intranet Portal

File Storage over the Decades Extranet Portal

File Storage over the Decades Problems with server affinity and mgt of large files. Relational DB doesn’t solve problem either

Blob Storage using Azure Cloud provides support for storage through “blobs” REST interface (PutBlob, GetBlob, DeleteBlob)

Blob Storage using Azure Support for Blocks PutBlock(blob, block, data) How about timeouts over HTTP? 10Gb MRI image Commit with PutBlockList

Patterns for Moving to the Cloud … and getting the image back?

Blob Storage using Azure Please give me the image http://mri.blob.core.windows.net/images/432532432.mri.jpg

Blob Storage using Azure Render low res-version of the image Zoom in please Render zoomed in portion of image Please show me the image

Patterns for Moving to the Cloud http://livelabs.com/seadragon/

Patterns for Moving to the Cloud What if I want to do relational storage in the cloud?

Patterns for Moving to the Cloud SQL Data Services (SDS)

Current SDS Implementation “ Code Near” Model Code near to home, “long” data access connection

Current SDS Implementation “ Code Far” Model Code far from home, “short” data access connection

Patterns for Moving to the Cloud SDS Moving Forward Using Relational Model

Current SDS Implementation “ Code Near” Model using REST (Astoria)

Current SDS Implementation “ Code Far” Model using Azure application

Taking the MRI Example Forward TDS (Tabular Data Stream) over TCP Code Near Model (using existing SQL Client Library)

Patterns for Moving to the Cloud Local storage is cheap, but management can be difficult

Patterns for Moving to the Cloud Cloud enables elastic storage growth for large files, but consider how user will access

Patterns for Moving to the Cloud SDS future has three ways of exposing – through HTTP (via Azure), through REST (via Astoria), through TDS

Patterns for Moving to the Cloud Pattern 5: Inter-Org Communications

Azure Queues for Web to Worker Communication Queue works between web and worker role, but not outside the organization

Azure Queues for Web to Worker Communication Technically possible to expose Azure queue via REST interface, but… How do you deal with Firewall/NAT for incoming msg?

Intro Service Bus (product slide)

.NET Service Bus for Communication sb://…/myqueue (Outbound bi-directional socket, kept alive in background) Subscriber

.NET Service Bus for Communication sb://…/myqueue (Outbound one-way socket) Sender Message routed appropriately Delivered without the use of any inbound ports

Patterns for Moving to the Cloud One of the other components of .NET Services is workflow

Patterns for Moving to the Cloud Event Driven vs. Hosted

Event Driven Workflow Workflow defined using XOML

Patterns for Moving to the Cloud Does the workflow always have to be initiated from the client?

Hosted Workflow Hosted Workflow

Patterns for Moving to the Cloud Red Prairie Example

Red Prairie Example Orchestrator Service Recall – Lead paint discovered in Item #242522

Red Prairie Example Iterate through list of partners Send recall notice

Red Prairie Example Iterate through list of partners Send recall notice Receive and Log Acknowledgement

Patterns for Moving to the Cloud Azure queues can be exposed through REST, but difficult to receive messages (without polling)

Patterns for Moving to the Cloud Protocol handling within the .NET Service Bus overcomes this

Patterns for Moving to the Cloud (Also provides durable queues as of March CTP)

Patterns for Moving to the Cloud Workflow can handle more complex communications

Patterns for Moving to the Cloud Hosted workflow in the cloud useful for monitoring

Conclusion

Conclusion We covered 5 patterns

Conclusion Pattern 1: Transference

Conclusion Pattern 2: Scale and Multi-Tenancy

Conclusion Pattern 3: Burst Compute

Conclusion Pattern 4: Elastic Storage

Conclusion Pattern 5: Inter-Org Communication

Conclusion These are “starter” patterns - not an exhaustive list, but show some of the different archetypes of applications possible in the cloud today

Conclusion This space is still evolving, but very exciting to see the new patterns that will emerge

ARC-INT01 – Join us for Part 2 of this talk! Larry Clarkin and Wade Wegner Sr. Architect Evangelists, Central Region Microsoft Corporation Showing 25 instances running on Azure!