Patterns For Cloud Computing

Patterns for Cloud Computing

This is Jim


Jim has many questions about cloud computing


The more he reads, the more confused he gets


“What is Cloud Computing?”


“What can I use the Cloud for?”


“What is Microsoft’s roadmap in this space?”

Answering these Questions can be Difficult

Answering these Questions can be Difficult

So many alternative definitions from
different vendors

It can be difficult to describe what
the cloud can be used for

Keeping up with our beta and
released products is challenging

Session Objectives

Explore a Clear Definition
of Cloud Computing

Arm you with 5 Patterns for
Cloud-based Applications

Show you how to Implement these
Patterns using our Platform

Defining Cloud Computing

Jim has heard all the buzzwords


Service Oriented Architecture


Rich Internet Applications


Software as a Service


Software + Services


Are any of these cloud computing?


Styles of application architecture


These styles can work in the cloud,
but they are not cloud computing


Where do your applications “live”?


On Premises
Hosted
Cloud


Application runs
on-premises

• Bring my own
machines,
Buy my own
connectivity,
software, etc.and
hardware,
• manage my own
Complete control
data center
and responsibility
• Upfront capital
costs for the
infrastructure


Application runs Application runs at a
on-premises hoster

• Bring my own • Rent machines,
machines, connectivity,
Buy my own Pay someone to
software
connectivity,
software, etc.and
hardware, host my application
• Less control, but
• manage my own
Complete control using hardware that
fewer
data center
and responsibility I specify
responsibilities
• Upfront capital • Lower capital costs,
costs for the but pay for fixed
infrastructure capacity, even if idle


Application runs Application runs at a Application runs using
on-premises hoster cloud platform

• Bring my own • Rent machines, • Shared,
machines, connectivity, multi-tenant
Pay someone for a
Buy my own Pay someone to
software environment
connectivity, pool of computing
software, etc.and
hardware, host my application
• Less control, but • Offers pool of
resources that can
• manage my own
Complete control using hardware that
fewer computing
be applied to a set
data center
and responsibility I specify
responsibilities resources,
of applications
abstracted from
• Upfront capital • Lower capital costs,
costs for the but pay for fixed infrastructure
infrastructure capacity, even if idle • Pay as you go


Cloud “Variants”


Public Cloud


Pool of computing resources offered by
a vendor, typically using a
“pay as you go” model


Private Cloud


Pool of computing resources that lives
within a self managed datacenter


Pool of computing resources that lives
within a datacenter with no sharing


“What is Microsoft doing in Cloud Computing?”


Refer to the introductory Azure
materials – not going to go through
them here


3 x Critical Concepts


Roles

Web Role
Worker Role


Storage

Table, Blob, Relational


Messaging

Queues


Using the Cloud for Scale


“Isn’t the cloud good for applications that need to
scale dynamically?”


For example, tax applications


“How does this work?”


Let’s do some white boarding for Jim…

…and when I say white boarding, I really mean it

#1 - Using the Cloud for Scale

“Wow! What a great site!”

Request
Browser Web Tier B/L Tier Database
Response


Browser

Browser

“Server Busy”
Browser

Browser


Browser

Browser


Browser “Timeout”

Browser

How would Jim do this today on premises?


Browser

Browser Web Tier
N
Browser L Web Tier B/L Tier Database
B
Browser Web Tier

Browser


Browser

Browser B/L Tier
N
Browser Web Tier L B/L Tier Database
B
Browser B/L Tier

Browser


Browser

Browser Web Tier B/L Tier
N N
Browser L Web Tier L B/L Tier Database
B B

Browser


Browser p1 p2 p3

N N
B B

Browser


Browser p1 p2 p3

N N
B B

Browser “That took a lot of work - and money!”


p1 p2 p3
“Not so great now…”
Web Tier B/L Tier
N N
B B
Web Tier B/L Tier

“That took a lot of work - and money!”
“Hmmm... Most of this stuff is sitting idle...”


Datacenter peak load

Usage Idle time

Jan Apr Jul Oct


“Wow! What a great site!”

Request
Browser Web Role Worker Role Azure
Storage
Response


Browser

Browser

Browser Web Role Worker Role Azure
Storage
“Server Busy”
Browser

Browser


Browser

Browser Web Role
N
Browser L Web Role Worker Role Azure
B Storage
Browser Web Role

Browser

You don’t see
this bit


Browser
Worker
Browser Web Role
Role
N N
Worker Azure
Browser L Web Role L
Role Storage
B B
Browser Worker
Web Role
Role
Browser


Browser p1 p2 p3
Worker
Browser Web Role
Role
N N
Worker Azure
Browser L Web Role L
Role Storage
B B
Browser Worker
Web Role
Role
Browser

OK, so changing config is easy...

…but what else do I need to know?


Web Role Worker Role

Tight coupling between web and
worker role is an anti-pattern


4. Process


2. Respond to UI

Req
1 Place on queue
. 3. Pickup from queue
Queue


4. Process


Req 5. Add result to table

Queue

6. Query table on refresh
Table

How many web and worker roles do you need?


Browser

Browser Web Role
N
Browser L Web Role Worker Role Azure
B Storage
Browser Web Role

Browser

Collate IIS logs
Testing
/ MOM pack



Req

Queue





Req Req Req

Queue


Web Role Monitor queue Worker Role
length against user’s
Web Role expectations Worker Role

Takeaways

Using configuration, Azure makes it
easy to scale roles

Understand how to communicate
between Web and Worker role

Strategy on when to scale up/down
roles in production

Patterns for Moving to the Cloud

Using the Cloud for Multi Tenancy


“I like the idea of scaling Web roles…”


“…but need to serve multiple customers”


“Without creating separate codebases!”

#2 - Using the Cloud for Multi Tenancy

Customer #1


Customer #1

Customer #2

Customer #3


Browser
Customer #1

Customer #2

Browser
Customer #3

Schema Customizations

UI Customizations

3 options for data in multi tenant environment


Browser
Fixed Schema
Customer #1

Customer #2

Browser
Option 1: Everyone Uses the Same Database/Schema
Customer #3
Pros: Simplest approach, easy to maintain/upgrade.
Cons: No customizations. Restoring of tenant data.


Browser Database
Customer #1 Customer #1


Browser Database

Option 2: Give Each Customer Their Own Database/Schema
Pros: Flexible. Tenant restore is easier. High Isolation.
Cons: Can be costly. Difficult to upgrade db schemas.


Browser Fixed Schema
with Customizations
Customer #1

Customer #2

Browser
Option 3: Fixed Database/Schema, with customizations
Customer #3
Pros: Customers can add their own custom fields
Cons: Non standard way of customizing the schema.
Tenant restore is difficult.

Tenant

*
1
TenantID int

TenantName nvarchar

*
Employee
EmployeeId int TypeID
*
Type
int

FirstName nvarchar Name nvarchar

LastName nvarchar CLRType nvarchar

1 1
Customization

*
int

*
CustomizationID

Value nvarchar

Tenant

*
1
TenantID 1

TenantName UK Branch

*
Employee
EmployeeId 1 TypeID
*
Type
1

FirstName Gordon Name PostalCode

LastName Brown CLRType string

1 1
Customization

*
1

*
CustomizationID

Value SW1 2AA
A

Tenant

*
1
TenantID 2

TenantName US Branch

*
Employee
EmployeeId 2 TypeID
*
Type
2

FirstName Barack Name ZipCode

LastName Obama CLRType string

1 1
Customization

*
2

*
CustomizationID

Value 20500

Tenant

*
1
Fixed Schema TenantID 2
Applies to All Could be both
TenantName US Branch

* *
Tenants

Employee Type
EmployeeId 2 TypeID 2
Customizable
FirstName Barack Tenant by Tenant Name ZipCode

LastName Obama Basis CLRType string

1 1
Customization

*
2

*
CustomizationID

Value 20500

Single Controller per Tenant

http://employeedata.cloudapp.net/CompanyA
(CompanyAController)

http://employeedata.cloudapp.net/CompanyB
(CompanyBController)

Shared Controller per Tenant

http://employeedata.cloudapp.net/CompanyA
(EmployeeController)

http://employeedata.cloudapp.net/CompanyB
(EmployeeController)

Shared Controller per Tenant (with URL mask)

http://hr.companya.co.uk
(http://employeedata.cloudapp.net/employees)

http://hr.companyb.com
(http://employeedata.cloudapp.net/employees)


http://hr.companya.co.uk
Browser
Customer #1 http://employeedata.cloudapp.net
Customer #2

Browser
Customer #3
http://hr.companyb.com


http://hr.companya.co.uk -> CNAME (employeedata.cloudapp.net)
Browser
Customer #2

Browser
Customer #3
http://hr.companyb.com -> CNAME (employeedata.cloudapp.net)


http://hr.companya.co.uk -> CNAME (employeedata.cloudapp.net)
Browser
Customer #2 Use custom routing in ASP
.NET MVC

Browser
Customer #3
http://hr.companyb.com -> CNAME (employeedata.cloudapp.net)

Demo: Multi Tenant Routing using ASP
.NET MVC

Takeaways

Always consider Multi Tenancy first,
even if only one customer

Design considerations must include
both data and UI

Many other considerations
(such as identity)


Using the Cloud for Compute


Jim has seen how Azure enables multiple nodes


“Can I use all of these nodes in parallel?”


“I’ve got this multi-GB file I need analyzing…”

#3 - Using the Cloud for Compute

Data
Data Worker
Data
Client Master Worker

Data
Worker


Result
Worker

Result

Result
Worker
Result

Popularized by the term “MapReduce”*

* 2004 OSDI paper by Jeff Dean and Sanjay Ghemawat (Google)


How many ”e”’s in
“The quick brown fox jumps over the lazy dog”?
M<k,v>
Data Worker
M<k,v>

M<k.v>
Worker

“Map”

M<“the quick brown”.”e”>
M<“fox jumps over”.”e”>
M<“the lazy dog”.”e”>


L<k,v>
Worker

L<k,v>

Result
Worker
L<k,v>
3 x ”e”s found
“Reduce”
L<”e”,”1”>
L<”e”,”1”>
L<”e”,”1”>

And it’s definitely popular...


Google
20pb of data analyzed every day using MapReduce

Yahoo!
10k+ cores, 4pb of data using MapReduce

Facebook
2500+ cores, 1pb of data using MapReduce


Apache Hadoop
Open Source Java “Inspired by MapReduce”
(Core, HDFS, many more)

Cloudera
Consulting, training, distribution of Hadoop

Amazon Elastic MapReduce
Hadoop implementation on EC2


Data
Data Worker
Data

Client Application Job/Task Scheduler Worker
Data

Remote Service

How about implementing this on Windows Azure?


Data
Worker
Data

Data
Worker
Client Web Role
Data
Client Application Job/Task Scheduler Worker
Remote Service

Req

Queue

Table

Demo: Windows Azure Demo
“Inspired by MapReduce”

Takeaways

MapReduce very visible, although
can be difficult to initially grasp

Learn about existing frameworks,
especially Apache Hadoop

Read up on Dryad (DryadLINQ) for
future direction


Using the Cloud for Storage


“The cloud lets me store infinite data, right?”


Lots of headaches with data management today


“It sounds too good to be true…”

How does Jim do this today on premises?

#4 - Using the Cloud for Storage

File
RPC/NFS
Client File Server Store


Data TDS (Tabular Data Stream)
Client DB Server RDBMS


Data
HTTP POST
Browser Web Server Database


I love I love
you! you too!

Server Data

Affinity between your data and physical
hardware that serves it


I love I love
you! you too!

Server Data

Symptoms:
Which RAID number was that again?
Tedious to backup exponentially growing data
Crap! I’m at 95% capacity - got to move to a bigger disk

Breaks the affinity between your data and hardware


“Code Near” Pattern
Data access code near to home, long data connection

Client DAL
Cloud Storage

Good for offline scenarios + client applications

DAL -> Storage typically REST connection


“Code Far” Pattern
Data access code far from home, short data
connection

Client Web Tier DAL
Cloud Storage

Good for browser based scenarios, but no offline.
Good for “chattier” applications between DAL and database


PutBlob Blob Container
PUT http://account.blob.core.windows./net/containername/blobname

REST API
Client Azure
Blob Storage

http://account.blob.core.windows.net/containername/blobname

PutBlob = 64Mb MAX
MetaData = 8Kb per Blob


Blob Container

REST API
Client Azure
Blob Storage
GetBlob
GET http://account.blob.core.windows./net/containername/blobname



Blob Container

REST API
Client Azure
Blob Storage
GetBlob
GET http://account.blob.core.windows./net/containername/blobname
Range: bytes=329300 - 730000


PutBlock(blobname, blockid, data) Blob Container
PutBlockList(blobname, blockid1 …, blockidN)
,
REST API
Client Azure
Blob Storage


PutBlock = 4Mb MAX to a maximum of 50Gb
BlockId = 64 bytes

REST:
GET http://account.table.core.windows.net/Customer?$filter=%20PartitionKey%20eq%20value
LINQ:
var customers = from o in context.CreateQuery<customer>(“Customer”) where o.PartitionKey
== value select o;

Worker Role Azure
Table Storage

http://account.table.core.windows.net
Each Table:

PartitionKey (e.g. DocumentName) to ensure
scalability
RowKey (e.g. version number)
[fields] for data

SQL Server Data Services (MIX08)


This is what I’m doing on premises...

Data
TDS


So, this is what I would like to do in the cloud...

Data
TDS


So, this is what I would like to do...

Data
TDS
Client SQL Azure RDBMS


HTTP TDS
Browser Web Role SQL Azure RDBMS


HTTP Queue TDS
Browser Web Role Worker Role SQL Azure RDBMS


“The Data Center”

HTTP TDS
Browser Web Tier Bus. Logic SQL Server RDBMS


“The Cloud”

HTTP Queue TDS
Browser Web Role Worker Role SQL Azure RDBMS

Takeaways

Understand the pricing model for
storage on-premises vs. cloud

Read up and understand code
near/code far models

SQL Azure as a factor for
migration/move from on premises


Using the Cloud for Communications


Jim’s organization needs to communicate with
other organizations


“This has always been a very tricky and expensive
process to get working”


“Does the cloud offer anything to help?”

How would Jim have done this before?

#5 - Using the Cloud for Communications

Telco provided WAN
Company 1 Company 2

Client Server

FTP FTP
Client Server


Internet
Telco provided WAN
Company 1 Company 2

Client Server

FTP FTP
Client Server


Internet
Telco provided WAN
Company 1 Company 2
DMZ

Client Server

Extranet
Browser
Site


http://app.queue.core.windows.net/

REST
Client Azure Queue

Company 1

Client

REST
Azure Queue

Company 2

Client

Company 1

Client
Master Key
REST
Azure Queue

Company 2

Client

Master Key

Company 1

Client

REST
Web Role Azure Queue

Company 2

Client

Proxy?
Company 1

Firewall
Client

REST

Company 2

Client
Firewall

Company 1

Firewall
Client

REST

Company 2 65.55.33.204

Client
Firewall
192.168.14.100

NAT?

Company 1

Firewall
Client

REST

Company 2 65.55.33.204

Client
Firewall
192.168.14.100
OK, so I’ll do a HTTP
poll every minute

Company 1

Firewall
Client

REST

Company 2 65.55.33.204

Client
Firewall
192.168.14.100
…and how about other
protocols other than HTTP?

How does the .NET Service Bus help?

Company 1

sb://.../myqueue
Client

.NET
Service Bus

Company 2

Client
Firewall
Outbound bi-directional socket
Kept alive in background

Company 1

Firewall
sb://.../myqueue
Client Outbound one-way socket

.NET
Service Bus

Company 2

Message routed
Client
accordingly
Firewall

This Conference
MySQL Admin Firewall
sb://.../myqueue
My Laptop Outbound one-way socket
Localhost:1000

.NET
Service Bus

My Home

Message routed
Home PC
accordingly
192.168.14.193 Firewall
My SQL

Port 3306

Takeaways

Be careful consuming Azure queues
directly via REST

Firewalls/NATs can add additional
trouble (especially non-HTTP)

Learn how .NET Service Bus
traverses in these scenarios

Next Steps

Obviously, our friend Jim, is fake…

Next Steps

Make sure you have a clear definition
of Cloud Computing

Explore the 5 usage patterns for
your scenarios today

Think about the next steps for
implementation and migration

simon.guest@microsoft.com
http://simonguest.com

Patterns For Cloud Computing

More Related Content

What's hot

Viewers also liked

Similar to Patterns For Cloud Computing

More from Simon Guest

Recently uploaded

Patterns For Cloud Computing