Real World Azure - Dev

MSDN Events Presents:Real World Azure
clint edmonson | architect evangelist | www.notsotrivial.net
mike benkovich | developer evangelist | www.benkotips.com

This is Jim
Patterns for Cloud Computing

Jim has many questions about cloud computing

The more he reads, the more confused he gets

“What is Cloud Computing?”

“What can I use the Cloud for?”

“What is Microsoft’s roadmap in this space?”

Define Cloud Computing
Break down the parts
Highlight the implementation of a Real World Azure scenario

Jim has heard all the buzzwords

Service Oriented Architecture

Rich Internet Applications

Software as a Service

Software + Services

Are any of these cloud computing?

Styles of application architecture

These styles can work in the cloud, but they are not cloud computing

Where do your applications “live”?

On Premises
Hosted
Cloud
Vendor’s Problem

“What is Microsoft doing in Cloud Computing?”

3 x Critical Concepts

Roles
Web Role
Worker Role

Storage
Table, Blob, Relational

Messaging
Queues

Using the Cloud for Scale

“Isn’t the cloud good for applications that need to scale dynamically?”

For example, tax applications

“How does this work?”

Let’s do some white boarding for Jim…

“Wow! What a great site!”
Database
Request
Web Tier
B/L Tier
Browser
Response

Browser
Browser
Database
Web Tier
B/L Tier
Browser
“Server Busy”
Browser
Browser

Browser
Browser
Database
Web Tier
B/L Tier
Browser
“Timeout”
Browser
Browser

How would Jim do this today on premises?

Browser
Web Tier
N L B
Browser
Database
Web Tier
B/L Tier
Browser
Browser
Web Tier
Browser

Browser
B/L Tier
N L B
Browser
Database
Web Tier
Browser
B/L Tier
Browser
B/L Tier
Browser

Browser
Web Tier
N L B
B/L Tier
N L B
Browser
Database
Web Tier
Browser
B/L Tier
Browser
Web Tier
B/L Tier
Browser

Browser
p1 p2 p3
Web Tier
N L B
B/L Tier
N L B
Browser
Database
Web Tier
Browser
B/L Tier
Browser
Web Tier
B/L Tier
Browser

Not without consequences...

Browser
p1 p2 p3
Web Tier
N L B
B/L Tier
N L B
Browser
Database
Web Tier
Browser
B/L Tier
Browser
Web Tier
B/L Tier
Browser
“That took a lot of work - and money!”

p1 p2 p3
“Not so great now…”
Web Tier
N L B
B/L Tier
N L B
Database
Web Tier
Browser
B/L Tier
Web Tier
B/L Tier
“That took a lot of work - and money!”
“Hmmm... Most of this stuff is sitting idle...”

Datacenter peak load
Idle time
Usage
Jan
Apr
Jul
Oct

How can Windows Azure help?

“Wow! What a great site!”
Azure Storage
Request
Web Role
Worker Role
Browser
Response

Browser
Browser
Azure
Storage
Web Role
Worker Role
Browser
“Server Busy”
Browser
Browser

Browser
Web Role
N L B
Browser
AzureStorage
Web Role
Worker Role
Browser
Browser
Web Role
Browser
You don’t see this bit

Browser
Web Role
N L B
Worker Role
N L B
Browser
AzureStorage
Web Role
Browser
Worker Role
Browser
Web Role
Worker Role
Browser

Browser
p1 p2 p3
Web Role
N L B
Worker Role
N L B
Browser
AzureStorage
Web Role
Browser
Worker Role
Browser
Web Role
Worker Role
Browser

What’s going on behind the scenes?

Windows Azure
Your
Service
DNS
LB
Web Portal
(API)
LB
Fabric
Controller

Service
Service
Service
Model
Your
Service
DNS
LB
Web Portal
(API)
DNS
config
LB
Service Deployment
Fabric
Controller

Your
Service
Service
Service
DNS
Service
Service
Service
Service
Service
LB
Service
Web Portal
(API)
LB
Model
Service Scaling
Fabric
Controller

Your
Service
Service
DNS
Service
Service
Service
LB
Web Portal
(API)
!
LB
Model
Service Monitoring & Recovery
Fabric
Controller

On to the Case Study…

RXD Incubation Project
Project Vision
Project Austin delivers a next-generation, micro-community based opportunity management and collaboration experience to our managed partners …
Project Goals
Gain first-hand experience on Azure
Cloud Storage – Security – Integration – Web – SQL Azure
Explore a business scenario that leverages the promises of the cloud
Provide enterprise feedback to the Azure team
Deliver a working prototype in FY09
Project Austin Overview

Project Austin delivers a next-generation, micro-community based opportunity management and collaboration experience that brings a managed feel to the unmanaged space, allowing Microsoft to observe and participate in the sales process at scale through dynamic, customer-driven collaboration.
Project Austin leverages Windows Azure, CRM Services, and SharePoint Services to provide a rich set of customer and partner capabilities in the cloud while integrating with existing on-premise solutions.
Project Austin significantly enhances our understanding of our customers and partners by facilitating relationships with and between customers, partners, and Microsoft, while providing data that allows Microsoft to identify and promote world-class selling techniques and content.
Project Austin Vision

Web Role
Multi-Tenant; Web App; Web Service
Integration
Worker Role; .NET Service Bus; Siebel
Data Storage
Tables; Blobs; Queues; SQL Azure
Live ID Integration
Web Auth; Access Control Service; WIF; RPS
Technical Overview

Community
Community
Micro Community
Factory
Community
Community
Community
Groups
Community Group A
Community Group B
Personalization
Membership
Content
Personalization
Membership
Content
High Level Services
Personalization
Customization
Content
Security
Integration
…
Navigation
Search
Membership
Identity
Groups
…
Foundation Services
Identity
Security
Storage
Eventing
Config
Content
…
Micro Community
Compute
59

(TODO: Insert Austin Screenshots or walkthrough application)

(Transition to Developer Evangelist…)
This slide is Hidden

Warning – this session contains information about Microsoft Technologies that are in the CTP (pre-Beta) stages. Specifics of the technology may change before final release.

Feedback.

We are here to help. Send us your questions, doubts, concerns, challenges, adoration, regrets, denials, and alibis.
We will start a discussion and help you out.
something@microsoft.com

The Development Experience…

Visual Studio
Templates
Debugging
.NET platform
.NET, IIS7, WCF
“The cloud on your desktop”
Complete offline cloud simulation
Like Cassini (web development server)
Consistent, Familiar Development

Write code on your development machine
Test locally
Build package w/VS Tools
Upload your package to the web portal
Push “deploy”
Monitor, upgrade, scale…
Publishing Your Service To The Cloud

Demo: Developer Experience

Roles
Web Role
Worker Role
Windows Server 2008 x64
.NET Start
Native Code
User Mode
Windows Server 2008 x64
IIS 7
FastCGI - PHP
Native Code
Full Trust
User Mode

Demo: Guest Book

Service Models & Roles
Bid Now Service
Worker X
Web A
(port 80)
Main Web
100 instances
Image Resize
2 instances
Worker Y
Auction Processing
25 instances
Web B
(port 8081)
Admin
2 instances
Worker Z
Notifications
10 instances

Debugging the cloud really means logging
Simple logging API today
More functionality over time
Debugging in the Cloud

Demo: Guest Book Logging

Storage in the Cloud…

Blobs, Tables, Relational

Blobs stored in Containers
1 or more Containers per account
Scoping is at container level
…/Container/blobpath
Blobs
Capacity 50GB in CTP
Metadata, accessed independently
name/value pairs (8kb total)
Private or Public container access
Use Blobs for file system
Blobs

Using the Cloud for Storage
Blob Container
PutBlob
PUT http://account.blob.core.windows./net/containername/blobname
Azure
Blob Storage
REST API
Client
http://account.blob.core.windows.net/containername/blobname
PutBlob = 64Mb MAX
MetaData = 8Kb per Blob

Blob Container
Azure
Blob Storage
REST API
Client
GetBlob
GET http://account.blob.core.windows./net/containername/blobname

Blob Container
Azure
Blob Storage
REST API
Client
GetBlob
GET http://account.blob.core.windows./net/containername/blobname
Range: bytes=329300 - 730000

Blob Container
PutBlock(blobname, blockid, data)
PutBlockList(blobname, blockid1, …, blockidN)
Azure
Blob Storage
REST API
Client
PutBlock = 4Mb MAX to a maximum of 50Gb
BlockId = 64 bytes

REST:
GET http://account.table.core.windows.net/Customer?$filter=%20PartitionKey%20eq%20value
LINQ:
var customers = from o in context.CreateQuery<customer>(“Customer”) where o.PartitionKey == value select o;
Azure
Table Storage
Worker Role
http://account.table.core.windows.net
Each Table:
PartitionKey (e.g. DocumentName) to ensure scalability
RowKey (e.g. version number)
[fields] for data

Entities and properties (rows & columns)
Tables scoped by account
Designed for billions+
Scale-out using partitions
Partition key & row key
Operations performed on partitions
Efficient queries
No limit on number of partitions
Use ADO.NET Data Services
Tables

Provides structured storage
Massively scalable tables (TBs of data)
Highly available
Durable
Familiar and easy-to-use API
ADO.NET Data Services – .NET 3.5 SP1
.NET classes and LINQ
REST – with any platform or language
Introduction to Tables

For scalable applications:
Billions of rows, TBs of data
Automatic load management (hot data)
For online applications:
High availability
Built-in replication
Flexible schema (no big “schema migration”)
Optimistic concurrency
Advantages

No join
No group by
No order by
Think: relational DB partitioned to the max
Not a Relational Database

Table
A Table is a set of Entities (rows)
An Entity is a set of Properties (columns)
Entity
Two “key” properties form unique ID
PartitionKey – enables scale
RowKey – uniquely ID within a partition
Data Model

Key Example – Blog Posts
Partition 1
Partition 2
Getting all of dunnry’s blog posts is fast
Single partition
Getting all posts after 2008-03-27 is slow
Traverse all partitions

Partition Key – how data is partitioned
Row Key – unique in partition, defines sort
Goals
Keep partitions small (increased scalability)
Specify partition key in common queries
Query/sort on row key
Keys

Tradeoff between locality and scalability
Considerations
Entity group transactions
Query efficiency
Scalability
Flexible Partitioning
Choosing a Partition Key

Pick potential keys (common query filters)
Order keys by importance
If needed, include an additional unique key
Use two most important keys as PK, RK
Consider concatenating to form keys
A Method of Choosing Keys

A Method for Choosing Keys…
Pick potential keys (common query filters)
Order keys by importance
If needed, include an additional unique key
Use two most important keys as PK, RK
Consider concatenating to form keys

Non-key queries are scans
Improve performance by scoping
Usually by partition key
But what about by table?
3 tables
Top 1,000 popular items
Top 10,000 popular items
Everything
Now arbitrary “top 1,000” queries are fast
Better locality than clever partition keys
Multiple Tables, Same Keys

Demo: Guest Book Table Storage

Lessons LearnedAzure Storage
Azure tables are *not* a relational database
Requires a mind shift
Azure tables scale
3 - 9s availability
Azure tables support exactly one key
PartitionKey + RowKey
Case Matters
No foreign keys
No referential integrity
No stored procedures
Leverage the community

Lessons LearnedAzure Storage
Azure storage Client Library
No longer just a “sample”
Azure storage is available via REST
Not limited to Azure hosted apps
Not limited to Microsoft platform or tools
Getting the signature correct is the hard part
Console tools are easy to write
Ultimate flexibility
Use the REST interface early as you’re versioning your tables

Lessons LearnedAzure Storage - RESTful
REST is *not* TDS
Be prepared to parse
LINQ and XML classes help
Sometimes, string parsing is the best choice
Don’t forget to close your HTTP connections
Azure storage names are picky
So are Azure key values
It’s possible to create an entity in a table and not be able to update or delete it

Lessons LearnedAzure Storage – Roundtrips are expensive
Often better to pull back more than you need vs. multiple roundtrips
LINQ on results in memory is fast & flexible
foreach works well too
don’t forget the break;
Sort and cache tables on the web tier
Use XML Serialization to write the results to local storage
It’s generally faster to hydrate from local storage
Not as fast as caching in memory

Lessons LearnedAzure Storage – List<>
Using List<> with entity types
List<> binds well
LINQ works well with List<>
So does foreach
List<> serializes well
Add intelligence to your entities
Compare, Equals, ToString, etc.

SQL Server Data Services (MIX08)

This is what I’m doing on premises...
Data
TDS
RDBMS
Client
DB Server

So, this is what I would like to do in the cloud...
Data
TDS
RDBMS
Client
DB Server

SQL Data Services (MIX09)

SQL Azure (July 2009)

So, this is what I would like to do…
Data
TDS
RDBMS
Client
SQL Azure

HTTP
TDS
RDBMS
Browser
Web Role
SQL Azure

Queue
TDS
HTTP
RDBMS
Browser
Web Role
Worker Role
SQL Azure

Migration!

“The Data Center”
TDS
HTTP
RDBMS
Browser
Web Tier
Bus. Logic
SQL Server

“The Cloud”
Queue
TDS
HTTP
RDBMS
Browser
Web Role
Worker Role
SQL Azure

Demo: SQL Azure CTP

CTP Limitations TodaySET ANSI_NULLS ONSET ANSI_NULLS OFFPAD_INDEX = OFFSET ANSI_PADDING OFFALLOW_ROW_LOCKS = ONALLOW_PAGE_LOCKS = ONON [PRIMARY]FILLFACTOR = 90Three-part naming (e.g. dbo.TableName.ColumnName)Cannot use “WITH IGNORE_DUP_KEY” w/o the quotesNo @@servernameNo CREATE SCHEMA(Not an exhaustive list)

Lessons LearnedSQL Azure
From the database “down” it’s just SQL Server
Well, almost …
Most tools don’t work today
System catalog is different
No CLR
Above the database is taken care of for you
You can’t really change anything

SQL Server is very familiar
SQL Azure *is* SQL Server in the cloud
Security of Azure tables is unknown
SQL Server has a very good pedigree
A lot of our customers LOVE SQL Server
Understand Azure storage
Understand SQL Azure
Make the right recommendation

Azure tables are *not* SQL Azure
SQL Azure is not the only storage option
SQL Azure is not always the best storage option
SQL Azure costs more
Delivers a *lot* more functionality
SQL Azure is more limited on scale [today]

Queues

Simple asynchronous dispatch queue
Create and delete queues
Message:
Retrieved at least once
Max size 8kb
Operations:
Enqueue
Dequeue
RemoveMessage
Queues

Azure Queues
RemoveMessage
GetMessage (Timeout)
Worker Role
PutMessage
Queue
Msg 1
Msg 2
Msg 2
Msg 1
Web Role
Worker Role
Worker Role
Msg 3
Msg 4
Msg 2

Patterns in the Cloud
Using the Cloud for Multi Tenancy

“I like the idea of scaling Web roles…”

“…but need to serve multiple customers”

“Without creating separate codebases!”

Database
Web Tier
B/L Tier
Browser
Customer #1

#2 - Using the Cloud for Multi Tenancy
Database
Web Tier
B/L Tier
Browser
Customer #1
Database
Web Tier
B/L Tier
Browser
Customer #2
Database
Web Tier
B/L Tier
Browser
Customer #3

Gets expensive pretty quickly

Browser
Customer #1
Database
Web Tier
B/L Tier
Browser
Customer #2
Browser
Customer #3

Schema CustomizationsUI Customizations

3 options for data in multi tenant environment

Browser
Fixed Schema
Customer #1
Database
Web Tier
B/L Tier
Browser
Customer #2
Browser
Option 1: Everyone Uses the Same Database/Schema
Customer #3
Pros: Simplest approach, easy to maintain/upgrade.
Cons: No customizations. Restoring of tenant data.

Database
Browser
Customer #1
Customer #1
Database
Web Tier
B/L Tier
Browser
Customer #2
Customer #2
Database
Browser
Customer #3
Customer #3
Option 2: Give Each Customer Their Own Database/Schema
Pros: Flexible. Tenant restore is easier. High Isolation.
Cons: Can be costly. Difficult to upgrade db schemas.

Fixed Schema
with Customizations
Browser
Customer #1
Database
Web Tier
B/L Tier
Browser
Customer #2
Browser
Option 3: Fixed Database/Schema, with customizations
Customer #3
Pros: Customers can add their own custom fields
Cons: Non standard way of customizing the schema. Tenant restore is difficult.

Tenant
1
*
int
TenantID
nvarchar
TenantName
*
*
Type
Employee
int
TypeID
int
EmployeeId
nvarchar
Name
nvarchar
FirstName
nvarchar
nvarchar
CLRType
LastName
1
1
Customization
int
CustomizationID
*
*
nvarchar
Value

Tenant
1
*
1
TenantID
UK Branch
TenantName
*
*
Type
Employee
1
TypeID
1
EmployeeId
PostalCode
Name
Gordon
FirstName
string
Brown
CLRType
LastName
1
1
Customization
1
CustomizationID
*
*
SW1A 2AA
Value

Tenant
1
*
2
TenantID
US Branch
TenantName
*
*
Type
Employee
2
TypeID
2
EmployeeId
ZipCode
Name
Barack
FirstName
string
Obama
CLRType
LastName
1
1
Customization
2
CustomizationID
*
*
20500
Value

Tenant
1
*
2
TenantID
Fixed Schema
Applies to All Tenants
Could be both
US Branch
TenantName
*
*
Type
Employee
2
TypeID
2
EmployeeId
Customizable
Tenant by Tenant Basis
ZipCode
Name
Barack
FirstName
string
Obama
CLRType
LastName
1
1
Customization
2
CustomizationID
*
*
20500
Value

Schema CustomizationsUI Customizations

#2 - Using the Cloud for Multi Tenancy
Browser
Customer #1
Database
Web Tier
B/L Tier
Browser
Customer #2
Browser
Customer #3

URL Handing

Can ASP.NET MVC Help?

Single Controller per Tenant http://employeedata.cloudapp.net/contoso (ContosoController)http://employeedata.cloudapp.net/fabrikam(FabrikamController)

Shared Controller per Tenant http://employeedata.cloudapp.net/contoso (EmployeeController)http://employeedata.cloudapp.net/fabrikam(EmployeeController)

Shared Controller per Tenant (with URL mask)http://hr.contoso.co.uk(http://employeedata.cloudapp.net/employees)http://hr.fabrikam.com(http://employeedata.cloudapp.net/employees)

http://hr.chase.co.uk
Browser
Customer #1
http://employeedata.cloudapp.net
Database
Web Tier
B/L Tier
Browser
Customer #2
Browser
Customer #3
http://hr.citigroup.com

http://hr.chase.co.uk -> CNAME (employeedata.cloudapp.net)
Browser
Customer #1
Database
Web Tier
B/L Tier
Browser
Customer #2
Browser
Customer #3
http://hr.citigroup.com -> CNAME (employeedata.cloudapp.net)

http://hr.chase.co.uk -> CNAME (employeedata.cloudapp.net)
Browser
Customer #1
Database
Web Tier
B/L Tier
Browser
Customer #2
Use custom routing in ASP.NET MVC
Browser
Customer #3
http://hr.citigroup.com -> CNAME (employeedata.cloudapp.net)

Demo: Multi-Tenant Routing with ASP.NET MVC
Tentative

Patterns for Moving to the Cloud
Using the Cloud for Communications

Jim’s organization needs to communicate with other organizations

“This has always been a very tricky and expensive process to get working”

“Does the cloud offer anything to help?”

How would Jim have done this before?

Telco provided WAN
Company 2
Company 1
Server
Client
FTP
Server
FTP
Client

Internet
Telco provided WAN
Company 2
Company 1
Server
Client
FTP
Server
FTP
Client

Internet
Telco provided WAN
Company 2
Company 1
DMZ
Server
Client
Extranet
Site
Browser

What does the cloud provide?

http://app.queue.core.windows.net/
Azure Queue
REST
Client

Company 1
Client
Azure Queue
REST
Company 2
Client

x
Company 1
Client
Azure Queue
REST
Company 2
Client

Company 1
Client
Master Key
Azure Queue
REST
Company 2
Client
Master Key

Company 1
Client
Azure Queue
REST
Web Role
Company 2
Client

Proxy?
Company 1
Firewall
Client
Azure Queue
REST
Web Role
Company 2
Client
Firewall

Company 1
Firewall
Client
Azure Queue
REST
Web Role
65.55.33.204
Company 2
Client
Firewall
192.168.14.100
NAT?

Company 1
Firewall
Client
Azure Queue
REST
Web Role
65.55.33.204
Company 2
Client
Firewall
192.168.14.100
OK, so I’ll do a HTTP poll every minute

Company 1
Firewall
Client
Azure Queue
REST
Web Role
65.55.33.204
Company 2
Client
Firewall
192.168.14.100
…and how about other protocols other than HTTP?

How does the .NET Service Bus help?

Company 1
sb://.../myqueue
Client
.NET
Service Bus
Company 2
Client
Firewall
Outbound bi-directional socket
Kept alive in background

Company 1
Firewall
sb://.../myqueue
Client
Outbound one-way socket
.NET
Service Bus
Company 2
Message routed
accordingly
Client
Firewall
Outbound bi-directional socket

Austin Integration with Siebel (on-premise)
Austin
Blob
Table
Queue
sb://.../myqueue
On-Premise DataCenter
.NET
Service Bus
Synchronization Message
Firewall
bi-directional socket
Siebel
Opp. Exchange
Service

Demo: Integration through the .NET Service Bus

High Level of Abstraction
Hardware
Server OS
Network Infrastructure
Web Server
Availability
Automated Service Management
Scalability
Instance & Partitions
Developer Experience
Familiar Developer Tools
Windows Azure Benefits

Resources
Azure Services Training Kit
Downloadable hands-on labs, demos, and presentations
http://www.azure.com
Blogs
http://blog.smarx.com – Steve Marx
http://blogs.msdn.com/clemensv - Clemens Vasters (.NET Services)
Azure Services Platform Forums
http://www.microsoft.com/azure/blog.mspx

(Transition to Architect Evangelist for wrap-up…)
Highlight customer wins or Partner experiences
Q&A
Collect surveys and Hand out tokens
Giveaways
TODO

From start to finish in two weeks
West Monroe Partners asked to develop an interactive, printable map for the 2009 Taste of Chicago’s two million visitors
Had two weeks to design and build externally facing Web functionality, ensure scalability for up to 50,000 hits per day, with no defined hosting solution in place
Taste of Chicago
“With Windows Azure and Live Services, we built a solution that uses the equivalent of 25 servers, and yet it required no up-front capital costs and minimal ongoing operational costs.”
Cory Chaplin, Technology Solutions Practice Lead, West Monroe Partners
[case study]

“Be This Close”
Country Music Festival 2009
Compelling Silverlight/DeepZoom experience leveraging Windows Azure as the storage mechanism
Less than 1 hour to get up and running on Azure
850 high resolution photos broken into x,000 tiles
Week a half to build Azure support
[play it online]
“Windows Azure was a breeze to use and didn't let us down.”
Ben Henderson, Firefly Logic

Customer Costs Reduced 60 Percent
Delivers enterprise line of business data to mobile workers anytime, anywhere, at minimal cost to the enterprise.
Aggregated LOB data, LOB access rules, and, optionally, even LOBs themselves are stored in the cloud in Microsoft SQL Data Services.
Cumulux
[case study]
“With software-plus-services, we can get our customers up and running on mPortal in two weeks versus two months—a 75 percent time-to-market improvement over on-premises deployment.”
RanjithRamakrishnan, Chief Technology Officer for Cumulux

What do I get?
MSDN Premium
Phone and Online Technical Support
Profiled on Microsoft and other web properties
How do I qualify?
Building software or software services
Privately held
In business for less than 3 years
Less than US $1 million in annual revenue
contact briangorbett
bgorbett@microsoft.com
425-538-0050

dave.bost@microsoft.com
http://davebost.com/blog
© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Real World Azure - Dev

by Clint Edmonson on Sep 30, 2009

Accessibility

Categories

Tags

Upload Details

Usage Rights

2 Embeds 24

Statistics

Real World Azure - Dev — Presentation Transcript

http://www.notsotrivial.net	20
http://www.slideshare.net	4