Scaling Big While Sleeping Well

Scaling Big while Sleeping Well
Josh Holmes
@joshholmes
josh.holmes@microsoft.com
www.joshholmes.com

Agenda
Testing the Waters
What is cloud computing?
What are the advantages of cloud computing?
How’s Azure fit in?
Diving Deep
Digging into PHP/Ruby on Azure
Leveraging FastCGI
Leveraging Azure Storage
Leveraging SQL Azure

We are all excited about the cloud

Cloud-Addressable Challenges
1
1
5
Maintaining security while increasing access and transparency—within and outside the organization
Infrastructure costs are fixed and ongoing, and distract from the mission of reducing business process friction
2
6
Leveraging past investments to provide future value
Security, access, and transparency across the value chain: suppliers, partners, etc.
3
Many data centers at limit—real estate, capacity, cooling and power
7
Lack of a common platform
4
Matching capacity to demand

In House or Hosted Servers
Allocated IT-capacities
Load Forecast
“Under-supply“ of capacities
“Waste“ of capacities
Fixed cost of IT-capacities
IT CAPACITY
Barrier for
innovations
ActualLoad
TIME

Cloud Computing
Load Forecast
Allocated IT capacities
No “under-supply“
IT CAPACITY
Reduction of “over-supply“
Possible reduction of IT-capacities in case of reduced load
Reduction of initial investments
ActualLoad
Time

Types of Clouds
Platform
(as a Service)
Private
(On-Premise)
Infrastructure
(as a Service)
You manage
Applications
Applications
Applications
You manage
Runtimes
Runtimes
Runtimes
Security & Integration
Managed by vendor
Databases
Databases
Databases
You manage
Servers
Servers
Servers
Managed by vendor
Virtualization
Virtualization
Virtualization
Server HW
Server HW
Server HW
Storage
Storage
Storage
Networking
Networking
Networking

The Microsoft Cloud
~100 Globally Distributed Data Centers
Quincy, WA
Chicago, IL
San Antonio, TX
Dublin, Ireland
Generation 4 DCs

Categories of Services
Application Services
Software Services
Platform Services
The Microsoft Cloud
Infrastructure Services

The trick is knowing what your systems need,
and how the cloud can help.

Not everything has to or can live in the cloud

Only move to the cloud that which can benefit

The core strategy is ‘hybrid’

Take an À la carteapproach

We call this Software + Services

An Example…

“Packaged”
Application
Big Pharmaceutical Example
Hosted
“Packaged”
“Packaged”
using cloud
“Software as a Service”
Buy
ERP
“Too costly to run this myself, but I’ve made too many customizations”
CRM
Email
Build vs. Buy
“Home Built”
Application
Hosted
“Home Built”
“Home Built”
using cloud
“Platform as a Service”
HR System
Molecule Research
Build
Clinical Trial
Hoster
Vendor
On Premise
Cloud

“Packaged”
Application
Hosted
“Packaged”
“Packaged”
using cloud
Buy
ERP
CRM
“CRM and Email are commodity services – They have no customizations, and it’s cheaper for someone else to run these”
Email
Build vs. Buy
“Home Built”
Application
Hosted
“Home Built”
“Home Built”
using cloud
HR System
Molecule Research
Build
Clinical Trial
Hoster
Vendor
On Premise
Cloud

“Packaged”
Application
Hosted
“Packaged”
“Packaged”
using cloud
Buy
ERP
CRM
Email
Build vs. Buy
“Home Built”
Application
Hosted
“Home Built”
“Home Built”
using cloud
“I can’t afford to maintain this old HR application written in VB4 – it’s driving me mad!”
HR System
“…but due to regulatory issues, I cannot store my HR data off-premise”
Molecule Research
Build
Clinical Trial
Hoster
Vendor
On Premise
Cloud

“Packaged”
Application
Hosted
“Packaged”
“Packaged”
using cloud
Buy
ERP
CRM
Email
HR System
Build vs. Buy
“Home Built”
Application
Hosted
“Home Built”
“Home Built”
using cloud
“I wish I had access to cheaper compute and storage when I need it”
Molecule Research
Build
Clinical Trial
Hoster
Vendor
On Premise
Cloud

“Packaged”
Application
Hosted
“Packaged”
“Packaged”
using cloud
Buy
ERP
CRM
Email
HR System
Build vs. Buy
“Home Built”
Application
Hosted
“Home Built”
“Home Built”
using cloud
Molecule Research
Build
“THIS is where I want to spend my IT resources – I’m going to double down on this application!”
Clinical Trial
Hoster
Vendor
On Premise
Cloud

Where the Cloud is Compelling

Only 2 reasons to use the cloud

Windows Azure VMs
Small
Medium
Large
X Large
$0.12
$0.24
$0.48
$0.96
Per service hour
Per service hour
Per service hour
Per service hour
1 x 1.6Ghz
2 x 1.6Ghz
4 x 1.6Ghz
8 x 1.6Ghz
(moderate IO)
(high IO)
(high IO)
(high IO)
1.75 GB memory
3.5 GB memory
7.0 GB memory
14 GB memory

Windows Azure, In One Picture
Business Portal
Developer Portal
Service Management Service
REST
User Code
…
…
Runtime API
Storage Cluster
VS Tools
Compute Cluster
…
WA SDK
VM Setup
REST
MSFT Datacenters
Desktop
Cloud VM

Determine an ROI
Consider:
Current hosting costs
Current staff costs
Cooling/power/space
Migration costs
Licensing
AzureROI.CloudApp.net

ZENDFRAMEWORK

Digging into Azure with PHP/Ruby

Windows Azure, In One Picture
Business Portal
Developer Portal
Service Management Service
REST
User Code
…
…
Runtime API
Storage Cluster
VS Tools
Compute Cluster
…
WA SDK
VM Setup
REST
MSFT Datacenters
Desktop
Cloud VM

Windows Azure Roles
WorkerRole
Internal Facing
TCP/HTTP Endpoint
Long running processes
Think Service or Deamon
WebRole
External Facing
HTTP/HTTPS Endpoint
Short lived calls
Think Web Server

Running PHP in Windows Azure
How to Do It
Host in Web role (like .NET)
Supply PHP runtime
Point to runtime via FastCGI configuration in
Web.config
Web.roleConfig
PHP
Web Role
Instance 1
VIP
Load Balancer
PHP
Web Role
Instance 2

Windows Azure 4 Eclipse
Does a lot of the heavy lifting for you
Creates the Web.config, Web.roleConfig, PHP implementation and debugs in the dev fabric
http://windowsazure4e.org

Running EXEs in the Worker Process
Start with a Worker Role Process to
Copy the exes to the worker role’s app directory
Execute the process
Monitor the health of the process
Other auxiliary tasks…

Running Ruby in the Worker Process
http://code.msdn.microsoft.com/railsonazure
Download and extract the solution
Copy the Ruby bin and lib folders to the Ruby folder in the RR project
Copy your rails application to the RailsApp folder in the RR project
Open the solution in Visual Studio
Run in the Dev Fabric
Navigate to http://127.0.0.1:5100

Data Storage

Storage options
Windows Azure Data
Sql Azure

Windows Azure Data Storage
Queue
Blob
Account
Tables
Drives

Azure Platform Data Storage Options
Blobs
Unstructured data storage
Tables
Semi-structured or tabular data storage
Queues
Buffered delivery data storage
Drives
Durable NTFS volumes that Windows Azure applications can use. See: http://microsoftpdc.com/Sessions/SVC14
SQL Azure
Relational data storage

Admin Windows Azure Data Storage

PHP with Windows Azure Storage
Windows Azure SDK for PHP @ http://phpazure.codeplex.com
PHP programming model for Windows Azure Storage
Features
PHP classes for Blobs, Tables & Queues
Store PHP sessions in Table Storage

Windows Azure Data Storage - Blobs
Unstructured data storage
Partitioned by container
Unlimited containers

Blobs Sample
$blobStorage= new Microsoft_WindowsAzure_Storage_Blob();
// Create
if (!$blobStorage->containerExists($containerName))
{
$blobStorage->createContainer($containerName);
$blobStorage->setContainerAcl($containerName,
Microsoft_WindowsAzure_Storage_Blob::ACL_PUBLIC);
}
// Store
$blob = $blobStorage->putBlob($containerName, $blobName,
$localFilename, $metadata);
/* @var $blob Microsoft_WindowsAzure_Storage_BlobInstance */

Blobs Sample Cont…
// Copy
$result = $blobStorage->copyBlob(
$containerName, $blobName, $containerName, $blob2Name);
// Retrieve
$tempStore= azure_getlocalresourcepath('tempstore');
$tempPath= $tempStore. 'apos; . $imageId;
$blobStorage->getBlob($containerName, $blobName, $tempPath);
// Delete
$result = $blobStorage->deleteBlob($containerName, $blobName);
$result = $blobStorage->deleteContainer($containerName);

Blob Stream Wrapper
$blobStorage= new Microsoft_WindowsAzure_Storage_Blob();
// Register:
$blobStorage->registerStreamWrapper(); // registers azure://
// or
$blobStorage->registerStreamWrapper('blob://'); // use blob://
// Use
$fp= fopen('azure://mycontainer/myfile.txt', 'r');
// ...
fclose($fp);

Storage: XDrive
NTFS drive in the cloud: X:
Fixed size between 16MB and 1TB
Max 8 drives on your VM
Implemented as a page blob
Single instance write
Multiple instance read

Queue Workflow Concepts
Windows Azure Queue Provides
Guarantee delivery (two-step consumption)
Worker Dequeues Message and mark it as Invisible
Worker Deletes Message when finished processing it
If Worker role crashes, message becomes visible for another Worker to process
Doesn’t guarantee “only once” delivery
Doesn’t guarantee ordering
Best effort FIFO
Worker Role
Web Role
Input Queue (Work Items)
Worker Role
Azure Queue
Web Role
Worker Role
Web Role
Worker Role

Azure Queues
RemoveMessage
GetMessage (Timeout)
Worker Role
PutMessage
Queue
Msg 1
Msg 2
Msg 2
Msg 1
Web Role
Worker Role
Worker Role
Msg 3
Msg 4
Msg 2

Loosely Coupled Work with Queues
Worker-Queue Model
Load work in a queue
Many workers consume the queue
Input Queue (Work Items)
Azure Queue
Worker Role
Web Role
Worker Role
Web Role
Worker Role
Web Role
Worker Role

Queues
$queueClient= new Microsoft_WindowsAzure_Storage_Queue();
// Create
$result = $queueClient->createQueue('imageQueue');
// Delete
$queueClient->deleteQueue('imageQueue');
// Add message
$queueClient->putMessage('imageQueue', $message, $ttl);
// Retrieve Messages
$messages = $queueClient->getMessages('imageQueue', 10);
foreach($messages as $message) {
// Do work here...
$queueClient->deleteMessage('imageQueue', $message);
}

Windows Azure Data Storage - Tables
Semi-Structured data
Tables contain entities
Entities contain properties
May be partitioned across thousands of servers.
Support ACID transactions over single entities
Queries over entire table
.NET and REST interfaces

Windows Azure Data Storage – Tables (Terms Part 1)
Table
Contains a set of entities.
Entity (Row)
Basic data items stored in a table.
Property (Column)
Single value in an entity.
RowKey
Unique ID of the entity within a partition
Timestamp
Time it was created

Windows Azure Data Storage – Tables (Terms Part 2)
Partition
Entities in a table with the same partition key
PartitionKey
Segments entities in to partitions to automatically distribute the table’s entities over many storage nodes.
Sort Order
There is a single index provided for the CTP, where all entities in a table are sorted by PartitionKey and then RowKey

Key Example – Blog Posts
Partition 1
Partition 2
Getting all of dunnry’s blog posts is fast
Single partition
Getting all posts after 2008-03-27 is slow
Traverse all partitions

Table Sample
$tableStorage= new Microsoft_WindowsAzure_Storage_Table(
'table.core.windows.net', 'myaccount', 'myauthkey');
// Create
$result = $tableStorage->createTable($tableName);
// List
$result = $tableStorage->listTables();
foreach($result as $table) {
echo 'Table name is: ' . $table->Name . " ";
}
// Delete
$tableStorage->deleteTable($tableName);

Tables with Entities
// Structured entity
class ImageEntityextends
Microsoft_WindowsAzure_Storage_TableEntity
{
/**
* @azure filename
*/
public $filename;
/**
* @azure size Edm.Int64
*/
public $size;
}
// Unstructured entity
// Microsoft_WindowsAzure_Storage_DynamicTableEntity

Tables with Entities Cont…
// Insert
$image = new ImageEntity($partitionKey, $rowKey);
$image->filename = $_FILES['imageUpload']['name'];
$image->size = $_FILES['imageUpload']['size'];
$image = $tableStorageClient->insertEntity($tableName, $image);
// Retrieve
$image = $tableStorage->retrieveEntityById($tableName,
$partitionKey, $rowKey, 'ImageEntity');
// Update
$image->filename = 'newname.jpg';
$result = $tableStorage->updateEntity($tableName, $image);
// Delete
$result = $tableStorage->deleteEntity($tableName, $image);

Table Queries
// Filter condition
$select = "filesizegt 1024 and PartitionKeyeq '$partitionKey'";
// Or fluent interface
$select = $tableStorage->select()->from($tableName)
->where('filesizegt 1024')
->andWhere('PartitionKeyeq ?', $partitionKey);
// Run query
$images = $tableStorage->storageClient->retrieveEntities(
'testtable', $select, 'ImageEntity'
);
foreach($images as $image) {
echo 'Name: ' . $image->filename . " ";
}

Batching Operations
// Start batch
$batch = $tableStorage->startBatch();
// Insert multiple
$images = generateEntities();
foreach($images as $image) {
$tableStorage->insertEntity($tableName, $image);
}
// Commit
$batch->commit();

Table session handler
$sessionHandler
= new Microsoft_WindowsAzure_SessionHandler($tableStorage);
$sessionHandler->register();
session_start();
if (!isset($_SESSION['start'])) {
$_SESSION['start'] = time();
}

SQL Azure and Windows Azure Table Comparison
Windows Azure Tables
SQL Azure Tables
Semi-structured
Loosely typed
Non-Relational (Not RDMS)
Massively scalable
Fully structured
Strongly typed
Relational (RDMS)
Highly scalable

MySQL: Simple Configuration
VIP
Load Balancer
Web Role
MySQL
Worker Role

MySQL in a Windows Azure Application
Running MySQL in a worker role
Copy MySQL to the worker role sub-directory
Copy to read-write local storage
Configure MySQL to listen on the right port
Monitor MySQL health
Consuming MySQL
Discover IP address and port
Normal access from then on
Handle topology changes

Simple Configuration
VIP
Load Balancer
MySQL

Replication
VIP
Load Balancer
M
S
S
MySQL
MySQL
MySQL

Windows Azure Drive with Hot Spare
VIP
Load Balancer
MySQL
MySQL

SQL Azure

SQL Azure Features
Supported
Tables, Indexes, Views
Stored Procedures
Triggers
Constraints
Table Variables
Temp Tables (#Name)
Not Supported
Physical Server Access
Catalog DDL
Common Language Runtime
Service Broker
Reporting Services
Analysis Services
Distributed Transactions and Queries

SQL AzureDeployment
Web Portal
(API)
DB Script
SQL Azure
TDS

SQL AzureAccessing databases
Web Portal
(API)
Your App
SQL Azure
TDS
Change Connection String

Database Replicas
Single Database
Multiple Replicas
Replica 1
Single Primary
Replica 2
DB
Replica 3

SQL AzureDatabase Monitoring & Recovery
Web Portal
(API)
!
Your App
SQL Azure
TDS

SQL Azure Server Creation

SQL Azure Firewall Maintenance
Simple rules
Easy one-screen portal maintenance

SQL Azure Database Connection String
An administrative user is created with the server
User has system administrator permissions likesa”
Server=tcp:itte80vcfq.database.windows.net; Database=FabrikamAzureDB;User ID=SaPaulM;Password=myPassword;Trusted_Connection=False;Encrypt=True;

Database Migrations
Scripts
Transfer Schema
BCP
Transfer Data
SSIS (SQL Server Integration Service)
Transfer Schema and Data

Database Migrations (Cont.)
The SQL Azure Migration Wizard helps you migrate your local SQL Server 2005 / 2008 databases into SQL Azure. The wizard walks you through the selection of your SQL objects, creates SQL scripts suitable for SQL Azure, and allows you to migrate your data.”
http://sqlazuremw.codeplex.com/

Database Management using SQL Management Studio

PHP with SQL Azure
SQL Server Driver for PHP @ http://sqlsrvphp.codeplex.com/
Supports PHP access to SQL Azure
Features
Choose between SQL Server and SQL Azure by changing connection string
Use from on-premises or in Windows Azure

More resources
Microsoft Windows Azure Interop
http://www.microsoft.com/windowsazure/interop/
Interop Bridges
http://www.interoperabilitybridges.com/

More resources
PHP
http://www.windowsazure4e.org
http://phpazure.codeplex.com/
MySQL
Windows Azure MySQL PHP Solution Accelerator
http://code.msdn.microsoft.com/winazuremysqlphp

More resources
Python
Sriram Krishnan
http://www.sriramkrishnan.com/blog/2008/11/python-wrapper-for-windows-azure.html
Ruby
Simon Davies
http://blogs.msdn.com/simondavies
http://code.msdn.microsoft.com/railsonazure
Johnny Halife
http://github.com/johnnyhalife/waz-storage
http://waz-storage.heroku.com/rdoc/index.html

And of course
Josh Holmes
http://www.joshholmes.com

Scaling Big while Sleeping Well
Josh Holmes
@joshholmes
josh.holmes@microsoft.com
www.joshholmes.com

http://blog.maartenballiauw.be	250
http://www.joshholmes.com	68
http://www.freelancephp.co.uk	48
http://www.blog.maartenballiauw.be	17
http://cartrackr.codeplex.com	13
http://www.nofluffjuststuff.com	7
http://www.slideshare.net	5
http://www.springone2gx.com	2
http://projectautomationexperience.com	2
http://uberconf.com	2
http://jumpincamp.com	1
http://www.therichwebexperience.com	1
http://therichwebexperience.com	1
http://www.nfjsone.com	1
http://static.slidesharecdn.com	1
http://translate.googleusercontent.com	1
http://therichwebexperience.com	1

Scaling Big While Sleeping Well

by Josh Holmes

Accessibility

Categories

Upload Details

Usage Rights

17 Embeds 421

Statistics