Windows Azure Storage & Sql Azure

Windows Azure StorageSQL Azure
Developing with Windows Azure storage & SQL Azure
Maarten Balliauw
http://blog.maartenballiauw.be
http://twitter.com/maartenballiauw
maarten@maartenballiauw.be

Whoam I?
Maarten Balliauw
Antwerp, Belgium
www.realdolmen.com
Focus on web
ASP.NET, ASP.NET MVC, PHP, Azure, VSTS, …
Special interest in interop
PHPExcel, PHPLinq, PHPMEF, Windows Azure SDK for PHP, ...

Agenda
Storage concepts
Windows Azure SDK for PHP
SQL Azure

Storage concepts
Where can I store my stuff?

Windows Azure Data Storage
Queue
Blob
Account
Tables
Drives

Azure Platform Data Storage Options
Blobs
Unstructured data storage
Tables
Semi-structured or tabular data storage
Queues
Buffered delivery data storage
Drives
Durable NTFS volumes that Windows Azure applications can use. See: http://microsoftpdc.com/Sessions/SVC14
SQL Azure
Relational data storage

PHP + Cloud Storage
Windows Azure Storage
PHP
Instance (web/worker)
On-Premise
VIP
Load Balancer
PHP App
SQL Azure
Windows Azure Platform

Windows Azure SDK for PHP
A PHP porgramming model for Windows Azure Storage

PHP with Windows Azure Storage
Windows Azure SDK for PHP at http://phpazure.codeplex.com
PHP programming model for Windows Azure Storage
Features
PHP classes for Blobs, Tables & Queues
Store PHP sessions in Table Storage
File system wrapper for Blob Storage

Blob
Container
Entities
Account
Table
http://<account>.blob.core.windows.net/<container>
Messages
Windows Azure Storage Concepts
http://<account>.table.core.windows.net/<table>
Queue
http://<account>.queue.core.windows.net/<queue>

Windows Azure Blobs
Unstructured data
Scale massively
At least 3 instances, 5 in optimal situation
Can be used as CDN
Can be mapped using a custom domain

Tools for connecting to blob storage
CloudBerryLab Explorerhttp://www.cloudberrylab.com
Azure Storage Explorerhttp://azurestorageexplorer.codeplex.com/
Onlinehttp://myazurestorage.com / ftp://ftp.cloudapp.net
Windows Azure tooling for Eclipse

Blobs Sample
$blobStorage= new Microsoft_WindowsAzure_Storage_Blob();
// Create
if (!$blobStorage->containerExists($containerName))
{
$blobStorage->createContainer($containerName);
$blobStorage->setContainerAcl($containerName,
Microsoft_WindowsAzure_Storage_Blob::ACL_PUBLIC);
}
// Store
$blob = $blobStorage->putBlob($containerName, $blobName,
$localFilename, $metadata);
/* @var $blob Microsoft_WindowsAzure_Storage_BlobInstance */

Blobs Sample Cont…
// Copy
$result = $blobStorage->copyBlob(
$containerName, $blobName, $containerName, $blob2Name);
// Retrieve
$tempStore= azure_getlocalresourcepath('tempstore');
$tempPath= $tempStore. 'apos; . $imageId;
$blobStorage->getBlob($containerName, $blobName, $tempPath);
// Delete
$result = $blobStorage->deleteBlob($containerName, $blobName);
$result = $blobStorage->deleteContainer($containerName);
http://phpazurecontrib.codeplex.com

Blob Stream Wrapper
$blobStorage= new Microsoft_WindowsAzure_Storage_Blob();
// Register:
$blobStorage->registerStreamWrapper(); // registers azure://
// or
$blobStorage->registerStreamWrapper('blob://'); // use blob://
// Use
$fp= fopen('azure://mycontainer/myfile.txt', 'r');
// ...
fclose($fp);

Windows Azure Drive (a.k.a. Xdrive)
Virtual NTFS volume that can be mounted
.vhd format
Use existing NTFS API’s
Easier migration
Stored on blob storage provides quick mount/unmount in other VM

Queue Workflow Concepts
Windows Azure Queue Provides
Guarantee delivery (two-step consumption)
Worker Dequeues Message and mark it as Invisible
Worker Deletes Message when finished processing it
If Worker role crashes, message becomes visible for another Worker to process
Doesn’t guarantee “only once” delivery
Doesn’t guarantee ordering
Best effort FIFO
Worker Role
Web Role
Input Queue (Work Items)
Worker Role
Azure Queue
Web Role
Worker Role
Web Role
Worker Role

Azure Queues
RemoveMessage
GetMessage (Timeout)
Worker Role
PutMessage
Queue
Msg 1
Msg 2
Msg 2
Msg 1
Web Role
Worker Role
Worker Role
Msg 3
Msg 4
Msg 2

Loosely Coupled Work with Queues
Worker-Queue Model
Load work in a queue
Many workers consume the queue
Input Queue (Work Items)
Azure Queue
Worker Role
Web Role
Worker Role
Web Role
Worker Role
Web Role
Worker Role

Queues
$queueClient= new Microsoft_WindowsAzure_Storage_Queue();
// Create
$result = $queueClient->createQueue('imageQueue');
// Delete
$queueClient->deleteQueue('imageQueue');
// Add message
$queueClient->putMessage('imageQueue', $message, $ttl);
// Retrieve Messages
$messages = $queueClient->getMessages('imageQueue', 10);
foreach($messages as $message) {
// Do work here...
$queueClient->deleteMessage('imageQueue', $message);
}

Windows Azure Data Storage – Tables (Terms Part 1)
Table
Contains a set of entities.
Entity (Row)
Basic data items stored in a table.
Property (Column)
Single value in an entity.
RowKey
Unique ID of the entity within a partition
Timestamp
Time it was created

Windows Azure Data Storage – Tables (Terms Part 2)
Partition
Entities in a table with the same partition key
PartitionKey
Segments entities in to partitions to automatically distribute the table’s entities over many storage nodes.
Sort Order
There is a single index provided, where all entities in a table are sorted by PartitionKey and then RowKey

Key Example – Blog Posts
Partition 1
Partition 2
Getting all of dunnry’s blog posts is fast
Single partition
Getting all posts after 2008-03-27 is slow
Traverse all partitions

Table Sample
$tableStorage= new Microsoft_WindowsAzure_Storage_Table(
'table.core.windows.net', 'myaccount', 'myauthkey');
// Create
$result = $tableStorage->createTable($tableName);
// List
$result = $tableStorage->listTables();
foreach($result as $table) {
echo 'Table name is: ' . $table->Name . " ";
}
// Delete
$tableStorage->deleteTable($tableName);

Tables with Entities
// Structured entity
class ImageEntityextends
Microsoft_WindowsAzure_Storage_TableEntity
{
/**
* @azure filename
*/
public $filename;
/**
* @azure size Edm.Int64
*/
public $size;
}
// Unstructured entity
// Microsoft_WindowsAzure_Storage_DynamicTableEntity

Tables with Entities Cont…
// Insert
$image = new ImageEntity($partitionKey, $rowKey);
$image->filename = $_FILES['imageUpload']['name'];
$image->size = $_FILES['imageUpload']['size'];
$image = $tableStorageClient->insertEntity($tableName, $image);
// Retrieve
$image = $tableStorage->retrieveEntityById($tableName,
$partitionKey, $rowKey, 'ImageEntity');
// Update
$image->filename = 'newname.jpg';
$result = $tableStorage->updateEntity($tableName, $image);
// Delete
$result = $tableStorage->deleteEntity($tableName, $image);

Table Queries
// Filter condition
$select = "filesizegt 1024 and PartitionKeyeq '$partitionKey'";
// Or fluent interface
$select = $tableStorage->select()->from($tableName)
->where('filesizegt 1024')
->andWhere('PartitionKeyeq ?', $partitionKey);
// Run query
$images = $tableStorage->storageClient->retrieveEntities(
'testtable', $select, 'ImageEntity'
);
foreach($images as $image) {
echo 'Name: ' . $image->filename . " ";
}

Batching Operations
// Start batch
$batch = $tableStorage->startBatch();
// Insert multiple
$images = generateEntities();
foreach($images as $image) {
$tableStorage->insertEntity($tableName, $image);
}
// Commit
$batch->commit();

Table session handler
$sessionHandler
= new Microsoft_WindowsAzure_SessionHandler($tableStorage);
$sessionHandler->register();
session_start();
if (!isset($_SESSION['start'])) {
$_SESSION['start'] = time();
}

SQL Azure
A relational database for the cloud

SQL Azure and Windows Azure Table Comparison
SQL Azure Tables
Windows Azure Tables
Fully structured
Strongly typed
Relational(RDBMS)
Highly scalable
Semi-structured
Loosely typed
Non-Relational(Not RDBMS)
Massively scalable

MySQL: Simple Configuration
VIP
Load Balancer
Web Role
MySQL
Worker Role

MySQL in a Windows Azure Application
Running MySQL in a worker role
Copy MySQL to the worker role sub-directory
Copy to read-write local storage
Configure MySQL to listen on the right port
Monitor MySQL health
Consuming MySQL
Discover IP address and port
Normal access from then on
Handle topology changes

Simple Configuration
VIP
Load Balancer
MySQL

Replication
VIP
Load Balancer
M
S
S
MySQL
MySQL
MySQL

Windows Azure Drive with Hot Spare
VIP
Load Balancer
MySQL
MySQL

SQL Azure Features
Supported
Not supported
Tables, Indexes, Views
Stored Procedures
Triggers
Constraints
Table Variables
Temp Tables (#Name)
Physical Server Access
Catalog DDL
Common Language Runtime
Service Broker
Reporting Services
Analysis Services
Distributed Transactions and Queries

SQL AzureDeployment
Web Portal
(API)
DB Script
SQL Azure
TDS

SQL AzureAccessing databases
Web Portal
(API)
Your App
SQL Azure
TDS
Change Connection String

Database Replicas
Single Database
Multiple Replicas
Replica 1
Single Primary
Replica 2
DB
Replica 3

SQL AzureDatabase Monitoring & Recovery
Web Portal
(API)
!
Your App
SQL Azure
TDS

SQL Azure Server Creation

SQL Azure Firewall Maintenance
Simple rules
Easy one-screen portal maintenance

SQL Azure Database Connection String
An administrative user is created with the server
User has system administrator permissions like “sa”
Server=tcp:itte80vcfq.database.windows.net; Database=FabrikamAzureDB;User ID=SaPaulM;Password=myPassword;Trusted_Connection=False;Encrypt=True;

Migrating schema and data
SQL Azure Migration Wizardhttp://sqlazuremw.codeplex.com
SQL Azure Data Sync Tool for SQL Serverhttp://www.microsoft.com/windowsazure/developers/sqlazure/datasync/
SQL Server Management Studio 2008 R2 November Community Technology Preview

PHP with SQL Azure
SQL Server Driver for PHP @ http://sqlsrvphp.codeplex.com/
Supports PHP access to SQL Azure
Features
Choose between SQL Server and SQL Azure by changing connection string
Use from on-premises or in Windows Azure

Resources
Learn more!

Resources
Microsoft Windows Azure Interop
http://www.microsoft.com/windowsazure/interop/
Interop Bridges
http://www.interoperabilitybridges.com/

More resources
PHP
http://www.windowsazure4e.org
http://phpazure.codeplex.com/
http://phpazurecontrib.codeplex.com/
MySQL
Windows Azure MySQL PHP Solution Accelerator
http://code.msdn.microsoft.com/winazuremysqlphp

Questions?
More information?
Contact me
http://phpazure.codeplex.com
maarten@maartenballiauw.be
Thankyouforwatching!

http://blog.maartenballiauw.be	178
http://www.slideshare.net	50
http://www.freelancephp.co.uk	35
http://www.joshholmes.com	32
http://www.blog.maartenballiauw.be	15
http://www.azurehub.com	5
http://cartrackr.codeplex.com	5
http://azurehub.com	4
http://www.nofluffjuststuff.com	4
http://www.nfjsone.com	2
http://therichwebexperience.com	2
http://www.therichwebexperience.com	1
http://translate.googleusercontent.com	1
http://microsoft.realdolmenblogs.com	1
http://uberconf.com	1
http://webcache.googleusercontent.com	1
http://www.jumpincamp.com	1
http://windowsazurehub.com	1
http://www.windowsazurehub.com	1
http://projectautomationexperience.com	1

Windows Azure Storage & Sql Azure

by Maarten Balliauw on Apr 07, 2010

Accessibility

Categories

Tags

Upload Details

Usage Rights

20 Embeds 341

Statistics

Windows Azure Storage & Sql Azure — Presentation Transcript