Open a window, see the clouds - php|tek 2011

Open a Window, see the clouds Rafael Dohms photo credit: Denis GrzeticWednesday, May 25, 2011

Rafael Dohms photo credit: Eli White PHP Evangelist and ZCE in Brazil and a very active member of the PHP Community. He helped found two PHP User Groups over the years and currently shares the lead of PHPSP. Developer, gamer and lover of code he also hosts Brazil’s ﬁrst PHP Podcast: PHPSPCast. Currently he works for MIH SWAT Team, a group of experts that provides technical knowledge to the MIH group as well as working on R&D in search of the new and exciting niches of the web. His role as a Senior PHP Developer is to code, train and aid other companies and to have fun doing so.Wednesday, May 25, 2011

PEEKING OUT THE WINDOW • What is the Cloud? • Why choose the Cloud? • Let’s take a look at Windows Azure • How does that affect my code?Wednesday, May 25, 2011

WHAT IS THE CLOUD? not just another buzzword bingo wordWednesday, May 25, 2011

REGULAR HOSTING • Shared account, VPS or Local Machine • One machine, one place • Pay by monthWednesday, May 25, 2011

Self REGULAR HOSTING • Shared account, VPS or Local Machine • One machine, one place • Pay by monthWednesday, May 25, 2011

CLOUD COMPUTING • Less “physical attachment” • One or multiple machines or “instances” • Geologically spread • Pay per hour/usage/data • “abstraction” of resources • 3 Flavors: IaaS, PaaS, SaaSWednesday, May 25, 2011

Data Application Software Operating System Hardware/NetworkWednesday, May 25, 2011

Storing Data Sharing Deploying Application Developing MySQL Software Apache Configuring Operating System Upgrading Cooling Hardware/Network CablingWednesday, May 25, 2011

IaaS a Service” “Infrastructure as Data Application Software Operating System Hardware/NetworkWednesday, May 25, 2011

IaaS a Service” “Infrastructure as Data Application Software Operating System you them Hardware/NetworkWednesday, May 25, 2011

PaaS “Platform as a Service” Data Application Software Operating System Hardware/NetworkWednesday, May 25, 2011

PaaS “Platform as a Service” Data Application you them Software Operating System Hardware/NetworkWednesday, May 25, 2011

SaaS “Software as a Service” Data Application Software Operating System Hardware/NetworkWednesday, May 25, 2011

SaaS “Software as a Service” Data you them Application Software Operating System Hardware/NetworkWednesday, May 25, 2011

X WHY CHOOSE THE CLOUD? What are the advantages of using the cloud?Wednesday, May 25, 2011

trafﬁc time THE UTILITY MODELWednesday, May 25, 2011

trafﬁc peak time THE UTILITY MODELWednesday, May 25, 2011

IaaS Paas SaaS costs server managment. software management product deployWednesday, May 25, 2011

AVAILABILITYWednesday, May 25, 2011

SCALABILITY Stateless Compute + Durable StorageWednesday, May 25, 2011

LET’S LOOK INSIDEWednesday, May 25, 2011

Windows Azure Overview Fabric Compute StorageWednesday, May 25, 2011

Fabric Middleware, used for developing, deploying and managing your applications AppFabric developerWednesday, May 25, 2011

Fabric Compute StorageWednesday, May 25, 2011

Compute Web Role Worker Role VM Role Windows Server Web application Background 2008 instance that running on top of processing can be loaded on IIS demandWednesday, May 25, 2011

Fabric Compute StorageWednesday, May 25, 2011

Cached version of CDN any resource in storage with a URI Storage Data Storage Table Storage Blob Storage SQL Azure Queue Text and binary Compatible with Messaging between Structured Storage data SQL Server Web and WorkerWednesday, May 25, 2011

UP & RUNNING for Development and Deployment • Requisites: • IIS7 Tools • Azure SDK (install DevAppFabric, the azure emulator) • Command Line Tools • Command line tools for PHPWednesday, May 25, 2011

BASIC TOOLSET • Command Line tools for PHP • Packages applicationand runs in emulator, with simulated compute and storage. • Azure Tools for Eclipse • Makes most processes a click-through process and gives you a nice IDEWednesday, May 25, 2011

Developer Environment Azure Emulator Code (Dev fabric) Packaging tools (command line or eclipse) Package + Service Conﬁguration Azure Window Azure (AppFabric) SQLAzure StorageWednesday, May 25, 2011

Developer Environment Azure Emulator Code (Dev fabric) PHP Packaging tools (command line or eclipse) Package + Service Conﬁguration Azure Window Azure (AppFabric) SQLAzure StorageWednesday, May 25, 2011

Developer Environment Azure Emulator Code (Dev fabric) php package.php PHP --project="twitter-azure" Packaging tools --target="c:azure-build" (command line or eclipse) --source="C:twitter-azure" Package + Service --defaultDoc="public/index.php" Conﬁguration --phpRuntime="C:Program Files (x86)PHPv5.3" --cleanRebuild --runDevFabric Azure Window Azure (AppFabric) SQLAzure StorageWednesday, May 25, 2011

Developer Environment Azure Emulator Code (Dev fabric) PHP Packaging tools (command line or eclipse) Package + Service Conﬁguration Azure Window Azure (AppFabric) SQLAzure StorageWednesday, May 25, 2011

THE GOOD • REST APIs • Storage • Diagnostics • Relational DB: SQL Azure • Role ArchitectureWednesday, May 25, 2011

THE BAD • Windows-only Management • No Azure Emulator for non-Windows OS • No Packaging Command Line tools for non-Windows OSWednesday, May 25, 2011

HOW DOES THAT AFFECT CODE? What tools can we use and how should we design our appsWednesday, May 25, 2011

WHAT DO I WORRY ABOUT?Wednesday, May 25, 2011

WHAT DO I WORRY ABOUT? CodeWednesday, May 25, 2011

WHAT DO I WORRY ABOUT? Code PHP on IIS/WindowsWednesday, May 25, 2011

WHAT DO I WORRY ABOUT? Architecture Code PHP on IIS/WindowsWednesday, May 25, 2011

WHAT DO I WORRY ABOUT? Scaling Architecture Code PHP on IIS/WindowsWednesday, May 25, 2011

WHAT DO I WORRY ABOUT? Scaling No Local Storage Architecture Code PHP on IIS/WindowsWednesday, May 25, 2011

WHAT DO I WORRY ABOUT? Scaling No Local Storage Session sharing Architecture Code PHP on IIS/WindowsWednesday, May 25, 2011

WHAT DO I WORRY ABOUT? Scaling No Local Storage Session sharing Worker Roles Architecture Code PHP on IIS/WindowsWednesday, May 25, 2011

WHAT DO I WORRY ABOUT? Scaling No Local Storage Session sharing Worker Roles Queues Architecture Code PHP on IIS/WindowsWednesday, May 25, 2011

WHAT DO I WORRY ABOUT? Storage Scaling No Local Storage Session sharing Worker Roles Queues Architecture Code PHP on IIS/WindowsWednesday, May 25, 2011

WHAT DO I WORRY ABOUT? What kind? Storage Scaling No Local Storage Session sharing Worker Roles Queues Architecture Code PHP on IIS/WindowsWednesday, May 25, 2011

WHAT DO I WORRY ABOUT? Table / Blob What kind? Storage Scaling No Local Storage Session sharing Worker Roles Queues Architecture Code PHP on IIS/WindowsWednesday, May 25, 2011

WHAT DO I WORRY ABOUT? Table / Blob Framework or PHP SDK What kind? Storage Scaling No Local Storage Session sharing Worker Roles Queues Architecture Code PHP on IIS/WindowsWednesday, May 25, 2011

WHAT DO I WORRY ABOUT? Table / Blob Framework or PHP SDK What kind? Relational Database Storage Scaling No Local Storage Session sharing Worker Roles Queues Architecture Code PHP on IIS/WindowsWednesday, May 25, 2011

WHAT DO I WORRY ABOUT? Table / Blob Framework or PHP SDK What kind? Relational Migrate to SQL Azure Database Storage Scaling No Local Storage Session sharing Worker Roles Queues Architecture Code PHP on IIS/WindowsWednesday, May 25, 2011

AZURE-READY FRAMEWORKSWednesday, May 25, 2011

WHAT MAKES IT COMPATIBLE? Code Does it run on PHP on Windows? Tools Does it have API Handlers? Database Does it offer MS SQL Compatibility?Wednesday, May 25, 2011

Tools • Blobs, Tables and Queues (CRUD operations) • Helper Classes for HTTP transport, AuthN/AuthZ, REST and Error Management • Manageability, Instrumentation and Logging support Database • Not tested, but should work well.Wednesday, May 25, 2011

Database • MS-SQL Drivers* are compatible with SQLAzure * Using pdo_sql_server, possibly pdo_dblib Powered by Doctrine:Wednesday, May 25, 2011

• PHP code runs normally, in Azure so any framework will work. • You will need other tools to communicate with resources like: DB, Queue, etc... • These have been tested!Wednesday, May 25, 2011

AZURE PHP SDK • Services: • Blob Storage • Table Storage • Queue Storage • Diagnostic Tools • Compatible with PHP 5+Wednesday, May 25, 2011

GOING OUT THE WINDOW Sample migration to the cloud • Sample Application: “Twitter RT Calculator” • Objective: Analyse your latest tweets that were ReTweeted, and calculate stats based on locations and words. • Show how to migrate: • Database: MySQL > SQLAzure • Move processing into a worker role using the QueueWednesday, May 25, 2011

Twitter OAuth Wait for it...Wednesday, May 25, 2011

Twitter OAuth Wait for it... MySQLWednesday, May 25, 2011

Twitter OAuth Wait for it... MySQL ResultsWednesday, May 25, 2011

Twitter OAuth Don’t call me, i’ll call youWednesday, May 25, 2011

Twitter OAuth Queue Don’t call me, i’ll call youWednesday, May 25, 2011

Twitter OAuth Queue Don’t call me, i’ll call you WorkerWednesday, May 25, 2011

Twitter OAuth Queue Don’t call me, i’ll call you Worker SQLAzureWednesday, May 25, 2011

Twitter OAuth Queue Don’t call me, i’ll call you Worker Results SQLAzureWednesday, May 25, 2011

Twitter OAuth Queue Don’t call me, i’ll call you Worker Worker Worker Worker Worker Worker Worker Worker Worker Worker Worker Results SQLAzureWednesday, May 25, 2011

USING SQLAZURE PDO MSSQL Driver doctrine.dbal.connection_options: driver: pdo_sqlsrv dbname: twitter-sample-app host: pl69qjwy8k.database.windows.net port: 1433 user: rdohmsDemo@pl69qjwy8k password: *password*Wednesday, May 25, 2011

LINE THEM UP IN THE QUEUE //Add user to our Queue $qItem = new stdClass(); $qItem->twitter_handle = $twitterInfo->screen_name; $qManager = new AzureQueue($this->getApp()->getConfig(azure)); $qManager->addToQueue($qItem);Wednesday, May 25, 2011

LINE THEM UP IN THE QUEUE //Add user to our Queue $qItem = new stdClass(); $qItem->twitter_handle = $twitterInfo->screen_name; $qManager = new AzureQueue($this->getApp()->getConfig(azure)); $qManager->addToQueue($qItem); $this->client = new Zend_Service_WindowsAzure_Storage_Queue( $qConfig[host], $qConfig[accountName], $qConfig[accountKey] ); $this->queue = $this->getQueueInstance($queueName); __contruct()Wednesday, May 25, 2011

LINE THEM UP IN THE QUEUE //Add user to our Queue $qItem = new stdClass(); $qItem->twitter_handle = $twitterInfo->screen_name; $qManager = new AzureQueue($this->getApp()->getConfig(azure)); $qManager->addToQueue($qItem); $this->client = new Zend_Service_WindowsAzure_Storage_Queue( $qConfig[host], $qConfig[accountName], $qConfig[accountKey] ); $this->queue = $this->getQueueInstance($queueName); __contruct() public function addToQueue($item) { $this->client->putMessage($this->queue->name, serialize($item)); }Wednesday, May 25, 2011

while (true){ try{ $this->logAction("Checking for messages..."); FIRST COME, //Read Queue $qMessage = $qManager->getMessage(); //If no message, sleep for 3 seconds and try again FIRST SERVED if ($qMessage === null){ $this->logAction("No pending messages..."); sleep(3); continue; } //Retrieve User {... doctrine query for stored twitter handle ...} //Clear Message $this->logAction("Removing message form queue..."); $qManager->deleteMessage($qMessage); //Process User $this->processUser($user); //Warn User $this->sendWarning($user); } catch (Exception $e) { $this->logAction("Exception found:" .$e->getMessage } $this->logAction("Initiating sleep for next loop."); sleep(2); }Wednesday, May 25, 2011

while (true){ try{ $this->logAction("Checking for messages..."); FIRST COME, //Read Queue $qMessage = $qManager->getMessage(); //If no message, sleep for 3 seconds and try again FIRST SERVED if ($qMessage === null){ $this->logAction("No getMessage() public function pending messages..."); { sleep(3); $messages = $this->client->getMessages($this->queue->name, 1); continue; } if (count($messages) > 0){ //Retrieve User $qMessage = array_shift($messages); {... doctrine query for stored twitter handle ...} $message = new stdClass(); //Clear Message $message->qMessage = $qMessage; $this->logAction("Removing message form queue..."); $message->decoded = unserialize($qMessage->messagetext); $qManager->deleteMessage($qMessage); return $message; //Process User } $this->processUser($user); return null; //Warn User $this->sendWarning($user); } } catch (Exception $e) { $this->logAction("Exception found:" .$e->getMessage } $this->logAction("Initiating sleep for next loop."); sleep(2); }Wednesday, May 25, 2011

while (true){ try{ $this->logAction("Checking for messages..."); FIRST COME, //Read Queue $qMessage = $qManager->getMessage(); //If no message, sleep for 3 seconds and try again FIRST SERVED if ($qMessage === null){ $this->logAction("No getMessage() public function pending messages..."); { sleep(3); $messages = $this->client->getMessages($this->queue->name, 1); continue; } if (count($messages) > 0){ //Retrieve User $qMessage = array_shift($messages); {... doctrine query for stored twitter handle ...} $message = new stdClass(); //Clear Message $message->qMessage = $qMessage; $this->logAction("Removing message form queue..."); $message->decoded = unserialize($qMessage->messagetext); $qManager->deleteMessage($qMessage); return $message; //Process User } $this->processUser($user); return null; //Warn User $this->sendWarning($user); array( } messageid => $messageId, insertiontime => $insertionTime, } catch (Exception $e) { expirationtime => $expirationTime, $this->logAction("Exception found:" .$e->getMessage popreceipt => $popReceipt, timenextvisible => $timeNextVisible, } dequeuecount => $dequeueCount, messagetext => $messageText $this->logAction("Initiating sleep for next loop."); ); sleep(2); }Wednesday, May 25, 2011

while (true){ try{ $this->logAction("Checking for messages..."); FIRST COME, //Read Queue $qMessage = $qManager->getMessage(); //If no message, sleep for 3 seconds and try again FIRST SERVED if ($qMessage === null){ $this->logAction("No pending messages..."); sleep(3); continue; } //Retrieve User {... doctrine query for stored twitter handle ...} //Clear Message $this->logAction("Removing message form queue..."); $qManager->deleteMessage($qMessage); //Process User $this->processUser($user); //Warn User $this->sendWarning($user); } catch (Exception $e) { $this->logAction("Exception found:" .$e->getMessage } $this->logAction("Initiating sleep for next loop."); sleep(2); }Wednesday, May 25, 2011

while (true){ try{ $this->logAction("Checking for messages..."); FIRST COME, //Read Queue $qMessage = $qManager->getMessage(); //If no message, sleep for 3 seconds and try again FIRST SERVED if ($qMessage === null){ $this->logAction("No pending messages..."); sleep(3); continue; } //Retrieve User {... doctrine query for stored twitter handle ...} //Clear Message $this->logAction("Removing message form queue..."); $qManager->deleteMessage($qMessage); After 20 seconds, message goes //Process User back into Queue $this->processUser($user); //Warn User $this->sendWarning($user); } catch (Exception $e) { $this->logAction("Exception found:" .$e->getMessage } $this->logAction("Initiating sleep for next loop."); sleep(2); }Wednesday, May 25, 2011

GOING OUT THE WINDOW • See all changes: github.com/rdohms/Sample-Azure-App • Compare these branches: non-cloud-version x cloud-designed-versionWednesday, May 25, 2011

LOOKING BACK BEFORE CLOSING THE WINDOW • Found out what is the Cloud • Looked at reasons on why to choose the Cloud • We took a look at Windows Azure • Peaked at how it affects our code?Wednesday, May 25, 2011

FURTHER READING... PHP Development in the Cloud ISBN: 9780981034522 Pages: 172 Authors: Ivo Jansch and Vito Chin http://bit.ly/i9Awk0Wednesday, May 25, 2011

GET STARTED, GET HELP • Get a free account: WindowsAzurePass.com • Talk to the Microsoft guys out in the Hall • Ask them about pricing options http://azurephp.com http://phpazure.codeplex.com/ http://azurephptools.codeplex.com/ http://www.ben-waine.co.uk/blog/php-azure http://marvelley.com/category/php/php-on-azure/Wednesday, May 25, 2011

twitter.com/rdohmshttp://doh.ms Questions? rafael@doh.ms THANK YOU! Feedback is very important, please visit: joind.in/3417Wednesday, May 25, 2011

http://blog.rafaeldohms.com.br	818
http://blog.doh.ms	131
http://www.planet-php.net	95
http://feeds.feedburner.com	23
http://planet-php.org	12
http://www.planet-php.org	5
url_unknown	4
http://www.phpeye.com	3
http://www.slideshare.net	2
http://translate.googleusercontent.com	1
http://blog.rafaeldohms.com.br HTTP	1
http://phpeye.com	1
http://planet-php.net	1

Open a window, see the clouds - php|tek 2011

by Rafael Dohms

Accessibility

Categories

Upload Details

Usage Rights

13 Embeds 1,097

Statistics

Open a window, see the clouds - php|tek 2011 Presentation Transcript