Developing Cloud Computing Applications with Java Shlomo Swidler CTO, MyDrifts.com [email_address]

Developing Cloud Computing Applications with Java Overview of Cloud Computing Amazon’s Cloud Platform Google’s Cloud Platform Application Development Challenges Posed by the Cloud… … and Java Solutions 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

Overview of Cloud Computing

Amazon’s Cloud Platform

Google’s Cloud Platform

Application Development Challenges Posed by the Cloud… … and Java Solutions

About Me CTO & co-Founder Music marketing on social networks Patent-pending targeting technology Java, MySQL, auto-scaling & cloud-based Active in the Cloud Computing community Open Cloud Computing Interface Working Group (an Open Grid Forum initiative) participant Contributor to Open Source cloud & Java projects 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

CTO & co-Founder

Music marketing on social networks

Patent-pending targeting technology

Java, MySQL, auto-scaling & cloud-based

Active in the Cloud Computing community

Open Cloud Computing Interface Working Group (an Open Grid Forum initiative) participant

Contributor to Open Source cloud & Java projects

Cloud Computing Is… A style of computing in which dynamically scalable and often virtualized resources are provided as a service over the Internet. Users need not have knowledge of, expertise in, or control over the technology infrastructure in the “cloud” that supports them. – Wikipedia 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

A style of computing in which dynamically scalable and often virtualized resources are provided as a service over the Internet. Users need not have knowledge of, expertise in, or control over the technology infrastructure in the “cloud” that supports them. – Wikipedia

Cloud Computing Is… A style of computing in which dynamically scalable and often virtualized resources are provided as a service over the Internet. Users need not have knowledge of, expertise in, or control over the technology infrastructure in the “cloud” that supports them. – Wikipedia 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

A style of computing in which dynamically scalable and often virtualized resources are provided as a service over the Internet. Users need not have knowledge of, expertise in, or control over the technology infrastructure in the “cloud” that supports them. – Wikipedia

Cloud Computing Is… 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

Cloud Computing Is… 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

Cloud Computing Is… Computing Resources As a Service Pay-as-you-go or Subscription 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Infrastructure Platform Software Processor LAMP Stack Email Memory JVM CRM System Storage Python VM ERP System Network MapReduce SCM System

Computing Resources

As a Service

Pay-as-you-go or Subscription

Advantages of Cloud Computing From a Developer’s Perspective: Pay-as-you-go “utility computing” Saves time Saves $$$ On-demand resource allocation & release Scalability More on this later 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

From a Developer’s Perspective:

Pay-as-you-go “utility computing”

Saves time

Saves $$$

On-demand resource allocation & release

Scalability

More on this later

Risks of Cloud Computing Security Who else has access to “your” resources ? Recovery How easy is it ? Provider lock-in 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

Security

Who else has access to “your” resources ?

Recovery

How easy is it ?

Provider lock-in

Amazon’s Cloud Platform: Amazon Web Services Infrastructure-as-a-Service Processors & Memory Elastic Compute Cloud “EC2” Storage Simple Storage Service “S3” Elastic Block Store “EBS” SimpleDB database 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Network Content Delivery Network CloudFront Messaging Simple Queue Service “SQS”

Infrastructure-as-a-Service

Processors & Memory

Elastic Compute Cloud “EC2”

Storage

Simple Storage Service “S3”

Elastic Block Store “EBS”

SimpleDB database

Network

Content Delivery Network CloudFront

Messaging

Simple Queue Service “SQS”

Amazon Dashboard ElasticFox Firefox plugin 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

ElasticFox Firefox plugin

Developing on Amazon’s Cloud Standard stuff: Language Libraries Communications Web Servers Application Servers Databases Challenges: Scaling 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Suitable for existing applications

Standard stuff:

Language

Libraries

Communications

Web Servers

Application Servers

Databases

Challenges:

Scaling

Suitable for existing applications

Google’s Cloud Platform: Google App Engine 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Platform-as-a-Service Language Python Java Storage JDO or JPA or Datastore APIs User Accounts Email Image Transformation Memcached Cron jobs

Platform-as-a-Service

Language

Python

Java

Storage

JDO or JPA or Datastore APIs

User Accounts

Email

Image Transformation

Memcached

Cron jobs

Google Dashboard Google Administration Console 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

Google Administration Console

Developing on Google’s Cloud Easy stuff: Scaling Challenges: Language Libraries Communications Data Storage 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Suitable for new, lighter-weight applications

Easy stuff:

Scaling

Challenges:

Language

Libraries

Communications

Data Storage

Suitable for new, lighter-weight applications

Application Development Challenges Posed by the Cloud Deploying to the Cloud Designing for Scalability Web Tier Application Tier Database Tier 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

Deploying to the Cloud

Designing for Scalability

Web Tier

Application Tier

Database Tier

Application Development Challenges Posed by the Cloud Deploying to the Cloud Designing for Scalability Web Tier Application Tier Database Tier 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

Deploying to the Cloud

Designing for Scalability

Web Tier

Application Tier

Database Tier

Deploying to the Cloud IaaS platforms Mostly the same as traditional deployment PaaS & SaaS platforms Custom procedures Custom configurations Custom tools Google App Engine: Eclipse plug-in 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

IaaS platforms

Mostly the same as traditional deployment

PaaS & SaaS platforms

Custom procedures

Custom configurations

Custom tools

Google App Engine: Eclipse plug-in

Deploying an Application to Google App Engine 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

Designing the Application Tier for Scalability 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

Designing the Application Tier for Scalability Make sure your Storage Tier is optimized Optimize database queries Use in-memory caching Parallelize operations Use concurrent threads Use the Service Pools design pattern 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

Make sure your Storage Tier is optimized

Optimize database queries

Use in-memory caching

Parallelize operations

Use concurrent threads

Use the Service Pools design pattern

Parallelize with Concurrent Threads Motivation Allow long-running tasks to proceed without impacting performance Java offers the java.util.concurrent package Executor interface Future<T> interface 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

Motivation

Allow long-running tasks to proceed without impacting performance

Java offers the java.util.concurrent package

Executor interface

Future<T> interface

java.util.concurrent Example: In-Memory Cache Existing implementations such as memcached Cache shared by all application instances Access is via the network Application requests an Object from the cache Time until response is received can vary True of any network operation Don’t let application code wait… 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

Existing implementations such as memcached

Cache shared by all application instances

Access is via the network

Application requests an Object from the cache

Time until response is received can vary

True of any network operation

Don’t let application code wait…

java.util.concurrent Example: In-Memory Cache String userId = &quot;visitor01&quot; ; String memcachedKey = &quot;userId:&quot; + userId + &quot;.lastLoginDate&quot; ; Future<Date> lastLoginDateGetter = MemcachedClient. get( memcachedKey, Date. class ); // perform the rest of the request handling code here // then, at the end, get the user's last login date Date lastLoginDate = null ; try { lastLoginDate = lastLoginDateGetter.get(50, TimeUnit. MILLISECONDS); } catch (InterruptedException e) { // someone interrupted the FutureTask } catch (ExecutionException e) { // the FutureTask threw an exception } catch (TimeoutException e) { // the FutureTask didn't complete within the 50ms time limit lastLoginDateGetter.cancel( false ); } // return lastLoginDate to the presentation layer 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

String userId = &quot;visitor01&quot; ;

String memcachedKey = &quot;userId:&quot; + userId + &quot;.lastLoginDate&quot; ;

Future<Date> lastLoginDateGetter = MemcachedClient. get( memcachedKey, Date. class );

// perform the rest of the request handling code here

// then, at the end, get the user's last login date

Date lastLoginDate = null ;

try {

lastLoginDate = lastLoginDateGetter.get(50, TimeUnit. MILLISECONDS);

} catch (InterruptedException e) {

// someone interrupted the FutureTask

} catch (ExecutionException e) {

// the FutureTask threw an exception

} catch (TimeoutException e) {

// the FutureTask didn't complete within the 50ms time limit

lastLoginDateGetter.cancel( false );

}

// return lastLoginDate to the presentation layer

java.util.concurrent Example: In-Memory Cache import java.util.concurrent.Callable; import java.util.concurrent.Executor; import java.util.concurrent.Executors; import java.util.concurrent.Future; import java.util.concurrent.FutureTask; public class MemcachedClient { private static Executor executor = Executors .newFixedThreadPool (1); public static <T> Future<T> get(String objectKey, Class<T> type) { final String objectKeyFinal = objectKey; FutureTask<T> getFromCacheOperation = new FutureTask<T>( new Callable<T>() { public T call() { Object networkResponse = requestObjectOverNetwork (objectKeyFinal); return (T) networkResponse; } } ); executor . execute(getFromCacheOperation); return getFromCacheOperation; } private static Object requestObjectOverNetwork(String objectKey) { // network stuff goes in here } } 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

import java.util.concurrent.Callable;

import java.util.concurrent.Executor;

import java.util.concurrent.Executors;

import java.util.concurrent.Future;

import java.util.concurrent.FutureTask;

public class MemcachedClient {

private static Executor executor = Executors .newFixedThreadPool (1);

public static <T> Future<T> get(String objectKey, Class<T> type) {

final String objectKeyFinal = objectKey;

FutureTask<T> getFromCacheOperation = new FutureTask<T>(

new Callable<T>() {

public T call() {

Object networkResponse = requestObjectOverNetwork (objectKeyFinal);

return (T) networkResponse;

}

}

);

executor . execute(getFromCacheOperation);

return getFromCacheOperation;

}

private static Object requestObjectOverNetwork(String objectKey) {

// network stuff goes in here

}

}

Parallelize with Service Pools Motivation Allow services to scale according to demand Scale up and down 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Request Queue Response Queue Storage

Motivation

Allow services to scale according to demand

Scale up and down

Java Service Pool for Amazon Web Services: Lifeguard Open source Apache License Version 2.0 http://code.google.com/p/lifeguard/ 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Request Queue Response Queue Storage

Open source Apache License Version 2.0

http://code.google.com/p/lifeguard/

Lifeguard Framework Framework provides: Message handling File handling Scaling logic 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Request SQS Queue Response SQS Queue EC2 Instances Ingestor Listener S3 Storage Pool Mgr Config

Framework provides:

Message handling

File handling

Scaling logic

Lifeguard Framework You provide: Ingestor Service Pool Manager Configuration 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Request SQS Queue Response SQS Queue EC2 Instances Ingestor Listener S3 Storage Pool Mgr Config

You provide:

Ingestor

Service

Pool Manager Configuration

public class ResizeImageIngestor extends IngestorBase { private static final String ResizeImageWorkflowXML = &quot;<Workflow>&quot; + &quot;<Service>&quot; + &quot;<Name>ResizeImage</Name>&quot; + &quot;<WorkQueue>ResizeImage-input</WorkQueue>&quot; + &quot;</Service>&quot; + &quot;</Workflow>&quot; ; public ResizeImageIngestor() { super ( ResizeImageIngestorWorkflowXML ); } public void ingest(File imageFile) { super .ingest(Collections. singletonList (imageFile)); } } 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Ingestor Implement the Ingestor S3 Storage

public class ResizeImageIngestor extends IngestorBase {

private static final String ResizeImageWorkflowXML =

&quot;<Workflow>&quot; +

&quot;<Service>&quot; +

&quot;<Name>ResizeImage</Name>&quot; +

&quot;<WorkQueue>ResizeImage-input</WorkQueue>&quot; +

&quot;</Service>&quot; +

&quot;</Workflow>&quot; ;

public ResizeImageIngestor() {

super ( ResizeImageIngestorWorkflowXML );

}

public void ingest(File imageFile) {

super .ingest(Collections. singletonList (imageFile));

}

}

public class ResizeImageService extends AbstractBaseService { private static final String ServiceConfigXML = &quot;<ServiceConfig>&quot; + &quot;<ServiceName>ResizeImage</ServiceName>&quot; + &quot;<WorkQueue>ResizeImage-input</WorkQueue>&quot; + &quot;</ServiceConfig>&quot; ; public ResizeImageService() { super( ServiceConfigXML ); } public List<File> executeService(File imageFile) { Image origImage = new Image(imageFile); File resizedImageFile = resizeImageToFile(origImage); return Collections. singletonList (resizedImageFile); } } 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Implement the Service S3 Storage

public class ResizeImageService extends AbstractBaseService {

private static final String ServiceConfigXML =

&quot;<ServiceConfig>&quot; +

&quot;<ServiceName>ResizeImage</ServiceName>&quot; +

&quot;<WorkQueue>ResizeImage-input</WorkQueue>&quot; +

&quot;</ServiceConfig>&quot; ;

public ResizeImageService() {

super( ServiceConfigXML );

}

public List<File> executeService(File imageFile) {

Image origImage = new Image(imageFile);

File resizedImageFile = resizeImageToFile(origImage);

return Collections. singletonList (resizedImageFile);

}

}

<ServicePool> <ServiceName> ResizeImage </ServiceName> <VMImage> ami-39ba5df0 </VMImage> <WorkQueue> ResizeImage-input </WorkQueue> <RampUpInterval> 1 </RampUpInterval> <RampUpDelay> 360 </RampUpDelay> <RampDownInterval> 1 </RampDownInterval> <RampDownDelay> 480 </RampDownDelay> <MinSize> 0 </MinSize> <MaxSize> 20 </MaxSize> <QueueSizeFactor> 20000 </QueueSizeFactor> </ServicePool> This configuration defines the SLA for this service That’s all there is to implement The framework does all the rest 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Configure the Pool Manager Pool Mgr Config

<ServicePool>

<ServiceName> ResizeImage </ServiceName>

<VMImage> ami-39ba5df0 </VMImage>

<WorkQueue> ResizeImage-input </WorkQueue>

<RampUpInterval> 1 </RampUpInterval>

<RampUpDelay> 360 </RampUpDelay>

<RampDownInterval> 1 </RampDownInterval>

<RampDownDelay> 480 </RampDownDelay>

<MinSize> 0 </MinSize>

<MaxSize> 20 </MaxSize>

<QueueSizeFactor> 20000 </QueueSizeFactor>

</ServicePool>

This configuration defines the SLA for this service

That’s all there is to implement

The framework does all the rest

Service Pool Pool of service instances dynamically scales with load 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Request SQS Queue Response SQS Queue EC2 Instances Ingestor Listener S3 Storage Pool Mgr Config

Pool of service instances dynamically scales with load

Service Pool Pool of service instances dynamically scales with load 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

Pool of service instances dynamically scales with load

Service Pool Multiple service pools scale independently 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler etc.

Multiple service pools scale independently

Service Pool Workloads can follow different workflows Specify the Ingestor’s XML accordingly 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

Workloads can follow different workflows

Specify the Ingestor’s XML accordingly

Developing Cloud Computing Applications with Java Q&A 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

Q&A

Developing Cloud Computing Applications with Java Shlomo Swidler [email_address] Thank you! 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler

Shlomo Swidler

[email_address]

Thank you!