Java Tech Day 2009 - Developing Cloud Computing Applications With Java
Upcoming SlideShare
Loading in...5
×
 

Java Tech Day 2009 - Developing Cloud Computing Applications With Java

on

  • 11,507 views

Challenges faced by developers of cloud-computing applications and Java-based solutions. Including an overview of Google App Engine, Amazon Web Services, and sample Java code demonstrating design ...

Challenges faced by developers of cloud-computing applications and Java-based solutions. Including an overview of Google App Engine, Amazon Web Services, and sample Java code demonstrating design patterns that will scale in the cloud.

Statistics

Views

Total Views
11,507
Views on SlideShare
11,391
Embed Views
116

Actions

Likes
11
Downloads
717
Comments
0

11 Embeds 116

http://www.slideshare.net 40
http://orzbooker.appspot.com 33
http://psychpro.com 14
http://www.cloud24by7.com 10
http://localhost 6
http://anandloni.blogspot.com 4
http://www.linkedin.com 3
http://cloudme.eu 2
http://anandloni.blogspot.in 2
http://webcache.googleusercontent.com 1
http://anandloni.blogspot.de 1
More...

Accessibility

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

CC Attribution-NonCommercial-ShareAlike LicenseCC Attribution-NonCommercial-ShareAlike LicenseCC Attribution-NonCommercial-ShareAlike License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Java Tech Day 2009 - Developing Cloud Computing Applications With Java Java Tech Day 2009 - Developing Cloud Computing Applications With Java Presentation Transcript

  • Developing Cloud Computing Applications with Java Shlomo Swidler CTO, MyDrifts.com [email_address]
  • Developing Cloud Computing Applications with Java
    • Overview of Cloud Computing
    • Amazon’s Cloud Platform
    • Google’s Cloud Platform
    • Application Development Challenges Posed by the Cloud… … and Java Solutions
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • About Me
    • CTO & co-Founder
      • Music marketing on social networks
      • Patent-pending targeting technology
      • Java, MySQL, auto-scaling & cloud-based
    • Active in the Cloud Computing community
      • Open Cloud Computing Interface Working Group (an Open Grid Forum initiative) participant
      • Contributor to Open Source cloud & Java projects
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • Cloud Computing Is…
    • A style of computing in which dynamically scalable and often virtualized resources are provided as a service over the Internet. Users need not have knowledge of, expertise in, or control over the technology infrastructure in the “cloud” that supports them. – Wikipedia
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • Cloud Computing Is…
    • A style of computing in which dynamically scalable and often virtualized resources are provided as a service over the Internet. Users need not have knowledge of, expertise in, or control over the technology infrastructure in the “cloud” that supports them. – Wikipedia
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • Cloud Computing Is… 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • Cloud Computing Is… 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • Cloud Computing Is…
    • Computing Resources
    • As a Service
      • Pay-as-you-go or Subscription
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Infrastructure Platform Software Processor LAMP Stack Email Memory JVM CRM System Storage Python VM ERP System Network MapReduce SCM System
  • Advantages of Cloud Computing
    • From a Developer’s Perspective:
    • Pay-as-you-go “utility computing”
      • Saves time
      • Saves $$$
    • On-demand resource allocation & release
    • Scalability
      • More on this later
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • Risks of Cloud Computing
    • Security
      • Who else has access to “your” resources ?
    • Recovery
      • How easy is it ?
    • Provider lock-in
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • Amazon’s Cloud Platform: Amazon Web Services
    • Infrastructure-as-a-Service
    • Processors & Memory
      • Elastic Compute Cloud “EC2”
    • Storage
      • Simple Storage Service “S3”
      • Elastic Block Store “EBS”
      • SimpleDB database
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
    • Network
      • Content Delivery Network CloudFront
    • Messaging
      • Simple Queue Service “SQS”
  • Amazon Dashboard
    • ElasticFox Firefox plugin
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • Developing on Amazon’s Cloud
    • Standard stuff:
    • Language
    • Libraries
    • Communications
    • Web Servers
    • Application Servers
    • Databases
    • Challenges:
    • Scaling
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
    • Suitable for existing applications
  • Google’s Cloud Platform: Google App Engine 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
    • Platform-as-a-Service
    • Language
      • Python
      • Java
    • Storage
      • JDO or JPA or Datastore APIs
    • User Accounts
    • Email
    • Image Transformation
    • Memcached
    • Cron jobs
  • Google Dashboard
    • Google Administration Console
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • Developing on Google’s Cloud
    • Easy stuff:
    • Scaling
    • Challenges:
    • Language
    • Libraries
    • Communications
    • Data Storage
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
    • Suitable for new, lighter-weight applications
  • Application Development Challenges Posed by the Cloud
    • Deploying to the Cloud
    • Designing for Scalability
      • Web Tier
      • Application Tier
      • Database Tier
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • Application Development Challenges Posed by the Cloud
    • Deploying to the Cloud
    • Designing for Scalability
      • Web Tier
      • Application Tier
      • Database Tier
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • Deploying to the Cloud
    • IaaS platforms
      • Mostly the same as traditional deployment
    • PaaS & SaaS platforms
      • Custom procedures
      • Custom configurations
      • Custom tools
      • Google App Engine: Eclipse plug-in
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • Deploying an Application to Google App Engine 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • Designing the Application Tier for Scalability 22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • Designing the Application Tier for Scalability
    • Make sure your Storage Tier is optimized
      • Optimize database queries
      • Use in-memory caching
    • Parallelize operations
      • Use concurrent threads
      • Use the Service Pools design pattern
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • Parallelize with Concurrent Threads
    • Motivation
      • Allow long-running tasks to proceed without impacting performance
    • Java offers the java.util.concurrent package
      • Executor interface
      • Future<T> interface
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • java.util.concurrent Example: In-Memory Cache
    • Existing implementations such as memcached
    • Cache shared by all application instances
      • Access is via the network
    • Application requests an Object from the cache
    • Time until response is received can vary
      • True of any network operation
    • Don’t let application code wait…
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • java.util.concurrent Example: In-Memory Cache
    • String userId = &quot;visitor01&quot; ;
    • String memcachedKey = &quot;userId:&quot; + userId + &quot;.lastLoginDate&quot; ;
    • Future<Date> lastLoginDateGetter = MemcachedClient. get( memcachedKey, Date. class );
    • // perform the rest of the request handling code here
    • // then, at the end, get the user's last login date
    • Date lastLoginDate = null ;
    • try {
    • lastLoginDate = lastLoginDateGetter.get(50, TimeUnit. MILLISECONDS);
    • } catch (InterruptedException e) {
    • // someone interrupted the FutureTask
    • } catch (ExecutionException e) {
    • // the FutureTask threw an exception
    • } catch (TimeoutException e) {
    • // the FutureTask didn't complete within the 50ms time limit
    • lastLoginDateGetter.cancel( false );
    • }
    • // return lastLoginDate to the presentation layer
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • java.util.concurrent Example: In-Memory Cache
    • import java.util.concurrent.Callable;
    • import java.util.concurrent.Executor;
    • import java.util.concurrent.Executors;
    • import java.util.concurrent.Future;
    • import java.util.concurrent.FutureTask;
    • public class MemcachedClient {
    • private static Executor executor = Executors .newFixedThreadPool (1);
    • public static <T> Future<T> get(String objectKey, Class<T> type) {
    • final String objectKeyFinal = objectKey;
    • FutureTask<T> getFromCacheOperation = new FutureTask<T>(
    • new Callable<T>() {
    • public T call() {
    • Object networkResponse = requestObjectOverNetwork (objectKeyFinal);
    • return (T) networkResponse;
    • }
    • }
    • );
    • executor . execute(getFromCacheOperation);
    • return getFromCacheOperation;
    • }
    • private static Object requestObjectOverNetwork(String objectKey) {
    • // network stuff goes in here
    • }
    • }
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • Parallelize with Service Pools
    • Motivation
      • Allow services to scale according to demand
      • Scale up and down
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Request Queue Response Queue Storage
  • Java Service Pool for Amazon Web Services: Lifeguard
    • Open source Apache License Version 2.0
      • http://code.google.com/p/lifeguard/
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Request Queue Response Queue Storage
  • Lifeguard Framework
    • Framework provides:
      • Message handling
      • File handling
      • Scaling logic
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Request SQS Queue Response SQS Queue EC2 Instances Ingestor Listener S3  Storage Pool Mgr Config
  • Lifeguard Framework
    • You provide:
      • Ingestor
      • Service
      • Pool Manager Configuration
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Request SQS Queue Response SQS Queue EC2 Instances Ingestor Listener S3  Storage Pool Mgr Config
    • public class ResizeImageIngestor extends IngestorBase {
      • private static final String ResizeImageWorkflowXML =
        • &quot;<Workflow>&quot; +
          • &quot;<Service>&quot; +
          • &quot;<Name>ResizeImage</Name>&quot; +
          • &quot;<WorkQueue>ResizeImage-input</WorkQueue>&quot; +
          • &quot;</Service>&quot; +
        • &quot;</Workflow>&quot; ;
    • public ResizeImageIngestor() {
    • super ( ResizeImageIngestorWorkflowXML );
    • }
      • public void ingest(File imageFile) {
        • super .ingest(Collections. singletonList (imageFile));
      • }
    • }
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Ingestor Implement the Ingestor S3  Storage
    • public class ResizeImageService extends AbstractBaseService {
    • private static final String ServiceConfigXML =
    • &quot;<ServiceConfig>&quot; +
    • &quot;<ServiceName>ResizeImage</ServiceName>&quot; +
    • &quot;<WorkQueue>ResizeImage-input</WorkQueue>&quot; +
    • &quot;</ServiceConfig>&quot; ;
    • public ResizeImageService() {
    • super( ServiceConfigXML );
    • }
      • public List<File> executeService(File imageFile) {
        • Image origImage = new Image(imageFile);
        • File resizedImageFile = resizeImageToFile(origImage);
        • return Collections. singletonList (resizedImageFile);
      • }
    • }
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Implement the Service S3  Storage
    • <ServicePool>
      • <ServiceName> ResizeImage </ServiceName>
      • <VMImage> ami-39ba5df0 </VMImage>
      • <WorkQueue> ResizeImage-input </WorkQueue>
      • <RampUpInterval> 1 </RampUpInterval>
      • <RampUpDelay> 360 </RampUpDelay>
      • <RampDownInterval> 1 </RampDownInterval>
      • <RampDownDelay> 480 </RampDownDelay>
      • <MinSize> 0 </MinSize>
      • <MaxSize> 20 </MaxSize>
      • <QueueSizeFactor> 20000 </QueueSizeFactor>
    • </ServicePool>
    • This configuration defines the SLA for this service
    • That’s all there is to implement
    • The framework does all the rest
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Configure the Pool Manager Pool Mgr Config
  • Service Pool
    • Pool of service instances dynamically scales with load
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler Request SQS Queue Response SQS Queue EC2 Instances Ingestor Listener S3  Storage Pool Mgr Config
  • Service Pool
    • Pool of service instances dynamically scales with load
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • Service Pool
    • Multiple service pools scale independently
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler etc.
  • Service Pool
    • Workloads can follow different workflows
      • Specify the Ingestor’s XML accordingly
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • Developing Cloud Computing Applications with Java
        • Q&A
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler
  • Developing Cloud Computing Applications with Java
        • Shlomo Swidler
        • [email_address]
        • Thank you!
    22 June 2009 Developing Cloud Computing Applications with Java by Shlomo Swidler