Benefits of Grid Computing in the Cloud


Published on

RightScale Webinar: March 5, 2009 – See how pharmaceutical, insurance, and Web 2.0 companies are using grid computing to reduce costs and speed processing. You'll learn how to set up a scalable compute array using RightScale's Grid Edition. Watch the video at

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Key benefits of the cloud:Infinite computing resourcesAvailable on-demandPay per useAccess via the InternetIn many ways surpassing traditional hosting:Multiple server sizes: ½ core to 8 coresReassign IPs / VIPsMultiple failure zonesDisk VolumesCloud interoperabilityMultiple geographiesRightScale automation tying it all together
  • Benefits of Grid Computing in the Cloud

    1. 1. Best Practices in the Cloud:<br />Grid Computing<br />
    2. 2. Your Panel Today<br />Presenting<br />Thorsten von Eicken – Founder, CTO<br />Josh Fraser – VP, Business Development<br />David Welch – Sr. Sales Engineer<br />Q&A<br />Matthew Small – Sr. Account Manager<br />
    3. 3. Agenda<br /><ul><li>Welcome
    4. 4. Grid Applications & the Cloud
    5. 5. RightGrid Architecture
    6. 6. Live Demo
    7. 7. Use Cases
    8. 8. Q&A – Getting Started
    9. 9. Please use chat to ask questions anytime!</li></li></ul><li>EXPERTISE<br />WEB SITE<br />GRID<br />Cloud Applications<br />EXPERTISE<br />& SUPPORT<br />AUTOMATION<br />ARCHITECTURE<br />CLOUD-READY<br />SOLUITIONS<br />RightScale<br />RIGHTSCRIPTS<br />MYSQL MGR<br />AWS US<br />AWS EU<br />FlexiScale<br />Rackspace<br />GoGrid<br />Other Clouds<br />Cloud Management Platform<br />
    10. 10. Grid Apps – Back-end Jobs <br />Users<br />Front-end web app<br />“Complete” web site<br />Simple submit/retrieve site<br />Back-end grid<br />Processes jobs “submitted”via web site<br />Results “retrieved” via web site<br />Job queue invisible to end user<br />Grow/shrink workers tomaintain SLA<br />Typical example:<br />Multi-media processing/transcoding<br />Web tier<br />Grid tier<br />
    11. 11. Grid Apps – Back-end Jobs <br />Users<br />Cloud effects<br />Grow/shrink workers to maintain SLA<br />Design, configure, manage all tiersin homogeneous infrastructure<br />Communicate and share across tiers (database, storage, aux servers, …)<br />Clone entire architecturefor dev & test<br />Web tier<br />Grid tier<br />
    12. 12. Job submission<br />Upload/submit<br />Complex priority scheduler<br />Cloud effects<br />Variable number of nodes<br />extend peak<br />improve utilization<br />On-demand vs. queue<br />Personal grids<br />Real-time grids<br />Grid Apps – Queued Batch<br />nodes<br />time<br />
    13. 13. Standard design pattern:<br />Produce/upload data<br />Queue work<br />Worker array<br />Queue results<br />Consume/download results<br />RightGridArchitecture<br />8<br />
    14. 14. RightGrid Architecture<br />Job<br />Producer<br />InputQueue<br />ResultQueue<br />Grid<br />Workers<br />Job<br />Consumer<br />web/app<br />server<br />web/app<br />server<br />user<br />workstation<br />user<br />workstation<br />Amazon EC2<br />Elastic Compute Cloud<br />Amazon SQS<br />Simple Queue Service<br />Amazon S3<br />Simple Storage Service<br />
    15. 15. RightGrid Demo<br />Job<br />Producer<br />InputQueue<br />ResultQueue<br />Grid<br />Workers<br />Job<br />Consumer<br />EC2<br />server<br />user<br />workstation<br />1000 images<br />1000 work items<br />1..100 servers<br />1000 watermarked images<br />1000 result items<br />
    16. 16. Standard worker server design pattern:<br />Loop over items and do work<br />Pull data descriptor in SQS, data in S3<br />Work …<br />Push data data into S3, descriptor into SQS<br />Audit audit record, log files<br />RightGridWorker<br />11<br />
    17. 17. RightGridWorker<br />RightGrid Worker Server<br />resultqueue<br />pre-<br />work<br />post-<br />work<br />your<br />code<br />workqueue<br />Results<br />(S3)<br />local disk<br />Input<br />(S3)<br />auditqueue<br />logs<br />12<br />
    18. 18. “Hello world” worker script<br />Worker array with 1 worker running<br />Coordinator server submitting “Hello” units<br />SQS queues<br />RightGrid 1-click set-up <br />
    19. 19. Pharmaceutical – Protein Analysis<br />Executed 2.5 million compound comparisons<br />Estimated one week of processing on internal servers<br />Completed in a half day on 100 instances<br />Insurance – Fraud Detection <br />Multiple years of records processed for fraudulent or duplicate claims<br />Estimated at weeks or months internally, or $M cap-ex<br />Reduced to days and hours on the cloud<br />Web 2.0 – Media Transcoding<br />From images and music, transcode and render video on demand<br />Produce high production videos within minutes instead of hours<br />Grid Use Cases Today<br />
    20. 20. Why the Cloud for Grid Apps?<br />In-house Grid<br />Cloud Grid<br />Invest for peak<br />Queue model<br />Web/batch isolation<br />Black-box jobs<br />Complex charge-back<br />Access “unlimited” resources<br />On-demand model<br />Easy web+batch mix<br />Transparent resource access<br />Simple cost equation<br />Neutral cost equation<br /> 1000 Jobs<br /> 10 Machines<br /> 100 Elapsed Hours<br /> 1000 Jobs<br /> 100 Machines<br /> 10 Elapsed Hours<br />same work<br />same cost<br />
    21. 21. RightGrid Benefits <br />Standard proven architecture<br />Worker framework ready to go<br />Management thru RightScale interface <br />Save Time,<br /> Improve Visibility<br />
    22. 22. Q&A - Getting Started<br /><ul><li>Contact a RightScale representative for a live demonstration of RightGrid:
    23. 23.
    24. 24. (866) 720 – 0208
    25. 25. Register for our next webinar and access live recordings of past webinars at:</li></ul><br />Thank you for listening!<br />
    26. 26. Best Practices in the Cloud:<br />Grid Computing<br />