Cloud Computing


Published on

Overview of Cloud computing and Comparing EC2 , Appengine and Project Caroline

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Cloud Computing

  1. 1. A Walk in the Clouds Comparing Google AppEngine , Amazon AWS and Sun Project Caroline Niraj Juneja Blog:
  2. 2. What are we talking about today <ul><li>Really Quick Overview of Cloud Computing </li></ul><ul><li>Market Analysis – POV’s </li></ul><ul><li>Comparing three clouds </li></ul><ul><ul><li>Amazon AWS </li></ul></ul><ul><ul><li>Google App Engine </li></ul></ul><ul><ul><li>Sun’s Project Caroline </li></ul></ul><ul><li>Enterprise Adoption </li></ul><ul><li>Other Players </li></ul><ul><ul><li>Hewlett Packard , SAP , Oracle , IBM </li></ul></ul><ul><ul><li>3Tera , Enki , Enomaly </li></ul></ul><ul><ul><li>Niche Application Players (Vertica , Greenplum ) </li></ul></ul>
  3. 3. What is Cloud Computing <ul><li>The Big Definition </li></ul><ul><li>Wikipedia - Cloud computing is Internet (' Cloud ') based development and use of computer technology (' Computing '). The cloud is a metaphor for the Internet (based on how it is depicted in computer network diagrams) and is an abstraction for the complex infrastructure it conceals [1] . It is a style of computing where IT-related capabilities are provided “ as a service ” [2] , allowing users to access technology-enabled services from the Internet (&quot;in the cloud&quot;) [3] without knowledge of, expertise with, or control over the technology infrastructure that supports them [4] . According to the IEEE Computer Society &quot;It is a paradigm in which information is permanently stored in servers on the Internet and cached temporarily on clients that include desktops, entertainment centers, table computers, notebooks, wall computers, handhelds, etc.&quot; [5] . “ </li></ul><ul><li>No Consensus in the industry for a good definition of “Cloud computing” . Today anything and everything internet will come with a cloud computing logo </li></ul><ul><li>My Definition: If the time difference between - your application needs more capacity and gets more capacity is greater than instantly it is not cloud computing. i.e if there is no programmatic way to provision hardware ,no pooled capacity and even worst a purchase order to get new hardware. </li></ul><ul><li>The Bottom-line </li></ul><ul><ul><li>Changes the economics of Computing from being a Capital investment to Utilities (You buy electricity you don’t buy generators ) </li></ul></ul><ul><ul><li>Changes the way software is developed – Hardware provisioning , Deployment and Scaling now part of developer lifecycle as a Program / script as compared to a Purchase order </li></ul></ul><ul><ul><li>Automates a whole bunch of infrastructure related tasks and activities leading efficiencies and cost savings </li></ul></ul>
  4. 4. Some Myth’s and perceptions <ul><li>Isn’t it all about hardware provisioning? </li></ul><ul><ul><li>Not Really – It is also about changing of Software Development Lifecycle with scaling up , hardware provisioning and deployment all under the control of developer written programs </li></ul></ul><ul><li>What about Security and Enterprise Adoption ? </li></ul><ul><ul><li>Two answers </li></ul></ul><ul><ul><ul><li>Private Clouds – You will start seeing the adoption of the cloud computing paradigm come into the corporate data center. Big iron vendors will start selling Private Cloud Products. </li></ul></ul></ul><ul><ul><ul><ul><li>Refer link here emailshare&uid =0AhZ8_zfEIec </li></ul></ul></ul></ul><ul><ul><ul><li>Just as Banks became a safe place to keep your money away from your safe-box in your grandfathers home , The Cloud will become the default place to keep your data in the future </li></ul></ul></ul>
  5. 5. Some Myth’s and perceptions <ul><li>Isn’t this similar to Time Sharing? </li></ul><ul><ul><li>Yes to some extent. </li></ul></ul><ul><ul><li>But it is not all about sharing of resources. It really boils down to cost savings as a result of automation and changing the SDLC </li></ul></ul><ul><li>How is it different from ASP? </li></ul><ul><ul><li>The ASP value-add was the typical value you get from an outsourcing company. Leverage Knowledge base , trained manpower and some shared infrastructure resources to guarantee reliability of operations and potential cost savings </li></ul></ul><ul><ul><li>Cloud Computing is like taking the ASP concept to the next level with zero to little amount of “People Services” and focus on the Computing as a Utility </li></ul></ul>
  6. 6. Market Analysis Bare Metal People Process based hardware provisioning HaaS – Hardware as a Service Programmatic Interface for Hardware Provisioning PaaS – Platform as a Service (Hardware Provisioning Hidden – Automatic Scaling) SaaS – Software as a Service (Platform , Scaling and Hardware transparent) Flexibility of Offering Google Apps Increasing Virtualization Gmail Amazon EC2/S3 Sun Caroline Google app engine Amazon Simple DB EDS (Infrastructure Outsourcing) In house hosted servers
  7. 7. Market Analysis (POV –Sun Microsystems) App Engine Source:
  8. 8. Market Analysis (POV –Sun Microsystems) Source:
  9. 9. Market Analysis (POV –Sun Microsystems) Source:
  10. 10. Market Analysis (POV – Red Monk) Source:
  11. 11. Comparing Three clouds <ul><li>Discussion to focus on </li></ul><ul><ul><li>Amazon Web Services </li></ul></ul><ul><ul><li>Google App Engine </li></ul></ul><ul><ul><li>Sun’s Project Caroline </li></ul></ul><ul><li>Why these ? </li></ul><ul><ul><li>Most talked about (except Caroline) </li></ul></ul><ul><ul><li>Gives a good overview around the breadth of offerings in the space </li></ul></ul>
  12. 12. Amazon Web Services <ul><li>Offerings </li></ul><ul><ul><li>Hardware as a Service (HaaS) AWS-EC2 </li></ul></ul><ul><ul><li>Storage as a Service – AWS-S3 </li></ul></ul><ul><ul><li>Database as a Service – SimpleDB </li></ul></ul><ul><ul><li>Queuing as a Service – SQS </li></ul></ul><ul><li>Aggregate Offerings </li></ul><ul><ul><li>Pretty much anything you can think off </li></ul></ul><ul><ul><li>Oracle , Solaris , Hadoop Clusters (NY times), Specialized Applications (Vertica DB) , Animoto </li></ul></ul>
  13. 13. AWS – Some Use Cases <ul><li>AWS – Some Use Cases </li></ul><ul><ul><li>Start up’s (low entry point and can get going with great infrastructure in a day) </li></ul></ul><ul><ul><li>SaaS vendors (Vertica ) – a logical marriage between SaaS and HaaS. AWS just becomes a component in the Supply Chain </li></ul></ul><ul><ul><li>Enterprise Use Cases </li></ul></ul><ul><ul><ul><li>Testing –(Performance testing ,Compatibility Testing) </li></ul></ul></ul><ul><ul><ul><li>Massive Batch Jobs – Hadoop Image (NY Times example) , Animoto uses 3000 EC2 instances </li></ul></ul></ul><ul><li>Claim to Fame </li></ul><ul><ul><li>Came from Bottom up in the market and took the low end of the market by storm </li></ul></ul><ul><ul><li>Low Entry point (10 cents an hour for a CPU) and can scale up to Terabytes of storage and thousands of server at the same price structure </li></ul></ul><ul><ul><li>Everything is Automated and has programmatic access (No calls to system admin’s to configure a parameter or restart a server) </li></ul></ul>
  14. 14. Google App Engine <ul><li>Exposes the Google Infrastructure to the outside world </li></ul><ul><ul><ul><li>BigTable </li></ul></ul></ul><ul><ul><ul><li>Python Language runtime </li></ul></ul></ul><ul><ul><ul><li>Access to some google api’s (authentication , image manipulation) </li></ul></ul></ul><ul><li>APIs </li></ul><ul><ul><li>The Python Runtime , The Python environment in which your app runs; CGI, sandbox features, application caching, logging </li></ul></ul><ul><ul><li>Datastore API , BigTable – Google’s Database </li></ul></ul><ul><ul><li>Images API , the image data manipulation service </li></ul></ul><ul><ul><li>Mail API , sending email from your app </li></ul></ul><ul><ul><li>Memcache API , the distributed memory cache </li></ul></ul><ul><ul><li>URL Fetch API , accessing other Internet hosts from your app </li></ul></ul><ul><ul><li>Users API , integrating your app with Google Accounts </li></ul></ul><ul><ul><li>You should expect to see more API’s exposed. More specifically the Google API’s for Docs , GWT , etc </li></ul></ul>
  15. 15. App Engine - offering <ul><li>Claim to Fame </li></ul><ul><ul><ul><li>Free (to start with) </li></ul></ul></ul><ul><ul><ul><li>BigTable ( a real winner) </li></ul></ul></ul><ul><ul><ul><li>Essentially a good way to get into the google world and potentially get acquired by google </li></ul></ul></ul>
  16. 16. <ul><li>Use cases </li></ul><ul><ul><li>Webscale Database needs (BigTable) – Map Reduce Programming model </li></ul></ul><ul><ul><li>Start up (who want to leverage google apis and sign on capability) </li></ul></ul><ul><li>Enterprise Use Cases </li></ul><ul><ul><li>None right now </li></ul></ul><ul><ul><li>But potentially Application’s requiring </li></ul></ul><ul><ul><li>to link the web presence of customers </li></ul></ul><ul><ul><li>(blogs , open social) to the Enterprise </li></ul></ul><ul><ul><li>Applications (Example customer </li></ul></ul><ul><ul><li>insight’s into CRM etc) could use </li></ul></ul><ul><ul><li>AppEngine. </li></ul></ul><ul><ul><li>if you are a Google Apps Shop there </li></ul></ul><ul><ul><li>Is a case of hosting on AppEngine </li></ul></ul>Google App Engine
  17. 17. Comparing Amazon and Google Stacks Source:
  18. 18. Project Caroline – Sun Microsystems <ul><li>Research project developing a platform for development and deployment of long-running Internet services </li></ul><ul><li>Utility scale: lots of customers and services on a single large shared grid, with secure isolation </li></ul><ul><li>Full programmatic control of distributed compute, storage, and network resources </li></ul><ul><li>Services can configure and flex their own resource usage up and down in real time </li></ul><ul><li>High level of resource abstraction </li></ul><ul><li>Will potentially end up in the “Private Cloud” for the Enterprise along Amazon like offerings for the Bottom market </li></ul>
  19. 19. Developer View
  20. 20. What is the API ? <ul><li>Essentially a way to Provision and manage the system resources like </li></ul><ul><ul><li>Network (IP Addresses) </li></ul></ul><ul><ul><li>Databases </li></ul></ul><ul><ul><li>Filesystem </li></ul></ul><ul><li>Standard Configurations available for Tomcat / Glassfish / Ruby </li></ul><ul><li>Can create new configurations for new server types </li></ul><ul><li>Ant Based Environment also available for controlling the grid </li></ul><ul><li>Direct Access from netbeans to integrate the GRID workflow into SDLC </li></ul>
  21. 21. What is the API ? <ul><li>File System Creation : </li></ul><ul><ul><li>myFS = grid.createBaseFileSystem(“myFS”,new BaseFileSystemConfiguration()); </li></ul></ul><ul><li>Network Creation : </li></ul><ul><li>myNet = grid.createNetwork(“myNet”, 16,new CustomerNetworkConfiguration()); </li></ul><ul><li>IP address allocation </li></ul><ul><li>dbAddr = myNet.allocateAddress(“dbAddr”); </li></ul><ul><li>intAddr = myNet.allocateAddress(“intAddr”); </li></ul><ul><li>extAddr = grid.allocateExternalAddress(“extAddr”); </li></ul><ul><li>Database Creation </li></ul><ul><li>myDB = grid.createPostgreSQLDatabase(“myDB”, </li></ul><ul><li>new PostgreSQLConfiguration( </li></ul><ul><li>dbAddr.getUUID(), null)); </li></ul>
  22. 22. Impact of Project Caroline Model <ul><li>Automate deployment & day-to-day operations </li></ul><ul><ul><li>Faster response times </li></ul></ul><ul><ul><li>Capture knowledge in programs not process books </li></ul></ul><ul><li>Services construct their environment instead of being inserted into an existing one </li></ul><ul><ul><li>Simpler for operations and developers </li></ul></ul><ul><li>Isolation between service instances </li></ul><ul><li>Multi-process components </li></ul><ul><li>Developer workflow </li></ul>
  23. 23. Other Players <ul><li>Big Iron Vendors </li></ul><ul><ul><li>Hewlett Packard.: A joint project between Yahoo , HP and Intel . Also watch out for EDS related Enterprise Offerings </li></ul></ul><ul><ul><li>IBM : On Demand Computing </li></ul></ul><ul><li>Software Vendors </li></ul><ul><ul><li>Microsoft – Project Reddog </li></ul></ul><ul><ul><li>Oracle – AWS Announcement’s plus more to come </li></ul></ul><ul><ul><li>SAP – Business by Design </li></ul></ul><ul><ul><li>Salesforce – </li></ul></ul><ul><li>Niche Players </li></ul><ul><ul><li>3Tera , Enki </li></ul></ul><ul><ul><li>Vertica </li></ul></ul><ul><ul><li>Dataware house appliances (Greenplum , Neoview) </li></ul></ul><ul><ul><li>A whole bunch others </li></ul></ul>
  24. 24. <ul><li>“ there will be small number of big players and a large numbers of small players in the cloud computing space ” </li></ul><ul><li>– Dr. Eric Schmidt , CEO Google </li></ul><ul><li>“ we had enough complexity inside Amazon that we were finding we were spending too much time on fine-grained coordination between our network engineering groups and our applications programming groups. Basically what we decided to do is build a [set of APIs] between those two layers so that you could just do coarse-grained coordination between those two groups. Amazon is, you know, just a web-scale application. “ </li></ul><ul><li>- Jeff Bezos , CEO Amazon on “how did Amazon end up creating AWS leaving the big iron vendors behind” </li></ul><ul><li>The world needs only five computers. </li></ul><ul><li>- Thomas Watson , CEO IBM (1943) </li></ul><ul><li>- and then re-phrased by Greg Papadopoulos – CTO Sun Microsystems </li></ul><ul><li> “ there will be, more or less, five hyperscale, pan-global broadband computing services giants. There will be lots of regional players, of course; mostly, they will exist to meet national needs. That is, the network computing services business will look a lot like the energy business: a half-dozen global giants, a few dozen national and/or regional concerns, followed by wildcatters and specialists.” </li></ul>
  25. 25. Final Reflections <ul><li>In my diagram below – There will be one layer added above the SaaS layer , which will be the device layer that will be realized as a result of everything moving to the cloud - Networked Refrigerators , Remote Controlled Vacuum Controllers or any and every device on the network were interesting discussions uptill now but will become a reality with the cloud. </li></ul><ul><li>The above is exactly what happened with the build-out of the last big grid – electricity in the 20 th century. A hundred years ago, when Tesla, Westinghouse, Insull, and others were building the electric grid - companies viewed the effort in terms of the cost reduction to their business: in particular, the power they needed to run the machines that produced the goods they sold. But the real revolutionary aspect of the electric grid was not the way it reduced the cost structure, but the way it created new businesses altogether. We saw an avalanche of new products outfitted with electric cords, many of which were inconceivable before the grid's arrival </li></ul>Network Device Layer Growth Engine for the next generation
  26. 26. Demos <ul><li>Project Caroline – animal guess example </li></ul><ul><li>Google App Engine – Guest Book </li></ul><ul><li>Amazon EC2 and S3 Console </li></ul>