Crash Course in Open Source Cloud Computing
•Download as PPTX, PDF•
4 likes•1,675 views
Slides from June 2011 talk," Crash Course in Open Source Cloud Computing", presented at the Southeast LinuxFest.
![%whoami ,[object Object]](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Crash Course in Open Source Cloud Computing
Similar to Crash Course in Open Source Cloud Computing (20)
More from Mark Hinkle
More from Mark Hinkle (18)
Recently uploaded
Recently uploaded (20)
Crash Course in Open Source Cloud Computing
- 1. Crash Course in Open Source Cloud Computing Mark R. Hinkle VP of Community Cloud.com Twitter: @mrhinkle Email: mrhinkle@gmail.com
- 3. Former manager of Zenoss Open Source project 100,000 users, 1.5 million downloads
- 4. Former Linux Desktop Advocate (Zealot?)
- 5. Former LinuxWorld Magazine Editor-in-Chief
- 6. Open Management Consortium Conspirator
- 7. Open Desktop Consortium Instigator
- 8. Author - “Windows to Linux Business Desktop Migration” - Thomson
- 9. NetDirector Project - Open Source Configuration Management Project
- 10. Sometimes Author and Blogger at SocializedSoftware.com/NetworkWorld
- 12. Agenda Cloud Computing Trends Quick Cloud Computing Overview Open Source Building Blocks for Cloud Computing Open Source Tools for Cloud Management Questions
- 13. Cloud Computing:Cloud Computing Trends http://www.dilbert.com/strips/comic/2011-01-07/
- 14. Recent Study on Cloud Computing Preferences 521 IT Professionals Surveyed Cloud.com, BitNami and Zenoss User Communities Conducted Q2 of 2011 Publishing week of June 12th
- 15. Top Reasons For Cloud Computing Adoption
- 17. Cloud Service Model Usage Services Models Consumed by Cloud Computing Users in 2011
- 18. Why Open Source? Typically User-Driven to solve real problems Larger user base, users helping users Lower barrier to participation Aggressive release cycles – stay current with the state of the art Try before you “buy”, no Brochure-ware, no “Powerpoint software Open data, Open standards, Open APIs
- 19. Quick Cloud Computing Overview: Or the Obligatory “What is the Cloud?” Slides
- 20. Five Characteristics of Clouds On-Demand Self-Service Broad Network Access Resource Pooling Rapid Elasticity Measured Service
- 21. Cloud Computing Service Models USER CLOUD a.k.a. SOFTWARE AS A SERVICE Single application, multi-tenancy, network-based, one-to-many delivery of applications, all users have same access to features. Examples: Salesforce.com, Google Docs, Red Hat Network/RHEL DEVELOPMENT CLOUD a.k.a. PLATFORM-AS-A-SERVICE Application developer model, Application deployed to an elastic service that autoscales, low administrative overhead. No concept of virtual machines or operating system. Code it and deploy it. Examples: Google AppEngine, Windows Azure, Rackspace Site, Red Hat Makara SYSTEMS CLOUD a.k.a INFRASTRUCTURE-AS-A-SERVICE Servers and storage are made available in a scalable way over a network. Examples: EC2,Rackspace CloudFiles, OpenStack, CloudStack, Eucalyptus, Ubuntu Enterprise Cloud, OpenNebula SaaS PaaS IaaS
- 22. Deployment Models Public, Private & Hybrid Clouds
- 23. Building Compute Cloudswith Open Source Software
- 24. Cloud Still Requires Architectural Design Cloud Computing isn’t a “magical solution” Need to design your architecture with the end in mind As you build it make your infrastructure easily replicable
- 25. Open Source Hypervisors Open Source Xen, Xen Cloud Platform (XCP) KVM – Kernel-based Virtualization VirtualBox* - Oracle supported Virtualization Solutions OpenVZ* - Container-based, Similar to Solaris Containers or BSD Zones LXC – User Space chrooted installs Proprietary VMware Citrix Xenserver Microsoft Hyper-V Oracle VM
- 26. Open Source Compute Clouds Ubuntu Enterprise Cloud
- 27. Open Source Cloud Computing Storage GlusterFS – Scale Out NAS system aggregating storage over Ethernet or Infiniband CEPH – Distributed file storage system OpenStack Object Storage (SWIFT) – Long-term storage object storage system Sheepdog – Distributed storage for KVM hypervisors NFS – Old standby, tried and true, not designed for cloud scale or performance
- 28. Cloud APIs Aren’t Created EqualOpen Source Abstractions jclouds libcloud deltacloud fog
- 29. Private Cloud Architecture API Abstractions
- 30. Managing Clouds with Open Source Tools
- 32. Devops & Agile IT Philosophy
- 35. What Makes Tools Cloudy? Network Capable Cloud “Aware” Easy-to-Integrate Adhere to Open Standards Lend Themselves to Automation
- 36. The Myth of the Nines Average polling interval for monitoring? 5 minutes? Even superhuman operations people can’t be alerted and take action in under 5 minutes. One outage per year could drop service level to three nines or worse.
- 37. 4 Types of Management Tools Provisioning Installation of operating systems and other software Configuration Management Sets the parameters for servers, can specify installation parameters Orchestration/Automation Automate tasks across systems Monitoring Records errors and health of IT infrastructure
- 38. Management Toolchains Toolchain (n): A set of tools where the output of one tool becomes the input of another tool
- 39. Open Source Provisioning Tools
- 40. Open SourceConfiguration Management Tools
- 42. Open Source Automation/Orchestration Tools
- 43. Automated Toolchain Application Service Orchestration Capistrano RunDeck Fabric Func Command and Control System Configuration BCFG2 Cfengine Chef Puppet Configuration Provisioning Activity Cloud Image Launch OS Install Cloud: Eucalyptus OpenStack CloudStack Abiquo OS Install: Kickstart Cobbler Spacewalk Bootstrapping
- 44. Questions?
- 45. Contact Me Professional: mrhinkle@cloud.com Personal: mrhinkle@gmail.com Professional: mrhinkle@cloud.com Personal: mrhinkle@gmail.com Mark R. Hinkle VP of Community Open Source Enthusiast Professional: http://open.cloud.com Personal: http://socializedsoftware.com Twitter: @mrhinkle
- 46. Delivering Infrastructure-as-a-Service with Open Source Softwareby Mark R. Hinkle is licensed under a Creative Commons Attribution-ShareAlike 3.0 United States License.
Editor's Notes
- IAAS deployments Compute and Storage
- From the NIST Cloud Computing On-demand self-service. A consumer can unilaterally provision computing capabilities, such as server time and network storage, as needed automatically without requiring human interaction with each service’s provider.Broad network access. Capabilities are available over the network and accessed through standard mechanisms that promote use by heterogeneous thin or thick client platforms (e.g., mobile phones, laptops, and PDAs).Resource pooling.The provider’s computing resources are pooled to serve multiple consumers using a multi-tenant model, with different physical and virtual resources dynamically assigned and reassigned according to consumer demand. There is a sense of location independence in that the customer generally has no control or knowledge over the exact location of the provided resources but may be able to specify location at a higher level of abstraction (e.g., country, state, or datacenter). Examples of resources include storage, processing, memory, network bandwidth, and virtual machines.This is different than virtual private hosting which is constrained to a single host or hosted Exchange server with fixed storage limits. Rapid elasticity.Capabilities can be rapidly and elastically provisioned, in some cases automatically, to quickly scale out, and rapidly released to quickly scale in. To the consumer, the capabilities available for provisioning often appear to be unlimited and can be purchased in any quantity at any time.Measured Service. Cloud systems automatically control and optimize resource use by leveraging a metering capability1 at some level of abstraction appropriate to the type of service (e.g., storage, processing, bandwidth, and active user accounts). Resource usage can be monitored, controlled, and reported, providing transparency for both the provider and consumer of the utilized service.
- Cloud Software as a Service (SaaS) – The Application CloudThe capability provided to the consumer is to use the provider’s applications running on a cloud infrastructure. The applications are accessible from various client devices through a thin client interface such as a web browser (e.g., web-based email). The consumer does not manage or control the underlying cloud infrastructure including network, servers, operating systems, storage, or even individual application capabilities, with the possible exception of limited user-specific application configuration settings.Cloud Platform as a Service (PaaS) – The Development Cloud The capability provided to the consumer is to deploy onto the cloud infrastructure consumer-created or acquired applications created using programming languages and tools supported by the provider. The consumer does not manage or control the underlying cloud infrastructure including network, servers, operating systems, or storage, but has control over the deployed applications and possibly application hosting environment configurations.Cloud Infrastructure as a Service (IaaS). – Systems CloudThe capability provided to the consumer is to provision processing, storage, networks, and other fundamental computing resources where the consumer is able to deploy and run arbitrary software, which can include operating systems and applications. The consumer does not manage or control the underlying cloud infrastructure but has control over operating systems, storage, deployed applications, and possibly limited control of select networking components (e.g., host firewalls).
- Private cloudThe cloud infrastructure is operated solely for an organization. It may be managed by the organization or a third party and may exist on premise or off premise.Public cloudThe cloud infrastructure is made available to the general public or a large industry group and is owned by an organization selling cloud services.Hybrid cloudThe cloud infrastructure is a composition of two or more clouds (private, community, or public) that remain unique entities but are bound together by standardized or proprietary technology that enables data and application portability (e.g., cloud bursting for load balancing between clouds).
- Top choices for Cloud Computing are Xen and KVM OpenVZ, container virtualization for Linux, is an interesting option as it has a very minimal overhead to scale application space similar to containers like BSD Jails. Advantage is that memory allocation is soft and unutilized memory can be used by other applications.
- GlusterFS is an open source scale-out NAS solution. The software is a powerful and flexible solution that simplifies the task of managing unstructured file data whether you have a few terabytes of storage or multiple petabytes.Ceph is a distributed network storage and file system designed to provide excellent performance, reliability, and scalability. Ceph is based on a reliable and scalable distributed object store, with a distributed metadata management cluster layered on top to provide a distributed file system with POSIX semantics. There are a variety of ways to interact with the systemOpenStack Object Storage (code-named Swift) is open source software for creating redundant, scalable object storage using clusters of standardized servers to store petabytes of accessible data. It is not a file system or real-time data storage system, but rather a long-term storage system for a more permanent type of static data that can be retrieved, leveraged, and then updated if necessary. Primary examples of data that best fit this type of storage model are virtual machine images, photo storage, email storage and backup archiving. Having no central "brain" or master point of control provides greater scalability, redundancy and permanence.Sheepdog is a distributed storage system for QEMU/KVM. It provides highly available block level storage volumes that can be attached to QEMU/KVM virtual machines. Sheepdog scales to several hundreds nodes, and supports advanced volume management features such as snapshot, cloning, and thin provisioning.
- Types of Tasks Accomplished by an APIProvisioning (creating, re-creating, moving, or deleting components e.g. virtual machines, vlans)Configuration (assigning or changing attributes of the architecture such as security and network settings)Cloud ProvidersJclouds – java API Abstraction Libcloud – started by CloudKick (now Rackspace) to abstract clouds, Apache incubator projectDeltacloud – started by Red Hat to abstract clouds, Apache incubator projectFog - provider and abstraction level API across compute and storage, written in Ruby
- Derived from the NIST Diagram
- Cloud computing promises highly available systems, but if you have a reactive approach you won’t achieve that goal. If you want a five nines service level you have 5.26 minutes to find, fix and recoverBuild redundant, highly environment systems
- Other disciplines like back-up, log management, performance and security (virus,intrusion detection) are important but not core to the delivery of cloud computing systems
- Ideally for the cloud you create management toolchains that automate the management of your cloud.