Successfully reported this slideshow.

Crash Course on Open Source Cloud Computing


Published on

Fourth update to these slides, still working on them but wanted them to be available for CloudCamp RTP


- Appliance Creation Tools
- Added Bitnami, Boxgrinder, SuseStudio
- Removed marginal tools for Cloud (BFCG2, OpenNMS)
- Added logstash

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

Crash Course on Open Source Cloud Computing

  1. 1. Crash Course in OpenSource CloudComputingMark R. HinkleDirector, Cloud Computing CommunityCitrix Systems Inc.Twitter: @mrhinkleEmail:
  2. 2. 2Agenda1.  Introduction2.  Quick Cloud Computing Overview3.  Open Source Building Blocks for Cloud Computing4.  Open Source Tools for Cloud Management5.  Questions
  3. 3. 3%whoami•  Responsible for Driving Adoption of CloudStack Open Source Cloud Computing Software•  Joined Citrix via acquisition July 2011•  Former manager of Zenoss Open Source project 100,000 users, 1.5 million downloads•  Former Linux Desktop Advocate (Zealot?)•  Former LinuxWorld Magazine Editor-in-Chief•  Open Management Consortium organizer•  Author - “Windows to Linux Business Desktop Migration” – Thomson•  NetDirector Project - Open Source Con guration Management Project•  Sometimes Author and Blogger at
  4. 4. Quick Cloud ComputingOverview: Or the Obligatory“What is the Cloud?” Slides
  5. 5. 5Five Characteristics of Clouds1. On-Demand Self-Service2. Broad Network Access3. Resource Pooling4. Rapid Elasticity5. Measured Service
  6. 6. 6Cloud Computing Service Models USER CLOUD a.k.a. SOFTWARE AS A SERVICE Single application, multi-tenancy, network-based, one-to-many delivery of applications, all users have same access to features. Examples:, Google Docs, Red Hat Network/RHEL DEVELOPMENT CLOUD a.k.a. PLATFORM-AS-A-SERVICE Application developer model, Application deployed to an elastic service that autoscales, low administrative overhead. No concept of virtual machines or operating system. Code it and deploy it. Examples: Google AppEngine, Windows Azure, Rackspace Site, Red Hat Makara SYSTEMS CLOUD a.k.a INFRASTRUCTURE-AS-A-SERVICE Servers and storage are made available in a scalable way over a network. Examples: EC2,Rackspace CloudFiles, OpenStack, CloudStack, Eucalyptus, Ubuntu Enterprise Cloud, OpenNebula
  7. 7. Deployment Models 7Public, Private & Hybrid Clouds
  8. 8. Cloud Still Requires 8Architectural Design•  Cloud Computing isn’t a “magical solution”•  Need to design your architecture with the end in mind•  As you build it make your infrastructure easily replicable
  9. 9. Building Compute Cloudswith Open Source Software
  10. 10. 10Why Open Source?•  Typically User-Driven Solutions to Real Problems•  Larger user base, users helping users•  Lower barrier to participation•  Aggressive release cycles – stay current with the state-of-the-art•  Try before you “buy”, no Brochure-ware, no “Powerpoint software•  Open data, Open standards, Open APIs
  11. 11. 11Open Virtual Machine FormatsOpen Virtualization Format (OVF) is an openstandard for packaging and distributing virtualappliances or more generally software to be runin virtual machines.An OVF package consists of several files, placedin one directory. A one-file alternative is the OVApackage, which is a TAR file with the OVFdirectory inside.
  12. 12. Tools for Creating OSS VMs and 12Cloud Appliances
  13. 13. 13Open Source HypervisorsOpen Source•  Xen, Xen Cloud Platform (XCP)•  KVM – Kernel-based Virtualization•  VirtualBox* - Oracle supported Virtualization Solutions•  OpenVZ* - Container-based, Similar to Solaris Containers or BSD Zones•  LXC – User Space chrooted installsProprietary•  VMware•  Citrix Xenserver•  Microsoft Hyper-V•  Oracle VM
  14. 14. 14Open Source Compute Clouds Year Started License Hypervisors Supported 2008 GPL Xen Cloud Platform, Xen Cloud Platform, KVM, VMware 2008 GPL Xen, KVM, VMware 2010 Apache VMware ESX and ESXi, (Developed by Microsoft Hyper-V, Xen, NASA by Anso KVM and Virtual Box Labs peviously) Other open source compute software include Abiquo and OpenNebula Numerous companies are building cloud software on OpenStack including Nebula, Piston Inc.
  15. 15. Open Source Platform-as-a- 15Service Year Started Sponsors Hypervisors Supported 2011 VMware Spring, Rails, Node.js 2011 Red Hat Express – Ruby, Php and Python Flex – Jboss, Java EE6 2010 WSO2 Jboss, Java EE6
  16. 16. Open Source 16Cloud Computing Storage•  GlusterFS – Scale Out NAS system aggregating storage over Ethernet or Infiniband•  CEPH – Distributed file storage system developed by DreamHost•  OpenStack Object Storage (SWIFT) – Long-term storage object storage system•  Sheepdog – Distributed storage for KVM hypervisors•  NFS – Old standby, tried and true, not designed for cloud scale or performance
  17. 17. Cloud APIs Aren’t Created Equal 17Open Source Abstractions•  jclouds•  libcloud•  deltacloud•  fog
  18. 18. 18Private Cloud Architecture API Abstractions
  19. 19. Managing Clouds withOpen Source Tools
  20. 20. Automation Unlocks 20the Potential of the Cloud•  MeatCloud, Can’t Keep up with Cloud Computing•  Devops & Agile IT Philosophy•  Script Repetitive Tasks•  Automate, Automate, Automate
  21. 21. 21Why Open Source Tools?•  Aggressively Developed, Keep Pace with State-of-the- Art•  User-Developed and Instrumented•  Easy to Assemble into Automated Toolchains
  22. 22. 22What Makes Tools Cloudy?•  Network Capable•  Cloud “Aware”•  Easy-to-Integrate•  Adhere to Open Standards•  Lend Themselves to Automation
  23. 23. 23The Myth of the NinesAvailability % Downtime per Downtime per Downtime per Year Month Week99.9% (three nines) 8.76 hours 43.2 minutes 10.1 minutes99.95% 4.38 hours 21.56 minutes 5.04 minutes99.99% (four nines) 52.6 minutes 4.32 minutes 1.01 minutes99.999% ( ve nines) 5.26 minutes 25.9 seconds 6.05 seconds99.9999% (six nines) 31.5 seconds 2.59 seconds .0605 seconds Average polling interval for monitoring? 5 minutes? Even superhuman operations people can’t be alerted and take action in under 5 minutes. One outage per year could drop service level to three nines or worse.
  24. 24. 244 Types of Management Tools Provisioning Installation of operating systems and other softwareConfiguration ManagementSets the parameters for servers, can specifyinstallation parameters Orchestration/Automation Automate tasks across systemsMonitoringRecords errors and health of IT infrastructure
  25. 25. 25Management ToolchainsToolchain (n): MonitoringA set of tools wherethe output of one Patching and Provisioningtool becomes theinput of another tool Con guration
  26. 26. Open Source 26Provisioning Tools Year Started Language License Installation TargetsCobbler (Plus 2007 Python GPL Red Hat,koan for PXE OpenSUSEboot of VMs) Fedora, Debian, UbuntuKickstart ? Python GPL Most .dep and RPM based Linux distrosSpacewalk 2008 Perl, Python, Java GPL Fedora, CentosCrowbar 2011 Ruby Apache (Bare metal provisioning)
  27. 27. Open Source 27Configuration Management Tools Year Started Language License Client/ServerCfengine 1993 C Apache YesChef 2009 Ruby Apache Chef Solo – No Chef Server - YesPuppet 2004 Ruby GPL yes
  28. 28. Open Source 28Monitoring Tools Year Started License Language Type of Collection Monitoring MethodsCacti / 2001 GPL PHP Performance SNMP, syslogRRDToolNagios 1999 GPL C/PHP Availability SNMP,TCP, ICMP, IPMI, syslogZabbix 2001 GPL C/PHP Availability/ SNMP, TCP/ Performance ICMP, IPMI, and more Synthetic TransactionsZenoss 2005 GPL Python Availability, SNMP, ICMP, Performance, SSH, syslog, Event WMI Management
  29. 29. Open Source 29Automation/Orchestration Tools Year Language License Client/ Support Started Server OrganizationCapistrano 2006 Ruby MIT Yes NoneRunDeck 2010 Java Apache Yes DTO SolutionsFunc 2007 Python GPL Yes Fedora ProjectMCollective 2009 Ruby Apache Yes PuppetLabs
  30. 30. Aggregated Logging/Event 30Management logstash is a tool for managing your logs. It helps you take logs and other event data from your systems and move it into a central place. logstash is open source and completely free. You can nd support on the mailing list and on IRC.
  31. 31. 31Automated Toolchain Capistrano Command and Application Service RunDeck Fabric Control Orchestration Func Provisioning Activity BCFG2 Con guration Cfengine System Con guration Chef Puppet Cloud: OS Install: Abiquo Kickstart Cloud Image OS CloudStack Cobbler Bootstrapping Launch Install Eucalyptus Spacewalk OpenStack
  32. 32. Questions? Slides Can be Viewed and Downloaded at:
  33. 33. 33Contact Me Professional: Personal: Professional: Personal: 919.522.3520 Mark R. Hinkle Professional: Personal: Director, Cloud Computing Community Citrix Systems Inc. Open Source Enthusiast Twitter: @mrhinkle
  34. 34. Crash Course in Open Source Cloud Computing by Mark R. Hinkle is licensed under a Creative Commons Attribution- ShareAlike 3.0 United States License.