Open Source Toolchains to Manage Cloud Infrastructure

Open Source Toolchainsto Manage CloudInfrastructureMark R. HinkleVP of CommunityCloud.comTwitter:@clouddotcom@mrhinkleEmail:mrhinkle@cloud.commrhinkle@gmail.com

2Introduction•  Responsible for Driving Adoption of CloudStack Open Source Cloud Computing Software•  Former manager of Zenoss Open Source project 100,000 users, 1.5 million downloads•  Former Linux Desktop Advocate (Zealot?)•  Former LinuxWorld Magazine Editor-in-Chief•  Open Management Consortium Conspirator•  Open Desktop Consortium Instigator•  Author - “Windows to Linux Business Desktop Migration” - Thomson•  NetDirector Project - Open Source Con guration Management Project•  Sometimes Author and Blogger at SocializedSoftware.com/NetworkWorld•  Start-up junkie, Glutton for punishment

3Agenda•  Introductions•  Cloud & Systems Management Overview•  Open Source Tools for Cloud Management•  Creating Open Source Toolchains•  Questions (and Hopefully Answers)

Cloud Computing &Systems Management Overview

5Jevon’s Paradox and the Cloud…the efficiency with which a resource is used tendsto increase (rather than decrease) the rate ofconsumption of that resource.…in cloud computing increasedconsumption can introduces signi cantmanagement overhead despite higherhardware utilization and other bene ts 1865, the English economist William Stanley Jevons

6Balancing the Equation:Creating the Cloud + =

7Balancing the Equation:Managing the Cloud + ? =

Automation Balances the 8Equation•  MeatCloud, Can’t Keep up with Cloud Computing•  Devops & Agile IT Philosophy•  Script Repetitive Tasks•  Integrate Tools•  Automate, Automate, Automate

DevOps – Agile Management for 9the Cloud•  Agile, fast moving•  Smaller incremental change•  Increased coordination across groups (development/operations)•  Eye towards Automation

10Management ToolchainsToolchain (n): MonitoringA set of tools where Patching and Provisioningthe output of onetool becomes the Con gurationinput of another tool

11The Myth of the NinesAvailability % Downtime per Downtime per Downtime per Year Month Week99.9% (three nines) 8.76 hours 43.2 minutes 10.1 minutes99.95% 4.38 hours 21.56 minutes 5.04 minutes99.99% (four nines) 52.6 minutes 4.32 minutes 1.01 minutes99.999% ( ve nines) 5.26 minutes 25.9 seconds 6.05 seconds99.9999% (six nines) 31.5 seconds 2.59 seconds .0605 seconds Average polling interval for monitoring? 5 minutes? Even superhuman operations people can’t be alerted and take action in under 5 minutes. One outage per year could drop service level to three nines or worse.

Open Source Tools toManage the Cloud

132011 CLOUD COMPUTING OUTLOOK SURVEYhttp://www.cloud.com/cloud-computing-outlook

144 Types of Management Tools Provisioning Installation of operating systems and other softwareConfiguration ManagementSets the parameters for servers, can specifyinstallation parameters Orchestration/Automation Automate tasks across systemsMonitoringRecords errors and health of IT infrastructure

15Cloudy Tools•  Network Capable•  Cloud “Aware”•  Easy-to-Integrate•  Adhere to Open Standards•  Lend Themselves to Automation

Open Source 16Provisioning Tools Year Started Language License Installation TargetsCobbler 2007 Python GPL Red Hat, OpenSUSE Fedora, Debian, UbuntuFully Automatic 2000 Perl GPL DebianInstallation (FAI)Kickstart ? Python GPL Most .dep and RPM based Linux distrosSpacewalk 2008 Perl, Python, Java GPL Fedora, CentosCrowbar/Chef 2011 Ruby Apache ?

Open Source 17Conﬁguration Management Tools Year Started Language License Client/ServerBcfg2 2003 Python BSD YesCfengine 1993 C Apache YesChef 2009 Ruby Apache Chef Solo – No Chef Server - YesPuppet 2004 Ruby GPL yes

Open Source 18Monitoring Tools Year Started License Language Type of Collection Monitoring MethodsCacti (RRDTool) 2001 GPL PHP Performance SNMP, syslogNagios 1999 GPL C/PHP Availability SNMP,TCP, ICMP, IPMI, syslogOpenNMS 2000 GPL Java Availability/ SNMP, PerformanceZabbix 2001 GPL C/PHP Availability/ SNMP, TCP/ICMP, Performance and IPMI, Synthetic more TransactionsZenoss 2005 GPL Python Availability, SNMP, ICMP, SSH, Performance, Event syslog, WMI Management

Open Source 19Automation/Orchestration Tools Year Language License Client/ Support Started Server OrganizationCapistrano 2006 Ruby MIT Yes NoneRunDeck 2010 Java Apache Yes DTO SolutionsFunc 2007 Python GPL Yes Fedora ProjectMCollective 2009 Ruby Apache Yes PuppetLabs

20Cloud APIs Aren’t Created EqualOpen Source AbstractionsAPI Languagejclouds javadeltacloud pythonLib cloud pythonFog Ruby

Open Source ManagementToolchains

22Toolchain Concept Source:http://code.google.com/p/devops-toolchain/wiki/ArchitectureComponents

23Automated Toolchain Capistrano Command and Application Service RunDeck Fabric Control Orchestration Func Provisioning Activity BCFG2 Con guration Cfengine System Con guration Chef Puppet Cloud: OS Install: Eucalyptus Kickstart Cloud Image OS OpenStack Cobbler Bootstrapping Launch Install CloudStack Spacewalk Abiquo

24Example: GeekNet•  Servers are automatically built using con guration management software (Puppet)•  Discovery tool (Zenoss) nds infrastructure and populates a CMDB then spits out Hundreds of servers, information to scripts that translate serving web, databases, information to BIND con gurations for DNS and other infrastructure•  Monitoring tool adds hosts to polling tool for some of the world’s (Nagios) to check servers for availability most highly traﬃcked•  As infrastructure changes systems are updated websites – over 40 million automatically visitors per month.•  Servers can be spun up and managed in minutes, not hours automatically with little or no human interaction

Example Toolchain: 25Online Gaming Studio

Questions?

27Contact Me Professional: mrhinkle@cloud.com Personal: mrhinkle@gmail.com Professional: mrhinkle@cloud.com Personal: mrhinkle@gmail.com Professional: http://open.cloud.com Personal: http://socializedsoftware.com Mark R. Hinkle VP of Community Twitter: Open Source Enthusiast @clouddotcom @mrhinkle

Open Source Toolchains to Manage Cloud Computinghttp://www.slideshare.net/socializedsoftwareby Mark R. Hinkle is licensed under a Creative Commons Attribution-ShareAlike 3.0 United States License.

Open Source Toolchains to Manage Cloud Infrastructure

by Mark Hinkle

Accessibility

Categories

Upload Details

Usage Rights

2 Embeds 2

Statistics

Open Source Toolchains to Manage Cloud Infrastructure Presentation Transcript

http://twitter.com	1
http://www.techgig.com	1