Cloudy Operations - OSCON 2010

Private Public SaaS PaaS PaaS IaaS IaaS Managed Virtualization hosting Slide courtesy Alistair Croll - alistair@rednod.com Thursday, July 29, 2010

Private Public nt t o SaaS a w d s, o u lo u y c If l k PaaS rs t.PaaS t a ne f i i ck o IaaS p IaaS Managed Virtualization hosting Slide courtesy Alistair Croll - alistair@rednod.com Thursday, July 29, 2010

Infrastructure as a Service (IaaS) Amazon EC2, Rackspace Cloud, Terremark, Gogrid, Joyent (and nearly every private cloud built on Zenserver or VMWare.) Slide courtesy Alistair Croll - alistair@rednod.com Thursday, July 29, 2010

Cloudy Operations Thursday, July 29, 2010

Fully Automated Infrastructure Control Provisioning Release Orchestration Deploy CI Server Issue tracker Artifact Config repository Dispatcher SCM management Build Repository OS boot/ Scheduler install Code Workflows Model Resources Configuration Events Trending Asset Identity inventory Trending Reporting Topology Host naming CMDB Monitoring Sources Copyright © 2010 Opscode, Inc - All Rights Reserved 9 Thursday, July 29, 2010

Network Operations Systems Administrators Software Developers Database Administrators Storage Management Project Management Change Management Continuity Planning Risk Management Web Design Performance Compliance ( ) Architecture * in no Tooling particular Testing order Security Reporting Facilities Thursday, July 29, 2010

Cloudy Monitoring Nagios Performance Collectd Log jcollectd Alerts Ganglia Event Zenoss Correlation JMX Capacity Analytics Copyright © 2010 Opscode, Inc - All Rights Reserved 12 Thursday, July 29, 2010

Cloudy Monitoring Nagios Performance Collectd Log jcollectd Alerts Ganglia Event Zenoss Correlation JMX Capacity OpenNMS Analytics Copyright © 2010 Opscode, Inc - All Rights Reserved 12 Thursday, July 29, 2010

Cloudy Monitoring Nagios Performance Collectd Log jcollectd Alerts Ganglia Event Zenoss Correlation JMX Capacity OpenNMS Analytics Munin Copyright © 2010 Opscode, Inc - All Rights Reserved 12 Thursday, July 29, 2010

Systems Integration Load Balancer Recipes haproxy Web Server Web Server apache2 myssql DB Master DB Slave DB Slave Disk Disk Disk Copyright © 2010 Opscode, Inc - All Rights Reserved 16 Thursday, July 29, 2010

Role Based Conﬁguration name "webserver" description "Systems that serve HTTP traffic" run_list( "role[base]", "recipe[apache2]", "recipe[apache2::mod_ssl]" ) default_attributes( "apache" => { "listen_ports" => [ "80", "443" ] } ) override_attributes( "apache" => { "max_children" => "50" } ) Copyright © 2010 Opscode, Inc - All Rights Reserved 17 Thursday, July 29, 2010

For Developers... Thursday, July 29, 2010

For Developers... • Self Service Operations Thursday, July 29, 2010

For Developers... • Self Service Operations • The infrastructure is the application (and vice versa) Thursday, July 29, 2010

For Developers... • Self Service Operations • The infrastructure is the application (and vice versa) • Minimize Bottlenecks Thursday, July 29, 2010

For Developers... • Self Service Operations • The infrastructure is the application (and vice versa) • Minimize Bottlenecks • The “Right” Tools Thursday, July 29, 2010

Operations http://covers.oreilly.com/images/9780596007836/lrg.jpg Lean into it appears courtesy of Cliff Moon, of Dynomite fame: http://twitter.com/moonpolysoft Thursday, July 29, 2010

Operations • Say “Yes”. http://covers.oreilly.com/images/9780596007836/lrg.jpg Lean into it appears courtesy of Cliff Moon, of Dynomite fame: http://twitter.com/moonpolysoft Thursday, July 29, 2010

Operations • Say “Yes”. • You never liked rack and stack that much anyway. http://covers.oreilly.com/images/9780596007836/lrg.jpg Lean into it appears courtesy of Cliff Moon, of Dynomite fame: http://twitter.com/moonpolysoft Thursday, July 29, 2010

Operations • Say “Yes”. • You never liked rack and stack that much anyway. • You have never been more critical. http://covers.oreilly.com/images/9780596007836/lrg.jpg Lean into it appears courtesy of Cliff Moon, of Dynomite fame: http://twitter.com/moonpolysoft Thursday, July 29, 2010

Operations • Say “Yes”. • You never liked rack and stack that much anyway. • You have never been more critical. • Just get out of the way. http://covers.oreilly.com/images/9780596007836/lrg.jpg Lean into it appears courtesy of Cliff Moon, of Dynomite fame: http://twitter.com/moonpolysoft Thursday, July 29, 2010

Infrastructure as Code is... A technical domain revolving around building and managing infrastructure programmatically http://www.ﬂickr.com/photos/kwerfeldein/2634561264/sizes/o/ Copyright © 2010 Opscode, Inc - All Rights Reserved 29 Thursday, July 29, 2010

Enable the reconstruction of the business from nothing but a source code repository, an application data backup, and bare metal resources. Copyright © 2010 Opscode, Inc - All Rights Reserved 30 Thursday, July 29, 2010

A Tornado Hits Your Data http://www.ﬂickr.com/photos/gi/518613153/sizes/o/ Thursday, July 29, 2010

A Tornado Hits Your Data • Pause your movie http://www.ﬂickr.com/photos/gi/518613153/sizes/o/ Thursday, July 29, 2010

A Tornado Hits Your Data • Pause your movie • Sign into your cloud provider http://www.ﬂickr.com/photos/gi/518613153/sizes/o/ Thursday, July 29, 2010

A Tornado Hits Your Data • Pause your movie • Sign into your cloud provider • Upload your offsite backups http://www.ﬂickr.com/photos/gi/518613153/sizes/o/ Thursday, July 29, 2010

A Tornado Hits Your Data • Pause your movie • Sign into your cloud provider • Upload your offsite backups • Provision, conﬁg and integrate the new servers http://www.ﬂickr.com/photos/gi/518613153/sizes/o/ Thursday, July 29, 2010

A Tornado Hits Your Data • Pause your movie • Sign into your cloud provider • Upload your offsite backups • Provision, conﬁg and integrate the new servers • Change DNS to point to “Hit by Tornado” page http://www.ﬂickr.com/photos/gi/518613153/sizes/o/ Thursday, July 29, 2010

A Tornado Hits Your Data • Pause your movie • Sign into your cloud provider • Upload your offsite backups • Provision, conﬁg and integrate the new servers • Change DNS to point to “Hit by Tornado” page • Restore the customer and application data http://www.ﬂickr.com/photos/gi/518613153/sizes/o/ Thursday, July 29, 2010

A Tornado Hits Your Data • Pause your movie • Sign into your cloud provider • Upload your offsite backups • Provision, conﬁg and integrate the new servers • Change DNS to point to “Hit by Tornado” page • Restore the customer and application data • Remove the “Hit by Tornado” page http://www.ﬂickr.com/photos/gi/518613153/sizes/o/ Thursday, July 29, 2010

A Tornado Hits Your Data • Pause your movie • Sign into your cloud provider • Upload your offsite backups • Provision, conﬁg and integrate the new servers • Change DNS to point to “Hit by Tornado” page • Restore the customer and application data • Remove the “Hit by Tornado” page • Unpause movie http://www.ﬂickr.com/photos/gi/518613153/sizes/o/ Thursday, July 29, 2010

A Tornado Hits Your Data • Pause your movie • Chapter 5 Sign into your cloud provider Infrastructure • Upload your offsite backups as Code • Provision, conﬁg and Jacob the new servers Adam integrate • Change DNS to point to “Hit by Tornado” page • Restore the customer and application data • Remove the “Hit by Tornado” page • Unpause movie http://www.ﬂickr.com/photos/gi/518613153/sizes/o/ Thursday, July 29, 2010

In a Cloudy World Your Prime Constraint Should Be The time it takes to restore your application data http://www.ﬂickr.com/photos/visualage/2126833132/sizes/o/ Copyright © 2010 Opscode, Inc - All Rights Reserved 32 Thursday, July 29, 2010

Recipies Applies resources in the order they are speciﬁed http://www.ﬂickr.com/photos/roadsidepictures/2478953342/sizes/o/ Thursday, July 29, 2010

Recipies Applies resources in the order they are speciﬁed • Can include other recipes. http://www.ﬂickr.com/photos/roadsidepictures/2478953342/sizes/o/ Thursday, July 29, 2010

Recipies Applies resources in the order they are speciﬁed • Can include other recipes. • A DSL like Ruby. http://www.ﬂickr.com/photos/roadsidepictures/2478953342/sizes/o/ Thursday, July 29, 2010

Tale of Two Startups “Traditional” Operations Operations - The “Secret Sauce” 50 50 40 40 # of Hours 30 30 20 20 Hardware OS Install 10 10 Conﬁg Upkeep 20 20 15 15 Servers 10 10 New 5 5 Existing 0 0 1 2 3 4 5 6 7 9 10 11 12 1 2 3 4 5 6 7 9 10 11 12 Week # Week # (http://radar.oreilly.com/archives/2007/10/operations-advantage.html) Copyright © 2010 Opscode, Inc - All Rights Reserved 35 Thursday, July 29, 2010

Tale of Two Startups “Traditional” Operations Operations - The “Secret Sauce” 50 50 This is the secret of 40 40 Cloud Computing. Every other virtue stems from # of Hours 30 30 here. 20 20 Hardware OS Install 10 10 Conﬁg Upkeep 20 20 15 15 Servers 10 10 New 5 5 Existing 0 0 1 2 3 4 5 6 7 9 10 11 12 1 2 3 4 5 6 7 9 10 11 12 Week # Week # (http://radar.oreilly.com/archives/2007/10/operations-advantage.html) Copyright © 2010 Opscode, Inc - All Rights Reserved 35 Thursday, July 29, 2010

Thursday, July 29, 2010

A Period of Combinatorial Innovation Thursday, July 29, 2010

A Period of Combinatorial Innovation • Abstract and fault tolerant components Thursday, July 29, 2010

A Period of Combinatorial Innovation • Abstract and fault tolerant components • Integrated network accessible services Thursday, July 29, 2010

A Period of Combinatorial Innovation • Abstract and fault tolerant components • Integrated network accessible services • Unlimited infrastructure Thursday, July 29, 2010

http://blog.zenoss.com	5004
http://www.opscode.com	81
http://feeds.feedburner.com	11
http://translate.googleusercontent.com	7
http://opscode.com	2
http://webcache.googleusercontent.com	2

Cloudy Operations - OSCON 2010

by Opscode, Inc.

Accessibility

Upload Details

Usage Rights

6 Embeds 5,107

Statistics