Crowbar & OpenStack
OpenStack Boston Users Group
Picking an Installer
         Deployment types                          Aspects
  Experimentation                        Open source / proprietary
       Kick the tires, exploratory
                                         Live pull / Packaged
  Development
       Test internal logic               All-In-One / Multi node
       Simulate HW                       Real HW / Simulated
  PoC / Testing -                        Internet Access / Stand
       Just enough to run a handful of   Alone
       servers
  Production                             Flexibility
       Full Stack                        Completeness
       Ops - Monitoring, management

Dell Cloud Solutions                 2
Some Installers

Aspects                     DevStack   LiveCloud     Stackops      Crowbar
Open source / proprietary   OS         OS            Prop          OS
Live pull / Packaged        Live       Packaged      Live          Packaged
All-In-One / Multi node     SAIO       SAIO          Both          Both
Real HW / simulate          Simulate   Simulate      HW            Both
Flexibility                 Very       Little        Very Little   Very
Tethered / Stand-Alone      Tethered   Stand-Alone   Tethered      Stand-Alone
Completeness                full       little        little        High
Target                      Devs       Eval          PoC           Production
Dell Cloud Solutions                      3
Clouds require an Operational Focus


                             Clouds demand significant
                             operational and process controls

        SW
                             Operational decisions drive
                       OPS
                             hardware and software decisions
        HW

                             We are finding ways to productize
                             operations into best practices

Dell Cloud Solutions           4
Dell OpenStack Cloud Solution


                                         “Crowbar”
                                          CloudOps


                                  SW
                             SW           Software
                                  OPS
                                   OPS
               Reference     HW
              Architecture               Services &
                                         Consulting

Dell Cloud Solutions          5
How DevOps is Different
                   Images vs. Layers



Dell Cloud Solutions      6
What is DevOps?


         DevOps is an operational approach that automates
         system configuration and management.

         To manage cloud systems, customers
              Need to manage servers as groups
              Must respond to rapid infrastructure changes
              Have repeatable automated deployments


Dell Cloud Solutions              7
Images vs. Layers

                          Soup                    Sandwich
             Delicious!                  Delicious!
             Fast!                       Fast!

             Premixed                    Flexible
             Hard to customize           Easy to customize
             Hard to change              Configurable
             Hard to carry               Very portable

             Every batch is unique       Components can be common

Dell Cloud Solutions                 8
Images vs. Layers: Overview

           Images: Single Unit               Layers: Stacked Pieces


                  Configuration                         Integrations




                                      Configuration
                                                       Application Foo
              Integrations +                           Application Bar
              Applications +
                Utilities +                               Utilities
             Operating System
                                                      Operating System
Dell Cloud Solutions              9
Images vs. Layers: Details

                         Images                      Layers
        Like a Compiled Language         Like an Interpreted Language
           Early Binding                    Late Binding
           Tightly Coupled                  Loosely Coupled
           Assembled as a package           Assembled in parts

        1-Step Deployment                Multi-Step Deployment
           Big Storage Footprint          Small Footprint (packages)
           Cloned from “Golden Image”     Setup per instance
           Single Version                 Discrete Versions

Dell Cloud Solutions                10
Images vs. Layers: Lifecycle

         Images: Replacement                       Layers: Upgrade




Config                 Config     Config
                                                       I                      I
                                                      Foo                    Foo




                                                Config




                                                                       Config
I+A+U+                 I+A+U+     I+A+U+
                                                     Bar v1                 Bar v2
  O/S                    O/S        O/S
                                                       U                      U
                                                      OS                     OS

                         Config                               Bar v2
                         I+A+U+
                           O/S

Dell Cloud Solutions                       11
CloudOps for OpenStack

    There are lot of pieces, but they share many elements!
                          I                     I            I                   I                I               I
                      Crowbar                              Dash                Nova             Nova            Nova
                                      Config




                                                      Config




                                                                      Config




                                                                                       Config




                                                                                                       Config
             Config




                                          Nagios
                        Chef                               Board               Cntrl             DB              API
                         U                     U             U                  U                U                U
                         OS                    OS           OS                  OS               OS              OS


                                 I               I               I               I                I               I
                               Nova            Nova            Nova            Nova             Nova            Nova
                      Config




                                      Config




                                                      Config




                                                                      Config




                                                                                       Config




                                                                                                       Config
                               Node            Node            Node            Node             Node            Node
                                U               U               U               U                U               U
                                OS              OS              OS              OS               OS              OS



Dell Cloud Solutions                                           12
CloudOps for OpenStack

    Plus interconnections are highly complex and dynamic
                          I                     I            I                   I                I               I
                      Crowbar                              Dash                Nova             Nova            Nova
                                      Config




                                                      Config




                                                                      Config




                                                                                       Config




                                                                                                       Config
             Config




                                          Nagios
                        Chef                               Board               Cntrl             DB              API
                         U                     U             U                  U                U                U
                         OS                    OS           OS                  OS               OS              OS


                                 I               I               I               I                I               I
                               Nova            Nova            Nova            Nova             Nova            Nova
                      Config




                                      Config




                                                      Config




                                                                      Config




                                                                                       Config




                                                                                                       Config
                               Node            Node            Node            Node             Node            Node
                                U               U               U               U                U               U
                                OS              OS              OS              OS               OS              OS



Dell Cloud Solutions                                           13
Cloud Deployments are Complex


Crowbar has
scripts that install
the components
of OpenStack
Nova in a proven
pattern that can
be customized
after the fact.

                             Source: Ken Pepple
 Dell Cloud Solutions   14
What is Crowbar?

    Mission: “A Zero Touch Cloud Installer”
         Servers in boxes to full function cloud in under 2 hours

         Fast & Flexible
              Bare metal install including BIOS & RAID config
              Users can choose how their system is configured (“barclamps”)
         DevOps Embracing
              Ongoing Operations Model (DevOps for Clouds)
              Leverages & Wraps Opscode Chef
         Open
              Not specific to OpenStack – Dell using for other Apps
              Not restricted to Dell hardware
              Apache 2 licensed

Dell Cloud Solutions                   15
Crowbar Stages of Deployment
                           APIs, User Access,
                                                     Includes all the components required to implement
                           & Ecosystem               an entire cloud infrastructure including ecosystems
                           Partners                  partners
         Ops Management




                                                     Pluggable components deploy cloud infrastructure.
          Dell “Crowbar”




                           Cloud
                                                     Allow for addition of Dell IP and expansion by the
                           Infrastructure &
                           Dell IP Extensions        community services and customers

                                                     Can integrate with Dell existing products
                           Core Components &         Delivers basic data center services and required
                           Operating Systems         cloud infrastructure.

                                                     Provision bare-metal servers from box to cloud
                                                     WITHOUT user intervention (other than
                           Physical Resources        racking/cabling and some minimal configuration
                                                     questions) NOT EXCLUSIVE TO DELL HARDWARE

                                  * Crowbar has potential to service other programs beyond OpenStack
Dell Cloud Solutions                            16
Modular Design: Barclamps
                           APIs, User Access,               Nagios          Ganglia        Dashboard
                           & Ecosystem
                           Partners
         Ops Management




                                                             Nova            Swift           Glance
          Dell “Crowbar”




                           Cloud
                           Infrastructure &
                           Dell IP Extensions                              Compellent      EqualLogic



                                                           Crowbar            DNS           Logging
                           Core Components &
                           Operating Systems
                                                           Deployer           NTP


                                                           Provisioner       BIOS             IPMI
                           Physical Resources
                                                           Network           RAID



                                  * Crowbar has potential to service other programs beyond OpenStack
Dell Cloud Solutions                            17
Crowbar = Install State Machine




Dell Cloud Solutions   18
Dashboard




Dell Cloud Solutions     19
Barclamps and Proposals




Dell Cloud Solutions     20
Monitoring




Dell Cloud Solutions      21
Supporting Services


    A self contained cloud requires some supporting
    services. Crowbar also includes:
      DNS: Can be forwarded to an upstream server
      NTP: Can be synced to an upstream time server
      Logging: Can be sent to a centralized logging server




Dell Cloud Solutions          22
New Features?


         Support for additional HW platforms
         Support for storage platforms
              Compellent
              Equalogic
              DX
         Networking
              10 Gig
              Integration with switching infrastructure
         OpenStack
              Volume
              Networking service

Dell Cloud Solutions                   23
Questions?
More info:
• http://Dell.com/OpenStack - White Papers & More!
• http://github.com/dellcloudedge/crowbar - Source code and instructions
• http://lists.us.dell.com/mailman/listinfo/crowbar - Discussions and
  questions

Dell openstack boston meetup dell crowbar and open stack

  • 1.
  • 2.
    Picking an Installer Deployment types Aspects Experimentation Open source / proprietary Kick the tires, exploratory Live pull / Packaged Development Test internal logic All-In-One / Multi node Simulate HW Real HW / Simulated PoC / Testing - Internet Access / Stand Just enough to run a handful of Alone servers Production Flexibility Full Stack Completeness Ops - Monitoring, management Dell Cloud Solutions 2
  • 3.
    Some Installers Aspects DevStack LiveCloud Stackops Crowbar Open source / proprietary OS OS Prop OS Live pull / Packaged Live Packaged Live Packaged All-In-One / Multi node SAIO SAIO Both Both Real HW / simulate Simulate Simulate HW Both Flexibility Very Little Very Little Very Tethered / Stand-Alone Tethered Stand-Alone Tethered Stand-Alone Completeness full little little High Target Devs Eval PoC Production Dell Cloud Solutions 3
  • 4.
    Clouds require anOperational Focus Clouds demand significant operational and process controls SW Operational decisions drive OPS hardware and software decisions HW We are finding ways to productize operations into best practices Dell Cloud Solutions 4
  • 5.
    Dell OpenStack CloudSolution “Crowbar” CloudOps SW SW Software OPS OPS Reference HW Architecture Services & Consulting Dell Cloud Solutions 5
  • 6.
    How DevOps isDifferent Images vs. Layers Dell Cloud Solutions 6
  • 7.
    What is DevOps? DevOps is an operational approach that automates system configuration and management. To manage cloud systems, customers Need to manage servers as groups Must respond to rapid infrastructure changes Have repeatable automated deployments Dell Cloud Solutions 7
  • 8.
    Images vs. Layers Soup Sandwich Delicious! Delicious! Fast! Fast! Premixed Flexible Hard to customize Easy to customize Hard to change Configurable Hard to carry Very portable Every batch is unique Components can be common Dell Cloud Solutions 8
  • 9.
    Images vs. Layers:Overview Images: Single Unit Layers: Stacked Pieces Configuration Integrations Configuration Application Foo Integrations + Application Bar Applications + Utilities + Utilities Operating System Operating System Dell Cloud Solutions 9
  • 10.
    Images vs. Layers:Details Images Layers Like a Compiled Language Like an Interpreted Language Early Binding Late Binding Tightly Coupled Loosely Coupled Assembled as a package Assembled in parts 1-Step Deployment Multi-Step Deployment Big Storage Footprint Small Footprint (packages) Cloned from “Golden Image” Setup per instance Single Version Discrete Versions Dell Cloud Solutions 10
  • 11.
    Images vs. Layers:Lifecycle Images: Replacement Layers: Upgrade Config Config Config I I Foo Foo Config Config I+A+U+ I+A+U+ I+A+U+ Bar v1 Bar v2 O/S O/S O/S U U OS OS Config Bar v2 I+A+U+ O/S Dell Cloud Solutions 11
  • 12.
    CloudOps for OpenStack There are lot of pieces, but they share many elements! I I I I I I Crowbar Dash Nova Nova Nova Config Config Config Config Config Config Nagios Chef Board Cntrl DB API U U U U U U OS OS OS OS OS OS I I I I I I Nova Nova Nova Nova Nova Nova Config Config Config Config Config Config Node Node Node Node Node Node U U U U U U OS OS OS OS OS OS Dell Cloud Solutions 12
  • 13.
    CloudOps for OpenStack Plus interconnections are highly complex and dynamic I I I I I I Crowbar Dash Nova Nova Nova Config Config Config Config Config Config Nagios Chef Board Cntrl DB API U U U U U U OS OS OS OS OS OS I I I I I I Nova Nova Nova Nova Nova Nova Config Config Config Config Config Config Node Node Node Node Node Node U U U U U U OS OS OS OS OS OS Dell Cloud Solutions 13
  • 14.
    Cloud Deployments areComplex Crowbar has scripts that install the components of OpenStack Nova in a proven pattern that can be customized after the fact. Source: Ken Pepple Dell Cloud Solutions 14
  • 15.
    What is Crowbar? Mission: “A Zero Touch Cloud Installer” Servers in boxes to full function cloud in under 2 hours Fast & Flexible Bare metal install including BIOS & RAID config Users can choose how their system is configured (“barclamps”) DevOps Embracing Ongoing Operations Model (DevOps for Clouds) Leverages & Wraps Opscode Chef Open Not specific to OpenStack – Dell using for other Apps Not restricted to Dell hardware Apache 2 licensed Dell Cloud Solutions 15
  • 16.
    Crowbar Stages ofDeployment APIs, User Access, Includes all the components required to implement & Ecosystem an entire cloud infrastructure including ecosystems Partners partners Ops Management Pluggable components deploy cloud infrastructure. Dell “Crowbar” Cloud Allow for addition of Dell IP and expansion by the Infrastructure & Dell IP Extensions community services and customers Can integrate with Dell existing products Core Components & Delivers basic data center services and required Operating Systems cloud infrastructure. Provision bare-metal servers from box to cloud WITHOUT user intervention (other than Physical Resources racking/cabling and some minimal configuration questions) NOT EXCLUSIVE TO DELL HARDWARE * Crowbar has potential to service other programs beyond OpenStack Dell Cloud Solutions 16
  • 17.
    Modular Design: Barclamps APIs, User Access, Nagios Ganglia Dashboard & Ecosystem Partners Ops Management Nova Swift Glance Dell “Crowbar” Cloud Infrastructure & Dell IP Extensions Compellent EqualLogic Crowbar DNS Logging Core Components & Operating Systems Deployer NTP Provisioner BIOS IPMI Physical Resources Network RAID * Crowbar has potential to service other programs beyond OpenStack Dell Cloud Solutions 17
  • 18.
    Crowbar = InstallState Machine Dell Cloud Solutions 18
  • 19.
  • 20.
    Barclamps and Proposals DellCloud Solutions 20
  • 21.
  • 22.
    Supporting Services A self contained cloud requires some supporting services. Crowbar also includes: DNS: Can be forwarded to an upstream server NTP: Can be synced to an upstream time server Logging: Can be sent to a centralized logging server Dell Cloud Solutions 22
  • 23.
    New Features? Support for additional HW platforms Support for storage platforms Compellent Equalogic DX Networking 10 Gig Integration with switching infrastructure OpenStack Volume Networking service Dell Cloud Solutions 23
  • 24.
    Questions? More info: • http://Dell.com/OpenStack- White Papers & More! • http://github.com/dellcloudedge/crowbar - Source code and instructions • http://lists.us.dell.com/mailman/listinfo/crowbar - Discussions and questions

Editor's Notes

  • #3 Different setups for different purposes:Development