As our founder and leader Michael Dell stated, cloud is a journey. Along that journey, Dell can help you build a cloud, use a cloud or understand and implement benefits of cloud. Using our lineage in specialty engineered server hardware, storage, and networks,18 of the 25 largest clouds are now powered by DELL. We have domain expertise (IP) and experiences to share from supporting the world’s top search providers, designing one of the world’s largest cloud storage initiatives in healthcare, and some of the most active and secure cloud infrastructures traversing the globe. Because of these core competencies, and because we excel in all these areas, DELL provides the most comprehensive approach to solving cloud computing requirements –through one Framework.
Further to this Our founder and CEO stated “ read quote”. Dell thru its internal transformations saved $200m whilst maintenance costs reduced to less than 50% of IT spending. The cloud journey was not however just about the cost savings it was about the ability to move towards IT as a service and have the agility to change workloads with varying capacities.
Openstack in action2! Automate and accelerate Cloud deployments with Dell Crowbar
Automate and acceleratecloud deployments withDell CrowbarOpenStack in Action 2!Paris, May 31st 2012Taco Scargo, EMEA Enterprise Technologist
Proven Cloud Experience• Dell powers 20 of the 25 largest clouds• Processes 13 billion security events each day• Managing over 6,000,000 SaaS based users• Managing more than 4 billion diagnostic imaging objects in cloud storage• Over 1 billion connections to the Dell’s own Cloud infrastructure each day• And last but not least: founding member of OpenStack
Value creationJust as IT is not a commodity, cloud isnot a destination. Cloud is a journey,placing IT squarely in the center of theenterprise as both facilitator andenabler of value-creation. Michael Dell, Chairman & CEO3 Dell Confidential
The cloud is never at rest. The cloud is always ready, never finished.
How do you manage a cloud that `won’t stay still? Cloud Operator Cloud User Problem Solution Challenge ChallengeCode is constantly Deployment time > Pace of innovation Continuous changing code delivery rate is fast deployment Resources are Match output with At scale, no system Automated constantly consumption is steady state deployment changing demand Too many Centralized Complexity is Require dynamic components to configuration expensive integration easily track management
Clouds require an Operational Focus Clouds demand significant operational and process controls SW Operational decisions drive OPS hardware and software decisions HW We are finding ways to productize operations into best practices
What is DevOps?Is an emerging set of principles, methods and practices for communication,collaboration and integration between application/software engineering andIT Operations that DRIVE AUTOMATION Staff Commodity Hardware Packaged Operations Software Scripts & Tools IT’S ALL SOFTWARE! Crowbar
Images vs. Layers: OverviewImages: Single Unit Layers: Stacked Pieces Configuration Integrations Configuration Application Foo Integrations + Application Bar Applications + Utilities + UtilitiesOperating System Operating System
Images vs. Layers: Lifecycle Images: Replacement Layers: UpgradeConfig Config Config I I Foo Foo Config ConfigI+A+U+ I+A+U+ I+A+U+ Bar v1 Bar v2 O/S O/S O/S U U OS OS Config Bar v2 I+A+U+ O/S
CloudOps for OpenStackThere are lot of pieces, but they share many elements! I I I I I I Crowbar Dash Nova Nova Nova Config Config Config Config Config Config Nagios Chef Board Cntrl DB API U U U U U U OS OS OS OS OS OS I I I I I I Nova Nova Nova Nova Nova Nova Config Config Config Config Config Config Node Node Node Node Node Node U U U U U U OS OS OS OS OS OS
CloudOps for OpenStackPlus interconnections are highly complex and dynamic I I I I I I Crowbar Dash Nova Nova Nova Config Config Config Config Config Config Nagios Chef Board Cntrl DB API U U U U U U OS OS OS OS OS OS I I I I I I Nova Nova Nova Nova Nova Nova Config Config Config Config Config Config Node Node Node Node Node Node U U U U U U OS OS OS OS OS OS
What is Crowbar?Mission: “A Zero Touch Cloud Installer” Servers in boxes to full function cloud in under 2 hours Fast & Flexible Bare metal install including BIOS & RAID config Users can choose how their system is configured (“barclamps”) DevOps Embracing Ongoing Operations Model (DevOps for Clouds) Leverages & Wraps Opscode Chef Open Not specific to OpenStack – Dell using for other Apps Not restricted to Dell hardware Apache 2 licensed
Crowbar Builds Up Clouds APIs, User Access, & Ecosystem PartnersOps Management Dell “Crowbar” Cloud Infrastructure Core Components & Operating Systems Physical Resources
2) OS and Ops Infrastructure APIs, User Access, & Ecosystem PartnersOps Management Dell “Crowbar” Cloud Infrastructure Core Components & Operating Systems * Physical Resources * Suse pending, based on open source activity
How does Crowbar work? Orchestration State Machine AppsOps Management Apps Dell “Crowbar” Crowbar Magic Happens! Run List Network Network Config Config Chef Server Operating System Config. Hardware Config (uses “Sledgehammer”) DHCP Server
Modular Design: Barclamps What Configuration You want to Deploy Nagios Ganglia Dashboard APIs, User Access, & Ecosystem Partners enStratus HorizonOps Management Dell “Crowbar” Nova Swift Glance Cloud Infrastructure & Dell IP Extensions Ceph Force10 Keystone Crowbar DNS Logging Core Components & Operating Systems Deployer NTP Quantum Provisioner BIOS IPMI Physical Resources Network RAID * Crowbar has potential to service other programs beyond OpenStack
What is a barclamp? Barclamp Crowbar API O/S App Components Chef Recipes & Partial UI Packages & ScriptsOps Management Dell “Crowbar” • Crowbar API & Partial UI • Adds states and transitions to Orchestration • Customizes UI specific to barclamp • Visual extensions to nodes/networks/utils • Chef Recipes • DevOps description of application • Enforced repeatable configuration • O/S App Packages • Operating system dependencies (Debs & RPMs) • Components & Scripts • Ad hoc configuration not covered by Chef
What is a barclamp? Barclamp Crowbar API O/S App Components Chef Recipes & Partial UI Packages & ScriptsOps Management Dell “Crowbar” • Interact as service layers • Have dependencies and pre-requisites • Can operate on multiple operating systems • Have independent version streams • Leverage/Reuse Chef Cookbooks Barclamp Barclamp
Networking in Crowbar IP Network Barclamp Allocations DHCP OtherChef Client Barclamps IPMI Request VLAN VLAN Conduit “Conduits” 1g1 eth0 VLAN VLAN Conduit Interface & 1g2 eth1 Conduits Teamed Teamed Conduit Normalize 1g3 eth# Networks Between not Nodes. mgm’d Server
Networking in Crowbar IP Network Barclamp Allocations DHCPChef Client Crowbar IPMI Discovers VLAN VLAN Switches eth0 and Ports VLAN VLAN eth1 Crowbar Teamed Teamed Does NOT eth# Configure The Switch! not O/S Only mgm’d Server
Monitoring View performance metrics and healthNagios® and Ganglia are installed by default and are configured to correctly monitor the services installed by crowbar
Supporting ServicesA self contained cloud requires some supportingservices. Crowbar also includes: DNS: Can be forwarded to an upstream server NTP: Can be synced to an upstream time server Logging: Can be sent to a centralized logging server
Questions?More info:• http://Dell.com/OpenStack - White Papers & More!• http://github.com/dellcloudedge/crowbar - Source code and instructions• http://lists.us.dell.com/mailman/listinfo/crowbar - Discussions and questions• Contact me at Taco_Scargo@dell.com
How many watt does it take torun a 48-node OpenStack cloud?
Introducing Dell “Copper”48 ARM-based quad-core servers in the3U PowerEdge C5000 chassis,aimed at the microserver marketEach ARM server node includes:1 SATA hard drive or flash drive1 DIMM slot for up to 8GB RAM1 GbE input per server into a non-blocking L2 switch per sled
ARM Server Market StatusProduct ARM Support StatusUbuntu Available Now - http://www.ubuntu.com/download/armFedora In Dev - Fedora-ARM ProjectLAMP Stack Open Source Available Now – continued optimizationHadoop Open Source Available Now – continued optimizationOpenStack Public demos May 2012Oracle Java Available Now – continued optimization, http://www.oracle.com/technetwork/java/embedded/overview/embedded-faq-159987.html#faq4KVM Open Source Expected w/Cortex A15
Availability• Seed Program • Continued delivery of Dell "Copper" ARM servers to select customers WW • Includes DCS Classic and non-Classic customers • Expected use: Test and development with web front-end and Hadoop workloads. No general availability at this time. • Timeframe: Systems have already begun shipping, and customers have started testing• Ecosystem Enablement: • Seed units will in-progress for key ecosystem partners, including Canonical, Cloudera and others • Remote accessible clusters for developer use include: • Dell Solution Centers: Centers planned worldwide, we will deploy multiple clusters over time • Texas Advanced Computing Center (UT): Austin-based cluster as part of their support of the development community
Questions?More info:• http://content.dell.com/us/en/enterprise/d/campaigns/project-copper.aspx• Contact me at Taco_Scargo@dell.com