2013年11月13日星期三

Compass – A Streamlined
OpenStack Deployment System
Shuo Yang
Principal Architect of Cloud Computing, US R...
Outline of This Talk
1

Scope of Problem for Compass

2

Compass Explained

3

DRY, Truly Open Deployment

1
Compass at a Glimpse
Think Big, Start Small


A General System to Deploy Distributed Systems, Extensibility as a Primary ...
Data Center as a Computer
Open Cloud OS (OpenStack)

Open Deployment (Compass)

OpenStack
Linux
Quantum
eth0, lo

NIC
Swit...
Why We Are Doing This?
Full HW Portfolio in Data Center


No.1 as Storage Revenue Growth



No. 2 as `x86 Server Revenue...
Outline of This Talk
1

Scope of Problem for Compass

2

Compass Explained

3

DRY, Truly Open Deployment

5
A Life of Deployment – How to Streamline All Controls
Plus a lot of scripts:

Boilerplate

Target system
description
Che...
Compass Philosophies – Programmability and
Extensibility
Programmability – To Be a Programmable Framework


A Restful API...
Compass Internals
Rest
Client

Huawei UI

Compass -- Open Source

Restful API Server

Message bus (RabbitMQ)

DB

Package ...
NOT to Be Conglomerate – Plug-in Architecture
Plug-in architecture for configuration management system


Currently we use...
NOT to Be Conglomerate – Roles in the System
Policy Databag (e.g., exclusive; default)
OpenStack Cookbook

Lib writer

Che...
Outline of This Talk
1

Scope of Problem for Compass

2

Compass Explained

3

DRY, Truly Open Deployment

11
Extensible in Use Cases
OS
ESXi ?
Windows Server?
CentOS

Ubuntu

Huawei

OpenStack Hadoop

HP

OCP?

Hardware
12

Ceph?

...
Extensible in Tool Chain
OS Provisioning Tools

Razor

Cobbler

Chef

Puppet

13

Ansible Salt

Configuration Management T...
To Summarize
Open Sourced under Apache 2.0


General Purpose Deployment System (Ultimate Goal)



Deploys OpenStack Clou...
Real Demo



Video Clips Recording Our First Deployment

15
Copyright©2013 Huawei Technologies Co., Ltd. All Rights Reserved.
The information in this document may contain predictive ...
Upcoming SlideShare
Loading in …5
×

Compass: Yet Another Deployment System or An Networking Gear Company’s Embrace to OpenStack Community?, Shuo YANG, Huawei

1,076 views
884 views

Published on

There is no lack of deployment software in the OpenStack market, and each one of them provides great value from different perspective and scenario. These deployment solutions did a great job on software deployment layer based upon OS provisioning tools like Cobbler and configuration management tools like Puppet/Chef, but they generally do not go deep down to networking and server hardware level configuration, which is a key step for large scale OpenStack solution. As part of a networking company and a server vendor, Huawei Cloud team are developing Compass, a system not only for OpenStack software deployment, but also for fully automated hardware level server and networking gear configuration. Our system automates hardware resource discovery, hardware configuration (e.g., hardware RAID configuration, switch configuration), topology-aware OpenStack
service deployment and etc. Therefore, end users have a streamlined OpenStack deployment experience with Compass. We are using Compass for deploying OpenStack cloud in several deployments and got very constructive feedback for us to make more robust and open deployment solution. We plan to open source our project. One major goal we have in designing the system is to achieve true openness at hardware level, so that other hardware vendors can write plug-in toward their special server designs. Just
like OpenStack’s openness makes it a valuable game-changing cloud solution, we hope we can work with other hardware vendors to make OpenStack universally available on various hardware platforms in a
streamlined fashion.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,076
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
24
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Compass: Yet Another Deployment System or An Networking Gear Company’s Embrace to OpenStack Community?, Shuo YANG, Huawei

  1. 1. 2013年11月13日星期三 Compass – A Streamlined OpenStack Deployment System Shuo Yang Principal Architect of Cloud Computing, US R&D Center
  2. 2. Outline of This Talk 1 Scope of Problem for Compass 2 Compass Explained 3 DRY, Truly Open Deployment 1
  3. 3. Compass at a Glimpse Think Big, Start Small  A General System to Deploy Distributed Systems, Extensibility as a Primary Design Goal  Not Limited to OpenStack, but Streamlined Our OpenStack Deployment Like a Charm To Be Open Sourced – Apache 2.0 Soon  100% Python, 5000 Line of Python Code  Successfully Deployed Several Dogfood Clusters  Compass Wiki Page: https://wiki.openstack.org/wiki/Compass 2
  4. 4. Data Center as a Computer Open Cloud OS (OpenStack) Open Deployment (Compass) OpenStack Linux Quantum eth0, lo NIC Switch Switch Switch NIC (5020) Nova /proc Live Auto CD / Deploy GRUB Cinder /dev CPU CPU CPU Server CPU (2285/1285) OpenStack Control Channel Disk Disk Storage Disk (N8000/N900) LILO/GRUB/LiveCD for OpenStack HW/SW Configuration Deployment Channel 3
  5. 5. Why We Are Doing This? Full HW Portfolio in Data Center  No.1 as Storage Revenue Growth  No. 2 as `x86 Server Revenue Growth  Needless to Say, Networking Gears.. OpenStack Makes the Above a Full Cloud Solution 4 Global Excellent Telecom Cloud Solution Provider of year 2012
  6. 6. Outline of This Talk 1 Scope of Problem for Compass 2 Compass Explained 3 DRY, Truly Open Deployment 5
  7. 7. A Life of Deployment – How to Streamline All Controls Plus a lot of scripts:  Boilerplate  Target system description Chef / Puppet / … Host OS Host OS Host OS Cobbler / Razor / … IPMI Server 1 Server 2 Server n SNMP Switch 1 Switch 2 6 Switch k
  8. 8. Compass Philosophies – Programmability and Extensibility Programmability – To Be a Programmable Framework  A Restful API service instead of a web app Extensibility – NOT To Be A Conglomerate  Functional modules with plug-in architecture (e.g., 200 Loc to support HP Switch)  Carefully designed boundary to mature tools like Cobbler, Chef and etc.  Work WITH the above tools, not to replace any of them. 7
  9. 9. Compass Internals Rest Client Huawei UI Compass -- Open Source Restful API Server Message bus (RabbitMQ) DB Package Deployment Hardware Discover Huawei Plugin 3rd Party ISV UI Chef plugin microkernel 8 Ansible plugin OS Provisioning Cobbler plugin Razor plugin
  10. 10. NOT to Be Conglomerate – Plug-in Architecture Plug-in architecture for configuration management system  Currently we use Chef as deployment management Engine  Puppet or Ansible devopers, we want to work with you Plug-in architecture for Hardware vendors IPMI / SNMP  Networking gear based bare metal discovery (topolology awareness)  Currently we are working on RAID Controller for Huawei  OCP community, what’s your thought 9
  11. 11. NOT to Be Conglomerate – Roles in the System Policy Databag (e.g., exclusive; default) OpenStack Cookbook Lib writer Chef-Server Restful Reqs Compass snippets kickstart files App writer Cobbler-server 10
  12. 12. Outline of This Talk 1 Scope of Problem for Compass 2 Compass Explained 3 DRY, Truly Open Deployment 11
  13. 13. Extensible in Use Cases OS ESXi ? Windows Server? CentOS Ubuntu Huawei OpenStack Hadoop HP OCP? Hardware 12 Ceph? Distributed System
  14. 14. Extensible in Tool Chain OS Provisioning Tools Razor Cobbler Chef Puppet 13 Ansible Salt Configuration Management Tools
  15. 15. To Summarize Open Sourced under Apache 2.0  General Purpose Deployment System (Ultimate Goal)  Deploys OpenStack Cloud Infrastructure Smoothly (Dogfoods Done)  Restful API: Allow Third-party UI Integration Open to Collaboration Contact us: shuo.yang@huawei.com Santa Clara R&D Center, US 14
  16. 16. Real Demo  Video Clips Recording Our First Deployment 15
  17. 17. Copyright©2013 Huawei Technologies Co., Ltd. All Rights Reserved. The information in this document may contain predictive statements including, without limitation, statements regarding the future financial and operating results, future product portfolio, new technology, etc. There are a number of factors that could cause actual results and developments to differ materially from those expressed or implied in the predictive statements. Therefore, such information is provided for reference purpose only and constitutes neither an offer nor an acceptance. Huawei may change the information at any time without notice.

×