Embrace Cloud Computing with an
  OpenStack-based Private Cloud
          中小型组织如何拥抱云计算

                                刘希斌
                        Chief Architect
                           瞬联软件科技
                   CIeNET Technologies
1. Challenges

我们面临的问题




                CIeNET PROPRIETARY   9/2/2012   2
We face common IT problems with other SMEs!

          About Us
          • CIeNET Technologies (瞬联软件科技)
          • A leading consulting and software company founded in 2000
          • Telecom, enterprise, mobile & internet software development
          • 1,900+ R&D engineers




          Honors
          •   2012 IAOP Global Outsourcing 100 Top 75 “Leader”
          •   2011, 2010 and 2009 IAOP Global Outsourcing 100
          •   2011 Diverse Supplier Development Program (Accenture)
          •   2010 Minority Global Technology Firm of the Year (US DOC)
          •   2011, 2010 and 2009 China Sourcing Top 100 (Gartner)
          •   2009 and 2008 Top 100 China Software Export Enterprise


                 CIeNET PROPRIETARY                            9/2/2012   3
What is
                                 cloud
                               computing?


      Can I make            什么是云计算?                What are
      money from                                  they doing
        cloud                                     with cloud
      computing?                                 computing?


我能利用云计算赚钱吗?                     CTO              大家都用云计算做什
                              Questions          么?
                                   ???
                                                Why do I need
      What’s the
                                                    cloud
       cost to
                                                computing in
     deploy cloud
                                                     our
     computing?
                                                organization?
                              What if I don’t
 部署云计算很贵吗?                     adopt cloud      我为什么需要云计算?
                              computing in
                                  our
                              organization?

                        不部署云计算会怎么样?

                    CIeNET PROPRIETARY                          9/2/2012   4
Several FACTS we discovered that you may not know about your
organization or also need to deal with …

We have a lot of computers (我们有很多机器)
  • Server, Blade, Workstation, Desktop PC, Laptop PC
Computer resource utilization is low (每台机器的使用率很低)
  • Average utilization < 10%
Old computers are idle (旧机器闲置)
 • They are put aside rather than being utilized
Computer software installation is done manually (软件手动安装)
  • Repetitive work (repeated installations) and added overhead for IT maintenance
We use a lot of commercial software licenses (好多商业软件!)
 • It’s expensive
We’ve installed some virtualization software (已经尝试使用虚拟化软件)
  • Not centrally managed


                            CIeNET PROPRIETARY                     9/2/2012          5
Several CONSTRAINTS we are aware of which may also be your
constraints …

Lack disposable budget for new equipment (我们没有额外的预算)
  • Economic slowdown and increased efficiency demands
Need for an increase in productivity and shorter TTM (需要提高效率缩短上市时间)
  • Competition!
Reluctant to put all data in public cloud (数据暂时不想放在公有云里)
  • Security and IPR concerns and not ready for it yet
Limited bandwidth for IT department (IT部门的工作已经非常饱和)
  • It’s all about cost
Need rich applications for collaboration (企业协作需要更多的应用)
  • Enterprise 2.0 …



                           CIeNET PROPRIETARY            9/2/2012   6
2. Solution

简单易行的解决方案




              CIeNET PROPRIETARY   9/2/2012   7
Storage Service
                                      Development
                                     and Deployment
                                        Platform
   Virtual
  Machine
Management                                                Enterprise
(Computing)                                              Applications




                CIeNET PROPRIETARY                    9/2/2012          8
Why OpenStack?




 Open      Active              Easy    Popular


          CIeNET PROPRIETARY          9/2/2012   9
Embrace Cloud Computing: A Strategic Plan
(拥抱云计算策略)
                                                    提供云服务

                                   使用云服务            Provide cloud-
                                                    based services to
            开发环境                   Deploy and use   public
                                   cloud-based
IT 基础设施      Develop/test with     services
             cloud platform




              CIeNET PROPRIETARY                    9/2/2012            10
3. Practices

我们的实践




               CIeNET PROPRIETARY   9/2/2012   11
Guideline: Don’t Over-Engineer in the Beginning
初始阶段不要过度设计
 We don’t buy extra hardware:        没有购买新硬件
   Not all applications need a powerful CPU and large memory to support
    high transaction rates.

 We haven’t implement HA:暂不实施高可用
   Not all applications need 24x7 availability.

 We only backup data for controller nodes: 仅备份控制节点
   Not all data need extremely high security.

 We don’t engineer for extremely concurrent usage of all users:
  不考虑所有用户同时使用等极端情况
   Not all user will use the system at same time



                         CIeNET PROPRIETARY                9/2/2012        12
Re-use Resources
已有资源利用
 High End Computers: 少数“中高端”机做控制节点和计算节点
  Control Node and Computing Node
  EG:
    DELL R510, Xeon E5 2420 1.9G, 16G RAM, 500G * 7, 1Gb NIC
    HP DL380, 2 4-core Intel® Xeon® X5550,16GB RAM,1Gb NIC

 Low End Computers: 大量普通机器做存储
  Storage
  EG:
    DELL 980/990, Intel i5 3.20GHz 4G RAM 500G * 4, 100Mb NIC
    DELL 320, Intel Core2 1.80GHz 2G RAM 80G * 10, 100Mb NIC



                   CIeNET PROPRIETARY                  9/2/2012   13
The Infrastructure
 我们搭建的基础设施

                                               Users




                                  OpenStack                      IaaS Software

Virtualization
                 KVM         KVM
                       KVM


                 Compute Node                     Storage Node




                          CIeNET PROPRIETARY                     9/2/2012        14
Controller:
          HP DL380




              Computer:
             DELL R510/
                                   Storage:
                 980
                                 DELL 980/990
                                    /320




CIeNET PROPRIETARY        9/2/2012        15
Software Version: 软件版本
   Ubuntu 12.04 64-bit
   Virtualization: QEMU-KVM-1.0

   Openstack Essex Release
      Controller
        nova-network nova-api nova-volume
      Compute Node
        nova-network nova-api nova-compute
      Storage
        Swift Proxy, Swift Object, Swift Container, Swift




                       CIeNET PROPRIETARY                    9/2/2012   16
Beyond OpenStack: Put Development
Platform Inside 整合内部开发平台
  Make internal development and testing environment as a
   standard image.
    Developers can now easily access a development environment
     with just the push of a button. All dependent software is
     included. (开发者点击鼠标就能获得想要的开发环境)
    Make environment management very easy.

        Java Dev. Env.

      Android Compile
           Env.

        Dev. Config.
        Management

     Auto Test Framework

                         CIeNET PROPRIETARY          9/2/2012     17
Beyond OpenStack: Develop Enterprise Net
Disk Module 开发企业网盘模块




                                              CIeDISK Module    SaaS Software

                                  OpenStack                    IaaS Software

Virtualization
                 KVM         KVM
                       KVM



                 Compute Node                 Storage Node


                         CIeNET PROPRIETARY                    9/2/2012         18
CIeDISK Module: 我们开发的企业网盘-”瞬盘”模块
    User File Management 基于用户的文件管理
    Group Sharing 群组分享
    Multiple Files Upload 多文件上传
    Online Photo Gallery 在线照片库
    MAC/Windows/Tablet Clients 多客户端




            CIeNET PROPRIETARY   9/2/2012   19
Planning 规划

 Computers
 Floating IP addresses
   Allocate enough floating IP addresses for virtual machines
 Some issues we met
   Partitioning:
      We should give var and tmp partitions a large amount of space
       since var is used for instance disk and tmp is used for snapshot
       generation




                    CIeNET PROPRIETARY                      9/2/2012      20
Installation 安装

 Manual Installation
   With modified OpenStack installer script
 Chef/Puppet/JUJU are not used




                   CIeNET PROPRIETARY          9/2/2012   21
Network 网络

 Network Manager: VLAN
 We use 100Mb NIC
 Issues we met:
    If floating IP and fixed IP are in same subnet, NAT translation will fail

 Some defects we met (but resolved in latest releases):
    Floating IPs are not released
      How: Terminate an instance and show floating lists
      Resolve: Clean the floating IPs timely
    Floating IP List shows Missing Instance
      Reason: Delete zombie instance from database
      Resolve: Set the delete status


                       CIeNET PROPRIETARY                       9/2/2012         22
Volume 卷

 To save user data after VM is terminated
 Controller node needs to have enough disk space
 Some defects we met:
   Can't create new volume:
      According to the official document, tgt and iscsitarget should both
       be installed and started, but actually, they are conflicting services
      Resolve: Stop iscsitarget




                      CIeNET PROPRIETARY                      9/2/2012         23
Resource Quota 资源限额
 Balance between user needs and system performance
 The limits we set:
   Virtual Machine:
     Provide limited flavors: (CPU/RAM/Root Disk)
      cloud.large 2 1024 0
      cloud.small 1 512 0
      TAS.large 2 2048 15GB
      TAS.small 1 1024 15GB
   Storage:
     Per user quota: 1GB
     File Size: < 50MB


                     CIeNET PROPRIETARY              9/2/2012   24
Filtering and Scheduling 结点选择

 Chance: With this method, a compute host is chosen
  randomly across availability zones

   This is the default configuration, but will easily cause the system
    to be overloaded



 Simple: With this method, hosts whose load is least are
  chosen to run the instance

   Choose this configuration



                    CIeNET PROPRIETARY                   9/2/2012         25
OA&M 监控管理

 Zenoss
   Physical node level, not inside VM




                   CIeNET PROPRIETARY    9/2/2012   26
Operation Results 内部运营效果

 Launched and running internally
   Hardware resource utilization
       10%  60%
     Re-used old idle hardware
     New development machine launch efficiency improved
       4 hours  10 minutes
     File/Picture sharing
       Transactions increased by 30X quarterly
     Personal space utilization
       Average: 10%



                   CIeNET PROPRIETARY              9/2/2012   27
OpenStack-based Infrastructure Summary
关键点

 OpenStack + New Modules + Customizations
  OpenStack + 新开发模块 + 定制化

 Low cost 低成本
  - Open source
  - Re-use existing, under-utilized hardware and old PCs
 Manageable 可管理
  - Easy, Private, Secure, Full Control, and Extensible




                    CIeNET PROPRIETARY                    9/2/2012   28
4. Moving to the Next Stage

未来展望




             CIeNET PROPRIETARY   9/2/2012   29
OpenStack-based Feature Development
继续基于OpenStack开发内部云功能

  More features will be implemented depending on the
   needs: 添加功能
    High Availability
    LDAP integration (Single Sign-On)
    OA&M
    Auto Installation
    System growth with more servers
  Deploy PaaS (Cloud Foundry) and Provide Server Running
   Environment 部署内部“平台即服务”
                    CIeNET is the pioneer of doing development around Cloud
                    Foundry and extending Juju for cloud software deployment

                    CIeNET PROPRIETARY                      9/2/2012           30
OpenStack-based Mobile Office &Collaboration
移动办公与协作

   The future working environment 未来的办公环境展望
     Everything is in the cloud 存储在云端
     Mobile 移动化
     Sharing among groups 基于群组的分享


   Our groupware on PC and mobile devices    群组软件
     Group task management software has been developed and is
      in alpha release now 群组任务管理
     Share everything in a mobile environment 分享任何东西
     License sharing in the cloud


                    CIeNET PROPRIETARY             9/2/2012      31
Our Private Cloud 我们的企业私有云全景

                                                                                Users

Developers


                     Portal
                                         Collaboration    CIeDISK   … SaaS Software
PaaS Software      Cloud Foundry


                                       OpenStack                      IaaS Software

  Virtualization
                   KVM           VMware
                          Xen


      Virtual Machine Nodes                          Storage Node


                              CIeNET PROPRIETARY                     9/2/2012           32
Contribute to the Community 回报社区

   We realized that more features are required 功能缺失
    from OpenStack and we would like to work on it:
     OpenStack monitor module
     Instance resource extension
     Define flavors for different projects
     Embedded HA
     Server usage report/statistics
   CIeNET has started submitting bug fixes to the OpenStack
    Open Source Project 开始代码提交
   We would like to share more and partner with all community
    participants 与所有社区参与者合作共享


                  CIeNET PROPRIETARY              9/2/2012       33
Thank You!
Contact Us:
Weibo:
刘希斌: @LiuXibin
孙琦:         @RaySun
瞬联软件: @CIeNET

CIeNET:
business@cienet.com.cn


         CIeNET PROPRIETARY   9/2/2012   34

Track2 -刘希斌----c ie-net-openstack-2012-apac

  • 1.
    Embrace Cloud Computingwith an OpenStack-based Private Cloud 中小型组织如何拥抱云计算 刘希斌 Chief Architect 瞬联软件科技 CIeNET Technologies
  • 2.
    1. Challenges 我们面临的问题 CIeNET PROPRIETARY 9/2/2012 2
  • 3.
    We face commonIT problems with other SMEs! About Us • CIeNET Technologies (瞬联软件科技) • A leading consulting and software company founded in 2000 • Telecom, enterprise, mobile & internet software development • 1,900+ R&D engineers Honors • 2012 IAOP Global Outsourcing 100 Top 75 “Leader” • 2011, 2010 and 2009 IAOP Global Outsourcing 100 • 2011 Diverse Supplier Development Program (Accenture) • 2010 Minority Global Technology Firm of the Year (US DOC) • 2011, 2010 and 2009 China Sourcing Top 100 (Gartner) • 2009 and 2008 Top 100 China Software Export Enterprise CIeNET PROPRIETARY 9/2/2012 3
  • 4.
    What is cloud computing? Can I make 什么是云计算? What are money from they doing cloud with cloud computing? computing? 我能利用云计算赚钱吗? CTO 大家都用云计算做什 Questions 么? ??? Why do I need What’s the cloud cost to computing in deploy cloud our computing? organization? What if I don’t 部署云计算很贵吗? adopt cloud 我为什么需要云计算? computing in our organization? 不部署云计算会怎么样? CIeNET PROPRIETARY 9/2/2012 4
  • 5.
    Several FACTS wediscovered that you may not know about your organization or also need to deal with … We have a lot of computers (我们有很多机器) • Server, Blade, Workstation, Desktop PC, Laptop PC Computer resource utilization is low (每台机器的使用率很低) • Average utilization < 10% Old computers are idle (旧机器闲置) • They are put aside rather than being utilized Computer software installation is done manually (软件手动安装) • Repetitive work (repeated installations) and added overhead for IT maintenance We use a lot of commercial software licenses (好多商业软件!) • It’s expensive We’ve installed some virtualization software (已经尝试使用虚拟化软件) • Not centrally managed CIeNET PROPRIETARY 9/2/2012 5
  • 6.
    Several CONSTRAINTS weare aware of which may also be your constraints … Lack disposable budget for new equipment (我们没有额外的预算) • Economic slowdown and increased efficiency demands Need for an increase in productivity and shorter TTM (需要提高效率缩短上市时间) • Competition! Reluctant to put all data in public cloud (数据暂时不想放在公有云里) • Security and IPR concerns and not ready for it yet Limited bandwidth for IT department (IT部门的工作已经非常饱和) • It’s all about cost Need rich applications for collaboration (企业协作需要更多的应用) • Enterprise 2.0 … CIeNET PROPRIETARY 9/2/2012 6
  • 7.
    2. Solution 简单易行的解决方案 CIeNET PROPRIETARY 9/2/2012 7
  • 8.
    Storage Service Development and Deployment Platform Virtual Machine Management Enterprise (Computing) Applications CIeNET PROPRIETARY 9/2/2012 8
  • 9.
    Why OpenStack? Open Active Easy Popular CIeNET PROPRIETARY 9/2/2012 9
  • 10.
    Embrace Cloud Computing:A Strategic Plan (拥抱云计算策略) 提供云服务 使用云服务 Provide cloud- based services to 开发环境 Deploy and use public cloud-based IT 基础设施 Develop/test with services cloud platform CIeNET PROPRIETARY 9/2/2012 10
  • 11.
    3. Practices 我们的实践 CIeNET PROPRIETARY 9/2/2012 11
  • 12.
    Guideline: Don’t Over-Engineerin the Beginning 初始阶段不要过度设计  We don’t buy extra hardware: 没有购买新硬件  Not all applications need a powerful CPU and large memory to support high transaction rates.  We haven’t implement HA:暂不实施高可用  Not all applications need 24x7 availability.  We only backup data for controller nodes: 仅备份控制节点  Not all data need extremely high security.  We don’t engineer for extremely concurrent usage of all users: 不考虑所有用户同时使用等极端情况  Not all user will use the system at same time CIeNET PROPRIETARY 9/2/2012 12
  • 13.
    Re-use Resources 已有资源利用  HighEnd Computers: 少数“中高端”机做控制节点和计算节点  Control Node and Computing Node  EG:  DELL R510, Xeon E5 2420 1.9G, 16G RAM, 500G * 7, 1Gb NIC  HP DL380, 2 4-core Intel® Xeon® X5550,16GB RAM,1Gb NIC  Low End Computers: 大量普通机器做存储  Storage  EG:  DELL 980/990, Intel i5 3.20GHz 4G RAM 500G * 4, 100Mb NIC  DELL 320, Intel Core2 1.80GHz 2G RAM 80G * 10, 100Mb NIC CIeNET PROPRIETARY 9/2/2012 13
  • 14.
    The Infrastructure 我们搭建的基础设施 Users OpenStack IaaS Software Virtualization KVM KVM KVM Compute Node Storage Node CIeNET PROPRIETARY 9/2/2012 14
  • 15.
    Controller: HP DL380 Computer: DELL R510/ Storage: 980 DELL 980/990 /320 CIeNET PROPRIETARY 9/2/2012 15
  • 16.
    Software Version: 软件版本  Ubuntu 12.04 64-bit  Virtualization: QEMU-KVM-1.0  Openstack Essex Release  Controller  nova-network nova-api nova-volume  Compute Node  nova-network nova-api nova-compute  Storage  Swift Proxy, Swift Object, Swift Container, Swift CIeNET PROPRIETARY 9/2/2012 16
  • 17.
    Beyond OpenStack: PutDevelopment Platform Inside 整合内部开发平台  Make internal development and testing environment as a standard image.  Developers can now easily access a development environment with just the push of a button. All dependent software is included. (开发者点击鼠标就能获得想要的开发环境)  Make environment management very easy. Java Dev. Env. Android Compile Env. Dev. Config. Management Auto Test Framework CIeNET PROPRIETARY 9/2/2012 17
  • 18.
    Beyond OpenStack: DevelopEnterprise Net Disk Module 开发企业网盘模块 CIeDISK Module SaaS Software OpenStack IaaS Software Virtualization KVM KVM KVM Compute Node Storage Node CIeNET PROPRIETARY 9/2/2012 18
  • 19.
    CIeDISK Module: 我们开发的企业网盘-”瞬盘”模块  User File Management 基于用户的文件管理  Group Sharing 群组分享  Multiple Files Upload 多文件上传  Online Photo Gallery 在线照片库  MAC/Windows/Tablet Clients 多客户端 CIeNET PROPRIETARY 9/2/2012 19
  • 20.
    Planning 规划  Computers Floating IP addresses  Allocate enough floating IP addresses for virtual machines  Some issues we met  Partitioning:  We should give var and tmp partitions a large amount of space since var is used for instance disk and tmp is used for snapshot generation CIeNET PROPRIETARY 9/2/2012 20
  • 21.
    Installation 安装  ManualInstallation  With modified OpenStack installer script  Chef/Puppet/JUJU are not used CIeNET PROPRIETARY 9/2/2012 21
  • 22.
    Network 网络  NetworkManager: VLAN  We use 100Mb NIC  Issues we met:  If floating IP and fixed IP are in same subnet, NAT translation will fail  Some defects we met (but resolved in latest releases):  Floating IPs are not released  How: Terminate an instance and show floating lists  Resolve: Clean the floating IPs timely  Floating IP List shows Missing Instance  Reason: Delete zombie instance from database  Resolve: Set the delete status CIeNET PROPRIETARY 9/2/2012 22
  • 23.
    Volume 卷  Tosave user data after VM is terminated  Controller node needs to have enough disk space  Some defects we met:  Can't create new volume:  According to the official document, tgt and iscsitarget should both be installed and started, but actually, they are conflicting services  Resolve: Stop iscsitarget CIeNET PROPRIETARY 9/2/2012 23
  • 24.
    Resource Quota 资源限额 Balance between user needs and system performance  The limits we set:  Virtual Machine:  Provide limited flavors: (CPU/RAM/Root Disk) cloud.large 2 1024 0 cloud.small 1 512 0 TAS.large 2 2048 15GB TAS.small 1 1024 15GB  Storage:  Per user quota: 1GB  File Size: < 50MB CIeNET PROPRIETARY 9/2/2012 24
  • 25.
    Filtering and Scheduling结点选择  Chance: With this method, a compute host is chosen randomly across availability zones  This is the default configuration, but will easily cause the system to be overloaded  Simple: With this method, hosts whose load is least are chosen to run the instance  Choose this configuration CIeNET PROPRIETARY 9/2/2012 25
  • 26.
    OA&M 监控管理  Zenoss  Physical node level, not inside VM CIeNET PROPRIETARY 9/2/2012 26
  • 27.
    Operation Results 内部运营效果 Launched and running internally  Hardware resource utilization  10%  60%  Re-used old idle hardware  New development machine launch efficiency improved  4 hours  10 minutes  File/Picture sharing  Transactions increased by 30X quarterly  Personal space utilization  Average: 10% CIeNET PROPRIETARY 9/2/2012 27
  • 28.
    OpenStack-based Infrastructure Summary 关键点 OpenStack + New Modules + Customizations OpenStack + 新开发模块 + 定制化  Low cost 低成本 - Open source - Re-use existing, under-utilized hardware and old PCs  Manageable 可管理 - Easy, Private, Secure, Full Control, and Extensible CIeNET PROPRIETARY 9/2/2012 28
  • 29.
    4. Moving tothe Next Stage 未来展望 CIeNET PROPRIETARY 9/2/2012 29
  • 30.
    OpenStack-based Feature Development 继续基于OpenStack开发内部云功能  More features will be implemented depending on the needs: 添加功能  High Availability  LDAP integration (Single Sign-On)  OA&M  Auto Installation  System growth with more servers  Deploy PaaS (Cloud Foundry) and Provide Server Running Environment 部署内部“平台即服务” CIeNET is the pioneer of doing development around Cloud Foundry and extending Juju for cloud software deployment CIeNET PROPRIETARY 9/2/2012 30
  • 31.
    OpenStack-based Mobile Office&Collaboration 移动办公与协作  The future working environment 未来的办公环境展望  Everything is in the cloud 存储在云端  Mobile 移动化  Sharing among groups 基于群组的分享  Our groupware on PC and mobile devices 群组软件  Group task management software has been developed and is in alpha release now 群组任务管理  Share everything in a mobile environment 分享任何东西  License sharing in the cloud CIeNET PROPRIETARY 9/2/2012 31
  • 32.
    Our Private Cloud我们的企业私有云全景 Users Developers Portal Collaboration CIeDISK … SaaS Software PaaS Software Cloud Foundry OpenStack IaaS Software Virtualization KVM VMware Xen Virtual Machine Nodes Storage Node CIeNET PROPRIETARY 9/2/2012 32
  • 33.
    Contribute to theCommunity 回报社区  We realized that more features are required 功能缺失 from OpenStack and we would like to work on it:  OpenStack monitor module  Instance resource extension  Define flavors for different projects  Embedded HA  Server usage report/statistics  CIeNET has started submitting bug fixes to the OpenStack Open Source Project 开始代码提交  We would like to share more and partner with all community participants 与所有社区参与者合作共享 CIeNET PROPRIETARY 9/2/2012 33
  • 34.
    Thank You! Contact Us: Weibo: 刘希斌:@LiuXibin 孙琦: @RaySun 瞬联软件: @CIeNET CIeNET: business@cienet.com.cn CIeNET PROPRIETARY 9/2/2012 34