Lessons learned from 100 cloud
deployments
Olivier Maes
Sr Director Market Development EMEA
Cloud Platforms Group

Olivier.maes@citrix.com
Twitter:omaes72
Who did we learn from?
Citrix cloud computing powers the world’s largest clouds
130 production clouds, 20.000 downloads/month, 50 customers in EMEA



      Telco and Service             Web 2.0 and                Public Sector
          Providers                   Media                     Enterprise




3
Citrix cloud architecture: building blocks we deploy
         WINDOWS     DEV         DISASTER     BRIDGE &          BYO       INFRA-      YOUR
        ON-DEMAND   & TEST       RECOVERY     GATEWAY        PLATFORM   STRUCTURE    SERVICE




                                 Cloudplatform
           NetScaler            Powered by Apache Cloudstack                CloudBridge



                             ESX Hyper-V    XenServer        KVM OVM
                                            VIRTUALIZATION




               Compute                       Network                       Storage
Openness matters
Since 2008 CloudStack has powered hundreds of clouds

                                               • Secure, multi-tenant cloud orchestration
                                                 platform
                                                 –   Turnkey platform for delivering IaaS clouds
                                                 –   Hypervisor agnostic
                                                 –   Highly scalable, secure and open
                                                 –   Complete Self-service portal
“CloudStack has successfully penetrated the      –   Open source, open standards
service provider market...and racked up some
solid wins in the enterprise to boot.”           –   Deploys on premise or as a hosted solution
James Staten
Vice President, Principal Analyst              • Deliver cloud services 50 times faster at
                                                 1/5th the cost
                                               • 130 commercial deployments
CloudPlatform Provides On-demand Access to
Infrastructure Through a Self-Service Portal
              Org A                     Org B
                                                                        Users
                      Admin                           Admin


End User              Users                           Users




           Compute                         Network                              Storage


Admin



                              Citrix Confidential - Do Not Distribute
CloudPlatform: key functionalities
Maintenance and Provisioning                                        User Interface                                  Developer API
                                                   Administrator         End User            Console       Amazon          OpenStack        Custom
 Operation, Administration,


                                                              Availability and Security                             Image Libraries

                               Integration API
                                                  Backup           LB             HA        Monitoring
                                                                                                                     Application Catalog


                                                           Dynamic Workload Management                               Custom Templates

                                                              Resource Management
                                                                                                                    Operating System ISOs

                                                    Servers             Storage           Network


                                                                   Service Management (Billing, Metering, Accounts, etc.)
                                                                                    Virtualization Layer
                                                              Citrix XenServer | Microsoft Hyper-V | KVM | VMWare ESX

                                                 Servers                                Network                           Storage
• Elevating CloudStack into a full
                              open source project
                            • Joining the leading open source
                              cloud projects
The Cloud Platform of the
                              • Hadoop, Cassandra, Tomcat, etc
    Apache Software
       Foundation           • Aligning with the Amazon Cloud
                              standard for ecosystem and
                              interoperability
                            • Not controlled by Citrix
Apache CloudStack Community Response has been phenomenal
                                                   Pre Apache Move (Jan 2012)   Y/E Goals       June Actuals
     # of unique web visitors                      159,211/month                375,000/month   447,325/month
     # of downloads                                8,392/month                  16,000/month    20,000/month
     # of companies endorsing project              0                            75              68

     # of companies participating                  10                           125             140

     # of developers working on project            40                           75              238

     # Citrix CloudPlatform Clouds in Production   82                           200             130




11
Cloud ecosystem drives innovation
                 Cloud Admin                                                          Consumer

Services         Applications                          Developer PaaS
Layer
                 Cloud Management                    Service Portal        Metering     DBaaS
Cloud
Services
Infrastructure   Cloud OS                           DevOps                        Images and Templates
Orchestration
                 Hypervisor                          Storage Software                 Networking Software
Infrastructure
Virtualization

Infrastructure
Hardware

                          Cloud.com Confidential | Shared Under NDA Only
“Managed” Clouds and Private
clouds prevail
Cloudplatforms support multiple cloud strategies
                On Premise                                                          Hosted
Private Cloud                  Managed               Hosted Private Cloud         Federated/Hybrid                Public
                             Private Cloud                                         Cloud Services             Cloud Services
   Enterprise                      Enterprise               Enterprise            Multi-tenant Users      Multi-tenant Users
  Data Center                     Data Center




                                  3rd party              3rd party hosted &
                                  operated                    operated


     •   Dedicated resource                     •   3rd party owned and       •     Mix of shared and     •     Shared resources
     •   Total control/security                     operated                        dedicated resources   •     Elastic scaling
     •   Internal network                       •   SLA bound                 •     Shared facility and   •     Pay as you go
                                                •   Security                        staff                 •     Public internet
                                                •   Dedicated resource        •     VPN access
Centralized management of your availability zones
                                 CloudPlatform Management Cluster




        San Jose                        London
                   Miami                                Hosted Dehli   Tokyo




                           Hosted Rio
Self Service portals are high in
demand
CloudPlatform + CloudPortal =
 Cloud orchestration + monetization for service providers
                   B/OSS Layer                                                        Cloud Services

                                 CloudPortal
Org A                CRM                                       Cloudplatform

           Admin                                                                         Hypervisor
                     Auth /                                           Cloud
           Users      SSO                                            Console               Server




                                               Orchestration
                    Catalog
                                                                                           Storage
Org B                                                               Resource




                                                                                API
                   Commerce                                        Management              Firewall
           Admin

           Users                                                                        Load Balancer
                    Service
                     Desk
                                                                      Usage
                                                                     Metering
                   Community
Customer
Partner
Internal
                     Billing
CloudPortal Business Manager
Enables Differentiation and Turns Clouds into Profitable Businesses

                                      • Comprehensive business and operations
                                        support platform
                                        for Service Providers
         CloudPortal                     –   Account management
      Business Manager
                                         –   Self-service portal
                                         –   Billing and metering
         A purpose-built,
       business operations               –   CRM and support ticketing
      suite for cloud service         • Facilitates differentiation and increases
             providers
                                        profitability
                                     CloudPortal dramatically accelerates the go-to-market process
                                            for IaaS cloud providers running on CloudStack
CloudPortal key features
         Account                               Pricing &                            Customer                            Dashboard                             Partner/OEM
        Management                               Billing                           Relationship                                                               Management


    •      Authentication                 •   Product Definition               •   Sales CRM                       •    Usage Reporting                   •    Partner Provisioning
    •      Account Provisioning           •   Catalog Management               •   Ticketing / Help Desk           •    Messaging                         •    Partner Management
    •      Account Management             •   Usage Tracking                   •   Community Forums                •    Alerts                            •    Partner CRM
    •      Cloud Management               •   Billing                          •   Service Status                  •    Service Status                    •    Partner Dashboard
    •      User Roles
                                          •   Payment Processing                                                                                          •    Partner Billing
    •      Portal Administration


                                              CloudPortal Business Manager

                                                                           3rd-Party Integrations
Content Management                 Customer Relationship                 Billing                        Fraud Control                   Payment Gateway                    Authentication
•       Liferay                    •   Salesforce.com              •   Zuora                        •   TeleSign                    •     Authorize.net                •    CAS (LDAP/AD)
•       JForum                                                     •   Amdocs *                     •   MaxMind                     •     CyberSource *
•       Drupal *                                                                                                                    •     PayPal *
Workloads dictate cloud
architecture
Architecture definition is a process


                             IaaS Cloud
                           Define target workloads

            Determine how that workload will be delivered reliably

           Determine the necessary functionality and performance

                     Develop your technical architecture

                        Implement your environment
Workload categories give us a starting point
                                        Traditional
                                        Enterprise
                                       Applications
                                                              Software
                   Disaster                                 Development,
                   Recovery                                  Testing and
                                                            Maintenance


                Social Media                                  Managed IT
                Applications                                   Services




                                                      High Performance
                    Batch processing
                                                         Computing


23
Possible to categorize workloads into two sets

                           Cloud Workloads


        Traditional Workload                Cloud Workload
      Reliable hardware, backup entire    Tell users to expect failure.
      cloud, and restore for users when   Users to build apps that can
      failure happens                     withstand infrastructure failure



 Both types of workloads must run reliably in the cloud
Every cloud starts with basic building blocks

     Servers                Networking



     Storage      Server       Server     Server
                 Clusters     Clusters   Clusters


    Networking
                             Storage


    Hypervisor



  Resources          Availability Zones             Clouds
How do you build clouds to
meet customer’s needs
-   Traditional server virtualization zone
-   Amazon-Style availability zone
Designing a zone for a traditional workload
                                          Hypervisor

                                               Feature Rich– vSphere, vCenter
           vCenter/XenCenter

                                          Storage
   Enterprise Networking (e.g., VLAN)
                                                    SAN



 Server         Server          Server    Networking
 Cluster        Cluster         Cluster        L2 VLANs


                                          Network Services
     Enterprise Storage (e.g., SAN)
                                             Load Balancing         PV-LANs

                                          Multi-tier Apps

                                            Multi-tier VLANs          OVF
Designing a zone for a traditional workload

                                          • Can achieve significant reliability for
           vCenter/XenCenter
                                            applications running in one zone.
   Enterprise Networking (e.g., VLAN)     • Reliability of individual nodes is very high.
                                          • All zone storage is replicated to a second
 Server
 Cluster
                Server
                Cluster
                                Server
                                Cluster
                                            storage platform (synchronous or
                                            asynchronous)
     Enterprise Storage (e.g., SAN)       • In event of failure, images are recovered
                                            from second storage array.
                                          • Existing workloads will run reliably.
                                          • Little cost benefit over existing approaches
Designing a zone for an Amazon-style workload
       Amazon-Style Availability Zone
          Software Defined Networks                 Hypervisor
       (e.g., Security Groups, EIP, ELB,...)          Simple - XenServer

  Server      Server         Server        Server   Storage
  Racks       Racks          Racks         Racks
                                                              Local            EBS          Object store

  Server      Server         Server        Server
                                                     Networking
  Racks       Racks          Racks         Racks
                                                               L3          SDN based L2     Elastic IP

  Server      Server         Server        Server
                                                    Network Services
  Racks       Racks          Racks         Racks
                                                         Security Groups         ELB              GSLB

              Elastic Block Storage                 Multi-tier Apps

                                                               L3           SDN based VPC       CloudFormation
Object store is critical for Amazon-style cloud
          Amazon-Style Cloud
                                                      Amazon-Style Availability Zone
                  CloudPlatform
                  Mgmt. Server                           Software Defined Networks
                                                      (e.g., Security Groups, EIP, ELB,...)

                                                 Server      Server         Server        Server
                                                 Racks       Racks          Racks         Racks


                                                 Server      Server         Server        Server
Availability   Availability       Availability
                                                 Racks       Racks          Racks         Racks
  Zone           Zone               Zone

                                                 Server      Server         Server        Server
                                                 Racks       Racks          Racks         Racks


                 Object Storage                              Elastic Block Storage
Object store is critical for Amazon-style cloud
          Amazon-Style Cloud
                  CloudPlatform
                  Mgmt. Server                   • Workloads are distributed across
                                                   availability zones
                                                 • No guarantee on zone reliability
                                                 • Applications designed to handle node
Availability   Availability       Availability     level failure
  Zone           Zone               Zone
                                                 • DBs and Templates snapped to
                                                   object store.
                                                 • In event of failure, images are
                 Object Storage                    recreated on new availability zone.
                                                 • Dramatically less expensive
Cloud Transition – General to Workload specific
                Past                                    Today

               General
                                        Traditional-Style         Amazon-Style
             Architecture



• General architecture for any
                                        • Workload-centric architecture
  workload
                                        • Workload-specific failure/disaster
• Limited definitive failure/disaster
                                          recovery
  recovery strategy
                                        • Separate legacy and cloud app
• Focused on legacy or cloud app
                                          architectures with interoperability
  architectures
Support for both type of workloads is required

                  CloudPlatform
                  Mgmt. Server                   Server Virtualization Availability Zone

                                                                  vCenter


                                                    Enterprise Networking (e.g., VLAN)
Availability   Availability       Availability
  Zone           Zone               Zone
                                                  ESXi           ESXi               ESXi
                                                 Cluster        Cluster            Cluster



                 Object Storage                        Enterprise Storage (e.g., SAN)
Key takeaways

1. Understand your workload and the type of cloud you
   want to build.
2. Consider the services you will be delivering from the
   cloud in the future.
3. Choose a platform and architecture that is flexible
   enough to support you today and in the future.
Learn how to build your own cloud
with new educational resources from
Citrix
and partners. http://bit.ly/OHhO08.

• http://www.cloudstack.org
• http://incubator.apache.org/project
  s/cloudstack
Mon1420 build clouds-oliviermaes-citrix

Mon1420 build clouds-oliviermaes-citrix

  • 1.
    Lessons learned from100 cloud deployments Olivier Maes Sr Director Market Development EMEA Cloud Platforms Group Olivier.maes@citrix.com Twitter:omaes72
  • 2.
    Who did welearn from?
  • 3.
    Citrix cloud computingpowers the world’s largest clouds 130 production clouds, 20.000 downloads/month, 50 customers in EMEA Telco and Service Web 2.0 and Public Sector Providers Media Enterprise 3
  • 5.
    Citrix cloud architecture:building blocks we deploy WINDOWS DEV DISASTER BRIDGE & BYO INFRA- YOUR ON-DEMAND & TEST RECOVERY GATEWAY PLATFORM STRUCTURE SERVICE Cloudplatform NetScaler Powered by Apache Cloudstack CloudBridge ESX Hyper-V XenServer KVM OVM VIRTUALIZATION Compute Network Storage
  • 6.
  • 7.
    Since 2008 CloudStackhas powered hundreds of clouds • Secure, multi-tenant cloud orchestration platform – Turnkey platform for delivering IaaS clouds – Hypervisor agnostic – Highly scalable, secure and open – Complete Self-service portal “CloudStack has successfully penetrated the – Open source, open standards service provider market...and racked up some solid wins in the enterprise to boot.” – Deploys on premise or as a hosted solution James Staten Vice President, Principal Analyst • Deliver cloud services 50 times faster at 1/5th the cost • 130 commercial deployments
  • 8.
    CloudPlatform Provides On-demandAccess to Infrastructure Through a Self-Service Portal Org A Org B Users Admin Admin End User Users Users Compute Network Storage Admin Citrix Confidential - Do Not Distribute
  • 9.
    CloudPlatform: key functionalities Maintenanceand Provisioning User Interface Developer API Administrator End User Console Amazon OpenStack Custom Operation, Administration, Availability and Security Image Libraries Integration API Backup LB HA Monitoring Application Catalog Dynamic Workload Management Custom Templates Resource Management Operating System ISOs Servers Storage Network Service Management (Billing, Metering, Accounts, etc.) Virtualization Layer Citrix XenServer | Microsoft Hyper-V | KVM | VMWare ESX Servers Network Storage
  • 10.
    • Elevating CloudStackinto a full open source project • Joining the leading open source cloud projects The Cloud Platform of the • Hadoop, Cassandra, Tomcat, etc Apache Software Foundation • Aligning with the Amazon Cloud standard for ecosystem and interoperability • Not controlled by Citrix
  • 11.
    Apache CloudStack CommunityResponse has been phenomenal Pre Apache Move (Jan 2012) Y/E Goals June Actuals # of unique web visitors 159,211/month 375,000/month 447,325/month # of downloads 8,392/month 16,000/month 20,000/month # of companies endorsing project 0 75 68 # of companies participating 10 125 140 # of developers working on project 40 75 238 # Citrix CloudPlatform Clouds in Production 82 200 130 11
  • 12.
    Cloud ecosystem drivesinnovation Cloud Admin Consumer Services Applications Developer PaaS Layer Cloud Management Service Portal Metering DBaaS Cloud Services Infrastructure Cloud OS DevOps Images and Templates Orchestration Hypervisor Storage Software Networking Software Infrastructure Virtualization Infrastructure Hardware Cloud.com Confidential | Shared Under NDA Only
  • 13.
    “Managed” Clouds andPrivate clouds prevail
  • 14.
    Cloudplatforms support multiplecloud strategies On Premise Hosted Private Cloud Managed Hosted Private Cloud Federated/Hybrid Public Private Cloud Cloud Services Cloud Services Enterprise Enterprise Enterprise Multi-tenant Users Multi-tenant Users Data Center Data Center 3rd party 3rd party hosted & operated operated • Dedicated resource • 3rd party owned and • Mix of shared and • Shared resources • Total control/security operated dedicated resources • Elastic scaling • Internal network • SLA bound • Shared facility and • Pay as you go • Security staff • Public internet • Dedicated resource • VPN access
  • 15.
    Centralized management ofyour availability zones CloudPlatform Management Cluster San Jose London Miami Hosted Dehli Tokyo Hosted Rio
  • 16.
    Self Service portalsare high in demand
  • 17.
    CloudPlatform + CloudPortal= Cloud orchestration + monetization for service providers B/OSS Layer Cloud Services CloudPortal Org A CRM Cloudplatform Admin Hypervisor Auth / Cloud Users SSO Console Server Orchestration Catalog Storage Org B Resource API Commerce Management Firewall Admin Users Load Balancer Service Desk Usage Metering Community Customer Partner Internal Billing
  • 18.
    CloudPortal Business Manager EnablesDifferentiation and Turns Clouds into Profitable Businesses • Comprehensive business and operations support platform for Service Providers CloudPortal – Account management Business Manager – Self-service portal – Billing and metering A purpose-built, business operations – CRM and support ticketing suite for cloud service • Facilitates differentiation and increases providers profitability CloudPortal dramatically accelerates the go-to-market process for IaaS cloud providers running on CloudStack
  • 19.
    CloudPortal key features Account Pricing & Customer Dashboard Partner/OEM Management Billing Relationship Management • Authentication • Product Definition • Sales CRM • Usage Reporting • Partner Provisioning • Account Provisioning • Catalog Management • Ticketing / Help Desk • Messaging • Partner Management • Account Management • Usage Tracking • Community Forums • Alerts • Partner CRM • Cloud Management • Billing • Service Status • Service Status • Partner Dashboard • User Roles • Payment Processing • Partner Billing • Portal Administration CloudPortal Business Manager 3rd-Party Integrations Content Management Customer Relationship Billing Fraud Control Payment Gateway Authentication • Liferay • Salesforce.com • Zuora • TeleSign • Authorize.net • CAS (LDAP/AD) • JForum • Amdocs * • MaxMind • CyberSource * • Drupal * • PayPal *
  • 21.
  • 22.
    Architecture definition isa process IaaS Cloud Define target workloads Determine how that workload will be delivered reliably Determine the necessary functionality and performance Develop your technical architecture Implement your environment
  • 23.
    Workload categories giveus a starting point Traditional Enterprise Applications Software Disaster Development, Recovery Testing and Maintenance Social Media Managed IT Applications Services High Performance Batch processing Computing 23
  • 24.
    Possible to categorizeworkloads into two sets Cloud Workloads Traditional Workload Cloud Workload Reliable hardware, backup entire Tell users to expect failure. cloud, and restore for users when Users to build apps that can failure happens withstand infrastructure failure Both types of workloads must run reliably in the cloud
  • 25.
    Every cloud startswith basic building blocks Servers Networking Storage Server Server Server Clusters Clusters Clusters Networking Storage Hypervisor Resources Availability Zones Clouds
  • 26.
    How do youbuild clouds to meet customer’s needs - Traditional server virtualization zone - Amazon-Style availability zone
  • 27.
    Designing a zonefor a traditional workload Hypervisor Feature Rich– vSphere, vCenter vCenter/XenCenter Storage Enterprise Networking (e.g., VLAN) SAN Server Server Server Networking Cluster Cluster Cluster L2 VLANs Network Services Enterprise Storage (e.g., SAN) Load Balancing PV-LANs Multi-tier Apps Multi-tier VLANs OVF
  • 28.
    Designing a zonefor a traditional workload • Can achieve significant reliability for vCenter/XenCenter applications running in one zone. Enterprise Networking (e.g., VLAN) • Reliability of individual nodes is very high. • All zone storage is replicated to a second Server Cluster Server Cluster Server Cluster storage platform (synchronous or asynchronous) Enterprise Storage (e.g., SAN) • In event of failure, images are recovered from second storage array. • Existing workloads will run reliably. • Little cost benefit over existing approaches
  • 29.
    Designing a zonefor an Amazon-style workload Amazon-Style Availability Zone Software Defined Networks Hypervisor (e.g., Security Groups, EIP, ELB,...) Simple - XenServer Server Server Server Server Storage Racks Racks Racks Racks Local EBS Object store Server Server Server Server Networking Racks Racks Racks Racks L3 SDN based L2 Elastic IP Server Server Server Server Network Services Racks Racks Racks Racks Security Groups ELB GSLB Elastic Block Storage Multi-tier Apps L3 SDN based VPC CloudFormation
  • 30.
    Object store iscritical for Amazon-style cloud Amazon-Style Cloud Amazon-Style Availability Zone CloudPlatform Mgmt. Server Software Defined Networks (e.g., Security Groups, EIP, ELB,...) Server Server Server Server Racks Racks Racks Racks Server Server Server Server Availability Availability Availability Racks Racks Racks Racks Zone Zone Zone Server Server Server Server Racks Racks Racks Racks Object Storage Elastic Block Storage
  • 31.
    Object store iscritical for Amazon-style cloud Amazon-Style Cloud CloudPlatform Mgmt. Server • Workloads are distributed across availability zones • No guarantee on zone reliability • Applications designed to handle node Availability Availability Availability level failure Zone Zone Zone • DBs and Templates snapped to object store. • In event of failure, images are Object Storage recreated on new availability zone. • Dramatically less expensive
  • 32.
    Cloud Transition –General to Workload specific Past Today General Traditional-Style Amazon-Style Architecture • General architecture for any • Workload-centric architecture workload • Workload-specific failure/disaster • Limited definitive failure/disaster recovery recovery strategy • Separate legacy and cloud app • Focused on legacy or cloud app architectures with interoperability architectures
  • 33.
    Support for bothtype of workloads is required CloudPlatform Mgmt. Server Server Virtualization Availability Zone vCenter Enterprise Networking (e.g., VLAN) Availability Availability Availability Zone Zone Zone ESXi ESXi ESXi Cluster Cluster Cluster Object Storage Enterprise Storage (e.g., SAN)
  • 34.
    Key takeaways 1. Understandyour workload and the type of cloud you want to build. 2. Consider the services you will be delivering from the cloud in the future. 3. Choose a platform and architecture that is flexible enough to support you today and in the future.
  • 35.
    Learn how tobuild your own cloud with new educational resources from Citrix and partners. http://bit.ly/OHhO08. • http://www.cloudstack.org • http://incubator.apache.org/project s/cloudstack