Confidential │ ©2018 VMware, Inc.
Private IaaS Cloud
How to design your private IaaS Cloud
David Pasek
dpasek@vmware.com
VMware, Senior HCI Specialist
Design factor analysis
Requirements, Constraints, Assumptions
Confidential │ ©2018 VMware, Inc.
Requirements
- Agile and Flexible Infrastructure for business-critical applications
- Infrastructure Service Delivery in compliance with mutually agreed SLAs
- Active/Active VMware Metro Storage Cluster for some virtual workloads
- Active/Active OS/App Clustering for some virtual workloads
- Local Data Protection of all virtual workloads based on SLA
- Remote Data Protection with Disaster Recovery of some virtual workloads based on SLA
- Private IaaS Cloud Automation
- Hardware infrastructure standardization
- Infrastructure management simplification
Design factor analysis
Requirements, Constraints, Assumptions
Confidential │ ©2018 VMware, Inc.
Constraints
- Technical engineering staff
- Technical operational staff
Design factor analysis
Requirements, Constraints, Assumptions
Confidential │ ©2018 VMware, Inc.
Assumptions
- DC Sites (A,B, DR) are Tier 3+
- 100Gb+ network connectivity between DC sites
Service Catalog
Technical Specifications with SLA’s
Confidential │ ©2018 VMware, Inc.
Self-Service Catalog – VMware vRealize Automation
vRealize Automation as a Self-Service portal
Confidential │ ©2018 VMware, Inc.
Health & SLA – VMware vRealize Operations
vRealize Operations Manager to monitor infrastructure health and SLA
Confidential │ ©2018 VMware, Inc.
Concept of Modern Datacenter
High Level Architecture
Confidential │ ©2018 VMware, Inc.
REMOTE
Site A Site B
Site DR
DC MANAGEMENT CLUSTER
vSphere Cluster - VMware Metro Storage Cluster
PAYLOAD
LOCAL
CLUSTER
vSphere Cluster
PAYLOAD
LOCAL
CLUSTER
vSphere Cluster
PAYLOAD
LOCAL
CLUSTER
vSphere Cluster
PAYLOAD
LOCAL
CLUSTER
vSphere Cluster
PAYLOAD STRETCHED CLUSTER
vSphere Cluster - VMware Metro Storage Cluster
PAYLOAD
LOCAL
CLUSTER
vSphere Cluster
PAYLOAD
LOCAL
CLUSTER
vSphere Cluster
PAYLOAD STRETCHED CLUSTER
vSphere Cluster - VMware Metro Storage Cluster
… …
…
..
DR MANAGEMENT CLUSTER
vSphere Cluster
L2 OVER L3 NETWORK
L2 NETWORK
DC
L2 NETWORK
L2 OVER L3 NETWORK
DR
Site REMOTE
PAYLOAD
LOCAL
CLUSTER
vSphere Cluster
L2 NETWORK
• Dedicated management cluster with
Independent L2 network
• Management Cluster stretched across
two sites
• DC Fabric (L2 over L3 network) for
payload
• Local vSphere Clusters (Resource
Pools)
• Stretched vSphere Clusters (Resource
Pools)
• Disaster Recovery Site
• Remote Sites
pPOD – Universal Concept of Infrastructure Block
High Level Architecture
Confidential │ ©2018 VMware, Inc.
• pPOD is block of physical hardware designed as
integrated system of Compute, Network and
Storage
• pPOD is a single rack
• pPOD is workload domain of one or more vSphere
Clusters
• pPOD is designed as an universal, replaceable
infrastructure component
• pPOD is isolated fault domain.
VMware
Hypervisor
ESXi Server 02
vSphere Cluster
VMware
Hypervisor
ESXi Server N
L3 Ethernet SW L3 Ethernet SW
VMware
Hypervisor
ESXi Server 01
Shared Storage
L3 Fabric nebo
Network
pPOD
Datacenter Facility
…
L3
L2
VMware
Hypervisor
ESXi Server N
vSphere Cluster
…
Shared Storage
pPOD – Rack Layout
High Level Architecture
Confidential │ ©2018 VMware, Inc.
Site
2x L3 TOR Ethernet Switch
Dell EMC VxRAIL Appliances
1x L2 OOB 1Gb Ethernet Switch
OOB 1Gb Eth SW
pPOD – DC Payload Cluster
High Level Architecture
Confidential │ ©2018 VMware, Inc.
pPOD – DC Payload Stretched Cluster
High Level Architecture
Confidential │ ©2018 VMware, Inc.
sPOD – Universal Concept of Storage Block
High Level Architecture
Confidential │ ©2018 VMware, Inc.
• sPOD is block of physical hardware designed as an
integrated system Storage System
• sPOD is designed as a universal, replaceable
infrastructure component
• sPOD supports one or many storage protocols like
• iSCSI, FCoE
• iSER (iSCSI Extensions for RDMA)
• NVMe-oF (RoCE or TCP/IP)
• NFS, CIFS
• S3 API
POD Datacenter
High Level Architecture
Confidential │ ©2018 VMware, Inc.
• pPOD (Hyper Converged Infrastructure)
covers 80%+ datacenter workloads
• sPOD provides special storage services
like
• Object storage
• File storage
• Secondary Storage for backup
• Tertiary storage for archive
• 100Gb DC Fabric (Leaf-Spine) works
as a high bandwidth data traffic
backplane among PODs
L3 Datacenter Fabric
High Level Architecture
Confidential │ ©2018 VMware, Inc.
Network and Security Virtualization Platform
NSX Micro-segmentation
Confidential │ ©2018 VMware, Inc.
SDDC Management
Software-defined Datacenter Management and Operations Stack
Confidential │ ©2018 VMware, Inc.
SDDC Data Protection
Agentless backup – Profile Driven Backup Strategy leveraging vSphere tags
Confidential │ ©2018 VMware, Inc.
SDDC Disaster Recovery
Automated Disaster Recovery from Primary to DR Datacenter
Confidential │ ©2018 VMware, Inc.
People, Organization and Processes
Org Chart for IaaS Cloud provider
Confidential │ ©2018 VMware, Inc.
Confidential │ ©2018 VMware, Inc.
VMware Cloud Foundation
on VxRAIL
What is it? High Level Overview.
David Pasek
VMware, Senior HCI Specialist
IT service delivery automation and self driving operations
Automate IT processes, adopt self driving operations, and build a standardized catalog of services for
easy consumption to accelerate IT service delivery for your business beyond the datacenter with hybrid
cloud.
Business outcomes for Cloud Foundation on VxRail with
VMware cloud management
Rapid deployment of a standarized private cloud
Reduce risk and benefit from a standarized, integrated architecture on premises and off premises
with automated lifecycle management
IT transformation to become a service broker/provider
Accelerate Digital Transformation by adopting an IT-as-a-Service operating model and becoming
a service provider or service broker for your business.
Full stack integration
VMware Cloud Foundation on VxRail delivers
end-to-end stack lifecycle automation
Automated install of
VxRail clusters
& SDDC software
Automated
VxRail & SDDC
environment
configuration
Automated VxRail
infrastructure resources
provisioning (VxRail VI
workload domains)
Integrated
& automated
end- to-end
infrastructure
patch &
upgrade
Rapid deployment and configuration
of HCI infrastructure using native VxRail
deployment process
Rapid SDDC deployment and
configuration that is “VxRail aware”
Integrated provisioning of VxRail
infrastructure pools
One-click, curated, end to end stack
patching and upgrading
Cloud Foundation on VxRail management
Easily deploy, configure, and lifecycle entire end-to-end software and hardware infrastructure stack
ConfigurationDeployment
Patching &
upgrades
Policy based
Provisioning
Configuration
Policy based
Provisioning
Patching &
upgrades
Deployment
SDDC
Manager
VxRail
Manager
vCenterNSX
vRealize Suite
VM
SDDC Manager
• Orchestrates the deployment, configuration, and
lifecycle management of vCenter, NSX, and vRealize
Suite above the ESXi and vSAN layers of VxRail
• Unifies multiple VxRail clusters as workload domains
or as multi-cluster workload domains
VxRail Manager
• Integrated with the SDDC Manager
• Used to deploy, configure, and lifecycle manage
ESXi, vSAN & HW firmware.
• Uses native VxRail Manager deployment processes
• Uses SDDC Manager LCM orchestration framework
to execute native VxRail LCM
• Monitors health of hardware components and
provides remote service support
vSANESXi
HCI HW

Private IaaS Cloud Provider

  • 1.
    Confidential │ ©2018VMware, Inc. Private IaaS Cloud How to design your private IaaS Cloud David Pasek dpasek@vmware.com VMware, Senior HCI Specialist
  • 2.
    Design factor analysis Requirements,Constraints, Assumptions Confidential │ ©2018 VMware, Inc. Requirements - Agile and Flexible Infrastructure for business-critical applications - Infrastructure Service Delivery in compliance with mutually agreed SLAs - Active/Active VMware Metro Storage Cluster for some virtual workloads - Active/Active OS/App Clustering for some virtual workloads - Local Data Protection of all virtual workloads based on SLA - Remote Data Protection with Disaster Recovery of some virtual workloads based on SLA - Private IaaS Cloud Automation - Hardware infrastructure standardization - Infrastructure management simplification
  • 3.
    Design factor analysis Requirements,Constraints, Assumptions Confidential │ ©2018 VMware, Inc. Constraints - Technical engineering staff - Technical operational staff
  • 4.
    Design factor analysis Requirements,Constraints, Assumptions Confidential │ ©2018 VMware, Inc. Assumptions - DC Sites (A,B, DR) are Tier 3+ - 100Gb+ network connectivity between DC sites
  • 5.
    Service Catalog Technical Specificationswith SLA’s Confidential │ ©2018 VMware, Inc.
  • 6.
    Self-Service Catalog –VMware vRealize Automation vRealize Automation as a Self-Service portal Confidential │ ©2018 VMware, Inc.
  • 7.
    Health & SLA– VMware vRealize Operations vRealize Operations Manager to monitor infrastructure health and SLA Confidential │ ©2018 VMware, Inc.
  • 8.
    Concept of ModernDatacenter High Level Architecture Confidential │ ©2018 VMware, Inc. REMOTE Site A Site B Site DR DC MANAGEMENT CLUSTER vSphere Cluster - VMware Metro Storage Cluster PAYLOAD LOCAL CLUSTER vSphere Cluster PAYLOAD LOCAL CLUSTER vSphere Cluster PAYLOAD LOCAL CLUSTER vSphere Cluster PAYLOAD LOCAL CLUSTER vSphere Cluster PAYLOAD STRETCHED CLUSTER vSphere Cluster - VMware Metro Storage Cluster PAYLOAD LOCAL CLUSTER vSphere Cluster PAYLOAD LOCAL CLUSTER vSphere Cluster PAYLOAD STRETCHED CLUSTER vSphere Cluster - VMware Metro Storage Cluster … … … .. DR MANAGEMENT CLUSTER vSphere Cluster L2 OVER L3 NETWORK L2 NETWORK DC L2 NETWORK L2 OVER L3 NETWORK DR Site REMOTE PAYLOAD LOCAL CLUSTER vSphere Cluster L2 NETWORK • Dedicated management cluster with Independent L2 network • Management Cluster stretched across two sites • DC Fabric (L2 over L3 network) for payload • Local vSphere Clusters (Resource Pools) • Stretched vSphere Clusters (Resource Pools) • Disaster Recovery Site • Remote Sites
  • 9.
    pPOD – UniversalConcept of Infrastructure Block High Level Architecture Confidential │ ©2018 VMware, Inc. • pPOD is block of physical hardware designed as integrated system of Compute, Network and Storage • pPOD is a single rack • pPOD is workload domain of one or more vSphere Clusters • pPOD is designed as an universal, replaceable infrastructure component • pPOD is isolated fault domain. VMware Hypervisor ESXi Server 02 vSphere Cluster VMware Hypervisor ESXi Server N L3 Ethernet SW L3 Ethernet SW VMware Hypervisor ESXi Server 01 Shared Storage L3 Fabric nebo Network pPOD Datacenter Facility … L3 L2 VMware Hypervisor ESXi Server N vSphere Cluster … Shared Storage
  • 10.
    pPOD – RackLayout High Level Architecture Confidential │ ©2018 VMware, Inc. Site 2x L3 TOR Ethernet Switch Dell EMC VxRAIL Appliances 1x L2 OOB 1Gb Ethernet Switch OOB 1Gb Eth SW
  • 11.
    pPOD – DCPayload Cluster High Level Architecture Confidential │ ©2018 VMware, Inc.
  • 12.
    pPOD – DCPayload Stretched Cluster High Level Architecture Confidential │ ©2018 VMware, Inc.
  • 13.
    sPOD – UniversalConcept of Storage Block High Level Architecture Confidential │ ©2018 VMware, Inc. • sPOD is block of physical hardware designed as an integrated system Storage System • sPOD is designed as a universal, replaceable infrastructure component • sPOD supports one or many storage protocols like • iSCSI, FCoE • iSER (iSCSI Extensions for RDMA) • NVMe-oF (RoCE or TCP/IP) • NFS, CIFS • S3 API
  • 14.
    POD Datacenter High LevelArchitecture Confidential │ ©2018 VMware, Inc. • pPOD (Hyper Converged Infrastructure) covers 80%+ datacenter workloads • sPOD provides special storage services like • Object storage • File storage • Secondary Storage for backup • Tertiary storage for archive • 100Gb DC Fabric (Leaf-Spine) works as a high bandwidth data traffic backplane among PODs
  • 15.
    L3 Datacenter Fabric HighLevel Architecture Confidential │ ©2018 VMware, Inc.
  • 16.
    Network and SecurityVirtualization Platform NSX Micro-segmentation Confidential │ ©2018 VMware, Inc.
  • 17.
    SDDC Management Software-defined DatacenterManagement and Operations Stack Confidential │ ©2018 VMware, Inc.
  • 18.
    SDDC Data Protection Agentlessbackup – Profile Driven Backup Strategy leveraging vSphere tags Confidential │ ©2018 VMware, Inc.
  • 19.
    SDDC Disaster Recovery AutomatedDisaster Recovery from Primary to DR Datacenter Confidential │ ©2018 VMware, Inc.
  • 20.
    People, Organization andProcesses Org Chart for IaaS Cloud provider Confidential │ ©2018 VMware, Inc.
  • 21.
    Confidential │ ©2018VMware, Inc. VMware Cloud Foundation on VxRAIL What is it? High Level Overview. David Pasek VMware, Senior HCI Specialist
  • 22.
    IT service deliveryautomation and self driving operations Automate IT processes, adopt self driving operations, and build a standardized catalog of services for easy consumption to accelerate IT service delivery for your business beyond the datacenter with hybrid cloud. Business outcomes for Cloud Foundation on VxRail with VMware cloud management Rapid deployment of a standarized private cloud Reduce risk and benefit from a standarized, integrated architecture on premises and off premises with automated lifecycle management IT transformation to become a service broker/provider Accelerate Digital Transformation by adopting an IT-as-a-Service operating model and becoming a service provider or service broker for your business.
  • 23.
    Full stack integration VMwareCloud Foundation on VxRail delivers end-to-end stack lifecycle automation Automated install of VxRail clusters & SDDC software Automated VxRail & SDDC environment configuration Automated VxRail infrastructure resources provisioning (VxRail VI workload domains) Integrated & automated end- to-end infrastructure patch & upgrade Rapid deployment and configuration of HCI infrastructure using native VxRail deployment process Rapid SDDC deployment and configuration that is “VxRail aware” Integrated provisioning of VxRail infrastructure pools One-click, curated, end to end stack patching and upgrading
  • 24.
    Cloud Foundation onVxRail management Easily deploy, configure, and lifecycle entire end-to-end software and hardware infrastructure stack ConfigurationDeployment Patching & upgrades Policy based Provisioning Configuration Policy based Provisioning Patching & upgrades Deployment SDDC Manager VxRail Manager vCenterNSX vRealize Suite VM SDDC Manager • Orchestrates the deployment, configuration, and lifecycle management of vCenter, NSX, and vRealize Suite above the ESXi and vSAN layers of VxRail • Unifies multiple VxRail clusters as workload domains or as multi-cluster workload domains VxRail Manager • Integrated with the SDDC Manager • Used to deploy, configure, and lifecycle manage ESXi, vSAN & HW firmware. • Uses native VxRail Manager deployment processes • Uses SDDC Manager LCM orchestration framework to execute native VxRail LCM • Monitors health of hardware components and provides remote service support vSANESXi HCI HW