Design and build a Private Cloud for your Enterprise using a Scalable Architecture.
- Bridge IT and the Public Cloud
- Reduce Cost
- On-Demand Services
- Run Scalable Applications
- Handle Traffic Growth
- Meet Compliance Objectives
- Offer Operational Flexibility and Efficiency
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Data Center for Cloud Computing - DC3X
1. Data Center for Cloud
Computing ( DC3X )
Overview
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
2. An Extensible Platform Architecture,
purpose built for Cloud Scale
environments.
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
3. Cloud Scaling Pillars of Success
Flexible Underlay
Orchestration
Infrastructure as a Service
Micro
Services
Application
Nirvana
A base layer of infrastructure engineered
for vertical and horizontal scaling of
physical resources
Software Defined Compute, Storage and
Networking offering on-demand services
Application deployment and management
automation systems
Containerized 12-Factor applications that can be iterated
frequently and scaled up or down as needs dictate
Applications with shorter development life-cycles can be
updated and deployed more frequently in production
environments leading to better services for end users
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
4. Vision
Bridge IT and the Public Cloud
Reduce Cost
On-Demand Services
Scalable Applications
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
5. Bridge IT and the Public Cloud
• Cloud Computing is desired by developers because of its utilization based Just-in-
Time (JIT) model. Only pay for what you need, when you need it.
• Companies interested in Cloud Computing often see the immediate benefits of
outsourcing their infrastructure to public clouds and moving to a paradigm where
resource provisioning and utilization is on-demand.
• While the gains can be many, the downside of higher cost associated with bandwidth
fees and losing control of their data is not a trade-off some firms choose to make.
• Enterprises often end up seeking an in-house solution that can deliver the same
convenience to their users, but with the benefits of privacy and a lower TCO.
Control and Flexibility
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
6. Reduce Cost
• The often "hidden fees" for bandwidth, along with under-utilization of provisioned resources, can
make the Public-Cloud less economical for longer term usage.
The Public Cloud can become expensive
Legacy Infrastructure Abandonment
• Many enterprises struggle with moving their workloads onto a purely virtualized and
containerized environment.
• A Cloud Architecture that allows them to connect their old and new infrastructures can preserve
previous investments in legacy infrastructure.
Flexible JIT Sourcing
• A white-box and open-source reference architecture means ultimate flexibility with CAPEX and
OPEX expenditures when deploying new environments. Choice of vendors for hardware with
community and vendor support available for software.
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
7. On-Demand
• A key feature of this new platform is a model where physical resources take a modular
“pay-as-you-grow” mode of deployment (typically referred to as a Rack-Scale
architecture).
• The allocation of said resources is on-demand with efficient provisioning of new
hardware by IT operations.
Infrastructure Growth
Services
• Familiar user work-flows for provisioning resources using tools like Terraform to
store Infrastructure-as-Code means no additional training needed for end users who
can self-provision their environments.
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
8. Scalable Applications
• Micro Service style containerized
applications running on orchestration
platforms like Kubernetes can use this
new Private Cloud Platform natively and
integrate with bare-metal application
components not yet converted.
• The automated provisioning of resources
using orchestration platforms means that
DevOps can iterate the software faster
and deploy these changes to production
systems just as quickly.
12-Factor Apps
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
10. Traffic Growth
• As an example, the rise of 4K devices (8K already in development) means the amount of
data created or transferred across networks will increase by an order of magnitude as
adoption of these devices continues.
• 5G connectivity will enhance a myriad of applications like Machine-to-Machine(M2M), the
Internet-of-Things (IoT), Virtual Reality (VR), Augmented Reality (AR) and Automated
Cars that utilize the increased bandwidth available.
• This increase of north/south traffic flow translates to an even greater increase for the
east/west flows as data center traffic is processed, analyzed, stored and rebalanced on the
internal infrastructure.
Reference: http://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual-networking-index-vni/vni-hyperconnectivity-wp.html
Continued growth in traffic requires a scale-up/out architecture
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
11. Compliance
• Organizations and localities have existing laws requiring local data storage.
• A distributed Data Center Architecture is required to build-out localized clouds
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
12. Operational Flexibility and Efficiency
• Retaining local knowledge with standardized builds and workflows can enable
better operational support at a global scale.
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
14. Key Recurring Themes
Modularity and Density
Cloud Scale Infrastructure
Operational Efficiency
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
15. Modularity and Density
Data Center Infrastructure in modular building blocks
Modular DC Vendors
ZTE | SmartCube | Total Site
Solutions | Rittal | PCX | Nortek Air
Solutions | Johnson Controls | IO |
Inspur | Gardner DC Solutions |
Eaton | DATAPOD | CommScope |
Colt | Dell | Emerson Network
Power | HP | Huawei | IBM |
Schneider Electric | SGI |
BASELAYER | BladeRoom
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
16. Data Center Building Blocks
IT Cooling Power
Deploy standardized infrastructure anywhere in the world
Reference: https://www.youtube.com/watch?v=ILcvKUI6mJU https://www.youtube.com/watch?v=Dkq67tASrm4&t
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
17. Data Center Design
• Traditional 3 Tier designs are not scalable.
• Core/Distribution/Access networks that rely on vendor "Big Boxes" are not suitable for scale-out
cloud environments as they lack sufficient port densities.
• Core devices would require continuous upgrades of the hardware as bandwidth requirements
increased.
Problems with Scaling current environments
• Modular and expandable Clos based (Leaf – Spine) design.
• Limited blast radius from a single device failure (no god box).
• 25/50/100Gb Access Port Standardization (lower speeds available).
• White-box hardware (multi-vendor sourcing).
• Open-Source software with optional vendor support.
• Scalable and proven control plane protocol using BGP.
• L3 Fabric with routing on the host.
Solutions for Cloud Architectures
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
18. Scalable Data Center Networking
• Micro
• Mini
• Small
• Medium
• Large
• Extra Large
Provide for the required port density and bandwidth
Layer 3 IP fabric design based on a Clos architecture ideal for scale
out infrastructure.
Single Rack to Entire Data Centers can be designed using a single
model L3 switch.
For a 3:1 over-subscription access to fabric design, port counts can
support thousands of 100Gb or 4x that amount of 10/25Gb ports
per DC zone (Cluster).
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
19. Rack Scale Infrastructure
• Pre-install Infrastructure cabling to
connect to racks.
• Standardize hardware builds at the
rack level to ease deployment of
physical resources.
• Expansion racks can be staged,
shipped to a location and
dynamically inserted into an
environment using remote
provisioning.
Plug & Play
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
20. Example of a Scalable Data Center Topology
Scale Up and Out Clos based Architecture
• Flexible Spine and Leaf Data Center Designs
can deliver the port density required at a
desired over-subscription level.
• Hundreds of Racks can be supported in a
Cluster.
• Multiple Clusters can be connected to further
extend the density of a Data Center.
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
PUBLIC INTERNETPRIVATE CORE
01 02 03 04 05 06 07 08 09 10 11 12
01 02 03 04 05 06 07 08 09 10 11 12
01 02 03 04 05 06 07 08 09 10 11 12
01 02 03 04 05 06 07 08 09 10 11 12
21. Software Defined
• SDN Networking to enable a scalable, backwards-compatible overlay network in the Data Center.
• L2 and L3 Overlay Networking with VXLAN and EVPNs for DCI (Data Center Interconnect).
• On-Demand Networking Services for IaaS (OpenStack), Bare-Metal and Containers with support
for Kubernetes.
• NFV (Network Functions Virtualization) possible for many traditionally physical only devices that
can be virtualized with great performance using DPDK and/or hardware offloads.
• Routers, Firewalls, Load Balancers, WAN Optimization are just a few examples.
• Built in Analytics gives Operations visibility into the Cloud Network.
• Secure by default with automatic Tenant isolation.
• Service policy enforcement with Service-Chaining (ex. dictating that traffic must flow through a
specific set of devices) at VM creation.
• Multi-site networking capable using federation.
Networking
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
22. Software Defined
• Ceph as a storage backend provides a Distributed Object, Block and File System that can be utilized to
store the enormous amounts of Data that will be consumed.
• Increased performance/features with each current release
• BlueStore backend
• RGW federated multisite
• Mellanox Converged Network Adapters
• Support for 10/25/40/50/100Gb/s Ethernet adapters deliver low latency sockets for storage
and networking
• RDMA (Remote Direct Memory Access) / NVMEoF (Non-Volatile Memory over Fabrics)
• Enable all virtualized environments to meet scale-out requirements using hardware offloads
Reference:
http://www.mellanox.com/blog/2016/02/making-ceph-faster-lessons-from-performance-testing/
Storage
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
23. Efficiency through Automation
• Metal as a Service
• Tools that leverage BMC and NIC services like IPMI and PXE to control the hardware and
enable the deployment of switches and servers in a highly distributed and parallel manner.
• Linux Networking Software
• A native Linux OS can be automated like a server using DevOps tools
• PTM (Prescriptive Topology Manager) is a dynamic cabling verification tool to help detect
and eliminate such errors.
• ZTP (Zero Touch Provisioning) enables network devices to be quickly deployed in large-
scale environments.
Automated Provisioning of IaaS Infrastructure
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT
24. Next Steps
• Design and build a POC Private Cloud to increase operational experience.
• Define hardware profiles based on the data center sizing and application classes given their
general requirements.
• Standardize workflows into global playbooks and processes to support production environments.
Key Enablers
RENAUD BLANCHETTE – INFRASTRUCTURE / NETWORK ARCHITECT