Easing the Path to Network Transformation - Network Transformation Experience Kits

© 2019 Intel Corporation, all rights reserved
EASING THE PATH TO NETWORK
TRANSFORMATION
Dana Nehama - Director, Product Management Cloud Networks
Jayakumar Muthurajan (M Jay) – Technical lead Network Products
Network and Custom Logic Group, Intel Corporation
October 30, 2019

DISCUSSION
What are Experience Kits
Network Transformation is here
Network Transformation Experience Kits
Why you should consider them

WHAT ARE EXPERIENCE KITS?
In short… Experience Kits are a collection of collaterals that provide
best-practice guidelines to enable and ease adoption of new
network platforms technologies in next-generation network
Reference
Architecture
Application
Notes
SW
Script
Benchmark
Report
Demo
Training
Available on: https://networkbuilders.intel.com/
COLLATERALS THAT SHOW AND TELL…

© 2019 Intel Corporation, all rights reserved 4
BUSINESS DRIVING NETWOK TRANSFORMATION
FLEXIBILITY
AGILITY
SCALE
RAPID innovations gains in…New opportunities
CLOUD NATIVE
BUSINESS
TRANSFORMATION
NETWORK
TRANSFORMATION
CLOUD
APPROACH
Match needs
MAKE IT EASIER AND FASTER TO GAIN MORE OF THE CLOUD NATIVE
BENEFITS IN NETWORK SERVICES
Entertainment
Healthcare Supply ChainVirtual Reality
Smart Cities

END TO END NETWORK TRANSFORMATION
Capacity
2017
2022
Within Metro
27%
33%
Cross-Regional
25%
24%
Core Cross-Country
48%
43%
<1 ms <5 ms <10-40 ms < 60 ms ~100 msLatency
INTEL 5G END TO END APPROACH ADRESSING NETWORK REQUIREMENTS
PER LOCATION WHILE CAPACITY IS SHIFTING TO THE EDGE
Capacity Estimates: Cisco VNI Global IP Traffic Forecast, 2017-2022

NETWORK TRANSFORMATION BEGINS WITH
NETWORK PLATFORM TRANSFORMATION
NFV - VIRTUALIZATION
2017 2018 2019 2020
BARE METAL – STANDARD SERVER
CLOUD READY - CLOUDIFICATION
AUTOMATION
AGILITY
SCALABILITY
CLOUD NATIVE
ENABLING A SPECTRUM OF DEPLOYMENT MODELS AND
EVOLVING TECHNOLOGIES

NFV - VIRTUALIZATION
2017 2018 2019 2020
BARE METAL – STANDARD SERVER
CLOUD READY - CLOUDIFICATION
AUTOMATION
AGILITY
SCALABILITY
CLOUD NATIVE
ENABLING A SPECTRUM OF DEPLOYMENT MODELS AND
EVOLVING TECHNOLOGIES
5G
EDGE
NETWORK TRANSFORMATION BEGINS WITH
NETWORK PLATFORM TRANSFORMATION

ENABLE NETWORK PLATFORMS’ ADOPTION
OPEN SOURCE & PARTNERS
https://networkbuilders.intel.com/
AUTOMATION
STANDARD INTERFACES
PLATFORM SECURITY
RESOURCE MANAGEMENT
DATA PLANE ACCELERATION
CLOUDIFICATION
Enabling Software
PLATFORM TECHNOLOGIES
Intel® QuickAssist
Technology
Intel® Ethernet
Controller
ADOPTION TOOLS
SCALABLE PLATFORMS
ODM OEM TEMISV OSV
*Other names and brands may be claimed as the property of others.
SOLUTIONSINDUSTRY GAPS ECOSYSTEM ADOPTION
EXPERIENCE KITS

ENABLE NETWORK PLATFORMS’ ADOPTION
OPEN SOURCE & PARTNERSAUTOMATION
STANDARD INTERFACES
PLATFORM SECURITY
RESOURCE MANAGEMENT
CLOUDIFICATION
Enabling Software
PLATFORM TECHNOLOGIES
Intel® QuickAssist
Technology
Intel® Ethernet
Controller
ADOPTION TOOLS
SCALABLE PLATFORMS
ODM OEM TEMISV OSV
EXPERIENCE KITS
CLOUDIFICATION https://networkbuilders.intel.com/

ADDRESS GAPS IN CLOUD NATIVE ORCHESTRATION
KUBERNETES NETWORKING
TELEMETRY
RESOURCE MANAGEMENT
(ENHANCED PLATFORM
AWARNESS)
EASE OF DEPLOYMENT
INDUSTRY GAPS

ADDRESS GAPS IN CLOUD NATIVE ORCHESTRATION
KUBERNETES NETWORKING
TELEMETRY
RESOURCE MANAGEMENT
(ENHANCED PLATFORM
AWARNESS)
EASE OF DEPLOYMENT
GitHub
Faster. Easier. Optimized.
https://networkbuilders.intel.com/network-
technologies/container-experience-kits
EXPERIENCE KITS

12
EXPERIENCE KITS REFERENCES
REFERENCE ARCHITECTURE| Application
Note | Feature Brief | TRAININGNetwork Transformation Experience Kits at:
https://networkbuilders.intel.com/network-technologies/network-transformation-exp-kits
Containers Experience Kits at:
https://networkbuilders.intel.com/network-technologies/container-experience-kits
KUBERNETES
NETWORKING
RESOURCE
MANAGEMENT
AUTOMATION DATA PLANE
ACCELERATION

GET THE EXPERIENCE – START WITH THESE VIDEOS…..
Network Transformation Related Videos:
• SST-BF https://networkbuilders.intel.com/intelr-speed-select-technology-base-frequency-intelr-sst-bf-overview
• DDP: https://networkbuilders.intel.com/intel-ethernet-dynamic-device-personalization-ddp-overview-training-video
• Close Loop Automation Service Healing: https://networkbuilders.intel.com/closed-loop-automation-telemetry-aware-scheduler-for-service-
healing-and-platform-resilience-demo
Containers and Kubernetes Videos:
• Topology Manager: https://networkbuilders.intel.com/topology-management-in-kubernetes-training-video
• Multus: https://networkbuilders.intel.com/multiple-network-interfaces-in-kubernetes-overview-training-video
• BM Ref. Architecture 1: https://networkbuilders.intel.com/container-bare-metal-reference-architecture-overview-part-1-training-video
• BM Ref. Architecture 2: https://networkbuilders.intel.com/container-bare-metal-reference-architecture-technology-part-2-training-video
• BM Ref. Architecture 3: https://networkbuilders.intel.com/container-bare-metal-reference-architecture-installation-part-3-training-video
• BM Ref. Architecture 4: https://networkbuilders.intel.com/container-bare-metal-reference-architecture-verification-part-4-training-video

Discussion Today…..
MULTUS
TOPOLOGY MANAGER
NUMA AWARNESS
CONTAIN BARE METAL
REF. ARCHITECTURE
Multi Network Interfaces
A “meta – plugin”
Open Source
K8s Network Plumbing WG
Intel® Xeon and accelerators
Open Source software
K8s networking solution
Auto deployment
Address performance needs
NUMA resource allocation
Start w CPU Manager and
Device Manager
In Kubernetes 1.16
TELEMETRY AWARE
SCHEDULING
Consider telemetry to
schedule workloads
Apply a policy to make
decisions.
Under development

CONTAINERS BARE
METAL REFERENCE
ARCHITECTURE
…Training and collaterals available on
15

NETWORK PLATFORM REFERENCE ARCHITECTURE
HARDWARE
BOM
SOFTWARE
BOM
TOPOLOGY INSTALLATION
PLAYBOOK
COMPLEMENT
MATERIAL
Connectivity &
configuration
IP Addresses; BKC;
Hierarchy of scripts
that set BKC
configuration loads
SW Capabilities
Experience Kits per
capability
ITEM DESCRIPTION
Platform
Intel® Xeon® Processor
Scalable Family
Processors
2x Intel® Xeon® Gold
5218N Processor
6230N Processor
6252N Processor
BIOS
Intel Corporation
SE5C620.86
B.0D.01.0241
Release Date: 11/19/2018
Switches
Cisco* Catalyst 2960-XR
Arista* DCS-7280QR-C36-
R
Host OS
CentOS* 7.6 build 1810
Kernel version: 3.10.0-
957.1.3.el7.x86_64
Kubespray*
Kubespray: v2.8.0-31-
g3c44ffc
Node Feature
Discovery
NFD v0.3.0
Data Plane
Development
Kit
DPDK 17.05.0
Multus CNI Multus CNI v4.0
SR-IOV CNI SR-IOV CNI v1.0
Userspace CNI Userspace CNI v1.0
 Provide a template solution for a Container Bare Metal deployment model
 Based on Intel hardware and open source software
 Latest available Intel hardware and open source software technologies
Shorten time to AWARENESS, EDUCATION, ADOPTION

REF. ARCHITECTURE (BMRA) ARCITECTURE DIAGRAM
Source: https://builders.intel.com/docs/networkbuilders/container-bare-metal-for-2nd-generation-intel-xeon-scalable-processor.pdf

18
HIGH LEVEL BARE METAL REF. ARCHITECTURE (BMRA)
PLAYBOOK ARCHITECTURE DIAGRAM
ANSIBLE MASTER
PLAYBOOK
PRE CONFIGURE
(kernel options, update
drivers, enable SR-IOV...)
PROVISION
(Kubespray)
HA
Kubernetes
Cluster
Add-ons
Helm server,
Docker
registry,
Multus CNI,
Flannel
FEATURES SETUP
Node
Feature
Discovery
(Helm
chart)
CPU Manager
for
Kubernetes
(Helm chart)
SR-IOV
CNI
Plugin
SR-IOV
Network
Device
Plugin
(Helm
chart)
User space
CNI plugin
User space
Network
Device Plugin
(Helm chart)
Intel Device
Plugins for
Kubernetes
(Helm chart)
1. Setup 2. Capabilities
*Other names and brands may be claimed as the property of others
INSTALLATION AND CONFIGURATION IN ~30 MINUTES
Infra/infra_setup.yml
k8s/k8s.yml
HELM
intel/bmra_features.yml

MULTUS
…Training and collaterals available on
19

WHY MULTUS? WHAT IS THE NEED?
Source: https://github.com/intel/multus-cni

USE CASES REQUIRING MULTIPLE NETWORK SUPPORT
• Storage/legacy applications: Multiple connections are needed to allow the service
provisioned within the pod to access a legacy application or storage drive and, at the
same time, support pod communications.
• Split data plane/control plane applications: most VNFs must connect to both the data
plane and the control plane.
• Virtual Private Network (VPN)/router applications: Multiple network interfaces are
essential for VPN and router use cases where security capabilities need to be extended
into the pod.
• Multi-tenant networks: If pod resources are shared between multiple tenants, multiple
interfaces are needed to enable dedicated network connections for each of those
customers.

MULTUS – BEFORE AND AFTER
• Multus solves the issue that
default Kubernetes supporting
only one pod network interface –
“eth0”
• MULTUS is a “Master CNI Plugin”
KUBELET
CNI
eth0
LINUX BRIDGE
KUBELET
CNI
MULTUS
LINUX BRIDGE
net0
net1
VF0 VF1
SR-IOV
eth0
AfterBefore

EXAMPLE - WHAT MULTUS DOES?
Source: ONS NORTH AMERICA 2019 – RedHat and Intel Presentation

TOPOLOGY MANAGER
(NUMA - NON UNIFIED MEMORY ACCESSN)
…Training available on
25

WHY TOPOLOGY MANAGER ?
Requirement:
NFV workloads demand high throughput and low latency.
Challenge:
In order to extract the best performance, optimizations related to CPU isolation,
memory and device locality are required. In Kubernetes, these optimizations are
handled by disjoint set of components.
CPU
1
Interconnect
Devic
e 0
Socke
t 0
Socke
t 1
Devic
e 1
NUMA NODE 0 NUMA NODE 1
Workload

SOLUTION – TOPOLOGY MANAGER for K8s
 Manages the resources allocated to workloads
in a NUMA topology aware manner
 CPU Manager and Device Manager are the
first components to implement the Topology
Manager interface
 Alpha as of Kubernetes 1.16
28
https://github.com/kubernetes/kubernetes/tree/release-
1.16/pkg/kubelet/cm/topologymanager
https://kubernetes.io/docs/tasks/administer-cluster/topology-
manager/
Devic
e 0
NUMA NODE 1
Sock
et 0
Sock
et 1
Devic
e 1
Workload
NUMA NODE 0
WITH TOPOLOGY MANAGER
CPU
1
Interconnect
Devic
e 0
Socke
t 0
Socke
t 1
Devic
e 1
NUMA NODE 0 NUMA NODE 1
Workload
WITHOUT TOPOLOGY MANAGER
Topology Manager, a kubelet component, provides an interface to co-
ordinate resource assignment on node level

IMPLEMENTATION –
“HINTS” GATHERED FROM OTHER COMPONENTS
We will look at two components:
1) CPU Manager - handles allocation of exclusive CPUs for containers.
2) Device Manager - handles allocation of extended resources such as
accelerators used by containers.
Topology Manager Deciding how to act based on hint providers
1) CPU Manager 2) Device Manager

TAKE AWAY
Intel is collaborating with the industry to enable and advance
solutions for the transforming network
Enabling software is developed as open-sources to allow scale
EXPERIENCE KITS
Experience Kits provide best practice enabling guidance
For more information visit: networkbuilders.intel.com

Legal Disclaimers
Copyright © 2019 Intel Corporation. All rights reserved.
Other names and brands may be claimed as the property of others.
Intel, Xeon, Intel Optane, Agilex, and the Intel logo are trademarks of Intel Corporation or its subsidiaries in the U.S. and/or other countries.
All products, computer systems, dates and figures specified are preliminary based on current expectations, and are subject to change without notice.
Intel® Virtualization Technology requires a computer system with an enabled Intel® processor, BIOS, virtual machine monitor (VMM) and, for some uses, certain platform software enabled for it. Functionality,
performance or other benefits will vary depending on hardware and software configurations and may require a BIOS update. Software applications may not be compatible with all operating systems. Please check with
your application vendor.
Hyper-Threading Technology requires a computer system with a processor supporting HT Technology and an HT Technology-enabled chipset, BIOS and operating system. Performance will vary depending on the
specific hardware and software you use. For more information including details on which processors support HT Technology, see here
Intel® Turbo Boost Technology requires a Platform with a processor with Intel Turbo Boost Technology capability. Intel Turbo Boost Technology performance varies depending on hardware, software and overall
system configuration. Check with your platform manufacturer on whether your system delivers Intel Turbo Boost Technology. For more information, see http://www.intel.com/technology/turboboost
No computer system can provide absolute security under all conditions. Intel® Trusted Execution Technology (Intel® TXT) requires a computer system with Intel® Virtualization Technology, an Intel TXT-enabled
processor, chipset, BIOS, Authenticated Code Modules and an Intel TXT-compatible measured launched environment (MLE). Intel TXT also requires the system to contain a TPM v1.s. For more information, visit
http://www.intel.com/technology/security. In addition, Intel TXT requires that the original equipment manufacturer provides TPM functionality, which requires a TPM-supported BIOS. TPM functionality must be initialized
and may not be available in all countries.
Intel® AES-NI requires a computer system with an AES-NI enabled processor, as well as non-Intel software to execute the instructions in the correct sequence. AES-NI is available on Intel® Core™ i5-600 Desktop
Processor Series, Intel® Core™ i7-600 Mobile Processor Series, and Intel® Core™ i5-500 Mobile Processor Series. For availability, consult your reseller or system manufacturer. For more information,
see http://software.intel.com/en-us/articles/intel-advanced-encryption-standard-instructions-aes-ni/ .
Intel® vPro™ Technology is sophisticated and requires setup and activation. Availability of features and results will depend upon the setup and configuration of your hardware, software and IT environment. To learn
more visit: http://www.intel.com/technology/vpro .
Intel processor numbers are not a measure of performance. Processor numbers differentiate features within each processor series, not across different processor sequences. See
http://www.intel.com/products/processor_number for details. Intel products are not intended for use in medical, life saving, life sustaining, critical control or safety systems, or in nuclear facility applications.

Legal Disclaimers (benchmarks)
Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific
computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully
evaluating your contemplated purchases, including the performance of that product when combined with other products.
Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance.
Results have been simulated and are provided for informational purposes only. Results were derived using simulations run on an architecture simulator or model. Any difference in system hardware or software design
or configuration may affect actual performance.
Intel does not control or audit the design or implementation of third party benchmarks or Web sites referenced in this document. Intel encourages all of its customers to visit the referenced Web sites or others where
similar performance benchmarks are reported and confirm whether the referenced benchmarks are accurate and reflect performance of systems available for purchase.
Intel's compilers may or may not optimize to the same degree for non-Intel microprocessors for optimizations that are not unique to Intel microprocessors. These optimizations include SSE2, SSE3, and SSE3
instruction sets and other optimizations. Intel does not guarantee the availability, functionality, or effectiveness of any optimization on microprocessors not manufactured by Intel.
Microprocessor-dependent optimizations in this product are intended for use with Intel microprocessors. Certain optimizations not specific to Intel microarchitecture are reserved for Intel microprocessors. Please refer
to the applicable product User and Reference Guides for more information regarding the specific instruction sets covered by this notice.
Relative performance is calculated by assigning a baseline value of 1.0 to one benchmark result, and then dividing the actual benchmark result for the baseline platform into each of the specific benchmark results of
each of the other platforms, and assigning them a relative performance number that correlates with the performance improvements reported.

Back Up

What are Experience Kits?
Feature
Briefs
Feature Application
Notes
DEMOS
SW
Script
Benchmark
Report
A library of best-practice architecture
and development guidelines for
accelerating IA and associated
technologies utilization for Network
Transformation
Addresses industry challenges in
performance, manageability, security
and service assurance
Addresses service enabling capabilities
of Intel products (e.g. Xeon, NIC, QAT)
Collateral that
Show and Tell…

Network Transformation Experience Kits –
Easing the Path to Network Transformation
In short… Experience Kits are a collection of collaterals that provide
best-practice guidelines to enable and ease adoption of new
technologies necessary for next-generation network
Reference
Architecture
Application
Notes
SW
Script
Benchmark
Report
Demo
Training
Available on: https://networkbuilders.intel.com/
COLLATERALS THAT SHOW AND TELL…

WORKING WITH THE COMMUNITIES – FOCUS
AREAS
Source: https://github.com/cncf/landscape
Scheduling &
Orchestration Data Plane Acceleration
& Resource Management
Ease of
Deployment
Telemetry Projects contributing to
Tools used
Activities:
CNCF Telco Group
CNCF CNF Test Bed
Kubernetes Special Interest
Groups (SIGs) and Work Groups
• WG: Resource Management
• SIGs: Network, Node,
Scheduling & Instrumentation
Cloud Native
Networking
Ease of
Deployment

38
KUBERNETES NETWORKING EXPERIENCE KITS
Reference Architecture Platform TelemetryEnhanced Platform Awareness Kubernetes Networking
User Guide | Application Note | Feature Brief |
DemoFind Containers Experience Kits at:
https://networkbuilders.intel.com/network-technologies/container-experience-kits

KUBERNETES NETWORKING – NEW DEVELOPMENTS
MULTUS TOPOLOGY MANAGER
NUMA AWARNESS
TELEMETRY AWARE
SCHEDULING
Address performance sensitive applications
Optimal NUMA topology resource allocation
Start w CPU Manager and Device Manager
In Kubernetes 1.16
Consider telemetry to schedule workloads
Apply a policy to make scheduling and
de-scheduling decisions.
Under development
Address the need for multi network interfaces
Multus is a “meta – plugin”
Attach multiple interfaces via CNI plugins:
macvlan, ipvlan, SR-IOV, OVS-DPDK, VPP etc.
Open Source – K8s Network Plumbing WG

Easing the Path to Network Transformation - Network Transformation Experience Kits

More Related Content

What's hot

Similar to Easing the Path to Network Transformation - Network Transformation Experience Kits

More from Liz Warner

Recently uploaded

Easing the Path to Network Transformation - Network Transformation Experience Kits