Seminar Accelerating Business Using Microservices Architecture in Digital Age - Intel Presentation

CLOUDINFRASTRUCTUREFOR NEXT-GEN
SERVICES
Frans – Intel Indonesia

CSP Technology Solutions Sales
Container-As-A-Service
Provide the building blocks of a
container infrastructure.
Platform-As-A-Service
Provide HW and Software Tools
required for application development.
Function-As-A-Service
Event driven service, HW completely
abstracted away. Backend is
implemented using containers.
Emerging Business Models

Managed Container Control Plane
Provide a Managed Container Service where the control plane for Container
System is off-premise while the worker nodes are running on-premise.
Stateful Applications in Containers (DBaaS/STaaS)
Provide a way for clients to deploy stateful applications ( like databases ) in
containers
Containers Orchestrated by Multiple Orchestrators
Eg. Spark/Hadoop workloads running together with Web applications managed
thru single pane of glass
Hybrid Cloud with workload federation
Monolith to Micro service code refactoring
CSP Business Opportunities

CSP Technology Solutions Sales 4
Software Development and Design is Changing
Monolithic vs Micro-services
Traditional monolithic software is being re-architected to micro-services architecture
Sample Banking ApplicationMonolithic vs Micro-services
D
B
UI
Business
Logic
Data Access
Layer
D
B
D
B
D
B
Microservice Microservice Microservice
API
Microservice
Monolithic Architecture Microservices Architecture

Independently Deployable1
Independently Scalable2
Independently Manageable3
Highly Available4
Enabled by Container
Technologies!
Why Microservices?

Day in the Life of a Developer
Environment set up and maintenance can add weeks to a project
Start
Project
Write
Code
Build
and
Test
Release
Local Dev Test
Team Build
& Test
CI / CD
Update
Services
Prod
Promote
Binaries
Start
Project
Write
Code
Build
and
Test
Release
Get Resources
Compute, Network,
Storage
Set Up
Environment
Clone
Environment
Local
Debug
Environment
Team Build &
Test
CI / CD
Update
Services
Promote
Binaries
Update
Environment
Dev Test ProdRepeat for every
Environment
Web App
Database
Traditional

Building a Container Infrastructure
• Self Service
• Easy to use
• Flexible
- Infrastructure agnostic
- Different Schedulers
• Centralized Controls
- Access Controls
- Audit Logging
- Policy Management

https://github.com/cncf/landscape
It is a Crowded Ecosystem Today

But Clear Leaders are Emerging
Container Engine
Orchestration
Operating Systems
Network & Security
Telemetry
Service Discovery
PaaS Providers
Endorsing Companies
List Not Comprehensive

Kubernetes - Roadmap
Q3’18 Q4’18 Q1’19 Q2’19
Node Feature Discovery
Detailed Q3
Development
Milestones
AEP enabling through CSI driver
CPU Pooling Rearchitecture CPU Pooling development (if
accepted)
Open Infrastructure Manager
(was OIO)
Hardware
Enabling
FeatureDevStackInteg
AIaaS POC w Kubeflow
POC: Scaleway
AEP enabling App Direct; Integ and validation
IOM upstream documentation and
adoption
Write Upstream documentation
POC: Tencent
AEP benchmarking memory mode
POC: JD.com (SCOPING for Spark)
POC: Nokia, Comcast, Verizon
POC: Nokia, Comcast, Verizon
QAT, FPGA, GPU Plugins QAT, FPGA, GPU Demos
Rethink NFD
requirements to
other interfaces
Implement remaining features
SRIOV plugin patches
Community
leadership
Support DBaaS (see AEP)
Mentorship Program
Target: 6 approvers
Release
Release
Release

ContainerBaremetalExperienceKits
Alibraryofbest-practicedevelopmentguidelinesforContainerbaremetalorchestration
Reference Architecture
Reference Architectures
Installation Scripts
Reference Architecture
User Guide
Platform Telemetry
Application Note
Feature Brief
Demo
Enhance Platform Awareness
Feature Brief
White Paper
Tech. Application Note
Benchmark Test Report
Demo
Kubernetes Networking
Feature Brief
Tech. Application Note
Demo
Released throughout November 30, 2017 on: https://networkbuilders-staging.onsumaye.com/network-technologies/intel-container-bare-metal-experience-kits

Multiple network interfaces for VNFs
High performance Data Plane (N-S)
High performance Data Plane (E-W)
Ability to request/allocate platform capabilities
CPU Core-Pinning for K8s pods
Dynamic Huge Page allocation
High performance Data Plane (UI)
Le
Removing performance penalties for container in VM (UI)
Platform telemetry information
Node Feature
Discovery
CPU Manager for
Kubernetes
Native Huge page
support for
Kubernetes
SR-IOV
VHOST USER
Master VM
Kuryr-
Kubernetes
In Development
Kuryr-k8s v0.1.0: Jun ‘17
Open Source: CNI plug-in
- V2.0 June ‘17
Upstream K8s: TBD
Open Source: CNI plug-in -
V1.0 Sep ‘17
Open Source: CNI plug-in -
V2.0 April ‘17
Open Source: Nov. ‘16
Upstream K8: Incubation
Graduation TBD
Open Source: V1.2 April ‘17
Upstream K8: Phase 1 - V1.8
Sept ‘17
Upstream K8: V1.8 Sept ‘17
Upstream collectd: V5.7.2
June ‘17 ; 5.8.0 ((Q4 2017
date TBD)
Partners&Scaling
Open Source: Available on Intel github https://github.com/Intel-Corp | NFD at https://github.com/kubernetes-incubator/node-feature-discovery
Data Plane challenges

Platinum Member of Foundation
4th biggest contributor to projects
Among Founding members with Google,
500 Node Lab for acceleration of cloud
native software
Founding member – aimed at standardizing
container image format & runtime
Runtime Optimizations Public Cloud Relationships
Open Source Contributions / Partnerships
Intel’s Involvement in the Ecosystem

Purley Platform Enhancements
PERFORMANCE
NEW MEMORY
ARCHITECTURE
INTEGRATED
ACCELERATORS
1.5X Memory bandwidth = Higher container density, faster performance,
better server utilization, lower TCO
RAS features help in early detection of memory errors –
scheduler/orchestrator/telemetry can use this information for reliable
scheduling of containers
Make use of IA technologies directly through containers running on bare
metal
( TXT, QAT, FPGA, SR-IOV, DPDK, vGPU direct access )
Next gen Purley will have Cache and Memory bandwidth (NEW)
monitoring and allocation using Intel Resource Director Technology
(RDT)

Worked with multiple customers in EMEA, APJ & PRC to launch Container-As-
A-Service on Kubernetes, PCF & RH Openshift
Kubernetes plugins for container based VNF for NFV for Telcos/CSPs
PRC customer - 56% cloud gaming hosting capacity improvement per server,
lowering TCO using containers
Intel-IBM-Twistlock container security solution
Some Customer Engagements

NodeFeatureDiscovery
SR-IOV Network Features Single Root I/O Virtualization
AVX CPUID Features: Intel® Advances Vector Extensions
512 (Intel® AVX 512)
Turbo Boost Intel® Turbo Boost Processor accelerator
Node Feature Discovery Label Details
NODE FEATUR DISCOVERY IN K8sPROBLEM
No way to identify hardware capabilities or
configuration
Inability for workload to request certain hardware
feature
SOLUTION
Node Feature Discovery brings Enhanced
Platform Awareness (EPA) to Kubernetes
NFD detects resources on each node in a
Kubernetes cluster and advertises those features
Allows matching of workload to
platform capabilities
REFERENCE
github.com/kubernetes-incubator/node-feature-discovery
NODE 1
NFD
DISCOVERY
POD
NODE 2
NFD
DISCOVERY
POD
SR-IOV
AVX
Turbo
boost
Application A
Application B
POD label:
Application B
Application A
POD label:
SR-IOV
AVX
MASTER
ETCD
NODE 1
NODE 2

ExperienceKitExample:CPUManagerforKubernetesBenchmarkTest
Disclaimer: For more complete information about performance and benchmark results, visit http://www.intel.com/performance. ; Test configuration: Master & Minion Nodes:
{mother board: Intel Corporation; S2600WFQ; CPU: Intel® Xeon® Gold Processor 6138T; 2.0 Ghz; 2 socket; 20 cores; 27.5 MB; 125 W; Memory: Micron MTA36ASF2G72PZ; 1
DIMM/Channel, 6 Channel/Socket; BIOS: Intel Corporation SE5C620.86B.0X.01.0007.060920171037; NIC: Intel Corporation; Ethernet Controller XXV710 for 2x25GbE Firmware
version 5.50; SW: Ubuntu 16.04.2 64bit; Kernel 4.4.0-62-generic x86_64; DPDK 17.05}; IXIA* - IxNetwork 8.10.1046.6 EA; Protocols: 8.10.1105.9, IxOS 8.10.1250.8 EA-Patch1
Core Isolation decrease latency of target workload up
>x13 in presence of Noisy Workload
Uptox55latencydecrease
Test are done with 16 Target Workloads” (=16 Containers) and with or without Noisy Workload present
1 Core with 2 threads are assigned to each container. Noisy Workload uses any available (non-isolated) cores in the system
Platform: Intel® Xeon® Gold Processor 20C@2.00 GHz (6138T); DPDK L2 Forwarding using XXV710 NICs
Core Isolation increase throughput of target-workload
>200% for small packets in presence of Noisy Workload
CoreIsolationleadstoperformanceconsistencysolvingnoisyworkloadsproblem
Uptox4throughput
increase

Kubernetes Solutions
Kubernetes can run on various platforms: from your laptop, to VMs on a cloud
provider, to a rack of bare metal servers. The effort required to set up a cluster
varies from running a single command to crafting your own customized cluster.
Use this guide to choose a solution that fits your needs.
https://kubernetes.io/docs/setup/pick-right-solution/#table-of-solutions

o In house container experts (K8S, Docker, Prometheus, flannel, Calico, OpenStack & more ) – Can help
technically review architecture and feedback. Can help with your field training
o Conduct engineer-engineer discussions on Intel technologies and show optimizations which will help you get
the best out of your hardware
o Ask Intel @ IT ( Learn first hand from Intel IT engineer experience )
o Reference Architectures and Documents posted @ Intel Cloud Builders Intel Builders. Contact your Intel
Account Owner for more information.
o Get in touch with AEs if interested in attending technical workshops or having training sessions
o Leverage strong Intel partner network - Google, MSFT, Apprenda, Nuage, Calico, Mirantis, RedHat, Docker,
CoreOS etc.
Ask Intel Experts Ref. Arch Documents Trainings & Workshops Intel Partner Network
How Can We Help?

References – Where to go for more information
There are some places where you should start and that you should bookmark:
 Docker.com
https://www.docker.com/
 Docker Documentation
https://docs.docker.com/
 Kubernetes.io
https://kubernetes.io/
 Kubernetes Documentation
https://kubernetes.io/docs/home/?path=browse
 YouTube - Docker Channel
https://www.youtube.com/channel/UC76AVf2JkrwjxNKMuPpscHQ
 YouTube – Kubernetes Channel
https://www.youtube.com/channel/UCZ2bu0qutTOM0tHYa_jkIwg
 YouTube – Cloud Native Computing Foundation
https://www.youtube.com/channel/UCvqbFHwN-nwalWPjPUKpvTA
See notes section
for more

Furtherresources
Link to Network Builders / bare metal containers page
INB University training: Container Orchestration with Kubernetes*
https://builders.intel.com/university/networkbuilders/coursescategory/management-and-
orchestration#integration-of-opendaylight-service-function-chaining-and-vector-packet-
processing
Container Bare Metal Experience Kits (released on INB site throughout November 30, 2017)
on: https://networkbuilders-staging.onsumaye.com/network-technologies/intel-container-bare-
metal-experience-kits
Enabling new features with Kubernetes for NFV
https://builders.intel.com/docs/networkbuilders/enabling_new_features_in_kubernetes_for
_NFV.pdf
(Internal) Containers training https://thrive.intel.com/containers/

Seminar Accelerating Business Using Microservices Architecture in Digital Age - Intel Presentation

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Seminar Accelerating Business Using Microservices Architecture in Digital Age - Intel Presentation

Similar to Seminar Accelerating Business Using Microservices Architecture in Digital Age - Intel Presentation (20)

More from PT Datacomm Diangraha

More from PT Datacomm Diangraha (20)

Recently uploaded

Recently uploaded (20)

Seminar Accelerating Business Using Microservices Architecture in Digital Age - Intel Presentation