The Service Mesh
Management Plane
Lee Calcote and Navendu Pottekkat, Layer5
- confidential -
Service Mesh
Performance
Service Mesh
Interface
Define and Enforce
Service Mesh Standards
Filter Hub GetNighthawk
Advanced Analysis and
Service Mesh Intelligence
The Only Openly Governed
Service Mesh Manager
Meshery
Service Mesh
Patterns
Defining Service
Mesh Best Practices
SMI
Conformance
Cloud Native Application Networking
Service Mesh
Performance
Service Mesh
Interface
Define and Enforce
Service Mesh Standards
Filter Hub GetNighthawk
Advanced Analysis and
Service Mesh Intelligence
The Only Openly Governed
Service Mesh Manager
Meshery
Service Mesh
Patterns
Defining Service
Mesh Best Practices
SMI
Conformance
and ecosystem projects
Stats
● 1,800+ Slack community
● 900+ Meshery users
● 550+ Twitter followers
● 850+ stars, 100+ releases
● 3,700+ performance tests collected
300+ contributors
15 maintainers across different
organizations:
Layer5, Red Hat, Rackspace, Intel, Quantex,
Lumina Networks, VMware, Citrix, Octarine,
HashiCorp, Independent, Microsoft, Google
Community-first
Sustainable open governance, not just open source
Newcomer
Onboarding
Program
#1 Most Popular Project
in Linux Foundation
Mentorship Program
Control
Plane
● Provides policy, configuration, and platform integration.
● Takes a set of isolated stateless sidecar proxies and turns
them into a service mesh.
● Does not touch any packets/requests in the data path.
Data
Plane
● Touches every packet/request in the system.
● Responsible for the execution of traffic control, health
checking, routing, load balancing, authentication,
authorization, and observability.
The service mesh management plane
Service meshes will be ubiquitous. Different service meshes will be deployed.
A
service
mesh
...and enhances in-network intelligence
Management
Plane
● Provides federation, backend system integration,
expanded policy and governance, continuous delivery
integration, workflow, chaos engineering, and application
performance tuning.
Meshery enables operators, developers,
and service owners to realize the full
potential of a service mesh...
Multi-Mesh Management
✔ Lifecycle
✔ Workload
✔ Performance
✔ Configuration
✔ Patterns and Practices
✔ Chaos and Filters
Working with each service mesh
project to incorporate Meshery into
their release process as the measure
of their adherence to service mesh
standards.
The service mesh management plane
Supports:
User
Data
and
Preferences
e
x
t
e
n
s
i
o
n
p
o
i
n
t
Infrastructure
a
c
c
o
u
n
t
s
u
s
e
r
s
g
r
o
u
p
s
r
o
l
e
s
p
e
r
m
i
s
s
i
o
n
s
Identity
t
e
s
t
s
c
h
e
d
u
l
e
t
e
s
t
r
e
s
u
l
t
s
t
e
s
t
p
r
o
fi
l
e
s
e
x
t
e
n
s
i
o
n
p
o
i
n
t
b
o
a
r
d
c
o
n
fi
g
v
a
l
i
d
a
t
o
r
s
p
e
r
f
t
e
s
t
System
Preferences
s
t
a
t
i
c
b
o
a
r
d
e
n
v
i
r
o
n
m
e
n
t
s
System
Deployment
Meshery
Server
Environment
d
o
c
k
e
r
-
c
o
m
p
o
s
e
a
n
a
l
y
t
i
c
s
a
d
a
p
t
e
r
s
K
8
s
m
a
n
i
f
e
s
t
s
H
e
l
m
c
h
a
r
t
s
The extensible mesh manager
Legend
K8s config
Prometheus
Grafana
N:1
1:1
1:1
N:N
Cluster
Provider
1:N
1:1
Adapter
Cluster
Local Provider
temporary storage
default functionality
Adapter
Meshery owns this
Object
Meshery is aware
of this Object
Meshery Extension
Point
Service Mesh
Prometheus
Grafana
Meshery
Preferences
Remote Provider
permanent storage
additional functionality
N:N
Load Generator
Load Generator
kubeconfig
c
o
n
t
e
x
t
mesheryctl config
Control Plane
Defaults
System-wide
Settings
SMI
UI Extension
Point
DB
Extension
Point
Extension
Point
Performance
Meshery owns this
Sub-object
Data Plane Filter
Extension
Point
Meshery
Operator
Prometheus
Application
GraphQL
Server
Extension
Point
Pattern
Pattern Extension
Point
Extension
Point
Extensions
N:1
Jaeger
Meshery Deployment
Meshery adapters
Meshery adapters
gRPC
A
P
I
DB
Meshery
Adapter SMI
Kubernetes
Meshery
Operator
MeshSync
Docker or Kubernetes
Service Mesh
Grafana
Kube API
HTTP
Request
Load
Prometheus
HTTP
HTTP
Service A
Gateway /
Ingress
Gateway /
Egress
Service B Service C
Service E Service D
Service E
HTTP/
TCP
gRPC
Meshery
Meshery adapters
Meshery adapters
gRPC
A
P
I
DB
Meshery
Adapter SMI
Kubernetes
Meshery
Operator
MeshSync
Docker or Kubernetes
Service Mesh
Grafana
Kube API
HTTP
Request
Load
Prometheus
HTTP
HTTP
Service A
Gateway /
Ingress
Gateway /
Egress
Service B Service C
Service E Service D
Service E
HTTP/
TCP
gRPC
Persistence
Layer
Persistence
Layer
Persistence
Layer
Meshery Deployment
Providers
Persistence
Layer
Meshery
University of
Engineering Jaipur
University of
Texas at Austin
SMI Conformance
Remote Provider
None
Local Provider
Meshery
Clients
Meshery Deployment
Clients
Meshery adapters
Meshery adapters
gRPC
A
P
I
DB
Meshery
Adapter SMI
Kubernetes
Meshery
Operator
MeshSync
Docker or Kubernetes
Service Mesh
Grafana
Kube API
HTTP
Request
Load
Prometheus
HTTP
HTTP
Service A
Gateway /
Ingress
Gateway /
Egress
Service B Service C
Service E Service D
Service E
HTTP/
TCP
gRPC
Meshery
GitHub Actions
Assess your service mesh
configuration against deployment
and operational best practices
with Meshery's configuration
analyzer.
Configuration Best Practices
Operate with confidence
Meshery Functionality
✔ Defines compliant behavior.
✔ Produces compatibility matrix.
✔ Ensures provenance of results.
✔ Runs a set of conformance tests.
✔ Securely ensures integrity of results.
✔ Manages all SMI compatible service meshes.
✔ Built into participating service mesh’s release pipeline.
✔ Common sample application for validating test assertions.
Service Mesh Interface Conformance
Meshery, the service mesh compliance tool
Operate and upgrade
with confirmation of
SMI compatibility.
Manage data plane intelligence with
WebAssembly filters
Expect more from your infrastructure
Harnessing data plane intelligence
Dynamically load and manage your own WebAssembly
filters in Envoy-based service meshes.
- confidential -
Service Mesh
Performance
Service Mesh
Interface
Define and Enforce
Service Mesh Standards
Filter Hub GetNighthawk
Advanced Analysis and
Service Mesh Intelligence
The Only Openly Governed
Service Mesh Manager
Meshery
Service Mesh
Patterns
SMI
Conformance
Defining Service
Mesh Best Practices
and ecosystem projects
Service Mesh Patterns
Enabling use of repeatable architectural patterns
name: IstioSM
version: 1.0.1
services:
istio:
type: IstioMesh
namespace: istio-system
settings:
version: 1.8.2
traits:
mTLS:
policy: mutual
namespaces:
- istio-test
automaticSidecarInjection:
namespaces:
- default
- istio-test
grafana:
type: GrafanaIstioAddon
namespace: istio-system
dependsOn:
- istio
- prometheus
prometheus:
type: PrometheusIstioAddon
namespace: istio-system
dependsOn:
- istio
Service Mesh Patterns enable the business function in
simple language.
● Patterns capture service mesh behavior in a single file and
an end-user centric way.
Service Mesh Patterns are service mesh agnostic.
● But, still allow users access service mesh-specific features
and differentiation.
Service Mesh Patterns are reusable.
● Not only are patterns idempotent, but you can easily copy
a pattern and modify to suit.
Meshery delivers
Service Mesh Patterns
Defining Service Mesh Patterns
SMP087: Circuit breaker pattern
layer5.io/books/service-mesh-patterns
- Meet on 1st and 3rd Thursday of every month at 11am Pacific.
- Connect: Slack Channel (#tag-network).
- Join: Service Mesh WG mailing lists at lists.cncf.io
CNCF Service Mesh
Working Group
- confidential -
Service Mesh
Performance
Service Mesh
Interface
Define and Enforce
Service Mesh Standards
Filter Hub GetNighthawk
Advanced Analysis and
Service Mesh Intelligence
The Only Openly Governed
Service Mesh Manager
Meshery
Service Mesh
Patterns
Defining Service
Mesh Best Practices
SMI
Conformance
and ecosystem projects
Facilitates:
- a universal performance index to gauge a service mesh’s efficiency
against deployments in other organizations’ environments.
- benchmarking of service mesh performance
- exchange of performance information from
system-to-system / mesh-to-mesh
- apples-to-apples performance comparisons of
service mesh deployments.
Meshery implements
Service Mesh Performance (SMP)
A vendor neutral specification for
capturing details of infrastructure
capacity, service mesh configuration,
and workload metadata.
smp-spec.io
Directly enables:
- capturing details of infrastructure capacity, service mesh
configuration, and workload metadata.
Performance Management
Understand value vs Overhead
MESHERY
Project Alignment
SMP, SMI, and Meshery
SMP SMI
Meshery runs
conformance for
Meshery
implements
Meshery
implements
SMP goes
deeper and
broader
WASM
Filters
Workloads
Traffic
Metrics
Git
integrations
Workflow
Traffic only
Scheduling
Orchestration
Policy
Benchmarks
Users
-more-
Visual
Topology
Load
Generators
Load Profile
Patterns
Configuration
Analysis
Traffic
Specs
Traffic
Split
Meshery goes
deeper,
incorporating
strategies
Access
Retries
Canaries
Rate
Limiting
Configuration
Designer
MULTI-
MESH
Dry-run
Adaptive
optimization
GitHub
Actions
Service Mesh
Performance
Service Mesh
Interface
Define and Enforce
Service Mesh Standards
Filter Hub GetNighthawk
Advanced Analysis and
Service Mesh Intelligence
The Only Openly Governed
Service Mesh Manager
Meshery
Service Mesh
Patterns
Defining Service
Mesh Best Practices
SMI
Conformance
and ecosystem projects
Meshery integrates GetNighthawk
Distributed systems require distributed analysis
getnighthawk.dev
● the service mesh management plane
● supports wrk2, fortio, and Nighthawk as
single instance load generators.
● a Layer 7 performance characterization tool
created by Envoy project.
● a load generator custom-built for data plane
proxy testing.
Nighthawk Meshery
+
=
● Recursively evaluate optimal configuration using adaptive load controllers
in Meshery for ongoing insight and automatic tuning.
● Parallelize distributed performance testing with high precision for insight
into high tail percentiles. Unlock distributed systems behavioral analysis.
Try Meshery.
Engage in the service mesh community →
https://meshery.io

The service mesh management plane

  • 1.
    The Service Mesh ManagementPlane Lee Calcote and Navendu Pottekkat, Layer5
  • 2.
    - confidential - ServiceMesh Performance Service Mesh Interface Define and Enforce Service Mesh Standards Filter Hub GetNighthawk Advanced Analysis and Service Mesh Intelligence The Only Openly Governed Service Mesh Manager Meshery Service Mesh Patterns Defining Service Mesh Best Practices SMI Conformance Cloud Native Application Networking
  • 3.
    Service Mesh Performance Service Mesh Interface Defineand Enforce Service Mesh Standards Filter Hub GetNighthawk Advanced Analysis and Service Mesh Intelligence The Only Openly Governed Service Mesh Manager Meshery Service Mesh Patterns Defining Service Mesh Best Practices SMI Conformance and ecosystem projects
  • 4.
    Stats ● 1,800+ Slackcommunity ● 900+ Meshery users ● 550+ Twitter followers ● 850+ stars, 100+ releases ● 3,700+ performance tests collected 300+ contributors 15 maintainers across different organizations: Layer5, Red Hat, Rackspace, Intel, Quantex, Lumina Networks, VMware, Citrix, Octarine, HashiCorp, Independent, Microsoft, Google Community-first Sustainable open governance, not just open source Newcomer Onboarding Program #1 Most Popular Project in Linux Foundation Mentorship Program
  • 5.
    Control Plane ● Provides policy,configuration, and platform integration. ● Takes a set of isolated stateless sidecar proxies and turns them into a service mesh. ● Does not touch any packets/requests in the data path. Data Plane ● Touches every packet/request in the system. ● Responsible for the execution of traffic control, health checking, routing, load balancing, authentication, authorization, and observability. The service mesh management plane Service meshes will be ubiquitous. Different service meshes will be deployed. A service mesh ...and enhances in-network intelligence Management Plane ● Provides federation, backend system integration, expanded policy and governance, continuous delivery integration, workflow, chaos engineering, and application performance tuning. Meshery enables operators, developers, and service owners to realize the full potential of a service mesh...
  • 6.
    Multi-Mesh Management ✔ Lifecycle ✔Workload ✔ Performance ✔ Configuration ✔ Patterns and Practices ✔ Chaos and Filters Working with each service mesh project to incorporate Meshery into their release process as the measure of their adherence to service mesh standards. The service mesh management plane Supports:
  • 7.
    User Data and Preferences e x t e n s i o n p o i n t Infrastructure a c c o u n t s u s e r s g r o u p s r o l e s p e r m i s s i o n s Identity t e s t s c h e d u l e t e s t r e s u l t s t e s t p r o fi l e s e x t e n s i o n p o i n t b o a r d c o n fi g v a l i d a t o r s p e r f t e s t System Preferences s t a t i c b o a r d e n v i r o n m e n t s System Deployment Meshery Server Environment d o c k e r - c o m p o s e a n a l y t i c s a d a p t e r s K 8 s m a n i f e s t s H e l m c h a r t s The extensible meshmanager Legend K8s config Prometheus Grafana N:1 1:1 1:1 N:N Cluster Provider 1:N 1:1 Adapter Cluster Local Provider temporary storage default functionality Adapter Meshery owns this Object Meshery is aware of this Object Meshery Extension Point Service Mesh Prometheus Grafana Meshery Preferences Remote Provider permanent storage additional functionality N:N Load Generator Load Generator kubeconfig c o n t e x t mesheryctl config Control Plane Defaults System-wide Settings SMI UI Extension Point DB Extension Point Extension Point Performance Meshery owns this Sub-object Data Plane Filter Extension Point Meshery Operator Prometheus Application GraphQL Server Extension Point Pattern Pattern Extension Point Extension Point Extensions N:1 Jaeger
  • 8.
    Meshery Deployment Meshery adapters Mesheryadapters gRPC A P I DB Meshery Adapter SMI Kubernetes Meshery Operator MeshSync Docker or Kubernetes Service Mesh Grafana Kube API HTTP Request Load Prometheus HTTP HTTP Service A Gateway / Ingress Gateway / Egress Service B Service C Service E Service D Service E HTTP/ TCP gRPC Meshery
  • 9.
    Meshery adapters Meshery adapters gRPC A P I DB Meshery AdapterSMI Kubernetes Meshery Operator MeshSync Docker or Kubernetes Service Mesh Grafana Kube API HTTP Request Load Prometheus HTTP HTTP Service A Gateway / Ingress Gateway / Egress Service B Service C Service E Service D Service E HTTP/ TCP gRPC Persistence Layer Persistence Layer Persistence Layer Meshery Deployment Providers Persistence Layer Meshery University of Engineering Jaipur University of Texas at Austin SMI Conformance Remote Provider None Local Provider Meshery
  • 10.
    Clients Meshery Deployment Clients Meshery adapters Mesheryadapters gRPC A P I DB Meshery Adapter SMI Kubernetes Meshery Operator MeshSync Docker or Kubernetes Service Mesh Grafana Kube API HTTP Request Load Prometheus HTTP HTTP Service A Gateway / Ingress Gateway / Egress Service B Service C Service E Service D Service E HTTP/ TCP gRPC Meshery GitHub Actions
  • 11.
    Assess your servicemesh configuration against deployment and operational best practices with Meshery's configuration analyzer. Configuration Best Practices Operate with confidence
  • 12.
    Meshery Functionality ✔ Definescompliant behavior. ✔ Produces compatibility matrix. ✔ Ensures provenance of results. ✔ Runs a set of conformance tests. ✔ Securely ensures integrity of results. ✔ Manages all SMI compatible service meshes. ✔ Built into participating service mesh’s release pipeline. ✔ Common sample application for validating test assertions. Service Mesh Interface Conformance Meshery, the service mesh compliance tool Operate and upgrade with confirmation of SMI compatibility.
  • 13.
    Manage data planeintelligence with WebAssembly filters Expect more from your infrastructure Harnessing data plane intelligence Dynamically load and manage your own WebAssembly filters in Envoy-based service meshes.
  • 14.
    - confidential - ServiceMesh Performance Service Mesh Interface Define and Enforce Service Mesh Standards Filter Hub GetNighthawk Advanced Analysis and Service Mesh Intelligence The Only Openly Governed Service Mesh Manager Meshery Service Mesh Patterns SMI Conformance Defining Service Mesh Best Practices and ecosystem projects
  • 15.
    Service Mesh Patterns Enablinguse of repeatable architectural patterns name: IstioSM version: 1.0.1 services: istio: type: IstioMesh namespace: istio-system settings: version: 1.8.2 traits: mTLS: policy: mutual namespaces: - istio-test automaticSidecarInjection: namespaces: - default - istio-test grafana: type: GrafanaIstioAddon namespace: istio-system dependsOn: - istio - prometheus prometheus: type: PrometheusIstioAddon namespace: istio-system dependsOn: - istio Service Mesh Patterns enable the business function in simple language. ● Patterns capture service mesh behavior in a single file and an end-user centric way. Service Mesh Patterns are service mesh agnostic. ● But, still allow users access service mesh-specific features and differentiation. Service Mesh Patterns are reusable. ● Not only are patterns idempotent, but you can easily copy a pattern and modify to suit.
  • 16.
  • 17.
    Defining Service MeshPatterns SMP087: Circuit breaker pattern layer5.io/books/service-mesh-patterns - Meet on 1st and 3rd Thursday of every month at 11am Pacific. - Connect: Slack Channel (#tag-network). - Join: Service Mesh WG mailing lists at lists.cncf.io CNCF Service Mesh Working Group
  • 18.
    - confidential - ServiceMesh Performance Service Mesh Interface Define and Enforce Service Mesh Standards Filter Hub GetNighthawk Advanced Analysis and Service Mesh Intelligence The Only Openly Governed Service Mesh Manager Meshery Service Mesh Patterns Defining Service Mesh Best Practices SMI Conformance and ecosystem projects
  • 19.
    Facilitates: - a universalperformance index to gauge a service mesh’s efficiency against deployments in other organizations’ environments. - benchmarking of service mesh performance - exchange of performance information from system-to-system / mesh-to-mesh - apples-to-apples performance comparisons of service mesh deployments. Meshery implements Service Mesh Performance (SMP) A vendor neutral specification for capturing details of infrastructure capacity, service mesh configuration, and workload metadata. smp-spec.io Directly enables: - capturing details of infrastructure capacity, service mesh configuration, and workload metadata.
  • 20.
  • 21.
    MESHERY Project Alignment SMP, SMI,and Meshery SMP SMI Meshery runs conformance for Meshery implements Meshery implements SMP goes deeper and broader WASM Filters Workloads Traffic Metrics Git integrations Workflow Traffic only Scheduling Orchestration Policy Benchmarks Users -more- Visual Topology Load Generators Load Profile Patterns Configuration Analysis Traffic Specs Traffic Split Meshery goes deeper, incorporating strategies Access Retries Canaries Rate Limiting Configuration Designer MULTI- MESH Dry-run Adaptive optimization GitHub Actions
  • 22.
    Service Mesh Performance Service Mesh Interface Defineand Enforce Service Mesh Standards Filter Hub GetNighthawk Advanced Analysis and Service Mesh Intelligence The Only Openly Governed Service Mesh Manager Meshery Service Mesh Patterns Defining Service Mesh Best Practices SMI Conformance and ecosystem projects
  • 23.
    Meshery integrates GetNighthawk Distributedsystems require distributed analysis getnighthawk.dev ● the service mesh management plane ● supports wrk2, fortio, and Nighthawk as single instance load generators. ● a Layer 7 performance characterization tool created by Envoy project. ● a load generator custom-built for data plane proxy testing. Nighthawk Meshery + = ● Recursively evaluate optimal configuration using adaptive load controllers in Meshery for ongoing insight and automatic tuning. ● Parallelize distributed performance testing with high precision for insight into high tail percentiles. Unlock distributed systems behavioral analysis.
  • 24.
    Try Meshery. Engage inthe service mesh community → https://meshery.io