Service Meshes
The Ultimate Guide
infoq.com/articles/service-mesh-ultimate-guide
Do you need service meshes in your tech stack?
Outline
Key takeaways
Timeline
Use Cases
Antipatterns
FAQ
More
I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
A service mesh manages all service-to-
service communication within a
distributed (potentially microservice-
based) software system. It accomplishes
this typically via the use of “sidecar”
proxies that are deployed alongside each
service through which all traffic is
transparently routed.
KEY TAKE AWAY NO 1
I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
Proxies used within a service mesh are
typically “application layer” aware
(operating at Layer 7 in the OSI
networking stack). This means that
traffic routing decisions and the labeling
of metrics can draw upon data in HTTP
headers or other application layer
protocol metadata.
KEY TAKE AWAY NO 2
I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
A service mesh provides dynamic service
discovery and traffic management,
including traffic shadowing (duplicating)
for testing, and traffic splitting for canary
releasing, incremental rollout, and A/B
type experimentation.
KEY TAKE AWAY NO 3
I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
A service mesh also supports the
implementation and enforcement of cross
cutting requirements, such as security
(providing service identity and TLS) and
reliability (rate limiting, circuit-breaking).
KEY TAKE AWAY NO 4
I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
As a service mesh is on the critical path
for every request being handled within
the system, it can also provide additional
“observability,” such as distributed
tracing of a request, frequency of HTTP
error codes, global and service-to-service
latency.
KEY TAKE AWAY NO 5
I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
There are clear benefits provided
by the use of a service mesh, but
the tradeoffs of added complexity
and the requirement of additional
runtime resources should be
analyzed.
KEY TAKE AWAY NO 6
I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
Service mesh technology is rapidly
becoming part of the (cloud native)
application platform “plumbing.” The
interesting innovation within this space is
happening in relation to the higher-level
abstractions and the human-focused
control planes.
KEY TAKE AWAY NO 7
I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
Popular service meshes include: Linkerd,
Istio, Consul, Kuma, and Maesh.
Supporting technologies within this space
include: Layer 7-aware proxies, such as
Envoy, HAProxy, and NGINX; and service
mesh orchestration, visualization, and
understandability tooling, such as
SuperGloo, Kiali, and Dive.
KEY TAKE AWAY NO 8
I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D EI N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
Timeline
SERVICE MESHES ON INFOQ
2011
Twitter began
work on the Scala-
powered Finagle
2013
Airbnb
released
SmartStack
2014
Netflix
released an
entire suite of
JVM-based
utilities
including
Prana
05/ 2017
the releases of
Istio
07/ 2018
Linkerd 2.0
11/2018
Consul Connect
and SuperGloo
05/2019
service mesh
interface
(SMI)
09/2019
Maesh and
Kuma
infoq.com/articles/service-mesh-ultimate-guideI N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
SERVICE MESHES- USE CASES
Z I M C O R E H U B S | D E S I G N T H I N K I N G
DYNAMIC
SERVICE
DISCOVERY
AND ROUTING
SERVICE-TO-
SERVICE
COMMUNICATION
RELIABILITY
OBSERVABILITY OF
TRAFFIC
COMMUNICATION
SECURITY
infoq.com/articles/service-mesh-ultimate-guideI N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
SERVICE MESHES- ANTIPATTERNS
Z I M C O R E H U B S | D E S I G N T H I N K I N G
TOO MANY
TRAFFIC
MANAGEMENT
LAYERS
SERVICE MESH
SILVER BULLET
ENTERPRISE
SERVICE BUS
(ESB) 2.0
BIG BANG
DEPLOYMENT
infoq.com/articles/service-mesh-ultimate-guideI N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
Q: WHAT IS A SERVICE MESH?
A: A service mesh is a technology that manages
all service-to-service, “east-west,” traffic within a
distributed (potentially microservice-based)
software system.
INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
FAQ
Q: HOW DOES A SERVICE MESH DIFFER FROM
AN API GATEWAY?
A: A service mesh manages all service-to-
service, “east-west,” traffic within a distributed
(potentially microservice-based) software
system.
FAQ
INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
Q: IF I AM DEPLOYING MICROSERVICES, DO I
NEED A SERVICE MESH?
A: Not necessarily. A service mesh provides one
way of implementing service discovery. Other
solutions include language-specific libraries
(such as Ribbon and Eureka, or Finagle)
FAQ
INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
Q: DO I NEED A SERVICE MESH TO IMPLEMENT
SERVICE DISCOVERY WITH MICROSERVICES?
A: No. A service mesh provides one way of
implementing service discovery. Other solutions
include language-specific libraries (such as
Ribbon and Eureka, or Finagle)
FAQ
INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
SOME RESOURCES
SERVICE MESH
PODCAST
Idit Levine Discussing
Gloo, Service Mesh
Interface, and Web
Assembly Hub
Oliver Gould on the
Three Pillars of Service
Mesh, SMI, and Making
Technology Bets
SERVICE MESH
INFLUENCERS
Kasun Indrasiri
Bilgin Ibryam
Kelsey Hightower
SERVICE MESH
TUTORIALS
Layer 5 Meshery
Solo’s SuperGloo
KataCoda Istio tutorial
SERVICE MESH
EMAG
Service Mesh: Past,
Present, and Future
https://www.infoq.co
m/minibooks/service-
mesh/
INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
Share your knowledge
WRITE FOR INFOQ
DANIEL BRYANT
InfoQ News Manager
CHARLES HUMBLE
Editor in Chief
Send us an email at
editors@infoq.com
INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
FACEBOOK/INFOQ @INFOQ YOUTUBE/INFOQ
CONNECT WITH US
INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE

Service Meshes- The Ultimate Guide

  • 1.
    Service Meshes The UltimateGuide infoq.com/articles/service-mesh-ultimate-guide Do you need service meshes in your tech stack?
  • 2.
    Outline Key takeaways Timeline Use Cases Antipatterns FAQ More IN F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 3.
    A service meshmanages all service-to- service communication within a distributed (potentially microservice- based) software system. It accomplishes this typically via the use of “sidecar” proxies that are deployed alongside each service through which all traffic is transparently routed. KEY TAKE AWAY NO 1 I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 4.
    Proxies used withina service mesh are typically “application layer” aware (operating at Layer 7 in the OSI networking stack). This means that traffic routing decisions and the labeling of metrics can draw upon data in HTTP headers or other application layer protocol metadata. KEY TAKE AWAY NO 2 I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 5.
    A service meshprovides dynamic service discovery and traffic management, including traffic shadowing (duplicating) for testing, and traffic splitting for canary releasing, incremental rollout, and A/B type experimentation. KEY TAKE AWAY NO 3 I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 6.
    A service meshalso supports the implementation and enforcement of cross cutting requirements, such as security (providing service identity and TLS) and reliability (rate limiting, circuit-breaking). KEY TAKE AWAY NO 4 I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 7.
    As a servicemesh is on the critical path for every request being handled within the system, it can also provide additional “observability,” such as distributed tracing of a request, frequency of HTTP error codes, global and service-to-service latency. KEY TAKE AWAY NO 5 I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 8.
    There are clearbenefits provided by the use of a service mesh, but the tradeoffs of added complexity and the requirement of additional runtime resources should be analyzed. KEY TAKE AWAY NO 6 I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 9.
    Service mesh technologyis rapidly becoming part of the (cloud native) application platform “plumbing.” The interesting innovation within this space is happening in relation to the higher-level abstractions and the human-focused control planes. KEY TAKE AWAY NO 7 I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 10.
    Popular service meshesinclude: Linkerd, Istio, Consul, Kuma, and Maesh. Supporting technologies within this space include: Layer 7-aware proxies, such as Envoy, HAProxy, and NGINX; and service mesh orchestration, visualization, and understandability tooling, such as SuperGloo, Kiali, and Dive. KEY TAKE AWAY NO 8 I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D EI N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 11.
    Timeline SERVICE MESHES ONINFOQ 2011 Twitter began work on the Scala- powered Finagle 2013 Airbnb released SmartStack 2014 Netflix released an entire suite of JVM-based utilities including Prana 05/ 2017 the releases of Istio 07/ 2018 Linkerd 2.0 11/2018 Consul Connect and SuperGloo 05/2019 service mesh interface (SMI) 09/2019 Maesh and Kuma infoq.com/articles/service-mesh-ultimate-guideI N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 12.
    SERVICE MESHES- USECASES Z I M C O R E H U B S | D E S I G N T H I N K I N G DYNAMIC SERVICE DISCOVERY AND ROUTING SERVICE-TO- SERVICE COMMUNICATION RELIABILITY OBSERVABILITY OF TRAFFIC COMMUNICATION SECURITY infoq.com/articles/service-mesh-ultimate-guideI N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 13.
    SERVICE MESHES- ANTIPATTERNS ZI M C O R E H U B S | D E S I G N T H I N K I N G TOO MANY TRAFFIC MANAGEMENT LAYERS SERVICE MESH SILVER BULLET ENTERPRISE SERVICE BUS (ESB) 2.0 BIG BANG DEPLOYMENT infoq.com/articles/service-mesh-ultimate-guideI N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 14.
    Q: WHAT ISA SERVICE MESH? A: A service mesh is a technology that manages all service-to-service, “east-west,” traffic within a distributed (potentially microservice-based) software system. INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE FAQ
  • 15.
    Q: HOW DOESA SERVICE MESH DIFFER FROM AN API GATEWAY? A: A service mesh manages all service-to- service, “east-west,” traffic within a distributed (potentially microservice-based) software system. FAQ INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
  • 16.
    Q: IF IAM DEPLOYING MICROSERVICES, DO I NEED A SERVICE MESH? A: Not necessarily. A service mesh provides one way of implementing service discovery. Other solutions include language-specific libraries (such as Ribbon and Eureka, or Finagle) FAQ INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
  • 17.
    Q: DO INEED A SERVICE MESH TO IMPLEMENT SERVICE DISCOVERY WITH MICROSERVICES? A: No. A service mesh provides one way of implementing service discovery. Other solutions include language-specific libraries (such as Ribbon and Eureka, or Finagle) FAQ INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
  • 18.
    SOME RESOURCES SERVICE MESH PODCAST IditLevine Discussing Gloo, Service Mesh Interface, and Web Assembly Hub Oliver Gould on the Three Pillars of Service Mesh, SMI, and Making Technology Bets SERVICE MESH INFLUENCERS Kasun Indrasiri Bilgin Ibryam Kelsey Hightower SERVICE MESH TUTORIALS Layer 5 Meshery Solo’s SuperGloo KataCoda Istio tutorial SERVICE MESH EMAG Service Mesh: Past, Present, and Future https://www.infoq.co m/minibooks/service- mesh/ INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
  • 19.
    Share your knowledge WRITEFOR INFOQ DANIEL BRYANT InfoQ News Manager CHARLES HUMBLE Editor in Chief Send us an email at editors@infoq.com INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
  • 20.
    FACEBOOK/INFOQ @INFOQ YOUTUBE/INFOQ CONNECTWITH US INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE