Multi-Cluster Service Mesh with Linkerd

•

0 likes•182 views

Presented by: Charles Pretzer (Field Engineer at Buoyant) What do you do when you have services running in multiple clusters and you need to keep track of them? As applications deployed on Kubernetes become more mature, companies find a need for deploying their applications across multiple clusters for any number of reasons, including the need for redundancy and availability zones. The latest release of Linkerd is the first version to support deployment of a service mesh across multiple clusters. In this presentation, Charles Pretzer will talk about the architecture of the Linkerd multicluster implementation within the context of the problems that are solved by having a single service mesh across multiple clusters. After discussing the architecture, we'll demonstrate the deployment so that we can see all the pieces at work.

Technology

Agenda
Service Mesh Overview
Deploying Linkerd Service Mesh and the Service Mirror⌨
Questions/Discussion��
Splitting Traﬃc Across Clusters��
Multicluster Concepts

CB
AA
Service Mesh: The basics
B C
A
CB
User
Traffic
AAX
AAY
AAZ
External
API

Service Mesh: Data Plane
Proxy
Proxy Proxy
A
CB

Service Mesh: Control Plane
Control Plane
Proxy
Proxy Proxy
A
CB

Linkerd
● Observability: Collecting actionable traffic metrics
● Security: Encrypting traffic between services
● Reliability: Ensuring services are available
● Traffic Management: Routing traffic to services

Linkerd
● All accomplished transparently
● No need to instrument your business logic! 🤯

How to multicluster?
Lots of ways to connect multiple Kubernetes clusters!
Linkerd's approach:
● Secure: everything happens over mTLS (confidentiality and authentication)
● Kubernetes-first: remote services should appear as K8s services
● No SPOF: no single cluster is blessed or magical
● Transparent: applications do not need to know whether a service is remote or local
● Network independent: only requirement is gateway connectivity
Heterogeneous clusters, different cloud providers, K8s distros, CNI plugins, ... it shouldn't
matter. Goal is to "just work".

K8s East
test
frontend
podinfo
K8s West
test
frontend
podinfo
Traffic Migration
Canary Deployments
Different Environments
Availability Zones
Failover

K8s East
Service Mirror
Kubeconfig secret
K8s West
API Server
Service Account
Linking the Clusters

K8s East
linkerd-gateway
pod
K8s West
linkerd-gateway
pod
Multicluster Security
linkerd install
📃🔑⚓

K8s East
linkerd
linkerd-multicluster
linkerd-service-mirror
linkerd-gateway
test
frontend
podinfo
K8s West
linkerd
linkerd-multicluster
linkerd-service-mirror
linkerd-gateway
test
frontend
podinfo

Photo Goes Here
Charles Pretzer
Photo Goes Here
@charles - https://slack.linkerd.io
@charpretz
cpretzer
charles@buoyant.io✉

F R O M Y O U R F R I E N D S A T
Join our community!
@linkerdgithub.com/linkerd slack.linkerd.io

What's hot

Service Mesh. What does it mean? We have already learned Microservices and can develop complex distributed applications. Is Service Mesh something we need or is another fancy buzzword? This presentation walks through the evolution of application architecture from Monolith to Service Mesh to give an idea of what a Service Mesh is, how it is applied to existing architectures and is focused help you to understand if you really need it.

Service Mesh - Why? How? What?

Orkhan Gasimov

Service meshes are relatively new, extremely powerful and can be complex. There’s a lot of information out there on what a service mesh is and what it can do, but it’s a lot to sort through. Sometimes, it’s helpful to have a guide. If you’ve been asking questions like “What is a service mesh?” “Why would I use one?” “What benefits can it provide?” or “How did people even come up with the idea for service mesh?” then The Complete Guide to Service Mesh is for you.

The Complete Guide to Service Mesh

Aspen Mesh

Introducing Vault

Ramit Surana

Docker Networking Overview

Sreenivas Makam

Ceph Introduction 2017

Karan Singh

This presentation about Docker will help you learn what Docker and Docker compose is, benefits of Docker compose, differences between Docker compose and Docker swarm, basic commands of docker compose and finally, a demo on docker compose. Docker is a tool which runs containers, whereas Docker Compose is used for running multiple containers as a single service. With compose, containers run in isolation (but they interact with each other). After watching this video, you will able to create a YAML file of docker compose and run multiple containers at a time. Now, let us get started and understand how does a Docker compose work. Below are the topics covered in this Docker compose presentation: 1. What is Docker? 2. What is a Docker Compose? 3. Benefits of Docker compose 4. Docker Compose vs Docker Swarm 5. Basic commands of Docker 6. Demo Why learn DevOps? Simplilearn’s DevOps training course is designed to help you become a DevOps practitioner and apply the latest in DevOps methodology to automate your software development lifecycle right out of the class. You will master configuration management; continuous integration deployment, delivery and monitoring using DevOps tools such as Git, Docker, Jenkins, Puppet and Nagios in a practical, hands on and interactive approach. The Devops training course focuses heavily on the use of Docker containers, a technology that is revolutionizing the way apps are deployed in the cloud today and is a critical skillset to master in the cloud age. After completing the DevOps training course you will achieve hands on expertise in various aspects of the DevOps delivery model. The practical learning outcomes of this Devops training course are: An understanding of DevOps and the modern DevOps toolsets The ability to automate all aspects of a modern code delivery and deployment pipeline using: 1. Source code management tools 2. Build tools 3. Test automation tools 4. Containerization through Docker 5. Configuration management tools 6. Monitoring tools Who should take this course? DevOps career opportunities are thriving worldwide. DevOps was featured as one of the 11 best jobs in America for 2017, according to CBS News, and data from Payscale.com shows that DevOps Managers earn as much as $122,234 per year, with DevOps engineers making as much as $151,461. DevOps jobs are the third-highest tech role ranked by employer demand on Indeed.com but have the second-highest talent deficit. 1. This DevOps training course will be of benefit the following professional roles: 2. Software Developers 3. Technical Project Managers 4. Architects 5. Operations Support 6. Deployment engineers 7. IT managers 8. Development managers Learn more at https://www.simplilearn.com/cloud-computing/devops-practitioner-certification-training

Docker Compose | Docker Compose Tutorial | Docker Tutorial For Beginners | De...

Simplilearn

Manually configuring mounts for containers to various network storage platforms and services is tedious and time consuming. OpenShift and Kubernetes provides a rich library of volume plugins that allow authors of containerized applications (Pods) to declaratively specify what the storage requirements for the containers are so that OpenShift can dynamically provision and allocate the storage assets for the specified containers. As the author of the Kubernetes Persistent Volume specification, I will provide an overview of how Persistent Volume plugins work in OpenShift, demo block storage and file storage volume plugins and close with the Red Hat storage roadmap. Presented at LinuxCon/ContainerCon by Mark Turansky, Principal Software Engineer, Red Hat Mark Turansky is a Principal Software Engineer at Red Hat and a full-time contributor to the Kubernetes Project. Mark is the author of the Kubernetes Persistent Volume specification and a member of the Red Hat OpenShift Engineering team.

Persistent Storage with Containers with Kubernetes & OpenShift

Red Hat Events

Docker multi-stage build

Alexei Ledenev

GraphQL is a query language for APIs and has been adopted by popular web services, including GitHub, ArangoDB and Nautobot, a network automation platform. This session introduces GraphQL and demonstrates using Nautobot as a Source of Truth for managing the configuration of Arista Containerized EOS (cEOS) routers using Ansible. Network engineers who wish to learn GraphQL for Nautobot, Ansible, and cEOS will benefit from this session. A sample code repository will be published for attendees.

Introduction to GraphQL using Nautobot and Arista cEOS

Joel W. King

Istio a service mesh

Chandresh Pancholi

Docker Kubernetes Istio

Araf Karsh Hamid

Terraform

Diego Pacheco

This beginning terraform workshop will teach you how to safely create and provision Infrastructure as Code (IAC) using Hashicorp Terraform in an AWS environment. In this class you will learn how to setup and install terraform. You will also be given a walkthrough of Terraform fundamentals. You will be lead through the process of deploying a single server, deploying a cluster and setting up a load balancer. You will also learn how to author Terraform Modules, work with Route53 and how to manage DNS. Requirements. You will need to have an AWS account set up already with Terraform v0.9.3 installed. You will also need to have git install to download the workshop material. You can find more informaiton on how to install terraform here: https://www.terraform.io/intro/getting-started/install.html. You can sign up for an AWS account here: https://aws.amazon.com/account/ https://github.com/jasonvance/terraform-introduction

Terraform introduction

Jason Vance

OpenTelemetry For Architects

Kevin Brockhoff

Alfresco DevCon 2019 - Alfresco Identity Services in Action

Francesco Corti

Using Rook to Manage Kubernetes Storage with Ceph

CloudOps2005

Introduction to Vault

Knoldus Inc.

Listen up, developers. You are not special. Your infrastructure is not a beautiful and unique snowflake. You have the same tech debt as everyone else. This is a talk about a better way to build and manage infrastructure: Terraform Modules. It goes over how to build infrastructure as code, package that code into reusable modules, design clean and flexible APIs for those modules, write automated tests for the modules, and combine multiple modules into an end-to-end techs tack in minutes. You can find the video here: https://www.youtube.com/watch?v=LVgP63BkhKQ

Reusable, composable, battle-tested Terraform modules

Yevgeniy Brikman

Hyperledger Indy tutorial

ssuser3993f3

Monitoring is the key to successful operation of any software service, but commercial solutions are complex, expensive, and slow. Let us show you how to build monitoring that is simple, cost-effective, and fast using open source stacks easily accessible to any developer. We’ll start with the elements of monitoring systems: data ingest, query engine, visualization, and alerting. We’ll then explain and contrast two implementation approaches. The first uses VictoriaMetrics, a fast growing, high performance time series database that uses PromQL for queries. The second is based on ClickHouse, a popular real-time analytics database that speaks SQL. Fast, affordable monitoring is within reach. This webinar provides designs and working code to get you there.

Application Monitoring using Open Source: VictoriaMetrics - ClickHouse

VictoriaMetrics

What's hot (20)

Service Mesh - Why? How? What?

The Complete Guide to Service Mesh

Introducing Vault

Docker Networking Overview

Ceph Introduction 2017

Docker Compose | Docker Compose Tutorial | Docker Tutorial For Beginners | De...

Persistent Storage with Containers with Kubernetes & OpenShift

Docker multi-stage build

Introduction to GraphQL using Nautobot and Arista cEOS

Istio a service mesh

Docker Kubernetes Istio

Terraform

Terraform introduction

OpenTelemetry For Architects

Alfresco DevCon 2019 - Alfresco Identity Services in Action

Using Rook to Manage Kubernetes Storage with Ceph

Introduction to Vault

Reusable, composable, battle-tested Terraform modules

Hyperledger Indy tutorial

Application Monitoring using Open Source: VictoriaMetrics - ClickHouse

Recently uploaded

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Edi Saputra

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

apidays

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

wesley chun

FWD Group - Insurer Innovation Award 2024

The Digital Insurer

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

apidays

Abhishek Deb(1), Mr Abdul Kalam(2) M. Des (UX) , School of Design, DIT University , Dehradun. This paper explores the future potential of AI-enabled smartphone processors, aiming to investigate the advancements, capabilities, and implications of integrating artificial intelligence (AI) into smartphone technology. The research study goals consist of evaluating the development of AI in mobile phone processors, analyzing the existing state as well as abilities of AI-enabled cpus determining future patterns as well as chances together with reviewing obstacles as well as factors to consider for more growth.

Exploring the Future Potential of AI-Enabled Smartphone Processors

debabhi2

MS Copilot expands with MS Graph connectors

Nanddeep Nachan

Accelerating FinTech Innovation: Unleashing API Economy and GenAI Vasa Krishnan, Chief Technology Officer - FinResults Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

apidays

Scalable LLM APIs for AI and Generative AI Application Development Ettikan Karuppiah, Director/Technologist - NVIDIA Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...

apidays

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

ICT role in 21st century education and its challenges

rafiqahmad00786416

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Martijn de Jong

Building Digital Trust in a Digital Economy Veronica Tan, Director - Cyber Security Agency of Singapore Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

apidays

Axa Assurance Maroc - Insurer Innovation Award 2024

The Digital Insurer

AXA XL - Insurer Innovation Award Americas 2024

The Digital Insurer

DBX First Quarter 2024 Investor Presentation

Dropbox

MySQL Webinar, presented on the 25th of April, 2024. Summary: MySQL solutions enable the deployment of diverse Database Architectures tailored to specific needs, including High Availability, Disaster Recovery, and Read Scale-Out. With MySQL Shell's AdminAPI, administrators can seamlessly set up, manage, and monitor these solutions, ensuring efficiency and ease of use in their administration. MySQL Router, on the other hand, provides transparent routing from the application traffic to the backend servers in the architectures, requiring minimal configuration. Completely built in-house and supported by Oracle, these solutions have been adopted by enterprises of all sizes for their business-critical applications. In this presentation, we'll delve into various database architecture solutions to help you choose the right one based on your business requirements. Focusing on technical details and the latest features to maximize the potential of these solutions.

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Miguel Araújo

Recently uploaded (20)

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Powerful Google developer tools for immediate impact! (2023-24 C)

FWD Group - Insurer Innovation Award 2024

AWS Community Day CPH - Three problems of Terraform

Apidays New York 2024 - The value of a flexible API Management solution for O...

Exploring the Future Potential of AI-Enabled Smartphone Processors

MS Copilot expands with MS Graph connectors

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Artificial Intelligence Chap.5 : Uncertainty

ICT role in 21st century education and its challenges

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Axa Assurance Maroc - Insurer Innovation Award 2024

AXA XL - Insurer Innovation Award Americas 2024

DBX First Quarter 2024 Investor Presentation

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Multi-Cluster Service Mesh with Linkerd

1. Multicluster Service Mesh with

2. Agenda Service Mesh Overview Deploying Linkerd Service Mesh and the Service Mirror⌨ Questions/Discussion�� Splitting Traﬃc Across Clusters�� Multicluster Concepts

3. Service Mesh Overview

4. What's a service mesh? A CB

5. CB AA Service Mesh: The basics B C A CB User Traffic AAX AAY AAZ External API

6. CB AA Service Mesh: The basics B C A CB User Traffic AAX AAY AAZ External API 🖨💵💵 💵 🖨💵💵

7. CB AA Service Mesh: The basics B C A CB User Traffic AAX AAY AAZ External API ��

8. CB AA Service Mesh: The basics B C A CB User Traffic AAX AAY AAZ External API ��

9. CB AA Service Mesh: The basics B C A CB User Traffic AAX AAY AAZ External API ��

10. CB AA Service Mesh: The basics B C A CB User Traffic AAX AAY AAZ External API ��

11. Service Mesh: Data Plane Proxy Proxy Proxy A CB

12. Service Mesh: Control Plane Control Plane Proxy Proxy Proxy A CB

13. Linkerd ● Observability: Collecting actionable traffic metrics ● Security: Encrypting traffic between services ● Reliability: Ensuring services are available ● Traffic Management: Routing traffic to services

14. Linkerd ● All accomplished transparently ● No need to instrument your business logic! 🤯

15. Multicluster Concepts

16. How to multicluster? Lots of ways to connect multiple Kubernetes clusters! Linkerd's approach: ● Secure: everything happens over mTLS (confidentiality and authentication) ● Kubernetes-first: remote services should appear as K8s services ● No SPOF: no single cluster is blessed or magical ● Transparent: applications do not need to know whether a service is remote or local ● Network independent: only requirement is gateway connectivity Heterogeneous clusters, different cloud providers, K8s distros, CNI plugins, ... it shouldn't matter. Goal is to "just work".

17. K8s East test frontend podinfo K8s West test frontend podinfo Traffic Migration Canary Deployments Different Environments Availability Zones Failover

18. K8s East Service Mirror Kubeconfig secret K8s West API Server Service Account Linking the Clusters

19. K8s East linkerd-gateway pod K8s West linkerd-gateway pod Multicluster Security linkerd install 📃🔑⚓

20. K8s East linkerd linkerd-multicluster linkerd-service-mirror linkerd-gateway test frontend podinfo K8s West linkerd linkerd-multicluster linkerd-service-mirror linkerd-gateway test frontend podinfo

21. K8s East linkerd linkerd-multicluster linkerd-service-mirror linkerd-gateway test frontend podinfo K8s West linkerd linkerd-multicluster linkerd-service-mirror linkerd-gateway test frontend podinfo podinfo-east TS

22. Let's Mesh Around

23. Q & A

24. Photo Goes Here Charles Pretzer Photo Goes Here @charles - https://slack.linkerd.io @charpretz cpretzer charles@buoyant.io✉

25. F R O M Y O U R F R I E N D S A T Join our community! @linkerdgithub.com/linkerd slack.linkerd.io

Multi-Cluster Service Mesh with Linkerd

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Multi-Cluster Service Mesh with Linkerd

Similar to Multi-Cluster Service Mesh with Linkerd (20)

Recently uploaded

Recently uploaded (20)

Multi-Cluster Service Mesh with Linkerd