Building Microservice Systems Without Cooking Your Laptop: Going “Remocal” with Docker, Telepresence & Kubernetes

•

0 likes•94 views

Join me for a tour of coding, testing, and shipping microservices using remote-to-local “remocal” tools and techniques. You will: - Understand the challenges with scaling container-based application development – i.e. you can only run so many microservices locally before minikube melts your laptop. - Learn when to use various types of development practices and tooling based on your use case and requirements for production realism, speed, and practicality. - Explore how to utilize containerized dependencies and Docker for testing, including for both apps and services you own and those you don’t. - Learn how Telepresence can enable “remocal” development, expanding your local machine and Docker Desktop out into a remote Kubernetes cluster.

Software

Building Microservice Systems
Without Cooking Your Laptop
Going “Remocal” with Docker, Telepresence & Kubernetes
Daniel Bryant
@danielbryantuk
Felipe Cruz
@felipecruz

@danielbryantuk | @felipecruz
tl;dr
2
• The inner development loop can be painful with microservices & Kubernetes
• Docker Desktop enables your development journey to cloud native
• Telepresence “proxies” your local machine into the cluster, increasing fast feedback
• Docker Desktop Extension for Telepresence enables “remocal” development
• Telepresence supports several workflows to make you more productive

@danielbryantuk | @felipecruz
@danielbryantuk
3
Daniel Bryant
@danielbryantuk
Ambassador Labs
Felipe Cruz
@felipecruz
Docker

@danielbryantuk | @felipecruz
Setting the Scene
4

@danielbryantuk | @felipecruz
Inner and outer dev loops
5
Hat tip to Mitch Denny (now 404): https://mitchdenny.com/the-inner-loop/
http://jorgemoral.es/posts/2020_03_17-develop_apps…

@danielbryantuk | @felipecruz
SOA: There’s just more stu
ff
(and dependencies)
6

@danielbryantuk | @felipecruz
So, let’s run everything locally…
7

@danielbryantuk | @felipecruz
Docker Desktop becomes your second IDE
Body Text
8

@danielbryantuk | @felipecruz
But if you’re
successful…
Mo’ services,
mo’ problems
9

@danielbryantuk | @felipecruz
tl;dr
10
“My laptop only has 16GB
RAM and you’re asking it
to run Kubernetes and a
JVM and a database???”

@danielbryantuk | @felipecruz
Okay, let’s run everything remotely…
11

@danielbryantuk | @felipecruz
Inner and outer dev loops with K8s
can be the same
12
• Write code
• Build container
• Push to registry
• Deploy to cluster
• Test
And can be …. SLOW.

@danielbryantuk | @felipecruz
Automation can help…
13

@danielbryantuk | @felipecruz
tl;dr
14
But you want a really fast inner loop (no docker build/push) …

@danielbryantuk | @felipecruz
tl;dr
15 And you want to use your own tools.

@danielbryantuk | @felipecruz
tl;dr
16
And you want to avoid the “works on my machine”
production vs local development debacle

@danielbryantuk | @felipecruz
What are Docker Extensions?
Extend Docker Desktop
A way to add new functionality into
Docker Desktop
Improve your team workflows
Connect your favorite dev tools to your
application development and
deployment workflows
Distribution channel
for your tooling
A way for the community and partners
to reach million of developers
18

@danielbryantuk | @felipecruz
What is Telepresence
19
• “Fancy Kubernetes VPN for development”
• “kubectl port-forward on steroids”
• “kubectl proxy all-the-things”
• A network bridge between your laptop and the Kubernetes cluster

@danielbryantuk | @felipecruz
Demo Time!
20

@danielbryantuk | @felipecruz
Our Emoji-User Demo App $$$
21
Web
Emoji
User
Ambassador
Edge Stack
(Ingress)
T
A
Traf
fi
c-
manager
User

@danielbryantuk | @felipecruz
Docker Desktop Extension for Telepresence
22
getambassador.io/testing-with-telepresence-and-docker

@danielbryantuk | @felipecruz
Key scenarios
23

@danielbryantuk | @felipecruz
Remocal development
24
www.slideshare.net/dbryant_uk/jax-london-22-debugging-microservices-remocally-in-kubernetes-with-telepresence

@danielbryantuk | @felipecruz
Testing Microservices: What to use, when
25
Mocks Service virtualization Remocal
Unit tests ✅
Integration tests ✅ ✅
Component tests ✅ ✅ ✅
End-to-end tests ✅ ✅
Poking around an
existing API
✅
Building an API ✅ ✅

@danielbryantuk | @felipecruz
Continuous Delivery
26
https://learning.oreilly.com/library/view/continuous-delivery-in/9781491986011/ch01.html#idm140291459013360
https://www.youtube.com/watch?v=hJkhPP2OLA8&t=291s

@danielbryantuk | @felipecruz
27
Continuous Delivery and build pipelines

@danielbryantuk | @felipecruz
Wrapping up
28

@danielbryantuk | @felipecruz
Telepresence is a CNCF project, with a wide variety of users
29

@danielbryantuk | @felipecruz
Conclusion
30
• The inner development loop can be painful with microservices & Kubernetes
• Docker Desktop enables your development journey to cloud native
• Telepresence “proxies” your local machine into the cluster, increasing fast feedback
• Docker Desktop Extension for Telepresence enables “remocal” development
• Telepresence supports several workflows to make you more productive

@danielbryantuk | @felipecruz
Thank you! Questions?
31
Sample code and extensions:
• github.com/ambassadorlabs/docker-extension-telepresence-java
• docs.docker.com/desktop/extensions/
Learn more:
• www.getambassador.io/kubernetes-learning-center/telepresence-docker-extension/
• hub.docker.com/extensions/ambassador/telepresence-docker-extension

What's hot

Azure DevOps CI/CD For Beginners

Rahul Nath

오픈스택 멀티노드 설치 후기

영우 김

Openshift

Knoldus Inc.

CMP325 talk for AWS re:Invent 2017, by Brendan Gregg. " At Netflix we make the best use of AWS EC2 instance types and features to create a high performance cloud, achieving near bare metal speed for our workloads. This session will summarize the configuration, tuning, and activities for delivering the fastest possible EC2 instances, and will help other EC2 users improve performance, reduce latency outliers, and make better use of EC2 features. We'll show how we choose EC2 instance types, how we choose between EC2 Xen modes: HVM, PV, and PVHVM, and the importance of EC2 features such SR-IOV for bare-metal performance. SR-IOV is used by EC2 enhanced networking, and recently for the new i3 instance type for enhanced disk performance as well. We'll also cover kernel tuning and observability tools, from basic to advanced. Advanced performance analysis includes the use of Java and Node.js flame graphs, and the new EC2 Performance Monitoring Counter (PMC) feature released this year."

How Netflix Tunes EC2 Instances for Performance

Brendan Gregg

Gitlab, GitOps & ArgoCD

Haggai Philip Zagury

Navigate the universe of CI/CD tools. As the fastest way to production, the CI/CD pipeline is now mainstream among software companies, forming the backbone of the modern DevOps environment. While DevOps handles the culture aspect, CI/CD focuses on the process and tools. With this guide, we hope to provide a clear overview of the various CI/CD tools categories and give a broad sampling of the various tools that are available.

CI/CD Tools Universe: The Ultimate List

Plutora

Red Hat OpenStack 17 저자직강+스터디그룹_4주차

Nalee Jang

The overview of lazypull with containerd Remote Snapshotter & Stargz Snapshotter

Kohei Tokunaga

Prometheus (Prometheus London, 2016)

Brian Brazil

Observability on Kubernetes - High Availability on Prometheus

Julian Alarcon Alarcon

Using eBPF for High-Performance Networking in Cilium

ScyllaDB

This talk will provide an introduction to injection options of Envoy and then deep dive into ongoing Linux kernel work that enables injecting Envoy while introducing as little latency as possible. The servicemesh and the sidecar proxy model are on a steep trajectory to redefine many networking and security use cases. This talk explains and demos a new socket redirect Linux kernel technology that allows running Envoy with similar performance as if the sidecar was linked to the application using a UNIX domain socket. The talk will also give an outlook on how Envoy can use the recently merged kernel TLS functionality to gain access to the clear text payload transparently for end to end encrypted applications without requiring to decrypt and re-encrypt any data to further reduce the overhead and latency.

Accelerating Envoy and Istio with Cilium and the Linux Kernel

Thomas Graf

https://dockercon19.smarteventscloud.com/connect/sessionDetail.ww?SESSION_ID=281879 Docker CE 19.03 is going to support "Rootless mode", which allows running the entire Docker daemon and its dependencies as a non-root user on the host, so as to protect the host from malicious containers in a simple but very strong way. Rootless mode is also attractive for users who cannot get `sudo` permission for installing Docker on shared computing machines. e.g. HPC users. In this talk, Akihiro Suda, the author of the Rootless mode (PR: moby#38050), will explain how users can get started with Rootless mode. He will also explain the implementation details of Rootless mode and planned enhancements such as LDAP integration.

[DockerCon 2019] Hardening Docker daemon with Rootless mode

Akihiro Suda

Developers building applications on Kubernetes today are being asked to not just code applications -- they are also responsible for shipping and running their applications, too. We often talk about needing a Kubernetes platform, but are we really looking for a PaaS? Or instead, are we looking for some kind of developer control plane with a Goldilock-sized collection of tools that provides just the right amount of platform? This talk will look back on my experience of building platforms, both as an end-user and now as part of an organization helping our customers do the same. The key takeaways are: - Treat platform as a product - Realize that you can’t have good developer experience (DevEx) without good UX - Focus on workflows and tooling interoperability We’ll wrap this talk with a walk-through of the CNCF ecosystem through the developer control plane lens, and look at what’s next in the future of this important emerging category.

KubeCon EU 2022: From Kubernetes to PaaS to Err What's Next

Daniel Bryant

OpenTelemetry Introduction

DimitrisFinas1

Introduction to Ansible

Knoldus Inc.

In the Cloud Native community, eBPF is gaining popularity, which can often be the best solution for solving different challenges with deep observability of system. Currently, eBPF is being embraced by major players. Mydbops co-Founder, Kabilesh P.R (MySQL and Mongo Consultant) illustrates on debugging linux issues with eBPF. A brief about BPF & eBPF, BPF internals and the tools in actions for faster resolution.

eBPF - Observability In Deep

Mydbops

KUBEDAY - JAPAN 2022 - Building FaaS Platforms.pdf

Mauricio (Salaboy) Salatino

Service Function Chaining (SFC) uses software-defined networking (SDN) capabilities to create a service chain of connected network services (such as L4-7 like firewalls, network address translation [NAT], intrusion protection) and connect them in a virtual chain. This capability can be used by network operators to set up suites or catalogs of connected services that enable the use of a single network connection for many services, with different characteristics. networking-sfc is a service plugin of Openstack neutron. The talk will go over the architecture, implementation, use-cases and latest enhancements to networking-sfc (the APIs and implementation to support service function chaining in neutron). About the speaker: Farhad Sunavala is currently a principal architect/engineer working on Network Virtualization, Cloud service, and SDN technologies at Huawei Technology USA. He has led several wireless projects in Huawei including virtual EPC, service function chaining, etc. Prior to Huawei, he worked 17 years at Cisco. Farhad received his MS in Electrical and Computer Engineering from University of New Hampshire. His expertise includes L2/L3/L4 networking, Network Virtualization, SDN, Cloud Computing, and mobile wireless networks. He holds several patents in platforms, virtualization, wireless, service-chaining and cloud computing. Farhad was a core member of networking-sfc.

Service Function Chaining in Openstack Neutron

Michelle Holley

Learn how to modernize your Java application monitoring and dashboarding with Prometheus and Grafana. There's a lot of information out there when it comes to monitoring a Kubernetes cluster with Prometheus, but, in the modern enterprise landscape, applications are still what matters. Learn how to leverage Prometheus and Grafana to build slick, modern monitoring dashboards and threshold logic for Java applications.

Monitoring Java Applications with Prometheus and Grafana

Justin Reock

What's hot (20)

Azure DevOps CI/CD For Beginners

오픈스택 멀티노드 설치 후기

Openshift

How Netflix Tunes EC2 Instances for Performance

Gitlab, GitOps & ArgoCD

CI/CD Tools Universe: The Ultimate List

Red Hat OpenStack 17 저자직강+스터디그룹_4주차

The overview of lazypull with containerd Remote Snapshotter & Stargz Snapshotter

Prometheus (Prometheus London, 2016)

Observability on Kubernetes - High Availability on Prometheus

Using eBPF for High-Performance Networking in Cilium

Accelerating Envoy and Istio with Cilium and the Linux Kernel

[DockerCon 2019] Hardening Docker daemon with Rootless mode

KubeCon EU 2022: From Kubernetes to PaaS to Err What's Next

OpenTelemetry Introduction

Introduction to Ansible

eBPF - Observability In Deep

KUBEDAY - JAPAN 2022 - Building FaaS Platforms.pdf

Service Function Chaining in Openstack Neutron

Monitoring Java Applications with Prometheus and Grafana

Similar to Building Microservice Systems Without Cooking Your Laptop: Going “Remocal” with Docker, Telepresence & Kubernetes

Many Java-based organizations adopt cloud native development practices with the goal of shipping features faster. The technologies and architectures may change when we move to the cloud, but the fact remains that we all still add the occasional bug to our code. The challenge here is that many of your existing local debugging tools and practices can't be used when everything is running in a container or deployed onto Kubernetes running in the cloud. This is where the open source Telepresence tool can help. Join me to learn about: - The challenges with scaling Kubernetes-based Java development i.e. you can only run so many microservices locally before minikube melts your laptop - An exploration of how Telepresence can "intercept" or reroute traffic from a specified service in a remote K8s cluster to your local dev machine - The benefits of getting a "hot reload" fast feedback loop between applications being developed locally and apps running in the remote environment - A tour of Telepresence, from the sidecar proxy deployed into the remote K8s cluster to the CLI - An overview of using "preview URLs" and header-based routing for the sharing, collaboration, and isolation of changes you are making on your local copy of an intercepted service

LJC 4/21"Easy Debugging of Java Microservices Running on Kubernetes with Tele...

Daniel Bryant

MJC 2021: "Debugging Java Microservices Running on Kubernetes with Telepresence"

Daniel Bryant

Many organizations adopt cloud native development practices with the goal of shipping features faster. The technologies and architectures may change when we move to the cloud, but the fact remains that we all still add the occasional bug to our code. The challenge here is that many of your existing local debugging tools and practices can't be used when everything is running in a container or deployed onto Kubernetes running in the cloud. This is where the open source Telepresence tool can help. Join me to learn about: - The challenges with scaling Kubernetes-based Java development i.e. you can only run so many microservices locally before minikube melts your laptop - An exploration of how Telepresence can "intercept" or reroute traffic from a specified service in a remote K8s cluster to your local dev machine - The benefits of getting a "hot reload" fast feedback loop between applications being developed locally and apps running in the remote environment - A tour of Telepresence, from the sidecar proxy deployed into the remote K8s cluster to the CLI - An overview of using "preview URLs" and header-based routing for the sharing, collaboration, and isolation of changes you are making on your local copy of an intercepted service

Container Days: Easy Debugging of Microservices Running on Kubernetes with Te...

Daniel Bryant

Many Java-based organizations adopt cloud native development practices with the goal of shipping features faster. The technologies and architectures may change when we move to the cloud, but the fact remains that we all still add the occasional bug to our code. The challenge here is that many of your existing local debugging tools and practices can’t be used when everything is running in a container or deployed onto Kubernetes running in the cloud. This is where the open source Telepresence tool can help. Join me to learn about: – The challenges with scaling Kubernetes-based Java development i.e. you can only run so many microservices locally before minikube melts your laptop – Quick overview of remote-local ("removal") options and tooling e.g. “kubectl port-forward”, Skaffold, ksync, Telepresence etc – An exploration of how Telepresence can “intercept” or reroute traffic from a specified service in a remote K8s cluster to your local dev machine – The benefits of getting a “hot reload” fast feedback loop between applications being developed locally and apps running in the remote environment

Devoxx UK 22: Debugging Java Microservices "Remocally" in Kubernetes with Tel...

Daniel Bryant

Docker Enterprise Workshop - Intro

Patrick Chanezon

Many organizations adopt cloud native development practices with the goal of shipping features faster. The technologies and architectures may change when we move to the cloud, but the fact remains that we all still add the occasional bug to our code. The challenge here is that many of your existing local debugging tools and practices can’t be used when everything is running in a container or deployed onto Kubernetes running in the cloud. This is where the open source Telepresence tool can help. Join Daniel to learn about: - Quick overview of remote-local ("remocal") options and tooling e.g. “kubectl port-forward”, Skaffold, ksync, Telepresence etc. - An exploration of how Telepresence can “intercept” or reroute traffic from a specified service in a remote K8s cluster to your local dev machine -- The benefits of getting a “hot reload” fast feedback loop between applications being developed locally and apps running in the remote environment

KubeCrash 22: Debugging Microservices "Remocally" in Kubernetes with Telepres...

Daniel Bryant

Docker 之道 Modernize Traditional Applications with 无为 Create New Cloud Native ...

Patrick Chanezon

When enterprise organizations adopt microservices, containers, and cloud native development, the technologies and architectures may change, but the fact remains that we all still add the occasional bug to our code. The main challenge you now face is how to perform integration or end-to-end testing without spinning up all of your microservices locally and driving your laptop fans into high speed! Join me for a tour of testing microservices using a series of Java applications as a case study. You will learn everything about effective unit testing with mocks, using TestContainers for dependency testing, and using Telepresence to extend your local testing environment into the cloud. Learn when to use each type of test and tooling based on your use case and requirements for realism, speed, and practicality. We will discuss how to utilize containerized dependencies and Docker for testing, including both apps and services you own and those you don’t. We’ll also go over the challenges with scaling container-based application development (you can only run so many microservices locally before minikube melts your laptop). Finally, you’ll see how Telepresence can "intercept" or reroute traffic from a specified service in a remote K8s cluster to your local dev machine.

JAX London 22: Debugging Microservices "Remocally" in Kubernetes with Telepre...

Daniel Bryant

This session will provide an intro to Telepresence, a CNCF Sandbox tool. We’ll talk about development workflows for Kubernetes. We’ll discuss the differences between traditional development, and different approaches people take to building Kubernetes services. We’ll then introduce Telepresence and discuss how it integrates with different organizational development workflows. Finally, we’ll talk about the evolution of Telepresence and how we are actively moving Telepresence forward from its heritage as a VPN-type approach into a more sophisticated L7 routing layer for developers.

KubeCon NA 2019 "Introduction to Telepresence: Fast Development (and Debuggin...

Daniel Bryant

When enterprise organizations adopt microservices, containers, and cloud native development, the technologies and architectures may change, but the fact remains that we all still add the occasional bug to our code. The main challenge you now face is how to perform integration or end-to-end testing without spinning up all of your microservices locally and driving your laptop fans into high speed! Join me for a tour of your microservices testing options using a series of Java-friendly tools. - Explore challenges with scaling container-based application development (you can only run so many microservices locally before minikube melts your laptop) - Learn about effective unit testing with mocks, using TestContainers for dependency testing, and using Telepresence to extend your local testing environment into the cloud - Understand when to use each type of test and tooling based on your use case and requirements for realism, speed, and practicality - See how Telepresence can "intercept" or reroute traffic from a specified service in a remote K8s cluster to your local dev machine

Java Meetup 23: 'Debugging Microservices "Remocally" in Kubernetes with Telep...

Daniel Bryant

When enterprise organizations adopt microservices, containers, and cloud native development, the technologies and architectures may change, but the fact remains that we all still add the occasional bug to our code. The main challenge you now face is how to perform integration or end-to-end testing without spinning up all of your microservices locally and driving your laptop fans into high speed! Join me for a tour of your microservices testing options using a series of Java-friendly tools. - Explore challenges with scaling container-based application development (you can only run so many microservices locally before minikube melts your laptop) - Learn about effective unit testing with mocks, using TestContainers for dependency testing, and using Telepresence to extend your local testing environment into the cloud - Understand when to use each type of test and tooling based on your use case and requirements for realism, speed, and practicality - See how Telepresence can "intercept" or reroute traffic from a specified service in a remote K8s cluster to your local dev machine

CraftConf 2023 "Microservice Testing Techniques: Mocks vs Service Virtualizat...

Daniel Bryant

DockerCon EU 2015: Day 1 General Session

Docker, Inc.

Tekton_ArgoCD-_KCD_Taiwan-cicd-openshift

bashwen2022

Docker adventures in Continuous Delivery - Alex Vranceanu

ITCamp

Scaling Your App With Docker Swarm using Terraform, Packer on Openstack

Bobby DeVeaux, DevOps Consultant

A hands-on workshop will go over the foundations of the containers platform, including an overview of the platform system components: images, containers, repositories, clustering, and orchestration. The strategy is to demonstrate through "live demo, and hands-on exercises." The reuse case of containers in building a portable distributed application cluster running a variety of workloads including HPC workload.

Bahrain ch9 introduction to docker 5th birthday

Walid Shaari

In celebration of Docker's 5th birthday in March, user groups all around the world hosted birthday events with an introduction to Docker presentation and hands-on-labs. We invited Docker users to recognize where they were on their Docker journey and the goal was to help them take the next step of their journey with the help of mentors. This presentation was done at the beginning of the events (this one is from the San Francisco event in HQ) and gives a run down of the birthday event series, Docker's momentum, a basic explanation of containers, the benefits of using the Docker platform, Docker + Kubernetes and more.

Docker Bday #5, SF Edition: Introduction to Docker

Docker, Inc.

Tampere Docker meetup - Happy 5th Birthday Docker

Sakari Hoisko

In this talk, Oleg will explain and show how you can simplify (and maybe even speed up) the development of modern .NET applications based on micro-service architecture and aimed at deployment in Kubernetes. We will also talk about a young and promising Tye project from Microsoft. We will look at what the Tye project is and how it simplifies the development process, both with examples from several .NET microservices and with more complex examples that involve interaction with external services.

"Project Tye to Tie .NET Microservices", Oleg Karasik

Fwdays

How can we effectively develop for the cloud, when we as developers are coding back down on earth? This is where effective cloud-native developer tools can enable us to either be transported into the cloud or alternatively, to bring the cloud back down to earth. But what tools should we be using for this? In this session, we’ll explore some of the useful OSS tools and technologies that can used by developers to effectively develop, design and test cloud-native Java applications.

FooConf23_Bringing the cloud back down to earth.pptx

Grace Jansen

Similar to Building Microservice Systems Without Cooking Your Laptop: Going “Remocal” with Docker, Telepresence & Kubernetes (20)

LJC 4/21"Easy Debugging of Java Microservices Running on Kubernetes with Tele...

MJC 2021: "Debugging Java Microservices Running on Kubernetes with Telepresence"

Container Days: Easy Debugging of Microservices Running on Kubernetes with Te...

Devoxx UK 22: Debugging Java Microservices "Remocally" in Kubernetes with Tel...

Docker Enterprise Workshop - Intro

KubeCrash 22: Debugging Microservices "Remocally" in Kubernetes with Telepres...

Docker 之道 Modernize Traditional Applications with 无为 Create New Cloud Native ...

JAX London 22: Debugging Microservices "Remocally" in Kubernetes with Telepre...

KubeCon NA 2019 "Introduction to Telepresence: Fast Development (and Debuggin...

Java Meetup 23: 'Debugging Microservices "Remocally" in Kubernetes with Telep...

CraftConf 2023 "Microservice Testing Techniques: Mocks vs Service Virtualizat...

DockerCon EU 2015: Day 1 General Session

Tekton_ArgoCD-_KCD_Taiwan-cicd-openshift

Docker adventures in Continuous Delivery - Alex Vranceanu

Scaling Your App With Docker Swarm using Terraform, Packer on Openstack

Bahrain ch9 introduction to docker 5th birthday

Docker Bday #5, SF Edition: Introduction to Docker

Tampere Docker meetup - Happy 5th Birthday Docker

"Project Tye to Tie .NET Microservices", Oleg Karasik

FooConf23_Bringing the cloud back down to earth.pptx

More from Daniel Bryant

API Gateways are certainly not a new technology, but the way in which they are being deployed, configured, and operated within modern platforms is forcing many of us to rethink our approach. Can we simply lift and shift our existing gateway into the cloud? Is our API gateway GitOps friendly (and does it need to be)? And what about service meshes, CNI, eBPF, and... Join this talk for a whistle stop tour of modern API gateways, which a focus on deploying and managing this technology within Kubernetes (on which many modern platforms are built): - Understand why platform engineers should care about API Gateways today - Learn about API gateways, options, and requirements for modern platforms - Identify key considerations for migrating to the cloud or building a new platform on Kubernetes - Understand how cloud native workflows impact the user/developer experience (UX/DX) of an API gateway - Explore the components of a complete "edge stack" that supports end-to-end development flows

ITKonekt 2023: The Busy Platform Engineers Guide to API Gateways

Daniel Bryant

PlatformCon 23: "The Busy Platform Engineers Guide to API Gateways"

Daniel Bryant

Over the last year, the Ambassador Labs team has doubled down on their adoption of Product Led Growth (PLG), a growth model where product usage drives customer acquisition, retention, and expansion. It’s been an interesting journey for the DevRel team, who have found themselves working more closely with both the sales and growth engineering teams. In their quest to reduce the friction of product adoption, they’re thinking more and more about the end-to-end experiences, experimentation, instrumentation, data analysis, and handoffs — much like we saw in the software development world with the adoption of DevOps breaking down barriers between engineering and operations. The Ambassador Labs team have learned more about the value of creating hypotheses and analyzing quantitative data, but have also been reminded that there is no substitute for qualitative data and engaging human-to-human. Join Daniel for a whistle-stop tour of PLG through the DevRel lens: – Understand how moving to PLG can impact devrel teams and the work they do: for better and worse! – Explore how DevRel tooling and community platforms are increasingly overlapping with PLG marketer tooling – Learn how to structure your goals, common languages, and teams for successfully adopting PLG

DevRelCon 2022: "Is Product Led Growth (PLG) the “DevOps” of the DevRel World"

Daniel Bryant

Developers building applications on Kubernetes today are being asked to not just code applications -- they are also responsible for shipping and running their applications, too. We often talk about needing a Kubernetes platform, but are we really looking for a PaaS? Or instead, are we looking for some kind of developer control plane with a Goldilock-sized collection of tools that provides just the right amount of platform? This talk will look back on my experience of building platforms, both as an end-user and now as part of an organization helping our customers do the same. We’ll wrap this talk with a walk-through of the CNCF ecosystem through the developer control plane lens, and look at what’s next in the future of this important emerging category.

Fall 22: "From Kubernetes to PaaS to... err, what's next"

Daniel Bryant

CloudBuilders 2022: "The Past, Present, and Future of Cloud Native API Gateways"

Daniel Bryant

Developers building applications on Kubernetes today are being asked to not just develop applications -- they are also responsible for releasing and running their applications, too. In this talk, we’ll discuss the secular shift towards what Netflix calls “Full Cycle Development” or what Google calls “Service Ownership”. With developers managing so much of the cloud-native development loop, a new class of infrastructure has emerged -- the developer control plane. We’ll explore the evolution from Kubernetes to PaaS, to the developer control planes in use today. We’ll draw on our personal experiences and podcast chats with the larger CNCF community, and discuss real-world examples of developer control planes used at New Relic, Spotify, InVision, and Twitter. We’ll wrap this talk with a walk through of the CNCF ecosystem through the developer control plane lens, and look at what’s next in the future of this important emerging category.

DevXDay KubeCon NA 2021: "From Kubernetes to PaaS to Developer Control Planes"

Daniel Bryant

At a previous JAX event I talked about effective cloud native Java developer workflow. Two years later and many new developer technologies have come and gone, but I still hear daily from cloud developers about the pain and friction associated with building, debugging, and deploying to the cloud. In this talk I’ll share my latest learning on how to bring the fun and productivity back into delivering Kubernetes-based software. Join this talk to: Learn why the core tenets of continuous delivery — speed and safety — must be considered in all parts of the cloud native SDLC Explore how cloud native coding benefits from thinking separately about the inner development loop, continuous integration, continuous deployment, observability, and analysis Understand how cloud native best practices and tooling fit together. Learn about artifact syncing (e.g. Skaffold), dev environment bridging (e.g. Telepresence), GitOps (e.g. Argo), and observability-focused monitoring (e.g. Prometheus, Jaeger) Explore the importance of cultivating an effective cloud platform and associated team of experts Walk away with an overview of tools that can help you develop and debug effectively when using Kubernetes

JAX London 2021: Jumpstart Your Cloud Native Development: An Overview of Prac...

Daniel Bryant

By Daniel Bryant, Ambassador Labs We all need to be able to get user traffic into our applications, and your requirements for services running on Kubernetes are no different. "But", I hear you say, "what about the K8s Ingress spec? And how do I observe what's happening under the hood? And who should be responsible for configuring the gateway: dev or ops?" These are all good questions! Join me for a whistle-stop tour of all things emissary-ingress, where we will explore how this new edition to the family of CNCF incubation projects can make your life easier when it comes to routing, observability, and integration into the bigger (people and technology) picture.

Canadian CNCF: "Emissary-ingress 101: An introduction to the CNCF incubation-...

Daniel Bryant

At GOTO Amsterdam in 2019 I presented how to create an effective cloud native developer workflow. Two years later and many new developer technologies have come and gone, but I still hear daily from cloud developers about the pain and friction associated with building, debugging, and deploying to the cloud. In this talk I'll share my latest learning on how to bring the fun and productivity back into delivering Kubernetes-based software. Join this talk to: Learn why the core tenets of continuous delivery -- speed and safety -- must be considered in all parts of the cloud native SDLC Explore how cloud native coding benefits from thinking separately about the inner development loop, continuous integration, continuous deployment, observability, and analysis Understand how cloud native best practices and tooling fit together. Learn about artifact syncing (e.g. Skaffold), dev environment bridging (e.g. Telepresence), GitOps (e.g. Argo), and observability-focused monitoring (e.g. Prometheus, Jaeger) Explore the importance of cultivating an effective cloud platform and associated team of experts Walk away with an overview of tools that can help you develop and debug effectively when using Kubernetes

GOTOpia 2/2021 "Cloud Native Development Without the Toil: An Overview of Pra...

Daniel Bryant

HashiCorp Consul integrates with Ambassador to securely route Ingress traffic to Consul Service Mesh when using Kubernetes. When onboarding applications onto a service mesh or when integrating with existing applications outside of the Mesh, a north south API gateway is typically required for communications with clients outside of the network. Ambassador is a Kubernetes API Gateway that allows you to route incoming traffic to your Consul Service Mesh proxies while also providing the ability to leverage advanced API Gateway functionalities such as rate limiting and authentication.

HashiCorp Webinar: "Getting started with Ambassador and Consul on Kubernetes ...

Daniel Bryant

Ambassador Fest: "Kubernetes Workflow 101: The Big Picture of Idea to an API ...

Daniel Bryant

An API gateway is at the core of how APIs are managed, secured, and presented within any web-based system. Although the technology has been in use for many years, it has not always kept pace with recent developments within the cloud native space, and many engineers are confused about how a cloud native API gateway relates to Kubernetes Ingress or a Service load balancer. Join this session to learn about: The evolution of API gateways over the past ten years, and how the original problems they were solving have shifted in relation to cloud native technologies and workflow Current challenges of using an API gateway within Kubernetes: scaling the developer workflow; and supporting multiple architecture styles and protocols Strategies for exposing Kubernetes services and APIs at the edge of your system A brief guide to the (potential) future of cloud native API gateways

ADDO 2020: "The past, present, and future of cloud native API gateways"

Daniel Bryant

Many engineers are confused about how a cloud-native API gateway relates to Kubernetes Ingress or a Service load balancer. This talk will unravel this confusion. An API gateway is at the core of how APIs are managed, secured and presented within any web-based system. Although the technology has been in use for many years, it has not always kept pace with recent developments within the cloud-native space. Join the expert to experts Daniel Bryant in uncovering the evolution of API gateways over the past ten years and how the original problems they were solving have shifted in relation to cloud-native technologies and workflow. Current challenges of using an API gateway within Kubernetes: scaling the developer workflow, and supporting multiple architecture styles and protocols In this talk, you'll learn: How the evolution of API gateways looks Strategies for exposing Kubernetes services and APIs at the edge of your system A brief guide to the (potential) future of cloud-native API gateways

GOTOpia 2020: "The Past, Present, and Future of Cloud Native API Gateways"

Daniel Bryant

An API gateway is at the core of how APIs are managed, secured, and presented within any web-based system. Although the technology has been in use for many years, it has not always kept pace with recent developments within the cloud native space, and many engineers are confused about how a cloud native API gateway relates to Kubernetes Ingress or a Service load balancer. Join this session to learn about: – The evolution of API gateways over the past ten years, and how the original problems they were solving have shifted in relation to cloud native technologies and workflow – Current challenges of using an API gateway within Kubernetes: scaling the developer workflow; and supporting multiple architecture styles and protocols – Strategies for exposing Kubernetes services and APIs at the edge of your system – A brief guide to the (potential) future of cloud native API gateways

SoftwareCircus 2020 "The Past, Present, and Future of Cloud Native API Gateways"

Daniel Bryant

An API gateway is at the core of how APIs are managed, secured, and presented within any web-based system. Although the technology has been in use for many years, it has not always kept pace with recent developments within the cloud native space, and many engineers are confused about how a cloud native API gateway relates to Kubernetes Ingress or a Service load balancer. Join this session to learn about: – The evolution of API gateways over the past ten years, and how the original problems they were solving have shifted in relation to cloud native technologies and workflow – Current challenges of using an API gateway within Kubernetes: scaling the developer workflow; and supporting multiple architecture styles and protocols – Strategies for exposing Kubernetes services and APIs at the edge of your system – A brief guide to the (potential) future of cloud native API gateways

DevOpsCon 2020: The Past, Present, and Future of Cloud Native API Gateways

Daniel Bryant

An API gateway is at the core of how APIs are managed, secured, and presented within any web-based system. Although the technology has been in use for many years, it has not always kept pace with recent developments within the cloud native space, and many engineers are confused about how a cloud native API gateway relates to Kubernetes Ingress or a Service load balancer. Join this session to learn about: - The evolution of API gateways over the past ten years, and how the original problems they were solving have shifted in relation to cloud native technologies and workflow - Current challenges of using an API gateway within Kubernetes: scaling the developer workflow; and supporting multiple architecture styles and protocols - Strategies for exposing Kubernetes services and APIs at the edge of your system - A brief guide to the (potential) future of cloud native API gateways Credit to Richard Li's QCon talk, which contains more information on this topic: https://www.infoq.com/presentations/api-gateways-history/

AllTheTalks 2020: "The Past, Present, and Future of Cloud Native API Gateways"

Daniel Bryant

In this webinar, we discussed the two most important challenges with an API gateway when adopting Kubernetes: - How to scale the management of 100s of services and the associated APIs across your teams - How the gateway can support a broad range of microservice architectures, protocols, and configuration that typically spans the entire edge stack Daniel then presented a whistle-stop tour of the three main strategies we see the industry converging on for preparing the edge for Kubernetes: 1. Deploy an additional Kubernetes API gateway 2. Extend an existing API gateway 3. Deploy a comprehensive self-service edge stack

[DW Webinar] Effective Management of APIs and the Edge when Adopting Kubernetes

Daniel Bryant

Modernizing applications by decoupling them from the underlying infrastructure on which they are running can enable portability and innovation (shifting workloads to the cloud), reduce costs, and improve security. Cloud native infrastructure, container technology, and orchestration frameworks like Kubernetes decouple applications from the compute fabric, but in order to fully realize the benefits, they also need to be decoupled at the traffic and networking layer too. An API gateway can decouple applications from external consumers by routing ingress requests from end users and third parties to various internal applications and by providing cross-cutting functionality like authentication, encryption, and rate limiting. A service mesh can decouple applications from internal consumers by dynamically routing inter-data center and service-to-service requests, regardless of where they’re exposed on the network. The core concepts behind an API gateway and service mesh are not new, but the combination of current user requirements and modern cloud native technologies provides new constraints and new opportunities. Daniel Bryant provides an overview of these technologies, how they impact application architecture, and what implementation options are currently available. Daniel has worked within these technologies for over five years, both as an architect and end user, and also as an engineer within a cloud infrastructure-focused tooling organization.

SACON EU 2019 "API Gateways and Service Meshes: Opening the Door to Applicati...

Daniel Bryant

The way in which communication is handled within a cloud native application has changed over the past few years. Kubernetes has become the de facto platform infrastructure, and inter-service communication is now handled via a service mesh. This session will explore how to integrate the open source Ambassador Kubernetes API gateway and the Consul Connect service mesh into your Java apps. Learn about Kubernetes ingress and inter-service communication Understand the tradeoffs of using different technologies to implement cloud native communication Explore how these technologies integrate well – or not – with new and existing Java applications Hear about lessons learned in production, at 3 a.m., with lots of coffee

JAX London 2019 "Cloud Native Communication: Using an API Gateway and Service...

Daniel Bryant

Dividing a system into a series of services that communicate over an unreliable network naturally creates challenging conditions for testing inter-service interactions. Each service has its own functional requirements, and performance and fault-tolerance characteristics that need to be validated during development, the QA process, and continually in production. Join Daniel Bryant to learn about the theory, techniques, and practices that can help to overcome these challenges. Overview and learning Outcomes: • Introduction to the challenges of testing distributed microservice systems • Learn tactics for isolating tests within a complex microservice ecosystem • Join a whistle-stop tour of consumer-driven contract testing and API simulation • Understand where to implement fault-injection within doubles in order to validate nonfunctional requirements in development and QA • Understand the benefits of continually validating microservice systems running in production

[SC London] "Testing Microservices: from Development to Production

Daniel Bryant

More from Daniel Bryant (20)