Telepresence - Fast Development Workflows for Kubernetes

•

3 likes•1,439 views

Telepresence allows developers to test Kubernetes applications locally on their laptop for a fast development workflow. It works by replacing deployments with a proxy that redirects traffic to the local machine, providing access to cluster resources and unlimited compute. This avoids the slow process of building containers and deploying to the cluster for each change. The developer's laptop joins the cluster network namespace, allowing local tools to integrate seamlessly. Telepresence is an open source CNCF project that is actively developed to support additional features like multi-user development and persistent proxy deployments.

1
TELEPRESENCE
FastDevelopmentWorkflowsfor
Kubernetes

2
https://mitchdenny.com/the-inner-loop/

3
The Kubernetes inner & outer loop is usually the same.
Write code
Build container
Push to registry
Deploy to cluster
Test
And can be …. SLOW.

5
But you want a really fast inner loop (no docker build/push) …

7
Let’s do everything locally, so it’s really fast and I can use
my tools!

8
My laptop only
has 16GB RAM and
you’re asking it to
run Kubernetes
and a JVM and a
database???

11
WhatisTelepresence?
“Fancy Kubernetes VPN for development”
“kubectl port-forward on steroids”
A network bridge between your laptop and the Kubernetes cluster

12
Howitworks
A B
C
A’
The “A” deployment is
replaced by a proxy. Requests
to the proxy are sent to the
laptop.
Telepresence:
1. Intercepts DNS
2. Environment variables &
secrets
3. Volumes
4. TCP

13
Benefits
Use any tool that runs on your laptop: IDE, profiler, debugger, …
Unlimited compute resources
Same network namespace (e.g., nslookup works)
Very fast inner loop!
Requirements
• Network connection
• kubectl access to cluster
• Mac or Linux

14
TelepresenceisaCNCFproject,withawide
varietyofusers.

15
• Capturing DNS and routing
only part of it to the cluster is
tricky
• No two laptops are alike
• Swapping out your (real)
deployment for a (proxy)
deployment is tricky

18
Our problem: Transfer data from monoliths to microservices
Following challenges
• Too many legacy services for Docker Compose (7+)
• Too many protocols to mock (LDAP, MSSQL, HTTP API, …)
• Too many cloud services to emulate (Cloud Pub/Sub, Consul, …)
TheProblem

19
One cluster with multiple namespaces for all single-source-of-truth
microservices
Developers check out one of the microservices
Developers use Bazel + Telepresence + IDE
Telepresence is used in container mode with Bazel images
Once code is done, Jenkins is used to run tests, build, and deploy
Ourworkflow

21
Telepresencecomponents
Proxy Server
Client
Capture DNS requests for Kubernetes
resources
DNS resolution for Kubernetes resources
Proxy TCP connections to cluster
Proxy TCP connections to laptop
Canonical DNS for Kubernetes resources

22
TelepresenceClient
Use kubectl port-forward to bootstrap sshuttle (ssh-based VPN)
sshuttle has a lot of functionality that is not used by Telepresence (it’s a VPN, after
all)
Replace sshuttle with Teleproxy — designed for Kubernetes
• Capture DNS locally
• Do DNS resolution intelligently
• Redirect TCP connections to the right destination
Already in progress, will replace VPN-TCP method
Also support multiple simultaneous swaps

23
TelepresenceProxyServer
Currently deployed every time you do a swap-deployment (and then deleted)
Switch mode to be persistent (this is what Kubernetes is good for)
• Speeds up startup
• Support reconnect

24
Multi-userdevelopment
Swap deployment doesn’t work well for multi-user development
Solution today is to use namespaces and/or individual clusters
• Expensive (more hardware & setup)
• Delays integration testing until after commit

25
Intercept(Commercial)
Ambassador sends adds a
user identity token to the
HTTP header.
The intercept sidecar will
route to B or B’ depending
on the HTTP header.

27
ContributingtoTelepresence
Documentation and workflows — how you integrate Telepresence into your
development workflow
Let us know if you’re a user!
Triage — lots of folks use GitHub for support; doesn’t scale well
Join Slack to help other users https://d6e.co/slack #telepresence

28
Thankyou!Questions?
richard@datawire.io / @rdli
www.telepresence.io
https://github.com/telepresenceio
If you missed Christian Roggia’s talk on Telepresence, check
out the video!
Visit us at Booth SE19

One of the challenges facing Telepresence is growing the contributor community. It’s a complex application that requires a good understanding of OS networking, VPNs, Kubernetes, and everything in between. We’ll kick off this meeting with a general architectural overview of Telepresence. We’ll talk about how we’ve managed the project to date, and our investments to make it easier. We want to then turn it over for an interactive discussion with participants to see what we can do to make it easier to contribute and grow the Telepresence community.

[KubeCon NA 2018] Effective Kubernetes Develop: Turbocharge Your Dev Loop - P...

Ambassador Labs

Every software development cycle is rife with inefficiency. Seasoned devs know the pain of getting access to essential remote systems, waiting for tests to run (and then fail), or debugging with only log files. This talk teaches you how to best leverage Kubernetes, remote infrastructure and related tooling to create a dev cycle that maximizes velocity and minimizes developer friction and frustration. Using tools such as Kubernetes, Docker and Telepresence, I will walk attendees through several advanced techniques that can be used to produce an effective developer experience and optimized dev loop. The goal of this is to eliminate many sources of frustrating inefficiency and reduce cycle time between releases. I will demonstrate how to incrementally adopt some of these techniques and how to approach introducing new and unfamiliar technology and techniques to skeptical dev teams.

Ambassador: Building a Control Plane for Envoy

Ambassador Labs

Managing Docker Containers In A Cluster - Introducing Kubernetes

Marc Sluiter

Containerising your applications with Docker gets more and more attraction. While managing your Docker containers on your developer machine or on a single server is not a big hassle, it can get uncomfortable very quickly when you want to deploy your containers in a cluster, no matter if in the cloud or on premises. How do you provide high availability, scaling and monitoring? Fortunately there is a rapidly growing ecosystem around docker, and there are tools available which support you with this. In this session I want to introduce you to Kubernetes, the Docker orchestration tool started and open sourced by Google. Based on the experience with their data centers, Google uses some interesting declarative concepts like pods, replication controllers and services in Kubernetes, which I will explain to you. While Kubernetes still is a quite young project, it reached its first stable version this summer, thanks to many contributions by Red Hat, Microsoft, IBM and many more.

Devoxx 2015 - Web Application Development using Grails and Docker

Ted Vinke

Troubleshooting tips from docker support engineers

Docker, Inc.

Docker makes everything easier. But even with the easiest platforms, sometimes you run into problems. In this session, you'll learn first-hand from someone whose job is helping customers fix these problems. In this session, you'll learn how to: Ask better questions & identify the real problems you want to solve Use command line tools to inspect internal Swarm and Kubernetes components Debug and troubleshoot interactions between Enterprise Edition components Troubleshoot Docker Enterprise Edition Windows nodes Apply these skills to troubleshooting Docker Enterprise Edition

DockerCon SF 2015: Enabling Microservices @Orbitz

Docker, Inc.

The slides from Steve Hoffman and Rick Fast's presentation at DockerCon SF 2015 - Talk Description: In this talk we will discuss how we enabled decomposition of one of our 250+ system components into a continously deployed microservice cluster. This includes building a standardized Docker server composed of various local companion services along side the Docker daemon including: dynamic service discovery via Consul, a log relay to a centralized Elasticsearch cluster, and forwarding/batching of Dropwizard metrics to Graphite. Building on this we'll cover our Jenkins driven automated pipeline for building Docker images and rolling deployments via Ansible using static placement on existing infrastructure while prototyping dynamic placement using Docker + Apache Mesos.

Building your production tech stack for docker container platform

Docker, Inc.

This session will focus on the practicals of building a fully-functional stack of container cluster tools, with different options for stacking those tools from the OS-up. We’ve all seen examples of common technologies stacks, like the good ol’ LAMP and MEAN stacks for apps, but what about lower-level infrastructure? And can we get it without cloud vendor lock in please? Oh and pure containers and infrastructure-as-code too? With Docker, sure thing! This session will cover: Which OS/Distro and Kernel to use VM’s or Bare Metal Recommended Swarm architectures Tool stacks for “pure open source”, “cloud-service based”, and “Docker EE” scenarios Demos of these tools working together including InfraKit, Docker, Swarm, Flow-Proxy, ELK, Prometheus, REX-Ray, and more.

Presentation by Sandeep Parikh In this talk, we will cover the basics of Kubernetes and show how to set up continuous delivery pipelines using Jenkins and Jenkins Workflow to go from code to deployment, without developers having to interact with the production deployment infrastructure. The goal is an end-to-end set of steps to automate deployment and delivery of an application composed of several microservices.

Kubernetes and CoreOS @ Athens Docker meetup

Mist.io

KubeCon NA 2017: Ambassador and Envoy (Envoy Salon)

Ambassador Labs

DockerCon SF 2015: Docker in the New York Times Newsroom

Docker, Inc.

Eric Buth's Presentation at DockerCon SF 2015: Talk Description: In the New York Times newsroom you’ll find a deeply heterogeneous technology environment that exists – by necessity – outside of the larger, more well-defined development pipelines of the rest of the organization. On the Interactive News team, part of our mission is providing a reliable path to production for designers/developers/reporters who need to be able to make their own technology choices on what can be extremely tight deadlines. Containerization is becoming increasingly important to these efforts, and we’re ready to share our experience working with Docker and crafting complementary orchestration, communication, and organization solutions.

Craig Box (Google) - The road to Kubernetes 1.0

Outlyer

It takes a Village to do the Impossible - Jeff Lindsay

Docker, Inc.

Kubernetes 101 Workshop

Bret McGowen - NYC Google Developer Advocate

Google has been running everything in containers for the past 15 years, but how do we orchestrate and manage all those containers? We've built and released the open source Kubernetes (http://kubernetes.io), which is based on years of running containers internally at Google. Join us for an introduction to containers and Kubernetes, followed by a hands-on workshop building and deploying your own Kubernetes cluster with multiple front end, database and caching instances. Docker containers help solve the issue of process-level reproducibility by packaging up your apps and execution environments into a number of containers. But once you have a lot of containers running, you'll need to coordinate them across a cluster of machines while keeping them healthy and making sure they can find each other. This can quickly turn into an unmanageable mess! Wouldn't it be helpful if you could declare what wanted, and then have the cluster assign the resources to get it done and to recover from failures and scale on demand? Kubernetes is here to help! Key takeaways - Gentle introduction into containers: why and how - Learn how Google manages applications using containers - Intro to Kubernetes: managing applications and services - Build and deploy your own multi-tier application using Kubernetes

Jenkins & IaC

HungWei Chiu

Getting Started Contributing to Docker

Docker, Inc.

Docker Platform Internals: Taking runtimes and image creation to the next lev...

Docker, Inc.

In this session, we'll go into details about the latest developments around some of the components behind the core features of the Docker Platform. We'll cover the containerd runtime that was built to serve as an underlying daemon for Docker and Kubernetes, and BuildKit, a toolkit that builds on containerd to provide next-generation capabilities for building software with the help of containers. You will learn about the architecture and design choices of these projects, for example, the power of containerd's rich client library and BuildKit's frontend model that allows introducing new build languages or Dockerfile features. You can discover how you can use these projects directly and how they are being integrated into the Docker Platform.

In-Cluster Continuous Testing Framework for Docker Containers

Neil Gehani

Just like a tugboat brings containers safely to port, “Tugbot” will do the same for running quality Docker containers in production . Tugbot makes Continuous Testing REAL. Any kind of test (including performance, chaos, and security) can be run with 5 lines in a “Test Container” Dockerfile. Leveraging the Docker LABEL and Docker Remote API, we will show how this simplifies testing for services running in docker containers while standardizing results collected for analytics to continuously improve the quality of software. We believe that this will be the first step in “social testing” for containers like github has done for social coding.  

GlueCon kubernetes & container engine

brendandburns

K8scale update-kubecon2015

Bob Wise

Configuration Management and Transforming Legacy Applications in the Enterpri...

Docker, Inc.

Share the continuity of Société Générale's journey with Docker Enterprise from different points of view, from executives to devops, with CD platform as an enabler. Creating a Dockerfile that runs a container on a developer's laptop is pretty straightforward. But extending that to stacks of containers running on a dozen environments (development, integration, testing, staging, production, etc.) with different configuration and topologies can be a challenge. This talk will cover aspects of our journey to Docker Enterprise: What configuration should go in an image? Where to put different types of configuration? Images, environment variables, entrypoint, ...? How to store assets for building images and configuration for deployment in version control. We will discuss how Société Générale has implemented these, and what we plan next for Docker Enterprise deployment.

Building a smarter application Stack by Tomas Doran from Yelp

dotCloud

Continuous Delivery with Jenkins & Kubernetes @ Sky

Adriana Vasiu

OpenStack Preso: DevOps on Hybrid Infrastructure

rhirschfeld

DockerCon EU 2015: Trading Bitcoin with Docker

Docker, Inc.

Presented by Sebastien Goasguen, VP, Apache CloudStack and Mathieu Buffenoir, co-founder, SBEX Bity is an internet money gateway built by Swiss Bitcoin Exchange ( SBEX ). To trade bitcoin the entire infrastructure of Bity is running in Docker containers. All the components of the infrastructure are using Docker, from the frontend applications and load balancer, the Django based backend, replicated Postgres database, Bitcoin daemon and remittance engine. All software goes through a CI pipeline that starts with Docker images being built on private repositories in Docker hub. Developers take also advantage of a docker-compose definition that allows them to run the entire infrastructure on a single laptop. Finally the production deployments happen thanks to the Ansible Docker module on a CloudStack based public cloud. Everything has been automated to ease re-deployment and operations. This presentation will go through every component and how Docker has enabled us to go production in 4 months.

Docker for Devs - John Zaccone, IBM

Docker, Inc.

In this talk John Zaccone will present tips and best practices for developing dockerized applications. We will start with the simple question: "Why Docker?", then dive into practical knowledge for developers to apply on their own. John will cover best practices concerning Dockerfiles and the best tools to use for developing. We will also talk about the "hand-off" between developer and operations and how the two roles can work together to address broad issues such as CI/CD and security. After John's talk, stay tuned for Scott Coulton's talk that will dive deeper into Docker for Ops.

DevOps Days Boston 2017: Real-world Kubernetes for DevOps

Ambassador Labs

DevOps Days Boston 2017 Microservices is an increasingly popular approach to building cloud-native applications. Dozens of new technologies that streamline adopting microservices development such as Docker, Kubernetes, and Envoy have been released over the past few years. But how do you actually use these technologies together to develop, deploy, and run microservices? In this presentation, we’ll cover the nuances of deploying containerized applications on Kubernetes, including creating a Kubernetes manifest, debugging and logging, and how to build an automated continuous deployment pipeline. Then, we’ll do a brief tour of some of the advanced concepts related to microservices, including service mesh, canary deployments, resilience, and security.

KubeCon NA 2019 "Introduction to Telepresence: Fast Development (and Debuggin...

Daniel Bryant

This session will provide an intro to Telepresence, a CNCF Sandbox tool. We’ll talk about development workflows for Kubernetes. We’ll discuss the differences between traditional development, and different approaches people take to building Kubernetes services. We’ll then introduce Telepresence and discuss how it integrates with different organizational development workflows. Finally, we’ll talk about the evolution of Telepresence and how we are actively moving Telepresence forward from its heritage as a VPN-type approach into a more sophisticated L7 routing layer for developers.

Containerize! Between Docker and Jube.

Henryk Konsek

What's hot

2016 - Continuously Delivering Microservices in Kubernetes using Jenkins

devopsdaysaustin

Kubernetes and CoreOS @ Athens Docker meetup

Mist.io

KubeCon NA 2017: Ambassador and Envoy (Envoy Salon)

Ambassador Labs

DockerCon SF 2015: Docker in the New York Times Newsroom

Docker, Inc.

Craig Box (Google) - The road to Kubernetes 1.0

Outlyer

It takes a Village to do the Impossible - Jeff Lindsay

Docker, Inc.

Kubernetes 101 Workshop

Bret McGowen - NYC Google Developer Advocate

Jenkins & IaC

HungWei Chiu

Getting Started Contributing to Docker

Docker, Inc.

Docker Platform Internals: Taking runtimes and image creation to the next lev...

Docker, Inc.

In-Cluster Continuous Testing Framework for Docker Containers

Neil Gehani

GlueCon kubernetes & container engine

brendandburns

K8scale update-kubecon2015

Bob Wise

Configuration Management and Transforming Legacy Applications in the Enterpri...

Docker, Inc.

Building a smarter application Stack by Tomas Doran from Yelp

dotCloud

Continuous Delivery with Jenkins & Kubernetes @ Sky

Adriana Vasiu

OpenStack Preso: DevOps on Hybrid Infrastructure

rhirschfeld

DockerCon EU 2015: Trading Bitcoin with Docker

Docker, Inc.

Docker for Devs - John Zaccone, IBM

Docker, Inc.

DevOps Days Boston 2017: Real-world Kubernetes for DevOps

Ambassador Labs

What's hot (20)

2016 - Continuously Delivering Microservices in Kubernetes using Jenkins

Kubernetes and CoreOS @ Athens Docker meetup

KubeCon NA 2017: Ambassador and Envoy (Envoy Salon)

DockerCon SF 2015: Docker in the New York Times Newsroom

Craig Box (Google) - The road to Kubernetes 1.0

It takes a Village to do the Impossible - Jeff Lindsay

Kubernetes 101 Workshop

Jenkins & IaC

Getting Started Contributing to Docker

Docker Platform Internals: Taking runtimes and image creation to the next lev...

In-Cluster Continuous Testing Framework for Docker Containers

GlueCon kubernetes & container engine

K8scale update-kubecon2015

Configuration Management and Transforming Legacy Applications in the Enterpri...

Building a smarter application Stack by Tomas Doran from Yelp

Continuous Delivery with Jenkins & Kubernetes @ Sky

OpenStack Preso: DevOps on Hybrid Infrastructure

DockerCon EU 2015: Trading Bitcoin with Docker

Docker for Devs - John Zaccone, IBM

DevOps Days Boston 2017: Real-world Kubernetes for DevOps

Similar to Telepresence - Fast Development Workflows for Kubernetes

KubeCon NA 2019 "Introduction to Telepresence: Fast Development (and Debuggin...

Daniel Bryant

Containerize! Between Docker and Jube.

Henryk Konsek

Secure Your Containers: What Network Admins Should Know When Moving Into Prod...

Cynthia Thomas

Kubernetes

Lhouceine OUHAMZA

K8s debugging talk

ConSol Consulting & Solutions Software GmbH

Container Days: Easy Debugging of Microservices Running on Kubernetes with Te...

Daniel Bryant

Many organizations adopt cloud native development practices with the goal of shipping features faster. The technologies and architectures may change when we move to the cloud, but the fact remains that we all still add the occasional bug to our code. The challenge here is that many of your existing local debugging tools and practices can't be used when everything is running in a container or deployed onto Kubernetes running in the cloud. This is where the open source Telepresence tool can help. Join me to learn about: - The challenges with scaling Kubernetes-based Java development i.e. you can only run so many microservices locally before minikube melts your laptop - An exploration of how Telepresence can "intercept" or reroute traffic from a specified service in a remote K8s cluster to your local dev machine - The benefits of getting a "hot reload" fast feedback loop between applications being developed locally and apps running in the remote environment - A tour of Telepresence, from the sidecar proxy deployed into the remote K8s cluster to the CLI - An overview of using "preview URLs" and header-based routing for the sharing, collaboration, and isolation of changes you are making on your local copy of an intercepted service

Kubernetes

Anastasios Gogos

Remote debugging of Application in Kubernetes

ConSol Consulting & Solutions Software GmbH

Docker, Atomic Host and Kubernetes.

Jooho Lee

To Build My Own Cloud with Blackjack…

Sergey Dzyuban

Cloud providers like Amazon or Goggle have great user experience to create and manage PaaS and IaaS services. But is it possible to reproduce same experience and flexibility locally, in on premise datacenter? This talk describes success story of creation private cloud based on DC/OS cluster. It is used to host and share different services like hadoop or kafka for development teams, dynamically manage services and resource pools with GKE integration.

DevJam 2019 - Introduction to Kubernetes

Ronny Trommer

Cloud technology with practical knowledge

AnshikaNigam8

Kubernetes overview and Exploitation

OWASPSeasides

Apache Cassandra Lunch #41: Cassandra on Kubernetes - Docker/Kubernetes/Helm ...

Anant Corporation

In Apache Cassandra Lunch #41: Apache Cassandra Lunch #41: Cassandra on Kubernetes - Docker/Kubernetes/Helm Part 1, we discuss Cassandra on Kubernetes and give an introduction to Docker, Kubernetes, and Helm. Accompanying Blog: https://blog.anant.us/apache-cassandra-lunch-41-cassandra-on-kubernetes-docker-kubernetes-helm-part-1/ Accompanying YouTube: https://youtu.be/-I8cKQO_Qr0 Sign Up For Our Newsletter: http://eepurl.com/grdMkn Join Cassandra Lunch Weekly at 12 PM EST Every Wednesday: https://www.meetup.com/Cassandra-DataStax-DC/events/ Cassandra.Link: https://cassandra.link/ Follow Us and Reach Us At: Anant: https://www.anant.us/ Awesome Cassandra: https://github.com/Anant/awesome-cassandra Cassandra.Lunch: https://github.com/Anant/Cassandra.Lunch Email: solutions@anant.us LinkedIn: https://www.linkedin.com/company/anant/ Twitter: https://twitter.com/anantcorp Eventbrite: https://www.eventbrite.com/o/anant-1072927283 Facebook: https://www.facebook.com/AnantCorp/

Getting started with google kubernetes engine

Shreya Pohekar

Distributed Tensorflow with Kubernetes - data2day - Jakob Karalus

Jakob Karalus

[Draft] Fast Prototyping with DPDK and eBPF in Containernet

Andrew Wang

Kubernetes Immersion

Juan Larriba

Kubernetes seems to be the biggest buzz word currently in the DevOps world. The Google designed container orchestrator based in their 10+ years of experience running production applications using containers seems to have positioned as the market leader. Open source, available in both Google Cloud and Azure container platforms or as a custom installation, it is ready to receive production loads. During this talk we will discover how does Kubernetes works, its architecture, what components compose a Kubernetes cluster. We will also learn what objects can a developer use to deploy its applications on a Kubernetes cluster. We will see a live demo where we will deploy an application and then introduce changes to it without any downtime.

Marc Sluiter - 15 Kubernetes Features in 15 Minutes

Marc Sluiter

DevOps Fest 2019. Stanislav Kolenkin. Сonnecting pool Kubernetes clusters: Fe...

DevOps_Fest

On this IT sense, we will talk about the Federation. The Federation is a very flexible tool for connecting several clusters and gives us a lot possibilities in K8s control. With the help of the Federation, we can easily: - sync resources across clusters - cross cluster discovery We will also discuss how to connect several Kubernetes clusters into one network, how to reach services in each Kubernetes cluster...

Similar to Telepresence - Fast Development Workflows for Kubernetes (20)

KubeCon NA 2019 "Introduction to Telepresence: Fast Development (and Debuggin...

Containerize! Between Docker and Jube.

Secure Your Containers: What Network Admins Should Know When Moving Into Prod...

Kubernetes

K8s debugging talk

Container Days: Easy Debugging of Microservices Running on Kubernetes with Te...

Kubernetes

Remote debugging of Application in Kubernetes

Docker, Atomic Host and Kubernetes.

To Build My Own Cloud with Blackjack…

DevJam 2019 - Introduction to Kubernetes

Cloud technology with practical knowledge

Kubernetes overview and Exploitation

Apache Cassandra Lunch #41: Cassandra on Kubernetes - Docker/Kubernetes/Helm ...

Getting started with google kubernetes engine

Distributed Tensorflow with Kubernetes - data2day - Jakob Karalus

[Draft] Fast Prototyping with DPDK and eBPF in Containernet

Kubernetes Immersion

Marc Sluiter - 15 Kubernetes Features in 15 Minutes

DevOps Fest 2019. Stanislav Kolenkin. Сonnecting pool Kubernetes clusters: Fe...

More from Ambassador Labs

Building Microservice Systems Without Cooking Your Laptop: Going “Remocal” wi...

Ambassador Labs

When you adopt microservices, containers, and cloud native development, the technologies and architectures may change, but the need for fast feedback doesn’t. Kubernetes enables us to deploy and run applications at scale, but whether you’re coding or testing applications, you want to be able to get work done quickly without spinning up all of your microservices locally and driving your laptop fans into high speed! Join me for a tour of coding, testing, and shipping microservices using remote-to-local “remocal” tools and techniques. You will: Understand the challenges with scaling container-based application development – i.e. you can only run so many microservices locally before minikube melts your laptop. Learn when to use various types of development practices and tooling based on your use case and requirements for production realism, speed, and practicality. Explore how to utilize containerized dependencies and Docker for testing, including for both apps and services you own and those you don’t. Learn how Telepresence can enable “remocal” development, expanding your local machine and Docker Desktop out into a remote Kubernetes cluster.

Ambassador Developer Office Hours: Summer of Kubernetes Ship Week 1: Intro to...

Ambassador Labs

Ship Week 1: Intro to Continuous Delivery and GitOps When building cloud native applications, software developers are no longer just responsible for coding new features. In the next module of Summer of Kubernetes, our expert guides (with the help of some special guests) will cover how to safely and effectively ship software without disrupting end users. To do this you will: ✅ Understand the basics of continuous delivery and GitOps ✅ Learn about how K8s enables declarative CD (via the use of reconciliation loops)

Cloud native development without the toil

Ambassador Labs

At GOTO Amsterdam in 2019 I presented how to create an effective cloud native developer workflow. Two years later and many new developer technologies have come and gone, but I still hear daily from cloud developers about the pain and friction associated with building, debugging, and deploying to the cloud. In this talk I'll share my latest learning on how to bring the fun and productivity back into delivering Kubernetes-based software. In this talk, you will: - Learn why the core tenets of continuous delivery -- speed and safety -- must be considered in all parts of the cloud native SDLC - Explore how cloud native coding benefits from thinking separately about the inner development loop, continuous integration, continuous deployment, observability, and analysis - Understand how cloud native best practices and tooling fit together. Learn about artifact syncing (e.g. Skaffold), dev environment bridging (e.g. Telepresence), GitOps (e.g. Argo), and observability-focused monitoring (e.g. Prometheus, Jaeger) - Explore the importance of cultivating an effective cloud platform and associated team of experts - Walk away with an overview of tools that can help you develop and debug effectively when using Kubernetes

Webinar: Accelerate Your Inner Dev Loop for Kubernetes Services

Ambassador Labs

Many turn to static duplicate dev environments to shorten the dev loop and isolate code tests, but those bring about additional issues. The idea of safely sharing a dev environment and seeing your code changes in action immediately before sharing them probably seems impossible. Service Preview, powered by Telepresence and the Ambassador Edge Stack, is here to help! This capability enables you to preview changes immediately and test locally with your tool of choice, while sharing a development cluster. In this 45-minute webinar, Abhay Saxena will demonstrate using Service Preview to have a fast inner development loop while fixing a bug in a microservice, including stepping through the code in a debugger while other developers continue working unaffected.

[Confoo Montreal 2020] From Grief to Growth: The 7 Stages of Observability - ...

Ambassador Labs

In this case-study talk, we will share Brent’s journey through the adoption of modern observability practices as he operated an architecture of distributed services. Facing difficulties using application logs as the primary tool to debug performance and reliability issues? Learn how to improve your company toolkit and engineering habits using existing monitoring tools with the addition of distributed tracing. https://confoo.ca/en/yul2020/session/from-grief-to-growth-the-7-stages-of-observability

[Confoo Montreal 2020] Build Your Own Serverless with Knative - Alex Gervais

Ambassador Labs

Google Cloud Run’s use of Knative introduced a portable Serverless solution built on top of Kubernetes. In this talk, we’ll recap the basic guidelines, use cases, and benefits of a Serverless architecture. Getting up and started, you will learn to take advantage of containers and the Ambassador API Gateway to serve event-driven application workloads and save costs using your existing Kubernetes resources. https://confoo.ca/en/yul2020/session/build-your-own-serverless-with-knative

[QCon London 2020] The Future of Cloud Native API Gateways - Richard Li

Ambassador Labs

The introduction of microservices, Kubernetes, and cloud technology has provided many benefits for developers. However, the age-old problem of getting user traffic routed correctly to the API of your backend applications can still be an issue, and may be complicated with the adoption of cloud native approaches: applications are now composed of multiple (micro)services that are built and released by independent teams; the underlying infrastructure is dynamically changing; services support multiple protocols, from HTTP/JSON to WebSockets and gRPC, and more; and many API endpoints require custom configuration of cross-cutting concerns, such as authn/z, rate limiting, and retry policies. A cloud native API gateway is on the critical path of all requests, and also on the critical path for the workflow of any developer that is releasing functionality. Join this session to learn about the underlying technology and the required changes in engineering workflows. Key takeaways will include: A brief overview of the evolution of API gateways over the past ten years, and how the original problems being solved have shifted in relation to cloud native technologies and workflow Two important challenges when using an API gateway within Kubernetes: scaling the developer workflow; and supporting multiple architecture styles and protocols Strategies for exposing Kubernetes services and APIs at the edge of your system Insight into the (potential) future of cloud native API gateways https://qconlondon.com/london2020/presentation/future-cloud-native-api-gateways

What's New in the Ambassador Edge Stack 1.0?

Ambassador Labs

Before Kubernetes, the boundary between your users and your monolithic application was simple to manage. Now with Kubernetes, managing the edge has become dynamic and complex. More developers are involved, there are exponentially more edge operations, and each microservice has diverse requirements. To fully capitalize on the benefits of Kubernetes, you need to provide a solution that supports the autonomy of application developers, the various requirements of your microservices, and your ability to scale. You no longer need an API Gateway - you need a self-service, comprehensive edge stack. In this 40 minute webinar on January 30th, we will discuss and demo the new functionality available with the Ambassador Edge Stack. Edge Policy Console- graphical UI to visualize and manage all of your edge policies Security Features- automatic TLS setup via ACME integration, OAuth/OpenID Connect integration, rate limiting, and fine-grained access control Developer Onboarding- API catalog, Swagger/OpenAPI documentation support, and a fully customizable developer portal

Webinar: Effective Management of APIs and the Edge when Adopting Kubernetes

Ambassador Labs

The rise of Layer 7, microservices, and the proxy war with Envoy, NGINX, and ...

Ambassador Labs

Modern cloud applications today are built as distributed microservices. These microservices talk to each other over L7 protocols: HTTP, gRPC, Redis, Kafka, and more. In this world, L7 proxies have assumed a crucial role in managing and observing L7 protocols. In this talk, I’ll discuss the evolution of service architectures, the role L7 proxies play in this world, and how there is now a battle raging between Envoy Proxy, HAProxy, and NGINX. I’ll wrap by talking about why we chose Envoy Proxy as the anchor of our Ambassador API Gateway and show how that has enabled a number of new capabilities.

The Simply Complex Task of Implementing Kubernetes Ingress - Velocity NYC

Ambassador Labs

Getting traffic into a Kubernetes cluster should be simple, but it’s not. Richard Li explains how software architectures have evolved to take advantage of Kubernetes and discusses the implications that these changes have on ingress. Richard then covers some of the nuances of modern ingress, including authentication, resilience, and observability at the edge, explores how Kubernetes handles ingress today, with NodePorts, LoadBalancers, and ingress controllers, and shares his experience and lessons learned from using several real-world implementations of ingress on Kubernetes.

Ambassador Kubernetes-Native API Gateway

Ambassador Labs

Micro xchg 2018 - What is a Service Mesh?

Ambassador Labs

Webinar: Code Faster on Kubernetes

Ambassador Labs

QCon SF 2017 - Microservices: Service-Oriented Development

Ambassador Labs

Conventional wisdom is that microservices is an architecture that is the spiritual successor to service-oriented architecture. While true, this myopic view of microservices ignores some of the profound workflow shifts in today’s microservices organizations. The reality is that microservices is an architecture _and_ workflow. In this talk, we’ll introduce the workflow of service-oriented development. Rafael will talk about how the real goal of microservices is to break up a monolithic development workflow. We’ll show you how, by breaking up your workflow, you can build software that lets you move fast and make things.

Montreal Kubernetes Meetup: Developer-first workflows (for microservices) on ...

Ambassador Labs

O'Reilly Software Architecture Conference London 2017: Building Resilient Mic...

Ambassador Labs

Velocity NYC 2017: Building Resilient Microservices with Kubernetes, Docker, ...

Ambassador Labs

DevOps Days Boston 2017: Developer first workflows for Kubernetes

Ambassador Labs

Kubernetes is a powerful, operational platform for containerized applications. However, the developer workflow on Kubernetes – how you code, deploy, update, and monitor your services – is much less mature. How should you lay out your Git repo? How do you create loosely coupled services? How do you support deploying your service at any time? In this talk, we’ll talk about these questions and more. We’ll discuss the journey towards a rapid development workflow, discuss best practices, and, talk about the process we followed to get to a rapid development workflow. DevOps Days Boston 2017

MA Microservices Meetup: Move fast and make things

Ambassador Labs

More from Ambassador Labs (20)

Building Microservice Systems Without Cooking Your Laptop: Going “Remocal” wi...

Ambassador Developer Office Hours: Summer of Kubernetes Ship Week 1: Intro to...

Cloud native development without the toil

Webinar: Accelerate Your Inner Dev Loop for Kubernetes Services

[Confoo Montreal 2020] From Grief to Growth: The 7 Stages of Observability - ...

[Confoo Montreal 2020] Build Your Own Serverless with Knative - Alex Gervais

[QCon London 2020] The Future of Cloud Native API Gateways - Richard Li

What's New in the Ambassador Edge Stack 1.0?

Webinar: Effective Management of APIs and the Edge when Adopting Kubernetes

The rise of Layer 7, microservices, and the proxy war with Envoy, NGINX, and ...

The Simply Complex Task of Implementing Kubernetes Ingress - Velocity NYC

Ambassador Kubernetes-Native API Gateway

Micro xchg 2018 - What is a Service Mesh?

Webinar: Code Faster on Kubernetes

QCon SF 2017 - Microservices: Service-Oriented Development

Montreal Kubernetes Meetup: Developer-first workflows (for microservices) on ...

O'Reilly Software Architecture Conference London 2017: Building Resilient Mic...

Velocity NYC 2017: Building Resilient Microservices with Kubernetes, Docker, ...

DevOps Days Boston 2017: Developer first workflows for Kubernetes

MA Microservices Meetup: Move fast and make things

Recently uploaded

Enterprise Resource Planning System in Telangana

NYGGS Automation Suite

Enterprise Resource Planning System includes various modules that reduce any business's workload. Additionally, it organizes the workflows, which drives towards enhancing productivity. Here are a detailed explanation of the ERP modules. Going through the points will help you understand how the software is changing the work dynamics. To know more details here: https://blogs.nyggs.com/nyggs/enterprise-resource-planning-erp-system-modules/

Understanding Globus Data Transfers with NetSage

Globus

NetSage is an open privacy-aware network measurement, analysis, and visualization service designed to help end-users visualize and reason about large data transfers. NetSage traditionally has used a combination of passive measurements, including SNMP and flow data, as well as active measurements, mainly perfSONAR, to provide longitudinal network performance data visualization. It has been deployed by dozens of networks world wide, and is supported domestically by the Engagement and Performance Operations Center (EPOC), NSF #2328479. We have recently expanded the NetSage data sources to include logs for Globus data transfers, following the same privacy-preserving approach as for Flow data. Using the logs for the Texas Advanced Computing Center (TACC) as an example, this talk will walk through several different example use cases that NetSage can answer, including: Who is using Globus to share data with my institution, and what kind of performance are they able to achieve? How many transfers has Globus supported for us? Which sites are we sharing the most data with, and how is that changing over time? How is my site using Globus to move data internally, and what kind of performance do we see for those transfers? What percentage of data transfers at my institution used Globus, and how did the overall data transfer performance compare to the Globus users?

Globus Compute Introduction - GlobusWorld 2024

Globus

Lecture 1 Introduction to games development

abdulrafaychaudhry

Quarkus Hidden and Forbidden Extensions

Max Andersen

In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...

Juraj Vysvader

GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)

Alina Yurenko

Text-Summarization-of-Breaking-News-Using-Fine-tuning-BART-Model.pptx

ShamsuddeenMuhammadA

Introducing Crescat - Event Management Software for Venues, Festivals and Eve...

Crescat

Crescat is industry-trusted event management software, built by event professionals for event professionals. Founded in 2017, we have three key products tailored for the live event industry. Crescat Event for concert promoters and event agencies. Crescat Venue for music venues, conference centers, wedding venues, concert halls and more. And Crescat Festival for festivals, conferences and complex events. With a wide range of popular features such as event scheduling, shift management, volunteer and crew coordination, artist booking and much more, Crescat is designed for customisation and ease-of-use. Over 125,000 events have been planned in Crescat and with hundreds of customers of all shapes and sizes, from boutique event agencies through to international concert promoters, Crescat is rigged for success. What's more, we highly value feedback from our users and we are constantly improving our software with updates, new features and improvements. If you plan events, run a venue or produce festivals and you're looking for ways to make your life easier, then we have a solution for you. Try our software for free or schedule a no-obligation demo with one of our product specialists today at crescat.io

Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf

AMB-Review

Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos https://www.amb-review.com/tubetrivia-ai Exclusive Features: AI-Powered Questions, Wide Range of Categories, Adaptive Difficulty, User-Friendly Interface, Multiplayer Mode, Regular Updates. #TubeTriviaAI #QuizVideoMagic #ViralQuizVideos #AIQuizGenerator #EngageExciteExplode #MarketingRevolution #BoostYourTraffic #SocialMediaSuccess #AIContentCreation #UnlimitedTraffic

Orion Context Broker introduction 20240604

Fermin Galan

APIs for Browser Automation (MoT Meetup 2024)

Boni García

Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...

Shahin Sheidaei

Games are powerful teaching tools, fostering hands-on engagement and fun. But they require careful consideration to succeed. Join me to explore factors in running and selecting games, ensuring they serve as effective teaching tools. Learn to maintain focus on learning objectives while playing, and how to measure the ROI of gaming in education. Discover strategies for pitching gaming to leadership. This session offers insights, tips, and examples for coaches, team leads, and enterprise leaders seeking to teach from simple to complex concepts.

Navigating the Metaverse: A Journey into Virtual Evolution"

Donna Lenk

Automated software refactoring with OpenRewrite and Generative AI.pptx.pdf

timtebeek1

OpenMetadata Community Meeting - 5th June 2024

OpenMetadata

The OpenMetadata Community Meeting was held on June 5th, 2024. In this meeting, we discussed about the data quality capabilities that are integrated with the Incident Manager, providing a complete solution to handle your data observability needs. Watch the end-to-end demo of the data quality features. * How to run your own data quality framework * What is the performance impact of running data quality frameworks * How to run the test cases in your own ETL pipelines * How the Incident Manager is integrated * Get notified with alerts when test cases fail Watch the meeting recording here - https://www.youtube.com/watch?v=UbNOje0kf6E

openEuler Case Study - The Journey to Supply Chain Security

Shane Coughlan

GraphSummit Paris - The art of the possible with Graph Technology

Neo4j

Atelier - Innover avec l’IA Générative et les graphes de connaissances

Neo4j

Atelier - Innover avec l’IA Générative et les graphes de connaissances Allez au-delà du battage médiatique autour de l’IA et découvrez des techniques pratiques pour utiliser l’IA de manière responsable à travers les données de votre organisation. Explorez comment utiliser les graphes de connaissances pour augmenter la précision, la transparence et la capacité d’explication dans les systèmes d’IA générative. Vous partirez avec une expérience pratique combinant les relations entre les données et les LLM pour apporter du contexte spécifique à votre domaine et améliorer votre raisonnement. Amenez votre ordinateur portable et nous vous guiderons sur la mise en place de votre propre pile d’IA générative, en vous fournissant des exemples pratiques et codés pour démarrer en quelques minutes.

May Marketo Masterclass, London MUG May 22 2024.pdf

Adele Miller

Recently uploaded (20)

Enterprise Resource Planning System in Telangana

Understanding Globus Data Transfers with NetSage

Globus Compute Introduction - GlobusWorld 2024

Lecture 1 Introduction to games development

Quarkus Hidden and Forbidden Extensions

In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...

GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)

Text-Summarization-of-Breaking-News-Using-Fine-tuning-BART-Model.pptx

Introducing Crescat - Event Management Software for Venues, Festivals and Eve...

Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf

Orion Context Broker introduction 20240604

APIs for Browser Automation (MoT Meetup 2024)

Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...

Navigating the Metaverse: A Journey into Virtual Evolution"

Automated software refactoring with OpenRewrite and Generative AI.pptx.pdf

OpenMetadata Community Meeting - 5th June 2024

openEuler Case Study - The Journey to Supply Chain Security

GraphSummit Paris - The art of the possible with Graph Technology

Atelier - Innover avec l’IA Générative et les graphes de connaissances

May Marketo Masterclass, London MUG May 22 2024.pdf

Telepresence - Fast Development Workflows for Kubernetes

1. 1 TELEPRESENCE FastDevelopmentWorkflowsfor Kubernetes

2. 2 https://mitchdenny.com/the-inner-loop/

3. 3 The Kubernetes inner & outer loop is usually the same. Write code Build container Push to registry Deploy to cluster Test And can be …. SLOW.

4. 4 Automation helps speed it up …

5. 5 But you want a really fast inner loop (no docker build/push) …

6. And you want to use your own tools.

7. 7 Let’s do everything locally, so it’s really fast and I can use my tools!

8. 8 My laptop only has 16GB RAM and you’re asking it to run Kubernetes and a JVM and a database???

10. 10 TELEPRESENCE

11. 11 WhatisTelepresence? “Fancy Kubernetes VPN for development” “kubectl port-forward on steroids” A network bridge between your laptop and the Kubernetes cluster

12. 12 Howitworks A B C A’ The “A” deployment is replaced by a proxy. Requests to the proxy are sent to the laptop. Telepresence: 1. Intercepts DNS 2. Environment variables & secrets 3. Volumes 4. TCP

13. 13 Benefits Use any tool that runs on your laptop: IDE, profiler, debugger, … Unlimited compute resources Same network namespace (e.g., nslookup works) Very fast inner loop! Requirements • Network connection • kubectl access to cluster • Mac or Linux

14. 14 TelepresenceisaCNCFproject,withawide varietyofusers.

15. 15 • Capturing DNS and routing only part of it to the cluster is tricky • No two laptops are alike • Swapping out your (real) deployment for a (proxy) deployment is tricky

16. 16 DEMO

17. 17 USINGTHISINYOUR WORKFLOW

18. 18 Our problem: Transfer data from monoliths to microservices Following challenges • Too many legacy services for Docker Compose (7+) • Too many protocols to mock (LDAP, MSSQL, HTTP API, …) • Too many cloud services to emulate (Cloud Pub/Sub, Consul, …) TheProblem

19. 19 One cluster with multiple namespaces for all single-source-of-truth microservices Developers check out one of the microservices Developers use Bazel + Telepresence + IDE Telepresence is used in container mode with Bazel images Once code is done, Jenkins is used to run tests, build, and deploy Ourworkflow

20. 20 WHAT’SNEXT?

21. 21 Telepresencecomponents Proxy Server Client Capture DNS requests for Kubernetes resources DNS resolution for Kubernetes resources Proxy TCP connections to cluster Proxy TCP connections to laptop Canonical DNS for Kubernetes resources

22. 22 TelepresenceClient Use kubectl port-forward to bootstrap sshuttle (ssh-based VPN) sshuttle has a lot of functionality that is not used by Telepresence (it’s a VPN, after all) Replace sshuttle with Teleproxy — designed for Kubernetes • Capture DNS locally • Do DNS resolution intelligently • Redirect TCP connections to the right destination Already in progress, will replace VPN-TCP method Also support multiple simultaneous swaps

23. 23 TelepresenceProxyServer Currently deployed every time you do a swap-deployment (and then deleted) Switch mode to be persistent (this is what Kubernetes is good for) • Speeds up startup • Support reconnect

24. 24 Multi-userdevelopment Swap deployment doesn’t work well for multi-user development Solution today is to use namespaces and/or individual clusters • Expensive (more hardware & setup) • Delays integration testing until after commit

25. 25 Intercept(Commercial) Ambassador sends adds a user identity token to the HTTP header. The intercept sidecar will route to B or B’ depending on the HTTP header.

26. 26 DEMO

27. 27 ContributingtoTelepresence Documentation and workflows — how you integrate Telepresence into your development workflow Let us know if you’re a user! Triage — lots of folks use GitHub for support; doesn’t scale well Join Slack to help other users https://d6e.co/slack #telepresence

28. 28 Thankyou!Questions? richard@datawire.io / @rdli www.telepresence.io https://github.com/telepresenceio If you missed Christian Roggia’s talk on Telepresence, check out the video! Visit us at Booth SE19

Telepresence - Fast Development Workflows for Kubernetes

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Telepresence - Fast Development Workflows for Kubernetes

Similar to Telepresence - Fast Development Workflows for Kubernetes (20)

More from Ambassador Labs

More from Ambassador Labs (20)

Recently uploaded

Recently uploaded (20)

Telepresence - Fast Development Workflows for Kubernetes