Dumb Services in Smart Nets - istio

•

0 likes•133 views

The document discusses how service meshes like Istio can help address issues with microservices architectures like misconfigured fallbacks, retry storms, and cascading failures. It outlines Istio's features like smart routing, telemetry, and built-in security. The author advocates for using operators and "Otomators" to automate cluster management and progressive delivery strategies. Real ninjas are said to use Otomators to prevent developers from getting stuck in the mesh or it becoming clogged. Questions are raised about alternative meshes and ensuring otomators are developed.

Software

@antweiss
while True:
intellect = 0.05
dumbness = 0.95

@antweiss
Microservices !!!
API
gateway
User
mgmt
Product
Service
Pricing
Service
Orders
Service
Billing
Service
Payment
Service
MainUI
DB DB DB
DB DB DB
UserUI
MobileUI

@antweiss
The Traps of Distributed SysteMS

@antweiss
● Misconﬁgured Fallback Options
The Traps of Distributed SysteMS

@antweiss
● Misconﬁgured Fallback Options
● Retry Storms
The Traps of Distributed SysteMS

@antweiss
● Misconﬁgured Fallback Options
● Retry Storms
● Outages When a Downstream is Overloaded
The Traps of Distributed SysteMS

@antweiss
● Misconﬁgured Fallback Options
● Retry Storms
● Outages When a Downstream is Overloaded
● Cascading Failures When a SPOF crashes
The Traps of Distributed SysteMS

@antweiss
http://principlesofchaos.org
The Traps of Distributed SysteMS

@antweiss
● connection pools
PATTERNS of RESILIENCE

@antweiss
● connection pools
● failure detectors
PATTERNS of RESILIENCE

@antweiss
● connection pools
● failure detectors
● failover strategies:
○ circuit breaking
○ exponential back-offs
PATTERNS of RESILIENCE

@antweiss
● connection pools
● failure detectors
● failover strategies:
○ circuit breaking
○ exponential back-offs
● load-balancers
PATTERNS of RESILIENCE

@antweiss
● connection pools
● failure detectors
● failover strategies:
○ circuit breaking
○ exponential back-offs
● load-balancers
● back-pressure techniques
○ rate limiting, etc
PATTERNS of RESILIENCE

@antweiss
ADDITIONAL CONCERNS
Service Discovery

@antweiss
ADDITIONAL CONCERNS
Service Discovery
Observability:
● Distributed Tracing
● Network Telemetry

@antweiss
Service Discovery
Observability:
● Distributed Tracing
● Network Telemetry
Security:
● Point-to-point mTLS
ADDITIONAL CONCERNS

@antweiss
ADDITIONAL CONCERNS
Service Discovery
Observability:
● Distributed Tracing
● Network Telemetry
Security:
● Point-to-point mTLS
Continuous Delivery

@antweiss
ADDITIONAL CONCERNS
Service Discovery
Observability:
● Distributed Tracing
● Network Telemetry
Security:
● Point-to-point mTLS
Progressive Delivery

@antweiss
Progressive Delivery Strategies
● Rolling updates

@antweiss
● Rolling updates
● Dark Launch
Progressive Delivery Strategies

@antweiss
● Rolling updates
● Dark Launch
● Blue-Green
Progressive Delivery Strategies

@antweiss
● Rolling updates
● Dark Launch
● Blue-Green
● Canary
Progressive Delivery Strategies

@antweiss
● Rolling updates
● Dark Launch
● Blue-Green
● Canary
● Traffic Mirroring
Kiaaaiiii !!
Progressive Delivery Strategies

@antweiss
Go to a Library?
Finagle
Ribbon
Hystrix
Zipkin
Spring-sleuth
Polly (for .NET)

@antweiss
The Cloud-Native Answer: Service Mesh
Istio

@antweiss
Istio Perks
● Smart Routing and Load Balancing

@antweiss
● Smart Routing and Load Balancing
● Detailed Network Telemetry
Istio Perks

@antweiss
● Smart Routing and Load Balancing
● Detailed Network Telemetry
● Security (TLS) Built-In
Istio Perks

@antweiss
● Smart Routing and Load Balancing
● Detailed Network Telemetry
● Security (TLS) Built-In
● Platform(?) and Language Independent
Istio Perks

@antweiss
● Smart Routing and Load Balancing
● Detailed Network Telemetry
● Security (TLS) Built-In
● Platform(?) and Language Independent
No Changes to App Code!!! (Well, almost)
Istio Perks

@antweiss
Demo App
front
bethaleph
envoy envoy
envoy
istio-ingress-gateway
envoy
https://github.com/otomato-gh/istio-games

@antweiss
The BirdWatch Loop
apiVersion: apiextensions.k8s.io/v1beta1
kind: CustomResourceDefinition
metadata:
name: birdwatches.otomato.link
WAIT
FOR
CANARY
Found Canary:
Service: aleph
Version: 0.4
Release
some
traffic to
the canary
Canary
Healthy?
Canary Flies to
Production
yes no
Canary Dies
https://github.com/otomato-gh/birdwatch-otomator

@antweiss
Real NInjas Use:
K8S
Operators
Manage Complex (Stateful)
Apps
K8S
Otomators
Automate Cluster
Management
VS.
https://github.com/otomato-gh/birdwatch-otomator

@antweiss
● Won’t DevOps get Stuck in the Mesh?
SOME HARD QuestIONS:

@antweiss
SOME HARD QuestIONS:
● Won’t DevOps get Stuck in the Mesh?
● Who’s Gonna Build the Otomators?

@antweiss
SOME HARD QuestIONS:
● Won’t DevOps get Stuck in the Mesh?
● Who’s Gonna Build the Otomators?
● Why Python and not Golang?

@antweiss
SUMMARIZE:
● Service Mesh Protects Us From the Traps
● Solves the Shared Libraries Issues
● A Good Fit if you like Centralised Control
● Smarter Pipelines -> Dumber Services
● Without Otomators The Mesh Can Get Clogged
● Dumb Services in a Clogged Mesh = Catastrophe
● Therefore Real Ninjas use Otomators

@antweiss
The Future:
● Alternatives:
○ Linkerd 2.0 (from Bouyant)
○ Consul Connect (Hashicorp)
● Commercial Options
○ Aspen Mesh (F5 incubator)
○ AWS, Azure, GCP
● SMI Spec - the Standard Service Mesh API

@antweiss
Thank You
@antweiss
http://otomato.link
http://devopstrain.pro

The document discusses Comcast's journey towards continuous delivery. It describes how Comcast has transitioned from a process where deployments were done by many humans over much time, to one where a single human and many machines can deploy changes much faster. It introduces "Gumby", a tool developed by Comcast to automate deployments across various cloud platforms like vSphere, Openstack, and EC2 using technologies like Puppet, Git, and Cloud-Init. Gumby started as an experiment using Play and Akka but was rewritten using Spray and Akka to scale deployments. It is now used to deploy around 60% of Comcast's X1 backend infrastructure.

Exactly once delivery is a harsh mistress - DevOps Days TLV

Natan Silnitsky

In this talk I go over the basic theory of messaging in distributed systems, the different message delivery guarantees in Kafka and the to use them. I focus on exactly once delivery guarantees and the way Kafka implements it with transaction based messaging protocol. Including a discussion of the latency/throughput trade-offs, resource utilisation and its overall advantages and shortcomings. Finally, I show a use-case at Wix where exactly once delivery helped us solve a big problem.

Functional legacy - how to incorporate ZIO in your legacy services

Natan Silnitsky

So you want to introduce ZIO to your existing Scala codebase. Great Idea! It will make your code more efficient, readable, composable and safe. For the past year we have done this at my team at Wix and we have learned a lot about how to do it right. In this talk you will see how to successfully use ZIO in your legacy service using real-life code examples. You will learn key tips and takeaways including: - How and when to execute the ZIO runtime - How/When to introduce ZLayers into your codebase - How to make your existing APIs interop with ZIO - How to have more flexibility on ZManaged resource shutdown

Beyond Heroku: Hosting Your Rails App Yourself

stcarpenter

This document discusses hosting a Rails application yourself as an alternative to Heroku. It recommends using Unicorn as the application server, nginx as a reverse proxy, and deploying with Capistrano. Affordable hosting options mentioned include Amazon, Windows Azure, Digital Ocean, and Linode. Configuration management software and the features of Unicorn, nginx, and Capistrano are also outlined.

Alex lakatos state of mobile web

Codecamp Romania

The document discusses building mobile web applications. It provides details on mobile hardware specifications in India, including the Intex Cloud FX phone. It lists various web APIs that can be used to build hosted, privileged, and certified mobile apps, such as the vibration, geolocation, and contacts APIs. The document encourages testing apps using Mozilla resources and simulators and concludes by thanking the audience.

(GAM302) EA's Real-World Hurdles with Millions of Players in the Simpsons: Ta...

Amazon Web Services

How do you really architect a game that can handle 5, 6, or 7 million daily active users? Learn about the scalability challenges that EA had to overcome for The Simpsons: Tapped Out. Hear how EA had to redesign their MySQL-based database layer on the fly, migrating over to Amazon DynamoDB, while keeping the game running. See how EA added AWS Elastic Beanstalk and Auto Scaling to simplify their deployments, while also lowering costs by enabling them to respond to changing player counts. EA shows how they switched from sticky sessions to Amazon ElastiCache, solving player disconnects and allowing further scaling out. Finally, EA shares some interesting statistics about The Simpsons: Tapped Out, as well as their overall learnings about how best to develop, deploy, and monitor a game on AWS.

사물 인터넷을 위한 AWS FreeRTOS 소개

Harry Oh

Amazon FreeRTOS is an open source real-time operating system for microcontrollers that makes it easy to securely connect small devices to AWS IoT services like AWS IoT Core and AWS Greengrass. It provides features for multi-tasking, messaging, security, and connectivity to AWS while reducing complexity and costs compared to rolling your own solution. Amazon FreeRTOS is free to use and integrates with over 100 AWS services to enable a wide variety of IoT use cases across industries.

Ruby Conference Belarus 2019 Apr Jets Ruby Serverless Framework

Tung Nguyen

We will do a quick introduction to the Serverless world and AWS Lambda to establish a baseline for everyone. Then we'll jump into a Ruby Framework that makes Serverless easy to work with. Ruby is the not only one of most beautiful languages in the world but also extremely powerful. The power lies in Ruby's Metaprogramming abilities. This serverless framework leverages these Ruby powers to create a DSL that essentially translates Ruby code to AWS Lambda functions. We'll introduce these Framework concepts: * Controllers * Routes * Jobs We will create a few demos and deploy it to AWS Lambda live. We will also cover some architecture pattern examples that can be built with the framework.

Service meshes are all the buzz in cloud-native world. How come only yesterday we didn't know such a thing existed and now everybody seems to want one? If you're already running a microservice-based system or only starting out with one — you may be asking yourself: "Do I also need a mesh?" In this session we'll try to answer what the mesh is good for, what problems it solves, what new questions it poses. More specifically we will: explore the SMI Spec; understand why everybody wants a mesh; see how the mesh helps with progressive delivery; discuss if it's time for you to get into the mesh.

WTF Do We Need a Service Mesh? By Anton Weiss.

Cloud Native Day Tel Aviv

Lessons learned migrating 100+ services to Kubernetes

Jose Galarza

TransferWise migrated over 150 services from bare metal servers to Kubernetes in AWS over the course of a year. They developed tools and processes to automate cluster creation with Terraform, service deployment through custom manifest generation from YAML definitions, and a network mesh with Envoy to enable service-to-service communication. Some lessons learned included not exposing Kubernetes complexity, choosing the right CNI plugin, and installing node local DNS to reduce errors. Future plans include using EKS for simplified upgrades, enabling developer environments, and implementing network policies and advanced deployment pipelines.

Being serverless and Swift... Is that allowed?

Dev_Events

This document discusses Apache OpenWhisk, a serverless platform. It provides an overview of OpenWhisk and how it works, including its programming model using triggers, actions, rules and packages. It describes OpenWhisk's backend architecture using Docker containers and Kubernetes. It also discusses how OpenWhisk can be deployed on multiple clouds and IBM is working on improving its support for Kubernetes. Finally, it announces job openings and provides a link to a GitHub repository for an OpenWhisk CLI demo.

Envoy, Wasm and Rust - the Mighty Trio

Anton Weiss

Envoy is a lightweight modern network proxy written in C++. It has quickly become the base component in most existing service mesh implementations. With such popularity - a new, safer, more scalable extensibility model was needed. Much to our excitement - now one can extend Envoy network filtering with WebAssembly modules written (among other languages) in Rust. We'll see a live demo of building and deploying such a filter.

How to build a Distributed Serverless Polyglot Microservices IoT Platform us...

Animesh Singh

When people aren't talking about VMs and containers, they're talking about serverless architecture. Serverless is about no maintenance. It means you are not worried about low-level infrastructural and operational details. An event-driven serverless platform is a great use case for IoT. In this session at @ThingsExpo, Animesh Singh, an STSM and Lead for IBM Cloud Platform and Infrastructure, detailed how to build a distributed serverless, polyglot, microservices framework using open source technologies like: OpenWhisk: Open source distributed compute service to execute application logic in response to events Docker: To run event driven actions 6. Ansible and BOSH: to deploy the serverless platform MQTT: Messaging protocol for IoT Node-RED: Tool to wire IoT together Consul: Tool for service discovery and configuration. Consul is distributed, highly available, and extremely scalable. Kafka: A high-throughput distributed messaging system. StatsD/ELK/Graphite: For statistics, monitoring and logging

Twilio Voice Applications with Amazon AWS S3 and EC2

Twilio Inc

This document summarizes Twilio's platform for enabling web developers to build voice communication applications using basic web skills. Twilio provides a simple API with only five building blocks to develop advanced applications. Developers pay per usage with no upfront costs or commitments. Twilio aims to make voice communications, typically costly and difficult to build, accessible to web developers through its platform hosted on AWS.

Von JavaEE auf Microservice in 6 Monaten - The Good, the Bad, and the wtfs...

André Goliath

This document summarizes a talk about transitioning from JavaEE monoliths to microservices architecture in 6 months. It discusses the reasons for moving to microservices (faster development and deployment, lower costs), and the challenges including organizing configuration, communication between services, and deployment. It then outlines the steps taken to implement microservices at a company, including setting up continuous integration, using Spring Boot and Cloud, and establishing vertical feature teams to overcome organizational barriers. The key lessons are that the transition does not require a "big bang", can start with a single service, and works best by automating the development and deployment process from development to production.

Make Java Microservices Resilient with Istio - Mangesh - IBM - CC18

CodeOps Technologies LLP

This presentation was made by Mangesh Patankar (Developer Advocate - IBM Cloud) as part of Container Conference 2018: www.containerconf.in. "How do we make microservices resilient and fault-tolerant? How do we enforce policy decisions, such as fine-grained access control and rate limits? How do we enable timeouts/retries, health checks, etc.? A service-mesh architecture attempts to resolve these issues by extracting the common resiliency features needed by a microservices framework away from the applications and frameworks and into the platform itself. Istio provides an easy way to create this service mesh."

Visualizing Threats: Network Visualization for Cyber Security

Cambridge Intelligence

NEW LAUNCH! Amazon FreeRTOS: IoT Operating System for Microcontrollers - IOT2...

Amazon Web Services

This document introduces Amazon FreeRTOS, an open source real-time operating system for microcontrollers. It discusses how FreeRTOS helps connect microcontrollers to the cloud more easily and reduces costs. FreeRTOS includes security features, connectivity to AWS services, and support for over 40 microcontroller architectures. The document shares examples of how Schlage and NXP use FreeRTOS and highlights the FreeRTOS ecosystem of partners and tools.

Thunderstruck by serverless

DevOpsDays Galway

Conall Bennett from CME Group Belfast gave this talk at DevOpsDays Galway 2017: What's all the fuss with serverless architecture? To some, it is the future of architecture implementation and is disrupting DevOps, traditional implementation models, enterprise approaches to IT, and entry to and time to market. This talk is an experience report on how our team fell into a serverless implementation without any real experience of the technology and how we learned about it along the way. I will give a brief overview of what serverless is and its benefits and how we went from sceptics of it initially to advocates along our journey of discovery. I will describe our team test first mentality and the multiple functional and non-functional approaches and patterns we applied to serverless, as well as the existing challenges of testing it. That includes how we ran exploratory performance tests to determine and quantify language deficiencies on the platform in order to help drive our implementation approach.

ABD322_Implementing a Flight Simulator Interface Using AI, Virtual Reality, a...

Amazon Web Services

This workshop explores the technology options, architectures, and implementations associated with instrumenting AR, VR, and simulated worlds. Using flight simulation as the primary use case, you learn to consume, process, store, and analyze high velocity telemetry as well as exploring control plane implementations using AWS IoT, AWS Lambda, Amazon Kinesis, and Amazon SNS. This is a hands-on workshop and you need a laptop (tablets are not suitable). You should have a solid understanding of AWS products and Node.js.

Building a Service Mesh with NGINX Owen Garrett.pptx

PINGXIONG3

This document discusses building a service mesh with NGINX. It notes that operating distributed applications is difficult due to issues like slow and unreliable calls between services, distributed fault finding, and continuous updates occurring in production. It reviews existing approaches like using an NGINX proxy per pod or a simple mesh. A full service mesh provides more capabilities but also more complexity. The document outlines NGINX's plans to build a service mesh focused on hybrid applications, with lightweight and performant data and control planes using open source projects like SPIRE and OpenTracing where possible.

Active network

Michel Burger

The document discusses the potential for service-enabled networks through programmable network nodes. It describes how network nodes could be "emancipated" by exposing application programming interfaces that allow third-party code and services to run on the nodes. This would allow entrepreneurs and service providers to develop innovative services tailored to market demands. Key challenges to realizing this vision include security, scalability, and developing standardized APIs. Several research projects are exploring approaches to programmable and active networks.

Start Up Austin 2017: Serverless Real Time Analytics

Amazon Web Services

This document discusses serverless real-time analytics using AWS services. It begins with an overview of the problem of remotely monitoring smoker temperatures over time. It then covers the overall architecture, including the device-side which uses AWS IoT, Lambda, and API Gateway. The speed tier section discusses using Kinesis streams and Kinesis Analytics for real-time data transformation and analysis.

Builders' Day- Mastering Kubernetes on AWS

Amazon Web Services LATAM

The document discusses running Kubernetes on AWS. It begins with an agenda on Kubernetes, AWS, and mastering Kubernetes. It then provides examples of running containers locally and considerations for moving workloads to production. It discusses Kubernetes networking concepts and how the AWS VPC CNI plugin handles IP allocation. It also covers different Kubernetes service types like NodePort, LoadBalancer, ExternalName and Ingress resources. The document shares an example of implementing logging with EFK and discusses Snap's use of Amazon EKS to move to a microservices architecture.

agile microservices @scaibo

Ciro Donato Caiazzo

The document discusses agile microservices and their advantages over monolithic architectures. It describes how to decompose a monolithic real estate management application into independent microservices for properties, facilities, and engineering. Microservices allow for improved independence, speed of development, automation, and use of different technologies. Inter-service communication can occur over REST, HTTP, or AMQP, while an API gateway pattern hides service complexity from clients. Cloud computing platforms like Docker and Convox can deploy and manage containerized microservices. The Internet of Things connects physical devices to these services over protocols like MQTT and WebSocket.

Under the Hood of the New Twitch API - TwitchCon Developer Day 2017

Twitch Developers

X by orange; una telco en la nube

Juan Vicente Herrera Ruiz de Alejo

This document discusses how to setup a telco in the cloud using open source technologies. It describes how the company X by Orange uses infrastructure as code practices like Git, Packer, Terraform, and Ansible to provision their cloud infrastructure immutably. They deploy applications as containers using OpenShift and monitor services with Prometheus and Netdata. The goal is to provide flexible online solutions to customers faster than traditional telcos by embracing a cloud native approach.

The New Science of Software Delivery

Anton Weiss

In the last decade multiple IT organizations jumped head first into CI - in an utopian belief that with enough time and investment the CI pipeline will take them straight into the promised land of CD. But things rarely go as expected. The reality is that until now most of us can't continuously and safely deploy to production - if it's because of lack of confidence, security concerns or contractual obligations. The number of outages caused by production updates is growing and the ever-increasing observability of our systems doesn't make SRE work any less stressful. Cloud native technologies are supposed to make operating complex distributed systems easier - but the CD gap is still not closed. New approaches such as GitOps and Progressive Delivery strategies are getting more widely known but are still hard to pull off for anyone but the most technologically advanced teams. We at Canarian and Otomato believe CD doesn't have to be so hard. In the last 4 years we've helped a number of orgs with their continuous deployment effort - both for SaaS and enterprise systems. We clearly see the need for better tooling and semantic change management that will allow us to modify information systems with heightened agility, stability and built-in support for continuous experimentation. I the talk I outline the CD solution we are working on, explain what features it brings to the table and how this will revolutionize software delivery in the cloud native world.

Escaping the Jungle - Migrating to Cloud Native CI/CD

Anton Weiss

The document discusses migrating from a complex "jungle" of tools and technologies for continuous integration and continuous delivery (CI/CD) to a cloud-native approach. It describes some of the challenges of the jungle model, including decision waste, integration pains, and lack of common standards. The document then outlines key aspects of a cloud-native CI/CD model, including using Kubernetes as the integration platform, dynamic agents and environments, and decoupling delivery from release. It provides examples of implementing such a model using shared libraries, Jenkinsfiles, containerized agents, and standardized pipelines and workflows.

Similar to Dumb Services in Smart Nets - istio

WTF Do We Need a Service Mesh?

Anton Weiss

WTF Do We Need a Service Mesh? By Anton Weiss.

Cloud Native Day Tel Aviv

Lessons learned migrating 100+ services to Kubernetes

Jose Galarza

Being serverless and Swift... Is that allowed?

Dev_Events

Envoy, Wasm and Rust - the Mighty Trio

Anton Weiss

How to build a Distributed Serverless Polyglot Microservices IoT Platform us...

Animesh Singh

Twilio Voice Applications with Amazon AWS S3 and EC2

Twilio Inc

Von JavaEE auf Microservice in 6 Monaten - The Good, the Bad, and the wtfs...

André Goliath

Make Java Microservices Resilient with Istio - Mangesh - IBM - CC18

CodeOps Technologies LLP

Visualizing Threats: Network Visualization for Cyber Security

Cambridge Intelligence

NEW LAUNCH! Amazon FreeRTOS: IoT Operating System for Microcontrollers - IOT2...

Amazon Web Services

Thunderstruck by serverless

DevOpsDays Galway

ABD322_Implementing a Flight Simulator Interface Using AI, Virtual Reality, a...

Amazon Web Services

Building a Service Mesh with NGINX Owen Garrett.pptx

PINGXIONG3

Active network

Michel Burger

Start Up Austin 2017: Serverless Real Time Analytics

Amazon Web Services

Builders' Day- Mastering Kubernetes on AWS

Amazon Web Services LATAM

agile microservices @scaibo

Ciro Donato Caiazzo

Under the Hood of the New Twitch API - TwitchCon Developer Day 2017

Twitch Developers

X by orange; una telco en la nube

Juan Vicente Herrera Ruiz de Alejo

Similar to Dumb Services in Smart Nets - istio (20)

WTF Do We Need a Service Mesh?

WTF Do We Need a Service Mesh? By Anton Weiss.

Lessons learned migrating 100+ services to Kubernetes

Being serverless and Swift... Is that allowed?

Envoy, Wasm and Rust - the Mighty Trio

How to build a Distributed Serverless Polyglot Microservices IoT Platform us...

Twilio Voice Applications with Amazon AWS S3 and EC2

Von JavaEE auf Microservice in 6 Monaten - The Good, the Bad, and the wtfs...

Make Java Microservices Resilient with Istio - Mangesh - IBM - CC18

Visualizing Threats: Network Visualization for Cyber Security

NEW LAUNCH! Amazon FreeRTOS: IoT Operating System for Microcontrollers - IOT2...

Thunderstruck by serverless

ABD322_Implementing a Flight Simulator Interface Using AI, Virtual Reality, a...

Building a Service Mesh with NGINX Owen Garrett.pptx

Active network

Start Up Austin 2017: Serverless Real Time Analytics

Builders' Day- Mastering Kubernetes on AWS

agile microservices @scaibo

Under the Hood of the New Twitch API - TwitchCon Developer Day 2017

X by orange; una telco en la nube

More from Anton Weiss

The New Science of Software Delivery

Anton Weiss

Escaping the Jungle - Migrating to Cloud Native CI/CD

Anton Weiss

Many Changes Little Fun

Anton Weiss

Optimizing the Delivery Pipeline for Flow

Anton Weiss

The document discusses optimizing the software delivery pipeline using lean principles. It defines the delivery pipeline as a subset of the overall value stream. Key aspects covered include identifying types of waste, establishing base performance metrics like deployment frequency and change failure rate, 12 specific devops flow metrics, and techniques for enabling smooth flow like transparency, pull-based flows, and on-demand resources. It emphasizes the importance of measurement for management but cautions against the myth that what can't be measured can't be managed.

A Deeper Look at Cargo

Anton Weiss

Cargo is the package manager for Rust. It is used to create new projects, manage dependencies, compile code, and publish packages. Cargo uses the Cargo.toml file to define metadata and dependencies, and Cargo.lock to lock dependency versions. Dependencies can come from Crates.io, Git repositories, or local paths. Build scripts allow generating code during compilation. Cargo can publish packages to Crates.io and supports workspaces, environment variables, custom commands, and unstable features for nightly builds.

Heralding change - How to Get Engineers On Board the DevOps Ship

Anton Weiss

When Your Pipelines Are a Mess

Anton Weiss

This document discusses managing chaos in complex systems like pipelines and plumbing. It suggests embracing failures and decentralization. Key concepts mentioned include feedback loops, self-organization, microservices, serverless architecture, blockchain, and chaos engineering. The document advocates for simplifying interaction between components rather than the components themselves. It also promotes open policy, observability, and dynamic policy definition for distributed systems.

Wiring up microservices with Istio

Anton Weiss

ChatOps - the Road to a Collaborative CLI

Anton Weiss

This document discusses ChatOps and how it can be implemented. It introduces common chat bots like Hubot and how they integrate different systems through a team chat interface. It provides tips on choosing a bot framework, developing discoverability through commands, and balancing the signal to noise ratio in chat. The document warns about risks like vendor lock-in but emphasizes that the overall goal is to have fun while improving collaboration and learning. Real customer examples are given to demonstrate the benefits of ChatOps.

The Road to a Hybrid, Transparent Pipeline

Anton Weiss

Jenkins and the Future of Software Delivery

Anton Weiss

This document discusses trends in software delivery past, present and future. It notes how software delivery has shifted from manual and localized to automated and distributed. It argues continuous delivery is about dealing with increasing chaos and diversity. The document suggests several trends for the future including machine learning, augmented reality, IoT and self-driving vehicles. It envisions a future where computers write more of the code, delivery is further automated through self-healing systems, and improved visualization and interfaces change how software is developed and delivered.

How Openstack is Built

Anton Weiss

Openstack is one of the largest OSS projects today with hundreds of commits flowing in daily. This high rate of change requires an advanced CI infrastructure. The purpose of the talk is to provide an overview of this infrastructure, explaining the role of each tool and the pipelines along which changes have to travel before they find their way into the approved Openstack codebase. Talk delivered at Openstack Day Israel 2016 : http://www.openstack-israel.org/#!agenda/cjg9

Continuous Delivery is Not a Commodity

Anton Weiss

Continuous Delivery is not a commodity because no two Continuous Delivery pipelines are exactly the same. Continuous Delivery requires integration with multiple tools and frameworks, support for multiple operating systems, and customizable flows, dashboards, and reporting. While the principles of Continuous Delivery can be learned from others, each organization's Continuous Delivery process is unique and cannot simply be copied from another. Continuous Delivery is more of an art than a science that depends on people, not just technology.

Grooving with Jenkins

Anton Weiss

Ninja, Choose Your Weapon!

Anton Weiss

DevOps - Transparency & Self Service

Anton Weiss

This document discusses the concepts of DevOps, transparency, and self-service. It argues that self-service requires better technology, usability, and trust which is built through transparency. Transparency involves traceability, monitoring, reporting, logs, dashboards and feedback loops to create a culture of openness and understanding between teams. When implemented successfully, self-service can provide services like continuous integration, testing, provisioning and deployment in an automated and user-friendly way to help deliver better software faster.

Vagrant in 15 minutes

Anton Weiss

Vagrant allows developers to easily create and configure consistent development environments across machines using configuration files and provisioning scripts. It works by defining a virtual environment using a Vagrantfile that specifies things like the base box image, networking, storage, and provisioning scripts. Vagrant then automates the setup of this virtual environment on the local machine, allowing developers to work with reproducible and portable development environments.

Continuous Delivery for Mobile R&D

Anton Weiss

The document summarizes a presentation given by Anton Weiss at the Jenkins User Conference on July 5, 2012 in Herzelia, Israel about full cycle mobile build automation using Jenkins. The presentation covered getting source from ClearCase and SVN, building Java and Objective C mobile applications for Android, BlackBerry and iOS, running static code analysis and tests, notifying teams of results, and opportunities to improve build flows in Jenkins.

Using Jenkins XML API

Anton Weiss

More from Anton Weiss (19)

The New Science of Software Delivery

Escaping the Jungle - Migrating to Cloud Native CI/CD

Many Changes Little Fun

Optimizing the Delivery Pipeline for Flow

A Deeper Look at Cargo

Heralding change - How to Get Engineers On Board the DevOps Ship

When Your Pipelines Are a Mess

Wiring up microservices with Istio

ChatOps - the Road to a Collaborative CLI

The Road to a Hybrid, Transparent Pipeline

Jenkins and the Future of Software Delivery

How Openstack is Built

Continuous Delivery is Not a Commodity

Grooving with Jenkins

Ninja, Choose Your Weapon!

DevOps - Transparency & Self Service

Vagrant in 15 minutes

Continuous Delivery for Mobile R&D

Using Jenkins XML API

Recently uploaded

LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM

lorraineandreiamcidl

Artificia Intellicence and XPath Extension Functions

Octavian Nadolu

Why Mobile App Regression Testing is Critical for Sustained Success_ A Detail...

kalichargn70th171

A dynamic process unfolds in the intricate realm of software development, dedicated to crafting and sustaining products that effortlessly address user needs. Amidst vital stages like market analysis and requirement assessments, the heart of software development lies in the meticulous creation and upkeep of source code. Code alterations are inherent, challenging code quality, particularly under stringent deadlines.

Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris

Neo4j

LORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptx

lorraineandreiamcidl

WhatsApp offers simple, reliable, and private messaging and calling services for free worldwide. With end-to-end encryption, your personal messages and calls are secure, ensuring only you and the recipient can access them. Enjoy voice and video calls to stay connected with loved ones or colleagues. Express yourself using stickers, GIFs, or by sharing moments on Status. WhatsApp Business enables global customer outreach, facilitating sales growth and relationship building through showcasing products and services. Stay connected effortlessly with group chats for planning outings with friends or staying updated on family conversations.

Introducing Crescat - Event Management Software for Venues, Festivals and Eve...

Crescat

Crescat is industry-trusted event management software, built by event professionals for event professionals. Founded in 2017, we have three key products tailored for the live event industry. Crescat Event for concert promoters and event agencies. Crescat Venue for music venues, conference centers, wedding venues, concert halls and more. And Crescat Festival for festivals, conferences and complex events. With a wide range of popular features such as event scheduling, shift management, volunteer and crew coordination, artist booking and much more, Crescat is designed for customisation and ease-of-use. Over 125,000 events have been planned in Crescat and with hundreds of customers of all shapes and sizes, from boutique event agencies through to international concert promoters, Crescat is rigged for success. What's more, we highly value feedback from our users and we are constantly improving our software with updates, new features and improvements. If you plan events, run a venue or produce festivals and you're looking for ways to make your life easier, then we have a solution for you. Try our software for free or schedule a no-obligation demo with one of our product specialists today at crescat.io

E-commerce Application Development Company.pdf

Hornet Dynamics

Need for Speed: Removing speed bumps from your Symfony projects ⚡️

Łukasz Chruściel

No one wants their application to drag like a car stuck in the slow lane! Yet it’s all too common to encounter bumpy, pothole-filled solutions that slow the speed of any application. Symfony apps are not an exception. In this talk, I will take you for a spin around the performance racetrack. We’ll explore common pitfalls - those hidden potholes on your application that can cause unexpected slowdowns. Learn how to spot these performance bumps early, and more importantly, how to navigate around them to keep your application running at top speed. We will focus in particular on tuning your engine at the application level, making the right adjustments to ensure that your system responds like a well-oiled, high-performance race car.

Vitthal Shirke Java Microservices Resume.pdf

Vitthal Shirke

Mobile App Development Company In Noida | Drona Infotech

Drona Infotech

UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions

Peter Muessig

The UI5 tooling is the development and build tooling of UI5. It is built in a modular and extensible way so that it can be easily extended by your needs. This session will showcase various tooling extensions which can boost your development experience by far so that you can really work offline, transpile your code in your project to use even newer versions of EcmaScript (than 2022 which is supported right now by the UI5 tooling), consume any npm package of your choice in your project, using different kind of proxies, and even stitching UI5 projects during development together to mimic your target environment.

What is Augmented Reality Image Tracking

pavan998932

Revolutionizing Visual Effects Mastering AI Face Swaps.pdf

Undress Baby

The quest for the best AI face swap solution is marked by an amalgamation of technological prowess and artistic finesse, where cutting-edge algorithms seamlessly replace faces in images or videos with striking realism. Leveraging advanced deep learning techniques, the best AI face swap tools meticulously analyze facial features, lighting conditions, and expressions to execute flawless transformations, ensuring natural-looking results that blur the line between reality and illusion, captivating users with their ingenuity and sophistication. Web:- https://undressbaby.com/

Hand Rolled Applicative User ValidationCode Kata

Philip Schwarz

Could you use a simple piece of Scala validation code (granted, a very simplistic one too!) that you can rewrite, now and again, to refresh your basic understanding of Applicative operators <*>, <*, *>? The goal is not to write perfect code showcasing validation, but rather, to provide a small, rough-and ready exercise to reinforce your muscle-memory. Despite its grandiose-sounding title, this deck consists of just three slides showing the Scala 3 code to be rewritten whenever the details of the operators begin to fade away. The code is my rough and ready translation of a Haskell user-validation program found in a book called Finding Success (and Failure) in Haskell - Fall in love with applicative functors.

Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management

Utilocate

Utilocate offers a comprehensive solution for locate ticket management by automating and streamlining the entire process. By integrating with Geospatial Information Systems (GIS), it provides accurate mapping and visualization of utility locations, enhancing decision-making and reducing the risk of errors. The system's advanced data analytics tools help identify trends, predict potential issues, and optimize resource allocation, making the locate ticket management process smarter and more efficient. Additionally, automated ticket management ensures consistency and reduces human error, while real-time notifications keep all relevant personnel informed and ready to respond promptly. The system's ability to streamline workflows and automate ticket routing significantly reduces the time taken to process each ticket, making the process faster and more efficient. Mobile access allows field technicians to update ticket information on the go, ensuring that the latest information is always available and accelerating the locate process. Overall, Utilocate not only enhances the efficiency and accuracy of locate ticket management but also improves safety by minimizing the risk of utility damage through precise and timely locates.

2024 eCommerceDays Toulouse - Sylius 2.0.pdf

Łukasz Chruściel

OpenMetadata Community Meeting - 5th June 2024

OpenMetadata

The OpenMetadata Community Meeting was held on June 5th, 2024. In this meeting, we discussed about the data quality capabilities that are integrated with the Incident Manager, providing a complete solution to handle your data observability needs. Watch the end-to-end demo of the data quality features. * How to run your own data quality framework * What is the performance impact of running data quality frameworks * How to run the test cases in your own ETL pipelines * How the Incident Manager is integrated * Get notified with alerts when test cases fail Watch the meeting recording here - https://www.youtube.com/watch?v=UbNOje0kf6E

Atelier - Innover avec l’IA Générative et les graphes de connaissances

Neo4j

Atelier - Innover avec l’IA Générative et les graphes de connaissances Allez au-delà du battage médiatique autour de l’IA et découvrez des techniques pratiques pour utiliser l’IA de manière responsable à travers les données de votre organisation. Explorez comment utiliser les graphes de connaissances pour augmenter la précision, la transparence et la capacité d’explication dans les systèmes d’IA générative. Vous partirez avec une expérience pratique combinant les relations entre les données et les LLM pour apporter du contexte spécifique à votre domaine et améliorer votre raisonnement. Amenez votre ordinateur portable et nous vous guiderons sur la mise en place de votre propre pile d’IA générative, en vous fournissant des exemples pratiques et codés pour démarrer en quelques minutes.

Energy consumption of Database Management - Florina Jonuzi

Green Software Development

Oracle Database 19c New Features for DBAs and Developers.pptx

Remote DBA Services

Recently uploaded (20)

LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM

Artificia Intellicence and XPath Extension Functions

Why Mobile App Regression Testing is Critical for Sustained Success_ A Detail...

Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris

LORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptx

Introducing Crescat - Event Management Software for Venues, Festivals and Eve...

E-commerce Application Development Company.pdf

Need for Speed: Removing speed bumps from your Symfony projects ⚡️

Vitthal Shirke Java Microservices Resume.pdf

Mobile App Development Company In Noida | Drona Infotech

UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions

What is Augmented Reality Image Tracking

Revolutionizing Visual Effects Mastering AI Face Swaps.pdf

Hand Rolled Applicative User ValidationCode Kata

Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management

2024 eCommerceDays Toulouse - Sylius 2.0.pdf

OpenMetadata Community Meeting - 5th June 2024

Atelier - Innover avec l’IA Générative et les graphes de connaissances

Energy consumption of Database Management - Florina Jonuzi

Oracle Database 19c New Features for DBAs and Developers.pptx

Dumb Services in Smart Nets - istio

1. Dumb Services In Smart Nets Ant Weiss, Otomato Software Deploy Like a Ninja with a Service Mesh

2. whoami: Anton (Ant) Weiss @antweiss Otomato Software Delivery http://otomato.link

3. @antweiss while True: intellect = 0.05

4. @antweiss while True: intellect = 0.05 dumbness = 0.95

5. @antweiss Microservices !!! API gateway User mgmt Product Service Pricing Service Orders Service Billing Service Payment Service MainUI DB DB DB DB DB DB UserUI MobileUI

6. @antweiss Microservices !!! API gateway User mgmt Product Service Pricing Service Orders Service Billing Service Payment Service MainUI DB DB DB DB DB DB UserUI MobileUI MacroPAIN !!!

7. @antweiss

8. @antweiss The Traps of Distributed SysteMS

9. @antweiss ● Misconﬁgured Fallback Options The Traps of Distributed SysteMS

10. @antweiss ● Misconﬁgured Fallback Options ● Retry Storms The Traps of Distributed SysteMS

11. @antweiss ● Misconﬁgured Fallback Options ● Retry Storms ● Outages When a Downstream is Overloaded The Traps of Distributed SysteMS

12. @antweiss ● Misconﬁgured Fallback Options ● Retry Storms ● Outages When a Downstream is Overloaded ● Cascading Failures When a SPOF crashes The Traps of Distributed SysteMS

13. @antweiss http://principlesofchaos.org The Traps of Distributed SysteMS

14. @antweiss PATTERNS of RESILIENCE

15. @antweiss ● connection pools PATTERNS of RESILIENCE

16. @antweiss ● connection pools ● failure detectors PATTERNS of RESILIENCE

17. @antweiss ● connection pools ● failure detectors ● failover strategies: ○ circuit breaking ○ exponential back-offs PATTERNS of RESILIENCE

18. @antweiss ● connection pools ● failure detectors ● failover strategies: ○ circuit breaking ○ exponential back-offs ● load-balancers PATTERNS of RESILIENCE

19. @antweiss ● connection pools ● failure detectors ● failover strategies: ○ circuit breaking ○ exponential back-offs ● load-balancers ● back-pressure techniques ○ rate limiting, etc PATTERNS of RESILIENCE

20. @antweiss ADDITIONAL CONCERNS Service Discovery

21. @antweiss ADDITIONAL CONCERNS Service Discovery Observability: ● Distributed Tracing ● Network Telemetry

22. @antweiss Service Discovery Observability: ● Distributed Tracing ● Network Telemetry Security: ● Point-to-point mTLS ADDITIONAL CONCERNS

23. @antweiss ADDITIONAL CONCERNS Service Discovery Observability: ● Distributed Tracing ● Network Telemetry Security: ● Point-to-point mTLS Continuous Delivery

24. @antweiss ADDITIONAL CONCERNS Service Discovery Observability: ● Distributed Tracing ● Network Telemetry Security: ● Point-to-point mTLS Progressive Delivery

25. @antweiss Progressive Delivery Strategies ● Rolling updates

26. @antweiss ● Rolling updates ● Dark Launch Progressive Delivery Strategies

27. @antweiss ● Rolling updates ● Dark Launch ● Blue-Green Progressive Delivery Strategies

28. @antweiss ● Rolling updates ● Dark Launch ● Blue-Green ● Canary Progressive Delivery Strategies

29. @antweiss ● Rolling updates ● Dark Launch ● Blue-Green ● Canary ● Traffic Mirroring Kiaaaiiii !! Progressive Delivery Strategies

30. @antweiss Go to a Library? Finagle Ribbon Hystrix Zipkin Spring-sleuth Polly (for .NET)

31. @antweiss The Cloud-Native Answer: Service Mesh Istio

32. @antweiss Istio Perks ● Smart Routing and Load Balancing

33. @antweiss ● Smart Routing and Load Balancing ● Detailed Network Telemetry Istio Perks

34. @antweiss ● Smart Routing and Load Balancing ● Detailed Network Telemetry ● Security (TLS) Built-In Istio Perks

35. @antweiss ● Smart Routing and Load Balancing ● Detailed Network Telemetry ● Security (TLS) Built-In ● Platform(?) and Language Independent Istio Perks

36. @antweiss ● Smart Routing and Load Balancing ● Detailed Network Telemetry ● Security (TLS) Built-In ● Platform(?) and Language Independent No Changes to App Code!!! (Well, almost) Istio Perks

37. @antweiss ISTIO ARCHITECTURE

38. @antweiss Demo App front bethaleph envoy envoy envoy istio-ingress-gateway envoy https://github.com/otomato-gh/istio-games

39. @antweiss YAM L who?

40. @antweiss The BirdWatch Loop apiVersion: apiextensions.k8s.io/v1beta1 kind: CustomResourceDefinition metadata: name: birdwatches.otomato.link WAIT FOR CANARY Found Canary: Service: aleph Version: 0.4 Release some traffic to the canary Canary Healthy? Canary Flies to Production yes no Canary Dies https://github.com/otomato-gh/birdwatch-otomator

41. @antweiss Real NInjas Use: K8S Operators Manage Complex (Stateful) Apps K8S Otomators Automate Cluster Management VS. https://github.com/otomato-gh/birdwatch-otomator

42. @antweiss ● Won’t DevOps get Stuck in the Mesh? SOME HARD QuestIONS:

43. @antweiss SOME HARD QuestIONS: ● Won’t DevOps get Stuck in the Mesh? ● Who’s Gonna Build the Otomators?

44. @antweiss SOME HARD QuestIONS: ● Won’t DevOps get Stuck in the Mesh? ● Who’s Gonna Build the Otomators? ● Why Python and not Golang?

45. @antweiss SUMMARIZE: ● Service Mesh Protects Us From the Traps ● Solves the Shared Libraries Issues ● A Good Fit if you like Centralised Control ● Smarter Pipelines -> Dumber Services ● Without Otomators The Mesh Can Get Clogged ● Dumb Services in a Clogged Mesh = Catastrophe ● Therefore Real Ninjas use Otomators

46. @antweiss The Future: ● Alternatives: ○ Linkerd 2.0 (from Bouyant) ○ Consul Connect (Hashicorp) ● Commercial Options ○ Aspen Mesh (F5 incubator) ○ AWS, Azure, GCP ● SMI Spec - the Standard Service Mesh API

47. @antweiss Thank You @antweiss http://otomato.link http://devopstrain.pro

Dumb Services in Smart Nets - istio

Recommended

Recommended

More Related Content

Similar to Dumb Services in Smart Nets - istio

Similar to Dumb Services in Smart Nets - istio (20)

More from Anton Weiss

More from Anton Weiss (19)

Recently uploaded

Recently uploaded (20)

Dumb Services in Smart Nets - istio