Resilient Kafka: How DNS Traffic Management and Client Wrappers Ensure Availability

•

0 likes•20 views

Kafka clients sometimes have problems producing messages because of an incident or maintenance. In most cases these issues are short lived, but clients get paged and while long incidents are rare, they are memorable. In this talk, we'll run through our Kafka infrastructure at Shopify and how clients connect to it. Next, we'll describe our solution for performing failovers using DNS. Afterwards, we'll look at some real world scenarios where this system saved us from major outages. In conclusion, Kafka clusters are more resilient to infrastructure hiccups with a DNS traffic manager and opinionated client wrappers.

Engineering

Vanessa Vuibert
Sta
ff
Production Engineer
Resilient Ka
f
ka: How DNS Tra
ff
ic Management
and Client Wrappers Ensure Availability
@V3_XD

862 14
Scale
Ka
f
ka brokers Ka
f
ka clusters
14M 9
Messages per sec GCP Regions
@V3_XD

• Maintenance
• Incidents
• Regionalize tra
ff
ic
Tra
ff
ic management use cases

Kubernetes (K8s) out of the box
🔓open source
Kafka broker

K8s out of the box
dig +short service.namespace.svc.cluster.local
IP0
IP1
IP2

K8s out of the box
bootstrap.servers=
service.namespace.svc.cluster.local:9092

K8s out of the box
dig +short pod2.service.namespace.svc.cluster.local
IP2

K8s out of the box
advertised.listeners=
pod2.service.namespace.svc.cluster.local:9092

• Readiness
• Startup
• Liveness
K8s StatefulSet: probes

dig +short service.namespace.svc.cluster.local
IP0
IP2
K8s readiness probe

dig +short service.namespace.svc.cluster.local
IP0
IP1
IP2
K8s readiness probe
not ready
publishNotReadyAddresses: true

External tra
ff
ic: load balancers
bootstrap.servers

External tra
ff
ic: load balancers
advertised.listeners

• Issues scaling
• Manual broker DNS
records
• Limited tra
ff
ic
control

Stateful buddy: load balancers
🔒closed source

Ka
f
ka access buddy: endpoints
🔒closed source

Ka
f
ka Access Buddy: producer failover
east

- Elasticsearch on call
“Let me failover real quick.”

Faster failovers with a
DNS tra
ff
ic manager.

DNS tra
ff
ic manager: normal
dig +short us-east1.somedomain.com
US-East1-IP

DNS tra
ff
ic manager: failover
dig +short us-east1.somedomain.com
US-Central1-IP

used to take
40
Minutes
now only takes
1
Minutes
Failover time savings
@V3_XD

Failover during
fl
ashsale
US Central1 -> US East1

• Failover reconnection
• Everything needed for connection
• Ruby, go and python
Client wrappers

K8s Deployment template: bootstrap.servers

Improved availability
with local consumers.

• More availability
• Reduced latency
• Reduced storage costs
• Reduced network costs
Local consumers

Aggregate
500
ms
Regional
20
ms
Latency 99th
@V3_XD

• More secure
• Reduced network costs
• Fetch from closest replica: KIP
-
392
Public to private tra
ff
ic

Reduction
-6%
bill
Network represents
29%
bill
Network cost reduction
@V3_XD

• GKE 1.24 -> 1.25
incident
• Apply
f
irewall rules
• LB more secure for
public tra
ff
ic

Single stop shop with Multi-
Cluster Services (MCS).

Regionalize tra
ff
ic: Ka
f
ka access buddy
east

40 18
MCS time savings
Minutes to regionalize tra
ff
ic Minutes to deploy
1 13
Minutes after migration Minutes after migration
@V3_XD

• Resiliency: DNS
tra
ff
ic management
• Toil: client wrappers
• Availability: local
consumption

Speakers: Ravi Dubey, Senior Manager, Software Engineering, Capital One + Jeff Sharpe, Software Engineer, Capital One Capital One supports interactions with real-time streaming transactional data using Apache Kafka®. Kafka helps deliver information to internal operation teams and bank tellers to assist with assessing risk and protect customers in a myriad of ways. Inside the bank, Kafka allows Capital One to build a real-time system that takes advantage of modern data and cloud technologies without exposing customers to unnecessary data breaches, or violating privacy regulations. These examples demonstrate how a streaming platform enables Capital One to act on their visions faster and in a more scalable way through the Kafka solution, helping establish Capital One as an innovator in the banking space. Join us for this online talk on lessons learned, best practices and technical patterns of Capital One’s deployment of Apache Kafka. -Find out how Kafka delivers on a 5-second service-level agreement (SLA) for inside branch tellers. -Learn how to combine and host data in-memory and prevent personally identifiable information (PII) violations of in-flight transactions. -Understand how Capital One manages Kafka Docker containers using Kubernetes. Watch the recording: https://videos.confluent.io/watch/6e6ukQNnmASwkf9Gkdhh69?.

Accelerated SDN in Azure

Open Networking Summit

Daniel Firestone and Gabriel Silva's presentation from the 2017 Open Networking Summit. SDN is at the foundation of all large scale networks in the public cloud, such as Microsoft Azure - at past ONSes, Microsoft has detailed how all of Azure's virtual networks, load balancing, and security operate on SDN. But how do we make a software network scale to an era of 40, 50, and 100 gigabit networks on servers, providing great performance to end customers with ever increasing VM and container scale and density? In this presentation, Daniel Firestone and Gabriel Silva will detail Azure Accelerated Networking, using Azure's FPGA-based SmartNICs. They will show how using FPGAs, we can achieve the programmability of a software network with the performance of a hardware one. They will detail how this and other host SDN advances have led to huge performance increases for Linux VMs in particular, and Linux-based NFV appliances, giving Azure industry-leading network performance.

From Three Nines to Five Nines - A Kafka Journey

Allen (Xiaozhong) Wang

LF_DPDK17_OpenNetVM: A high-performance NFV platforms to meet future communic...

LF_DPDK

This document discusses software-based networking and network function virtualization (NFV). It introduces NetVM, an NFV platform developed by the author that provides high performance packet delivery across virtual machines using DPDK for zero-copy networking. NetVM enables complex network services to be distributed across multiple VMs while maintaining high throughput. The author also discusses OpenNetVM, an open source version of NetVM, and contributions like Flurries that enable unique network functions to run per flow for improved scalability. NFVnice, a userspace framework for scheduling NFV chains, is also introduced to improve throughput, fairness and CPU utilization.

Cloud Native SDN

Romana Project

This document summarizes a presentation about Romana Cloud Native SDN and multi-tenant networking in Kubernetes. It discusses how Romana embeds tenant and segment IDs in IP addresses to provide layer 3 isolation and tenancy without using overlays. This simplifies operations by eliminating the need for VLANs, VXLANs, and other complex networking constructs. The presentation includes examples of how Romana assigns addresses and isolates tenants, pods, and tiers through network policies. It concludes with an outline of a demo to showcase these capabilities by launching isolated tenants and enforcing policies between tiers.

Geode - Day 2

Swapnil Bawaskar

Uber Real Time Data Analytics

Ankur Bansal

Building data pipelines is pretty hard! Building a multi-datacenter active-active real time data pipeline for multiple classes of data with different durability, latency and availability guarantees is much harder. Real time infrastructure powers critical pieces of Uber (think Surge) and in this talk we will discuss our architecture, technical challenges, learnings and how a blend of open source infrastructure (Apache Kafka and Samza) and in-house technologies have helped Uber scale.

This document provides an overview of Kafka including its architecture, key concepts, and performance tuning. It describes how Kafka is a distributed streaming platform popular for use cases like logging, metrics, and messaging. The architecture explained includes Kafka brokers that make up clusters, Zookeeper for coordination, producers that publish messages, consumers that subscribe to messages, and topics for categorizing data. It also covers message delivery guarantees, monitoring tools, and ways to optimize producer, broker, consumer, and JVM performance such as configuration settings for throughput, latency, and durability.

In Flux Limiting for a multi-tenant logging service

DataWorks Summit/Hadoop Summit

The document discusses in-flux limiting for a multi-tenant logging service. It describes Symantec's logging and metrics architecture using Kafka, Elasticsearch, and InfluxDB. It addresses the issue of ingestion spikes overwhelming InfluxDB and presents a solution to normalize event rates using buffers that allocate ingestion quotas per tenant. The design implements rate limiting using a scheduled task pattern in Storm to track each tenant's event rate over a configurable window and throttle events if the threshold is exceeded.

Netflix Keystone Pipeline at Big Data Bootcamp, Santa Clara, Nov 2015

Monal Daxini

Keystone - Processing over Half a Trillion events per day with 8 million events & 17 GB per second peaks, and at-least once processing semantics. We will explore in detail how we employ Kafka, Samza, and Docker at scale to implement a multi-tenant pipeline. We will also look at the evolution to its current state and where the pipeline is headed next in offering a self-service stream processing infrastructure atop the Kafka based pipeline and support Spark Streaming.

Azure Event Hubs - Behind the Scenes With Kasun Indrasiri | Current 2022

HostedbyConfluent

Azure Event Hubs - Behind the Scenes With Kasun Indrasiri | Current 2022 Azure Event Hubs is a hyperscale PaaS event stream broker with protocol support for HTTP, AMQP, and Apache Kafka RPC that accepts and forwards several trillion (!) events per day and is available in all global Azure regions. This session is a look behind the curtain where we dive deep into the architecture of Event Hubs and look at the Event Hubs cluster model, resource isolation, and storage strategies and also review some performance figures.

DNS Survival Guide

APNIC

The document provides an overview of DNS history and requirements for maintaining a DNS infrastructure. It discusses how DNS has evolved since 1983 to support features like load balancing, geobalancing, failover, and security protocols. When choosing a DNS software product or service provider, key considerations include scalability, supported features, dynamic configuration, failover capabilities, and protection against DDoS attacks. Maintaining DNS with multiple service providers can improve performance and reliability compared to a single provider.

DNS Survival Guide.

Qrator Labs

A contemporary network service heavily depends on domain name system operating normally. Yet, often issues and caveats of typical DNS setup are being overlooked. DNS (like BGP before) is expected to "just work" everywhere, however, just as BGP, this is a complex protocol and a complex solution where a lot of things could go wrong in multiple ways under different circumstances. This talk is supposed to provide some assistance both in maintaining your own DNS infrastructure and in relying on service providers doing this.

Battle Tested Event-Driven Patterns for your Microservices Architecture - Ris...

Natan Silnitsky

During the past couple of years I’ve implemented or have witnessed implementations of several key patterns of event-driven messaging designs on top of Kafka that have facilitated creating a robust distributed microservices system at Wix that can easily handle increasing traffic and storage needs with many different use-cases. In this talk I will share these patterns with you, including: * Consume and Project (data decoupling) * End-to-end Events (Kafka+websockets) * In memory KV stores (consume and query with 0-latency) * Events transactions (Exactly Once Delivery)

Battle Tested Event-Driven Patterns for your Microservices Architecture

Natan Silnitsky

Experience with Kafka & Storm

Otto Mok

This document discusses AcuityAds' use of Apache Kafka and Storm for processing over 10 billion daily ad impressions. It describes their architecture with Kafka used to ingest bid request data from multiple sources into partitions. Storm topologies read from Kafka and processed the data to calculate metrics like daily impressions by site. Initial issues included unbalanced Kafka partitions and low Storm uptime due to exceptions. Future improvements involved upgrading versions and adding monitoring capabilities.

AWS re:Invent 2016: NextGen Networking: New Capabilities for Amazon’s Virtual...

Amazon Web Services

Amazon’s Virtual Private Cloud (Amazon VPC) lets you provision a logically isolated section of the Amazon Web Services (AWS) cloud and gives you complete control over your virtual networking environment. Amazon VPC continues to evolve with new capabilities and enhancements. These features give you increasingly greater isolation, control, and visibility at the all-important networking layer. In this session, we review some of the latest changes, discuss their value, and describe their use cases.

Scaling Kubernetes to Support 50000 Services.pptx

thaond2

Scaling Kubernetes to Support 50,000 Services The challenges of scaling Kubernetes include high API server load from managing a large number of services, pods and endpoints. Solutions tested include batch processing requests to reduce QPS, and restructuring iptables rules into a search tree for faster routing. IPVS was also tested and showed significantly better performance than iptables for large scale deployments, with constant latency for adding rules and higher network bandwidth. With these techniques, Kubernetes has been scaled to support over 50,000 services.

Sharing is Caring: Toward Creating Self-tuning Multi-tenant Kafka (Anna Povzn...

HostedbyConfluent

Deploying Kafka to support multiple teams or even an entire company has many benefits. It reduces operational costs, simplifies onboarding of new applications as your adoption grows, and consolidates all your data in one place. However, this makes applications sharing the cluster vulnerable to any one or few of them taking all cluster resources. The combined cluster load also becomes less predictable, increasing the risk of overloading the cluster and data unavailability. In this talk, we will describe how to use quota framework in Apache Kafka to ensure that a misconfigured client or unexpected increase in client load does not monopolize broker resources. You will get a deeper understanding of bandwidth and request quotas, how they get enforced, and gain intuition for setting the limits for your use-cases. While quotas limit individual applications, there must be enough cluster capacity to support the combined application load. Onboarding new applications or scaling the usage of existing applications may require manual quota adjustments and upfront capacity planning to ensure high availability. We will describe the steps we took toward solving this problem in Confluent Cloud, where we must immediately support unpredictable load with high availability. We implemented a custom broker quota plugin (KIP-257) to replace static per broker quota allocation with dynamic and self-tuning quotas based on the available capacity (which we also detect dynamically). By learning our journey, you will have more insights into the relevant problems and techniques to address them.

PLNOG 9: Robert Dąbrowski - Carrier-grade NAT (CGN) Solution with FortiGate

PROIDEA

Summit 16: Achieving Low Latency Network Function with Opnfv

OPNFV

It's challenging to have low-latency VNFs in virtualization and cloud environment. OPNFV KVM4NFV project, together with other OPNFV projects like OVSNFV, helps to achieve low latency network functionality. This session will firstly introduce KVM4NFV project. Then some DPDK workload will be used to show how the KVM4NFV project helps reducing the packet latency and compare the result with and without OPNFV environment. In the end, experience will be shared on how to setup the OPNFV environment correctly, and how to tune the OPNFV environment to meet the latency and performance requirement.

Integrating OpenStack To Existing Infrastructure

Hui Cheng

This document discusses integrating OpenStack into Sina's existing infrastructure. It describes Sina's business, infrastructure, and challenges faced in integrating OpenStack. Key integration challenges discussed include network deployment, security considerations, load balancing, and evaluating Swift for object storage. The document also outlines Sina's contributions to OpenStack around billing and monitoring integration.

(BDT318) How Netflix Handles Up To 8 Million Events Per Second

Amazon Web Services

In this session, Netflix provides an overview of Keystone, their new data pipeline. The session covers how Netflix migrated from Suro to Keystone, including the reasons behind the transition and the challenges of zero loss while processing over 400 billion events daily. The session covers in detail how they deploy, operate, and scale Kafka, Samza, Docker, and Apache Mesos in AWS to manage 8 million events & 17 GB per second during peak.

FreeSWITCH as a Microservice

Evan McGee

This document discusses microservices architecture compared to a monolithic architecture. A microservices architecture breaks an application into smaller, independent services that each perform discrete functions. This allows for more rapid development and improved scalability. However, a microservices architecture is also more complex to deploy and manage. The document provides an example of how a VoIP application could use a microservices approach by breaking components like billing, fraud detection, and call analytics into separate services. It also discusses using Docker containers and services to deploy and scale the microservices architecture.

Practice of large Hadoop cluster in China Mobile

DataWorks Summit

China Mobile Limited is the leading telecommunications services provider in China, with more than 800 million active users. In China Mobile, distributed big data clusters are built by branch companies in each province for their unique requirements. Meanwhile, we have built a centralized Hadoop cluster with scale more than 1600 nodes, on which we collect data from dozens of distributed clusters and make analysis for our business. In this session, we will introduce the architecture of the centralized Hadoop cluster and experience of constructing and tuning this large scale Hadoop cluster. Key points are as follows: 1. About Ambari: we improve Ambari with features like supporting HDFS Federation and Ambari HA , improving its performance and enabling it to support up to 1600 nodes. 2. About HDFS: we build a large HDFS cluster with data up to 60PB, using federation, ViewFS, FairCallQueue. Our best practice of cluster operation and management will also be included. 3. About Flume: We use the reformed Flume to collect data as much as 200TB per day. Speakers Yuxuan Pan, Software Engineer, China Mobile Software Technology Duan Yunfeng, Chief Designer of China Mobile's big data system, China Mobile Communications Corporation

Docker Networking in Production at Visa - Sasi Kannappan, Visa and Mark Churc...

Docker, Inc.

Docker has developed a new way of delivering applications, and with that, containers have also changed some aspects of how we approach networking. Visa will detail how they use Docker networking to connect applications in a dynamic environment by using Swarm overlays, service discovery, and load balancing. By switching to overlay networking they will show that they were able to reduce complexity and increase performance. By the end of the talk, you'll learn about the different Docker networking drivers and how you can use Docker networking to architect dynamic and resilient networks.

Apache Kafka - Event Sourcing, Monitoring, Librdkafka, Scaling & Partitioning

Guido Schmutz

Apache Kafka is a distributed streaming platform. It provides a high-throughput distributed messaging system with publish-subscribe capabilities. The document discusses Kafka producers and consumers, Kafka clients in different programming languages, and important configuration settings for Kafka brokers and topics. It also demonstrates sending messages to Kafka topics from a Java producer and consuming messages from the console consumer.

Electric vehicle and photovoltaic advanced roles in enhancing the financial p...

IJECEIAES

Climate change's impact on the planet forced the United Nations and governments to promote green energies and electric transportation. The deployments of photovoltaic (PV) and electric vehicle (EV) systems gained stronger momentum due to their numerous advantages over fossil fuel types. The advantages go beyond sustainability to reach financial support and stability. The work in this paper introduces the hybrid system between PV and EV to support industrial and commercial plants. This paper covers the theoretical framework of the proposed hybrid system including the required equation to complete the cost analysis when PV and EV are present. In addition, the proposed design diagram which sets the priorities and requirements of the system is presented. The proposed approach allows setup to advance their power stability, especially during power outages. The presented information supports researchers and plant owners to complete the necessary analysis while promoting the deployment of clean energy. The result of a case study that represents a dairy milk farmer supports the theoretical works and highlights its advanced benefits to existing plants. The short return on investment of the proposed approach supports the paper's novelty approach for the sustainable electrical system. In addition, the proposed system allows for an isolated power setup without the need for a transmission line which enhances the safety of the electrical network

132/33KV substation case study Presentation

kandramariana6

Similar to Resilient Kafka: How DNS Traffic Management and Client Wrappers Ensure Availability

Kafka practical experience

Rico Chen

In Flux Limiting for a multi-tenant logging service

DataWorks Summit/Hadoop Summit

Netflix Keystone Pipeline at Big Data Bootcamp, Santa Clara, Nov 2015

Monal Daxini

Azure Event Hubs - Behind the Scenes With Kasun Indrasiri | Current 2022

HostedbyConfluent

DNS Survival Guide

APNIC

DNS Survival Guide.

Qrator Labs

Battle Tested Event-Driven Patterns for your Microservices Architecture - Ris...

Natan Silnitsky

Battle Tested Event-Driven Patterns for your Microservices Architecture

Natan Silnitsky

Experience with Kafka & Storm

Otto Mok

AWS re:Invent 2016: NextGen Networking: New Capabilities for Amazon’s Virtual...

Amazon Web Services

Scaling Kubernetes to Support 50000 Services.pptx

thaond2

Sharing is Caring: Toward Creating Self-tuning Multi-tenant Kafka (Anna Povzn...

HostedbyConfluent

PLNOG 9: Robert Dąbrowski - Carrier-grade NAT (CGN) Solution with FortiGate

PROIDEA

Summit 16: Achieving Low Latency Network Function with Opnfv

OPNFV

Integrating OpenStack To Existing Infrastructure

Hui Cheng

(BDT318) How Netflix Handles Up To 8 Million Events Per Second

Amazon Web Services

FreeSWITCH as a Microservice

Evan McGee

Practice of large Hadoop cluster in China Mobile

DataWorks Summit

Docker Networking in Production at Visa - Sasi Kannappan, Visa and Mark Churc...

Docker, Inc.

Apache Kafka - Event Sourcing, Monitoring, Librdkafka, Scaling & Partitioning

Guido Schmutz

Similar to Resilient Kafka: How DNS Traffic Management and Client Wrappers Ensure Availability (20)

Kafka practical experience

In Flux Limiting for a multi-tenant logging service

Netflix Keystone Pipeline at Big Data Bootcamp, Santa Clara, Nov 2015

Azure Event Hubs - Behind the Scenes With Kasun Indrasiri | Current 2022

DNS Survival Guide

DNS Survival Guide.

Battle Tested Event-Driven Patterns for your Microservices Architecture - Ris...

Battle Tested Event-Driven Patterns for your Microservices Architecture

Experience with Kafka & Storm

AWS re:Invent 2016: NextGen Networking: New Capabilities for Amazon’s Virtual...

Scaling Kubernetes to Support 50000 Services.pptx

Sharing is Caring: Toward Creating Self-tuning Multi-tenant Kafka (Anna Povzn...

PLNOG 9: Robert Dąbrowski - Carrier-grade NAT (CGN) Solution with FortiGate

Summit 16: Achieving Low Latency Network Function with Opnfv

Integrating OpenStack To Existing Infrastructure

(BDT318) How Netflix Handles Up To 8 Million Events Per Second

FreeSWITCH as a Microservice

Practice of large Hadoop cluster in China Mobile

Docker Networking in Production at Visa - Sasi Kannappan, Visa and Mark Churc...

Apache Kafka - Event Sourcing, Monitoring, Librdkafka, Scaling & Partitioning

Recently uploaded

Electric vehicle and photovoltaic advanced roles in enhancing the financial p...

IJECEIAES

132/33KV substation case study Presentation

kandramariana6

spirit beverages ppt without graphics.pptx

Madan Karki

BPV-GUI-01-Guide-for-ASME-Review-Teams-(General)-10-10-2023.pdf

MIGUELANGEL966976

2008 BUILDING CONSTRUCTION Illustrated - Ching Chapter 02 The Building.pdf

Yasser Mahgoub

Comparative analysis between traditional aquaponics and reconstructed aquapon...

bijceesjournal

The aquaponic system of planting is a method that does not require soil usage. It is a method that only needs water, fish, lava rocks (a substitute for soil), and plants. Aquaponic systems are sustainable and environmentally friendly. Its use not only helps to plant in small spaces but also helps reduce artificial chemical use and minimizes excess water use, as aquaponics consumes 90% less water than soil-based gardening. The study applied a descriptive and experimental design to assess and compare conventional and reconstructed aquaponic methods for reproducing tomatoes. The researchers created an observation checklist to determine the significant factors of the study. The study aims to determine the significant difference between traditional aquaponics and reconstructed aquaponics systems propagating tomatoes in terms of height, weight, girth, and number of fruits. The reconstructed aquaponics system’s higher growth yield results in a much more nourished crop than the traditional aquaponics system. It is superior in its number of fruits, height, weight, and girth measurement. Moreover, the reconstructed aquaponics system is proven to eliminate all the hindrances present in the traditional aquaponics system, which are overcrowding of fish, algae growth, pest problems, contaminated water, and dead fish.

ACEP Magazine edition 4th launched on 05.06.2024

Rahul

This document provides information about the third edition of the magazine "Sthapatya" published by the Association of Civil Engineers (Practicing) Aurangabad. It includes messages from current and past presidents of ACEP, memories and photos from past ACEP events, information on life time achievement awards given by ACEP, and a technical article on concrete maintenance, repairs and strengthening. The document highlights activities of ACEP and provides a technical educational article for members.

International Conference on NLP, Artificial Intelligence, Machine Learning an...

gerogepatton

International Conference on NLP, Artificial Intelligence, Machine Learning and Applications (NLAIM 2024) offers a premier global platform for exchanging insights and findings in the theory, methodology, and applications of NLP, Artificial Intelligence, Machine Learning, and their applications. The conference seeks substantial contributions across all key domains of NLP, Artificial Intelligence, Machine Learning, and their practical applications, aiming to foster both theoretical advancements and real-world implementations. With a focus on facilitating collaboration between researchers and practitioners from academia and industry, the conference serves as a nexus for sharing the latest developments in the field.

Introduction to AI Safety (public presentation).pptx

MiscAnnoy1

CompEx~Manual~1210 (2).pdf COMPEX GAS AND VAPOURS

RamonNovais6

22CYT12-Unit-V-E Waste and its Management.ppt

KrishnaveniKrishnara1

Introduction- e - waste – definition - sources of e-waste– hazardous substances in e-waste - effects of e-waste on environment and human health- need for e-waste management– e-waste handling rules - waste minimization techniques for managing e-waste – recycling of e-waste - disposal treatment methods of e- waste – mechanism of extraction of precious metal from leaching solution-global Scenario of E-waste – E-waste in India- case studies.

Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024

Sinan KOZAK

Sinan from the Delivery Hero mobile infrastructure engineering team shares a deep dive into performance acceleration with Gradle build cache optimizations. Sinan shares their journey into solving complex build-cache problems that affect Gradle builds. By understanding the challenges and solutions found in our journey, we aim to demonstrate the possibilities for faster builds. The case study reveals how overlapping outputs and cache misconfigurations led to significant increases in build times, especially as the project scaled up with numerous modules using Paparazzi tests. The journey from diagnosing to defeating cache issues offers invaluable lessons on maintaining cache integrity without sacrificing functionality.

Manufacturing Process of molasses based distillery ppt.pptx

Madan Karki

Material for memory and display system h

gowrishankartb2005

Harnessing WebAssembly for Real-time Stateless Streaming Pipelines

Christina Lin

Traditionally, dealing with real-time data pipelines has involved significant overhead, even for straightforward tasks like data transformation or masking. However, in this talk, we’ll venture into the dynamic realm of WebAssembly (WASM) and discover how it can revolutionize the creation of stateless streaming pipelines within a Kafka (Redpanda) broker. These pipelines are adept at managing low-latency, high-data-volume scenarios.

Properties Railway Sleepers and Test.pptx

MDSABBIROJJAMANPAYEL

Computational Engineering IITH Presentation

co23btech11018

Embedded machine learning-based road conditions and driving behavior monitoring

IJECEIAES

Car accident rates have increased in recent years, resulting in losses in human lives, properties, and other financial costs. An embedded machine learning-based system is developed to address this critical issue. The system can monitor road conditions, detect driving patterns, and identify aggressive driving behaviors. The system is based on neural networks trained on a comprehensive dataset of driving events, driving styles, and road conditions. The system effectively detects potential risks and helps mitigate the frequency and impact of accidents. The primary goal is to ensure the safety of drivers and vehicles. Collecting data involved gathering information on three key road events: normal street and normal drive, speed bumps, circular yellow speed bumps, and three aggressive driving actions: sudden start, sudden stop, and sudden entry. The gathered data is processed and analyzed using a machine learning system designed for limited power and memory devices. The developed system resulted in 91.9% accuracy, 93.6% precision, and 92% recall. The achieved inference time on an Arduino Nano 33 BLE Sense with a 32-bit CPU running at 64 MHz is 34 ms and requires 2.6 kB peak RAM and 139.9 kB program flash memory, making it suitable for resource-constrained embedded systems.

Casting-Defect-inSlab continuous casting.pdf

zubairahmad848137

Understanding Inductive Bias in Machine Learning

SUTEJAS

This presentation explores the concept of inductive bias in machine learning. It explains how algorithms come with built-in assumptions and preferences that guide the learning process. You'll learn about the different types of inductive bias and how they can impact the performance and generalizability of machine learning models. The presentation also covers the positive and negative aspects of inductive bias, along with strategies for mitigating potential drawbacks. We'll explore examples of how bias manifests in algorithms like neural networks and decision trees. By understanding inductive bias, you can gain valuable insights into how machine learning models work and make informed decisions when building and deploying them.

Recently uploaded (20)

Electric vehicle and photovoltaic advanced roles in enhancing the financial p...

132/33KV substation case study Presentation

spirit beverages ppt without graphics.pptx

BPV-GUI-01-Guide-for-ASME-Review-Teams-(General)-10-10-2023.pdf

2008 BUILDING CONSTRUCTION Illustrated - Ching Chapter 02 The Building.pdf

Comparative analysis between traditional aquaponics and reconstructed aquapon...

ACEP Magazine edition 4th launched on 05.06.2024

International Conference on NLP, Artificial Intelligence, Machine Learning an...

Introduction to AI Safety (public presentation).pptx

CompEx~Manual~1210 (2).pdf COMPEX GAS AND VAPOURS

22CYT12-Unit-V-E Waste and its Management.ppt

Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024

Manufacturing Process of molasses based distillery ppt.pptx

Material for memory and display system h

Harnessing WebAssembly for Real-time Stateless Streaming Pipelines

Properties Railway Sleepers and Test.pptx

Computational Engineering IITH Presentation

Embedded machine learning-based road conditions and driving behavior monitoring

Casting-Defect-inSlab continuous casting.pdf

Understanding Inductive Bias in Machine Learning

Resilient Kafka: How DNS Traffic Management and Client Wrappers Ensure Availability

1. Vanessa Vuibert Sta ff Production Engineer Resilient Ka f ka: How DNS Tra ff ic Management and Client Wrappers Ensure Availability @V3_XD

2. 862 14 Scale Ka f ka brokers Ka f ka clusters 14M 9 Messages per sec GCP Regions @V3_XD

3. • Maintenance • Incidents • Regionalize tra ff ic Tra ff ic management use cases

4. Kubernetes (K8s) out of the box 🔓open source Kafka broker

5. K8s out of the box dig +short service.namespace.svc.cluster.local IP0 IP1 IP2

6. K8s out of the box bootstrap.servers= service.namespace.svc.cluster.local:9092

7. K8s out of the box dig +short pod2.service.namespace.svc.cluster.local IP2

8. K8s out of the box advertised.listeners= pod2.service.namespace.svc.cluster.local:9092

9. • Readiness • Startup • Liveness K8s StatefulSet: probes

10. dig +short service.namespace.svc.cluster.local IP0 IP2 K8s readiness probe

11. dig +short service.namespace.svc.cluster.local IP0 IP1 IP2 K8s readiness probe not ready publishNotReadyAddresses: true

12. Regional pairs

13. External tra ff ic: load balancers

14. External tra ff ic: load balancers bootstrap.servers

15. External tra ff ic: load balancers advertised.listeners

16. • Issues scaling • Manual broker DNS records • Limited tra ff ic control

17. Built automation with k8s controllers.

18. Stateful buddy: load balancers 🔒closed source

19. Name buddy: DNS records 🔒closed source

20. Ka f ka access buddy: endpoints 🔒closed source

21. Ka f ka Access Buddy: consumer

22. Ka f ka Access Buddy: producer failover east

23. - Elasticsearch on call “Let me failover real quick.”

24. Faster failovers with a DNS tra ff ic manager.

25. DNS tra ff ic manager 🔒closed source

26. DNS tra ff ic manager: normal dig +short us-east1.somedomain.com US-East1-IP

27. DNS tra ff ic manager: failover dig +short us-east1.somedomain.com US-Central1-IP

28. - A Ka f ka client “DNS trickery.”

29. used to take 40 Minutes now only takes 1 Minutes Failover time savings @V3_XD

30. Incident during fl ashsale

31. Failover during fl ashsale US Central1 -> US East1

32. Reduced toil with client wrappers.

33. • Failover reconnection • Everything needed for connection • Ruby, go and python Client wrappers

34. K8s Deployment template: bootstrap.servers

35. K8s Deployment template: client ID

36. K8s Deployment template

37. Improved availability with local consumers.

38. • More availability • Reduced latency • Reduced storage costs • Reduced network costs Local consumers

39. Aggregate consumer

40. Local consumers

41. Local consumers: DNS records

42. Aggregate 500 ms Regional 20 ms Latency 99th @V3_XD

43. Connect directly through private IPs.

44. • More secure • Reduced network costs • Fetch from closest replica: KIP - 392 Public to private tra ff ic

45. Tra ff ic manager: pod IPs

46. Reduction -6% bill Network represents 29% bill Network cost reduction @V3_XD

47. • GKE 1.24 -> 1.25 incident • Apply f irewall rules • LB more secure for public tra ff ic

48. Failover: pod IPs

49. Single stop shop with Multi- Cluster Services (MCS).

50. MCS endpoints 🔒closed source

51. Tra ff ic sources

52. Regional pairs: uneven distribution

53. Regionalize tra ff ic: Ka f ka access buddy east

54. Regionalize tra ff ic: MCS

55. 40 18 MCS time savings Minutes to regionalize tra ff ic Minutes to deploy 1 13 Minutes after migration Minutes after migration @V3_XD

56.

57. • Resiliency: DNS tra ff ic management • Toil: client wrappers • Availability: local consumption

58. Thanks! @V3_XD

Resilient Kafka: How DNS Traffic Management and Client Wrappers Ensure Availability

Recommended

Recommended

More Related Content

Similar to Resilient Kafka: How DNS Traffic Management and Client Wrappers Ensure Availability

Similar to Resilient Kafka: How DNS Traffic Management and Client Wrappers Ensure Availability (20)

Recently uploaded

Recently uploaded (20)

Resilient Kafka: How DNS Traffic Management and Client Wrappers Ensure Availability