SlideShare a Scribd company logo
1 of 77
1
Top Ten Kafka Configs
Important Configurations for Optimum Kafka Performance
and Robustness
2
Brief Introduction
• Worked at Confluent (Streams Team) 2 years
• Apache Kafka Committer
• Author Kafka Streams in Action
3
Special Thanks
• Dustin Cote
• Justin Manchester
• Koelli Mungee
• Ryan Prigeon
4
Agenda
• Quick Intro to Kafka
• Ground Rules
• Broker Configs
• Client Configs
• Consumer
• Producer
5
Intro to Kafka
Broker 1
Broker 2
Broker 3
6
Intro to Kafka
Broker 1
Broker 2
Broker 3
Topic
7
Intro to Kafka
Topic
0 1 2 3
Next record
8
Intro to Kafka
0 1 2 3
Producer
9
Intro to Kafka
0 1 2 3
Producer
Consumer
10
Intro to Kafka
0 1 2 3
Producer
Consumer
Consumer reads available records
then commits the offsets
11
Configuration Ground Rules
• Kafka is the central nervous system of your Event based platform
• Proper configuration is important
12
Configuration Ground Rules
Not All Configurations need to be tuned!
13
Configuration Ground Rules
• Make sure you understand the behavior and what you’re trying to
achieve before changing configs
• Focus on what’s essential for your needs
14
Broker Configs
Producer
Broker
Consumer
15
Broker Configs
• JMX metrics
• UncleanLeaderElection
• Retention (Topic and Broker)
• Min InSync Replicas (discussed in Producer section)
16
JMX Metrics
• JMX metrics not exposed remotely by default
• No insight into broker activity without them
17
JMX Metrics
• Set the environment variable JMX_PORT to enable
remote JMX metrics
18
JMX Metrics
• With environment variable JMX_PORT set Kafka
uses these default properties for JMX
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
19
JMX Metrics
• To override/customize the JMX settings, i.e.
provide authentication set the KAFKA_JMX_OPTS
env variable
20
JMX Metrics Viewing JConsole
https://docs.oracle.com/javase/8/docs/technotes/guid
es/management/jconsole.html
21
JMX Metrics Connecting
ssh -fN -D 7777 -i ~/.ssh/<key name> <instance-public-ip>
jconsole -J-DsocksProxyHost=localhost 
-J-DsocksProxyPort=7777 
-J-DsocksNonProxyHosts=
service:jmx:rmi:///jndi/rmi://localhost:<JMX_PORT>/jmxrmi
22
JMX Metrics BrokerTopicMetrics
• MessagesInPerSec
• BytesInPerSec
• BytesOutPerSec
23
JMX Metrics RequestMetrics
• Requests per second
• Produce - requests from producer to send records
• FetchConsumer – requests from consumer to retrieve
records
• FetchFollower – requests from follower broker to keep in
sync with leader for given topic-partition
24
JMX Metrics RequestChannel
• ReqeustQueueSize
Special thanks to Dustin Cote for the Broker Load metrics
25
UncleanLeaderElection
Leader Broker Follower Broker
Leader has records up to offset
300
Follower is only up to 150
26
UncleanLeaderElection
Leader Broker Follower Broker
Leader has records up to offset
300
Follower is only up to 150
UncleanLeaderElection
Allow Follower to become leader
• Almost immediately available
• Potential for missing records
UncleanLeaderElection
Wait to bring back old leader broker
• Not highly available
• Downtime until old leader recovered
• No potential for missing records
UncleanLeaderElection
• Default setting is false
• Use with caution
30
Retention
• Size
• Age of records
• now – largest timestamp > retention time
31
Timestamps - CreateTime
Producer sets timestamp
Producer
Broker
Topic
32
Timestamps -LogAppendTime
Producer sets timestamp
Producer
Broker
Topic
33
Retention
Topic A retention 1 week Topic B retention 2
days
Kafka Streams
Application
34
Consumer Configs
Producer
Broker
Consumer
35
Consumer Configurations
• Max Poll Interval
• Committing
36
Max Poll Interval
max.poll.interval.ms
• max time between poll calls
• If exceeded then consumer kicked out of group, rebalancing
while (true) {
ConsumerRecords<String, String> records =
consumer.poll(Duration.ofSeconds(5));
for (ConsumerRecord<String, String> record : records) {
//do something with recrods
}
}
37
Max Poll Interval
max.poll.interval.ms = 30000/30 seconds
while (true) {
ConsumerRecords<String, String> records =
consumer.poll(Duration.ofSeconds(5));
for (ConsumerRecord<String, String> record : records) {
//This loop must complete in under 30 seconds
}
}
38
Max Poll Interval
Processing time for fetched records on consumer takes 45 seconds
while (true) {
ConsumerRecords<String, String> records =
consumer.poll(Duration.ofSeconds(5));
for (ConsumerRecord<String, String> record : records) {
//Processing in this loop takes 45 seconds this
consumer kicked out of group, and a rebalance is triggered
}
}
39
Max Poll Interval
max.poll.interval.ms solutions -
• Increase the poll interval time – maybe
• Possibly decrease max.poll.records
while (true) {
ConsumerRecords<String, String> records =
consumer.poll(Duration.ofSeconds(5));
for (ConsumerRecord<String, String> record : records) {
//This loop must complete in under 30 seconds
}
}
40
Max Poll Interval
max.poll.interval.ms solutions -
• Decrease processing time
• Take processing out of loop
while (true) {
ConsumerRecords<String, String> records =
consumer.poll(Duration.ofSeconds(5));
for (ConsumerRecord<String, String> record : records) {
//This loop must complete in under 30 seconds
}
}
41
Committing
Partition A
Consumer
By default auto commit
enabled every 5 seconds
42
Committing
Partition A
Consumer
Only commit last record
processed
43
Committing
1
2
3
4
5
6
7
8
9
10
6 last processed
offset
10 Records in batch
44
Committing
1
2
3
4
5
6
7
8
9
10
Committing offset 11
means 7, 8, and 9
committed as well!
45
Producer Configs
Producer
Broker
Consumer
46
Producer Configs
• Linger
• Acks
• Retries and Delivery Timeouts
• Keeping Records in Order
47
Linger
Producer
Record
Producer Record Buffer
48
Linger – Normal Traffic
Producer Record Buffer
49
Linger – Lighter Traffic
Producer Record Buffer
50
Linger Trade Offs
• Wait for more records
• Waiting to send a batch
• Decreased number of requests to broker
51
Linger Trade Offs
• Set linger.ms to zero
• Send batches faster
• More requests to broker
52
Acks
• Number of acknowledgements from broker that it has
persisted the message
• Zero
• One
• All
53
Acks Zero
Producer
“Fire” and forget don’t
wait for any response
Broker (Leader)
Broker
(Follower)
Broker
(Follower)
54
Acks One
Producer
Produce records and wait for
leader broker to
acknowledge
Broker (Leader)
Broker
(Follower)
Broker
(Follower)
Got it!
55
Acks All
Producer
Produce waits for leader
broker to acknowledge after
all followers have
acknowledged
Broker (Leader)
Broker
(Follower)
Broker
(Follower)
Got it!
56
Acks All
Producer
Produce waits for leader
broker to acknowledge after
all followers have
acknowledged
Broker (Leader)
Broker
(Follower)
Broker
(Follower)
Got it!
Got it!
57
InSync Replicas
• acks = “all”
• Leader broker is considered a replica!
58
InSync Replicas
Producer
acks = “all”
min.insync.replicas = 1
Broker (Leader)
Broker
(Follower)
Broker
(Follower)
Got it!
59
InSync Replicas
Producer
acks = “all”
min.insync.replicas = 1
possible data loss
Broker (Leader)
Broker
(Follower)
Broker
(Follower)
Got it!
60
InSync Replicas
Producer
acks = “all”
min.insync.replicas = 2
no data loss
Broker (Leader)
Broker
(Follower)
Broker
(Follower)
Got it!
61
InSync Replicas
Producer
acks = “all”
min.insync.replicas = 2
no data loss
Broker (Leader)
Broker
(Follower)
Broker
(Follower)
Got it!
Got it!
62
InSync Replicas
Producer
acks = “all”
min.insync.replicas = 2
no data loss
Broker (Leader)
Broker
(Follower)
Broker
(Follower)
Got it!
63
Retries
Topic A Partition 0
Producer
Retriable
Exception
64
Retries
Topic A Partition 0
Producer
Retriable
Exception
0.. Max Retries
65
Retries
Topic A Partition 0
Producer
Retriable
Exception
0.. Max Retries or
66
Retries
Topic A Partition 0
Producer
Retriable
Exception
Use delivery.timeout.ms for limit of time
from sending to receiving
acknowledgement see KIP-91 for details
67
Keeping Records in Order
Topic A Partition 0
Producer
Retriable
Exception
Batch 1
68
Keeping Records in Order
Topic A Partition 0
Producer
Retriable
Exception
Batch 1
Batch 2
69
Keeping Records in Order
Topic A Partition 0
Producer
Retriable
Exception
Batch 1
Batch 2
Batch 1
70
Keeping Records in Order
Topic A Partition 0
Producer
Retriable
Exception
Batch 1
Batch 2
Batch 1
Batch 2 processed before Batch 1 !
71
Keeping Records in Order
Topic A Partition 0
Producer
Retriable
Exception
Batch 1
Batch 2
Batch 1
max.in.flight.requests.per.connection = 1
72
Keeping Records in Order
Topic A Partition 0
Producer
Retriable
Exception
Batch 1
Batch 1
max.in.flight.requests.per.connection = 1
Batch 2
73
Summary
• Configuration is important to the health of a Kafka
Cluster/
• Need to know which knobs to turn
• Measure the before and after
• Try it in development first
74
Summary
• Kafka The Definitive Guide -
http://shop.oreilly.com/product/0636920044123.do
• Apache Kafka docs -
https://kafka.apache.org/documentation/
NOMINATE YOURSELF OR A PEER AT
CONFLUENT.IO/NOMINATE
KS19Meetup.
CONFLUENT COMMUNITY DISCOUNT CODE
25% OFF*
*Standard Priced Conference pass
77
Thanks!
Stay in Touch!
• https://slackpass.io/confluentcommunity
• https://www.confluent.io/blog/
• Twitter @bbejeck
• We are hiring! https://www.confluent.io/careers/

More Related Content

What's hot

Consistency and Completeness: Rethinking Distributed Stream Processing in Apa...
Consistency and Completeness: Rethinking Distributed Stream Processing in Apa...Consistency and Completeness: Rethinking Distributed Stream Processing in Apa...
Consistency and Completeness: Rethinking Distributed Stream Processing in Apa...Guozhang Wang
 
SFBigAnalytics_20190724: Monitor kafka like a Pro
SFBigAnalytics_20190724: Monitor kafka like a ProSFBigAnalytics_20190724: Monitor kafka like a Pro
SFBigAnalytics_20190724: Monitor kafka like a ProChester Chen
 
Overcoming the Perils of Kafka Secret Sprawl (Tejal Adsul, Confluent) Kafka S...
Overcoming the Perils of Kafka Secret Sprawl (Tejal Adsul, Confluent) Kafka S...Overcoming the Perils of Kafka Secret Sprawl (Tejal Adsul, Confluent) Kafka S...
Overcoming the Perils of Kafka Secret Sprawl (Tejal Adsul, Confluent) Kafka S...confluent
 
Real Time Streaming Data with Kafka and TensorFlow (Yong Tang, MobileIron) Ka...
Real Time Streaming Data with Kafka and TensorFlow (Yong Tang, MobileIron) Ka...Real Time Streaming Data with Kafka and TensorFlow (Yong Tang, MobileIron) Ka...
Real Time Streaming Data with Kafka and TensorFlow (Yong Tang, MobileIron) Ka...confluent
 
KSQL in Practice (Almog Gavra, Confluent) Kafka Summit London 2019
KSQL in Practice (Almog Gavra, Confluent) Kafka Summit London 2019KSQL in Practice (Almog Gavra, Confluent) Kafka Summit London 2019
KSQL in Practice (Almog Gavra, Confluent) Kafka Summit London 2019confluent
 
Achieving a 50% Reduction in Cross-AZ Network Costs from Kafka (Uday Sagar Si...
Achieving a 50% Reduction in Cross-AZ Network Costs from Kafka (Uday Sagar Si...Achieving a 50% Reduction in Cross-AZ Network Costs from Kafka (Uday Sagar Si...
Achieving a 50% Reduction in Cross-AZ Network Costs from Kafka (Uday Sagar Si...confluent
 
Running Kafka On Kubernetes With Strimzi For Real-Time Streaming Applications
Running Kafka On Kubernetes With Strimzi For Real-Time Streaming ApplicationsRunning Kafka On Kubernetes With Strimzi For Real-Time Streaming Applications
Running Kafka On Kubernetes With Strimzi For Real-Time Streaming ApplicationsLightbend
 
Deploying Confluent Platform for Production
Deploying Confluent Platform for ProductionDeploying Confluent Platform for Production
Deploying Confluent Platform for Productionconfluent
 
Actors or Not: Async Event Architectures
Actors or Not: Async Event ArchitecturesActors or Not: Async Event Architectures
Actors or Not: Async Event ArchitecturesYaroslav Tkachenko
 
Flexible Authentication Strategies with SASL/OAUTHBEARER (Michael Kaminski, T...
Flexible Authentication Strategies with SASL/OAUTHBEARER (Michael Kaminski, T...Flexible Authentication Strategies with SASL/OAUTHBEARER (Michael Kaminski, T...
Flexible Authentication Strategies with SASL/OAUTHBEARER (Michael Kaminski, T...confluent
 
Running large scale Kafka upgrades at Yelp (Manpreet Singh,Yelp) Kafka Summit...
Running large scale Kafka upgrades at Yelp (Manpreet Singh,Yelp) Kafka Summit...Running large scale Kafka upgrades at Yelp (Manpreet Singh,Yelp) Kafka Summit...
Running large scale Kafka upgrades at Yelp (Manpreet Singh,Yelp) Kafka Summit...confluent
 
A Tour of Apache Kafka
A Tour of Apache KafkaA Tour of Apache Kafka
A Tour of Apache Kafkaconfluent
 
Securing Kafka At Zendesk (Joy Nag, Zendesk) Kafka Summit 2020
Securing Kafka At Zendesk (Joy Nag, Zendesk) Kafka Summit 2020Securing Kafka At Zendesk (Joy Nag, Zendesk) Kafka Summit 2020
Securing Kafka At Zendesk (Joy Nag, Zendesk) Kafka Summit 2020confluent
 
Infrastructure at Scale: Apache Kafka, Twitter Storm & Elastic Search (ARC303...
Infrastructure at Scale: Apache Kafka, Twitter Storm & Elastic Search (ARC303...Infrastructure at Scale: Apache Kafka, Twitter Storm & Elastic Search (ARC303...
Infrastructure at Scale: Apache Kafka, Twitter Storm & Elastic Search (ARC303...Amazon Web Services
 
War Stories: DIY Kafka
War Stories: DIY KafkaWar Stories: DIY Kafka
War Stories: DIY Kafkaconfluent
 
Exactly-Once Made Easy: Transactional Messaging Improvement for Usability and...
Exactly-Once Made Easy: Transactional Messaging Improvement for Usability and...Exactly-Once Made Easy: Transactional Messaging Improvement for Usability and...
Exactly-Once Made Easy: Transactional Messaging Improvement for Usability and...HostedbyConfluent
 
Getting Started with Confluent Schema Registry
Getting Started with Confluent Schema RegistryGetting Started with Confluent Schema Registry
Getting Started with Confluent Schema Registryconfluent
 
Connect at Twitter-scale | Jordan Bull and Ryanne Dolan, Twitter
Connect at Twitter-scale | Jordan Bull and Ryanne Dolan, TwitterConnect at Twitter-scale | Jordan Bull and Ryanne Dolan, Twitter
Connect at Twitter-scale | Jordan Bull and Ryanne Dolan, TwitterHostedbyConfluent
 
Kafka Summit SF 2017 - Kafka Stream Processing for Everyone with KSQL
Kafka Summit SF 2017 - Kafka Stream Processing for Everyone with KSQLKafka Summit SF 2017 - Kafka Stream Processing for Everyone with KSQL
Kafka Summit SF 2017 - Kafka Stream Processing for Everyone with KSQLconfluent
 
Ingesting Healthcare Data, Micah Whitacre
Ingesting Healthcare Data, Micah WhitacreIngesting Healthcare Data, Micah Whitacre
Ingesting Healthcare Data, Micah Whitacreconfluent
 

What's hot (20)

Consistency and Completeness: Rethinking Distributed Stream Processing in Apa...
Consistency and Completeness: Rethinking Distributed Stream Processing in Apa...Consistency and Completeness: Rethinking Distributed Stream Processing in Apa...
Consistency and Completeness: Rethinking Distributed Stream Processing in Apa...
 
SFBigAnalytics_20190724: Monitor kafka like a Pro
SFBigAnalytics_20190724: Monitor kafka like a ProSFBigAnalytics_20190724: Monitor kafka like a Pro
SFBigAnalytics_20190724: Monitor kafka like a Pro
 
Overcoming the Perils of Kafka Secret Sprawl (Tejal Adsul, Confluent) Kafka S...
Overcoming the Perils of Kafka Secret Sprawl (Tejal Adsul, Confluent) Kafka S...Overcoming the Perils of Kafka Secret Sprawl (Tejal Adsul, Confluent) Kafka S...
Overcoming the Perils of Kafka Secret Sprawl (Tejal Adsul, Confluent) Kafka S...
 
Real Time Streaming Data with Kafka and TensorFlow (Yong Tang, MobileIron) Ka...
Real Time Streaming Data with Kafka and TensorFlow (Yong Tang, MobileIron) Ka...Real Time Streaming Data with Kafka and TensorFlow (Yong Tang, MobileIron) Ka...
Real Time Streaming Data with Kafka and TensorFlow (Yong Tang, MobileIron) Ka...
 
KSQL in Practice (Almog Gavra, Confluent) Kafka Summit London 2019
KSQL in Practice (Almog Gavra, Confluent) Kafka Summit London 2019KSQL in Practice (Almog Gavra, Confluent) Kafka Summit London 2019
KSQL in Practice (Almog Gavra, Confluent) Kafka Summit London 2019
 
Achieving a 50% Reduction in Cross-AZ Network Costs from Kafka (Uday Sagar Si...
Achieving a 50% Reduction in Cross-AZ Network Costs from Kafka (Uday Sagar Si...Achieving a 50% Reduction in Cross-AZ Network Costs from Kafka (Uday Sagar Si...
Achieving a 50% Reduction in Cross-AZ Network Costs from Kafka (Uday Sagar Si...
 
Running Kafka On Kubernetes With Strimzi For Real-Time Streaming Applications
Running Kafka On Kubernetes With Strimzi For Real-Time Streaming ApplicationsRunning Kafka On Kubernetes With Strimzi For Real-Time Streaming Applications
Running Kafka On Kubernetes With Strimzi For Real-Time Streaming Applications
 
Deploying Confluent Platform for Production
Deploying Confluent Platform for ProductionDeploying Confluent Platform for Production
Deploying Confluent Platform for Production
 
Actors or Not: Async Event Architectures
Actors or Not: Async Event ArchitecturesActors or Not: Async Event Architectures
Actors or Not: Async Event Architectures
 
Flexible Authentication Strategies with SASL/OAUTHBEARER (Michael Kaminski, T...
Flexible Authentication Strategies with SASL/OAUTHBEARER (Michael Kaminski, T...Flexible Authentication Strategies with SASL/OAUTHBEARER (Michael Kaminski, T...
Flexible Authentication Strategies with SASL/OAUTHBEARER (Michael Kaminski, T...
 
Running large scale Kafka upgrades at Yelp (Manpreet Singh,Yelp) Kafka Summit...
Running large scale Kafka upgrades at Yelp (Manpreet Singh,Yelp) Kafka Summit...Running large scale Kafka upgrades at Yelp (Manpreet Singh,Yelp) Kafka Summit...
Running large scale Kafka upgrades at Yelp (Manpreet Singh,Yelp) Kafka Summit...
 
A Tour of Apache Kafka
A Tour of Apache KafkaA Tour of Apache Kafka
A Tour of Apache Kafka
 
Securing Kafka At Zendesk (Joy Nag, Zendesk) Kafka Summit 2020
Securing Kafka At Zendesk (Joy Nag, Zendesk) Kafka Summit 2020Securing Kafka At Zendesk (Joy Nag, Zendesk) Kafka Summit 2020
Securing Kafka At Zendesk (Joy Nag, Zendesk) Kafka Summit 2020
 
Infrastructure at Scale: Apache Kafka, Twitter Storm & Elastic Search (ARC303...
Infrastructure at Scale: Apache Kafka, Twitter Storm & Elastic Search (ARC303...Infrastructure at Scale: Apache Kafka, Twitter Storm & Elastic Search (ARC303...
Infrastructure at Scale: Apache Kafka, Twitter Storm & Elastic Search (ARC303...
 
War Stories: DIY Kafka
War Stories: DIY KafkaWar Stories: DIY Kafka
War Stories: DIY Kafka
 
Exactly-Once Made Easy: Transactional Messaging Improvement for Usability and...
Exactly-Once Made Easy: Transactional Messaging Improvement for Usability and...Exactly-Once Made Easy: Transactional Messaging Improvement for Usability and...
Exactly-Once Made Easy: Transactional Messaging Improvement for Usability and...
 
Getting Started with Confluent Schema Registry
Getting Started with Confluent Schema RegistryGetting Started with Confluent Schema Registry
Getting Started with Confluent Schema Registry
 
Connect at Twitter-scale | Jordan Bull and Ryanne Dolan, Twitter
Connect at Twitter-scale | Jordan Bull and Ryanne Dolan, TwitterConnect at Twitter-scale | Jordan Bull and Ryanne Dolan, Twitter
Connect at Twitter-scale | Jordan Bull and Ryanne Dolan, Twitter
 
Kafka Summit SF 2017 - Kafka Stream Processing for Everyone with KSQL
Kafka Summit SF 2017 - Kafka Stream Processing for Everyone with KSQLKafka Summit SF 2017 - Kafka Stream Processing for Everyone with KSQL
Kafka Summit SF 2017 - Kafka Stream Processing for Everyone with KSQL
 
Ingesting Healthcare Data, Micah Whitacre
Ingesting Healthcare Data, Micah WhitacreIngesting Healthcare Data, Micah Whitacre
Ingesting Healthcare Data, Micah Whitacre
 

Similar to Top Ten Kafka Configs for Optimum Performance

Cruise Control: Effortless management of Kafka clusters
Cruise Control: Effortless management of Kafka clustersCruise Control: Effortless management of Kafka clusters
Cruise Control: Effortless management of Kafka clustersPrateek Maheshwari
 
Kafka Needs No Keeper
Kafka Needs No KeeperKafka Needs No Keeper
Kafka Needs No KeeperC4Media
 
MySQL Performance for DevOps
MySQL Performance for DevOpsMySQL Performance for DevOps
MySQL Performance for DevOpsSveta Smirnova
 
Cassandra and drivers
Cassandra and driversCassandra and drivers
Cassandra and driversBen Bromhead
 
Monitoring Apache Kafka
Monitoring Apache KafkaMonitoring Apache Kafka
Monitoring Apache Kafkaconfluent
 
Tokyo AK Meetup Speedtest - Share.pdf
Tokyo AK Meetup Speedtest - Share.pdfTokyo AK Meetup Speedtest - Share.pdf
Tokyo AK Meetup Speedtest - Share.pdfssuser2ae721
 
SQL Server Deep Drive
SQL Server Deep Drive SQL Server Deep Drive
SQL Server Deep Drive DataArt
 
Citi TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep DiveCiti TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep Diveconfluent
 
Microservices interaction at scale using Apache Kafka
Microservices interaction at scale using Apache KafkaMicroservices interaction at scale using Apache Kafka
Microservices interaction at scale using Apache KafkaIvan Ursul
 
Streaming architecture patterns
Streaming architecture patternsStreaming architecture patterns
Streaming architecture patternshadooparchbook
 
TDEA 2018 Kafka EOS (Exactly-once)
TDEA 2018 Kafka EOS (Exactly-once)TDEA 2018 Kafka EOS (Exactly-once)
TDEA 2018 Kafka EOS (Exactly-once)Erhwen Kuo
 
Oracle Database Performance Tuning Advanced Features and Best Practices for DBAs
Oracle Database Performance Tuning Advanced Features and Best Practices for DBAsOracle Database Performance Tuning Advanced Features and Best Practices for DBAs
Oracle Database Performance Tuning Advanced Features and Best Practices for DBAsZohar Elkayam
 
Kafka Summit NYC 2017 - Deep Dive Into Apache Kafka
Kafka Summit NYC 2017 - Deep Dive Into Apache KafkaKafka Summit NYC 2017 - Deep Dive Into Apache Kafka
Kafka Summit NYC 2017 - Deep Dive Into Apache Kafkaconfluent
 
When it Absolutely, Positively, Has to be There: Reliability Guarantees in Ka...
When it Absolutely, Positively, Has to be There: Reliability Guarantees in Ka...When it Absolutely, Positively, Has to be There: Reliability Guarantees in Ka...
When it Absolutely, Positively, Has to be There: Reliability Guarantees in Ka...confluent
 
Client Drivers and Cassandra, the Right Way
Client Drivers and Cassandra, the Right WayClient Drivers and Cassandra, the Right Way
Client Drivers and Cassandra, the Right WayDataStax Academy
 
Distributed system coordination by zookeeper and introduction to kazoo python...
Distributed system coordination by zookeeper and introduction to kazoo python...Distributed system coordination by zookeeper and introduction to kazoo python...
Distributed system coordination by zookeeper and introduction to kazoo python...Jimmy Lai
 
Introduction to Apache ZooKeeper | Big Data Hadoop Spark Tutorial | CloudxLab
Introduction to Apache ZooKeeper | Big Data Hadoop Spark Tutorial | CloudxLabIntroduction to Apache ZooKeeper | Big Data Hadoop Spark Tutorial | CloudxLab
Introduction to Apache ZooKeeper | Big Data Hadoop Spark Tutorial | CloudxLabCloudxLab
 
Kafka Needs no Keeper( Jason Gustafson & Colin McCabe, Confluent) Kafka Summi...
Kafka Needs no Keeper( Jason Gustafson & Colin McCabe, Confluent) Kafka Summi...Kafka Needs no Keeper( Jason Gustafson & Colin McCabe, Confluent) Kafka Summi...
Kafka Needs no Keeper( Jason Gustafson & Colin McCabe, Confluent) Kafka Summi...confluent
 
Seek and Destroy Kafka Under Replication
Seek and Destroy Kafka Under ReplicationSeek and Destroy Kafka Under Replication
Seek and Destroy Kafka Under ReplicationHostedbyConfluent
 
Performance Scenario: Diagnosing and resolving sudden slow down on two node RAC
Performance Scenario: Diagnosing and resolving sudden slow down on two node RACPerformance Scenario: Diagnosing and resolving sudden slow down on two node RAC
Performance Scenario: Diagnosing and resolving sudden slow down on two node RACKristofferson A
 

Similar to Top Ten Kafka Configs for Optimum Performance (20)

Cruise Control: Effortless management of Kafka clusters
Cruise Control: Effortless management of Kafka clustersCruise Control: Effortless management of Kafka clusters
Cruise Control: Effortless management of Kafka clusters
 
Kafka Needs No Keeper
Kafka Needs No KeeperKafka Needs No Keeper
Kafka Needs No Keeper
 
MySQL Performance for DevOps
MySQL Performance for DevOpsMySQL Performance for DevOps
MySQL Performance for DevOps
 
Cassandra and drivers
Cassandra and driversCassandra and drivers
Cassandra and drivers
 
Monitoring Apache Kafka
Monitoring Apache KafkaMonitoring Apache Kafka
Monitoring Apache Kafka
 
Tokyo AK Meetup Speedtest - Share.pdf
Tokyo AK Meetup Speedtest - Share.pdfTokyo AK Meetup Speedtest - Share.pdf
Tokyo AK Meetup Speedtest - Share.pdf
 
SQL Server Deep Drive
SQL Server Deep Drive SQL Server Deep Drive
SQL Server Deep Drive
 
Citi TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep DiveCiti TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep Dive
 
Microservices interaction at scale using Apache Kafka
Microservices interaction at scale using Apache KafkaMicroservices interaction at scale using Apache Kafka
Microservices interaction at scale using Apache Kafka
 
Streaming architecture patterns
Streaming architecture patternsStreaming architecture patterns
Streaming architecture patterns
 
TDEA 2018 Kafka EOS (Exactly-once)
TDEA 2018 Kafka EOS (Exactly-once)TDEA 2018 Kafka EOS (Exactly-once)
TDEA 2018 Kafka EOS (Exactly-once)
 
Oracle Database Performance Tuning Advanced Features and Best Practices for DBAs
Oracle Database Performance Tuning Advanced Features and Best Practices for DBAsOracle Database Performance Tuning Advanced Features and Best Practices for DBAs
Oracle Database Performance Tuning Advanced Features and Best Practices for DBAs
 
Kafka Summit NYC 2017 - Deep Dive Into Apache Kafka
Kafka Summit NYC 2017 - Deep Dive Into Apache KafkaKafka Summit NYC 2017 - Deep Dive Into Apache Kafka
Kafka Summit NYC 2017 - Deep Dive Into Apache Kafka
 
When it Absolutely, Positively, Has to be There: Reliability Guarantees in Ka...
When it Absolutely, Positively, Has to be There: Reliability Guarantees in Ka...When it Absolutely, Positively, Has to be There: Reliability Guarantees in Ka...
When it Absolutely, Positively, Has to be There: Reliability Guarantees in Ka...
 
Client Drivers and Cassandra, the Right Way
Client Drivers and Cassandra, the Right WayClient Drivers and Cassandra, the Right Way
Client Drivers and Cassandra, the Right Way
 
Distributed system coordination by zookeeper and introduction to kazoo python...
Distributed system coordination by zookeeper and introduction to kazoo python...Distributed system coordination by zookeeper and introduction to kazoo python...
Distributed system coordination by zookeeper and introduction to kazoo python...
 
Introduction to Apache ZooKeeper | Big Data Hadoop Spark Tutorial | CloudxLab
Introduction to Apache ZooKeeper | Big Data Hadoop Spark Tutorial | CloudxLabIntroduction to Apache ZooKeeper | Big Data Hadoop Spark Tutorial | CloudxLab
Introduction to Apache ZooKeeper | Big Data Hadoop Spark Tutorial | CloudxLab
 
Kafka Needs no Keeper( Jason Gustafson & Colin McCabe, Confluent) Kafka Summi...
Kafka Needs no Keeper( Jason Gustafson & Colin McCabe, Confluent) Kafka Summi...Kafka Needs no Keeper( Jason Gustafson & Colin McCabe, Confluent) Kafka Summi...
Kafka Needs no Keeper( Jason Gustafson & Colin McCabe, Confluent) Kafka Summi...
 
Seek and Destroy Kafka Under Replication
Seek and Destroy Kafka Under ReplicationSeek and Destroy Kafka Under Replication
Seek and Destroy Kafka Under Replication
 
Performance Scenario: Diagnosing and resolving sudden slow down on two node RAC
Performance Scenario: Diagnosing and resolving sudden slow down on two node RACPerformance Scenario: Diagnosing and resolving sudden slow down on two node RAC
Performance Scenario: Diagnosing and resolving sudden slow down on two node RAC
 

More from confluent

Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...confluent
 
Santander Stream Processing with Apache Flink
Santander Stream Processing with Apache FlinkSantander Stream Processing with Apache Flink
Santander Stream Processing with Apache Flinkconfluent
 
Unlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insightsUnlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insightsconfluent
 
Workshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con FlinkWorkshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con Flinkconfluent
 
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...confluent
 
AWS Immersion Day Mapfre - Confluent
AWS Immersion Day Mapfre   -   ConfluentAWS Immersion Day Mapfre   -   Confluent
AWS Immersion Day Mapfre - Confluentconfluent
 
Eventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalkEventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalkconfluent
 
Q&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent CloudQ&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent Cloudconfluent
 
Build real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with ConfluentBuild real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with Confluentconfluent
 
Q&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service MeshQ&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service Meshconfluent
 
Citi Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka MicroservicesCiti Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka Microservicesconfluent
 
Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3confluent
 
Citi Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging ModernizationCiti Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging Modernizationconfluent
 
Citi Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time dataCiti Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time dataconfluent
 
Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2confluent
 
Data In Motion Paris 2023
Data In Motion Paris 2023Data In Motion Paris 2023
Data In Motion Paris 2023confluent
 
Confluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with SynthesisConfluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with Synthesisconfluent
 
The Future of Application Development - API Days - Melbourne 2023
The Future of Application Development - API Days - Melbourne 2023The Future of Application Development - API Days - Melbourne 2023
The Future of Application Development - API Days - Melbourne 2023confluent
 
The Playful Bond Between REST And Data Streams
The Playful Bond Between REST And Data StreamsThe Playful Bond Between REST And Data Streams
The Playful Bond Between REST And Data Streamsconfluent
 
The Journey to Data Mesh with Confluent
The Journey to Data Mesh with ConfluentThe Journey to Data Mesh with Confluent
The Journey to Data Mesh with Confluentconfluent
 

More from confluent (20)

Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
 
Santander Stream Processing with Apache Flink
Santander Stream Processing with Apache FlinkSantander Stream Processing with Apache Flink
Santander Stream Processing with Apache Flink
 
Unlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insightsUnlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insights
 
Workshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con FlinkWorkshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con Flink
 
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
 
AWS Immersion Day Mapfre - Confluent
AWS Immersion Day Mapfre   -   ConfluentAWS Immersion Day Mapfre   -   Confluent
AWS Immersion Day Mapfre - Confluent
 
Eventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalkEventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalk
 
Q&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent CloudQ&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent Cloud
 
Build real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with ConfluentBuild real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with Confluent
 
Q&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service MeshQ&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service Mesh
 
Citi Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka MicroservicesCiti Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka Microservices
 
Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3
 
Citi Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging ModernizationCiti Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging Modernization
 
Citi Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time dataCiti Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time data
 
Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2
 
Data In Motion Paris 2023
Data In Motion Paris 2023Data In Motion Paris 2023
Data In Motion Paris 2023
 
Confluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with SynthesisConfluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with Synthesis
 
The Future of Application Development - API Days - Melbourne 2023
The Future of Application Development - API Days - Melbourne 2023The Future of Application Development - API Days - Melbourne 2023
The Future of Application Development - API Days - Melbourne 2023
 
The Playful Bond Between REST And Data Streams
The Playful Bond Between REST And Data StreamsThe Playful Bond Between REST And Data Streams
The Playful Bond Between REST And Data Streams
 
The Journey to Data Mesh with Confluent
The Journey to Data Mesh with ConfluentThe Journey to Data Mesh with Confluent
The Journey to Data Mesh with Confluent
 

Recently uploaded

Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Snow Chain-Integrated Tire for a Safe Drive on Winter Roads
Snow Chain-Integrated Tire for a Safe Drive on Winter RoadsSnow Chain-Integrated Tire for a Safe Drive on Winter Roads
Snow Chain-Integrated Tire for a Safe Drive on Winter RoadsHyundai Motor Group
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 

Recently uploaded (20)

Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Snow Chain-Integrated Tire for a Safe Drive on Winter Roads
Snow Chain-Integrated Tire for a Safe Drive on Winter RoadsSnow Chain-Integrated Tire for a Safe Drive on Winter Roads
Snow Chain-Integrated Tire for a Safe Drive on Winter Roads
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 

Top Ten Kafka Configs for Optimum Performance

Editor's Notes

  1. This is me I’ve worked at Confluent for 1.5 years on Streams team I authored the book Kafka Streams in Action Now let’s get started! First let’s go over what we are going to cover today
  2. This is me I’ve worked at Confluent for 1.5 years on Streams team I authored the book Kafka Streams in Action Now let’s get started! First let’s go over what we are going to cover today
  3. This is me I’ve worked at Confluent for 1.5 years on Streams team I authored the book Kafka Streams in Action Now let’s get started! First let’s go over what we are going to cover today
  4. This is me I’ve worked at Confluent for 1.5 years on Streams team I authored the book Kafka Streams in Action Now let’s get started! First let’s go over what we are going to cover today
  5. This is me I’ve worked at Confluent for 1.5 years on Streams team I authored the book Kafka Streams in Action Now let’s get started! First let’s go over what we are going to cover today
  6. This is me I’ve worked at Confluent for 1.5 years on Streams team I authored the book Kafka Streams in Action Now let’s get started! First let’s go over what we are going to cover today
  7. This is me I’ve worked at Confluent for 1.5 years on Streams team I authored the book Kafka Streams in Action Now let’s get started! First let’s go over what we are going to cover today
  8. This is me I’ve worked at Confluent for 1.5 years on Streams team I authored the book Kafka Streams in Action Now let’s get started! First let’s go over what we are going to cover today
  9. This is me I’ve worked at Confluent for 1.5 years on Streams team I authored the book Kafka Streams in Action Now let’s get started! First let’s go over what we are going to cover today
  10. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  11. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  12. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  13. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  14. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  15. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  16. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  17. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  18. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  19. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  20. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  21. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  22. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  23. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  24. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  25. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  26. Image you have a Kafka topic and you need to do a group-by count on it, without Kafka Streams you'd need to do some manual processing to acheive this. Here is the main method and setting up the consumer and producer and subscribing to two topics This is more boiler plate work that needs to be done
  27. Image you have a Kafka topic and you need to do a group-by count on it, without Kafka Streams you'd need to do some manual processing to acheive this. Here is the main method and setting up the consumer and producer and subscribing to two topics This is more boiler plate work that needs to be done
  28. Image you have a Kafka topic and you need to do a group-by count on it, without Kafka Streams you'd need to do some manual processing to acheive this. Here is the main method and setting up the consumer and producer and subscribing to two topics This is more boiler plate work that needs to be done
  29. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  30. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  31. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  32. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  33. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  34. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  35. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  36. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  37. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  38. Don’t want to blindly increase the max.poll.interval, this setting is piggy backed to other settings on the broker
  39. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  40. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  41. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  42. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  43. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  44. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  45. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  46. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  47. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  48. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  49. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  50. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  51. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  52. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  53. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  54. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  55. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  56. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  57. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  58. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  59. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  60. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  61. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  62. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  63. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  64. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  65. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  66. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  67. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  68. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  69. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  70. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  71. Toplogy is a collection of procesing nodes in a graph A sub-topology is a collection of processing nodes connected by common input topic Relationship between tasks threads and state stores Next let's take a look a life before Kafka Streams so we can get a sense of what Kafka Streams is.
  72. Thanks for your time Stay in touch and use these resources to participate in the community We have a book signing for Kafka Streams in Action at the Confluent Booth at 4:45 PM today stop By and pick up a signed copy and check out what’s going on at Confluent
  73. Thanks for your time Stay in touch and use these resources to participate in the community We have a book signing for Kafka Streams in Action at the Confluent Booth at 4:45 PM today stop By and pick up a signed copy and check out what’s going on at Confluent
  74. Thanks for your time Stay in touch and use these resources to participate in the community We have a book signing for Kafka Streams in Action at the Confluent Booth at 4:45 PM today stop By and pick up a signed copy and check out what’s going on at Confluent