Guozhang Wang, profile picture
Uploaded byGuozhang Wang
PDF, PPTX1,692 views

Apache Kafka, and the Rise of Stream Processing

The document discusses Apache Kafka as a scalable and distributed pub-sub messaging system that serves as a real-time data pipeline and integrated data processing platform. It explains Kafka Streams, a client library for processing streaming data, the concepts of event-time and processing-time, and the importance of fault tolerance and state management in stream processing. The document highlights ongoing developments in Kafka, including new features and support for multiple programming languages.

Embed presentation

Download as PDF, PPTX
1 / 105
2 / 105
3 / 105
4 / 105
5 / 105
6 / 105
7 / 105
8 / 105
9 / 105
10 / 105
11 / 105
12 / 105
13 / 105
14 / 105
15 / 105
16 / 105
17 / 105
18 / 105
19 / 105
20 / 105
21 / 105
22 / 105
23 / 105
24 / 105
25 / 105
26 / 105
27 / 105
28 / 105
29 / 105
30 / 105
31 / 105
32 / 105
33 / 105
34 / 105
35 / 105
36 / 105
37 / 105
38 / 105
39 / 105
40 / 105
41 / 105
42 / 105
43 / 105
44 / 105
45 / 105
46 / 105
47 / 105
48 / 105
49 / 105
50 / 105
51 / 105
52 / 105
53 / 105
54 / 105
55 / 105
56 / 105
57 / 105
58 / 105
59 / 105
60 / 105
61 / 105
62 / 105
63 / 105
64 / 105
65 / 105
66 / 105
67 / 105
68 / 105
69 / 105
70 / 105
71 / 105
72 / 105
73 / 105
74 / 105
75 / 105
76 / 105
77 / 105
78 / 105
79 / 105
80 / 105
81 / 105
82 / 105
83 / 105
84 / 105
85 / 105
86 / 105
87 / 105
88 / 105
89 / 105
90 / 105
91 / 105
92 / 105
93 / 105
94 / 105
95 / 105
96 / 105
97 / 105
98 / 105
99 / 105
100 / 105
101 / 105
102 / 105
103 / 105
104 / 105
105 / 105
1 Guozhang Wang DataEngConf, Nov 3, 2016 Apache Kafka and the Rise of Stream Processing
2 What is Kafka, really?
3 What is Kafka, Really? [NetDB 2011]a scalable Pub-sub messaging system..
4 What is Kafka, Really? [NetDB 2011] [Hadoop Summit 2013] a scalable Pub-sub messaging system.. a real-time data pipeline..
5 Example: Centralized Data Pipeline KV-Store Doc-Store RDBMS Tracking Logs / Metrics Hadoop / DW Monitoring Rec. Engine Social GraphSearchingSecurity Apache Kafka …
6 What is Kafka, Really? [NetDB 2011] [Hadoop Summit 2013] [VLDB 2015] a scalable Pub-sub messaging system.. a real-time data pipeline.. a distributed and replicated log..
7 Example: Data Store Geo-Replication Apache Kafka Local Stores User Apps User Apps Local Stores Apache Kafka Region 2Region 1 write read append log mirroring apply log
8 What is Kafka, Really? a scalable Pub-sub messaging system.. [NetDB 2011] a real-time data pipeline.. [Hadoop Summit 2013] a distributed and replicated log.. [VLDB 2015] a unified data integration stack.. [CIDR 2015]
9 Example: Async. Micro-Services
10 Which of the following is true? a scalable Pub-sub messaging system.. [NetDB 2011] a real-time data pipeline.. [Hadoop Summit 2013] a distributed and replicated log.. [VLDB 2015] a unified data integration stack.. [CIDR 2015]
11 Which of the following is true? a scalable Pub-sub messaging system.. [NetDB 2011] a real-time data pipeline.. [Hadoop Summit 2013] a distributed and replicated log.. [VLDB 2015] a unified data integration stack.. [CIDR 2015] All of them!
12 Kafka: Streaming Platform • Publish / Subscribe • Move data around as online streams • Store • “Source-of-truth” continuous data • Process • React / process data in real-time
13 Kafka: Streaming Platform • Publish / Subscribe • Move data around as online streams • Store • “Source-of-truth” continuous data • Process • React / process data in real-time Producer Producer Consumer Consumer
14 Kafka: Streaming Platform • Publish / Subscribe • Move data around as online streams • Store • “Source-of-truth” continuous data • Process • React / process data in real-time Producer Producer Consumer Consumer Connect Connect
15
16 Connectors • 40+ since first release this Feb (0.9+) • 13 from & partners
17 Kafka: Streaming Platform • Publish / Subscribe • Move data around as online streams • Store • “Source-of-truth” continuous data • Process • React / process data in real-time Streams Producer Producer Consumer Consumer Connect Connect Streams
18 Kafka: Streaming Platform • Publish / Subscribe • Move data around as online streams • Store • “Source-of-truth” continuous data • Process • React / process data in real-time Streams Producer Producer Consumer Consumer Connect Connect Streams Today’s Talk
19 Stream Processing • A different programming paradigm • .. that brings computation to unbounded data • .. with tradeoffs between latency / cost / correctness
20 Model Update Model Prediction Training / Feedback Stream Input Stream (parameters, etc) Output Stream (scores, categories, etc) Online Machine Learning
21 Sales Message Queue Shipment Orders Async. Micro-services
22 OLAP Engine Real-time Analytics Online DB2 Log File Stream / Change Data Capture Stream Online DB1 Query Results
Kafka Streams (0.10+) • New client library besides producer and consumer • Powerful yet easy-to-use • Event-at-a-time, Stateful • Windowing with out-of-order handling • Highly scalable, distributed, fault tolerant • and more.. 23
24 Anywhere, anytime Ok. Ok. Ok. Ok.
25 Anywhere, anytime <dependency>
 <groupId>org.apache.kafka</groupId> <artifactId>kafka-streams</artifactId> <version>0.10.0.0</version> </dependency>
26 Anywhere, anytime War File Rsync Puppet/Chef YARN M esos Docker Kubernetes Very Uncool Very Cool
27 Simple is Beautiful
Kafka Streams DSL 28 public static void main(String[] args) { // specify the processing topology by first reading in a stream from a topic KStream<String, String> words = builder.stream(”topic1”); // count the words in this stream as an aggregated table KTable<String, Long> counts = words.countByKey(”Counts”); // write the result table to a new topic counts.to(”topic2”); // create a stream processing instance and start running it KafkaStreams streams = new KafkaStreams(builder, config); streams.start(); }
Kafka Streams DSL 29 public static void main(String[] args) { // specify the processing topology by first reading in a stream from a topic KStream<String, String> words = builder.stream(”topic1”); // count the words in this stream as an aggregated table KTable<String, Long> counts = words.countByKey(”Counts”); // write the result table to a new topic counts.to(”topic2”); // create a stream processing instance and start running it KafkaStreams streams = new KafkaStreams(builder, config); streams.start(); }
Kafka Streams DSL 30 public static void main(String[] args) { // specify the processing topology by first reading in a stream from a topic KStream<String, String> words = builder.stream(”topic1”); // count the words in this stream as an aggregated table KTable<String, Long> counts = words.countByKey(”Counts”); // write the result table to a new topic counts.to(”topic2”); // create a stream processing instance and start running it KafkaStreams streams = new KafkaStreams(builder, config); streams.start(); }
Kafka Streams DSL 31 public static void main(String[] args) { // specify the processing topology by first reading in a stream from a topic KStream<String, String> words = builder.stream(”topic1”); // count the words in this stream as an aggregated table KTable<String, Long> counts = words.countByKey(”Counts”); // write the result table to a new topic counts.to(”topic2”); // create a stream processing instance and start running it KafkaStreams streams = new KafkaStreams(builder, config); streams.start(); }
Kafka Streams DSL 32 public static void main(String[] args) { // specify the processing topology by first reading in a stream from a topic KStream<String, String> words = builder.stream(”topic1”); // count the words in this stream as an aggregated table KTable<String, Long> counts = words.countByKey(”Counts”); // write the result table to a new topic counts.to(”topic2”); // create a stream processing instance and start running it KafkaStreams streams = new KafkaStreams(builder, config); streams.start(); }
33 API, coding “Full stack” evaluation Operations, debugging, …
34 API, coding “Full stack” evaluation Operations, debugging, … Simple is Beautiful
35 Kafka Streams: Key Concepts
Stream and Records 36 Key Value Key Value Key Value Key Value Stream Record
Processor Topology 37 KStream<..> stream1 = builder.stream(”topic1”); KStream<..> stream2 = builder.stream(”topic2”); KStream<..> joined = stream1.leftJoin(stream2, ...); KTable<..> aggregated = joined.aggregateByKey(...); aggregated.to(”topic3”);
Processor Topology 38 Stream
Processor Topology 39 Stream Processor
Processor Topology 40 KStream<..> stream1 = builder.stream(”topic1”); KStream<..> stream2 = builder.stream(”topic2”); KStream<..> joined = stream1.leftJoin(stream2, ...); KTable<..> aggregated = joined.aggregateByKey(...); aggregated.to(”topic3”);
Processor Topology 41 KStream<..> stream1 = builder.stream(”topic1”); KStream<..> stream2 = builder.stream(”topic2”); KStream<..> joined = stream1.leftJoin(stream2, ...); KTable<..> aggregated = joined.aggregateByKey(...); aggregated.to(”topic3”);
Processor Topology 42 KStream<..> stream1 = builder.stream(”topic1”); KStream<..> stream2 = builder.stream(”topic2”); KStream<..> joined = stream1.leftJoin(stream2, ...); KTable<..> aggregated = joined.aggregateByKey(...); aggregated.to(”topic3”);
Processor Topology 43 KStream<..> stream1 = builder.stream(”topic1”); KStream<..> stream2 = builder.stream(”topic2”); KStream<..> joined = stream1.leftJoin(stream2, ...); KTable<..> aggregated = joined.aggregateByKey(...); aggregated.to(”topic3”);
Processor Topology 44 KStream<..> stream1 = builder.stream(”topic1”); KStream<..> stream2 = builder.stream(”topic2”); KStream<..> joined = stream1.leftJoin(stream2, ...); KTable<..> aggregated = joined.aggregateByKey(...); aggregated.to(”topic3”);
Processor Topology 45 Source Processor Sink Processor KStream<..> stream1 = builder.stream( KStream<..> stream2 = builder.stream( aggregated.to(
Processor Topology 46Kafka Streams Kafka
Stream Partitions and Tasks 47 Kafka Topic B Kafka Topic A P1 P2 P1 P2
Stream Partitions and Tasks 48 Kafka Topic B Kafka Topic A Processor Topology P1 P2 P1 P2
Stream Partitions and Tasks 49 Kafka Topic AKafka Topic B
Kafka Topic B Stream Threads 50 Kafka Topic A MyApp.1 MyApp.2 Task2Task1
Stream Threads 51 Kafka Topic AKafka Topic B Task2Task1 MyApp.1 MyApp.2
Stream Threads 52 Task3 MyApp.3 Kafka Topic AKafka Topic B Task2Task1 MyApp.1 MyApp.2
Stream Threads 53 Task3 Kafka Topic AKafka Topic B Task2Task1 MyApp.1 MyApp.2 MyApp.3
States in Stream Processing 54 • filter • map
 • join
 • aggregate Stateless Stateful
55
States in Stream Processing 56 KStream<..> stream1 = builder.stream(”topic1”); KStream<..> stream2 = builder.stream(”topic2”); KStream<..> joined = stream1.leftJoin(stream2, ...); KTable<..> aggregated = joined.aggregateByKey(...); aggregated.to(”topic2”); State
Kafka Topic B Task2Task1 States in Stream Processing 57 Kafka Topic A State State
Interactive Queries on States 58 Your App (Streams) Kafka Other AppN Other App1 … Query Engine
Interactive Queries on States 59 Your App (Streams) Kafka Other AppN Other App1 … Query Engine Complexity: lots of moving parts
Interactive Queries on States (0.10.1+) 60 Your App (Streams) Kafka State Other AppN Other App2 Other App1 …
Stream v.s.Table? 61 KStream<..> stream1 = builder.stream(”topic1”); KStream<..> stream2 = builder.stream(”topic2”); KStream<..> joined = stream1.leftJoin(stream2, ...); KTable<..> aggregated = joined.aggregateByKey(...); aggregated.to(”topic2”); State
62 Tables ≈ Streams
63
64
65
The Stream-Table Duality • A stream is a changelog of a table • A table is a materialized view at time of a stream • Example: change data capture (CDC) of databases 66
KStream = interprets data as record stream ~ think: “append-only” KTable = data as changelog stream ~ continuously updated materialized view 67
68 alice eggs bob lettuce alice milk alice lnkd bob googl alice msft KStream KTable User purchase history User employment profile
69 alice eggs bob lettuce alice milk alice lnkd bob googl alice msft KStream KTable User purchase history User employment profile time “Alice bought eggs.” “Alice is now at LinkedIn.”
70 alice eggs bob lettuce alice milk alice lnkd bob googl alice msft KStream KTable User purchase history User employment profile time “Alice bought eggs and milk.” “Alice is now at LinkedIn Microsoft.”
71 alice 2 bob 10 alice 3 timeKStream.aggregate() KTable.aggregate() (key: Alice, value: 2) (key: Alice, value: 2)
72 alice 2 bob 10 alice 3 time (key: Alice, value: 2 3) (key: Alice, value: 2+3) KStream.aggregate() KTable.aggregate()
73 KStream KTable reduce() aggregate() … toStream() map() filter() join() … map() filter() join() …
74 KTable aggregated KStream joined KStream stream1KStream stream2 Updates Propagation in KTable State
75 KTable aggregated KStream joined KStream stream1KStream stream2 State Updates Propagation in KTable
76 KTable aggregated KStream joined KStream stream1KStream stream2 State Updates Propagation in KTable
77 KTable aggregated KStream joined KStream stream1KStream stream2 State Updates Propagation in KTable
78 What about Fault Tolerance?
79 Remember?
80 StateProcess StateProcess StateProcess Kafka ChangelogFault Tolerance Kafka Kafka Streams Kafka
81 StateProcess StateProcess Protoco l StateProcess Fault Tolerance Kafka Kafka Streams Kafka Changelog Kafka
82 StateProcess StateProcess Protoco l StateProcess Fault Tolerance StateProcess Kafka Kafka Streams Kafka Changelog Kafka
83
84
85
86
It’s all about Time • Event-time (when an event is created) • Processing-time (when an event is processed) 87
Event-time 1 2 3 4 5 6 7 Processing-time 1999 2002 2005 1977 1980 1983 2015 88 PHANTOMMENACE ATTACKOFTHECLONES REVENGEOFTHESITH ANEWHOPE THEEMPIRESTRIKESBACK RETURNOFTHEJEDI THEFORCEAWAKENS Out-of-Order
Timestamp Extractor 89 public long extract(ConsumerRecord<Object, Object> record) { return System.currentTimeMillis(); } public long extract(ConsumerRecord<Object, Object> record) { return record.timestamp(); }
Timestamp Extractor 90 public long extract(ConsumerRecord<Object, Object> record) { return System.currentTimeMillis(); } public long extract(ConsumerRecord<Object, Object> record) { return record.timestamp(); } processing-time
Timestamp Extractor 91 public long extract(ConsumerRecord<Object, Object> record) { return System.currentTimeMillis(); } public long extract(ConsumerRecord<Object, Object> record) { return record.timestamp(); } processing-time event-time
Timestamp Extractor 92 public long extract(ConsumerRecord<Object, Object> record) { return System.currentTimeMillis(); } processing-time event-time public long extract(ConsumerRecord<Object, Object> record) { return ((JsonNode) record.value()).get(”timestamp”).longValue(); }
Windowing 93 t …
Windowing 94 t …
Windowing 95 t …
Windowing 96 t …
Windowing 97 t …
Windowing 98 t …
Windowing 99 t …
100 • Ordering • Partitioning &

 Scalability
 • Fault tolerance Stream Processing Hard Parts • State Management • Time, Window &

 Out-of-order Data
 • Re-processing For more details: http://docs.confluent.io/current
101 • Ordering • Partitioning &

 Scalability
 • Fault tolerance Stream Processing Hard Parts • State Management • Time, Window &

 Out-of-order Data
 • Re-processing Simple is Beautiful For more details: http://docs.confluent.io/current
Ongoing Work (0.10.1+) • Beyond Java APIs • SQL support, Python client, etc • End-to-End Semantics (exactly-once) • … and more 102
Take-aways • Apache Kafka: a centralized streaming platform • Kafka Streams: stream processing made easy 103
Take-aways • Apache Kafka: a centralized streaming platform 104
Take-aways 105 THANKS! Guozhang Wang | guozhang@confluent.io | @guozhangwang CFP Kafka Summit 2017 @ NYC & SF Confluent Webinar: http://www.confluent.io/resources • Apache Kafka: a centralized streaming platform • Kafka Streams: stream processing made easy

More Related Content

PDF
Exactly-Once Made Easy: Transactional Messaging Improvement for Usability and...
byGuozhang Wang
 
PDF
Consistency and Completeness: Rethinking Distributed Stream Processing in Apa...
byGuozhang Wang
 
PDF
Kafka Summit SF 2017 - Exactly-once Stream Processing with Kafka Streams
byconfluent
 
PDF
Performance Analysis and Optimizations for Kafka Streams Applications
byGuozhang Wang
 
PDF
Kafka Streams: the easiest way to start with stream processing
byYaroslav Tkachenko
 
PPTX
Exactly-once Stream Processing with Kafka Streams
byGuozhang Wang
 
PDF
Event stream processing using Kafka streams
byFredrik Vraalsen
 
PPTX
Stream Application Development with Apache Kafka
byMatthias J. Sax
 
Exactly-Once Made Easy: Transactional Messaging Improvement for Usability and...
byGuozhang Wang
 
Consistency and Completeness: Rethinking Distributed Stream Processing in Apa...
byGuozhang Wang
 
Kafka Summit SF 2017 - Exactly-once Stream Processing with Kafka Streams
byconfluent
 
Performance Analysis and Optimizations for Kafka Streams Applications
byGuozhang Wang
 
Kafka Streams: the easiest way to start with stream processing
byYaroslav Tkachenko
 
Exactly-once Stream Processing with Kafka Streams
byGuozhang Wang
 
Event stream processing using Kafka streams
byFredrik Vraalsen
 
Stream Application Development with Apache Kafka
byMatthias J. Sax
 

What's hot

PDF
Stream Processing made simple with Kafka
byDataWorks Summit/Hadoop Summit
 
PDF
Introduction to Kafka Streams
byGuozhang Wang
 
PPTX
Kafka Streams: The Stream Processing Engine of Apache Kafka
byEno Thereska
 
PDF
Kafka Summit NYC 2017 - The Best Thing Since Partitioned Bread
byconfluent
 
PPTX
Building a Replicated Logging System with Apache Kafka
byGuozhang Wang
 
PDF
Exactly-once Data Processing with Kafka Streams - July 27, 2017
byconfluent
 
PDF
What's the time? ...and why? (Mattias Sax, Confluent) Kafka Summit SF 2019
byconfluent
 
PDF
Exactly-Once Made Easy: Transactional Messaging Improvement for Usability and...
byHostedbyConfluent
 
PDF
Real Time Streaming Data with Kafka and TensorFlow (Yong Tang, MobileIron) Ka...
byconfluent
 
PDF
Achieving a 50% Reduction in Cross-AZ Network Costs from Kafka (Uday Sagar Si...
byconfluent
 
PPTX
Kafka Summit NYC 2017 - Easy, Scalable, Fault-tolerant Stream Processing with...
byconfluent
 
PDF
Building Scalable and Extendable Data Pipeline for Call of Duty Games: Lesson...
byYaroslav Tkachenko
 
PDF
From Message to Cluster: A Realworld Introduction to Kafka Capacity Planning
byconfluent
 
PDF
Robust Operations of Kafka Streams
byconfluent
 
PDF
Deep Dive Into Kafka Streams (and the Distributed Stream Processing Engine) (...
byconfluent
 
PPTX
Apache Kafka at LinkedIn
byDiscover Pinterest
 
PDF
kafka
byAriel Moskovich
 
PDF
Kafka Summit SF 2017 - Kafka Stream Processing for Everyone with KSQL
byconfluent
 
PDF
KSQL: Streaming SQL for Kafka
byconfluent
 
PPTX
Kick your database_to_the_curb_reston_08_27_19
byconfluent
 
Stream Processing made simple with Kafka
byDataWorks Summit/Hadoop Summit
 
Introduction to Kafka Streams
byGuozhang Wang
 
Kafka Streams: The Stream Processing Engine of Apache Kafka
byEno Thereska
 
Kafka Summit NYC 2017 - The Best Thing Since Partitioned Bread
byconfluent
 
Building a Replicated Logging System with Apache Kafka
byGuozhang Wang
 
Exactly-once Data Processing with Kafka Streams - July 27, 2017
byconfluent
 
What's the time? ...and why? (Mattias Sax, Confluent) Kafka Summit SF 2019
byconfluent
 
Exactly-Once Made Easy: Transactional Messaging Improvement for Usability and...
byHostedbyConfluent
 
Real Time Streaming Data with Kafka and TensorFlow (Yong Tang, MobileIron) Ka...
byconfluent
 
Achieving a 50% Reduction in Cross-AZ Network Costs from Kafka (Uday Sagar Si...
byconfluent
 
Kafka Summit NYC 2017 - Easy, Scalable, Fault-tolerant Stream Processing with...
byconfluent
 
Building Scalable and Extendable Data Pipeline for Call of Duty Games: Lesson...
byYaroslav Tkachenko
 
From Message to Cluster: A Realworld Introduction to Kafka Capacity Planning
byconfluent
 
Robust Operations of Kafka Streams
byconfluent
 
Deep Dive Into Kafka Streams (and the Distributed Stream Processing Engine) (...
byconfluent
 
Apache Kafka at LinkedIn
byDiscover Pinterest
 
kafka
byAriel Moskovich
 
Kafka Summit SF 2017 - Kafka Stream Processing for Everyone with KSQL
byconfluent
 
KSQL: Streaming SQL for Kafka
byconfluent
 
Kick your database_to_the_curb_reston_08_27_19
byconfluent
 

Viewers also liked

PPTX
Apache Kafka at LinkedIn
byGuozhang Wang
 
PPTX
Automatic Scaling Iterative Computations
byGuozhang Wang
 
PPTX
Behavioral Simulations in MapReduce
byGuozhang Wang
 
PDF
Building Realtim Data Pipelines with Kafka Connect and Spark Streaming
byGuozhang Wang
 
PDF
Building Stream Infrastructure across Multiple Data Centers with Apache Kafka
byGuozhang Wang
 
PPTX
Introduction to Apache Kafka
byJeff Holoman
 
PDF
Hadoop Summit Europe 2014: Apache Storm Architecture
byP. Taylor Goetz
 
PDF
Streaming Plattformen und die Qual der Wahl
byMatthias Niehoff
 
PPTX
Kafka - Linkedin's messaging backbone
byAyyappadas Ravindran (Appu)
 
PPT
Effective linux.3.(diagnosis)
bywang hongjiang
 
PPT
Exodus2 大局观
bywang hongjiang
 
PPT
Java7 fork join framework and closures
bywang hongjiang
 
PPT
Effective linux.1.(commandline)
bywang hongjiang
 
PPT
Enum开锁
bywang hongjiang
 
PPT
Effective linux.2.(tools)
bywang hongjiang
 
DOC
深入剖析Concurrent hashmap中的同步机制（下）
bywang hongjiang
 
PPT
聊一些电影
bywang hongjiang
 
PPT
善用工具
bywang hongjiang
 
DOC
深入剖析Concurrent hashmap中的同步机制（上）
bywang hongjiang
 
PDF
Hash map导致cpu100% 的分析
bywang hongjiang
 
Apache Kafka at LinkedIn
byGuozhang Wang
 
Automatic Scaling Iterative Computations
byGuozhang Wang
 
Behavioral Simulations in MapReduce
byGuozhang Wang
 
Building Realtim Data Pipelines with Kafka Connect and Spark Streaming
byGuozhang Wang
 
Building Stream Infrastructure across Multiple Data Centers with Apache Kafka
byGuozhang Wang
 
Introduction to Apache Kafka
byJeff Holoman
 
Hadoop Summit Europe 2014: Apache Storm Architecture
byP. Taylor Goetz
 
Streaming Plattformen und die Qual der Wahl
byMatthias Niehoff
 
Kafka - Linkedin's messaging backbone
byAyyappadas Ravindran (Appu)
 
Effective linux.3.(diagnosis)
bywang hongjiang
 
Exodus2 大局观
bywang hongjiang
 
Java7 fork join framework and closures
bywang hongjiang
 
Effective linux.1.(commandline)
bywang hongjiang
 
Enum开锁
bywang hongjiang
 
Effective linux.2.(tools)
bywang hongjiang
 
深入剖析Concurrent hashmap中的同步机制（下）
bywang hongjiang
 
聊一些电影
bywang hongjiang
 
善用工具
bywang hongjiang
 
深入剖析Concurrent hashmap中的同步机制（上）
bywang hongjiang
 
Hash map导致cpu100% 的分析
bywang hongjiang
 

Similar to Apache Kafka, and the Rise of Stream Processing

PPTX
Apache Kafka 101 for Techies in IT dep.pptx
byamulyareddyk97
 
PDF
Kafka Streams - From the Ground Up to the Cloud
byVMware Tanzu
 
PPTX
Kafka Streams for Java enthusiasts
bySlim Baltagi
 
PDF
Kafka Connect and Streams (Concepts, Architecture, Features)
byKai Wähner
 
PDF
Richmond kafka streams intro
byconfluent
 
PPTX
Apache kafka
byDaan Gerits
 
ODP
Stream processing using Kafka
byKnoldus Inc.
 
PDF
Data Streaming in Kafka
bySilviuMarcu1
 
PPTX
Apache Kafka Streams
byApache Kafka TLV
 
PDF
Follow the (Kafka) Streams
byconfluent
 
PDF
Performance Analysis and Optimizations for Kafka Streams Applications (Guozha...
byconfluent
 
PPTX
Introduction to Kafka Streams Presentation
byKnoldus Inc.
 
PDF
Building a Streaming Platform with Kafka
byconfluent
 
PDF
Using Kafka as a Database For Real-Time Transaction Processing | Chad Preisle...
byHostedbyConfluent
 
PDF
Introducción a Stream Processing utilizando Kafka Streams
byconfluent
 
PDF
Rethinking Stream Processing with Apache Kafka: Applications vs. Clusters, St...
byMichael Noll
 
PPTX
Kick Your Database to the Curb
byBill Bejeck
 
PPTX
Streaming Data and Stream Processing with Apache Kafka
byconfluent
 
PDF
Spark (Structured) Streaming vs. Kafka Streams
byGuido Schmutz
 
PPTX
Building streaming data applications using Kafka*[Connect + Core + Streams] b...
byData Con LA
 
Apache Kafka 101 for Techies in IT dep.pptx
byamulyareddyk97
 
Kafka Streams - From the Ground Up to the Cloud
byVMware Tanzu
 
Kafka Streams for Java enthusiasts
bySlim Baltagi
 
Kafka Connect and Streams (Concepts, Architecture, Features)
byKai Wähner
 
Richmond kafka streams intro
byconfluent
 
Apache kafka
byDaan Gerits
 
Stream processing using Kafka
byKnoldus Inc.
 
Data Streaming in Kafka
bySilviuMarcu1
 
Apache Kafka Streams
byApache Kafka TLV
 
Follow the (Kafka) Streams
byconfluent
 
Performance Analysis and Optimizations for Kafka Streams Applications (Guozha...
byconfluent
 
Introduction to Kafka Streams Presentation
byKnoldus Inc.
 
Building a Streaming Platform with Kafka
byconfluent
 
Using Kafka as a Database For Real-Time Transaction Processing | Chad Preisle...
byHostedbyConfluent
 
Introducción a Stream Processing utilizando Kafka Streams
byconfluent
 
Rethinking Stream Processing with Apache Kafka: Applications vs. Clusters, St...
byMichael Noll
 
Kick Your Database to the Curb
byBill Bejeck
 
Streaming Data and Stream Processing with Apache Kafka
byconfluent
 
Spark (Structured) Streaming vs. Kafka Streams
byGuido Schmutz
 
Building streaming data applications using Kafka*[Connect + Core + Streams] b...
byData Con LA
 

Recently uploaded

PDF
NS unit wise unit wise 1 -5 so prepare,.
bykumaransudhan1512
 
PDF
Chemical Hazards at Workplace – Types, Properties & Exposure Routes, CORE-EHS
byCORE EHS
 
PPT
Cloud computing-1.ppt presentation preview
byMohanaPriya780617
 
PDF
Shear Strength of Soil/Mohr Coulomb Failure Criteria-1.pdf
byMahmoodKhalid11
 
PPTX
ISO 13485.2016 Awareness's Training material
byPrakashSivan
 
PPTX
Presentation-WPS Office.pptx afgouvhyhgfccf
byEndaleTimerga
 
PPTX
How Does LNG Regasification Work | INOXCVA
byINOXCVA
 
PPTX
Value engineering and cost analysis with case study
byhp9879098082
 
PPTX
Theory to Practice of Unsaturated Soil Mechanics-1.pptx
byMahmoodKhalid11
 
PPTX
Unit 1_Importance of modelling(Object oriented concepts).pptx
byVidyaranichougule
 
PPTX
ME3592 - Metrology and Measurements - Unit - 1 - Lecture Notes
bypprakash21252
 
PDF
Soil Compressibility (Elastic Settlement).pdf
byMahmoodKhalid11
 
PPTX
Basic Volume Mass Relationship and unit weight as function of volumetric wate...
byMahmoodKhalid11
 
PDF
Decision-Support-Systems-and-Decision-Making-Processes.pdf
byPatankarNikhil
 
PPTX
operating_systems.pptx m,nm,nm,n,nm,n,nm,nikl
bykirthigaaiml
 
PDF
AWS Re:Invent 2025 Recap by FivexL - Guilherme, Vladimir, Andrey
byAndrey Devyatkin
 
PPT
Momentum and collisions in physics or engineering
byazizrahmanhakimi
 
PDF
Applications of AI in Civil Engineering - Dr. Rohan Dasgupta
byRohan Dasgupta
 
PPT
Ceramic Matrix Composites Slide from Composite Materials
byUsman635773
 
PDF
Shear Strength of Soil (Direct shear test).pdf
byMahmoodKhalid11
 
NS unit wise unit wise 1 -5 so prepare,.
bykumaransudhan1512
 
Chemical Hazards at Workplace – Types, Properties & Exposure Routes, CORE-EHS
byCORE EHS
 
Cloud computing-1.ppt presentation preview
byMohanaPriya780617
 
Shear Strength of Soil/Mohr Coulomb Failure Criteria-1.pdf
byMahmoodKhalid11
 
ISO 13485.2016 Awareness's Training material
byPrakashSivan
 
Presentation-WPS Office.pptx afgouvhyhgfccf
byEndaleTimerga
 
How Does LNG Regasification Work | INOXCVA
byINOXCVA
 
Value engineering and cost analysis with case study
byhp9879098082
 
Theory to Practice of Unsaturated Soil Mechanics-1.pptx
byMahmoodKhalid11
 
Unit 1_Importance of modelling(Object oriented concepts).pptx
byVidyaranichougule
 
ME3592 - Metrology and Measurements - Unit - 1 - Lecture Notes
bypprakash21252
 
Soil Compressibility (Elastic Settlement).pdf
byMahmoodKhalid11
 
Basic Volume Mass Relationship and unit weight as function of volumetric wate...
byMahmoodKhalid11
 
Decision-Support-Systems-and-Decision-Making-Processes.pdf
byPatankarNikhil
 
operating_systems.pptx m,nm,nm,n,nm,n,nm,nikl
bykirthigaaiml
 
AWS Re:Invent 2025 Recap by FivexL - Guilherme, Vladimir, Andrey
byAndrey Devyatkin
 
Momentum and collisions in physics or engineering
byazizrahmanhakimi
 
Applications of AI in Civil Engineering - Dr. Rohan Dasgupta
byRohan Dasgupta
 
Ceramic Matrix Composites Slide from Composite Materials
byUsman635773
 
Shear Strength of Soil (Direct shear test).pdf
byMahmoodKhalid11
 

Apache Kafka, and the Rise of Stream Processing