Streaming with Spring Cloud Stream and Apache Kafka - Soby Chacko

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Streaming with Spring and
Apache Kafka
Spring Cloud Stream
Apache Kafka
Kafka Streams

About me…
Soby Chacko
Committer - Spring Cloud Stream/Spring Cloud Data Flow
Twitter: @sobychacko
Github: github.com/sobyc...

Spring Cloud Stream
Overview
• General purpose framework for writing event
driven/stream processing micro services
• Desti...

Persistent publish-subscribe

Consumer groups

Partitioning Support

Apache Kafka
• Single Source of Truth for data
• Fault Tolerant
• Based on the ubiquitous log
data structure
• Producer/Co...

Application Core
Spring Boot
Spring Kafka
Spring Integration/Kafka Streams
Spring Cloud Stream
Inputs
Outputs
Spring Cloud...

Application Core
Spring Cloud Stream Application
Inputs Outputs
Binder
Middleware
Zooming in on the Application
Model

Spring Cloud Stream
Event-Driven microservices framework
Pluggable Binder
Implementations
Opportunities: Same code; Same t...

Spring Cloud Stream
Application level features
• Message conversions are handled by the framework
• Support for error hand...

Spring Cloud Stream
Programming model
• Java 8 based functional programming model
• Spring Cloud Function support as the f...

Spring Cloud Stream
application types
• Sources - java.util.function.Supplier
• Sinks - java.util.function.Consumer
• Proc...

A simple processor
@SpringBootApplication
…
@Bean
public Function<String, String> toUpperCase() {
return String::toUpperCa...

A simple source
@SpringBootApplication
…
@Bean
public Supplier<Long> currentTime() {
return System::currentTimeMillis;
}

A simple sink
@SpringBootApplication
…
@Bean
public Consumer<String> cons() {
return x -> {
System.out.println("Consumer")...

Stream processing with
Spring Cloud Stream and
Kafka Streams

“We call an application data-
intensive if data is its primary
challenge—the quantity of
data, the complexity of data,
or ...

Kafka Streams
• Client library
• No need for dedicated processing cluster
• All guarantees of Kafka are applicable
• Per r...

Spring Cloud Stream
with Kafka Streams
Spring Boot Application
Kafka Streams binder from Spring
Cloud Stream
Kafka Streams...

Major types available for
stream processing
• KStream
• KTable
• GlobalKTable
Spring Cloud Stream
provides binding capabil...

Stream processing concepts
• Stream-Table duality
• Time based windowing
• Joins and Aggregation
• Stateless map and ﬁlter...

Stateful Stream Processing
• Kafka Streams provide built in capabilities for
stateful stream processing
• Default state st...

Spring Cloud Stream programming
model for Kafka Streams apps
• Java 8 based functional programming model
• Processors can ...

Kafka Streams app as a
function…
@Bean
public Function<KStream<Object, String>, KStream<?, WordCount>> process()
{
return ...

Quick Demo…

Resources
• Code used for the demo
• Samples Repository
• Project page
• Dataﬂow microsite
• Conﬂuent Blogs on Spring with...

Questions?
Comments?

Share SlideShare

Facebook
Twitter
LinkedIn

Embed

Size (px)

Show related SlideShares at end

WordPress Shortcode

Link

Share
Email

ChatGPT and the Future of Work - Cl... by Clark Boyd 9424 views
Getting into the tech field. what n... by Tessa Mero 2384 views
Google's Just Not That Into You: Un... by Lily Ray 3774 views
How to have difficult conversations by Rajiv Jayarajah, ... 2378 views
Introduction to Data Science by Christy Abraham Joy 81737 views
Time Management & Productivity - B... by Vit Horky 169438 views

Top clipped slide

1 of 28 Ad

1 of 28 Ad