When to KSQL & When to Live the KStream (Dani Traphagen, Confluent)...

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

who am i
user ID Dani
Alias DTrapezoid
Bg Apache Proj
Dist Sys
s real time
event driven Sys
slaying legacy
How did we
get ...

Ok let's learn more
about
E
you

What letter best describes your ego
on
T
select hope
for
your
cluster
select profit
I
l select
y
it
depends
select make
a ...

it
y.souyewieqsm
bzdr.my
give
select
eqsocluster
select x
smeary
it
qnaEg
depends
select
y
make
a
wish

Why does it matter to
think about a
Query
before you
eE
execute it p
P 77
27
n
p
Lots of
led sons

we do hit always have control over stuff
E
ear
to
I can r
jeng'd
s
g
FEI
a

why
use
Igf
E TEEoietEEIifions
qq.fqtf.gd.de
RDBMS
initial use cases thinking Benefits
11
DB integration Buffering
1 Back ...

Event Driven systems
Transform once use
many
o
sto
I
tIIgsEgEe etc
ftp.eamprocessing
3 f
L a Ii
zgiB
iP
KSQL KSTREAMS
ice ...

O oFiEE Stream ProcessingEIEEE.EE
Ehis w Kafka
tt
FFfB abstracts
I
F't
7f
9 to
KSQL KSTREAMS
III gently caaa.sieams3
s5om3...

what happens when you KSQL
CREATE STREAM AS SELECT
CREATE TABLE AS SELECT
Hr
Output
To P l C
Name Default same
2Istream
ta...

is KSQL like 5dL
O
I KSQL
µ 1
111111
1 IT Aggregate
11
I
11TH
t 55
join
i ta
i WT
IT
Filter
o HDDI
0 I connect 0 7
WE 0 si...

why would someone want to use
KSQL then
Mumia
to write
EE
CONTINUOUS
stream processing programs
simply
my Run SQL Queries ...

what does the architecture of Ksa
look like
EE
ii
I I I
I
Ksai clients
if
EEE
SQL Engine
www.gesksQLstdtemeuts
Quenes
rest...

https://www.confluent.io/blog/ksql-in-action-real-time-streaming-etl-from-oracle-
transactional-data
https://www.confluent...

${ "order_id": 1, "customer_name": "Maryanna Andryszczak", "date_of_birth": "1922-06-06T02:21:59Z", "product": "Nut - Walnu...$

CREATE STREAM PUCHASES_GERMANY AS SELECT * FROM PURCHASES
WHERE COUNTRY='Germany';
ksql> LIST TOPICS;
Kafka Topic | Regist...

https://docs.confluent.io/current/ksql/docs/capacity-
planning.html
HttRDWARET Performance
Considerations
MemoryCPU
Resour...

Sizing
considerations
It may need to add more brokers
KSQL Queries consume I produce
from topics
Repartitioning
stateful Q...

What about headless
TIP D Test in
deployment
indeYET.info
gdefsg
ii
JVM
I
af
s
gcog
pgekg t.pg.es
path to confluent bin1kS...

When
to use
KSQL
when to note
Where is
yerp
B
f outed
data
Kafka Et
ggqB.B.qStreams
4 q BEBoBBoaooqBdOEFBdoao.q
BB BB
q.BB...

Kafka Streams
Processer API low level
Imperative customizable
streams API built in abstractions
Functional
KSTREAM
KTABLE
...

L l I I r I i r a
I
don't
care howy
I
want
KafkaStreams
forEvery
language on
the
planet o
I C C l y 7 Your team
tfGo
gggµ
...

anotseha.LT
DO BIG CLUSTERS
A
gI5E
IjE
isagoge
RESOURCE
ISOLATION
PER USE CASE
TEAM RULE
JUST LIKE D BI
U SE Ca SE

eDB
g
f gqt
EFTrapezoidFooloewarTmore
D
yZ bout Kafka
my dog my losing
battle against
the girl
scouts of America O.BEBD.io

https://mockaroo.com/
TEE
earn
you
waivers
jI
EEE EEEaka
more
F Yehaephes
E
l
get
Ksac
what if l want to use differentdats...

When to KSQL & When to Live the KStream (Dani Traphagen, Confluent) Kafka Summit London 2019