Slides for my BLD() Tech Conference 2021 talk: Data exploration with KSQL.

1. .BLD() TECH
CONFERENCE
DATA EXPLORATION
WITH KSQL
GILLIS J. DE NIJS

2. Data exploration with KSQL | Gillis J. de Nijs | 25 November 2021 2
Public © Capgemini 2021. All rights reserved |
• Introduction
• Overview
• Demo
SCHEDULE

3. Data exploration with KSQL | Gillis J. de Nijs | 25 November 2021 3
Public © Capgemini 2021. All rights reserved |
INTRODUCTION

4. Data exploration with KSQL | Gillis J. de Nijs | 25 November 2021 4
Public © Capgemini 2021. All rights reserved |
• Gillis J. de Nijs
@mrjink
• Senior Software Engineer @ Capgemini
• No prior knowledge of Kafka
WHO AM I?

5. Data exploration with KSQL | Gillis J. de Nijs | 25 November 2021 5
Public © Capgemini 2021. All rights reserved |
• open-source
• distributed
• event streaming platform
WHAT IS KAFKA?

6. Data exploration with KSQL | Gillis J. de Nijs | 25 November 2021 6
Public © Capgemini 2021. All rights reserved |
Topic 1, 1 partition
WHAT IS KAFKA?
1 2 3 4 5 6 7 8 9
Producer n
Producer 3
Producer 2
Producer 1
Consumer n
Consumer 3
Consumer 2
Consumer 1

7. Data exploration with KSQL | Gillis J. de Nijs | 25 November 2021 7
Public © Capgemini 2021. All rights reserved |
Topic 1, 2 partitions
WHAT IS KAFKA?
1 2 5 6 7 12 13 14 18 19
Producer n
Producer 3
Producer 2
Producer 1
Consumer n
Consumer 3
Consumer 2
Consumer 1
3 4 8 9 10 11 15 16 17

8. Data exploration with KSQL | Gillis J. de Nijs | 25 November 2021 8
Public © Capgemini 2021. All rights reserved |
• Use Docker!
• I use Confluent Platform (trial)
https://docs.confluent.io/platform/current/quickstart/ce-docker-quickstart.html
HOW TO RUN KAFKA

9. Data exploration with KSQL | Gillis J. de Nijs | 25 November 2021 9
Public © Capgemini 2021. All rights reserved |
OVERVIEW

10. Exploring data with KSQL | Gillis J. de Nijs | 25 November 2021 10
Company Confidential © Capgemini 2021. All rights reserved |
OVERVIEW
What we’re going to do today

11. Data exploration with KSQL | Gillis J. de Nijs | 25 November 2021 11
Public © Capgemini 2021. All rights reserved |
DEMO

12. Exploring data with KSQL | Gillis J. de Nijs | 25 November 2021 12
Company Confidential © Capgemini 2021. All rights reserved |
STREAMING FROM TWITTER
Connect to streaming API

13. Exploring data with KSQL | Gillis J. de Nijs | 25 November 2021 13
Company Confidential © Capgemini 2021. All rights reserved |
EXPLORING TOPICS
Let’s see what we’re recording

14. Exploring data with KSQL | Gillis J. de Nijs | 25 November 2021 14
Company Confidential © Capgemini 2021. All rights reserved |
KSQL QUERIES
Some examples

15. Data exploration with KSQL | Gillis J. de Nijs | 25 November 2021 15
Public © Capgemini 2021. All rights reserved |
https://kafka.apache.org/
https://docs.confluent.io/platform/current/quickstart/ce-docker-quickstart.html
https://developer.twitter.com/en/products/twitter-api
https://github.com/mrjink-medium/bldtc_2021
LINKS

16. capgemini.com
GET THE
FUTURE
YOU WANT

17. This presentation contains information that may be privileged or confidential and
is the property of the Capgemini Group.
Copyright © 2021 Capgemini. All rights reserved.
Capgemini is a global leader in partnering with companies to transform and manage their
business by harnessing the power of technology. The Group is guided everyday by its
purpose of unleashing human energy through technology for an inclusive and sustainable
future. It is a responsible and diverse organization of 270,000 team members in nearly 50
countries. With its strong 50 year heritage and deep industry expertise, Capgemini is
trusted by its clients to address the entire breadth of their business needs, from strategy
and design to operations, fuelled by the fast evolving and innovative world of cloud, data,
AI, connectivity, software, digital engineering and platforms. The Group reported in 2020
global revenues of €16 billion.
About Capgemini
Get the Future You Want | www.capgemini.com