Modern data processing applications built on Kafka and InfluxDB deliver the performance, reliability, and flexibility that customers need for robust real-time data pipeline solutions. As the saying goes, the pipeline is greater than the sum of its Kafka and InfluxDB parts. In this session, Russ Savage, Director of Product Management at InfluxData will discuss basic concepts of integrating Kafka and InfluxDB while highlighting how companies are creating fault-tolerant, scalable and fast data pipelines with the power of InfluxDB and Kafka.

1. Russ Savage, Product Manager
Aug 2021
Kafka & InfluxDB: BFFs for
Enterprise DataApplications

2. © 2021 InfluxData. All rights reserved.
InfluxDB Cloud runs over
80 production Kafka
nodes for data ingestion.

3. © 2021 InfluxData. All rights reserved.
Visualization
Alerts
Triggers
Metrics
Logs
Traces
Events
InfluxDB Cloud is the platform for metrics & events

4. © 2021 InfluxData. All rights reserved.
InfluxDB Cloud
Enables organizations to make
cost–disruptive decisions
on high volumes
of time-sensitive data

5. © 2021 InfluxData. All rights reserved.
The age of instrumentation
Sensors in the
physical world (IoT)
Instrumentation of
virtual world (DevOps)

6. © 2021 InfluxData. All rights reserved.
AUTOMATE
LEARN
OBSERVE
INSTRUMENT
The move to autonomy

7. © 2021 InfluxData. All rights reserved.
Characteristics
of the data
– Time-stamped
– Generated in regular (metric) and
irregular (event) time periods
– Huge volumes
– Real time and time sensitive

8. © 2021 InfluxData. All rights reserved.
Volume
and variety
Logs and
web pages
Orders and
order lines
SQL SEARCH BIG DATA
Metrics
and events
TIME SERIES
Emergence of a new category

9. © 2021 InfluxData. All rights reserved.
“Better business insights correlating business process SLAs and system metrics”
“Meeting business uptime SLAs by enabling self-healing and self-scaling systems”
“Achieving business results by matching product usage and customer expectations”
“Moving from reactive to proactive customer support”
“Revenue assurance during Cyber 5 Holiday Weekend”
Solving business problems

10. © 2021 InfluxData. All rights reserved.
InfluxData
Platform

11. © 2021 InfluxData. All rights reserved.
Powerful Analytics
OPEN SOURCE FLUX
LANGUAGE TO SEE ACROSS
TIME
– Designed for time series analysis
– Easy to share, easy to extend
– Multi data source
– Open Source (MIT license)
– Easy to get started but powerful to
scale

12. © 2021 InfluxData. All rights reserved.
Core Focus:
Developers and
builders
– Developer happiness
– Time to awesome
– Ease of scale-out & deployment

13. © 2021 InfluxData. All rights reserved.
THE TIME SERIES PLATFORM FOR YOUR DATA APPLICATIONS
ELASTIC SERVICES
Ingestion, Visualization, Robust Query & Analytics, Alert & Notifications
PLATFORM SERVICES
Available, Durable, Optimized, Secure, Monitored
POWERFUL REST API AND TOOLING
HTTP REST API, Command line interface, Dedicated client libraries for your language
SUPPORT SERVICES
Inline Assistance, Community Support, Email Support, Phone Support, Customer Success
InfluxDB Cloud

14. © 2021 InfluxData. All rights reserved.
Enterprise data
applications need
reliable ingestion
architectures

15. © 2021 InfluxData. All rights reserved.
InfluxDB Cloud
Datacenter 0
Relay
Datacenter N
Relay
…

16. © 2021 InfluxData. All rights reserved.
• The open-source agent
for collecting metrics
• Driven by the community
(600+ contributors)
• Simple to configure,
extremely flexible

17. © 2021 InfluxData. All rights reserved.
Telegraf can be used as a producer and consumer

18. © 2021 InfluxData. All rights reserved.
InfluxDB Cloud

19. © 2021 InfluxData. All rights reserved.

20. © 2021 InfluxData. All rights reserved.
Telegraf can also monitor your Kafka cluster
• You can leverage Jolokia + Kafka Configuration
• You can leverage Burrow

21. © 2021 InfluxData. All rights reserved.
IoT monitoring
Software
Some of our customers

22. Created a solution that
• standardizes internal operations
• improves company-wide monitoring
practices
• enhances customer experience
by collecting customer and infrastructure
metrics supporting the Firefox web browser
DEVOPS MONITORING

23. Created a solution that
• gives their customers insight into solar
energy production and battery storage
• enables predictive maintenance ensuring
greater customer satisfaction
by storing and analyzing all the sensor data
derived from solar panel and battery sensors
IOT ANALYTICS

24. Created a solution that
• creates a better customer experience across
their web and mobile properties
• reduces downtime attributed to CICD
• provides faster root–cause analysis
by storing, analyzing and visualizing click stream
data, container and application metrics across all
web infrastructure services
REAL USER MONITORING (RUM)

25. © 2021 InfluxData. All rights reserved.
Summary
Enable organizations to make
cost–disruptive decisions
on high volumes
of time-sensitive data
INFLUXDB CLOUD: THE TIME SERIES PLATFORM FOR YOUR DATA APPLICATIONS

26. © 2021 InfluxData. All rights reserved.
Summary
InfluxDB and Kafka help
build Robust Enterprise
Data Applications

27. © 2021 InfluxData. All rights reserved.
Learn more at
influxdata.com

28. Thank You