Paul Dix
Founder & CTO
paul@influxdata.com
@pauldix
Why Time Series &
InfluxDB
© 2021 InfluxData Inc. All Rights Reserved.
2
© 2021 InfluxData Inc. All Rights Reserved.
If you want to observe
anything, you’re
collecting time stamped
data
© 2021 InfluxData Inc. All Rights Reserved.
3
© 2021 InfluxData Inc. All Rights Reserved.
If you want to analyze and
learn from that data,
you’re working with time
series
© 2021 InfluxData Inc. All Rights Reserved.
4
© 2021 InfluxData Inc. All Rights Reserved.
All data is based in time
© 2021 InfluxData Inc. All Rights Reserved.
5
© 2021 InfluxData Inc. All Rights Reserved.
Everything that can be
instrumented will be
instrumented.
© 2021 InfluxData Inc. All Rights Reserved.
6
© 2021 InfluxData Inc. All Rights Reserved.
Everything that can be
optimized will be
optimized.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
A few interesting use cases…
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
12
© 2021 InfluxData Inc. All Rights Reserved.
Many others in vertical
farming, improved
water use, and energy
© 2021 InfluxData Inc. All Rights Reserved.
13
© 2021 InfluxData Inc. All Rights Reserved.
What changed over the
last 10-20 years?
© 2021 InfluxData Inc. All Rights Reserved.
14
© 2021 InfluxData Inc. All Rights Reserved.
Wireless speeds and
coverage
© 2021 InfluxData Inc. All Rights Reserved.
15
© 2021 InfluxData Inc. All Rights Reserved.
Cheap sensors
© 2021 InfluxData Inc. All Rights Reserved.
16
© 2021 InfluxData Inc. All Rights Reserved.
Compute power at the
edge
© 2021 InfluxData Inc. All Rights Reserved.
17
© 2021 InfluxData Inc. All Rights Reserved.
Enabling hardware and
network requires
enabling software.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
19
© 2021 InfluxData Inc. All Rights Reserved.
Time series are historical
observations and
predictions of the future.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
Two kinds of time series
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
32
© 2021 InfluxData Inc. All Rights Reserved.
InfluxDB will be the
home for time series
data of all kinds.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
Four common areas of functionality
• Collect & Transform
• Store & Query
• Process, Monitor, Alert, and Act
• Manage & Secure
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
Three user experiences
• CLI, API, client libraries
• UI
• VS Code
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
Functional Areas
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
Collect
Transform, monitor at the edge
© 2021 InfluxData Inc. All Rights Reserved.
Serialization
Format
Transform
Messaging
System
InfluxDB
Telegraf
© 2021 InfluxData Inc. All Rights Reserved.
Serialization
Format
Transform
Messaging
System
InfluxDB
Telegraf
© 2021 InfluxData Inc. All Rights Reserved.
Serialization
Format
Transform
Messaging
System
InfluxDB
© 2021 InfluxData Inc. All Rights Reserved.
Serialization
Format
Transform
Messaging
System
InfluxDB
JSON
Protobuf
CSV
Line Protocol
Parquet
TSM
© 2021 InfluxData Inc. All Rights Reserved.
Serialization
Format
Transform
Messaging
System
InfluxDB
JSON
Protobuf
CSV
Line Protocol
Parquet
TSM
MQTT
Kafka
Kinesis
Azure Event Hubs
GCP Pub/Sub
© 2021 InfluxData Inc. All Rights Reserved.
Serialization
Format
Transform
Messaging
System
InfluxDB
JSON
Protobuf
CSV
Line Protocol
Parquet
TSM
MQTT
Kafka
Kinesis
Azure Event Hubs
GCP Pub/Sub
Flux
Python
Javascript/Typescript
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
Store
Distributed, federated, query
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
Query
• Flux
• InfluxQL
• SQL (next year)
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
InfluxDB IOx
• MIT & Apache 2 License
• New core in Rust
• Apache Arrow
• Apache Arrow Datafusion
• Apache Parquet
• Unlimited cardinality
• Object storage durability
• Bulk import/export
• Embedded Javascript/Typescript
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
IOx Router
Kafka
IOx Query Server IOx Query Server
IOx Router IOx Router
Object Storage
InfluxDB IOx Cloud Architecture
© 2021 InfluxData Inc. All Rights Reserved.
InfluxDB Cloud
InfluxDB InfluxDB InfluxDB InfluxDB InfluxDB
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
Process
Monitor, alert, act
© 2021 InfluxData Inc. All Rights Reserved.
Serialization
Format
Transform
Messaging
System
InfluxDB
Process, monitor,
alert, act
© 2021 InfluxData Inc. All Rights Reserved.
Serialization
Format
Transform
Messaging
System
InfluxDB
Process, monitor,
alert, act
Flux
Python
Javascript/Typescript
© 2021 InfluxData Inc. All Rights Reserved.
InfluxDB Cloud
InfluxDB InfluxDB InfluxDB InfluxDB InfluxDB
Push processing
to the edge!
© 2021 InfluxData Inc. All Rights Reserved.
52
© 2021 InfluxData Inc. All Rights Reserved.
There is overlap in
collect, store, and
process!
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
Manage
Secure, audit, inspect
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
Manage
• Security policies
• Usage policies
• Deployment of Tasks
• Audit logging
• Schema locking & enforcement
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
Developer experience
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
63
© 2021 InfluxData Inc. All Rights Reserved.
GitOps flows
© 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
Next Year
• InfluxDB IOx
• SQL support
• Unlimited Cardinality
• Ingest from messaging systems
• MQTT
• InfluxDB at the edge
• Tasks in Python & Javascript
• Bulk import/export
• Developer tooling
© 2021 InfluxData Inc. All Rights Reserved.
Thank You
paul@influxdata.com
@pauldix

Paul Dix [InfluxData] | InfluxDays Keynote: Future of InfluxDB | InfluxDays NA 2021

  • 1.
    Paul Dix Founder &CTO paul@influxdata.com @pauldix Why Time Series & InfluxDB
  • 2.
    © 2021 InfluxDataInc. All Rights Reserved. 2 © 2021 InfluxData Inc. All Rights Reserved. If you want to observe anything, you’re collecting time stamped data
  • 3.
    © 2021 InfluxDataInc. All Rights Reserved. 3 © 2021 InfluxData Inc. All Rights Reserved. If you want to analyze and learn from that data, you’re working with time series
  • 4.
    © 2021 InfluxDataInc. All Rights Reserved. 4 © 2021 InfluxData Inc. All Rights Reserved. All data is based in time
  • 5.
    © 2021 InfluxDataInc. All Rights Reserved. 5 © 2021 InfluxData Inc. All Rights Reserved. Everything that can be instrumented will be instrumented.
  • 6.
    © 2021 InfluxDataInc. All Rights Reserved. 6 © 2021 InfluxData Inc. All Rights Reserved. Everything that can be optimized will be optimized.
  • 7.
    © 2021 InfluxDataInc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. A few interesting use cases…
  • 8.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 9.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 10.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 11.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 12.
    © 2021 InfluxDataInc. All Rights Reserved. 12 © 2021 InfluxData Inc. All Rights Reserved. Many others in vertical farming, improved water use, and energy
  • 13.
    © 2021 InfluxDataInc. All Rights Reserved. 13 © 2021 InfluxData Inc. All Rights Reserved. What changed over the last 10-20 years?
  • 14.
    © 2021 InfluxDataInc. All Rights Reserved. 14 © 2021 InfluxData Inc. All Rights Reserved. Wireless speeds and coverage
  • 15.
    © 2021 InfluxDataInc. All Rights Reserved. 15 © 2021 InfluxData Inc. All Rights Reserved. Cheap sensors
  • 16.
    © 2021 InfluxDataInc. All Rights Reserved. 16 © 2021 InfluxData Inc. All Rights Reserved. Compute power at the edge
  • 17.
    © 2021 InfluxDataInc. All Rights Reserved. 17 © 2021 InfluxData Inc. All Rights Reserved. Enabling hardware and network requires enabling software.
  • 18.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 19.
    © 2021 InfluxDataInc. All Rights Reserved. 19 © 2021 InfluxData Inc. All Rights Reserved. Time series are historical observations and predictions of the future.
  • 20.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 21.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 22.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 23.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 24.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 25.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 26.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 27.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 28.
    © 2021 InfluxDataInc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Two kinds of time series
  • 29.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 30.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 31.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 32.
    © 2021 InfluxDataInc. All Rights Reserved. 32 © 2021 InfluxData Inc. All Rights Reserved. InfluxDB will be the home for time series data of all kinds.
  • 33.
    © 2021 InfluxDataInc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Four common areas of functionality • Collect & Transform • Store & Query • Process, Monitor, Alert, and Act • Manage & Secure
  • 34.
    © 2021 InfluxDataInc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Three user experiences • CLI, API, client libraries • UI • VS Code
  • 35.
    © 2021 InfluxDataInc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Functional Areas
  • 36.
    © 2021 InfluxDataInc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Collect Transform, monitor at the edge
  • 37.
    © 2021 InfluxDataInc. All Rights Reserved. Serialization Format Transform Messaging System InfluxDB Telegraf
  • 38.
    © 2021 InfluxDataInc. All Rights Reserved. Serialization Format Transform Messaging System InfluxDB Telegraf
  • 39.
    © 2021 InfluxDataInc. All Rights Reserved. Serialization Format Transform Messaging System InfluxDB
  • 40.
    © 2021 InfluxDataInc. All Rights Reserved. Serialization Format Transform Messaging System InfluxDB JSON Protobuf CSV Line Protocol Parquet TSM
  • 41.
    © 2021 InfluxDataInc. All Rights Reserved. Serialization Format Transform Messaging System InfluxDB JSON Protobuf CSV Line Protocol Parquet TSM MQTT Kafka Kinesis Azure Event Hubs GCP Pub/Sub
  • 42.
    © 2021 InfluxDataInc. All Rights Reserved. Serialization Format Transform Messaging System InfluxDB JSON Protobuf CSV Line Protocol Parquet TSM MQTT Kafka Kinesis Azure Event Hubs GCP Pub/Sub Flux Python Javascript/Typescript
  • 43.
    © 2021 InfluxDataInc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Store Distributed, federated, query
  • 44.
    © 2021 InfluxDataInc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Query • Flux • InfluxQL • SQL (next year)
  • 45.
    © 2021 InfluxDataInc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. InfluxDB IOx • MIT & Apache 2 License • New core in Rust • Apache Arrow • Apache Arrow Datafusion • Apache Parquet • Unlimited cardinality • Object storage durability • Bulk import/export • Embedded Javascript/Typescript
  • 46.
    © 2021 InfluxDataInc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. IOx Router Kafka IOx Query Server IOx Query Server IOx Router IOx Router Object Storage InfluxDB IOx Cloud Architecture
  • 47.
    © 2021 InfluxDataInc. All Rights Reserved. InfluxDB Cloud InfluxDB InfluxDB InfluxDB InfluxDB InfluxDB
  • 48.
    © 2021 InfluxDataInc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Process Monitor, alert, act
  • 49.
    © 2021 InfluxDataInc. All Rights Reserved. Serialization Format Transform Messaging System InfluxDB Process, monitor, alert, act
  • 50.
    © 2021 InfluxDataInc. All Rights Reserved. Serialization Format Transform Messaging System InfluxDB Process, monitor, alert, act Flux Python Javascript/Typescript
  • 51.
    © 2021 InfluxDataInc. All Rights Reserved. InfluxDB Cloud InfluxDB InfluxDB InfluxDB InfluxDB InfluxDB Push processing to the edge!
  • 52.
    © 2021 InfluxDataInc. All Rights Reserved. 52 © 2021 InfluxData Inc. All Rights Reserved. There is overlap in collect, store, and process!
  • 53.
    © 2021 InfluxDataInc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Manage Secure, audit, inspect
  • 54.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 55.
    © 2021 InfluxDataInc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Manage • Security policies • Usage policies • Deployment of Tasks • Audit logging • Schema locking & enforcement
  • 56.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 57.
    © 2021 InfluxDataInc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Developer experience
  • 58.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 59.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 60.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 61.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 62.
    © 2021 InfluxDataInc. All Rights Reserved.
  • 63.
    © 2021 InfluxDataInc. All Rights Reserved. 63 © 2021 InfluxData Inc. All Rights Reserved. GitOps flows
  • 64.
    © 2021 InfluxDataInc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Next Year • InfluxDB IOx • SQL support • Unlimited Cardinality • Ingest from messaging systems • MQTT • InfluxDB at the edge • Tasks in Python & Javascript • Bulk import/export • Developer tooling
  • 65.
    © 2021 InfluxDataInc. All Rights Reserved. Thank You paul@influxdata.com @pauldix