Successfully reported this slideshow.
Your SlideShare is downloading. ×

Tim Hall [InfluxData] | InfluxDays Keynote: InfluxDB Roadmap | InfluxDays NA 2021

Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad

Check these out next

1 of 55 Ad
Advertisement

More Related Content

Slideshows for you (20)

Similar to Tim Hall [InfluxData] | InfluxDays Keynote: InfluxDB Roadmap | InfluxDays NA 2021 (20)

Advertisement

More from InfluxData (20)

Recently uploaded (20)

Advertisement

Tim Hall [InfluxData] | InfluxDays Keynote: InfluxDB Roadmap | InfluxDays NA 2021

  1. 1. Tim Hall, VP Products InfluxDB Roadmap
  2. 2. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Agenda ● InfluxDB: Where are we now? ● Meeting developers where they are ● Optimizing for Time to Awesome
  3. 3. Where are we now? InfluxDB
  4. 4. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Common API (Read/Write) InfluxDB Cloud ● Latest innovations available first ● Serverless, managed by InfluxData ● UI for builders, operators ● Available on AWS, Azure, GCP ● Multiple consumption models: free, marketplace, PAYG, and Annual
  5. 5. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. InfluxDB Cloud ● Latest innovations available first ● Serverless, managed by InfluxData ● UI for builders, operators ● Available on AWS, Azure, GCP ● Multiple consumption models: free, marketplace, PAYG, and Annual OSS ● Software; Self-managed ● Open source, community supported ● Single-node only ● Edge deployment or initial development ● Optional: UI for builders, operators
  6. 6. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. InfluxDB Enterprise ● Software; Self-managed ● Licensed and supported ● Single-node through Multi-node for scale out and high-availability ● Advanced security features Cloud ● Latest innovations available first ● Serverless, managed by InfluxData ● UI for builders, operators ● Available on AWS, Azure, GCP ● Multiple consumption models: free, marketplace, PAYG, and Annual OSS ● Software; Self-managed ● Open source, community supported ● Single-node only ● Edge deployment or initial development ● Optional: UI for builders, operators
  7. 7. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Common API (Read/Write) InfluxDB Enterprise ● Software; Self-managed ● Licensed and supported ● Single-node through Multi-node for scale out and high-availability ● Advanced security features Cloud ● Latest innovations available first ● Serverless, managed by InfluxData ● UI for builders, operators ● Available on AWS, Azure, GCP ● Multiple consumption models: free, marketplace, PAYG, and Annual OSS ● Software; Self-managed ● Open source, community supported ● Single-node only ● Edge deployment or initial development ● Optional: UI for builders, operators
  8. 8. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. OSS 1.x → OSS 2.x How to take the limo ride? IN-PLACE UPGRADE OPTIONS ● Automated ○ use influxd upgrade command Automated: https:/ /docs.influxdata.com/influxdb/v2.0/upgrade/v1-to-v2/automatic-upgrade/ INFLUXDB OSS 2.x
  9. 9. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. OSS 1.x → OSS 2.x How to take the limo ride? IN-PLACE UPGRADE OPTIONS ● Automated ○ use influxd upgrade command ● Manual ○ Documented steps for ■ Updating Configuration ■ Creating DBRP mappings ■ Creating authorizations ■ Backing up and migrating the underlying time series data ■ Instructions for what to do with continuous queries Automated: https:/ /docs.influxdata.com/influxdb/v2.0/upgrade/v1-to-v2/automatic-upgrade/ Manual: https:/ /docs.influxdata.com/influxdb/v2.0/upgrade/v1-to-v2/manual-upgrade/ INFLUXDB OSS 2.x
  10. 10. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. OSS 1.x → OSS 2.x How to take the limo ride? IN-PLACE UPGRADE OPTIONS ● Automated ○ use influxd upgrade command ● Manual ○ Documented steps for ■ Updating Configuration ■ Creating DBRP mappings ■ Creating authorizations ■ Backing up and migrating the underlying time series data ■ Instructions for what to do with continuous queries ● Using Docker? ○ Automated and Manual Options for Docker-based installs as of 2.0.4 Automated: https:/ /docs.influxdata.com/influxdb/v2.0/upgrade/v1-to-v2/automatic-upgrade/ Manual: https:/ /docs.influxdata.com/influxdb/v2.0/upgrade/v1-to-v2/manual-upgrade/ Docker: https:/ /docs.influxdata.com/influxdb/v2.0/upgrade/v1-to-v2/docker/ INFLUXDB OSS 2.x
  11. 11. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Continuous Queries (CQ) Replace with Flux Tasks. Leverage docs and Flux TICKscript package 1.x Supported Protocols (Graphite, CollectD, OpenTSDB, UDP, Prometheus Remote Write) Use Telegraf Kapacitor (Subscription API) Dual write to InfluxDB and Kapacitor Chronograf / Grafana (Dashboards) Existing dashboards will continue to work with InfluxQL compatibility API Authentication Auth required by default Admin users Re-assess and manually create admin users in OSS 2.x Platform Support Docker, Windows, ARM builds are available now! What’s New? INFLUXDB OSS 2.x
  12. 12. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Kapacitor 1.6 Released - July 22nd, 2021 ● Goal: enable existing Kapacitor users to continue to leverage their investment with latest editions InfluxDB ● Flux task engine within Kapacitor, side-by-side with TICKscript ○ Allows for definition, deployment, scheduling and management of Flux-based tasks ○ Leverages the v2 API for tasks ○ Added queryFlux node for TICKscripts ○ Alert Handler additions: Zenoss ● Open sourced Kapacitor enterprise security feature ○ Allows Kapacitor, when paired with InfluxDB Enterprise to leverage the same security store
  13. 13. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Flux: TICKscript Compatibility Package ● Most TICKscript functions have similar counterparts in Flux. ● The tickscript package simplifies conversion of TICKscripts to InfluxDB Flux-based tasks. ● import ts "contrib/bonitoo-io/tickscript" ● Provides a set of functions making conversion easier. ● Allows for creation of custom checks executed as Flux tasks and triggering notifications in InfluxDB OSS and Cloud.
  14. 14. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Who and What are we focused on? Teams of Developers & Builders 1. Meeting developers where they are ○ Browser or IDE ○ Supporting languages you love to work with ○ Software or Cloud ○ Direct or Cloud Marketplace ○ Supporting a variety of destinations
  15. 15. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Who and What are we focused on? Teams of Developers & Builders 2. Optimize time to awesome ○ Teams & Collaboration ○ Platform Innovation ○ Observability & Operations ○ Ease Data Collection & Movement 1. Meeting developers where they are ○ Browser or IDE ○ Supporting languages you love to work with ○ Software or Cloud ○ Direct or Cloud Marketplace ○ Supporting a variety of destinations
  16. 16. © 2021  InfluxData Inc. All Rights Reserved. Meeting developers where they are
  17. 17. © 2021  InfluxData Inc. All Rights Reserved. Browser-based Tooling IDE integration with VS Code
  18. 18. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Browser-based Tooling Supporting Teams & Collaboration ● Goal is to provide a single consistent building experience in our platform; developer workbench ● Designed to allow teams to incrementally build resources on the platform ○ Tasks including custom alerts and notifications ○ Queries independent of their destination ○ Scratchpad for code, snippets and other Now
  19. 19. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Browser-based Tooling Supporting Teams & Collaboration ● Goal is to provide a single consistent building experience in our platform; developer workbench ● Designed to allow teams to incrementally build resources on the platform ○ Tasks including custom alerts and notifications ○ Queries independent of their destination ○ Scratchpad for code, snippets and other ● Flexible enough to guide new users and unblock power users ● View multiple related resources in a single view Now
  20. 20. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Browser-based Tooling Supporting Teams & Collaboration ● Goal is to provide a single consistent building experience in our platform; developer workbench ● Designed to allow teams to incrementally build resources on the platform ○ Tasks including custom alerts and notifications ○ Queries independent of their destination ○ Scratchpad for code, snippets and other ● Flexible enough to guide new users and unblock power users ● View multiple related resources in a single view ● Construct and export finished resources to their ultimate destination Now
  21. 21. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. IDE Integration with VS Code Flux Extension ● Goal is to allow developers to build applications in whatever language they wish as rapidly as possible Now
  22. 22. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. IDE Integration with VS Code Flux Extension ● Goal is to allow developers to build applications in whatever language they wish as rapidly as possible ● Browse schema & platform resources ● Rapidly create and evolve resources as necessary Now
  23. 23. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. IDE Integration with VS Code Flux Extension ● Goal is to allow developers to build applications in whatever language they wish as rapidly as possible ● Browse schema & platform resources ● Rapidly create and evolve resources as necessary ● Develop queries and provide the ability to execute and evaluate results from within the IDE ● Leverage source code control capabilities native to IDE environment Now
  24. 24. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Example: Time Series Application Building InfluxDB OSS Development Now
  25. 25. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Example: Time Series Application Building InfluxDB OSS Development Now
  26. 26. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Example: Time Series Application Building InfluxDB OSS Development Now
  27. 27. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Example: Time Series Application Building InfluxDB OSS Development Deployment InfluxDB Cloud Now
  28. 28. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Example: Time Series Application Building InfluxDB OSS Development Deployment InfluxDB Enterprise InfluxDB Cloud Now
  29. 29. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Roadmap Next Browser-based Tooling ● Stacks / Template Creation ● Source code integration ● Promotion between organizations ● Support more destinations
  30. 30. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Roadmap Next Browser-based Tooling IDE-based Tooling ● Stacks / Template Creation ● Source code integration ● Promotion between organizations ● Support more destinations ● Expand resource browsing and creation from IDE
  31. 31. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Roadmap Next InfluxDB Enterprise Browser-based Tooling IDE-based Tooling ● Stacks / Template Creation ● Source code integration ● Promotion between organizations ● Support more destinations ● Expand v2 API compatibility: buckets/delete ● Expand resource browsing and creation from IDE
  32. 32. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Roadmap Next InfluxDB Cloud InfluxDB Enterprise Browser-based Tooling IDE-based Tooling ● Stacks / Template Creation ● Source code integration ● Promotion between organizations ● Support more destinations ● Expand v2 API compatibility: buckets/delete ● Expand regional availability ● Expand resource browsing and creation from IDE
  33. 33. © 2021  InfluxData Inc. All Rights Reserved. Optimize time to awesome
  34. 34. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. InfluxDB Cloud: Explicit Schema Define Buckets with Explicit Schema ● Define schema using ○ CSV ○ JSON ○ Newline delimited JSON ● Blocks non-compliant writes ● Allow for additions Now
  35. 35. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. InfluxDB Cloud: API Invocable Scripts ● Goal is code reusability ○ Define Flux code once ○ Register via /api/v2/scripts or via VS Code Flux Extension with defined parameters Now from(bucket: "default") |> range(start: params.start, stop: params.stop) |> filter(fn: (r) => (r["_measurement"] == "win_cpu")) |> filter(fn: (r) => (r["_field"] == "Percent_User_Time")) |> filter(fn: (r) => (r["host"] == params.host)) |> filter(fn: (r) => (r["instance"] == "_Total")) |> aggregateWindow(every: params.windowPeriod, fn: mean)
  36. 36. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. InfluxDB Cloud: API Invocable Scripts ● Goal is code reusability ○ Define Flux code once ○ Register via /api/v2/scripts or via VS Code Flux Extension with defined parameters ○ Invoke, as desired, with different values supplied as arguments via API or Client Libraries ○ Next: Browser-based support Now from(bucket: "default") |> range(start: params.start, stop: params.stop) |> filter(fn: (r) => (r["_measurement"] == "win_cpu")) |> filter(fn: (r) => (r["_field"] == "Percent_User_Time")) |> filter(fn: (r) => (r["host"] == params.host)) |> filter(fn: (r) => (r["instance"] == "_Total")) |> aggregateWindow(every: params.windowPeriod, fn: mean) curl -X 'POST' "${INFLUX_URL}/api/v2/scripts/${SCRIPT_ID}/invoke" --header "Authorization: Token ${INFLUX_TOKEN}" --header 'Accept: application/csv' --header 'Content-Type: application/json' --data-binary '{ "params": { "start": "2021-10-01" }, { "stop": "2021-10-24" }, { "host": "Destroyer" }, { "windowPeriod": "1d" }}'
  37. 37. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Integrations Flux: Features and Performance Now New
  38. 38. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Integrations Flux: Features and Performance Now New Time Zone Support import "timezone" timezone.location(name: "America/Los_Angeles")
  39. 39. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Integrations Flux: Features and Performance Now New Time Zone Support Performance import "timezone" timezone.location(name: "America/Los_Angeles") ● Pushdowns ● Function Optimizations ○ Pivot ○ Derivative ● Compiled Std Library ● CSV creation
  40. 40. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Key Themes in 2022 Teams & Collaboration Tenant Observability & Operations Platform Innovation Ease Data Collection & Movement
  41. 41. © 2021  InfluxData Inc. All Rights Reserved. Expanding Support for Teams & Collaboration ● Single email can be used for multiple accounts ● Multiple organizations can be created within an account ● Within an account, access restrictions to each org by email ● Role can be different in each account or org ● More fine-grained resource permissions coming later - e.g. access to a particular dashboard Next My personal account Tim’s Org Team account Team dev org Team prod org tim@influxdata.com
  42. 42. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. InfluxDB Cloud: Triggers ● Goal is to use events to invoke scripts ● Events can be “write to a bucket” ● Use cases: ○ Late arrivals of data ○ Streamlined alerting Next QUERY ACT Scheduled Task / Alert check Notificatio n systems WRITE Notificatio n systems WRITE WRITE ACT Triggers
  43. 43. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. • Enable distributed transaction tracing (APM), • Log archival, • Call records, • Network trace routes, • OpenTelemetry, • and more…. InfluxDB Cloud: Extreme Cardinality Use Cases Next
  44. 44. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. InfluxDB Cloud: Observability ● Goal is to provide self-service access to usage and operations: ○ Usage ○ Cardinality ○ Write errors ● User configurable templates for dashboards & alerts Now
  45. 45. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. InfluxDB Enterprise: Observability & Operations ● Expanded operational metrics include: ○ data size on disk per measurement ○ cardinality per measurement ○ data written metrics by measurement and/or username ○ series creation metrics ○ license expiration Now
  46. 46. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. InfluxDB Enterprise: Observability & Operations ● Expanded operational metrics include: ○ data size on disk per measurement ○ cardinality per measurement ○ data written metrics by measurement and/or username ○ series creation metrics ○ license expiration ● Operational improvements included in the latest release: ○ Significant reduction in memory usage when using tsi1 index ○ Added retry with exponential back-off to anti-entropy repair ○ Incremental backup/restore improvements ■ You can now restore data with a new retention policy into an existing database. ■ You can override the duration of a retention policy contained within the backup while restoring. So, if you backed-up a database with a 30 day retention period, you can restore this and extend the retention period to any duration you wish, including infinite. Now
  47. 47. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Ease Data Collection & Movement Agent-based Cloud-native Bulk Import & Replication to Cloud
  48. 48. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Agent-based: Telegraf Configuration • Creating a new Telegraf configuration now supports all input plug-ins Now
  49. 49. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Agent-based: Telegraf Configuration • Creating a new Telegraf configuration now supports all input plug-ins • Sources page supports adding plug-in configurations to existing configurations as well as creating new ones Now
  50. 50. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Agent-based: Telegraf 1.21 Planned Release: Dec 2021 New Plugins ● Inputs ○ Tencent Cloud Monitoring Input ○ OpenStack Input ● Exernal ○ Oracle ○ DB/2 ● Outputs ○ Azure Event Hubs Output ● Processors/Parsers/Aggregators ○ Starlark Aggregator Features ● Implement new InfluxDB Line Protocol parser for performance improvements *merged Next
  51. 51. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Configure MQTT Consumer within InfluxDB Cloud Fewer moving parts Support rapid integration of IoT Data Future expansion to include Cloud-based messaging services Cloud-native: MQTT Next
  52. 52. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Bulk Data Import Support migration from OSS or Enterprise to Cloud Bulk Import TSM files Next CLI tooling to facilitate process
  53. 53. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Configuration-based replication to Cloud Durable Data Replication Bucket-level Replication Next InfluxDB OSS InfluxDB Enterprise InfluxDB Cloud Database-level Replication
  54. 54. © 2021  InfluxData Inc. All Rights Reserved. © 2021  InfluxData Inc. All Rights Reserved. Optimize time to awesome ● Teams & Collaboration ● Platform Innovation ● Observability & Operations ● Ease Data Collection & Movement Meeting developers where they are ● Browser or IDE ● Supporting languages you love to work with ● Software or Cloud ● Direct or Cloud Marketplace ● Supporting a variety of destinations Summary
  55. 55. Questions

×