Gary Fowler [InfluxData] | InfluxDB Scripting Languages | InfluxDays 2022

InfluxData
InfluxDataInfluxData
Gary Fowler [InfluxData] | InfluxDB Scripting Languages | InfluxDays 2022
The Scripting
Languages of InfluxDB
A look at the scripting language options that can be
used with InfluxDB in the past, present, and future.
Gary Fowler
Product Manager
Gary Fowler is a Product Manager for InfluxDB Cloud at
InfluxData. Gary has nearly three decades of experience
in product management, program management,
software engineering and sales engineering. He
previously held Vice President roles in Product and
Engineering at iPass, Airborne Interactive and Lilee
Systems. Gary resides in Holualoa, Hawaii.
InfluxDB Scripting Languages
Agenda
1. Script Language Options with InfluxDB - past,
present, and future
2. Benefits of each Language
3. The new Script Editor in InfluxDB Cloud
DEVELOPER HAPPINESS
TIME TO AWESOME
Developers
Cloud native real time applications
requiring time series data store
Scripting Languages –
Doing more than Query
Learning curve:
STEEP
Learning curve:
LITTLE TO NONE
Capabilities:
QUERY,
TRANSFORM &
ACT
(POWERFUL)
Capabilities:
QUERY ONLY
(EASY)
INFLUXQL
SQL*
FLUX
* Coming soon
Flux
• Functional Scripting
Language
• Optimized for ETL,
monitoring, and alerting
• Not just for queries, but
also for transforming and
triggering actions
• Used with OSS, Enterprise,
& current Cloud product
Influx Query
Language (InfluxQL)
• SQL-like query language for
working with data in
InfluxDB databases
• InfluxDB’s first Query
Language
• Standard SQL functions +
time series extensions
• /query API available with
OSS, Enterprise, and Cloud
• Cloud UI support coming
soon
Coming soon:
Native SQL
• IOx powered InfluxDB
Cloud brings SQL support
• SQL editor within InfluxDB
Cloud in development
(Coming Soon)
• PostgresQL Wire Protocol
Support
Future
Flux 1.0 • First official versioned
release
Whats in it for the
customer?
Planned: InfluxQL
Cloud Support
• InfluxQL Editor option in
InfluxDB Cloud
• Easier transition from OSS
or Enterprise
Future: Tasks in
your language
• Use Python or Javascript
within InfluxDB
• Create downsampling and
other tasks that can run
inside InfluxDB cloud
• Data stays internal and in
the cloud
Future: Javascript
Tasks
• Use Javascript within the
Cloud UI
• Create downsampling and
other tasks that can run
inside InfluxDB cloud
• Data stays internal and in
the cloud
Choosing a Language
Selection Factors
Flux SQL InfluxQL Python/Javascript
Need most power and
flexibility
Transition from
relational DB
Already using with OSS
& Enterprise
Python or Javascript
Expertise
Need to transform or
otherwise manipulate
data, not just query it
Previous SQL Expertise Previous InfluxQL or
SQL Expertise
Want to move existing
Python code into the
Cloud
Need to combine data
sources
Only need to do fast,
simple queries
Need to make REST or
other API calls
Easier API transition
from other SQL DBs
Selection Factors
Flux SQL InfluxQL Python/Javascri
pt
Need most power and
flexibility
Transition from
relational DB
Already using with OSS
& Enterprise
Python or Javascript
Expertise
Need to transform or
otherwise manipulate
data, not just query it
Previous SQL Expertise Previous InfluxQL or
SQL Expertise
Want to move existing
Python code into the
Cloud
Need to combine data
sources
Only need to do fast,
simple queries
Need to make REST or
other API calls
Easier API transition
from other SQL DBs
Examples of ways you can use Flux
The Power of Flux
Query from Multiple
Data Sources
import "sql"
import "influxdata/influxdb/secrets"
username = secrets.get(key:
"POSTGRES_USER")
password = secrets.get(key:
"POSTGRES_PASS")
sql.from(
driverName: "postgres",
dataSourceName:
"postgresql://${username}:${password}@loc
alhost:5432",
query: "SELECT * FROM example_table",
)
Make outbound
API calls
import "json"
import "http"
lastReported =
from(bucket: "example-bucket")
|> range(start: -1m)
|> filter(fn: (r) => r._measurement == "statuses")
|> last()
|> findColumn(fn: (key) => true, column: "_level")
http.post(
url: "http://myawsomeurl.com/api/notify",
headers: {Authorization: "Bearer mySuPerSecRetTokEn",
"Content-type": "application/json"},
data: json.encode(v: lastReported[0]),
)
Downsample Data
option task = {name: "Downsampling CPU",
every: 1m}
data = from(bucket: "my-bucket")
|> range(start: -2h)
|> filter(fn: (r) =>
(r["_measurement"] == "cpu"))
|> filter(fn: (r) =>
(r["_field"] == "usage_user"))
data
|> aggregateWindow(every: 10s, fn: mean,
createEmpty: false)
|> set(key: "agg_type",value: "mean_cpu")
|> to(bucket: "downsampled", org:
"my-org", tagColumns: ["agg_type"])
Flux vs. Custom
Application
Eliminates the need to
extract/download a large
dataset to your own
application for evaluation and
transformation
Script Editing
New Script Editor - InfluxDB Cloud
➔ Multi-Language Editing
➔ Instructional - learn while using
➔ Instructional - help users write
more performant queries
➔ Schema Browsing
➔ Faster Iteration
➔ Loading/Saving/Re-using Scripts
➔ Remove forced visual selection
vs. script editing choice
➔ Invokable Script Editing
Why a new Script Editor?
New Script Editor
Language Support
• Flux Supported
• SQL In-Development
• InfluxQL Planned
• Python Planned
• Javascript Planned
Instructional Schema Browser
1. Helps introduce new user’s
to InfluxDB Elements via
Contextual Help
2. Helps users understand the
shape of their data &
hierarchical structure
Schema — > Flux Sync
• Do queries with no
scripting knowledge
• Shows you the script
that gets created based
on your selections to
help you learn
• Add code to your script
without losing the ability
to choose filters from
the schema browser
Load and Save Scripts
• Long awaited feature of the Script Editor
• Basic Load/Save for now, but planning to add versioning,
labels/folder organization, and permissions in the future
Edit Invokable
Scripts
You can use the script editor
to edit invocable scripts and
gather their URL
Improved
Performance
Improved Performance,
especially when working with
larger Datasets
VS Code Extension You can use the Flux VS
Code extension to edit Flux
PostgreSQL Wire
Protocol
Write SQL scripts/queries
from your own tools that
support the PostgreSQL Wire
Protocol
T H A N K Y O U
1 of 35

Recommended

Internationalizing The New York Times by
Internationalizing The New York TimesInternationalizing The New York Times
Internationalizing The New York TimesScott Taylor
1.9K views53 slides
Michael Hall [InfluxData] | Become an InfluxDB Pro in 20 Minutes | InfluxDays... by
Michael Hall [InfluxData] | Become an InfluxDB Pro in 20 Minutes | InfluxDays...Michael Hall [InfluxData] | Become an InfluxDB Pro in 20 Minutes | InfluxDays...
Michael Hall [InfluxData] | Become an InfluxDB Pro in 20 Minutes | InfluxDays...InfluxData
17 views37 slides
Building a fully managed stream processing platform on Flink at scale for Lin... by
Building a fully managed stream processing platform on Flink at scale for Lin...Building a fully managed stream processing platform on Flink at scale for Lin...
Building a fully managed stream processing platform on Flink at scale for Lin...Flink Forward
853 views56 slides
Experiences using CouchDB inside Microsoft's Azure team by
Experiences using CouchDB inside Microsoft's Azure teamExperiences using CouchDB inside Microsoft's Azure team
Experiences using CouchDB inside Microsoft's Azure teamBrian Benz
5.6K views32 slides
Chef vs Puppet vs Ansible vs SaltStack | Configuration Management Tools Compa... by
Chef vs Puppet vs Ansible vs SaltStack | Configuration Management Tools Compa...Chef vs Puppet vs Ansible vs SaltStack | Configuration Management Tools Compa...
Chef vs Puppet vs Ansible vs SaltStack | Configuration Management Tools Compa...Edureka!
5.7K views29 slides
Apache Drill (ver. 0.2) by
Apache Drill (ver. 0.2)Apache Drill (ver. 0.2)
Apache Drill (ver. 0.2)Camuel Gilyadov
2.2K views28 slides

More Related Content

Similar to Gary Fowler [InfluxData] | InfluxDB Scripting Languages | InfluxDays 2022

DevOps Fest 2020. immutable infrastructure as code. True story. by
DevOps Fest 2020. immutable infrastructure as code. True story.DevOps Fest 2020. immutable infrastructure as code. True story.
DevOps Fest 2020. immutable infrastructure as code. True story.Vlad Fedosov
157 views52 slides
Real Time Streaming with Flink & Couchbase by
Real Time Streaming with Flink & CouchbaseReal Time Streaming with Flink & Couchbase
Real Time Streaming with Flink & CouchbaseManuel Hurtado
883 views23 slides
Devops with Python by Yaniv Cohen DevopShift by
Devops with Python by Yaniv Cohen DevopShiftDevops with Python by Yaniv Cohen DevopShift
Devops with Python by Yaniv Cohen DevopShiftYaniv cohen
652 views122 slides
Case Study : InfluxDB by
Case Study : InfluxDBCase Study : InfluxDB
Case Study : InfluxDBomkarpowar4
37 views12 slides
Vinay Kumar [InfluxData] | InfluxDB API Overview | InfluxDays 2022 by
Vinay Kumar [InfluxData] | InfluxDB API Overview  | InfluxDays 2022Vinay Kumar [InfluxData] | InfluxDB API Overview  | InfluxDays 2022
Vinay Kumar [InfluxData] | InfluxDB API Overview | InfluxDays 2022InfluxData
31 views22 slides
Top 10 dev ops tools (1) by
Top 10 dev ops tools (1)Top 10 dev ops tools (1)
Top 10 dev ops tools (1)yalini97
74 views23 slides

Similar to Gary Fowler [InfluxData] | InfluxDB Scripting Languages | InfluxDays 2022(20)

DevOps Fest 2020. immutable infrastructure as code. True story. by Vlad Fedosov
DevOps Fest 2020. immutable infrastructure as code. True story.DevOps Fest 2020. immutable infrastructure as code. True story.
DevOps Fest 2020. immutable infrastructure as code. True story.
Vlad Fedosov157 views
Real Time Streaming with Flink & Couchbase by Manuel Hurtado
Real Time Streaming with Flink & CouchbaseReal Time Streaming with Flink & Couchbase
Real Time Streaming with Flink & Couchbase
Manuel Hurtado883 views
Devops with Python by Yaniv Cohen DevopShift by Yaniv cohen
Devops with Python by Yaniv Cohen DevopShiftDevops with Python by Yaniv Cohen DevopShift
Devops with Python by Yaniv Cohen DevopShift
Yaniv cohen652 views
Case Study : InfluxDB by omkarpowar4
Case Study : InfluxDBCase Study : InfluxDB
Case Study : InfluxDB
omkarpowar437 views
Vinay Kumar [InfluxData] | InfluxDB API Overview | InfluxDays 2022 by InfluxData
Vinay Kumar [InfluxData] | InfluxDB API Overview  | InfluxDays 2022Vinay Kumar [InfluxData] | InfluxDB API Overview  | InfluxDays 2022
Vinay Kumar [InfluxData] | InfluxDB API Overview | InfluxDays 2022
InfluxData31 views
Top 10 dev ops tools (1) by yalini97
Top 10 dev ops tools (1)Top 10 dev ops tools (1)
Top 10 dev ops tools (1)
yalini9774 views
Language Engineering in the Cloud by lennartkats
Language Engineering in the CloudLanguage Engineering in the Cloud
Language Engineering in the Cloud
lennartkats833 views
Normalizing x pages web development by Shean McManus
Normalizing x pages web development Normalizing x pages web development
Normalizing x pages web development
Shean McManus329 views
Apache Flex: Overview by Tarun Telang
Apache Flex: OverviewApache Flex: Overview
Apache Flex: Overview
Tarun Telang1.5K views
Serverless GraphQL for Product Developers by Sashko Stubailo
Serverless GraphQL for Product DevelopersServerless GraphQL for Product Developers
Serverless GraphQL for Product Developers
Sashko Stubailo1K views
Gs08 modernize your data platform with sql technologies wash dc by Bob Ward
Gs08 modernize your data platform with sql technologies   wash dcGs08 modernize your data platform with sql technologies   wash dc
Gs08 modernize your data platform with sql technologies wash dc
Bob Ward815 views
Immutable Infrastructure: Rise of the Machine Images by C4Media
Immutable Infrastructure: Rise of the Machine ImagesImmutable Infrastructure: Rise of the Machine Images
Immutable Infrastructure: Rise of the Machine Images
C4Media806 views
Dirigible powered by Orion for Cloud Development (EclipseCon EU 2015) by Nedelcho Delchev
Dirigible powered by Orion for Cloud Development (EclipseCon EU 2015)Dirigible powered by Orion for Cloud Development (EclipseCon EU 2015)
Dirigible powered by Orion for Cloud Development (EclipseCon EU 2015)
Nedelcho Delchev888 views
.NET Cloud-Native Bootcamp by VMware Tanzu
.NET Cloud-Native Bootcamp.NET Cloud-Native Bootcamp
.NET Cloud-Native Bootcamp
VMware Tanzu753 views
How the Automation of a Benchmark Famework Keeps Pace with the Dev Cycle at I... by DevOps.com
How the Automation of a Benchmark Famework Keeps Pace with the Dev Cycle at I...How the Automation of a Benchmark Famework Keeps Pace with the Dev Cycle at I...
How the Automation of a Benchmark Famework Keeps Pace with the Dev Cycle at I...
DevOps.com98 views
DevOps for Databricks by Databricks
DevOps for DatabricksDevOps for Databricks
DevOps for Databricks
Databricks1.1K views
gRPC, GraphQL, REST - Which API Tech to use - API Conference Berlin oct 20 by Phil Wilkins
gRPC, GraphQL, REST - Which API Tech to use - API Conference Berlin oct 20gRPC, GraphQL, REST - Which API Tech to use - API Conference Berlin oct 20
gRPC, GraphQL, REST - Which API Tech to use - API Conference Berlin oct 20
Phil Wilkins1.1K views

More from InfluxData

Announcing InfluxDB Clustered by
Announcing InfluxDB ClusteredAnnouncing InfluxDB Clustered
Announcing InfluxDB ClusteredInfluxData
100 views30 slides
Best Practices for Leveraging the Apache Arrow Ecosystem by
Best Practices for Leveraging the Apache Arrow EcosystemBest Practices for Leveraging the Apache Arrow Ecosystem
Best Practices for Leveraging the Apache Arrow EcosystemInfluxData
50 views25 slides
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu... by
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...InfluxData
134 views24 slides
Power Your Predictive Analytics with InfluxDB by
Power Your Predictive Analytics with InfluxDBPower Your Predictive Analytics with InfluxDB
Power Your Predictive Analytics with InfluxDBInfluxData
127 views41 slides
Build an Edge-to-Cloud Solution with the MING Stack by
Build an Edge-to-Cloud Solution with the MING StackBuild an Edge-to-Cloud Solution with the MING Stack
Build an Edge-to-Cloud Solution with the MING StackInfluxData
375 views52 slides
Meet the Founders: An Open Discussion About Rewriting Using Rust by
Meet the Founders: An Open Discussion About Rewriting Using RustMeet the Founders: An Open Discussion About Rewriting Using Rust
Meet the Founders: An Open Discussion About Rewriting Using RustInfluxData
235 views12 slides

More from InfluxData(20)

Announcing InfluxDB Clustered by InfluxData
Announcing InfluxDB ClusteredAnnouncing InfluxDB Clustered
Announcing InfluxDB Clustered
InfluxData100 views
Best Practices for Leveraging the Apache Arrow Ecosystem by InfluxData
Best Practices for Leveraging the Apache Arrow EcosystemBest Practices for Leveraging the Apache Arrow Ecosystem
Best Practices for Leveraging the Apache Arrow Ecosystem
InfluxData50 views
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu... by InfluxData
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...
InfluxData134 views
Power Your Predictive Analytics with InfluxDB by InfluxData
Power Your Predictive Analytics with InfluxDBPower Your Predictive Analytics with InfluxDB
Power Your Predictive Analytics with InfluxDB
InfluxData127 views
Build an Edge-to-Cloud Solution with the MING Stack by InfluxData
Build an Edge-to-Cloud Solution with the MING StackBuild an Edge-to-Cloud Solution with the MING Stack
Build an Edge-to-Cloud Solution with the MING Stack
InfluxData375 views
Meet the Founders: An Open Discussion About Rewriting Using Rust by InfluxData
Meet the Founders: An Open Discussion About Rewriting Using RustMeet the Founders: An Open Discussion About Rewriting Using Rust
Meet the Founders: An Open Discussion About Rewriting Using Rust
InfluxData235 views
Introducing InfluxDB Cloud Dedicated by InfluxData
Introducing InfluxDB Cloud DedicatedIntroducing InfluxDB Cloud Dedicated
Introducing InfluxDB Cloud Dedicated
InfluxData129 views
Gain Better Observability with OpenTelemetry and InfluxDB by InfluxData
Gain Better Observability with OpenTelemetry and InfluxDB Gain Better Observability with OpenTelemetry and InfluxDB
Gain Better Observability with OpenTelemetry and InfluxDB
InfluxData398 views
How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali... by InfluxData
How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...
How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...
InfluxData182 views
How Delft University's Engineering Students Make Their EV Formula-Style Race ... by InfluxData
How Delft University's Engineering Students Make Their EV Formula-Style Race ...How Delft University's Engineering Students Make Their EV Formula-Style Race ...
How Delft University's Engineering Students Make Their EV Formula-Style Race ...
InfluxData105 views
Start Automating InfluxDB Deployments at the Edge with balena by InfluxData
Start Automating InfluxDB Deployments at the Edge with balena Start Automating InfluxDB Deployments at the Edge with balena
Start Automating InfluxDB Deployments at the Edge with balena
InfluxData185 views
Understanding InfluxDB’s New Storage Engine by InfluxData
Understanding InfluxDB’s New Storage EngineUnderstanding InfluxDB’s New Storage Engine
Understanding InfluxDB’s New Storage Engine
InfluxData135 views
Streamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDB by InfluxData
Streamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDBStreamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDB
Streamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDB
InfluxData63 views
Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa... by InfluxData
Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...
Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...
InfluxData74 views
Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022 by InfluxData
Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022
Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022
InfluxData26 views
Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022 by InfluxData
Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022
InfluxData9 views
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ... by InfluxData
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
InfluxData10 views
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022 by InfluxData
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
InfluxData5 views
Paul Dix [InfluxData] The Journey of InfluxDB | InfluxDays 2022 by InfluxData
Paul Dix [InfluxData] The Journey of InfluxDB | InfluxDays 2022Paul Dix [InfluxData] The Journey of InfluxDB | InfluxDays 2022
Paul Dix [InfluxData] The Journey of InfluxDB | InfluxDays 2022
InfluxData112 views
Jay Clifford [InfluxData] | Tips & Tricks for Analyzing IIoT in Real-Time | I... by InfluxData
Jay Clifford [InfluxData] | Tips & Tricks for Analyzing IIoT in Real-Time | I...Jay Clifford [InfluxData] | Tips & Tricks for Analyzing IIoT in Real-Time | I...
Jay Clifford [InfluxData] | Tips & Tricks for Analyzing IIoT in Real-Time | I...
InfluxData19 views

Recently uploaded

Future of AR - Facebook Presentation by
Future of AR - Facebook PresentationFuture of AR - Facebook Presentation
Future of AR - Facebook Presentationssuserb54b561
15 views27 slides
Case Study Copenhagen Energy and Business Central.pdf by
Case Study Copenhagen Energy and Business Central.pdfCase Study Copenhagen Energy and Business Central.pdf
Case Study Copenhagen Energy and Business Central.pdfAitana
16 views3 slides
Zero to Automated in Under a Year by
Zero to Automated in Under a YearZero to Automated in Under a Year
Zero to Automated in Under a YearNetwork Automation Forum
15 views23 slides
Network Source of Truth and Infrastructure as Code revisited by
Network Source of Truth and Infrastructure as Code revisitedNetwork Source of Truth and Infrastructure as Code revisited
Network Source of Truth and Infrastructure as Code revisitedNetwork Automation Forum
27 views45 slides
Melek BEN MAHMOUD.pdf by
Melek BEN MAHMOUD.pdfMelek BEN MAHMOUD.pdf
Melek BEN MAHMOUD.pdfMelekBenMahmoud
14 views1 slide
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f... by
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...TrustArc
11 views29 slides

Recently uploaded(20)

Future of AR - Facebook Presentation by ssuserb54b561
Future of AR - Facebook PresentationFuture of AR - Facebook Presentation
Future of AR - Facebook Presentation
ssuserb54b56115 views
Case Study Copenhagen Energy and Business Central.pdf by Aitana
Case Study Copenhagen Energy and Business Central.pdfCase Study Copenhagen Energy and Business Central.pdf
Case Study Copenhagen Energy and Business Central.pdf
Aitana16 views
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f... by TrustArc
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc11 views
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas... by Bernd Ruecker
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
Bernd Ruecker40 views
Igniting Next Level Productivity with AI-Infused Data Integration Workflows by Safe Software
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Safe Software280 views
"Surviving highload with Node.js", Andrii Shumada by Fwdays
"Surviving highload with Node.js", Andrii Shumada "Surviving highload with Node.js", Andrii Shumada
"Surviving highload with Node.js", Andrii Shumada
Fwdays22 views
STPI OctaNE CoE Brochure.pdf by madhurjyapb
STPI OctaNE CoE Brochure.pdfSTPI OctaNE CoE Brochure.pdf
STPI OctaNE CoE Brochure.pdf
madhurjyapb14 views
SAP Automation Using Bar Code and FIORI.pdf by Virendra Rai, PMP
SAP Automation Using Bar Code and FIORI.pdfSAP Automation Using Bar Code and FIORI.pdf
SAP Automation Using Bar Code and FIORI.pdf
HTTP headers that make your website go faster - devs.gent November 2023 by Thijs Feryn
HTTP headers that make your website go faster - devs.gent November 2023HTTP headers that make your website go faster - devs.gent November 2023
HTTP headers that make your website go faster - devs.gent November 2023
Thijs Feryn22 views
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors by sugiuralab
TouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective SensorsTouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective Sensors
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors
sugiuralab21 views
STKI Israeli Market Study 2023 corrected forecast 2023_24 v3.pdf by Dr. Jimmy Schwarzkopf
STKI Israeli Market Study 2023   corrected forecast 2023_24 v3.pdfSTKI Israeli Market Study 2023   corrected forecast 2023_24 v3.pdf
STKI Israeli Market Study 2023 corrected forecast 2023_24 v3.pdf
Piloting & Scaling Successfully With Microsoft Viva by Richard Harbridge
Piloting & Scaling Successfully With Microsoft VivaPiloting & Scaling Successfully With Microsoft Viva
Piloting & Scaling Successfully With Microsoft Viva

Gary Fowler [InfluxData] | InfluxDB Scripting Languages | InfluxDays 2022

  • 3. A look at the scripting language options that can be used with InfluxDB in the past, present, and future. Gary Fowler Product Manager Gary Fowler is a Product Manager for InfluxDB Cloud at InfluxData. Gary has nearly three decades of experience in product management, program management, software engineering and sales engineering. He previously held Vice President roles in Product and Engineering at iPass, Airborne Interactive and Lilee Systems. Gary resides in Holualoa, Hawaii. InfluxDB Scripting Languages
  • 4. Agenda 1. Script Language Options with InfluxDB - past, present, and future 2. Benefits of each Language 3. The new Script Editor in InfluxDB Cloud
  • 5. DEVELOPER HAPPINESS TIME TO AWESOME Developers Cloud native real time applications requiring time series data store
  • 7. Learning curve: STEEP Learning curve: LITTLE TO NONE Capabilities: QUERY, TRANSFORM & ACT (POWERFUL) Capabilities: QUERY ONLY (EASY) INFLUXQL SQL* FLUX * Coming soon
  • 8. Flux • Functional Scripting Language • Optimized for ETL, monitoring, and alerting • Not just for queries, but also for transforming and triggering actions • Used with OSS, Enterprise, & current Cloud product
  • 9. Influx Query Language (InfluxQL) • SQL-like query language for working with data in InfluxDB databases • InfluxDB’s first Query Language • Standard SQL functions + time series extensions • /query API available with OSS, Enterprise, and Cloud • Cloud UI support coming soon
  • 10. Coming soon: Native SQL • IOx powered InfluxDB Cloud brings SQL support • SQL editor within InfluxDB Cloud in development (Coming Soon) • PostgresQL Wire Protocol Support
  • 12. Flux 1.0 • First official versioned release Whats in it for the customer?
  • 13. Planned: InfluxQL Cloud Support • InfluxQL Editor option in InfluxDB Cloud • Easier transition from OSS or Enterprise
  • 14. Future: Tasks in your language • Use Python or Javascript within InfluxDB • Create downsampling and other tasks that can run inside InfluxDB cloud • Data stays internal and in the cloud
  • 15. Future: Javascript Tasks • Use Javascript within the Cloud UI • Create downsampling and other tasks that can run inside InfluxDB cloud • Data stays internal and in the cloud
  • 17. Selection Factors Flux SQL InfluxQL Python/Javascript Need most power and flexibility Transition from relational DB Already using with OSS & Enterprise Python or Javascript Expertise Need to transform or otherwise manipulate data, not just query it Previous SQL Expertise Previous InfluxQL or SQL Expertise Want to move existing Python code into the Cloud Need to combine data sources Only need to do fast, simple queries Need to make REST or other API calls Easier API transition from other SQL DBs
  • 18. Selection Factors Flux SQL InfluxQL Python/Javascri pt Need most power and flexibility Transition from relational DB Already using with OSS & Enterprise Python or Javascript Expertise Need to transform or otherwise manipulate data, not just query it Previous SQL Expertise Previous InfluxQL or SQL Expertise Want to move existing Python code into the Cloud Need to combine data sources Only need to do fast, simple queries Need to make REST or other API calls Easier API transition from other SQL DBs
  • 19. Examples of ways you can use Flux The Power of Flux
  • 20. Query from Multiple Data Sources import "sql" import "influxdata/influxdb/secrets" username = secrets.get(key: "POSTGRES_USER") password = secrets.get(key: "POSTGRES_PASS") sql.from( driverName: "postgres", dataSourceName: "postgresql://${username}:${password}@loc alhost:5432", query: "SELECT * FROM example_table", )
  • 21. Make outbound API calls import "json" import "http" lastReported = from(bucket: "example-bucket") |> range(start: -1m) |> filter(fn: (r) => r._measurement == "statuses") |> last() |> findColumn(fn: (key) => true, column: "_level") http.post( url: "http://myawsomeurl.com/api/notify", headers: {Authorization: "Bearer mySuPerSecRetTokEn", "Content-type": "application/json"}, data: json.encode(v: lastReported[0]), )
  • 22. Downsample Data option task = {name: "Downsampling CPU", every: 1m} data = from(bucket: "my-bucket") |> range(start: -2h) |> filter(fn: (r) => (r["_measurement"] == "cpu")) |> filter(fn: (r) => (r["_field"] == "usage_user")) data |> aggregateWindow(every: 10s, fn: mean, createEmpty: false) |> set(key: "agg_type",value: "mean_cpu") |> to(bucket: "downsampled", org: "my-org", tagColumns: ["agg_type"])
  • 23. Flux vs. Custom Application Eliminates the need to extract/download a large dataset to your own application for evaluation and transformation
  • 25. New Script Editor - InfluxDB Cloud
  • 26. ➔ Multi-Language Editing ➔ Instructional - learn while using ➔ Instructional - help users write more performant queries ➔ Schema Browsing ➔ Faster Iteration ➔ Loading/Saving/Re-using Scripts ➔ Remove forced visual selection vs. script editing choice ➔ Invokable Script Editing Why a new Script Editor?
  • 27. New Script Editor Language Support • Flux Supported • SQL In-Development • InfluxQL Planned • Python Planned • Javascript Planned
  • 28. Instructional Schema Browser 1. Helps introduce new user’s to InfluxDB Elements via Contextual Help 2. Helps users understand the shape of their data & hierarchical structure
  • 29. Schema — > Flux Sync • Do queries with no scripting knowledge • Shows you the script that gets created based on your selections to help you learn • Add code to your script without losing the ability to choose filters from the schema browser
  • 30. Load and Save Scripts • Long awaited feature of the Script Editor • Basic Load/Save for now, but planning to add versioning, labels/folder organization, and permissions in the future
  • 31. Edit Invokable Scripts You can use the script editor to edit invocable scripts and gather their URL
  • 33. VS Code Extension You can use the Flux VS Code extension to edit Flux
  • 34. PostgreSQL Wire Protocol Write SQL scripts/queries from your own tools that support the PostgreSQL Wire Protocol
  • 35. T H A N K Y O U