Michael Hall [InfluxData] | Become an InfluxDB Pro in 20 Minutes | InfluxDays 2022

InfluxData
InfluxDataInfluxData
Michael Hall [InfluxData] | Become an InfluxDB Pro in 20 Minutes | InfluxDays 2022
Become an InfluxDB
Pro in 20 minutes
Michael Hall
Community Manager, InfluxData
This short taste of InfluxDB University will help you
master the key areas where users commonly struggle
when getting started with InfluxDB.
Michael Hall
Community Manager, InfluxData
Michael Hall leads the Developer Relations team at
InfluxData and is an open source software developer,
community manager and technology evangelist. He has
extensive experience in developing desktop and
web-based software in a large variety of languages and
frameworks, and contributes to a number of open
source projects and communities.
Become an InfluxDB Pro in 20
Minutes
Agenda
1. Working with InfluxDB
2. Building a data schema for success
3. Introduction to the Flux language
4. Getting the most out of your data
5. Going to the cloud with Edge Data Replication
Interfaces to InfluxDB
Graphical User Interface (GUI)
Command Line Interface (CLI)
Client Libraries
Flux VS Code Extension
Data Schema
Schema Elements
Measurement Tags
Timestamp
Field
Tag Set
ticker=AAPL
Measurement
stock_price,
Field Set
price=177.03
Timestamp
1234567890000000
Data Cardinality
Cardinality = Measurements * Tag Values
Tips for Managing Cardinality
• Use measurement names that reflect categories of data
• Limit the number of measurements per bucket
• Use tags for data you’re going to regularly filter on
• Avoid duplicating data in tags
• Avoid unbounded tag values
Flux Language
Function-based Processing
from(bucket: "stocks")
|> range(start: -1h)
|> filter(fn: (r) => r["_measurement"] == "stock_price")
|> filter(fn: (r) => r["ticker"] == "AAPL")
|> filter(fn: (r) => r["market"] == "NASDAQ")
|> filter(fn: (r) => r["_field"] == "price")
|> mean()
• Everything is a function
• Work on a stream of tables
• Data processed step by step
• Aggregates run once per-table
• Last result is returned
Column-Oriented Data
Compared to InfluxQL
Orchestrate Multiple Queries
Enrich with Outside Data
import "sql"
companyInfo = sql.from(
driverName: "postgres",
dataSourceName: "postgresql://username:password@localhost:5432",
query: "SELECT * FROM stock_names"
)
stockPrices = from(bucket: "stocks")
|> range(start: -1h)
|> filter(fn: (r) => r._measurement == "stock_prices")
join(tables: {metric: stockPrices, info: companyInfo}, on: ["ticker"])
Pushdown Patterns
• Executes on the storage layer
• Avoids moving data into memory
• Example:
from(bucket: "stocks")
|> range(start: -1h)
|> filter(fn: (r) => r["_measurement"] == "stock_price")
|> filter(fn: (r) => r["ticker"] == "AAPL")
|> window(every: 1m)
|> max()
Tips for Mastering Flux
• Think in columns not rows
• Save queries in variables to use different aggregations
• Use the Data Explorer to play around
• Use multiple yield( ) calls to output multiple results
• Learn pushdowns: from( ) |> range( ) |> filter( ) |> aggregate( )
Transforming and Alerting
Background Tasks
• Written in Flux
• Executed by InfluxDB
• Tasks can:
• Read
• Transform
• Write
• Repond
Downsampling
Check Notification
Endpoint
Alerting
Tips for Better Results
• Stagger Task times with offsets to spread compute load
• Use tasks.lastSuccess( ) for resiliency
• Understand Check schedule vs Notification schedule
• Use offsets to avoid scheduling conflicts
• Only notify on escalations
• Write Tasks for more complex alerting needs
Edge Data Replication
InfluxDB on the Edge and the Cloud
Bucket Queue
Bucket Queue
Flux
Disk
How it Works
Durable Flexible
No complex code Data @ Edge & Cloud
Native Queueing
Automatic
2-Step Setup
API CLI
/api/v2/remotes influx remote [create,delete,list,update]
/api/v2/replications influx replication [create,delete,list,update]
Tips for Edge Architectures
• Combine with Downsampling Tasks
• Enrich with Edge Metadata
• Stack Multiple Edge Layers
Further Learning
In this talk we’ll learn about some of the biggest
challenges beginner Flux users face. We’ll also learn
about resources and tools that developers can take
advantage of to become a Flux Pro.
Anais Dotis-Georgiou
Lead Developer Advocate
Anais Dotis-Georgiou is a developer advocate at
InfluxData with a passion for making data beautiful
using data analytics, AI, and machine learning. She
takes the data that she collects and does a mix of
research, exploration, and engineering to translate the
data into something of function, value, and beauty.
Becoming a Flux Pro
InfluxDB University offers free live and self-paced training on:
Scan to explore the
course catalog
influxdbu.com
• InfluxDB
• Telegraf
• Flux
Time to Awesome Online Book
Available for free at
awesome.influxdata.com
Resources
Get started: influxdata.com/cloud
Forums: community.influxdata.com
Slack: influxcommunity.slack.com
Book: awesome.influxdata.com
Docs: docs.influxdata.com
InfluxDB University: influxdata.com/university
T H A N K Y O U
1 of 37

Recommended

OFF SHORE RECRUITER TRAINING by
OFF SHORE RECRUITER TRAININGOFF SHORE RECRUITER TRAINING
OFF SHORE RECRUITER TRAININGsatish_kumar646
2.6K views44 slides
Software Engineering by
Software EngineeringSoftware Engineering
Software EngineeringTharindu Weerasinghe
53 views27 slides
Virtual training intro to InfluxDB - June 2021 by
Virtual training  intro to InfluxDB  - June 2021Virtual training  intro to InfluxDB  - June 2021
Virtual training intro to InfluxDB - June 2021InfluxData
517 views24 slides
Rails Tips and Best Practices by
Rails Tips and Best PracticesRails Tips and Best Practices
Rails Tips and Best PracticesDavid Keener
1.3K views19 slides
Intro to InfluxDB by
Intro to InfluxDBIntro to InfluxDB
Intro to InfluxDBInfluxData
484 views42 slides
Flux QL - Nexgen Management of Time Series Inspired by JS by
Flux QL - Nexgen Management of Time Series Inspired by JSFlux QL - Nexgen Management of Time Series Inspired by JS
Flux QL - Nexgen Management of Time Series Inspired by JSIvo Andreev
2.5K views32 slides

More Related Content

Similar to Michael Hall [InfluxData] | Become an InfluxDB Pro in 20 Minutes | InfluxDays 2022

Real Time Data Processing Using Spark Streaming by
Real Time Data Processing Using Spark StreamingReal Time Data Processing Using Spark Streaming
Real Time Data Processing Using Spark StreamingHari Shreedharan
2.6K views29 slides
Real Time Data Processing using Spark Streaming | Data Day Texas 2015 by
Real Time Data Processing using Spark Streaming | Data Day Texas 2015Real Time Data Processing using Spark Streaming | Data Day Texas 2015
Real Time Data Processing using Spark Streaming | Data Day Texas 2015Cloudera, Inc.
19.6K views29 slides
AI與大數據數據處理 Spark實戰(20171216) by
AI與大數據數據處理 Spark實戰(20171216)AI與大數據數據處理 Spark實戰(20171216)
AI與大數據數據處理 Spark實戰(20171216)Paul Chao
1.1K views127 slides
Jump Start into Apache® Spark™ and Databricks by
Jump Start into Apache® Spark™ and DatabricksJump Start into Apache® Spark™ and Databricks
Jump Start into Apache® Spark™ and DatabricksDatabricks
3.9K views39 slides
Integration-Monday-Stateful-Programming-Models-Serverless-Functions by
Integration-Monday-Stateful-Programming-Models-Serverless-FunctionsIntegration-Monday-Stateful-Programming-Models-Serverless-Functions
Integration-Monday-Stateful-Programming-Models-Serverless-FunctionsBizTalk360
244 views34 slides
Hadoop and HBase experiences in perf log project by
Hadoop and HBase experiences in perf log projectHadoop and HBase experiences in perf log project
Hadoop and HBase experiences in perf log projectMao Geng
832 views41 slides

Similar to Michael Hall [InfluxData] | Become an InfluxDB Pro in 20 Minutes | InfluxDays 2022(20)

Real Time Data Processing Using Spark Streaming by Hari Shreedharan
Real Time Data Processing Using Spark StreamingReal Time Data Processing Using Spark Streaming
Real Time Data Processing Using Spark Streaming
Hari Shreedharan2.6K views
Real Time Data Processing using Spark Streaming | Data Day Texas 2015 by Cloudera, Inc.
Real Time Data Processing using Spark Streaming | Data Day Texas 2015Real Time Data Processing using Spark Streaming | Data Day Texas 2015
Real Time Data Processing using Spark Streaming | Data Day Texas 2015
Cloudera, Inc.19.6K views
AI與大數據數據處理 Spark實戰(20171216) by Paul Chao
AI與大數據數據處理 Spark實戰(20171216)AI與大數據數據處理 Spark實戰(20171216)
AI與大數據數據處理 Spark實戰(20171216)
Paul Chao1.1K views
Jump Start into Apache® Spark™ and Databricks by Databricks
Jump Start into Apache® Spark™ and DatabricksJump Start into Apache® Spark™ and Databricks
Jump Start into Apache® Spark™ and Databricks
Databricks3.9K views
Integration-Monday-Stateful-Programming-Models-Serverless-Functions by BizTalk360
Integration-Monday-Stateful-Programming-Models-Serverless-FunctionsIntegration-Monday-Stateful-Programming-Models-Serverless-Functions
Integration-Monday-Stateful-Programming-Models-Serverless-Functions
BizTalk360244 views
Hadoop and HBase experiences in perf log project by Mao Geng
Hadoop and HBase experiences in perf log projectHadoop and HBase experiences in perf log project
Hadoop and HBase experiences in perf log project
Mao Geng832 views
Overview of VS2010 and .NET 4.0 by Bruce Johnson
Overview of VS2010 and .NET 4.0Overview of VS2010 and .NET 4.0
Overview of VS2010 and .NET 4.0
Bruce Johnson879 views
Gary Fowler [InfluxData] | InfluxDB Scripting Languages | InfluxDays 2022 by InfluxData
Gary Fowler [InfluxData] | InfluxDB Scripting Languages | InfluxDays 2022Gary Fowler [InfluxData] | InfluxDB Scripting Languages | InfluxDays 2022
Gary Fowler [InfluxData] | InfluxDB Scripting Languages | InfluxDays 2022
InfluxData11 views
An insight to microsoft platform by Confiz
An insight to microsoft platformAn insight to microsoft platform
An insight to microsoft platform
Confiz582 views
Metaflow: The ML Infrastructure at Netflix by Bill Liu
Metaflow: The ML Infrastructure at NetflixMetaflow: The ML Infrastructure at Netflix
Metaflow: The ML Infrastructure at Netflix
Bill Liu523 views
Spark SQL Deep Dive @ Melbourne Spark Meetup by Databricks
Spark SQL Deep Dive @ Melbourne Spark MeetupSpark SQL Deep Dive @ Melbourne Spark Meetup
Spark SQL Deep Dive @ Melbourne Spark Meetup
Databricks9K views
Learn How to Run Python on Redshift by Chartio
Learn How to Run Python on RedshiftLearn How to Run Python on Redshift
Learn How to Run Python on Redshift
Chartio3.7K views
Introduction to interactive data visualisation using R Shiny by anamarisaguedes
Introduction to interactive data visualisation using R ShinyIntroduction to interactive data visualisation using R Shiny
Introduction to interactive data visualisation using R Shiny
anamarisaguedes185 views
Automating Workflows for Analytics Pipelines by Sadayuki Furuhashi
Automating Workflows for Analytics PipelinesAutomating Workflows for Analytics Pipelines
Automating Workflows for Analytics Pipelines
Sadayuki Furuhashi1.9K views
Setting Up a TIG Stack for Your Testing by Jet Liu
Setting Up a TIG Stack for Your TestingSetting Up a TIG Stack for Your Testing
Setting Up a TIG Stack for Your Testing
Jet Liu252 views
Saranteja gutta wells by ramesh5080
Saranteja gutta wellsSaranteja gutta wells
Saranteja gutta wells
ramesh5080189 views
Improving Apache Spark Downscaling by Databricks
 Improving Apache Spark Downscaling Improving Apache Spark Downscaling
Improving Apache Spark Downscaling
Databricks827 views

More from InfluxData

Announcing InfluxDB Clustered by
Announcing InfluxDB ClusteredAnnouncing InfluxDB Clustered
Announcing InfluxDB ClusteredInfluxData
101 views30 slides
Best Practices for Leveraging the Apache Arrow Ecosystem by
Best Practices for Leveraging the Apache Arrow EcosystemBest Practices for Leveraging the Apache Arrow Ecosystem
Best Practices for Leveraging the Apache Arrow EcosystemInfluxData
51 views25 slides
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu... by
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...InfluxData
137 views24 slides
Power Your Predictive Analytics with InfluxDB by
Power Your Predictive Analytics with InfluxDBPower Your Predictive Analytics with InfluxDB
Power Your Predictive Analytics with InfluxDBInfluxData
128 views41 slides
Build an Edge-to-Cloud Solution with the MING Stack by
Build an Edge-to-Cloud Solution with the MING StackBuild an Edge-to-Cloud Solution with the MING Stack
Build an Edge-to-Cloud Solution with the MING StackInfluxData
381 views52 slides
Meet the Founders: An Open Discussion About Rewriting Using Rust by
Meet the Founders: An Open Discussion About Rewriting Using RustMeet the Founders: An Open Discussion About Rewriting Using Rust
Meet the Founders: An Open Discussion About Rewriting Using RustInfluxData
235 views12 slides

More from InfluxData(20)

Announcing InfluxDB Clustered by InfluxData
Announcing InfluxDB ClusteredAnnouncing InfluxDB Clustered
Announcing InfluxDB Clustered
InfluxData101 views
Best Practices for Leveraging the Apache Arrow Ecosystem by InfluxData
Best Practices for Leveraging the Apache Arrow EcosystemBest Practices for Leveraging the Apache Arrow Ecosystem
Best Practices for Leveraging the Apache Arrow Ecosystem
InfluxData51 views
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu... by InfluxData
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...
InfluxData137 views
Power Your Predictive Analytics with InfluxDB by InfluxData
Power Your Predictive Analytics with InfluxDBPower Your Predictive Analytics with InfluxDB
Power Your Predictive Analytics with InfluxDB
InfluxData128 views
Build an Edge-to-Cloud Solution with the MING Stack by InfluxData
Build an Edge-to-Cloud Solution with the MING StackBuild an Edge-to-Cloud Solution with the MING Stack
Build an Edge-to-Cloud Solution with the MING Stack
InfluxData381 views
Meet the Founders: An Open Discussion About Rewriting Using Rust by InfluxData
Meet the Founders: An Open Discussion About Rewriting Using RustMeet the Founders: An Open Discussion About Rewriting Using Rust
Meet the Founders: An Open Discussion About Rewriting Using Rust
InfluxData235 views
Introducing InfluxDB Cloud Dedicated by InfluxData
Introducing InfluxDB Cloud DedicatedIntroducing InfluxDB Cloud Dedicated
Introducing InfluxDB Cloud Dedicated
InfluxData129 views
Gain Better Observability with OpenTelemetry and InfluxDB by InfluxData
Gain Better Observability with OpenTelemetry and InfluxDB Gain Better Observability with OpenTelemetry and InfluxDB
Gain Better Observability with OpenTelemetry and InfluxDB
InfluxData403 views
How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali... by InfluxData
How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...
How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...
InfluxData184 views
How Delft University's Engineering Students Make Their EV Formula-Style Race ... by InfluxData
How Delft University's Engineering Students Make Their EV Formula-Style Race ...How Delft University's Engineering Students Make Their EV Formula-Style Race ...
How Delft University's Engineering Students Make Their EV Formula-Style Race ...
InfluxData105 views
Start Automating InfluxDB Deployments at the Edge with balena by InfluxData
Start Automating InfluxDB Deployments at the Edge with balena Start Automating InfluxDB Deployments at the Edge with balena
Start Automating InfluxDB Deployments at the Edge with balena
InfluxData186 views
Understanding InfluxDB’s New Storage Engine by InfluxData
Understanding InfluxDB’s New Storage EngineUnderstanding InfluxDB’s New Storage Engine
Understanding InfluxDB’s New Storage Engine
InfluxData138 views
Streamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDB by InfluxData
Streamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDBStreamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDB
Streamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDB
InfluxData63 views
Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa... by InfluxData
Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...
Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...
InfluxData74 views
Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022 by InfluxData
Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022
Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022
InfluxData26 views
Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022 by InfluxData
Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022
InfluxData9 views
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ... by InfluxData
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
InfluxData10 views
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022 by InfluxData
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
InfluxData5 views
Paul Dix [InfluxData] The Journey of InfluxDB | InfluxDays 2022 by InfluxData
Paul Dix [InfluxData] The Journey of InfluxDB | InfluxDays 2022Paul Dix [InfluxData] The Journey of InfluxDB | InfluxDays 2022
Paul Dix [InfluxData] The Journey of InfluxDB | InfluxDays 2022
InfluxData112 views
Jay Clifford [InfluxData] | Tips & Tricks for Analyzing IIoT in Real-Time | I... by InfluxData
Jay Clifford [InfluxData] | Tips & Tricks for Analyzing IIoT in Real-Time | I...Jay Clifford [InfluxData] | Tips & Tricks for Analyzing IIoT in Real-Time | I...
Jay Clifford [InfluxData] | Tips & Tricks for Analyzing IIoT in Real-Time | I...
InfluxData19 views

Recently uploaded

Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda... by
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...ShapeBlue
93 views13 slides
Future of AR - Facebook Presentation by
Future of AR - Facebook PresentationFuture of AR - Facebook Presentation
Future of AR - Facebook PresentationRob McCarty
54 views27 slides
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ... by
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...ShapeBlue
114 views12 slides
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti... by
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...ShapeBlue
69 views29 slides
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava... by
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...ShapeBlue
74 views17 slides
Digital Personal Data Protection (DPDP) Practical Approach For CISOs by
Digital Personal Data Protection (DPDP) Practical Approach For CISOsDigital Personal Data Protection (DPDP) Practical Approach For CISOs
Digital Personal Data Protection (DPDP) Practical Approach For CISOsPriyanka Aash
103 views59 slides

Recently uploaded(20)

Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda... by ShapeBlue
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...
ShapeBlue93 views
Future of AR - Facebook Presentation by Rob McCarty
Future of AR - Facebook PresentationFuture of AR - Facebook Presentation
Future of AR - Facebook Presentation
Rob McCarty54 views
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ... by ShapeBlue
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...
ShapeBlue114 views
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti... by ShapeBlue
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...
ShapeBlue69 views
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava... by ShapeBlue
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...
ShapeBlue74 views
Digital Personal Data Protection (DPDP) Practical Approach For CISOs by Priyanka Aash
Digital Personal Data Protection (DPDP) Practical Approach For CISOsDigital Personal Data Protection (DPDP) Practical Approach For CISOs
Digital Personal Data Protection (DPDP) Practical Approach For CISOs
Priyanka Aash103 views
Updates on the LINSTOR Driver for CloudStack - Rene Peinthor - LINBIT by ShapeBlue
Updates on the LINSTOR Driver for CloudStack - Rene Peinthor - LINBITUpdates on the LINSTOR Driver for CloudStack - Rene Peinthor - LINBIT
Updates on the LINSTOR Driver for CloudStack - Rene Peinthor - LINBIT
ShapeBlue138 views
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f... by TrustArc
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc130 views
CloudStack and GitOps at Enterprise Scale - Alex Dometrius, Rene Glover - AT&T by ShapeBlue
CloudStack and GitOps at Enterprise Scale - Alex Dometrius, Rene Glover - AT&TCloudStack and GitOps at Enterprise Scale - Alex Dometrius, Rene Glover - AT&T
CloudStack and GitOps at Enterprise Scale - Alex Dometrius, Rene Glover - AT&T
ShapeBlue81 views
Confidence in CloudStack - Aron Wagner, Nathan Gleason - Americ by ShapeBlue
Confidence in CloudStack - Aron Wagner, Nathan Gleason - AmericConfidence in CloudStack - Aron Wagner, Nathan Gleason - Americ
Confidence in CloudStack - Aron Wagner, Nathan Gleason - Americ
ShapeBlue58 views
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ... by ShapeBlue
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...
ShapeBlue97 views
Keynote Talk: Open Source is Not Dead - Charles Schulz - Vates by ShapeBlue
Keynote Talk: Open Source is Not Dead - Charles Schulz - VatesKeynote Talk: Open Source is Not Dead - Charles Schulz - Vates
Keynote Talk: Open Source is Not Dead - Charles Schulz - Vates
ShapeBlue178 views
Migrating VMware Infra to KVM Using CloudStack - Nicolas Vazquez - ShapeBlue by ShapeBlue
Migrating VMware Infra to KVM Using CloudStack - Nicolas Vazquez - ShapeBlueMigrating VMware Infra to KVM Using CloudStack - Nicolas Vazquez - ShapeBlue
Migrating VMware Infra to KVM Using CloudStack - Nicolas Vazquez - ShapeBlue
ShapeBlue147 views
VNF Integration and Support in CloudStack - Wei Zhou - ShapeBlue by ShapeBlue
VNF Integration and Support in CloudStack - Wei Zhou - ShapeBlueVNF Integration and Support in CloudStack - Wei Zhou - ShapeBlue
VNF Integration and Support in CloudStack - Wei Zhou - ShapeBlue
ShapeBlue134 views
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha... by ShapeBlue
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...
ShapeBlue113 views
Data Integrity for Banking and Financial Services by Precisely
Data Integrity for Banking and Financial ServicesData Integrity for Banking and Financial Services
Data Integrity for Banking and Financial Services
Precisely76 views
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas... by Bernd Ruecker
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
Bernd Ruecker50 views
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N... by James Anderson
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
James Anderson142 views

Michael Hall [InfluxData] | Become an InfluxDB Pro in 20 Minutes | InfluxDays 2022

  • 2. Become an InfluxDB Pro in 20 minutes Michael Hall Community Manager, InfluxData
  • 3. This short taste of InfluxDB University will help you master the key areas where users commonly struggle when getting started with InfluxDB. Michael Hall Community Manager, InfluxData Michael Hall leads the Developer Relations team at InfluxData and is an open source software developer, community manager and technology evangelist. He has extensive experience in developing desktop and web-based software in a large variety of languages and frameworks, and contributes to a number of open source projects and communities. Become an InfluxDB Pro in 20 Minutes
  • 4. Agenda 1. Working with InfluxDB 2. Building a data schema for success 3. Introduction to the Flux language 4. Getting the most out of your data 5. Going to the cloud with Edge Data Replication
  • 9. Flux VS Code Extension
  • 11. Schema Elements Measurement Tags Timestamp Field Tag Set ticker=AAPL Measurement stock_price, Field Set price=177.03 Timestamp 1234567890000000
  • 12. Data Cardinality Cardinality = Measurements * Tag Values
  • 13. Tips for Managing Cardinality • Use measurement names that reflect categories of data • Limit the number of measurements per bucket • Use tags for data you’re going to regularly filter on • Avoid duplicating data in tags • Avoid unbounded tag values
  • 15. Function-based Processing from(bucket: "stocks") |> range(start: -1h) |> filter(fn: (r) => r["_measurement"] == "stock_price") |> filter(fn: (r) => r["ticker"] == "AAPL") |> filter(fn: (r) => r["market"] == "NASDAQ") |> filter(fn: (r) => r["_field"] == "price") |> mean() • Everything is a function • Work on a stream of tables • Data processed step by step • Aggregates run once per-table • Last result is returned
  • 19. Enrich with Outside Data import "sql" companyInfo = sql.from( driverName: "postgres", dataSourceName: "postgresql://username:password@localhost:5432", query: "SELECT * FROM stock_names" ) stockPrices = from(bucket: "stocks") |> range(start: -1h) |> filter(fn: (r) => r._measurement == "stock_prices") join(tables: {metric: stockPrices, info: companyInfo}, on: ["ticker"])
  • 20. Pushdown Patterns • Executes on the storage layer • Avoids moving data into memory • Example: from(bucket: "stocks") |> range(start: -1h) |> filter(fn: (r) => r["_measurement"] == "stock_price") |> filter(fn: (r) => r["ticker"] == "AAPL") |> window(every: 1m) |> max()
  • 21. Tips for Mastering Flux • Think in columns not rows • Save queries in variables to use different aggregations • Use the Data Explorer to play around • Use multiple yield( ) calls to output multiple results • Learn pushdowns: from( ) |> range( ) |> filter( ) |> aggregate( )
  • 23. Background Tasks • Written in Flux • Executed by InfluxDB • Tasks can: • Read • Transform • Write • Repond
  • 26. Tips for Better Results • Stagger Task times with offsets to spread compute load • Use tasks.lastSuccess( ) for resiliency • Understand Check schedule vs Notification schedule • Use offsets to avoid scheduling conflicts • Only notify on escalations • Write Tasks for more complex alerting needs
  • 28. InfluxDB on the Edge and the Cloud Bucket Queue Bucket Queue Flux Disk
  • 29. How it Works Durable Flexible No complex code Data @ Edge & Cloud Native Queueing Automatic
  • 30. 2-Step Setup API CLI /api/v2/remotes influx remote [create,delete,list,update] /api/v2/replications influx replication [create,delete,list,update]
  • 31. Tips for Edge Architectures • Combine with Downsampling Tasks • Enrich with Edge Metadata • Stack Multiple Edge Layers
  • 33. In this talk we’ll learn about some of the biggest challenges beginner Flux users face. We’ll also learn about resources and tools that developers can take advantage of to become a Flux Pro. Anais Dotis-Georgiou Lead Developer Advocate Anais Dotis-Georgiou is a developer advocate at InfluxData with a passion for making data beautiful using data analytics, AI, and machine learning. She takes the data that she collects and does a mix of research, exploration, and engineering to translate the data into something of function, value, and beauty. Becoming a Flux Pro
  • 34. InfluxDB University offers free live and self-paced training on: Scan to explore the course catalog influxdbu.com • InfluxDB • Telegraf • Flux
  • 35. Time to Awesome Online Book Available for free at awesome.influxdata.com
  • 36. Resources Get started: influxdata.com/cloud Forums: community.influxdata.com Slack: influxcommunity.slack.com Book: awesome.influxdata.com Docs: docs.influxdata.com InfluxDB University: influxdata.com/university
  • 37. T H A N K Y O U