Getting Started Series:
Introduction to the TICK Stack &
InfluxEnterprise
© 2017 InfluxData. All rights reserved.2
Agenda
¨ What is the TICK Stack
¨ What is InfluxEnterprise and InfluxCloud
¨ Demo of the installation and use of the TICK Stack
© 2017 InfluxData. All rights reserved.3 © 2017 InfluxData. All rights reserved.3
• High volume of real-time writes
• Irregular (events) and regular (metrics)
• Retention policies
New workload requirements
• Aggregation and summation time-based functions
• Large range scans of many records
• Ordering, ranking, and limiting
Time-based queries
• Distributed by design
• Fast and consistent
• Always available
Scalability and availability
A modern Open Source Platform
built from the ground up for
metrics and events.
The Modern Engine for Metrics and Events
Architectural Approach
© 2017 InfluxData. All rights reserved.5 © 2017 InfluxData. All rights reserved.5
InfluxData Architectural Overview
© 2017 InfluxData. All rights reserved.6 © 2017 InfluxData. All rights reserved.6
Why TICK?
¨ Easy to use
¨ No External Dependencies
¨ Allow for metrics and events (regular and
irregular time-series)
¨ Horizontally Scalable
¨ Full Platform - Not just a single tool
¨ Pull and Push for collecting time series
© 2017 InfluxData. All rights reserved.7 © 2017 InfluxData. All rights reserved.7
¨ Plugin-driven server agent for collecting &
reporting metrics
¨ Pull metrics from third party APIs, or even listen
for metrics via a statsd and Kafka consumer
services
¨ Output plugins to send metrics to a variety of
other datastores, services, and message
queues, including
¨ InfluxDB, Graphite, OpenTSDB, Datadog,
Librato, Kafka, MQTT, NSQ, and many
others
¨ Minimal memory footprint
¨ Written entirely in Go. It compiles into a single
binary with no external dependencies
© 2017 InfluxData. All rights reserved.8 © 2017 InfluxData. All rights reserved.8
¨ Custom high performance datastore written
specifically for time series data
¨ The TSM engine allows for high ingest speed &
data compression
¨ Written entirely in Go. It compiles into a single
binary with no external dependencies
¨ Expressive SQL-like query language tailored to
easily query aggregated data
¨ Tags allow series to be indexed for fast and
efficient queries
¨ Retention policies efficiently auto-expire stale data
¨ Supports ephemeral time series (1+ Billion time
series) with TSI
© 2017 InfluxData. All rights reserved.9 © 2017 InfluxData. All rights reserved.9
Load Write Queries Cardinality
without TSI
Cardinality
with TSI
Low <250k/sec <25/sec <100k 1B+
Moderate >500k/sec >25/sec >100K 1B+
High >750k/sec >50/sec >1M 1B+
Performance
© 2017 InfluxData. All rights reserved.10 © 2017 InfluxData. All rights reserved.10
Hardware Recommendation
Load CPU RAM Disk (IOPS)
Must be SSD
Low 4 Cores 4-8G 500
Moderate 6 Cores 8-16G 500-1K
High 8+ Cores 16G+ 1K
© 2017 InfluxData. All rights reserved.11 © 2017 InfluxData. All rights reserved.11
An integrated user experience for the TICK stack:
¨ Administrative capabilities
○ Database creation
○ User management
○ Alert configuration
¨ Data exploration
○ Rapid creation & visualization of queries
○ Custom dashboards using collected
metrics & events
¨ Rapid time to value
○ Pre-built dashboards based on metrics
from Telegraf
¨ Create Kapacitor Tasks
○ Rules
○ TICKscript editor
© 2017 InfluxData. All rights reserved.12 © 2017 InfluxData. All rights reserved.12
¨ Open source data processing framework that
makes it easy to create alerts, run ETL jobs and
detect anomalies
¨ Downsample InfluxDB data
¨ Query data from InfluxDB on a schedule, and
receive data
¨ Perform data transformation and enrichment
¨ Store transformed data back in InfluxDB
¨ Add custom user defined functions to detect
anomalies
¨ Compatible with Prometheus scapers
¨ Integrate with HipChat, OpsGenie, Alerta,
Sensu, PagerDuty, Slack, and more
© 2017 InfluxData. All rights reserved.13 © 2017 InfluxData. All rights reserved.13
Load Tasks Writes Cardinality
Low < 10 < 100k/sec < 100k
Moderate < 100 > 100k/sec > 100K
High > 100 > 300k/sec > 1M
Performance
© 2017 InfluxData. All rights reserved.14 © 2017 InfluxData. All rights reserved.14
Hardware Recommendation
Load Tasks CPU RAM
Low < 10 4 Cores 4-8G
Moderate < 100 6 Cores 8-16G
High > 100 8+ Cores 16G+
© 2017 InfluxData. All rights reserved.15 © 2017 InfluxData. All rights reserved.15
¨ InfluxDB Clustering capabilities:
¨ High-Availability
¨ Scalability
¨ Kapacitor Clustering capabilities:
¨ High-Availability
¨ Scalability (coming)
¨ Enhanced backup and restore
¨ Fine-grained auth
¨ Enhanced Security
¨ Battle Tested and hardened
¨ Enhanced production deployment capabilities
InfluxEnterprise
© 2017 InfluxData. All rights reserved.16 © 2017 InfluxData. All rights reserved.16
¨ InfluxEnterprise
¨ Chronograf
¨ Basic Alerting
¨ Kapacitor Add-on
¨ Fully managed by InfluxData
¨ Monitored by InfluxData team
¨ Fully Optimized
¨ Runs in AWS
InfluxCloud
© 2017 InfluxData. All rights reserved.17 © 2017 InfluxData. All rights reserved.17
Product Offerings
¨ Open Source Core
¨ Extensible
¨ Support for Regular and
Irregular Data
¨ High Availability (Clustering)
¨ Scalability (Clustering)
¨ Advanced Backup and Restore
¨ Complete Platform support
¨ Managed by InfluxData
¨ Runs on AWS
¨ Run on Premises
¨ Open Source Core
¨ Extensible
¨ Support for Regular and
Irregular Data
¨ High Availability (Clustering)
¨ Scalability (Clustering)
¨ Advanced Backup and Restore
¨ Complete Platform support
¨ Managed by InfluxData
¨ Runs on any Cloud
¨ Runs on Premises
¨ Open Source Core
¨ Extensible
¨ Support for Regular and
Irregular Data
¨ High Availability (Clustering)
¨ Scalability (Clustering)
¨ Advanced Backup and Restore
¨ Complete Platform support
¨ Managed by InfluxData
¨ Runs on Cloud
¨ Runs on Premises
InfluxCloud
Great place to start
InfluxEnterprise
Ready to scale
TICK Stack
Open Source
Demo
Questions?
Thank you

Virtual training Intro to the Tick stack and InfluxEnterprise

  • 1.
    Getting Started Series: Introductionto the TICK Stack & InfluxEnterprise
  • 2.
    © 2017 InfluxData.All rights reserved.2 Agenda ¨ What is the TICK Stack ¨ What is InfluxEnterprise and InfluxCloud ¨ Demo of the installation and use of the TICK Stack
  • 3.
    © 2017 InfluxData.All rights reserved.3 © 2017 InfluxData. All rights reserved.3 • High volume of real-time writes • Irregular (events) and regular (metrics) • Retention policies New workload requirements • Aggregation and summation time-based functions • Large range scans of many records • Ordering, ranking, and limiting Time-based queries • Distributed by design • Fast and consistent • Always available Scalability and availability A modern Open Source Platform built from the ground up for metrics and events. The Modern Engine for Metrics and Events
  • 4.
  • 5.
    © 2017 InfluxData.All rights reserved.5 © 2017 InfluxData. All rights reserved.5 InfluxData Architectural Overview
  • 6.
    © 2017 InfluxData.All rights reserved.6 © 2017 InfluxData. All rights reserved.6 Why TICK? ¨ Easy to use ¨ No External Dependencies ¨ Allow for metrics and events (regular and irregular time-series) ¨ Horizontally Scalable ¨ Full Platform - Not just a single tool ¨ Pull and Push for collecting time series
  • 7.
    © 2017 InfluxData.All rights reserved.7 © 2017 InfluxData. All rights reserved.7 ¨ Plugin-driven server agent for collecting & reporting metrics ¨ Pull metrics from third party APIs, or even listen for metrics via a statsd and Kafka consumer services ¨ Output plugins to send metrics to a variety of other datastores, services, and message queues, including ¨ InfluxDB, Graphite, OpenTSDB, Datadog, Librato, Kafka, MQTT, NSQ, and many others ¨ Minimal memory footprint ¨ Written entirely in Go. It compiles into a single binary with no external dependencies
  • 8.
    © 2017 InfluxData.All rights reserved.8 © 2017 InfluxData. All rights reserved.8 ¨ Custom high performance datastore written specifically for time series data ¨ The TSM engine allows for high ingest speed & data compression ¨ Written entirely in Go. It compiles into a single binary with no external dependencies ¨ Expressive SQL-like query language tailored to easily query aggregated data ¨ Tags allow series to be indexed for fast and efficient queries ¨ Retention policies efficiently auto-expire stale data ¨ Supports ephemeral time series (1+ Billion time series) with TSI
  • 9.
    © 2017 InfluxData.All rights reserved.9 © 2017 InfluxData. All rights reserved.9 Load Write Queries Cardinality without TSI Cardinality with TSI Low <250k/sec <25/sec <100k 1B+ Moderate >500k/sec >25/sec >100K 1B+ High >750k/sec >50/sec >1M 1B+ Performance
  • 10.
    © 2017 InfluxData.All rights reserved.10 © 2017 InfluxData. All rights reserved.10 Hardware Recommendation Load CPU RAM Disk (IOPS) Must be SSD Low 4 Cores 4-8G 500 Moderate 6 Cores 8-16G 500-1K High 8+ Cores 16G+ 1K
  • 11.
    © 2017 InfluxData.All rights reserved.11 © 2017 InfluxData. All rights reserved.11 An integrated user experience for the TICK stack: ¨ Administrative capabilities ○ Database creation ○ User management ○ Alert configuration ¨ Data exploration ○ Rapid creation & visualization of queries ○ Custom dashboards using collected metrics & events ¨ Rapid time to value ○ Pre-built dashboards based on metrics from Telegraf ¨ Create Kapacitor Tasks ○ Rules ○ TICKscript editor
  • 12.
    © 2017 InfluxData.All rights reserved.12 © 2017 InfluxData. All rights reserved.12 ¨ Open source data processing framework that makes it easy to create alerts, run ETL jobs and detect anomalies ¨ Downsample InfluxDB data ¨ Query data from InfluxDB on a schedule, and receive data ¨ Perform data transformation and enrichment ¨ Store transformed data back in InfluxDB ¨ Add custom user defined functions to detect anomalies ¨ Compatible with Prometheus scapers ¨ Integrate with HipChat, OpsGenie, Alerta, Sensu, PagerDuty, Slack, and more
  • 13.
    © 2017 InfluxData.All rights reserved.13 © 2017 InfluxData. All rights reserved.13 Load Tasks Writes Cardinality Low < 10 < 100k/sec < 100k Moderate < 100 > 100k/sec > 100K High > 100 > 300k/sec > 1M Performance
  • 14.
    © 2017 InfluxData.All rights reserved.14 © 2017 InfluxData. All rights reserved.14 Hardware Recommendation Load Tasks CPU RAM Low < 10 4 Cores 4-8G Moderate < 100 6 Cores 8-16G High > 100 8+ Cores 16G+
  • 15.
    © 2017 InfluxData.All rights reserved.15 © 2017 InfluxData. All rights reserved.15 ¨ InfluxDB Clustering capabilities: ¨ High-Availability ¨ Scalability ¨ Kapacitor Clustering capabilities: ¨ High-Availability ¨ Scalability (coming) ¨ Enhanced backup and restore ¨ Fine-grained auth ¨ Enhanced Security ¨ Battle Tested and hardened ¨ Enhanced production deployment capabilities InfluxEnterprise
  • 16.
    © 2017 InfluxData.All rights reserved.16 © 2017 InfluxData. All rights reserved.16 ¨ InfluxEnterprise ¨ Chronograf ¨ Basic Alerting ¨ Kapacitor Add-on ¨ Fully managed by InfluxData ¨ Monitored by InfluxData team ¨ Fully Optimized ¨ Runs in AWS InfluxCloud
  • 17.
    © 2017 InfluxData.All rights reserved.17 © 2017 InfluxData. All rights reserved.17 Product Offerings ¨ Open Source Core ¨ Extensible ¨ Support for Regular and Irregular Data ¨ High Availability (Clustering) ¨ Scalability (Clustering) ¨ Advanced Backup and Restore ¨ Complete Platform support ¨ Managed by InfluxData ¨ Runs on AWS ¨ Run on Premises ¨ Open Source Core ¨ Extensible ¨ Support for Regular and Irregular Data ¨ High Availability (Clustering) ¨ Scalability (Clustering) ¨ Advanced Backup and Restore ¨ Complete Platform support ¨ Managed by InfluxData ¨ Runs on any Cloud ¨ Runs on Premises ¨ Open Source Core ¨ Extensible ¨ Support for Regular and Irregular Data ¨ High Availability (Clustering) ¨ Scalability (Clustering) ¨ Advanced Backup and Restore ¨ Complete Platform support ¨ Managed by InfluxData ¨ Runs on Cloud ¨ Runs on Premises InfluxCloud Great place to start InfluxEnterprise Ready to scale TICK Stack Open Source
  • 18.
  • 19.
  • 20.