Marina Svicevic, Milos Pavkovic, Mladen Maric, Vijeta Hingorani [Socialgist] | Transforming Email Reports into Self-Serving Dashboards & Detecting Anomalies In-Stream | InfluxDays NA 2021

1. A platform that provides the tools & services to connect research & analytics companies to the data which they depend upon.

2. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Project Overview : Transforming Email Reports • Consume messages from Apache Kafka • Aggregate and store in Influxdb • Goal is to generate self serving dashboards • High volume mismatch issue solved by • adding unique tag • building point cache • randomizing timestamp

5. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Project Overview : Anomaly Detection • into a problem of counts mismatch for high traffic Kafka topics and we solved it by randomizing timestamp and building cache. • Collecting tons of data from various sources • Storing count of collected data in InfluxDB • Goal is to find anomalies in data • There are three types of anomalies: • sudden drops • volume decay • deadman

6. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Usage of InfluxDB • into a problem of counts mismatch for high traffic Kafka topics and we solved it by randomizing timestamp and building cache. • Storing results of Anomaly Detection into InfluxDB • Alerts - Tick scripts • Using dynamic thresholds • Alert handling: • slack channel • email (sms)

7. © 2021 InfluxData Inc. All Rights Reserved. © 2021 InfluxData Inc. All Rights Reserved. Visualizing • Slack alert • which stream • anomaly strength • threshold • Visualization in Grafana • Obtaining data from InfluxDB

Marina Svicevic, Milos Pavkovic, Mladen Maric, Vijeta Hingorani [Socialgist] | Transforming Email Reports into Self-Serving Dashboards & Detecting Anomalies In-Stream | InfluxDays NA 2021

You are reading a preview.

Check these out next

Marina Svicevic, Milos Pavkovic, Mladen Maric, Vijeta Hingorani [Socialgist] | Transforming Email Reports into Self-Serving Dashboards & Detecting Anomalies In-Stream | InfluxDays NA 2021

More Related Content

Slideshows for you (20)

Similar to Marina Svicevic, Milos Pavkovic, Mladen Maric, Vijeta Hingorani [Socialgist] | Transforming Email Reports into Self-Serving Dashboards & Detecting Anomalies In-Stream | InfluxDays NA 2021 (20)

More from InfluxData (20)

Recently uploaded (20)