Noah will walk you through a typical data architecture for an IoT deployment: from sensor to edge to cloud. Then, it will be a hands-on demo to gather data from the device, display it on a dashboard and trigger alerts.
IoT Event Processing and Analytics with InfluxDB in Google Cloud | Christoph ...InfluxData
The presentation introduces a Google Cloud native architecture for collecting, processing, analyzing and archiving of events from IoT devices, vehicles as well as upstream software systems. InfluxDB and its connection to global native Google Cloud services like BigQuery or Cloud Machine Learning Engine as well as Kubernetes is at the center of the architecture. The architecture demonstrates how access to global scaling cloud services addresses use cases from the Energy Sector.
Catalogs - Turning a Set of Parquet Files into a Data SetInfluxData
InfluxDB IOx Tech Talks
Placing a Parquet file into an object store serves as a simple data persistence format. However, storing data into multiple files enabling upserts, deletions, format upgrades, metadata management, and consistency checks at scale requires some form of a catalog that manages these files. In this talk we will explore the requirements for a catalog for InfluxDB IOx, prior art from the Parquet ecosystem, and the proposed solution.
A hands-on workshop about a typical data architecture for an IoT device - how to gather data from the device, display it on a dashboard and trigger alerts based on thresholds that you set.
Kapacitor is the brains of the TICK Stack. Nathaniel will cover the stream processing capabilities of Kapacitor, how to process data before it gets stored in InfluxDB and after it is stored, best practices around anomaly detection and machine learning. In addition, Nathaniel will discuss how to configure the clustered version of Kapacitor.
Kapacitor is the brains of the TICK Stack. Nathaniel will cover the stream processing capabilities of Kapacitor, how to process data before it gets stored in InfluxDB and after it is stored, best practices around anomaly detection and machine learning. In addition, Nathaniel will discuss how to configure the clustered version of Kapacitor.
How to Create a Modern IIoT Monitoring Solution On iOS Using Swift, MQTT and ...InfluxData
MOXIE IoT uses industry standards and cutting-edge technology to create a monitoring solution which provides their manufacturing customers with a single source of truth. Their iOS iPad app equips their customers to visualize and analyze industrial factory data in real time. Discover how they use a time series database, MQTT and Ultra-Wideband to accurately measure and track any object, device, personnel or machinery.
In this webinar, Dr. Austin Gurley will dive into:
MOXIE’s approach to app-centric asset monitoring
Their ability to help customers streamline operations while bridging the gap between hardware and software
How a time series database improves customer experience by enabling them to query, filter and parse their data
Techniques for performing Flux queries in iOS Swift
Vasilis Papavasiliou [Mist.io] | Integrating Telegraf, InfluxDB and Mist to M...InfluxData
Mist is an open source multicloud management platform. Mist.io's goal is to make multicloud simple and offer a single interface from where you can manage everything. To help users make informed decisions about their infrastructure, Mist is integrating with Telegraf and InfluxDB for collecting and storing monitoring metrics. This is an evolution of a previous stack based on collectd and Graphite. This session will go over why Mist.io moved and the implementation details of its current stack. The session will also analyze the challenges faced and the solutions built. This session is a follow-up to the webinar presentation at https://www.influxdata.com/resources/how-to-gain-visibility-into-containers-vms-and-multi-cloud-environments-using-telegraf-influxdb-and-mist/ which focuses more on the technical details.
Learn more about InfluxData’s time series platform. InfluxDB Cloud is a fast, elastic, serverless real-time monitoring platform, dashboarding engine, analytics service and event and metrics processor. It is available on AWS, Azure and Google Cloud. Since its launch, we have been busy making updates to the product!
Join Balaji Palani, Director of Product Management, as he demonstrates the the latest features of InfluxDB Cloud. This one-hour webinar will feature a product update and Q&A time.
IoT Event Processing and Analytics with InfluxDB in Google Cloud | Christoph ...InfluxData
The presentation introduces a Google Cloud native architecture for collecting, processing, analyzing and archiving of events from IoT devices, vehicles as well as upstream software systems. InfluxDB and its connection to global native Google Cloud services like BigQuery or Cloud Machine Learning Engine as well as Kubernetes is at the center of the architecture. The architecture demonstrates how access to global scaling cloud services addresses use cases from the Energy Sector.
Catalogs - Turning a Set of Parquet Files into a Data SetInfluxData
InfluxDB IOx Tech Talks
Placing a Parquet file into an object store serves as a simple data persistence format. However, storing data into multiple files enabling upserts, deletions, format upgrades, metadata management, and consistency checks at scale requires some form of a catalog that manages these files. In this talk we will explore the requirements for a catalog for InfluxDB IOx, prior art from the Parquet ecosystem, and the proposed solution.
A hands-on workshop about a typical data architecture for an IoT device - how to gather data from the device, display it on a dashboard and trigger alerts based on thresholds that you set.
Kapacitor is the brains of the TICK Stack. Nathaniel will cover the stream processing capabilities of Kapacitor, how to process data before it gets stored in InfluxDB and after it is stored, best practices around anomaly detection and machine learning. In addition, Nathaniel will discuss how to configure the clustered version of Kapacitor.
Kapacitor is the brains of the TICK Stack. Nathaniel will cover the stream processing capabilities of Kapacitor, how to process data before it gets stored in InfluxDB and after it is stored, best practices around anomaly detection and machine learning. In addition, Nathaniel will discuss how to configure the clustered version of Kapacitor.
How to Create a Modern IIoT Monitoring Solution On iOS Using Swift, MQTT and ...InfluxData
MOXIE IoT uses industry standards and cutting-edge technology to create a monitoring solution which provides their manufacturing customers with a single source of truth. Their iOS iPad app equips their customers to visualize and analyze industrial factory data in real time. Discover how they use a time series database, MQTT and Ultra-Wideband to accurately measure and track any object, device, personnel or machinery.
In this webinar, Dr. Austin Gurley will dive into:
MOXIE’s approach to app-centric asset monitoring
Their ability to help customers streamline operations while bridging the gap between hardware and software
How a time series database improves customer experience by enabling them to query, filter and parse their data
Techniques for performing Flux queries in iOS Swift
Vasilis Papavasiliou [Mist.io] | Integrating Telegraf, InfluxDB and Mist to M...InfluxData
Mist is an open source multicloud management platform. Mist.io's goal is to make multicloud simple and offer a single interface from where you can manage everything. To help users make informed decisions about their infrastructure, Mist is integrating with Telegraf and InfluxDB for collecting and storing monitoring metrics. This is an evolution of a previous stack based on collectd and Graphite. This session will go over why Mist.io moved and the implementation details of its current stack. The session will also analyze the challenges faced and the solutions built. This session is a follow-up to the webinar presentation at https://www.influxdata.com/resources/how-to-gain-visibility-into-containers-vms-and-multi-cloud-environments-using-telegraf-influxdb-and-mist/ which focuses more on the technical details.
Learn more about InfluxData’s time series platform. InfluxDB Cloud is a fast, elastic, serverless real-time monitoring platform, dashboarding engine, analytics service and event and metrics processor. It is available on AWS, Azure and Google Cloud. Since its launch, we have been busy making updates to the product!
Join Balaji Palani, Director of Product Management, as he demonstrates the the latest features of InfluxDB Cloud. This one-hour webinar will feature a product update and Q&A time.
Craig will discuss architecture patterns with InfluxDB Enterprise, covering an overview of InfluxDB Enterprise, features, ingestion and query rates, deployment examples, replication patterns, and general advice.
Jacob Marble [InfluxData] | Observability with InfluxDB IOx and OpenTelemetry...InfluxData
The document discusses observability with InfluxDB/IOx and OpenTelemetry. It provides definitions and descriptions of InfluxDB/TSM and InfluxDB/IOx storage engines, highlighting their strengths. It also defines OpenTelemetry as a standard for observability signals including metrics, logs and traces. The document outlines how OpenTelemetry aims to provide a common instrumentation standard to unify the observability stack, and describes how InfluxData supports and integrates with OpenTelemetry.
A True Story About Database OrchestrationInfluxData
Gianluca shared the architecture of the project, described the criticalities of the infrastructure and how the team strives to make this powerful service secure, fast, and reliable for all customers using InfluxCloud.
Streaming Sensor Data with Grafana and InfluxDB | Ryan Mckinley | GrafanaInfluxData
In this session, Ryan will preview the new streaming and shared query support in Grafana. He will show how you can visualize high-resolution real-time sensor streams using InfluxDB and Grafana.
Taming the Tiger: Tips and Tricks for Using TelegrafInfluxData
On 17th May as part of InfluxDays EMEA 2021 Virtual Experience, the Technical Services team will be offering a free live InfluxDB training to the first 300 registered attendees. This will be hosted over Zoom with two main trainers and there will be assistants to help participants with the course work. The training will be recorded and made available on the InfluxDays website and the InfluxData YouTube channel.
Monitor Kubernetes in Rancher using InfluxDataInfluxData
The document discusses monitoring Kubernetes in Rancher using InfluxData. It provides an introduction to Rancher and how it can deploy and manage Kubernetes clusters. It then discusses the time series data problem and how InfluxData solutions like Telegraf, InfluxDB, Chronograf and Kapacitor can collect, store and analyze the high volume time series data generated by containers. It highlights key features of Rancher and InfluxData and demonstrates how their tools can be used together to monitor Kubernetes workloads.
How to Deliver a Critical and Actionable Customer-Facing Metrics Product with...InfluxData
In IoT, understanding the health of thousands of devices is critical for deployment at scale especially when troubleshooting an issue. Particle’s customer base needed visibility into their devices with actionable data to reference in real time. Join Cullen Murphy, Site Reliability Engineer at Particle, to learn how the team built a metrics system on Telegraf, Kubernetes, and Prometheus to deploy a customer-facing product that provides critical and relevant data to their IoT product creators.
Alan Pope, Sebastian Spaink [InfluxData] | Data Collection 101 | InfluxDays N...InfluxData
The document discusses Telegraf, an open source agent for collecting and reporting metrics and events. It provides an overview of Telegraf and how it works, describes new input and output plugins, demonstrates new parsers for JSON and XML data, discusses community contributions and improvements to Telegraf development processes, and encourages audience participation.
This document appears to be an agenda for InfluxDays EMEA 2021, an event hosted by InfluxData. It includes opening remarks by the CEO, keynotes on InfluxDB IOx and managing dashboards/alerts. There is a networking break and sessions on integrating Telegraf/InfluxDB/Mist and an InfluxDB roadmap update. Day 2 includes sessions on Grafana, InfluxDB Cloud, IIoT monitoring and an InfluxDB community update. The document thanks InfluxData commercial customers and contributors for their support.
Lessons Learned Running InfluxDB Cloud and Other Cloud Services at Scale by T...InfluxData
In this session, Tim will cover principles, learnings, and practical advice from operating multiple cloud services at scale, including of course our InfluxDB Cloud service. What do we monitor, what do we alert on, and how did we architect it all? What are our underlying architectural and operational principles?
A TRUE STORY ABOUT DATABASE ORCHESTRATIONInfluxData
During this talk, Gianluca will share the architecture of the project, describe the criticalities of the infrastructure and how the team strives to make this powerful service secure, fast, and reliable for all customers using InfluxCloud.
InfluxDB + Kepware: Start Monitoring Industrial Data QuicklyInfluxData
Kepware (a PTC Technology) is the market leader in Industrial Connectivity platforms, and is helping companies bridge the gap between IT and OT. For the past 25 years, Kepware has developed industrial connectivity tools including over 150 industrial drivers, and supporting over 300 protocols – from traditional automation protocols such as OPC UA or OPC DA to more modern IIoT protocols like MQTT or REST. Together with InfluxDB, customers achieve quick time to value, gaining insights from their industrial time-stamped data. Developers are able to collect, process, store and analyze thousands of metrics faster! Join this webinar to learn multiple approaches to sending IIoT data to a time series database.
In this webinar, Kyle Carreau and Jay Clifford dive into:
How to use Telegraf to send OPC UA and MQTT metrics to InfluxDB
The new Kepware IoT Gateway Advanced Template features to send data directly to InfluxDB
Best practices for using InfluxDB + Kepware for industrial automation – stick around for a demo!
No matter what type of IoT devices you have, or what your use case is for them, you’re going to end up producing a lot of time series data. What you use to handle it is going to be as important to your success as the code you write yourself.
This talk will evaluate the available open source tools for the collection, activation, transmission and visualization of time series data on the IoT Edge, and demonstrate how to use them, together with InfluxDB, to solve various use cases for the Internet of Things.
Optimizing InfluxDB Performance in the Real World | Sam Dillard | InfluxDataInfluxData
Sam will provide practical tips and techniques learned from helping hundreds of customers deploy InfluxDB and InfluxDB Enterprise. This includes hardware and architecture choices, schema design, configuration setup, and running queries.
Bernard Paques & Kevin Polossat [AWS] | Combining the Power of InfluxDB and A...InfluxData
Data from sensors and systems flows in from a myriad of sources in industrial settings. In this session, learn how to combine the power of InfluxDB with IoT tools and cloud resources from AWS to extract the most value out of your IoT data. We’ll also be sharing some real-world examples of how customers are using these combined solutions to gain a competitive edge.
How to Monitor Your Gaming Computer with a Time Series DatabaseInfluxData
Virtual Time Series Meetup
Whether you're a gamer determining computer utilization or if you're a parent monitoring your child's gaming habits, a time series database can help track important computer stats. Discover how you can use InfluxDB to monitor a computer’s fluctuating GPU and CPU usage due to online gaming, and how to set up Slack alerts about unexpected computer utilization
Join this virtual time series meetup to learn how a parent is using Telegraf, InfluxDB Cloud and Slack to monitor their child's computer which is used for schooling and gaming. At a time when home and school converge, making sure kids are doing their homework (at least some of the time) and not gaming (all the time) is a must!
How a Time Series Database Contributes to a Decentralized Cloud Object Storag...InfluxData
In this presentation, you'll learn how InfluxDB is a component to Storj’s Tardigrade service and workflows. John Gleeson and Ben Sirb of Storj Lab will Storj’s redefinition of a cloud object storage network, how InfluxData fits into Storj’s Open Source Partner Program, and how to collect and manage high-volume, real-time telemetry data from a distributed network.
Tim Hall and Ryan Betts [InfluxData] | InfluxDB Roadmap and Engineering Updat...InfluxData
In this talk, Tim and Ryan will provide an InfluxDB roadmap and engineering update. This will also include what you can expect in the future in terms of InfluxDB and Flux capabilities.
How to Store and Visualize CAN Bus Telematic Data with InfluxDB Cloud and Gra...InfluxData
The document discusses how CSS Electronics stores and visualizes telematic data collected from CAN bus networks using InfluxDB and Grafana. Specifically, it summarizes:
1) CSS Electronics develops CAN bus data loggers and sensors to collect data from vehicles and industrial equipment. They implemented InfluxDB to store the decoded telematic data and Grafana to visualize it in customizable dashboards.
2) The process involves logging raw CAN bus data, decoding it using Python scripts, and writing it to InfluxDB. Grafana then pulls the data from InfluxDB to generate intuitive dashboards without coding.
3) Examples are shown of heavy vehicle, automotive, maritime, and sensor fusion dashboards. The solution is open source
Building Your Data Streams for all the IoTDevOps.com
Apache NIFI and OPC-UA have been game changers in the world of IoT, allowing you to automate the flow of data from IoT sensors to just about anywhere you want. In this presentation, Craig Hobbs of InfluxData will demonstrate how you can collect and process data streams of millions of values per second using an OPC-UA server and automate into an InfluxDB stream processing engine using Nifi. You'll learn how to setup your workflow to gain a highly-available, fast, scalable, and reliable data stream as a real-world application.
Introducing Cloudera DataFlow (CDF) 2.13.19Cloudera, Inc.
Watch this webinar to understand how Hortonworks DataFlow (HDF) has evolved into the new Cloudera DataFlow (CDF). Learn about key capabilities that CDF delivers such as -
-Powerful data ingestion powered by Apache NiFi
-Edge data collection by Apache MiNiFi
-IoT-scale streaming data processing with Apache Kafka
-Enterprise services to offer unified security and governance from edge-to-enterprise
Craig will discuss architecture patterns with InfluxDB Enterprise, covering an overview of InfluxDB Enterprise, features, ingestion and query rates, deployment examples, replication patterns, and general advice.
Jacob Marble [InfluxData] | Observability with InfluxDB IOx and OpenTelemetry...InfluxData
The document discusses observability with InfluxDB/IOx and OpenTelemetry. It provides definitions and descriptions of InfluxDB/TSM and InfluxDB/IOx storage engines, highlighting their strengths. It also defines OpenTelemetry as a standard for observability signals including metrics, logs and traces. The document outlines how OpenTelemetry aims to provide a common instrumentation standard to unify the observability stack, and describes how InfluxData supports and integrates with OpenTelemetry.
A True Story About Database OrchestrationInfluxData
Gianluca shared the architecture of the project, described the criticalities of the infrastructure and how the team strives to make this powerful service secure, fast, and reliable for all customers using InfluxCloud.
Streaming Sensor Data with Grafana and InfluxDB | Ryan Mckinley | GrafanaInfluxData
In this session, Ryan will preview the new streaming and shared query support in Grafana. He will show how you can visualize high-resolution real-time sensor streams using InfluxDB and Grafana.
Taming the Tiger: Tips and Tricks for Using TelegrafInfluxData
On 17th May as part of InfluxDays EMEA 2021 Virtual Experience, the Technical Services team will be offering a free live InfluxDB training to the first 300 registered attendees. This will be hosted over Zoom with two main trainers and there will be assistants to help participants with the course work. The training will be recorded and made available on the InfluxDays website and the InfluxData YouTube channel.
Monitor Kubernetes in Rancher using InfluxDataInfluxData
The document discusses monitoring Kubernetes in Rancher using InfluxData. It provides an introduction to Rancher and how it can deploy and manage Kubernetes clusters. It then discusses the time series data problem and how InfluxData solutions like Telegraf, InfluxDB, Chronograf and Kapacitor can collect, store and analyze the high volume time series data generated by containers. It highlights key features of Rancher and InfluxData and demonstrates how their tools can be used together to monitor Kubernetes workloads.
How to Deliver a Critical and Actionable Customer-Facing Metrics Product with...InfluxData
In IoT, understanding the health of thousands of devices is critical for deployment at scale especially when troubleshooting an issue. Particle’s customer base needed visibility into their devices with actionable data to reference in real time. Join Cullen Murphy, Site Reliability Engineer at Particle, to learn how the team built a metrics system on Telegraf, Kubernetes, and Prometheus to deploy a customer-facing product that provides critical and relevant data to their IoT product creators.
Alan Pope, Sebastian Spaink [InfluxData] | Data Collection 101 | InfluxDays N...InfluxData
The document discusses Telegraf, an open source agent for collecting and reporting metrics and events. It provides an overview of Telegraf and how it works, describes new input and output plugins, demonstrates new parsers for JSON and XML data, discusses community contributions and improvements to Telegraf development processes, and encourages audience participation.
This document appears to be an agenda for InfluxDays EMEA 2021, an event hosted by InfluxData. It includes opening remarks by the CEO, keynotes on InfluxDB IOx and managing dashboards/alerts. There is a networking break and sessions on integrating Telegraf/InfluxDB/Mist and an InfluxDB roadmap update. Day 2 includes sessions on Grafana, InfluxDB Cloud, IIoT monitoring and an InfluxDB community update. The document thanks InfluxData commercial customers and contributors for their support.
Lessons Learned Running InfluxDB Cloud and Other Cloud Services at Scale by T...InfluxData
In this session, Tim will cover principles, learnings, and practical advice from operating multiple cloud services at scale, including of course our InfluxDB Cloud service. What do we monitor, what do we alert on, and how did we architect it all? What are our underlying architectural and operational principles?
A TRUE STORY ABOUT DATABASE ORCHESTRATIONInfluxData
During this talk, Gianluca will share the architecture of the project, describe the criticalities of the infrastructure and how the team strives to make this powerful service secure, fast, and reliable for all customers using InfluxCloud.
InfluxDB + Kepware: Start Monitoring Industrial Data QuicklyInfluxData
Kepware (a PTC Technology) is the market leader in Industrial Connectivity platforms, and is helping companies bridge the gap between IT and OT. For the past 25 years, Kepware has developed industrial connectivity tools including over 150 industrial drivers, and supporting over 300 protocols – from traditional automation protocols such as OPC UA or OPC DA to more modern IIoT protocols like MQTT or REST. Together with InfluxDB, customers achieve quick time to value, gaining insights from their industrial time-stamped data. Developers are able to collect, process, store and analyze thousands of metrics faster! Join this webinar to learn multiple approaches to sending IIoT data to a time series database.
In this webinar, Kyle Carreau and Jay Clifford dive into:
How to use Telegraf to send OPC UA and MQTT metrics to InfluxDB
The new Kepware IoT Gateway Advanced Template features to send data directly to InfluxDB
Best practices for using InfluxDB + Kepware for industrial automation – stick around for a demo!
No matter what type of IoT devices you have, or what your use case is for them, you’re going to end up producing a lot of time series data. What you use to handle it is going to be as important to your success as the code you write yourself.
This talk will evaluate the available open source tools for the collection, activation, transmission and visualization of time series data on the IoT Edge, and demonstrate how to use them, together with InfluxDB, to solve various use cases for the Internet of Things.
Optimizing InfluxDB Performance in the Real World | Sam Dillard | InfluxDataInfluxData
Sam will provide practical tips and techniques learned from helping hundreds of customers deploy InfluxDB and InfluxDB Enterprise. This includes hardware and architecture choices, schema design, configuration setup, and running queries.
Bernard Paques & Kevin Polossat [AWS] | Combining the Power of InfluxDB and A...InfluxData
Data from sensors and systems flows in from a myriad of sources in industrial settings. In this session, learn how to combine the power of InfluxDB with IoT tools and cloud resources from AWS to extract the most value out of your IoT data. We’ll also be sharing some real-world examples of how customers are using these combined solutions to gain a competitive edge.
How to Monitor Your Gaming Computer with a Time Series DatabaseInfluxData
Virtual Time Series Meetup
Whether you're a gamer determining computer utilization or if you're a parent monitoring your child's gaming habits, a time series database can help track important computer stats. Discover how you can use InfluxDB to monitor a computer’s fluctuating GPU and CPU usage due to online gaming, and how to set up Slack alerts about unexpected computer utilization
Join this virtual time series meetup to learn how a parent is using Telegraf, InfluxDB Cloud and Slack to monitor their child's computer which is used for schooling and gaming. At a time when home and school converge, making sure kids are doing their homework (at least some of the time) and not gaming (all the time) is a must!
How a Time Series Database Contributes to a Decentralized Cloud Object Storag...InfluxData
In this presentation, you'll learn how InfluxDB is a component to Storj’s Tardigrade service and workflows. John Gleeson and Ben Sirb of Storj Lab will Storj’s redefinition of a cloud object storage network, how InfluxData fits into Storj’s Open Source Partner Program, and how to collect and manage high-volume, real-time telemetry data from a distributed network.
Tim Hall and Ryan Betts [InfluxData] | InfluxDB Roadmap and Engineering Updat...InfluxData
In this talk, Tim and Ryan will provide an InfluxDB roadmap and engineering update. This will also include what you can expect in the future in terms of InfluxDB and Flux capabilities.
How to Store and Visualize CAN Bus Telematic Data with InfluxDB Cloud and Gra...InfluxData
The document discusses how CSS Electronics stores and visualizes telematic data collected from CAN bus networks using InfluxDB and Grafana. Specifically, it summarizes:
1) CSS Electronics develops CAN bus data loggers and sensors to collect data from vehicles and industrial equipment. They implemented InfluxDB to store the decoded telematic data and Grafana to visualize it in customizable dashboards.
2) The process involves logging raw CAN bus data, decoding it using Python scripts, and writing it to InfluxDB. Grafana then pulls the data from InfluxDB to generate intuitive dashboards without coding.
3) Examples are shown of heavy vehicle, automotive, maritime, and sensor fusion dashboards. The solution is open source
Building Your Data Streams for all the IoTDevOps.com
Apache NIFI and OPC-UA have been game changers in the world of IoT, allowing you to automate the flow of data from IoT sensors to just about anywhere you want. In this presentation, Craig Hobbs of InfluxData will demonstrate how you can collect and process data streams of millions of values per second using an OPC-UA server and automate into an InfluxDB stream processing engine using Nifi. You'll learn how to setup your workflow to gain a highly-available, fast, scalable, and reliable data stream as a real-world application.
Introducing Cloudera DataFlow (CDF) 2.13.19Cloudera, Inc.
Watch this webinar to understand how Hortonworks DataFlow (HDF) has evolved into the new Cloudera DataFlow (CDF). Learn about key capabilities that CDF delivers such as -
-Powerful data ingestion powered by Apache NiFi
-Edge data collection by Apache MiNiFi
-IoT-scale streaming data processing with Apache Kafka
-Enterprise services to offer unified security and governance from edge-to-enterprise
There is a fuzzy border between the streaming and operational requirements of managing fast data in IoT. There is also an increasingly fuzzy border between where the computation and data management activities should occur. In this webinar, Ryan Betts, CTO of VoltDB highlights the benefits and disadvantages of a unified IoT architecture and discuss how simplifying at the core allows for high throughput, streamlined scalability and data consistency.
OSACon 2023_ Unlocking Financial Data with Real-Time PipelinesTimothy Spann
OSACon 2023_ Unlocking Financial Data with Real-Time Pipelines
Unlocking Financial Data with Real-Time Pipelines
Financial institutions thrive on accurate and timely data to drive critical decision-making processes, risk assessments, and regulatory compliance. However, managing and processing vast amounts of financial data in real-time can be a daunting task. To overcome this challenge, modern data engineering solutions have emerged, combining powerful technologies like Apache Flink, Apache NiFi, Apache Kafka, and Iceberg to create efficient and reliable real-time data pipelines. In this talk, we will explore how this technology stack can unlock the full potential of financial data, enabling organizations to make data-driven decisions swiftly and with confidence.
Introduction: Financial institutions operate in a fast-paced environment where real-time access to accurate and reliable data is crucial. Traditional batch processing falls short when it comes to handling rapidly changing financial markets and responding to customer demands promptly. In this talk, we will delve into the power of real-time data pipelines, utilizing the strengths of Apache Flink, Apache NiFi, Apache Kafka, and Iceberg, to unlock the potential of financial data.
Key Points to be Covered:
Introduction to Real-Time Data Pipelines: a. The limitations of traditional batch processing in the financial domain. b. Understanding the need for real-time data processing.
Apache Flink: Powering Real-Time Stream Processing: a. Overview of Apache Flink and its role in real-time stream processing. b. Use cases for Apache Flink in the financial industry. c. How Flink enables fast, scalable, and fault-tolerant processing of streaming financial data.
Apache Kafka: Building Resilient Event Streaming Platforms: a. Introduction to Apache Kafka and its role as a distributed streaming platform. b. Kafka's capabilities in handling high-throughput, fault-tolerant, and real-time data streaming. c. Integration of Kafka with financial data sources and consumers.
Apache NiFi: Data Ingestion and Flow Management: a. Overview of Apache NiFi and its role in data ingestion and flow management. b. Data integration and transformation capabilities of NiFi for financial data. c. Utilizing NiFi to collect and process financial data from diverse sources.
Iceberg: Efficient Data Lake Management: a. Understanding Iceberg and its role in managing large-scale data lakes. b. Iceberg's schema evolution and table-level metadata capabilities. c. How Iceberg simplifies data lake management in financial institutions.
Real-World Use Cases: a. Real-time fraud detection using Flink, Kafka, and NiFi. b. Portfolio risk analysis with Iceberg and Flink. c. Streamlined regulatory reporting leveraging all four technologies.
Best Practices and Considerations: a. Architectural considerations when building real-time financial data pipelines. b. Ensuring data integrity, security, and compliance in real-time pipelines. c. Scalability an
Meetup Streaming Data Pipeline DevelopmentTimothy Spann
Meetup Streaming Data Pipeline Development
28 June 2023 6pm EST
Milwaukee meetup
https://www.meetup.com/futureofdata-princeton/events/292976004/
Details
This will be a hybrid event with a Zoom. The in-person event will be in Milwaukee.
In this interactive session, Tim will lead participants through how to best build streaming data pipelines. He will cover how to build applications from some common use cases and highlight tips, tricks, best practices and patterns.
He will show how to build the easy way and then dive deep into the underlying open source technologies including Apache NiFi, Apache Flink, Apache Kafka and Apache Iceberg.
If you wish to follow along, please download open source projects beforehand. You can also download this helpful streaming platform: https://docs.cloudera.com/csp-ce/latest/installation/topics/csp-ce-installing-ce.html
All source code and slides will be shared for those interested in building their own FLaNK Apps. https://www.flankstack.dev/
https://www.thecapitalgrille.com/locations/wi/milwaukee/milwaukee/8027
The Capital Grille 310 W Wisconsin Ave, Milwaukee, WI 53203
limited seating, preference will be given to NLIT attendees
A peak at the menu (Not Pizza)
RISOTTO FRITTERS WITH FRESH MOZZARELLA AND PROSCIUTTO
SLICED SIRLOIN WITH ROQUEFORT AND BALSAMIC ONIONS
MINIATURE LOBSTER AND CRAB CAKES
WILD MUSHROOM AND HERBED CHEESE
You can join the meeting virtually here (no meat or cheese virtually):
Future of Data Milwaukee Meetup Streaming Data Pipeline Development 28 June 2023ssuser73434e
Future of Data Milwaukee Meetup Streaming Data Pipeline Development 28 June 2023
Future of Data: New Jersey - Princeton, Edison, Holmdel
This will be a hybrid event with a Zoom. The in-person event will be in Milwaukee.
In this interactive session, Tim will lead participants through how to best build streaming data pipelines. He will cover how to build applications from some common use cases and highlight tips, tricks, best practices and patterns.
He will show how to build the easy way and then dive deep into the underlying open source technologies including Apache NiFi, Apache Flink, Apache Kafka and Apache Iceberg.
If you wish to follow along, please download open source projects beforehand. You can also download this helpful streaming platform: https://docs.cloudera.com/csp-ce/latest/installation/topics/csp-ce-installing-ce.html
All source code and slides will be shared for those interested in building their own FLaNK Apps. https://www.flankstack.dev/
https://www.thecapitalgrille.com/locations/wi/milwaukee/milwaukee/8027
The Capital Grille 310 W Wisconsin Ave, Milwaukee, WI 53203
limited seating, preference will be given to NLIT attendees
A peak at the menu (Not Pizza)
RISOTTO FRITTERS WITH FRESH MOZZARELLA AND PROSCIUTTO
SLICED SIRLOIN WITH ROQUEFORT AND BALSAMIC ONIONS
MINIATURE LOBSTER AND CRAB CAKES
WILD MUSHROOM AND HERBED CHEESE
You can join the meeting virtually here (no meat or cheese virtually):
Tracking crime as it occurs with apache phoenix, apache hbase and apache nifiTimothy Spann
Tracking crime as it occurs with apache phoenix, apache hbase and apache nifi.
Ingesting JSON Crime Feeds, XML Feeds, Twitter feeds, Traffic Camera Images.
Where is the edge in IoT and how much can you do there? Data collection? Analytics? I’ll show you how to build and deploy an embedded IoT edge platform that can do data collection, analytics, dashboarding and much more. All using Open Source.
As IoT deployments move forward, the need to collect, analyze, and respond to data further out on the edge becomes a critical factor in the success – or failure – of any IoT project. Network bandwidth costs may be dropping, and storage is cheaper than ever, but at IoT scale, these costs can still quickly overrun a project’s budget and ultimately doom it to failure.
The more you centralize your data collection and storage, the higher these costs become. Edge data collection and analysis can dramatically lower these costs, plus decrease the time to react to critical sensor data. With most data platforms, it simply isn’t practical, or even possible, to push collection AND analytics to the edge. In this talk I’ll show how I’ve done exactly this with a combination of open source hardware – Pine64 – and open source software – InfluxDB – to build a practical, efficient and scalable data collection and analysis gateway device for IoT deployments. The edge is where the data is, so the edge is where the data collection and analytics needs to be.
Open Source Edge Computing Platforms - OverviewKrishna-Kumar
IEEE 11th International Conference - COMSNETS 2019 - Last MilesTalk - Jan 2019. This talk is for Beginner or intermediate levels only. Kubernetes and related edge platforms are discussed.
Companies that understand how to overcome Data Gravity with a LiveData strategy stand to benefit the most from innovations in data and analytics. Others will continue to invest in legacy systems and data silos that fail to take advantage of distributed computing and the rapid pace of data product innovation on the cloud. This talk shares best practices our clients have taken to evolve their data architecture to become a LiveData company.
Open Source for Industry 4.0 – Open IoT Summit NA 2018Benjamin Cabé
Industry 4.0 is set to revolutionize the manufacturing industry. The potential for more flexible manufacturing, more efficient processes and lower costs are the driving factors behind the investment in Industry 4.0 solutions. A key part of creating successful Industry 4.0 solutions will be software on the factory floor and in the cloud.
In this talk, we will introduce how open source software has become a trusted source of technology for the enterprise IT software industry and how the Eclipse IoT open source community and other open source communities are now ready to provide production ready technology for the manufacturing industry and Industry 4.0. Open source software will provide the key building blocks that will promote the interoperability and flexibility required by Industry 4.0 solutions.
IoT Deep Dive - Be an IoT Developer for an HourTaisuke Yamada
This document summarizes a workshop on IoT development. It discusses setting up a demo IoT system to monitor activity using sensors. Participants will experience data extraction, analysis, application development, and designing an upgradable system. The demo will use ESP8266 IoT modules to send sensor data over WiFi to cloud services for storage and analysis. Technologies discussed include communication protocols, cloud platforms, and open source IoT frameworks. Participants will help run the live demo by customizing the application code.
Sensor Data in InfluxDB by David Simmons, IoT Developer Evangelist | InfluxDataInfluxData
Bring your laptop ready to go(*), and David will provide a walkthrough of a typical data architecture for an IoT device, followed by how to gather data from the devices in the workshop and display it on a dashboard and trigger alerts based on thresholds that you set.
CWIN16 UK Event - The Future of Infrastructure Gunnar Menzel
What technologies made the biggest impact and which ones will impact us in the future? Will technology advances slow down, stay the same of speed up? What trends and technologies should I consider?
The Digital agenda, shifting business models, as well as the need for speed at lower cost are impacting, shaping and forming new technologies; creating new opportunities at an ever increasing pace.
During the 30 min presentation Gunnar will outline the various key infrastructure related trends and technologies that are and will be key going forward.
Successful AI/ML Projects with End-to-End Cloud Data EngineeringDatabricks
Trusted, high-quality data and efficient use of data engineers’ time are critical success factors for AI/ML projects. Enterprise data is complex—it comes from several sources, in a variety of formats, and at varied speeds. For your machine learning projects on Apache Spark, you need a holistic approach to data engineering: finding & discovering, ingesting & integrating, server-less processing at scale, and data governance. Stop by this session for an overview on how to set up AI/ML projects for success while Informatica takes the heavy lifting out of your data engineering.
finCODE US 2018 - En route to CI/CD nirvanaRémi Vichery
En route to CI/CD nirvana with the Nuage Networks Technical Marketing Team. This presentation goes over the challenges we faced building an ecosystem of technology partner with a small team. From building a self-service demonstration platform for employees, partners & customers to automating various aspects of our day to day job.
The internet has evolved from a human-centric client-server based architecture to one where humans and assets (or things) are equal stakeholders. Do our databases, middleware, and client applications still stand up? In this talk, Brian Gilmore outlines the unique challenges of data operations and analytics in the IoT environment, examines how human and machine interactions drive architecture and deployment, and identifies where we could work to improve our data strategies to fully leverage the IoT opportunity.
Why time series data is the secret to success when it comes to Industry 4.0
How an IoT data platform fits in with any IoT architecture to manage the data requirements of every IoT implementation
Effectively collect, manage, and analyze time series data to drive your ability to improve operations
Building Real-time Pipelines with FLaNK_ A Case Study with Transit DataTimothy Spann
Building Real-time Pipelines with FLaNK_ A Case Study with Transit Data
Building Real-time Pipelines with FLaNK: A Case Study with Transit Data
In this session, we will explore the powerful combination of Apache Flink, Apache NiFi, and Apache Kafka for building real-time data processing pipelines. We will present a case study using the FLaNK-MTA project, which leverages these technologies to process and analyze real-time data from the New York City Metropolitan Transportation Authority (MTA). By integrating Flink, NiFi, and Kafka, FLaNK-MTA demonstrates how to efficiently collect, transform, and analyze high-volume data streams, enabling timely insights and decision-making.
Takeaways:
Understanding the integration of Apache Flink, Apache NiFi, and Apache Kafka for real-time data processing
Insights into building scalable and fault-tolerant data processing pipelines
Best practices for data collection, transformation, and analytics with FLaNK-MTA as a reference
Knowledge of use cases and potential business impact of real-time data processing pipelines
https://github.com/tspannhw/FLaNK-MTA/tree/main
https://medium.com/@tspann/finding-the-best-way-around-7491c76ca4cb
apache nifi
apache kafka
apache flink
apache iceberg
apache parquet
real-time streaming
tim spann
principal developer advocate
cloudera
datainmotion.dev
Similar to InfluxData Architecture for IoT | Noah Crowley | InfluxData (20)
InfluxData is excited to announce InfluxDB Clustered, the self-managed version of InfluxDB 3.0 with unparalleled flexibility, speed, performance, and scale. The evolution of InfluxDB Enterprise, InfluxDB Clustered is delivered as a collection of Kubernetes-based containers and services, which enables you to run and operate InfluxDB 3.0 where you need it, whether that's on-premises or in a private cloud environment. With this new enterprise offering, we’re excited to provide our customers with real-time queries, low-cost object storage, unlimited cardinality, and SQL language support – all with improved data access, support, and security! The newest version of InfluxDB was built on Apache Arrow, and through the open source ecosystem and integrations, extends the value of your time-stamped data.
Join this webinar to learn more about InfluxDB Clustered, and how to manage your large mission-critical workloads in the highly available database service offering!
In this webinar, Balaji Palani and Gunnar Aasen will dive into:
Key features of the new InfluxDB Clustered solution
Use cases for using the newest version of the purpose-built time series database
Live demo
During this 1-hour technical webinar, you’ll also get a chance to ask your questions live.
Best Practices for Leveraging the Apache Arrow EcosystemInfluxData
Apache Arrow is an open source project intended to provide a standardized columnar memory format for flat and hierarchical data. It enables more efficient analytics workloads for modern CPU and GPU hardware, which makes working with large data sets easier and cheaper.
InfluxData and Dremio are both members of the Apache Software Foundation (ASF). Dremio is a data lakehouse management service known for its scalability and capacity for direct querying across diverse data sources. InfluxDB is the purpose-built time series database, and InfluxDB 3.0 has a new columnar storage engine and uses the Arrow format for representing data and moving data to and from Parquet. Discover how InfluxDB and Dremio have advanced their solutions by relying on the Apache Arrow framework.
Join this live panel as Alex Merced and Anais Dotis-Georgiou dive into:
Advantages to utilizing the Apache Arrow ecosystem
Tips and tricks for implementing the columnar data structure
How developers can best utilize the ASF to innovate and contribute to new industry standards
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...InfluxData
Bevi are the creators of smart water dispensers which empower people to choose their desired beverage — flat or sparkling, their desired flavor and temperature. Since 2014, Bevi users have saved more than 350 million bottles and cans. Their "smart" water coolers have prevented the extraction of 1.4 trillion oz of oil from Earth and have saved 21.7 billion grams of CO2 from the atmosphere.
Discover how Bevi uses a time series database to enable better predictive maintenance and alerting of their entire ecosystem — including the hardware and software. They are using InfluxDB to collect sensor data in real-time remotely from their internet-connected machines about their status and activity — i.e., flavor and CO2 levels, water temp, filter status, etc. They a7re using these metrics to improve their customer experience and continuously improve their sustainability practices. Gain tips and tricks on how to best utilize InfluxDB's schema-less design.
Join this webinar as Spencer Gagnon dives into:
Bevi's approach to reducing organizations' carbon footprint — they are saving 50K+ bottles and cans annually
Their entire system architecture — including InfluxDB Cloud, Grafana, Kafka, and DigitalOcean
The importance of using time-stamped data to extend the life of their machines
Power Your Predictive Analytics with InfluxDBInfluxData
If you're using InfluxDB to store and manage your time series data, you're already off to a great start. But why stop there? In our upcoming webinar, we'll show you how to take your data analysis to the next level by building predictive analytics using a variety of tools and techniques.
We will demonstrate how to use Quix to create custom dashboards and visualizations that allow you to monitor your data in real-time. We'll also introduce you to Hugging Face, a powerful tool for building models that can predict future trends and identify anomalies. With these tools at your disposal, you'll be able to extract valuable insights from your data and make more informed decisions about the future. Don't miss out on this opportunity to improve your data analysis skills and take your business to the next level!
What you will learn:
Use InfluxDB to store and manage time series data
Utilize Quix and Hugging Face to build models, visualize trends, and identify anomalies
Extract valuable insights from your data
Improve your data analysis skills to make informed decision
How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base InfluxData
Are you considering replacing your legacy data historian and moving your OT data to the cloud? Join this technical webinar to learn how to adopt InfluxDB and IO Base - a digital platform used to improve operational efficiencies!
Teréga Solutions are the creators of digital solutions used to improve energy efficiencies and to address decarbonization challenges. Their network includes 5,000+ km of gas pipelines within France; they aim to help France attain carbon neutrality by 2050. With these impressive goals in mind, Teréga has created IO-Base — the digital platform to improve industrial performance, and increase profitability. Creating digital twins for their clients allows them to collect data from all production sites and view it in real time, from anywhere and at any time.
Discover how Teréga uses InfluxDB, Docker, and AWS to monitor its gas and hydrogen pipeline infrastructure. They chose to replace their legacy data historian with InfluxDB — the purpose built time series database. They are collecting more than 100K different metrics at various frequencies — some are collected every 5 seconds to only every 1-2 minutes. THey have reduced overall IT spend by 50% and collect 2x the amount of data at 20x frequency! By using various industrial protocols (Modbus, OPC-UA, etc.), Teréga improved output, reduced the TCO, and is now able to create added-value services: forecast, monitoring, predictive maintenance.
Join this webinar as Thomas Delquié dives into:
Teréga's approach to modernizing fossil fuel pipelines IT systems while improving yields and safety
Their centralized methodology to collecting sensor, hardware, and network metrics
The importance of time series data and why they chose InfluxDB
Build an Edge-to-Cloud Solution with the MING StackInfluxData
FlowForge enables organizations to reliably deliver Node-RED applications in a continuous, collaborative, and secure manner. Node-RED is the popular, low-code programming solution that makes it easy to connect different services using a visual programming environment. InfluxData is the creator of InfluxDB, the purpose-built time series database run by developers at scale and in any environment in the cloud, on-premises, or at the edge.
Jump-start monitoring your industrial IoT devices and discover how to build an edge-to-cloud solution with the MING stack. The MING stack includes Mosquitto/MQTT, InfluxDB, Node-RED, and Grafana. This solution can be used to improve fleet management, enable predictive maintenance of industrial machines and power generation equipment (i.e. turbines and generators) and increase safety practices (i.e. buildings, construction sites). Join this webinar to learn best practices from industrial IoT SME's.
In this webinar, Robert Marcer and Jay Clifford dive into:
Best practices for monitoring sensor data collected by everyone — from the edge to the factory
Tips and tricks for using Node-RED and InfluxDB together
Demo — see Node-RED and InfluxDB live
Meet the Founders: An Open Discussion About Rewriting Using RustInfluxData
The document is an agenda for a discussion between the CTO and founder of Ockam, Mrinal Wadhwa, and the CTO and founder of InfluxData, Paul Dix, about rewriting products using the Rust programming language. It includes an introduction of the founders, an overview of the discussion topics like why they decided to rewrite in Rust and the challenges they faced, how they got their engineers comfortable with Rust, tips they learned in the process, benefits gained from moving to Rust, and how their communities responded to the switch.
InfluxData is excited to announce the general availability of InfluxDB Cloud Dedicated! It is a fully managed time series database service running on cloud infrastructure resources that are dedicated to a single tenant. With this new offering, we’re excited to provide our customers with additional security options, and more custom configuration options to best suit customers’ workload requirements. Join this webinar to learn more about InfluxDB Cloud, and the new dedicated database service offering!
In this webinar, Balaji Palani and Gary Fowler will dive into:
Key features of the new InfluxDB Cloud Dedicated solution
Use cases for using the newest version of the purpose-built time series database
Live demo
During this 1-hour technical webinar, you’ll also get a chance to ask your questions live.
Gain Better Observability with OpenTelemetry and InfluxDB InfluxData
Many developers and DevOps engineers have become aware of using their observability data to gain greater insights into their infrastructure systems. InfluxDB is the purpose-built time series database used to collect metrics and gain observability into apps, servers, containers, and networks. Developers use InfluxDB to improve the quality and efficiency of their CI/CD pipelines. Start using InfluxDB to aggregate infrastructure and application performance monitoring metrics to enable better anomaly detection, root-cause analysis, and alerting.
This session will demonstrate how to record metrics, logs, and traces with one library — OpenTelemetry — and store them in one open source time series database — InfluxDB. Zoe will demonstrate how easy it is to set up the OpenTelemetry Operator for Kubernetes and to store and analyze your data in InfluxDB.
How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...InfluxData
American Metal Processing Company ("AMP") is the US' largest commercial rotary heat treat facility with customers in the automotive, construction, military, and agriculture industries. They use their atmosphere-protected rotary retort furnaces to provide their clients with three primary hardening services: neutral hardening (quench and temper), carburizing, and carbonitriding.
This furnace style ensures consistent, uniform heat treatment process vs. traditional batch-or-belt-style furnaces; excels at processing high volumes of smaller parts with tight tolerances; and improves the strength and toughness of plain carbon steels. Discover why AMP’s use of Telegraf, InfluxDB, Node-RED, and Grafana allows them to gain 24/7 insights into their plant operations and metallurgical results. Learn how they use time-stamped data to gain accurate metrics about their consumables usage, furnace profiles, and machine status.
Join this webinar as Grant Pinkos dives into:
American Metal Processing's approach to heat treating in a digitized environment through connected systems
Their approach to collecting and measuring sensor data to enable predictive maintenance and improve product quality
Why they need a time series database for managing and analyzing vast amounts of time-stamped data
How Delft University's Engineering Students Make Their EV Formula-Style Race ...InfluxData
Delft University is the oldest and largest technical university in the Netherlands with 25,000+ students. Since 1999, they have had a team of students (undergraduate and graduate) designing, building, and racing cars, as part of the Formula Student worldwide competition. The competition has grown to include teams from 1K+ universities in 20+ countries. Students are responsible for all aspects of car manufacturing (research, construction, testing, developing, marketing, management, and fundraising). Delft University's team includes 90 students across disciplines.
Discover how Delft University's team uses Marple and InfluxDB to collect telemetry and sensor metrics while they develop, test, and race their electrics cars. They collect sensor data about their EV's control systems using a time series platform. During races, they are collecting IoT data about their batteries, accelerometer, gyroscope, tires, etc. The engineers are able to share important car stats during races which help the drivers tweak their driving decisions — all with the goal of winning. After races, the entire team are able to analyze data in Marple to understand what to do better next time. By using Marple + InfluxDB, their team are able to collect, share and analyze high frequency car data used to make their car faster at competitions.
Join this webinar as Robbin Baauw and Nero Vanbiervliet dive into:
Marple's approach to empowering engineers to organize, analyze, and visualize their data
Delft University's collaborative methodology to building and racing their Formula-style race car
How InfluxDB is crucial to their collaborative engineering and racing process
Introducing InfluxDB’s New Time Series Database Storage EngineInfluxData
InfluxData is excited to announce the general availability of InfluxDB Cloud's new storage engine! It is a cloud-native, real-time, columnar database optimized for time series data. InfluxDB's rebuilt core was coded in Rust and sits on top of Apache Arrow and DataFusion. InfluxData's team picked Apache Parquet as the persistent format. In this webinar, Paul Dix and Balaji Palani will demonstrate key product features including the removal of cardinality limits!
They will dive into:
The next phase of the InfluxDB platform
How using Apache Arrow's ecosystem has improved InfluxDB's performance and scalability
Key features of InfluxDB Cloud's new core — including SQL native support
Start Automating InfluxDB Deployments at the Edge with balena InfluxData
balena.io helps companies develop, deploy, update, and manage IoT devices. By using Linux containers and other cloud technologies, balena enables teams to quickly and easily build fleets of connected devices. Developers are able to use containers with the language of choice and pull IoT sensor data from 70+ different single board computers into balenaCloud. Discover how to use balena.io to automate your InfluxDB deployments at the edge!
During this one-hour session, experts from balena and InfluxData will demonstrate how to build and deploy your own air quality IoT solution. You will learn:
The fundamentals of IoT sensor deployment and management using balena.
How to use a time series platform to collect and visualize metrics from edge devices.
Tips and tricks to using balenaCloud to automate InfluxDB deployments and Telegraf configurations.
How to use InfluxDB's Edge Data Replication feature to collect sensor data and push it to InfluxDB Cloud for analysis.
No coding experience required, just a curiosity to start your own IoT adventure.
Understanding InfluxDB’s New Storage EngineInfluxData
Learn more about InfluxDB’s new storage engine! The team developed a cloud-native, real-time, columnar database optimized for time series data. We built it all in Rust and it sits on top of Apache Arrow and DataFusion. We chose Apache Parquet as the persistent format, which is an open source columnar data file format. This new storage engine provides InfluxDB Cloud users with new functionality, including the removal of cardinality limits, so developers can bring in massive amounts of time series data at scale.
In this webinar, Anais Dotis-Georgiou will dive into:
Requirements for rebuilding InfluxDB’s core
Key product features and timeline
How Apache Arrow’s ecosystem is used to meet those requirements
Stick around for a demo and live Q&A
Streamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDBInfluxData
RudderStack — the creators of the leading open source Customer Data Platform (CDP) — needed a scalable way to collect and store metrics related to customer events and processing times (down to the nanosecond). They provide their clients with data pipelines that simplify data collection from applications, websites, and SaaS platforms. RudderStack's solution enables clients to stream customer data in real time — they quickly deploy flexible data pipelines that send the data to the customer's entire stack without engineering headaches. Customers are able to stream data from any tool using their 16+ SDK's, and they are able to transform the data in-transit using JavaScript or Python. How does RudderStack use a time series platform to provide their customers with real-time analytics?
Join this webinar as Ryan McCrary dives into:
RudderStack's approach to streamlining data pipelines with their 180+ out-of-the-box integrations
Their data architecture including Kapacitor for alerting and Grafana for customized dashboards
Why using InfluxDB was crucial for them for fast data collection and providing single-sources of truths for their customers
Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...InfluxData
Customers using ThingWorx and the Manufacturing Solutions often need to store property data longer than the Solutions default to. These customers are recommended to use InfluxDB, and this presentation will cover the key considerations for moving to InfluxDB vs the standard ThingWorx value streams. Join this session as Ward highlights ThingWorx’s solution and its easy implementation process.
Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022InfluxData
Two new features are coming to Flux that add flexibility
and functionality to your data workflow—polymorphic
labels and dynamic types. This session walks through
these new features and shows how they work.
This document outlines the schedule for Day 2 of InfluxDays 2022, an event hosted by InfluxData. The schedule includes sessions on building developer experience, how developers like to work, an overview of the InfluxDB developer console and API, demos of client libraries and the InfluxDB v2 API, tips for getting involved in the InfluxDB community and university, use cases for networking monitoring, crypto/fintech, monitoring/observability, and IIoT, and closing thoughts. Recordings of all sessions will be made available to registered attendees by November 7th. Upcoming events include advanced Flux training in London and resources through the community forums, Slack channel, and online university.
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...InfluxData
This document contains the agenda for Day 2 of InfluxDays 2022, which includes:
- Welcome and introductory remarks from Zoe Steinkamp and Jay Clifford of InfluxData.
- Fireside chats and presentations on building great developer experiences, how developers like to work, and use cases for InfluxDB from companies like Tesla, InfluxData, and others.
- Sessions on the InfluxDB developer console, APIs, client libraries, getting involved in the community, accelerating time to awesome with InfluxDB University, and tips for analyzing IoT data with InfluxDB.
- Closing thoughts from Zoe Steinkamp and Jay Clifford, as well as
The document summarizes the agenda and sessions for Day 1 of InfluxDays 2022. It includes sessions on InfluxDB data collection, scripting languages like Flux, the InfluxDB time series engine, tasks, storage, and a closing discussion. The agenda involves talks from InfluxData employees on building applications with real-time data, navigating the developer experience, solving problems, the InfluxDB platform, community, education, use cases in crypto/fintech and IIoT, and tips/tricks for analysis.
How to Get CNIC Information System with Paksim Ga.pptxdanishmna97
Pakdata Cf is a groundbreaking system designed to streamline and facilitate access to CNIC information. This innovative platform leverages advanced technology to provide users with efficient and secure access to their CNIC details.
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
“An Outlook of the Ongoing and Future Relationship between Blockchain Technologies and Process-aware Information Systems.” Invited talk at the joint workshop on Blockchain for Information Systems (BC4IS) and Blockchain for Trusted Data Sharing (B4TDS), co-located with with the 36th International Conference on Advanced Information Systems Engineering (CAiSE), 3 June 2024, Limassol, Cyprus.
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...Neo4j
Leonard Jayamohan, Partner & Generative AI Lead, Deloitte
This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Speck&Tech
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024Neo4j
Neha Bajwa, Vice President of Product Marketing, Neo4j
Join us as we explore breakthrough innovations enabled by interconnected data and AI. Discover firsthand how organizations use relationships in data to uncover contextual insights and solve our most pressing challenges – from optimizing supply chains, detecting fraud, and improving customer experiences to accelerating drug discoveries.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceIndexBug
Imagine a world where machines not only perform tasks but also learn, adapt, and make decisions. This is the promise of Artificial Intelligence (AI), a technology that's not just enhancing our lives but revolutionizing entire industries.
Building Production Ready Search Pipelines with Spark and MilvusZilliz
Spark is the widely used ETL tool for processing, indexing and ingesting data to serving stack for search. Milvus is the production-ready open-source vector database. In this talk we will show how to use Spark to process unstructured data to extract vector representations, and push the vectors to Milvus vector database for search serving.
Pushing the limits of ePRTC: 100ns holdover for 100 daysAdtran
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.
Communications Mining Series - Zero to Hero - Session 1DianaGray10
This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered:
• Communication Mining Overview
• Why is it important?
• How can it help today’s business and the benefits
• Phases in Communication Mining
• Demo on Platform overview
• Q/A
GraphRAG for Life Science to increase LLM accuracyTomaz Bratanic
GraphRAG for life science domain, where you retriever information from biomedical knowledge graphs using LLMs to increase the accuracy and performance of generated answers
UiPath Test Automation using UiPath Test Suite series, part 5DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 5. In this session, we will cover CI/CD with devops.
Topics covered:
CI/CD with in UiPath
End-to-end overview of CI/CD pipeline with Azure devops
Speaker:
Lyndsey Byblow, Test Suite Sales Engineer @ UiPath, Inc.