Network traffic monitoring tools are traditionally based on the packet paradigm where tools need to analyse each incoming and outgoing packet. As systems are moving towards a micro-service oriented architecture based on containers, the packet paradigm is no longer enough to provide IT visibility as services interact inside a system and not over a network where it is possible to install network sensors. This talk will explain how open source tools designed by ntop on top of InfluxDB allow packet monitoring tools to be complemented with container monitoring and thus implement a lightweight visibility solution for modern IT infrastructures.
Developing Your Own Flux Packages by David McKay | Head of Developer Relation...InfluxData
Flux is easy to contribute to, and it is easy to share functions and libraries of Flux code with other developers. Although there are many functions in the language, the true power of Flux is its ability to be extended with custom functions. In this session, David will show you how to write your own custom function to perform some new analytics.
InfluxDB 101 – Concepts and Architecture by Michael DeSa, Software Engineer |...InfluxData
Complete introduction to time series, the components of InfluxDB, how to get started, and how to think of your metrics problems with the InfluxDB platform in mind. What is a tag, and what is a value? Come and find out!
Optimizing InfluxDB Performance in the Real World | Sam Dillard | InfluxDataInfluxData
Sam will provide practical tips and techniques learned from helping hundreds of customers deploy InfluxDB and InfluxDB Enterprise. This includes hardware and architecture choices, schema design, configuration setup, and running queries.
How to Build a Telegraf Plugin by Noah CrowleyInfluxData
Telegraf is a plugin-driven server agent for collecting & reporting metrics and there are many plugins already written to source data from a variety of services and systems. However, there may be instances where you need to write your own plugin to source data from your particular systems. In this InfluxDays NYC 2019 session, Noah Crowley will provide you with the steps on how to write your own Telegraf plugin. Writing your own Telegraf plugin will require an understanding of the Go programming language.
In this presentation, I take a deep dive into the InfluxDB open source storage engine. More than just a single storage engine, InfluxDB is two engines in one: the first for time series data and the second, an index for metadata. I'll delve into the optimizations for achieving high write throughput, compression and fast reads for both the raw time series data and the metadata.
Learn How To Use The #1 DevOps Open Source Time Series DB Platform for Metrics & Events (Time Series Data).
Presentation used in Udemy training: https://www.udemy.com/course/influxdb-time-series-database/?referralCode=09D0B30F92258262D4C6
If you're looking to setup a system to store your metrics in (e.g. app/server metrics), or you need to store & manage other time series, then this course is for you! InfluxDB is currently the #1 time series database (according to db-engines). More and more companies are moving their time series data into a database that is really fit for this purpose, which makes it a really good skill to have.
InfluxDB is an open-source database optimized for fast, high-availability storage and retrieval of time series data. InfluxDB is great for operations monitoring, application metrics, and real-time analytics. InfluxDB is the Time Series Database in the TICK stack and this technology is rising and so is the need for this knowledge in the job market. Its a super useful tool to have on your toolbelt as a DevOps engineer or as a IT professional in general. In this course we will touch all important topics without the need for any prior knowledge.
InfluxDB 101 - Concepts and Architecture | Michael DeSa | InfluxDataInfluxData
Complete introduction to time series, the components of InfluxDB, how to get started, and how to think of your metrics problems with the InfluxDB platform in mind. What is a tag, and what is a value? Come and find out!
Creating and Using the Flux SQL Datasource | Katy Farmer | InfluxData InfluxData
This talk introduces the SQL data source for Flux. It will start with examples of using data from MySQL or Postgres with time series data from InfluxDB. It will then go over the details of how the SQL data source was created.
Developing Your Own Flux Packages by David McKay | Head of Developer Relation...InfluxData
Flux is easy to contribute to, and it is easy to share functions and libraries of Flux code with other developers. Although there are many functions in the language, the true power of Flux is its ability to be extended with custom functions. In this session, David will show you how to write your own custom function to perform some new analytics.
InfluxDB 101 – Concepts and Architecture by Michael DeSa, Software Engineer |...InfluxData
Complete introduction to time series, the components of InfluxDB, how to get started, and how to think of your metrics problems with the InfluxDB platform in mind. What is a tag, and what is a value? Come and find out!
Optimizing InfluxDB Performance in the Real World | Sam Dillard | InfluxDataInfluxData
Sam will provide practical tips and techniques learned from helping hundreds of customers deploy InfluxDB and InfluxDB Enterprise. This includes hardware and architecture choices, schema design, configuration setup, and running queries.
How to Build a Telegraf Plugin by Noah CrowleyInfluxData
Telegraf is a plugin-driven server agent for collecting & reporting metrics and there are many plugins already written to source data from a variety of services and systems. However, there may be instances where you need to write your own plugin to source data from your particular systems. In this InfluxDays NYC 2019 session, Noah Crowley will provide you with the steps on how to write your own Telegraf plugin. Writing your own Telegraf plugin will require an understanding of the Go programming language.
In this presentation, I take a deep dive into the InfluxDB open source storage engine. More than just a single storage engine, InfluxDB is two engines in one: the first for time series data and the second, an index for metadata. I'll delve into the optimizations for achieving high write throughput, compression and fast reads for both the raw time series data and the metadata.
Learn How To Use The #1 DevOps Open Source Time Series DB Platform for Metrics & Events (Time Series Data).
Presentation used in Udemy training: https://www.udemy.com/course/influxdb-time-series-database/?referralCode=09D0B30F92258262D4C6
If you're looking to setup a system to store your metrics in (e.g. app/server metrics), or you need to store & manage other time series, then this course is for you! InfluxDB is currently the #1 time series database (according to db-engines). More and more companies are moving their time series data into a database that is really fit for this purpose, which makes it a really good skill to have.
InfluxDB is an open-source database optimized for fast, high-availability storage and retrieval of time series data. InfluxDB is great for operations monitoring, application metrics, and real-time analytics. InfluxDB is the Time Series Database in the TICK stack and this technology is rising and so is the need for this knowledge in the job market. Its a super useful tool to have on your toolbelt as a DevOps engineer or as a IT professional in general. In this course we will touch all important topics without the need for any prior knowledge.
InfluxDB 101 - Concepts and Architecture | Michael DeSa | InfluxDataInfluxData
Complete introduction to time series, the components of InfluxDB, how to get started, and how to think of your metrics problems with the InfluxDB platform in mind. What is a tag, and what is a value? Come and find out!
Creating and Using the Flux SQL Datasource | Katy Farmer | InfluxData InfluxData
This talk introduces the SQL data source for Flux. It will start with examples of using data from MySQL or Postgres with time series data from InfluxDB. It will then go over the details of how the SQL data source was created.
InfluxDB IOx Tech Talks: A Rusty Introduction to Apache Arrow and How it App...InfluxData
InfluxDB IOx Tech Talks - December 2020
A Rusty Introduction to Apache Arrow and How it Applies to a Time Series Database
This session will start with a tech talk from an InfluxDB IOx team member. This is your chance to interact directly with Influxers who are available to answer your questions about all things InfluxDB IOx and time series — including Paul Dix, Founder and CTO of InfluxData. This event will last about an hour and there will be time for live Q&A.
Monitoring, Alerting, and Tasks as Code by Russ Savage, Director of Product M...InfluxData
In this talk Russ will explore how to build tasks, alerting rules, and triggering events inside of InfluxDB 2.0 with the new Flux language. Russ will then showcase how to work this into a regular development flow by using command line tools for testing, source control as the source of truth, and testing against production data.
Kapacitor - Real Time Data Processing EnginePrashant Vats
Kapacitor is a native data processing engine.Kapacitor is a native data processing engine.It can process both stream and batch data from InfluxDB.It lets you plug in your own custom logic or user-defined functions to process alerts with dynamic thresholds. Key Kapacitor Capabilities
-Alerting
-ETL (Extraction, Transformation and Loading)
-Action Oriented
-Streaming Analytics
-Anomaly Detection
Kapacitor uses a DSL (Domain Specific Language) called TICKscript to define tasks.
This document discusses distributed tracing and provides an overview of its history and key concepts. It begins with an overview of logging, tracing, and monitoring techniques. It then discusses the challenges of debugging asynchronous distributed systems and how distributed tracing addresses these challenges. The document outlines the basic terminology and components of distributed tracing systems, including spans and traces. It provides a timeline of major developments in distributed tracing technologies from 2010 to the present. It concludes with recommendations around using OpenTelemetry or OpenTracing for instrumentation and notes areas that were not covered in depth.
Intro to InfluxDB 2.0 and Your First Flux Query by Sonia GuptaInfluxData
In this InfluxDays NYC 2019 talk, InfluxData Developer Advocate Sonia Gupta will provide an introduction to InfluxDB 2.0 and a review of the new features. She will demonstrate how to install it, insert data, and build your first Flux query.
Lessons Learned: Running InfluxDB Cloud and Other Cloud Services at Scale | T...InfluxData
In this session, Tim will cover principles, learnings, and practical advice from operating multiple cloud services at scale, including of course our InfluxDB Cloud service. What do we monitor, what do we alert on, and how did we architect it all? What are our underlying architectural and operational principles?
A hands-on workshop about a typical data architecture for an IoT device - how to gather data from the device, display it on a dashboard and trigger alerts based on thresholds that you set.
Sam Dillard [InfluxData] | Performance Optimization in InfluxDB | InfluxDays...InfluxData
Like my past talks on this, I will give a rundown of the different levers one can pull to make InfluxDB perform better for one's use case. As I do each iteration of this, I have additional slides to add to this topic.
Most of the presentation focuses on write procedure as that is what defines schema and, ultimately, how queries will work against the DB.
Catalogs - Turning a Set of Parquet Files into a Data SetInfluxData
InfluxDB IOx Tech Talks
Placing a Parquet file into an object store serves as a simple data persistence format. However, storing data into multiple files enabling upserts, deletions, format upgrades, metadata management, and consistency checks at scale requires some form of a catalog that manages these files. In this talk we will explore the requirements for a catalog for InfluxDB IOx, prior art from the Parquet ecosystem, and the proposed solution.
Worldsensing: A Real World Use Case for Flux by Albert Zaragoza, CTO & Head o...InfluxData
Albert Zaragoza, Fuad Mimoun and Daniel Lázaro from Worldsensing will be sharing how their team built an end-to-end IoT solution for cities — from traffic flow management and smart parking to emergency & security response and critical infrastructure monitoring. They will focus this talk on how they used Flux to pull together lots of data sources into their real-time platform to provide alerts to the many constituents of the data.
How Sensor Data Can Help Manufacturers Gain Insight to Reduce Waste, Energy C...InfluxData
In this webinar, learn how a long-time Industrial IT Consultant helps his customer make the leap into providing visibility of their processes to everyone in the plant. This journey led to the discovery of untapped opportunity to improve operations, reduce energy consumption, and minimize plant downtime. The collection of data from the individual sensors has led to powerful Grafana dashboards shared across the organization.
Introduction to InfluxDB 2.0 & Your First Flux Query by Sonia Gupta, Develope...InfluxData
Bring your laptop ready to go(*) and get started with InfluxDB 2.0 and how to build your first set of dashboards and Flux queries.
* Prerequisites: InfluxDB 2.0 and Telegraf need to be installed on your laptop before the session in order to follow along.
How to Use Telegraf and Its Plugin EcosystemInfluxData
Telegraf is the open source server agent which is used to collect metrics from your stacks, sensors and systems. It is InfluxDB’s native data collector that supports over 250+ inputs and outputs. Learn how to send data from a variety of systems, apps, databases and services in the appropriate format to InfluxDB. Discover tips and tricks on how to write your own plugins.
Join this webinar as Jessica Ingrassellino and Samantha Wang dive into:
Types of Telegraf plugins (i.e. input, output, aggregator and processor)
Specific plugins including Execd input plugins and the Starlark processor plugin
How to create your own Telegraf plugin
The document provides an agenda for a seasoned developers track workshop. The agenda includes sessions on InfluxDB query language (IFQL), writing Telegraf plugins, using InfluxDB for open tracing, advanced Kapacitor techniques, setting up InfluxData for IoT, and database orchestration. There will also be breakfast, lunch, breaks and pizza/beer.
InfluxDB Community Office Hours September 2020 InfluxData
The document provides information about InfluxDB 2.0 going to general availability (GA) and the migration path for existing users. It discusses that the next release will be the first release candidate with bug fixes and no new features. It also outlines reasons users may want to hold off upgrading, including continuous queries and authorization changes. The document asks existing users to help with testing the upcoming release candidate.
Building Modern Data Pipelines for Time Series Data on GCP with InfluxData by...InfluxData
In this InfluxDays NYC 2019 talk, you will get an overview of the Google data pipelines and some use-cases for infrastructure monitoring and IoT (Google). In addition, we will share some common solutions that can be deployed on GCP including using InfluxDB time series database for Kubernetes Monitoring and IoT.
IoT Event Processing and Analytics with InfluxDB in Google Cloud | Christoph ...InfluxData
The presentation introduces a Google Cloud native architecture for collecting, processing, analyzing and archiving of events from IoT devices, vehicles as well as upstream software systems. InfluxDB and its connection to global native Google Cloud services like BigQuery or Cloud Machine Learning Engine as well as Kubernetes is at the center of the architecture. The architecture demonstrates how access to global scaling cloud services addresses use cases from the Energy Sector.
Kapacitor is the brains of the TICK Stack. Nathaniel will cover the stream processing capabilities of Kapacitor, how to process data before it gets stored in InfluxDB and after it is stored, best practices around anomaly detection and machine learning. In addition, Nathaniel will discuss how to configure the clustered version of Kapacitor.
How an Open Marine Standard, InfluxDB and Grafana Are Used to Improve Boating...InfluxData
Steve and Teppo presented a solution for visualizing and analyzing boat data from disparate sources. Their goals were to record all boat data for later analysis, create customizable dashboards to visualize data and trends, and gain access to data from any source. Their solution uses Signal K to connect data sources, writes the data to InfluxDB for storage, and uses Grafana dashboards to visualize trends over time. This has helped users monitor engine performance, electrical systems, storms, and troubleshoot issues remotely. Future work includes more dashboards, alerts, device integrations, and extending the Signal K data model.
BGP FlowSpec experience and future developmentsPavel Odintsov
This document discusses BGP FlowSpec, which is a technique for mitigating DDoS attacks. It provides an overview of FlowSpec implementations by various vendors and open source tools. It also discusses operational experience with FlowSpec deployments. While FlowSpec works well against many amplification attacks, the document notes some limitations and areas for improvement. This includes improving router scale, adding flexibility to payload matching, and developing standards for traffic reporting across administrative domains. Overall, FlowSpec is presented as a mature mitigation technique, but one that requires continued development and vendor/operator collaboration to address evolving attacks.
OSMC 2013 | Monitoring network traffic using ntopng by Luca DeriNETWAYS
ntop ist ein Open Source Network Monitoring Projekt fokussiert auf Network Traffic Monitoring. Durch das Aufkommen von modernen Computerarchitekturen und high-speed Netzwerken, mussten viele Komponenten umgestaltet werden, um die neuen Herausforderungen zu meistern. Das Monitoring von 10G-Netzwerken erfordert eine high-speed Paketerfassung/-übermittlung und effiziente Monitoring Applikationen. In den vergangenen Jahren hat ntop etliche Open Source Tools, Kernel Module und flow-basierte Applikationen, um high-speed Traffic Monitoring auf Standard Hardware zu ermöglichen. Dieser Talk wird Ihnen einen Überblick über die Vielzahl an ntop Monitoring Komponenten verschaffen und Ihnen ntopng vorstellen, die neuste Version von ntop. Außerdem werden Use Cases aufzeigen, bei denen sich diese Tools bewährt haben.
InfluxDB IOx Tech Talks: A Rusty Introduction to Apache Arrow and How it App...InfluxData
InfluxDB IOx Tech Talks - December 2020
A Rusty Introduction to Apache Arrow and How it Applies to a Time Series Database
This session will start with a tech talk from an InfluxDB IOx team member. This is your chance to interact directly with Influxers who are available to answer your questions about all things InfluxDB IOx and time series — including Paul Dix, Founder and CTO of InfluxData. This event will last about an hour and there will be time for live Q&A.
Monitoring, Alerting, and Tasks as Code by Russ Savage, Director of Product M...InfluxData
In this talk Russ will explore how to build tasks, alerting rules, and triggering events inside of InfluxDB 2.0 with the new Flux language. Russ will then showcase how to work this into a regular development flow by using command line tools for testing, source control as the source of truth, and testing against production data.
Kapacitor - Real Time Data Processing EnginePrashant Vats
Kapacitor is a native data processing engine.Kapacitor is a native data processing engine.It can process both stream and batch data from InfluxDB.It lets you plug in your own custom logic or user-defined functions to process alerts with dynamic thresholds. Key Kapacitor Capabilities
-Alerting
-ETL (Extraction, Transformation and Loading)
-Action Oriented
-Streaming Analytics
-Anomaly Detection
Kapacitor uses a DSL (Domain Specific Language) called TICKscript to define tasks.
This document discusses distributed tracing and provides an overview of its history and key concepts. It begins with an overview of logging, tracing, and monitoring techniques. It then discusses the challenges of debugging asynchronous distributed systems and how distributed tracing addresses these challenges. The document outlines the basic terminology and components of distributed tracing systems, including spans and traces. It provides a timeline of major developments in distributed tracing technologies from 2010 to the present. It concludes with recommendations around using OpenTelemetry or OpenTracing for instrumentation and notes areas that were not covered in depth.
Intro to InfluxDB 2.0 and Your First Flux Query by Sonia GuptaInfluxData
In this InfluxDays NYC 2019 talk, InfluxData Developer Advocate Sonia Gupta will provide an introduction to InfluxDB 2.0 and a review of the new features. She will demonstrate how to install it, insert data, and build your first Flux query.
Lessons Learned: Running InfluxDB Cloud and Other Cloud Services at Scale | T...InfluxData
In this session, Tim will cover principles, learnings, and practical advice from operating multiple cloud services at scale, including of course our InfluxDB Cloud service. What do we monitor, what do we alert on, and how did we architect it all? What are our underlying architectural and operational principles?
A hands-on workshop about a typical data architecture for an IoT device - how to gather data from the device, display it on a dashboard and trigger alerts based on thresholds that you set.
Sam Dillard [InfluxData] | Performance Optimization in InfluxDB | InfluxDays...InfluxData
Like my past talks on this, I will give a rundown of the different levers one can pull to make InfluxDB perform better for one's use case. As I do each iteration of this, I have additional slides to add to this topic.
Most of the presentation focuses on write procedure as that is what defines schema and, ultimately, how queries will work against the DB.
Catalogs - Turning a Set of Parquet Files into a Data SetInfluxData
InfluxDB IOx Tech Talks
Placing a Parquet file into an object store serves as a simple data persistence format. However, storing data into multiple files enabling upserts, deletions, format upgrades, metadata management, and consistency checks at scale requires some form of a catalog that manages these files. In this talk we will explore the requirements for a catalog for InfluxDB IOx, prior art from the Parquet ecosystem, and the proposed solution.
Worldsensing: A Real World Use Case for Flux by Albert Zaragoza, CTO & Head o...InfluxData
Albert Zaragoza, Fuad Mimoun and Daniel Lázaro from Worldsensing will be sharing how their team built an end-to-end IoT solution for cities — from traffic flow management and smart parking to emergency & security response and critical infrastructure monitoring. They will focus this talk on how they used Flux to pull together lots of data sources into their real-time platform to provide alerts to the many constituents of the data.
How Sensor Data Can Help Manufacturers Gain Insight to Reduce Waste, Energy C...InfluxData
In this webinar, learn how a long-time Industrial IT Consultant helps his customer make the leap into providing visibility of their processes to everyone in the plant. This journey led to the discovery of untapped opportunity to improve operations, reduce energy consumption, and minimize plant downtime. The collection of data from the individual sensors has led to powerful Grafana dashboards shared across the organization.
Introduction to InfluxDB 2.0 & Your First Flux Query by Sonia Gupta, Develope...InfluxData
Bring your laptop ready to go(*) and get started with InfluxDB 2.0 and how to build your first set of dashboards and Flux queries.
* Prerequisites: InfluxDB 2.0 and Telegraf need to be installed on your laptop before the session in order to follow along.
How to Use Telegraf and Its Plugin EcosystemInfluxData
Telegraf is the open source server agent which is used to collect metrics from your stacks, sensors and systems. It is InfluxDB’s native data collector that supports over 250+ inputs and outputs. Learn how to send data from a variety of systems, apps, databases and services in the appropriate format to InfluxDB. Discover tips and tricks on how to write your own plugins.
Join this webinar as Jessica Ingrassellino and Samantha Wang dive into:
Types of Telegraf plugins (i.e. input, output, aggregator and processor)
Specific plugins including Execd input plugins and the Starlark processor plugin
How to create your own Telegraf plugin
The document provides an agenda for a seasoned developers track workshop. The agenda includes sessions on InfluxDB query language (IFQL), writing Telegraf plugins, using InfluxDB for open tracing, advanced Kapacitor techniques, setting up InfluxData for IoT, and database orchestration. There will also be breakfast, lunch, breaks and pizza/beer.
InfluxDB Community Office Hours September 2020 InfluxData
The document provides information about InfluxDB 2.0 going to general availability (GA) and the migration path for existing users. It discusses that the next release will be the first release candidate with bug fixes and no new features. It also outlines reasons users may want to hold off upgrading, including continuous queries and authorization changes. The document asks existing users to help with testing the upcoming release candidate.
Building Modern Data Pipelines for Time Series Data on GCP with InfluxData by...InfluxData
In this InfluxDays NYC 2019 talk, you will get an overview of the Google data pipelines and some use-cases for infrastructure monitoring and IoT (Google). In addition, we will share some common solutions that can be deployed on GCP including using InfluxDB time series database for Kubernetes Monitoring and IoT.
IoT Event Processing and Analytics with InfluxDB in Google Cloud | Christoph ...InfluxData
The presentation introduces a Google Cloud native architecture for collecting, processing, analyzing and archiving of events from IoT devices, vehicles as well as upstream software systems. InfluxDB and its connection to global native Google Cloud services like BigQuery or Cloud Machine Learning Engine as well as Kubernetes is at the center of the architecture. The architecture demonstrates how access to global scaling cloud services addresses use cases from the Energy Sector.
Kapacitor is the brains of the TICK Stack. Nathaniel will cover the stream processing capabilities of Kapacitor, how to process data before it gets stored in InfluxDB and after it is stored, best practices around anomaly detection and machine learning. In addition, Nathaniel will discuss how to configure the clustered version of Kapacitor.
How an Open Marine Standard, InfluxDB and Grafana Are Used to Improve Boating...InfluxData
Steve and Teppo presented a solution for visualizing and analyzing boat data from disparate sources. Their goals were to record all boat data for later analysis, create customizable dashboards to visualize data and trends, and gain access to data from any source. Their solution uses Signal K to connect data sources, writes the data to InfluxDB for storage, and uses Grafana dashboards to visualize trends over time. This has helped users monitor engine performance, electrical systems, storms, and troubleshoot issues remotely. Future work includes more dashboards, alerts, device integrations, and extending the Signal K data model.
BGP FlowSpec experience and future developmentsPavel Odintsov
This document discusses BGP FlowSpec, which is a technique for mitigating DDoS attacks. It provides an overview of FlowSpec implementations by various vendors and open source tools. It also discusses operational experience with FlowSpec deployments. While FlowSpec works well against many amplification attacks, the document notes some limitations and areas for improvement. This includes improving router scale, adding flexibility to payload matching, and developing standards for traffic reporting across administrative domains. Overall, FlowSpec is presented as a mature mitigation technique, but one that requires continued development and vendor/operator collaboration to address evolving attacks.
OSMC 2013 | Monitoring network traffic using ntopng by Luca DeriNETWAYS
ntop ist ein Open Source Network Monitoring Projekt fokussiert auf Network Traffic Monitoring. Durch das Aufkommen von modernen Computerarchitekturen und high-speed Netzwerken, mussten viele Komponenten umgestaltet werden, um die neuen Herausforderungen zu meistern. Das Monitoring von 10G-Netzwerken erfordert eine high-speed Paketerfassung/-übermittlung und effiziente Monitoring Applikationen. In den vergangenen Jahren hat ntop etliche Open Source Tools, Kernel Module und flow-basierte Applikationen, um high-speed Traffic Monitoring auf Standard Hardware zu ermöglichen. Dieser Talk wird Ihnen einen Überblick über die Vielzahl an ntop Monitoring Komponenten verschaffen und Ihnen ntopng vorstellen, die neuste Version von ntop. Außerdem werden Use Cases aufzeigen, bei denen sich diese Tools bewährt haben.
Swisscom Network Analytics Data Mesh Architecture - ETH Viscon - 10-2022.pdfThomasGraf40
This document discusses the evolution of Swisscom's network analytics capabilities from 2015 to the present. It begins with nationwide outages at Swisscom that revealed deficiencies in network visibility. It then summarizes the growth of Swisscom's data collection and analytics platforms over time, starting from early adopters in 2015-2016 to becoming mainstream by 2020-2022. It highlights key milestones like onboarding new platforms, scaling data ingestion rates, and expanding use cases from troubleshooting to anomaly detection and closed-loop network operations.
This document discusses in-band network telemetry (INT) which is a framework for monitoring network state and collecting telemetry data from network elements in the data plane without requiring control plane intervention. It describes how INT works by having each network element insert metadata into packets passing through it. This metadata is collected at the destination and can be analyzed to provide visibility into network performance and states. The document outlines the motivations for INT, how it evolved from previous telemetry approaches, its components like the INT header and metadata, deployment models, use cases like measuring latency, and open standards around INT.
This document summarizes the evolution of Swisscom's network analytics capabilities from 2015 to the present. It discusses moving from basic network monitoring to a data mesh architecture enabling closed-loop network operations. Key developments include onboarding more platforms and metrics, anomaly detection, visualization, and collaborating with IETF on standards like BGP Monitoring Protocol, IPFIX, and YANG push notifications. The goal is network visibility to make informed decisions and recognize service interruptions before customers. Future work involves standardizing extensions for additional RIB coverage, segment routing, and route policies.
The Network Knows—Avi Freedman, CEO & Co-Founder of Kentik Outlyer
Apps generate the traffic, but the network delivers it. Many devops and netops stacks are completely separate, but it doesn't have to be that way!
In this talk we'll talk a bit about network traffic telemetry - sources, tools, and methods - and show how that data can be linked to metric, log, and APM systems.
Onboarding a Historical Company on the Cloud Journey (IT Camp 2018)Marius Zaharia
1. The document describes the journey of a historical French transportation company moving parts of its IT infrastructure and workloads to the cloud with Microsoft Azure.
2. Key challenges included modernizing the company's culture and processes to be more agile and innovative while maintaining security, as well as gaining approval from the larger corporate group.
3. An Azure team was established within the company to manage cloud projects and provide services like infrastructure setup, governance, and acting as an intermediary for other Azure services. This helped drive more cloud adoption over time.
The document discusses Burlington Electric Department's deployment of a secure distributed SCADA (DSCADA) system using data-diodes in a self-contained fiber-optic network. It describes how the system shares data from a high security SCADA network to a lower security business LAN network through uni-directional gateways for improved isolation and security. The deployment addressed issues with the previous firewall-based system and provides benefits like complete isolation of the critical SCADA systems while still enabling necessary communications.
The "Internet of Things" (IoT) has been around a long time and is becoming an increasingly growing topic. It has already impacted on our everyday lives at the workplace and at home.
Come and dive in for a night of exploration as we speak about some amazing products, IoT trends, current landscape and what the future will hold
There will be short IoT presentations as well as a panel of IoT panel speakers for you to engage and ask questions.
Sensor Data in InfluxDB by David Simmons, IoT Developer Evangelist | InfluxDataInfluxData
Bring your laptop ready to go(*), and David will provide a walkthrough of a typical data architecture for an IoT device, followed by how to gather data from the devices in the workshop and display it on a dashboard and trigger alerts based on thresholds that you set.
Intel's Out of the Box Network Developers Ireland Meetup on March 29 2017 - ...Haidee McMahon
For details on Intel's Out of The Box Network Developers Ireland meetup, goto https://www.meetup.com/Out-of-the-Box-Network-Developers-Ireland/events/237726826/
Openet Talk : How vendors on-board solutions and define their attributes in the VNFD such as DPDK
By Aidan Molloy, Senior Director, NFV Strategy at Openet Accelerate
Bio: Aidan Molloy joined Openet in 2012, and currently serves as our Senior Director NFV Strategy in Openet Accelerate, a BU dedicated to NFV adoption since 2016. He is responsible for Openet Products in the NFV framework and more specifically MANO layer with Openet Weaver® as a G-VNFM. Prior to this, Mr Molloy has served in a number of roles for Openet, including, Product Management, Technical Sales Support and Operations. More information can be found at: http:/accelerate.openet.com/
SYN207: Newest and coolest NetScaler features you should be jazzed aboutCitrix
Citrix NetScaler engineering continues to deliver new enhancements and cool features. This technical session will highlight five recent NetScaler innovations in virtual application, desktop and server availability and security that can improve your datacenter network and make applications run better and faster. Topics will include faster app acceleration and why developers are building apps to leverage advanced ADC capabilities.
Overview and Opentracing in theory by Gianluca ArbezzanoGianluca Arbezzano
That is this group? How does it work? What is the CNCF? After this short introduction I am going to show you what is Opentracing what it means and why the adoption is growing so much in a short amount of time. Use cases, possible implementations and so on.
Network monitoring and management involves three key activities:
1. Monitoring networks to diagnose problems and gather statistics using tools that monitor components and notify administrators of outages or issues.
2. Managing networks by ensuring security, optimizing performance, maintaining reliability, and addressing faults and problems using systems, services, fault, change and performance monitoring.
3. Consolidating and analyzing monitoring data in a network operations center to coordinate tasks, field incidents, and improve the network over time based on trends.
HiveMQ + Kafka - The Ideal Solution for IoT MQTT Data IntegrationHiveMQ
This document provides an overview of HiveMQ and how it can be used to connect IoT devices using MQTT to Apache Kafka. It discusses the challenges of using Kafka directly for IoT including scalability, large numbers of topics, and constraints of devices. HiveMQ acts as an MQTT broker that can connect millions of devices and stream their data via its Enterprise extension for Kafka. This provides bidirectional communication, high scalability, support for schemas, and observability of the MQTT-Kafka communication. A demo is shown of how simulated car data can be streamed from devices to Kafka and back.
HiveMQ + Kafka: The ideal solution for IoT MQTT data integrationMargarethaErber
Many companies want to move MQTT data between IoT devices and Kafka clusters connected to back-end enterprise systems. However, connecting thousands or even millions of IoT devices over unreliable networks and providing end-to-end persistent messaging guarantees can create some challenges.
HiveMQ has created a solution that allows for easy bi-direction MQTT message flow between IoT devices and Kafka clusters.
This presentation describes the technical challenges of connecting IoT devices to Apache Kafka and how the HiveMQ Kafka solution solves these problems.
Is Linux ready for safety related applications?Alexander Much
The presentation is from a talk I gave at the ETAS Connections 2018 event. It details the reasoning for the use of Linux in the Automotive domain for safety-critical systems.
The content is based on our OSADL approach taken in the SIL2MP Linux project
3 Reasons to Select Time Series Platforms for Cloud Native Applications Monit...DevOps.com
Cloud native architectures deliver the much needed performance and scale but require an entirely different monitoring strategy. Legacy monitoring technologies fail to meet the granularity, ingest and query requirements of modern cloud-native architectures.
Enter Time Series platforms such as InfluxDB which can capture the metrics and events generated by applications, containers and Kubernetes pods & nodes.
Join us to find out more about why Time Series platforms are growing faster than any other monitoring technology and why they should be part of your new application architecture.
23 November 2017 - At ION Belgrade, Kevin Meynell discusses what happened at the recent IETF meeting, and how to get involved in the open Internet standards community.
Distributed intelligence using edge computing addresses challenges with centralized cloud computing like high latency and bandwidth usage. However, it introduces new security challenges with multiple providers and tenants. Solutions include encrypting all data, communications and keys; using technologies like TPM and SGX for secure execution; and reducing overhead of encryption through hardware accelerators to ensure security and performance in fog computing environments.
Similar to IT Monitoring in the Era of Containers | Luca Deri Founder & Project Lead | ntop (20)
InfluxData is excited to announce InfluxDB Clustered, the self-managed version of InfluxDB 3.0 with unparalleled flexibility, speed, performance, and scale. The evolution of InfluxDB Enterprise, InfluxDB Clustered is delivered as a collection of Kubernetes-based containers and services, which enables you to run and operate InfluxDB 3.0 where you need it, whether that's on-premises or in a private cloud environment. With this new enterprise offering, we’re excited to provide our customers with real-time queries, low-cost object storage, unlimited cardinality, and SQL language support – all with improved data access, support, and security! The newest version of InfluxDB was built on Apache Arrow, and through the open source ecosystem and integrations, extends the value of your time-stamped data.
Join this webinar to learn more about InfluxDB Clustered, and how to manage your large mission-critical workloads in the highly available database service offering!
In this webinar, Balaji Palani and Gunnar Aasen will dive into:
Key features of the new InfluxDB Clustered solution
Use cases for using the newest version of the purpose-built time series database
Live demo
During this 1-hour technical webinar, you’ll also get a chance to ask your questions live.
Best Practices for Leveraging the Apache Arrow EcosystemInfluxData
Apache Arrow is an open source project intended to provide a standardized columnar memory format for flat and hierarchical data. It enables more efficient analytics workloads for modern CPU and GPU hardware, which makes working with large data sets easier and cheaper.
InfluxData and Dremio are both members of the Apache Software Foundation (ASF). Dremio is a data lakehouse management service known for its scalability and capacity for direct querying across diverse data sources. InfluxDB is the purpose-built time series database, and InfluxDB 3.0 has a new columnar storage engine and uses the Arrow format for representing data and moving data to and from Parquet. Discover how InfluxDB and Dremio have advanced their solutions by relying on the Apache Arrow framework.
Join this live panel as Alex Merced and Anais Dotis-Georgiou dive into:
Advantages to utilizing the Apache Arrow ecosystem
Tips and tricks for implementing the columnar data structure
How developers can best utilize the ASF to innovate and contribute to new industry standards
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...InfluxData
Bevi are the creators of smart water dispensers which empower people to choose their desired beverage — flat or sparkling, their desired flavor and temperature. Since 2014, Bevi users have saved more than 350 million bottles and cans. Their "smart" water coolers have prevented the extraction of 1.4 trillion oz of oil from Earth and have saved 21.7 billion grams of CO2 from the atmosphere.
Discover how Bevi uses a time series database to enable better predictive maintenance and alerting of their entire ecosystem — including the hardware and software. They are using InfluxDB to collect sensor data in real-time remotely from their internet-connected machines about their status and activity — i.e., flavor and CO2 levels, water temp, filter status, etc. They a7re using these metrics to improve their customer experience and continuously improve their sustainability practices. Gain tips and tricks on how to best utilize InfluxDB's schema-less design.
Join this webinar as Spencer Gagnon dives into:
Bevi's approach to reducing organizations' carbon footprint — they are saving 50K+ bottles and cans annually
Their entire system architecture — including InfluxDB Cloud, Grafana, Kafka, and DigitalOcean
The importance of using time-stamped data to extend the life of their machines
Power Your Predictive Analytics with InfluxDBInfluxData
If you're using InfluxDB to store and manage your time series data, you're already off to a great start. But why stop there? In our upcoming webinar, we'll show you how to take your data analysis to the next level by building predictive analytics using a variety of tools and techniques.
We will demonstrate how to use Quix to create custom dashboards and visualizations that allow you to monitor your data in real-time. We'll also introduce you to Hugging Face, a powerful tool for building models that can predict future trends and identify anomalies. With these tools at your disposal, you'll be able to extract valuable insights from your data and make more informed decisions about the future. Don't miss out on this opportunity to improve your data analysis skills and take your business to the next level!
What you will learn:
Use InfluxDB to store and manage time series data
Utilize Quix and Hugging Face to build models, visualize trends, and identify anomalies
Extract valuable insights from your data
Improve your data analysis skills to make informed decision
How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base InfluxData
Are you considering replacing your legacy data historian and moving your OT data to the cloud? Join this technical webinar to learn how to adopt InfluxDB and IO Base - a digital platform used to improve operational efficiencies!
Teréga Solutions are the creators of digital solutions used to improve energy efficiencies and to address decarbonization challenges. Their network includes 5,000+ km of gas pipelines within France; they aim to help France attain carbon neutrality by 2050. With these impressive goals in mind, Teréga has created IO-Base — the digital platform to improve industrial performance, and increase profitability. Creating digital twins for their clients allows them to collect data from all production sites and view it in real time, from anywhere and at any time.
Discover how Teréga uses InfluxDB, Docker, and AWS to monitor its gas and hydrogen pipeline infrastructure. They chose to replace their legacy data historian with InfluxDB — the purpose built time series database. They are collecting more than 100K different metrics at various frequencies — some are collected every 5 seconds to only every 1-2 minutes. THey have reduced overall IT spend by 50% and collect 2x the amount of data at 20x frequency! By using various industrial protocols (Modbus, OPC-UA, etc.), Teréga improved output, reduced the TCO, and is now able to create added-value services: forecast, monitoring, predictive maintenance.
Join this webinar as Thomas Delquié dives into:
Teréga's approach to modernizing fossil fuel pipelines IT systems while improving yields and safety
Their centralized methodology to collecting sensor, hardware, and network metrics
The importance of time series data and why they chose InfluxDB
Build an Edge-to-Cloud Solution with the MING StackInfluxData
FlowForge enables organizations to reliably deliver Node-RED applications in a continuous, collaborative, and secure manner. Node-RED is the popular, low-code programming solution that makes it easy to connect different services using a visual programming environment. InfluxData is the creator of InfluxDB, the purpose-built time series database run by developers at scale and in any environment in the cloud, on-premises, or at the edge.
Jump-start monitoring your industrial IoT devices and discover how to build an edge-to-cloud solution with the MING stack. The MING stack includes Mosquitto/MQTT, InfluxDB, Node-RED, and Grafana. This solution can be used to improve fleet management, enable predictive maintenance of industrial machines and power generation equipment (i.e. turbines and generators) and increase safety practices (i.e. buildings, construction sites). Join this webinar to learn best practices from industrial IoT SME's.
In this webinar, Robert Marcer and Jay Clifford dive into:
Best practices for monitoring sensor data collected by everyone — from the edge to the factory
Tips and tricks for using Node-RED and InfluxDB together
Demo — see Node-RED and InfluxDB live
Meet the Founders: An Open Discussion About Rewriting Using RustInfluxData
The document is an agenda for a discussion between the CTO and founder of Ockam, Mrinal Wadhwa, and the CTO and founder of InfluxData, Paul Dix, about rewriting products using the Rust programming language. It includes an introduction of the founders, an overview of the discussion topics like why they decided to rewrite in Rust and the challenges they faced, how they got their engineers comfortable with Rust, tips they learned in the process, benefits gained from moving to Rust, and how their communities responded to the switch.
InfluxData is excited to announce the general availability of InfluxDB Cloud Dedicated! It is a fully managed time series database service running on cloud infrastructure resources that are dedicated to a single tenant. With this new offering, we’re excited to provide our customers with additional security options, and more custom configuration options to best suit customers’ workload requirements. Join this webinar to learn more about InfluxDB Cloud, and the new dedicated database service offering!
In this webinar, Balaji Palani and Gary Fowler will dive into:
Key features of the new InfluxDB Cloud Dedicated solution
Use cases for using the newest version of the purpose-built time series database
Live demo
During this 1-hour technical webinar, you’ll also get a chance to ask your questions live.
Gain Better Observability with OpenTelemetry and InfluxDB InfluxData
Many developers and DevOps engineers have become aware of using their observability data to gain greater insights into their infrastructure systems. InfluxDB is the purpose-built time series database used to collect metrics and gain observability into apps, servers, containers, and networks. Developers use InfluxDB to improve the quality and efficiency of their CI/CD pipelines. Start using InfluxDB to aggregate infrastructure and application performance monitoring metrics to enable better anomaly detection, root-cause analysis, and alerting.
This session will demonstrate how to record metrics, logs, and traces with one library — OpenTelemetry — and store them in one open source time series database — InfluxDB. Zoe will demonstrate how easy it is to set up the OpenTelemetry Operator for Kubernetes and to store and analyze your data in InfluxDB.
How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...InfluxData
American Metal Processing Company ("AMP") is the US' largest commercial rotary heat treat facility with customers in the automotive, construction, military, and agriculture industries. They use their atmosphere-protected rotary retort furnaces to provide their clients with three primary hardening services: neutral hardening (quench and temper), carburizing, and carbonitriding.
This furnace style ensures consistent, uniform heat treatment process vs. traditional batch-or-belt-style furnaces; excels at processing high volumes of smaller parts with tight tolerances; and improves the strength and toughness of plain carbon steels. Discover why AMP’s use of Telegraf, InfluxDB, Node-RED, and Grafana allows them to gain 24/7 insights into their plant operations and metallurgical results. Learn how they use time-stamped data to gain accurate metrics about their consumables usage, furnace profiles, and machine status.
Join this webinar as Grant Pinkos dives into:
American Metal Processing's approach to heat treating in a digitized environment through connected systems
Their approach to collecting and measuring sensor data to enable predictive maintenance and improve product quality
Why they need a time series database for managing and analyzing vast amounts of time-stamped data
How Delft University's Engineering Students Make Their EV Formula-Style Race ...InfluxData
Delft University is the oldest and largest technical university in the Netherlands with 25,000+ students. Since 1999, they have had a team of students (undergraduate and graduate) designing, building, and racing cars, as part of the Formula Student worldwide competition. The competition has grown to include teams from 1K+ universities in 20+ countries. Students are responsible for all aspects of car manufacturing (research, construction, testing, developing, marketing, management, and fundraising). Delft University's team includes 90 students across disciplines.
Discover how Delft University's team uses Marple and InfluxDB to collect telemetry and sensor metrics while they develop, test, and race their electrics cars. They collect sensor data about their EV's control systems using a time series platform. During races, they are collecting IoT data about their batteries, accelerometer, gyroscope, tires, etc. The engineers are able to share important car stats during races which help the drivers tweak their driving decisions — all with the goal of winning. After races, the entire team are able to analyze data in Marple to understand what to do better next time. By using Marple + InfluxDB, their team are able to collect, share and analyze high frequency car data used to make their car faster at competitions.
Join this webinar as Robbin Baauw and Nero Vanbiervliet dive into:
Marple's approach to empowering engineers to organize, analyze, and visualize their data
Delft University's collaborative methodology to building and racing their Formula-style race car
How InfluxDB is crucial to their collaborative engineering and racing process
Introducing InfluxDB’s New Time Series Database Storage EngineInfluxData
InfluxData is excited to announce the general availability of InfluxDB Cloud's new storage engine! It is a cloud-native, real-time, columnar database optimized for time series data. InfluxDB's rebuilt core was coded in Rust and sits on top of Apache Arrow and DataFusion. InfluxData's team picked Apache Parquet as the persistent format. In this webinar, Paul Dix and Balaji Palani will demonstrate key product features including the removal of cardinality limits!
They will dive into:
The next phase of the InfluxDB platform
How using Apache Arrow's ecosystem has improved InfluxDB's performance and scalability
Key features of InfluxDB Cloud's new core — including SQL native support
Start Automating InfluxDB Deployments at the Edge with balena InfluxData
balena.io helps companies develop, deploy, update, and manage IoT devices. By using Linux containers and other cloud technologies, balena enables teams to quickly and easily build fleets of connected devices. Developers are able to use containers with the language of choice and pull IoT sensor data from 70+ different single board computers into balenaCloud. Discover how to use balena.io to automate your InfluxDB deployments at the edge!
During this one-hour session, experts from balena and InfluxData will demonstrate how to build and deploy your own air quality IoT solution. You will learn:
The fundamentals of IoT sensor deployment and management using balena.
How to use a time series platform to collect and visualize metrics from edge devices.
Tips and tricks to using balenaCloud to automate InfluxDB deployments and Telegraf configurations.
How to use InfluxDB's Edge Data Replication feature to collect sensor data and push it to InfluxDB Cloud for analysis.
No coding experience required, just a curiosity to start your own IoT adventure.
Understanding InfluxDB’s New Storage EngineInfluxData
Learn more about InfluxDB’s new storage engine! The team developed a cloud-native, real-time, columnar database optimized for time series data. We built it all in Rust and it sits on top of Apache Arrow and DataFusion. We chose Apache Parquet as the persistent format, which is an open source columnar data file format. This new storage engine provides InfluxDB Cloud users with new functionality, including the removal of cardinality limits, so developers can bring in massive amounts of time series data at scale.
In this webinar, Anais Dotis-Georgiou will dive into:
Requirements for rebuilding InfluxDB’s core
Key product features and timeline
How Apache Arrow’s ecosystem is used to meet those requirements
Stick around for a demo and live Q&A
Streamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDBInfluxData
RudderStack — the creators of the leading open source Customer Data Platform (CDP) — needed a scalable way to collect and store metrics related to customer events and processing times (down to the nanosecond). They provide their clients with data pipelines that simplify data collection from applications, websites, and SaaS platforms. RudderStack's solution enables clients to stream customer data in real time — they quickly deploy flexible data pipelines that send the data to the customer's entire stack without engineering headaches. Customers are able to stream data from any tool using their 16+ SDK's, and they are able to transform the data in-transit using JavaScript or Python. How does RudderStack use a time series platform to provide their customers with real-time analytics?
Join this webinar as Ryan McCrary dives into:
RudderStack's approach to streamlining data pipelines with their 180+ out-of-the-box integrations
Their data architecture including Kapacitor for alerting and Grafana for customized dashboards
Why using InfluxDB was crucial for them for fast data collection and providing single-sources of truths for their customers
Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...InfluxData
Customers using ThingWorx and the Manufacturing Solutions often need to store property data longer than the Solutions default to. These customers are recommended to use InfluxDB, and this presentation will cover the key considerations for moving to InfluxDB vs the standard ThingWorx value streams. Join this session as Ward highlights ThingWorx’s solution and its easy implementation process.
Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022InfluxData
Two new features are coming to Flux that add flexibility
and functionality to your data workflow—polymorphic
labels and dynamic types. This session walks through
these new features and shows how they work.
This document outlines the schedule for Day 2 of InfluxDays 2022, an event hosted by InfluxData. The schedule includes sessions on building developer experience, how developers like to work, an overview of the InfluxDB developer console and API, demos of client libraries and the InfluxDB v2 API, tips for getting involved in the InfluxDB community and university, use cases for networking monitoring, crypto/fintech, monitoring/observability, and IIoT, and closing thoughts. Recordings of all sessions will be made available to registered attendees by November 7th. Upcoming events include advanced Flux training in London and resources through the community forums, Slack channel, and online university.
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...InfluxData
This document contains the agenda for Day 2 of InfluxDays 2022, which includes:
- Welcome and introductory remarks from Zoe Steinkamp and Jay Clifford of InfluxData.
- Fireside chats and presentations on building great developer experiences, how developers like to work, and use cases for InfluxDB from companies like Tesla, InfluxData, and others.
- Sessions on the InfluxDB developer console, APIs, client libraries, getting involved in the community, accelerating time to awesome with InfluxDB University, and tips for analyzing IoT data with InfluxDB.
- Closing thoughts from Zoe Steinkamp and Jay Clifford, as well as
The document summarizes the agenda and sessions for Day 1 of InfluxDays 2022. It includes sessions on InfluxDB data collection, scripting languages like Flux, the InfluxDB time series engine, tasks, storage, and a closing discussion. The agenda involves talks from InfluxData employees on building applications with real-time data, navigating the developer experience, solving problems, the InfluxDB platform, community, education, use cases in crypto/fintech and IIoT, and tips/tricks for analysis.
How to Get CNIC Information System with Paksim Ga.pptxdanishmna97
Pakdata Cf is a groundbreaking system designed to streamline and facilitate access to CNIC information. This innovative platform leverages advanced technology to provide users with efficient and secure access to their CNIC details.
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
Climate Impact of Software Testing at Nordic Testing DaysKari Kakkonen
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
A tale of scale & speed: How the US Navy is enabling software delivery from l...sonjaschweigert1
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
Removing Uninteresting Bytes in Software FuzzingAftab Hussain
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
Full-RAG: A modern architecture for hyper-personalizationZilliz
Mike Del Balso, CEO & Co-Founder at Tecton, presents "Full RAG," a novel approach to AI recommendation systems, aiming to push beyond the limitations of traditional models through a deep integration of contextual insights and real-time data, leveraging the Retrieval-Augmented Generation architecture. This talk will outline Full RAG's potential to significantly enhance personalization, address engineering challenges such as data management and model training, and introduce data enrichment with reranking as a key solution. Attendees will gain crucial insights into the importance of hyperpersonalization in AI, the capabilities of Full RAG for advanced personalization, and strategies for managing complex data integrations for deploying cutting-edge AI solutions.
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...Neo4j
Leonard Jayamohan, Partner & Generative AI Lead, Deloitte
This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.
Pushing the limits of ePRTC: 100ns holdover for 100 daysAdtran
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
Maruthi Prithivirajan, Head of ASEAN & IN Solution Architecture, Neo4j
Get an inside look at the latest Neo4j innovations that enable relationship-driven intelligence at scale. Learn more about the newest cloud integrations and product enhancements that make Neo4j an essential choice for developers building apps with interconnected data and generative AI.
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slackshyamraj55
Discover the seamless integration of RPA (Robotic Process Automation), COMPOSER, and APM with AWS IDP enhanced with Slack notifications. Explore how these technologies converge to streamline workflows, optimize performance, and ensure secure access, all while leveraging the power of AWS IDP and real-time communication via Slack notifications.
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc
How does your privacy program stack up against your peers? What challenges are privacy teams tackling and prioritizing in 2024?
In the fifth annual Global Privacy Benchmarks Survey, we asked over 1,800 global privacy professionals and business executives to share their perspectives on the current state of privacy inside and outside of their organizations. This year’s report focused on emerging areas of importance for privacy and compliance professionals, including considerations and implications of Artificial Intelligence (AI) technologies, building brand trust, and different approaches for achieving higher privacy competence scores.
See how organizational priorities and strategic approaches to data security and privacy are evolving around the globe.
This webinar will review:
- The top 10 privacy insights from the fifth annual Global Privacy Benchmarks Survey
- The top challenges for privacy leaders, practitioners, and organizations in 2024
- Key themes to consider in developing and maintaining your privacy program
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfMalak Abu Hammad
Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers:
* What is Vector Search?
* Importance and benefits of vector search
* Practical use cases across various industries
* Step-by-step implementation guide
* Live demos with code snippets
* Enhancing LLM capabilities with vector search
* Best practices and optimization strategies
Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications.
#MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Building RAG with self-deployed Milvus vector database and Snowpark Container...Zilliz
This talk will give hands-on advice on building RAG applications with an open-source Milvus database deployed as a docker container. We will also introduce the integration of Milvus with Snowpark Container Services.
Building RAG with self-deployed Milvus vector database and Snowpark Container...
IT Monitoring in the Era of Containers | Luca Deri Founder & Project Lead | ntop
1. Luca Deri <deri@ntop.org>, ntop Founder
IT Monitoring in the
Era of Containers
Luca Deri <deri@ntop.org>, ntop Founder
IT Monitoring in the
Era of Containers