Rolls Royce collects 0.5 TB of data during the design, manufacture, and operation of its Trent 1000 jet engines. This includes real-time data transmitted back during flights. Caterpillar uses sensors in its mining and transportation equipment to monitor factors like fuel usage, location, and idle time to improve efficiency. Predictive maintenance has saved millions by identifying issues before failures occur.
WSO2Con ASIA 2016: Patterns for Deploying Analytics in the Real WorldWSO2
Abundant data is all around. The most important aspect is how you as an organization can access the data, process it, and present information to the relevant authorities on time. To gain competitive advantage the means of accessing, processing and presenting the data should be optimal, highly available and scalable.
In this talk, we will discuss how you can leverage WSO2 Data Analytics Server, WSO2 IoT Server, WSO2 Enterprise Service Bus and other WSO2 products in order to analyze the data. We will also discuss different deployment patterns that can provide you with a suitable solution that lets you analyze relevant data historically, in real-time or interactively and predict future states to make better decisions for your organization’s success.
ThingsBoard IoT Platform provides device management, telemetry, data processing and visualization. It combines with ThingsBoard IoT Gateway and Trendz Analytics. It is suitable for a wide variety of use cases including smart energy, fleet tracking, smart farming and IIoT.
Using OPC-UA to Extract IIoT Time Series Data from PLC and SCADA SystemsInfluxData
Algist Bruggeman NV produces yeast for large-scale bakeries and home bakers. The company lacked insight into its fermentation process as its sensor data collection process was manual. Production data was committed to paper, making it difficult to compare batches, aggregate production parameters or detect anomalies.
Factry.IO’s data historian, built on InfluxDB, has helped the company collect process data, enabling it to gain more insight into its production process and provide predictive maintenance.
In this webinar, learn about Algist Bruggeman NV’s business outcomes and the technical setup of linking time series data with ERP, planning and quality data for operational improvement.
How Sensor Data Can Help Manufacturers Gain Insight to Reduce Waste, Energy C...InfluxData
In this webinar, learn how a long-time Industrial IT Consultant helps his customer make the leap into providing visibility of their processes to everyone in the plant. This journey led to the discovery of untapped opportunity to improve operations, reduce energy consumption, and minimize plant downtime. The collection of data from the individual sensors has led to powerful Grafana dashboards shared across the organization.
How KeyBank Used Elastic to Build an Enterprise Monitoring SolutionElasticsearch
KeyBank is using an iterative design approach to scale their end-to-end enterprise monitoring system with Kafka and Elasticsearch at its core. See how they did it and the lessons learned along the way.
WSO2Con ASIA 2016: Patterns for Deploying Analytics in the Real WorldWSO2
Abundant data is all around. The most important aspect is how you as an organization can access the data, process it, and present information to the relevant authorities on time. To gain competitive advantage the means of accessing, processing and presenting the data should be optimal, highly available and scalable.
In this talk, we will discuss how you can leverage WSO2 Data Analytics Server, WSO2 IoT Server, WSO2 Enterprise Service Bus and other WSO2 products in order to analyze the data. We will also discuss different deployment patterns that can provide you with a suitable solution that lets you analyze relevant data historically, in real-time or interactively and predict future states to make better decisions for your organization’s success.
ThingsBoard IoT Platform provides device management, telemetry, data processing and visualization. It combines with ThingsBoard IoT Gateway and Trendz Analytics. It is suitable for a wide variety of use cases including smart energy, fleet tracking, smart farming and IIoT.
Using OPC-UA to Extract IIoT Time Series Data from PLC and SCADA SystemsInfluxData
Algist Bruggeman NV produces yeast for large-scale bakeries and home bakers. The company lacked insight into its fermentation process as its sensor data collection process was manual. Production data was committed to paper, making it difficult to compare batches, aggregate production parameters or detect anomalies.
Factry.IO’s data historian, built on InfluxDB, has helped the company collect process data, enabling it to gain more insight into its production process and provide predictive maintenance.
In this webinar, learn about Algist Bruggeman NV’s business outcomes and the technical setup of linking time series data with ERP, planning and quality data for operational improvement.
How Sensor Data Can Help Manufacturers Gain Insight to Reduce Waste, Energy C...InfluxData
In this webinar, learn how a long-time Industrial IT Consultant helps his customer make the leap into providing visibility of their processes to everyone in the plant. This journey led to the discovery of untapped opportunity to improve operations, reduce energy consumption, and minimize plant downtime. The collection of data from the individual sensors has led to powerful Grafana dashboards shared across the organization.
How KeyBank Used Elastic to Build an Enterprise Monitoring SolutionElasticsearch
KeyBank is using an iterative design approach to scale their end-to-end enterprise monitoring system with Kafka and Elasticsearch at its core. See how they did it and the lessons learned along the way.
Christoph Bussler [Google Cloud] | IoT Event Processing and Analytics with In...InfluxData
The presentation introduces a Google Cloud native architecture for collecting, processing, analyzing and archiving events from IoT devices, vehicles as well as upstream software systems. InfluxDB and its connection to global native Google Cloud services like BigQuery or Cloud Machine Learning Engine as well as Kubernetes is at the center of the architecture. The architecture demonstrates how access to global scaling cloud services address use cases from the Energy Sector.
Learn more about InfluxData’s time series platform. InfluxDB Cloud is a fast, elastic, serverless real-time monitoring platform, dashboarding engine, analytics service and event and metrics processor. It is available on AWS, Azure and Google Cloud. Since its launch, we have been busy making updates to the product!
Join Balaji Palani, Director of Product Management, as he demonstrates the the latest features of InfluxDB Cloud. This one-hour webinar will feature a product update and Q&A time.
Full Stack Monitoring with Azure MonitorKnoldus Inc.
The full-stack monitoring solutions within Azure Monitor is a boon for DevOps & SRE professionals as they can achieve complete observability of all the applications at a centralized location. Be it troubleshooting issues within your application, infrastructure or network, a unified monitoring solution ensures that you can diagnose problems at one place and fix them within
This webinar talks about how Azure Monitor has eased the monitoring of complex modern applications, whether cloud-based or on-premise. It answers questions like -
~ How to quickly detect and diagnose issues across applications?
~ How to manage infrastructure concerns like those in VMs or containers?
~ How to gain insights from your monitoring data?
~ How to support operations at scale?
Topics of this presentation:
- Basics and best practices of developing single-page applications (SPA) and Web API Services on Microsoft .NET -
- Core with Docker and Linux.
- PowerShell Core automated builds.
- Markdown/PDF documentation.
- Documentation of public interfaces with Swagger/OAS/YAML.
- Automated testing of SPA on Protractor and testing the Web API on Postman/Newman.
This presentation by Sergii Fradkov (Consultant, Engineering), Andrii Zarharov (Lead Software Engineer, Consultant), Igor Magdich (Lead Test Engineer, Consultant) was delivered at GlobalLogic Kharkiv .NET TechTalk #1 on May 24, 2019.
Martin Moucka [Red Hat] | How Red Hat Uses gNMI, Telegraf and InfluxDB to Gai...InfluxData
Red Hat is the provider of enterprise open source solutions. Its portfolio of products includes hybrid cloud infrastructure, middleware, cloud-native apps and automation solutions. Its internal network supports all lines of business — including 60+ sites. Discover how Red Hat uses InfluxDB and Flux for better real-time monitoring of their networks to improve performance and to understand utilization better.
Alex Nauda [Nobl9] | How Not to Build an SLO Platform | InfluxDays NA 2021InfluxData
Nobl9 is a Service Level Objective Platform for measuring and monitoring reliability. We will look under the hood of an SLO platform using InfluxDB as part of the core architecture. We’ll talk about the project, the decisions we took, the challenges we faced, the mistakes we made, and the lessons learned.
Shashi Raina [AWS] & Al Sargent [InfluxData] | Build Modern Monitoring with I...InfluxData
Infrastructure management and observability can be challenging in industries like financial services where uptime is of paramount importance. Learn how AWS and InfluxDB solutions overcome these challenges by delivering real-time visibility into systems to help quickly identify and mitigate potential outages. We’ll share real examples of how these solutions were implemented, providing better observability into infrastructure and transactions, and how these organizations were able to pass on these performance improvements to their customers as a result. Finally, this session will share how you can get started with a free trial of InfluxDB on AWS.
David Henthorn [Rose-Hulman Institute of Technology] | Illuminating the Dark ...InfluxData
Critical infrastructure, such as manufacturing facilities, power plants, dams, and chemical plants, has long experienced a phenomenon known as dark data – crucial information is locked away in disparate and proprietary systems. At Rose-Hulman Institute of Technology, we are teaching students to unlock this data with the help of tools such as Telegraf and InfluxDB to better make informed decisions. In addition, these tools allow our students to investigate best practices in data handling and critical infrastructure cybersecurity.
Divide & Conquer - Logging Architecture in Distributed Ecosystems with Elasti...Elasticsearch
See how the Otto.de team built a scalable and resilient logging solution and how they’re scaling Logstash, addressing housekeeping for Elasticsearch, and collecting usage metrics for analytics and billing.
How to Streamline Incident Response with InfluxDB, PagerDuty and RundeckInfluxData
Mean Time to Resolution (MTTR) is a foundational KPI for most organizations. DevOps and SRE teams are under intense pressure to reduce MTTR when resolving incidents. Often parts of incident response processes are manual, bringing together alerts, runbooks, ad-hoc scripts, and people to form a response.
In this webinar, we will show you how to improve resolution time by configuring InfluxDB notification endpoints to PagerDuty and triggering auto-remediations with Rundeck. Using Rundeck’s automated runbooks, customers have experienced up to 50% reduction in incident response time, greatly improving team productivity and reducing unnecessary outage time.
Workshop: Event-sourced system through Reactive Streamssterkje
These are the slides from our meetup/workshop: "Event-sourced system through Reactive Streams" that we organized on 22 nov 2018.
https://www.meetup.com/Reactive-Programming-Belgium/events/254708703/
One Azure Monitor to Rule Them All? - Marius ZahariaITCamp
After winding paths, the different Azure services finally harmonize into a unified monitoring strategy. Focus on Azure Monitor and its features, as well as the modalities of integration between Azure Monitor and complementary blocks, Application Insights, or Log Analytics.
Timothy Spann [StreamNative] | Using FLaNK with InfluxDB for EdgeAI IoT at Sc...InfluxData
Using FLaNK with InfluxDB for EdgeAI IoT at Scale
Timothy from StreamNative take you on a hands-on deep-dive on using Pulsar, Apache NiFi + Edge Flow Manager + MiniFi Agents with Apache MXNet, OpenVino, TensorFlow Lite, and other Deep Learning Libraries on the actual edge devices including Raspberry Pi with Movidius 2, Google Coral TPU and NVidia Jetson Nano. The team run deep learning models on the edge devices and send images, and capture real-time GPS and sensor data. Their low-coding IoT applications provide easy edge routing, transformation, data acquisition and alerting before they decide what data to stream real-time to their data space. These edge applications classify images and sensor readings real-time at the edge and then send Deep Learning results to Flink SQL and Apache NiFi for transformation, parsing, enrichment, querying, filtering and merging data to InfluxDB.
How a Time Series Database Contributes to a Decentralized Cloud Object Storag...InfluxData
In this presentation, you'll learn how InfluxDB is a component to Storj’s Tardigrade service and workflows. John Gleeson and Ben Sirb of Storj Lab will Storj’s redefinition of a cloud object storage network, how InfluxData fits into Storj’s Open Source Partner Program, and how to collect and manage high-volume, real-time telemetry data from a distributed network.
WSO2Con EU 2016: WSO2 IoT Server: Your Foundation for the Internet of ThingsWSO2
WSO2 IoT Server encapsulates everything you need for implementing a server side Internet of things (IoT) architecture. It features an extensible framework for device manufacturers to write plugins, analytics and integration capabilities for devices they manufacture. It also has a strong analytics framework for performing batch, real time and predictive analytics on data streams from devices. Processed device data can be shared with other consumers allowing integration between devices or systems.
In this talk, Sumedha will introduce WSO2 IoT Server. He will focus on how device manufacturers and integration architects can make use of existing features of WSO2 IoT Server or extend them.
WSO2Con EU 2016: Enterprise Platform for Digital TransformationWSO2
Enterprises are looking for digital transformation today by making it the highest priority in every CxO and enterprise architect’s task list. This session explores what digital transformation is and how you can get there in both business and technical terms. In addition to sharing a few success stories from his experiences, Asanka will also explain the pattern of building a platform or platform of platforms and
The role of middleware in this process
Functional capabilities required for it
How the WSO2 enterprise middleware platform can help you
Christoph Bussler [Google Cloud] | IoT Event Processing and Analytics with In...InfluxData
The presentation introduces a Google Cloud native architecture for collecting, processing, analyzing and archiving events from IoT devices, vehicles as well as upstream software systems. InfluxDB and its connection to global native Google Cloud services like BigQuery or Cloud Machine Learning Engine as well as Kubernetes is at the center of the architecture. The architecture demonstrates how access to global scaling cloud services address use cases from the Energy Sector.
Learn more about InfluxData’s time series platform. InfluxDB Cloud is a fast, elastic, serverless real-time monitoring platform, dashboarding engine, analytics service and event and metrics processor. It is available on AWS, Azure and Google Cloud. Since its launch, we have been busy making updates to the product!
Join Balaji Palani, Director of Product Management, as he demonstrates the the latest features of InfluxDB Cloud. This one-hour webinar will feature a product update and Q&A time.
Full Stack Monitoring with Azure MonitorKnoldus Inc.
The full-stack monitoring solutions within Azure Monitor is a boon for DevOps & SRE professionals as they can achieve complete observability of all the applications at a centralized location. Be it troubleshooting issues within your application, infrastructure or network, a unified monitoring solution ensures that you can diagnose problems at one place and fix them within
This webinar talks about how Azure Monitor has eased the monitoring of complex modern applications, whether cloud-based or on-premise. It answers questions like -
~ How to quickly detect and diagnose issues across applications?
~ How to manage infrastructure concerns like those in VMs or containers?
~ How to gain insights from your monitoring data?
~ How to support operations at scale?
Topics of this presentation:
- Basics and best practices of developing single-page applications (SPA) and Web API Services on Microsoft .NET -
- Core with Docker and Linux.
- PowerShell Core automated builds.
- Markdown/PDF documentation.
- Documentation of public interfaces with Swagger/OAS/YAML.
- Automated testing of SPA on Protractor and testing the Web API on Postman/Newman.
This presentation by Sergii Fradkov (Consultant, Engineering), Andrii Zarharov (Lead Software Engineer, Consultant), Igor Magdich (Lead Test Engineer, Consultant) was delivered at GlobalLogic Kharkiv .NET TechTalk #1 on May 24, 2019.
Martin Moucka [Red Hat] | How Red Hat Uses gNMI, Telegraf and InfluxDB to Gai...InfluxData
Red Hat is the provider of enterprise open source solutions. Its portfolio of products includes hybrid cloud infrastructure, middleware, cloud-native apps and automation solutions. Its internal network supports all lines of business — including 60+ sites. Discover how Red Hat uses InfluxDB and Flux for better real-time monitoring of their networks to improve performance and to understand utilization better.
Alex Nauda [Nobl9] | How Not to Build an SLO Platform | InfluxDays NA 2021InfluxData
Nobl9 is a Service Level Objective Platform for measuring and monitoring reliability. We will look under the hood of an SLO platform using InfluxDB as part of the core architecture. We’ll talk about the project, the decisions we took, the challenges we faced, the mistakes we made, and the lessons learned.
Shashi Raina [AWS] & Al Sargent [InfluxData] | Build Modern Monitoring with I...InfluxData
Infrastructure management and observability can be challenging in industries like financial services where uptime is of paramount importance. Learn how AWS and InfluxDB solutions overcome these challenges by delivering real-time visibility into systems to help quickly identify and mitigate potential outages. We’ll share real examples of how these solutions were implemented, providing better observability into infrastructure and transactions, and how these organizations were able to pass on these performance improvements to their customers as a result. Finally, this session will share how you can get started with a free trial of InfluxDB on AWS.
David Henthorn [Rose-Hulman Institute of Technology] | Illuminating the Dark ...InfluxData
Critical infrastructure, such as manufacturing facilities, power plants, dams, and chemical plants, has long experienced a phenomenon known as dark data – crucial information is locked away in disparate and proprietary systems. At Rose-Hulman Institute of Technology, we are teaching students to unlock this data with the help of tools such as Telegraf and InfluxDB to better make informed decisions. In addition, these tools allow our students to investigate best practices in data handling and critical infrastructure cybersecurity.
Divide & Conquer - Logging Architecture in Distributed Ecosystems with Elasti...Elasticsearch
See how the Otto.de team built a scalable and resilient logging solution and how they’re scaling Logstash, addressing housekeeping for Elasticsearch, and collecting usage metrics for analytics and billing.
How to Streamline Incident Response with InfluxDB, PagerDuty and RundeckInfluxData
Mean Time to Resolution (MTTR) is a foundational KPI for most organizations. DevOps and SRE teams are under intense pressure to reduce MTTR when resolving incidents. Often parts of incident response processes are manual, bringing together alerts, runbooks, ad-hoc scripts, and people to form a response.
In this webinar, we will show you how to improve resolution time by configuring InfluxDB notification endpoints to PagerDuty and triggering auto-remediations with Rundeck. Using Rundeck’s automated runbooks, customers have experienced up to 50% reduction in incident response time, greatly improving team productivity and reducing unnecessary outage time.
Workshop: Event-sourced system through Reactive Streamssterkje
These are the slides from our meetup/workshop: "Event-sourced system through Reactive Streams" that we organized on 22 nov 2018.
https://www.meetup.com/Reactive-Programming-Belgium/events/254708703/
One Azure Monitor to Rule Them All? - Marius ZahariaITCamp
After winding paths, the different Azure services finally harmonize into a unified monitoring strategy. Focus on Azure Monitor and its features, as well as the modalities of integration between Azure Monitor and complementary blocks, Application Insights, or Log Analytics.
Timothy Spann [StreamNative] | Using FLaNK with InfluxDB for EdgeAI IoT at Sc...InfluxData
Using FLaNK with InfluxDB for EdgeAI IoT at Scale
Timothy from StreamNative take you on a hands-on deep-dive on using Pulsar, Apache NiFi + Edge Flow Manager + MiniFi Agents with Apache MXNet, OpenVino, TensorFlow Lite, and other Deep Learning Libraries on the actual edge devices including Raspberry Pi with Movidius 2, Google Coral TPU and NVidia Jetson Nano. The team run deep learning models on the edge devices and send images, and capture real-time GPS and sensor data. Their low-coding IoT applications provide easy edge routing, transformation, data acquisition and alerting before they decide what data to stream real-time to their data space. These edge applications classify images and sensor readings real-time at the edge and then send Deep Learning results to Flink SQL and Apache NiFi for transformation, parsing, enrichment, querying, filtering and merging data to InfluxDB.
How a Time Series Database Contributes to a Decentralized Cloud Object Storag...InfluxData
In this presentation, you'll learn how InfluxDB is a component to Storj’s Tardigrade service and workflows. John Gleeson and Ben Sirb of Storj Lab will Storj’s redefinition of a cloud object storage network, how InfluxData fits into Storj’s Open Source Partner Program, and how to collect and manage high-volume, real-time telemetry data from a distributed network.
WSO2Con EU 2016: WSO2 IoT Server: Your Foundation for the Internet of ThingsWSO2
WSO2 IoT Server encapsulates everything you need for implementing a server side Internet of things (IoT) architecture. It features an extensible framework for device manufacturers to write plugins, analytics and integration capabilities for devices they manufacture. It also has a strong analytics framework for performing batch, real time and predictive analytics on data streams from devices. Processed device data can be shared with other consumers allowing integration between devices or systems.
In this talk, Sumedha will introduce WSO2 IoT Server. He will focus on how device manufacturers and integration architects can make use of existing features of WSO2 IoT Server or extend them.
WSO2Con EU 2016: Enterprise Platform for Digital TransformationWSO2
Enterprises are looking for digital transformation today by making it the highest priority in every CxO and enterprise architect’s task list. This session explores what digital transformation is and how you can get there in both business and technical terms. In addition to sharing a few success stories from his experiences, Asanka will also explain the pattern of building a platform or platform of platforms and
The role of middleware in this process
Functional capabilities required for it
How the WSO2 enterprise middleware platform can help you
To view recording of this webinar please use below URL:
http://wso2.com/library/webinars/2015/09/web-oriented-architecture/
Is SOA the answer to everything? Perhaps not. Web oriented architecture (WOA) or SOA + WWW + REST, takes you several steps further by filling the blanks of SOA and helping you build an end-to-end complete web application. In addition to APIs, WOA identifies user interfaces and application state as first-class components of an architecture. Most of what we build today is actually WOA, though the abbreviation might not be that popular.
This session will discuss
The original definition of WOA by Gartner in 2006
The changes to WOA over the last 10 years
Today’s trends
WOA-Stack
Please use the below URL to view webinar recording.
http://wso2.com/library/webinars/2015/01/understanding-the-wso2-platform/
In this webinar, attendees will understand
Capabilities of the platform
Why a unified platform leads to faster and more cost-effective implementation
How other organizations have benefited from the WSO2 platform
See Tekla Global BIM Awards 2015 finalists and winners.
The winners from three continents showcase extremely skillful modeling and great collaboration and innovative construction.
The competition had six categories: commercial projects, public projects, industrial projects, infrastructure projects, sports and recreational and small projects.
WSO2Con USA 2015: Safe for Work: The Internet of Dirty ThingsWSO2
The Internet of Things is deep in Trimble’s DNA. This session will discuss how Trimble combines positioning with domain expertise in construction, agriculture, and fleet management to improve the efficiency, productivity and transparency of our customers’ businesses through a connected network of things. Big things, that like to play in the mud.
Consumer to Data: Next-Generation Middleware and Cloud Platform for your Ente...WSO2
To view recording of this webinar please use the below URL:
http://wso2.com/library/webinars/2015/08/consumer-to-data-next-generation-middleware-and-cloud-platform-for-your-enterprise/
One of WSO2's biggest strengths is its 100% open source, unified, modular platform for middleware. In this webinar, Asanka Abeysinghe, vice president of solutions architecture at WSO2, will explain the motivation, design, and capability of this platform. Asanka will also look at customer examples and address how the platform is used in real life.
He will discuss
An evolution of the platform (Platform 3.0)
Capabilities of the platform (system of systems)
Why a unified platform leads to a faster and more cost-effective implementation (data to consumer)
How other organizations have benefited from the WSO2 platform (reference architectures)
The session is aimed at CxOs and enterprise architects interested in integration, rapid application development, APIs, identity, analytics and the Cloud.
WSO2Con USA 2017: Is It Time to Update My Open Source Strategy?WSO2
The industry continually changes and so does the role and importance of open source. This session presents some practical advice on updating your open source strategy in harmony with your digital transformation strategy, cloud strategy, talent strategy, license strategy, and more.
Since more than 15 years we have been very happy to work with JCAPS and its predecessors. When Oracle announced to cease support for the platform, we created a task force with the mission to assess which platform provides the best assets to become a true successor for JCAPS. We finally selected WSO2 which is a great, stable, flexible and performing SOA platform. Our experience confirmed it to be the best fit for successful migration projects. We have written a complete set of migration tools for JCAPS (5.x) and eGate (4.x) to WSO2 ESB. This helps really to speed up the migration and keeping the quality and even improve the performance.
WSO2Con USA 2017: The Role of Enterprise Integration in Digital TransformationWSO2
Enterprise integration has been evolving for several decades and has been going through drastic changes. In this session, we focus on the future trends in enterprise integration and how WSO2 integration addresses these needs.
Overview of enterprise integration: past, present and the future
Integration Service: Is it an anti pattern in future enterprise architecture?
Importance of integration in modern enterprises
Integration beyond the ESB: integrating services, systems, data and identities
The role of integration in microservices, Internet of Things (IoT) and APIs
Redefining scaling and performance
Developer experience: visual modeling, debugging and tracing
Hybrid integration: on-premise, integration Platform as a Service (iPaaS) and iSaaS
WSO2Con USA 2017: Iterative Architecture: A Pragmatic Approach to Digital Tra...WSO2
“Think big, act small” – Its easy to develop a vision, but the path to achieve it from wherever you are right now often has many technical and non-technical barriers. WSO2, as an open source technology provider, helps many enterprises transform to provide better digital experiences to consumers, both internally and externally. In this closing keynote Asanka Abeysinghe, vice president of solutions architecture at WSO2, will share his experiences as a consultant and evangelist of digital transformation, and discuss a practical implementation model using an iterative approach.
WSO2Con USA 2017: Rise to the Challenge with WSO2 Identity Server and WSO2 AP...WSO2
At Proximus, the Enabling Company initiative (EnCo, https://www.enabling.be) is building a comprehensive ecosystem to support the connected business. The initiative integrates Proximus’ powerful telco assets and state-of-the-art networks to shape tomorrow’s business. Proximus EnCo enables companies by connecting the dots between things, telecommunications, cloud and big data.
This session will explore how RealDolmen designed the architecture for the EnCo platform. It will discuss how
The core of the platform is powered by two key products from WSO2’s offering: WSO2 API Manager and WSO2 Identity Server
These were specifically selected with the objective of realizing an ecosystem that should serve an API-driven economy, and support Identity-as-a-Service (IDaaS)
Every enterprise has a multitude of existing systems - including on-premise as well as cloud solutions - that perform critical functions. Integrating data and services across these systems is critical for an enterprise to successfully implement its digital transformation efforts. Therefore, most often than not, enterprise integration is at the heart of any organization’s digital transformation strategy.
WSO2Con USA 2017: Managing Verifone’s New Payment Device “Carbon” with WSO2’s...WSO2
Verifone’s new flagship payment device “Carbon” comes along with a whole service platform for Estate Owners, merchants, and app developers. A developer SDK and platform allows third-party developers to create apps that can interact with the payment flow, and merchants can purchase these apps via an app store. Merchants can manage their devices and users via the device or via a web platform. Estate owners get an overview of all devices in their “estate” and can manage the devices, their merchants, and apps that they can provide to the merchants. The device consists of two parts – an Android tablet and a Unix-based payment terminal. Verifone decided to use WSO2’s mobile device management solution (EMM) to manage the Android tablet for installing apps, getting information about the current state of the devices, locking or rebooting the devices, installing security policies, etc. Our own terminal management system interacts with EMM on an API-only basis to manage the Android tablets. And the plan is to use EMM for a large-scale deployment of thousands of devices in the field.
This talk will introduce the features and use cases of Carbon, the motivation why we chose the open-source EMM over commercial alternatives, as well as the architecture of our device management via our own terminal management system and EMM APIs.
WSO2 Data Analytics Server is a comprehensive enterprise data analytics platform; it fuses batch and real-time analytics of any source of data with predictive analytics via machine learning.
AWS Big Data Demystified #1: Big data architecture lessons learned Omid Vahdaty
AWS Big Data Demystified #1: Big data architecture lessons learned . a quick overview of a big data techonoligies, which were selected and disregard in our company
The video: https://youtu.be/l5KmaZNQxaU
dont forget to subcribe to the youtube channel
The website: https://amazon-aws-big-data-demystified.ninja/
The meetup : https://www.meetup.com/AWS-Big-Data-Demystified/
The facebook group : https://www.facebook.com/Amazon-AWS-Big-Data-Demystified-1832900280345700/
Big data Argentina meetup 2020-09: Intro to presto on dockerFederico Palladoro
We will talk about how we are migrating our Presto clusters from AWS EMR to Docker using production-grade orchestrators
considering cluster management, configuration and monitoring. We will discuss between Hashicorp Nomad and Kubernetes as a base solution
Apache Big Data 2016: Next Gen Big Data Analytics with Apache ApexApache Apex
Apache Apex is a next gen big data analytics platform. Originally developed at DataTorrent it comes with a powerful stream processing engine, rich set of functional building blocks and an easy to use API for the developer to build real-time and batch applications. Apex runs natively on YARN and HDFS and is used in production in various industries. You will learn about the Apex architecture, including its unique features for scalability, fault tolerance and processing guarantees, programming model and use cases.
http://apachebigdata2016.sched.org/event/6M0L/next-gen-big-data-analytics-with-apache-apex-thomas-weise-datatorrent
Zeus: Uber’s Highly Scalable and Distributed Shuffle as a ServiceDatabricks
Zeus is an efficient, highly scalable and distributed shuffle as a service which is powering all Data processing (Spark and Hive) at Uber. Uber runs one of the largest Spark and Hive clusters on top of YARN in industry which leads to many issues such as hardware failures (Burn out Disks), reliability and scalability challenges.
Anurag Awasthi - Machine Learning applications for CloudStackShapeBlue
While Machine learning and data mining has had profound impact on how we model applications and use data for better product consumption, there is scope for extending prediction algorithms to lower levels as well. Some useful applications of machine learning in ACS could be exploring better resource allocation that is aware of usage statistics, predicting faults, load balancing, etc. In this talk we will * take a broad overview of what Machine Learning/Data mining is and how it is being used in today's tech ecosystemn* explore ways in which we can make ACS more efficientn* discuss some recent advancements in how ML can benefit datacenters from research community
Archmage, Pinterest’s Real-time Analytics Platform on DruidImply
In this talk, we will talk about:
1) the motivation of switching from Hbase backed analytics system to Druid
2) the architecture design of Druid as a platform in Pinterest (Archmage, Hadoop, Kafka) including a query interface, Archmage, a thrift service in front of Druid which exposes a thrift api to company-wise clients, handles Druid broker hosts discovery, serves as a relay to broker hosts to abstract the async HTTP connection and provides query optimizations transparent to clients including directly translating fixed pattern SQL to Druid native JSON queries to save planning time. In addition, we’ll cover the production Hadoop batch and Kafka real time ingestion pipeline setup and the reason we picked a pull-based solution instead of a push-based solution for real time ingestion.
3) We will also talk about the use cases currently running in production on this platform including their data volume, QPS, Druid cluster setup, the unique challenges we met while onboarding and how we addressed them with extensive tunings to meet SLA and lessons learned for use cases including: partner insights, which provides partners with stats on organic pins; realtime spam detection, which detects user login related anomaly events and pin related spamming events like pin creation and repin; and migrating the backend from Presto to Druid for Ads related experiments data analysis.
How to Develop and Operate Cloud First Data PlatformsAlluxio, Inc.
Alluxio Online Meetup
Feb 11, 2020
Speakers:
Du Li, Electronic Arts
Bin Fan, Alluxio
In cloud-based software stacks, there are varying degrees of automation across different layers: infrastructure, platform, and application. The mismatch in automation often breaks balance in devops, causing ops nightmares in platforms and applications. This talk will overview two projects at Electronic Arts (EA) that address the mismatch by data orchestration: One project automatically generates configurations for all components in a large monitoring system, which reduces the daily average number of alerts from ~1000 to ~20. The other project introduces Alluxio for caching and unifying address space across ETL and analytics workloads, which substantially simplifies architecture, improves performance, and reduces ops overheads.
NetflixOSS Meetup S3 E1, covering latest components in Distributed Databases, Telemetry systems, Big Data tools and more. Speakers from Netflix, IBM Watson, Pivotal and Nike Digital
Incremental Processing on Large Analytical Datasets with Prasanna Rajaperumal...Databricks
Prasanna Rajaperumal and Vinoth Chandar will explore a specific problem of ingesting petabytes of data in Uber and why they ended up building an analytical datastore from scratch using Spark. Prasanna will discuss design choices and implementation approaches in building Hoodie to provide near-real-time data ingestion and querying using Spark and HDFS.
Hoodie: How (And Why) We built an analytical datastore on SparkVinoth Chandar
Exploring a specific problem of ingesting petabytes of data in Uber and why they ended up building an analytical datastore from scratch using Spark. Then, discuss design choices and implementation approaches in building Hoodie to provide near-real-time data ingestion and querying using Spark and HDFS.
https://spark-summit.org/2017/events/incremental-processing-on-large-analytical-datasets/
How to Develop and Operate Cloud Native Data Platforms and ApplicationsAlluxio, Inc.
Data Orchestration Summit
www.alluxio.io/data-orchestration-summit-2019
November 7, 2019
How to Develop and Operate Cloud Native Data Platforms and Applications
Speaker:
Du Li, Electronic Arts (EA)
For more Alluxio events: https://www.alluxio.io/events/
Accelerate Enterprise Software Engineering with PlatformlessWSO2
Key takeaways:
Challenges of building platforms and the benefits of platformless.
Key principles of platformless, including API-first, cloud-native middleware, platform engineering, and developer experience.
How Choreo enables the platformless experience.
How key concepts like application architecture, domain-driven design, zero trust, and cell-based architecture are inherently a part of Choreo.
Demo of an end-to-end app built and deployed on Choreo.
Less Is More: Utilizing Ballerina to Architect a Cloud Data PlatformWSO2
At its core, the challenge of managing Human Resources data is an integration challenge: estimates range from 2-3 HR systems in use at a typical SMB, up to a few dozen systems implemented amongst enterprise HR departments, and these systems seldom integrate seamlessly between themselves. Providing a multi-tenant, cloud-native solution to integrate these hundreds of HR-related systems, normalize their disparate data models and then render that consolidated information for stakeholder decision making has been a substantial undertaking, but one significantly eased by leveraging Ballerina. In this session, we’ll cover:
The overall software architecture for VHR’s Cloud Data Platform
Critical decision points leading to adoption of Ballerina for the CDP
Ballerina’s role in multiple evolutionary steps to the current architecture
Roadmap for the CDP architecture and plans for Ballerina
WSO2’s partnership in bringing continual success for the CD
The integration landscape is changing rapidly with the introduction of technologies like GraphQL, gRPC, stream processing, iPaaS, and platformless. However, not all existing applications and industries can keep up with these new technologies. Certain industries, like manufacturing, logistics, and finance, still rely on well-established EDI-based message formats. Some applications use XML or CSV with file-based communications, while others have strict on premises deployment requirements. This talk focuses on how Ballerina's built-in integration capabilities can bridge the gap between "old" and "new" technologies, modernizing enterprise applications without disrupting business operations.
Platformless Horizons for Digital AdaptabilityWSO2
In this keynote, Asanka Abeysinghe, CTO,WSO2 will explore the shift towards platformless technology ecosystems and their importance in driving digital adaptability and innovation. We will discuss strategies for leveraging decentralized architectures and integrating diverse technologies, with a focus on building resilient, flexible, and future-ready IT infrastructures. We will also highlight WSO2's roadmap, emphasizing our commitment to supporting this transformative journey with our evolving product suite.
Quantum computers are rapidly evolving and are promising significant advantages in domains like machine learning or optimization, to name but a few areas. In this keynote we sketch the underpinnings of quantum computing, show some of the inherent advantages, highlight some application areas, and show how quantum applications are built.
"Impact of front-end architecture on development cost", Viktor TurskyiFwdays
I have heard many times that architecture is not important for the front-end. Also, many times I have seen how developers implement features on the front-end just following the standard rules for a framework and think that this is enough to successfully launch the project, and then the project fails. How to prevent this and what approach to choose? I have launched dozens of complex projects and during the talk we will analyze which approaches have worked for me and which have not.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Search and Society: Reimagining Information Access for Radical FuturesBhaskar Mitra
The field of Information retrieval (IR) is currently undergoing a transformative shift, at least partly due to the emerging applications of generative AI to information access. In this talk, we will deliberate on the sociotechnical implications of generative AI for information access. We will argue that there is both a critical necessity and an exciting opportunity for the IR community to re-center our research agendas on societal needs while dismantling the artificial separation between the work on fairness, accountability, transparency, and ethics in IR and the rest of IR research. Instead of adopting a reactionary strategy of trying to mitigate potential social harms from emerging technologies, the community should aim to proactively set the research agenda for the kinds of systems we should build inspired by diverse explicitly stated sociotechnical imaginaries. The sociotechnical imaginaries that underpin the design and development of information access technologies needs to be explicitly articulated, and we need to develop theories of change in context of these diverse perspectives. Our guiding future imaginaries must be informed by other academic fields, such as democratic theory and critical theory, and should be co-developed with social science scholars, legal scholars, civil rights and social justice activists, and artists, among others.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
2. Source: http://www.businesstimes.com.sg/
Rolls Royce Trent 1000
Analytics data collected in
● Design
● Manufacture
● After-sales
One fan blade manufacturing
-> 0.5 TB of data
Real-time data transmitted
back to RR when planes are
in-flight.
3. Source: http://wallpapercave.com/
Caterpillar
From autonomous mining
trucks to locomotives, they
have sensors monitoring
fuel, idle time, location for
maximum operation
efficiency.
Predictive maintenance has
saved millions from timely
fuel pump replacement to
adjusting ship hull cleaning
intervals in their marine
services.
4. ● What type of data?
● How fast you need results?
● How much data to keep?
● Historical, real-time, or predictive?
● Cloud or fog / edge analytics?
Source: jaxenter.com
5. ● Time related data
○ Time series processing
■ Energy consumption with time
■ Failure prediction
■ Specialized DBs - OpenTSDB
● Location data
○ GPS / iBeacons
○ Used in agriculture
■ Detect soil moisture, crop growth
■ Manage irrigation equipment
○ Traffic planning
■ Monitor vehicle speeds, location for better route suggestions
○ Geospatial optimized processing engines - GeoTrellis
6. Do we need the results instantaneously?, or a few seconds
delay okay?, or else, results after several minutes or more is
fine?
7. ● The most often used processing mode in IoT
○ Immediately take action on some event occurring with the source
devices
■ Send out alerts from a temperature sensor hitting a limit
■ Notification in a car dashboard of low tire pressure
● Generating instant alerts and information based on the data sent by
sensors, requires stream processing. Process events one by one in
real-time to match to a predefined set of rules.
○ Apache Storm as a stream processing engine
■ Scalable and fault tolerant
○ For advanced pattern matching, a full fledged CEP engine can be
used, e.g. WSO2 CEP, Esper etc..
8. ● Long term statistics generations, a batch processing system can be
used: Apache Hadoop, Apache Spark
○ Average temperature in a room in the last month
○ Total power usage of the house in the last year
● Interactive analytics with technologies such as Apache Drill and
indexed storage systems such as Couchbase.
● Most often, we may need to mash-up both batch analytics results with
real-time processing
○ Comparing a long term statistics result with incoming real-time
events for alerts etc..
● Batch operations can be brought together with an indexing system for
real-time analytics to lookup data instantly when required
○ Apache Lucene, WSO2 DAS Analytics / Event Tables
9. ● IoT devices generate high volume or different types of data
● We can decide to process right away when we receive it, and discard it,
or else, keep it for more detailed processing
● Big Data stores gives us the option to store huge amounts of data as
such.
● Purge the data, after the raw data is no longer required
10. ● Hindsight can be achieved by processing historical data, and
understanding what has happened.
○ Batch processing systems such as Apache Hadoop and Apache
Spark is used in this area
○ Data visualization with dashboards, showing related data together
● Insight would be understanding what is happening now
○ Achieved with real-time processing systems
○ Scenario: How are my jet engines performing right now
● Foresight is predicting what is going to happen
○ Achieved with machine learning systems such as Apache Mahout,
Apache Spark MLlib, Microsoft Azure Machine Learning, WSO2 ML
○ Scenario: Predictive maintenance -> time to change specific parts
in my car, service scheduling on an aeroplane
11. … …
● IoT will mean, naturally large amounts of data created, thus large
amount of computation resources are required
● Typical scenario of a centralized analytics server for all devices may not
be feasible all the time
○ Centralized analytics hardware may not be scalable for all the
thousands of devices getting added frequently
○ The network communication will get flooded with analytics chatter
when the device count increases
● Solution: edge analytics, a.k.a, fog analytics
○ Some of the analytics operations are offloaded to the end device
itself or to an immediate gateway, for doing most or some of the
analytics operations required. This creates a scalable infrastructure
for device management in the IoT ecosystem.