SlideShare a Scribd company logo
1 of 23
Download to read offline
Advanced Open IoT Platform
for Prevention and Early
Detection of Forest Fires
Ivelin Andreev
March 27-29, 2018 (Naples, Italy)
1
2
About me
Software Architect @
16+ years professional experience
Microsoft Azure MVP
External Expert Horizon 2020
External Expert Eurostars-Eureka & IFD
Business Interests
Web Development, SOA, Integration
IoT, Machine Learning
Security & Performance Optimization
Contact
ivelin.andreev@icb.bg
www.linkedin.com/in/ivelin
www.slideshare.net/ivoandreev
Agenda
Objectives
Platform Benefits
Platform Overview
State of the Art
Validation
3
Objectives
 Early detection of forest fires
 Open and interoperable
 Wide range of interfaces, protocols and devices
 Existing Crisis Management Systems (National, EU-level)
 Continuous monitoring of disaster related data
 Retrospective disaster assessment
 New methods for fire detection (AI, drones, sensors)
 Command devices in surrounding area (i.e. barriers)
 Automatic processing and alert generation
 Decision making support
 Cost efficient monitoring
4
Platform Benefits
 Open source and free license components
 Deployment on-premises and public cloud
 Adaptable – multiple abstraction points
 Cutting edge technologies
 AI, Machine Learning, Time Series data, Drones support
 High performance
 30’000+ simultaneous agents/things on node, 1M sensor parameters
 Built with security in mind
 TRL 6 (test in relevant environment)
With sensors, thermal cameras and state of the art AI algorithms,
the platform aims to combine the best approaches
and achieve 10% better fire assessment and prevention.
5
6
ASPires
Distributed & Open
IoT Platform
Funded by
EUROPEAN CIVIL PROTECTION AND
HUMANITARIAN AID OPERATIONS
ECHO/SUB/742906/PREV03 (ASPIRES)
Ingestion Scope
 Field gateway (On-premises)
 Local aggregation point for range of sensors (on-site, drone mounted)
 Features: Device specific protocol conversion (i.e. Lora-Modbus TCP)
 Cloud gateway (On-premises)
 Cross-platform SW gateway based on Azure IoT Edge with 2-way communication
 Features: Buffering, Processing, Protocol adapters (i.e. Profinet, Profibus, OPC, ZigBee…)
 Ingestion hub
 Entry point of the cloud platform (MQTT broker)
 Features: Secure 2-way communication over MQTT and HTTP
7
Cloud Scope
 Stream Processor
 Real-time data simple analytics (i.e. threshold, anomaly detection, data conversion)
 Features: Device specific protocol conversion (i.e. Lora-Modbus TCP)
 Data Persisters
 Data storage engine abstraction (RDBMS, Time Series)
 Features: Read/Write operations on persistence storage
 Data Storage
 Asset Configuration, Raw Data, Time Series Data
 Features: Performance (40x-60x faster than SQL and NoSQL) and TS data functions
 Analyzer services
 Generic and specific pluggable custom logic components
 Features: Asynchronous data processing 8
Consumer Scope
 Platfrom Micro-services
 Open format scalable APIs (GraphQL)
 Features: Identity Management, Data Retrieval & Manipulation, Alerts
 Configuration Portal
 Web application with limited access (i.e. organization administrators)
 Features: Platform configuration and asset management (i.e. GW, sensors, users)
 Presentation and Visualization
 Mobile apps, Web apps, Hybrid apps
 Features: Responsive, administration, dashboarding
 Third Party Platform Integration
 Crisis Management Systems, Recourse Management
 Features: Raw data, trends, analytics and alerts visualization
9
State of the Art
10
Drone Support
 Complement other infrastructure (i.e. towers)
 Rapid deployment almost anywhere
 Sensor data collection (fixed, mobile)
 Visual image and thermography
 Near real-time transmission
 Low cost
 Protocols (ZigBee, WiFi, 3G/4G)
11
Computer Intelligence
 Seas of data are generated by sensors
 How to gain insight on hidden relations?
 How to get actionable results?
 How to make platform provide business value?
 Open issues
 Cameras are diagnostic and not predictive approach
 Thermal cameras cannot detect fire behind hills
 FWI is not able to model hidden relations and thresholds
 Human operators are required
12
Computer Vision (Positive Sample)
13
 Computer intelligence and computer vision could be used for
automated alerting for camera capture
 Works on predefined description tags
 Less operators could control larger area
Computer Vision (Negative Sample)
14
 Computer vision can process low resolution images (VGA)
 Computer vision is capable to distinguish clouds from smoke
 Alerts could be raised based on confidence level
Forest Fire Prediction ML Model
15
 ML model could be used for prediction of
fire state with certain confidence level
 Model features are result of in-depth
analysis of other crisis management systems
 Model consumed as web service from Azure
(ML Studio & Azure Experimentation Service)
Platform Openness
 Open source technologies
 Azure IoT Edge
 Influx DB
 Mosquitto MQTT
 Open protocols
 Inbound & Outbound Interfaces
 Data & Alerts Services
 CMS Systems: EFFIS, MKFFIS
16
Validation
17
Validation Setup
InfluxDB v1.3.0 single node SQL Server 2016 Standard
CPU: Intel Core i7 3.40GHz (quad, 8MB cache)
Memory: 16GB DDR3 1333MHz
OS: Windows 10 Enterprise, 64 bit
SSD: Samsung 850 EVO 250GB
HDD: Seagate 7200RPM, 16MB cache, 500GB
Name Type Indexed
ID (PK) int Yes
TagID int Yes
Value int No
Timestamp DateTime Yes
Name Type
tagID Int Tag Key
value Int Field Key
time DateTime TimeStamp
InfluxDB schema: SQL Server schema:
Write Performance (writes/sec)
0
50000
100000
150000
200000
250000
0 20,000,000 40,000,000 60,000,000 80,000,000 100,000,000
Influx
Insertspersecond
• Influx average write speed of 200,000 writes/second
• SQL Server average write speed of 5,000-8,000 writes/second
• Memory optimized tables increases write performance by 1.4x
• Write trend unaffected by the amount of data (in this volumes)
• Influx outperforms SQL Server 40x
0
1000
2000
3000
4000
5000
6000
7000
8000
9000
0 20,000,000 40,000,000 60,000,000 80,000,000 100,000,000
SQL In-Memory OLTP
Disk Storage
• 27% improvement is SQL Server page compression is enabled (1883MB)
• Influx has 19x-26x less disk requirements for the same functionality
2579MB
98MB
0
500
1000
1500
2000
2500
3000
On-Disk Storage
SQL Server
Influx
DiskSpaceUsed(megabytes)DiskSpaceUsed(megabytes)
Read Performance (queries/sec)
0
500
1000
1500
2000
2500
3000
3500
4000
1 2 4 8
InfluxDB
SQL Server
QueriesperSecond
Concurrency
Benchmark query:
Aggregate samples of 10,000 points, average over 1,000 runs.
• SQL Server mean query response time – 78ms (13 queries/sec)
• Influx mean query response time – 1,3ms (769 queries/sec)
• Influx has 59x better query throughput than SQL Server
Read Performance (rows at a time)
• SQL Server relatively unaffected by SSD (due to caching)
• Influx performance improves up to 100% on SSD, chunk size 10’000
• SQL Server is up to 2x better on HDD (Influx is better up to 600K)
• Relatively equal on SSD (Influx is better up to 1.6M)
0
500,000
1,000,000
1,500,000
2,000,000
2,500,000
3,000,000
3,500,000
0 5 10 15 20 25 30
HDD Performance
SQL Influx
Queriedresults
Seconds to execute (lower is better)
0
500,000
1,000,000
1,500,000
2,000,000
2,500,000
3,000,000
3,500,000
0 5 10 15 20 25 30
SSD Performance
SQL Influx
Seconds to execute (lower is better)
Thank You!
23

More Related Content

What's hot

Autoencoder Forest for Anomaly Detection from IoT Time Series
Autoencoder Forest for Anomaly Detection from IoT Time SeriesAutoencoder Forest for Anomaly Detection from IoT Time Series
Autoencoder Forest for Anomaly Detection from IoT Time SeriesYiqun Hu
 
Accelerating algorithmic and hardware advancements for power efficient on-dev...
Accelerating algorithmic and hardware advancements for power efficient on-dev...Accelerating algorithmic and hardware advancements for power efficient on-dev...
Accelerating algorithmic and hardware advancements for power efficient on-dev...Qualcomm Research
 
“Case Study: Facial Detection and Recognition for Always-On Applications,” a ...
“Case Study: Facial Detection and Recognition for Always-On Applications,” a ...“Case Study: Facial Detection and Recognition for Always-On Applications,” a ...
“Case Study: Facial Detection and Recognition for Always-On Applications,” a ...Edge AI and Vision Alliance
 
Enabling Power-Efficient AI Through Quantization
Enabling Power-Efficient AI Through QuantizationEnabling Power-Efficient AI Through Quantization
Enabling Power-Efficient AI Through QuantizationQualcomm Research
 
“Getting Started with Vision AI Model Training,” a Presentation from NVIDIA
“Getting Started with Vision AI Model Training,” a Presentation from NVIDIA“Getting Started with Vision AI Model Training,” a Presentation from NVIDIA
“Getting Started with Vision AI Model Training,” a Presentation from NVIDIAEdge AI and Vision Alliance
 
Final Presentation Andy Rosales (1) (1)
Final Presentation Andy Rosales (1) (1)Final Presentation Andy Rosales (1) (1)
Final Presentation Andy Rosales (1) (1)Andy Rosales-Elias
 

What's hot (6)

Autoencoder Forest for Anomaly Detection from IoT Time Series
Autoencoder Forest for Anomaly Detection from IoT Time SeriesAutoencoder Forest for Anomaly Detection from IoT Time Series
Autoencoder Forest for Anomaly Detection from IoT Time Series
 
Accelerating algorithmic and hardware advancements for power efficient on-dev...
Accelerating algorithmic and hardware advancements for power efficient on-dev...Accelerating algorithmic and hardware advancements for power efficient on-dev...
Accelerating algorithmic and hardware advancements for power efficient on-dev...
 
“Case Study: Facial Detection and Recognition for Always-On Applications,” a ...
“Case Study: Facial Detection and Recognition for Always-On Applications,” a ...“Case Study: Facial Detection and Recognition for Always-On Applications,” a ...
“Case Study: Facial Detection and Recognition for Always-On Applications,” a ...
 
Enabling Power-Efficient AI Through Quantization
Enabling Power-Efficient AI Through QuantizationEnabling Power-Efficient AI Through Quantization
Enabling Power-Efficient AI Through Quantization
 
“Getting Started with Vision AI Model Training,” a Presentation from NVIDIA
“Getting Started with Vision AI Model Training,” a Presentation from NVIDIA“Getting Started with Vision AI Model Training,” a Presentation from NVIDIA
“Getting Started with Vision AI Model Training,” a Presentation from NVIDIA
 
Final Presentation Andy Rosales (1) (1)
Final Presentation Andy Rosales (1) (1)Final Presentation Andy Rosales (1) (1)
Final Presentation Andy Rosales (1) (1)
 

Similar to Advanced Open IoT Platform for Prevention and Early Detection of Forest Fires

MindSphere: The cloud-based, open IoT operating system. Damiano Manocchia
MindSphere: The cloud-based, open IoT operating system. Damiano ManocchiaMindSphere: The cloud-based, open IoT operating system. Damiano Manocchia
MindSphere: The cloud-based, open IoT operating system. Damiano ManocchiaData Driven Innovation
 
Java in the Air: A Case Study for Java-based Environment Monitoring Stations
Java in the Air: A Case Study for Java-based Environment Monitoring StationsJava in the Air: A Case Study for Java-based Environment Monitoring Stations
Java in the Air: A Case Study for Java-based Environment Monitoring StationsEurotech
 
People Counting: Internet of Things in Motion at JavaOne 2013
People Counting: Internet of Things in Motion at JavaOne 2013People Counting: Internet of Things in Motion at JavaOne 2013
People Counting: Internet of Things in Motion at JavaOne 2013Eurotech
 
IoT Analytics from Edge to Cloud - using IBM Informix
IoT Analytics from Edge to Cloud - using IBM InformixIoT Analytics from Edge to Cloud - using IBM Informix
IoT Analytics from Edge to Cloud - using IBM InformixPradeep Muthalpuredathe
 
2016-09-eclipse-iot-cf-summit
2016-09-eclipse-iot-cf-summit2016-09-eclipse-iot-cf-summit
2016-09-eclipse-iot-cf-summitMike Milinkovich
 
Implementing Private Clouds
Implementing Private CloudsImplementing Private Clouds
Implementing Private CloudsJohn Pritchard
 
Windows iot barone
Windows iot baroneWindows iot barone
Windows iot baroneDotNetCampus
 
MICROSOFT E IL MONDO IOT
MICROSOFT E IL MONDO IOTMICROSOFT E IL MONDO IOT
MICROSOFT E IL MONDO IOTDotNetCampus
 
Azure and Predix
Azure and PredixAzure and Predix
Azure and PredixAltoros
 
eMagic : A Complete Datacenter Management Suite
eMagic : A Complete Datacenter Management SuiteeMagic : A Complete Datacenter Management Suite
eMagic : A Complete Datacenter Management SuiteRaj Gire
 
Intelligent Monitoring
Intelligent MonitoringIntelligent Monitoring
Intelligent MonitoringIntelie
 
45days-embedded-systems-and-iot.pdf
45days-embedded-systems-and-iot.pdf45days-embedded-systems-and-iot.pdf
45days-embedded-systems-and-iot.pdfcbecuk23
 
Tiarrah Computing: The Next Generation of Computing
Tiarrah Computing: The Next Generation of ComputingTiarrah Computing: The Next Generation of Computing
Tiarrah Computing: The Next Generation of ComputingIJECEIAES
 
Horizontal Scaling for Millions of Customers!
Horizontal Scaling for Millions of Customers! Horizontal Scaling for Millions of Customers!
Horizontal Scaling for Millions of Customers! elangovans
 
Cloud computingintroduction
Cloud computingintroductionCloud computingintroduction
Cloud computingintroductionKhelender Sasan
 

Similar to Advanced Open IoT Platform for Prevention and Early Detection of Forest Fires (20)

MindSphere: The cloud-based, open IoT operating system. Damiano Manocchia
MindSphere: The cloud-based, open IoT operating system. Damiano ManocchiaMindSphere: The cloud-based, open IoT operating system. Damiano Manocchia
MindSphere: The cloud-based, open IoT operating system. Damiano Manocchia
 
Introduction To Cloud Computing
Introduction To Cloud ComputingIntroduction To Cloud Computing
Introduction To Cloud Computing
 
Java in the Air: A Case Study for Java-based Environment Monitoring Stations
Java in the Air: A Case Study for Java-based Environment Monitoring StationsJava in the Air: A Case Study for Java-based Environment Monitoring Stations
Java in the Air: A Case Study for Java-based Environment Monitoring Stations
 
People Counting: Internet of Things in Motion at JavaOne 2013
People Counting: Internet of Things in Motion at JavaOne 2013People Counting: Internet of Things in Motion at JavaOne 2013
People Counting: Internet of Things in Motion at JavaOne 2013
 
IoT Analytics from Edge to Cloud - using IBM Informix
IoT Analytics from Edge to Cloud - using IBM InformixIoT Analytics from Edge to Cloud - using IBM Informix
IoT Analytics from Edge to Cloud - using IBM Informix
 
2016-09-eclipse-iot-cf-summit
2016-09-eclipse-iot-cf-summit2016-09-eclipse-iot-cf-summit
2016-09-eclipse-iot-cf-summit
 
Database as a Service - Tutorial @ICDE 2010
Database as a Service - Tutorial @ICDE 2010Database as a Service - Tutorial @ICDE 2010
Database as a Service - Tutorial @ICDE 2010
 
OracleOEP-EWebcast
OracleOEP-EWebcastOracleOEP-EWebcast
OracleOEP-EWebcast
 
Implementing Private Clouds
Implementing Private CloudsImplementing Private Clouds
Implementing Private Clouds
 
Windows iot barone
Windows iot baroneWindows iot barone
Windows iot barone
 
MICROSOFT E IL MONDO IOT
MICROSOFT E IL MONDO IOTMICROSOFT E IL MONDO IOT
MICROSOFT E IL MONDO IOT
 
Azure and Predix
Azure and PredixAzure and Predix
Azure and Predix
 
eMagic : A Complete Datacenter Management Suite
eMagic : A Complete Datacenter Management SuiteeMagic : A Complete Datacenter Management Suite
eMagic : A Complete Datacenter Management Suite
 
DataPalooza: ML & IoT Workshop
DataPalooza: ML & IoT WorkshopDataPalooza: ML & IoT Workshop
DataPalooza: ML & IoT Workshop
 
Intelligent Monitoring
Intelligent MonitoringIntelligent Monitoring
Intelligent Monitoring
 
45days-embedded-systems-and-iot.pdf
45days-embedded-systems-and-iot.pdf45days-embedded-systems-and-iot.pdf
45days-embedded-systems-and-iot.pdf
 
Tiarrah Computing: The Next Generation of Computing
Tiarrah Computing: The Next Generation of ComputingTiarrah Computing: The Next Generation of Computing
Tiarrah Computing: The Next Generation of Computing
 
Horizontal Scaling for Millions of Customers!
Horizontal Scaling for Millions of Customers! Horizontal Scaling for Millions of Customers!
Horizontal Scaling for Millions of Customers!
 
IoT meets Big Data
IoT meets Big DataIoT meets Big Data
IoT meets Big Data
 
Cloud computingintroduction
Cloud computingintroductionCloud computingintroduction
Cloud computingintroduction
 

More from Ivo Andreev

Cybersecurity and Generative AI - for Good and Bad vol.2
Cybersecurity and Generative AI - for Good and Bad vol.2Cybersecurity and Generative AI - for Good and Bad vol.2
Cybersecurity and Generative AI - for Good and Bad vol.2Ivo Andreev
 
Architecting AI Solutions in Azure for Business
Architecting AI Solutions in Azure for BusinessArchitecting AI Solutions in Azure for Business
Architecting AI Solutions in Azure for BusinessIvo Andreev
 
Cybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and BadCybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and BadIvo Andreev
 
JS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AIJS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AIIvo Andreev
 
How do OpenAI GPT Models Work - Misconceptions and Tips for Developers
How do OpenAI GPT Models Work - Misconceptions and Tips for DevelopersHow do OpenAI GPT Models Work - Misconceptions and Tips for Developers
How do OpenAI GPT Models Work - Misconceptions and Tips for DevelopersIvo Andreev
 
OpenAI GPT in Depth - Questions and Misconceptions
OpenAI GPT in Depth - Questions and MisconceptionsOpenAI GPT in Depth - Questions and Misconceptions
OpenAI GPT in Depth - Questions and MisconceptionsIvo Andreev
 
Cutting Edge Computer Vision for Everyone
Cutting Edge Computer Vision for EveryoneCutting Edge Computer Vision for Everyone
Cutting Edge Computer Vision for EveryoneIvo Andreev
 
Collecting and Analysing Spaceborn Data
Collecting and Analysing Spaceborn DataCollecting and Analysing Spaceborn Data
Collecting and Analysing Spaceborn DataIvo Andreev
 
Collecting and Analysing Satellite Data with Azure Orbital
Collecting and Analysing Satellite Data with Azure OrbitalCollecting and Analysing Satellite Data with Azure Orbital
Collecting and Analysing Satellite Data with Azure OrbitalIvo Andreev
 
Language Studio and Custom Models
Language Studio and Custom ModelsLanguage Studio and Custom Models
Language Studio and Custom ModelsIvo Andreev
 
CosmosDB for IoT Scenarios
CosmosDB for IoT ScenariosCosmosDB for IoT Scenarios
CosmosDB for IoT ScenariosIvo Andreev
 
Forecasting time series powerful and simple
Forecasting time series powerful and simpleForecasting time series powerful and simple
Forecasting time series powerful and simpleIvo Andreev
 
Constrained Optimization with Genetic Algorithms and Project Bonsai
Constrained Optimization with Genetic Algorithms and Project BonsaiConstrained Optimization with Genetic Algorithms and Project Bonsai
Constrained Optimization with Genetic Algorithms and Project BonsaiIvo Andreev
 
Azure security guidelines for developers
Azure security guidelines for developers Azure security guidelines for developers
Azure security guidelines for developers Ivo Andreev
 
Autonomous Machines with Project Bonsai
Autonomous Machines with Project BonsaiAutonomous Machines with Project Bonsai
Autonomous Machines with Project BonsaiIvo Andreev
 
Global azure virtual 2021 - Azure Lighthouse
Global azure virtual 2021 - Azure LighthouseGlobal azure virtual 2021 - Azure Lighthouse
Global azure virtual 2021 - Azure LighthouseIvo Andreev
 
Flux QL - Nexgen Management of Time Series Inspired by JS
Flux QL - Nexgen Management of Time Series Inspired by JSFlux QL - Nexgen Management of Time Series Inspired by JS
Flux QL - Nexgen Management of Time Series Inspired by JSIvo Andreev
 
Azure architecture design patterns - proven solutions to common challenges
Azure architecture design patterns - proven solutions to common challengesAzure architecture design patterns - proven solutions to common challenges
Azure architecture design patterns - proven solutions to common challengesIvo Andreev
 
Industrial IoT on Azure
Industrial IoT on AzureIndustrial IoT on Azure
Industrial IoT on AzureIvo Andreev
 
The Power of Auto ML and How Does it Work
The Power of Auto ML and How Does it WorkThe Power of Auto ML and How Does it Work
The Power of Auto ML and How Does it WorkIvo Andreev
 

More from Ivo Andreev (20)

Cybersecurity and Generative AI - for Good and Bad vol.2
Cybersecurity and Generative AI - for Good and Bad vol.2Cybersecurity and Generative AI - for Good and Bad vol.2
Cybersecurity and Generative AI - for Good and Bad vol.2
 
Architecting AI Solutions in Azure for Business
Architecting AI Solutions in Azure for BusinessArchitecting AI Solutions in Azure for Business
Architecting AI Solutions in Azure for Business
 
Cybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and BadCybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and Bad
 
JS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AIJS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AI
 
How do OpenAI GPT Models Work - Misconceptions and Tips for Developers
How do OpenAI GPT Models Work - Misconceptions and Tips for DevelopersHow do OpenAI GPT Models Work - Misconceptions and Tips for Developers
How do OpenAI GPT Models Work - Misconceptions and Tips for Developers
 
OpenAI GPT in Depth - Questions and Misconceptions
OpenAI GPT in Depth - Questions and MisconceptionsOpenAI GPT in Depth - Questions and Misconceptions
OpenAI GPT in Depth - Questions and Misconceptions
 
Cutting Edge Computer Vision for Everyone
Cutting Edge Computer Vision for EveryoneCutting Edge Computer Vision for Everyone
Cutting Edge Computer Vision for Everyone
 
Collecting and Analysing Spaceborn Data
Collecting and Analysing Spaceborn DataCollecting and Analysing Spaceborn Data
Collecting and Analysing Spaceborn Data
 
Collecting and Analysing Satellite Data with Azure Orbital
Collecting and Analysing Satellite Data with Azure OrbitalCollecting and Analysing Satellite Data with Azure Orbital
Collecting and Analysing Satellite Data with Azure Orbital
 
Language Studio and Custom Models
Language Studio and Custom ModelsLanguage Studio and Custom Models
Language Studio and Custom Models
 
CosmosDB for IoT Scenarios
CosmosDB for IoT ScenariosCosmosDB for IoT Scenarios
CosmosDB for IoT Scenarios
 
Forecasting time series powerful and simple
Forecasting time series powerful and simpleForecasting time series powerful and simple
Forecasting time series powerful and simple
 
Constrained Optimization with Genetic Algorithms and Project Bonsai
Constrained Optimization with Genetic Algorithms and Project BonsaiConstrained Optimization with Genetic Algorithms and Project Bonsai
Constrained Optimization with Genetic Algorithms and Project Bonsai
 
Azure security guidelines for developers
Azure security guidelines for developers Azure security guidelines for developers
Azure security guidelines for developers
 
Autonomous Machines with Project Bonsai
Autonomous Machines with Project BonsaiAutonomous Machines with Project Bonsai
Autonomous Machines with Project Bonsai
 
Global azure virtual 2021 - Azure Lighthouse
Global azure virtual 2021 - Azure LighthouseGlobal azure virtual 2021 - Azure Lighthouse
Global azure virtual 2021 - Azure Lighthouse
 
Flux QL - Nexgen Management of Time Series Inspired by JS
Flux QL - Nexgen Management of Time Series Inspired by JSFlux QL - Nexgen Management of Time Series Inspired by JS
Flux QL - Nexgen Management of Time Series Inspired by JS
 
Azure architecture design patterns - proven solutions to common challenges
Azure architecture design patterns - proven solutions to common challengesAzure architecture design patterns - proven solutions to common challenges
Azure architecture design patterns - proven solutions to common challenges
 
Industrial IoT on Azure
Industrial IoT on AzureIndustrial IoT on Azure
Industrial IoT on Azure
 
The Power of Auto ML and How Does it Work
The Power of Auto ML and How Does it WorkThe Power of Auto ML and How Does it Work
The Power of Auto ML and How Does it Work
 

Recently uploaded

The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdfThe Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdfkalichargn70th171
 
The Evolution of Karaoke From Analog to App.pdf
The Evolution of Karaoke From Analog to App.pdfThe Evolution of Karaoke From Analog to App.pdf
The Evolution of Karaoke From Analog to App.pdfPower Karaoke
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...gurkirankumar98700
 
XpertSolvers: Your Partner in Building Innovative Software Solutions
XpertSolvers: Your Partner in Building Innovative Software SolutionsXpertSolvers: Your Partner in Building Innovative Software Solutions
XpertSolvers: Your Partner in Building Innovative Software SolutionsMehedi Hasan Shohan
 
Unit 1.1 Excite Part 1, class 9, cbse...
Unit 1.1 Excite Part 1, class 9, cbse...Unit 1.1 Excite Part 1, class 9, cbse...
Unit 1.1 Excite Part 1, class 9, cbse...aditisharan08
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantAxelRicardoTrocheRiq
 
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...soniya singh
 
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEBATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEOrtus Solutions, Corp
 
why an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfwhy an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfjoe51371421
 
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxHand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxbodapatigopi8531
 
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer DataAdobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer DataBradBedford3
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsAlberto González Trastoy
 
Project Based Learning (A.I).pptx detail explanation
Project Based Learning (A.I).pptx detail explanationProject Based Learning (A.I).pptx detail explanation
Project Based Learning (A.I).pptx detail explanationkaushalgiri8080
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...Christina Lin
 
What is Binary Language? Computer Number Systems
What is Binary Language?  Computer Number SystemsWhat is Binary Language?  Computer Number Systems
What is Binary Language? Computer Number SystemsJheuzeDellosa
 
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝soniya singh
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...ICS
 
Cloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStackCloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStackVICTOR MAESTRE RAMIREZ
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityNeo4j
 

Recently uploaded (20)

The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdfThe Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
 
The Evolution of Karaoke From Analog to App.pdf
The Evolution of Karaoke From Analog to App.pdfThe Evolution of Karaoke From Analog to App.pdf
The Evolution of Karaoke From Analog to App.pdf
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
 
XpertSolvers: Your Partner in Building Innovative Software Solutions
XpertSolvers: Your Partner in Building Innovative Software SolutionsXpertSolvers: Your Partner in Building Innovative Software Solutions
XpertSolvers: Your Partner in Building Innovative Software Solutions
 
Unit 1.1 Excite Part 1, class 9, cbse...
Unit 1.1 Excite Part 1, class 9, cbse...Unit 1.1 Excite Part 1, class 9, cbse...
Unit 1.1 Excite Part 1, class 9, cbse...
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service Consultant
 
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
 
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEBATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
 
why an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfwhy an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdf
 
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxHand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptx
 
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer DataAdobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
 
Project Based Learning (A.I).pptx detail explanation
Project Based Learning (A.I).pptx detail explanationProject Based Learning (A.I).pptx detail explanation
Project Based Learning (A.I).pptx detail explanation
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
 
What is Binary Language? Computer Number Systems
What is Binary Language?  Computer Number SystemsWhat is Binary Language?  Computer Number Systems
What is Binary Language? Computer Number Systems
 
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
Call Girls In Mukherjee Nagar 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
Call Girls In Mukherjee Nagar 📱  9999965857  🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...Call Girls In Mukherjee Nagar 📱  9999965857  🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
Call Girls In Mukherjee Nagar 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
 
Cloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStackCloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStack
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered Sustainability
 

Advanced Open IoT Platform for Prevention and Early Detection of Forest Fires

  • 1. Advanced Open IoT Platform for Prevention and Early Detection of Forest Fires Ivelin Andreev March 27-29, 2018 (Naples, Italy) 1
  • 2. 2 About me Software Architect @ 16+ years professional experience Microsoft Azure MVP External Expert Horizon 2020 External Expert Eurostars-Eureka & IFD Business Interests Web Development, SOA, Integration IoT, Machine Learning Security & Performance Optimization Contact ivelin.andreev@icb.bg www.linkedin.com/in/ivelin www.slideshare.net/ivoandreev
  • 4. Objectives  Early detection of forest fires  Open and interoperable  Wide range of interfaces, protocols and devices  Existing Crisis Management Systems (National, EU-level)  Continuous monitoring of disaster related data  Retrospective disaster assessment  New methods for fire detection (AI, drones, sensors)  Command devices in surrounding area (i.e. barriers)  Automatic processing and alert generation  Decision making support  Cost efficient monitoring 4
  • 5. Platform Benefits  Open source and free license components  Deployment on-premises and public cloud  Adaptable – multiple abstraction points  Cutting edge technologies  AI, Machine Learning, Time Series data, Drones support  High performance  30’000+ simultaneous agents/things on node, 1M sensor parameters  Built with security in mind  TRL 6 (test in relevant environment) With sensors, thermal cameras and state of the art AI algorithms, the platform aims to combine the best approaches and achieve 10% better fire assessment and prevention. 5
  • 6. 6 ASPires Distributed & Open IoT Platform Funded by EUROPEAN CIVIL PROTECTION AND HUMANITARIAN AID OPERATIONS ECHO/SUB/742906/PREV03 (ASPIRES)
  • 7. Ingestion Scope  Field gateway (On-premises)  Local aggregation point for range of sensors (on-site, drone mounted)  Features: Device specific protocol conversion (i.e. Lora-Modbus TCP)  Cloud gateway (On-premises)  Cross-platform SW gateway based on Azure IoT Edge with 2-way communication  Features: Buffering, Processing, Protocol adapters (i.e. Profinet, Profibus, OPC, ZigBee…)  Ingestion hub  Entry point of the cloud platform (MQTT broker)  Features: Secure 2-way communication over MQTT and HTTP 7
  • 8. Cloud Scope  Stream Processor  Real-time data simple analytics (i.e. threshold, anomaly detection, data conversion)  Features: Device specific protocol conversion (i.e. Lora-Modbus TCP)  Data Persisters  Data storage engine abstraction (RDBMS, Time Series)  Features: Read/Write operations on persistence storage  Data Storage  Asset Configuration, Raw Data, Time Series Data  Features: Performance (40x-60x faster than SQL and NoSQL) and TS data functions  Analyzer services  Generic and specific pluggable custom logic components  Features: Asynchronous data processing 8
  • 9. Consumer Scope  Platfrom Micro-services  Open format scalable APIs (GraphQL)  Features: Identity Management, Data Retrieval & Manipulation, Alerts  Configuration Portal  Web application with limited access (i.e. organization administrators)  Features: Platform configuration and asset management (i.e. GW, sensors, users)  Presentation and Visualization  Mobile apps, Web apps, Hybrid apps  Features: Responsive, administration, dashboarding  Third Party Platform Integration  Crisis Management Systems, Recourse Management  Features: Raw data, trends, analytics and alerts visualization 9
  • 10. State of the Art 10
  • 11. Drone Support  Complement other infrastructure (i.e. towers)  Rapid deployment almost anywhere  Sensor data collection (fixed, mobile)  Visual image and thermography  Near real-time transmission  Low cost  Protocols (ZigBee, WiFi, 3G/4G) 11
  • 12. Computer Intelligence  Seas of data are generated by sensors  How to gain insight on hidden relations?  How to get actionable results?  How to make platform provide business value?  Open issues  Cameras are diagnostic and not predictive approach  Thermal cameras cannot detect fire behind hills  FWI is not able to model hidden relations and thresholds  Human operators are required 12
  • 13. Computer Vision (Positive Sample) 13  Computer intelligence and computer vision could be used for automated alerting for camera capture  Works on predefined description tags  Less operators could control larger area
  • 14. Computer Vision (Negative Sample) 14  Computer vision can process low resolution images (VGA)  Computer vision is capable to distinguish clouds from smoke  Alerts could be raised based on confidence level
  • 15. Forest Fire Prediction ML Model 15  ML model could be used for prediction of fire state with certain confidence level  Model features are result of in-depth analysis of other crisis management systems  Model consumed as web service from Azure (ML Studio & Azure Experimentation Service)
  • 16. Platform Openness  Open source technologies  Azure IoT Edge  Influx DB  Mosquitto MQTT  Open protocols  Inbound & Outbound Interfaces  Data & Alerts Services  CMS Systems: EFFIS, MKFFIS 16
  • 18. Validation Setup InfluxDB v1.3.0 single node SQL Server 2016 Standard CPU: Intel Core i7 3.40GHz (quad, 8MB cache) Memory: 16GB DDR3 1333MHz OS: Windows 10 Enterprise, 64 bit SSD: Samsung 850 EVO 250GB HDD: Seagate 7200RPM, 16MB cache, 500GB Name Type Indexed ID (PK) int Yes TagID int Yes Value int No Timestamp DateTime Yes Name Type tagID Int Tag Key value Int Field Key time DateTime TimeStamp InfluxDB schema: SQL Server schema:
  • 19. Write Performance (writes/sec) 0 50000 100000 150000 200000 250000 0 20,000,000 40,000,000 60,000,000 80,000,000 100,000,000 Influx Insertspersecond • Influx average write speed of 200,000 writes/second • SQL Server average write speed of 5,000-8,000 writes/second • Memory optimized tables increases write performance by 1.4x • Write trend unaffected by the amount of data (in this volumes) • Influx outperforms SQL Server 40x 0 1000 2000 3000 4000 5000 6000 7000 8000 9000 0 20,000,000 40,000,000 60,000,000 80,000,000 100,000,000 SQL In-Memory OLTP
  • 20. Disk Storage • 27% improvement is SQL Server page compression is enabled (1883MB) • Influx has 19x-26x less disk requirements for the same functionality 2579MB 98MB 0 500 1000 1500 2000 2500 3000 On-Disk Storage SQL Server Influx DiskSpaceUsed(megabytes)DiskSpaceUsed(megabytes)
  • 21. Read Performance (queries/sec) 0 500 1000 1500 2000 2500 3000 3500 4000 1 2 4 8 InfluxDB SQL Server QueriesperSecond Concurrency Benchmark query: Aggregate samples of 10,000 points, average over 1,000 runs. • SQL Server mean query response time – 78ms (13 queries/sec) • Influx mean query response time – 1,3ms (769 queries/sec) • Influx has 59x better query throughput than SQL Server
  • 22. Read Performance (rows at a time) • SQL Server relatively unaffected by SSD (due to caching) • Influx performance improves up to 100% on SSD, chunk size 10’000 • SQL Server is up to 2x better on HDD (Influx is better up to 600K) • Relatively equal on SSD (Influx is better up to 1.6M) 0 500,000 1,000,000 1,500,000 2,000,000 2,500,000 3,000,000 3,500,000 0 5 10 15 20 25 30 HDD Performance SQL Influx Queriedresults Seconds to execute (lower is better) 0 500,000 1,000,000 1,500,000 2,000,000 2,500,000 3,000,000 3,500,000 0 5 10 15 20 25 30 SSD Performance SQL Influx Seconds to execute (lower is better)