Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Sensor SDI in PDOK with Smart Emission Platform

244 views

Published on

Presentation provided at "Geo Gebruikersfestival", okt 31, 2018, Amersfoort, The Netherlands. Sketches how from several Sensor projects the Smart Emission Platform emerged and migrated to the PDOK Platform. How a next step could be be a Dutch national Sensor SDI asa a federated/distributed architecture. Special attention is given to APIs, in particular the SensorThings API.

Published in: Software
  • Be the first to comment

  • Be the first to like this

Sensor SDI in PDOK with Smart Emission Platform

  1. 1. SensorSDI op PDOK met het Smart Emission Data Platform Just van den Broecke Just Objects B.V. Geo Gebruikersfestival 2018 en SDI.Next Amersfoort 31 oktober, 2018 Met dank aan
  2. 2. Context
  3. 3. Sensor Data? • Milieu indicatoren: 
 Lucht, Geluid, Meteo • Geo? Ja! Ruimte en Tijd ==> “Spatiotemporal” • Alle geodata is “Spatiotemporal”! • Relevant? Ja! Van CO2 tot Schiphol • RIVM: “Samenmeten" Project • En ook: INSPIRE
  4. 4. Historie • 2014/2015 - SOSPilot - Geonovum en RIVM
 RIVM LML Data via OGC Sensor Observation Service (SOS)
 http://sensors.geonovum.nl 
 • 2015-2017 - Smart Emission Nijmegen - Consortium
 Burgers meten zelf luchtkwaliteit en geluid
 http://smartemission.ruhosting.nl 
 •2017-2018 - Consolidatie en Opschaling
 Smart City Living Lab (meerdere steden),
 Green Challenge Nijmegen, AirSensEUR (EU JRC)
 SE Platform Migratie naar PDOK - Kadaster
 https://data.smartemission.nl
  5. 5. Inclusive Citizen Sensing ▪ Citizen-sensor-networks for fine-grained measurements, with new low-cost sensing devices ▪ Transparency and democracy of pollution monitoring, ‘making the externalities (e.g. noise, air pollution) visible’ ▪ Cost-effective environmental monitoring with Open Source, Open Data, Open Standards (APIs) Smart Emission Nijmegen
  6. 6. 1. Deployment of a local air quality network using low-cost sensors
 - What is the quality of low-cost sensors in general? - Which type of low cost sensors to deploy? - How to calibrate the low-cost sensors? - How many and at what locations (spatial pattern) to deploy the sensors? - What data platform for data collection and distribution? - Which standards for data acquisition and distribution? - Which (interpolation) models for further processing air quality data? - How to visualize the results? 
 2. Involvement of citizens in the deployment and maintenance of the sensor network
 – Which method to use for citizen engagement? – Do we need to train citizens to deploy and maintain the sensor? 3. Involvement of citizens in the analysis of the results of local air quality monitoring
 – How to engage citizens? – How to preprocess and visualize the data for citizens? – How to interact with citizens? – How and when to meetup with citizens? – What applications will the citizens need? Issues and questions Smart Emission Nijmegen
  7. 7. Which type of low cost sensors to deploy? Quality and price Number of sensors applied in a city Smart Emission “Jose” Aireas “Airbox” “Smart Citizen Kit” National Air Quality stations Smart Emission Nijmegen
  8. 8. Smart Emission Nijmegen
  9. 9. Smart Emission Nijmegen
  10. 10. Smart Emission Platform
  11. 11. Data Management WMS WFS SOS STA Client Apps/Viewers SE Platform The Big Picture web-APIs sensors Collector APIs
  12. 12. Data Collectors Data Processing Platform Data Collectors WMS WFS SOS STA Client Apps SE Platform The Big Picture Decoupling, data push &pull via Data Collectors
  13. 13. Smart 
 Emission Platform WMS WFS SOS STA CityGIS Data Collector Intemo Data Collector InfluxDB Data Collector RIVM LML SOS SOS Influx HTTP Whale API Whale API SOSEmu Harvesters ETL (Current Values) LML Influx HTTP Sensors API API Outbound Inbound Dataflow Smart Emission Platform Dataflow and APIs
  14. 14. Data Processing Platform Data Architecture with 3-Step ETL Postgres/GIS DB + InfluxDB SOS Harvester RIVM SOS InfluxDB InfluxDB
 Harvester Intemo Server
  15. 15. Smart Emission Platform 
 Componenten in Functionele Lagen Web Heron Viewer Smart App 52North SOSViewer Grafana Website data.smartemission.nl Beheer AppServers GeoServer 52North SOS GOST STA Databases PostGIS InfluxDB Processing (ETL) Calibrator Refiner SOS Publisher STA Publisher Harvesters CityGIS Harvester SOS Harvester InfluxDB Harvester
  16. 16. Viewers https://data.smartemission.nl (data platform) Heron Viewer Smart App 52North JSClient Grafana In SE Platform Extern
  17. 17. National Sensor SDI Thoughts
  18. 18. Data Services Sensors API APIs Dataflow National SensorSDI Functional Blocks Data Processing Data Collection Metadata/ Registry - users - sensors - apps - services - … Apps API API API API API API API API
  19. 19. National SensorSDI Principles Distributed (Federated) Architecture follows Organization (and v.v.) Organizational Specialisms Common Standards & APIs Common Open Source Cloud-Based (e.g. Kubernetes)
  20. 20. Data ServicesAPIs Dataflow Data Processor API API API Registry App1 App2 AppN API Data Collector 1 API Data Collector N API
  21. 21. OGC SensorThings API
  22. 22. OGC SensorThings API Showcase Modern Standard (REST) API-based: HTTP Verbs Data Model is First Class Citizen Multiple Implementations (Geo)JSON Encoding Pub/Sub via MQTT GOST SOS-Killer?
  23. 23. SensorThings API Model
  24. 24. SensorThings API Entity Mapping 13:43:26
  25. 25. Links https://data.smartemission.nl (data platform) https://github.com/smartemission (source code) https://smartplatform.readthedocs.io (documentation) https://smartplatform.readthedocs.io/en/latest/evolution.html (SensorSDI) https://geoforum.nl/c/datasets/sensordata (support and comms) https://en.wikipedia.org/wiki/SensorThings_API (SensorThings API, STA) https://www.gostserver.xyz/ (Geodan STA Open Source Implementation) We would like to acknowledge for their valuable input: All partners of the Smart Emission Consortium Dank U!

×