Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Hosting open data endpoints at IRCEL-CELINE serving air quality data from the three Belgian regional government measurement networks

147 views

Published on

Presentation by Olav Peeters at the OpenDataDay event 'Towards Clean Air with Open Data'. The event took place at BeCentral in Brussels on Saturday 3 March 2018.

Published in: Data & Analytics
  • Be the first to comment

  • Be the first to like this

Hosting open data endpoints at IRCEL-CELINE serving air quality data from the three Belgian regional government measurement networks

  1. 1. Open data @ IRCEL - CELINE Olav Peeters Belgian Interregional Environment Agency (IRCEL – CELINE)
  2. 2. 03/03/2018 2 Content ● Who are we (IRCEL – CELINE) and what do we do? ● Our spatial data infrastructure (SDI) – OGC download and viewing services ● Shiny webapps with (real-time) data via a REST-api – sensorweb4R – sensorweby ● A Cordova mobile app ● Engaging citizen science initiatives ● Current EU-projects to develop tools for collaboration
  3. 3. 03/03/2018 3 IRCEL – CELINE Intergewestelijke Cel voor het Leefmilieu (IRCEL) Cellule Interrégionale de l'Environnement (CELINE) Belgische Interregionale Umweltagentur (IRCEL - CELINE) Belgian Interregional Environment Agency (IRCEL - CELINE) Cooperation agreement between the three Belgian regions (VMM) Leefmilieu Brussel - Bruxelles Environnement Agence wallonne de l'Air et du Climat (AWAC)
  4. 4. 03/03/2018 4 IRCEL – CELINE The three Belgian networks
  5. 5. 03/03/2018 5 IRCEL – CELINE ● Most important functions of IRCEL - CELINE (air quality): – Continuous forecasts (cf SMOG alert) – Informing the public on air quality (real-time and assessment) – National report under the air quality directive (2004/107/EC) – Enforcing a common scientific basis between monitoring networks – Interregional calibration laboratory – Interregional data processing centre (IDPC) - real-time database ● National Focal Point (Eionet) ● Compilation GHG inventory
  6. 6. 03/03/2018 6 IRCEL – CELINE http://www.irceline.be - Real-time data - All major pollutants (incl. BC) - Forecasts - Information about pollutants - Publications - etc. Integration of OGC-services (download and viewing) into website … and tables with (real-time) data:
  7. 7. 03/03/2018 7 Overview SDI @ IRCEL - CELINE Real-time validated Desktop applications Brussels Environment Viewing services (WMS) Download service (WFS, WCS, SOS, REST-api) Static png, XML, txt, json, etc. AWACVMM geo.irceline.be ETL
  8. 8. 03/03/2018 8 Documentation open data endpoints http://www.irceline.be/en/documentation/open-data https://github.com/irceline/open_data
  9. 9. 03/03/2018 9 Sensor observation services (SOS) http://geo.irceline.be/sos Geographic position Timestamp & measured concentrations (e.g. 24 hours) - Efficient transmission of time series - queryable: Extended for e-reporting since version 4.3.x … an INSPIRE compliant downloading service http://viewer.irceline.be
  10. 10. 03/03/2018 10 Faster data access via a REST-api https://github.com/52North/helgoland https://github.com/52North/series-rest-api As part of the SOS implementation of 52°North http://geo.irceline.be/sos/api/v1/ http://geo.irceline.be/sos/static/doc/api-doc/ (documentation)
  11. 11. 03/03/2018 11 The REST-api http://geo.irceline.be/sos/api/v1/timeseries/6578/getData http://geo.irceline.be/sos/api/v1/stations http://geo.irceline.be/sos/api/v1/search?q=molenbeek See documentation: http://geo.irceline.be/sos/static/doc/api-doc/
  12. 12. 03/03/2018 12 Shiny webapps for advanced interactive R-analyses http://www.openair-project.org A package for R specifically for the air quality community How to integrate the power of R into an SDI? - SOS4R: existing SOAP (xml) based implementation → to slow for longer time series http://shiny.rstudio.com/
  13. 13. 03/03/2018 13 Shiny webapps for advanced interactive R-analyses
  14. 14. 03/03/2018 14 Shiny webapps for advanced interactive R-analyses PollutionRose Select time series (jsClient) scatterPlot (per season, etc.) calendarPlot scatterPlot with model evaluation ScatterPlot (hexbin) http://shiny.irceline.be/examples/
  15. 15. 03/03/2018 15 Shiny webapps for advanced interactive R-analyses ● https://github.com/52North/sensorweb4R ● https://github.com/52North/sensorweby ● http://blog.52north.org/2015/04/22/advanced-time-series-analysis-on-the-web-with-r/ (google “blog sensorweby”) ● You can run this locally in R-Studio or on a remote Shiny server ● Example apps: http://shiny.irceline.be/examples/ ● Better security since there is no direct DB-connection ● REST is still very fast data access
  16. 16. 03/03/2018 16 A mobile app Real-time data Forecasts Multilingual (EN, NL, FR, DE) Interactive data exploration https://github.com/irceline/air-quality-belgium-app New Ionic version (under development): https://github.com/irceline/aq-mobile-be - feels more native
  17. 17. 03/03/2018 17 Hi-resolution modelling (RIO-IFDM) 0 - 10 11 - 15 16 - 20 21 - 25 26 - 30 31 - 35 36 - 40 41 - 45 46 - 50 > 50 microgram/m³ measuring station: colour represents the measured concentration less than 85% data capture Nitrogen dioxide (NO2) annual mean 2014 We are here now
  18. 18. 27/02/2018 18 Hi resolution air quality model + + + RIO background Grid of receptor points Line source emissions Assimilated meteo Point source emissions Hourly RIO-IFDM Air Quality Index IFDM
  19. 19. 03/03/2018 19 New: hi-resolution real-time data See http://www.bumbair.be Available for: BC, O3 , PM10 & PM2.5
  20. 20. 27/02/2018 20 Population exposure - the best population data set for the whole of Belgium: data from Census 2011 (Geostat – a Eurostat project) http://census2011.fgov.be/idk/idk4_nl.html - Bin RIO-IFDM to Geostat grid (mean concentration per grid cell) - exposure calculated every hour for BC, NO2, O3, PM10 & PM2.5 http://www.irceline.be/air/pop_exp_bc.php http://www.irceline.be/air/pop_exp_no2.php http://www.irceline.be/air/pop_exp_o3.php http://www.irceline.be/air/pop_exp_pm10.php http://www.irceline.be/air/pop_exp_pm25.php Under development: XML and Json version
  21. 21. 27/02/2018 21 Web Coverage Service (WCS) http://geo.irceline.be/rioifdm/no2_hmean/wcs/? SERVICE=WCS&REQUEST=GetCoverage&coverageid=rioifdm__no2_hmean&FORMAT=image/tiff &subset=X,http://www.opengis.net/def/crs/EPSG/0/EPSG:31370(108950,138950)&subset=Y,http://w ww.opengis.net/def/crs/EPSG/0/EPSG:31370(108950,138950)&subset=time(%222018-02- 26T09:00:00Z%22)&version=2.0.1 - OGC-standard - Can be used for further processing, e.g. to calculate the healthiest route: http://docs.geoserver.org/latest/en/user/ services/wcs/reference.html - to compare measurement results
  22. 22. 03/03/2018 22 Engaging citizen science initiatives http://www.airsenseur.org/ http://luftdaten.info/ Winsen ZH03A
  23. 23. 03/03/2018 23 Who thinks the gouvernment is hiding something? This is what you measured on Thursday night (01/03/2018 @ 22-23h00)
  24. 24. 03/03/2018 24 Who thinks the gouvernment is hiding something? Adding the measurement data from IRCEL - CELINE
  25. 25. 03/03/2018 25 This is what “the gouverment” was saying
  26. 26. 03/03/2018 26 Measuring air quality is not easy ● Low cost sensors like the SDS011 have a problem with very dry conditions (case Thursday night) ● High relative humidity is also a challenge and it is not easily corrected ● Agreement for PM2.5 with reference monitors is generally better than for PM10 ● For gas sensors (e.g. NO2 , O3 ) the interference of the presence of O3 is difficult to handle ● But don’t worry, the agreement between your SDS011 and the reference monitors was much better on Friday night
  27. 27. 03/03/2018 27 Three EU-projects to facilitate collaboration ● BE-GOOD: the healthiest route API ● CORONA-EU: making the open data endpoints more user friendly, viewers for comparing data from citizen science projects, etc. ● VAQUUMS: evaluating a shortlist of sensors (long term side-by-side comparison), establish a webplatform for comparing data + more advanced analytical tools, “standard operating procedures” for measurements, etc. ● Everything is developed the open source way ● let’s look for synergies, we are here to support
  28. 28. 28 Thank you! Olav Peeters Belgian Interregional Environment Agency (IRCEL – CELINE)

×