Hosting open data endpoints at IRCEL-CELINE serving air quality data from the three Belgian regional government measurement networks
Mar. 5, 2018•0 likes•807 views
Download to read offline
Report
Data & Analytics
Presentation by Olav Peeters at the OpenDataDay event 'Towards Clean Air with Open Data'. The event took place at BeCentral in Brussels on Saturday 3 March 2018.
Hosting open data endpoints at IRCEL-CELINE serving air quality data from the three Belgian regional government measurement networks
1. Open data @ IRCEL - CELINE
Olav Peeters
Belgian Interregional Environment Agency (IRCEL – CELINE)
2. 03/03/2018 2
Content
●
Who are we (IRCEL – CELINE) and what do we do?
●
Our spatial data infrastructure (SDI)
– OGC download and viewing services
●
Shiny webapps with (real-time) data via a REST-api
– sensorweb4R
– sensorweby
●
A Cordova mobile app
●
Engaging citizen science initiatives
●
Current EU-projects to develop tools for collaboration
3. 03/03/2018 3
IRCEL – CELINE
Intergewestelijke Cel voor het Leefmilieu (IRCEL)
Cellule Interrégionale de l'Environnement (CELINE)
Belgische Interregionale Umweltagentur (IRCEL - CELINE)
Belgian Interregional Environment Agency (IRCEL - CELINE)
Cooperation agreement between the three Belgian regions
(VMM) Leefmilieu Brussel -
Bruxelles Environnement
Agence wallonne de l'Air et du
Climat (AWAC)
5. 03/03/2018 5
IRCEL – CELINE
●
Most important functions of IRCEL - CELINE (air quality):
– Continuous forecasts (cf SMOG alert)
– Informing the public on air quality (real-time and assessment)
– National report under the air quality directive (2004/107/EC)
– Enforcing a common scientific basis between monitoring networks
– Interregional calibration laboratory
– Interregional data processing centre (IDPC) - real-time database
●
National Focal Point (Eionet)
●
Compilation GHG inventory
6. 03/03/2018 6
IRCEL – CELINE
http://www.irceline.be
- Real-time data
- All major pollutants
(incl. BC)
- Forecasts
- Information about
pollutants
- Publications
- etc.
Integration of OGC-services
(download and viewing)
into website
… and tables with (real-time) data:
8. 03/03/2018 8
Documentation open data endpoints
http://www.irceline.be/en/documentation/open-data
https://github.com/irceline/open_data
9. 03/03/2018 9
Sensor observation services (SOS)
http://geo.irceline.be/sos
Geographic position
Timestamp & measured concentrations (e.g. 24 hours)
- Efficient transmission of time series
- queryable:
Extended for
e-reporting
since version
4.3.x
… an INSPIRE compliant downloading service
http://viewer.irceline.be
10. 03/03/2018 10
Faster data access via a REST-api
https://github.com/52North/helgoland
https://github.com/52North/series-rest-api
As part of the SOS
implementation of 52°North
http://geo.irceline.be/sos/api/v1/
http://geo.irceline.be/sos/static/doc/api-doc/ (documentation)
12. 03/03/2018 12
Shiny webapps for advanced interactive
R-analyses
http://www.openair-project.org A package for R specifically for the
air quality community
How to integrate the power of R into
an SDI?
- SOS4R: existing SOAP (xml) based
implementation → to slow for longer
time series
http://shiny.rstudio.com/
14. 03/03/2018 14
Shiny webapps for advanced interactive
R-analyses
PollutionRose Select time series (jsClient)
scatterPlot (per season, etc.)
calendarPlot
scatterPlot with
model evaluation
ScatterPlot (hexbin)
http://shiny.irceline.be/examples/
15. 03/03/2018 15
Shiny webapps for advanced interactive
R-analyses
●
https://github.com/52North/sensorweb4R
●
https://github.com/52North/sensorweby
●
http://blog.52north.org/2015/04/22/advanced-time-series-analysis-on-the-web-with-r/
(google “blog sensorweby”)
●
You can run this locally in R-Studio or on a remote Shiny
server
●
Example apps: http://shiny.irceline.be/examples/
●
Better security since there is no direct DB-connection
●
REST is still very fast data access
16. 03/03/2018 16
A mobile app
Real-time data Forecasts
Multilingual (EN, NL, FR, DE)
Interactive data exploration
https://github.com/irceline/air-quality-belgium-app
New Ionic version (under development):
https://github.com/irceline/aq-mobile-be
- feels more native
17. 03/03/2018 17
Hi-resolution modelling (RIO-IFDM)
0 - 10
11 - 15
16 - 20
21 - 25
26 - 30
31 - 35
36 - 40
41 - 45
46 - 50
> 50
microgram/m³
measuring station:
colour represents
the measured
concentration
less than 85%
data capture
Nitrogen dioxide
(NO2)
annual mean 2014
We are here
now
18. 27/02/2018 18
Hi resolution air quality model
+ +
+
RIO
background
Grid of receptor
points
Line source
emissions
Assimilated meteo
Point source
emissions
Hourly RIO-IFDM
Air Quality Index
IFDM
20. 27/02/2018 20
Population exposure
- the best population data
set for the whole of Belgium:
data from Census 2011
(Geostat – a Eurostat project)
http://census2011.fgov.be/idk/idk4_nl.html
- Bin RIO-IFDM to Geostat grid
(mean concentration per grid cell)
- exposure calculated every hour
for BC, NO2, O3, PM10 & PM2.5
http://www.irceline.be/air/pop_exp_bc.php
http://www.irceline.be/air/pop_exp_no2.php
http://www.irceline.be/air/pop_exp_o3.php
http://www.irceline.be/air/pop_exp_pm10.php
http://www.irceline.be/air/pop_exp_pm25.php
Under development:
XML and Json version
21. 27/02/2018 21
Web Coverage Service (WCS)
http://geo.irceline.be/rioifdm/no2_hmean/wcs/?
SERVICE=WCS&REQUEST=GetCoverage&coverageid=rioifdm__no2_hmean&FORMAT=image/tiff
&subset=X,http://www.opengis.net/def/crs/EPSG/0/EPSG:31370(108950,138950)&subset=Y,http://w
ww.opengis.net/def/crs/EPSG/0/EPSG:31370(108950,138950)&subset=time(%222018-02-
26T09:00:00Z%22)&version=2.0.1
- OGC-standard
- Can be used for further processing,
e.g. to calculate the healthiest route:
http://docs.geoserver.org/latest/en/user/
services/wcs/reference.html
- to compare measurement results
26. 03/03/2018 26
Measuring air quality is not easy
●
Low cost sensors like the SDS011 have a problem with
very dry conditions (case Thursday night)
●
High relative humidity is also a challenge and it is not
easily corrected
● Agreement for PM2.5
with reference monitors is generally
better than for PM10
● For gas sensors (e.g. NO2
, O3
) the interference of the
presence of O3 is difficult to handle
●
But don’t worry, the agreement between your SDS011 and
the reference monitors was much better on Friday night
27. 03/03/2018 27
Three EU-projects to facilitate
collaboration
●
BE-GOOD: the healthiest route API
●
CORONA-EU: making the open data endpoints more user
friendly, viewers for comparing data from citizen science
projects, etc.
●
VAQUUMS: evaluating a shortlist of sensors (long term
side-by-side comparison), establish a webplatform for
comparing data + more advanced analytical tools,
“standard operating procedures” for measurements, etc.
●
Everything is developed the open source way
●
let’s look for synergies, we are here to support