Sharing Environmental Data, Our Experiences at EPA


Published on

Sharing Environmental Data, Our Experiences at EPA presentation by Dr. Peter Mooney Research Fellow EPA & Dept of Computer Science NUI Maynooth at Dublinked Environment DubMeet May 2014

Published in: Environment, Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Sharing Environmental Data, Our Experiences at EPA

  1. 1. Sharing Environmental Data Our experiences at EPA Dr. Peter Mooney EPA Research Fellow Dept of Computer Science, NUIM
  2. 2. As of .. May 26th 2014
  3. 3. The EPA and Environmental Data and Information Generator and Collector (monitoring, position as legal entity, etc) Facilitator and enabler (through R&D programmes) Manager and distributor (Water Framework Directive....)
  4. 4. Providing ‘open-data’ as PDF reports: knowledge distribution - but not actionable “like funding James Cameron to make Avatar, and then releasing it in a black and white flip book. We are missing all the good stuff”
  5. 5. The EPA have committed significant resources to making GIS data available
  6. 6. Envision
  7. 7. Pre-packaged data downloads
  8. 8. Service-based access to geospatial data
  9. 9. WFS, WMS and REST Services
  10. 10. Envision Download Services
  11. 11. EPA Research
  12. 12. Over 700 fundedOver 700 funded projects (> €10K)projects (> €10K) since 2002since 2002
  13. 13. EPA Research Programme has been operating an open access approach over the last 6 years All EPA funded research projects must provide “significant outputs” (datasets, info resources, etc) for public access via SAFER Crucially and innovatively, this couples the final reports/papers with the actual data/information used to generate the findings/recommendations
  14. 14. SAFER -Secure Archive for Environmental Research Data
  15. 15. High rates of download
  16. 16. SAFER has driven excellent resource efficiencies in EPA Research ● AQ PM10 Data Archive Open Access ● 2300 downloads (May 2013) ● 2300 X 6 minutes per request = 13,800 minutes ● 13,800 / 60 = 230 hours ● 8 hour working day ● TOTAL 28.75 days SAVED Example
  17. 17. Several key EPA dataset archives are available on SAFER
  18. 18. SAFER is beginning to offer some web-service access
  19. 19. The open nature of the Catalogue has exceeded our expecations
  20. 20. EPA Air Quality
  21. 21. The Air Quality Index for Health (AQIH) Launched May 2013 The AQIH was developed through collaboration between EPA, HSE, Met Eireann, and other public bodies and experts
  22. 22. The AQIH is true real-time open data from the EPA Monitoring Network Ongoing Sampling EPA Servers and Databases Processing and Analysis Delivery to the public and stakeholders Example Sampling between 09:00 and 10:00 Receive from monitoring stations (09:00 – 10:00) Storage in Databases Processing and analysis 10:00 – 11:00 Data from the periods including 09:00 – 10:00 is now available for access
  23. 23. AQIH Map Access Screenshot taken at 14:33 on 26-May-2014
  24. 24. AQIH Twitter Automated tweets @ 08:00 and 17:00 each day – hourly if AQIH becomes poor in one or more regions
  25. 25. AQIH Web Pages for Stations
  26. 26. AQIH as JSON Open Data
  27. 27. AQIH JSON (wget call)
  28. 28. We get lots of request for the raw hourly data from individual monitoring stations This type of data requires expert interpretation – so the AQIH is made available openly instead
  29. 29. SAFER contains the entire archive of validated AQ data from EPA
  30. 30. Summary of thoughts
  31. 31. Our advice is to L.E.A.R.N Listen Engage Activity/Actions Research New/Innovate
  32. 32. The unbounded evolution of InternetThe unbounded evolution of Internet technologies has completely changed thetechnologies has completely changed the data playing field and rules of engagementdata playing field and rules of engagement 10 Years Ago “Fear of being open” Today “Fear of not being open” DRIVERS CHANGE INSPIRE, SEIS, PSI Directive, Open Data, Initiatives, etc Open Internet, Social Media, User-generated content, “The Internet Generation”, etc
  33. 33. Open Data is high on the EPA agenda for future work ● AQIH: Make historical archive available (JSON) ● Up-to-date AQ data: AQ Directive changes are being implemented – potential to make INSPIRE-compliant AQ UTD available ● Explore potential linkages to DUBLINKED: Are there datasets/services which can be shared? ● Upgrading tools such as SAFER: Investigate adding more web-services (pull of information)
  34. 34. Emphasis on delivery of mobile- focused applications
  35. 35. The EPA must carefully consider open-data on a case-by-case basis Concerns about data misuse or misinterpretation The resource costs – making open data available isn't free Working with stakeholders – when data has been generated or owned by several parties Privacy and security issues – particularly in point-based geospatial datasets
  36. 36. Dr. Peter Mooney email and