Environmental Linked Data - Semtech Biz London


Published on

Slides from our Semtech Biz London 2012 presentation: Environmental Linked Data

Published in: Technology
1 Like
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Our reason for being here is to help create a better place for people and wildlife.Increasingly we seek to achieve this by working closely with and/or influencing a wide range of others including businesses, government, local authorities, other agencies, civil society groups, communities and individuals getting them to use our information is critical in this.To help them to use our information when we share it requires us to provide it in ways that allow it to be useful, usable and to be built upon. This in turn will further it’s reach and influence in achieving our environmental outcomes.Critically our remit rightly puts those environmental outcomes first and everything else fits around that core aim
  • Context about bathing water qualityWe get a lot of interest about bathing water quality, every year there are press articles and lots of information requests. We make our information available through are websiteThe public are interested in lots of things about beachesButOur remit is limited So we need to make our information available in ways that it can be combined with others
  • Demo visualisation – to show Incremental publication (able to do updates ourselves) Extend and adding scalability plus api documentation to support developers and enhanced application
  • ContextWe have information about where we sample, the defined beach, the water quality results, other influencing things such as outflow pointsBut also of interest would be access, car parking, toilets, can you walk your dog, fishing rights, photos, history and so on
  • Repurpose information that was previously locked up
  • Environmental Linked Data - Semtech Biz London

    1. 1. Linked Environmental Data Alex Coley @alexrcoley Stuart Williams @skwlilac
    2. 2. rationaleAlex
    3. 3. our vision a better place for people and wildlife to achieve this we will Act to reduce Work with Protect and Work with people climate change businesses and other improve water, and communities to and its organisations to use land and air create better places consequences resources wisely Be the best we canWe cannot do this alone. We work closely with a wide range ofpartners including government, business, local authorities, otheragencies, civil society groups and the communities we serve.
    4. 4. how we used to supply data EA hosted web services (and very restricted access to the actual data) data supplies & information requests
    5. 5. INSPIREInfrastructure for Spatial Information in the European Community
    6. 6. bathing water quality start of season Press interest 15th May bathing season 20-22 samples what information in 22weeks is relevant to the public about beaches 30th Sept annual report November what we do December
    7. 7. Proof of concept (one off)PilotBAU and extend
    8. 8. defining things (and context)
    9. 9. why Linked dataAlex
    10. 10. Tenby Tourist Information Centre Unit 2 , The Gateway Complex Tenby. Wales , SA70 7LT Tel: 01834 842 402 Fax: 01834 845 439Email: tenby.tic@pembrokeshire.gov.uk Photo by Skellig2008 (flickr)
    11. 11. Day 1 Day 1-3 Day 4 entered onto monitoring / operational databaseSampling happens Lab analysis happens Tuesday (snapshot) available via data.gov.uk Bathing Water Weekly/Daily assessment run available on WIYBY Linked data “feeds” available on EyeOnEarth available on our own apps available on other apps
    12. 12. more than ‘just’ linked data api configuration * applications update process data modelling additional data mini apps* api as organised URI space with consistent behaviours documentation others apps
    13. 13. practical issuesStuart
    14. 14. URIs + Governance Stable points of reference Applications Operational Data Domain Reference Data Vocabularies Standard Vocabularies (RDF, RDFS, OWL) Vocabularies and Reference Data form the foundationsImage from Wikimedia Commons CC-BY-2.5
    15. 15. "Cool URIs dont change" but... http://www.w3.org/Provider/Style/URI Stakeholder URI Sets Sector Governance education school transport station environment bathing-water ... ... http://{sector}.data.gov.uk/id/{concept}/{reference} thematic code-point id things doc documents about things <- reference data data datasets and data items INSPIRE def vocabularies and terms so spatial object Infrastructure for Spatial Information in the European Community
    16. 16. URI Space Map
    17. 17. Modelling• Access to Domain Expertise (not just data) • Linkage to Legislation (terms and definitions)• Entities and Relationships• Lifecycles • Mutable and Invariant Properties • Sameness and difference• What do things mean? • eg. Assessment Criteria • Code lists (G,I,F,C,N what do these mean?)
    18. 18. Revising Sample Assessmentshttp://environment.data.gov.uk/data/bathing-water-quality/in-season/sample/point{bwspid}/date/{sampleDate}/time/{sampleTime}/recordDate/{recordDate} bwq:recordDate bwq:recordStatus 2011-08-01 bwq:new dct:replaces dct:isReplacedBy 2011-08-04 bwq:replacement dct:replaces dct:isReplacedBy 2011-08-08 bwq:replacement dct:replaces dct:isReplacedBy 2011-08-11 bwq:withdrawal recordStatus new -> replacement -> withdrawn replaces / isReplaced linkages maintained using SPARQL Update.
    19. 19. Scaling Up Update Server Load Balancers SPARQL Update Upload Preview / Convert Review Publish / Remove (Disposable) Publishing Backup / Restore Server x N
    20. 20. Encouraging Use and Reuse RESTful APIhttp://environment.data.gov.uk/id/bathing-water/ukc2102-03600http://environment.data.gov.uk/id/bathing-water SELECT ?itemView Control WHERE { ... }&view= selector Data&_property={properties} GET /doc/bathing-water Store&_metadata= + viewer DESCRIBE SPARQLPage Control <x> <y> ... <z> Endpoint&page= formatter Formatted Response&pageSize= native linked data RDF Endpoint semantic web TTLFiltering CSV&{property}={value} Publication Server Developer friendly XML config&min-{property}={value} (elda+fuseki+jena) JSON&max-{property}={value} Styled data for people HTMLMisc.&_sort=&_lang={langTags}&callback= (for JSONP) Apache Jena
    21. 21. Encouraging Use & ReuseDeveloper Friendly Formats
    22. 22. Encouraging Use & Reuse Documentation Data Model and API URI pattern Referencehttp://environment.data.gov.uk/lab/
    23. 23. Rich Web Applications... English Welsh
    24. 24. Embeddable Widgets and Mobile Apps
    25. 25. where nextAlex
    26. 26. Our data and informationwill be usable and useful to whoever needs to use it
    27. 27. BW Rivers Profile Bathing Water WFD public record Reference Flood Linked Data Linked ServicesInternal
    28. 28. Questions…Alex and Stuart
    29. 29. Alex Coley@alexrcoleyalex.coley@environment-agency.gov.ukwww.environment-agency.gov.ukenvironment.data.gov.ukStuart Williams@skwlilacskw@epimorphics.com data.gov.uk/linked-datawww. epimorphics.com
    30. 30. SPARQL Update Query (part 1 of 3)preamble and delete # SPARQL update query to patch up store after a publish or remove PREFIX qb: <http://purl.org/linked-data/cube#> PREFIX bwq: <http://environment.data.gov.uk/def/bathing-water-quality/> PREFIX dct: <http://purl.org/dc/terms/> PREFIX interval: <http://reference.data.gov.uk/def/intervals/> # Remove previous replaces/replacedBy links for records DELETE { ?update dct:replaces ?predecessor . ?predecessor dct:isReplacedBy ?update . } WHERE { ?update dct:replaces ?predecessor . ?predecessor dct:isReplacedBy ?update . } ;
    31. 31. SPARQL Update Query (part 2 of 3)insert: find an update record and its predecessors# Reconstruct links based on current replacements/withdrawalsINSERT { ?update dct:replaces ?predecessor . ?predecessor dct:isReplacedBy ?update . }WHERE { ?update a bwq:SampleAssessment; bwq:bathingWater ?bw; bwq:samplingPoint ?sp; bwq:sampleDateTime ?u_stime ; bwq:recordDate ?u_recordDate; { ?update bwq:recordStatus ?bwq:withdrawal } UNION { ?update bwq:recordStatus ?bwq:replacement } # Find a ?prececessor ?predecessor a bwq:SampleAssessment; bwq:bathingWater ?bw; bwq:samplingPoint ?sp; bwq:sampleDateTime ?u_stime; bwq:recordDate ?pred_recordDate; . FILTER (?pred_recordDate<?u_recordDate)
    32. 32. SPARQL Update Query (part 3 of 3)insert: ensure there is no matching ?probe between ?update and ?predecessor # Make sure that the is no ?probe between ?update and its immediate # predecessor. OPTIONAL { ?probe a bwq:SampleAssessment; bwq:bathingWater ?bw; bwq:samplingPoint ?sp; bwq:sampleDateTime ?u_stime; bwq:recordDate ?probe_recordDate; FILTER ( ?probe_recordDate > ?pred_recordDate && ?u_recordDate > ?probe_recordDate) } FILTER (!bound(?probe))} ;