Consuming open and linked data with open source tools

Uploaded on

Presentation for the AGI Northern Group Interoperability Day at Manchester Musuem, Manchester, July 4th 2012

Presentation for the AGI Northern Group Interoperability Day at Manchester Musuem, Manchester, July 4th 2012

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads


Total Views
On Slideshare
From Embeds
Number of Embeds



Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

    No notes for slide


  • 1. 5/31/2011Consuming Open andLinked Data with Open Source ToolsOr, how to do something useful with all this free data Jo Cook, Geospatial Consultant, Astun Technology
  • 2. Talk Outline ● The data and the distribution technologies explained ● The software stack explained ● Actually getting some data and doing something with it ● Gotchas ● Further resources and links
  • 3. The Data and Technologies
  • 4. The Data and Technologies
  • 5. The Data and Technologies Point in Latitude/Longitude format (WGS84)
  • 6. The Data and Technologies
  • 7. The Data and Technologies
  • 8. The Data and TechnologiesPREFIX naptan: <>PREFIX rdf: <>PREFIX skos: <>PREFIX geo: <>SELECT DISTINCT ?stopPoint_airport ?name ?iataRef ?lat ?longWHERE { ?item a naptan:StopArea ; naptan:administrativeArea <> ; skos:prefLabel ?name ; geo:lat ?lat ; geo:long ?long ; naptan:stopPoint [ naptan:airport ?stopPoint_airport ] . ?stopPoint_airport naptan:iataRef ?iataRef .}
  • 9. The Data and Technologies
  • 10. The Data and Technologies
  • 11. The Data and Technologies
  • 12. The Data and Technologies
  • 13. The Data and Technologies
  • 14. The Data and Technologies
  • 15. The Data and Technologies
  • 16. The Data and Technologies
  • 17. The Data and
  • 18. The Data and Technologies
  • 19. The Data and Technologies
  • 20. Actually doing something with the data
  • 21. Actually doing something with the data
  • 22.
  • 23. Gotchas
  • 24. Mitigation Keep your data here so youre not relying directly on the service for updates to customers(Maybe evenkeep it here too)
  • 25. ConclusionsA dash of all these, some readilyavailable python libraries, andsome relatively simple scriptinggets you useful data for your ownapplications...... and by using PostgreSQL tostore your data, you can providea buffer in case of api changes oroutages...... and even do some niftymanipulation to analyse andpresent the data differently!
  • 26. Conclusions Simples!
  • 27. ConclusionsNot *that* simple, but...
  • 28. ResourcesLinked Data Resources and Example QueriesBest API for transport data: Book: Query: Guide: Choices- RSS Data- JSON/RESTAPI: Software ResourcesMapserver dynamic charting: SparQLWrapper: SimpleJSON: PygreSQL:
  • 29. Thank You! @archaeogeek