Consuming open and linked data with open source tools

  • 650 views
Uploaded on

Presentation for the AGI Northern Group Interoperability Day at Manchester Musuem, Manchester, July 4th 2012

Presentation for the AGI Northern Group Interoperability Day at Manchester Musuem, Manchester, July 4th 2012

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
650
On Slideshare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
2
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. 5/31/2011Consuming Open andLinked Data with Open Source ToolsOr, how to do something useful with all this free data Jo Cook, Geospatial Consultant, Astun Technology
  • 2. Talk Outline ● The data and the distribution technologies explained ● The software stack explained ● Actually getting some data and doing something with it ● Gotchas ● Further resources and links
  • 3. The Data and Technologies
  • 4. The Data and Technologies
  • 5. The Data and Technologies Point in Latitude/Longitude format (WGS84)
  • 6. The Data and Technologies
  • 7. The Data and Technologies
  • 8. The Data and TechnologiesPREFIX naptan: <http://transport.data.gov.uk/def/naptan/>PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>PREFIX skos: <http://www.w3.org/2004/02/skos/core#>PREFIX geo: <http://www.w3.org/2003/01/geo/wgs84_pos#>SELECT DISTINCT ?stopPoint_airport ?name ?iataRef ?lat ?longWHERE { ?item a naptan:StopArea ; naptan:administrativeArea <http://transport.data.gov.uk/id/administrative-area/145> ; skos:prefLabel ?name ; geo:lat ?lat ; geo:long ?long ; naptan:stopPoint [ naptan:airport ?stopPoint_airport ] . ?stopPoint_airport naptan:iataRef ?iataRef .}
  • 9. The Data and Technologies
  • 10. The Data and Technologies
  • 11. The Data and Technologieshttp://wallpapertree.com/wallpaper/Sad-Kitten/
  • 12. The Data and Technologies
  • 13. The Data and Technologies
  • 14. The Data and Technologies
  • 15. The Data and Technologieshttp://freeimagesarchive.com
  • 16. The Data and Technologies
  • 17. The Data and Technologies1m4ge.blogspot.com
  • 18. The Data and Technologies
  • 19. The Data and Technologies
  • 20. Actually doing something with the data
  • 21. Actually doing something with the data
  • 22. Gotchassmashingmagazine.com
  • 23. Gotchas
  • 24. Mitigation Keep your data here so youre not relying directly on the service for updates to customers(Maybe evenkeep it here too)
  • 25. ConclusionsA dash of all these, some readilyavailable python libraries, andsome relatively simple scriptinggets you useful data for your ownapplications...... and by using PostgreSQL tostore your data, you can providea buffer in case of api changes oroutages...... and even do some niftymanipulation to analyse andpresent the data differently!
  • 26. Conclusions Simples!
  • 27. ConclusionsNot *that* simple, but...
  • 28. ResourcesLinked Data Resources and Example QueriesBest API for transport data: http://openuplabs.tso.co.uk/OReilly Book: http://www.learningsparql.com/Blog: http://talis-systems.com/blog/Airport Query: http://getthedata.org/questions/137/where-can-i-get-a-list-of-all-airports-codes-names-locationsBeginner Guide: http://www.pezholio.co.uk/2011/01/a-beginners-guide-to-sparqling-linked-data-part-1/NHS Choices- RSShttp://www.nhs.uk/servicedirectories/Pages/ServiceSearch.aspxPolice Data- JSON/RESTAPI: http://policeapi2.rkh.co.uk/api/docs/CSV/SHP: http://www.police.uk/dataBasic Software ResourcesMapserver dynamic charting: http://mapserver.org/output/dynamic_charting.htmlPython SparQLWrapper: http://sparql-wrapper.sourceforge.net/Python SimpleJSON: https://github.com/simplejson/simplejsonPython PygreSQL: http://www.pygresql.org/Loader: https://github.com/AstunTechnology/Loader
  • 29. Thank You! www.archaeogeek.com @archaeogeek jocook@astuntechnology.com