0
5/31/2011Consuming Open andLinked Data with Open    Source ToolsOr, how to do something useful     with all this free data...
Talk Outline ● The data and the distribution technologies   explained ● The software stack explained ● Actually getting so...
The Data and Technologies
The Data and Technologies
The Data and Technologies           Point in Latitude/Longitude format (WGS84)
The Data and Technologies
The Data and Technologies
The Data and TechnologiesPREFIX naptan: <http://transport.data.gov.uk/def/naptan/>PREFIX rdf: <http://www.w3.org/1999/02/2...
The Data and Technologies
The Data and Technologies
The Data and Technologieshttp://wallpapertree.com/wallpaper/Sad-Kitten/
The Data and Technologies
The Data and Technologies
The Data and Technologies
The Data and Technologieshttp://freeimagesarchive.com
The Data and Technologies
The Data and Technologies1m4ge.blogspot.com
The Data and Technologies
The Data and Technologies
Actually doing something with the data
Actually doing something with the data
Gotchassmashingmagazine.com
Gotchas
Mitigation                    Keep your data here so youre                    not relying directly on the service         ...
ConclusionsA dash of all these, some readilyavailable python libraries, andsome relatively simple scriptinggets you useful...
Conclusions        Simples!
ConclusionsNot *that* simple, but...
ResourcesLinked Data Resources and Example QueriesBest API for transport data: http://openuplabs.tso.co.uk/OReilly Book: h...
Thank You!         www.archaeogeek.com         @archaeogeek         jocook@astuntechnology.com
Upcoming SlideShare
Loading in...5
×

Consuming open and linked data with open source tools

791

Published on

Presentation for the AGI Northern Group Interoperability Day at Manchester Musuem, Manchester, July 4th 2012

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
791
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Consuming open and linked data with open source tools"

  1. 1. 5/31/2011Consuming Open andLinked Data with Open Source ToolsOr, how to do something useful with all this free data Jo Cook, Geospatial Consultant, Astun Technology
  2. 2. Talk Outline ● The data and the distribution technologies explained ● The software stack explained ● Actually getting some data and doing something with it ● Gotchas ● Further resources and links
  3. 3. The Data and Technologies
  4. 4. The Data and Technologies
  5. 5. The Data and Technologies Point in Latitude/Longitude format (WGS84)
  6. 6. The Data and Technologies
  7. 7. The Data and Technologies
  8. 8. The Data and TechnologiesPREFIX naptan: <http://transport.data.gov.uk/def/naptan/>PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>PREFIX skos: <http://www.w3.org/2004/02/skos/core#>PREFIX geo: <http://www.w3.org/2003/01/geo/wgs84_pos#>SELECT DISTINCT ?stopPoint_airport ?name ?iataRef ?lat ?longWHERE { ?item a naptan:StopArea ; naptan:administrativeArea <http://transport.data.gov.uk/id/administrative-area/145> ; skos:prefLabel ?name ; geo:lat ?lat ; geo:long ?long ; naptan:stopPoint [ naptan:airport ?stopPoint_airport ] . ?stopPoint_airport naptan:iataRef ?iataRef .}
  9. 9. The Data and Technologies
  10. 10. The Data and Technologies
  11. 11. The Data and Technologieshttp://wallpapertree.com/wallpaper/Sad-Kitten/
  12. 12. The Data and Technologies
  13. 13. The Data and Technologies
  14. 14. The Data and Technologies
  15. 15. The Data and Technologieshttp://freeimagesarchive.com
  16. 16. The Data and Technologies
  17. 17. The Data and Technologies1m4ge.blogspot.com
  18. 18. The Data and Technologies
  19. 19. The Data and Technologies
  20. 20. Actually doing something with the data
  21. 21. Actually doing something with the data
  22. 22. Gotchassmashingmagazine.com
  23. 23. Gotchas
  24. 24. Mitigation Keep your data here so youre not relying directly on the service for updates to customers(Maybe evenkeep it here too)
  25. 25. ConclusionsA dash of all these, some readilyavailable python libraries, andsome relatively simple scriptinggets you useful data for your ownapplications...... and by using PostgreSQL tostore your data, you can providea buffer in case of api changes oroutages...... and even do some niftymanipulation to analyse andpresent the data differently!
  26. 26. Conclusions Simples!
  27. 27. ConclusionsNot *that* simple, but...
  28. 28. ResourcesLinked Data Resources and Example QueriesBest API for transport data: http://openuplabs.tso.co.uk/OReilly Book: http://www.learningsparql.com/Blog: http://talis-systems.com/blog/Airport Query: http://getthedata.org/questions/137/where-can-i-get-a-list-of-all-airports-codes-names-locationsBeginner Guide: http://www.pezholio.co.uk/2011/01/a-beginners-guide-to-sparqling-linked-data-part-1/NHS Choices- RSShttp://www.nhs.uk/servicedirectories/Pages/ServiceSearch.aspxPolice Data- JSON/RESTAPI: http://policeapi2.rkh.co.uk/api/docs/CSV/SHP: http://www.police.uk/dataBasic Software ResourcesMapserver dynamic charting: http://mapserver.org/output/dynamic_charting.htmlPython SparQLWrapper: http://sparql-wrapper.sourceforge.net/Python SimpleJSON: https://github.com/simplejson/simplejsonPython PygreSQL: http://www.pygresql.org/Loader: https://github.com/AstunTechnology/Loader
  29. 29. Thank You! www.archaeogeek.com @archaeogeek jocook@astuntechnology.com
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×