Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Exploring theExploring the
Potential ofPotential of
OpenStreetMap DataOpenStreetMap Data
JerryJerry CloughClough
SK53 on O...
OSM (still) in data collection phase
Sep-12 Mar-13 Sep-13 Mar-14 Sep-14 Mar-15
0%
20%
40%
60%
80%
100%
120% Post Boxes Map...
Themes
● How complete is X on OSM?
● Where are the gaps in X?
● Is OSM data usable?
● If so, what's involved?
● Can furthe...
ToolkitToolkit
● OSM Extracts from Geofabrik
● Overpass
● taginfo & umap
● osmconvert & osmfilter
● osm2pgsql & osmosis
● ...
Looking at the DataLooking at the Data
Counts, Visualisations, ComparisonCounts, Visualisations, Comparison
Simple Visualisations:Simple Visualisations:
Pub Density in Great BritainPub Density in Great Britain
Basic CountsBasic Counts
Some 'Interesting' Stats for Great Britain
(with apologies to Ordnance Survey)
● Pylons: 75,446 (...
Comparisons:Comparisons:
Data CompletenessData Completeness
Food Hygiene Open Data
© 2015OSM contributors
Comparisons:Comparisons:
Data AccuracyData Accuracy
Land Registry Inspire parcels
OSM gardens etc, Sutton
Coldfield (B72)
...
Comparisons:Comparisons:
Missing DataMissing Data
© 2015 OpenStreetMap contributors
Surrey Rights of Way from rowmaps.org....
Comparisons:Comparisons:
Internal to OSMInternal to OSM
Building a Global DataBuilding a Global Data
SetSet
Retail in OSMRetail in OSM
Long-tail of shop tagsLong-tail of shop tags
Pubs on OpenStreetMapPubs on OpenStreetMap
© 2015 OpenStreetMap contributors; Country Polygons also OSM
Cartograms from Retail POIsCartograms from Retail POIs
© 2015 OpenStreetMap contributors; Country Polygons Natural Earth
C...
Derived & EmergentDerived & Emergent
DataData
Landuse PolygonsLanduse Polygons
Deriving Data : Landuse PolygonsDeriving Data : Landuse Polygons
●
●
Gridding PolygonsGridding Polygons
• Intersection of all
features on 1km grid
– Reduce polygon size
– Performance
– Avoid ...
PostGIS ProcessingPostGIS Processing
OSM
Polygons
OSM
Lines
Painter's
Algorithm
Rules
Clipped
Polygons
Clipped
Lines
Clean...
Emergent Data : Retail land use
Classifying Retail
Areas
SummarySummary
● Potential future use of OSM data can be tested
by judicious choice of data sets.
● Evaluation of suitabil...
I'm not alone!I'm not alone!
Exploring the Potential of OpenStreetMap Data
Exploring the Potential of OpenStreetMap Data
Upcoming SlideShare
Loading in …5
×

Exploring the Potential of OpenStreetMap Data

725 views

Published on

Talk at Geomob, May 2015

Published in: Technology
  • Be the first to comment

Exploring the Potential of OpenStreetMap Data

  1. 1. Exploring theExploring the Potential ofPotential of OpenStreetMap DataOpenStreetMap Data JerryJerry CloughClough SK53 on OpenStreetMap @SK53onOSM SK53.osm@gmail.com Maps Matter Blog : www.sk53-osm.blogspot.com
  2. 2. OSM (still) in data collection phase Sep-12 Mar-13 Sep-13 Mar-14 Sep-14 Mar-15 0% 20% 40% 60% 80% 100% 120% Post Boxes Mapped by City on OSM percentage of current total Pittsburgh Zurich Karlsruhe Krakow Tallinn Nantes Salamanca Nottingham Aug-12 Aug-14 0 200 400 600 800 1000 1200 1400 1600 0 20 40 60 80 100 120 140 160 180 200 bookies NG restaurants Sep-12 Feb-13 Jul-13 Dec-13 May-14 Oct-14 Mar-15 0% 20% 40% 60% 80% 100% 120% Restaurants by City on OSM San Francisco Pittsburgh St Louis Seattle Oklahoma City Denver Zurich Karlsruhe Munich Krakow Tallinn Nantes Salamanca Nottingham
  3. 3. Themes ● How complete is X on OSM? ● Where are the gaps in X? ● Is OSM data usable? ● If so, what's involved? ● Can further information be derived?
  4. 4. ToolkitToolkit ● OSM Extracts from Geofabrik ● Overpass ● taginfo & umap ● osmconvert & osmfilter ● osm2pgsql & osmosis ● PostgreSQL ● QGIS ● R ● Possibles – Routing Packages: graphhopper, OpenTripPlanner – RapidMiner DataData ● Data in PostGIS: – Static data for GB using osm2pgsql ● Lose interconnectedness ● Avoid issues in creating polygons – Pre-filtered topic-based data sets – Limited use of (osmosis) snapshot schema ● Common processes: – Geodata » Graph » Geodata – Gridding of data
  5. 5. Looking at the DataLooking at the Data Counts, Visualisations, ComparisonCounts, Visualisations, Comparison
  6. 6. Simple Visualisations:Simple Visualisations: Pub Density in Great BritainPub Density in Great Britain
  7. 7. Basic CountsBasic Counts Some 'Interesting' Stats for Great Britain (with apologies to Ordnance Survey) ● Pylons: 75,446 (OSGB: 80,517) ● Post Boxes: 51,023 (93.728) ● Camp sites: 4,347 (8,908) ● Buildings: 3,394,208 (35,397,754) ● Bus Stops: 222,505 (354,099) ● Petrol Stations: 6,575 (7,702) ● Addresses: 892,938 (27,341,262) ● Electricity Poles: 150,209 (183, 987) ● Road length: 522,627 km (407,532 km) ● 11 post boxes with Edward VIII cypher ● Only 420 War Memorials ● 1,353 Fire Hydrants ● 2,000 Real Ale pubs – 109 with Real Fires ● 7,845 Cycle Parking ● 300 Wildlife Hides ● 10,968 Stiles ● 2,033 Canal Locks ● 8 Knitting Shops Ordnance Survey figures: /www.ordnancesurvey.co.uk/blog/2013/04/10-fascinating-facts-from-ordnance-survey/ OSM figures (May '15): /taginfo.openstreetmap.org.uk/
  8. 8. Comparisons:Comparisons: Data CompletenessData Completeness Food Hygiene Open Data © 2015OSM contributors
  9. 9. Comparisons:Comparisons: Data AccuracyData Accuracy Land Registry Inspire parcels OSM gardens etc, Sutton Coldfield (B72) © 2013 OSM Contributors @2013 Crown Copyright & Database right
  10. 10. Comparisons:Comparisons: Missing DataMissing Data © 2015 OpenStreetMap contributors Surrey Rights of Way from rowmaps.org.uk
  11. 11. Comparisons:Comparisons: Internal to OSMInternal to OSM
  12. 12. Building a Global DataBuilding a Global Data SetSet Retail in OSMRetail in OSM
  13. 13. Long-tail of shop tagsLong-tail of shop tags
  14. 14. Pubs on OpenStreetMapPubs on OpenStreetMap © 2015 OpenStreetMap contributors; Country Polygons also OSM
  15. 15. Cartograms from Retail POIsCartograms from Retail POIs © 2015 OpenStreetMap contributors; Country Polygons Natural Earth Created using Scapetoad
  16. 16. Derived & EmergentDerived & Emergent DataData Landuse PolygonsLanduse Polygons
  17. 17. Deriving Data : Landuse PolygonsDeriving Data : Landuse Polygons ● ●
  18. 18. Gridding PolygonsGridding Polygons • Intersection of all features on 1km grid – Reduce polygon size – Performance – Avoid joining on geometries (use key for grid cell)
  19. 19. PostGIS ProcessingPostGIS Processing OSM Polygons OSM Lines Painter's Algorithm Rules Clipped Polygons Clipped Lines Cleaned & Clipped Polygons UA Shape Polygons Clean Geometry Gridded UA Classes Filter on Tags & Grid Gridded & Buffered UA Classes Tag Filter, Grid & Buffer Clip to Area Clip to Area Piecewise Union Union Step 1 Union Union Step 2 Merge Class Gridded Polygons Merge Grid Gridded UA Polygons Union Clipping areas by UA Class ClippingRegion Final Polygons Compare UA/OSM Union/Intersect/ Difference
  20. 20. Emergent Data : Retail land use
  21. 21. Classifying Retail Areas
  22. 22. SummarySummary ● Potential future use of OSM data can be tested by judicious choice of data sets. ● Evaluation of suitability of OSM data for a given purpose solely using internal criteria is still hard. ● Deriving rather than consuming data is often (technically) involved. ● It can be fun in its own right!
  23. 23. I'm not alone!I'm not alone!

×