Geospatial vector files published by Elastic for our users are created by mashing up vector data from OpenStreetMap and attribute data from Wikidata using Sophox. In this talk, I demonstrate how you can use Sophox and SPARQL queries to generate useful vector data and attributes.

1. 1
Nick Peihl
2019-04-16, Software Engineer, Elastic
@nickpeihl
Create Useful Vector Data
from OSM and Wikidata

2. 2
Agenda
About1
How we use Sophox at Elastic3
Wrap-Up4
Questions?5
Querying OpenStreetMap and Wikidata with Sophox2

3. 3
About me
• GIS Analyst and Software Engineer at Elastic (https://elastic.co)
• Elastic Maps Service and Kibana
• Previously GIS in local government
• @nickpeihl
Nick Peihl
Source: Gray Arial 10pt

4. 4
Agenda
About1
How we use Sophox at Elastic3
Wrap-Up4
Questions?5
Querying OpenStreetMap and Wikidata with Sophox2

5. 5
Sophox
● Created by Yuri Astrakhan (github.com/nyurik)
● Apache 2.0 OSS (github.com/sophox)
● Built upon Wikidata Query Service (query.wikidata.org)
● Hosted for the community by Elastic
OpenStreetMap RDF Query Tool (SPARQL)

6. 6
Sophox.org

7. 7
Wikidata Query Service (https://query.wikidata.org/)

8. 8
Sophox SPARQL Example
List OSM objects with a place tag
SELECT * WHERE {
?osmId osmm:type ?osmType .
?osmId osmt:place ?place .
} LIMIT 50
Try me

9. 9
Results

10. 10
Sophox SPARQL Example
List OSM objects with a place tag
SELECT * WHERE {
?osmId osmm:type ?osmType .
?osmId osmt:place ?place .
} LIMIT 50
Try me

11. 11
Sophox SPARQL Example
List OSM objects with a place tag = island
SELECT * WHERE {
?osmId osmm:type ?osmType .
?osmId osmt:place 'island' .
} LIMIT 50
Try me

12. 12
Results

13. 13
Sophox SPARQL Example
List OSM objects with a place tag = island
SELECT * WHERE {
?osmId osmm:type ?osmType .
?osmId osmt:place 'island' .
} LIMIT 50
Try me

14. 14
Sophox SPARQL Example
List OSM objects with a place tag = island
SELECT * WHERE {
?osmId osmm:type ?osmType .
?osmId osmt:place 'island' .
?osmId osmt:name ?osmName .
?osmId osmt:wikidata ?wikidataId .
} LIMIT 50
Try me

15. 15
Results

16. 16
Sophox SPARQL Example
List OSM objects with a place tag = island
SELECT * WHERE {
?osmId osmm:type ?osmType .
?osmId osmt:place 'island' .
?osmId osmt:name ?osmName .
?osmId osmt:wikidata ?wikidataId .
} LIMIT 50
Try me

17. 17
Sophox SPARQL Example
List OSM objects with a place tag = island
SELECT * WHERE {
?osmId osmm:type ?osmType .
?osmId osmt:place 'island' .
?osmId osmt:name ?osmName .
?osmId osmt:wikidata ?wikidataId .
SERVICE <https://query.wikidata.org/sparql> {
?wikidataId wdt:P1082 ?population
}
} LIMIT 50
Try me

18. 18
Results

19. 19
Sophox SPARQL Example
List OSM objects with a place tag = island
SELECT * WHERE {
?osmId osmm:type ?osmType .
?osmId osmt:place 'island' .
?osmId osmt:name ?osmName .
?osmId osmt:wikidata ?wikidataId .
SERVICE <https://query.wikidata.org/sparql> {
?wikidataId wdt:P1082 ?population
}
} LIMIT 50
Try me

20. 20
Sophox SPARQL Example
List OSM objects with a place tag = island and population <= 100
SELECT * WHERE {
?osmId osmm:type ?osmType .
?osmId osmt:place 'island' .
?osmId osmt:name ?osmName .
?osmId osmt:wikidata ?wikidataId .
SERVICE <https://query.wikidata.org/sparql> {
?wikidataId wdt:P1082 ?population
}
FILTER(?population > 0 && ?population <= 100)
} LIMIT 50
Try me

21. 21
Results

22. 22
Sophox SPARQL Example
List OSM objects with a place tag = island and population <= 100
SELECT * WHERE {
?osmId osmm:type ?osmType .
?osmId osmt:place 'island' .
?osmId osmt:name ?osmName .
?osmId osmt:wikidata ?wikidataId .
SERVICE <https://query.wikidata.org/sparql> {
?wikidataId wdt:P1082 ?population
}
FILTER(?population > 0 && ?population <= 100)
} LIMIT 50
Try me

23. 23
Sophox SPARQL Example
Map OSM objects with a place tag = island and population <= 100
#defaultView:Map
SELECT * WHERE {
?osmId osmm:type ?osmType .
?osmId osmt:place 'island' .
?osmId osmt:name ?osmName .
?osmId osmt:wikidata ?wikidataId .
?osmId osmm:loc ?wkt .
SERVICE <https://query.wikidata.org/sparql> {
?wikidataId wdt:P1082 ?population
}
FILTER(?population > 0 && ?population <= 100)
} LIMIT 50
Try me

24. 24
Results

25. 25
Results

26. 26
Import into QGIS

27. 27
Import into QGIS

28. 28
Agenda
About1
How we use Sophox at Elastic3
Wrap-Up4
Questions?5
Querying OpenStreetMap and Wikidata with Sophox2

29. 29
Elastic Maps Service (https://maps.elastic.co)

30. 30
Sophox: Generating Polygon Files

31. 31
Sophox: Generating Polygon Files

32. 32
Sophox: Generating Polygon Files

33. 33
Sophox: Generating Polygon Files

34. 34
Kibana Visualizations

35. 35
Agenda
About1
How we use Sophox at Elastic3
Wrap-Up4
Questions?5
Querying OpenStreetMap and Wikidata with Sophox2

36. 36
Wednesday
11AM E10
“Let your data tell its
story with
Elasticsearch and
Kibana”

37. 3737
Kibana GIS Analyst
elastic.co/about/careers/

38. 3838
QUESTIONS?
Nick Peihl
@nickpeihl
Slides:
http://tinyurl.com/mashup-osm-wikidata