SlideShare a Scribd company logo
Trending Places
on OpenStreetMap
State of the Map, Brussels, 24.9.2016
Stefan Keller
Geometa Lab at HSR
University of Applied Sciences Rapperswil
Trending Places on
OpenStreetMap
• A big data project with a Twitter bot
• @trending_places (and github)
• Goal: Find significant viewing activity
worldwide on the main web map (“slippy
map”) of OpenStreetMap (OSM)
• This activity may be indicative of popular
news or events in that region
Log data
• A web map consists of map tiles at
different zoom levels
• The views of these tiles are logged daily
and published in an anonymized form with
a delay of 2 days
• http://planet.openstreetmap.org/tile_logs/
Log count
for each line in all the logs
{
z, x, y = extract coordinate from line
ip = extract source IP address from line
counter[z, x, y] += 1
source_addresses[z, x, y].append(ip)
}
for each (z, x, y) key in counter
{
if counter[z, x, y] >= 10 {
if count_unique(source_addresses[z, x, y]) >= 3 {
print z, x, y, counter[z, x, y]
}
}
}
File Format (as TSV): date,z,y,z where z=zoom, x/y=TMS index
How?
• For previous 7 days the tile view logs are aggregated
up to zoom level 14
• A T-score is calculated to standardize the data
• Values above a certain threshold are filtered out to
catch spikes
• These spikes are ranked relative to the mean increase
in views overall (compensates growth of OSM)
• Clustering eliminates locations that are near one
another
• Tile coordinates are reverse geocoded using
Nominatim in order to get geographic names
• A Twitter bot @trending_places announces the top 10
each day arfter 10 a.m. (or en error in case)
Challenges: Crawling
activity on osm
Visualizing OSM.org's Map
Views
• Lukas Martinelli (@lukmartinelli), May 2016
http://lukasmartinelli.ch/python/2015/05/24/parsing-and-
visualizing-osm-access-logs.html
• Martin Raifer (@tyr_asd), September 2016
http://www.openstreetmap.org/user/tyr_asd/diary/39434
Challenges: Clustering
around a trending place
Challenges: Ranking
trending places
Normalization
Challenges: Reverse
Geocoding
• Given a coordinates (from tile boundary)
• Give most relevant geographic name
inside / nearby
• Using place geographic names
=> Nominatim
• (no POIs yet)
Ex. of strong correlation:
Fort McMurray (CA)
1-3 May 2016: Wildfire across approximately 5900 square km
(1/6 Belgium 2x Luxembourg), destroying ~2,400 homes
Ex. of strong correlation #2:
Flüelen (CH)
1 June 2016: Switzerland celebrated the world's longest railway
tunnel (“The Gotthard Base Tunnel”) through the Alps…
Example of strong corr. #3:
San Severino Marche (IT)
24 August 2016: Earthquake of 6.2 on the moment magnitude scale hit
Central Italy. Its epicentre was southeast of Perugia and north of L'Aquila,
in an area near the borders of the Umbria, Lazio, Abruzzo and Marche
regions. As of 16 September 2016, 297 people have been killed
More statistics…
• Processing time: 5h (using SQLite / Python)
• Reporting period: 2016-04-11 - 2016-09-18
• No. reports: 125 (out of 160 days)
• Top 10 countries overall: RU 293, US 131, DE
70, UA 67, FR 46, PL 44, NO 43, ES 35, RO 33,
GB 31
• Top 10 place names overall: Saratovsky District
(RU) 16, 57.04.53.26 (RU) 13, Stara Emetivka
(UA) 13, Tatarstan (RU) 13, Jambyl Province (KZ)
11, Johor Bahru (MY Malaysia) 11, Odessa (UA)
11, Shimen (TW) 11, N.N. 11, Black Point (US) 10
Open questions
• Why so much russian places (and places
from post-Soviet states)?
• Influence of crawling?
• Bias of places with spikes after zero
activity vs. crowded places?
• Other bias?
• Better than T-Score? E.g. w/ Poisson
Distribution (multivariate ARIMA?)
Final open questions…
• Do you know…
– Sea Cliff (US),
– Sitionuevo (CO),
– Athens (GR),
– Sacele (RO), or
– Pretoria (ZA) ………?
• Wonder why !
https://youtu.be/olmL1fUnQAQ
Thanks
Also to Bhavya Chandra (main author, NTU
Singapore), Matt Amos, Lukas Martinelli
(@lukasmartinelli), Pavel Tyslacki (@tbicr),
Joost Schouppe (joostjakob)
Stefan Keller
Geometa Lab at HSR
University of Applied Sciences
Rapperswil (Switzerland)
www.hsr.ch/geometalab
@sfkeller

More Related Content

Similar to Trending Places on OpenStreetMap

Analysing OpenStreetMap Data with QGIS
Analysing OpenStreetMap Data with QGISAnalysing OpenStreetMap Data with QGIS
Analysing OpenStreetMap Data with QGIS
SK53
 
OSM and QGIS
OSM and QGISOSM and QGIS
OSM and QGIS
QGIS UK
 
20160315 OpenStreetMap at 中央大學
20160315 OpenStreetMap at 中央大學20160315 OpenStreetMap at 中央大學
20160315 OpenStreetMap at 中央大學
裕翔 黃
 
MVP OSM
MVP OSMMVP OSM
gis mathematicalgis mathematical modelling
gis mathematicalgis mathematical modellinggis mathematicalgis mathematical modelling
gis mathematicalgis mathematical modelling
hxusmze
 
GIS Research at UCL
GIS Research at UCLGIS Research at UCL
GIS Research at UCL
James Cheshire
 
20160306 公舘社區開放街圖研習
20160306 公舘社區開放街圖研習20160306 公舘社區開放街圖研習
20160306 公舘社區開放街圖研習
裕翔 黃
 
Conference talk: Understanding Vulnerabilities of Location Privacy Mechanisms...
Conference talk: Understanding Vulnerabilities of Location Privacy Mechanisms...Conference talk: Understanding Vulnerabilities of Location Privacy Mechanisms...
Conference talk: Understanding Vulnerabilities of Location Privacy Mechanisms...
Zohaib Riaz
 
Seattle hug 2010
Seattle hug 2010Seattle hug 2010
Seattle hug 2010
Abe Taha
 
JRC OpenStreetMap, editing and tasking mechanisms, 20130326
JRC OpenStreetMap, editing and tasking mechanisms, 20130326JRC OpenStreetMap, editing and tasking mechanisms, 20130326
JRC OpenStreetMap, editing and tasking mechanisms, 20130326
Severin Menard
 
Learn about Your Location (Using ALL Your Data)
Learn about Your Location (Using ALL Your Data)Learn about Your Location (Using ALL Your Data)
Learn about Your Location (Using ALL Your Data)
Commonwealth Computer Research, Inc.
 

Similar to Trending Places on OpenStreetMap (11)

Analysing OpenStreetMap Data with QGIS
Analysing OpenStreetMap Data with QGISAnalysing OpenStreetMap Data with QGIS
Analysing OpenStreetMap Data with QGIS
 
OSM and QGIS
OSM and QGISOSM and QGIS
OSM and QGIS
 
20160315 OpenStreetMap at 中央大學
20160315 OpenStreetMap at 中央大學20160315 OpenStreetMap at 中央大學
20160315 OpenStreetMap at 中央大學
 
MVP OSM
MVP OSMMVP OSM
MVP OSM
 
gis mathematicalgis mathematical modelling
gis mathematicalgis mathematical modellinggis mathematicalgis mathematical modelling
gis mathematicalgis mathematical modelling
 
GIS Research at UCL
GIS Research at UCLGIS Research at UCL
GIS Research at UCL
 
20160306 公舘社區開放街圖研習
20160306 公舘社區開放街圖研習20160306 公舘社區開放街圖研習
20160306 公舘社區開放街圖研習
 
Conference talk: Understanding Vulnerabilities of Location Privacy Mechanisms...
Conference talk: Understanding Vulnerabilities of Location Privacy Mechanisms...Conference talk: Understanding Vulnerabilities of Location Privacy Mechanisms...
Conference talk: Understanding Vulnerabilities of Location Privacy Mechanisms...
 
Seattle hug 2010
Seattle hug 2010Seattle hug 2010
Seattle hug 2010
 
JRC OpenStreetMap, editing and tasking mechanisms, 20130326
JRC OpenStreetMap, editing and tasking mechanisms, 20130326JRC OpenStreetMap, editing and tasking mechanisms, 20130326
JRC OpenStreetMap, editing and tasking mechanisms, 20130326
 
Learn about Your Location (Using ALL Your Data)
Learn about Your Location (Using ALL Your Data)Learn about Your Location (Using ALL Your Data)
Learn about Your Location (Using ALL Your Data)
 

More from Stefan Keller

Where can you dine like a king?
Where can you dine like a king?Where can you dine like a king?
Where can you dine like a king?
Stefan Keller
 
OpenStreetMap für Webkarten ("OpenStreetMap - die unterschätzte Ressource")
OpenStreetMap für Webkarten ("OpenStreetMap - die unterschätzte Ressource")OpenStreetMap für Webkarten ("OpenStreetMap - die unterschätzte Ressource")
OpenStreetMap für Webkarten ("OpenStreetMap - die unterschätzte Ressource")
Stefan Keller
 
Open Source Won. So, Now What?
Open Source Won. So, Now What?Open Source Won. So, Now What?
Open Source Won. So, Now What?
Stefan Keller
 
Eine (kleine) Übersicht über Geodaten-Quellen in der Schweiz
Eine (kleine) Übersicht über Geodaten-Quellen in der SchweizEine (kleine) Übersicht über Geodaten-Quellen in der Schweiz
Eine (kleine) Übersicht über Geodaten-Quellen in der Schweiz
Stefan Keller
 
OpenStreetMap und amtliche Geodaten (Workshop-Präsentation)
OpenStreetMap und amtliche Geodaten (Workshop-Präsentation)OpenStreetMap und amtliche Geodaten (Workshop-Präsentation)
OpenStreetMap und amtliche Geodaten (Workshop-Präsentation)
Stefan Keller
 
State of Kort Game - Presentation at SotM-EU in Karlsruhe June 13 2014
State of Kort Game - Presentation at SotM-EU in Karlsruhe June 13 2014State of Kort Game - Presentation at SotM-EU in Karlsruhe June 13 2014
State of Kort Game - Presentation at SotM-EU in Karlsruhe June 13 2014
Stefan Keller
 
Come with an idea - go home with a web map: Tools for sharing maps and vector...
Come with an idea - go home with a web map: Tools for sharing maps and vector...Come with an idea - go home with a web map: Tools for sharing maps and vector...
Come with an idea - go home with a web map: Tools for sharing maps and vector...
Stefan Keller
 

More from Stefan Keller (7)

Where can you dine like a king?
Where can you dine like a king?Where can you dine like a king?
Where can you dine like a king?
 
OpenStreetMap für Webkarten ("OpenStreetMap - die unterschätzte Ressource")
OpenStreetMap für Webkarten ("OpenStreetMap - die unterschätzte Ressource")OpenStreetMap für Webkarten ("OpenStreetMap - die unterschätzte Ressource")
OpenStreetMap für Webkarten ("OpenStreetMap - die unterschätzte Ressource")
 
Open Source Won. So, Now What?
Open Source Won. So, Now What?Open Source Won. So, Now What?
Open Source Won. So, Now What?
 
Eine (kleine) Übersicht über Geodaten-Quellen in der Schweiz
Eine (kleine) Übersicht über Geodaten-Quellen in der SchweizEine (kleine) Übersicht über Geodaten-Quellen in der Schweiz
Eine (kleine) Übersicht über Geodaten-Quellen in der Schweiz
 
OpenStreetMap und amtliche Geodaten (Workshop-Präsentation)
OpenStreetMap und amtliche Geodaten (Workshop-Präsentation)OpenStreetMap und amtliche Geodaten (Workshop-Präsentation)
OpenStreetMap und amtliche Geodaten (Workshop-Präsentation)
 
State of Kort Game - Presentation at SotM-EU in Karlsruhe June 13 2014
State of Kort Game - Presentation at SotM-EU in Karlsruhe June 13 2014State of Kort Game - Presentation at SotM-EU in Karlsruhe June 13 2014
State of Kort Game - Presentation at SotM-EU in Karlsruhe June 13 2014
 
Come with an idea - go home with a web map: Tools for sharing maps and vector...
Come with an idea - go home with a web map: Tools for sharing maps and vector...Come with an idea - go home with a web map: Tools for sharing maps and vector...
Come with an idea - go home with a web map: Tools for sharing maps and vector...
 

Recently uploaded

一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
nuttdpt
 
一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理
aqzctr7x
 
Intelligence supported media monitoring in veterinary medicine
Intelligence supported media monitoring in veterinary medicineIntelligence supported media monitoring in veterinary medicine
Intelligence supported media monitoring in veterinary medicine
AndrzejJarynowski
 
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
xclpvhuk
 
Experts live - Improving user adoption with AI
Experts live - Improving user adoption with AIExperts live - Improving user adoption with AI
Experts live - Improving user adoption with AI
jitskeb
 
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
taqyea
 
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
bopyb
 
writing report business partner b1+ .pdf
writing report business partner b1+ .pdfwriting report business partner b1+ .pdf
writing report business partner b1+ .pdf
VyNguyen709676
 
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
wyddcwye1
 
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
nuttdpt
 
Challenges of Nation Building-1.pptx with more important
Challenges of Nation Building-1.pptx with more importantChallenges of Nation Building-1.pptx with more important
Challenges of Nation Building-1.pptx with more important
Sm321
 
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
apvysm8
 
Module 1 ppt BIG DATA ANALYTICS_NOTES FOR MCA
Module 1 ppt BIG DATA ANALYTICS_NOTES FOR MCAModule 1 ppt BIG DATA ANALYTICS_NOTES FOR MCA
Module 1 ppt BIG DATA ANALYTICS_NOTES FOR MCA
yuvarajkumar334
 
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docxDATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
SaffaIbrahim1
 
UofT毕业证如何办理
UofT毕业证如何办理UofT毕业证如何办理
UofT毕业证如何办理
exukyp
 
一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理
bmucuha
 
University of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma TranscriptUniversity of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma Transcript
soxrziqu
 
原版一比一弗林德斯大学毕业证(Flinders毕业证书)如何办理
原版一比一弗林德斯大学毕业证(Flinders毕业证书)如何办理原版一比一弗林德斯大学毕业证(Flinders毕业证书)如何办理
原版一比一弗林德斯大学毕业证(Flinders毕业证书)如何办理
a9qfiubqu
 
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
nyfuhyz
 
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
Timothy Spann
 

Recently uploaded (20)

一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
 
一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理
 
Intelligence supported media monitoring in veterinary medicine
Intelligence supported media monitoring in veterinary medicineIntelligence supported media monitoring in veterinary medicine
Intelligence supported media monitoring in veterinary medicine
 
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
 
Experts live - Improving user adoption with AI
Experts live - Improving user adoption with AIExperts live - Improving user adoption with AI
Experts live - Improving user adoption with AI
 
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
 
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
 
writing report business partner b1+ .pdf
writing report business partner b1+ .pdfwriting report business partner b1+ .pdf
writing report business partner b1+ .pdf
 
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
 
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
 
Challenges of Nation Building-1.pptx with more important
Challenges of Nation Building-1.pptx with more importantChallenges of Nation Building-1.pptx with more important
Challenges of Nation Building-1.pptx with more important
 
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
 
Module 1 ppt BIG DATA ANALYTICS_NOTES FOR MCA
Module 1 ppt BIG DATA ANALYTICS_NOTES FOR MCAModule 1 ppt BIG DATA ANALYTICS_NOTES FOR MCA
Module 1 ppt BIG DATA ANALYTICS_NOTES FOR MCA
 
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docxDATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
 
UofT毕业证如何办理
UofT毕业证如何办理UofT毕业证如何办理
UofT毕业证如何办理
 
一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理
 
University of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma TranscriptUniversity of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma Transcript
 
原版一比一弗林德斯大学毕业证(Flinders毕业证书)如何办理
原版一比一弗林德斯大学毕业证(Flinders毕业证书)如何办理原版一比一弗林德斯大学毕业证(Flinders毕业证书)如何办理
原版一比一弗林德斯大学毕业证(Flinders毕业证书)如何办理
 
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
 
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
 

Trending Places on OpenStreetMap

  • 1. Trending Places on OpenStreetMap State of the Map, Brussels, 24.9.2016 Stefan Keller Geometa Lab at HSR University of Applied Sciences Rapperswil
  • 2. Trending Places on OpenStreetMap • A big data project with a Twitter bot • @trending_places (and github) • Goal: Find significant viewing activity worldwide on the main web map (“slippy map”) of OpenStreetMap (OSM) • This activity may be indicative of popular news or events in that region
  • 3. Log data • A web map consists of map tiles at different zoom levels • The views of these tiles are logged daily and published in an anonymized form with a delay of 2 days • http://planet.openstreetmap.org/tile_logs/
  • 4. Log count for each line in all the logs { z, x, y = extract coordinate from line ip = extract source IP address from line counter[z, x, y] += 1 source_addresses[z, x, y].append(ip) } for each (z, x, y) key in counter { if counter[z, x, y] >= 10 { if count_unique(source_addresses[z, x, y]) >= 3 { print z, x, y, counter[z, x, y] } } } File Format (as TSV): date,z,y,z where z=zoom, x/y=TMS index
  • 5. How? • For previous 7 days the tile view logs are aggregated up to zoom level 14 • A T-score is calculated to standardize the data • Values above a certain threshold are filtered out to catch spikes • These spikes are ranked relative to the mean increase in views overall (compensates growth of OSM) • Clustering eliminates locations that are near one another • Tile coordinates are reverse geocoded using Nominatim in order to get geographic names • A Twitter bot @trending_places announces the top 10 each day arfter 10 a.m. (or en error in case)
  • 7. Visualizing OSM.org's Map Views • Lukas Martinelli (@lukmartinelli), May 2016 http://lukasmartinelli.ch/python/2015/05/24/parsing-and- visualizing-osm-access-logs.html • Martin Raifer (@tyr_asd), September 2016 http://www.openstreetmap.org/user/tyr_asd/diary/39434
  • 10. Challenges: Reverse Geocoding • Given a coordinates (from tile boundary) • Give most relevant geographic name inside / nearby • Using place geographic names => Nominatim • (no POIs yet)
  • 11. Ex. of strong correlation: Fort McMurray (CA) 1-3 May 2016: Wildfire across approximately 5900 square km (1/6 Belgium 2x Luxembourg), destroying ~2,400 homes
  • 12. Ex. of strong correlation #2: Flüelen (CH) 1 June 2016: Switzerland celebrated the world's longest railway tunnel (“The Gotthard Base Tunnel”) through the Alps…
  • 13. Example of strong corr. #3: San Severino Marche (IT) 24 August 2016: Earthquake of 6.2 on the moment magnitude scale hit Central Italy. Its epicentre was southeast of Perugia and north of L'Aquila, in an area near the borders of the Umbria, Lazio, Abruzzo and Marche regions. As of 16 September 2016, 297 people have been killed
  • 14. More statistics… • Processing time: 5h (using SQLite / Python) • Reporting period: 2016-04-11 - 2016-09-18 • No. reports: 125 (out of 160 days) • Top 10 countries overall: RU 293, US 131, DE 70, UA 67, FR 46, PL 44, NO 43, ES 35, RO 33, GB 31 • Top 10 place names overall: Saratovsky District (RU) 16, 57.04.53.26 (RU) 13, Stara Emetivka (UA) 13, Tatarstan (RU) 13, Jambyl Province (KZ) 11, Johor Bahru (MY Malaysia) 11, Odessa (UA) 11, Shimen (TW) 11, N.N. 11, Black Point (US) 10
  • 15. Open questions • Why so much russian places (and places from post-Soviet states)? • Influence of crawling? • Bias of places with spikes after zero activity vs. crowded places? • Other bias? • Better than T-Score? E.g. w/ Poisson Distribution (multivariate ARIMA?)
  • 16. Final open questions… • Do you know… – Sea Cliff (US), – Sitionuevo (CO), – Athens (GR), – Sacele (RO), or – Pretoria (ZA) ………? • Wonder why !
  • 18. Thanks Also to Bhavya Chandra (main author, NTU Singapore), Matt Amos, Lukas Martinelli (@lukasmartinelli), Pavel Tyslacki (@tbicr), Joost Schouppe (joostjakob) Stefan Keller Geometa Lab at HSR University of Applied Sciences Rapperswil (Switzerland) www.hsr.ch/geometalab @sfkeller