UrbanMatch – linking andimproving Smart Cities DataIrene Celino, Simone Contessa, Marta Corubolo,    Daniele Dell’Aglio, E...
Three converging trends                                                                    citizens as sensors,           ...
Research hypothesis  Urban Games:       to consume, create and assess the quality of       Smart Cities-related Linked Dat...
UrbanMatch: input and output data                 Places & POIs from                  OpenStreetMap                       ...
UrbanMatch: gameplay                 Video at: http://youtu.be/FYBXxwAL0NY UrbanMatch - LDOW @ WWW 2012   5              L...
UrbanMatch: achieving the purpose Trusted links are constituted by correct POI-photo          When a POI-photo link is cou...
UrbanMatch: links and confidence value    Trusted sources                  Trusted links                                  ...
UrbanMatch evaluation (1/2)Data Quality Metrics  Evaluation data       54 unique players, 290 games (781 game levels)     ...
UrbanMatch evaluation (2/2)User-based evaluation: actual "engagement"  Based on game evaluation literature and integrated ...
Conclusions and next steps  Evaluation results seem to prove our research  hypothesis       Purpose "hiding" is key to GWA...
Thanks for your attention!          Any question?Irene Celino – CEFRIEL, ICT Institute Politecnico di Milano   email: Iren...
Upcoming SlideShare
Loading in …5
×

UrbanMatch - linking and improving Smart Cities Data

3,389 views

Published on

Presentation at Linked Data on the Web Workshop (LDOW 2012) @ WWW 2012

Published in: Technology, Education
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
3,389
On SlideShare
0
From Embeds
0
Number of Embeds
56
Actions
Shares
0
Downloads
18
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

UrbanMatch - linking and improving Smart Cities Data

  1. 1. UrbanMatch – linking andimproving Smart Cities DataIrene Celino, Simone Contessa, Marta Corubolo, Daniele Dell’Aglio, Emanuele Della Valle, Stefano Fumeo and Thorsten Krüger CEFRIEL – Politecnico di Milano – SIEMENS UrbanMatch - LDOW @ WWW 2012
  2. 2. Three converging trends citizens as sensors, Urban Computing and check-in logging, Location-based Services mobile apps Urban Games Linked Data and Games with a Semantic Web Purpose and Crowdsourcing open/gov data, structured data, collecting data, cleaning social networks, data, engaging the user, tourism data and supporting the user whilerecommendations entertaining him/her UrbanMatch - LDOW @ WWW 2012 2 Lyon, 16th April 2012
  3. 3. Research hypothesis Urban Games: to consume, create and assess the quality of Smart Cities-related Linked Data via a Human Computation approach for users in mobility with smart phone devices Traditional Human Computation approaches are based on users domain knowledge… …while Urban Games are based on and aim at exploiting "on site" users experience knowledge UrbanMatch is our first prototype of Urban Games: a GWAP for iPhone aimed to create links between urban POIs and their most representative photos UrbanMatch - LDOW @ WWW 2012 3 Lyon, 16th April 2012
  4. 4. UrbanMatch: input and output data Places & POIs from OpenStreetMap UrbanMatch server Trusted Manual sources Selection of linked photos UrbanMatch clients Uncertain sources Wikimedia Commons Trusted links: <POI> foaf:depiction <photo> UrbanMatch - LDOW @ WWW 2012 4 Lyon, 16th April 2012
  5. 5. UrbanMatch: gameplay Video at: http://youtu.be/FYBXxwAL0NY UrbanMatch - LDOW @ WWW 2012 5 Lyon, 16th April 2012
  6. 6. UrbanMatch: achieving the purpose Trusted links are constituted by correct POI-photo When a POI-photo link is couples (i.e. the correlation between the photo assessed to be correct, and the depicted POI was verified) it becomes trusted Post-Trusted New Processing link POI trusted POI linkCandidate links UrbanMatch players POI POI Incorrect link discarded Players coupling decisionsCandidate links are those are collected and thenreturned by the uncertain post-processed When a POI-photo link issources (e.g. Duomo-photoXYZ assessed to be incorrect,with photoXYZ retrieved via a it is discarded and neverFlickr API geo-search for Duomo) again proposed to players UrbanMatch - LDOW @ WWW 2012 6 Lyon, 16th April 2012
  7. 7. UrbanMatch: links and confidence value Trusted sources Trusted links POImanually selected photos ~ 200 Confidence value initial value changes on Uncertain sources Candidate links value players choices trustable Wikimedia 60% when > Commons POI upper threshold ~ 37,000 incorrect 40% when < POI lower threshold UrbanMatch - LDOW @ WWW 2012 7 Lyon, 16th April 2012
  8. 8. UrbanMatch evaluation (1/2)Data Quality Metrics Evaluation data 54 unique players, 290 games (781 game levels) 2006 input links, 1284 assessed (trustable/incorrect) upper threshold 70%, lower threshold 20% Completeness def: assessed links (trusted+incorrect) / all input links intuitively: game ability to assess input links globally from 1.54% (only manually-checked links) to 4.98% trusted links have tripled (incremented by 322%) Accuracy def: correctly assessed links (w/ FP+FN) / all assessed links intuitively: game ability to correctly assess input links 99.4% (only 4 False Positive and 8 False Negative links) UrbanMatch - LDOW @ WWW 2012 8 Lyon, 16th April 2012
  9. 9. UrbanMatch evaluation (2/2)User-based evaluation: actual "engagement" Based on game evaluation literature and integrated with our research-specific questions Questionnaire at http://bit.ly/um-survey Findings: UrbanMatch - LDOW @ WWW 2012 9 Lyon, 16th April 2012
  10. 10. Conclusions and next steps Evaluation results seem to prove our research hypothesis Purpose "hiding" is key to GWAP success Publication of generated links as Linked Open Data Further evaluation on GWAP-specific metrics UrbanMatch Milano soon to be followed by its "brother" app UrbanMatch Munich ☺ Comparative evaluation of UrbanMatch vs. manual assessment via domain experts A more complex Urban Game under development to prove our research hypothesis on different kinds of Smart Cities-related Linked Data Urbanopoly game coming soon from PlanetData project... UrbanMatch - LDOW @ WWW 2012 10 Lyon, 16th April 2012
  11. 11. Thanks for your attention! Any question?Irene Celino – CEFRIEL, ICT Institute Politecnico di Milano email: Irene.Celino@cefriel.it – web: http://swa.cefriel.it UrbanMatch - LDOW @ WWW 2012

×