SlideShare a Scribd company logo
1 of 12
Download to read offline
Analysis of a Cultural Heritage
Game with a Purpose
with an Educational Incentive
Irene Celino, Andrea Fiano and Riccardo Fino
CEFRIEL – Milano, Italy
paper: http://dx.doi.org/10.1007/978-3-319-38791-8_28
Introduction and motivation
Cultural Heritage (CH) Game with a Purpose (GWAP)
Gameplay: quiz to guess a CH asset from four different images
Purpose: ranking images of CH assets
Collateral effect: learning about CH
Evaluation of the CH GWAP:
Effectiveness to achieve its ranking purpose
Ability to engage and retain players
Potential effect of the educational/cultural incentive
Indomilando gameplay
Images of CH architectures in
the city of Milano
Churches, villas, buildings,
schools, towers, …
1 name/title and 4 photos
(of 4 different assets)
Link to official asset record
Map to explore CH assets
the user played with
http://bit.ly/indomilando
Intuitively, a photo is recognizable if it is correctly guessed more frequently
Conservative measure: lower bound of Wilson score interval
But some categories are more recognizable
than others (e.g. buildings are difficult)
 correction: standardization
by asset type
Final photo rank score:
Indomilando purpose
Computing photo ranking
p: observed fraction of successes (=photo guessed)
z2
α/2: (1 - α/2) quantile of the standard normal distribution
n: total number of trials (=photo played)
Indomilando purpose
Computing CH asset ranking
Intuitively, an asset rank score corresponds to the average
of its photos’ rank scores
But each asset has a different no. of photos (1-40)
 correction for number of photos
But each set of photos can be heterogeneous (mix of good
and bad photos)
 correction for photo inhomogeneity
Final asset rank score:
Indomilando purpose
Evaluating ability to rank
Comparison with no. of visits of assets’
Wikipedia pages (when existing)
But no. of Wikipedia visits is more a sign
of “popularity” than “recognisability”
Comparison with ground truth
Best photo of top-10 Wikipedia assets
Manual ranking by 12 users
Rank aggregation weighted by declared
familiarity with Milano CH
Good ability to rank and much more time-effective 
Each manual ranker: avg. of 1 min 27 sec to rank 10 assets
Indomilando: 72 players with avg. of 7.5 min to rank ~1400 photos and ~650 assets
Indomilando gaming flavor
Evaluating players engagement
ALP (Average Life Play): 7.5 min
Left-skewed distribution (long tail)
Median < 3 min
Two user groups (+ “outliers”)
Subjective analysis of engagement
through user questionnaire
Players like it 
Indomilando cultural flavor
Evaluating educational incentive (1/2)
Possibility to explore CH official records
between game rounds (map exploration)
Two rounds consecutive if < 15 min
Distribution of “exploration” time
Possibility to learn over time to recognize
CH assets
No. of correctly guessed photos as a
function of the played game rounds
Indomilando cultural flavor
Evaluating educational incentive (2/2)
Subjective analysis of cultural incentive through user questionnaire
What motivated you to play? Did you learn anything new about Milano?
 guessing it right
 leaderboard
 learning something new
Conclusions
Indomilando is effective to achieve its ranking purpose
Resulting rank highly correlated to a ground truth
Outcome achieved in a very limited time
Indomilando shows a good engagement potential
Most players find the game fun
User group spending a significantly long time in playing
Indomilando has a learning/educational effect
Players are motivated to acquire new knowledge
Interplay of ranking purpose and educational incentive to be further investigated
Indomilando promoted by Lombardy
http://l15.regione.lombardia.it/
Analysis of a Cultural Heritage Game with a
Purpose with an Educational Incentive
Irene Celino, AndreaFiano andRiccardoFino
Thank you!
Additional material can be found at http://swa.cefriel.it/urbangames/indomilando/icwe2016.html
http://bit.ly/indomilando

More Related Content

More from Irene Celino

More from Irene Celino (20)

Human Computation
Human ComputationHuman Computation
Human Computation
 
Ninja Riders - Youth and Road Safety: Discovering Urban Mobility Behaviours
Ninja Riders - Youth and Road Safety: Discovering Urban Mobility BehavioursNinja Riders - Youth and Road Safety: Discovering Urban Mobility Behaviours
Ninja Riders - Youth and Road Safety: Discovering Urban Mobility Behaviours
 
BotDCAT-AP: An Extension of the DCAT Application Profile for Describing Datas...
BotDCAT-AP: An Extension of the DCAT Application Profile for Describing Datas...BotDCAT-AP: An Extension of the DCAT Application Profile for Describing Datas...
BotDCAT-AP: An Extension of the DCAT Application Profile for Describing Datas...
 
Give and Take in Citizen Science
Give and Take in Citizen ScienceGive and Take in Citizen Science
Give and Take in Citizen Science
 
Ninja Riders @ Human Factory Day 2017
Ninja Riders @ Human Factory Day 2017Ninja Riders @ Human Factory Day 2017
Ninja Riders @ Human Factory Day 2017
 
Night Knights: exploiting games to engage people in a citizen science campaign
Night Knights: exploiting games to engage people in a citizen science campaignNight Knights: exploiting games to engage people in a citizen science campaign
Night Knights: exploiting games to engage people in a citizen science campaign
 
STARS4ALL-CAPSSI-Workshop
STARS4ALL-CAPSSI-WorkshopSTARS4ALL-CAPSSI-Workshop
STARS4ALL-CAPSSI-Workshop
 
Towards Talkin'Piazza: Engaging Citizens through Playful Interaction with Urb...
Towards Talkin'Piazza: Engaging Citizens through Playful Interaction with Urb...Towards Talkin'Piazza: Engaging Citizens through Playful Interaction with Urb...
Towards Talkin'Piazza: Engaging Citizens through Playful Interaction with Urb...
 
SSSW 2016 Cognition Tutorial
SSSW 2016 Cognition TutorialSSSW 2016 Cognition Tutorial
SSSW 2016 Cognition Tutorial
 
Supporting Geo-Ontology Engineering through Spatial Data Analytics
Supporting Geo-Ontology Engineering through Spatial Data AnalyticsSupporting Geo-Ontology Engineering through Spatial Data Analytics
Supporting Geo-Ontology Engineering through Spatial Data Analytics
 
Smart City Semantics - Data Analytics and Human Computation to understand the...
Smart City Semantics - Data Analytics and Human Computation to understand the...Smart City Semantics - Data Analytics and Human Computation to understand the...
Smart City Semantics - Data Analytics and Human Computation to understand the...
 
Towards a Semantic City Service Ecosystem
Towards a Semantic City Service EcosystemTowards a Semantic City Service Ecosystem
Towards a Semantic City Service Ecosystem
 
Living Land Use - Telecom Big Data Challenge - Trento ICT Days 2014
Living Land Use - Telecom Big Data Challenge - Trento ICT Days 2014Living Land Use - Telecom Big Data Challenge - Trento ICT Days 2014
Living Land Use - Telecom Big Data Challenge - Trento ICT Days 2014
 
Urbanopoly @ PlanetData review
Urbanopoly @ PlanetData reviewUrbanopoly @ PlanetData review
Urbanopoly @ PlanetData review
 
Urbanopoly: Collection and Quality Assessment of Geo-spatial Linked Data via ...
Urbanopoly: Collection and Quality Assessment of Geo-spatial Linked Data via ...Urbanopoly: Collection and Quality Assessment of Geo-spatial Linked Data via ...
Urbanopoly: Collection and Quality Assessment of Geo-spatial Linked Data via ...
 
Urbanopoly minute madness
Urbanopoly minute madnessUrbanopoly minute madness
Urbanopoly minute madness
 
Linking Smart Cities Datasets with Human Computation - the case of UrbanMatch
Linking Smart Cities Datasets with Human Computation - the case of UrbanMatchLinking Smart Cities Datasets with Human Computation - the case of UrbanMatch
Linking Smart Cities Datasets with Human Computation - the case of UrbanMatch
 
Urbanopoly @ SoHuman - SocialCom 2012
Urbanopoly @ SoHuman - SocialCom 2012Urbanopoly @ SoHuman - SocialCom 2012
Urbanopoly @ SoHuman - SocialCom 2012
 
UrbanGames in PlanetData: introducing Urbanopoly
UrbanGames in PlanetData: introducing UrbanopolyUrbanGames in PlanetData: introducing Urbanopoly
UrbanGames in PlanetData: introducing Urbanopoly
 
UrbanMatch - linking and improving Smart Cities Data
UrbanMatch - linking and improving Smart Cities DataUrbanMatch - linking and improving Smart Cities Data
UrbanMatch - linking and improving Smart Cities Data
 

Recently uploaded

Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
panagenda
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc
 

Recently uploaded (20)

Intro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxIntro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptx
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
 
Top 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development CompaniesTop 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development Companies
 
WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024
 
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
 
AI mind or machine power point presentation
AI mind or machine power point presentationAI mind or machine power point presentation
AI mind or machine power point presentation
 
Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024
 
The Metaverse: Are We There Yet?
The  Metaverse:    Are   We  There  Yet?The  Metaverse:    Are   We  There  Yet?
The Metaverse: Are We There Yet?
 
2024 May Patch Tuesday
2024 May Patch Tuesday2024 May Patch Tuesday
2024 May Patch Tuesday
 
Overview of Hyperledger Foundation
Overview of Hyperledger FoundationOverview of Hyperledger Foundation
Overview of Hyperledger Foundation
 
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdfFrisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024
 
Event-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream ProcessingEvent-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream Processing
 
Using IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandUsing IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & Ireland
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
 
Oauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoftOauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoft
 
JavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuideJavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate Guide
 
ChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps Productivity
 
Portal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russePortal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russe
 

Analysis of a Cultural Heritage Game with a Purpose with an Educational Incentive

  • 1. Analysis of a Cultural Heritage Game with a Purpose with an Educational Incentive Irene Celino, Andrea Fiano and Riccardo Fino CEFRIEL – Milano, Italy paper: http://dx.doi.org/10.1007/978-3-319-38791-8_28
  • 2. Introduction and motivation Cultural Heritage (CH) Game with a Purpose (GWAP) Gameplay: quiz to guess a CH asset from four different images Purpose: ranking images of CH assets Collateral effect: learning about CH Evaluation of the CH GWAP: Effectiveness to achieve its ranking purpose Ability to engage and retain players Potential effect of the educational/cultural incentive
  • 3. Indomilando gameplay Images of CH architectures in the city of Milano Churches, villas, buildings, schools, towers, … 1 name/title and 4 photos (of 4 different assets) Link to official asset record Map to explore CH assets the user played with http://bit.ly/indomilando
  • 4. Intuitively, a photo is recognizable if it is correctly guessed more frequently Conservative measure: lower bound of Wilson score interval But some categories are more recognizable than others (e.g. buildings are difficult)  correction: standardization by asset type Final photo rank score: Indomilando purpose Computing photo ranking p: observed fraction of successes (=photo guessed) z2 α/2: (1 - α/2) quantile of the standard normal distribution n: total number of trials (=photo played)
  • 5. Indomilando purpose Computing CH asset ranking Intuitively, an asset rank score corresponds to the average of its photos’ rank scores But each asset has a different no. of photos (1-40)  correction for number of photos But each set of photos can be heterogeneous (mix of good and bad photos)  correction for photo inhomogeneity Final asset rank score:
  • 6. Indomilando purpose Evaluating ability to rank Comparison with no. of visits of assets’ Wikipedia pages (when existing) But no. of Wikipedia visits is more a sign of “popularity” than “recognisability” Comparison with ground truth Best photo of top-10 Wikipedia assets Manual ranking by 12 users Rank aggregation weighted by declared familiarity with Milano CH Good ability to rank and much more time-effective  Each manual ranker: avg. of 1 min 27 sec to rank 10 assets Indomilando: 72 players with avg. of 7.5 min to rank ~1400 photos and ~650 assets
  • 7. Indomilando gaming flavor Evaluating players engagement ALP (Average Life Play): 7.5 min Left-skewed distribution (long tail) Median < 3 min Two user groups (+ “outliers”) Subjective analysis of engagement through user questionnaire Players like it 
  • 8. Indomilando cultural flavor Evaluating educational incentive (1/2) Possibility to explore CH official records between game rounds (map exploration) Two rounds consecutive if < 15 min Distribution of “exploration” time Possibility to learn over time to recognize CH assets No. of correctly guessed photos as a function of the played game rounds
  • 9. Indomilando cultural flavor Evaluating educational incentive (2/2) Subjective analysis of cultural incentive through user questionnaire What motivated you to play? Did you learn anything new about Milano?  guessing it right  leaderboard  learning something new
  • 10. Conclusions Indomilando is effective to achieve its ranking purpose Resulting rank highly correlated to a ground truth Outcome achieved in a very limited time Indomilando shows a good engagement potential Most players find the game fun User group spending a significantly long time in playing Indomilando has a learning/educational effect Players are motivated to acquire new knowledge Interplay of ranking purpose and educational incentive to be further investigated
  • 11. Indomilando promoted by Lombardy http://l15.regione.lombardia.it/
  • 12. Analysis of a Cultural Heritage Game with a Purpose with an Educational Incentive Irene Celino, AndreaFiano andRiccardoFino Thank you! Additional material can be found at http://swa.cefriel.it/urbangames/indomilando/icwe2016.html http://bit.ly/indomilando