SlideShare a Scribd company logo
1 of 22
Download to read offline
GAMES WITH A
PURPOSE
ELENA SIMPERL
UNIVERSITY OF SOUTHAMPTON
7/18/2013
Tutorial@ESWC2013
1
GAMES AND
GAMIFICATION
GAMES WITH A PURPOSE
7/18/2013
2
Tutorial@ESWC2013
GAMES WITH A
PURPOSE (GWAP)
โ€ž a human-based computation technique in which a
computational process performs its function by outsourcing
certain steps to humans in an entertaining wayโ€
[Wikipedia]
RELATED:
GAMIFICATION
โ€œuse of game play mechanics for non-game applications [โ€ฆ] in
order to encourage people to adopt the applicationsโ€
[Wikipedia]
Image from http://gapingvoid.com/2011/06/07/pixie-dust-the-mountain-of-
mediocrity/
HOW TO IMPLEMENT
GAMIFICATION*
โ€ข Cosmetic: adding game-like visual elements or copy
(usually visual design or copy-driven)
โ€ข Accessory: wedging in easy-to-add-on game elements,
such as badges or adjacent products (usually marketing-
driven)
โ€ข Integrated: more subtle, deeply integrated elements like %
complete (usually interaction-design driven)
โ€ข Basis: making the entire offering a game (usually product-
driven)
* http://uxmag.com/design/a-gamification-framework-for-interaction-
designers
GAMIFICATION
FEATURES*
โ€ข Accelerated feedback cycles
โ€ข Annual performance appraisals vs immediate feedback to
maintain engagement.
โ€ข Clear goals and rules of play
โ€ข Players feel empowered to achieve goals vs fuzzy, complex
system of rules in real-world.
โ€ข Compelling narrative
โ€ข Gamification builds a narrative that engages players to
participate and achieve the goals of the activity
*http://www.gartner.com/it/page.jsp?id=1629214
WHAT TASKS CAN BE
SUBJECT TO A GAME?*
โ€ข Decomposable into simpler tasks
โ€ข Nested tasks
โ€ข Performance is measurable
โ€ข Obvious rewarding scheme
โ€ข Skills can be arranged in a smooth learning curve
*http://www.lostgarden.com/2008/06/what-actitivies-that-can-be-turned-
into.html
EXAMPLE: GAME ELEMENTS
IN TAG-A-TUNE
โ€ข Task is decomposable
โ€ข Audio annotation one
tune per game round
โ€ข No nested tasks
โ€ข Performance:
consensus, bonus round
on rating audios
7/18/2013
Tutorial@ESWC2013
8
Players decide whether they listen to the same
tune by exchanging free-text hints
EXAMPLE: GAMIFIED
HEALTHCARE
โ€ข eCommerce solution provider, loyality management,
gamification
โ€ข Goal: motivate employees to exercise ; reduces health
insurance costs and increases productivity
โ€ข How
โ€ข Installed gyms in offices and built custom application to
check in to each workout; competition with cash prize ๏ƒ 
12% employees
โ€ข Fitness as a team sport: form regional teams competing
against each other; leaderboards ๏ƒ  70% employees
7/18/2013
Tutorial@ESWC201
9
DIMENSIONS
OF GWAP
DESIGN
GAMES WITH A PURPOSE
7/18/2013
10
Tutorial@ESWC201
DIMENSIONS OF
GWAP DESIGN
WHAT IS THE PURPOSE OF THE GAME
โ€ข Concrete specification of the task
โ€ข Example: annotation of a set of 500,000 images using free labels,
controlled vocabulary etc
โ€ข Where does the input data come from? How much noise can you
expect in the data?
โ€ข Example: validating the results of algorithms; poor input data
hampers UX
HOW CAN IT BE TRANSLATED INTO DECOMPOSABLE TASKS
โ€ข Repetitive tasks vs. player experience; see motivation
7/18/2013
Tutorial@ESWC201
11
DIMENSIONS OF
GWAP DESIGN (2)
WHAT SUB-TASKS CAN YOU IDENTIFY
โ€ข Number of interrelated steps in a casual game and
granularity of tasks
HOW DOES THE HUMAN READABLE DESCRIPTION OF THE
TASK LOOK LIKE
โ€ข See Linked Data examples
7/18/2013
Tutorial@ESWC2013
12
DIMENSIONS OF
GWAP DESIGN (3)
HOW TO YOU MEASURE PERFORMANCE
โ€ข Redundancy (output-agreement games)
โ€ข Consensus (input agreement, cf Tag-A-Tune)
โ€ข Describer - guesser
WHAT DO USERS RECEIVE POINTS FOR, WHEN, AND HOW
MANY
โ€ข Mechanism design
Note: tasks cannot be too difficult, otherwise the tasks feel
like work; they have to be interesting and intellectually
challenging, otherwise the game is boring; players should be
able to get better at it during the game.
7/18/2013
Tutorial@ESWC201
13
SINGLE VS. MULTI-
PLAYER GAMES
โ€ข Multi-player games
โ€ข UX (player appreciate social contact and intellectual
challenge)
โ€ข Consensus mechanism, less spam
โ€ข Rapid feedback cycles
โ€ข But: requires playersโ€™ matching functionality and enough
players in the system at the same time
โ€ข Can be simulated using bots and (lots of) pre-recorded
rounds
โ€ข Single-player games
โ€ข Different quality assurance method (player receives reward
once correct answer is determined); or
โ€ข Training data available to build initial profile
7/18/2013
Tutorial@ESWC2013
14
VERBOSITY AS
INVERSION PROBLEM
GAME
7/18/2013
Tutorial@ESWC2013
15
TASKS SHOULD BE
SOLVABLE
7/18/2013
Tutorial@ESWC2013
16
MECHANISM DESIGN
โ€ข Area of game theory
โ€ข Game designer defining the structure of the game
โ€ข Game designer is interested in specific outcomes and
attempts to influence playersโ€™ behavior to achieve these
outcomes
โ€ข Different reward models can be applied
โ€ข Pay-per-item vs winner-takes-it-all
โ€ข Competitions among individuals and teams
โ€ข How to price contributions
โ€ข These parameters will change the behavior of the users in the
system
7/18/2013
Tutorial@ESWC2013
17
DIMENSIONS OF
GWAP DESIGN (4)
HOW DO YOU TRANSLATE CROWD INPUTS INTO
VALIDATED ANSWERS
โ€ข When are two answers the same
โ€ข How many assignments per question
โ€ข Playerโ€™s reliability, spam
HOW DO YOU ASSIGN CHALLENGES TO PLAYERS
โ€ข Random vs based on previous performance
โ€ข The same about players matching
7/18/2013
Tutorial@ESWC2013
18
DIMENSIONS OF
GWAP DESIGN (5)
WHAT ADDITIONAL GAME
ELEMENTS CAN YOU INCLUDE
โ€ข Different types of players*
โ€ข Useful information (tabu lists)
โ€ข Levels of difficulty (requires
knowledge of the problem space)
โ€ข Timing adds a sense of urgency,
feels more like play and less like
work
โ€ข Leader boards, badges,
appointment dynamics
*http://www.gamasutra.com/blogs/Vi
ctorManrique/20130524/193007/Gam
ification_Player_Types_The_TimeEn
gagement_Pyramid.php
7/18/2013
Tutorial@ESWC2013
19
GAME MECHANICS:
LEADERBOARDS*
โ€ข Global: top-players
โ€ข Local: user can find himself, has
attainable objective
โ€ข Friends: user competes and interacts
with players he feels emotionally
attached to
โ€ข Filtered: e.g., all players in one area,
creates a sense of community
โ€ข Aggregates: e.g., for teams,
encourage cooperation, create social
pressure
*http://blog.badgeville.com/2013/03/15/g
ame-mechanics-leaderboards-pt1/
7/18/2013
Tutorial@ESWC2013
20
CONCLUSIONS
GWAPs are a useful concept for intellectually challenging,
but solvable, fine-granular tasks, in domains appealing for
mainstream casual Internet users
Game mechanics need careful tuning to be effective
7/18/2013
Tutorial@ESWC201
21
e.simperl@soton.ac.uk @esimperl
7/18/2013
Tutorial@ESWC201
22
THANK YOU

More Related Content

Similar to Games with a purpose

Openbadges for e-assessment - e-assessment scotland 2013
Openbadges for e-assessment - e-assessment scotland 2013Openbadges for e-assessment - e-assessment scotland 2013
Openbadges for e-assessment - e-assessment scotland 2013
stevesidaway
ย 

Similar to Games with a purpose (20)

WEEF/GEDC eMadrid_Systematizing Game Learning Analytics for Improving Serious...
WEEF/GEDC eMadrid_Systematizing Game Learning Analytics for Improving Serious...WEEF/GEDC eMadrid_Systematizing Game Learning Analytics for Improving Serious...
WEEF/GEDC eMadrid_Systematizing Game Learning Analytics for Improving Serious...
ย 
Icce21 systematizing game learning analytics for improving serious games life...
Icce21 systematizing game learning analytics for improving serious games life...Icce21 systematizing game learning analytics for improving serious games life...
Icce21 systematizing game learning analytics for improving serious games life...
ย 
Rev gaming learning analytics rage and beaconing
Rev gaming learning analytics  rage and beaconingRev gaming learning analytics  rage and beaconing
Rev gaming learning analytics rage and beaconing
ย 
SAVE ENERGY_WP3+5_Presentation_CKIR
SAVE ENERGY_WP3+5_Presentation_CKIRSAVE ENERGY_WP3+5_Presentation_CKIR
SAVE ENERGY_WP3+5_Presentation_CKIR
ย 
Lec 04. The way to production: game testing and analytics
Lec 04. The way to production: game testing and analyticsLec 04. The way to production: game testing and analytics
Lec 04. The way to production: game testing and analytics
ย 
Learning Analytics Design in Game-based Learning
Learning Analytics Design in Game-based LearningLearning Analytics Design in Game-based Learning
Learning Analytics Design in Game-based Learning
ย 
Dsdt meetup 2018 02-12
Dsdt meetup 2018 02-12Dsdt meetup 2018 02-12
Dsdt meetup 2018 02-12
ย 
DSDT Meetup February 2018
DSDT Meetup February 2018DSDT Meetup February 2018
DSDT Meetup February 2018
ย 
Dsdt meetup 2018
Dsdt meetup 2018 Dsdt meetup 2018
Dsdt meetup 2018
ย 
Openbadges for e-Assessment
Openbadges for e-AssessmentOpenbadges for e-Assessment
Openbadges for e-Assessment
ย 
A Framework to build Games with a Purpose for Linked Data Re๏ฌnement
A Framework to build Games with a Purpose  for Linked Data Re๏ฌnementA Framework to build Games with a Purpose  for Linked Data Re๏ฌnement
A Framework to build Games with a Purpose for Linked Data Re๏ฌnement
ย 
Openbadges for e-assessment - e-assessment scotland 2013
Openbadges for e-assessment - e-assessment scotland 2013Openbadges for e-assessment - e-assessment scotland 2013
Openbadges for e-assessment - e-assessment scotland 2013
ย 
Gamification for Business, Training and Education
Gamification for Business, Training and EducationGamification for Business, Training and Education
Gamification for Business, Training and Education
ย 
Using Game Learning Analytics to Improve the Design, Evaluation and Deploymen...
Using Game Learning Analytics to Improve the Design, Evaluation and Deploymen...Using Game Learning Analytics to Improve the Design, Evaluation and Deploymen...
Using Game Learning Analytics to Improve the Design, Evaluation and Deploymen...
ย 
Holistic player modeling for controlling adaptation in video games
Holistic player modeling for controlling adaptation in video gamesHolistic player modeling for controlling adaptation in video games
Holistic player modeling for controlling adaptation in video games
ย 
Applying Machine Learning for Mobile Games by Neil Patrick Del Gallego
Applying Machine Learning for Mobile Games by Neil Patrick Del GallegoApplying Machine Learning for Mobile Games by Neil Patrick Del Gallego
Applying Machine Learning for Mobile Games by Neil Patrick Del Gallego
ย 
Tcea 2014 Video Game Design for New TEKS
Tcea 2014   Video Game Design for New TEKSTcea 2014   Video Game Design for New TEKS
Tcea 2014 Video Game Design for New TEKS
ย 
GAMING BOT USING REINFORCEMENT LEARNING
GAMING BOT USING REINFORCEMENT LEARNINGGAMING BOT USING REINFORCEMENT LEARNING
GAMING BOT USING REINFORCEMENT LEARNING
ย 
IRJET- Clustering Students through Data Mining and Gamified Learning
IRJET- Clustering Students through Data Mining and Gamified LearningIRJET- Clustering Students through Data Mining and Gamified Learning
IRJET- Clustering Students through Data Mining and Gamified Learning
ย 
Game analytics - The challenges of mobile free-to-play games
Game analytics - The challenges of mobile free-to-play gamesGame analytics - The challenges of mobile free-to-play games
Game analytics - The challenges of mobile free-to-play games
ย 

More from Elena Simperl

One does not simply crowdsource the Semantic Web: 10 years with people, URIs,...
One does not simply crowdsource the Semantic Web: 10 years with people, URIs,...One does not simply crowdsource the Semantic Web: 10 years with people, URIs,...
One does not simply crowdsource the Semantic Web: 10 years with people, URIs,...
Elena Simperl
ย 

More from Elena Simperl (20)

This talk was not generated with ChatGPT: how AI is changing science
This talk was not generated with ChatGPT: how AI is changing scienceThis talk was not generated with ChatGPT: how AI is changing science
This talk was not generated with ChatGPT: how AI is changing science
ย 
Knowledge graph use cases in natural language generation
Knowledge graph use cases in natural language generationKnowledge graph use cases in natural language generation
Knowledge graph use cases in natural language generation
ย 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
ย 
The web of data: how are we doing so far
The web of data: how are we doing so farThe web of data: how are we doing so far
The web of data: how are we doing so far
ย 
What Wikidata teaches us about knowledge engineering
What Wikidata teaches us about knowledge engineeringWhat Wikidata teaches us about knowledge engineering
What Wikidata teaches us about knowledge engineering
ย 
Open government data portals: from publishing to use and impact
Open government data portals: from publishing to use and impactOpen government data portals: from publishing to use and impact
Open government data portals: from publishing to use and impact
ย 
Ten myths about knowledge graphs.pdf
Ten myths about knowledge graphs.pdfTen myths about knowledge graphs.pdf
Ten myths about knowledge graphs.pdf
ย 
What Wikidata teaches us about knowledge engineering
What Wikidata teaches us about knowledge engineeringWhat Wikidata teaches us about knowledge engineering
What Wikidata teaches us about knowledge engineering
ย 
Data commons and their role in fighting misinformation.pdf
Data commons and their role in fighting misinformation.pdfData commons and their role in fighting misinformation.pdf
Data commons and their role in fighting misinformation.pdf
ย 
Are our knowledge graphs trustworthy?
Are our knowledge graphs trustworthy?Are our knowledge graphs trustworthy?
Are our knowledge graphs trustworthy?
ย 
The web of data: how are we doing so far?
The web of data: how are we doing so far?The web of data: how are we doing so far?
The web of data: how are we doing so far?
ย 
Crowdsourcing and citizen engagement for people-centric smart cities
Crowdsourcing and citizen engagement for people-centric smart citiesCrowdsourcing and citizen engagement for people-centric smart cities
Crowdsourcing and citizen engagement for people-centric smart cities
ย 
Pie chart or pizza: identifying chart types and their virality on Twitter
Pie chart or pizza: identifying chart types and their virality on TwitterPie chart or pizza: identifying chart types and their virality on Twitter
Pie chart or pizza: identifying chart types and their virality on Twitter
ย 
High-value datasets: from publication to impact
High-value datasets: from publication to impactHigh-value datasets: from publication to impact
High-value datasets: from publication to impact
ย 
The story of Data Stories
The story of Data StoriesThe story of Data Stories
The story of Data Stories
ย 
The human face of AI: how collective and augmented intelligence can help sol...
The human face of AI:  how collective and augmented intelligence can help sol...The human face of AI:  how collective and augmented intelligence can help sol...
The human face of AI: how collective and augmented intelligence can help sol...
ย 
Qrowd and the city: designing people-centric smart cities
Qrowd and the city: designing people-centric smart citiesQrowd and the city: designing people-centric smart cities
Qrowd and the city: designing people-centric smart cities
ย 
One does not simply crowdsource the Semantic Web: 10 years with people, URIs,...
One does not simply crowdsource the Semantic Web: 10 years with people, URIs,...One does not simply crowdsource the Semantic Web: 10 years with people, URIs,...
One does not simply crowdsource the Semantic Web: 10 years with people, URIs,...
ย 
Qrowd and the city
Qrowd and the cityQrowd and the city
Qrowd and the city
ย 
Inclusive cities: a crowdsourcing approach
Inclusive cities: a crowdsourcing approachInclusive cities: a crowdsourcing approach
Inclusive cities: a crowdsourcing approach
ย 

Recently uploaded

VIP Model Call Girls Koregaon Park ( Pune ) Call ON 8005736733 Starting From ...
VIP Model Call Girls Koregaon Park ( Pune ) Call ON 8005736733 Starting From ...VIP Model Call Girls Koregaon Park ( Pune ) Call ON 8005736733 Starting From ...
VIP Model Call Girls Koregaon Park ( Pune ) Call ON 8005736733 Starting From ...
SUHANI PANDEY
ย 
Jodhpur Park ( Call Girls ) Kolkata โœ” 6297143586 โœ” Hot Model With Sexy Bhabi ...
Jodhpur Park ( Call Girls ) Kolkata โœ” 6297143586 โœ” Hot Model With Sexy Bhabi ...Jodhpur Park ( Call Girls ) Kolkata โœ” 6297143586 โœ” Hot Model With Sexy Bhabi ...
Jodhpur Park ( Call Girls ) Kolkata โœ” 6297143586 โœ” Hot Model With Sexy Bhabi ...
ritikasharma
ย 
Behala ( Call Girls ) Kolkata โœ” 6297143586 โœ” Hot Model With Sexy Bhabi Ready ...
Behala ( Call Girls ) Kolkata โœ” 6297143586 โœ” Hot Model With Sexy Bhabi Ready ...Behala ( Call Girls ) Kolkata โœ” 6297143586 โœ” Hot Model With Sexy Bhabi Ready ...
Behala ( Call Girls ) Kolkata โœ” 6297143586 โœ” Hot Model With Sexy Bhabi Ready ...
ritikasharma
ย 
Top Rated Kolkata Call Girls Dum Dum โŸŸ 6297143586 โŸŸ Call Me For Genuine Sex S...
Top Rated Kolkata Call Girls Dum Dum โŸŸ 6297143586 โŸŸ Call Me For Genuine Sex S...Top Rated Kolkata Call Girls Dum Dum โŸŸ 6297143586 โŸŸ Call Me For Genuine Sex S...
Top Rated Kolkata Call Girls Dum Dum โŸŸ 6297143586 โŸŸ Call Me For Genuine Sex S...
ritikasharma
ย 
Verified Trusted Call Girls Ambattur Chennai โœ”โœ”7427069034 Independent Chenna...
Verified Trusted Call Girls Ambattur Chennai โœ”โœ”7427069034  Independent Chenna...Verified Trusted Call Girls Ambattur Chennai โœ”โœ”7427069034  Independent Chenna...
Verified Trusted Call Girls Ambattur Chennai โœ”โœ”7427069034 Independent Chenna...
Shivani Pandey
ย 
Hotel And Home Service Available Kolkata Call Girls Lake Town โœ” 6297143586 โœ”C...
Hotel And Home Service Available Kolkata Call Girls Lake Town โœ” 6297143586 โœ”C...Hotel And Home Service Available Kolkata Call Girls Lake Town โœ” 6297143586 โœ”C...
Hotel And Home Service Available Kolkata Call Girls Lake Town โœ” 6297143586 โœ”C...
ritikasharma
ย 
Navsari Escorts Service โ˜Ž๏ธ 6378878445 ( Sakshi Sinha ) High Profile Call Girl...
Navsari Escorts Service โ˜Ž๏ธ 6378878445 ( Sakshi Sinha ) High Profile Call Girl...Navsari Escorts Service โ˜Ž๏ธ 6378878445 ( Sakshi Sinha ) High Profile Call Girl...
Navsari Escorts Service โ˜Ž๏ธ 6378878445 ( Sakshi Sinha ) High Profile Call Girl...
mriyagarg453
ย 
Hotel And Home Service Available Kolkata Call Girls Howrah โœ” 6297143586 โœ”Call...
Hotel And Home Service Available Kolkata Call Girls Howrah โœ” 6297143586 โœ”Call...Hotel And Home Service Available Kolkata Call Girls Howrah โœ” 6297143586 โœ”Call...
Hotel And Home Service Available Kolkata Call Girls Howrah โœ” 6297143586 โœ”Call...
ritikasharma
ย 
Model Call Girls In Ariyalur WhatsApp Booking 7427069034 call girl service 24...
Model Call Girls In Ariyalur WhatsApp Booking 7427069034 call girl service 24...Model Call Girls In Ariyalur WhatsApp Booking 7427069034 call girl service 24...
Model Call Girls In Ariyalur WhatsApp Booking 7427069034 call girl service 24...
Shivani Pandey
ย 
Book Sex Workers Available Kolkata Call Girls Service Airport Kolkata โœ” 62971...
Book Sex Workers Available Kolkata Call Girls Service Airport Kolkata โœ” 62971...Book Sex Workers Available Kolkata Call Girls Service Airport Kolkata โœ” 62971...
Book Sex Workers Available Kolkata Call Girls Service Airport Kolkata โœ” 62971...
ritikasharma
ย 
Verified Trusted Call Girls Tambaram Chennai โœ”โœ”7427069034 Independent Chenna...
Verified Trusted Call Girls Tambaram Chennai โœ”โœ”7427069034  Independent Chenna...Verified Trusted Call Girls Tambaram Chennai โœ”โœ”7427069034  Independent Chenna...
Verified Trusted Call Girls Tambaram Chennai โœ”โœ”7427069034 Independent Chenna...
Shivani Pandey
ย 
๐“€คCall On 6297143586 ๐“€ค Ultadanga Call Girls In All Kolkata 24/7 Provide Call W...
๐“€คCall On 6297143586 ๐“€ค Ultadanga Call Girls In All Kolkata 24/7 Provide Call W...๐“€คCall On 6297143586 ๐“€ค Ultadanga Call Girls In All Kolkata 24/7 Provide Call W...
๐“€คCall On 6297143586 ๐“€ค Ultadanga Call Girls In All Kolkata 24/7 Provide Call W...
rahim quresi
ย 
Verified Trusted Call Girls Singaperumal Koil Chennai โœ”โœ”7427069034 Independe...
Verified Trusted Call Girls Singaperumal Koil Chennai โœ”โœ”7427069034  Independe...Verified Trusted Call Girls Singaperumal Koil Chennai โœ”โœ”7427069034  Independe...
Verified Trusted Call Girls Singaperumal Koil Chennai โœ”โœ”7427069034 Independe...
Shivani Pandey
ย 
Hotel And Home Service Available Kolkata Call Girls Sonagachi โœ” 6297143586 โœ”C...
Hotel And Home Service Available Kolkata Call Girls Sonagachi โœ” 6297143586 โœ”C...Hotel And Home Service Available Kolkata Call Girls Sonagachi โœ” 6297143586 โœ”C...
Hotel And Home Service Available Kolkata Call Girls Sonagachi โœ” 6297143586 โœ”C...
ritikasharma
ย 

Recently uploaded (20)

โคPersonal Whatsapp Number Keylong Call Girls 8617697112 ๐Ÿ’ฆโœ….
โคPersonal Whatsapp Number Keylong Call Girls 8617697112 ๐Ÿ’ฆโœ….โคPersonal Whatsapp Number Keylong Call Girls 8617697112 ๐Ÿ’ฆโœ….
โคPersonal Whatsapp Number Keylong Call Girls 8617697112 ๐Ÿ’ฆโœ….
ย 
VIP Model Call Girls Koregaon Park ( Pune ) Call ON 8005736733 Starting From ...
VIP Model Call Girls Koregaon Park ( Pune ) Call ON 8005736733 Starting From ...VIP Model Call Girls Koregaon Park ( Pune ) Call ON 8005736733 Starting From ...
VIP Model Call Girls Koregaon Park ( Pune ) Call ON 8005736733 Starting From ...
ย 
Top Rated Pune Call Girls Dhayari โŸŸ 6297143586 โŸŸ Call Me For Genuine Sex Ser...
Top Rated  Pune Call Girls Dhayari โŸŸ 6297143586 โŸŸ Call Me For Genuine Sex Ser...Top Rated  Pune Call Girls Dhayari โŸŸ 6297143586 โŸŸ Call Me For Genuine Sex Ser...
Top Rated Pune Call Girls Dhayari โŸŸ 6297143586 โŸŸ Call Me For Genuine Sex Ser...
ย 
Jodhpur Park ( Call Girls ) Kolkata โœ” 6297143586 โœ” Hot Model With Sexy Bhabi ...
Jodhpur Park ( Call Girls ) Kolkata โœ” 6297143586 โœ” Hot Model With Sexy Bhabi ...Jodhpur Park ( Call Girls ) Kolkata โœ” 6297143586 โœ” Hot Model With Sexy Bhabi ...
Jodhpur Park ( Call Girls ) Kolkata โœ” 6297143586 โœ” Hot Model With Sexy Bhabi ...
ย 
Top Rated Pune Call Girls Pimpri Chinchwad โŸŸ 6297143586 โŸŸ Call Me For Genuin...
Top Rated  Pune Call Girls Pimpri Chinchwad โŸŸ 6297143586 โŸŸ Call Me For Genuin...Top Rated  Pune Call Girls Pimpri Chinchwad โŸŸ 6297143586 โŸŸ Call Me For Genuin...
Top Rated Pune Call Girls Pimpri Chinchwad โŸŸ 6297143586 โŸŸ Call Me For Genuin...
ย 
Behala ( Call Girls ) Kolkata โœ” 6297143586 โœ” Hot Model With Sexy Bhabi Ready ...
Behala ( Call Girls ) Kolkata โœ” 6297143586 โœ” Hot Model With Sexy Bhabi Ready ...Behala ( Call Girls ) Kolkata โœ” 6297143586 โœ” Hot Model With Sexy Bhabi Ready ...
Behala ( Call Girls ) Kolkata โœ” 6297143586 โœ” Hot Model With Sexy Bhabi Ready ...
ย 
๐Ÿ“ž Contact Number 8617697112 VIP East Sikkim Call Girls
๐Ÿ“ž Contact Number 8617697112 VIP East Sikkim Call Girls๐Ÿ“ž Contact Number 8617697112 VIP East Sikkim Call Girls
๐Ÿ“ž Contact Number 8617697112 VIP East Sikkim Call Girls
ย 
Top Rated Kolkata Call Girls Dum Dum โŸŸ 6297143586 โŸŸ Call Me For Genuine Sex S...
Top Rated Kolkata Call Girls Dum Dum โŸŸ 6297143586 โŸŸ Call Me For Genuine Sex S...Top Rated Kolkata Call Girls Dum Dum โŸŸ 6297143586 โŸŸ Call Me For Genuine Sex S...
Top Rated Kolkata Call Girls Dum Dum โŸŸ 6297143586 โŸŸ Call Me For Genuine Sex S...
ย 
Verified Trusted Call Girls Ambattur Chennai โœ”โœ”7427069034 Independent Chenna...
Verified Trusted Call Girls Ambattur Chennai โœ”โœ”7427069034  Independent Chenna...Verified Trusted Call Girls Ambattur Chennai โœ”โœ”7427069034  Independent Chenna...
Verified Trusted Call Girls Ambattur Chennai โœ”โœ”7427069034 Independent Chenna...
ย 
2k Shot Call girls Laxmi Nagar Delhi 9205541914
2k Shot Call girls Laxmi Nagar Delhi 92055419142k Shot Call girls Laxmi Nagar Delhi 9205541914
2k Shot Call girls Laxmi Nagar Delhi 9205541914
ย 
Kanpur call girls ๐Ÿ“ž 8617697112 At Low Cost Cash Payment Booking
Kanpur call girls ๐Ÿ“ž 8617697112 At Low Cost Cash Payment BookingKanpur call girls ๐Ÿ“ž 8617697112 At Low Cost Cash Payment Booking
Kanpur call girls ๐Ÿ“ž 8617697112 At Low Cost Cash Payment Booking
ย 
Hotel And Home Service Available Kolkata Call Girls Lake Town โœ” 6297143586 โœ”C...
Hotel And Home Service Available Kolkata Call Girls Lake Town โœ” 6297143586 โœ”C...Hotel And Home Service Available Kolkata Call Girls Lake Town โœ” 6297143586 โœ”C...
Hotel And Home Service Available Kolkata Call Girls Lake Town โœ” 6297143586 โœ”C...
ย 
Navsari Escorts Service โ˜Ž๏ธ 6378878445 ( Sakshi Sinha ) High Profile Call Girl...
Navsari Escorts Service โ˜Ž๏ธ 6378878445 ( Sakshi Sinha ) High Profile Call Girl...Navsari Escorts Service โ˜Ž๏ธ 6378878445 ( Sakshi Sinha ) High Profile Call Girl...
Navsari Escorts Service โ˜Ž๏ธ 6378878445 ( Sakshi Sinha ) High Profile Call Girl...
ย 
Hotel And Home Service Available Kolkata Call Girls Howrah โœ” 6297143586 โœ”Call...
Hotel And Home Service Available Kolkata Call Girls Howrah โœ” 6297143586 โœ”Call...Hotel And Home Service Available Kolkata Call Girls Howrah โœ” 6297143586 โœ”Call...
Hotel And Home Service Available Kolkata Call Girls Howrah โœ” 6297143586 โœ”Call...
ย 
Model Call Girls In Ariyalur WhatsApp Booking 7427069034 call girl service 24...
Model Call Girls In Ariyalur WhatsApp Booking 7427069034 call girl service 24...Model Call Girls In Ariyalur WhatsApp Booking 7427069034 call girl service 24...
Model Call Girls In Ariyalur WhatsApp Booking 7427069034 call girl service 24...
ย 
Book Sex Workers Available Kolkata Call Girls Service Airport Kolkata โœ” 62971...
Book Sex Workers Available Kolkata Call Girls Service Airport Kolkata โœ” 62971...Book Sex Workers Available Kolkata Call Girls Service Airport Kolkata โœ” 62971...
Book Sex Workers Available Kolkata Call Girls Service Airport Kolkata โœ” 62971...
ย 
Verified Trusted Call Girls Tambaram Chennai โœ”โœ”7427069034 Independent Chenna...
Verified Trusted Call Girls Tambaram Chennai โœ”โœ”7427069034  Independent Chenna...Verified Trusted Call Girls Tambaram Chennai โœ”โœ”7427069034  Independent Chenna...
Verified Trusted Call Girls Tambaram Chennai โœ”โœ”7427069034 Independent Chenna...
ย 
๐“€คCall On 6297143586 ๐“€ค Ultadanga Call Girls In All Kolkata 24/7 Provide Call W...
๐“€คCall On 6297143586 ๐“€ค Ultadanga Call Girls In All Kolkata 24/7 Provide Call W...๐“€คCall On 6297143586 ๐“€ค Ultadanga Call Girls In All Kolkata 24/7 Provide Call W...
๐“€คCall On 6297143586 ๐“€ค Ultadanga Call Girls In All Kolkata 24/7 Provide Call W...
ย 
Verified Trusted Call Girls Singaperumal Koil Chennai โœ”โœ”7427069034 Independe...
Verified Trusted Call Girls Singaperumal Koil Chennai โœ”โœ”7427069034  Independe...Verified Trusted Call Girls Singaperumal Koil Chennai โœ”โœ”7427069034  Independe...
Verified Trusted Call Girls Singaperumal Koil Chennai โœ”โœ”7427069034 Independe...
ย 
Hotel And Home Service Available Kolkata Call Girls Sonagachi โœ” 6297143586 โœ”C...
Hotel And Home Service Available Kolkata Call Girls Sonagachi โœ” 6297143586 โœ”C...Hotel And Home Service Available Kolkata Call Girls Sonagachi โœ” 6297143586 โœ”C...
Hotel And Home Service Available Kolkata Call Girls Sonagachi โœ” 6297143586 โœ”C...
ย 

Games with a purpose

  • 1. GAMES WITH A PURPOSE ELENA SIMPERL UNIVERSITY OF SOUTHAMPTON 7/18/2013 Tutorial@ESWC2013 1
  • 2. GAMES AND GAMIFICATION GAMES WITH A PURPOSE 7/18/2013 2 Tutorial@ESWC2013
  • 3. GAMES WITH A PURPOSE (GWAP) โ€ž a human-based computation technique in which a computational process performs its function by outsourcing certain steps to humans in an entertaining wayโ€ [Wikipedia]
  • 4. RELATED: GAMIFICATION โ€œuse of game play mechanics for non-game applications [โ€ฆ] in order to encourage people to adopt the applicationsโ€ [Wikipedia] Image from http://gapingvoid.com/2011/06/07/pixie-dust-the-mountain-of- mediocrity/
  • 5. HOW TO IMPLEMENT GAMIFICATION* โ€ข Cosmetic: adding game-like visual elements or copy (usually visual design or copy-driven) โ€ข Accessory: wedging in easy-to-add-on game elements, such as badges or adjacent products (usually marketing- driven) โ€ข Integrated: more subtle, deeply integrated elements like % complete (usually interaction-design driven) โ€ข Basis: making the entire offering a game (usually product- driven) * http://uxmag.com/design/a-gamification-framework-for-interaction- designers
  • 6. GAMIFICATION FEATURES* โ€ข Accelerated feedback cycles โ€ข Annual performance appraisals vs immediate feedback to maintain engagement. โ€ข Clear goals and rules of play โ€ข Players feel empowered to achieve goals vs fuzzy, complex system of rules in real-world. โ€ข Compelling narrative โ€ข Gamification builds a narrative that engages players to participate and achieve the goals of the activity *http://www.gartner.com/it/page.jsp?id=1629214
  • 7. WHAT TASKS CAN BE SUBJECT TO A GAME?* โ€ข Decomposable into simpler tasks โ€ข Nested tasks โ€ข Performance is measurable โ€ข Obvious rewarding scheme โ€ข Skills can be arranged in a smooth learning curve *http://www.lostgarden.com/2008/06/what-actitivies-that-can-be-turned- into.html
  • 8. EXAMPLE: GAME ELEMENTS IN TAG-A-TUNE โ€ข Task is decomposable โ€ข Audio annotation one tune per game round โ€ข No nested tasks โ€ข Performance: consensus, bonus round on rating audios 7/18/2013 Tutorial@ESWC2013 8 Players decide whether they listen to the same tune by exchanging free-text hints
  • 9. EXAMPLE: GAMIFIED HEALTHCARE โ€ข eCommerce solution provider, loyality management, gamification โ€ข Goal: motivate employees to exercise ; reduces health insurance costs and increases productivity โ€ข How โ€ข Installed gyms in offices and built custom application to check in to each workout; competition with cash prize ๏ƒ  12% employees โ€ข Fitness as a team sport: form regional teams competing against each other; leaderboards ๏ƒ  70% employees 7/18/2013 Tutorial@ESWC201 9
  • 10. DIMENSIONS OF GWAP DESIGN GAMES WITH A PURPOSE 7/18/2013 10 Tutorial@ESWC201
  • 11. DIMENSIONS OF GWAP DESIGN WHAT IS THE PURPOSE OF THE GAME โ€ข Concrete specification of the task โ€ข Example: annotation of a set of 500,000 images using free labels, controlled vocabulary etc โ€ข Where does the input data come from? How much noise can you expect in the data? โ€ข Example: validating the results of algorithms; poor input data hampers UX HOW CAN IT BE TRANSLATED INTO DECOMPOSABLE TASKS โ€ข Repetitive tasks vs. player experience; see motivation 7/18/2013 Tutorial@ESWC201 11
  • 12. DIMENSIONS OF GWAP DESIGN (2) WHAT SUB-TASKS CAN YOU IDENTIFY โ€ข Number of interrelated steps in a casual game and granularity of tasks HOW DOES THE HUMAN READABLE DESCRIPTION OF THE TASK LOOK LIKE โ€ข See Linked Data examples 7/18/2013 Tutorial@ESWC2013 12
  • 13. DIMENSIONS OF GWAP DESIGN (3) HOW TO YOU MEASURE PERFORMANCE โ€ข Redundancy (output-agreement games) โ€ข Consensus (input agreement, cf Tag-A-Tune) โ€ข Describer - guesser WHAT DO USERS RECEIVE POINTS FOR, WHEN, AND HOW MANY โ€ข Mechanism design Note: tasks cannot be too difficult, otherwise the tasks feel like work; they have to be interesting and intellectually challenging, otherwise the game is boring; players should be able to get better at it during the game. 7/18/2013 Tutorial@ESWC201 13
  • 14. SINGLE VS. MULTI- PLAYER GAMES โ€ข Multi-player games โ€ข UX (player appreciate social contact and intellectual challenge) โ€ข Consensus mechanism, less spam โ€ข Rapid feedback cycles โ€ข But: requires playersโ€™ matching functionality and enough players in the system at the same time โ€ข Can be simulated using bots and (lots of) pre-recorded rounds โ€ข Single-player games โ€ข Different quality assurance method (player receives reward once correct answer is determined); or โ€ข Training data available to build initial profile 7/18/2013 Tutorial@ESWC2013 14
  • 17. MECHANISM DESIGN โ€ข Area of game theory โ€ข Game designer defining the structure of the game โ€ข Game designer is interested in specific outcomes and attempts to influence playersโ€™ behavior to achieve these outcomes โ€ข Different reward models can be applied โ€ข Pay-per-item vs winner-takes-it-all โ€ข Competitions among individuals and teams โ€ข How to price contributions โ€ข These parameters will change the behavior of the users in the system 7/18/2013 Tutorial@ESWC2013 17
  • 18. DIMENSIONS OF GWAP DESIGN (4) HOW DO YOU TRANSLATE CROWD INPUTS INTO VALIDATED ANSWERS โ€ข When are two answers the same โ€ข How many assignments per question โ€ข Playerโ€™s reliability, spam HOW DO YOU ASSIGN CHALLENGES TO PLAYERS โ€ข Random vs based on previous performance โ€ข The same about players matching 7/18/2013 Tutorial@ESWC2013 18
  • 19. DIMENSIONS OF GWAP DESIGN (5) WHAT ADDITIONAL GAME ELEMENTS CAN YOU INCLUDE โ€ข Different types of players* โ€ข Useful information (tabu lists) โ€ข Levels of difficulty (requires knowledge of the problem space) โ€ข Timing adds a sense of urgency, feels more like play and less like work โ€ข Leader boards, badges, appointment dynamics *http://www.gamasutra.com/blogs/Vi ctorManrique/20130524/193007/Gam ification_Player_Types_The_TimeEn gagement_Pyramid.php 7/18/2013 Tutorial@ESWC2013 19
  • 20. GAME MECHANICS: LEADERBOARDS* โ€ข Global: top-players โ€ข Local: user can find himself, has attainable objective โ€ข Friends: user competes and interacts with players he feels emotionally attached to โ€ข Filtered: e.g., all players in one area, creates a sense of community โ€ข Aggregates: e.g., for teams, encourage cooperation, create social pressure *http://blog.badgeville.com/2013/03/15/g ame-mechanics-leaderboards-pt1/ 7/18/2013 Tutorial@ESWC2013 20
  • 21. CONCLUSIONS GWAPs are a useful concept for intellectually challenging, but solvable, fine-granular tasks, in domains appealing for mainstream casual Internet users Game mechanics need careful tuning to be effective 7/18/2013 Tutorial@ESWC201 21