SlideShare a Scribd company logo
1 of 15
Summative Evaluation
Summative Games Evaluation



Summative Evaluation




                  Why bother?
Summative Games Evaluation
Summative Games Evaluation
Summative Games Evaluation
Summative Games Evaluation



Method
•   Analytics
•   Survey
•   Interviews and Focus Groups
•   Community commentary
Summative Games Evaluation



Analytics – Google Analytics
Summative Games Evaluation



Analytics – Google Analytics
Summative Games Evaluation



Analytics – other tools: Google Trends
Summative Games Evaluation



Analytics – other tools: stats.grok.se
Summative Games Evaluation



Survey
Summative Games Evaluation



Interviews
Summative Games Evaluation



Community commentary
Summative Games Evaluation



So why bother?
• Informs  future game design and distribution
• External dissemination and discussion
• Internal awareness and buy-in
• Validation of the project
• Surprising, rewarding and fascinating
Summative Games Evaluation



Share
• http://museumgames.pbworks.com
• @marthasadie
• marthasadie.wordpress.com

More Related Content

Similar to Summative Evaluation of Educational Games

Your Game is None of Your Business | Randall Robbins
Your Game is None of Your Business | Randall RobbinsYour Game is None of Your Business | Randall Robbins
Your Game is None of Your Business | Randall RobbinsJessica Tams
 
Kiyat games game evaluation process
Kiyat games game evaluation processKiyat games game evaluation process
Kiyat games game evaluation processSun Cho
 
Andrew Hughes - Gamification vs. Game-Based Learning
Andrew Hughes - Gamification vs. Game-Based LearningAndrew Hughes - Gamification vs. Game-Based Learning
Andrew Hughes - Gamification vs. Game-Based LearningSeriousGamesAssoc
 
Jonathan Barone-University of Washington
Jonathan Barone-University of WashingtonJonathan Barone-University of Washington
Jonathan Barone-University of WashingtonSeriousGamesAssoc
 
World Council for Curriculum & Instruction Presentation
World Council for Curriculum & Instruction PresentationWorld Council for Curriculum & Instruction Presentation
World Council for Curriculum & Instruction PresentationJason Rosenblum, PhD
 
Using Data Science for Behavioural Game Design
Using Data Science for Behavioural Game DesignUsing Data Science for Behavioural Game Design
Using Data Science for Behavioural Game DesignGameCamp
 
Kristyna Paskova. The ABCs of Marketing Your Game
Kristyna Paskova. The ABCs of Marketing Your GameKristyna Paskova. The ABCs of Marketing Your Game
Kristyna Paskova. The ABCs of Marketing Your GameInteractive Denmark
 
PGA NMC Social Media Workshop - PGA East - Spring 2015
PGA NMC Social Media Workshop - PGA East - Spring 2015PGA NMC Social Media Workshop - PGA East - Spring 2015
PGA NMC Social Media Workshop - PGA East - Spring 2015Caitlin Burns
 
How to Kickstarter: PR & Community Management
How to Kickstarter: PR & Community ManagementHow to Kickstarter: PR & Community Management
How to Kickstarter: PR & Community ManagementJakub Kwinta
 
Engage Workshop Berlin-part1
Engage Workshop Berlin-part1Engage Workshop Berlin-part1
Engage Workshop Berlin-part1Maja Pivec
 
Social media analytics
Social media analyticsSocial media analytics
Social media analyticsRyan Jones
 
Gamification for MediaBarCamp
Gamification for MediaBarCampGamification for MediaBarCamp
Gamification for MediaBarCampsvemet
 
Gamification in Digital Marketing
Gamification in Digital MarketingGamification in Digital Marketing
Gamification in Digital MarketingGunter Blanckaert
 
Introduction to Game Development
Introduction to Game DevelopmentIntroduction to Game Development
Introduction to Game DevelopmentiTawy Community
 
Game shows aqa
Game shows aqaGame shows aqa
Game shows aqakrober4
 
Creative digifest - how to create a leaderboard by toby beresford from leade...
Creative digifest -  how to create a leaderboard by toby beresford from leade...Creative digifest -  how to create a leaderboard by toby beresford from leade...
Creative digifest - how to create a leaderboard by toby beresford from leade...Toby Beresford
 

Similar to Summative Evaluation of Educational Games (20)

Your Game is None of Your Business | Randall Robbins
Your Game is None of Your Business | Randall RobbinsYour Game is None of Your Business | Randall Robbins
Your Game is None of Your Business | Randall Robbins
 
Kiyat games game evaluation process
Kiyat games game evaluation processKiyat games game evaluation process
Kiyat games game evaluation process
 
Andrew Hughes - Gamification vs. Game-Based Learning
Andrew Hughes - Gamification vs. Game-Based LearningAndrew Hughes - Gamification vs. Game-Based Learning
Andrew Hughes - Gamification vs. Game-Based Learning
 
Jonathan Barone-University of Washington
Jonathan Barone-University of WashingtonJonathan Barone-University of Washington
Jonathan Barone-University of Washington
 
World Council for Curriculum & Instruction Presentation
World Council for Curriculum & Instruction PresentationWorld Council for Curriculum & Instruction Presentation
World Council for Curriculum & Instruction Presentation
 
Class5
Class5Class5
Class5
 
Gamification consumer apps
Gamification consumer appsGamification consumer apps
Gamification consumer apps
 
Using Data Science for Behavioural Game Design
Using Data Science for Behavioural Game DesignUsing Data Science for Behavioural Game Design
Using Data Science for Behavioural Game Design
 
Kristyna Paskova. The ABCs of Marketing Your Game
Kristyna Paskova. The ABCs of Marketing Your GameKristyna Paskova. The ABCs of Marketing Your Game
Kristyna Paskova. The ABCs of Marketing Your Game
 
PGA NMC Social Media Workshop - PGA East - Spring 2015
PGA NMC Social Media Workshop - PGA East - Spring 2015PGA NMC Social Media Workshop - PGA East - Spring 2015
PGA NMC Social Media Workshop - PGA East - Spring 2015
 
How to Kickstarter: PR & Community Management
How to Kickstarter: PR & Community ManagementHow to Kickstarter: PR & Community Management
How to Kickstarter: PR & Community Management
 
Unit 13 Pecha Kucha
Unit 13 Pecha KuchaUnit 13 Pecha Kucha
Unit 13 Pecha Kucha
 
Engage Workshop Berlin-part1
Engage Workshop Berlin-part1Engage Workshop Berlin-part1
Engage Workshop Berlin-part1
 
Social media analytics
Social media analyticsSocial media analytics
Social media analytics
 
Actuate - Gamification
Actuate - GamificationActuate - Gamification
Actuate - Gamification
 
Gamification for MediaBarCamp
Gamification for MediaBarCampGamification for MediaBarCamp
Gamification for MediaBarCamp
 
Gamification in Digital Marketing
Gamification in Digital MarketingGamification in Digital Marketing
Gamification in Digital Marketing
 
Introduction to Game Development
Introduction to Game DevelopmentIntroduction to Game Development
Introduction to Game Development
 
Game shows aqa
Game shows aqaGame shows aqa
Game shows aqa
 
Creative digifest - how to create a leaderboard by toby beresford from leade...
Creative digifest -  how to create a leaderboard by toby beresford from leade...Creative digifest -  how to create a leaderboard by toby beresford from leade...
Creative digifest - how to create a leaderboard by toby beresford from leade...
 

More from Martha Henson

Creating compelling museum games (We Are Museums 2016)
Creating compelling museum games (We Are Museums 2016)Creating compelling museum games (We Are Museums 2016)
Creating compelling museum games (We Are Museums 2016)Martha Henson
 
Playful Learning : how to turn any IP into a successful educational app or game
Playful Learning : how to turn any IP into a successful educational app or gamePlayful Learning : how to turn any IP into a successful educational app or game
Playful Learning : how to turn any IP into a successful educational app or gameMartha Henson
 
Games and Museums: The potential, the proof, and the challenges (talk for Mu...
Games and Museums:  The potential, the proof, and the challenges (talk for Mu...Games and Museums:  The potential, the proof, and the challenges (talk for Mu...
Games and Museums: The potential, the proof, and the challenges (talk for Mu...Martha Henson
 
Making Magic on Mobile
Making Magic on MobileMaking Magic on Mobile
Making Magic on MobileMartha Henson
 
How we got millions of people to play our games and learn stuff (Digital Shor...
How we got millions of people to play our games and learn stuff (Digital Shor...How we got millions of people to play our games and learn stuff (Digital Shor...
How we got millions of people to play our games and learn stuff (Digital Shor...Martha Henson
 
Gaming science, scientific games
Gaming science, scientific gamesGaming science, scientific games
Gaming science, scientific gamesMartha Henson
 
Museums and the Web 2011: key learning and cool stuff
Museums and the Web 2011: key learning and cool stuffMuseums and the Web 2011: key learning and cool stuff
Museums and the Web 2011: key learning and cool stuffMartha Henson
 

More from Martha Henson (7)

Creating compelling museum games (We Are Museums 2016)
Creating compelling museum games (We Are Museums 2016)Creating compelling museum games (We Are Museums 2016)
Creating compelling museum games (We Are Museums 2016)
 
Playful Learning : how to turn any IP into a successful educational app or game
Playful Learning : how to turn any IP into a successful educational app or gamePlayful Learning : how to turn any IP into a successful educational app or game
Playful Learning : how to turn any IP into a successful educational app or game
 
Games and Museums: The potential, the proof, and the challenges (talk for Mu...
Games and Museums:  The potential, the proof, and the challenges (talk for Mu...Games and Museums:  The potential, the proof, and the challenges (talk for Mu...
Games and Museums: The potential, the proof, and the challenges (talk for Mu...
 
Making Magic on Mobile
Making Magic on MobileMaking Magic on Mobile
Making Magic on Mobile
 
How we got millions of people to play our games and learn stuff (Digital Shor...
How we got millions of people to play our games and learn stuff (Digital Shor...How we got millions of people to play our games and learn stuff (Digital Shor...
How we got millions of people to play our games and learn stuff (Digital Shor...
 
Gaming science, scientific games
Gaming science, scientific gamesGaming science, scientific games
Gaming science, scientific games
 
Museums and the Web 2011: key learning and cool stuff
Museums and the Web 2011: key learning and cool stuffMuseums and the Web 2011: key learning and cool stuff
Museums and the Web 2011: key learning and cool stuff
 

Recently uploaded

The Core Functions of the Bangko Sentral ng Pilipinas
The Core Functions of the Bangko Sentral ng PilipinasThe Core Functions of the Bangko Sentral ng Pilipinas
The Core Functions of the Bangko Sentral ng PilipinasCherylouCamus
 
Market Morning Updates for 16th April 2024
Market Morning Updates for 16th April 2024Market Morning Updates for 16th April 2024
Market Morning Updates for 16th April 2024Devarsh Vakil
 
Stock Market Brief Deck for "this does not happen often".pdf
Stock Market Brief Deck for "this does not happen often".pdfStock Market Brief Deck for "this does not happen often".pdf
Stock Market Brief Deck for "this does not happen often".pdfMichael Silva
 
The Triple Threat | Article on Global Resession | Harsh Kumar
The Triple Threat | Article on Global Resession | Harsh KumarThe Triple Threat | Article on Global Resession | Harsh Kumar
The Triple Threat | Article on Global Resession | Harsh KumarHarsh Kumar
 
SBP-Market-Operations and market managment
SBP-Market-Operations and market managmentSBP-Market-Operations and market managment
SBP-Market-Operations and market managmentfactical
 
government_intervention_in_business_ownership[1].pdf
government_intervention_in_business_ownership[1].pdfgovernment_intervention_in_business_ownership[1].pdf
government_intervention_in_business_ownership[1].pdfshaunmashale756
 
Unveiling Business Expansion Trends in 2024
Unveiling Business Expansion Trends in 2024Unveiling Business Expansion Trends in 2024
Unveiling Business Expansion Trends in 2024Champak Jhagmag
 
House of Commons ; CDC schemes overview document
House of Commons ; CDC schemes overview documentHouse of Commons ; CDC schemes overview document
House of Commons ; CDC schemes overview documentHenry Tapper
 
Role of Information and technology in banking and finance .pptx
Role of Information and technology in banking and finance .pptxRole of Information and technology in banking and finance .pptx
Role of Information and technology in banking and finance .pptxNarayaniTripathi2
 
Financial analysis on Risk and Return.ppt
Financial analysis on Risk and Return.pptFinancial analysis on Risk and Return.ppt
Financial analysis on Risk and Return.ppttadegebreyesus
 
NO1 WorldWide Love marriage specialist baba ji Amil Baba Kala ilam powerful v...
NO1 WorldWide Love marriage specialist baba ji Amil Baba Kala ilam powerful v...NO1 WorldWide Love marriage specialist baba ji Amil Baba Kala ilam powerful v...
NO1 WorldWide Love marriage specialist baba ji Amil Baba Kala ilam powerful v...Amil baba
 
NO1 Certified Amil Baba In Lahore Kala Jadu In Lahore Best Amil In Lahore Ami...
NO1 Certified Amil Baba In Lahore Kala Jadu In Lahore Best Amil In Lahore Ami...NO1 Certified Amil Baba In Lahore Kala Jadu In Lahore Best Amil In Lahore Ami...
NO1 Certified Amil Baba In Lahore Kala Jadu In Lahore Best Amil In Lahore Ami...Amil baba
 
212MTAMount Durham University Bachelor's Diploma in Technology
212MTAMount Durham University Bachelor's Diploma in Technology212MTAMount Durham University Bachelor's Diploma in Technology
212MTAMount Durham University Bachelor's Diploma in Technologyz xss
 
project management information system lecture notes
project management information system lecture notesproject management information system lecture notes
project management information system lecture notesongomchris
 
(中央兰开夏大学毕业证学位证成绩单-案例)
(中央兰开夏大学毕业证学位证成绩单-案例)(中央兰开夏大学毕业证学位证成绩单-案例)
(中央兰开夏大学毕业证学位证成绩单-案例)twfkn8xj
 
fca-bsps-decision-letter-redacted (1).pdf
fca-bsps-decision-letter-redacted (1).pdffca-bsps-decision-letter-redacted (1).pdf
fca-bsps-decision-letter-redacted (1).pdfHenry Tapper
 
BPPG response - Options for Defined Benefit schemes - 19Apr24.pdf
BPPG response - Options for Defined Benefit schemes - 19Apr24.pdfBPPG response - Options for Defined Benefit schemes - 19Apr24.pdf
BPPG response - Options for Defined Benefit schemes - 19Apr24.pdfHenry Tapper
 
Managing Finances in a Small Business (yes).pdf
Managing Finances  in a Small Business (yes).pdfManaging Finances  in a Small Business (yes).pdf
Managing Finances in a Small Business (yes).pdfmar yame
 

Recently uploaded (20)

The Core Functions of the Bangko Sentral ng Pilipinas
The Core Functions of the Bangko Sentral ng PilipinasThe Core Functions of the Bangko Sentral ng Pilipinas
The Core Functions of the Bangko Sentral ng Pilipinas
 
Market Morning Updates for 16th April 2024
Market Morning Updates for 16th April 2024Market Morning Updates for 16th April 2024
Market Morning Updates for 16th April 2024
 
Stock Market Brief Deck for "this does not happen often".pdf
Stock Market Brief Deck for "this does not happen often".pdfStock Market Brief Deck for "this does not happen often".pdf
Stock Market Brief Deck for "this does not happen often".pdf
 
The Triple Threat | Article on Global Resession | Harsh Kumar
The Triple Threat | Article on Global Resession | Harsh KumarThe Triple Threat | Article on Global Resession | Harsh Kumar
The Triple Threat | Article on Global Resession | Harsh Kumar
 
SBP-Market-Operations and market managment
SBP-Market-Operations and market managmentSBP-Market-Operations and market managment
SBP-Market-Operations and market managment
 
government_intervention_in_business_ownership[1].pdf
government_intervention_in_business_ownership[1].pdfgovernment_intervention_in_business_ownership[1].pdf
government_intervention_in_business_ownership[1].pdf
 
Unveiling Business Expansion Trends in 2024
Unveiling Business Expansion Trends in 2024Unveiling Business Expansion Trends in 2024
Unveiling Business Expansion Trends in 2024
 
House of Commons ; CDC schemes overview document
House of Commons ; CDC schemes overview documentHouse of Commons ; CDC schemes overview document
House of Commons ; CDC schemes overview document
 
Role of Information and technology in banking and finance .pptx
Role of Information and technology in banking and finance .pptxRole of Information and technology in banking and finance .pptx
Role of Information and technology in banking and finance .pptx
 
Financial analysis on Risk and Return.ppt
Financial analysis on Risk and Return.pptFinancial analysis on Risk and Return.ppt
Financial analysis on Risk and Return.ppt
 
NO1 WorldWide Love marriage specialist baba ji Amil Baba Kala ilam powerful v...
NO1 WorldWide Love marriage specialist baba ji Amil Baba Kala ilam powerful v...NO1 WorldWide Love marriage specialist baba ji Amil Baba Kala ilam powerful v...
NO1 WorldWide Love marriage specialist baba ji Amil Baba Kala ilam powerful v...
 
NO1 Certified Amil Baba In Lahore Kala Jadu In Lahore Best Amil In Lahore Ami...
NO1 Certified Amil Baba In Lahore Kala Jadu In Lahore Best Amil In Lahore Ami...NO1 Certified Amil Baba In Lahore Kala Jadu In Lahore Best Amil In Lahore Ami...
NO1 Certified Amil Baba In Lahore Kala Jadu In Lahore Best Amil In Lahore Ami...
 
212MTAMount Durham University Bachelor's Diploma in Technology
212MTAMount Durham University Bachelor's Diploma in Technology212MTAMount Durham University Bachelor's Diploma in Technology
212MTAMount Durham University Bachelor's Diploma in Technology
 
project management information system lecture notes
project management information system lecture notesproject management information system lecture notes
project management information system lecture notes
 
Q1 2024 Newsletter | Financial Synergies Wealth Advisors
Q1 2024 Newsletter | Financial Synergies Wealth AdvisorsQ1 2024 Newsletter | Financial Synergies Wealth Advisors
Q1 2024 Newsletter | Financial Synergies Wealth Advisors
 
(中央兰开夏大学毕业证学位证成绩单-案例)
(中央兰开夏大学毕业证学位证成绩单-案例)(中央兰开夏大学毕业证学位证成绩单-案例)
(中央兰开夏大学毕业证学位证成绩单-案例)
 
fca-bsps-decision-letter-redacted (1).pdf
fca-bsps-decision-letter-redacted (1).pdffca-bsps-decision-letter-redacted (1).pdf
fca-bsps-decision-letter-redacted (1).pdf
 
BPPG response - Options for Defined Benefit schemes - 19Apr24.pdf
BPPG response - Options for Defined Benefit schemes - 19Apr24.pdfBPPG response - Options for Defined Benefit schemes - 19Apr24.pdf
BPPG response - Options for Defined Benefit schemes - 19Apr24.pdf
 
Managing Finances in a Small Business (yes).pdf
Managing Finances  in a Small Business (yes).pdfManaging Finances  in a Small Business (yes).pdf
Managing Finances in a Small Business (yes).pdf
 
🔝+919953056974 🔝young Delhi Escort service Pusa Road
🔝+919953056974 🔝young Delhi Escort service Pusa Road🔝+919953056974 🔝young Delhi Escort service Pusa Road
🔝+919953056974 🔝young Delhi Escort service Pusa Road
 

Summative Evaluation of Educational Games

Editor's Notes

  1. To test: did we achieve our aims? Reach a new audience – distribution strategy Engage them meaningfully with the subject matter Do so with a game which was high quality and satisfying to play
  2. Number of plays has passed 3.2 million, far exceeding target of 100k in month one and 50k thereafter Average dwell time just under 15 min Most popular countries 26% USA, 6% UK, 5.5% Brazil… Only about 3% visits to our hosted version, rest syndicated Around 30k referrals from game to WC site Social media drove tiny fraction of traffic to the game – can be more targeted next time
  3. Distribution strategy
  4. Google trends http://stats.grok.se/
  5. Google trends http://stats.grok.se/
  6. 1100 responses. Confirm it/ Survey Monkey Questions about gameplay and demographics, but also learnings and feelings. But over 50% either quite or very likely to look for more information after playing Nearly 60% retained the same opinion about the British empire, but nearly 28% felt more negatively, and nearly 10% felt more positively Comments mostly positive, pleased to be learning and having fun, small number thought it was tasteless
  7. Players intrigued by subject matter but also high rating and front page positioning on game portals Positive feedback on game, could have included even more information about history etc All but one who was very familiar with the history felt they had learnt something. Several went on to check Wikipedia page or other sources, including reading a book about China Several had thought about the ethics whilst playing Were pleasantly surprised to see us doing this, wanted to see us do more gamsPlayers intrigued by subject matter but also high rating and front page positioning on game portals Positive feedback on game, could have included even more information about history etc All but one who was very familiar with the history felt they had learnt something. Several went on to check Wikipedia page or other sources, including reading a book about China Several had thought about the ethics whilst playing Were pleasantly surprised to see us doing this, wanted to see us do more gams
  8. Game portal comments, numerous and often thoughtful “ How come I only understood what I’d seen in a museum after playing this game?” 18 blog reviews, many discussing history, some economics, not all English language. Also generated comments and debate on those blogs Threads on Reddit and Metafilter, on history, ethics and economics Video reviews and walkthroughs on YouTube, also hack video Discussed in depth on Popmatter’s Moving Pixels podcast Response from conferences and other similar institutions has been positive and interested