Game learning analtytics is not informagic educon 2018

Baltasar Fernández-Manjón
Baltasar Fernández-ManjónFull Professor (Catedrático) at Universidad Complutense de Madrid
Game Learning Analytics is not informagic!
Iván Pérez-Colado, Cristina Alonso-Fernández,
Manuel Freire, Iván Martínez-Ortiz,
Baltasar Fernández-Manjón
EDUCON 2018, Tenerife, Spain
Game Learning Analytics
Learning Analytics collect interaction
information from e-learning system to
get insight and improve the educational
process
Game Learning Analytics is LA applied
to Serious Games
to collect, analyze and visualize
information from players interactions for
the different stakeholders (teacher,
student, developer, manager)
Learning Analytics Model (LAM)
Game Learning Analytics needs a model to drive the analysis of the inputs at
different levels to better understand learners and to improve educational outcomes
For LAMs to provide insight into learning, it is necessary to clearly establish:
- requirements to fulfill a LAM definition
- realistic expectations of what the outcomes can be
Too often, users expect GLA with deep meaning based on shallow interaction
data, assuming the GLA system can infer the game educational design
This is not Game Learning Analytics but an unrealistic expectation (informagic).
LAM in a Game Learning Analytics platform
LAM is the model that drive and details how information should be tracked,
collected, aggregated and reported to a Learning Analytics System (LAS).
Learning Analytics Model (LAM)
LAMs must provide an executable definition of:
● What: the data the system gathers, manages and uses for analysis
● How: the way in which the analysis is performed on the collected data
● Who: the stakeholders targeted by the analysis
LAMs interplay with the analytics
system and the main stakeholders.
Blue boxes -> mechanism (LAS)
Red boxes -> policy (LAM)
Learning Analytics Model (LAM)
Several steps to define a LAM, involving
stakeholders in charge of the definitions.
Each step corresponds to an activity that
provides a result to fulfill that step in the
LAM.
Default LAM available, but particular
LAMs need to be created for new games.
Steps to define a LAM
1. Learning goals to be achieved in
the game.
2. Game goals (e.g. tasks, levels)
Correspondence between learning
& game goals.
3. Traces to be sent by the game
(follow some standard)
4. Analysis model defined how
traces should be analyzed &
interpreted.
5. Visualizations game-dependent
to extend the default LAM.
Meta - Learning Analytics Model
LAMs are designed for individual games. When several games are connected, we
need a larger structure to deal with multi-scale games: meta-LAMs that stitch
together the individual game LAMs into a larger whole.
e.g. geolocalized game launching minigames
A complete Meta-LAM definition requires:
● the hierarchy between the games
● the information flow from one level to another
Meta-LAM allows to cover progress and completion in the whole structure to show
global information.
Meta-LAM structure proposal
Meta-LAM can be defined for general structures of games (e.g. trees).
We propose a structure based on the IMS Simple Sequencing specification as
described in SCORM 2004 4th Edition Sequencing and Navigation (SN).
Learning activities (with associated LAMs)
correspond to nodes in the Activity Tree
(meta-LAM). Activities allow to define
completion and mastery conditions.
Rollup rules define how information is
passed from children to parent nodes.
LAM and Meta-LAM in EU H2020 BEACONING
Meta-LAM proposal
considered for the H2020 EU
BEACONING Project.
Hierarchical structure of
games and mini-games.
Learning designers define
GLPs as tree of missions,
quests and activities.
Data Collection
Experience API for Serious
Games Profile (xAPI-SG):
standard interactions model
implemented in xAPI with ADL.
The model allows tracking of all
in-game interactions as xAPI
traces (statements). It also
simplifies data sharing.
To use the xAPI-SG Profile,
several open-source tracker
implementations are available.
https://github.com/e-ucm/unity-tracker
Data Analysis and Visualization
xAPI traces allows for:
- a default set of analyses
and visualizations
- for different stakeholders
(e.g. teachers, developers).
Visualization for specific
games can be developed
based on game-specific
LAMs.
Correct/incorrect answers per
question (alternative in xAPI-SG).
Progress per player in each task /
level (completable in xAPI-SG).
Conclusions
● Learning Analytics Models describe and drive how interaction data from
serious games is gameplay is to be collected, analyzed and displayed.
● The information extracted is essential to provide feedback to different
stakeholders (e.g. teachers).
● Effective LAMs should be based on the learning design and provide a
process establishing clear definitions and expected outputs.
● LAMs are applied for a single game. More complex structures require
meta-LAMs to define how information is passed between levels.
● Next steps:
- improve and provide more examples of LAMs to simplify adoption
- test meta-LAM structure in large scale experiments
Thank you!
Baltasar Fernandez-Manjon
@baltaFM
balta@fdi.ucm.es
Code: https://github.com/e-ucm
www.e-ucm.es
1 of 14

Recommended

Using Game Learning Analytics to Improve the Design, Evaluation and Deploymen... by
Using Game Learning Analytics to Improve the Design, Evaluation and Deploymen...Using Game Learning Analytics to Improve the Design, Evaluation and Deploymen...
Using Game Learning Analytics to Improve the Design, Evaluation and Deploymen...Baltasar Fernández-Manjón
1.1K views46 slides
eMadrid Gaming4Coding - Possibilities of game learning analytics for coding l... by
eMadrid Gaming4Coding - Possibilities of game learning analytics for coding l...eMadrid Gaming4Coding - Possibilities of game learning analytics for coding l...
eMadrid Gaming4Coding - Possibilities of game learning analytics for coding l...eMadrid network
31 views30 slides
Gaming Learning Analytics Contributing to the serious games ecosystem by
Gaming Learning Analytics Contributing to the serious games ecosystemGaming Learning Analytics Contributing to the serious games ecosystem
Gaming Learning Analytics Contributing to the serious games ecosystemBaltasar Fernández-Manjón
1.1K views33 slides
WEEF/GEDC eMadrid_Systematizing Game Learning Analytics for Improving Serious... by
WEEF/GEDC eMadrid_Systematizing Game Learning Analytics for Improving Serious...WEEF/GEDC eMadrid_Systematizing Game Learning Analytics for Improving Serious...
WEEF/GEDC eMadrid_Systematizing Game Learning Analytics for Improving Serious...eMadrid network
1.2K views46 slides
Icce21 systematizing game learning analytics for improving serious games life... by
Icce21 systematizing game learning analytics for improving serious games life...Icce21 systematizing game learning analytics for improving serious games life...
Icce21 systematizing game learning analytics for improving serious games life...Baltasar Fernández-Manjón
224 views46 slides
2022_03_22 EDUCON 2022 “Using e-Learning Standards to Improve Serious Game De... by
2022_03_22 EDUCON 2022 “Using e-Learning Standards to Improve Serious Game De...2022_03_22 EDUCON 2022 “Using e-Learning Standards to Improve Serious Game De...
2022_03_22 EDUCON 2022 “Using e-Learning Standards to Improve Serious Game De...eMadrid network
181 views15 slides

More Related Content

Similar to Game learning analtytics is not informagic educon 2018

Rev gaming learning analytics rage and beaconing by
Rev gaming learning analytics  rage and beaconingRev gaming learning analytics  rage and beaconing
Rev gaming learning analytics rage and beaconingBaltasar Fernández-Manjón
819 views21 slides
Learning analytics for improving educational games jcsg2017 by
Learning analytics for improving educational games jcsg2017Learning analytics for improving educational games jcsg2017
Learning analytics for improving educational games jcsg2017Baltasar Fernández-Manjón
536 views52 slides
Full Lyifecycle Architecture for Serious Games - JCSG 2017 by
Full Lyifecycle Architecture for Serious Games - JCSG 2017Full Lyifecycle Architecture for Serious Games - JCSG 2017
Full Lyifecycle Architecture for Serious Games - JCSG 2017Cristina Alonso
93 views20 slides
Serious games, e-learning and standards by
Serious games, e-learning and standards Serious games, e-learning and standards
Serious games, e-learning and standards Baltasar Fernández-Manjón
1.6K views25 slides
Machine Learning Contents.pptx by
Machine Learning Contents.pptxMachine Learning Contents.pptx
Machine Learning Contents.pptxNaveenkushwaha18
13 views83 slides
The Web Science MacroScope: Mixed-methods Approach for Understanding Web Acti... by
The Web Science MacroScope: Mixed-methods Approach for Understanding Web Acti...The Web Science MacroScope: Mixed-methods Approach for Understanding Web Acti...
The Web Science MacroScope: Mixed-methods Approach for Understanding Web Acti...Markus Luczak-Rösch
477 views28 slides

Similar to Game learning analtytics is not informagic educon 2018(20)

Full Lyifecycle Architecture for Serious Games - JCSG 2017 by Cristina Alonso
Full Lyifecycle Architecture for Serious Games - JCSG 2017Full Lyifecycle Architecture for Serious Games - JCSG 2017
Full Lyifecycle Architecture for Serious Games - JCSG 2017
Cristina Alonso93 views
The Web Science MacroScope: Mixed-methods Approach for Understanding Web Acti... by Markus Luczak-Rösch
The Web Science MacroScope: Mixed-methods Approach for Understanding Web Acti...The Web Science MacroScope: Mixed-methods Approach for Understanding Web Acti...
The Web Science MacroScope: Mixed-methods Approach for Understanding Web Acti...
Towards Human-Centered Machine Learning by Sri Ambati
Towards Human-Centered Machine LearningTowards Human-Centered Machine Learning
Towards Human-Centered Machine Learning
Sri Ambati740 views
Requirements@Runtime: The case of Gameful Systems by antbucc
Requirements@Runtime: The case of Gameful SystemsRequirements@Runtime: The case of Gameful Systems
Requirements@Runtime: The case of Gameful Systems
antbucc934 views
IRJET- Machine Learning: Survey, Types and Challenges by IRJET Journal
IRJET- Machine Learning: Survey, Types and ChallengesIRJET- Machine Learning: Survey, Types and Challenges
IRJET- Machine Learning: Survey, Types and Challenges
IRJET Journal47 views
Online learning & adaptive game playing by Saeid Ghafouri
Online learning & adaptive game playingOnline learning & adaptive game playing
Online learning & adaptive game playing
Saeid Ghafouri76 views
Serious Games Analytics - Lecture at TU Darmstadt by Laila Shoukry
Serious Games Analytics - Lecture at TU DarmstadtSerious Games Analytics - Lecture at TU Darmstadt
Serious Games Analytics - Lecture at TU Darmstadt
Laila Shoukry1.3K views
Holistic player modeling for controlling adaptation in video games by Boyan Bontchev
Holistic player modeling for controlling adaptation in video gamesHolistic player modeling for controlling adaptation in video games
Holistic player modeling for controlling adaptation in video games
Boyan Bontchev332 views
Elg 5100 project report anurag & jayanshu by Anurag Das
Elg 5100 project report   anurag & jayanshuElg 5100 project report   anurag & jayanshu
Elg 5100 project report anurag & jayanshu
Anurag Das98 views
Tutorial machine learning with python - a tutorial by MarcusBBraga
Tutorial   machine learning with python - a tutorialTutorial   machine learning with python - a tutorial
Tutorial machine learning with python - a tutorial
MarcusBBraga88 views
Machine Learning Basics by Suresh Arora
Machine Learning BasicsMachine Learning Basics
Machine Learning Basics
Suresh Arora736 views
Aidvanced - Presentation of the Company by Aidvanced S.r.l
Aidvanced - Presentation of the CompanyAidvanced - Presentation of the Company
Aidvanced - Presentation of the Company
Aidvanced S.r.l257 views
ConvegnoCKBG2014 - Schembri - Aidvanced by CKBGShare
ConvegnoCKBG2014 - Schembri - AidvancedConvegnoCKBG2014 - Schembri - Aidvanced
ConvegnoCKBG2014 - Schembri - Aidvanced
CKBGShare464 views
Games Analytics and players segmentation by michele de meo
Games Analytics and players segmentationGames Analytics and players segmentation
Games Analytics and players segmentation
michele de meo4.7K views
Game balancing with ecosystem mechanism by Anand Bhojan
Game balancing with ecosystem mechanismGame balancing with ecosystem mechanism
Game balancing with ecosystem mechanism
Anand Bhojan72 views

More from Baltasar Fernández-Manjón

Articodign juego para mejorar el aprendizaje de la programacion.pptx by
Articodign juego para mejorar el aprendizaje de la programacion.pptxArticodign juego para mejorar el aprendizaje de la programacion.pptx
Articodign juego para mejorar el aprendizaje de la programacion.pptxBaltasar Fernández-Manjón
12 views30 slides
Juegos serios en museos - by
Juegos serios en museos -Juegos serios en museos -
Juegos serios en museos -Baltasar Fernández-Manjón
258 views28 slides
Metaverses lifelong learning in a changing world by
Metaverses lifelong learning in a changing worldMetaverses lifelong learning in a changing world
Metaverses lifelong learning in a changing worldBaltasar Fernández-Manjón
311 views6 slides
Extending narrative serious games using ad hoc minigames by
Extending narrative serious games using ad hoc minigamesExtending narrative serious games using ad hoc minigames
Extending narrative serious games using ad hoc minigamesBaltasar Fernández-Manjón
315 views15 slides
E madrid jornadas 2021 ucm final by
E madrid jornadas 2021 ucm finalE madrid jornadas 2021 ucm final
E madrid jornadas 2021 ucm finalBaltasar Fernández-Manjón
210 views9 slides
CONECTADO : SERIOUS GAME TO PREVENT CYBERBULLYING by
CONECTADO : SERIOUS GAME TO PREVENT CYBERBULLYINGCONECTADO : SERIOUS GAME TO PREVENT CYBERBULLYING
CONECTADO : SERIOUS GAME TO PREVENT CYBERBULLYINGBaltasar Fernández-Manjón
185 views12 slides

More from Baltasar Fernández-Manjón(20)

Una visión critica sobre las tecnologias inmersivas en educación Aumentame 2019 by Baltasar Fernández-Manjón
Una visión critica sobre las tecnologias inmersivas en educación Aumentame 2019Una visión critica sobre las tecnologias inmersivas en educación Aumentame 2019
Una visión critica sobre las tecnologias inmersivas en educación Aumentame 2019
Intégration de jeux numériques à l’école et analytique de l’apprentissage fri... by Baltasar Fernández-Manjón
Intégration de jeux numériques à l’école et analytique de l’apprentissage fri...Intégration de jeux numériques à l’école et analytique de l’apprentissage fri...
Intégration de jeux numériques à l’école et analytique de l’apprentissage fri...
Uso de tecnología de juegos para automatizar pruebas neuropsicológicas e inve... by Baltasar Fernández-Manjón
Uso de tecnología de juegos para automatizar pruebas neuropsicológicas e inve...Uso de tecnología de juegos para automatizar pruebas neuropsicológicas e inve...
Uso de tecnología de juegos para automatizar pruebas neuropsicológicas e inve...

Recently uploaded

AWS Certified Solutions Architect Associate Exam Guide_published .pdf by
AWS Certified Solutions Architect Associate Exam Guide_published .pdfAWS Certified Solutions Architect Associate Exam Guide_published .pdf
AWS Certified Solutions Architect Associate Exam Guide_published .pdfKiran Kumar Malik
6 views121 slides
Integrating Sustainable Development Goals (SDGs) in School Education by
Integrating Sustainable Development Goals (SDGs) in School EducationIntegrating Sustainable Development Goals (SDGs) in School Education
Integrating Sustainable Development Goals (SDGs) in School EducationSheetalTank1
20 views29 slides
Different type of computer networks .pptx by
Different  type of computer networks .pptxDifferent  type of computer networks .pptx
Different type of computer networks .pptxnazmul1514788
20 views22 slides
Automated Remote sensing GPS satellite system for managing resources and moni... by
Automated Remote sensing GPS satellite system for managing resources and moni...Automated Remote sensing GPS satellite system for managing resources and moni...
Automated Remote sensing GPS satellite system for managing resources and moni...Khalid Abdel Naser Abdel Rahim
7 views1 slide
Plant Design Report-Oil Refinery.pdf by
Plant Design Report-Oil Refinery.pdfPlant Design Report-Oil Refinery.pdf
Plant Design Report-Oil Refinery.pdfSafeen Yaseen Ja'far
9 views10 slides
MongoDB.pdf by
MongoDB.pdfMongoDB.pdf
MongoDB.pdfArthyR3
53 views6 slides

Recently uploaded(20)

AWS Certified Solutions Architect Associate Exam Guide_published .pdf by Kiran Kumar Malik
AWS Certified Solutions Architect Associate Exam Guide_published .pdfAWS Certified Solutions Architect Associate Exam Guide_published .pdf
AWS Certified Solutions Architect Associate Exam Guide_published .pdf
Integrating Sustainable Development Goals (SDGs) in School Education by SheetalTank1
Integrating Sustainable Development Goals (SDGs) in School EducationIntegrating Sustainable Development Goals (SDGs) in School Education
Integrating Sustainable Development Goals (SDGs) in School Education
SheetalTank120 views
Different type of computer networks .pptx by nazmul1514788
Different  type of computer networks .pptxDifferent  type of computer networks .pptx
Different type of computer networks .pptx
nazmul151478820 views
MongoDB.pdf by ArthyR3
MongoDB.pdfMongoDB.pdf
MongoDB.pdf
ArthyR353 views
Web Dev Session 1.pptx by VedVekhande
Web Dev Session 1.pptxWeb Dev Session 1.pptx
Web Dev Session 1.pptx
VedVekhande23 views
Design_Discover_Develop_Campaign.pptx by ShivanshSeth6
Design_Discover_Develop_Campaign.pptxDesign_Discover_Develop_Campaign.pptx
Design_Discover_Develop_Campaign.pptx
ShivanshSeth659 views
BCIC - Manufacturing Conclave - Technology-Driven Manufacturing for Growth by Innomantra
BCIC - Manufacturing Conclave -  Technology-Driven Manufacturing for GrowthBCIC - Manufacturing Conclave -  Technology-Driven Manufacturing for Growth
BCIC - Manufacturing Conclave - Technology-Driven Manufacturing for Growth
Innomantra 28 views
Programmable Logic Devices : SPLD and CPLD by Usha Mehta
Programmable Logic Devices : SPLD and CPLDProgrammable Logic Devices : SPLD and CPLD
Programmable Logic Devices : SPLD and CPLD
Usha Mehta44 views
DevFest 2023 Daegu Speech_이재규, Implementing easy and simple chat with gol... by JQLEE6
DevFest 2023 Daegu Speech_이재규,  Implementing easy and simple chat with gol...DevFest 2023 Daegu Speech_이재규,  Implementing easy and simple chat with gol...
DevFest 2023 Daegu Speech_이재규, Implementing easy and simple chat with gol...
JQLEE616 views
Solution Challenge Introduction.pptx by GDSCCEC
Solution Challenge Introduction.pptxSolution Challenge Introduction.pptx
Solution Challenge Introduction.pptx
GDSCCEC13 views
2023-12 Emarei MRI Tool Set E2I0501ST (TQ).pdf by Philipp Daum
2023-12 Emarei MRI Tool Set E2I0501ST (TQ).pdf2023-12 Emarei MRI Tool Set E2I0501ST (TQ).pdf
2023-12 Emarei MRI Tool Set E2I0501ST (TQ).pdf
Philipp Daum6 views
Programmable Switches for Programmable Logic Devices by Usha Mehta
Programmable Switches for Programmable Logic DevicesProgrammable Switches for Programmable Logic Devices
Programmable Switches for Programmable Logic Devices
Usha Mehta37 views

Game learning analtytics is not informagic educon 2018

  • 1. Game Learning Analytics is not informagic! Iván Pérez-Colado, Cristina Alonso-Fernández, Manuel Freire, Iván Martínez-Ortiz, Baltasar Fernández-Manjón EDUCON 2018, Tenerife, Spain
  • 2. Game Learning Analytics Learning Analytics collect interaction information from e-learning system to get insight and improve the educational process Game Learning Analytics is LA applied to Serious Games to collect, analyze and visualize information from players interactions for the different stakeholders (teacher, student, developer, manager)
  • 3. Learning Analytics Model (LAM) Game Learning Analytics needs a model to drive the analysis of the inputs at different levels to better understand learners and to improve educational outcomes For LAMs to provide insight into learning, it is necessary to clearly establish: - requirements to fulfill a LAM definition - realistic expectations of what the outcomes can be Too often, users expect GLA with deep meaning based on shallow interaction data, assuming the GLA system can infer the game educational design This is not Game Learning Analytics but an unrealistic expectation (informagic).
  • 4. LAM in a Game Learning Analytics platform LAM is the model that drive and details how information should be tracked, collected, aggregated and reported to a Learning Analytics System (LAS).
  • 5. Learning Analytics Model (LAM) LAMs must provide an executable definition of: ● What: the data the system gathers, manages and uses for analysis ● How: the way in which the analysis is performed on the collected data ● Who: the stakeholders targeted by the analysis LAMs interplay with the analytics system and the main stakeholders. Blue boxes -> mechanism (LAS) Red boxes -> policy (LAM)
  • 6. Learning Analytics Model (LAM) Several steps to define a LAM, involving stakeholders in charge of the definitions. Each step corresponds to an activity that provides a result to fulfill that step in the LAM. Default LAM available, but particular LAMs need to be created for new games.
  • 7. Steps to define a LAM 1. Learning goals to be achieved in the game. 2. Game goals (e.g. tasks, levels) Correspondence between learning & game goals. 3. Traces to be sent by the game (follow some standard) 4. Analysis model defined how traces should be analyzed & interpreted. 5. Visualizations game-dependent to extend the default LAM.
  • 8. Meta - Learning Analytics Model LAMs are designed for individual games. When several games are connected, we need a larger structure to deal with multi-scale games: meta-LAMs that stitch together the individual game LAMs into a larger whole. e.g. geolocalized game launching minigames A complete Meta-LAM definition requires: ● the hierarchy between the games ● the information flow from one level to another Meta-LAM allows to cover progress and completion in the whole structure to show global information.
  • 9. Meta-LAM structure proposal Meta-LAM can be defined for general structures of games (e.g. trees). We propose a structure based on the IMS Simple Sequencing specification as described in SCORM 2004 4th Edition Sequencing and Navigation (SN). Learning activities (with associated LAMs) correspond to nodes in the Activity Tree (meta-LAM). Activities allow to define completion and mastery conditions. Rollup rules define how information is passed from children to parent nodes.
  • 10. LAM and Meta-LAM in EU H2020 BEACONING Meta-LAM proposal considered for the H2020 EU BEACONING Project. Hierarchical structure of games and mini-games. Learning designers define GLPs as tree of missions, quests and activities.
  • 11. Data Collection Experience API for Serious Games Profile (xAPI-SG): standard interactions model implemented in xAPI with ADL. The model allows tracking of all in-game interactions as xAPI traces (statements). It also simplifies data sharing. To use the xAPI-SG Profile, several open-source tracker implementations are available. https://github.com/e-ucm/unity-tracker
  • 12. Data Analysis and Visualization xAPI traces allows for: - a default set of analyses and visualizations - for different stakeholders (e.g. teachers, developers). Visualization for specific games can be developed based on game-specific LAMs. Correct/incorrect answers per question (alternative in xAPI-SG). Progress per player in each task / level (completable in xAPI-SG).
  • 13. Conclusions ● Learning Analytics Models describe and drive how interaction data from serious games is gameplay is to be collected, analyzed and displayed. ● The information extracted is essential to provide feedback to different stakeholders (e.g. teachers). ● Effective LAMs should be based on the learning design and provide a process establishing clear definitions and expected outputs. ● LAMs are applied for a single game. More complex structures require meta-LAMs to define how information is passed between levels. ● Next steps: - improve and provide more examples of LAMs to simplify adoption - test meta-LAM structure in large scale experiments