Learning Analytics
Door data gestuurd leren
Joris Klerkx
Research Expert, PhD.
http://hci.cs.kuleuven.be
@jkofmsk
Erik Duval
Professor
http://hci.cs.kuleuven.be
@erikd
Studienamiddag - Learning analytics - HU Brussel - 22 mei 2014
1
Our team:

Human-Computer Interaction
!
technology enhanced learning
music
research
(personal) health
2
3 http://eng.kuleuven.be/datavislab/
http://www.slideshare.net/jkofmsk
4
About learning…
5
we are teaching students
to solve problems we don't know
using technologies we don't know
6
we are should be teaching students
to solve problems we don't know
using technologies we don't know
7
http://www.flickr.com/photos/jonbecker/4625331304/8
http://www.youtube.com/watch?v=p0wk4qG2mIg
http://www.learner.org/vod/vod_window.html?pid=9
9
10
Motivation - empowerment
11
http://www.motivationhacker.com/motivation-is-situational-not-a-personality-trait/
Motivation - empowerment
12
Meten = Weten
13
Ex cathedra - exams
http://www.flickr.com/photos/wolflawlibrary/2417195782/
14
Fake learning
15
exams
Judge a man by his questions/actions
rather than by his answers…Voltaire
16
Continuous monitoring
exams
before - during - after
17
Learning analytics
18
Collecting traces that learners leave
behind and using those traces to improve
learning
http://erikduval.wordpress.com/2012/01/30/learning-analytics-and-educational-data-mining/
Learning analytics
19
What to measure?
Depends on the user
20
Analytics for Students
access to learning resources

posts in discussion fora

logins to learning management systems

posts of assignments

replies to posts

votes in lecture response systems

time on page in electronic textbook

location of device used to access course

(and thus proximity to other users)

software lines produced

contributions to shared documents or wikis
etc.
Who?
!
!
What?
!
!
When?
21
Analytics for professors
22
23
email, twitter, facebook, web reading,
physical movement, location, proximity,
food intake, sleeping, drinking, emotion
tracking, weather info, attention,
brainwaves, …
As learning moves online, traces also
include…
Relevant?
24
http://bigtablechi13.appspot.com/dashboard.jsp
Learning Dashboards
25
Raw Aggregated
Conceptual process model
26
awareness
(self) reflection
sense making
impact
data
questions
answers
behavior change or
new meaning
27
How can data on relevant actions be
captured?
Inspiration
28
Inspiration
quantifiedself.com
29
http://www.fitbit.com/
Sensors
30
31
32
https://www.rescuetime.com/
Software
Sensors
33
Web Analytics - trackers34
35
https://jawbone.com/up/coffee
Self-reporting
36
http://developer.runkeeper.com/healthgraph
Sharing, Comparing with your friends
37
What else do people track?
38
http://quantifiedself.com/QSLondon_Survey_overview.pdf 39
Making sense of the data
Raise awareness & Reflection
40
http://www.slideshare.net/infoscape41
42
algorithm
<>
human
43
Trust?
http://www.demorgen.be/dm/nl/5403/Internet/article/detail/1890428/2014/05/18/Twitteractiviteit-verraadt-je-politieke-profiel.dhtml
44
Number crunching
<>
Human perception
45
Anscombe’”⁹s quartet
!
uX = 9.0
uY = 7.5
sigma X = 3.317
sigma Y = 2.03
Y = 3 + 0.5X
http://en.wikipedia.org/wiki/Anscombe's_quartet
46
Educational Data mining
Data Visualisation
Visual Dashboards
<>
47
Example dashboards
48
49
http://www.snappvis.org
50
http://www.engadget.com/2013/01/09/kno-launches-kno-me-interactive-textbook-metrics-lets-you-stu/
51


Khaled	
  Bachour,	
  Frederic	
  Kaplan,	
  Pierre	
  Dillenbourg,	
  "An	
  Interac:ve	
  Table	
  for	
  Suppor:ng	
  Par:cipa:on	
  Balance	
  in	
  Face-­‐to-­‐Face	
  
Collabora:ve	
  Learning,"	
  IEEE	
  Transac:ons	
  on	
  Learning	
  Technologies,	
  vol.	
  3,	
  no.	
  3,	
  pp.	
  203-­‐213,	
  July-­‐September,	
  2010	
  
52
http://gigaom.com/2013/06/19/new-augmented-reality-glasses-let-teachers-know-when-their-students-are-falling-behind/
T. Zarraonandia, I. Aedo, P. Dıaz, and A. Montero. An augmented lecture feedback system to support learner and teacher communication. British Journal o
Technology, 44(4):616–628, 2013.
53
54
What we do
55
56
57
58
59
60
61
62
63
http://tomdebuyser.ulyssis.be/topija/Code/VisualizationV2_1.html
64
65
Abundance of data?
http://ariadne.cs.kuleuven.be/LARAe/chi14/67
68
69
70
71
Tabletops
J. Santos, S. Charleer, G. Parra, J. Klerkx, E. Duval, and K.Verbert. Evaluating the use of open badges in an open learning
environment. In D. Hernandez-Leo,T. Ley, R. Klamma, and A. Harrer, editors, Scaling up Learning for Sustained Impact, volume
8095 of Lecture Notes in Computer Science, pages 314–327. Springer Berlin Heidelberg, 2013.72
73
74
In-class display
75
Measuring sentiment
76
Measuring emotion
Privacy? Control?
77
Fear
Uncertainty
Doubt
78
http://www.slideshare.net/abelardo_pardo/ethics-and-privacy-in-learning-analytics#
Attention Trust (2005)
Property
Mobility
(Economy)
Transparancy
Data access policies
79
http://quantifiedself.com/QSLondon_Survey_overview.pdf 80
QS community
When
81
http://www.nmc.org/pdf/2014-nmc-horizon-report-he-EN.pdf82
83
Also: you?
84
what can we measure & how is it relevant?
what is relevant & how can we measure it?
85
Thank you for your attention!
joris.klerkx@cs.kuleuven.be
@jkofmsk
86

Learning Analytics - Door data gestuurd leren