The document discusses learning analytic tools for massive open online courses (MOOCs). It introduces the motivation for such tools given ubiquitous learning environments and large online resources. It then provides background on MOOCs and learning analytics, focusing on capturing learner activity traces to improve learning. The implementation section describes a learning analytics cockpit dashboard that visualizes various metrics on activity, resources accessed, and mouse interactions. An evaluation of the tool in a MOOC found it helped define activity, bridge information gaps, and support data literacy to motivate course improvement.

1. W I S S E N T E C H N I K L E I D E N S C H A F T
www.tugraz.at
Learning Analytic Tools
for Massive Open Online Courses
Karin Maier, BSc
April 11, 2019

2. 2
Motivation
Motivation
Ubiquitous learning environments
Large scaled online resources
Connected but distant learners
Karin Maier, BSc
April 11, 2019

3. 2
Motivation
Motivation
Ubiquitous learning environments
Large scaled online resources
Connected but distant learners
How to capture activity, how to bridge such
information gap?
Image Credit from [1]Karin Maier, BSc
April 11, 2019

4. 3
Background
Massive Open Online Courses
Online Courses
Many Participants
Open Resources
Interactive Content
Blended Learning/
Addition to traditional
concepts
Karin Maier, BSc
April 11, 2019

5. 4
Background
Learning Analytics
...is about collecting traces that
learners leave behind and using
those traces to improve
learning. Erik Duval, 2012
Karin Maier, BSc
April 11, 2019

6. 5
Background
TEL Marketplace, LLT, March 19, 2019
Karin Maier, BSc
April 11, 2019

7. 6
Implementation
Learning Analytics Cockpit
Dashboard with various Widgets/Metrics
PHP, HTML, CSS
JavaScript
D3.js
node.js
Karin Maier, BSc
April 11, 2019

8. 7
Implementation
Web Analytics Plugin
Karin Maier, BSc
April 11, 2019

9. 8
Implementation
How to capture learning?
How are resources accessed?
Device Statistics
Karin Maier, BSc
April 11, 2019

10. 8
Implementation
How to capture learning?
How are resources accessed?
Device Statistics
When are resources used?
Activity Calendar
Karin Maier, BSc
April 11, 2019

11. 8
Implementation
How to capture learning?
How are resources accessed?
Device Statistics
When are resources used?
Activity Calendar
Which items/regions are used?
Heat Map (Mouse Activity)
Karin Maier, BSc
April 11, 2019

12. 9
Implementation
Demo
Karin Maier, BSc
April 11, 2019

13. 10
Implementation
Features
Multiple customizable dashboards
Interactive visualizations with D3.js
Report Generation
Note Section
Activity-related Widgets
Karin Maier, BSc
April 11, 2019

14. 11
Evaluation
Proof of Concept - Law Busters
Test Period within December 2018 to February 2019
3 weeks, one hour video
each
Initial: more than 50
participants
Data aggregation and
visualization with LA
Cockpit
Karin Maier, BSc
April 11, 2019

15. 12
Evaluation
Activity Calendar
Timely patterns, see relation to events
Karin Maier, BSc
April 11, 2019

16. 13
Evaluation
Heat Map
Layout and structure matter
Karin Maier, BSc
April 11, 2019

17. 14
Evaluation
Feedback & Future Work
More and diverse widgets (include video statistics)
Some usability additions
Interactivity and visualization boost user satisfaction
Evaluate with more participants
Evaluate interface design
Karin Maier, BSc
April 11, 2019

18. 15
Summary
Conclusions 1/2
The tool showed
various ways to define activity
proposed metrics suitably bridge information gap
data literacy is supported
MOOC improvement is motivated
Karin Maier, BSc
April 11, 2019

19. 16
Summary
Conclusions 2/2
Visualization is crucial
Coherences and insights are built upon that
Learning Analytics is no silver bullet or replacement
for experienced teachers
Make connections, not categories.
Karin Maier, BSc
April 11, 2019

20. 17
Summary
Summary
Background on MOOCs and Learning Analytics
The challenges new learning environments present
Various ideas how to capture student activity
A tool to bridge the information gap of MOOCs
A tool to close the feedback loop and improve
learning resources
Karin Maier, BSc
April 11, 2019

21. 18
Summary
Thank you for your attention!
It’s time, to learn something new.
Karin Maier, BSc
April 11, 2019