Teaching Excellence Framework

1. Learning analytics
and learning gains:
Multilevel modelling
of academic
performance
Jekaterina Rogaten
TEF2016 14/07/2016

2. Open University Team
Dr Bart Rienties
Dr Jekaterina Rogaten
Prof Denise Whitelock
Dr Simon Cross
Prof Allison Littlejohn

3. Oxford Brooks University Team
Dr Ian ScottProf Rhona Sharpe

4. University of Surrey Team
Dr Simon Lygo-BakerProf Steven WarburtonProf Ian Kinchin

5. Learning Gains
•Learning gains has been defined as growth or change in
knowledge, skills, and abilities over time that can be linked
to the desired learning outcomes or learning goals of the
course

6. ABC model of Learning Gains

7. ABC model of Learning Gains

8. ABC model of Learning Gains

9. • Web of Science core collection and ERIC
• The time frame of the search 2000 – 2016
• In total 231 studies were identified of which 51 studies were
selected.
• All learning gains can be classified into ABC
• Learning gains are primarily used to examine the effect of any
particular educational ‘intervention’
Literature Review

10. Literature Review
Cognitive Learning Gains 27
studies
Behaviour-Cognitive
Learning Gains
5 studies
Affective-Behaviour-
Cognitive Learning
Gains
8 studies
Affective-Cognitive
Learning Gains
11 studies
21%
10%
53%
16%

11. Cognitive Learning Gains:
a Three-level Growth Curve Model
Level 1
Level 2
Level 3
TMA1
Student1
TMA3 TMA1 TMA2 TMA3 TMA1 TMA2 TMA3TMA2
Student2 Student3
Module1 Module2
TMA1 TMA2 TMA3
Student4
TMA1 TMA2 TMA3
Student5
Module3

12. Faculty of Arts
Trellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve

13. Business and Law
Trellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve

14. Faculty of Education and Language Studies
(FELS)
Trellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve

15. Faculty of Health and Social Care (HSC)
Trellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve

16. Math, Computing and Technology
Trellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve

17. Science
Trellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve

18. Social Science
Trellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve

19. Results
Faculty
Students
Variation in
students’ initial
achievements
Variation in
students’
subsequent
learning gain
Arts 5,066 31% -
Business & Law 11,154 16% 51%
FELS 7,015 54% 88%
HSC 4,055 65% 72%
Math, Computing & Technology 10,038 46% 77%
Science 5,791 33% 26%
Social Science 2,317 6% 19%

20. Learning analytics
and learning gains:
Multilevel modelling
of academic
performance
Jekaterina Rogaten
TEF2016 14/07/2016