A presentation given in the ACM User Modeling, Adaptation and Personalization (2016) conference in July 2016, describing the impact of personality in massive open online learning environment.

1. On the Impact of Personality
in Massive Open Online Learning
Guanliang Chen, Dan Davis,
Claudia Hauff, Geert-Jan Houben
Web Information Systems, TU Delft

2. Whythis research?
Personality
MOOC-based
learning
Classroom-based
learning
- Conscientious learners
are likely to succeed.
- …
matters
MOOCs

3. Whythis research?
Personality
MOOC-based
learning
Classroom-based
learning
- Conscientious learners
are likely to succeed.
- …
matters
Do learners' personalities impact their learning &
learning behaviour in the MOOC setting?
MOOCs

4. Whatresearch questions?

5. Whatresearch questions?
1
Does personality impact learner engagement, learner behaviour
and learner success in the context of MOOCs?

6. Whatresearch questions?
1
Does personality impact learner engagement, learner behaviour
and learner success in the context of MOOCs?
Can learners' personalities be predicted based on their
behaviour exhibited on a MOOC platform?2

7. Method
Data
Gathering
Feature
Engineering
Correlation
Analysis
Prediction

8. Method
Data
Gathering
Feature
Engineering
Correlation
Analysis
Prediction
MOOC
EX101x +
Learning
data
Personality
Test
Course
Surveys
Prior
knowledge
Personality
information

9. Method
Data
Gathering
Feature
Engineering
Correlation
Analysis
Prediction
Big Five Personality Test
Extraversion
Conscientiousness
Being organised, disciplined
and achievement-oriented
A high degree of sociability and
assertiveness
Agreeableness
Being helpful to others,
cooperative and sympathetic
Neuroticism
Emotional stability, the level of
anxiety and impulse control
Openness
Being intellectual curious and
prefer variety and novelty

10. Method
Data
Gathering
Feature
Engineering
Correlation
Analysis
Prediction
Big Five Personality Test
Extraversion
Conscientiousness
Being organised, disciplined
and achievement-oriented
A high degree of
assertiveness
Agreeableness
Being
cooperative
Neuroticism
Emotional stability,
anxiety
Openness
Being
prefer

11. Method
Data
Gathering
Feature
Engineering
Correlation
Analysis
Prediction
Big Five Personality Test
Extraversion
Conscientiousness
Being
and
A high degree of
assertiveness
Agreeableness
Being
cooperative
Neuroticism
Emotional stability,
anxiety
Openness
Being intellectual curious and
prefer variety and novelty

12. Method
Data
Gathering
Feature
Engineering
Correlation
Analysis
Prediction

13. Method
Data
Gathering
Feature
Engineering
Correlation
Analysis
Prediction
Video-based features
- Time watching video material
- # videos skipped
- …
Quiz-based features
- Time solving quizzes
- # Questions learners attempted to solve
- …
Forum-based features
- # New forum questions
- # Forum replies
- …

14. Method
Data
Gathering
Feature
Engineering
Correlation
Analysis
Prediction
Video-based features
- Time watching video material
- # videos skipped
- …
Quiz-based features
- Time solving quizzes
- # Questions learners attempted to solve
- …
Forum-based features
- # New forum questions
- # Forum replies
- …
In total, there are 20 features.

15. Method
Data
Gathering
Feature
Engineering
Correlation
Analysis
Prediction

16. Method
Data
Gathering
Feature
Engineering
Correlation
Analysis
Prediction
Low prior-
knowledge group
High prior-
knowledge group
Learners

17. Method
Data
Gathering
Feature
Engineering
Correlation
Analysis
Prediction
18 features
5 personality
traits
Spearman’s rank
correlation analysis
Low prior-
knowledge group
High prior-
knowledge group
Learners

18. Method
Data
Gathering
Feature
Engineering
Correlation
Analysis
Prediction

19. Method
Data
Gathering
Feature
Engineering
Correlation
Analysis
Prediction
Learning features
Personality traits
Input
Regression
Model
Output
Gaussian Processes
Ramdom Forests

20. Results
Correlation
Analysis
Prediction
Accuracy

21. Prediction
Accuracy
Results
Correlation
Analysis
Low prior-knowledge group E A C N O
Time watching video material (in min.) 0.00 -0.04 0.15 0.03 -0.18
Time solving quizes (in min.) -0.02 0.02 0.07 0.02 -0.18
# Questions learners attempted to solve -0.04 -0.04 0.15 0.03 -0.17
# New forum questions 0.07 0.04 0.01 0.04 0.00
# Forum replies 0.12 0.12 0.00 0.01 0.03
# Total forum postings 0.11 0.10 0.03 0.03 0.02
Forum browsing time -0.10 0.00 0.06 -0.04 -0.13
Forum accesses -0.11 -0.04 0.06 -0.05 -0.16
# Forum interactions 0.10 0.11 0.03 0.04 0.03
Total time on-site -0.02 -0.03 0.12 0.01 -0.19
Average time responded to videos 0.09 -0.04 -0.04 -0.06 -0.1
Average time responded to quizs 0.03 0 -0.14 -0.1 -0.15
# Videos skipped 0.02 0.07 -0.14 -0.04 0.18
# Videos sped up 0.00 -0.03 0.10 -0.01 -0.02
Maximum session time -0.02 -0.05 0.10 0.00 -0.17
Average session time 0.00 -0.03 0.05 -0.01 -0.08
Standard deviation session time 0.04 -0.01 0.11 0.02 -0.16
Average between-quizzes time 0.03 0.10 0.00 0.02 -0.10
Standard deviation between-quizzes time 0.01 0.06 0.04 0.01 -0.14
Final score -0.06 -0.07 0.12 0.07 -0.15

22. Prediction
Accuracy
Results
Correlation
Analysis
Low prior-knowledge group E A C N O
Time watching video material (in min.) 0.00 -0.04 0.15 0.03 -0.18
Time solving quizes (in min.) -0.02 0.02 0.07 0.02 -0.18
# Questions learners attempted to solve -0.04 -0.04 0.15 0.03 -0.17
# New forum questions 0.07 0.04 0.01 0.04 0.00
# Forum replies 0.12 0.12 0.00 0.01 0.03
# Total forum postings 0.11 0.10 0.03 0.03 0.02
Forum browsing time -0.10 0.00 0.06 -0.04 -0.13
Forum accesses -0.11 -0.04 0.06 -0.05 -0.16
# Forum interactions 0.10 0.11 0.03 0.04 0.03
Total time on-site -0.02 -0.03 0.12 0.01 -0.19
Average time responded to videos 0.09 -0.04 -0.04 -0.06 -0.1
Average time responded to quizs 0.03 0 -0.14 -0.1 -0.15
# Videos skipped 0.02 0.07 -0.14 -0.04 0.18
# Videos sped up 0.00 -0.03 0.10 -0.01 -0.02
Maximum session time -0.02 -0.05 0.10 0.00 -0.17
Average session time 0.00 -0.03 0.05 -0.01 -0.08
Standard deviation session time 0.04 -0.01 0.11 0.02 -0.16
Average between-quizzes time 0.03 0.10 0.00 0.02 -0.10
Standard deviation between-quizzes time 0.01 0.06 0.04 0.01 -0.14
Final score -0.06 -0.07 0.12 0.07 -0.15
Only openness to experience and conscientiousness are
significantly correlated with a number of features.

23. Prediction
Accuracy
Results
Correlation
Analysis
Low prior-knowledge group E A C N O
Time watching video material (in min.) 0.00 -0.04 0.15 0.03 -0.18
Time solving quizes (in min.) -0.02 0.02 0.07 0.02 -0.18
# Questions learners attempted to solve -0.04 -0.04 0.15 0.03 -0.17
# New forum questions 0.07 0.04 0.01 0.04 0.00
# Forum replies 0.12 0.12 0.00 0.01 0.03
# Total forum postings 0.11 0.10 0.03 0.03 0.02
Forum browsing time -0.10 0.00 0.06 -0.04 -0.13
Forum accesses -0.11 -0.04 0.06 -0.05 -0.16
# Forum interactions 0.10 0.11 0.03 0.04 0.03
Total time on-site -0.02 -0.03 0.12 0.01 -0.19
Average time responded to videos 0.09 -0.04 -0.04 -0.06 -0.1
Average time responded to quizs 0.03 0 -0.14 -0.1 -0.15
# Videos skipped 0.02 0.07 -0.14 -0.04 0.18
# Videos sped up 0.00 -0.03 0.10 -0.01 -0.02
Maximum session time -0.02 -0.05 0.10 0.00 -0.17
Average session time 0.00 -0.03 0.05 -0.01 -0.08
Standard deviation session time 0.04 -0.01 0.11 0.02 -0.16
Average between-quizzes time 0.03 0.10 0.00 0.02 -0.10
Standard deviation between-quizzes time 0.01 0.06 0.04 0.01 -0.14
Final score -0.06 -0.07 0.12 0.07 -0.15
Only openness to experience and conscientiousness are
significantly correlated with a number of features.
Conscientious learners (self-disciplined, striving for success) are likely
to be more engaged with more learning materials.

24. Prediction
Accuracy
Results
Correlation
Analysis
Low prior-knowledge group E A C N O
Time watching video material (in min.) 0.00 -0.04 0.15 0.03 -0.18
Time solving quizes (in min.) -0.02 0.02 0.07 0.02 -0.18
# Questions learners attempted to solve -0.04 -0.04 0.15 0.03 -0.17
# New forum questions 0.07 0.04 0.01 0.04 0.00
# Forum replies 0.12 0.12 0.00 0.01 0.03
# Total forum postings 0.11 0.10 0.03 0.03 0.02
Forum browsing time -0.10 0.00 0.06 -0.04 -0.13
Forum accesses -0.11 -0.04 0.06 -0.05 -0.16
# Forum interactions 0.10 0.11 0.03 0.04 0.03
Total time on-site -0.02 -0.03 0.12 0.01 -0.19
Average time responded to videos 0.09 -0.04 -0.04 -0.06 -0.1
Average time responded to quizs 0.03 0 -0.14 -0.1 -0.15
# Videos skipped 0.02 0.07 -0.14 -0.04 0.18
# Videos sped up 0.00 -0.03 0.10 -0.01 -0.02
Maximum session time -0.02 -0.05 0.10 0.00 -0.17
Average session time 0.00 -0.03 0.05 -0.01 -0.08
Standard deviation session time 0.04 -0.01 0.11 0.02 -0.16
Average between-quizzes time 0.03 0.10 0.00 0.02 -0.10
Standard deviation between-quizzes time 0.01 0.06 0.04 0.01 -0.14
Final score -0.06 -0.07 0.12 0.07 -0.15
Only openness to experience and conscientiousness are
significantly correlated with a number of features.
Learners with high openness (being intellectually curious, prefer
variety) are less likely to spend time on the learning material.
Conscientious learners (self-disciplined, striving for success) are likely
to be more engaged with more learning materials.

25. Prediction
Accuracy
Correlation
Analysis
Results
High prior-knowledge group E A C N O
Time watching video material (in min.) -0.08 -0.07 0.09 0.05 -0.01
Time solving quizes (in min.) -0.09 -0.10 0.10 0.04 -0.03
# Questions learners attempted to solve -0.13 -0.08 0.08 0.00 -0.03
# New forum questions -0.04 0.04 0.10 -0.03 0.03
# Forum replies -0.02 0.03 0.15 0.08 0.03
# Total forum postings -0.03 0.02 0.15 0.02 0.03
Forum browsing time -0.11 -0.04 0.02 -0.03 -0.06
Forum accesses -0.14 -0.06 0.03 -0.04 -0.04
# Forum interactions -0.02 0.02 0.15 0.03 0.03
Total time on-site -0.07 -0.07 0.11 0.04 -0.03
Average time responded to videos 0.05 -0.02 -0.01 0.06 0.03
Average time responded to quizs 0.03 -0.05 0 0.05 0.02
# Videos skipped 0.09 0.08 -0.09 -0.04 0.00
# Videos sped up 0.03 0.00 0.06 0.09 0.06
Maximum session time -0.04 -0.04 0.11 0.04 -0.04
Average session time 0.06 -0.05 0.03 0.06 -0.04
Standard deviation session time -0.03 -0.07 0.12 0.04 -0.04
Average between-quizzes time 0.00 -0.06 0.09 0.06 0.00
Standard deviation between-quizzes time -0.03 -0.07 0.09 0.07 0.00
Final score -0.12 -0.05 0.07 0.01 -0.01

26. Prediction
Accuracy
Correlation
Analysis
Results
High prior-knowledge group E A C N O
Time watching video material (in min.) -0.08 -0.07 0.09 0.05 -0.01
Time solving quizes (in min.) -0.09 -0.10 0.10 0.04 -0.03
# Questions learners attempted to solve -0.13 -0.08 0.08 0.00 -0.03
# New forum questions -0.04 0.04 0.10 -0.03 0.03
# Forum replies -0.02 0.03 0.15 0.08 0.03
# Total forum postings -0.03 0.02 0.15 0.02 0.03
Forum browsing time -0.11 -0.04 0.02 -0.03 -0.06
Forum accesses -0.14 -0.06 0.03 -0.04 -0.04
# Forum interactions -0.02 0.02 0.15 0.03 0.03
Total time on-site -0.07 -0.07 0.11 0.04 -0.03
Average time responded to videos 0.05 -0.02 -0.01 0.06 0.03
Average time responded to quizs 0.03 -0.05 0 0.05 0.02
# Videos skipped 0.09 0.08 -0.09 -0.04 0.00
# Videos sped up 0.03 0.00 0.06 0.09 0.06
Maximum session time -0.04 -0.04 0.11 0.04 -0.04
Average session time 0.06 -0.05 0.03 0.06 -0.04
Standard deviation session time -0.03 -0.07 0.12 0.04 -0.04
Average between-quizzes time 0.00 -0.06 0.09 0.06 0.00
Standard deviation between-quizzes time -0.03 -0.07 0.09 0.07 0.00
Final score -0.12 -0.05 0.07 0.01 -0.01
Again, no significant correlation between behavioural features and
agreeableness and neuroticism can be observed.

27. Prediction
Accuracy
Correlation
Analysis
Results
High prior-knowledge group E A C N O
Time watching video material (in min.) -0.08 -0.07 0.09 0.05 -0.01
Time solving quizes (in min.) -0.09 -0.10 0.10 0.04 -0.03
# Questions learners attempted to solve -0.13 -0.08 0.08 0.00 -0.03
# New forum questions -0.04 0.04 0.10 -0.03 0.03
# Forum replies -0.02 0.03 0.15 0.08 0.03
# Total forum postings -0.03 0.02 0.15 0.02 0.03
Forum browsing time -0.11 -0.04 0.02 -0.03 -0.06
Forum accesses -0.14 -0.06 0.03 -0.04 -0.04
# Forum interactions -0.02 0.02 0.15 0.03 0.03
Total time on-site -0.07 -0.07 0.11 0.04 -0.03
Average time responded to videos 0.05 -0.02 -0.01 0.06 0.03
Average time responded to quizs 0.03 -0.05 0 0.05 0.02
# Videos skipped 0.09 0.08 -0.09 -0.04 0.00
# Videos sped up 0.03 0.00 0.06 0.09 0.06
Maximum session time -0.04 -0.04 0.11 0.04 -0.04
Average session time 0.06 -0.05 0.03 0.06 -0.04
Standard deviation session time -0.03 -0.07 0.12 0.04 -0.04
Average between-quizzes time 0.00 -0.06 0.09 0.06 0.00
Standard deviation between-quizzes time -0.03 -0.07 0.09 0.07 0.00
Final score -0.12 -0.05 0.07 0.01 -0.01
Again, no significant correlation between behavioural features and
agreeableness and neuroticism can be observed.
Conscientious learners are likely to be active in forum discussion, while
extraneous leaners not.

28. Prediction
Accuracy
Correlation
Analysis
Results
High prior-knowledge group E A C N O
Time watching video material (in min.) -0.08 -0.07 0.09 0.05 -0.01
Time solving quizes (in min.) -0.09 -0.10 0.10 0.04 -0.03
# Questions learners attempted to solve -0.13 -0.08 0.08 0.00 -0.03
# New forum questions -0.04 0.04 0.10 -0.03 0.03
# Forum replies -0.02 0.03 0.15 0.08 0.03
# Total forum postings -0.03 0.02 0.15 0.02 0.03
Forum browsing time -0.11 -0.04 0.02 -0.03 -0.06
Forum accesses -0.14 -0.06 0.03 -0.04 -0.04
# Forum interactions -0.02 0.02 0.15 0.03 0.03
Total time on-site -0.07 -0.07 0.11 0.04 -0.03
Average time responded to videos 0.05 -0.02 -0.01 0.06 0.03
Average time responded to quizs 0.03 -0.05 0 0.05 0.02
# Videos skipped 0.09 0.08 -0.09 -0.04 0.00
# Videos sped up 0.03 0.00 0.06 0.09 0.06
Maximum session time -0.04 -0.04 0.11 0.04 -0.04
Average session time 0.06 -0.05 0.03 0.06 -0.04
Standard deviation session time -0.03 -0.07 0.12 0.04 -0.04
Average between-quizzes time 0.00 -0.06 0.09 0.06 0.00
Standard deviation between-quizzes time -0.03 -0.07 0.09 0.07 0.00
Final score -0.12 -0.05 0.07 0.01 -0.01
Again, no significant correlation between behavioural features and
agreeableness and neuroticism can be observed.
Overall, behavioural features extracted from MOOC log traces are less
correlated with personality traits than lexical or behavioural features
extracted from social media traces.
Conscientious learners are likely to be active in forum discussion, while
extraneous leaners not.

29. Prediction
Accuracy
Correlation
Analysis
Results
Evaluation: Spearman’ rank correlation coefficient

30. Prediction
Accuracy
Correlation
Analysis
Results
Evaluation: Spearman’ rank correlation coefficient
Significant correlations (indicating usable predictions) are achieved
for 4 of the 5 personality traits.

31. Prediction
Accuracy
Correlation
Analysis
Results
Evaluation: Spearman’ rank correlation coefficient
Significant correlations (indicating usable predictions) are achieved
for 4 of the 5 personality traits.
The correlation coefficients tend to increase with
increasing course weeks.

32. Prediction
Accuracy
Correlation
Analysis
Results
Evaluation: Spearman’ rank correlation coefficient
Significant correlations (indicating usable predictions) are achieved
for 4 of the 5 personality traits.
The correlation coefficients tend to increase with
increasing course weeks.
Extraversion and neuroticism achieve the highest prediction accuracy.

33. Summary

34. Summary
1
Various learning features are correlated with
the personality traits of conscientiousness and openness.

35. Summary
1
Various learning features are correlated with
the personality traits of conscientiousness and openness.
The predictions are statistically significant for 4 out of the 5
personality traits and improve as more data becomes available.2

36. http://bit.ly/wis-learning-analytics
Thanks for your
attention!