This workshop was give at the EUNIS Learning Analytics Workshop on 12 October 2018.

1. SHEILA
workshop
Developing an evidence-based
institutional learning analytics
policy

2. Main sources of data
• Institutional leader interviews
• Group concept mapping (LA experts)
• Staff focus groups
• Student focus groups
http://sheilaproject.eu/

3. Institutional leader interviews (64 interviews, 51 institutions)
1. Does your institution have a learning analytics project? What is it?
2. Why are you doing it? (Or, why do you plan to do it?)
3. Do/Will you have a strategy for this project?
4. How does/ will your institution develop the strategy?
5. How does/ will your institution prepare itself for learning analytics?
6. Has your institution achieved any goals? How do/ will you evaluate the results?
7. What may have contributed to the success of this project?
8. Has your institution encountered any challenges when implementing the
project? (And/ Or, do you foresee any (more) challenges in this project?)
9. What ethical and privacy considerations do you have to take account of?
10. What do you think is essential in a learning analytics policy?
http://sheilaproject.eu/

4. Inclusive adoption process
Macfadyen, L., Dawson, S., Pardo, A., Gašević, D., (2014). The learning analytics imperative and the sociotechnical challenge: Policy for complex systems. Research & Practice in Assessment,
9(Winter 2014), 17-28.
http://sheilaproject.eu/

5. Onderwerp via >Beeld >Koptekst en voettekst Pagina 5
27 March 2014@HDrachsler 5 / 31
An essential feature of a higher education institution’s
learning analytics policy should be …
Group Concept Mapping

6. Point Map
1 2
3
4 5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39 40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79 80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
9899

7. Staff focus groups(16 focus groups, 59 teaching staff)
1. What do you think would be legitimate purposes for the university to use such data?
2. What kinds of data would be particularly useful to you in improving students’ educational
experience in a module/course/programme that you are responsible for?
3. What kinds of data would be particularly useful to you in your professional development?
4. Do you see any challenges in offering teaching and learning support to your students?
5. Do you see any ways learning analytics could be used to address these challenges by taking
advantage of student data or data about your teaching performance?
6. Do you consider there to be any ethical or legal issues concerning the use of student data or data
about your teaching activities and effectiveness?
7. Here are some examples of ways the university could use learning analytics to enhance learning and
teaching. Which of these uses of do you think would be useful (multiple choices)?
8. How do you think teaching staff and tutors should approach the analysis results of student data?
9. Are there any concerns you would have in incorporating learning analytics into teaching?
10. Do you have any suggestions for the adoption of learning analytics at the University?
http://sheilaproject.eu/

8. Student focus groups (18 focus groups, 74 students)
1. Are you aware that your university has the ability to collect and analyse data about your
actions in various learning environments?
2. What would be legitimate purposes for the university to use your data?
3. Do you consider there to be any ethical or legal issues with this collection and analysis of your
data?
4. Do you think the university should allow you to opt out of data collection at any time?
5. Thinking about the learning support that you have received from the university, is there
anything that could have been done better?
6. Would you like the university to use your background and educational data to support you in
areas that we just discussed?
7. Here are some examples of ways the university could use your background and educational
data to support your learning. Which of these uses of your data would you prefer?
8. How would you like to receive feedback from the analysis of your educational data?
9. How should teaching staff and tutors approach the analysis of your data?
10. Are there any concerns you would have towards the way the university uses your data?
http://sheilaproject.eu/