The SHEILA policy framework aims to guide institutional strategies for the adoption of learning analytics by addressing capabilities, ethics, privacy, and stakeholder engagement. It emphasizes the need for policy conversations among stakeholders to define the purpose and management of learning analytics while overcoming key challenges. Future versions of the framework will incorporate diverse perspectives to enhance its effectiveness.

1. SHEILA policy framework:
informing institutional strategies and
policy processes of learning analytics
Yi-Shan Tsai, Pedro Manuel Moreno-Marcos, Kairit
Tammets, Kaire Kollom, and Dragan Gašević
http://sheilaproject.eu/

2. Team

3. http://bit.ly/2EX9Hc1
http://bit.ly/2CFuRsW
http://bit.ly/2GErmFE
http://bit.ly/2BLAgSw
30,000
30,000
10,000

4. http://bit.ly/2GDq6CC

5. Mr Learning Analytics (Mr LA)
L A
L A
http://bit.ly/2EXxYln
http://bit.ly/2CerVI1

6. L A
Demand on resources
Ethics and privacy issues
Stakeholder engagement
and buy-inhttp://bit.ly/2osa5bq
http://bit.ly/2CgbrPS

7. Ferguson, R., Macfadyen, L.P., Clow, D., Tynan, B., Alexander, S. and Dawson, S. 2014. Setting Learning
Analytics in Context: Overcoming the Barriers to Large-Scale Adoption. Journal of Learning Analytics. 1, 3
(Sep. 2014), 120–144.
Macfadyen, L.P., Dawson, S., Pardo, A. and Gaševic, D. 2014. Embracing Big Data in Complex Educational
Systems: The Learning Analytics Imperative and the Policy Challenge. Research & Practice in Assessment. 9,
(2014), 17–28.
ROMA (Rapid Outcome Mapping Approach)
http://bit.ly/2omfd1n

8. Slide credit: Dragan Gašević (2017) Let’s get there! Towards policy for adoption of learning analytics. LSAC, Amsterdam, The Netherlands.

9. SHEILA framework v.1
http://sheilaproject.eu/
• 64 Interviews
• 78 Senior managers
• 51 higher education
institutions

10. Results - subthemes
Capabilities Culture
Ethics &
Privacy
Evaluation
Financial &
Human
Resources
Infrastructure
Internal &
external
Support
Management
Methodology Purpose
Stakeholder
engagement

11. Results Actions
Purpose ( , , )
Methodology ( )
Actions
Stakeholder engagement ( , , )
Challenges
Management ( )
Ethics and Privacy ( , )
Actions
Purpose ( , , )
Challenges
Methodology ( , )
Actions
Ethics and privacy ( , )
Human Resources ( , , )
Methodology ( , , )
Stakeholder involvement ( )
Actions
Methodology ( )
Financial resources ( )
Infrastructure ( )
Challenges
Methodology ( )
Infrastructure ( , , )
Culture ( , , )
Capabilities ( , )
Challenges
Methodology ( , , )
Challenges
Methodology ( , )
Management ( )
Challenges
Management ( )
Methodology ( )

12. Results
Policy prompts
Purpose: What are the reasons for introducing LA to students and staff?
Purpose: How do institutional objectives align with personal benefits for
teaching staff and students?
Policy prompts
Stakeholder engagement: Who is the policy for?
Methodology: Whose data will be collected?
Data management: How will consent be obtained?
Policy prompts
Purpose: What changes will LA bring to the
current situation?
Stakeholder engagement: How will the purpose of
LA be communicated to primary users?
Policy prompts
Purpose: What are the objectives for LA?
Methodology: How will the results of analytics be interpreted within
the context?
Policy prompts
Methodology: How will data
integrity be achieved?
Data management: How will the
data be stored and disposed?
Stakeholder engagement: What
training will be deployed?
Policy prompts
Evaluation: How will success be
measured?
Policy management: How often
will the policy be reviewed and
updated?

13. Results
Actions
Purpose ( , , )
Methodology ( )
Challenges
Management ( , )

14. Results
Policy prompts
Purpose: What are the reasons for introducing LA to
students and staff?
Purpose: How do institutional objectives align with
personal benefits for teaching staff and students?

15. Results
Actions
Stakeholder engagement ( , , )
Challenges
Management ( )
Ethics and Privacy ( , )

16. Results
Policy prompts
Stakeholder engagement:
Who is the policy for?
Methodology: Whose data
will be collected?
Data management: How
will consent be obtained?

17. Results
Actions
Purpose ( , , )
Challenges
Methodology ( , )

18. Results
Policy prompts
Purpose: What changes will LA
bring to the current situation?
Stakeholder engagement: How
will the purpose of LA be
communicated to primary users?

19. Results
Actions
Ethics and privacy ( , )
Human Resources ( , , )
Methodology ( , , )
Stakeholder involvement ( )
Challenges
Methodology ( , )
Management ( )

20. Results
Policy prompts
Purpose: What are the objectives for LA?
Methodology: How will the results of analytics be
interpreted within the context?

21. Results
Actions
Methodology ( )
Financial resources ( )
Infrastructure ( )
Challenges
Methodology ( )
Infrastructure ( , , )
Culture ( , , )
Capabilities ( , )

22. Results
Policy prompts
Methodology: How will data
integrity be achieved?
Data management: How will the
data be stored and disposed?
Stakeholder engagement: What
training will be deployed?

23. Results
Challenges
Methodology ( , , )

24. Results
Policy prompts
Evaluation: How will
success be measured?
Policy management: How
often will the policy be
reviewed and updated?

25. Discussion Purpose for LA
Collective efforts from
various stakeholders
Objectives for LA
Approaches to achieve the
objectives and address challenges
Availability of existing
resources
Currently absent in all
three cases.

26. Indicators of success are
to be defined
Discussion

27. Key challenges around
culture, capability and
infrastructure
Demand on resources
Stakeholder engagement and buy-in
Discussion

28. Policy focus:
• data management
• channels for training and
communications
Demand on resources
Stakeholder engagement and buy-in
Discussion

29. Ethics and privacy issues are
key challenges
Ethics and privacy issues
Discussion

30. Policy focus:
• privacy management
Ethics and privacy issues
Discussion

31. Discussion
Key challenges:
• methodology
• management
Policy focus:
• purpose
• value

32. Conclusion
• SHEILA policy framework intends to
initiate policy conversations around key
actions and challenges related to LA.
• Future versions will incorporate
perspectives from other stakeholders.

33. Yi-Shan Tsai
University of Edinburgh
yi-shan.tsai@ed.ac.uk
@yi_shan_tsai
Pedro Manuel Moreno-Marcos
University of Carlos III Madrid
pemoreno@it.uc3m.es
With great power comes great responsibility.
SHEILA conference
Date: 5 June 2018
Place: House of the Dutch
Provinces (Brussels)
SHEILA MOOC
Time: September 2018