Update on Jisc learning analytics network meeting 22 Feb at the University of Exeter

1. University of Exeter, 22 February 2017
9th UK Learning Analytics Network Meeting

2. Programme
Jisc Learning Analytics 2017
10:15 – 10:25 Arrangements for the day & welcome to the University of Exeter
10:25 – 11:25 Learning analytics at Exeter, Professor Wendy Robinson, Academic Dean for
Students
11:25 – 11:40 Tea/Coffee break
11:40 – 12:30 Update on Jisc’s learning analytics programme
12:30 – 13:30 Lunch
13:30 – 14:15 Measuring Learning Gain: Big Data, Learning Analytics, Tests and Surveys
Dr Camille B. Kandiko Howson, Senior Lecturer in Higher Education & Academic
Head of Student Engagement, King’s College London
14:15 – 15:00 Learning analytics and learning gain: the experience at Oxford Brookes
Dr Ian Scott, Assoc Dean Student Experience
15:00 – 15:15 Tea/Coffee break
15:15 – 15:55 Blackboard research into learning analytics
John Whitmer, Director of Analytics, Blackboard
15:55 – 16:00 Farewell

3. Paul Bailey, Senior Codesign Manager, Research and Development
Jisc learning analytics service
http://www.slideshare.net/paul.bailey/

4. Effective Learning Analytics Challenge
Jisc Learning Analytics 2017
Rationale
»Organisations wanted help to get started and have access to standard
tools and technologies to monitor and intervene
Priorities identified
»Code of Practice on legal and ethical issues
»Develop basic learning analytics service with app for students
»Provide a network to share knowledge and experience
Timescale
»2015-16—test and develop the tools and metrics
»2016-17—transition to service
»Sep 2017—launch, measure impact: retention and achievement

5. Jisc’s Learning Analytics Project
Three core strands:
Learning
Analytics Service
Toolkit Community
Jisc Learning Analytics
Jisc Learning Analytics 2017

6. Community: Project Blog,
mailing list and network events
Blog: http://analytics.jiscinvolve.org ~
40 blog posts
Mailing: analytics@jiscmail.ac.uk –
500+ members (190+ organisations)
9th Network Meeting ~600+
participants
Jisc Learning Analytics 2017

7. Code of Practice
Jisc Learning Analytics 2017
 Code of Practice
http://www.jisc.ac.uk/guides/code-of-practice-for-learning-
analytics
 Literature Review
http://repository.jisc.ac.uk/5661/1/Learning_Analytics_A-
_Literature_Review.pdf
 Template Learning Analytics Policy
https://analytics.jiscinvolve.org/wp/2016/11/29/developing-
an-institutional-learning-analytics-policy/
 Guidance on consent for learning analytics
https://analytics.jiscinvolve.org/wp/2017/02/16/consent-for-
learning-analytics-some-practical-guidance-for-
institutions/

8. Accessibility and Learning Analytics
Blog Post Accessibility considerations for learning analytics
https://analytics.jiscinvolve.org/wp/2016/12/14/accessibility-considerations-for-learning-
analytics/
Webinar: Data and disadvantaged students - using learning analytics for inclusion
Monday 27 February 2017, 12:00-13:00
Register: https://www.jisc.ac.uk/events/
Jisc Learning Analytics 2017

9. Analytics Labs
Invitation to join April – July analytics lab teams
http://bit.ly/jisc_bi_team_application
Jisc Learning Analytics 2017

10. Learning Analytics Service Architecture
Jisc Learning Analytics 2017

11. Descriptive
Analytics
Predictive
Analytics
Prescriptive
Analytics
AutomatedDiagnostic
Analytics
Standardised
Data
Learning
Records
Warehouse
xAPI Plugins
Data
transformation
tools
Data and API
Standards
Jisc
Services
Other
Provider
Services
Basic
dashboards
Student App
Analytics Labs
Benchmarking
services
College
Analytics
Basic predictive
modelling and
intervention
management
Procurement
frameworks
Integration
tools
Services for
researchers
Pilot projects
Services for
researchers
Pilot projects
Institutional
Dashboards
Data
visualisation
tools
Data
exploration
tools
Advanced
predictive
modelling
Integrated
intervention
management
??? ???

12. working with…
Jisc Learning Analytics 2017
Look out for
further
announcements
soon….
Dynamic
purchasing
agreement to
make it easier for
institutions…

13. Where are we now…

14. Learning analytics products and tools
Learning records warehouse – active
Data Explorer – basic visualisations
Student Unified Data Definition –
version 1.3.0 and examples major SRS
and validation too
VLE – xAPI recipe and plugins for
Blackboard and Moodle
Attendance tracking – xAPI recipe
(being piloted)
Study Goal – version 1.0 on IoS and
Android pilots - (3)
Jisc Learning Analytics 2017
Tribal Student Insights (14)
Open Learning Analytics Processor (4)
Further learning analytics product
pilots (tbc)

15. UDDValidatorTool
• UDD data preparation tool for institutions
• Will prepare all institutions for UDD historical/ live data loads into LA LRW
• Links directly to UDDGitHub site (dynamic updates)
• Covers current & future UDD - 1.2.7, 1.2.x, 1.3.0 etc
• Basic validation (UDD structure, optional/ mandatory fields, field contents)
• Relational entities – integrity checks between entities/ joins
• Data quality and concentration/ coverage checks (working withTribal/ Unicon Marist)
• Full Excel-based report pack provided to institutions, with backing audit/ tracking data for errors/ warnings
• Built-in field-level (AES) encryption, with output to JSON files (LRW load ready)
• Agile approach to software functionality/ release
• Internal version allows rapid validation for institutions – taking in JSON, XML &TSV formats
• Customer-side UDD validation (web-based, secure access) – due Q1/2 2017
• Gives control & flexibility to our members – rapidly quick data validation (Azure Cloud)
Jisc Learning Analytics 2017

16. Learning from experience…

17. Jisc Learning Analytics 2017
Initial Implementation Approach
Historic
Data
Model
Live
Data
Analyse
Results
Analysis
and Pilot
Choose
full
product
Suppliers
Institution
Team
End Users
Deploy
Study
Goal

18. Jisc Learning Analytics 2017
Current Implementation Approach
Analyse
and Pilot
Choose
full
Product
Historic
Data
Analyse
Results
Live
Data
Deploy dashboards/other
tools
Suppliers
Institution
Team
End Users
Model
Build
Deploy
Study
Goal
Deploy
DataX
Analyse
and Pilot

19. Data Explorer
 Basic visualisation tool
 Purpose: to enable initial data exploration and assist institutions to
chose suitable commercial solutions and set a basic expectation
 Being used by several pilot institutions
 Demo uses dummy data from University of Jisc
Jisc Learning Analytics 2017

20. Jisc Learning Analytics 2017

21. Jisc Learning Analytics 2017

22. Jisc Learning Analytics 2017

23. Jisc Learning Analytics 2017

24. Getting on-board…
https://analytics.jiscinvolve.org/wp/on-boarding/

25. On-boarding Process
Stage 1: Orientation
Stage 2: Discovery
Stage 3: Culture and Organisation Setup
Stage 4: Data Integration
Stage 5: Implementation Planning
Jisc Learning Analytics 2017
https://analytics.jiscinvolve.org/wp/on-boarding/

26. Contacts
Paul Bailey paul.bailey@jisc.ac.uk
Further Information:
http://www.analytics.jiscinvolve.org
Join: analytics@jiscmail.ac.uk
Jisc Learning Analytics 2017