1. Course Quality & Domo as Tool for Analysis
17 May 2022
Anniek Wintraeken Instructional Designer team OLE
Jurjen te Hoonte Functional Administrator team OLE
2. ▪ Context
▪ Quality
▪ Brightspace check
▪ Use of Domo (data analysis tool)
▪ Brightspace booster plan
▪ Q&A (if time left)
Session topics
2
3. ▪ 1 faculty
● 5 departments; 94 chair groups across the departments
● 19 bachelor's programmes; 30 master's programmes
● Appr. 13000 students; 6000 BSc and 7000 MSc (2020)
● Appr. 6000 employees; 236 professors
About Wageningen University & Research (WUR)
3
4. ▪ Part of ESC (Education Support Centre) (7 teams; 70 people)
▪ Responsible for Brightspace and related tools
● Product Owner
● 6 Instructional Designers (4,5 FTE)
● 4 Functional Administrators (3,4 FTE)
▪ Brightspace fully implemented by start of Academic Year 2020-2021
● 99% of all courses has a Brightspace environment
● 1426 courses in total
Team Online Learning Environment
4
5. WUR’s view on Quality
▪ The quality culture of our university is characterised by four
important values:
● the course coordinator is the main actor in the quality of
education;
● students are seen as co-owners of education and can
contribute equally;
● we stimulate bottom-up initiative and
● strive to involve the whole community in quality
assessment.
5
6. WUR’s PDCA cycles
▪ at the course level, where the lecturers have the
greatest responsibility;
▪ at the programme level, which is a fine-tuned
combined action between the Programme Board
and the Programme Committees;
▪ at the institutional level, where the Executive
Board, the Dean of Education and the Programme
Board play an important role.
6
The quality system consists of multiple coherent PDCA-cycles at various levels, in
various time schedules and many actors. The most important cycles are these:
7. Team OLE’s view on quality
System
Quality
BS & related tools
Information
Quality
Courses
design/layout/content
(not subject matter
quality)
Service
Quality
Training workshops |
webinars portfolio etc.
What's up What's new |
Showcases
Helpdesk and manuals
Pedagogical advise
8. PDCA cycle team OLE
Build courses
based on
template and
building rules :
setting a
standard
Plan and do on
course level ;
check and act
on team
service/
process level &
LMS
Result:
Brightspace qualityof
the courses differs a lot
between courses and is
up to the course
coordinators.
Some courses improve,
others deterioratein
time.
Standardis slipping
away.
9. How to complete the cycle?
▪ Brightspace check
▪ Brightspace check dashboard in DOMO
▪ Brightspace Boosterplan
10
10. ▪ Checks a course on settings/use of Brightspace
● Against the standard
● Per criterium: below, on or above standard (27 criteria total)
▪ Use
● Follow-up check on transfer with ID-er
● New courses; new to CC; new CC
● Re-design or improve courses or programmes
● Workshop ‘Boost your Brightspace’
● sUTQ (under development)
Brightspace check
11
12. ▪ DOMO, data analysis tool integrated in Brightspace
▪ Monitor the use of Brightspace by creating own reports
▪ Brightspace check dashboard is derived from the Brightspace check
● Check per course, support for manual check
● Check per theme e.g. use of module depth in a certain period
● Check EMC theme data against use of Brightspace (e.g.
gradebook)
Brightspace check dashboard in DOMO
13