Presentation as part of Listening Session for revised QQI Statutory Quality Assurance Guidelines for Providers of Blended and Online Learning Programmes, 20/21 October, 2022.
Listening Session: QQI Statutory Quality Assurance Guidelines for Providers of Blended and Online Learning Programmes
1. Statutory Quality Assurance Guidelines for Providers of
Blended and Online Learning Programmes
20th & 21st October 2022
Mark Brown
Eamon Costello & Prajakta (Lily) Girme
National Institute for Digital Learning
Listening Sessions…
2. To provide a consultation forum for Irish educators and
educational providers to help shape the development of revised
Statutory QA Guidelines for Providers of Blended and Online
Learning Programmes.
Purpose
Listening Sessions…
4. 1. What are you keen to hear or learn
about in this session?
See chat-box for link to vote
Online poll…
Listening Sessions…
5. • Welcome and introductions
• The tricky question of definitions
• What can we learn from the literature?
• Brief overview of current guidelines
• Breakout room discussion
- What do you like about the guidelines?
- How could the current guidelines be improved?
- Where are the major gaps and what else needs to considered?
• Reporting back
• Next steps
Listening Sessions…
Outline
8. Online poll…
2. How clear are you about the
differences between the terms blended
and online learning?
The tricky question of definitions
See chat-box for link to vote
10. The tricky question of definitions
“What used to be a simple binary of face-to-face or online has now become so extremely
complex that our ability to understand each other is impaired” (Irvine, 2020, p. 42).
11. 2018
The tricky question of definitions
https://www.enqa.eu/wp-content/uploads/Considerations-for-QA-of-e-learning-provision.pdf
12. The tricky question of definitions
https://er.educause.edu/articles/2020/10/the-landscape-of-merging-modalities
2020
13. The tricky question of definitions
“While the statement that more online, hybrid, and technology-
supported learning are expected seems straightforward enough, one
only needs to ask what another means when they use these terms to
reveal widespread differences in how these commonly used
terms are defined” (Johnson, 2021, p. 2).
http://www.cdlra-acrfl.ca/wp-content/uploads/2021/07/2021-CDLRA-definitions-report-5.pdf
14. The tricky question of definitions
“Means
different things
to different people” (p. 564)
https://link.springer.com/article/10.1007/s11528-019-00375-5
15. How do we mean by online learning?
• 46 definitions
• Muddied terminology
• Often overlapping terms
The tricky question of definitions
https://www.tandfonline.com/doi/abs/10.1080/08923647.2019.1663082?journalCode=hajd20
16. The tricky question of definitions
“Importantly, the learner’s location is a key determinant in
naming the mode” (Johnson, Seaman & Poulin, 2022, p. 106)
On-campus
Off-campus
https://olj.onlinelearningconsortium.org/index.php/olj/article/view/3565
19. • Online education: teaching and learning predominantly
takes place off-campus, either synchronously or
asynchronously, or in combination.
The tricky question of definitions
2022
20. • Online education: teaching and learning predominantly
takes place off-campus, either synchronously or
asynchronously, or in combination.
• Hybrid education: teaching and learning involves a mix of
on-campus and off-campus study, with some synchronous
online delivery.
The tricky question of definitions
2022
21. • Online education: teaching and learning predominantly
takes place off-campus, either synchronously or
asynchronously, or in combination.
• Hybrid education: teaching and learning involves a mix of
on-campus and off-campus study, with some synchronous
online delivery.
• Blended education: teaching and learning predominantly
takes place on-campus through face-to-face study with some
asynchronous delivery.
The tricky question of definitions
2022
22. Poll result…
The tricky question of definitions
2. How clear are you about the
differences between the terms blended
and online learning?
25. 3. How familiar are you with the quality
assurance literature related to blended
and online learning?
What can we learn from the literature?
Online poll…
See chat-box for link to vote
26. What can we learn from the literature?
• How are national QA agencies responding?
• What can we learn from existing quality frameworks?
• What gaps and key lessons emerge from the research?
Three sources…
27. What can we learn from the literature?
What do we mean by quality?
28. “Quality is an elusive
term for which there is a
wide variety of
interpretations depending
upon the views of different
stakeholders.”
(Schindler, et al., 2015, p. 4)
What can we learn from the literature?
What do we mean by quality?
29. • Multifaced and multifunctional
• Mission driven and fit-for-purpose
• Where institutions are central to QA processes
• Owned, shared, and distributed across institutions
• Approach is contextualised to meet local requirements
• Is representative of all stakeholders, especially students
• Intentional and integrated into mainstream QA processes
• Conversational, shares experiences and involves feedback loops
• Evidence driven, transparent, action-focused, and impactful
• Dynamic as part of a living and thriving quality culture
Synthesis of QA principles…
What can we learn from the literature?
30. QA is not new problem…
2002
2005
2004
US
UK
NZ
What can we learn from the literature?
31. “The overarching paradox is that online and
distance education systems with their digital
content and the persistent record of online
transactions provide a rich source of evidence to
enable quality assurance and audit processes.
What can we learn from the literature?
Quality irrespective of mode…
32. “The overarching paradox is that online and
distance education systems with their digital
content and the persistent record of online
transactions provide a rich source of evidence to
enable quality assurance and audit processes.
If open and distance learning were the current
dominant mode of Higher Education… the
challenge would lie in how to quality assure a form
of education in which interactions at the core of the
system were ephemeral, highly dependent on
personal interpretation by the teacher and student
and seldom directly monitored” (2015, p. 16).
What can we learn from the literature?
Quality irrespective of mode…
https://www.pedocs.de/volltexte/2015/10879/pdf/Ossiannilsson_et_al_2015_Qualitymodels.pdf
35. “Standards or criteria take into consideration the
specific aspects related to different modes of
provision, such as transnational education,
distance or online programmes or other non-
traditional approaches to HE as relevant to the
context in which they operate” (p.7).
What can we learn from the literature?
https://www.inqaahe.org/guidelines-good-practice
36. What can we learn from the literature?
2021
Specific
https://mfhea.mt/wp-content/uploads/2021/10/Guidelines-for-FHEI-V1.pdf
37. 2019
Mapped to
Standards
Specific
What can we learn from the literature?
https://www2.mqa.gov.my/qad/garispanduan/COPIA/2019/Final%20COPPA-ODL%202nd%20edition%204.12.19.pdf
38. 2018 Aligned to Standards
Specific
What can we learn from the literature?
https://www.enqa.eu/wp-content/uploads/Considerations-for-QA-of-e-learning-provision.pdf
43. 2021
The report maintains the position that QA needs to be
embedded into existing institution-wide processes, “...
and not separate from the mainstream” (Tait, 2021, p. 9-
10).
What can we learn from the literature?
https://static1.squarespace.com/static/5b99664675f9eea7a3ecee82/t/6220bfa167590f615a454786/1646313378469/ICDE+Quality+Network+Report+2021.pdf
44. What can we learn from the literature?
2021
https://eua.eu/resources/publications/953:developing-a-high-performance-digital-education-ecosystem.html
48. 2022
What can we learn from the literature?
https://eua.eu/resources/publications/1010:strategy-and-organisational-culture-group-report.html
49. Alignment
8 Benchmarks
What can we learn from the literature?
https://www.acode.edu.au/pluginfile.php/550/mod_resource/content/8/TEL_Benchmarks.pdf
52. • Version
• Domains
• Indicators
• Levels
• Implementation Guide
• Action Plan
• Research on Use
What can we learn from the literature?
(Brown, 2022)
53. Analysis of domains across 12 quality frameworks…
Most
Common
Least
Common
What can we learn from the literature?
(Brown, 2022)
54. • An abundance of QA frameworks
• Many common dimensions shared across
the different QA frameworks
• Absence of output measures of QA
• Emergence of new QA considerations
• More research needed on how institutions
implement QA frameworks
Findings…
What can we learn from the literature?
https://www.tandfonline.com/doi/abs/10.1080/08923647.2018.1417658
55. Culture
2022
What can we learn from the literature?
https://www.tandfonline.com/doi/full/10.1080/08923647.2021.2005414
57. What can we learn from the literature?
2022 2022 2021
https://www.infoagepub.com/products/Quarterly-Review-of-Distance-Education-22-2
https://link.springer.com/referenceworkentry/10.1007/978-981-19-0351-9_41-1
https://link.springer.com/referenceworkentry/10.1007/978-981-19-0351-9_39-1
58. What can we learn from the literature?
Poll result…
3. How familiar are you with the quality
assurance literature related to blended
and online learning?
61. 4. How would you rate your knowledge of the
current QQI Statutory Quality Assurance
Guidelines for Providers of Blended Learning
Programmes?
Online poll…
Brief overview of current guidelines
See chat-box for link to vote
62. 2018
Brief overview of current guidelines
https://www.qqi.ie/sites/default/files/media/file-uploads/Statutory%20QA%20Guidelines%20for%20Blended%20Learning%20Programmes.pdf
68. Poll result…
Brief overview of current guidelines
4. How would you rate your knowledge of the
current QQI Statutory Quality Assurance
Guidelines for Providers of Blended Learning
Programmes?
70. 1. What do you like about the guidelines?
2. How could the current guidelines be improved?
3. Where are the major gaps and what else needs
to be considered?
Questions…
Breakout room discussion
30 minutes
72. Online poll…
Reporting back
See chat-box for link to vote
5. What in a single word is the most
important quality consideration that
you would like to see in the new
guidelines?
73. 1. What do you like about the guidelines?
2. How could the current guidelines be improved?
3. Where are the major gaps and what else needs
to be considered?
Reporting back
Questions…
77. Poll result 1. What are you keen to hear or learn
about in this session ?
Summary
5. What in a single word is the most
important quality consideration that you
would like to see in the new guidelines?