Framework to Assess the Quality of Open Education Resources (OER)
1. Frameworks to Assess the
Quality of OER
Ashish Kumar Awadhiya
Assistant Director- Training & Development
Inter University Consortium (IUC)
Indira Gandhi National Open University (IGNOU)
New Delhi - 110068
1
Presented as Discussant during
National Consultation Meeting on OER,
Organized by UNESCO, CEMCA and JNU on 1–2 December 2015,
2. Open Education Resource (OER)
characterized & distinct by the Open
License
allows the community to use/ reuse/ adopt/
& repurpose
democratization of education by providing
equity & access to quality educational
opportunities
2
3. Stakeholders of OER
International/ national bodies
QA bodies
Technology providers
Institutions
Teachers & learners
3
4. Phase of OER
Phase I: focused on availability & access to
the OER.
Phase II: using OER to improve learning
experiences.
OER is currently in an intermediate phase.
‘opening up access &
availability’
‘improving learning
quality’ ’
Phase I Phase II
4
5. Barriers to Use OER
lack of institutional support
lack of technological tools for sharing &
adapting resources
lack of skills & time of users
lack of Quality or Fitness of OER
lack of trust & time.
5
6. Quality of OER
In terms of
Efficacy, Impact, Availability, Accuracy
& Excellence of the OER.
Key dimension for quality of OER is
thus Fitness for Purpose.
6
7. TIPS Framework by CEMCA
Quality indicators of OER based on
learning domains
◦ Cognitive
◦ Affective
◦ Meta-cognitive
◦ Environment &
◦ Management Domain.
7
8. TIPS Framework by CEMCA
T: Teaching & Learning Processes
I: Information & Material Content
P: Presentation, Product & Format &
S: System Technical & Technology
8
9. Teaching & learning processes
Provide Study guide on how to use OER,
navigational aids,
learner-centered, authentic pedagogy
reason & purpose , relevance & importance of the
OER
aligned to local wants & needs, current & future
needs of the student
gender-free & user-friendly, conversational & simple
language
Add tasks, activities, SAQs
Links to before & afterwards OER
Monitor progress, add feedback & offer learning
support
9
10. Information & material content
Up-to-date, accurate & reliable, relevant &
appropriate to purpose
support equality & equity, promoting social
harmony, & socially inclusive, law abiding &
non-discriminatory
authentic, internally consistent & localized
Encourage student input to create localized
content
compact in size, with added links to other
relevant resources
Include a date of production, & date of next
revision
10
11. Presentation product & format
Be sure the open license is clearly visible
easy to access & engage
clear, concise, & pleasing attractive
design
Provision for feedback from students
Printable, off-line, mobile compatible
Use open formats for maximum reuse &
remix
11
12. System technical & technology
add metadata tags about the content to find
your OER,
add metadata tags about duration, level of
difficulty, format, & size of the OER
use freeware source/ software, compatible
across platforms
OER is easily adaptable, portable &
transmissible
Your OER & the student’s work should be
easily transmitted to the student’s own e-
portfolio 12
13. Quality of Quality Assurance Tools
Transparency of procedures used to
assess quality,
Independence of bodies assessing
quality,
Reproducibility of QA procedures,
Auditability of QA processes,
Comprehensiveness of quality audits.
13
14. Implementation Framework
Institutions should be encouraged to adopt
these guidelines
Capacity building of the teachers
Do It Yourself (DIY) modules on technical
aspects of OERs
DIY modules on Mobile-OERs (M-OERs)
Promote use of freeware
Learners should be encouraged to publish
their re-purposed OERs
Repository of OERs meeting these
standards
14
16. References
Calimmeri, A., Ehlers, U. D., & Pawlowski, J. (2014). State of the Art Review of Quality Issues related to
Open Educational Resources (OER) (No. JRC88304). Institute for Prospective & Technological Studies,
Joint Research Centre.
Kawachi, P. (2014). Quality Assurance Guidelines for Open Educational Resources: TIPS Framework.
https://en.wikipedia.org/wiki/PDCA#/media/File:PDCA_Cycle.svg
16