Project Team
Mohan Menon
Phalachandra Bhandigadi
Jasmine Emmanuel
Wawasan Open University, Penang
Presented by Cheryl Hodgkinson-Williams, ROER4D Principal Investigator, University of Cape Town
A Study on the Processes of OER Integration in Course Development
1. A Study on the Processes
of OER Integration in
Course Development
Sub-Project 7 – Action research study of
teacher educators – Malaysia
Project Team
Mohan Menon
Phalachandra Bhandigadi
Jasmine Emmanuel
Wawasan Open University, Penang
Presented by Cheryl Hodgkinson-Williams, ROER4D
Principal Investigator, University of Cape Town
2. Background to the study
Training and ongoing professional development
of teachers has been one of the priority areas in
Malaysia & India, but the costs of textbooks is
high and do not have local examples
OER is regarded as having the potential to allow
for the creation and adaption of high quality
teaching and learning materials at relatively low
cost
There is inadequate research evidence on the
process of reuse and integration of OER for
designing and developing courses.
3. Study
This study probes the operational processes
involved in course development using
available online multi-media OER materials
for a 5 credit (200 hours study) course on
‘Research in Education’ at post-graduate
level
The collaborative course development is
being undertaken at the host institution,
Wawasan Open University in Penang,
Malaysia and with a group of institutions in
India and two others in Malaysia
4. General Objectives
The present study intends to probe
the:
operational processes involved in
course development using available
online text & multi-media OER materials
and
the impact of this engagement with OER
materials on the course writers’
practices and experts and learners’
perceptions of the quality of the
materials.
5.
6. Nature of data and collection
process
Variable Tools Data Source
1. Findability 1. Search LOG
2. Group reflections
Questions
From the course writers before,
during and after their
engagement in course
writing
2.
Usability/Reusabilii
ty
1. Course development LOG
2. Written individual reflection
on OER use
3. Rating scale on a set of
evaluation criteria
From course writers prior to,
during and after
development work
3. Cost/Time
efficiency
1. Course development LOG
2. Individual Reflection
Questions
From the course writers before,
during and after their
engagement in course
writing
7. Nature of data and collection
process
Variable Tools Data Source
4. Conceptual
knowledge of
OER
1. Concept Mapping
2. Individual/group reflection
From the course writers before,
during and after their
engagement in course writing
5. Attitude
towards OER
1. Scale for course writers 1. Course writers before and
after the course writing
engagement
6. Quality of
learning
materials
1. Quality Assessment scale
(Experts)-Adapted from Kawachi
(2014)
2. Quality Assessment Scale
(students)
1. Experts
2. Students
8.
9. Curriculum and Material
Development Workshops
Item Purpose of the workshop Dates Course Outputs
Research data
1. Development of
Curriculum in Research
Methodology at Post-
Graduate Level
May 2014 A Draft Curriculum Outline
2. Concept analysis
workshop
May 2015 Operationalisation of each
variable with draft items for
data collection
3 Module Development
using Multi-media OER
materials
Nov 2015
(5 days)
First draft of few units of
Modules 3, 4 and 5
Concept mapping, reflection
& Attitude survey
4. Module Development
using Multi-media OER
materials
Jan 2015
(5 days)
First draft of few units of
Modules 1 and 2 (As above)
10. Proposed Module Tryout
Workshops
Venue Proposed
Dates
Modules/ Units
being tried
Sample (about
120 students)
1. MET College of Education,
Nagakoel, India (RURAL)
25th
April Module-4: All Units 32 M.Ed. Students
2. St. Joseph college of teacher
education for women, India
(SMALL TOWN)
7th
May Module-2- All Units 35 M.Ed. Students
3. School of Education, Nottingham
University Malaysia (SMALL
TOWN)
3rd
Week of
May
Unit-1- All Units M.Ed. students
4. School of Education,,University
Sains Malaysia. (BIG CITY)
June All five modules 5 groups of M.Ed.
Students
5. Azim Prenji University,
Bangalore, India (BIG CITY)
July All five modules 5 groups of M.Ed.
Students
11. 05/11/15 Sub-Project:7-WOU, Malaysia 11
TOOL NATURE AND SCALE
OF DATA COLLECTED
METHOD OF DATA ANALYSIS
OER Search LOG and OER
USE LOG
Expert assessment tool
Verbal, descriptive – nominal
scale
Qualitative interpretative
categorisation/coding based on a set of
criteria developed from Okada (2012)
framework
OER Concept Mapping Number of concepts covered
and logical links
Analysis and assessment based on a set
of criteria (Zelik, n.d)
Individual written reflection-
Open and closed
Rating in a five point scale and
verbal narration/description-
Nominal & ordinal scale
Percentages of ratings and comparisons
Group reflection Verbal, descriptive, narrative-
nominal scale
Content/narrative analysis of transcribed
data; Qualitative interpretative
categorisation/coding
Attitude scale Rating on a five point scale-
Ordinal
Percentages of ratings and comparisons
Quality assessment scales Ratings on a five point scale
and verbal descriptive data
Percentages of ratings and comparisons
Content/narrative analysis; Qualitative
interpretative categorisation/coding
Expert rating tool Ratings and descriptive
observations
Percentages of ratings and comparisons
Content/narrative analysis; Qualitative
interpretative categorisation/coding
13. Concept map analysis
questions (following Zelik)
Are the most important concepts depicted?
Is there a substantial amount of branching
hierarchy and cross-linking?
Do any of the propositions suggest that the
course writers display significant
misconceptions of OER?
How have their concept maps changed over
the period of the course development ?
14. ACKNOWLEDGEMENT
We thank Cheryl for presentation of these
slides in our absence
We thank Tess for all the support provided
Warm regards to all participants from
Mohan, Phala and Jasmine
Sub-project-7 Team, WOU, Penang
The present study intends to probe into :
1. The operational processes involved in course development using available online multi-media OER materials and
2. Understand:
a) The process of search and use of OER materials in developing a course for e-Learning
b) The impact on the course writers engagement in writing and students engagement in studying the materials on their attitude towards OER and conceptual understanding of OER
c) The quality of OER based materials as perceived by the course writers and learners
The present study will have the following specific objectives:
To study the findability of course writers in searching for and identifying appropriately licenced online multi-media OER materials to suit the curriculum of the selected course
To identify the various levels of usability and ways of reusing OER for developing a new course
To study the cost/time efficiency of developing an e-Learning course with various levels of usability and ways of reusing OER
To study the impact of the course development and course learning process on the conceptual understanding about OER and attitude towards OER of all participating course writers and learners
To study the perceptions of teacher learners and experts reviewing the course materials with regard to the quality of learning materials
‘Findability’ is "the ability of users to identify an appropriate Web site and navigate the pages of the site to discover and retrieve relevant information resources" (Peter Morville, 2005)
‘Levels of usability and ways of reusing OE’: Reusability is an essential feature for OER designers having the facility and flexibility for adopting and/or adapting them. (Okada, 2012)
‘Cost/Time Efficiency’: relates to a comparison of what is actually produced or performed (OER-integrated course development) with what can be achieved with the sameconsumption of resources in terms of money and time.
‘Conceptual knowledge’: refers to a person’s representation of the major concepts in a system. http://wik.ed.uiuc.edu/articles/c/o/n/Conceptual_knowledge.html
‘Attitude towards OER’: A predisposition or a tendency to respond positively or negatively towards a certain idea, object, person, or situation. http://www.businessdictionary.com/definition/attitude.html
‘Quality of learning materials’: Quality is a characteristic defined by the user. In the case of a learning material, it is defined by the learner who uses the material to learn new facts, new skills, new attitudes or new behaviours. (Veniegas, 2000).
Item 1. Curriculum development workshop of two days duration was conducted in May 2015. A group of 10 experts in research methodology developed the curriculum based on existing curricula from a few universities in Malaysia and India. The curriculum is for teaching at post-graduate level and is for 200 hours study.
Item 2. Each of the variables (concepts) was analysed operationalised in specific measurable terms leading to draft description of/items to be included in the tools
Item 3 and 4. In these workshops of 5-days each, every course writer ( worked on one module (with 3-6 units) using OER materials including all media. Concept mapping exercise, written reflection on a given format and attitude towards OER scale were administered prior to and after the workshop. Group reflection sessions were held prior to, during and after the workshop
Five module tryout workshops are planned during April-to July 2015 as indicated in the slide. A total of about 120 students pursuing M.Ed. Studies in Malaysia and India are included in the sample. These students were selected from institutions agreed to participate in the study and hence are opportunity (convenient) sample. This was adopted as the intention in the study is not to generalise the finding to entire population of M.Ed. Students in Malaysia and india. The institutions are from three different demographic contexts (rural, small town and big City) from two countries
It is propose that a mixed method of analysis will be followed- Qualitative techniques such as content analysis, narrative analysis, categorisation and coding will be used for all descriptive/narrative data. where rating scales used, the ratings will be quantified in percentages and comparisons done where applicable. Where the number in the sample is large (learner group), chi-square may be used to compare pre-post ratings as well as comparison with control group.
Concept map comparisons
The concept maps will be assessed based on a the following questions: (Michael Zeilik)
Are the most important concepts depicted? Are the links among concepts scientifically acceptable? Is there a substantial amount of branching hierarchy and crosslinking? Do any of the propositions suggest that the student subscribes to significant misconceptions? How have students' concept maps changed over the course of days or weeks?