Connect curriculum to reality via creation-based learning: The pre-experiment of the CLEAR pedagogy among STEM students
1. IT活用教育センター Center for IT-based
Connect curriculum to reality via creation-based
learning: The pre-experiment of the CLEAR
pedagogy among STEM students
Dr. Jingjing Lin
Center for IT-based Education
Toyohashi University of Technology, Japan
lin.jingjing.qc@tut.jp
1
2. IT活用教育センター Center for IT-based
Two-stage research
Theoretical framework
• Lin, J. (2021). The CLEAR
Framework to Implement Active
Learning in STEM
Education, 2021 IEEE
International Conference on
Engineering, Technology &
Education (TALE), pp. 01-05, doi:
10.1109/TALE52509.2021.967870
2.
• The CLEAR model
Empirical exploration
• Lin, J. (2022). Connect curriculum
to reality via creation-based
learning: The pre-experiment of
the CLEAR pedagogy among
STEM students, 2022 The
International Symposium on
Advances in Technology
Education (ISATE), 2022.
• The pre-experiment
2
4. IT活用教育センター Center for IT-based
Virtual learning space
Moodle (version: 3.10.9+) and the Mahara (version: 21.10.1)
4
5. IT活用教育センター Center for IT-based
Research questions
• RQ1: Is the CLEAR-designed course effective in
improving students’ understanding of the topic?
• RQ2: How do demographics differentiate grades and
engagement level among students?
• RQ3: What are the students’ feedbacks on taking the
CLEAR-designed course?
5
6. IT活用教育センター Center for IT-based
Methodology
• Pre-experiment (one-group
pre-test-post-test)
– Online course: Creative
Commons (CC) Licencing:
Create, Distribute, and Use
Internet Content
– 17 undergraduate and
postgraduate students at the
Toyohashi University of
Technology
12.6% female student ratio at TUT.
* Detailed distribution of 13 non-Japanese nationality among students: five Malaysian, two Egyptian, one Indian, one Pakistani, one Mongolian, one Tanzanian, one Chinese, and one Afghan
6
8. IT活用教育センター Center for IT-based
Results and discussion
• Demographic
profile’s influence on
grades
– Nationality,
gender, education
level,
specialization
Bar chart of grades by nationality, gender, education group, and specialization
2
8
9. IT活用教育センター Center for IT-based
Results and discussion
• Demographic profile’s
influence on
engagement
– Nationality, gender,
education level,
specialization
• Activities are more
engaging than
materials.
• Most students paid little
attention to the
extended learning
content. Bar chart of engagement logs by nationality, gender, education group, and specialization
3
9
10. IT活用教育センター Center for IT-based
Results and discussion
• All participants agreed that
the course was a success.
• 94% loved the experience.
• The creation assignment was
the most time-consuming
activity in the course; 71%
felt that it was simple to
complete it; 94% considered
it valuable and boosted their
learning in the course.
4
10
11. IT活用教育センター Center for IT-based
Conclusion
• Creation-based learning approach was proven effective in improving
learning results and engaging learners.
• Learners were satisfied with the creation-based learning experience.
• Student profiles that were female, had a higher level of education, or
had greater digital literacy seemed to benefit more from the creation-
based learning experience.
• More studies are needed to validate the CLEAR model’s effectiveness
on learning performance, engagement, and course satisfaction.
• STEM subjects, bigger sample size, and true experiment design should
be used in further studies.
11
12. IT活用教育センター Center for IT-based
Q&A
Connect curriculum to reality via creation-based learning:
The pre-experiment of the CLEAR pedagogy among STEM
students
Dr. Jingjing Lin
Center for IT-based Education
Toyohashi University of Technology, Japan
lin.jingjing.qc@tut.jp
12
Editor's Notes
Greeting from Toyohashi city of Japan. I am Jingjing Lin. In this presentation I will report findings from a research project that I did at my university last year.
Let me first explain some terms in the title. Curriculum is often about sequence and content of teaching. Pedagogy is about teaching methods and tools. This research is about seeking teaching approaches hence in the domain of pedagogy. I use the phrase of “creation-based learning”, which means to engage students by creation activities that involve using digital technologies. The CLEAR pedagogy is an original teaching approach that puts the creation-based learning as the core activity in classroom and engages students in both individual and social learning process. The pre-experiment research design was adopted; therefore, the results from this study are explorative and cannot be generalized to other context and other samples.
In the IEEE TALE 2021 conference, I proposed a new instructional design model called CLEAR. It proposes to embrace creation-based learning as one active learning strategy and positions it as the primary learning activity that acts like a compass to guide students’ learning and interaction in classroom. The model is constructed with five cognitive learning processes, which are create, learn, extend, apply, and reflect. Students are informed from the very beginning that they will need to create a tangible output as the key assessment in classroom. Then they are given the must-know materials, and also bonus materials for extending their knowledge. They apply the acquired knowledge to creating the output, and share the result to exchange social feedback. In the end they need to reflect on the whole learning experience. To investigate the impact of such a design on student performance, engagement, and satisfaction, I did an empirical study as a follow-up.
The online course was hosted on the university Moodle platform, which is networked with e-portfolio management system Mahara to accept Mahara page submission as a type of Moodle assignment.
A group of 17 university students at Toyohashi University of Technology participated in a one-month online course on the topic of open licensing. Because it adopted a pre-experiment design, I chose a non-STEM topic that I am familiar with to move the research progress faster without the need of involving a STEM teacher. As exploratory approaches, pre-experiments can be a cost-effective way to discern whether a potential explanation is worthy of further investigation and to detect potential threats and risks when scaling up to true experiments.
In the pre-test all students scored less than 15 out of 20 points; In the post-test over 75% of participants scored higher than 15.
It may be tied to cultural values such as the fact that preservation is taken very seriously in Japan and seeking changes can be seen as unconstrained and irresponsible (Ge et al., 2021); therefore, Japanese students are accustomed to hearing and strictly following directions.
The student demographics were reported to significantly impact student engagement (Al-Nimer & Mustafa, 2022).