This document outlines an online workshop for evaluating online materials for learning. The workshop covers pedagogy, instructional design, designing teaching materials, principles of evaluating online materials, aspects of evaluating materials, and practicing evaluation. It discusses defining learning objectives, identifying learning needs, developing learning activities, and designing and testing material prototypes. Principles of evaluation include assessing objectives and activities, learner fitness, and technical components. Bloom's Digital Taxonomy and curated lists of educational tools are presented as useful references for aligning objectives, activities, and tools.

1. ©2022
Isharyanti, N.
Evaluating
online materials
for learning
Neny Isharyanti

2. Scholarships
Alum
Neny Isharyanti,
S.Pd., M.A.,
Ph.D., AFHEA
Affiliations

3. ©2022
Isharyanti, N.
To evaluate online materials
which are appropriate for
learning
Aim of today’s workshop

4. ©2022
Isharyanti, N.
• Pedagogy
• Instructional Design
• Designing Teaching Materials
• Principles of Evaluating Online Materials
• Aspects of Evaluating Materials
• Principles of Evaluating Materials
• Practice
• Some Useful Shortcuts & References
Today’s
menu

5. ©2022
Isharyanti, N.
What comes into your mind
when you hear the word
PEDAGOGY?
Menti.com
5063 4165

6. ©2022
Isharyanti, N.
Learning
Environments
• Students
• Teacher
• Resources
• Systems
• Etc.
‘engineered’
• structured
• designed
most
effectively
facilitate
learning
Learning
Objectives
Instructional design (GagnÉ, 1987)
“deliberate design” of learning environments

7. ©2022
Isharyanti, N.
Filtering the ecology of resources (GagnÉ)
the knowledge
of the most
appropriate
media to fulfill
each step
the steps
needed to
meet these
objectives
the knowledge
of the
objectives of
the
environment
“deliberate
design” of
learning
environments
THE TEACHER IS THE EXPERT

8. ©2022
Isharyanti, N.
Designing teaching materials
(adapted from Laurillard, 2002)
Defining
Learning
Objectives
Identifying
Learning
Needs
Developing
Specific
Learning
Activities
Designing
Prototype
of Materials
Testing the
prototype

9. ©2022
Isharyanti, N.
What do we know as a teacher?
Defining
Learning
Objectives
• What to learn?
Identifying
Learning
Needs
• Why learning it?
Developing
Specific
Learning
Activities
• How to learn it?
Designing
Prototype of
Materials
• What are needed
to learn it?
Testing the
prototype
• Where does each
of them fall in the
whole learning?
LEARNING is of the UTMOST IMPORTANCE!

10. ©2022
Isharyanti, N.
ASPECTS of evaluating materials
Objectives &
Activities
Learners Technicalities

11. ©2022
Isharyanti, N.
Which one is more relevant to your learning
environment?
Principles
Relevance
Go to
MENTI.COM
Code
16694

12. ©2022
Isharyanti, N.
Principles of evaluating materials
Objectives &
Activities
• Meaningfulness
• Engagement
• Production
• Feedback
• Learners
Fitness
• Stress Level
• Inclusiveness
• Autonomy
• Technicalities
Technical
Components
• Support
• Privacy

13. ©2022
Isharyanti, N.
You are all experts. Let’s Reflect..
• Ask questions to your material, based on the principles of
evaluating materials
• Not all questions  only relevant questions
• For example…

14. ©2022
Isharyanti, N.
Now it’s your turn
I’ll model, you can contribute your questions
https://padlet.com/nenyisharyanti/iTELL1

15. ©2022
Isharyanti, N.
Rating system
• Select the questions that are more relevant to your learning
environment
• Answer the questions by giving rating of 0 to 2
• 0 – not suitable for learner’s age
• 1 – needs modification to be suitable to the learner’s age
• 2 – suitable for learner’s age
• Total your rating. The higher the more suitable the material for your
learning environment

16. ©2022
Isharyanti, N.
Let’s practice
https://padlet.com/nenyisharyanti/iTELL2

17. ©2022
Isharyanti, N.
Some useful
‘shortcuts’
Bloom’s Digital Taxonomy –
for aligning learning
objective, digital learning
activity, and possible tools.
Objectives &
Activities
• Meaningfulness
• Engagement
• Production
• Feedback

18. ©2022
Isharyanti, N.
From:
https://www.fractu
slearning.com/blo
oms-taxonomy-
digital-print-table/

19. ©2022
Isharyanti, N.
From:
https://wabisabilearning.co
m/blogs/literacy-
numeracy/download-
blooms-digital-taxonomy-
verbs-poster/

20. ©2022
Isharyanti, N.
or these compilations of tools
• https://www.educatorstechnology.com/search/label/bloom
s%20taxonomy?updated-max=2016-02-18T17:53:00-
04:00&max-results=20&start=10&by-date=false
• https://www.toptools4learning.com/

21. ©2022
Isharyanti, N.
Useful references
• Anstey, L. & Watson, G. 2018. A Rubric for Evaluating E-Learning Tools in Higher Education.
EDUCAUSE Review. Retrieved on 21 April 2020 from https://er.educause.edu/articles/2018/9/a-rubric-
for-evaluating-e-learning-tools-in-higher-education#fn3
• Bloom’s Digital Taxonomy. From: https://www.fractuslearning.com/blooms-taxonomy-digital-print-table/
• Bloom’s Digital Taxonomy. From: https://wabisabilearning.com/blogs/literacy-numeracy/download-
blooms-digital-taxonomy-verbs-poster/
• Chapelle, C. 2001. Computer applications in Second Language Acquisition: Foundations for teaching,
testing and research. Cambridge, UK: Cambridge University Press
• Davies, G. 2005. Information and Communications Technology For Language Teaching (ICT4LT)
Project. Retrieved on 27 December 2005 from http://www.ict4lt.org/index.htm
• Egbert, J. 2005. CALL essentials: Principles and practice in CALL classrooms. Alexandria, VA, USA:
TESOL.

22. ©2022
Isharyanti, N.
Questions?

23. Neny Isharyanti, Ph.D., AFHEA
Universitas Kristen Satya Wacana
Salatiga, Indonesia
neny.isharyanti@uksw.edu
@nenyish
085740001857