Models of Evaluation in Educational Technology


Published on

Models of Evaluation in Educational Technology

Published in: Education, Technology
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Models of Evaluation in Educational Technology

  1. 1. TECH4102 Evaluation in Educational Technology Dr. Alaa Sadik Department of Instructional & Learning Technologies [email_address]
  2. 2. TECH4102 Evaluation in Educational Technology Week 4 Models of Evaluation in Educational Technology
  3. 3. Before Evaluation… <ul><li>What makes quality teaching and learning? </li></ul><ul><li>What are the variables that affect technology-based learning and need to be evaluated? </li></ul><ul><li>What instruments can be used to evaluate the quality of technology-based learning and provide designers with information for improvement? </li></ul>Try to answer the following questions with your team, then share the findings with us.
  4. 4. Models of Evaluation <ul><li>A Model is a hypothetical description of a complex entity or process. </li></ul><ul><li>In educational technology, an evaluation model is used to provide a framework for selecting, evaluating and improving the learning process. </li></ul>
  5. 5. Models of Evaluation <ul><li>Models of Evaluation in Educational Technology. </li></ul><ul><li>Kirkpatrick’s Four-Level Model (1975) </li></ul><ul><li>Bates’ ACTIONS Model (1995) </li></ul><ul><li>EITIMI Model (1999) </li></ul>
  6. 6. Models of Evaluation <ul><li>Kirkpatrick’s Four-Level Model (1975) </li></ul><ul><li>A four-step model used to evaluate technology-based training as well as traditional forms of delivery. </li></ul><ul><li>Reaction </li></ul><ul><li>Learning </li></ul><ul><li>Behavior </li></ul><ul><li>Results </li></ul>
  7. 7. Kirkpatrick’s Model: The best known model
  8. 8. Kirkpatrick’s Model <ul><li>1. Reaction </li></ul><ul><li>It measures how well students liked the program and technology, and includes questions about: </li></ul><ul><li>The relevance of the objectives. </li></ul><ul><li>The ability of the course to maintain interest. </li></ul><ul><li>The appropriateness of interactive exercises. </li></ul><ul><li>The ease of navigation. </li></ul><ul><li>The perceived value. </li></ul>
  9. 9. Kirkpatrick’s Model <ul><li>2. Learning </li></ul><ul><li>It measures students’ learning results and whether students actually learn the knowledge, skills, and attitudes the program was supposed to teach, or not. </li></ul>
  10. 10. Kirkpatrick’s Model <ul><li>3. Behavior/Transfer in the Workplace </li></ul><ul><li>Attempts to answer whether or not students’ behaviors actually change as a result of new learning technology, and conducted three to six months after the program. </li></ul>
  11. 11. Kirkpatrick’s Model <ul><li>4. Results </li></ul><ul><li>Measures the success of the program in terms that managers and decision-makers can understand. </li></ul><ul><li>Examples are, increased production, improved quality, decreased costs, reduced frequency of accidents, increased sales, and even higher profits or return on investment. </li></ul>
  12. 12. Models of Evaluation <ul><li>Bates’ ACTIONS Model (1995) </li></ul><ul><li>A generic framework developed at the British Open University to help in analyzing and selecting the appropriate technology. </li></ul><ul><li>Access </li></ul><ul><ul><li>How accessible is a particular technology for learners? </li></ul></ul><ul><ul><li>How flexible is it for a particular target group? </li></ul></ul>
  13. 13. Models of Evaluation <ul><li>Costs </li></ul><ul><ul><li>What is the cost structure of each technology? </li></ul></ul><ul><ul><li>What is the unit cost per student? </li></ul></ul><ul><ul><li>What are the opportunity costs vs. other technology choices? </li></ul></ul><ul><li>Teaching and Learning </li></ul><ul><ul><li>What instructional approaches will best meet these needs? </li></ul></ul><ul><ul><li>Can the content be adapted to the technology? </li></ul></ul><ul><ul><li>What skills does the technology develop? </li></ul></ul>
  14. 14. Models of Evaluation <ul><li>Interactivity and User-friendliness </li></ul><ul><ul><li>What kind of interaction does this technology enable? </li></ul></ul><ul><ul><li>How easy is it to use and learn? </li></ul></ul><ul><li>Organizational Issues </li></ul><ul><ul><li>What are the organizational requirements to provide stability and support? </li></ul></ul><ul><ul><li>What are the barriers to using this technology successfully within the institution? </li></ul></ul><ul><ul><li>What changes need to be made within the organization to incorporate the technology? </li></ul></ul>
  15. 15. Models of Evaluation <ul><li>Novelty </li></ul><ul><ul><li>How new is the technology? </li></ul></ul><ul><ul><li>What are its technical capabilities? </li></ul></ul><ul><li>Speed </li></ul><ul><ul><li>How quickly can courses be created and distributed with this technology? </li></ul></ul><ul><ul><li>How quickly can materials be changed? </li></ul></ul>
  16. 16. Models of Evaluation <ul><li>EITIMI Model (1999) </li></ul><ul><li>A three-step model considers the elements of the learning process and used for selection and evaluation of technologies to enhance the quality of teaching and learning. </li></ul>
  17. 17. Models of Evaluation <ul><li>EITIMI Model Elements </li></ul>
  18. 18. <ul><li>EITIMI Model: A Medical Course Example </li></ul>
  19. 19. Discussion & Conclusion Lap application: Apply one of the models above to evaluate an educational technology project.