Examples of evaluation studies in educational technolgy


Published on

This presenation show summaries of two evaluation studies in educational technolgy. The first summary focus on the methodolgy of the study.The second summary focus on specific educational technolgy features.

Published in: Education, Technology
1 Comment
  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Examples of evaluation studies in educational technolgy

  1. 1. Done by: Hiba AL-Gulandani Tamadher AL-Za’abi
  2. 2. Study#1: Usability and Instructional Design Heuristics for E-Learning Evaluation <ul><li>This paper aims at evaluating e-learning programs by participants in terms of usability and instructional design. </li></ul><ul><li>Evaluation instrument: This study was conducted using Nielsen’s instrument and protocol for heuristic evaluation of e-learning programs. </li></ul>
  3. 3. Nielsen’s protocol for heuristic evaluation of e-learning programs <ul><li>It is to be use by instructional designers and other experts engaged in heuristic evaluations of e-learning programs. </li></ul><ul><li>The instrument contains fifteen aspects that help participants to evaluate e-learning programs, some of which are based upon Jacob Nielsen’s widely used protocol for heuristic evaluation of any type of software ( http://useit.com/papers/heuristic/ ), and the rest of which are based upon factors related to instructional design. </li></ul>
  4. 4. Study#2: Usability and Learning: A framework for evaluation <ul><li>The purpose of this study is to develop a framework for e-learning course usability. </li></ul><ul><li>The focus of this framework is to close the gap between the educational computing and Human computer interaction. </li></ul>
  5. 5. Con, study#2 <ul><li>The researcher develop a framework using literature from books, journals, articles and conferencing articles about theories & models in e-learning and human computer interaction and he used the framework later to develop a questionnaire. </li></ul><ul><li>The aim of this questionnaire is to determine the effectiveness of the framework and to test the usability of the course. </li></ul>
  6. 6. <ul><li>In addition to the questionnaire the researcher use interview to evaluate the information system3 online course. </li></ul><ul><li>The study results shows (72) problems with usability in the course: (1) problem from the analysis of the closed question in the survey, (66) problems from the analysis of the opened questions in the survey, and (5) problems from the interview. </li></ul>
  7. 7. Number of problems Problems Criteria Category No 2 Visibility of system status General interface design criteria 1 3 Match between the system and the real world 6 User control and freedom 5 Consistency and adherence to standards 3 Error prevention, specifically prevention of peripheral usability-related errors 4 Recognition rather than recall 6 Flexibility and efficiency of use 4 Authenticity and minimalism in design 3 Recognition, diagnosis, and recovery from errors 4 Help and documentation 9 Simplicity of site navigation, organization and structure (educational websites) design criteria 2 2 Relevance of site content to user 3 Clarity of goals, objectives and outcomes Learner-centered instructional design criteria 3 2 Collaborative learning 2 Appropriateness of the level of learner control 2 Support for personally significant approaches to learning 0 Cognitive error recognition, diagnosis and recovery 8 Feedback, guidance and assessment 2 Context meaningful to domain and learner 2 Motivation, creativity and active learning
  8. 8. References: <ul><li>Ssemugabi & M.R. De. (2007). “Usability and Learning: A Framework for Evaluation”. Retrieved 20 February 2009. available at: http://www.editlib.org/?fuseaction=Reader.ViewFullText&paper_id=25488 </li></ul><ul><li>Thomas & others. (2003). “ Usability and Instructional Design Heuristics for E-Learning Evaluation”. Retrieved 20 February 2009. Available at: http://eric.ed.gov/ERICDocs/data/ericdocs2sql/content_storage_01/0000019b/80/1b/19/c8.pdf </li></ul>