SlideShare a Scribd company logo
1 of 44
Download to read offline
Evaluation of eLearning,[object Object],Michael M. Grant, PhD,[object Object],Michael M. Grant 2010,[object Object]
Evaluation of eLearning
Kirkpatrick’s Levels,[object Object],the investment of the training compared,[object Object],to its relative benefits to the organization,[object Object],and/or productivity/revenue,[object Object],Level 5:ROI,[object Object],2.1%,[object Object],7.6%,[object Object],22.9%,[object Object],53.9%,[object Object],91.3%,[object Object],(ASTD, 2005),[object Object]
Kirkpatrick (& Phillips) Model,[object Object],17.9%,[object Object],92%,[object Object],(ASTD, 2009),[object Object]
Formative Evaluation,[object Object],What’s the purpose?,[object Object]
A focus on improvement during development.,[object Object]
Level 2 Evaluations,[object Object],Appeal,[object Object],Effectiveness,[object Object],Efficiency,[object Object]
Data Collection Matrix,[object Object]
“Vote early and often.”,[object Object],The sooner formative evaluation is conducted during development, the more likely that substantive improvements will be made and costly errors avoided. (Reeves & Hedberg, 2003, p. 142),[object Object]
Evaluation of eLearning
“Experts are anyone with specialized knowledge that is relevant to the design of your ILE.”,[object Object],(Reeves & Hedberg, 2003, p. 145),[object Object]
Expert Review,[object Object]
Interface Review Guidelines,[object Object],from http://it.coe.uga.edu/~treeves/edit8350/UIRF.html,[object Object]
User Review,[object Object],Observations from one-on-ones and small groups,[object Object]
What Is Usability?,[object Object]
The most common user action on a Web site is to flee.”,[object Object],— Edward Tufte,[object Object]
“at least 90% of all commercial Web sites are overly difficult to use….the average outcome of Web usability studies is that test users fail when they try to perform a test task on the Web.  Thus, when you try something new on the Web, the expected outcome is failure.”,[object Object],— Jakob Nielsen,[object Object]
Nielsen’s Web Usability Rules,[object Object],Visibility of system status,[object Object],Match between system and real world,[object Object],User control and freedom,[object Object],Consistency and standards,[object Object],Error prevention,[object Object],Recognition rather than recall,[object Object],Flexibility and efficiency of use,[object Object],Help users recognize, diagnose, and recover from errors,[object Object],Help and documentation,[object Object],Aesthetic and minimalist design,[object Object]
Ease of learning - How fast can a user who has never seen the user interface before learn it sufficiently well to accomplish basic tasks?,[object Object],Efficiency of use - Once an experienced user has learned to use the system, how fast can he or she accomplish tasks?,[object Object],Memorability - If a user has used the system before, can he or she remember enough to use it effectively the next time or does the user have to start over again learning everything?,[object Object],Error frequency and severity - How often do users make errors while using the system, how serious are these errors, and how do users recover from these errors?,[object Object],Subjective satisfaction - How much does the user like using the system?,[object Object]
Two Major Methods to Evaluate Usability,[object Object]
Heuristic Evaluation Process,[object Object],Several experts individually compare a product to a set of usability heuristics,[object Object],Violations of the heuristics are evaluated for their severity and extent suggested solutions,[object Object],At a group meeting, violation reports are categorized and assigned,[object Object],average severity ratings, extents, heuristics violated, description of opportunity for improvement,[object Object]
Heuristic Evaluation Comparisons,[object Object],Advantages,[object Object],Quick: Do not need to find or schedule users,[object Object],Easy to review problem areas many times,[object Object],Inexpensive: No fancy equipment,[object Object],Disadvantages,[object Object],Validity: No users involved,[object Object],Finds fewer problems (40-60% less??),[object Object],Getting good experts,[object Object],Building consensus with experts,[object Object]
Heuristic Evaluation Report,[object Object]
Heuristic Evaluation Report,[object Object]
User TEsting,[object Object]
User Testing,[object Object],People whose characteristics (or profiles) match those of the Web site’s target audience perform a sequence of typical tasks using the site.,[object Object],Examines:,[object Object],Ease of learning,[object Object],Speed of task performance,[object Object],Error rates,[object Object],User satisfaction,[object Object],User retention over time,[object Object]
Image from (nz)dave at http://www.flickr.com/photos/nzdave/491411546/,[object Object]
Elements of User Testing,[object Object],Define target users,[object Object],Have users perform representative tasks,[object Object],Observe users,[object Object],Report results,[object Object]
Why Multiple Evaluators?,[object Object],Single evaluator achieves poor results,[object Object],Only finds about 35% of usability problems,[object Object],5 evaluators find more than 75%,[object Object]
Why only 5 Users?,[object Object],(Nielsen, 2000),[object Object]
Reporting User Testing,[object Object],Overall goals/objectives,[object Object],Methodology,[object Object],Target profile,[object Object],Testing outline with test script,[object Object],Specific task list to perform,[object Object],Data analysis & results,[object Object],Recommendations,[object Object]
Recent Methods for User Testing,[object Object]
Evaluation of eLearning
Evaluation of eLearning
Evaluation of eLearning
Evaluation of eLearning
Evaluation of eLearning
Evaluation of eLearning
Evaluation of eLearning
Evaluation of eLearning
10 Second Usability Test,[object Object],Disable stylesheets,[object Object],Check for the following:,[object Object],Semantic markup,[object Object],Logical organization,[object Object],Only images related to content appear,[object Object]
Alpha, Beta & Field Testing,[object Object],Akin to prototyping,[object Object]
References & Acknolwedgements,[object Object],American Society for Training & Development. (2009). The value of evaluation: Making training evaluations more effective. Author. ,[object Object],Follett, A. (2009, October 9). 10 qualitative tools to improve your web site.  Instant Shift. Retrieved March 18, 2010 from http://www.instantshift.com/2009/10/08/10-qualitative-tools-to-improve-your-website/,[object Object],Nielsen, J. (2000, March 19). Why you only need to test with 5 users. Jakob Nielsen’s Alertbox. Retrieved from http://www.useit.com/alertbox/20000319.html,[object Object],Reeves, T.C. (2004, December 9). Design research for advancing the integration of digital technologies into teaching and learning: Developing and evaluating educational interventions. Paper presented to the Columbia Center for New Media Teaching and Learning, New York, NY.  Available at http://ccnmtl.columbia.edu/seminars/reeves/CCNMTLFormative.ppt,[object Object],Reeves, T.C. & Hedberg, J.C. (2003). Interactive learning systems evaluation. Englewood Cliffs, NJ: Educational Technology Publications.,[object Object]
Michael M. Grant 2010,[object Object]

More Related Content

What's hot

Hci In The Software Process
Hci In The Software ProcessHci In The Software Process
Hci In The Software Processahmad bassiouny
 
Content package - Mobile computing
Content package - Mobile computingContent package - Mobile computing
Content package - Mobile computingPriyanka Rana
 
Introducing a tool into an organization
Introducing a tool into an organizationIntroducing a tool into an organization
Introducing a tool into an organizationYoga Pratama Putra
 
Introduction of software engineering
Introduction of software engineeringIntroduction of software engineering
Introduction of software engineeringBhagyashriMore10
 
W4A 2010 Education Tool to Support the Educational Process Chris Bailey
W4A 2010 Education Tool to Support the Educational Process Chris BaileyW4A 2010 Education Tool to Support the Educational Process Chris Bailey
W4A 2010 Education Tool to Support the Educational Process Chris Baileychrisbailey000
 
HCI Part 6 - Prototype and Evaluation Plan
HCI Part 6 - Prototype and Evaluation PlanHCI Part 6 - Prototype and Evaluation Plan
HCI Part 6 - Prototype and Evaluation PlanKemar Harris
 
American Meridian University_Force Field Analysis_ Quality Tools Series 2014
American Meridian University_Force Field Analysis_ Quality Tools Series 2014American Meridian University_Force Field Analysis_ Quality Tools Series 2014
American Meridian University_Force Field Analysis_ Quality Tools Series 2014American Meridian University
 
Evaluation in hci
Evaluation in hciEvaluation in hci
Evaluation in hcisajid rao
 
Introducing a tool into an organization 2
Introducing a tool into an organization 2Introducing a tool into an organization 2
Introducing a tool into an organization 2Bima Alvamiko
 
IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...
IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...
IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...IEEEMEMTECHSTUDENTPROJECTS
 
Test automation and beyond developing an effective continuous test strategy d...
Test automation and beyond developing an effective continuous test strategy d...Test automation and beyond developing an effective continuous test strategy d...
Test automation and beyond developing an effective continuous test strategy d...GerieOwen
 
When Users Becom Collaborators: Towards Continuous and Context-Aware User Input
When Users Becom Collaborators: Towards Continuous and Context-Aware User InputWhen Users Becom Collaborators: Towards Continuous and Context-Aware User Input
When Users Becom Collaborators: Towards Continuous and Context-Aware User InputHans-Joerg Happel
 
Introducing a tool into an organization
Introducing a tool into an organizationIntroducing a tool into an organization
Introducing a tool into an organizationM Branikno Ramadhan
 
Standards Based Approach to User Interface Development
Standards Based Approach to User Interface DevelopmentStandards Based Approach to User Interface Development
Standards Based Approach to User Interface DevelopmentSameer Chavan
 
HCI 3e - Ch 6: HCI in the software process
HCI 3e - Ch 6:  HCI in the software processHCI 3e - Ch 6:  HCI in the software process
HCI 3e - Ch 6: HCI in the software processAlan Dix
 
7 Components to Medical Device Usability Testing Success
7 Components to Medical Device Usability Testing Success7 Components to Medical Device Usability Testing Success
7 Components to Medical Device Usability Testing SuccessMargee Moore
 
Hci in software process
Hci in software processHci in software process
Hci in software processrida mariam
 
State of the art on the cognitive walkthrough method by MAHATODY, SAGAR and ...
State of the  art on the cognitive walkthrough method by MAHATODY, SAGAR and ...State of the  art on the cognitive walkthrough method by MAHATODY, SAGAR and ...
State of the art on the cognitive walkthrough method by MAHATODY, SAGAR and ...Fran Maciel
 

What's hot (20)

Online testing strategy
Online testing strategyOnline testing strategy
Online testing strategy
 
Hci In The Software Process
Hci In The Software ProcessHci In The Software Process
Hci In The Software Process
 
Content package - Mobile computing
Content package - Mobile computingContent package - Mobile computing
Content package - Mobile computing
 
Introducing a tool into an organization
Introducing a tool into an organizationIntroducing a tool into an organization
Introducing a tool into an organization
 
Introduction of software engineering
Introduction of software engineeringIntroduction of software engineering
Introduction of software engineering
 
W4A 2010 Education Tool to Support the Educational Process Chris Bailey
W4A 2010 Education Tool to Support the Educational Process Chris BaileyW4A 2010 Education Tool to Support the Educational Process Chris Bailey
W4A 2010 Education Tool to Support the Educational Process Chris Bailey
 
HCI Part 6 - Prototype and Evaluation Plan
HCI Part 6 - Prototype and Evaluation PlanHCI Part 6 - Prototype and Evaluation Plan
HCI Part 6 - Prototype and Evaluation Plan
 
American Meridian University_Force Field Analysis_ Quality Tools Series 2014
American Meridian University_Force Field Analysis_ Quality Tools Series 2014American Meridian University_Force Field Analysis_ Quality Tools Series 2014
American Meridian University_Force Field Analysis_ Quality Tools Series 2014
 
Evaluation in hci
Evaluation in hciEvaluation in hci
Evaluation in hci
 
Introducing a tool into an organization 2
Introducing a tool into an organization 2Introducing a tool into an organization 2
Introducing a tool into an organization 2
 
IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...
IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...
IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...
 
Check upload1
Check upload1Check upload1
Check upload1
 
Test automation and beyond developing an effective continuous test strategy d...
Test automation and beyond developing an effective continuous test strategy d...Test automation and beyond developing an effective continuous test strategy d...
Test automation and beyond developing an effective continuous test strategy d...
 
When Users Becom Collaborators: Towards Continuous and Context-Aware User Input
When Users Becom Collaborators: Towards Continuous and Context-Aware User InputWhen Users Becom Collaborators: Towards Continuous and Context-Aware User Input
When Users Becom Collaborators: Towards Continuous and Context-Aware User Input
 
Introducing a tool into an organization
Introducing a tool into an organizationIntroducing a tool into an organization
Introducing a tool into an organization
 
Standards Based Approach to User Interface Development
Standards Based Approach to User Interface DevelopmentStandards Based Approach to User Interface Development
Standards Based Approach to User Interface Development
 
HCI 3e - Ch 6: HCI in the software process
HCI 3e - Ch 6:  HCI in the software processHCI 3e - Ch 6:  HCI in the software process
HCI 3e - Ch 6: HCI in the software process
 
7 Components to Medical Device Usability Testing Success
7 Components to Medical Device Usability Testing Success7 Components to Medical Device Usability Testing Success
7 Components to Medical Device Usability Testing Success
 
Hci in software process
Hci in software processHci in software process
Hci in software process
 
State of the art on the cognitive walkthrough method by MAHATODY, SAGAR and ...
State of the  art on the cognitive walkthrough method by MAHATODY, SAGAR and ...State of the  art on the cognitive walkthrough method by MAHATODY, SAGAR and ...
State of the art on the cognitive walkthrough method by MAHATODY, SAGAR and ...
 

Viewers also liked

Online assessment concluding_course
Online assessment concluding_courseOnline assessment concluding_course
Online assessment concluding_courseConsultans-E
 
Usability in digital publications
Usability in digital publicationsUsability in digital publications
Usability in digital publicationsMCI Press
 
Cengage Webinar: Leading managing online class
Cengage Webinar: Leading managing online classCengage Webinar: Leading managing online class
Cengage Webinar: Leading managing online classCengage Learning
 
Online assessment ict4 elt2017
Online assessment ict4 elt2017Online assessment ict4 elt2017
Online assessment ict4 elt2017Arjana Blazic
 
Webinar - Top 5 Strategies for Digital Process Agility
Webinar - Top 5 Strategies for Digital Process AgilityWebinar - Top 5 Strategies for Digital Process Agility
Webinar - Top 5 Strategies for Digital Process AgilityBizagi
 
Mobile app heuristics evaluation by hyena labs studio
Mobile app heuristics evaluation by hyena labs studioMobile app heuristics evaluation by hyena labs studio
Mobile app heuristics evaluation by hyena labs studioHyena Design Studio
 
Are You Ready? Implementing COSO's Updated Internal Controls Framework
Are You Ready? Implementing COSO's Updated Internal Controls FrameworkAre You Ready? Implementing COSO's Updated Internal Controls Framework
Are You Ready? Implementing COSO's Updated Internal Controls FrameworkBlackLine
 
ePortfolios for Authentic Assessment
ePortfolios for Authentic AssessmentePortfolios for Authentic Assessment
ePortfolios for Authentic AssessmentDiana Benner
 
Cross-Channel Customer Experience Design in Telecommunications
Cross-Channel Customer Experience Design in TelecommunicationsCross-Channel Customer Experience Design in Telecommunications
Cross-Channel Customer Experience Design in TelecommunicationsHugo de Vries
 
Wikis in Education
Wikis in EducationWikis in Education
Wikis in Educationlesterk
 
Mission Based UX Strategy (UX Strat USA 2015)
Mission Based UX Strategy (UX Strat USA 2015)Mission Based UX Strategy (UX Strat USA 2015)
Mission Based UX Strategy (UX Strat USA 2015)Ben Judy
 
UX STRAT USA, Phil Ohme, "TurboTax Mobile Experience Strategy"
UX STRAT USA, Phil Ohme, "TurboTax Mobile Experience Strategy"UX STRAT USA, Phil Ohme, "TurboTax Mobile Experience Strategy"
UX STRAT USA, Phil Ohme, "TurboTax Mobile Experience Strategy"UX STRAT
 
UX STRAT USA, Peter Merholz, "My Journey with Experience Strategy"
UX STRAT USA, Peter Merholz, "My Journey with Experience Strategy"UX STRAT USA, Peter Merholz, "My Journey with Experience Strategy"
UX STRAT USA, Peter Merholz, "My Journey with Experience Strategy"UX STRAT
 

Viewers also liked (20)

Online assessment concluding_course
Online assessment concluding_courseOnline assessment concluding_course
Online assessment concluding_course
 
Usability in digital publications
Usability in digital publicationsUsability in digital publications
Usability in digital publications
 
Cengage Webinar: Leading managing online class
Cengage Webinar: Leading managing online classCengage Webinar: Leading managing online class
Cengage Webinar: Leading managing online class
 
Online assessment ict4 elt2017
Online assessment ict4 elt2017Online assessment ict4 elt2017
Online assessment ict4 elt2017
 
Mapping Hilton
Mapping HiltonMapping Hilton
Mapping Hilton
 
Webinar - Top 5 Strategies for Digital Process Agility
Webinar - Top 5 Strategies for Digital Process AgilityWebinar - Top 5 Strategies for Digital Process Agility
Webinar - Top 5 Strategies for Digital Process Agility
 
Mobile app heuristics evaluation by hyena labs studio
Mobile app heuristics evaluation by hyena labs studioMobile app heuristics evaluation by hyena labs studio
Mobile app heuristics evaluation by hyena labs studio
 
Wiki In Education
Wiki In EducationWiki In Education
Wiki In Education
 
Are You Ready? Implementing COSO's Updated Internal Controls Framework
Are You Ready? Implementing COSO's Updated Internal Controls FrameworkAre You Ready? Implementing COSO's Updated Internal Controls Framework
Are You Ready? Implementing COSO's Updated Internal Controls Framework
 
ePortfolios for Authentic Assessment
ePortfolios for Authentic AssessmentePortfolios for Authentic Assessment
ePortfolios for Authentic Assessment
 
Management audit sako
Management audit sakoManagement audit sako
Management audit sako
 
Cross-Channel Customer Experience Design in Telecommunications
Cross-Channel Customer Experience Design in TelecommunicationsCross-Channel Customer Experience Design in Telecommunications
Cross-Channel Customer Experience Design in Telecommunications
 
Wikis in Education
Wikis in EducationWikis in Education
Wikis in Education
 
UX Maturity Models
UX Maturity ModelsUX Maturity Models
UX Maturity Models
 
Bblackboard vs Moodle
Bblackboard vs MoodleBblackboard vs Moodle
Bblackboard vs Moodle
 
PLM-ERP Integration
PLM-ERP IntegrationPLM-ERP Integration
PLM-ERP Integration
 
Mission Based UX Strategy (UX Strat USA 2015)
Mission Based UX Strategy (UX Strat USA 2015)Mission Based UX Strategy (UX Strat USA 2015)
Mission Based UX Strategy (UX Strat USA 2015)
 
UX STRAT USA, Phil Ohme, "TurboTax Mobile Experience Strategy"
UX STRAT USA, Phil Ohme, "TurboTax Mobile Experience Strategy"UX STRAT USA, Phil Ohme, "TurboTax Mobile Experience Strategy"
UX STRAT USA, Phil Ohme, "TurboTax Mobile Experience Strategy"
 
Rubrics ppt
Rubrics pptRubrics ppt
Rubrics ppt
 
UX STRAT USA, Peter Merholz, "My Journey with Experience Strategy"
UX STRAT USA, Peter Merholz, "My Journey with Experience Strategy"UX STRAT USA, Peter Merholz, "My Journey with Experience Strategy"
UX STRAT USA, Peter Merholz, "My Journey with Experience Strategy"
 

Similar to Evaluation of eLearning

Arrogance or Apathy: The Need for Formative Evaluation + Current & Emerging S...
Arrogance or Apathy: The Need for Formative Evaluation + Current & Emerging S...Arrogance or Apathy: The Need for Formative Evaluation + Current & Emerging S...
Arrogance or Apathy: The Need for Formative Evaluation + Current & Emerging S...Michael M Grant
 
Usability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working GroupUsability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working GroupNormanMendoza
 
Software testing
Software testingSoftware testing
Software testingthaneofife
 
Lecture 10 Static Testing.ppt
Lecture 10 Static Testing.pptLecture 10 Static Testing.ppt
Lecture 10 Static Testing.pptssuser9a23691
 
What I Learned In Pr Writing
What I Learned In Pr WritingWhat I Learned In Pr Writing
What I Learned In Pr Writingcwhitin4
 
Designfor Strangers
Designfor StrangersDesignfor Strangers
Designfor Strangersguest08cd22
 
Designfo#{1} #{2}trangers
Designfo#{1} #{2}trangersDesignfo#{1} #{2}trangers
Designfo#{1} #{2}trangersguest0437b8
 
Rashmi Xerox Parc
Rashmi Xerox ParcRashmi Xerox Parc
Rashmi Xerox Parctest98
 
Designfor Strangers
Designfor StrangersDesignfor Strangers
Designfor Strangersguestbdd02b
 
Designfor Strangers
Designfor StrangersDesignfor Strangers
Designfor Strangersguru100
 
Design For Strangers
Design For StrangersDesign For Strangers
Design For Strangerstest99
 
Designfor strangers
Designfor strangersDesignfor strangers
Designfor strangersguestc72c35
 
Usability and evolution Human computer intraction.ppt
Usability and evolution Human computer intraction.pptUsability and evolution Human computer intraction.ppt
Usability and evolution Human computer intraction.pptSyedGhassanAzhar
 
Introduction to Software Review
Introduction to Software ReviewIntroduction to Software Review
Introduction to Software ReviewPhilip Johnson
 
7. evalution of interactive system
7. evalution of interactive system7. evalution of interactive system
7. evalution of interactive systemKh Ravy
 

Similar to Evaluation of eLearning (20)

Arrogance or Apathy: The Need for Formative Evaluation + Current & Emerging S...
Arrogance or Apathy: The Need for Formative Evaluation + Current & Emerging S...Arrogance or Apathy: The Need for Formative Evaluation + Current & Emerging S...
Arrogance or Apathy: The Need for Formative Evaluation + Current & Emerging S...
 
Usability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working GroupUsability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working Group
 
Software testing
Software testingSoftware testing
Software testing
 
Prvt file test
Prvt file testPrvt file test
Prvt file test
 
Lecture 10 Static Testing.ppt
Lecture 10 Static Testing.pptLecture 10 Static Testing.ppt
Lecture 10 Static Testing.ppt
 
Check upload1
Check upload1Check upload1
Check upload1
 
What I Learned In Pr Writing
What I Learned In Pr WritingWhat I Learned In Pr Writing
What I Learned In Pr Writing
 
Designfor Strangers
Designfor StrangersDesignfor Strangers
Designfor Strangers
 
Biblioteca.
Biblioteca.Biblioteca.
Biblioteca.
 
Designfo#{1} #{2}trangers
Designfo#{1} #{2}trangersDesignfo#{1} #{2}trangers
Designfo#{1} #{2}trangers
 
Rashmi Xerox Parc
Rashmi Xerox ParcRashmi Xerox Parc
Rashmi Xerox Parc
 
Designfor Strangers
Designfor StrangersDesignfor Strangers
Designfor Strangers
 
Designfor Strangers
Designfor StrangersDesignfor Strangers
Designfor Strangers
 
Design For Strangers
Design For StrangersDesign For Strangers
Design For Strangers
 
Qué es un blog?
Qué es un blog?Qué es un blog?
Qué es un blog?
 
Designfor strangers
Designfor strangersDesignfor strangers
Designfor strangers
 
Usability and evolution Human computer intraction.ppt
Usability and evolution Human computer intraction.pptUsability and evolution Human computer intraction.ppt
Usability and evolution Human computer intraction.ppt
 
Mobile Healthcare App
Mobile Healthcare AppMobile Healthcare App
Mobile Healthcare App
 
Introduction to Software Review
Introduction to Software ReviewIntroduction to Software Review
Introduction to Software Review
 
7. evalution of interactive system
7. evalution of interactive system7. evalution of interactive system
7. evalution of interactive system
 

More from Michael M Grant

Level up! Integrating Games and Gamification to Support Teaching & Learning
Level up! Integrating Games and Gamification to Support Teaching & LearningLevel up! Integrating Games and Gamification to Support Teaching & Learning
Level up! Integrating Games and Gamification to Support Teaching & LearningMichael M Grant
 
Engaging students with inquiry: Project-based learning and problem-based lear...
Engaging students with inquiry: Project-based learning and problem-based lear...Engaging students with inquiry: Project-based learning and problem-based lear...
Engaging students with inquiry: Project-based learning and problem-based lear...Michael M Grant
 
Level Up! Games & Gamification for Teaching and Learning
Level Up! Games & Gamification for Teaching and LearningLevel Up! Games & Gamification for Teaching and Learning
Level Up! Games & Gamification for Teaching and LearningMichael M Grant
 
Tried & Tested More Grounded Pedagogies for Online & Blended Courses
Tried & TestedMore Grounded Pedagogies for Online & Blended CoursesTried & TestedMore Grounded Pedagogies for Online & Blended Courses
Tried & Tested More Grounded Pedagogies for Online & Blended CoursesMichael M Grant
 
Sound Pedagogies Online in Blended, Synchronous & Asynchronous Courses
Sound Pedagogies Online in Blended, Synchronous & Asynchronous Courses Sound Pedagogies Online in Blended, Synchronous & Asynchronous Courses
Sound Pedagogies Online in Blended, Synchronous & Asynchronous Courses Michael M Grant
 
Classroom Slide Templates
Classroom Slide TemplatesClassroom Slide Templates
Classroom Slide TemplatesMichael M Grant
 
Using Mobile Devices & Apps to Drive Engagement
Using Mobile Devices & Apps to Drive EngagementUsing Mobile Devices & Apps to Drive Engagement
Using Mobile Devices & Apps to Drive EngagementMichael M Grant
 
Information Session: Submitting a proposal to the Research & Theory Division
Information Session: Submitting a proposal to the Research & Theory DivisionInformation Session: Submitting a proposal to the Research & Theory Division
Information Session: Submitting a proposal to the Research & Theory DivisionMichael M Grant
 
You gotta see this! QR codes & augmented reality
You gotta see this! QR codes & augmented realityYou gotta see this! QR codes & augmented reality
You gotta see this! QR codes & augmented realityMichael M Grant
 
Engaging Students On ground & Online
Engaging Students On ground & OnlineEngaging Students On ground & Online
Engaging Students On ground & OnlineMichael M Grant
 
Engaging Students with Inquiry
Engaging Students with InquiryEngaging Students with Inquiry
Engaging Students with InquiryMichael M Grant
 
Learning on the move: Considerations for formal, informal, and semiformal lea...
Learning on the move: Considerations for formal, informal, and semiformal lea...Learning on the move: Considerations for formal, informal, and semiformal lea...
Learning on the move: Considerations for formal, informal, and semiformal lea...Michael M Grant
 
How are schools using technology? A survey of the landscape & emerging practices
How are schools using technology? A survey of the landscape & emerging practicesHow are schools using technology? A survey of the landscape & emerging practices
How are schools using technology? A survey of the landscape & emerging practicesMichael M Grant
 
Panel on Mobile Computing Devices and Applications for Teaching & Learning
Panel on Mobile Computing Devices and Applications for Teaching & LearningPanel on Mobile Computing Devices and Applications for Teaching & Learning
Panel on Mobile Computing Devices and Applications for Teaching & LearningMichael M Grant
 
It's a phone! It's a computer! No, it's mobile learning!
It's a phone! It's a computer! No, it's mobile learning!It's a phone! It's a computer! No, it's mobile learning!
It's a phone! It's a computer! No, it's mobile learning!Michael M Grant
 
FREEways to Making Teaching & Learning Mobile
FREEways to Making Teaching & Learning MobileFREEways to Making Teaching & Learning Mobile
FREEways to Making Teaching & Learning MobileMichael M Grant
 
How Are Schools Doing Mobile?
How Are Schools Doing Mobile?How Are Schools Doing Mobile?
How Are Schools Doing Mobile?Michael M Grant
 
Definite And Indefinite: A Critical Perspective On Defining Mobile Learning a...
Definite And Indefinite: A Critical Perspective On Defining Mobile Learning a...Definite And Indefinite: A Critical Perspective On Defining Mobile Learning a...
Definite And Indefinite: A Critical Perspective On Defining Mobile Learning a...Michael M Grant
 

More from Michael M Grant (20)

Level up! Integrating Games and Gamification to Support Teaching & Learning
Level up! Integrating Games and Gamification to Support Teaching & LearningLevel up! Integrating Games and Gamification to Support Teaching & Learning
Level up! Integrating Games and Gamification to Support Teaching & Learning
 
Engaging students with inquiry: Project-based learning and problem-based lear...
Engaging students with inquiry: Project-based learning and problem-based lear...Engaging students with inquiry: Project-based learning and problem-based lear...
Engaging students with inquiry: Project-based learning and problem-based lear...
 
Level Up! Games & Gamification for Teaching and Learning
Level Up! Games & Gamification for Teaching and LearningLevel Up! Games & Gamification for Teaching and Learning
Level Up! Games & Gamification for Teaching and Learning
 
Tried & Tested More Grounded Pedagogies for Online & Blended Courses
Tried & TestedMore Grounded Pedagogies for Online & Blended CoursesTried & TestedMore Grounded Pedagogies for Online & Blended Courses
Tried & Tested More Grounded Pedagogies for Online & Blended Courses
 
Sound Pedagogies Online in Blended, Synchronous & Asynchronous Courses
Sound Pedagogies Online in Blended, Synchronous & Asynchronous Courses Sound Pedagogies Online in Blended, Synchronous & Asynchronous Courses
Sound Pedagogies Online in Blended, Synchronous & Asynchronous Courses
 
Classroom Slide Templates
Classroom Slide TemplatesClassroom Slide Templates
Classroom Slide Templates
 
Using Mobile Devices & Apps to Drive Engagement
Using Mobile Devices & Apps to Drive EngagementUsing Mobile Devices & Apps to Drive Engagement
Using Mobile Devices & Apps to Drive Engagement
 
Information Session: Submitting a proposal to the Research & Theory Division
Information Session: Submitting a proposal to the Research & Theory DivisionInformation Session: Submitting a proposal to the Research & Theory Division
Information Session: Submitting a proposal to the Research & Theory Division
 
You gotta see this! QR codes & augmented reality
You gotta see this! QR codes & augmented realityYou gotta see this! QR codes & augmented reality
You gotta see this! QR codes & augmented reality
 
Engaging Students On ground & Online
Engaging Students On ground & OnlineEngaging Students On ground & Online
Engaging Students On ground & Online
 
Engaging Students with Inquiry
Engaging Students with InquiryEngaging Students with Inquiry
Engaging Students with Inquiry
 
Learning on the move: Considerations for formal, informal, and semiformal lea...
Learning on the move: Considerations for formal, informal, and semiformal lea...Learning on the move: Considerations for formal, informal, and semiformal lea...
Learning on the move: Considerations for formal, informal, and semiformal lea...
 
How are schools using technology? A survey of the landscape & emerging practices
How are schools using technology? A survey of the landscape & emerging practicesHow are schools using technology? A survey of the landscape & emerging practices
How are schools using technology? A survey of the landscape & emerging practices
 
Panel on Mobile Computing Devices and Applications for Teaching & Learning
Panel on Mobile Computing Devices and Applications for Teaching & LearningPanel on Mobile Computing Devices and Applications for Teaching & Learning
Panel on Mobile Computing Devices and Applications for Teaching & Learning
 
Secrets of PBL for STEM
Secrets of PBL for STEMSecrets of PBL for STEM
Secrets of PBL for STEM
 
QR codes are qrazy
QR codes are qrazyQR codes are qrazy
QR codes are qrazy
 
It's a phone! It's a computer! No, it's mobile learning!
It's a phone! It's a computer! No, it's mobile learning!It's a phone! It's a computer! No, it's mobile learning!
It's a phone! It's a computer! No, it's mobile learning!
 
FREEways to Making Teaching & Learning Mobile
FREEways to Making Teaching & Learning MobileFREEways to Making Teaching & Learning Mobile
FREEways to Making Teaching & Learning Mobile
 
How Are Schools Doing Mobile?
How Are Schools Doing Mobile?How Are Schools Doing Mobile?
How Are Schools Doing Mobile?
 
Definite And Indefinite: A Critical Perspective On Defining Mobile Learning a...
Definite And Indefinite: A Critical Perspective On Defining Mobile Learning a...Definite And Indefinite: A Critical Perspective On Defining Mobile Learning a...
Definite And Indefinite: A Critical Perspective On Defining Mobile Learning a...
 

Recently uploaded

What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?TechSoup
 
How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17Celine George
 
3.21.24 The Origins of Black Power.pptx
3.21.24  The Origins of Black Power.pptx3.21.24  The Origins of Black Power.pptx
3.21.24 The Origins of Black Power.pptxmary850239
 
Work Experience for psp3 portfolio sasha
Work Experience for psp3 portfolio sashaWork Experience for psp3 portfolio sasha
Work Experience for psp3 portfolio sashasashalaycock03
 
Protein Structure - threading Protein modelling pptx
Protein Structure - threading Protein modelling pptxProtein Structure - threading Protein modelling pptx
Protein Structure - threading Protein modelling pptxvidhisharma994099
 
ARTICULAR DISC OF TEMPOROMANDIBULAR JOINT
ARTICULAR DISC OF TEMPOROMANDIBULAR JOINTARTICULAR DISC OF TEMPOROMANDIBULAR JOINT
ARTICULAR DISC OF TEMPOROMANDIBULAR JOINTDR. SNEHA NAIR
 
The basics of sentences session 10pptx.pptx
The basics of sentences session 10pptx.pptxThe basics of sentences session 10pptx.pptx
The basics of sentences session 10pptx.pptxheathfieldcps1
 
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptxSandy Millin
 
5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...CaraSkikne1
 
EBUS5423 Data Analytics and Reporting Bl
EBUS5423 Data Analytics and Reporting BlEBUS5423 Data Analytics and Reporting Bl
EBUS5423 Data Analytics and Reporting BlDr. Bruce A. Johnson
 
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdfP4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdfYu Kanazawa / Osaka University
 
How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17Celine George
 
KARNAADA.pptx made by - saransh dwivedi ( SD ) - SHALAKYA TANTRA - ENT - 4...
KARNAADA.pptx  made by -  saransh dwivedi ( SD ) -  SHALAKYA TANTRA - ENT - 4...KARNAADA.pptx  made by -  saransh dwivedi ( SD ) -  SHALAKYA TANTRA - ENT - 4...
KARNAADA.pptx made by - saransh dwivedi ( SD ) - SHALAKYA TANTRA - ENT - 4...M56BOOKSTORE PRODUCT/SERVICE
 
In - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxIn - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxAditiChauhan701637
 
Ultra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptxUltra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptxDr. Asif Anas
 
A gentle introduction to Artificial Intelligence
A gentle introduction to Artificial IntelligenceA gentle introduction to Artificial Intelligence
A gentle introduction to Artificial IntelligenceApostolos Syropoulos
 
Slides CapTechTalks Webinar March 2024 Joshua Sinai.pptx
Slides CapTechTalks Webinar March 2024 Joshua Sinai.pptxSlides CapTechTalks Webinar March 2024 Joshua Sinai.pptx
Slides CapTechTalks Webinar March 2024 Joshua Sinai.pptxCapitolTechU
 
Optical Fibre and It's Applications.pptx
Optical Fibre and It's Applications.pptxOptical Fibre and It's Applications.pptx
Optical Fibre and It's Applications.pptxPurva Nikam
 
Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....Riddhi Kevadiya
 
10 Topics For MBA Project Report [HR].pdf
10 Topics For MBA Project Report [HR].pdf10 Topics For MBA Project Report [HR].pdf
10 Topics For MBA Project Report [HR].pdfJayanti Pande
 

Recently uploaded (20)

What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?
 
How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17
 
3.21.24 The Origins of Black Power.pptx
3.21.24  The Origins of Black Power.pptx3.21.24  The Origins of Black Power.pptx
3.21.24 The Origins of Black Power.pptx
 
Work Experience for psp3 portfolio sasha
Work Experience for psp3 portfolio sashaWork Experience for psp3 portfolio sasha
Work Experience for psp3 portfolio sasha
 
Protein Structure - threading Protein modelling pptx
Protein Structure - threading Protein modelling pptxProtein Structure - threading Protein modelling pptx
Protein Structure - threading Protein modelling pptx
 
ARTICULAR DISC OF TEMPOROMANDIBULAR JOINT
ARTICULAR DISC OF TEMPOROMANDIBULAR JOINTARTICULAR DISC OF TEMPOROMANDIBULAR JOINT
ARTICULAR DISC OF TEMPOROMANDIBULAR JOINT
 
The basics of sentences session 10pptx.pptx
The basics of sentences session 10pptx.pptxThe basics of sentences session 10pptx.pptx
The basics of sentences session 10pptx.pptx
 
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
 
5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...
 
EBUS5423 Data Analytics and Reporting Bl
EBUS5423 Data Analytics and Reporting BlEBUS5423 Data Analytics and Reporting Bl
EBUS5423 Data Analytics and Reporting Bl
 
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdfP4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
 
How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17
 
KARNAADA.pptx made by - saransh dwivedi ( SD ) - SHALAKYA TANTRA - ENT - 4...
KARNAADA.pptx  made by -  saransh dwivedi ( SD ) -  SHALAKYA TANTRA - ENT - 4...KARNAADA.pptx  made by -  saransh dwivedi ( SD ) -  SHALAKYA TANTRA - ENT - 4...
KARNAADA.pptx made by - saransh dwivedi ( SD ) - SHALAKYA TANTRA - ENT - 4...
 
In - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxIn - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptx
 
Ultra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptxUltra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptx
 
A gentle introduction to Artificial Intelligence
A gentle introduction to Artificial IntelligenceA gentle introduction to Artificial Intelligence
A gentle introduction to Artificial Intelligence
 
Slides CapTechTalks Webinar March 2024 Joshua Sinai.pptx
Slides CapTechTalks Webinar March 2024 Joshua Sinai.pptxSlides CapTechTalks Webinar March 2024 Joshua Sinai.pptx
Slides CapTechTalks Webinar March 2024 Joshua Sinai.pptx
 
Optical Fibre and It's Applications.pptx
Optical Fibre and It's Applications.pptxOptical Fibre and It's Applications.pptx
Optical Fibre and It's Applications.pptx
 
Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....
 
10 Topics For MBA Project Report [HR].pdf
10 Topics For MBA Project Report [HR].pdf10 Topics For MBA Project Report [HR].pdf
10 Topics For MBA Project Report [HR].pdf
 

Evaluation of eLearning

  • 1.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 9.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 41.
  • 42.
  • 43.
  • 44.

Editor's Notes

  1. Kirkpatrick and Phillips modelLevel 1: Reaction — participants’ reactions to the instructionLevel 2: Learning — the degree to which learning occurs as a result of the instructionLevel 3: Transfers — the transfer of learning to impact on job behaviorLevel 4: Organizational performance — the impact the learning has on the organizationLevel 5: ROI — the investment of the training compared to its relative benefits to the organization and/or productivity/revenue
  2. Effectiveness, efficiency and appeal. Carry out expert review, user observations and usability testing.Purpose? Provide information to guide decisions about creating, debugging and enhancing the ILE at various stages of development.
  3. Decisions & QuestionsShould the interface be redesigned?Is the navigation clear to users?Are the meanings of icons clear?Do users get lost in navigating through the program?Should the number and length of video segments be decreased?Do user select to view video segments?Do users use video replay options?Do users rate video highly?Should more practice opportunities be added?Do user pass module quizzes?Do users achieve master on unit tests?Do users rate practice highly?Should the program scope be expanded?Are the materials coordinated with curricular guidelines?Do content experts rate the program as comprehensive?
  4. Image fromNational Photo Company Collection (Library of Congress) at http://hdl.loc.gov/loc.pnp/cph.3b23344
  5. The concern with designing software applications that people find easy to use and personally empowering.Usable computer programs are logical, intuitive and clear to the people who use them.(Reeves, 2004)
  6. From U.S. Government Web site managed by the U.S. Department of Health & Human Services athttp://www.usability.gov/basics/index.html
  7. Delicious usability lab
  8. Why not more evaluators?
  9. Userfly, lets you record your site’s users' actions and then play them back in your own browser. You are able to see exactly what people are doing, which includes mouse clicks, keystrokes (except for those in password fields for obvious security reasons), page scrolling and navigation across multiple pages. Everything happens as if you’re browsing the site yourself, except the actions you see follow another user’s recorded session.(Dmitry Fadeyev,March 9, 2009 at http://www.usabilitypost.com/2009/03/09/userfly-review/)
  10. Google Website Optimizer (GWO) is a free website testing and optimization tool that lets you test and optimize site content and design. Upload a few variations of a web page and GWO will serve them in an alternating pattern to your visitors. Behind the scenes, GWO’s reporting tools are monitoring which combinations lead to the highest conversion rates. At the end of the test, you’ll have a definitive result, allowing you to continually optimize your designs and improve site performance.While GWO may not be a purely qualitative tool, it should be one of the most important in your toolbelt. Using some of the tools listed above, you can come to better conclusions about which designs and layouts should work best, but GWO provides a real-life litmus test. GWO takes the guesswork out of design and gives you a virtual laboratory to test your assumptions.(Andrew Follett, Instant Shift, October 8, 2009 at http://www.instantshift.com/2009/10/08/10-qualitative-tools-to-improve-your-website/)
  11. Conducting a five second test allows you to find out which parts of your designs are the most prominent. You can do this in two ways: Memory TestYou give users five seconds to look at your design and then ask them to remember specific elements. Click TestYou give users five seconds to locate and click on specific elements of your design. All you need to do is upload a design you want to test and choose the type of test you want to run. You will be given a unique link that you can share with friends and colleagues and have them do your test. Of course, you can always just let our random users do your test for really fast feedback! (Angry Monkeys Pty. Ltd, Retrieved March 18, 2010 from http://www.fivesecondtest.com/about)
  12. Jason Garrison, November 21, 2009, from http://www.fivefingercoding.com/xhtml-and-css/website-usability-testingSemantic markupThe content should be understandable even without style information. Tags should be chosen based on the meaning of the content, not how they render in the browser. For instance, site navigation is really a list of links so an appropriate way to mark them up is as an unordered list.Logical organizationThe structure of the page should make sense apart from the styled layout and be arranged in an understandable hierarchy. Ideally you should use source ordered content.  The main heading would appear first followed by the most important content, which is how you’d expect a page to be laid out.The only images are those with text or some relation to the contentIf somebody read a web page to you, they probably wouldn’t talk about the tiled background or the email icon next to the contact link. While useful, these elements are decorative rather than structural. Once styles are disabled, the only images that should be left are those with text (preferably with alt attributes so they’re accessible) and those that are integral to the content.