Data Collection Matrix</li></ul>Methods1. What are the logistical requirements?2. What are user reactions?3. What are trainer reactions?4. What are expert reactions?5. What corrections must be made?6. What enhancements can be made?Anecdotal recordsXXXXXUser questionnairesXXXXUser interviewsXXXXUser focus groupsXXXUsability observationsXXXXOnline data collectionXXExpert reviewsXXX<br /><ul><li>“Vote early and often.”
The sooner formative evaluation is conducted during development, the more likely that substantive improvements will be made and costly errors avoided (Reeves & Hedberg, 2003, p. 142).
Observations from one-on-ones and small groups
We need additional information about how the elearning product is being used and how it will perform.</li></ul>What Is Usability?<br /><ul><li>“The most common user action on a Web site is to flee.” —Edward Tufte
“at least 90% of all commercial Web sites are overly difficult to use….the average outcome of Web usability studies is that test users fail when they try to perform a test task on the Web. Thus, when you try something new on the Web, the expected outcome is failure.” —Jakob Nielsen
Check for the following: Semantic markup, logical organization & only images related to content appear</li></ul>Alpha, Beta & Field Testing<br /><ul><li>Akin to prototyping</li></ul>References & Acknolwedgements<br />American Society for Training & Development. (2009). The value of evaluation: Making training evaluations more effective. Author. <br />Nielsen, J. (2000, March 19). Why you only need to test with 5 users. Jakob Nielsen’s Alertbox. Retrieved from http://www.useit.com/alertbox/20000319.html<br />Reeves, T.C. (2004, December 9). Design research for advancing the integration of digital technologies into teaching and learning: Developing and evaluating educational interventions. Paper presented to the Columbia Center for New Media Teaching and Learning, New York, NY. Available at http://ccnmtl.columbia.edu/seminars/reeves/CCNMTLFormative.ppt<br />Reeves, T.C. & Hedberg, J.C. (2003). Interactive learning systems evaluation. Englewood Cliffs, NJ: Educational Technology Publications.<br />