Measuring the Effectiveness
   of Online Tutorials:
  A Pragmatic Approach
                 Curt G. Friehs
               ...
A Bear with a Bad Idea
Occasionally People Get Bad
       Ideas Too…
That Includes Librarians
s   “Interactivity is the online hallmark of active
    learning.” ~Nancy Dewald
s   Technology i...
Our Conclusions
s   Online tutorials can supplement
    (but not completely replace) live library
    instruction unless y...
Replacement Librarian and Library
    Fine Negotiator “iBender”
Our Conclusions, Continued
s Students learn more from video tutorials
  than from HTML tutorials.
s Interactivity is not n...
Research: Part I
s   Surveyed 140 finance students after watching
     Value Line Online tutorial.
s   Tutorial left stude...
HTML vs. Streaming Media Tutorials

                                                  Streaming Media
     Principle      ...
Creating the Tutorials
                 HTML Tutorial




Video Tutorial
Survey Results
        Interactive n=53    Video n=54
    s   Confidence BEFORE tutorial
        - Interactive:     64%
  ...
Quiz Results: Correct Answers
         Interactive n=53    Video n=54
  s   Question 1
      - Interactive:        29 (55%...
Quiz Results: Correct Answers
          Interactive n=53    Video n=54
   s   Question 4
       - Interactive:        29 (...
Special Thanks
s   Laura Baas
s   Jennifer McCoy
s   Peggy Ward
s   John Sweller
s   South Central Kansas Library System
s...
Upcoming SlideShare
Loading in …5
×

Measuring the Effectiveness of Online Tutorials: A Pragmatic Approach

3,119 views

Published on

Presented by Curt Friehs and Cindy Craig at the 15th Annual Reference Research Forum, ALA Annual, Chicago, July 12, 2009.

Published in: Education, Technology
1 Comment
1 Like
Statistics
Notes
  • Excellent presentation at ALA; interesting conclusions, and as a long-time advocate of the static, text-based tutorial, much food for thought. Whatever works best, and if the conclusions here are any indication, some rethinking is in order.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total views
3,119
On SlideShare
0
From Embeds
0
Number of Embeds
19
Actions
Shares
0
Downloads
33
Comments
1
Likes
1
Embeds 0
No embeds

No notes for slide

Measuring the Effectiveness of Online Tutorials: A Pragmatic Approach

  1. 1. Measuring the Effectiveness of Online Tutorials: A Pragmatic Approach Curt G. Friehs Business Librarian Kansas City, Kansas Public Library Cindy L. Craig Assistant Professor and Social Sciences Librarian Wichita State University
  2. 2. A Bear with a Bad Idea
  3. 3. Occasionally People Get Bad Ideas Too…
  4. 4. That Includes Librarians s “Interactivity is the online hallmark of active learning.” ~Nancy Dewald s Technology is naturally intuitive to college students and young adults. s Tutorials are too hard to make and “I’m too old.” s Why can’t we just use the vendor tutorials? s “I’ll just put my handouts online. It’s the same thing as an online tutorial.” s “Online tutorials are going to make my job obsolete.”
  5. 5. Our Conclusions s Online tutorials can supplement (but not completely replace) live library instruction unless you’re this guy....
  6. 6. Replacement Librarian and Library Fine Negotiator “iBender”
  7. 7. Our Conclusions, Continued s Students learn more from video tutorials than from HTML tutorials. s Interactivity is not necessary for learning (and may hinder it).
  8. 8. Research: Part I s Surveyed 140 finance students after watching Value Line Online tutorial. s Tutorial left students wanting to know even more. s But more research was needed. Would students outside of a brutally difficult finance class have different learning needs?
  9. 9. HTML vs. Streaming Media Tutorials Streaming Media Principle HTML Tutorial Tutorial Modality Uses visual only Visual & verbal used Effect Dual Coding Not used Yes (visual & verbal) Theory (visual only) Navigation allows for Navigation is linear Constructivism choice (interactivity) (minimal interactivity) Nadaleen Tempelman-Kluit. (2006). Multimedia Learning Theories…
  10. 10. Creating the Tutorials HTML Tutorial Video Tutorial
  11. 11. Survey Results Interactive n=53 Video n=54 s Confidence BEFORE tutorial - Interactive: 64% - Video: 47% s Confidence AFTER tutorial - Interactive: 89% - Video: 91% Video tutorial students reported greater confidence boost after viewing.
  12. 12. Quiz Results: Correct Answers Interactive n=53 Video n=54 s Question 1 - Interactive: 29 (55%) - Video: 42 (78%) s Question 2 - Interactive: 39 (74%) - Video: 51 (94%) s Question 3 - Interactive: 20 (38%) - Video: 26 (48%)
  13. 13. Quiz Results: Correct Answers Interactive n=53 Video n=54 s Question 4 - Interactive: 29 (55%) - Video: 38 (70%) s Question 5 - Interactive: 35 (66%) - Video: 47 (87%) Video tutorial students scored higher on every quiz question.
  14. 14. Special Thanks s Laura Baas s Jennifer McCoy s Peggy Ward s John Sweller s South Central Kansas Library System s North East Kansas Library System Curt Friehs Cindy Craig cfriehs@kckpl.lib.ks.us cindy.craig@wichita.edu

×