Enabling Access, Assessing Impact: Subject Guides 2.0


Published on

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Enabling Access, Assessing Impact: Subject Guides 2.0

  1. 1. Kristina De Voe | Temple University Libraries | Philadelphia, PA
  2. 2. Wordle art by Palm Beach Community College Library. Available at http://palmbeachstate.libguides.com/seflin2009
  3. 3. but do they impact student work? and what about student learning?
  4. 4. the plan <ul><ul><li>Identify a course with many sections and a research component </li></ul></ul><ul><ul><li>Provide instruction sessions </li></ul></ul><ul><ul><li>Collect assignments </li></ul></ul><ul><ul><li>Create, distribute & collect surveys </li></ul></ul><ul><ul><li>Evaluate assignments </li></ul></ul><ul><ul><li>Examine surveys </li></ul></ul><ul><ul><li>Get some answers (hopefully) </li></ul></ul>
  5. 6. Photo by weirdeout. Available via flickr at http://www.flickr.com/photos/weirdedout/2406590192/
  6. 7. assignment requirements <ul><li>Identify at least 10 relevant sources </li></ul><ul><ul><li>must be varied and reflect multiple positions </li></ul></ul><ul><li>Include in the annotations: </li></ul><ul><ul><li>an explanation of why you chose the source </li></ul></ul><ul><ul><li>a brief summary of the source </li></ul></ul><ul><ul><li>a brief description of how you found the source </li></ul></ul><ul><ul><li>a summary of the relevant information </li></ul></ul>
  7. 8. guides.temple.edu/public_speaking
  8. 9. instruction sessions <ul><li>Exposed to the Guide </li></ul><ul><li>(experimental) </li></ul><ul><li>Not Exposed to the Guide </li></ul><ul><li>(control) </li></ul>Fall 2009 Spring 2010 Fall 2009 Spring 2010
  9. 10. session outcomes <ul><li>Able to critically evaluate retrieved sources and determine if the information meets the need of the research problem (ACRL Standard 2) </li></ul><ul><li>Able to organize, integrate, and communicate information from a variety of sources to create an annotated bibliography (ACRL Standard 4) </li></ul>
  10. 11. data collection Fall 2009
  11. 14. Experimental Control Total Return Rate Surveys Returned 83 148 231 62.7% Bibliographies Submitted 15 24 39 10.6%
  12. 15. annotated bibliography collection and evaluation
  13. 16. Beginning (1 point) Developing (2 points) Competent (3 points) Excellent (4 points) Search Tools Used Types of Sources Currency of Sources Authority of Sources Summarization of Source Content Evaluation of Source Relevance Bibliographic Format
  14. 19. how did students perform?
  15. 20. Not a significant difference…?!
  16. 22. survey analysis
  17. 24. Huh?! Wait a minute…
  18. 25. I did?! Really?!
  19. 26. where would students like to find guides?
  20. 27. in the spaces where they already are
  21. 28. back to that assignment
  22. 29. control group relied more heavily on faculty and librarian expertise
  23. 30. what helped make the assignment easier? (librarian visit vs. guide)
  24. 31. Librarian Visit Control ~80% agreed or strongly agreed Experimental ~68% agreed or strongly agreed
  25. 32. Guide Control ~75% agreed or strongly agreed Experimental ~69% agreed or strongly agreed
  26. 33. * * *
  27. 34. how do students want to get help?
  28. 36. what we learned
  29. 37. … about ourselves <ul><li>Too concerned over naming guides </li></ul><ul><li>Our rubrics must be more aligned to our faculty’s assignments </li></ul><ul><li>F2F still matters </li></ul>
  30. 38. … about the students <ul><li>Students will use LibGuides when recommended by librarians or faculty </li></ul><ul><li>Students indicate that they find LibGuides help them succeed on assignments </li></ul><ul><li>Students appear to struggle with source selection and evaluation </li></ul><ul><ul><li>How can we use LibGuides to address this? </li></ul></ul>
  31. 39. what’s next
  32. 40. the distant future <ul><li>Assess Spring 2010 sample and compare </li></ul><ul><ul><li>Fewer sections, more control </li></ul></ul><ul><ul><li>Required bibliography submission </li></ul></ul><ul><ul><li>Examine students’ use of sources more </li></ul></ul><ul><li>Attempt with distance ed. courses to remove f2f element </li></ul><ul><li>Usability studies of guides </li></ul><ul><ul><li>How do we make them more useful? </li></ul></ul>
  33. 41. email: devoek@temple.edu slides & data will be avail at: guides.temple.edu/assessLibGuides