Kristina De Voe | Temple University Libraries | Philadelphia, PA
Wordle art by Palm Beach Community College Library. Available at http://palmbeachstate.libguides.com/seflin2009
but do they impact student work? and what about student learning?
the plan <ul><ul><li>Identify a course with many sections and a research component </li></ul></ul><ul><ul><li>Provide inst...
 
Photo by weirdeout. Available via flickr at http://www.flickr.com/photos/weirdedout/2406590192/
assignment requirements <ul><li>Identify at least 10 relevant sources </li></ul><ul><ul><li>must be varied and reflect mul...
guides.temple.edu/public_speaking
instruction sessions <ul><li>Exposed to the Guide </li></ul><ul><li>(experimental) </li></ul><ul><li>Not Exposed to the Gu...
session outcomes <ul><li>Able to critically evaluate retrieved sources and determine if the information meets the need of ...
data collection Fall 2009
 
 
Experimental Control Total Return Rate Surveys Returned 83 148 231 62.7% Bibliographies Submitted 15 24 39 10.6%
annotated bibliography  collection and evaluation
Beginning  (1 point) Developing (2 points) Competent  (3 points) Excellent  (4 points) Search Tools Used Types of Sources ...
 
 
how did students perform?
Not a significant difference…?!
 
survey analysis
 
Huh?! Wait a minute…
I did?!  Really?!
where would students  like to find guides?
in the spaces where they already are
back to that assignment
control group relied more heavily on faculty and librarian expertise
what helped make the  assignment easier? (librarian visit vs. guide)
Librarian Visit Control  ~80% agreed or strongly agreed Experimental  ~68% agreed or strongly agreed
Guide Control  ~75% agreed or strongly agreed Experimental  ~69% agreed or strongly agreed
* * *
how do students want  to get help?
 
what we learned
… about ourselves <ul><li>Too concerned over naming guides  </li></ul><ul><li>Our rubrics must be more aligned to our facu...
… about the students <ul><li>Students will use LibGuides when recommended by librarians or faculty  </li></ul><ul><li>Stud...
what’s next
the distant future <ul><li>Assess Spring 2010 sample and compare </li></ul><ul><ul><li>Fewer sections, more control </li><...
email: devoek@temple.edu slides & data will be avail at:  guides.temple.edu/assessLibGuides
Upcoming SlideShare
Loading in...5
×

Enabling Access, Assessing Impact: Subject Guides 2.0

447

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
447
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Enabling Access, Assessing Impact: Subject Guides 2.0"

  1. 1. Kristina De Voe | Temple University Libraries | Philadelphia, PA
  2. 2. Wordle art by Palm Beach Community College Library. Available at http://palmbeachstate.libguides.com/seflin2009
  3. 3. but do they impact student work? and what about student learning?
  4. 4. the plan <ul><ul><li>Identify a course with many sections and a research component </li></ul></ul><ul><ul><li>Provide instruction sessions </li></ul></ul><ul><ul><li>Collect assignments </li></ul></ul><ul><ul><li>Create, distribute & collect surveys </li></ul></ul><ul><ul><li>Evaluate assignments </li></ul></ul><ul><ul><li>Examine surveys </li></ul></ul><ul><ul><li>Get some answers (hopefully) </li></ul></ul>
  5. 6. Photo by weirdeout. Available via flickr at http://www.flickr.com/photos/weirdedout/2406590192/
  6. 7. assignment requirements <ul><li>Identify at least 10 relevant sources </li></ul><ul><ul><li>must be varied and reflect multiple positions </li></ul></ul><ul><li>Include in the annotations: </li></ul><ul><ul><li>an explanation of why you chose the source </li></ul></ul><ul><ul><li>a brief summary of the source </li></ul></ul><ul><ul><li>a brief description of how you found the source </li></ul></ul><ul><ul><li>a summary of the relevant information </li></ul></ul>
  7. 8. guides.temple.edu/public_speaking
  8. 9. instruction sessions <ul><li>Exposed to the Guide </li></ul><ul><li>(experimental) </li></ul><ul><li>Not Exposed to the Guide </li></ul><ul><li>(control) </li></ul>Fall 2009 Spring 2010 Fall 2009 Spring 2010
  9. 10. session outcomes <ul><li>Able to critically evaluate retrieved sources and determine if the information meets the need of the research problem (ACRL Standard 2) </li></ul><ul><li>Able to organize, integrate, and communicate information from a variety of sources to create an annotated bibliography (ACRL Standard 4) </li></ul>
  10. 11. data collection Fall 2009
  11. 14. Experimental Control Total Return Rate Surveys Returned 83 148 231 62.7% Bibliographies Submitted 15 24 39 10.6%
  12. 15. annotated bibliography collection and evaluation
  13. 16. Beginning (1 point) Developing (2 points) Competent (3 points) Excellent (4 points) Search Tools Used Types of Sources Currency of Sources Authority of Sources Summarization of Source Content Evaluation of Source Relevance Bibliographic Format
  14. 19. how did students perform?
  15. 20. Not a significant difference…?!
  16. 22. survey analysis
  17. 24. Huh?! Wait a minute…
  18. 25. I did?! Really?!
  19. 26. where would students like to find guides?
  20. 27. in the spaces where they already are
  21. 28. back to that assignment
  22. 29. control group relied more heavily on faculty and librarian expertise
  23. 30. what helped make the assignment easier? (librarian visit vs. guide)
  24. 31. Librarian Visit Control ~80% agreed or strongly agreed Experimental ~68% agreed or strongly agreed
  25. 32. Guide Control ~75% agreed or strongly agreed Experimental ~69% agreed or strongly agreed
  26. 33. * * *
  27. 34. how do students want to get help?
  28. 36. what we learned
  29. 37. … about ourselves <ul><li>Too concerned over naming guides </li></ul><ul><li>Our rubrics must be more aligned to our faculty’s assignments </li></ul><ul><li>F2F still matters </li></ul>
  30. 38. … about the students <ul><li>Students will use LibGuides when recommended by librarians or faculty </li></ul><ul><li>Students indicate that they find LibGuides help them succeed on assignments </li></ul><ul><li>Students appear to struggle with source selection and evaluation </li></ul><ul><ul><li>How can we use LibGuides to address this? </li></ul></ul>
  31. 39. what’s next
  32. 40. the distant future <ul><li>Assess Spring 2010 sample and compare </li></ul><ul><ul><li>Fewer sections, more control </li></ul></ul><ul><ul><li>Required bibliography submission </li></ul></ul><ul><ul><li>Examine students’ use of sources more </li></ul></ul><ul><li>Attempt with distance ed. courses to remove f2f element </li></ul><ul><li>Usability studies of guides </li></ul><ul><ul><li>How do we make them more useful? </li></ul></ul>
  33. 41. email: devoek@temple.edu slides & data will be avail at: guides.temple.edu/assessLibGuides
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×