• Like
Assessment for the Rest of Us: Informal Techniques You Can Use
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

Published

Program conducted by LLAMA - MAES at ALA Annual 2010. …

Program conducted by LLAMA - MAES at ALA Annual 2010.

Informal assessment techniques can be used to quickly evaluate and improve services throughout the library. This fast-paced program features presenters from 8-10 libraries who will share various types of informal assessment, the time commitment required, and how assessment led to service improvements throughout the library. Attendees will gain an understanding of how informal assessment can be incorporated into decision-making at all levels and lead to a culture of assessment.

Published in Education
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
1,626
On SlideShare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
10
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Assessment for the Rest of Us: Informal Techniques You Can Use
    Sponsored by the LLAMA Measurement, Assessment & Evaluation Section, Data Collection for Library Managers Committee
    Program Co-chairs:
    • Jeanne Brown, Assessment Librarian, University of Nevada, Las Vegas
    • 2. Jan Lewis, Associate Director, East Carolina University
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 3. Our Student Scholars Said What???
    A 12-Question survey followed by an informal focus group luncheon were fairly easy techniques for discerning what a group of undergraduate student scholars know and think about the library.
    Oklahoma State University
    Karen Neurohr, Associate Professor, Assessment Librarian
    Jennifer Paustenbaugh, Ph.D., Associate Dean for Planning and Assessment
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 4. Student Scholars and the Library
    Oklahoma State University- Land-grant; ARL Library, serving 22,845 students
    Assessment activity: Survey and Informal Focus Group
    Population: Undergraduate research scholars
    Time Commitment: 4 hours
    Findings: Several interesting discrepancies between survey results and comments
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 5. Let them try it before you buy it
    Conducting demonstrations and trials can help libraries get the biggest bang for their buck.  Students test, evaluate, and recommend products and libraries make informed purchases.
    Louise L. Lowe, Assistant ProfessorPublic Services Librarian
    Judith D. Brook, Associate ProfessorAssociate Dean of University Libraries and Director
    Mercer University, Atlanta
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 6. Let them try it before you buy it
    Who we are…
    Mercer University, Atlanta Campus
    Approximately 2,500 graduate and professional students
    Approximately 4,000 library visitors per week
    What we did…
    Conducted trials or demonstrations; allowed 1 - 2 weeks for feedback
    Tested equipment like netbooks, adjustable monitors and keyboards, etc.
    Taste test for new coffee vending
    What we learned…
    ‘Good value’ is important to student
    Students are willing to make compromises
    Students want to be involved
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 7. Unobtrusive User Observation as Assessment Technique: What are Students Doing in the Library After Hours
    Study of User Behavior in Uris Library, open 24/7
    Kornelia Tancheva, Director of John M. Olin Library and Uris Library, Cornell University
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 8. Student Behavior in the Library After Hours
    Cornell U Library; Uris: former “undergraduate library”
    Unobtrusive observation
    Survey population: undergraduate students
    Moderate Time Commitment
    Findings: use of spaces, use of technology; service requirements
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 9. Why Isn’t Our Chat Reference Service Used More Often?
    Exploring patron attitudes and behavior through focus groups
    Sharon Naylor and Bruce StoffelEducation Librarian and Reference Coordinator
    Illinois State University
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 10. Why Isn’t Our Chat Reference Service Used More Often?
    Who we are...
    21,184 students (87% undergraduates)
    1.6 million volumes, 43,000 annual patron transactions
    What we did...
    Conducted 7 focus groups, August-December 2005
    Involved 45 sophomores, juniors, seniors
    Each group discussion lasted about 90 minutes
    What we learned...
    • Desire for reference services that are personalized
    • 11. Support for a variety of reference venues not just IM/chat
    • 12. Preference for familiar, reliable technology
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 13. The CalArts’ Student Behaviors and Habits (CASBAH) Project
    Poster surveys were used to generate a wealth of instant and practical feedback with minimal effort.
    Jeff Gatten, Dean of Library and Information Resources at California Institute of the Arts
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 14. The CalArts’ Student Behaviors and Habits (CASBAH) Project
    Arts college (BFA, MFA, DMA)
    1,399 Students
    60% undergrad. & 40% grad.
    51% female & 49% male
    Poster surveys in the Library
    3-4 hours to compile & organize data
    Findings: Most desired = easy changes to environment
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 15. Challenging Assumptions: Chatting with Patrons
    The information gathered challenged many of the assumptions held about undergraduate students.
    Rachel Besara, Assessment Librarian
    Kirsten Kinsley, Assessment Librarian
    Florida State University Libraries
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 16. Challenging Assumptions: Chatting with Patrons
    Florida State University (Carnegie Foundation Rated Doctoral/Research Extensive University)
    Short Survey/Interviews
    167 Undergraduate Students on & off campus
    One Month
    Discovered nuanced student study habits
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 17. Assessing Community Usersin an Academic Library
    The Ottenheimer Library recently conducted a quantitative/qualitative assessment of its unaffiliated library users.
    Wanda V. Dole, Dean
    Ottenheimer Library, University of Arkansas at Little Rock
     J. B. Hill, Director of Public Services
    Ottenheimer Library, University of Arkansas at Little Rock
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 18. Assessing Community Users
    University of Arkansas at Little Rock
    Metropolitan university with 13,000 students
    Carnegie Research Extensive University
    Quantitative Data
    Analysis of Millennium and Uniprint patron records
    Qualitative Data
    Survey of unaffiliated library users registered for circulation of Internet privileges
    Limited Time Commitment - ~80 hours
    Findings
    Two distinct user populations – behaviors & needs
    Casual affiliations with university
    Privileges created good will toward university
    Result in review of unaffiliated user policies/services
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 19. “Flip” the Library
    Video Assessment at
    Georgia Tech Library
    AmeetDoshi
    User Engagement Librarian and Assessment Coordinator
    Georgia Institute of Technology Library
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 20. Flip Camera Assessment: Fast, Cheap, Easy
    Georgia Tech Student Culture: Hands-on, interactive
    LibQUAL 2010: 88% of Undergrads use facility regularly
    Video Assessment of Library Facility
    Student Library Advisory Board
    1 hour (prep/shooting/recap) and 2-4 hours editing
    Useful to…
    View experience from user perspective
    Assess completed or discuss proposed renovations
    Discover emerging problems
    Web usability
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 21. LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 22. MIT Libraries’ Book(cart)mobile: Assessing its Value
    The MIT Libraries’ Humanities and Music Libraries surveyed users and staff to determine if the benefits of undertaking a monthly bookmobile outweighed its staffing costs.
    Lisa R. Horowitz, Assessment Librarian, Massachusetts Institute of Technology
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 23. MIT Libraries’ Book(cart)mobile
    MIT: 10,000 students; 10,000 faculty and staff
    Five main libraries – Bookmobile is specific to Humanities and its branch, Music
    Two survey instruments: user survey and staff interviews
    Data gathered over two and half months, March to May 2009
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 24. Observation and Mapping
    Observing student behavior helped us achieve a better balance between high
    and low use study spaces
     
    Kathy Ray
    University Librarian
    American University of Sharjah
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
  • 25. Observation and Mapping
    AUS – 5,000 students primarily undergrad
    Coed environment new for majority
    Incredibly active/high traffic zone in the middle of preferred high use study space
    Observations over 5 week period
    30 minutes 3 times per week
    Reconfigured mix of carrels, tables, browsing collections & displays for better balance of quiet and active zones
    LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us