Still Bound forDisappointment?Another Look at Facultyand Library Journal Collections Library Assessment Conference 2010 Jennifer Rutner, Assessment & Marketing Librarian, Columbia University Libraries Jim Self, Director, Management Information Services, University of Virginia Libraries
2006 Research Questions• Given the substantial investment in journals, why are faculty consistently dissatisfied with their library’s journal collections?• What is the relationship between journal collections and overall library satisfaction among faculty?• How should we address the dissatisfaction?
2006 FindingsARL libraries are not meeting faculty wants and needs when it comes to journal collections.There is a correlation between overall satisfaction with library services and journal collections. http://www.arl.org/bm~doc/arl-br-257-bound.pdf
2006 FindingsA variety of factors influenced faculty perceptions at UVA. • access is confusing • foreign language coverage • incomplete backfiles • physical access • remote access • browsing facilities
2009 Research Questions• Are faculty at ARL libraries still dissatisfied with journals?• Is the correlation between journal collection satisfaction and overall satisfaction still significant?• Are journal collections still the #1 issue for faculty?• Why are faculty perceptions negative at Columbia?
Data + Methodology
Data Methodology2006, 2007, 2008, 2009 Same as UVA in 2006. LibQUAL+ Notebooks for participating ARL Quantitative analysis of Libraries with >50 LibQUAL+ faculty data faculty respondents. from ARL libraries. Follow-up phone interviews at Columbia.
The Infamous IC-8“The print and/or electronic journal collections I require for my work.”
Columbia Faculty 2009
ARL Libraries 2009 Figure 3: LibQUAL+ 2009, ARL Libraries Faculty10 9 8 7 6 5 4 AS - 1 AS - 2 AS - 3 AS - 4 AS - 5 AS - 6 AS - 7 AS - 8 AS - 9 IC-1 IC-2 IC-3 IC-4 IC-5 IC-6 IC-7 IC-8 LP - 1 LP - 2 LP- 3 LP - 4 LP - 5
Is there a difference in scores from year to year? (ANOVA)• 2006-2009 adequacy gaps from each ARL institution.• P-value = 0.119, which is not deemed statistically significant.Faculty were no more or less dissatisfied with journal collections in 2009.
Journals and Overall Satisfaction Figure 8: LibQUAL+ 2009, Correlation of Faculty Satisfaction with Journal Collections (IC-8) and Overall Library Service, 21 Libraries 9 r =0.71 8 7 6 5-1.2 -1 -0.8 -0.6 -0.4 -0.2 0 0.2
What else should we be watching? Figure 6: LibQUAL+ 2006-09, Information Control Adequacy Gaps Over Time0.20.1 0 2006 (n=37 ) IC1 IC2 IC3 IC4 IC5 IC6 IC7 IC8-0.1 2007 (n=19)-0.2 2008 (n=14) 2009 (n=21)-0.3-0.4-0.5-0.6-0.7
Follow-up at Columbia
What do our faculty say?Columbia Phone Interviews N for LibQUAL+ 2009 IC-8Discipline Conducted 2009 Departmental Mean Adequacy GapArchitecture 5 8 -1.375Business 6 8 -0.125Computer Science 4 3 -0.333Engineering 4 12 -0.583History 0 22 -0.318Humanities 5 60 -0.379Math 1 4 -0.750
What do our faculty say?• Support• Search and online access• Collection gaps• Coverage• Work-around• Quick list• Resources• Print vs. Electronic
What do our faculty say?Support“What would be great for faculty would be if when things are not available, there was one source in the library, extraordinarily skilled at tracking down items. […] These people would be specialists in working the electronic and journal capabilities.”
What do our faculty say?Search and Online Access“I think just having free text search, like Google book search, would be something that would be very, very useful to have. I still feel like we are living 20 years behind where the rest of the world is in terms of being able to search these databases and large collections of books that we have.”
What do our faculty say?Work-Arounds“I just buy them individually from my research funds, so it’s coming out of my research money.”
What do our faculty say?Quick List“If I was to give a suggestion, maybe to have discipline-specific pointers that could help each discipline find things. […] It’s more of an interface issue than a collections issue.”
What do our faculty say?Resources“The size of the collection is not as important as getting the current collection working as smooth as possible. Before, when we used to go to the library, we got service.”
What do our faculty say?Print vs. Electronic“A few years ago, I wouldn’t have said that. But, I guess things have changed.”
What do our faculty say?Remote Access (((crickets)))
What do faculty want?Complete online coverage of a title, in one place, with PDF downloads.Great service, online and in-person.
Special ThanksShanna Jaggars, Quantitative ConsultantBecca Chovnick, Assessment InternImage: http://www.flickr.com/photos/simonk/48373052/