Different needs and applications for the research </li></ul>
Research <ul><li>Today's Library Catalogues: </li><ul><li>Important and fundamental medium between users and their information needs
Competing against powerful alternatives for information discovery
Extensions of the physical library, considered in a social context as well as fulfilling information needs
Potential to impact core library services, with our emphasis on user-centered collections and RA driven services
Growing in popularity and increased implementation in libraries </li></ul></ul>
Why? <ul><li>Need to evaluate the usefulness of social catalogues </li><ul><li>How are they being used?
Frequency of use and features being used? </li></ul><li>No comprehensive studies in Canada to evaluate usability among staff and library users </li><ul><li>Evaluation that has occurred is vendor-based and has not been published </li></ul></ul>
Choosing the participants <ul><li>Two Canadian Public Libraries </li><ul><li>Leading discovery tools in Canada </li><ul><li>AquaBrowser
Was it a good investment? </li></ul><li>Expressed interest in research </li><ul><li>Largest public library east of Toronto
Represents rural, suburban and urban users </li><ul><li>Variety of age groups, income levels, education levels and diverse communities </li></ul></ul></ul></ul>
Participants <ul><li>Edmonton Public Library </li><ul><li>Launched BiblioCommons in September 2009
Major library system in the mid-West representing a large geographic area with diverse communities, income and educational levels
Interest in the research and what it will tell them about their social catalogue </li></ul></ul>
Scope of our research agenda To examine: <ul><li>The extent to which public library users, librarians, and library staff can efficiently access, use, and interact with social discovery systems;
The public library users’ perception of, and satisfaction with, the benefits of social discovery systems; and
The public library librarians’ and staffs’ perception of, and satisfaction with, the benefits of social discovery systems. </li></ul>
Specific goal of current project <ul><li>The specific goal of this project is to examine and compare how library users access, use, and interact with two social discovery systems used in two Canadian public library systems. </li></ul>
Research questions How do public library users interact with social discovery systems? <ul><ul><li>Which enhanced catalogue features do they use, e.g., faceted navigation, user-contributed content such as tagging, reviews, and ratings, sorting features, etc., and with which frequency? </li></ul></ul>How does usage between the two social discovery systems compare? <ul><ul><li>Are there commonalities or differences between how public library users use different social discovery systems? </li></ul></ul>
Research questions Does the use of social discovery systems change over time? <ul><ul><li>Is the use of the features in social discovery systems consistent over time? </li></ul></ul>
Methodology <ul><li>Transaction logs of the social discovery systems used by Halifax and Edmonton will be compiled over a four-month period. </li><ul><li>A transaction log is an electronic record of interactions that have occurred between a system and users of that system. Transaction log analysis (TLA) is a way of collecting data unobtrusively without directly interfacing with the catalogue users and that allows researchers to observe and analyze user behaviours. </li></ul></ul>
Limitations of transaction log analysis <ul><li>TLA is only the first step in a comprehensive usability study, since it can indicate only how users interact with a system, not the reasons for their choices. TLA can provide useful information about how the features of a system are used and can inform decisions about how these features can be improved. </li><ul><li>Since TLA does not explain the reasons for users’ interaction with the systems, nor the extent to which they are satisfied with the systems, future research will focus on usability studies, consisting of structured observations, questionnaires and focus groups with users and library staff </li></ul></ul>
Types of data gathered Type of search used (e.g., keyword, subject) Use of relevance ranking features Use of sorting features Use of tagging features Use of posted reviews Use of ratings features Use of faceted navigation
User behaviour An ethogram will be designed to categorize and define the behavioural patterns of the users. An ethogram is an index of the behavioural patterns of a particular group, in this case, public library users. Examples of categories of behaviour include: <ul><li>Search process (Type of search used, e.g., keyword, subject)
View results (How user chooses to have the system display the results)
Tracking user-contributed metadata <ul><li>A set of 50 catalogue records will be examined (weekly) in both systems to track changes to tags, reviews, and ratings assigned by the clients. </li><ul><li>10 Adult fiction
Mapping user tags to LCSH <ul><li>Although the nature of the tags used is not directly related to the scope of this project, we are interested in comparing the tags assigned by clients to the corresponding LC headings assigned to the record. </li></ul>
Inversion (e.g., ancient philosophy/philosophy, ancient) </li></ul><li>No match </li></ul>
Future studies Future research will focus on usability studies, consisting of structured observations, questionnaires and focus groups with users and library staff, to measure: <ul><li>Usefulness : How well does the system enable users/staff to achieve their goals?
Effectiveness : How well does the system behave in the way that users/staff expect it to?
Efficiency : How long does it take library users/staff to accomplish their desired tasks?
Learnability : How easily can users/staff learn how to use the system?
Satisfaction : How well does the system meet library users’/staff needs and expectations? </li></ul>
Acknowledgments <ul><li>Funding for this research study is provided by the OCLC/ALISE Library and Information Science Research Grant Program. </li></ul>
Thank You! Louise Spiteri MLIS Academic Program Director School of Informaton Management [email_address] <ul>Laurel Tarulli Collection Access Librarian Halifax Public Libraries [email_address] http://www.halifaxpubliclibraries.ca The Cataloguing Librarian Blog http://laureltarulli.wordpress.com </ul>