From Far and Near: Analysis of On Campus and Distance Learning Students’ Responses to a Library Assessment

From Far and Near: Analysis of On-Campus and Distance Learning Students’ Responses to a Library Assessment J. Ann Jerabek Head of Interlibrary Services Sam Houston State University Joe Hardenbrook Library Instruction Coordinator & Educational Technologist Millikin University Lynn M. McMain Head of Reference and Instructional Services Sam Houston State University S. Thomas Kordinak Professor of Psychology Sam Houston State University

Introduction

Sam Houston State University, medium-sized regional institution located in Huntsville, TX

Task: develop an instrument to assess use of Library resources and services by students and faculty

Why Assess?

Discover what Library resources and services are being used

Determine how users access Library resources and services

Provide data for decision-making

Why Assess?

Find out how often and from what venue “distance learning” users access and use resources

Provide documentation and reports to the University and for accreditation review

Apply ACRL standards and guidelines for assessment

Literature Review

Libraries have conducted many use studies with on-campus students

Several also examined use by distance learning students

Few compare both groups

Assessment Instrument

Survey selected as preferred method of assessment

Flexible, variable length, different types of questions

Can be administered without extensive training

Machine-readable

Print format chosen

Machine readable, can be analyzed with SPSS

Allows for greater flexibility regarding stratification of the sample population

Eliminates difficulty of verifying student use of University assigned e-mail addresses

Survey Design

Quick to complete; no longer than 10 mins.

Human subjects/IRB approval

Assess specific Library services and resources:

Reference Service

Ask-a-Librarian E-mail service

Interlibrary Loan

Reserves

Copy Services

Library-based computer lab

Databases & Indexes

OPAC

Electronic Journals Search

Online Tutorials

F2F Library Instruction

Library homepage

Special Collections

Study Carrels

Microforms

Gov’t Docs.

Overall service

Survey Design

Separate surveys were administered to faculty and students

This presentation covers the student survey results

Survey divided into 5 parts:

Frequency of use

Use of a specific resource or service

Resources and/or services used during last Library visit

Overall rating of Library services

Demographic information

Student Survey: First Page

Student Survey: Second Page

Methodology

On-Campus, Off-Campus, and Online

On-Campus:

Classes selected in each of the four colleges to provide a representative sample:

Arts & Sciences

Business Administration

Education & Applied Science

Criminal Justice

Either librarian or faculty member administered survey to class

Methodology

Off-Campus

Face-to-face off-campus classes selected

Survey administered by librarian or faculty member

Online

Survey mailed to students enrolled in selected online courses

Participant returned survey in postage paid return envelope

Results

Administered in spring 2004

2200 student surveys distributed, 1080 returned (return rate=50%)

959 usable surveys

Surveys scanned optically and data analyzed using SPSS

Responses grouped into 3 categories:

Students enrolled in ONLY main campus courses

Students enrolled in BOTH main campus courses and distance learning courses at satellite campus

Students enrolled ONLY in distance learning courses, whether at the satellite campus or elsewhere, or online

Demographics

Gender

Male (41%)

Female (56%)

No Listing (3%)

Age

Mean age: 22.58

Range from 17 to 63 years

Demographics

College Affiliation

Demographics

Classification:

17% Freshmen

17% Sophomores

29% Juniors

37% Seniors

Graduate students removed from sample because it was not statistically significant

Enrolled hours:

Less than 12 hrs. (9%)

12-16 hrs. (73%)

16+ hrs. (17%)

Part 1: Frequency of Use

How frequently do you use Library services and resources?

Asks students to report their use of Library services or resources on a 6 point scale

From “have not used”

To “more than twice a week”

On-Campus

Visiting Library building (39%)

Accessing Library homepage (25%)

Using the Library homepage from a personal computer (18%)

Using a computer in the Library’s reference area (15%)

Accessing the Library’s databases (14%)

On-Campus/Satellite

Visiting the Library building (38%)

Accessing the Library’s homepage (21%)

Using the Library’s homepage from a personal computer (13%)

Using the Electronic Journals link (9%), tied with Using the databases (9%)

Off-Campus

Accessing the Library homepage (25%)

Accessing the Library homepage from the satellite campus (23%)

Using the Library homepage from a personal computer (23%)

Accessing the Library’s databases (18%), tied with obtaining a full-text article (18%), and using the Electronic Journals link (18%)

Comparison of the three groups:

Part 2: Using Specific Resources

3 yes/no questions about specific Library services and resources:

Used the “Ask-a-Librarian” e-mail service

On-Campus: 5%

On-Campus/Satellite: 0%

Off-Campus: 0%

Completed any online library tutorial

On-Campus: 23%

Off-Campus: 15%

Received a library instruction session presented by a librarian

On-Campus: 55%

Off-Campus: 31%

Part 3: Resources used at last visit

Asked users to identify Library resources and services used during last visit

-- Use computers in Reference Area -- Use Reference Materials -- Use Online Catalog -- Use Interlibrary Loan -- Use Special Collections -- Use Reserve Material -- Use a Study Carrel -- Check Out Books/Books -- Use Book Collection -- Use Photocopy Machines -- Use Microfiche or Microfilm -- Use Government Documents -- Ask for Reference Assistance -- Use Computer Lab in Library