1. From Far and Near:
Analysis of On-Campus and Distance
Learning Students’ Responses to a
Library Assessment
J. Ann Jerabek Lynn M. McMain
Head of Interlibrary Services Head of Reference and Instructional Services
Sam Houston State University Sam Houston State University
Joe Hardenbrook S. Thomas Kordinak
Library Instruction Coordinator Professor of Psychology
& Educational Technologist Sam Houston State University
Millikin University

2. Introduction
 Sam Houston State University, medium-
sized regional institution located in
Huntsville, TX
 Task: develop an instrument to assess use of
Library resources and services by students
and faculty

3. Why Assess?
 Discover what Library resources and
services are being used
 Determine how users access Library
resources and services
 Provide data for decision-making

4. Why Assess?
 Find out how often and from what venue
“distance learning” users access and use
resources
 Provide documentation and reports to the
University and for accreditation review
 Apply ACRL standards and guidelines for
assessment

5. Literature Review
 Libraries have conducted many use studies
with on-campus students
 Several also examined use by distance
learning students
 Few compare both groups

6. Assessment Instrument
 Survey selected as preferred method of assessment
– Flexible, variable length, different types of questions
– Can be administered without extensive training
– Machine-readable
 Print format chosen
– Machine readable, can be analyzed with SPSS
– Allows for greater flexibility regarding stratification of
the sample population
– Eliminates difficulty of verifying student use of
University assigned e-mail addresses

7. Survey Design
 Quick to complete; no longer than 10 mins.
 Human subjects/IRB approval
 Assess specific Library services and resources:
Library-based F2F Library Instruction Gov’t Docs.
computer lab Reserves Ask-a-Librarian E-mail service
Special Collections
Reference Service OPAC Microforms
Library homepage  Interlibrary Loan
Study Carrels
Electronic Databases & Indexes
Copy Services
Journals Search
Overall service Online Tutorials

8. Survey Design
 Separate surveys were administered to faculty
and students
 This presentation covers the student survey
results
 Survey divided into 5 parts:
– Frequency of use
– Use of a specific resource or service
– Resources and/or services used during last Library
visit
– Overall rating of Library services
– Demographic information

9. Student
Survey:
First Page

10. Student
Survey:
Second Page

11. Methodology
 On-Campus, Off-Campus, and Online
 On-Campus:
– Classes selected in each of the four colleges to
provide a representative sample:
 Arts & Sciences
 Business Administration
 Education & Applied Science
 Criminal Justice
– Either librarian or faculty member administered
survey to class

12. Methodology
 Off-Campus
– Face-to-face off-campus classes selected
– Survey administered by librarian or faculty
member
 Online
– Survey mailed to students enrolled in selected
online courses
– Participant returned survey in postage paid
return envelope

13. Results
 Administered in spring 2004
 2200 student surveys distributed, 1080 returned
(return rate=50%)
 959 usable surveys
 Surveys scanned optically and data analyzed using
SPSS
 Responses grouped into 3 categories:
– Students enrolled in ONLY main campus courses
– Students enrolled in BOTH main campus courses and
distance learning courses at satellite campus
– Students enrolled ONLY in distance learning courses,
whether at the satellite campus or elsewhere, or online

14. Demographics

15. Demographics
 Gender
– Male (41%)
– Female (56%)
– No Listing (3%)
 Age
– Mean age: 22.58
– Range from 17 to 63 years

16. Demographics
 College Affiliation
College
35 31
30 26
25
20 19
Percent
20
15
10 5
5
0
Arts & Sciences Business Education & Applied Criminal Justice No affiliation
Administration Science

17. Demographics
 Classification:
– 17% Freshmen
– 17% Sophomores
– 29% Juniors
– 37% Seniors
 Graduate students removed from sample
because it was not statistically significant
 Enrolled hours:
– Less than 12 hrs. (9%)
– 12-16 hrs. (73%)
– 16+ hrs. (17%)

18. Part 1: Frequency of Use

19. Part 1: Frequency of Use
 How frequently do you use Library services
and resources?
 Asks students to report their use of Library
services or resources on a 6 point scale
– From “have not used”
– To “more than twice a week”

20. Part 1: Frequency of Use
 On-Campus
– Visiting Library building (39%)
– Accessing Library homepage (25%)
– Using the Library homepage from a personal
computer (18%)
– Using a computer in the Library’s reference
area (15%)
– Accessing the Library’s databases (14%)

21. Part 1: Frequency of Use
 On-Campus/Satellite
– Visiting the Library building (38%)
– Accessing the Library’s homepage (21%)
– Using a computer in the Library’s reference
area (18%)
– Using the Library’s homepage from a personal
computer (13%)
– Using the Electronic Journals link (9%), tied
with Using the databases (9%)

22. Part 1: Frequency of Use
 Off-Campus
– Accessing the Library homepage (25%)
– Accessing the Library homepage from the
satellite campus (23%)
– Using the Library homepage from a personal
computer (23%)
– Using a computer in the Library’s reference area
(21%)
– Accessing the Library’s databases (18%), tied
with obtaining a full-text article (18%), and using
the Electronic Journals link (18%)

23. Part 1: Frequency of Use
 Comparison of the three groups:
On-Campus
45
39 38 On-Campus/Satellite
40
35 Off-Campus
30 25 25
23 23
Percent
25 21 21
20 18 18 18 18 18
15 14
15 13 13
9 9 9 10
10 7 6 8
5
0
Visit Library Access Lib. Use Lib. Use Use Lib. Use Elec. Access Lib. Obtain Full-
Bldg. Hmpg. Hmpg. from Computer in Databases Journals Hmpg. from Text Article
pers. comp. Lib. Ref. Link sat. campus
Area

24. Part 2: Using Specific Resources

25. Part 2: Using Specific Resources
 3 yes/no questions about specific Library services
and resources:
– Used the “Ask-a-Librarian” e-mail service
 On-Campus: 5%
 On-Campus/Satellite: 0%
 Off-Campus: 0%
– Completed any online library tutorial
 On-Campus: 23%
 On-Campus/Satellite: 7%
 Off-Campus: 15%
– Received a library instruction session presented by a
librarian
 On-Campus: 55%
 On-Campus/Satellite: 36%
 Off-Campus: 31%

26. Part 3: Resources used at last
visit

27. Part 3: Resources used at last visit
 Asked users to identify Library resources
and services used during last visit
-- Use computers in Reference Area -- Check Out Books/Books
-- Use Reference Materials -- Use Book Collection
-- Use Online Catalog -- Use Photocopy Machines
-- Use Interlibrary Loan -- Use Microfiche or Microfilm
-- Use Special Collections -- Use Government Documents
-- Use Reserve Material -- Ask for Reference Assistance
-- Use a Study Carrel -- Use Computer Lab in Library

28. Part 3: Resources used at last visit
 Most popular responses for on-campus
students:
– Computer Lab
 55%
– Computers in Library Reference Area
 44%
– Photocopy Machines
 39%
– Checking out Books
 35%
– Using Library Catalog
 30%

29. Part 3: Resources used at last visit
 Most popular responses for on-campus/satellite
students:
– Computer Lab
 53%
– Photocopy Machines
 38%
– Computers in Library Reference Area
 37%
– Checking out Books
 26%
– Using Library Catalog
 22%

30. Part 3: Resources used at last visit
 Most popular responses for off-campus
students:
– Computers in Library Reference Area
 43%
– Computer Lab
 25%
– Checking out Books
 23%
– Using Reference Materials
 18%
– Using Library Catalog
 18%

31. Part 3: Resources used at last visit
 Comparison of the three groups:
Resources Used at Last Visit
60 55 53
50 44 43
37 39 38
40 35 On-Campus
30
Percent
30 25 26 23 26 On-Campus/Satellite
22
18 17 18 Off-Campus
20 13
10
0
Computer Computers Photocopy Checking Using Using
Lab in Library Machines out Books Library Reference
Reference Catalog Materials
Area

32. Part 4: Overall Rating

33. Part 4: Overall Rating
 Asked respondents to provide an overall
rating of Library services and resources
 Used a 5 point scale ranging from “very
poor” to “very good”
Overall Rating of Library Services
40 38
35 33
30 26
25
Percent
20
15
10
5 3
0
Very Good Good Average Very Poor / Poor

34. Analysis & Conclusion
 Noteworthy Percentages
 Statistically Significant Differences

35. Analysis & Conclusion
 Ask-A-Librarian
 On-line Tutorials
 Library Instruction

36. Analysis & Conclusion
 Checking Out Books
 Photocopying
 Computer Lab

37. Analysis & Conclusion
 Explore New Marketing Approaches
 Increase Faculty Contact

38. Questions?