Evaluating library support for a new graduate program: Finding harmony with a mixed method approach
Upcoming SlideShare
Loading in...5
×
 

Evaluating library support for a new graduate program: Finding harmony with a mixed method approach

on

  • 524 views

In 2008, the University of Southern Indiana began a new Doctor of Nursing Practice (DNP) program offered via distance education. Prior to its beginning, USI librarians collaborated with nursing ...

In 2008, the University of Southern Indiana began a new Doctor of Nursing Practice (DNP) program offered via distance education. Prior to its beginning, USI librarians collaborated with nursing faculty to identify ways to support the program. As a result of these discussions and using grant funding provided by the nursing department, the library added relevant electronic journals and open access journal collections Providing electronic access to the journals would enable distance education students to easily use these materials. In addition to existing full-text databases, the library also made available two open access journal collections, including Bentham Open Access Journals and PubMed Central Open Access Journals. The library also expanded its interlibrary loan (ILL) services by providing an article delivery (AD) service on a trial basis to all students enrolled in the program living more than 50 miles from campus. This three-year study sought to answer the question, “How well do the library’s new and existing resources and services support DNP student research?” The methods used by this study included a citation analysis of references listed in formal papers, an examination of usage statistics generated by the electronic resources supporting the program, a student satisfaction survey, and a review of students’ use of ILL and AD services. The citation analysis provided data indicating the sources used (number, type, currency, etc.) by the students and the library’s ability to supply them. Reviews of the usage statistics for the online journals and databases provided a comparison of how the use of these resources has been affected by the DNP enrollment. The student satisfaction surveys have given feedback on the students’ opinions and behaviors regarding the resources and services made available by the library.
Presenters: Peter Whiting and Philip Orr, David L. Rice Library, University of Southern Indiana

Statistics

Views

Total Views
524
Views on SlideShare
524
Embed Views
0

Actions

Likes
0
Downloads
2
Comments
0

0 Embeds 0

No embeds

Accessibility

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Evaluating library support for a new graduate program: Finding harmony with a mixed method approach Evaluating library support for a new graduate program: Finding harmony with a mixed method approach Presentation Transcript

  • Evaluating Library Support for a New Graduate Program:Finding Harmony with a Mixed Method ApproachPhilip Orr Peter WhitingDistance Learning Librarian Serials Technical Services LibrarianDavid L. Rice Library David L. Rice LibraryUniversity of Southern Indiana University of Southern Indianaporr@usi.edu pwhiting@usi.edu
  • Background / Significance of Research
  • USI Doctor of Nursing Practice (DNP) Program• Begun in August 2008• University’s first doctoral program• Program requires a minimum of 36 hours beyondthe MSN and involves both coursework and clinicalpractice• Courses use a hybrid method involving on-campusintensives and distance education delivery• Curriculum designed to be completed within 2(full-time) or 3 (part-time) years
  • The DNP Student• Enrolled 64 students, 2008-2010• 78% lived more than 50 miles from campus• 49% lived outside Indiana
  • The DNP StudentBased on student satisfaction survey (35 responses):• Majority are more than 40 years old• Last educational degree program: < 5 Years – 14 5-10 Years – 8 > 10 Years -- 13• Employed as: Nurse professional – 15 Nurse educator – 16 Nurse administrator – 2 Other – 2
  • DNP Student Participation in Research Project Summary 2008 2009 2010 Total Cohort Cohort CohortNumber of StudentsEnrolled 19 21 24 64Number of StudentsParticipating in 10 5 15 30Citation AnalysisNumber of StudentsSurveyed 16 13 20 49Number of StudentsResponding to Survey 14 10 11 35Number of StudentsGraduating 15 15 18 (proj.) 48
  • Library Collaboration with DNP Program• Provided access to nine online journals – “NursingNine”• Provided access to two open access journalcollections: PubMed Central Bentham Open Access Journals• Expanded interlibrary loan (ILL) service to includetrial article delivery (AD) service• Provided an intensive face-to-face orientation toRice Library’s resources and services• Maintained a “Library Support” section within theDoctoral Student Virtual Center (Blackboard Site)
  • Health care professionals are users ofinformation Accurate Current Understandable Timely
  • Research QuestionThis study sought to answer the following question:How well do Rice Library’s resources and services supportthe information needs (study and research) of studentsenrolled in the University of Southern Indiana’s DNPprogram?
  • Research Methods
  • Four Methods Used To Evaluate the Library’s Performance:1. Examination of Database Usage Statistics2. Survey of Student Satisfaction3. Examination of Interlibrary Loan and Article Delivery Usage4. Analysis of Reference Citations in Student Research Papers
  • Findings
  • Use of Nursing Databases All Users 2006 - 2011 2006/2007 2007/2008 2008/2009 2009/2010 2010/2011 Database TOTAL Searches Searches Searches Searches SearchesCINAHL with Full Text 37,763 68,672 57,141 62,665 85,606 311,847Health Source: Nursing 25,946 37,531 35,526 45,858 48,080 192,941MEDLINE 17,912 22,430 22,461 28,103 34,415 125,321ProQuest Health and 48,839 61,952 60,500 69,203 78,694 319,188Medical StatisticsPubMed Central Not Available StatisticsBentham Open Access NotJournals Available Total per year 130,460 190,585 175,628 205,829 246,795
  • College of Nursing and Health Professions Enrollment 2,500 2,218 1,968 2,000 1,832 1,743 1,500 Undergraduates Masters 1,000 Doctorate 357 410 500 285 317 19 31 48 0 2007 2008 2009 2010 Source: USI Fact Book -- http://www.usi.edu/opra/factbook/
  • Use of Nursing Databases All Users 2006 - 201190,00080,00070,00060,000 CINAHL with Full-Text50,000 Health Source: Nursing40,00030,000 MEDLINE20,000 ProQuest Health &10,000 Medical Complete -
  • Use of Nursing Databases Percent of Change 2006 - 2011 2006/2007 2007/2008 2008/2009 2009/2010 2010/2011 Database Searches Searches Searches Searches Searches CINAHL with Full Text 37,763 68,672 57,141 62,665 85,606 Percent Change 82% -17% 10% 37% Health Source: Nursing 25,946 37,531 35,526 45,858 48,080 Percent Change 45% -5% 29% 5% MEDLINE 17,912 22,430 22,461 28,103 34,415 Percent Change 25% 0% 25% 22%ProQuest Health & Medical 48,839 61,952 60,500 69,203 78,694 Percent Change 27% -2% 14% 14%
  • Use of “Nursing Nine” Journals Ranked by Usage All Users 2008 - 2011 7/08 – 7/11 Journal Title Usage1 Journal of Nursing Administration (JONA) 1,8632 Nursing Research 5313 Nurse Educator 4564 Evidence Based Nursing 4435 Applied Nursing Research 3856 Journal of Professional Nursing 3497 Nursing Outlook 2668 Western Journal of Nursing Research 184 Clinical Scholars Review: The Journal of Doctoral9 29 Nursing TOTAL 4,506
  • Use of “Nursing Nine” Journals All Users 2008 - 2011 1,876 1,570 1,056 7/08 - 7/09 8/09-7/10 8/10-7/11
  • Student Satisfaction Survey• Distributed electronically by university’s Office ofPlanning, Research, and Assessment• Distributed at the end of the students’ second semester inthe program• 49 students received survey / 35 students responded(Response rate: 71%)• Included 28 questions – 23 content questions + 5demographic questions
  • Overall DNP Student Satisfaction Satisfied / Service Very SatisfiedReference Services 96% (Ex: Library orientation, e-mail reference, etc.)Interlibrary Loan / Article Delivery Services 100%Online Services 97% (Ex: Library web pages, Journal Finder, etc.)Resources 94% (Ex: Electronic course reserves, e-books, etc.)
  • Q18: Databases Used Database No. of ResponsesMost Frequently Used:CINAHL w/FT / CINAHL+ w/FT 34ProQuest Health and Medical Complete 34MEDLINE 33Health Source: Nursing/Academic Edition 31Least Frequently Used:Health Business FullTEXT 12WorldCat 8Health Source: Consumer Edition 6
  • Q19: Most Useful Databases Database No. of ResponsesCINAHL w/FT / CINAHL+ w/FT 15Health Source: Nursing/Academic Edition 10ProQuest Health and Medical Complete 6ProQuest Research Library 1PsycINFO 1
  • Q20: Least Useful Databases Database No. of ResponsesMEDLINE 7PsycINFO 5Health Source: Nursing/Academic Edition 4ProQuest Health and Medical Complete 4WorldCat 4ProQuest Research Library 3Health Source: Consumer Edition 3Academic Search Premier 2Health Business Full Text 2CINAHL w/FT, CINAHL+ w/FT 1
  • Q21: Information Providers Used Information Provider No. of ResponsesInternet 30Rice Library 28Journal Articles from Publishers’ Websites 21Other Academic Libraries 15Workplace Library 15Other Corporate/Special Libraries 10Other Information Providers 5Public Libraries 4Commercial Document Delivery Services 4
  • Q22: Action Taken When Article Was Not Available in Full Text Action No. of ResponsesRequested it through Rice Library’s interlibrary 19loan serviceDid not use the article / Chose another article 19Checked on its availability in / used from another 15libraryUsed a copy from personal journal collection 8Did something else 7Requested it from a publisher’s Website 5Borrowed a copy from a colleague’s personal 2journal collectionRequested it from a commercial document 0delivery serviceDid not have this problem 0
  • Q5: Interlibrary Loan / Article Delivery Use Used Have Not Not Aware Of UsedInterlibraryLoan 22 (63%) 13 (37%) 0 (0%)ArticleDelivery 12 (34%) 23 (66%) 0 (0%)Q6: Interlibrary Loan / Article Delivery Usefulness Very Useful Somewhat Not at all Useful UsefulInterlibraryLoan 19 (86%) 2 (9%) 1 (5%)ArticleDelivery 12 (100%) 0 (0%) 0 (0%)
  • Interlibrary Loan / Article Delivery Usage Submitted Cancelled FilledInterlibraryLoan 746 183 563 (75%)RequestsArticleDelivery 17 2 15 (88%)Requests
  • Citation Analysis Overview• Thirty students participated, 2008-2011 10 2008 cohort 5 2009 cohort 15 2010 cohort• Examined a total of 229 papers involving 4,399citations
  • Number and Percentage of Cited Sources by Format Percentage Articles 67% Web sites 18% Books 13% Other 1%
  • Number and Percentage of Cited Sources by Date Range N=4,391 Number Percentage 0 – 5 Years 2,895 66% 6 – 10 Years 1,020 23% 11+ Years 476 11%Number and Percentage of Articles Cited by Date Range N=2,954 Number Percentage 0 – 5 Years 1,824 62% 6 – 10 Years 793 27% 11+ Years 337 11%
  • Number and Percentage of Cited Sources Which Rice Library Made Available (Excluding Web Sites) Number Available / Percentage Number Cited Articles 2,390 / 2,954 81% Books 232 / 672 35% Other 4 / 54 7% TOTAL 2,626 / 3,680 71%
  • Number and Percentage of Cited Sources Freely Available on the Web Percentage Articles 24% TOTAL 25%
  • Journals Most Frequently Cited Some Ulrich’s Citation Avail. in Content Ulrich’s Subject Journal Title Doc. Freq. RL Free on Classification Type Web JONA (Journal of Nursing 1986- Med. Sci- Nurses1 171 N J, A/S Administration) present and Nursing 1983- Med. Sci- Nurses2 Nursing Economic$ 124 N J, A/S present and Nursing 1981 to Med. Sci- Nurses3 Journal of Advanced Nursing 93 1 year Y J, A/S and Nursing ago Online Journal of Issues in 2002- Med. Sci- Nurses4 61 Y A/S Nursing present and Nursing Nursing Administration 1986- Med. Sci- Nurses5 50 N J, A/S Quarterly 2005 and NursingUlrich’s Document Type Codes: A/S = Academic/Scholarly; J = Journal; T =Trade
  • Journals Most Frequently Cited Some Ulrich’s Citation Avail. in Content Ulrich’s Subject Journal Title Doc. Freq. RL Free on Classification Type Web 1993- Med. Sci.- Nurses6 Nursing Management 44 N J, A/S 2007 and Nursing Journal for Nurses in Staff Med. Sci.- Nurses7 44 n/a N J, A/S Development and Nursing New England Journal of 1961-8 39 Y J, A/S Medical Science Medicine present 1986- Med. Sci.- Nurses9 Critical Care Nurse 38 Y J, A/S present and Nursing Journal of the American 1986- Gerontology and10 37 N J, A/S Geriatrics Society present GeriatricsUlrich’s Document Type Codes: A/S = Academic/Scholarly; J = Journal; T =Trade
  • Journals Most Frequently Cited Some Ulrich’s Citation Avail. in Content Ulrich’s Subject Journal Title Doc. Freq. RL Free on Classification Type Web Journal of Continuing 1997- 11 Education in the Health 35 one year N J, A/S Medical Sciences Professions ago American Journal of Critical 1998- Medical Sci.-Nurses 12 33 Y J, A/S Care present and Nursing Journal of Gerontological 1986- Gerontology and 13 32 N J, A/S Nursing present Geriatrics 1986- Med. Sci.- Nurses 14 Nursing Research 30 N A/S present and Nursing 1994- Public Health and 15 Health Affairs 29 N J, A/S present SafetyUlrich’s Document Type Codes: A/S = Academic/Scholarly; J = Journal; T =Trade
  • Frequency of Citation “Nursing Nine” Citation Journal Title Frequency1 Journal of Nursing Administration (JONA) 1712 Nursing Research 303 Nursing Outlook 174 Journal of Professional Nursing 165 Applied Nursing Research 146 Western Journal of Nursing Research 87 Nurse Educator 18 Evidence Based Nursing 09 Clinical Scholars Review: The Journal of Doctoral Nursing 0 TOTAL 257
  • Discussion / Implications
  • Evaluation of Library Performance
  • Library Orientation
  • Promote the Use of Interlibrary Loanand Article Delivery Services
  • Emphasize Proper Use of APACitation Style
  • Promote the Use of “Nursing Nine”Electronic Journals
  • Adjust Journal Offerings Supportingthe Program
  • Expand the Nursing DatabasesAvailable
  • Extend Article Delivery Services toOther Graduate Programs
  • Thank You For Attending Today’s Session Questions?Philip Orr Peter WhitingDistance Learning Librarian Serials Technical Services LibrarianRice Library, USI Rice Library, USIporr@usi.edu pwhiting@usi.edu