Listening to the Customer: Using Assessment Results to Make a Difference


Published on

LLAMA LOMS Program: Listening to the Customer: Using Assessment
Results to Make a Difference
ALA Annual (Chicago)
Sunday, July 11, 2009
Dr. Richard J. Moniz, Jr. (Johnson & Wales University)

Published in: Business, Education
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Listening to the Customer: Using Assessment Results to Make a Difference

  1. 1. Listening to the Customer: Using Assessment Results to Make a Difference
  2. 2. Johnson & Wales University • Multiple Campuses – North Miami, FL , – Providence, RI – Denver, CO – Charlotte, NC • Business, Culinary Arts, Hospitality • Career-Oriented 2
  3. 3. Assessments • LibQUAL+ - North Miami data (conducted system-wide in 2003/2004) • Annual Surveys – Charlotte (from 2004/2005 - Present) • SAILS (Standardized Assessment of Information Literacy Skills) – Charlotte (from 2007/2008 – Present) • SWOT (Strengths, Weaknesses, Opportunities, and Threats) – Ch l Th ) Charlotte (from 2005 – P (f Present) ) • Focus Groups (2009) 3
  4. 4. Johnson & Wales Campuses – Library Staffing • North Miami – 4 Librarians, 1 Library Assistant, 12 Workstudy Employees • Charlotte – 6 Librarians, 1 Student Assistant, 12 Workstudy Employees o stu y p oyees 4
  5. 5. LibQUAL+ 2003/2004 – Service Adequacy Scores North Miami - Undergraduates Affect of Service - Employees who instill confidence in users -1.84 Library as Place - Library space that inspires study and learning -1.7 17 Information Control - Easy-to-use access tools that allow me to find things on my own -1.64 5
  6. 6. LibQUAL+ Results 2003/2004 North Miami – Undergraduates – Comment Samples • I feel that we should have more computers t • Needs more books about business • Books about business and recreation topics • The library website should be more widely published… • Need more computers!!! • I would enjoy some more literat re o ld enjo literature. 6
  7. 7. What have we done (Florida campus)? • McNaughton collection • P bli i d business databases, partnered with Publicized b i d t b t d ith Career Development Office to emphasize databases • Added computer terminals and wireless • More work-study training, spread over time more • M More structured study room usage d d • Created a blog and IM to emphasize online services 7
  8. 8. Charlotte Campus – A New Library Strategic Plan Goal 3 Create a library focused upon the idea of continual assessment which views the entire academic community as key customers. Enhanced preparation for re-accreditation will serve as an inevitable byproduct of this goal. 8
  9. 9. Annual Surveys (Charlotte) 9
  10. 10. What did we learn? • Not enough accessible hours – specific needs in this regard • Need for greater functionality in library computers • Desire for popular fiction and movies p p • Need for more comfortable setting and furniture • Students valued quiet over access to their p q phones • Loan periods too short in some cases 10
  11. 11. What have we done? • Additional weekend and evening hours • Additional full service PCs in the front area (provides extra access when lab in use) • “Percolator” collection • Added décor and soft furniture • Crafted more strict noise policy • Increased loan periods 11
  12. 12. How do they know we hear them? 12
  13. 13. SAILS (Standard Assessment of Information Literacy Skills) What did we learn? • We are relatively “average” overall. • The scores of our students were better than average on Standard 2 (accessing information effectively). y) • The scores of our seniors were only slightly higher than average on Standard 4 (evaluating resources) g ( g ) despite significant efforts on our part to address this standard. 13
  14. 14. SAILS What did we do? • We completely revamped our required IL module on evaluating resources providing additional l i idi ddi i l examples (one hour session became a two hour session). session) • We incorporated clickers into the standard two- hour session we do to test better for understanding (i.e. more formative assessment). 14
  15. 15. SWOT (with staff) – Sample Weaknesses (Charlotte – 2004) • Non-culinary Collections: Business collection lacking in specialization and bulk; Limited p y p ; physical resources in non-culinary y areas and low numbers in culinary even until the other collections are phased in; Business Collection; Fashion Collection; Sports and Event Management collection; Number of books available for class g ; projects • Workstudies: Workstudy students and their lack of motivation; Poor workstudies; Limited staff – one person lost and we struggle to maintain day to day (will be worse as student body increases) • Hours: Lack of Saturday and late evening hours; Reasonable but limited hours • Purchasing Process: Sometimes cumbersome purchasing process; YBP takes too long sometimes 15
  16. 16. What have we done? • More money dedicated to the business collections • G Greater emphasis and planning with regard to training h d l h d work-study employees • Additional hours - Saturday and evening hours • Changed to Ingram and in-house cataloging 16
  17. 17. Focus Groups (2009) – What did we learn? • Still concerns about hours but especially during finals weeks • Need white boards in the student study rooms • Need to “get the word out about what the library has get out” even more 17
  18. 18. Focus Groups – What have we done? • Met with President of Student Government Association – initial planning for “finals week experience starting fall finals experience” 2009 • Installed white boards sta e w te boa s • More outreach done at the end of the academic year and more planned for fall 2009 18
  19. 19. Other Efforts • Best/Worst exercise with students • S d of IL session quiz scores Study f 19
  20. 20. What did we learn (bigger picture)? • Need for multiple assessments and to look at the needs of different groups separately at times • Nationally-recognized assessments don’t always work best fo for us • Triangulation is important – Hearing the same thing from multiple sources strengthens the need for change • It is possible to get a fairly accurate picture of user needs and make changes if you are willing to change 20
  21. 21. Contact Information Dr. Richard J. Moniz, Jr. Director of Library Services D fLb S Johnson & Wales University, Charlotte Campus i h d i @j d 980-598-1603 21