Evaluate ! Evaluating School Media Services LIB 620 Library Management Fall 2008
Preemptive Action : The busy librarian’s guide to program evaluation Based in part on: A workshop developed by the Pennsylvania School Librarians Association Professional Development Committee ( No longer available online)
Number of OPAC searches Size of collection Number of lessons planned with teachers Students’ success rate in locating appropriate resources in OPAC searches Collection supports the curriculum Comprehensive and collaborative planning is in place
Students whose school librarian plays an instructional role tend to achieve higher than average test scores. This is also dependent on collaboration between school librarians and teachers and the inclusion of the library materials in the curriculum.
3. The Library Media program supports collaborative planning with the staff for the enhancement of instruction and support of student achievement. Distinguished: The LMS teams with teachers in the formal planning of student-centered authentic learning and project-based teaching and is a teaching partner.
Target Indicator: Student achievement is assessed.
Library 100% Basic Prof. Exemplary
Admin. 100% Basic ____ Prof. Exemplary
Teacher 90% Basic 10% Prof. Exemplary
Back to Step 2 Collecting More Data – Focus Groups
How are student products and performances assessed in units involving use of the library?
How do you determine the products and performances to demonstrate mastery of content in units involving use of the library?
What is the role of reflection in student work involving use of the library?
Evaluation Model Step 4. Formulate recommendations
Review the data, formulate recommendations.
Because of the strong correlation between the school librarian’s instructional role and student achievement, the Advisory Committee establishes a three year goal of reaching the Exemplary level in all target indicators in the Teaching and Learning Rubric
Provide a series of author workshops and develop plans with teachers for student reading, writing, speaking, and viewing responses to the author workshops.
Clarify conflicting feedback through focus groups targeting use of assessment, differentiation, & inquiry in instruction.
Develop recommendations based on new data.
Evaluation Model Step 5 . Develop an action plan
Library staff develop an action plan for each recommendation.
The Advisory Committee of Stakeholders reviews and approves the action plans.
Action Plan Example: Target Indicator: Curriculum development is modeled and promoted Objective Activity Documentation Participants New Resources Completion Date Review barriers preventing librarians from participating in curriculum sessions. Review policies School Council minutes School Council & admin. None projected Sept. 1 Secure schedule Post schedule in lib. & faculty rm. Principal None Sept. 10 Participate in mtgs. Meeting minutes Librarians None projected June 1 Report back Faculty mtg. minutes Librarians None Monthly Written material In professional library Librarians None Within 5 days of mtg
“ The basic premise . . . is that you can learn a great deal . . . by looking at how things wear (‘erosion’), how things are left in the building (‘traces’) and how things are rearranged (‘adaptations for use’).”
Nancy Everhart, Evaluating the School Library Media Center : Analysis Techniques and Research Practices. Libraries Unlimited, 1998 .
“ The reference service performance model [that led to the 55% rule] was overly simplistic, samples were way too small, and the test questions were not representative of real-world reference questions.”
“ Students of reference service should learn about the existence of multiple performance outcomes (i.e., accuracy, utility, and satisfaction) and to recognize that each outcome is driven by different factors.”