Betty rogers presentation evaluation. 1ppt


Published on

Team Presentation

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Betty rogers presentation evaluation. 1ppt

  1. 1. Team Presentation Evaluation Team Member Betty Rogers September 20, 2010
  2. 2. Overview <ul><li>How evaluation techniques can be applied to libraries program and services. </li></ul><ul><li>Define evaluation </li></ul><ul><li>Purpose of evaluation </li></ul><ul><li>Evaluation Method </li></ul><ul><li>Evaluation Strategies libraries can use </li></ul><ul><li>Evaluation Types </li></ul><ul><li>Evaluation planning process </li></ul>
  3. 3. What being measured? What does it indicate? What is not being measured? For What Purpose is the Evaluation? Who are the audiences for the information from the evaluation? From what sources should the information be collected? When is the information needed? “ If you don’t know where you are going, how are you gonna’ know when you get there?” Yogi Berra
  4. 4. Definition <ul><li>First, evaluation is viewed as a systematic process </li></ul><ul><li>Second, evaluation involves collecting data </li></ul><ul><li>Third, evaluation is a process for enhancing knowledge and </li></ul><ul><li>decision making </li></ul><ul><li>Fourth, evaluation is a process of determining the success, impact, results, costs, outcome </li></ul><ul><li>SOURCE: Adapted from Russ-Eft and Preskill (2001 ) </li></ul>
  5. 5. Purpose of Evaluation <ul><li>Provide “Useful Feedback </li></ul><ul><li>Planning/efficiency </li></ul><ul><li>Accountability </li></ul><ul><li>Implementation </li></ul><ul><li>Institutional strengthening </li></ul>
  6. 6. Evaluation Method <ul><li>Input measurement </li></ul><ul><li>Output/Performance Measurement </li></ul><ul><li>Impact/Outcomes Assessment </li></ul><ul><li>Service Quality </li></ul>
  7. 7. Evaluation Methods <ul><li>Input Measurement </li></ul><ul><ul><li>Money, </li></ul></ul><ul><ul><li>Facilities, </li></ul></ul><ul><ul><li>Customers </li></ul></ul><ul><ul><li>Clients, </li></ul></ul><ul><ul><li>Program staff </li></ul></ul><ul><ul><li>Volunteers </li></ul></ul><ul><ul><li>External partners </li></ul></ul><ul><ul><li>Time </li></ul></ul><ul><ul><li>Equipment </li></ul></ul><ul><ul><li>Technology </li></ul></ul>
  8. 8. Evaluation Methods <ul><li>Output measurement </li></ul><ul><li>Activity </li></ul><ul><ul><li>Events </li></ul></ul><ul><ul><li>Products </li></ul></ul><ul><ul><li>Workshops </li></ul></ul><ul><ul><li>Trainings </li></ul></ul><ul><ul><li>exhibits </li></ul></ul><ul><ul><li>Numbered of customer served </li></ul></ul>
  9. 9. Evaluation Methods <ul><li>Impact/Outcomes Measures </li></ul><ul><li>Indicative of impacts or outcomes from the service, program, or library activity on those who are receiving the service </li></ul><ul><li>Outcome / Impact </li></ul><ul><li>knowledge </li></ul><ul><li>Attitudes </li></ul><ul><li>Awareness </li></ul><ul><li>Opinions </li></ul><ul><li>Skills </li></ul><ul><li>Behavior </li></ul><ul><li>Educational </li></ul><ul><li>Environmental quality </li></ul>
  10. 10. Evaluation Methods <ul><li>Service Quality </li></ul><ul><li>Difference between what customers expect and their perceptions of the service performance. </li></ul><ul><li>- Encompasses the interactive relationship between the library and the people whom it is supposed to serve </li></ul><ul><li>Does the service meet organizational or user expectation </li></ul>
  11. 11. Evaluation Strategies <ul><li>Major Model Groups </li></ul><ul><ul><li>Scientific-experimental models </li></ul></ul><ul><ul><li>Management-oriented systems models </li></ul></ul><ul><ul><ul><li>PERT(Program Evaluation and Review Technique </li></ul></ul></ul><ul><ul><ul><li>CPM(Critical Path Method) </li></ul></ul></ul><ul><ul><li>Qualitative Models </li></ul></ul><ul><ul><li>Participant-oriented Models </li></ul></ul>
  12. 12. ROI Model <ul><li>Solution Matrix • Cost-Benefit-Analysis </li></ul>
  13. 13. Type of Evaluation <ul><li>Formative </li></ul><ul><li>Summative </li></ul><ul><li>Robert Stake likened the two stages of evaluation to making soup: when the chef tastes the soup, </li></ul><ul><li>its formative; when the diners (or a food critic) taste the soup it is summative </li></ul>
  14. 14. Types of Evaluation <ul><li>Formative Evaluation </li></ul><ul><ul><ul><ul><li>Needs Assessment </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Evaluability assessment </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Structured conceptualization </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Implementation evaluation </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Process evaluation </li></ul></ul></ul></ul><ul><ul><li>Research Methods Knowledge Base </li></ul></ul>
  15. 15. Types of Evaluation <ul><li>Summative Evaluation </li></ul><ul><ul><ul><ul><li>Outcome evaluations </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Impact evaluation </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Cost-effectiveness and cost-benefit analysis </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Secondary analysis </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Meta-analysis </li></ul></ul></ul></ul><ul><ul><li>Research Methods Knowledge Base </li></ul></ul>
  16. 16. Types of Evaluation
  17. 17. Planning Evaluation Cycle <ul><li>Evaluation Phase </li></ul><ul><ul><li>Formulation </li></ul></ul><ul><ul><li>Conceptualization </li></ul></ul><ul><ul><li>Detailing </li></ul></ul><ul><ul><li>Evaluation </li></ul></ul><ul><ul><li>implementation </li></ul></ul>
  18. 18. Planning Evaluation Cycle <ul><li>Planning Phase </li></ul><ul><ul><li>Formulation </li></ul></ul><ul><ul><li>Conceptualization </li></ul></ul><ul><ul><li>Design </li></ul></ul><ul><ul><li>Detailing </li></ul></ul><ul><ul><li>Analysis </li></ul></ul><ul><ul><li>utilization </li></ul></ul>
  19. 19. Planning-Evaluation Cycle <ul><ul><li>Research Methods Knowledge Base </li></ul></ul>
  20. 20. Typical activity indicators to track <ul><li>Amount of products, services delivered </li></ul><ul><li>#/type of customers/clients served </li></ul><ul><li>Timeliness of service provision </li></ul><ul><li>Accessibility and convenience of service </li></ul><ul><ul><li>Location; hours of operation; staff availability </li></ul></ul><ul><li>Accuracy, adequacy, relevance of assistance </li></ul><ul><li>Courteousness </li></ul><ul><li>Customer satisfaction </li></ul>University of Wisconsin-Extension, Program Development and Evaluation E.g.: # of clients served # of consultations # of workshops held # of attendees # of referrals Quality of service
  21. 21. Data Collection Techniques <ul><li>Tests </li></ul><ul><li>Assessments </li></ul><ul><ul><li>Questionnaires </li></ul></ul><ul><ul><li>Interviews </li></ul></ul><ul><ul><li>Observation </li></ul></ul><ul><ul><li>Evaluation </li></ul></ul><ul><ul><li>Use record </li></ul></ul><ul><ul><li>Analysis </li></ul></ul><ul><ul><li>Content analysis </li></ul></ul><ul><ul><li>Surveys </li></ul></ul>
  22. 22. Technique used to Evaluation my Library’s Service/ FVSU H.A. Hunt Memorial Library <ul><li>Formative </li></ul><ul><li>Pretest </li></ul><ul><li>-Students </li></ul><ul><li>Summative </li></ul><ul><ul><li>Survey </li></ul></ul><ul><ul><li>-faculty </li></ul></ul>
  23. 23. Conclusion/Summary <ul><li>In essence, Evaluations are important to library programs and services. The evaluation experience is likely to be more positive and its results are likely to be more useful if you build evaluation in form the start and make it an on-going activity. </li></ul>
  24. 24. Reference <ul><li>University of Wisconsin-Extension, Program Development and Evaluation Logic Model. Retrieved. September 1, 2010; </li></ul><ul><li>These forms of evaluation are derived from the work of Owen published in Program Evaluation: Forms and Approaches (2006) . Retrieved September 1, 2010; </li></ul><ul><li>Haycock, K. & Sheldon ,B.E (2008) . The Portable MLIS; Insights from the Experts . Westport, CT: Libraries Unlimited. </li></ul><ul><li>Research Methods Knowledge Base. Retrieved. September 12, 2010; http:// </li></ul>