Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Indicators workshop ces 2013


Published on

Reed Early's presentation on Choosing Performance Indicators from June 10 - see matched PPTX and DOCX files.

  • Be the first to comment

  • Be the first to like this

Indicators workshop ces 2013

  1. 1. Performance Indicators WithinPerformance Indicators Withinand Across Community Settingsand Across Community SettingsReed EarlyReed EarlyCanadian Evaluation SocietyCanadian Evaluation SocietyConference 2013Conference 2013TorontoToronto
  2. 2. 2Activity 1 -Activity 1 - Obstacles toObstacles toselecting indicators (3-4 min)selecting indicators (3-4 min)1.1. Close eyes and write name on piece of paperClose eyes and write name on piece of paper2.2. Turn it over and write place of birth using non-Turn it over and write place of birth using non-dominant handdominant hand3.3. Swap cards with person next & verballySwap cards with person next & verballyinstruct them to write your age in monthsinstruct them to write your age in monthswithout telling them what it actually iswithout telling them what it actually is4.4. Optional - Provide lengthy written instructionsOptional - Provide lengthy written instructionsvia a Policy and Procedure Manual on how tovia a Policy and Procedure Manual on how tomeasure your success on the cardmeasure your success on the card
  3. 3. 3Logic ModelLogic ModelInputs Activities Outputs Outcomes UltimateOutcomesPerformance Indicators
  4. 4. 4OrganizationUltimate indicatorsImmediateperformance indicatorsBeyond the sphereof influence Beyond attributionProgram/Service EnvironmentDistant EnvironmentPerformance Indicator ProximityPerformance Indicator Proximity
  5. 5. Management Choice of IndicatorsGoals Objectives IndicatorsStrategic Choice of IndicatorsStrat-egiesIndicatorsTargetsConsultative Choice of IndicatorsDataCollection IndicatorsAnalysisBest Practice Choice of IndicatorsIndicatorsBorrow &AdaptShared andevaluatedStyles of Indicator SelectionStyles of Indicator Selection
  6. 6. 6ManagementManagementIndicators reflect goals and objectives –Indicators reflect goals and objectives –i.e. related toi.e. related to logic model outcomeslogic model outcomesUseful in service/prevention agenciesUseful in service/prevention agenciesOften mandated via legislationOften mandated via legislationThis style may be used by seniorThis style may be used by seniormanagers to independently choose themanagers to independently choose theindicatorsindicators
  7. 7. 7StrategicStrategicIndicators reflect strategies and targetsIndicators reflect strategies and targets– i.e.– i.e. activities, outputs and nearactivities, outputs and nearoutcomesoutcomesUseful for quantifiable or tangibleUseful for quantifiable or tangibleproductsproductsOften result of accountability initiativeOften result of accountability initiativeThis style may be used by performanceThis style may be used by performanceteam in a larger agencyteam in a larger agency
  8. 8. 8ConsultativeConsultativeIndicators based on focus group or survey ofIndicators based on focus group or survey ofemployeesemployees (or clients)(or clients)Useful for decentralized, flat organizationsUseful for decentralized, flat organizationsRequires time, effort and original dataRequires time, effort and original datacollectioncollectionMay be used by smaller agencies practicingMay be used by smaller agencies practicingmore democratic managementmore democratic management
  9. 9. 9Best PracticesBest PracticesSelecting indicators fromSelecting indicators fromliterature/Internet, from similar leadingliterature/Internet, from similar leadingagencies, and adaptedagencies, and adaptedUseful to any agency with resources toUseful to any agency with resources tosearch and researchsearch and researchRequires time, effort, and openness toRequires time, effort, and openness toexperimentationexperimentationMay provide benchmark comparabilityMay provide benchmark comparability
  10. 10. 10Health IndicatorsHealth IndicatorsSurgical wait timeImmunization rateInfant mortality rateHospital acquired infectionsInpatient mortality rateCost per bed/day
  11. 11. 11Social Services IndicatorsSocial Services IndicatorsChild Behavior ChecklistYouth unemployment rateTeen pregnancy and childbearingSchool attendance or graduation rateChildren in families below poverty lineCost per child in care
  12. 12. 12Industry IndicatorsIndustry IndicatorsSalesSalesSales of new productsSales of new productsValue added to raw material consumedValue added to raw material consumedCost savings to industry i.e. reducedCost savings to industry i.e. reducedtraining and down timetraining and down timeIncreased market share %Increased geographic penetration
  13. 13. 13Continuing EducationContinuing EducationReach RelevanceStaffing OverheadEducational FinancialEfficiency ratioEffectiveness ratio
  14. 14. 14Performance MeasurementPerformance MeasurementSystemsSystemscommunity results based indicators, i.ecommunity results based indicators, i.e..Tools For Action Series A resource guideTools For Action Series A resource guidefor designing a community indicatorfor designing a community indicatorprojectproject. a report by SPARC BC, April 2008. a report by SPARC BC, April 2008– Community Objective and PotentialCommunity Objective and PotentialIndicatorsIndicators, United Way of Greater, United Way of GreaterMilwaukee, Planning, Allocation &Milwaukee, Planning, Allocation &Monitoring DivisionMonitoring Division
  15. 15. 15How do you develop PI’sHow do you develop PI’s
  16. 16. 16Conference Indicators…Conference Indicators…– Participant satisfactionParticipant satisfaction– Citations to conferenceCitations to conference– Publications from conferencePublications from conference– Networking and outside connectionsNetworking and outside connections– Sleeper effectsSleeper effects– Diffusion of benefitsDiffusion of benefits– ……othersothers
  17. 17. 17Criteria for IndicatorsCriteria for IndicatorsIs it:Is it:– Authoritative - commonly agreed to beAuthoritative - commonly agreed to betruetrue– Economical – only what’s neededEconomical – only what’s needed– EthicalEthical– Feasible – possible to measureFeasible – possible to measure– Logical – outputs vs. outcomesLogical – outputs vs. outcomes
  18. 18. 18Criteria Con’tCriteria Con’tIs it:Is it:– Manageable - suggest 10 -40Manageable - suggest 10 -40– Measurable – qualitative or quantitativeMeasurable – qualitative or quantitative– Reliable - accurateReliable - accurate– Specific – at the right level of precisionSpecific – at the right level of precision– Visible/accessible like a car dashboardVisible/accessible like a car dashboard– Timely True and ValidTimely True and Valid
  19. 19. 19Analog and ContinuousAnalog and ContinuousMeasuresMeasures
  20. 20. 20Digital and Logical MeasuresDigital and Logical Measures
  21. 21. 21Qualitative and SpacialQualitative and Spacial
  22. 22. 22Ratio and Rate MeasuresRatio and Rate Measures
  23. 23. 23Take away notesTake away notesPerformance indicators relate to logic modelsPerformance indicators relate to logic modelsIndicator selection requires care, time andIndicator selection requires care, time andconscious thoughtconscious thoughtDifferent styles are:Different styles are:– Management, strategic, consultative, best practiceManagement, strategic, consultative, best practiceIndicators should be selected and evaluatedIndicators should be selected and evaluatedagainst criteriaagainst criteria