Your SlideShare is downloading. ×
Indicators workshop ces 2013
Upcoming SlideShare
Loading in...5

Thanks for flagging this SlideShare!

Oops! An error has occurred.

Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Indicators workshop ces 2013


Published on

Reed Early's presentation on Choosing Performance Indicators from June 10 - see matched PPTX and DOCX files.

Reed Early's presentation on Choosing Performance Indicators from June 10 - see matched PPTX and DOCX files.

  • Be the first to comment

  • Be the first to like this

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

No notes for slide


  • 1. Performance Indicators WithinPerformance Indicators Withinand Across Community Settingsand Across Community SettingsReed EarlyReed EarlyCanadian Evaluation SocietyCanadian Evaluation SocietyConference 2013Conference 2013TorontoToronto
  • 2. 2Activity 1 -Activity 1 - Obstacles toObstacles toselecting indicators (3-4 min)selecting indicators (3-4 min)1.1. Close eyes and write name on piece of paperClose eyes and write name on piece of paper2.2. Turn it over and write place of birth using non-Turn it over and write place of birth using non-dominant handdominant hand3.3. Swap cards with person next & verballySwap cards with person next & verballyinstruct them to write your age in monthsinstruct them to write your age in monthswithout telling them what it actually iswithout telling them what it actually is4.4. Optional - Provide lengthy written instructionsOptional - Provide lengthy written instructionsvia a Policy and Procedure Manual on how tovia a Policy and Procedure Manual on how tomeasure your success on the cardmeasure your success on the card
  • 3. 3Logic ModelLogic ModelInputs Activities Outputs Outcomes UltimateOutcomesPerformance Indicators
  • 4. 4OrganizationUltimate indicatorsImmediateperformance indicatorsBeyond the sphereof influence Beyond attributionProgram/Service EnvironmentDistant EnvironmentPerformance Indicator ProximityPerformance Indicator Proximity
  • 5. Management Choice of IndicatorsGoals Objectives IndicatorsStrategic Choice of IndicatorsStrat-egiesIndicatorsTargetsConsultative Choice of IndicatorsDataCollection IndicatorsAnalysisBest Practice Choice of IndicatorsIndicatorsBorrow &AdaptShared andevaluatedStyles of Indicator SelectionStyles of Indicator Selection
  • 6. 6ManagementManagementIndicators reflect goals and objectives –Indicators reflect goals and objectives –i.e. related toi.e. related to logic model outcomeslogic model outcomesUseful in service/prevention agenciesUseful in service/prevention agenciesOften mandated via legislationOften mandated via legislationThis style may be used by seniorThis style may be used by seniormanagers to independently choose themanagers to independently choose theindicatorsindicators
  • 7. 7StrategicStrategicIndicators reflect strategies and targetsIndicators reflect strategies and targets– i.e.– i.e. activities, outputs and nearactivities, outputs and nearoutcomesoutcomesUseful for quantifiable or tangibleUseful for quantifiable or tangibleproductsproductsOften result of accountability initiativeOften result of accountability initiativeThis style may be used by performanceThis style may be used by performanceteam in a larger agencyteam in a larger agency
  • 8. 8ConsultativeConsultativeIndicators based on focus group or survey ofIndicators based on focus group or survey ofemployeesemployees (or clients)(or clients)Useful for decentralized, flat organizationsUseful for decentralized, flat organizationsRequires time, effort and original dataRequires time, effort and original datacollectioncollectionMay be used by smaller agencies practicingMay be used by smaller agencies practicingmore democratic managementmore democratic management
  • 9. 9Best PracticesBest PracticesSelecting indicators fromSelecting indicators fromliterature/Internet, from similar leadingliterature/Internet, from similar leadingagencies, and adaptedagencies, and adaptedUseful to any agency with resources toUseful to any agency with resources tosearch and researchsearch and researchRequires time, effort, and openness toRequires time, effort, and openness toexperimentationexperimentationMay provide benchmark comparabilityMay provide benchmark comparability
  • 10. 10Health IndicatorsHealth IndicatorsSurgical wait timeImmunization rateInfant mortality rateHospital acquired infectionsInpatient mortality rateCost per bed/day
  • 11. 11Social Services IndicatorsSocial Services IndicatorsChild Behavior ChecklistYouth unemployment rateTeen pregnancy and childbearingSchool attendance or graduation rateChildren in families below poverty lineCost per child in care
  • 12. 12Industry IndicatorsIndustry IndicatorsSalesSalesSales of new productsSales of new productsValue added to raw material consumedValue added to raw material consumedCost savings to industry i.e. reducedCost savings to industry i.e. reducedtraining and down timetraining and down timeIncreased market share %Increased geographic penetration
  • 13. 13Continuing EducationContinuing EducationReach RelevanceStaffing OverheadEducational FinancialEfficiency ratioEffectiveness ratio
  • 14. 14Performance MeasurementPerformance MeasurementSystemsSystemscommunity results based indicators, i.ecommunity results based indicators, i.e..Tools For Action Series A resource guideTools For Action Series A resource guidefor designing a community indicatorfor designing a community indicatorprojectproject. a report by SPARC BC, April 2008. a report by SPARC BC, April 2008– Community Objective and PotentialCommunity Objective and PotentialIndicatorsIndicators, United Way of Greater, United Way of GreaterMilwaukee, Planning, Allocation &Milwaukee, Planning, Allocation &Monitoring DivisionMonitoring Division
  • 15. 15How do you develop PI’sHow do you develop PI’s
  • 16. 16Conference Indicators…Conference Indicators…– Participant satisfactionParticipant satisfaction– Citations to conferenceCitations to conference– Publications from conferencePublications from conference– Networking and outside connectionsNetworking and outside connections– Sleeper effectsSleeper effects– Diffusion of benefitsDiffusion of benefits– ……othersothers
  • 17. 17Criteria for IndicatorsCriteria for IndicatorsIs it:Is it:– Authoritative - commonly agreed to beAuthoritative - commonly agreed to betruetrue– Economical – only what’s neededEconomical – only what’s needed– EthicalEthical– Feasible – possible to measureFeasible – possible to measure– Logical – outputs vs. outcomesLogical – outputs vs. outcomes
  • 18. 18Criteria Con’tCriteria Con’tIs it:Is it:– Manageable - suggest 10 -40Manageable - suggest 10 -40– Measurable – qualitative or quantitativeMeasurable – qualitative or quantitative– Reliable - accurateReliable - accurate– Specific – at the right level of precisionSpecific – at the right level of precision– Visible/accessible like a car dashboardVisible/accessible like a car dashboard– Timely True and ValidTimely True and Valid
  • 19. 19Analog and ContinuousAnalog and ContinuousMeasuresMeasures
  • 20. 20Digital and Logical MeasuresDigital and Logical Measures
  • 21. 21Qualitative and SpacialQualitative and Spacial
  • 22. 22Ratio and Rate MeasuresRatio and Rate Measures
  • 23. 23Take away notesTake away notesPerformance indicators relate to logic modelsPerformance indicators relate to logic modelsIndicator selection requires care, time andIndicator selection requires care, time andconscious thoughtconscious thoughtDifferent styles are:Different styles are:– Management, strategic, consultative, best practiceManagement, strategic, consultative, best practiceIndicators should be selected and evaluatedIndicators should be selected and evaluatedagainst criteriaagainst criteria