Indicators workshop ces 2013


Published on

Published in: Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Indicators workshop ces 2013

  1. 1. Performance Indicators WithinPerformance Indicators Withinand Across Community Settingsand Across Community SettingsReed EarlyReed EarlyCanadian Evaluation SocietyCanadian Evaluation SocietyConference 2013Conference 2013TorontoToronto
  2. 2. 2Logic ModelLogic ModelInputs Activities Outputs Outcomes UltimateOutcomesPerformance Indicators
  3. 3. 3OrganizationUltimate indicatorsImmediateperformance indicatorsBeyond the sphereof influence Beyond attributionProgram/Service EnvironmentDistant EnvironmentPerformance Indicator ProximityPerformance Indicator Proximity
  4. 4. Management Choice of IndicatorsGoals Objectives IndicatorsStrategic Choice of IndicatorsStrat-egiesIndicatorsTargetsConsultative Choice of IndicatorsDataCollection IndicatorsAnalysisBest Practice Choice of IndicatorsIndicatorsBorrow &AdaptShared andevaluatedStyles of Indicator SelectionStyles of Indicator Selection
  5. 5. 5ManagementManagementIndicators reflect goals and objectives –Indicators reflect goals and objectives –i.e. related toi.e. related to logic model outcomeslogic model outcomesUseful in service/prevention agenciesUseful in service/prevention agenciesOften mandated via legislationOften mandated via legislationThis style may be used by seniorThis style may be used by seniormanagers to independently choose themanagers to independently choose theindicatorsindicators
  6. 6. 6StrategicStrategicIndicators reflect strategies and targetsIndicators reflect strategies and targets– i.e.– i.e. activities, outputs and nearactivities, outputs and nearoutcomesoutcomesUseful for quantifiable or tangibleUseful for quantifiable or tangibleproductsproductsOften result of accountability initiativeOften result of accountability initiativeThis style may be used by performanceThis style may be used by performanceteam in a larger agencyteam in a larger agency
  7. 7. 7ConsultativeConsultativeIndicators based on focus group or survey ofIndicators based on focus group or survey ofemployeesemployees (and statekholders) and Q sort(and statekholders) and Q sortUseful for decentralized, flat organizationsUseful for decentralized, flat organizationsRequires time, effort and original dataRequires time, effort and original datacollectioncollectionMay be used by smaller agencies practicingMay be used by smaller agencies practicingmore democratic managementmore democratic management
  8. 8. 8Best PracticesBest PracticesSelecting indicators from best practicesSelecting indicators from best practicesin literature/Internet, from similarin literature/Internet, from similarleading agencies, and adaptedleading agencies, and adaptedUseful to any agency with resources toUseful to any agency with resources tosearch and researchsearch and researchRequires time, effort, and openness toRequires time, effort, and openness toexperimentationexperimentationMay provide benchmark comparabilityMay provide benchmark comparability
  9. 9. 9Health IndicatorsHealth IndicatorsSurgical wait timeImmunization rateInfant mortality rateHospital acquired infectionsInpatient mortality rateCost per bed/day
  10. 10. 10Social Services IndicatorsSocial Services IndicatorsChild Behavior ChecklistYouth unemployment rateTeen pregnancy and childbearingSchool attendance or graduation rateChildren in families below poverty lineCost per child in care
  11. 11. 11Industry IndicatorsIndustry IndicatorsSalesSalesSales of new productsSales of new productsValue added to raw material consumedValue added to raw material consumedCost savings to industry i.e. reducedCost savings to industry i.e. reducedtraining and down timetraining and down timeIncreased market share %Increased geographic penetration
  12. 12. 12Continuing EducationContinuing EducationReach RelevanceStaffing OverheadEducational FinancialEfficiency ratioEffectiveness ratio
  13. 13. 13Performance MeasurementPerformance MeasurementSystemsSystemscommunity results based indicators, i.ecommunity results based indicators, i.e..Tools For Action Series A resource guideTools For Action Series A resource guidefor designing a community indicatorfor designing a community indicatorprojectproject. a report by SPARC BC, April 2008. a report by SPARC BC, April 2008– Community Objective and PotentialCommunity Objective and PotentialIndicatorsIndicators, United Way of Greater, United Way of GreaterMilwaukee, Planning, Allocation &Milwaukee, Planning, Allocation &Monitoring DivisionMonitoring Division
  14. 14. 14How do you develop PI’sHow do you develop PI’s
  15. 15. 15Conference Indicators…Conference Indicators…– Participant satisfactionParticipant satisfaction– Citations to conferenceCitations to conference– Publications from conferencePublications from conference– Networking and outside connectionsNetworking and outside connections– Sleeper effectsSleeper effects– Diffusion of benefitsDiffusion of benefits– ……othersothers
  16. 16. 16Criteria for IndicatorsCriteria for IndicatorsIs it:Is it:– Authoritative - commonly agreed to beAuthoritative - commonly agreed to betruetrue– Economical – only what’s neededEconomical – only what’s needed– EthicalEthical– Feasible – possible to measureFeasible – possible to measure– Logical – outputs vs. outcomesLogical – outputs vs. outcomes
  17. 17. 17Criteria Con’tCriteria Con’tIs it:Is it:– Manageable - suggest 10 -40Manageable - suggest 10 -40– Measurable – qualitative or quantitativeMeasurable – qualitative or quantitative– Reliable - accurateReliable - accurate– Specific – at the right level of precisionSpecific – at the right level of precision– Visible/accessible like a car dashboardVisible/accessible like a car dashboard– Timely True and ValidTimely True and Valid
  18. 18. 18Analog and ContinuousAnalog and ContinuousMeasuresMeasures
  19. 19. 19Digital and Logical MeasuresDigital and Logical Measures
  20. 20. 20Qualitative and SpacialQualitative and Spacial
  21. 21. 21Ratio and Rate MeasuresRatio and Rate Measures
  22. 22. 22Take away notesTake away notesPerformance indicators relate to logic modelsPerformance indicators relate to logic modelsIndicator selection requires care, time andIndicator selection requires care, time andconscious thoughtconscious thoughtDifferent styles are:Different styles are:– Management, strategic, consultative, best practiceManagement, strategic, consultative, best practiceIndicators should be selected and evaluatedIndicators should be selected and evaluatedagainst criteriaagainst criteria