Pullin

370 views

Published on

Published in: Business, Technology
  • Be the first to comment

  • Be the first to like this

Pullin

  1. 1. Overview Presentation by Melissa Pullin, Director of EHSResults November 2009 Managing Performance. Focused on Results.
  2. 2. EHSResults! Context: Overview of EOHHS EHSResults Overview 10/09 Massachusetts Executive Office of Health and Human Services (EOHHS) is comprised of 16 state agencies, including … Medicaid (MassHealth) Mental Health Public Health Elders Transitional Assistance Veterans Developmentally Disabled Blind; Deaf & Hard of Hearing It has an annual budget of approximately $13.5B, or about half of the Commonwealth of Massachusetts budget It employs about 23,000 employees and contracts with approximately 1,000 human service providers
  3. 3. EHSResults! EOHHS Call to Action “ We need to transform to a culture that is outcomes-focused, not just budget- or process- focused. We need to talk more often and openly about what our policy and program goals are, and use performance information that communicates how well we are achieving those goals as the starting point for our management discussions, rather than an after-the-fact reporting requirement. This change in culture is not easy, and will take several years.” Dr. JudyAnn Bigby Secretary, Executive Office of Health & Human Services November 2007 EHSResults Overview 10/09
  4. 4. EHSResults! Why (and How) Performance Management? <ul><li>The National Performance Management Advisory Commission recently identified three fundamental government challenges that are addressed through the use of performance management: </li></ul><ul><ul><ul><li>Need to focus the organization on results that are important to stakeholders </li></ul></ul></ul><ul><ul><ul><li>Need to improve results within resource constraints </li></ul></ul></ul><ul><ul><ul><li>Need to gain and keep the public’s trust and confidence </li></ul></ul></ul><ul><li>They also summarized the three main approaches that governments may choose from in defining their performance management process: </li></ul><ul><ul><ul><li>“ Stats” approach (think CompStat program in NYC; CitiStat program in Baltimore) </li></ul></ul></ul><ul><ul><ul><li>Balance Scorecard (think Kaplan and Norton approach) </li></ul></ul></ul><ul><ul><ul><li>Strategic planning cascading system of objectives, strategies & measures (think EHSResults) </li></ul></ul></ul>Source: National Performance Management Advisory Commission “ A Performance Management Framework for State and Local Government: From Measurement & Reporting to Management & Improving” Public Review Draft, July 2009 EHSResults Overview 10/09
  5. 5. EHSResults! Our Approach & Main Work Streams At the beginning of the Patrick Administration, EOHHS began an exciting initiative called EHSResults EHSResults takes an innovative approach to performance management, aiming to foster transparency, accountability, creativity and cross-agency collaboration <ul><li>Four Main Work Streams Support Our Approach: </li></ul><ul><li>Strategic Goal Area Maps & Associated Outcomes </li></ul><ul><ul><ul><li>Intranet-Based Dashboard Reporting Tool </li></ul></ul></ul><ul><ul><ul><li>Associated Performance Management Activities </li></ul></ul></ul><ul><ul><ul><li>Public Awareness of Our Strategic Goals and Performance </li></ul></ul></ul>EHSResults Overview 10/09
  6. 6. EHSResults! Strategic Goal Area Maps <ul><li>Four Main Work Streams Support Our Approach: </li></ul><ul><ul><ul><li>Strategic Goal Area Maps & Associated Outcomes </li></ul></ul></ul><ul><ul><ul><li>Intranet-Based Dashboard Reporting Tool </li></ul></ul></ul><ul><ul><ul><li>Associated Performance Management Activities </li></ul></ul></ul><ul><ul><ul><li>Public Awareness of Our Strategic Goals and Performance </li></ul></ul></ul>EHSResults Overview 10/09
  7. 7. EHSResults! Approach to Strategic Goal Area Maps The strategic goal area maps identify cross-agency, Secretariat wide goals and sub-goals that address the question, “What should EOHHS deliver to Massachusetts residents?” Supporting outcome measures identified from agency programs provide indicators of how well EOHHS is meeting its goals, and answer the question, “How does EOHHS know if it is accomplishing its goals?” EHSResults Overview 10/09 EOHHS’ strategic goal area map development was lead by cross-agency leadership identified by Secretary Bigby Strategy “maps” were developed for each of the EHSResults strategic goal areas
  8. 8. EHSResults! Strategic Goal Areas Compliment the Administration’s Work Effective Government Jobs & Self Sufficiency Safe Communities Educating Kids in Our Care Community First Civic Engagement Affordable Housing Clean Energy And Housing Efficient Transportation & Mobility Safe Communities Economic Growth and Job Creation Effective Government Quality, Affordable Health Care for All World Class Education MassGOALS Reporting Areas Wellness and Quality Of Health Care EOHHS’ strategic goal framework is rooted in the Patrick Administration’s original priority areas EOHHS’ Strategic Goal Areas EHSResults Overview 10/09
  9. 9. EHSResults! Strategic Goal Areas Highlight our Agencies’ Important Work <ul><li>Ensure access to education related programming, services & opportunities for children & youth in EOHHS care </li></ul><ul><li>Maximize school attendance and engagement for children & youth in EOHHS care </li></ul><ul><li>Maximize stability in education programs for children & youth in EOHHS care </li></ul><ul><li>Maximize educational success for children & youth in EOHHS care </li></ul><ul><li>Provide client-centered customer service </li></ul><ul><li>Develop & maintain a high performance workforce </li></ul><ul><li>Improve internal efficiencies </li></ul><ul><li>Increase efficiencies and quality of the POS system </li></ul><ul><li>Surveillance – Monitor key indicators of safe communities </li></ul><ul><li>Preparedness – Develop infrastructure to support safe communities </li></ul><ul><li>Prevention – Deliver proactive & targeted services to individuals, families & communities </li></ul><ul><li>Intervention – Intervene where needed to ensure safety of individuals, families & communities </li></ul><ul><li>Ensure access to care </li></ul><ul><li>Advance health care quality </li></ul><ul><li>Contain health care costs </li></ul><ul><li>Promote individual wellness </li></ul><ul><li>Promote healthy communities </li></ul><ul><li>Increase accessibility & diversity of available jobs for targeted residents through policy & employer outreach </li></ul><ul><li>Provide employment support services for targeted adults </li></ul><ul><li>Maximize number of targeted adults who move toward self-sufficiency and independence through employment </li></ul><ul><li>Successfully transition EOHHS youth entering the workforce </li></ul>Effective Government Jobs & Self Sufficiency Safe Communities Wellness & Quality of Health Care Educating Kids in Our Care <ul><li>Help individuals transition from institutional care </li></ul><ul><li>Expand access to community-based long-term support </li></ul><ul><li>Improve the capacity and quality of community-based long-term supports </li></ul><ul><li>Promote awareness of long-term supports </li></ul>Community First EHSResults Overview 10/09
  10. 10. EHSResults! Approach to Identifying Goals and Outcomes Cross-agency development of the Strategic Goal Area Maps resulted in Secretariat-wide goal statements that are supported by agency-specific outcome metrics Provided supporting agency level outcomes to track success at meeting goals Identified multiple sub-goals necessary to deliver highest level goals Defined EOHHS’ highest level goals, ensuring alignment within and between agencies & EOHHS Example within Jobs and Self Sufficiency Goal Area: Goal Sub-Goal Outcome Measure Outcome Measure Outcome Measure Maximize number of targeted adults who move toward self-sufficiency and independence through employment Maximize number of targeted adults who obtain health benefits from employers Percent of individuals with disabilities with employer sponsored health benefits at time of employment Sub-Goal Sub-Goal EHSResults Overview 10/09
  11. 11. EHSResults! Strategic Goal Area Map Example EHSResults Overview 10/09 (Strategic goal area map showing illustrative example)
  12. 12. EHSResults! Major Strategic Goal Area & Outcome Accomplishments to Date EOHHS Strategic Goal Areas and Outcome Measures Effective Government Jobs & Self Sufficiency Safe Communities Educating Kids in Our Care Community First Wellness and Quality Of Health Care EHSResults Overview 10/09 Strategic goal area maps have been developed for each of the six goal areas, resulting in 25 major goal statements About 75 subgoal statements Approximately 50 - 100 associated outcome measures per map
  13. 13. EHSResults! Executive-Level, Intranet-Based Dashboards <ul><li>Four Main Work Streams Support Our Approach: </li></ul><ul><ul><ul><li>Strategic Goal Area Maps & Associated Outcomes </li></ul></ul></ul><ul><ul><ul><li>Intranet-Based Dashboard Reporting Tool </li></ul></ul></ul><ul><ul><ul><li>Associated Performance Management Activities </li></ul></ul></ul><ul><ul><ul><li>Public Awareness of Our Strategic Goals and Performance </li></ul></ul></ul>EHSResults Overview 10/09
  14. 14. EHSResults! We’ve started developing “dashboard” reporting for EOHHS executives EHSResults Overview 10/09 Effective Government Jobs & Self Sufficiency Safe Communities Educating Kids in Our Care Community First Wellness and Quality Of Health Care
  15. 15. EHSResults! Internal Reporting Promotes our Goals & Helps Us Evaluate Performance EOHHS is focused on our strategic goals and measuring our success; We’re developing internal reporting on our goals & measures, available to EOHHS leadership Jobs & Self Sufficiency Safe Communities Wellness and Quality Of Health Care Educating Kids in Our Care Effective Government EOHHS Strategic Goal Areas and Outcome Measures Goal Area Summaries Outcome Measure Details Community First EHSResults Overview 10/09 (Summary & detail are illustrative examples)
  16. 16. EHSResults! Agency Outcome Measures Agency specific outcome measures provide another way to view strategic goal measures and include agency identified indicators that monitor how well each agency is meeting its own goals CHE DMH MCB HCF MRC VET DYS DPH DDS ELD MCD HLY ORI EHS DTA DCF Agency Outcome Measures Agency Outcome Measures EHSResults Overview 10/09 (Summary & detail are illustrative examples)
  17. 17. EHSResults! Pushing Reports to Executives In addition to its executive-level dashboard reporting, EHSResults produces “paper” reports and emails them to executives for regularly scheduled meetings and ad hoc uses EHSResults Overview 10/09 (Report data are illustrative examples)
  18. 18. EHSResults! Dashboard Reporting Accomplishments to Date CHE DMH MCB HCF MRC VET DYS DPH DMR ELD MCD HLY ORI EHS DTA DCF EOHHS Strategic Goal Areas and Outcome Measures Agency Outcome Measures Effective Government Jobs & Self Sufficiency Safe Communities Educating Kids in Our Care Community First Wellness and Quality Of Health Care EHSResults Overview 10/09 Dashboard reporting has been developed for four of our six strategic goal area maps representing Approximately 500 EOHHS strategic goal area outcome measures Around 80 agency-specific outcome measures
  19. 19. EHSResults! Other Performance Management Activities <ul><li>Four Main Work Streams Support Our Approach: </li></ul><ul><ul><ul><li>Strategic Goal Area Maps & Associated Outcomes </li></ul></ul></ul><ul><ul><ul><li>Intranet-Based Dashboard Reporting Tool </li></ul></ul></ul><ul><ul><ul><li>Associated Performance Management Activities </li></ul></ul></ul><ul><ul><ul><li>Public Awareness of Our Strategic Goals and Performance </li></ul></ul></ul>EHSResults Overview 10/09
  20. 20. EHSResults! Associated Performance Management Activities EHSResults Overview 10/09 <ul><li>Examples of other performance management activities at EOHHS include: </li></ul><ul><li>Fiscal year priority development for 2009 </li></ul><ul><li>Last year, EOHHS identified three FY priority initiatives; For each of those areas we developed business plans (including things like ROI’s, competitive environment analyses, etc.), milestones and outcome measures for reporting </li></ul><ul><ul><ul><li>Recurring EHSResults “spotlight” in weekly HR newsletter to all employees </li></ul></ul></ul><ul><ul><ul><li>Individual manager performance objectives tied to EOHHS strategic goals </li></ul></ul></ul><ul><ul><ul><li>Completed for FY09 cycle with higher level managers ; Each manager identified 3 – 5 performance objectives using EHSResults goal area structure </li></ul></ul></ul><ul><ul><ul><li>FY09 and FY10 “Results Plans” (f/k/a budget spending plans) tied to Results </li></ul></ul></ul><ul><ul><ul><li>Agencies were asked to identify their top 3 – 5 priorities including </li></ul></ul></ul><ul><ul><ul><li>associated performance measures, caseload and spending estimates </li></ul></ul></ul>
  21. 21. EHSResults! Public Awareness of Our Work <ul><li>Four Main Work Streams Support Our Approach: </li></ul><ul><ul><ul><li>Strategic Goal Area Maps & Associated Outcomes </li></ul></ul></ul><ul><ul><ul><li>Intranet-Based Dashboard Reporting Tool </li></ul></ul></ul><ul><ul><ul><li>Associated Performance Management Activities </li></ul></ul></ul><ul><ul><ul><li>Public Awareness of Our Strategic Goals and Performance </li></ul></ul></ul>EHSResults Overview 10/09
  22. 22. EHSResults! We’re Going Public EHSResults Overview 10/09 We will soon be promoting our work publicly through our mass.gov/eohhs internet site and other channels Goal is to launch first version of web presence in January 2010 Content will be relatively static but help promote EOHHS’ use of performance management & our high-level strategic goals & performance measures Content & design work currently underway
  23. 23. EHSResults! <ul><ul><ul><li>The Holy Grail </li></ul></ul></ul>EHSResults Overview 10/09
  24. 24. EHSResults! Tying Outcomes to Budget EHSResults Overview 10/09 <ul><li>Our research has shown that a few (but not many) larger government entities in North America are making a strong tie between performance management & their budget process </li></ul><ul><li>Notable examples include the Commonwealth of Virginia (Virginia Performs program), the Ontario Ministry of Health and Long Term Care, and Washington State (GMAP) </li></ul><ul><li>Most successful outcome-to-budget ties seem to be centered around providing useful information, not creating a punitive environment; Most took several years to set up </li></ul>
  25. 25. EHSResults! Tying Outcomes to Budget EHSResults Overview 10/09 <ul><li>For EOHHS, tying performance outcomes to budget would have many benefits, including </li></ul><ul><ul><ul><li>Providing a fact basis for what programs are delivering desired results </li></ul></ul></ul><ul><ul><ul><li>Understanding the relationship between $$ and outcomes and using this data to drive investment decisions </li></ul></ul></ul><ul><ul><ul><li>Providing data points for setting priorities in budget cutting environments </li></ul></ul></ul><ul><ul><ul><li>Better informing the public about how and why we spend our $$ </li></ul></ul></ul>
  26. 26. EHSResults! Tying Outcomes to Budget <ul><li>We have taken several passes at making “the tie” but have encountered stumbling blocks </li></ul><ul><ul><ul><li>Our EHSResults approach using strategic goals was meant to encourage creative thinking and participation, not shoe-horn our activities into spending buckets </li></ul></ul></ul><ul><ul><ul><li>Programs are often not designed around single outcomes and, by design, they often combine multiple outcomes to best meet client needs </li></ul></ul></ul><ul><ul><ul><li>A budget “unit” is not consistently defined within and across EOHHS </li></ul></ul></ul><ul><ul><ul><li>Monitoring a budget / performance tie requires lots of resources </li></ul></ul></ul><ul><ul><ul><li>Cultural resistance (to target setting and linking outcomes to $$s) is real and needs to be factored into systematic changes </li></ul></ul></ul><ul><ul><ul><li>Our goals and measures do not represent everything we do </li></ul></ul></ul><ul><li>Because of those challenges, EOHHS is taking an incremental approach to starting the outcome-to-budget tie by using the spending plan process </li></ul>EHSResults Overview 10/09
  27. 27. EHSResults! Using the Spending Plan Process as Step 1 <ul><li>Departments identify 3 – 5 strategic priorities for the FY. For each strategic priority they provide: </li></ul><ul><ul><li>A brief overview for each, including things like changes from last FY, milestones, challenges / risks, populations served & caseload estimates </li></ul></ul><ul><ul><li>Estimated spending / funding and clients or units of service in order to derive a spending per client or unit of service estimate </li></ul></ul><ul><ul><li>Three to five associated outcome measures, including targets and prior year actuals </li></ul></ul>EHSResults Overview 10/09 EOHHS uses its spending plan process to request priorities, outcomes and strategic ties from Agencies … … This type of strategic priority information is the basis for much of the agency spending plan conversation with the Secretary
  28. 28. EHSResults! <ul><ul><ul><li>Lessons Learned </li></ul></ul></ul>EHSResults Overview 10/09
  29. 29. EHSResults! Lessons Learned: Our Overall Approach <ul><li>What started out as a technology project isn’t that at all </li></ul><ul><ul><li>In the concept stage, we were an 80:20 technology to business resource split. In reality, we are a 75:25 business to technology split. </li></ul></ul><ul><li>Outcomes, metrics, measures… We can use the same words & mean different things </li></ul><ul><ul><li>Different organizations & approaches use the same words in different ways. We check with users to ensure our vocabulary is understood & matches our intent. </li></ul></ul><ul><li>Both program managers & leaders often default to identifying process measures </li></ul><ul><ul><li>Caseload & dollars are traditional measures. We are constantly reminding staff and ourselves that we need to focus on client results / outcomes. </li></ul></ul><ul><li>We maintain credibility by remaining facilitators; we’re not subject matter experts </li></ul><ul><ul><li>The agencies and EOHHS leadership know their programs, data and environment. Our goal is to facilitate change & empower others to use it. </li></ul></ul><ul><li>Top dog EOHHS support and agency champions are necessary for our success </li></ul><ul><ul><li>Our Secretary promotes & requires participation; our agency “business representatives” keep projects moving. </li></ul></ul>EHSResults Overview 10/09
  30. 30. EHSResults! Lessons Learned: Dashboard Reporting <ul><li>Most (all?) of our executives don’t know their passwords and don’t want to log on </li></ul><ul><ul><li>In our culture, we need to email and promote “canned” (.pdf) reports. Our initial expectation that executives would log on to see data was unrealistic. </li></ul></ul><ul><li>Targets make some people uncomfortable and some people downright cranky </li></ul><ul><ul><li>Our reporting compares actuals to targets. Some agencies did not have or resisted setting targets, some did not feel directly responsible for the result. </li></ul></ul><ul><li>Sometimes we take the Big Brother approach to changes and enhancements </li></ul><ul><ul><li>Optimally, business users would request new functionality. When they don’t, we make educated guesses about what might be helpful. </li></ul></ul><ul><li>Users prefer to see only measures they “own”, not by EOHHS strategic goal area </li></ul><ul><ul><li>Although we report by agency view, we also report by goal area so enterprise-wide policy implications & cross-agency comparisons are visible. </li></ul></ul><ul><li>What to measure? Check. How to get to data? Check. Now what do we DO with it?! </li></ul><ul><ul><li>Identifying, capturing, providing context & reporting the data is big. But figuring out how to use the data and analysis is the real bugaboo… </li></ul></ul>EHSResults Overview 10/09
  31. 31. EHSResults! Lessons Learned: Non-Reporting Activities <ul><li>We exploit all reasonable opportunities to embed ourselves into on-going activities </li></ul><ul><ul><li>Whether it’s budget exercises or leadership meeting agendas or HR employee communications, we try and embed our work into people’s daily work in order to promote performance management at EOHHS & increase name recognition. </li></ul></ul><ul><li>A lot of our unit’s time is required to communicate our messages </li></ul><ul><ul><li>EOHHS employees, dashboard users, data owners, the public, clients, advocacy groups… yipes! We try to segment stakeholders & communication strategies </li></ul></ul><ul><li>Leadership’s use of our reporting in on-going meetings is vital </li></ul><ul><ul><li>Our Secretary made our reports a mandatory agenda item at her regular meetings with Commissioners. Guess what? People now pay more attention. </li></ul></ul><ul><li>We strive to be an operational unit & not perceived as administration-based </li></ul><ul><ul><li>We previously used consultants but are switching to an FTE-only staffing model. We hope this promotes stability, saves money & limits our exposure to funding cuts. We constantly reinforce the message that we are here to stay… </li></ul></ul>EHSResults Overview 10/09
  32. 32. EHSResults! <ul><ul><ul><li>Questions? Comments? Ideas? Advice? </li></ul></ul></ul>EHSResults Overview 10/09 Melissa Pullin Director, EHSResults [email_address]

×