Performance Measurement Summit
Upcoming SlideShare
Loading in...5
×

Like this? Share it with your network

Share

Performance Measurement Summit

  • 1,573 views
Uploaded on

 

More in: Business
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
1,573
On Slideshare
1,573
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
26
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. LCDR Bill Butler U.S. Coast Guard Headquarters Commandant (CG-512) Office Performance Management & Assessment Performance Measures OVERVIEW
  • 2. Office of Boating Safety Performance Measurement Performance Measurement Improvements cannot be made without measures
    • Today’s discussion…
    • Why we’re doing performance Measurement
    • The Logic Model
    • CG-541 Waterways Management
    • Reviewing Performance Data
    • Campaign Plan Requirements
  • 3. Public Law 103-62 1.1 Government Performance & Results Act (GPRA)
  • 4. 1.2 OMB Guidance & Requirements – Circular A-11
  • 5. 1.3 OMB’s Program Assessment Rating Tool (PART)
  • 6.
    • Strategic Plans (Submission Year + 5 years forward)
      • Mission Statement
      • Goals & Objectives
      • Intent
      • Key Factors
    • Performance Plans ( Annual )
      • Verifiable Output, Service Level, & Outcome Measures
      • Tangible, measurable performance targets
    • Performance Reports ( Annual )
      • Actual performance, and remediation intentions
    1.4 GPRA & OMB Requirements
  • 7. 1.5 GAO Assessments of USCG
  • 8.
    • When we're finished, program managers will be able to use the information from the dashboard measures to assess performance and goals across program
    1.6 Purpose and Vision Vision : Build program dashboard measures that will enable program managers to ensure the effective and efficient use of Coast Guard resources to achieve results.
  • 9.
    • Data Meets OMB, GAO & DHS Requirements
    • Data Measurement Card for each Measurement
    • Data Measurement Card captures…
      • Measurement Name
      • Measurement Description
      • Measurement Algorithm
      • Measurement Type (Outcome, Output, Activity)
      • Frequency of Collection
      • Data Source (Where the data is extracted from)
      • Data Scope & Limitations
    1.7 Data Specification Requirements
  • 10. True or False?
    • The Coast Guard will use Performance Measurement Data to change billets.
    FALSE! The information acquired by our office is used only for the development of your unit’s scorecards and dashboard measurements.
  • 11. True or False? 2. Some of the activities we do you really can’t measure. FALSE! If we do then we measure it!
  • 12. True or False? 3. You can’t measure this because we have no data collected on it. FALSE! When we do our data collection, we will look for where data may come from, even if it comes from a non-government source.
  • 13. True or False? 4. Our office will be critiquing your performance information. FALSE! Our goal is to help facilitate the development of your program’s scorecard. Program managers will be the ones reviewing actual performance. We do request performance data for OPG, RAP, BBD, and Campaign Plans.
  • 14. True or False? 5. Using performance measurement data makes better arguments for additional resources. True! How can you legitimately request more resources when you have nothing to back up your request?
  • 15. True or False? 6. Performance measurement gives you the opportunity to make a compelling argument for what you do. True! A good performance measurement communicates worth!
  • 16. Logic Model Purpose: To show how your day-to-day activities effect the organization Outcomes. 4. Performance Logic Model (skeletal) 2.1 The Logic Model Capabilities Activities Outputs Outcomes Activity Measures Output Measures Outcome Measures Mission Purpose & Goals Capability Measures 1 2 3 4 5
  • 17. Risk Management System 2.2 The Original Logic Model
  • 18.
    • Helps us explain to GAO, OMB and DHS the stem-to-stern logic of our world of work.
    • It’s a process for getting to our measurements and measurement development.
    • It gets people to see how their work affects missions and outcomes
    • It shows the interdependency of all our missions.
    2.3 Why the Logic Model?
  • 19. 1 2 3 4 5 4. Performance Logic Model (skeletal) 2.4 Logic Model – Purpose The Public benefits we aim to influence. Capabilities Activities Outputs Outcomes Activity Measures Output Measures Outcome Measures 1 Mission Purpose & Goals Capability Measures
  • 20.
    • What does the public expect from us?
    • What Strategic Goals are we aiming to achieve?
    • Helps us explain to GAO, OMB and DHS the logic of our world of work.
    • Conduct a situation analysis:
      • Identifying your strengths and weaknesses
      • identifying trends that might impact our business in the next 5-7 years
    • Define key success factors and business fundamentals
      • What success factors are or are NOT
    • And, if I hear… “We facilitate commerce…”
    2.4b Logic Model – Mission & Purpose?
  • 21. 1 2 3 4 5 4. Performance Logic Model (skeletal) 2.5 Logic Model – Outcomes Benefits provided as a direct result of USCG products & services Capabilities Activities Outputs Outcomes What is the greater “societal” Outcome? Activity Measures Output Measures Outcome Measures Mission Purpose & Goals Capability Measures
  • 22.
    • What is the “greater good” to society?
    • How are you going to measure this “greater good?”
    • If you use “Economic Impact” or other monetary figures or numbers be prepared for some in-depth research.
    • Many Outcome measurements presented to our office are NOT Outcome measurements.
    • Give The Outcome Measurements Test to your measurement… Does the public care about this?”
    2.5b Logic Model – Outcomes
  • 23. 1 2 3 4 5 4. Performance Logic Model (skeletal) 2.6 The Logic Model – Outputs Products & services provided as a direct result of USCG work. Capabilities Activities Outputs What is the impact of this Output? Outcomes Activity Measures Output Measures Outcome Measures Mission Purpose & Goals Capability Measures
  • 24.
    • The End Result of the goods & services we provide!
      • COI
      • CG License
      • Cleared Channel
      • BNTM
      • A working ATON
      • A successfully transited vessel
    • Ask: What impact is our Outputs having on the desired Outcome?
    • Assess: The effectiveness of this work.
      • Do we need all deployed ATON in a specific channel?
    2.6b Logic Model – Outputs
  • 25. 4. Performance Logic Model (skeletal) 2.7 The Logic Model – Activities The work performed by USCG resources. Capabilities Activities Why do we do this Activity? Outputs Outcomes Activity Measures Output Measures Outcome Measures Mission Purpose & Goals Capability Measures 1 2 3 4 5
  • 26.
    • Usually the easier to do
    • Activities are the events that go into producing the Output. For example, to get a COI
      • Inspect Life Saving Equipment
      • Inspect Fire Fighting Equipment
      • Inspect Navigation systems
      • Inspect stability and subdivision
    • Ask: What impact is our activities having on the desired Output?
    • Assess: The effectiveness of this work.
      • Do we really need to be inspecting lifejackets?
    2.7b Logic Model – Activities
  • 27. 1 2 3 4 5 4. Performance Logic Model (skeletal) 2.7 The Logic Model – Capabilities The state of Readiness and the Capabilities needed to perform USCG work. Capabilities Activities Outputs Outcomes Activity Measures Output Measures Outcome Measures Mission Purpose & Goals Capability Measures
  • 28.
    • Our office does NOT facilitate “Capability” and Readiness
    • Separate program in CGHQs does (CG-7)
    • Owners of Mission Outcome (MS, MEP, WM, SAR, DR, MLE, PWCS) are responsible for conveying their needs.
    2.7b The Logic Model – Capabilities
  • 29.
    • Make sure Data Measurement Card captures…
      • Measurement Name
      • Measurement Description & Definition
      • Measurement Algorithm
      • Measurement Type (Outcome, Output, Activity)
      • Frequency of Collection
      • Data Source (Where the data is extracted from)
      • Data Scope & Limitations
    2.8 Logic Model – Measurements
  • 30. 3.1 Waterways Management Logic Model VTS
  • 31. Organizational Outcomes 3.2 CG-541 Waterways Management Logic Model Maritime Safety Maritime Security Environmental Stewardship Primary Collateral Waterways Response & Restoration Efficient & Available Waterways Readiness Equipment Infrastructure Information People Training Mission Activities Traffic Control / Navigation Assistance Bridge Administration Aids To Navigation Marine Information Waterway Access & Usage Domestic Ice Breaking Mission Outputs Directed Navigation Management Bridge Actions & Permits Marked Channel Information for the Mariner Waterway Access Controls Cleared Channel Mission Outputs Directed Navigation Management Bridge Actions & Permits Marked Channel Information for the Mariner Waterway Access Controls Cleared Channel
  • 32. 3.3 CG-541 Waterways Management Logic Model
  • 33.
    • Current Measurement:
    • Number of days Waterways closed
    3.3 Current Domestic Ice Measurements
  • 34.
    • Great Lake Pilotage
      • They produce one regulation per year.
    • Polar Ice Breaking
      • They make one trip to the South Pole per year
    • International Ice Patrol
      • No Icebergs reported in shipping lanes.
    • Vessel Traffic Service
      • They moved the office out of Waterways and into CG-7 (Capabilities)
    • Bridge Admin
      • some permits take years to develop
    3.4 Challenges to Waterways Measurements
  • 35.
    • Proper Representation during workshops
      • Over-represented on Bridges
      • Under-represented on Ice
    • Developing the master WWs Logic Models required concurrent individual program development
    • It was easy to test the viability of measures .
    • Measurement definition caused lots of work
      • What’s a “transit”
      • What’s a “vessel”
      • What’s a “delay”
    • Merging of several cultures into one Directorate
    • And, if I hear… “We facilitate commerce…”
    3.5 Lessons Learn from Waterways Management
  • 36.  
  • 37.
    • Requires that measurements are Reported
    • Don’t be afraid of the results…
      • Having bad results is better than no system of measurement at all
    • Constantly Assess your Measurements
      • Is the measurement giving me what I need to know?
      • Are there other sources of data?
    • Be prepared to explain your results
    • Determine the Frequency of Reporting
    4.1 Reviewing Performance Data
  • 38. 4.2 Program Results – Reporting Outcomes
  • 39. How many delays / district / period ? What waterways were affected? What were the results of these delays? 4.3 Program Results – “Drill Down”
  • 40. 4.4 Program Results – Report “Causes” No. of channels cleared No. of Assists SAMPLE Report Comments: 6 5 4 3 2 1 Cause Time of delay Section Effected Date Name of Critical Waterway Comments: Hrs 07 06 05 04 03 This Year Last Four Ice Seasons
  • 41.
    • Where do we go from here?
    • Continue refining & defining measures
    • Develop Targets
    • Develop Efficiency Measures
    • Continue assessing Risk & Risk “buy down”
    • Develop Sensitivity Analysis
    • Develop costs and costing models
    • We can’t do any of these unless we’re measuring!
    4.4 The Way Ahead
  • 42. Simplified Planning Process 5.1 Campaign Planning Process
  • 43.
    • Seven Program Missions
    • Marine Safety
    • Marine Environmental Protection
    • Waterways Management
    • Ports, Waterways, & Coastal Security
    • Search and Rescue
    • Maritime Law Enforcement
    • Defense Readiness
    5.2 Campaign Plans Required for…
  • 44.
    • PART 1: Program Mission
    • Introduction
    • Mission and Vision
    • Guiding Principles
    • Roles, Responsibilities, and Mission Business Case
    • Linkage with Departmental and Executive directives
    5.3 Components of a Campaign Plan
  • 45.
    • PART 2: Strategic Assessment
    • Key Outcome Measurements
    • Current Performance
    • Targeting
    • Objectives and Strategies
      • Opportunities and Challenges
      • Performance Gaps and Issues
      • ACCCP Gaps and Issues
    5.4 Components of a Campaign Plan
  • 46.
    • PART 3: Action Plans
    • Initiative
    • Synopsis of the Initiative
      • A“1-minute Elevator summary
    • Situation-Needs Assessment
      • The “necessity” of the situation
    • Proposed Course of Action
    • Benefits, Costs and Risks
    • Illustrations
    5.5 Components of a Campaign Plan