Performance Measures and Targets for Transportation Asset Management Project Summary presented to NCHRP Project 20-60 Pane...
Presentation Contents <ul><li>NCHRP Project 20-60  –  Background and Objectives </li></ul><ul><li>Overview of Findings </l...
NCHRP Project 20-60 Background and Objectives
Context <ul><li>“ Asset Management is a Strategic Approach…It is driven by policy goals and objectives and relies on syste...
NCHRP Project 20-60 Objectives <ul><li>Develop guidance to help transportation agencies  </li></ul><ul><ul><li>Identify me...
NCHRP 20-60 Products <ul><li>Volume 1 – Formal Project Report </li></ul><ul><ul><li>Review of current practices </li></ul>...
Overview of Findings
Role of Performance Measures in Asset Management Policy Goals and Objectives Analysis of Options and Trade-offs Resource A...
Role of Performance Measures in Asset Management  (continued) Policy Goals and Objectives Analysis of Options and Trade-of...
Role of Performance Measures in Asset Management  (continued) Policy Goals and Objectives Analysis of Options and Trade-of...
Role of Performance Measures in Asset Management  (continued) Policy Goals and Objectives Analysis of Options and Trade-of...
Role of Performance Measures in Asset Management  (continued) Policy Goals and Objectives Analysis of Options and Trade-of...
Role of Performance Measures in Asset Management  (continued) Policy Goals and  Objectives Analysis of Options and Trade-o...
Selecting Suitable Performance Measures <ul><li>Essential requirements for a measure to support asset management </li></ul...
Getting the Most out of Performance Measures for Asset Management <ul><li>Look at performance versus investment over the l...
Examples of Best Practices <ul><li>Use measures as basis for establishing program allocation levels – pavement, bridge, an...
Recommended Framework
Guidance for Performance Measures and Targets Tailor Measures to Decisions Design Consistent Measures Across Program Areas...
Identifying Performance Measures  Inventory Existing Measures Define Criteria for Selecting New Measures Identify Candidat...
Identifying Performance Measures  (continued) <ul><li>Step 1  –  Inventory Existing Measures </li></ul><ul><ul><li>How are...
Identifying Performance Measures  (continued) <ul><li>Step 3 – Define Criteria for Selecting New Measures </li></ul><ul><u...
Identifying Performance Measures  (continued) <ul><li>Step 4 – Identify Candidate Measures </li></ul><ul><ul><li>Develop a...
Integrating Performance Measures into an Organization  Engage Stakeholders Tailor Measures to Decisions Design Consistent ...
Integrating Performance Measures into  an Organization  (continued) <ul><li>Step 1  –  Engage Stakeholders to Ensure Buy-i...
Integrating Performance Measures into  an Organization  (continued) <ul><li>Step 3  –  Design Consistent Measures Across P...
Integrating Performance Measures into  an Organization  (continued) <ul><li>Step 5  –  Design Communication Devices  </li>...
Communication Devices Virginia DOT Dashboard
Communication Devices Virginia DOT Dashboard  (continued)
Integrating Performance Measures into  an Organization  (continued) <ul><li>Step 6 – Document Measure Definitions and Proc...
Establishing Performance Targets  Define Contexts and Time Horizons for Targets Select Scope of Measures for Targets Devel...
Establishing Performance Targets  (continued)   Considerations for Setting Performance Targets <ul><li>Realistic projectio...
Establishing Performance Targets  (continued) <ul><li>Step 1  –  Define Target Setting Context and Set Time Horizons </li>...
Establishing Performance Targets  (continued) <ul><li>Step 3 – Develop Long-Term Performance Goals based on Technical and ...
Establishing Performance Targets  (continued) <ul><li>Step 4 – Consider Current and Future Funding Availability </li></ul>...
Resource Allocation and Trade-off Scenarios Effects on Infrastructure Condition 0 20 40 60 80 100 0 1 2 3 4 5 6 7 8 9 10 T...
Establishing Performance Targets  (continued) <ul><li>Step 6 – Consider Policy and Public Input  </li></ul><ul><ul><li>Exc...
Establish Targets and Track Progress  Minnesota DOT Communication of Performance Targets Performance Level Current Perform...
Establish Targets and Track Progress  Florida DOT Communication of Performance Targets 1996-1997 1997-1998 1998-1999 1999-...
Upcoming SlideShare
Loading in...5
×

PowerPoint Presentation

648

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
648
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
25
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • By the end of the module, the participants will be able to perform the items listed on the slide.
  • PowerPoint Presentation

    1. 1. Performance Measures and Targets for Transportation Asset Management Project Summary presented to NCHRP Project 20-60 Panel presented by Cambridge Systematics, Inc. with PB Consult Inc. Texas Transportation Institute Transportation leadership you can trust.
    2. 2. Presentation Contents <ul><li>NCHRP Project 20-60 – Background and Objectives </li></ul><ul><li>Overview of Findings </li></ul><ul><li>Framework for Performance Measure Selection and Target Setting </li></ul>
    3. 3. NCHRP Project 20-60 Background and Objectives
    4. 4. Context <ul><li>“ Asset Management is a Strategic Approach…It is driven by policy goals and objectives and relies on systematic assessments of asset performance and cost in making decisions on future actions.” </li></ul><ul><li>– AASHTO Transportation Asset Management Guide, November 2002 </li></ul>
    5. 5. NCHRP Project 20-60 Objectives <ul><li>Develop guidance to help transportation agencies </li></ul><ul><ul><li>Identify measures best suited for asset management </li></ul></ul><ul><ul><ul><li>Preservation </li></ul></ul></ul><ul><ul><ul><li>Operations </li></ul></ul></ul><ul><ul><ul><li>Expansion </li></ul></ul></ul><ul><ul><li>Select specific measures for implementation </li></ul></ul><ul><ul><li>Establish performance targets </li></ul></ul><ul><li>Complement the AASHTO Transportation Asset Management Guide </li></ul>
    6. 6. NCHRP 20-60 Products <ul><li>Volume 1 – Formal Project Report </li></ul><ul><ul><li>Review of current practices </li></ul></ul><ul><ul><li>In-depth discussion of key issues in developing and using measures in an asset management context </li></ul></ul><ul><ul><li>Several examples from state DOTs </li></ul></ul><ul><li>Volume 2 – Stand-alone Implementation Guide </li></ul><ul><ul><li>Identify performance measures </li></ul></ul><ul><ul><li>Integrate measures into the organization </li></ul></ul><ul><ul><li>Establish performance targets </li></ul></ul>
    7. 7. Overview of Findings
    8. 8. Role of Performance Measures in Asset Management Policy Goals and Objectives Analysis of Options and Trade-offs Resource Allocation Decisions Financial Staff Equipment Other Program and Service Delivery System Condition and Service Levels Funding Levels Public Input Preservation Operations Capacity Expansion
    9. 9. Role of Performance Measures in Asset Management (continued) Policy Goals and Objectives Analysis of Options and Trade-offs Resource Allocation Decisions Financial Staff Equipment Other Program and Service Delivery System Condition and Service Levels Funding Levels Public Input Preservation Operations Capacity Expansion Translate policy objectives into guidance for decision-making
    10. 10. Role of Performance Measures in Asset Management (continued) Policy Goals and Objectives Analysis of Options and Trade-offs Resource Allocation Decisions Financial Staff Equipment Other Program and Service Delivery System Condition and Service Levels Funding Levels Public Input Preservation Operations Capacity Expansion Provide framework for evaluating options to define best mix of investments within and between programs
    11. 11. Role of Performance Measures in Asset Management (continued) Policy Goals and Objectives Analysis of Options and Trade-offs Resource Allocation Decisions Financial Staff Equipment Other Program and Service Delivery System Condition and Service Levels Funding Levels Public Input Preservation Operations Capacity Expansion Help to define expectations and outcomes for budget decisions
    12. 12. Role of Performance Measures in Asset Management (continued) Policy Goals and Objectives Analysis of Options and Trade-offs Resource Allocation Decisions Financial Staff Equipment Other Program and Service Delivery System Condition and Service Levels Funding Levels Public Input Preservation Operations Capacity Expansion Help track effectiveness of program and service project delivery
    13. 13. Role of Performance Measures in Asset Management (continued) Policy Goals and Objectives Analysis of Options and Trade-offs Resource Allocation Decisions Financial Staff Equipment Other Program and Service Delivery System Condition and Service Levels Funding Levels Public Input Preservation Operations Capacity Expansion Provide basis for monitoring system conditions
    14. 14. Selecting Suitable Performance Measures <ul><li>Essential requirements for a measure to support asset management </li></ul><ul><ul><li>Helps agency make better decisions about where to invest resources </li></ul></ul><ul><ul><li>Agency can take actions that change its value </li></ul></ul><ul><li>Additional criteria </li></ul><ul><ul><li>Linked to agency objectives </li></ul></ul><ul><ul><li>Easy to communicate </li></ul></ul><ul><ul><li>Feasible to collect </li></ul></ul><ul><ul><li>Feasible to predict </li></ul></ul>
    15. 15. Getting the Most out of Performance Measures for Asset Management <ul><li>Look at performance versus investment over the long-term </li></ul><ul><li>Integrate use of PMs within planning, budgeting, prioritization, operations, and annual reporting </li></ul><ul><li>Use to help make investment trade-offs across asset classes and types of work </li></ul><ul><li>Set targets that are achievable and monitor progress </li></ul><ul><li>Use a mix of output- and outcome-oriented measures </li></ul><ul><li>Design effective data gathering, reporting, and communication devices </li></ul>
    16. 16. Examples of Best Practices <ul><li>Use measures as basis for establishing program allocation levels – pavement, bridge, and capacity (MT) </li></ul><ul><li>Provide targets and associated funding levels to districts to aide in project selection (NY) </li></ul><ul><li>Districts show implications of +/- 10% in funding as part of allocation process (OH) </li></ul><ul><li>Quarterly reviews of performance by DOT management (CO and FL) </li></ul><ul><li>Current performance data on Internet (VA and WS) </li></ul>
    17. 17. Recommended Framework
    18. 18. Guidance for Performance Measures and Targets Tailor Measures to Decisions Design Consistent Measures Across Program Areas Identify Improvements to Data and Tools Design Communication Devices Engage Stakeholders Document Definitions and Procedures Identify Performance Measures Inventory Existing Measures Consider Policy and Public Input Assess and Select Measures for Further Design and Implementation Integrate Performance Measures into the Organization Establish Performance Targets Define Contexts and Time Horizons Select Scope of Measures for Targets Develop Long-Term Goals Consider Funding Availability Analyze Resource Allocation Scenarios and Trade-offs Establish Targets and Track Progress Assess Gaps Define Selection Criteria Identify Candidate Measures/Adjustments to Existing Measures
    19. 19. Identifying Performance Measures Inventory Existing Measures Define Criteria for Selecting New Measures Identify Candidate Measures/ Adjustments to Existing Measures Assess and Select Measures for Further Design and Implementation Gap Analysis
    20. 20. Identifying Performance Measures (continued) <ul><li>Step 1 – Inventory Existing Measures </li></ul><ul><ul><li>How are they working? </li></ul></ul><ul><ul><li>How are they being used? </li></ul></ul><ul><li>Step 2 – Gap Analysis </li></ul><ul><ul><li>What are the most important outcomes to be achieved? Do your existing performance measures adequately cover these outcome areas? </li></ul></ul>
    21. 21. Identifying Performance Measures (continued) <ul><li>Step 3 – Define Criteria for Selecting New Measures </li></ul><ul><ul><li>Selection criteria should reflect the intended purpose, use, and audience for the performance measure </li></ul></ul><ul><ul><li>Suggested selection criteria include </li></ul></ul><ul><ul><ul><li>Feasible </li></ul></ul></ul><ul><ul><ul><li>Policy sensitive </li></ul></ul></ul><ul><ul><ul><li>Supports long-term, strategic view </li></ul></ul></ul><ul><ul><ul><li>Useful for decision support </li></ul></ul></ul>
    22. 22. Identifying Performance Measures (continued) <ul><li>Step 4 – Identify Candidate Measures </li></ul><ul><ul><li>Develop a set of performance measures that could be helpful for making better resource allocation decisions </li></ul></ul><ul><ul><li>Organize measures that you select according to their intended use(s) and audience(s) </li></ul></ul><ul><li>Step 5 – Assess and Select Measures </li></ul><ul><ul><li>Evaluate candidate measures by applying criteria developed in Step 3 </li></ul></ul><ul><ul><li>Select performance measures to implement </li></ul></ul><ul><ul><li>Clearly document the definitions of each selected measure </li></ul></ul>
    23. 23. Integrating Performance Measures into an Organization Engage Stakeholders Tailor Measures to Decisions Design Consistent Measures Across Program Areas Identify Improvements to Data and Tools Design Communication Devices
    24. 24. Integrating Performance Measures into an Organization (continued) <ul><li>Step 1 – Engage Stakeholders to Ensure Buy-in </li></ul><ul><ul><li>Give stakeholders the opportunity to participate in the performance measure development process </li></ul></ul><ul><ul><li>Involve both users of PMs and producers of PMs </li></ul></ul><ul><li>Step 2 – Tailor Performance Measures to Decisions </li></ul><ul><ul><li>Project-, corridor-, network-level </li></ul></ul><ul><ul><li>Short-, medium-, long-term </li></ul></ul><ul><ul><li>Executive, middle management, technical </li></ul></ul>
    25. 25. Integrating Performance Measures into an Organization (continued) <ul><li>Step 3 – Design Consistent Measures Across Program Areas </li></ul><ul><ul><li>Percent good, fair, poor </li></ul></ul><ul><ul><li>Percent desirable, minimum tolerable, high-risk </li></ul></ul><ul><li>Step 4 – Identify Needs for Improved Data and Analytical Tools </li></ul><ul><ul><li>Action items to implement selected measures </li></ul></ul><ul><ul><li>Ensure availability of sufficient budget and staff resources </li></ul></ul>
    26. 26. Integrating Performance Measures into an Organization (continued) <ul><li>Step 5 – Design Communication Devices </li></ul><ul><ul><li>Match reports to needs of intended users </li></ul></ul><ul><ul><li>Design report formats to make the measures easily understandable </li></ul></ul>
    27. 27. Communication Devices Virginia DOT Dashboard
    28. 28. Communication Devices Virginia DOT Dashboard (continued)
    29. 29. Integrating Performance Measures into an Organization (continued) <ul><li>Step 6 – Document Measure Definitions and Procedures </li></ul><ul><ul><li>Common understanding of definitions, calculation methods </li></ul></ul><ul><ul><li>Quality Assurance process </li></ul></ul><ul><ul><li>Basis for auditing </li></ul></ul><ul><ul><li>Update as measures evolve </li></ul></ul><ul><ul><li>Archive documentation with historical data </li></ul></ul>
    30. 30. Establishing Performance Targets Define Contexts and Time Horizons for Targets Select Scope of Measures for Targets Develop Long-Term Goals Consider Funding Availability Analyze Resource Allocation Scenarios and Trade-offs Consider Policy and Public Input Establish Targets and Track Progress
    31. 31. Establishing Performance Targets (continued) Considerations for Setting Performance Targets <ul><li>Realistic projection of available funding </li></ul><ul><li>Policies and priorities </li></ul><ul><li>Current and forecast conditions </li></ul><ul><li>Economic efficiency considerations </li></ul>
    32. 32. Establishing Performance Targets (continued) <ul><li>Step 1 – Define Target Setting Context and Set Time Horizons </li></ul><ul><ul><li>When and how will targets be used? </li></ul></ul><ul><ul><li>Watch out for inconsistent targets across measures </li></ul></ul><ul><li>Step 2 – Select the Scope of Measures for Performance Targets – consider </li></ul><ul><ul><li>Baseline data availability </li></ul></ul><ul><ul><li>Analytical capabilities to predict future values under different assumptions </li></ul></ul>
    33. 33. Establishing Performance Targets (continued) <ul><li>Step 3 – Develop Long-Term Performance Goals based on Technical and Economic Factors </li></ul><ul><ul><li>Alignment with national or other goals (e.g., U.S. DOT safety goals) </li></ul></ul><ul><ul><li>Benchmarks from other agencies </li></ul></ul><ul><ul><li>Optimization models – performance levels with least long-term user and agency costs </li></ul></ul><ul><ul><li>“Steady-state” condition levels </li></ul></ul><ul><ul><li>Law of diminishing marginal returns </li></ul></ul><ul><ul><li>User cost curves from past research – levels of performance where user costs rise steeply </li></ul></ul><ul><ul><li>Customer surveys or feedback </li></ul></ul>
    34. 34. Establishing Performance Targets (continued) <ul><li>Step 4 – Consider Current and Future Funding Availability </li></ul><ul><ul><li>Place performance targets in the context of future funding availability </li></ul></ul><ul><ul><li>Estimate future funding from past trends and available information about future funding levels </li></ul></ul><ul><li>Step 5 – Analyze Resource Allocation Scenarios and Trade-offs </li></ul><ul><ul><li>Analyze performance-cost relationships to use as guides for target-setting based on funding and resource allocation scenarios </li></ul></ul><ul><ul><li>Estimate cost to achieve long-term goals – for use in the budget process </li></ul></ul>
    35. 35. Resource Allocation and Trade-off Scenarios Effects on Infrastructure Condition 0 20 40 60 80 100 0 1 2 3 4 5 6 7 8 9 10 Time (Years) Pavement in Good Condition (in Percent) $25M per year $5M per year Do Nothing
    36. 36. Establishing Performance Targets (continued) <ul><li>Step 6 – Consider Policy and Public Input </li></ul><ul><ul><li>Exchange information and ideas with external stakeholder to establish desired performance levels and priorities </li></ul></ul><ul><li>Step 7 – Establish Targets and Track Progress </li></ul><ul><ul><li>Select actual target values, report these targets, and track progress towards achievement of the targets </li></ul></ul><ul><ul><li>Periodically adjust targets based on progress made, changes in policy or priorities, or emergence of information or factors not previously considered </li></ul></ul>
    37. 37. Establish Targets and Track Progress Minnesota DOT Communication of Performance Targets Performance Level Current Performance Level 1997 2001 6-Year Target Baseline Performance 20-Year Performance Level Future Performance Gap 10-Year Target 20-Year Target Trend-Based Performance Projections Current Performance Level Policy-Based Performance Target
    38. 38. Establish Targets and Track Progress Florida DOT Communication of Performance Targets 1996-1997 1997-1998 1998-1999 1999-2000 2000-2001 2001-2002 2002-2003 2003-2004 2004-2005 2005-2006 Actual Planned Fiscal Year 100 90 80 70 60 50 40 30 20 10 0 Objective 80% Percent
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×