UEDA MEP Presentation Nov 2008. Final

1,065 views

Published on

UEDA 2008 Presentation

Published in: Business, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,065
On SlideShare
0
From Embeds
0
Number of Embeds
6
Actions
Shares
0
Downloads
14
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • UEDA MEP Presentation Nov 2008. Final

    1. 1. Manufacturing Extension Partnership: Demonstrating Innovative Strategies in Performance Metrics Carroll Thomas, Partnership Catalyst Kenneth P. Voytek, Chief Economist
    2. 2. Presentation Purpose & Objectives <ul><li>About The Manufacturing Extension Partnership (MEP) </li></ul><ul><ul><li>underlying rationale for the program </li></ul></ul><ul><li>How MEP Evaluates Partnership Opportunities </li></ul><ul><li>Examine how MEP assesses and evaluates client, center, and program performance </li></ul>
    3. 3. <ul><li>“ It’s déjà vu all over again!” </li></ul><ul><li>~ Yogi Berra </li></ul>
    4. 4. <ul><li>Mission Statement </li></ul><ul><li>“ To strengthen the global competitiveness of US-based manufacturing by providing information, decision support, and implementation of innovative approaches focused on leveraging technologies, techniques, and business best practices.” </li></ul>The National Institute of Standard and Technology (NIST) is an agency of the U.S. Commerce Department
    5. 5. What/Where is MEP 59 “Centers” 1600 Field Staff 440 Service Locations
    6. 6. The MEP Program in Short…. <ul><li>The centers, serving all 50 States and Puerto Rico, are linked together through the Department of Commerce's National Institute of Standards and Technology . </li></ul><ul><ul><li>59 assistance centers with 442 field locations </li></ul></ul><ul><ul><ul><li>System wide, Non-Federal staff is ~1,600 </li></ul></ul></ul><ul><ul><ul><li>Contracting with over 3,000 third party service providers </li></ul></ul></ul><ul><ul><li>Partnership Model – Federal/State/Industry </li></ul></ul><ul><ul><li>MEP System budget ~ $300M </li></ul></ul><ul><ul><ul><li>1/3 Federal, ~1/3 State and >1/3 Industry (fees for services) </li></ul></ul></ul><ul><ul><li>Emphasis on performance – program and center – measured based upon impact of center services on client firms. </li></ul></ul>
    7. 7. What MEP Does <ul><li>Focus on meeting manufacturer’s short term needs, but in context of overall company strategy </li></ul><ul><li>Working directly with over 27,000 manufacturing companies a year* </li></ul><ul><li>UNDERLYING IT ALL – Establish and expand partnerships with other like-minded, mission oriented organizations at Federal, state and local level </li></ul><ul><ul><ul><ul><ul><li>*Based on FY2007 MEP Center reported performance data. </li></ul></ul></ul></ul></ul>
    8. 8. Client Impacts Resulting from MEP Services <ul><li>New Sales $3.11 Billion </li></ul><ul><li>Retained Sales $3.65 Billion </li></ul><ul><li>Capital Investment $1.65 Billion </li></ul><ul><li>Cost Savings $1.115 Billion </li></ul><ul><li>Jobs Created and Retained 52,585 </li></ul>FY 2006 economic impact results are based on a survey of 4,959 MEP-served establishments out of 5,384 attempted.
    9. 9. = Partnership <ul><li>The Green Suppliers Network , an innovative collaboration between government and industry, </li></ul><ul><li>Focus : Address the dual challenge of reducing the environmental impact of small and mid-sized manufacturing suppliers while simultaneously increasing those companies’ efficiency, productivity and profitability. </li></ul><ul><li>Approach : Lean & Clean on-site reviews </li></ul><ul><li>Value Add : Expands lean definition of waste to include environmental considerations </li></ul><ul><li>Deliverable : Measurable business and environmental impacts </li></ul>
    10. 10. What to Look for in Potential Partners Center Impact / Revenue / Reach <ul><li>Alignment of missions </li></ul><ul><li>Overlap in customer base or target markets </li></ul><ul><li>Brand prominence, credibility and fit </li></ul><ul><li>Complementary products & services </li></ul><ul><li>Visibility with stakeholders </li></ul><ul><li>Financial resources for clients or the center </li></ul><ul><li>Opportunities to share or leverage resources </li></ul>Stakeholder Influence, Visibility Complementary Products & Services Referrals (Access to Clients) & Joint Marketing Basic Partnership Model Financial Resources (for Centers, Clients) Other Benefits Buried Treasure/Other Benefits Types of Partnership Benefits Partnership Benefits What to Look for in a Potential Partner (to obtain these benefits)
    11. 11. How to Evaluate “ROI” of Potential Partnerships Partnership Benefits Identified in this Study Referrals/Cross-Marketing Complementary Products/Services Stakeholder Visibility Financial Other Benefits
    12. 12. Evaluation and Performance Measurement <ul><li>Performance Measurement: The ongoing monitoring and reporting of program progress and accomplishments using pre-selected performance measures. </li></ul><ul><li>Program evaluation: systematic study using measurement and analysis to answer specific questions about how well a program is working to achieve its outcomes and why. </li></ul>
    13. 13. The Changing Face of Manufacturing: Getting Smaller; Need to Get Smarter <ul><ul><li>Facts about small manufacturers: </li></ul></ul><ul><ul><ul><li>Represent 99 percent of all manufacturing establishments </li></ul></ul></ul><ul><ul><ul><li>Employ 10.2 million people -- 70 percent of all manufacturing employment, and </li></ul></ul></ul><ul><ul><ul><li>Account for about 57 percent of the total value-added by all U.S. manufacturers </li></ul></ul></ul><ul><ul><li>The Challenges for Small Manufacturers: </li></ul></ul><ul><ul><ul><li>In 2002, productivity per employee in large establishments was 69 percent higher than productivity in small establishments. In 1967, productivity per employee was “only” 26 percent higher. </li></ul></ul></ul><ul><ul><ul><li>Over the last 10 years, productivity among large firms grew 7 percentage points faster than small firms. </li></ul></ul></ul><ul><ul><ul><li>Market Failures in several dimensions: firm, inter-firm, consulting/services, public failure. </li></ul></ul></ul>
    14. 14. Evaluations should assess the extent to which the NIST MEP strategy is achieving its goals <ul><ul><li>The principal goal is to help manufacturers increase the competitiveness and productivity of U.S. manufacturing and NIST MEP has a two-pronged strategy: </li></ul></ul><ul><ul><ul><li>Help manufacturers in the United States improve performance – i.e., make products the right way </li></ul></ul></ul><ul><ul><ul><li>Help manufacturers in the United States grow their business – i.e., make the right products for the right customers profitably </li></ul></ul></ul>
    15. 15. Performance should be assessed on multiple dimensions <ul><li>Coverage . The extent to which companies in the target population have received services. </li></ul><ul><li>Outputs : The volume of services undertaken by affiliated centers as reflected in key outputs. </li></ul><ul><li>Operating efficiency . The extent to which processes are efficient, yielding the highest level of output for a given level of input, or alternatively, using the fewest resources to achieve a given level of output. </li></ul><ul><li>Financial sustainability . The extent to which affiliated centers have sufficient resources to cover their operating costs and needed investments. </li></ul><ul><li>Effectiveness . The extent to which the objectives have been achieved in terms of improved performance of the target population and associated economic outcomes. </li></ul><ul><li>Leadership, strategy and operations . The organizational performance of affiliated centers. </li></ul>
    16. 16. Effectiveness should focus on the impact of centers on the change in value-added and sales within manufacturing firms. <ul><li>The crucial issue in assessing impacts is comparing the observed situation with the counterfactual </li></ul>
    17. 17. The Center Balancing Act The Program Balancing Act Revenue Market Penetration Client Impact Market Penetration Financial Stability Market Penetration Economic Impact
    18. 18. MEP Measures Success & Performance At Different Levels Client Impacts and Performance Improvements Center Performance & Impacts System Performance & Impacts
    19. 19. Manufacturing Extension Partnership (MEP) Program: Impact Path <ul><li>Inputs </li></ul><ul><li>Funding </li></ul><ul><li>Federal Funding </li></ul><ul><li>State/local funding </li></ul><ul><li>Client fees </li></ul><ul><li>Staff </li></ul><ul><li>Trained MEP Center staff </li></ul><ul><li>National MEP program staff provide program oversight, training, technical business assistance </li></ul><ul><li>Activities </li></ul><ul><li>MEP Centers provide: </li></ul><ul><li>Information </li></ul><ul><li>Decision Support </li></ul><ul><li>Implementation assistance </li></ul><ul><li>Center’s services help manufacturing clients adopt new and more advanced manufacturing technologies, techniques, and business practices </li></ul><ul><li>Firm-level Business Impacts </li></ul><ul><li>Cost savings </li></ul><ul><li>Capital investment </li></ul><ul><li>Jobs created </li></ul><ul><li>Sales (new and retained) </li></ul><ul><li>Profit Margin </li></ul><ul><li>Improvements in: </li></ul><ul><ul><li>Manufacturing systems </li></ul></ul><ul><ul><li>Human resources system </li></ul></ul><ul><ul><li>IT systems </li></ul></ul><ul><ul><li>Marketing and sales systems </li></ul></ul><ul><ul><li>Management systems </li></ul></ul><ul><li>Outcomes </li></ul><ul><li>Productivity growth of small manufacturing firms </li></ul><ul><li>Increased global competitiveness of US-based manufacturers </li></ul><ul><li>Improved supply chain efficiency </li></ul><ul><li>Improved job opportunities for US workers </li></ul><ul><li>Higher rates of business survival </li></ul>Output Tracking MEP tracks the number of clients each year over 20,000) and the total number of activities performed by MEP Centers (over 30,000/year) Measuring Client Impacts Through an annual client survey, MEP tracks the impacts of Center assistance on several major firm-level indicators (sales, cost savings, jobs). As a set, these indicators suggest the presence of business changes that are positively associated with productivity growth Program Evaluation Need more access or creative ways to conduct such studies Center Review Annual operating plan, External reviews, Center impacts metrics, and quarterly reporting Measuring Along the Way Measuring Along the Way
    20. 20. MEP Performance Continues to Increase While Federal Funding Remains Relatively Flat Project-based survey Client-based survey Center Metrics in Place *FY 2007 data represented only ¾ of impacts
    21. 21. CLIENTS TOUCHED AND SURVEYED OVER TIME Note: Data on clients served did not become a GPRA target until FY 2001. In addition, FY 2000 and FY 2007 data on clients surveyed represent partial years. Surveys are done with a lag. Client Interaction Metric in effect
    22. 22. MEP’s Data Reporting & Center Performance System <ul><li>Operating Plan : Annual plan (linked to the center’s strategic plan) that outlines the anticipated activities and results for the coming year. </li></ul><ul><li>Quarterly Data Reporting : Center reports progress and client project data quarterly. </li></ul><ul><li>Annual Review : Each year prior to annual renewal of federal funding, the performance of the center is reviewed comprehensively by NIST-MEP or an external panel. </li></ul><ul><li>External Panel Review : Every two years the center is reviewed by an external panel that assesses the center performance and alignment with their operational and strategic plans. </li></ul><ul><li>Third Party Client Survey : NIST sponsors a national survey conducted by an independent third party that quarterly collects data from center clients on the business impacts of the services provided by their local center. NIST-MEP uses this performance data as a core component in reviewing center performance. The results also provide the centers with a tool to measure their effectiveness and benchmark their performance against other centers. </li></ul>
    23. 23. Center Performance Metrics Percent quantified impacts (10 points) Clients Served per Million Federal dollar (15 points) Investment Leverage Ratio (25 points) Bottom-line client impact ratio (25 points) Impacted clients per Million Federal $ (25 points) Center Performance Metrics
    24. 24. LOW IMPACT, LOW PENETRATION HIGH IMPACT, LOW PENETRATION HIGH IMPACT, HIGH PENETRATION LOW IMPACT, HIGH PENETRATION The Variation in Center Performance, Q2 2008
    25. 25. Median Center Performance Over Time
    26. 26. Components of MEP’s Performance & Evaluation System: The Portfolio <ul><ul><li>Firm Level Studies: </li></ul></ul><ul><ul><ul><li>Impact Data from Third Party Client Impact Survey : new sales, cost-savings, investments attributed to MEP services [GPRA metrics] used in part to develop center performance metrics. </li></ul></ul></ul><ul><ul><ul><li>Longitudinal Studies : focuses on comparing the competitive performance of MEP clients relative to similar firms that did not receive MEP services. </li></ul></ul></ul><ul><ul><ul><li>Case Studies : focus on successful MEP projects to gain insight into variables at both the firm and industry-level that impact technology adoption and business transformation. </li></ul></ul></ul><ul><ul><li>Impact Studies: regional economic impact analysis of MEP centers </li></ul></ul>
    27. 27. Attributes of Current System <ul><li>Mix of performance measurement and evaluation approaches </li></ul><ul><li>Triangulation of results through different methods and approaches </li></ul><ul><li>Focus on intermediate outcomes and ultimate program goals </li></ul><ul><li>Multi-level & Multi-dimensional (firm, center, and system) </li></ul>
    28. 28. MEP Measurement System is a Competitive Advantage <ul><li>Communicate to federal, state, local stakeholders </li></ul><ul><ul><li>Replicable, believable data </li></ul></ul><ul><ul><li>Voice of Customer results </li></ul></ul><ul><ul><li>Measurement process investment better than any economic development program </li></ul></ul><ul><li>Operational Improvement </li></ul><ul><ul><li>Benchmarking against other centers </li></ul></ul><ul><ul><li>Measurable impact focus drives service delivery choices </li></ul></ul>
    29. 29. Thanks! Contact the MEP <ul><li>Just call our toll-free number 1-800-MEP 4 MFG (1-800-637-4634), and your call will be automatically routed to the MEP center that serves your region. </li></ul><ul><li>www.mep.nist.gov </li></ul><ul><li>Program Questions:   mailto:mfg@nist.gov </li></ul><ul><li>NIST MEP 100 Bureau Drive, Stop 4800 Gaithersburg, MD 20899-3460 (301) 975-5020 </li></ul>

    ×