CPEC Assessment Pilot JIT Training


Published on

The LDC-created just-in-time training for team members before a CAP site visit.

Published in: Education, Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • CPEC Assessment Pilot JIT Training

    1. 1. CPEC Assessment Team Sector Jacksonville Site Visit Just-in-Time Training June 2008 Performance Excellence: Always Ready and Striving to do Better
    2. 2. JIT Site Visit Training Overview <ul><ul><li>Outcomes </li></ul></ul><ul><ul><li>Pilot Process </li></ul></ul><ul><ul><li>Roles and Responsibilities </li></ul></ul><ul><ul><li>Site Agenda </li></ul></ul><ul><ul><li>Just-in-Time Training </li></ul></ul><ul><ul><li>Site Visit Guidelines </li></ul></ul>
    3. 3. Outcomes <ul><li>Encourage management excellence for successful mission execution by providing a framework to assess current performance, reveal opportunities for improvement, identify role model practices, and provide actionable feedback from trained, impartial examiners. </li></ul><ul><li>Educate Coast Guard leaders and managers about the meaning, framework, and practical utility of the Criteria (CPEC); </li></ul>
    4. 4. Outcomes <ul><li>Identify and Publicize organizational achievements and successes, sharing role model practices for Coast Guard wide use and learning; and </li></ul><ul><li>Recognize CPEC Award recipients as Coast Guard organizational role models that demonstrate excellent, sustained performance results while being good stewards of the public trust. </li></ul>
    5. 5. Unit Individual Small Cat Teams Plenary Team Team Leads Team Coach Program Manager Submit Org Profile Submit “What” answers Review submitted info Review all inputs Fill out the Scorebook Draft Key Factors Create/validate interview questions and develop strategies Determine approach for fact finding Engage unit Consensus on top strengths, OFIs, scores Write Executive Summary Review Scorebook and Exec Summary (final report) Present to Awards Board Create PowerPoint outbrief Present outbrief to unit Develop Key Factors Develop schedules Approve schedules Develop proposed strengths/OFIs (5-8/item) Finalize Scorebook Review final report Send final report to unit, Team Leader, and OPCs Brief CO/XO on intermediate findings <ul><li>Provide just in time training on process, documents, scoring, etc. </li></ul><ul><li>Provide guidance and help with criteria and technical aspects of the process </li></ul><ul><li>Ensure consistency of product among evaluation teams </li></ul><ul><li>Assist team with logistics </li></ul><ul><li>Provide initial contact with unit. </li></ul><ul><li>Provide over-sight and support as needed. </li></ul><ul><li>Provide continuity of program’s products </li></ul><ul><li>Ensure final results are consistent with intent of the program </li></ul>CPEC Pilot Process Map
    6. 6. <ul><li>Team Leader and Assistant Team Leader </li></ul><ul><li>Team Members </li></ul><ul><li>Coach </li></ul><ul><li>Program Representative </li></ul>Roles and Responsibilities
    7. 7. <ul><ul><li>Coordinate: </li></ul></ul><ul><ul><ul><li>Examination Team activities </li></ul></ul></ul><ul><ul><ul><li>Virtual Meetings </li></ul></ul></ul><ul><ul><ul><li>Site visit logistics with the assistance of Program Manager </li></ul></ul></ul><ul><ul><ul><li>Roles and responsibilities of Examination Team </li></ul></ul></ul>Team Leader and Assistant Team Leader
    8. 8. <ul><ul><li>Ensure: </li></ul></ul><ul><ul><ul><li>Examination process is followed </li></ul></ul></ul><ul><ul><ul><li>Deadlines are met </li></ul></ul></ul><ul><ul><ul><li>Deliverables are produced and submitted to the unit and Program Manager (CG-0931) </li></ul></ul></ul><ul><ul><ul><li>Unit understands the process </li></ul></ul></ul><ul><ul><ul><li>Examination Team conducts themselves professionally </li></ul></ul></ul>Team Leader and Assistant Team Leader
    9. 9. <ul><ul><li>Attend Examiner Training </li></ul></ul><ul><ul><li>Serve as a Category Lead and/or back-up </li></ul></ul><ul><ul><li>Attend virtual meetings and site visit </li></ul></ul><ul><ul><li>Review unit documents prior to site visit </li></ul></ul><ul><ul><li>Prepare interview and examination strategy </li></ul></ul><ul><ul><li>Complete Site Visit Strategy Worksheet and Draft scorebook </li></ul></ul>Team Members
    10. 10. <ul><ul><li>Provide: </li></ul></ul><ul><ul><li>Just-in-Time Training to Examination Team </li></ul></ul><ul><ul><li>Advice and counsel for team leaders </li></ul></ul><ul><ul><li>Coaching on comment writing and interviewing to Examination team members </li></ul></ul><ul><ul><li>Review of final comments and scores </li></ul></ul><ul><ul><li>Assistance with logistics during site visit </li></ul></ul>Coach
    11. 11. <ul><ul><li>Ensure: </li></ul></ul><ul><ul><li>Overall examination process is followed </li></ul></ul><ul><ul><li>CPEC is properly applied to the unit being examined </li></ul></ul><ul><ul><li>Serve in an unobtrusive (stealth) way </li></ul></ul>Coach
    12. 12. <ul><ul><li>Provide: </li></ul></ul><ul><ul><li>Liaison with unit’s leadership team </li></ul></ul><ul><ul><li>Logistics coordination for site visit </li></ul></ul><ul><ul><li>Funding for site visit travel and meeting rooms </li></ul></ul><ul><ul><li>Sounding board to unit’s leadership </li></ul></ul><ul><ul><li>Evaluation of the process </li></ul></ul><ul><ul><li>Ensure the Site Visit is carried out in a way that is beneficial to the organization, examiners and the program </li></ul></ul>Program Representative
    13. 13. Generic Site Visit Agenda Finalize Scorebook Outbrief Friday Finalize Scorebook Scoring Thursday Interviews Deployment Check Consensus Meeting Wednesday Interviews Deployment Check Tuesday Senior Leadership Assessment Team Time & Interviews Monday
    14. 14. Daily Meetings <ul><li>Purpose: </li></ul><ul><li>Review major findings for each category </li></ul><ul><li>Discuss items to be addressed the next day </li></ul><ul><li>Gauge progress and provide assistance as needed </li></ul><ul><li>For CAP JAX will be held daily at 1900 at the Residence Inn. </li></ul>
    15. 15. Daily Deliverables Executive Summary Power Point Out Brief Completed Scorebook Friday Finalized Scorebooks including scores Thursday Consensus on Top Strengths and OFIs Wednesday Updated Site Visit Worksheet/Scorebook Tuesday Finalized Team Game Plan Monday Finalized Game Plan Sunday
    16. 16. Just-In-Time Training <ul><li>Site Visit Worksheet </li></ul><ul><li>ADLI </li></ul><ul><li>Results </li></ul><ul><li>Code of Conduct </li></ul><ul><li>*Scoring </li></ul><ul><li>*Final Scorebook </li></ul><ul><li>*To be completed at team meeting Wednesday </li></ul>
    17. 17. ADLI Approach – Deployment – Learning -Integration Four factors used to evaluate process items. Process items are Categories 1 – 6
    18. 18. ADLI <ul><li>Approach </li></ul><ul><li>The methods used to accomplish the process </li></ul><ul><li>The appropriateness of the methods to the item requirements </li></ul><ul><li>The effectiveness of the use of the methods </li></ul><ul><li>The degree to which the approach is repeatable and based on reliable data and information </li></ul>
    19. 19. ADLI <ul><li>Deployment </li></ul><ul><li>The approach is applied in addressing Item requirements relevant and important to the unit </li></ul><ul><li>The approach is applied consistently </li></ul><ul><li>The approach is used by all appropriate work units </li></ul>
    20. 20. ADLI <ul><li>Learning </li></ul><ul><li>Refining the approach through cycles of evaluation and improvement </li></ul><ul><li>Encouraging breakthrough change to the approach through innovation </li></ul><ul><li>Sharing refinements and innovations with other relevant work units and processes in the unit </li></ul>
    21. 21. ADLI <ul><li>Integration </li></ul><ul><li>The approach is aligned with the units needs identified in the Organizational Profile and other process items </li></ul><ul><li>The measures, information, and improvement systems are complementary across processes and work units </li></ul><ul><li>The plans, processes, results, analyses, learning, and actions are harmonized across processes and work units to support unit-wide goals </li></ul>
    22. 22. Site Visit Worksheets (SVW) SVW are the initial version of the Scorebook. Two versions will be required for each Category. One will include notes, interviewees, strategies, and findings. The second will be the finalized version with only the top 5-8 strengths and OFIs for each item.
    23. 23. How to Complete SVWs <ul><li>At the end of each day… </li></ul><ul><li>Review notes from interviews, observations, and/or documents </li></ul><ul><li>Discuss MAJOR Findings & Conclusions w/the team during the evening meeting </li></ul><ul><li>Summarize & document your Findings on the SVW, identify Strengths and OFIs </li></ul><ul><li>If an SVW contains relevant Criteria areas to address that are still open and a strength or opportunity cannot be concluded, ensure that you make the team leaders aware in order to schedule appropriate interviews the next day </li></ul>
    24. 24. How to Complete SVWs <ul><li>Findings: </li></ul><ul><li>Based on your strategy, what did you learn? </li></ul><ul><li>Capture specific information (e.g., documents reviewed, interviews conducted, specific responses to questions, actual data observed) </li></ul><ul><li>SUMMARIZE findings with enough detail that an outsider could benefit from reading </li></ul><ul><ul><li>Include specific Examples from interviews, observations, documents </li></ul></ul><ul><li>Share with other category leads related findings </li></ul>ENSURE THAT FINDINGS ARE CRITERIA- & KEY FACTOR-RELEVANT. THIS WILL HELP YOU BOTH TO DETERMINE AND DEMONSTRATE WHICH AREAS ARE STRENGTHS and WHICH ARE OPPORTUNITIES
    25. 25. Results Understanding charts, data, and comparisons
    26. 26. Understanding the Charts Ask the person to explain the chart to you; show the chart in question. Be sure you understand the reply; if you’re unsure, ask for clarification.
    27. 27. Understanding the Data <ul><ul><ul><li>Ask about where the results data come from and how they are calculated. Don’t make assumptions. </li></ul></ul></ul>
    28. 28. Understanding Comparisons <ul><ul><ul><li>Ask about where the comparative data come from and the calculation. Don’t make assumptions. </li></ul></ul></ul>
    29. 29. LeTCI Levels – Trends – Comparisons – Integration The four factors used to evaluate results (Category 7)
    30. 30. LeTCI <ul><li>Levels </li></ul><ul><li>Current level of performance </li></ul><ul><li>Trends </li></ul><ul><li>Rate of performance improvements or the sustainability of good performance </li></ul><ul><li>Breadth of performance results </li></ul>
    31. 31. LeTCI <ul><li>Comparisons </li></ul><ul><li>Performance relative to appropriate comparisons, such as competitors or similar units </li></ul><ul><li>Performance relative to benchmarks or industry leaders </li></ul>
    32. 32. LeTCI <ul><li>Integration </li></ul><ul><li>Results measures address important customers, product and service, market, process, and action performance requirements identified in the Org Profile and in Process Items </li></ul><ul><li>Results include valid indicators of future performance </li></ul><ul><li>Results are harmonized across processes and work units to support unit-wide goals </li></ul>
    33. 33. Final Scorebook <ul><li>Wednesday Afternoon </li></ul><ul><li>Finalize all input into your SVWs. </li></ul><ul><li>As a small team, finalize 5-8 strengths and OFIs for each item in your scorebook. </li></ul><ul><li>Be prepared to share these comments with the team on Wednesday afternoon. </li></ul>
    34. 34. <ul><li>Wednesday/Thursday </li></ul><ul><li>Category discussion – Category Lead will lead discussion reviewing each item </li></ul><ul><li>Recommend Item Scoring </li></ul><ul><li>Revise/Finalize Scorebook Item Worksheets and </li></ul><ul><li>Team Leader facilitates session to develop Key Themes for Executive Summary and Executive Out Brief </li></ul><ul><li>Finalize Executive Out Brief </li></ul>Final Scorebook Process Steps
    35. 35. <ul><li>Purpose / Background </li></ul><ul><li>How to fill out </li></ul>Role Model Practice Worksheets
    36. 36. <ul><li>Purpose / Background </li></ul><ul><li>Discussion </li></ul>Site Visit Guidelines Wrap-up / Review <ul><li>Questions and Answers </li></ul>
    37. 37. “ Chartmanship” Do your best to understand the information. Do not comment of charting techniques or try to create your own trends or charts from the data provided.
    38. 38. Questions or Concerns <ul><li>Team Leader: George Yacus </li></ul><ul><li>Assistant Team Lead: Peter Stinson </li></ul><ul><li>Process Coach: Charlie Coiro </li></ul><ul><li>Program Representative: David King </li></ul>