Training Presentation

551 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
551
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
9
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Training Presentation

  1. 1. SUBPART O TESTING PUBLIC WORKSHOP David Dykes Joe Levine February 19, 2009 New Orleans
  2. 2. WORKSHOP AGENDA <ul><li>Subpart O Testing Regulations </li></ul><ul><li>Subpart O Testing History </li></ul><ul><li>Subpart O Pilot Testing Process </li></ul><ul><li>Subpart O Pilot Test Results </li></ul><ul><li>Testing Beyond Pilot </li></ul><ul><li>Discussion, Q & A </li></ul>
  3. 3. WORKSHOP GOAL <ul><li>To explain </li></ul><ul><ul><li>What Subpart O testing is all about </li></ul></ul><ul><ul><li>Eliminate unwarranted concerns </li></ul></ul><ul><ul><li>How MMS & industry can use testing to help raise the level of OCS safety </li></ul></ul>
  4. 4. Can Testing Benefit Your Company? <ul><li>An extra set of “eyes” evaluating your personnel </li></ul><ul><li>Additional assessment of employees between regularly scheduled training </li></ul><ul><li>If an area of concern is uncovered by testing you have the opportunity to address it </li></ul>
  5. 5. What Subpart O Testing Is Not <ul><li>A quantitative measure of an employees’ </li></ul><ul><ul><li>Competency or knowledge of job </li></ul></ul><ul><ul><li>Ability to perform their job </li></ul></ul><ul><ul><li>Passing a test does not mean an employee knows their job </li></ul></ul><ul><ul><li>Failing a test does not mean an employee can not do their job </li></ul></ul>
  6. 6. What Subpart O Testing Is <ul><li>Another data point for MMS & industry to use to assess the effectiveness of a company‘s Subpart O training program and overall safety management system (SEMS, SEMP….) </li></ul><ul><li>An opportunity to gain additional feedback on how well “you” are getting critical job related information across to your most important asset; your people </li></ul>
  7. 7. Subpart O Overriding Principles <ul><li>Testing, as with other aspects of Subpart O is aimed primarily at the lessee </li></ul><ul><li>Testing will impact not only lessees, but contractors as well </li></ul><ul><li>It is the lessees responsibility to ensure their contractors can properly perform their assigned duties </li></ul>
  8. 8. Subpart O Testing Regulations
  9. 9. 30 CFR 250.1507 (c) <ul><li>c) Employee or contract personnel testing </li></ul><ul><li>MMS or its authorized representative may conduct testing at either onshore or offshore locations for the purpose of evaluating an individual's knowledge and skills in performing well control and production safety duties. </li></ul>
  10. 10. 30 CFR 250.1507 (d) <ul><li>(d) Hands-on production safety, simulator, or live well testing </li></ul><ul><li>MMS or its authorized representative may conduct tests at either onshore or offshore locations. Tests will be designed to evaluate the competency of your employees or contract personnel in performing their assigned well control and production safety duties. You are responsible for the costs associated with this testing, excluding salary and travel costs for MMS personnel . </li></ul>
  11. 11. 30 CFR 250.1508 <ul><li>What must I do when MMS administers written or oral tests? </li></ul><ul><li>MMS or its authorized representative may test your employees or contract personnel at your worksite or at an onshore location. You and your contractors must: </li></ul><ul><li>(a) Allow MMS or its authorized representative to administer written or oral tests; and </li></ul><ul><li>(b) Identify personnel by current position, years of experience in present position, years of total oil field experience, and employer's name (e.g., operator, contractor, or sub-contractor company name). </li></ul>
  12. 12. 30 CFR 250.1509 <ul><li>  What must I do when MMS administers or requires hands-on, simulator, or other types of testing? </li></ul><ul><li>If MMS or its authorized representative conducts, or requires you or your contractor to conduct hands-on, simulator, or other types of testing, you must: </li></ul><ul><li>(a) Allow MMS or its authorized representative to administer or witness the testing; </li></ul><ul><li>(b) Identify personnel by current position, years of experience in present position, years of total oil field experience, and employer's name (e.g., operator, contractor, or sub-contractor company name); and </li></ul><ul><li>(c) Pay for all costs associated with the testing, excluding salary and travel costs for MMS personnel </li></ul>
  13. 13. Subpart O Testing History
  14. 14. At This Point, Testing Should Not be a Surprise to You or Your Company <ul><li>Testing has been included in our regulations since the year 2000 </li></ul><ul><li>We have voiced our intention to test at a variety of conferences & meetings in recent years </li></ul><ul><li>Before initiating the 2008 Subpart O pilot the agency began exploring testing in 2007 </li></ul>
  15. 15. January, 2007 IADC Well Control Work Group <ul><li>MMS introduced idea to IADC that agency was interested in implementing Subpart O testing </li></ul><ul><li>MMS presented hands-on well control testing options to IADC for discussion purposes </li></ul><ul><ul><li>Live well tests </li></ul></ul><ul><ul><li>School based testing </li></ul></ul><ul><ul><ul><li>simulators </li></ul></ul></ul><ul><ul><ul><li>computers </li></ul></ul></ul><ul><ul><li>30 CFR 250.462 (d) Well Control Drill </li></ul></ul>
  16. 16. January, 2007 IADC Well Control Work Group <ul><li>Why Was MMS Interested in Testing? </li></ul><ul><ul><li>Increase in Subpart O INCs </li></ul></ul><ul><ul><ul><li>40 INCs as of 1/2007 </li></ul></ul></ul><ul><ul><ul><li>G 846, G851, G862, G842 </li></ul></ul></ul><ul><ul><li>Loss of experienced personnel </li></ul></ul><ul><li>Up to this point MMS had conducted 6 written tests, several oral tests, & no hands-on tests </li></ul><ul><li>MMS requested IADC/Industry input on testing </li></ul>
  17. 17. NTL No. 2008-N03 - Well Control & Production Safety Training <ul><li>Effective March 31, 2008 </li></ul><ul><li>Clarified terms used in Subpart O rule </li></ul><ul><ul><li>Internal audit, production safety, periodic, contractor </li></ul></ul><ul><li>Discussed lessee and contractor responsibilities, program evaluations, & employee verifications </li></ul><ul><li>Announced MMS intent to conduct hands-on testing in 2008 </li></ul>
  18. 18. April, 2008 - Baker Energy <ul><li>MMS met with Baker to review their production training program </li></ul><ul><li>Baker provided MMS detailed information on program highlights to aid us in developing a successful Subpart O test program </li></ul><ul><ul><li>Training components </li></ul></ul><ul><ul><li>Assessment criteria </li></ul></ul><ul><ul><li>Test questions </li></ul></ul><ul><ul><li>Grading issues </li></ul></ul><ul><ul><li>Program statistics </li></ul></ul>
  19. 19. June, 2008 IADC Well Control Work Group <ul><li>MMS updated IADC & continued to press for input into testing program </li></ul><ul><li>Training INCs continue to increase </li></ul><ul><ul><li>71 INCs as of 12/2007 </li></ul></ul><ul><li>Up to this point MMS had conducted 10 written tests, 36 oral tests, & no hands-on tests </li></ul><ul><li>IADC agreed to form internal group to provide MMS testing feedback </li></ul>
  20. 20. August, 2008 IADC Well Control Work Group <ul><li>Since June, 2008 IADC/Chevron provided MMS a series of hands-on well control scenarios </li></ul><ul><ul><li>Operational based </li></ul></ul><ul><ul><li>Position specific </li></ul></ul><ul><li>Discussed IADC/Chevron suggestions for hands-on well control scenarios received by agency </li></ul><ul><li>MMS provided work group overview of how pilot Subpart O testing program could work moving forward </li></ul>
  21. 21. October, 2008 Diamond Offshore Drilling <ul><li>Diamond volunteers rigs for offshore written &/or hands-on well control testing </li></ul><ul><ul><li>Diamond/Devon </li></ul></ul><ul><ul><li>Ocean Endeavour semisubmersible </li></ul></ul><ul><ul><li>Pre MMS pilot </li></ul></ul><ul><li>Received valuable real world input and comments on specific test questions, test process, grading policies </li></ul>
  22. 22. Testing <ul><li>Since publication of Subpart O in 2000 MMS has had a variety of tools at our disposal to monitor industry compliance </li></ul><ul><ul><li>Employee interviews </li></ul></ul><ul><ul><li>Audits </li></ul></ul><ul><ul><li>Tests </li></ul></ul><ul><li>Majority of MMS efforts to date have focused on interviews and audits </li></ul>
  23. 23. INFORMAL EMPLOYEE INTERVIEW’S (2002 – 2008 YTD)
  24. 24. SUB O AUDITS & INCs (2002 – 2008 YTD)
  25. 25. Testing <ul><li>After evaluating how interviews and audits work/don’t work MMS began to explore testing </li></ul><ul><li>Provides MMS another tool in our audit tool box to evaluate employee competency </li></ul><ul><li>Provides MMS and company more of a “real” world evaluation of individual skills as related to their job </li></ul>
  26. 26. SUBPART O PILOT TESTING PROCESS
  27. 27. Testing Pilot Program <ul><li>Started 11/1/08 </li></ul><ul><li>No enforcement (INC) </li></ul><ul><li>Goal </li></ul><ul><ul><li>Issue as many tests as possible to gain a better understanding of test administration </li></ul></ul><ul><ul><li>Receive lessee & contractor input </li></ul></ul><ul><li>Areas of concern </li></ul><ul><ul><li>Grading </li></ul></ul><ul><ul><ul><li>70% </li></ul></ul></ul><ul><ul><ul><li>pass/fail </li></ul></ul></ul><ul><ul><li>Consistency </li></ul></ul><ul><ul><ul><li>test administration </li></ul></ul></ul><ul><ul><li>Level of difficulty </li></ul></ul>
  28. 28. Testing Pilot Program <ul><li>Open book </li></ul><ul><li>All material acceptable </li></ul><ul><ul><li>Charts, guides, books, tables…. </li></ul></ul><ul><li>No time limit </li></ul><ul><li>Testing location </li></ul><ul><ul><li>Onshore (office, school), offshore </li></ul></ul><ul><li>Passing grade </li></ul><ul><ul><li>Written – 70% and above </li></ul></ul><ul><ul><li>Hands-on – pass/fail, all steps deemed critical </li></ul></ul>
  29. 29. Written Well Control Pilot Tests <ul><li>Three tests; “A”, “B”, “C” </li></ul><ul><li>Each test includes three levels based upon rig position </li></ul><ul><ul><ul><li>Level “L1” </li></ul></ul></ul><ul><ul><ul><ul><li>floorhand, derrickman </li></ul></ul></ul></ul><ul><ul><ul><li>Level “L1L2” </li></ul></ul></ul><ul><ul><ul><ul><li>driller, assistant driller </li></ul></ul></ul></ul><ul><ul><ul><li>Level “L1L2L3” </li></ul></ul></ul><ul><ul><ul><ul><li>toolpusher, company man </li></ul></ul></ul></ul>
  30. 30. Written Well Control Pilot Tests - Grading <ul><li>Level “L1” (floorhand, derrickman) </li></ul><ul><ul><li>5 questions </li></ul></ul><ul><ul><li>Passing = 70% on this section only </li></ul></ul><ul><li>Level “L1L2” (driller, assistant driller) </li></ul><ul><ul><li>11 questions </li></ul></ul><ul><ul><ul><li>5 questions from “L1” + 6 new questions </li></ul></ul></ul><ul><ul><li>Passing = 70% on 11 questions </li></ul></ul><ul><li>Level “L1L2L3” (toolpusher, company man) </li></ul><ul><ul><li>20 questions </li></ul></ul><ul><ul><ul><li>5 questions from “L1” + 6 questions from “L1L2” + 9 new questions </li></ul></ul></ul><ul><ul><li>Passing = 70% on 20 questions (entire test) </li></ul></ul>
  31. 31. Written Well Control Pilot Tests - Questions <ul><li>Level “L1” questions </li></ul><ul><ul><li>Basic well control concepts, equipment practices </li></ul></ul><ul><li>Level “L1L2” questions </li></ul><ul><ul><li>More advanced well control theory, equipment concepts </li></ul></ul><ul><li>Level “L1L2L3” questions </li></ul><ul><ul><li>Deeper knowledge of well control techniques, operational systems, calculations </li></ul></ul><ul><ul><li>Only level to contain calculations </li></ul></ul>
  32. 32. Hands-On Pilot Well Control Tests <ul><li>Five scenarios </li></ul><ul><li>Each scenario includes a series of Yes/No skill based questions </li></ul><ul><ul><li>5 to 8 questions per scenario </li></ul></ul><ul><li>Employee/team needs to show competency by demonstrating or answering all questions correctly </li></ul><ul><li>Each question in a scenario deemed to be critical </li></ul><ul><li>Scenarios focus on either an individual or a team </li></ul>
  33. 33. Written Production Pilot Tests <ul><li>Five tests; “A”, “B”, “C”, “D”, “E” </li></ul><ul><li>Each test includes three levels based upon position on facility </li></ul><ul><ul><li>Level “L1” </li></ul></ul><ul><ul><ul><li>C or D operator </li></ul></ul></ul><ul><ul><li>Level “L1L2” </li></ul></ul><ul><ul><ul><li>A or B operator </li></ul></ul></ul><ul><ul><li>Level “L1L2L3” </li></ul></ul><ul><ul><ul><li>Lead operator </li></ul></ul></ul>
  34. 34. Written Production Pilot Tests - Grading <ul><li>Level “L1” (C or D operator) </li></ul><ul><ul><li>35 questions </li></ul></ul><ul><ul><li>Passing = 70% on this section only </li></ul></ul><ul><li>Level “L1L2” (A or B operator) </li></ul><ul><ul><li>44 questions total </li></ul></ul><ul><ul><ul><li>35 questions from “L1” + 9 new questions </li></ul></ul></ul><ul><ul><li>Passing = 70% on 44 questions </li></ul></ul><ul><li>Level “L1L2L3” (lead operator) </li></ul><ul><ul><li>50 questions total </li></ul></ul><ul><ul><ul><li>35 questions from “L1” + 9 questions from “L1L2” + 6 new questions </li></ul></ul></ul><ul><ul><li>Passing = 70% on 50 questions (entire test) </li></ul></ul>
  35. 35. Written Production Pilot Tests - Questions <ul><li>Level “L1” questions </li></ul><ul><ul><li>Basic wellhead equipment design, safety device testing and reporting requirements </li></ul></ul><ul><li>Level “L1L2” questions </li></ul><ul><ul><li>More advanced safety analysis concepts, system design theory and practices </li></ul></ul><ul><li>Level “L1L2L3” questions </li></ul><ul><ul><li>Deeper knowledge of analysis, design, installation and testing of production surface safety systems and of government codes, rules and regulations </li></ul></ul>
  36. 36. Hands-On Production Pilot Tests <ul><li>Ten scenarios </li></ul><ul><li>Each scenario includes a series of Yes/No skill based questions </li></ul><ul><ul><li>10 to 14 questions per scenario </li></ul></ul><ul><li>Employee/team needs to show competency by demonstrating or answering all questions in a correct manner </li></ul><ul><li>Each question in a scenario deemed to be critical </li></ul><ul><li>Scenarios focus on either an individual or a team </li></ul>
  37. 37. PILOT TESTING PROGRAM RESULTS
  38. 38. Type of Tests Conducted During Pilot <ul><li>Majority of written tests were offshore & announced </li></ul><ul><li>Small percentage of written tests were unannounced </li></ul><ul><li>18 well control written tests conducted at school & compared against schools’ test </li></ul><ul><li>All hands-on pilot tests were conducted offshore </li></ul>
  39. 39. Testing Pilot Program <ul><li>Lessee & contractors either volunteered to participate or were picked at random </li></ul><ul><li>Testing was conducted during normal MMS inspection activities </li></ul><ul><li>Tests were mostly graded onsite </li></ul><ul><li>Employee comments were solicited </li></ul><ul><li>Often times an individual was given multiple tests for feedback and comparison purposes </li></ul><ul><li>Test data was entered into an MMS data base </li></ul>
  40. 40. Companies Tested During Pilot <ul><ul><li>Devon/Diamond </li></ul></ul><ul><ul><li>ExxonMobil/H&P </li></ul></ul><ul><ul><li>ExxonMobil/Sam Jones </li></ul></ul><ul><ul><li>Energy X X 1/Hercules </li></ul></ul><ul><ul><li>BP/Rowan </li></ul></ul><ul><ul><li>Helis/Rowan </li></ul></ul><ul><ul><li>Hunt/Ensco </li></ul></ul><ul><ul><li>Badger/Pride </li></ul></ul><ul><ul><li>Mariner/Noble </li></ul></ul><ul><ul><li>El Paso/Wood Group </li></ul></ul><ul><ul><li>Mariner/Prosper </li></ul></ul><ul><ul><li>Chevron/Parker </li></ul></ul><ul><ul><li>Venoco </li></ul></ul><ul><ul><li>PXP </li></ul></ul><ul><ul><li>Shell </li></ul></ul><ul><ul><li>Stone </li></ul></ul><ul><ul><li>Apache </li></ul></ul>
  41. 41. Pilot Test Breakdown by MMS Region <ul><li>Total tests conducted during pilot </li></ul><ul><ul><li>Gulf of Mexico - 129 </li></ul></ul><ul><ul><li>Pacific - 7 </li></ul></ul><ul><ul><li>Alaska - 0 </li></ul></ul>
  42. 42. Subpart O Pilot Tests Conducted <ul><li>Written Tests </li></ul><ul><ul><li>Well control – 86 </li></ul></ul><ul><ul><ul><li>37 L1 </li></ul></ul></ul><ul><ul><ul><li>23 L1L2 </li></ul></ul></ul><ul><ul><ul><li>26 L1L2L3 </li></ul></ul></ul><ul><ul><li>Production – 31 </li></ul></ul><ul><ul><ul><li>4 L1 </li></ul></ul></ul><ul><ul><ul><li>7 L1L2 </li></ul></ul></ul><ul><ul><ul><li>20 L1L2L3 </li></ul></ul></ul><ul><li>Hands-On Tests -19 </li></ul><ul><ul><li>Well control - 4 </li></ul></ul><ul><ul><li>Production - 15 </li></ul></ul>
  43. 43. Pilot Written Well Control Tests
  44. 44. PILOT WRITTEN WELL CONTROL TEST “A”GRADE DISTRIBUTION*   L1,L2,L3 L1,L2 L1   85 91 100   95 73 80   85 64 60   90 91 60   93 73 80   65 64 80   100   60       60 * Failures (less than 70% noted in red)       60       40       80 Tests Given 7 6 11 Average Grade 87.6 76 69.1
  45. 45. PILOT WRITTEN WELL CONTROL TEST “B” GRADE DISTRIBUTION*   L1,L2,L3 L1,L2 L1   95 64 100   75 73 100   80 64 80   90 91 100   85 91 60   90 91 100   80 100 80   85 73 100   * Failures (less than 70% noted in red)  90 64 80   70   80       60       60       100       100 Tests Given 10 9 14 Average Grade 84 79 85.7
  46. 46. PILOT WRITTEN WELL CONTROL TEST “C” GRADE DISTRIBUTION*   L1,L2,L3 L1,L2 L1   65 64 40   90 64 80   60 73 80   45 64 20   95 64 40   75   64 40 * Failures (less than 70% noted in red)  90   37 40     70   55 40     80   40       40 0 0 Tests Given 9 8 12 Average Grade 74 61 42
  47. 47. PILOT WRITTEN WELL CONTROL TEST “A”
  48. 48. PILOT WRITTEN WELL CONTROL TEST “B”
  49. 49. PILOT WRITTEN WELL CONTROL TEST “C”
  50. 50. PILOT WELL CONTROL WRITTEN TEST vs. SCHOOL TESTS <ul><li>18 MMS well control written tests conducted at school & compared against schools’ test </li></ul><ul><li>Tested 6 people; 2 toolpushers, 1 driller, 1 derrickman, 2 floorhands </li></ul><ul><li>School WellCAP test averages </li></ul><ul><ul><li>Introductory – 78% </li></ul></ul><ul><ul><li>Fundamental – 87% </li></ul></ul><ul><ul><li>Supervisory – 89% </li></ul></ul><ul><li>MMS test averages </li></ul><ul><ul><li>“ L1” – 70% </li></ul></ul><ul><ul><li>“ L1L2” – 81.7% </li></ul></ul><ul><ul><li>“ L1L2L3” – 83.3% </li></ul></ul><ul><li>Limited data shows consistently higher school scores than MMS scores for “comparable” tests </li></ul>
  51. 51. WELL CONTROL WRITTEN PILOT TESTS WHAT DID WE LEARN ? <ul><li>Well Control Test “C” Appears to be the Most Difficult </li></ul><ul><ul><li>Test C has more calculations than Test A or Test B </li></ul></ul><ul><ul><li>Test C has lowest average test scores in each category </li></ul></ul><ul><li>Most Test Failures are for the “L1” level </li></ul><ul><ul><li>Floorhand, derrickman </li></ul></ul><ul><ul><li>As expected, “L1” personnel are least experienced </li></ul></ul><ul><ul><ul><li>6 yrs. avg. oilfield experience </li></ul></ul></ul><ul><ul><li>Majority of “L1” personnel appear to be trained in accordance with IADC WellCAP Introductory level </li></ul></ul><ul><ul><ul><li>some MMS “L1” questions were outside scope of IADC WellCAP Introductory level </li></ul></ul></ul><ul><ul><ul><ul><li>BOP testing and MMS regulations </li></ul></ul></ul></ul>
  52. 52. WELL CONTROL WRITTEN PILOT TESTS AREAS OF CONCERN <ul><li>L1 (floorhand, derrickman) </li></ul><ul><ul><li>Causes of kick </li></ul></ul><ul><ul><ul><li>not keeping hole full </li></ul></ul></ul><ul><ul><ul><li>insufficient mud weight </li></ul></ul></ul><ul><ul><ul><li>lost circulation </li></ul></ul></ul><ul><ul><li>First step to control kick </li></ul></ul><ul><ul><ul><li>shut well in ASAP </li></ul></ul></ul><ul><ul><li>Location of wrench for manual valves (MMS regulations) </li></ul></ul><ul><ul><ul><li>ready access </li></ul></ul></ul><ul><ul><li>Annular test pressure or test frequency </li></ul></ul><ul><ul><ul><li>14 day </li></ul></ul></ul><ul><ul><ul><li>70% RWP or per MMS (not in WEllCAP, MMS regulations) </li></ul></ul></ul>
  53. 53. WELL CONTROL WRITTEN PILOT TESTS AREAS OF CONCERN <ul><li>L1L2 (driller, assistant driller) </li></ul><ul><ul><li>Hydrostatic pressure concept </li></ul></ul><ul><ul><ul><li>gradient or density of fluid x height of fluid column </li></ul></ul></ul><ul><ul><li>Ways to circulate out kick </li></ul></ul><ul><ul><ul><li>drillers, wait/weight, volumetric </li></ul></ul></ul><ul><ul><li>Ram test pressure </li></ul></ul><ul><ul><ul><li>RWP or per MMS (MMS regulations) </li></ul></ul></ul><ul><ul><li>With well shut in what happens to BHP as gas bubble rises </li></ul></ul><ul><ul><li>Quantities of drilling fluid and drilling fluid materials on rig to ensure well control (MMS regulations) </li></ul></ul><ul><ul><li>Safe drilling margin </li></ul></ul>
  54. 54. WELL CONTROL WRITTEN PILOT TESTS AREAS OF CONCERN <ul><li>L1L2L3 (toolpusher, company man) </li></ul><ul><ul><li>Calculations (only test w/ calculations) </li></ul></ul><ul><ul><ul><li>P 1 V 1 =P 2 V 2 </li></ul></ul></ul><ul><ul><ul><li>sacks Barite to increase MW </li></ul></ul></ul><ul><ul><ul><li>circulating pressures </li></ul></ul></ul><ul><ul><ul><li>equivalent mud weight </li></ul></ul></ul><ul><ul><li>MMS regulations </li></ul></ul><ul><ul><ul><li>diverter vent line OD (bottom founded, floater) </li></ul></ul></ul><ul><ul><ul><li>directional requirements (inclination, azimuth) </li></ul></ul></ul>
  55. 55. Written Well Control Tests Lessons Learned <ul><li>Evaluate increasing number of questions in “L1” section of test from 5 to 10 for easier/better grading </li></ul><ul><li>Evaluate IADC WellCAP course curriculum in developing questions for tests and use as appropriate; </li></ul><ul><ul><li>Introductory (floorhand, derrickman) </li></ul></ul><ul><ul><li>Fundamental (derrickman, assistant driller, driller) </li></ul></ul><ul><ul><li>Supervisory (tool pusher, company man) </li></ul></ul><ul><li>Evaluate question specific comments received by MMS & industry personnel </li></ul>
  56. 56. Pilot Written Production Tests
  57. 57. PILOT WRITTEN PRODUCTION TEST “A”GRADE DISTRIBUTION   L1,L2,L3 L1,L2 L1   74 75 80 88 82 92   86       92   Tests Given 4 2 2   Average Grade 85 78.5 86
  58. 58. PILOT WRITTEN PRODUCTION TEST “B” GRADE DISTRIBUITION   L1,L2,L3 L1,L2 L1 92 77   90   90     76     76   86   92     Tests Given 7 1 0 Average  Grade 86 77 NA
  59. 59. PILOT WRITTEN PRODUCTION TEST “C” GRADE DISTRIBUTION   L1,L2,L3 L1,L2 L1   80 91 86 92   94 Tests Given 3 1 1   Average Grade 88.7 91 86
  60. 60. PILOT WRITTEN PRODUCTION TEST “D” GRADE DISTRIBUTION   L1,L2,L3 L1,L2 L1   86 84 83 96   88 Tests Given 3 1 1 Average Grade 90 84 83
  61. 61. PILOT WRITTEN PRODUCTION TEST “E” GRADE DISTRIBUTION   L1,L2,L3 L1,L2 L1   80 91   92 89   94 Tests Given 3 2 0 Average  Grade 88.7 90 NA
  62. 62. PILOT WRITTEN PRODUCTION TEST “A”
  63. 63. PILOT WRITTEN PRODUCTION TEST “B”
  64. 64. PILOT WRITTEN PRODUCTION TEST “C”
  65. 65. PILOT WRITTEN PRODUCTION TEST “D”
  66. 66. PILOT WRITTEN PRODUCTION TEST “E”
  67. 67. Written Pilot Production Tests What Did We Learn? <ul><li>MMS would have liked to have conducted more production written tests however, based upon the data; </li></ul><ul><ul><li>Production tests A – E appear to be of equivalent difficulty </li></ul></ul><ul><ul><li>No failures out of 31 tests </li></ul></ul><ul><ul><ul><li>74% lowest recorded grade (Test A-L1L2L3) </li></ul></ul></ul>
  68. 68. Written Pilot Production Tests Areas of Concern <ul><li>L1 (C, D operators) </li></ul><ul><ul><li>Wellhead component identification </li></ul></ul><ul><ul><ul><li>casing valves (intermediate, production) </li></ul></ul></ul><ul><ul><ul><li>casing heads (surface, intermediate, production) </li></ul></ul></ul><ul><ul><li>Equipment testing interval </li></ul></ul><ul><ul><ul><li>TSH-compressor (six months) </li></ul></ul></ul><ul><ul><ul><li>TSH-fired component (annual) </li></ul></ul></ul>
  69. 69. Written Pilot Production Tests Areas of Concern <ul><li>L1L2 (A, B operators) </li></ul><ul><ul><li>Wellhead component identification </li></ul></ul><ul><ul><ul><li>casing valves (intermediate, production) </li></ul></ul></ul><ul><ul><ul><li>casing heads (surface, intermediate, production </li></ul></ul></ul><ul><ul><li>Separator pressure valve settings </li></ul></ul><ul><ul><li>Equipment testing interval </li></ul></ul><ul><ul><ul><li>BSL (annual) </li></ul></ul></ul><ul><ul><ul><li>tubing plug (six months) </li></ul></ul></ul><ul><ul><li>What does LACT stand for? </li></ul></ul>
  70. 70. Written Pilot Production Tests Areas of Concern <ul><li>L1L2L3 (lead operators) </li></ul><ul><ul><li>DOI pipeline out of service requirements </li></ul></ul><ul><ul><li>% of LEL gas detector should alarm at </li></ul></ul><ul><ul><li>Separator pressure valve settings </li></ul></ul><ul><ul><li>What does LACT stand for? </li></ul></ul><ul><ul><li>Equipment testing interval </li></ul></ul><ul><ul><ul><li>tubing plug (annual) </li></ul></ul></ul>
  71. 71. Pilot Hands On Test Results <ul><li>Well Control – 4 (P, P, P, P) </li></ul><ul><li>Production – 15 </li></ul><ul><ul><ul><li>(P, F-13/14) </li></ul></ul></ul><ul><ul><ul><li>(P) </li></ul></ul></ul><ul><ul><ul><li>(P) </li></ul></ul></ul><ul><ul><ul><li>(P, P, F-9/10) </li></ul></ul></ul><ul><ul><ul><li>(P, P) </li></ul></ul></ul><ul><ul><ul><li>(P, F-9/10) </li></ul></ul></ul><ul><ul><ul><li>(P, F-7/10) </li></ul></ul></ul><ul><ul><ul><li>(P, P) </li></ul></ul></ul>
  72. 72. Pilot Hands On Tests – What Did We Learn <ul><li>Grading </li></ul><ul><ul><li>Test taker could be competent even though they did not answer all questions correctly or perform task properly </li></ul></ul><ul><ul><li>Subjectivity of MMS </li></ul></ul><ul><li>Should we continue with P/F hands on grading system or evaluate use of a grading system similar to written testing? </li></ul>
  73. 73. Test Taker Comments <ul><li>Well Control Written </li></ul><ul><ul><li>Good program </li></ul></ul><ul><ul><li>Tests put together well, each level fair, good learning tool, good refresher, fair test </li></ul></ul><ul><ul><li>Tests should lead to increased safety </li></ul></ul><ul><ul><li>L1 test adequate, tests L1L2 and L1L2L3 should be more detailed </li></ul></ul><ul><ul><li>Straightforward, easy to understand </li></ul></ul><ul><ul><li>Good for basic knowledge, good mix of easy/hard questions </li></ul></ul><ul><ul><li>Good for rig tests </li></ul></ul><ul><ul><li>Will help improve skills between school based training </li></ul></ul><ul><ul><li>L1 test easy, L1L2 test confusing </li></ul></ul><ul><ul><li>Do not test on crew change days (2 times) </li></ul></ul>
  74. 74. Test Taker Comments <ul><li>Well Control Written </li></ul><ul><ul><li>Some questions I have seen before others I have not </li></ul></ul><ul><ul><li>Strong test, good test (7 times) </li></ul></ul><ul><ul><li>Questions did not clearly show choices, I knew the answer but it was not in the choices </li></ul></ul><ul><ul><li>Need MMS regulation book for test </li></ul></ul><ul><ul><li>Hard test </li></ul></ul><ul><ul><li>Testing is good, allows you to see who understands what </li></ul></ul><ul><ul><li>Don’t test on first day back after days off, keep testing </li></ul></ul><ul><ul><li>Not enough time, felt rushed </li></ul></ul><ul><ul><li>Use one big test </li></ul></ul><ul><ul><li>Good questions (2 times) </li></ul></ul><ul><ul><li>Too many repeat questions </li></ul></ul><ul><ul><li>Tests shouldn’t be announced </li></ul></ul><ul><ul><li>Tests identify items I am weak in </li></ul></ul>
  75. 75. Test Taker Comments <ul><li>Production Written </li></ul><ul><ul><li>Some questions geared to management personnel not operational personnel </li></ul></ul><ul><ul><li>Test A question #7; confusing </li></ul></ul><ul><ul><li>Test A question #2; misleading </li></ul></ul><ul><ul><li>Test B question #19; could not find in CFR (2 times) </li></ul></ul><ul><ul><li>We need a list of publications showing where questions come from </li></ul></ul><ul><ul><li>Good general test on equipment and regulations </li></ul></ul><ul><ul><li>Good test </li></ul></ul><ul><ul><li>Test B is best, more real world then other test versions </li></ul></ul>
  76. 76. Test Taker Comments <ul><li>Production Hands On </li></ul><ul><ul><li>Scenario went over all procedures to troubleshoot this event (2 times) </li></ul></ul><ul><ul><li>Evaluation went over all steps to troubleshoot equipment and went through all components </li></ul></ul><ul><ul><li>Scenario went over all components & operations associated with performing task </li></ul></ul><ul><li>Well Control </li></ul><ul><ul><li>None </li></ul></ul>
  77. 77. What's Next? Testing Beyond Pilot
  78. 78. Major Points of Interest <ul><li>Post-pilot testing program will go into effect on 4/1/09 </li></ul><ul><li>Post-pilot program will include enforcement </li></ul><ul><li>Lessons learned from pilot program will be integrated into program whenever feasible </li></ul>
  79. 79. Who Will MMS Test ? <ul><li>Possible test candidates; </li></ul><ul><ul><li>Operator </li></ul></ul><ul><ul><li>Contractor </li></ul></ul><ul><ul><li>Companies picked @ random </li></ul></ul><ul><ul><li>Companies experiencing; </li></ul></ul><ul><ul><ul><li>problems with Subpart O audit </li></ul></ul></ul><ul><ul><ul><li>loss of well control </li></ul></ul></ul><ul><ul><ul><li>lower than average OSI (poor performers) </li></ul></ul></ul><ul><ul><li>When training is identified as a cause in an accident </li></ul></ul>
  80. 80. Test Triggers <ul><li>Testing is one tool in the audit toolbox </li></ul><ul><li>Triggers for testing include: </li></ul><ul><ul><li>Failure of the operator to verify employee knowledge and skill </li></ul></ul><ul><ul><li>Failure of the operator to verify contractor employee knowledge and skill </li></ul></ul><ul><ul><li>Failure of the operator to evaluate contractors training program </li></ul></ul>
  81. 81. Post-Pilot Testing Procedure - Basics <ul><li>Tests will be announced or unannounced </li></ul><ul><ul><li>Announced </li></ul></ul><ul><ul><ul><li>phone call or letter from MMS </li></ul></ul></ul><ul><li>Tests will be conducted at a variety of locations; onshore (school, office), offshore </li></ul><ul><ul><li>Offshore </li></ul></ul><ul><ul><ul><li>MMS to discuss w/ field management to determine if it is safe & appropriate to conduct a test at that time (written or hands-on) </li></ul></ul></ul><ul><li>Open book </li></ul><ul><ul><li>All material acceptable </li></ul></ul><ul><ul><li>Computers OK with MMS monitoring </li></ul></ul><ul><ul><ul><li>No emails, no IM’s </li></ul></ul></ul><ul><li>No time limit for test </li></ul>
  82. 82. Post-Pilot Testing Procedure - Basics <ul><li>No set number of tests to be conducted by MMS during a year </li></ul><ul><li>If we conduct test @ your rig/facility/school goal is to test 10% of personnel on location </li></ul><ul><li>No retests </li></ul><ul><li>No help from others </li></ul><ul><li>Grading </li></ul><ul><ul><li>70% = passing for both written and hands-on tests </li></ul></ul>
  83. 83. Post-Pilot Testing Procedure - Basics <ul><li>Well control written tests </li></ul><ul><ul><li>4 new tests instead of 3 </li></ul></ul><ul><ul><li>10 questions in “L1” (floorhand, derrickman) section of test instead of 5 </li></ul></ul><ul><ul><li>Questions to focus more on IADC WellCAP Introductory level and less on MMS regulations </li></ul></ul><ul><li>Production written tests </li></ul><ul><ul><li>More or less same questions as pilot tests however questions will be renumbered for easier grading </li></ul></ul><ul><ul><li>Addition of an H 2 S supplement – operational specific testing </li></ul></ul>
  84. 84. Post-Pilot Testing Procedure <ul><li>Enforcement </li></ul><ul><ul><li>If employee fails written test (< 70%) a G-856 INC may be issued </li></ul></ul><ul><ul><ul><li>MMS will consider a hands-on test of employee to validate written test prior to deciding on INC </li></ul></ul></ul><ul><ul><li>Based on test(s) results MMS briefs lessee with general assessment of employees performance </li></ul></ul><ul><ul><ul><li>if MMS feels strongly that INC should be issued lessee will be informed to expect INC in the mail from District within 7 business days </li></ul></ul></ul><ul><ul><ul><li>no INC issued on-site </li></ul></ul></ul><ul><ul><ul><li>grading will not be conducted on-site, but in District </li></ul></ul></ul><ul><ul><ul><li>lessee needs to identify to MMS how they will address deficient employee before MMS leaves location (school, rig/facility…) </li></ul></ul></ul>
  85. 85. G 856 INC Information <ul><li>INC with explanatory letter to lessee is issued by District office and will include; </li></ul><ul><ul><li>Date & time of test </li></ul></ul><ul><ul><li>Employer </li></ul></ul><ul><ul><ul><li>lessee, contractor </li></ul></ul></ul><ul><ul><li>Location of test </li></ul></ul><ul><ul><ul><li>onshore (school, office) </li></ul></ul></ul><ul><ul><ul><li>offshore (rig/facility, lease/block) </li></ul></ul></ul><ul><ul><li>Position of employee </li></ul></ul><ul><ul><ul><li>Lead operator, driller ….. </li></ul></ul></ul><ul><ul><li>Score and result </li></ul></ul><ul><ul><ul><li>numeric grade </li></ul></ul></ul><ul><ul><ul><li>pass/ fail </li></ul></ul></ul><ul><ul><ul><li>specific questions wrong will not be released </li></ul></ul></ul><ul><ul><li>Overview of concerns </li></ul></ul>
  86. 86. Post-Pilot Testing Procedure <ul><li>G-856 Possible Corrective Actions </li></ul><ul><ul><li>Retrain employee </li></ul></ul><ul><ul><li>Retest employee w/ company test </li></ul></ul><ul><ul><li>Retrain and retest employee </li></ul></ul><ul><ul><li>Put employee under direct supervision of another employee </li></ul></ul><ul><ul><li>Transfer employee to another job </li></ul></ul><ul><ul><li>Others ?? </li></ul></ul>
  87. 87. New G-856 PINC <ul><li>G-856   DOES EACH EMPLOYEE UNDERSTAND AND PERFORM THE ASSIGNED WELL-CONTROL OR PRODUCTION SAFETY DUTIES? </li></ul><ul><li>Authority: 30 CFR 250.1503(a)   30 CFR 250.1507(c)                     </li></ul><ul><li>Enforcement Action: W/C  30 CFR 250.1507(d)     </li></ul><ul><li>INSPECTION PROCEDURE:  Verify that lessee’s training plan provides a process to ensure that employees understand and can perform their assigned well-control or production safety duties.    Verify (either through written, hands-on, or oral testing) that employees understand and can perform their assigned well-control or production safety duties. </li></ul><ul><li>                              </li></ul><ul><li>IF NONCOMPLIANCE EXISTS:   Issue one warning (W) INC for an audit of one or more employees if the training plan fails to provide a process to ensure that employees understand and can perform assigned well-control or production safety duties.  Issue one component shut-in (C) INC for one or more employees that fail to demonstrate either through written, hands-on, or oral testing, their ability to perform the assigned well-control or production duties. </li></ul><ul><li>Note:  The employee is the component. </li></ul><ul><li>INSPECTION COUNT/INC COUNT: Enter one item checked/issue on INC per training plan audited. </li></ul>
  88. 88. Discussion, Questions, Comments, Opinions… <ul><li>[email_address] </li></ul><ul><li>Phone: (703) 787-1033 David.Dykes@mms.gov </li></ul><ul><li>Phone: (504) 736-3249 </li></ul><ul><li>THANK YOU !!! </li></ul>

×