Critical Control Management
Part 4 of 6: Verification & Evaluation
Mark Wright
Managing Director,
Fefo Consulting
1. Material Unwanted Events ✓
2. Identifying the Critical Few ✓
3. Critical Performance Standards ✓
4. Critical Control Verification Today
5. Critical Control Measurement 24 Nov
6. Myosh Digital Bow-tie + CCM 25 Nov
Rebecca Crompton,
General Manager, HSE,
BSA Ltd
TEAM CLIENTS REACH OUTCOMES
About Us
✓ Statistically reliable >0.9
✓ Credible lead indicators benchmarks
✓ Integrated Health AND Safety
2
info@fefo.com.au fefo.com.au
3
Desired
Current State
A. Webinar #1-3 Recap
B. Where to check?
C. How to check?
D. Pitfalls and Leading Practices
CCM
Act
Measure Focus
4
Webinar 1: Current vs Desired State
info@fefo.com.au | fefo.com.au
5
info@fefo.com.au | fefo.com.au
Critical Control /
Performance Parameter
Criteria
Method of
Verification
Frequency Who
Webinars 1-3 Recap: Identify Critical Controls & Set Expectations
# Target Volume No targets
Effective Critical Control Target > xx%
Ineffective Critical Control Target < xx%
Case Study #1: Setting Targets
Working at Heights
Electrical Isolation
First Aid
6
Demo Construction Operate & Use Maintain End of Life
Raw Material Manufacture Transport Wholesale Retail End User
Where to Check?
7
info@fefo.com.au | fefo.com.au
CCM
Capture and Report Control Effectiveness
Reporting
Automation
Levels
High
Low
Low High
Capturing
Automation Levels
8
Critical Control Verification Checks
9
info@fefo.com.au | fefo.com.au
CCM
Visible engagement on site
• Acts
• Objects
• Systems
10
Coaching
Past Positive
Negative Future
11
Reporting Data
CCM
12
Govern |
Design
Lead | Facilitate
Manage | Coach
Implement | Support
Evaluating Critical Control Management Programs
>95% >95% >95% >95% >95%
24 24 12 24
2021
● ● ● ● ●
● ● ● ● ●
Control Effectiveness Target
Number Target
Measure Result
HPI HPI
March
Effective Controls (%)
Number Completed (#)
13
Case Study #2: Dashboards
Leading Indicators
Metrics
September
Target Result
Critical Process Confirmations 50 79
Critical Control Effectiveness 95% 96%
Old approach New Approach
Challenges:
• Senior leaders not visible
• Poor coaching conversation
• Critical controls unclear
• Not focused on major unwanted events
14
Focus on the negatives
Focusing solely on data
Too many critical controls
Ask what’s working well
and do more of it!
Effective conversations and
understand indirect CCM benefits
Focusing on the critical few
Critical Control Checks
Verifying critical controls from behind a desk Verifying onsite with operations
Common Pitfalls Leading Practices
15
info@fefo.com.au | fefo.com.au
Administration creating a burden
greater than CCM benefits
Design process to align with your
goals, maturity levels and resources
Poll
16
What topics would benefit your organisation?
You can choose more than one option:
A. Verification schedules based on material unwanted events
B. Skills to apply effective coaching conversations
C. Simple technology to capture on site checks
D. Critical Control Management reporting templates
E. Other?
info@fefo.com.au | fefo.com.au
17
Additional Help
info@fefo.com.au | fefo.com.au
Complimentary
Discovery Workshop
http://calendly.com/mark-wright
https://calendly.com/fefo_terry
Future Webinar: 6-Part Series
Wednesday’s 17 Nov – 1 Dec
5
6
18
info@fefo.com.au | fefo.com.au

Part 4 - Critical Control Verification: Are your controls effective?

  • 1.
    Critical Control Management Part4 of 6: Verification & Evaluation Mark Wright Managing Director, Fefo Consulting 1. Material Unwanted Events ✓ 2. Identifying the Critical Few ✓ 3. Critical Performance Standards ✓ 4. Critical Control Verification Today 5. Critical Control Measurement 24 Nov 6. Myosh Digital Bow-tie + CCM 25 Nov Rebecca Crompton, General Manager, HSE, BSA Ltd
  • 2.
    TEAM CLIENTS REACHOUTCOMES About Us ✓ Statistically reliable >0.9 ✓ Credible lead indicators benchmarks ✓ Integrated Health AND Safety 2 info@fefo.com.au fefo.com.au
  • 3.
    3 Desired Current State A. Webinar#1-3 Recap B. Where to check? C. How to check? D. Pitfalls and Leading Practices CCM
  • 4.
    Act Measure Focus 4 Webinar 1:Current vs Desired State info@fefo.com.au | fefo.com.au
  • 5.
    5 info@fefo.com.au | fefo.com.au CriticalControl / Performance Parameter Criteria Method of Verification Frequency Who Webinars 1-3 Recap: Identify Critical Controls & Set Expectations
  • 6.
    # Target VolumeNo targets Effective Critical Control Target > xx% Ineffective Critical Control Target < xx% Case Study #1: Setting Targets Working at Heights Electrical Isolation First Aid 6
  • 7.
    Demo Construction Operate& Use Maintain End of Life Raw Material Manufacture Transport Wholesale Retail End User Where to Check? 7 info@fefo.com.au | fefo.com.au CCM
  • 8.
    Capture and ReportControl Effectiveness Reporting Automation Levels High Low Low High Capturing Automation Levels 8
  • 9.
    Critical Control VerificationChecks 9 info@fefo.com.au | fefo.com.au CCM Visible engagement on site • Acts • Objects • Systems
  • 10.
  • 11.
  • 12.
  • 13.
    Govern | Design Lead |Facilitate Manage | Coach Implement | Support Evaluating Critical Control Management Programs >95% >95% >95% >95% >95% 24 24 12 24 2021 ● ● ● ● ● ● ● ● ● ● Control Effectiveness Target Number Target Measure Result HPI HPI March Effective Controls (%) Number Completed (#) 13
  • 14.
    Case Study #2:Dashboards Leading Indicators Metrics September Target Result Critical Process Confirmations 50 79 Critical Control Effectiveness 95% 96% Old approach New Approach Challenges: • Senior leaders not visible • Poor coaching conversation • Critical controls unclear • Not focused on major unwanted events 14
  • 15.
    Focus on thenegatives Focusing solely on data Too many critical controls Ask what’s working well and do more of it! Effective conversations and understand indirect CCM benefits Focusing on the critical few Critical Control Checks Verifying critical controls from behind a desk Verifying onsite with operations Common Pitfalls Leading Practices 15 info@fefo.com.au | fefo.com.au Administration creating a burden greater than CCM benefits Design process to align with your goals, maturity levels and resources
  • 16.
    Poll 16 What topics wouldbenefit your organisation? You can choose more than one option: A. Verification schedules based on material unwanted events B. Skills to apply effective coaching conversations C. Simple technology to capture on site checks D. Critical Control Management reporting templates E. Other? info@fefo.com.au | fefo.com.au
  • 17.
    17 Additional Help info@fefo.com.au |fefo.com.au Complimentary Discovery Workshop http://calendly.com/mark-wright https://calendly.com/fefo_terry
  • 18.
    Future Webinar: 6-PartSeries Wednesday’s 17 Nov – 1 Dec 5 6 18 info@fefo.com.au | fefo.com.au