SlideShare a Scribd company logo
1 of 111
AIHA VIDEO SERIES:
MAKING ACCURATE EXPOSURE RISK
DECISIONS
Video 1A
Exposure Variability and the Importance of
Using Statistics to Improve Judgements
1
John R. Mulhausen, PhD, CIH, CSP, FAIHA
Disclaimer &
Copyright
Although the information contained in this session has been compiled from sources believed to be reliable, the presenter and AIHA®
make no guarantee as to, and assumes no responsibility for, the correctness, sufficiency, or completeness of such information.
Since standards and codes vary from one place to another, consult with your local Occupational or Environmental Health and Safety
professional to determine the current state of the art before applying what you learn from this webinar.
AIHA must ensure balance, independence, objectivity, and scientific rigor in its educational events. Instructors are expected to
disclose any significant financial interests or other relationships. The intent of this disclosure is not to prevent an instructor from
presenting, but to provide participants with information to base their own judgments. It remains up to the participant to determine
whether an instructor’s interests or relationships may influence the presentation.
Session presentation material belongs to the presenter with usage rights given to AIHA. This session and associated materials can
be reproduced, rebroadcast, or made into derivative works without express written permission.
Disclaimer &
Copyright
Handout Information
All AIHA University session handouts are produced by AIHA as submitted by the instructors, and in the instructor determined order.
AIHA does not change or modify handout content; we may adjust images to improve layout and clarity.
AGENDA
• Why Important?
• Decision Statistic
• AIHA Categories
• Exposure Judgment Accuracy
• Exposure Variability
• Inferential IH Statistics
• Data Interpretation Using IHSTAT™
• Examples
• Review: Data Interpretation
• Key Resources
CLICK TO EDIT MASTER TITLE
STYLE
5
WHY
IMPORTANT?
Effective and Efficient
Exposure Risk Management
Effective:
Ensure that no worker has
unacceptable exposures
Efficient:
Do it for minimum cost
6
7
7
What if our exposure assessment is wrong?
If we underestimate the exposure?
• Increased risk to employees
If we overestimate the exposure?
• Unnecessary expenditures for controls
• Unnecessary constraints for employees
and production
7
Well-Designed Exposure Risk
Management Strategy
We Want: We Don’t Want:
Good Data Bad Data
To Be Effective To Not Be Protective
To Be Efficient To Waste Resources
No Biases Biases (High or Low)
Low Uncertainty High Uncertainty
Correct Decisions Wrong Decisions
AIHA Exposure Risk Management Process
Comprehensive Exposure Assessment
and Management
• Goal is to understand and manage
all exposures
• Document both qualitative and
quantitative exposure assessments
• Document low exposures
• Emphasize Accurate and Efficient
Exposure Decisions
• Drive Effective and Efficient
Exposure Risk Management
• Devise OELs when needed
• Continuous Prioritization
• Continuous Improvement
• Identify the critical SEGs
• Anticipate and manage change
8
CLICK TO EDIT MASTER TITLE
STYLE
9
DECISION
STATISTIC
Decision Statistic:
•Relative to Appropriate OEL
•Defined BEFORE conducting exposure risk assessment
Defines Objective for Acceptable Exposure
(i.e. No Further Intervention Needed)
10
Decision Statistic:
1st Framing Question
An employee performs a job 100 days per year. If
you collected personal samples on the employee all
100 days, how many days is it acceptable for
exposures to exceed the Occupational Exposure
Limit (OEL) without a respirator?
1) 0 days?
2) 1 days?
3) 5 days?
4) 10 days?
5) 25 days?
6) 50 days?
11
Decision Statistic:
1st Framing Question
An employee performs a job 100 days per year. If
you collected personal samples on the employee all
100 days, how many days is it acceptable for
exposures to exceed the Occupational Exposure
Limit (OEL) without a respirator?
1) 0 days?
2) 1 days?
3) 5 days?
4) 10 days?
5) 25 days?
6) 50 days?
12
• Answers emphasize the desire for
very few days above the OEL
• Professional consensus developing
around targeting for no more than
5 days out of 100 above the OEL
(i.e. 95th Percentile)
95%ile
5/100 (5%) above
95/100 (95%) below
Concentration (ppm)
Concentration
Range
Frequency
175
150
125
100
75
50
25
0
95%ile
Chart of the 100 Air Samples:
Lognormally Distributed Data
13
Concentration (ppm)
Concentration
Range
Frequency
175
150
125
100
75
50
25
0
95%ile
Uncertainty
Chart of the 100 Air Samples:
Lognormally Distributed Data
14
Concentration (ppm)
Concentration
Range
Frequency
175
150
125
100
75
50
25
0
Usual Number of Samples << 100
95%ile
Uncertainty
?
?
15
Decision Statistic:
2nd Framing Question
How sure do you want to
be in your judgment?
16
?
?
1) 100% Sure?
2) 99%?
3) 95%?
4) 90%?
5) 70%?
6) 50%?
Decision Statistic:
2nd Framing Question
How sure do you want to
be in your judgment?
17
?
?
1) 100% Sure?
2) 99%?
3) 95%?
4) 90%?
5) 70%?
6) 50%?
• Answers express the desire for high confidence that
employees are protected.
• Implementing the AIHA Strategy with its emphasis on
driving follow-up actions and continuous improvement
enables a program to strive for high confidence.
• Common to strive for 95% confidence.
Decision Statistic:
“Strive for at least 95% confidence that the
true 95th percentile is less than the OEL”
OEL
95%ile
95%ile UCL
0 1 2 3 4
-2
0
2
4
6
8
10
0 0.2 0.4 0.6 0.8 1 1.2
Best Estimate
95% Upper Confidence
Best Estimate
Exposure Profile
95% Upper Confidence
Exposure Profile
Pulling Together 1st and 2nd Framing Questions:
18
CLICK TO EDIT MASTER TITLE
STYLE
19
AIHA
CATEGORIES
Exposure Rating Category** Recommended Control
0 (<1% of OEL) No action
1 (<10% of OEL) Procedures and Training; General Hazard Communication
2 (10-50% of OEL)
+ Chemical Specific Hazard Communication; Periodic Exposure
Monitoring,
3 (50-100% of OEL)
+ Required Exposure Monitoring, Workplace Inspections to Verify
Work Practice Controls; Medical Surveillance, Biological Monitoring
4 (>100% of OEL)
+ Implement Hierarchy of Controls; Monitoring to Validate
Respirator Protection Factor Selection.
Multiples of OEL (>500% of OEL
or others based on respirator APF)
+Immediate Engineering Controls or Process Shut Down, Validate
Acceptable Respirators
** Decision statistic = 95th percentile
AIHA Exposure Rating and Control Categories
20
AIHA Exposure Rating and Control Categories
Increase Effectiveness and Efficiency
• Avoid diminishing returns from
“over-refining” exposure estimates
• Streamline Documentation
• Facilitate Qualitative Exposure
Judgements
• Drive consistent follow-up
management and control activities
which lead to consistent risk
management.
21
CLICK TO EDIT MASTER TITLE
STYLE
22
EXPOSURE JUDGMENT
ACCURACY
?
Exposure Risk Decisions:
How Accurate Are We?
** Decision statistic = 95th percentile
Sample Results
(ppm)
18
15
5
8
12
When We Have Monitoring Data . . .
23
Video Tasks: Quantitative Judgment Accuracy
Pre- and Post- Statistical Training
24
P. Logan, G. Ramachandran, J. Mulhausen and P. Hewett “Occupational Exposure Decisions: Can Limited Data
Interpretation Training Help Improve Accuracy?”. Annals of Occupational Hygiene - 2009
Biased Low
Pre-Training
Statistical Training
Increased Accuracy
and Eliminated Bias
What About Real Life? . . .
25
Task results, Pre and Post training
7%
18%
28%
46%
1% 0% 0%
2%
11%
16%
69%
1% 0% 0%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
-3 -2 -1 0 1 2 3
%
correct
judgments
Pre Training Post training
Number of AIHA Categories Away From the Correct Category
Vadali, Ramachandran, Mulhausen & Banerjee (2012): Effect of Training on Exposure Judgment
Accuracy of Industrial Hygienists, Journal of Occupational and Environmental Hygiene, 9:4, 242-256
Statistical Training
Increased Accuracy
NIOSH Funded U of MN Study
Actual Workplace Assessments
26
Monitoring-Based
Exposure Judgments
• Bad News
• Often incorrect
• Good News
• Simple statistical training
improves judgments
• GREAT NEWS!!!
• Using statistical tools when we
make monitoring-based
exposure judgments will greatly
improve accuracy
27
Industrial Hygiene Statistics Beta 0.9 - For trial and testing only - Please do not distribute
Data Description: John Mulhausen
OEL DESCRIPTIVE STATISTICS
5 Number of Samples (n) 15
Maximum (max) 5.5
Sample Data Minimum (min) 1.2
(max n=50) Range 4.3
No less-than (<) Percent above OEL (%>OEL) 6.667
or greater-than (>) Mean 2.680
1.3 Median 2.500
1.8 Standard Deviation (s) 1.138
1.2 Mean of Log (LN) Transformed Data 0.908
4.5 Std Deviation of Log (LN) Transformed Data 0.407
2 Geometric Mean (GM) 2.479
2.1 Geometric Standard Deviation (GSD) 1.502
5.5
2.2 TEST FOR DISTRIBUTION FIT
3 W Test of Log (LN) Transformed Data 0.974
2.4 Lognormal (a=0.05)? Yes
2.5
2.5 W Test of Data 0.904
3.5 Normal (a=0.05)? Yes
2.8
2.9 LOGNORMAL PARAMETRIC STATISTICS
Estimated Arithmetic Mean - MVUE 2.677
1,95%LCL - Land's "Exact" 2.257
1,95%UCL - Land's "Exact" 3.327
95th Percentile 4.843
Upper Tolerance Limit (95%, 95%) 7.046
Percent Exceeding OEL (% > OEL) 4.241
1,95% LCL % > OEL 0.855
1,95% UCL % > OEL 15.271
NORMAL PARAMETRIC STATISTICS
Mean 2.680
1,95%LCL - t stats 2.162
1,95%UCL- t stats 3.198
95th Percentile - Z 4.553
Upper Tolerance Limit (95%, 95%) 5.60
Percent Exceeding OEL (% > OEL) 2.078
Linear Probability Plot and Least Squares
Best Fit Line
1%
2%
5%
10%
16%
25%
50%
75%
84%
90%
95%
98%
99%
-5 0 5 10
Concentration
Log-Probability Plot and Least Squares Best Fit Line
1%
2%
5%
10%
16%
25%
50%
75%
84%
90%
95%
98%
99%
0 1 10
Concentration
Idealized Lognormal Distribution
AM and CI's 95%ile
0
0.05
0.1
0.15
0.2
0.25
0.3
0.35
0.4
0.45
0 1 2 3 4 5 6 7
Concentration
Sequential Data Plot
0
1
2
3
4
5
6
0 2 4 6 8 10 12 14 16
Sample Number
Concentration
AIHA IHSTAT
Use Statistical Tools!!
28
95%ile = 1.2
0
0.05
0.1
0.15
0.2
0.25
0.3
0.35
0 0.5 1.0 1.5 2.0
Concentration (mg/M3)
UTL95%,95% =
16 mg/M3
AIHA
IHSTAT
Industrial Hygiene Statistics Beta 0.9 - For trial and testing only - Please do not distribute
Data Description: John Mulhausen
OEL DESCRIPTIVE STATISTICS
5 Number of Samples (n) 15
Maximum (max) 5.5
Sample Data Minimum (min) 1.2
(max n=50) Range 4.3
No less-than (<) Percent above OEL (%>OEL) 6.667
or greater-than (>) Mean 2.680
1.3 Median 2.500
1.8 Standard Deviation (s) 1.138
1.2 Mean of Log (LN) Transformed Data 0.908
4.5 Std Deviation of Log (LN) Transformed Data 0.407
2 Geometric Mean (GM) 2.479
2.1 Geometric Standard Deviation (GSD) 1.502
5.5
2.2 TEST FOR DISTRIBUTION FIT
3 W Test of Log (LN) Transformed Data 0.974
2.4 Lognormal (a=0.05)? Yes
2.5
2.5 W Test of Data 0.904
3.5 Normal (a=0.05)? Yes
2.8
2.9 LOGNORMAL PARAMETRIC STATISTICS
Estimated Arithmetic Mean - MVUE 2.677
1,95%LCL - Land's "Exact" 2.257
1,95%UCL - Land's "Exact" 3.327
95th Percentile 4.843
Upper Tolerance Limit (95%, 95%) 7.046
Percent Exceeding OEL (% > OEL) 4.241
1,95% LCL % > OEL 0.855
1,95% UCL % > OEL 15.271
NORMAL PARAMETRIC STATISTICS
Mean 2.680
1,95%LCL - t stats 2.162
1,95%UCL- t stats 3.198
95th Percentile - Z 4.553
Upper Tolerance Limit (95%, 95%) 5.60
Percent Exceeding OEL (% > OEL) 2.078
Linear Probability Plot and Least Squares
Best Fit Line
1%
2%
5%
10%
16%
25%
50%
75%
84%
90%
95%
98%
99%
-5 0 5 10
Concentration
Log-Probability Plot and Least Squares Best Fit Line
1%
2%
5%
10%
16%
25%
50%
75%
84%
90%
95%
98%
99%
0 1 10
Concentration
Idealized Lognormal Distribution
AM and CI's 95%ile
0
0.05
0.1
0.15
0.2
0.25
0.3
0.35
0.4
0.45
0 1 2 3 4 5 6 7
Concentration
Sequential Data Plot
0
1
2
3
4
5
6
0 2 4 6 8 10 12 14 16
Sample Number
Concentration
IH
Data
Analyst
Exposure Rating Category
<1%OEL <10% OEL 10 – 50% 50 – 100% >100% OEL
Probability
1
0.9
0.8
0.7
0.6
0.5
0.4
0.3
0.2
0.1
0
0 0
0.087
0.4
0.513
OEL
Likelihood that
95%ile falls into
indicated
Exposure Rating
Category
Initial
Qualitative
Assessment
or Validated
Model
Prior
Exposure Rating
0 1 2 3 4
Decision
Probability
1
0.8
0.6
0.4
0.2
0
0.05
0.2
0.5
0.2
0.05
Monitoring
Results
Likelihood
Exposure Rating
0 1 2 3 4
Decision
Probability
1
0.8
0.6
0.4
0.2
0
0 0 0.06
0.376
0.564
Integrated
Exposure
Assessment
Posterior
Exposure Rating
0 1 2 3 4
Decision
Probability
1
0.8
0.6
0.4
0.2
0
0 0
0.225
0.564
0.211
Expostats
Traditional Statistics Bayesian Statistics
28
CLICK TO EDIT MASTER TITLE
STYLE
29
EXPOSURE
VARIABILITY
Our Fundamental Issue:
Exposure Variability
+
Very Low Numbers of Samples
30
Annual population of exposures for one worker: 250 Worker-days per Year
Measurement
250
200
150
100
50
0
Concentration
6.5
6
5.5
5
4.5
4
3.5
3
2.5
2
1.5
1
0.5
0
Trying to understand this . . . .
31
Annual population of exposures for one worker: 250 Worker-days per Year
Measurement
250
200
150
100
50
0
Concentration
6.5
6
5.5
5
4.5
4
3.5
3
2.5
2
1.5
1
0.5
0
Based on this (n=5 samples) . . . .
“See” Only 2%
of Exposures
32
Measurement
250
200
150
100
50
0
Concentration
6.5
6
5.5
5
4.5
4
3.5
3
2.5
2
1.5
1
0.5
0
Measurement
250
200
150
100
50
0
Concentration
7
6
5
4
3
2
1
0
Measurement
250
200
150
100
50
0
Concentration
8
7
6
5
4
3
2
1
0
Measurement
250
200
150
100
50
0
Concentration
6.5
6
5.5
5
4.5
4
3.5
3
2.5
2
1.5
1
0.5
0
Measurement
250
200
150
100
50
0
Concentration
6.5
6
5.5
5
4.5
4
3.5
3
2.5
2
1.5
1
0.5
0
Measurement
250
200
150
100
50
0
Concentration
7
6
5
4
3
2
1
0
Measurement
250
200
150
100
50
0
Concentration
7
6
5
4
3
2
1
0
Measurement
250
200
150
100
50
0
Concentration
9
8
7
6
5
4
3
2
1
0
Measurement
250
200
150
100
50
0
Concentration
8
7
6
5
4
3
2
1
0
Measurement
250
200
150
100
50
0
Concentration
6
5.5
5
4.5
4
3.5
3
2.5
2
1.5
1
0.5
0
10 Worker SEG:
2500 Worker-days
per year
“See” Only 0.2%
of Exposures
33
CLICK TO EDIT MASTER TITLE
STYLE
34
INFERENTIAL IH
STATISTICS
Solution: Inferential Statistics . . . .
Estimate From What We Looked At
(Our Five Samples) . . .
The Actual Population Exposure
Profile (SEG of 10 Workers)
Using Knowledge of Underlying
Shape (Lognormal Distribution) . . .
35
Things can go wrong at several stages when
extrapolating sample data to make inferences
about the underlying population
Data
(measurements)
Sample
(Actual exposure
levels during
measurements)
Distribution of
which the sample
is representative
• Intrument
quality
• Interferences
• Exposure
periods missed
• Worst case
• Night shift
• Summer/winter
• Process changes
• Selection of workers
Inductive Inference
Target population
(exposure
distribution)
• Sample size
Confidence
intervals
36
Things can go wrong at several stages when
extrapolating sample data to make inferences
about the underlying population
Data
(measurements)
Sample
(Actual exposure
levels during
measurements)
Distribution of
which the sample
is representative
• Intrument
quality
• Interferences
• Exposure
periods missed
• Worst case
• Night shift
• Summer/winter
• Process changes
• Selection of workers
Inductive Inference
Target population
(exposure
distribution)
• Sample size
Confidence
intervals
Critical Data Quality Considerations
• Defined decision statistic
• Well defined SEG
• Appropriate OEL
• Well described exposure question
• Appropriate sampling strategy
• Valid and appropriate monitoring method
• Validated analytical method
37
Lognormal Model Most Appropriate?
38
• Many papers dating back to the 60s, in Europe and the US, have shown the lognormal
distribution to fit occupational exposure data reasonably well.
• Noise exposure data also follow a lognormal distribution when expressed as dose.
• Formal statistical tests exist but they have low power for small sample sizes, and reject
lognormality very (too) quickly for large sample sizes.
Lognormal Model Most Appropriate?
39
• Many papers dating back to the 60s, in Europe and the US, have shown the lognormal
distribution to fit occupational exposure data reasonably well.
• Noise exposure data also follow a lognormal distribution when expressed as dose.
• Formal statistical tests exist but they have low power for small sample sizes, and reject
lognormality very (too) quickly for large sample sizes.
A Pragmatic Approach:
• Assume lognormality based on historical weight of evidence
• Make a graphical check (Quantile - Quantile or log – probit
plot) to detect obvious departures from the model
“All models are wrong, some are useful”
- George E. P. Box
Always Check the
Lognormal Assumption
• Check your monitoring data for
lognormal distribution fit before
detailed analysis.
• If data is not lognormal go back
and verify SEG is constructed well.
• Are jobs/tasks truly similar?
• Does the data have errors?
• Should SEG be broken down to
smaller levels?
• Challenge your SEG assumptions.
• Many other factors . . .
40
Probability
Probit
3
2
1
0
-1
-2
-3
99
98
95
90
84
75
50
25
16
10
5
2
1 99
98
95
90
84
75
50
25
16
10
5
2
1
Concentration
0.01
0.1
1
Lognormal Distribution:
A model for exposure variability
41
Simple scatterplot
Histogram
Probability
density curve
41
probability
density
Less frequent
More frequent
Area under
the curve sums to
100% of the population
Values of the quantity of interest
Less frequent
𝑋𝑃%ile = 𝐺𝑀 ⋅ 𝐺𝑆𝐷𝑍𝑝
Interpreting a probability density curve is just like
interpreting a histogram . . .
42
95%ile = 𝐺𝑀 ⋅ 𝐺𝑆𝐷1.645
95%ile
95% 5%
probability
density
Lognormal Distribution
Defined by GM and GSD
Geometric mean (GM)
Measure location. Central parameter. Cuts
the distribution into 2 equal parts (median).
Geometric standard deviation (GSD)
Measure variability (~ distance between
the lowest and highest values)
Concentration Concentration
Median = GM
Mean
Mode
44
Calculate GM and GSD
Samples
xi (mg/m3)
0.84
0.98
0.42
1.16
1.36
2.66
Calculate GM and GSD
Samples
xi (mg/m3)
0.84
0.98
0.42
1.16
1.36
2.66
yi=ln(xi)
-0.1744
-0.0202
-0.8675
0.1484
0.3075
0.9783
1. Log-Transform Data:
e.g. yi=ln(xi)
Calculate GM and GSD
Samples
xi (mg/m3)
0.84
0.98
0.42
1.16
1.36
2.66
yi=ln(xi)
-0.1744
-0.0202
-0.8675
0.1484
0.3075
0.9783
2. Calculate Parameter of
Interest:
e.g. mean (y) and
standard deviation (sy)
1. Log-Transform Data:
e.g. yi=ln(xi)
y = 0.062
sy = 0.606
Calculate GM and GSD
Samples
xi (mg/m3)
0.84
0.98
0.42
1.16
1.36
2.66
yi=ln(xi)
-0.1744
-0.0202
-0.8675
0.1484
0.3075
0.9783
2. Calculate Parameter of
Interest:
e.g. mean (y) and
standard deviation (sy)
1. Log-Transform Data:
e.g. yi=ln(xi)
3. Calculate Anti-Log of the
Parameter of Interest:
e.g. GM=exp(y) and
GSD=exp(sy)
GM = 1.06
GSD = 1.83
y = 0.062
sy = 0.606
Calculate GM and GSD
Worked Example for Reference
Welding Fume Sample Data
Case
Samples
xi (mg/m3) yi=ln(xi) (yi-y)2
1 0.84 -0.1744 0.055877
2 0.98 -0.0202 0.006762
3 0.42 -0.8675 0.864025
4 1.16 0.1484 0.007463
5 1.36 0.3075 0.060248
6 2.66 0.9783 0.839600
Sum = 0.3722 1.833976
y = 0.0620
GM = 1.06
GSD = 1.83
49
_
_
𝐺𝑀 = exp
𝑦𝑖
𝑛
𝐺𝑆𝐷 = exp
𝑦𝑖 − 𝑦 2
𝑛 − 1
𝐺𝑀 = exp
0.3722
6
𝐺𝑀 = 1.06
𝐺𝑆𝐷 = exp
1.833976
6 − 1
𝐺𝑆𝐷 = 1.83
𝑦𝑖 = ln 𝑥𝑖
Calculate 95%ile
Worked Example for Reference
Welding Fume Sample Data
𝑋𝑃%ile = 𝐺𝑀 ⋅ 𝐺𝑆𝐷𝑍𝑝
95%ile = 𝐺𝑀 ⋅ 𝐺𝑆𝐷1.645
• Six full-shift TWA welding
fume measurements resulted
in the following statistics:
GM = 1.06 mg/m3
GSD = 1.83
• What is the point estimate
(i.e., best estimate) of the true
95th percentile?
95%ile = 1.06 ⋅ 1.831.645
95%ile = 2.86 mg/m3
95%ile = 2.86 mg/m3
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0 2 4 6 8 10
50
Upper Tolerance Limit (UTL) for the 95th Percentile
[Same as 95%ile Upper Confidence Limit (UCL)]
• Concept
• Calculate the 95% upper tolerance limit
(same as upper confidence limit) for the
95th percentile statistic to characterize
uncertainty in the point estimate
• Interpretation
• If the UTL95%,95% is less than the OEL,
then we can say that we are at least 95%
confident that the true 95th percentile is
less than the OEL
95%ile
0
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0.09
0.1
Distribution of
SEG Exposures
(Exposure Profile)
51
Upper Tolerance Limit (UTL) for the 95th Percentile
[Same as 95%ile Upper Confidence Limit (UCL)]
• Concept
• Calculate the 95% upper tolerance limit
(same as upper confidence limit) for the
95th percentile statistic to characterize
uncertainty in the point estimate
• Interpretation
• If the UTL95%,95% is less than the OEL,
then we can say that we are at least 95%
confident that the true 95th percentile is
less than the OEL
95%ile
0
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0.09
0.1
95%ile point
estimate
95%ile point
estimate
uncertainty
distribution
Distribution of
SEG Exposures
(Exposure Profile)
52
Upper Tolerance Limit (UTL) for the 95th Percentile
[Same as 95%ile Upper Confidence Limit (UCL)]
• Concept
• Calculate the 95% upper tolerance limit
(same as upper confidence limit) for the
95th percentile statistic to characterize
uncertainty in the point estimate
• Interpretation
• If the UTL95%,95% is less than the OEL,
then we can say that we are at least 95%
confident that the true 95th percentile is
less than the OEL
95%ile
0
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0.09
0.1
95%ile point
estimate
95%ile point
estimate
uncertainty
distribution
95% upper confidence limit
for the 95%ile estimate
UTL95%,95%
Distribution of
SEG Exposures
(Exposure Profile)
53
Upper Tolerance Limit (UTL) for the 95th Percentile
[Same as 95%ile Upper Confidence Limit (UCL)]
• Concept
• Calculate the 95% upper tolerance limit
(same as upper confidence limit) for the
95th percentile statistic to characterize
uncertainty in the point estimate
• Interpretation
• If the UTL95%,95% is less than the OEL,
then we can say that we are at least 95%
confident that the true 95th percentile is
less than the OEL
95%ile
0
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0.09
0.1
95%ile point
estimate
95%ile point
estimate
uncertainty
distribution
95% upper confidence limit
for the 95%ile estimate
UTL95%,95%
UTL95%,95% = UCL95,95
Distribution of
SEG Exposures
(Exposure Profile)
54
Upper Tolerance Limit (UTL) for the 95th Percentile
[Same as 95%ile Upper Confidence Limit (UCL)]
• Concept
• Calculate the 95% upper tolerance limit
(same as upper confidence limit) for the
95th percentile statistic to characterize
uncertainty in the point estimate
• Interpretation
• If the UTL95%,95% is less than the OEL,
then we can say that we are at least 95%
confident that the true 95th percentile is
less than the OEL
95%ile
0
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0.09
0.1
UTL95%,95% = UCL95,95
Distribution of
SEG Exposures
(Exposure Profile)
55
Calculate UTL95%,95% for the 95th Percentile
(UTL95%,95% = UCL95%,95%)
Procedure:
1.Calculate the GM and GSD
2.Using n, read the UTL K-value from
the appropriate table
g = confidence level, e.g., 0.95
p = proportion, e.g., 0.95
n = sample size
3.Using GM, GSD, and K, calculate the
UTL95%,95%:
56
𝑦 = ln 𝐺𝑀
𝑠𝑦 = ln 𝐺𝑆𝐷
𝑈𝑇𝐿95%,95% = exp 𝑦 + 𝐾 ⋅ 𝑠𝑦
Factors for one-sided tolerance limits
for normal distributions*
*Partial Table IV.11 - A Strategy for Assessing
and Managing Occupational Exposures, Fourth
Edition. AIHA Press 2015.
Worked Example for Reference:
Calculate 95%ile UTL95%,95
Welding Fume Sample Data
• Six full-shift TWA welding fume
measurements:
GM = 1.06 mg/m3
GSD = 1.83
• What is the 95th percentile UTL95%,95%?
𝑈𝑇𝐿95%,95% = exp 𝑦 + 𝐾 ⋅ 𝑠𝑦
𝑈𝑇𝐿95%,95% = exp 0.058 + 3.707 ⋅ 0.604
𝑠𝑦 = ln 𝐺𝑆𝐷 = ln( 1.83) = 0.604
𝑦 = ln 𝐺𝑀 = ln 1.06 = 0.058
𝑈𝑇𝐿95%,95% = 10mg/m3
95%ile =
2.86 mg/m3
UTL95%,95% =
10 mg/m3
0
0.2
0.4
0.6
0.8
0 2 4 6 8 10
57
Factors for one-sided tolerance limits
for normal distributions
CLICK TO EDIT MASTER TITLE
STYLE
58
aiha.org | 58
DATA INTERPRETATION
USING IHSTAT
Use Statistical Tools!!
59
95%ile = 1.2
0
0.05
0.1
0.15
0.2
0.25
0.3
0.35
0 0.5 1.0 1.5 2.0
Concentration (mg/M3)
UTL95%,95% =
16 mg/M3
AIHA
IHSTAT
Industrial Hygiene Statistics Beta 0.9 - For trial and testing only - Please do not distribute
Data Description: John Mulhausen
OEL DESCRIPTIVE STATISTICS
5 Number of Samples (n) 15
Maximum (max) 5.5
Sample Data Minimum (min) 1.2
(max n=50) Range 4.3
No less-than (<) Percent above OEL (%>OEL) 6.667
or greater-than (>) Mean 2.680
1.3 Median 2.500
1.8 Standard Deviation (s) 1.138
1.2 Mean of Log (LN) Transformed Data 0.908
4.5 Std Deviation of Log (LN) Transformed Data 0.407
2 Geometric Mean (GM) 2.479
2.1 Geometric Standard Deviation (GSD) 1.502
5.5
2.2 TEST FOR DISTRIBUTION FIT
3 W Test of Log (LN) Transformed Data 0.974
2.4 Lognormal (a=0.05)? Yes
2.5
2.5 W Test of Data 0.904
3.5 Normal (a=0.05)? Yes
2.8
2.9 LOGNORMAL PARAMETRIC STATISTICS
Estimated Arithmetic Mean - MVUE 2.677
1,95%LCL - Land's "Exact" 2.257
1,95%UCL - Land's "Exact" 3.327
95th Percentile 4.843
Upper Tolerance Limit (95%, 95%) 7.046
Percent Exceeding OEL (% > OEL) 4.241
1,95% LCL % > OEL 0.855
1,95% UCL % > OEL 15.271
NORMAL PARAMETRIC STATISTICS
Mean 2.680
1,95%LCL - t stats 2.162
1,95%UCL- t stats 3.198
95th Percentile - Z 4.553
Upper Tolerance Limit (95%, 95%) 5.60
Percent Exceeding OEL (% > OEL) 2.078
Linear Probability Plot and Least Squares
Best Fit Line
1%
2%
5%
10%
16%
25%
50%
75%
84%
90%
95%
98%
99%
-5 0 5 10
Concentration
Log-Probability Plot and Least Squares Best Fit Line
1%
2%
5%
10%
16%
25%
50%
75%
84%
90%
95%
98%
99%
0 1 10
Concentration
Idealized Lognormal Distribution
AM and CI's 95%ile
0
0.05
0.1
0.15
0.2
0.25
0.3
0.35
0.4
0.45
0 1 2 3 4 5 6 7
Concentration
Sequential Data Plot
0
1
2
3
4
5
6
0 2 4 6 8 10 12 14 16
Sample Number
Concentration
IH
Data
Analyst
Exposure Rating Category
<1%OEL <10% OEL 10 – 50% 50 – 100% >100% OEL
Probability
1
0.9
0.8
0.7
0.6
0.5
0.4
0.3
0.2
0.1
0
0 0
0.087
0.4
0.513
OEL
Likelihood that
95%ile falls into
indicated
Exposure Rating
Category
Initial
Qualitative
Assessment
or Validated
Model
Prior
Exposure Rating
0 1 2 3 4
Decision
Probability
1
0.8
0.6
0.4
0.2
0
0.05
0.2
0.5
0.2
0.05
Monitoring
Results
Likelihood
Exposure Rating
0 1 2 3 4
Decision
Probability
1
0.8
0.6
0.4
0.2
0
0 0 0.06
0.376
0.564
Integrated
Exposure
Assessment
Posterior
Exposure Rating
0 1 2 3 4
Decision
Probability
1
0.8
0.6
0.4
0.2
0
0 0
0.225
0.564
0.211
Expostats
Traditional Statistics Bayesian Statistics
Focus on Traditional
IH Statistics
59
FREE Traditional Statistical Tools
• IHSTAT (macro-free version)
https://www.aiha.org/public-
resources/consumer-resources/topics-of-
interest/ih-apps-tools
• IHSTAT (multi-language version)
https://www.aiha.org/public-
resources/consumer-resources/topics-of-
interest/ih-apps-tools
• HYGINIST http://www.tsac.nl/hyginist.html
FREE
TOOLS!!
60
AIHA
IHSTAT
Enter Sample Data
GM
and
GSD
Enter OEL
61
AIHA
IHSTAT
95%ile
and
UTL95,95
(UCL95,95)
62
AIHA
IHSTAT
Plot to check for sample data lognormality
63
AIHA
IHSTAT
Plot of “Best Guess” SEG exposure profile
64
* Decision statistic = 95th percentile
?
Into which AIHA Exposure Category will the 95th percentile MOST
LIKELY fall?
OEL = 100 ppm
Sample Results
(ppm)
18
15
5
8
12
65
Into which AIHA Exposure Category will the 95th percentile MOST
LIKELY fall?
OEL = 100 ppm
Inferential
Statistics
OEL
95%ile 95%ile
UCL
-0.01
0
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0.09
0 20 40 60 80 100 120
GM = 10.5 ppm
GSD = 1.67
95%ile = 24.5 ppm
95%ile UCL95,95 (UTL) = 91.6 ppm
Exposure
Category
Sample Results
(ppm)
18
15
5
8
12
“Best Guess” Population
(SEG) Exposure Profile
Follow-Up
Actions
66
Steps in Data Analysis and Interpretation*
1. Enter Data Into Appropriate Statistical Tool
2. Evaluate the Goodness-of-fit
3. Review Descriptive and Inferential Statistics
Compare…
• the “decision statistic” (e.g., sample 95th percentile) to the OEL.
• the 95%UCL to the OEL.
4. Assign a Final Rating and Certainty Level
• Final Rating: Compare the sample 95th percentile to the Exposure
Control Categories (ECCs) and select a category.
• Certainty Level: Compare the 95%UCL to the ECCs:
• Low certainty if > 2 categories above the chosen ECC
• Medium certainty if only 1 category above
• High certainty if within chosen category
5. Document the Analysis and Recommendations
Recommend controls and/or PPE; work practice evaluation; additional
sampling; surveillance sampling, etc.
67
*After Executing a Carefully
Defined Monitoring Plan:
• Defined decision statistic
• Well defined SEG
• Appropriate OEL
• Well described exposure question
• Appropriate sampling strategy
• Valid and appropriate monitoring
method
• Validated analytical method
Hewett’s
ROT
67
CLICK TO EDIT MASTER TITLE
STYLE
68
EXAMPLES
* Decision statistic = 95th percentile
?
Into which AIHA Exposure Category will the 95th percentile
MOST LIKELY fall?
OEL = 100 ppm
Sample Results
(ppm)
18
15
5
8
12
69
Example 1
Sample Results
(ppm)
18
15
5
8
12
OEL = 100 ppm GM = 10.5 ppm
GSD = 1.67
95%ile = 24.5 ppm
95%ile UCL95,95 = 91.6 ppm
70
Exposure Rating
Category*
0
(<1% of
OEL)
1
(<10% of
OEL)
2
(10-50% of
OEL)
3
(50-100%
of OEL)
4
(>100% of
OEL)
Multiples of OEL
(>500% of OEL
or others based
on respirator
APF)
Recommended Control No action Procedures and
Training;
General Hazard
Communication
+ Chemical
Specific Hazard
Communication;
Periodic
Exposure
Monitoring,
+ Required
Exposure
Monitoring,
Workplace
Inspections to
Verify Work
Practice
Controls; Medical
Surveillance,
Biological
Monitoring
+ Implement
Hierarchy of
Controls;
Monitoring to
Validate
Respirator
Protection Factor
Selection.
+Immediate
Engineering
Controls or
Process Shut
Down, Validate
Acceptable
Respirators
OEL
95%ile 95%ile
UCL
-0.01
0
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0.09
0 20 40 60 80 100 120
Sample Results
(ppm)
18
15
5
8
12
OEL = 100 ppm GM = 10.5 ppm
GSD = 1.67
95%ile = 24.5 ppm
95%ile UCL95,95 = 91.6 ppm
71
Exposure Rating
Category*
0
(<1% of
OEL)
1
(<10% of
OEL)
2
(10-50% of
OEL)
3
(50-100%
of OEL)
4
(>100% of
OEL)
Multiples of OEL
(>500% of OEL
or others based
on respirator
APF)
Recommended Control No action Procedures and
Training;
General Hazard
Communication
+ Chemical
Specific Hazard
Communication;
Periodic
Exposure
Monitoring,
+ Required
Exposure
Monitoring,
Workplace
Inspections to
Verify Work
Practice
Controls; Medical
Surveillance,
Biological
Monitoring
+ Implement
Hierarchy of
Controls;
Monitoring to
Validate
Respirator
Protection Factor
Selection.
+Immediate
Engineering
Controls or
Process Shut
Down, Validate
Acceptable
Respirators
OEL
95%ile 95%ile
UCL
-0.01
0
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0.09
0 20 40 60 80 100 120
95%ile Most Likely
in Category 2
(Medium Certainty)
Sample Results
(ppm)
18
15
5
8
12
OEL = 100 ppm GM = 10.5 ppm
GSD = 1.67
95%ile = 24.5 ppm
95%ile UCL95,95 = 91.6 ppm
72
Exposure Rating
Category*
0
(<1% of
OEL)
1
(<10% of
OEL)
2
(10-50% of
OEL)
3
(50-100%
of OEL)
4
(>100% of
OEL)
Multiples of OEL
(>500% of OEL
or others based
on respirator
APF)
Recommended Control No action Procedures and
Training;
General Hazard
Communication
+ Chemical
Specific Hazard
Communication;
Periodic
Exposure
Monitoring,
+ Required
Exposure
Monitoring,
Workplace
Inspections to
Verify Work
Practice
Controls; Medical
Surveillance,
Biological
Monitoring
+ Implement
Hierarchy of
Controls;
Monitoring to
Validate
Respirator
Protection Factor
Selection.
+Immediate
Engineering
Controls or
Process Shut
Down, Validate
Acceptable
Respirators
OEL
95%ile 95%ile
UCL
-0.01
0
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0.09
0 20 40 60 80 100 120
95%ile Most Likely
in Category 2
(Medium Certainty)
More Than 95%
Confident That True
95%ile Exposure <OEL
Sample Results
(ppm)
18
15
5
8
12
OEL = 100 ppm GM = 10.5 ppm
GSD = 1.67
95%ile = 24.5 ppm
95%ile UCL95,95 = 91.6 ppm
73
Exposure Rating
Category*
0
(<1% of
OEL)
1
(<10% of
OEL)
2
(10-50% of
OEL)
3
(50-100%
of OEL)
4
(>100% of
OEL)
Multiples of OEL
(>500% of OEL
or others based
on respirator
APF)
Recommended Control No action Procedures and
Training;
General Hazard
Communication
+ Chemical
Specific Hazard
Communication;
Periodic
Exposure
Monitoring,
+ Required
Exposure
Monitoring,
Workplace
Inspections to
Verify Work
Practice
Controls; Medical
Surveillance,
Biological
Monitoring
+ Implement
Hierarchy of
Controls;
Monitoring to
Validate
Respirator
Protection Factor
Selection.
+Immediate
Engineering
Controls or
Process Shut
Down, Validate
Acceptable
Respirators
OEL
95%ile 95%ile
UCL
-0.01
0
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0.09
0 20 40 60 80 100 120
95%ile Most Likely
in Category 2
(Medium Certainty)
More Than 95%
Confident That True
95%ile Exposure <OEL
Sample Results
(ppm)
18
15
5
8
12
OEL = 100 ppm GM = 10.5 ppm
GSD = 1.67
95%ile = 24.5 ppm
95%ile UCL95,95 = 91.6 ppm
Follow-Up Actions:
• Procedures and
Training; General Haz.
Com.
• + Chemical Specific
Haz. Com.; Periodic
Exposure Monitoring,
74
* Decision statistic = 95th percentile
?
Into which AIHA Exposure Category will the 95th percentile
MOST LIKELY fall?
OEL = 100 ppm
75
Example 2
Sample Results
(ppm)
8
75
5
37
12
Exposure Rating
Category*
0
(<1% of
OEL)
1
(<10% of
OEL)
2
(10-50% of
OEL)
3
(50-100%
of OEL)
4
(>100% of
OEL)
Multiples of OEL
(>500% of OEL
or others based
on respirator
APF)
Recommended Control No action Procedures and
Training;
General Hazard
Communication
+ Chemical
Specific Hazard
Communication;
Periodic
Exposure
Monitoring,
+ Required
Exposure
Monitoring,
Workplace
Inspections to
Verify Work
Practice
Controls; Medical
Surveillance,
Biological
Monitoring
+ Implement
Hierarchy of
Controls;
Monitoring to
Validate
Respirator
Protection Factor
Selection.
+Immediate
Engineering
Controls or
Process Shut
Down, Validate
Acceptable
Respirators
OEL
95%ile
0
0.005
0.01
0.015
0.02
0.025
0.03
0.035
0.04
0.045
0 20 40 60 80 100 120
95%ile Most Likely in
Category 4
(High Certainty)
Far Less Than 95%
Confident That True 95%ile
Exposure <OEL as 95%ile
Point Estimate >OEL
Sample Results
(ppm)
8
75
5
37
12
OEL = 100 ppm GM = 16.8 ppm
GSD = 3.06
95%ile = 105 ppm
95%ile UCL95,95 = 1836 ppm
Follow-Up Actions:
+ Implement Hierarchy of
Controls; Monitoring to
Validate Respirator
Protection Factor
Selection.
76
* Decision statistic = 95th percentile
?
Into which AIHA Exposure Category will the 95th percentile
MOST LIKELY fall?
OEL = 100 ppm
77
Example 3
Sample Results
(ppm)
0.75
5
2
1
3
Exposure Rating
Category*
0
(<1% of
OEL)
1
(<10% of
OEL)
2
(10-50% of
OEL)
3
(50-100%
of OEL)
4
(>100% of
OEL)
Multiples of OEL
(>500% of OEL
or others based
on respirator
APF)
Recommended Control No action Procedures and
Training;
General Hazard
Communication
+ Chemical
Specific Hazard
Communication;
Periodic
Exposure
Monitoring,
+ Required
Exposure
Monitoring,
Workplace
Inspections to
Verify Work
Practice
Controls; Medical
Surveillance,
Biological
Monitoring
+ Implement
Hierarchy of
Controls;
Monitoring to
Validate
Respirator
Protection Factor
Selection.
+Immediate
Engineering
Controls or
Process Shut
Down, Validate
Acceptable
Respirators
Sample Results
(ppm)
0.75
5
2
1
3
OEL = 100 ppm GM = 1.9 ppm
GSD = 2.18
95%ile = 6.7 ppm
95%ile UCL95,95 = 49 ppm
95%ile
95%ile
UCL
0
0.05
0.1
0.15
0.2
0.25
0.3
0.35
0.4
0 20 40 60
OEL
95%ile Most Likely in
Category 1
(Medium Certainty)
More Than 95%
Confident That True
95%ile Exposure <OEL
Follow-Up Actions:
• Procedures and
Training; General Haz.
Com.
• Consider Periodic
Monitoring
78
* Decision statistic = 95th percentile
?
Into which AIHA Exposure Category will the 95th percentile
MOST LIKELY fall?
OEL = 100 ppm
79
Example 4
Sample Results
(ppm)
8
25
5
Exposure Rating
Category*
0
(<1% of
OEL)
1
(<10% of
OEL)
2
(10-50% of
OEL)
3
(50-100%
of OEL)
4
(>100% of
OEL)
Multiples of OEL
(>500% of OEL
or others based
on respirator
APF)
Recommended Control No action Procedures and
Training;
General Hazard
Communication
+ Chemical
Specific Hazard
Communication;
Periodic
Exposure
Monitoring,
+ Required
Exposure
Monitoring,
Workplace
Inspections to
Verify Work
Practice
Controls; Medical
Surveillance,
Biological
Monitoring
+ Implement
Hierarchy of
Controls;
Monitoring to
Validate
Respirator
Protection Factor
Selection.
+Immediate
Engineering
Controls or
Process Shut
Down, Validate
Acceptable
Respirators
Sample Results
(ppm)
8
25
5
OEL = 100 ppm
GM = 10.0 ppm
GSD = 2.3
95%ile = 39.0 ppm
95%ile UCL95,95 = 5641.1 ppm
OEL
95%ile
0
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0 20 40 60 80 100 120
95% UCL
95%ile Likely in
Category 2 ???
(Low Certainty)
Less Than 95% Confident That
True 95%ile Exposure <OEL
Follow-Up Actions:
• Procedures and
Training; General Haz.
Com.
• + Chemical Specific
Haz. Com.; Required
Exposure Monitoring,
80
OEL = 100 ppm
Sample
Results
(ppm)
8
25
5
10
3
OEL = 100 ppm Sample
Results
(ppm)
8
25
5
10
3
7
11
OEL = 100 ppm
Sample
Results
(ppm)
8
25
5
GM = 10.0 ppm
GSD = 2.3
95%ile = 39.0 ppm
95%ile UCL95,95 =5641.1 ppm
GM = 7.9 ppm
GSD = 2.2
95%ile = 29.1 ppm
95%ile UCL95,95 = 222.1 ppm
GM = 8.1 ppm
GSD = 1.9
95%ile = 24.2 ppm
95%ile UCL95,95 = 77.6 ppm
OEL
95%ile
95%ile
UCL
01 2 3 4
-0.02
0
0.02
0.04
0.06
0.08
0.1
0 20 40 60 80 100 120
OEL
95%ile 95%ile
UCL
0
1
2
3
4
-0.02
-0.01
0
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0 1000 2000 3000 4000 5000 6000
OEL
95%ile 95%ile
UCL
0
1 2 3 4
-0.02
0
0.02
0.04
0.06
0.08
0.1
0 50 100 150 200 250
81
Change in UCL95%,95% and LCL95%,95%
With Increasing Number of Samples
Idealized
GSD = 2 Random measurements generated
from a distribution where the true
GSD=3.0 and the true 95%ile=1.
Simulated
Number of Samples Number of Samples
82
* Decision statistic = 95th percentile
?
Into which AIHA Exposure Category will the 95th percentile
MOST LIKELY fall?
OEL = 100 ppm
83
Example 5
Sample Results
(ppm)
8
55
5
37
12
Exposure Rating
Category*
0
(<1% of
OEL)
1
(<10% of
OEL)
2
(10-50% of
OEL)
3
(50-100%
of OEL)
4
(>100% of
OEL)
Multiples of OEL
(>500% of OEL
or others based
on respirator
APF)
Recommended Control No action Procedures and
Training;
General Hazard
Communication
+ Chemical
Specific Hazard
Communication;
Periodic
Exposure
Monitoring,
+ Required
Exposure
Monitoring,
Workplace
Inspections to
Verify Work
Practice
Controls; Medical
Surveillance,
Biological
Monitoring
+ Implement
Hierarchy of
Controls;
Monitoring to
Validate
Respirator
Protection Factor
Selection.
+Immediate
Engineering
Controls or
Process Shut
Down, Validate
Acceptable
Respirators
Sample Results
(ppm)
8
55
5
37
12
OEL = 100 ppm GM = 15.8 ppm
GSD = 2.8
95%ile =84.1 ppm
95%ile UCL95,95 = 1135.3 ppm OEL
95%ile
0
0.005
0.01
0.015
0.02
0.025
0.03
0.035
0.04
0.045
0 20 40 60 80 100 120
95% UCL
95%ile Likely in
Category 3 ? 4 ???
(Low Certainty)
Less Than 95%
Confident That True
95%ile Exposure <OEL
Follow-Up Actions:
+ Required Exposure
Monitoring, Workplace
Inspections to Verify Work
Practice Controls; Medical
Surveillance, Biological
Monitoring
+ Consider Implementing
Hierarchy of Controls;
84
A Few Words About Handling Censored Data . . .
Sample
Results
(ppm)
8
25
<5
10
<3
7
11
A Few Words About Handling Censored Data . . .
Do:
• Minimize the Likelihood and Impact of Censored Data
with Good Sample Planning
• Strive for a detection limit that is less than 10% of the OEL.
• Ask the laboratory performing sample analysis if they would
calculate results down to their limit of detection (LOD) in
addition to their limit of quantification (LOQ) as the LOD is
often significantly lower than the LOQ.
Sample
Results
(ppm)
8
25
<5
10
<3
7
11
A Few Words About Handling Censored Data . . .
Do:
• Minimize the Likelihood and Impact of Censored Data
with Good Sample Planning
• Strive for a detection limit that is less than 10% of the OEL.
• Ask the laboratory performing sample analysis if they would
calculate results down to their limit of detection (LOD) in
addition to their limit of quantification (LOQ) as the LOD is
often significantly lower than the LOQ.
Don’t:
• Remove the non-detects from the statistical analysis.
• Perform data analysis with the detection limit
substituted for the less-than values.
Sample
Results
(ppm)
8
25
<5
10
<3
7
11
Parametric Censored Data Analysis Methods
(Assumes Lognormal Distribution)
• Simple Substitution - DL/2 or DL/sqrt(2)
• Very easy to implement
• Reasonable performance [particularly DL/sqrt(2) for 95%ile estimation] for low n (<20)
and low (<25%) to moderate (25-50%) censoring.
• Maximum Likelihood Estimates (MLE)
• Complex calculations
• Closest to best universal method
• Beta Substitution
• Straight forward to program in a spreadsheet
• Performance similar to MLE
• Log-Probit Regression (LPR) - also called Regression on Order Statistics (ROS)
• Straight forward to program in a spreadsheet
• Good choice for 25% to 50% censored data if n greater than 10 or 15.
Sample
Results
(ppm)
8
25
<5
10
<3
7
11
Parametric Censored Data Analysis Methods
(Assumes Lognormal Distribution)
• Simple Substitution - DL/2 or DL/sqrt(2)
• Very easy to implement
• Reasonable performance [particularly DL/sqrt(2) for 95%ile estimation] for low n (<20)
and low (<25%) to moderate (25-50%) censoring.
• Maximum Likelihood Estimates (MLE)
• Complex calculations
• Closest to best universal method
• Beta Substitution
• Straight forward to program in a spreadsheet
• Performance similar to MLE
• Log-Probit Regression (LPR) - also called Regression on Order Statistics (ROS)
• Straight forward to program in a spreadsheet
• Good choice for 25% to 50% censored data if n greater than 10 or 15.
Simple
Option for
IHSTAT
Sample
Results
(ppm)
8
25
<5
10
<3
7
11
Parametric Censored Data Analysis Methods
(Assumes Lognormal Distribution)
• Simple Substitution - DL/2 or DL/sqrt(2)
• Very easy to implement
• Reasonable performance [particularly DL/sqrt(2) for 95%ile estimation] for low n (<20)
and low (<25%) to moderate (25-50%) censoring.
• Maximum Likelihood Estimates (MLE)
• Complex calculations
• Closest to best universal method
• Beta Substitution
• Straight forward to program in a spreadsheet
• Performance similar to MLE
• Log-Probit Regression (LPR) - also called Regression on Order Statistics (ROS)
• Straight forward to program in a spreadsheet
• Good choice for 25% to 50% censored data if n greater than 10 or 15.
• Bayesian Decision Analysis
• BDA uses same equations as MLE
• Superior performance for characterizing parameter uncertainty
• Can readily analyze censored data, including fully censored datasets
Simple
Option for
IHSTAT
Sample
Results
(ppm)
8
25
<5
10
<3
7
11
Parametric Censored Data Analysis Methods
(Assumes Lognormal Distribution)
• Simple Substitution - DL/2 or DL/sqrt(2)
• Very easy to implement
• Reasonable performance [particularly DL/sqrt(2) for 95%ile estimation] for low n (<20)
and low (<25%) to moderate (25-50%) censoring.
• Maximum Likelihood Estimates (MLE)
• Complex calculations
• Closest to best universal method
• Beta Substitution
• Straight forward to program in a spreadsheet
• Performance similar to MLE
• Log-Probit Regression (LPR) - also called Regression on Order Statistics (ROS)
• Straight forward to program in a spreadsheet
• Good choice for 25% to 50% censored data if n greater than 10 or 15.
• Bayesian Decision Analysis
• BDA uses same equations as MLE
• Superior performance for characterizing parameter uncertainty
• Can readily analyze censored data, including fully censored datasets
Simple
Option for
IHSTAT
Sample
Results
(ppm)
8
25
<5
10
<3
7
11
Sample
Results
(ppm)
8
25
<5
10
<3
7
11
OEL = 100 ppm
Example:
IHSTAT Analysis of Censored Data Using Simple Substitution:
Detection Limit Divided by Square Root of Two [DL / sqrt(2)]
29% censored
Sample
Results
(ppm)
8
25
<5
10
<3
7
11
OEL = 100 ppm
Sample Results
With Substitutions
for Non-Detects
(ppm)
8
25
3.54
10
2.12
7
11
Substitute
𝐷𝐿
2
=
𝐷𝐿
1.4142
Example:
IHSTAT Analysis of Censored Data Using Simple Substitution:
Detection Limit Divided by Square Root of Two [DL / sqrt(2)]
29% censored
Sample
Results
(ppm)
8
25
<5
10
<3
7
11
OEL = 100 ppm
Sample Results
With Substitutions
for Non-Detects
(ppm)
8
25
3.54
10
2.12
7
11
Substitute
𝐷𝐿
2
=
𝐷𝐿
1.4142
Example:
IHSTAT Analysis of Censored Data Using Simple Substitution:
Detection Limit Divided by Square Root of Two [DL / sqrt(2)]
29% censored
Exposure Rating
Category*
0
(<1% of
OEL)
1
(<10% of
OEL)
2
(10-50%
of OEL)
3
(50-100%
of OEL)
4
(>100% of
OEL)
Multiples of OEL
(>500% of OEL
or others based
on respirator
APF)
Recommended Control No action Procedures and
Training; General
Hazard
Communication
+ Chemical
Specific
Hazard
Communicatio
n; Periodic
Exposure
Monitoring,
+ Required
Exposure
Monitoring,
Workplace
Inspections to
Verify Work
Practice Controls;
Medical
Surveillance,
Biological
Monitoring
+ Implement
Hierarchy of
Controls;
Monitoring to
Validate
Respirator
Protection Factor
Selection.
+Immediate
Engineering
Controls or
Process Shut
Down, Validate
Acceptable
Respirators
OEL
95%ile 95%ile
UCL
0
0.005
0.01
0.015
0.02
0.025
0.03
0 20 40 60 80 100 120 140 160 180 200
OEL = 100 ppm
Sample Results
DL/sqrt(2) Substitution
for Non-Detects
(ppm)
8
25
<5  3.54
10
<3  2.12
7
11
GM = 7.35 ppm
GSD = 2.3
95%ile =27.4 ppm
UTL95%,95% = 112 ppm
95%ile Most Likely
in Category 2
(Low Certainty)
Less Than 95% Confident That
True 95%ile Exposure <OEL
29% censored
Example:
BDA Analysis of Censored Data
Sample
Results
(ppm)
8
25
<5
10
<3
7
11
OEL = 100 ppm
29% censored
Example:
BDA Analysis of Censored Data
No Substitution
Needed
Enter Directly Into Bayesian
Statistical Analysis Tool
(IHDA or Expostats)
Sample
Results
(ppm)
8
25
<5
10
<3
7
11
OEL = 100 ppm
29% censored
Expostats
Learn More: Censored Data References
• IHDA Help File
• Hewett, P. Appendix VIII: Analysis of Censored Data. A Strategy for Assessing and Managing
Occupational Exposures. 4th Ed. AIHA Press. 2015.
• Hewett, P., and G. Ganser. “A Comparison of Several Methods for Analyzing Censored
Data”. Ann. Occup. Hyg., Vol. 51, No. 7, pp. 611–632, 2007
• Ganser, G. and P. Hewett. “An Accurate Substitution Method for Analyzing Censored Data”.
Journal of Occupational and Environmental Hygiene, 7:4, 233-244, 2010.
• Huynh, Tran, Harrison Quick, Gurumurthy Ramachandran, Sudipto Banerjee, Mark Stenzel,
Dale P Sandler, Lawrence S Engel, Richard K Kwok, Aaron Blair, and Patricia A Stewart. “A
Comparison of the β-Substitution Method and a Bayesian Method for Analyzing Left-
Censored Data.” The Annals of Occupational Hygiene 60, no. 1 (January 2016): 56–73.
• Helsel, D. Non Detects and Data Analysis - Statistics for Censored Environmental Data.
Hoboken, NJ: John Wiley & Sons, Inc., 2005.
• Helsel, Dennis R. Statistics for Censored Environmental Data Using Minitab and R
(CourseSmart). Wiley, 2012.
CLICK TO EDIT MASTER TITLE
STYLE
99
aiha.org | 99
REVIEW:
DATA
INTERPRETATION
REVIEW: Steps in Data Analysis and Interpretation*
100
*After Executing a Carefully
Defined Monitoring Plan:
• Defined decision statistic
• Well defined SEG
• Appropriate OEL
• Well described exposure question
• Appropriate sampling strategy
• Valid and appropriate monitoring
method
• Validated analytical method
100
Preparation:
Collect High Quality Data
*After Executing a Carefully
Defined Monitoring Plan:
• Defined decision statistic
• Well defined SEG
• Appropriate OEL
• Well described exposure question
• Appropriate sampling strategy
• Valid and appropriate monitoring
method
• Validated analytical method
REVIEW: Steps in Data Analysis and Interpretation*
1. Enter Data Into Appropriate Statistical Tool
2. Evaluate the Goodness-of-fit
101
101
Evaluate Lognormal Assumption
*After Executing a Carefully
Defined Monitoring Plan:
• Defined decision statistic
• Well defined SEG
• Appropriate OEL
• Well described exposure question
• Appropriate sampling strategy
• Valid and appropriate monitoring
method
• Validated analytical method
REVIEW: Steps in Data Analysis and Interpretation*
1. Enter Data Into Appropriate Statistical Tool
2. Evaluate the Goodness-of-fit
3. Review Descriptive and Inferential Statistics
Compare…
• the “decision statistic” (e.g., sample 95th percentile) to the OEL.
• the 95%UCL to the OEL.
102
102
Compare 95%ile Estimate
and 95%UCL to OEL
OEL
95%ile
95%ile UCL
0 1 2 3 4
-0.02
0
0.02
0.04
0.06
0.08
0.1
0 20 40 60 80 100 120
REVIEW: Steps in Data Analysis and Interpretation*
1. Enter Data Into Appropriate Statistical Tool
2. Evaluate the Goodness-of-fit
3. Review Descriptive and Inferential Statistics
Compare…
• the “decision statistic” (e.g., sample 95th percentile) to the OEL.
• the 95%UCL to the OEL.
4. Assign a Final Rating and Certainty Level
• Final Rating: Compare the sample 95th percentile to the Exposure
Control Categories (ECCs) and select a category.
• Certainty Level: Compare the 95%UCL to the ECCs:
• Low certainty if > 2 categories above the chosen ECC
• Medium certainty if only 1 category above
• High certainty if within chosen category
103
*After Executing a Carefully
Defined Monitoring Plan:
• Defined decision statistic
• Well defined SEG
• Appropriate OEL
• Well described exposure question
• Appropriate sampling strategy
• Valid and appropriate monitoring
method
• Validated analytical method
Hewett’s
ROT
103
Assign Exposure Rating and Certainty
OEL
95%ile 95%il
e
UCL
01 2 3 4
-0.02
0
0.02
0.04
0.06
0.08
0.1
0 20 40 60 80 100 120
Category 2
Medium Certainty
REVIEW: Steps in Data Analysis and Interpretation*
1. Enter Data Into Appropriate Statistical Tool
2. Evaluate the Goodness-of-fit
3. Review Descriptive and Inferential Statistics
Compare…
• the “decision statistic” (e.g., sample 95th percentile) to the OEL.
• the 95%UCL to the OEL.
4. Assign a Final Rating and Certainty Level
• Final Rating: Compare the sample 95th percentile to the Exposure
Control Categories (ECCs) and select a category.
• Certainty Level: Compare the 95%UCL to the ECCs:
• Low certainty if > 2 categories above the chosen ECC
• Medium certainty if only 1 category above
• High certainty if within chosen category
5. Document the Analysis and Recommendations
Recommend controls and/or PPE; work practice evaluation; additional
sampling; surveillance sampling, etc.
104
*After Executing a Carefully
Defined Monitoring Plan:
• Defined decision statistic
• Well defined SEG
• Appropriate OEL
• Well described exposure question
• Appropriate sampling strategy
• Valid and appropriate monitoring
method
• Validated analytical method
Hewett’s
ROT
104
Document Results and Implement Follow-Up Actions
CLICK TO EDIT MASTER TITLE
STYLE
105
KEY RESOURCES
Key References
• Papers:
• Hewett, P., Logan, P., Mulhausen, J., Ramachandran, G., and Banerjee, S.: “Rating Exposure Control
using Bayesian Decision Analysis”, Journal of Occupational and Environmental Hygiene, 3: 568–581,
2006
• Logan P., G. Ramachandran, J. Mulhausen, S. Banerjee, and P. Hewett “Desktop Study of Occupational
Exposure Judgments: Do Education and Experience Influence Accuracy?” Journal of Occupational and
Environmental Hygiene, 8:12, 746-758, 2011.
• Logan P., G. Ramachandran, J. Mulhausen, and P. Hewett:” Occupational Exposure Decisions: Can
Limited Data Interpretation Training Help Improve Accuracy?” Annals of Occupational Hygiene, Vol. 53,
No. 4, pp. 311–324, 2009.
• Vadali, M. G. Ramachandran, J. Mulhausen, S. Banerjee, "Effect of Training on Exposure Judgment
Accuracy of Industrial Hygienists”. Journal of Occupational & Environmental Hygiene. 9: 242–256, 2012.
• Vadali, M., G. Ramachandran, and J. Mulhausen, “Exposure Modeling in Occupational Hygiene Decision
Making”, Journal of Occupational and Environmental Hygiene: 6,353 — 362, 2009.
106
Key References - Continued
• Papers:
• Hewett, P., and G. Ganser. “A Comparison of Several Methods for Analyzing Censored Data”. Ann.
Occup. Hyg., Vol. 51, No. 7, pp. 611–632, 2007
• Ganser, G. and P.Hewett. “An Accurate Substitution Method for Analyzing Censored Data”. Journal of
Occupational and Environmental Hygiene, 7:4, 233-244, 2010.
• Arnold S., M. Stenzel, D. Drolet, G. Ramachandran; Journal of Occupational and Environmental Hygiene,
13, 159-168, 2016
• Jérôme Lavoué, Lawrence Joseph, Peter Knott, Hugh Davies, France Labrèche, Frédéric Clerc, Gautier
Mater, Tracy Kirkham, “Expostats: A Bayesian Toolkit to Aid the Interpretation of Occupational Exposure
Measurements”, Annals of Work Exposures and Health, Volume 63, Issue 3, April 2019, Pages 267–279,
• Books:
• A Strategy for Assessing and Managing Occupational Exposures. 4th Ed. AIHA Press. 2015.
107
Key Resources
• IH Stats and Other Exposure Assessment Tools:
AIHA Exposure Assessment Strategies Committee Website “Tools and Links for
Exposure Assessment Strategies”:
https://www.aiha.org/public-resources/consumer-resources/topics-of-interest/ih-apps-tools
• BDA Computer Tool:
Paul Hewett’s Website - Exposure Assessment Solutions:
http://www.EASInc.co
• ExpoStats Bayesian IH Data Analysis Tools
http://expostats.ca/site/en/index.html
• Competency Demonstration:
AIHA Exposure Decision Analysis Registry
108
Exposure Decision Analysis:
Competency Assessment
Exposure Decision Criteria
• Allowable Exceedance
• Needed Confidence
• Use of Exposure Categories
Traditional Industrial Hygiene Stats
• Properties of a lognormal distribution
• Upper percentile estimate calculation & interpretation
• Tolerance Limit calculation & interpretation
Bayesian Decision Analysis (BDA)
• Properties of a lognormal distribution
• Upper percentile estimate calculation & interpretation
• Tolerance Limit calculation & interpretation
Data and Similar Exposure Groups (SEGs)
• Rules for combining data
• Indications that a SEG may need refining
Decision Heuristics and Human Biases
• ​Common sources of bias in data interpretation and
exposure assessment
• How to avoid bias in data interpretation
Exposure Data Interpretation
• ​Most likely exposure category given data
• Meet the certainty requirement given data
Techniques for Improving Professional Judgments
• ​Feedback loops (quantitative judgment > monitoring >
qualitative judgment)
• Group judgment sessions
• Documentation of rationale
• Break decisions into aggregate parts (Modeling)
109
AIHA VIDEO SERIES:
MAKING ACCURATE EXPOSURE RISK
DECISIONS
Video 1A
Exposure Variability and the Importance of
Using Statistics to Improve Judgements
110
John R. Mulhausen, PhD, CIH, CSP, FAIHA
AIHA VIDEO SERIES:
MAKING ACCURATE EXPOSURE RISK DECISIONS
Video 1A: Exposure Variability and the Importance of Using Statistics to
Improve Judgements
Video 1B: Rules of Thumb for Interpreting Exposure Monitoring Data
Video 2: Introduction to Bayesian Statistical Approaches and Their
Advantages
Video 3A: Free Bayesian Statistical Tools: IHDA Student Edition
Video 3B: Free Bayesian Statistical Tools: Expostats
Video 4: Implementing AIHA Strategy Using Statistical Tools: Examples
111
Join us for the next video in the series . . .

More Related Content

Similar to Video 1A Handout 2023.pptx

5 essential steps for sample size determination in clinical trials slideshare
5 essential steps for sample size determination in clinical trials   slideshare5 essential steps for sample size determination in clinical trials   slideshare
5 essential steps for sample size determination in clinical trials slidesharenQuery
 
E00 program-level modeling and simulation experiences
E00   program-level modeling and simulation experiencesE00   program-level modeling and simulation experiences
E00 program-level modeling and simulation experiencestherealreverendbayes
 
11 hazardrecognition
11 hazardrecognition11 hazardrecognition
11 hazardrecognitionFahad Hashmi
 
Safety life cycle seminar IEC61511
Safety life cycle seminar IEC61511Safety life cycle seminar IEC61511
Safety life cycle seminar IEC61511Luis Atencio
 
Laboratory Management With Constrains Iamm 2010
Laboratory Management With Constrains Iamm 2010Laboratory Management With Constrains Iamm 2010
Laboratory Management With Constrains Iamm 2010PathKind Labs
 
2 Brian Hudson Lean 6 Sigma
2 Brian Hudson Lean 6 Sigma2 Brian Hudson Lean 6 Sigma
2 Brian Hudson Lean 6 Sigmagueste681ce
 
Methodologies for impact assessment of post harvest technologies
Methodologies for impact assessment of post harvest technologiesMethodologies for impact assessment of post harvest technologies
Methodologies for impact assessment of post harvest technologiesAshish Murai
 
Examples with solutions v2.0 FINAL.pptx
Examples with solutions v2.0 FINAL.pptxExamples with solutions v2.0 FINAL.pptx
Examples with solutions v2.0 FINAL.pptxJhonatanJesusRamnRoj
 
Examples with solutions v2.0 FINAL.pptx
Examples with solutions v2.0 FINAL.pptxExamples with solutions v2.0 FINAL.pptx
Examples with solutions v2.0 FINAL.pptxJhonatanJesusRamnRoj
 
Beyond the Audit: Measuring MedRec Processes for Quality Improvement
Beyond the Audit: Measuring MedRec Processes for Quality ImprovementBeyond the Audit: Measuring MedRec Processes for Quality Improvement
Beyond the Audit: Measuring MedRec Processes for Quality ImprovementCanadian Patient Safety Institute
 
Med day presentation
Med day presentationMed day presentation
Med day presentationCarsten Lund
 
RUNNING HEADER Potential Risk FactorsPotential Risk Factors.docx
RUNNING HEADER Potential Risk FactorsPotential Risk Factors.docxRUNNING HEADER Potential Risk FactorsPotential Risk Factors.docx
RUNNING HEADER Potential Risk FactorsPotential Risk Factors.docxrtodd599
 
An Introduction To Risk Management Professional Societies
An Introduction To Risk Management   Professional SocietiesAn Introduction To Risk Management   Professional Societies
An Introduction To Risk Management Professional Societiesmkaufer
 
Measurement System Analysis
Measurement System AnalysisMeasurement System Analysis
Measurement System AnalysisRonald Shewchuk
 
SPC Presentation.pptx
SPC Presentation.pptxSPC Presentation.pptx
SPC Presentation.pptxssuserb1c139
 

Similar to Video 1A Handout 2023.pptx (20)

5 essential steps for sample size determination in clinical trials slideshare
5 essential steps for sample size determination in clinical trials   slideshare5 essential steps for sample size determination in clinical trials   slideshare
5 essential steps for sample size determination in clinical trials slideshare
 
Safety & health management
Safety & health managementSafety & health management
Safety & health management
 
E00 program-level modeling and simulation experiences
E00   program-level modeling and simulation experiencesE00   program-level modeling and simulation experiences
E00 program-level modeling and simulation experiences
 
hris-1207896670311343-8
hris-1207896670311343-8hris-1207896670311343-8
hris-1207896670311343-8
 
11 hazardrecognition
11 hazardrecognition11 hazardrecognition
11 hazardrecognition
 
Safety life cycle seminar IEC61511
Safety life cycle seminar IEC61511Safety life cycle seminar IEC61511
Safety life cycle seminar IEC61511
 
Laboratory Management With Constrains Iamm 2010
Laboratory Management With Constrains Iamm 2010Laboratory Management With Constrains Iamm 2010
Laboratory Management With Constrains Iamm 2010
 
2 Brian Hudson Lean 6 Sigma
2 Brian Hudson Lean 6 Sigma2 Brian Hudson Lean 6 Sigma
2 Brian Hudson Lean 6 Sigma
 
Methodologies for impact assessment of post harvest technologies
Methodologies for impact assessment of post harvest technologiesMethodologies for impact assessment of post harvest technologies
Methodologies for impact assessment of post harvest technologies
 
IAASB Webinar on Assurance on Sustainability Reporting
IAASB Webinar on Assurance on Sustainability ReportingIAASB Webinar on Assurance on Sustainability Reporting
IAASB Webinar on Assurance on Sustainability Reporting
 
13711404.ppt
13711404.ppt13711404.ppt
13711404.ppt
 
Examples with solutions v2.0 FINAL.pptx
Examples with solutions v2.0 FINAL.pptxExamples with solutions v2.0 FINAL.pptx
Examples with solutions v2.0 FINAL.pptx
 
Examples with solutions v2.0 FINAL.pptx
Examples with solutions v2.0 FINAL.pptxExamples with solutions v2.0 FINAL.pptx
Examples with solutions v2.0 FINAL.pptx
 
Beyond the Audit: Measuring MedRec Processes for Quality Improvement
Beyond the Audit: Measuring MedRec Processes for Quality ImprovementBeyond the Audit: Measuring MedRec Processes for Quality Improvement
Beyond the Audit: Measuring MedRec Processes for Quality Improvement
 
Med day presentation
Med day presentationMed day presentation
Med day presentation
 
RUNNING HEADER Potential Risk FactorsPotential Risk Factors.docx
RUNNING HEADER Potential Risk FactorsPotential Risk Factors.docxRUNNING HEADER Potential Risk FactorsPotential Risk Factors.docx
RUNNING HEADER Potential Risk FactorsPotential Risk Factors.docx
 
An Introduction To Risk Management Professional Societies
An Introduction To Risk Management   Professional SocietiesAn Introduction To Risk Management   Professional Societies
An Introduction To Risk Management Professional Societies
 
IAASB Webinar on Assurance on Sustainability Reporting
IAASB Webinar on Assurance on Sustainability ReportingIAASB Webinar on Assurance on Sustainability Reporting
IAASB Webinar on Assurance on Sustainability Reporting
 
Measurement System Analysis
Measurement System AnalysisMeasurement System Analysis
Measurement System Analysis
 
SPC Presentation.pptx
SPC Presentation.pptxSPC Presentation.pptx
SPC Presentation.pptx
 

Recently uploaded

Concrete Mix Design - IS 10262-2019 - .pptx
Concrete Mix Design - IS 10262-2019 - .pptxConcrete Mix Design - IS 10262-2019 - .pptx
Concrete Mix Design - IS 10262-2019 - .pptxKartikeyaDwivedi3
 
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...VICTOR MAESTRE RAMIREZ
 
Call Girls Narol 7397865700 Independent Call Girls
Call Girls Narol 7397865700 Independent Call GirlsCall Girls Narol 7397865700 Independent Call Girls
Call Girls Narol 7397865700 Independent Call Girlsssuser7cb4ff
 
Call Us ≽ 8377877756 ≼ Call Girls In Shastri Nagar (Delhi)
Call Us ≽ 8377877756 ≼ Call Girls In Shastri Nagar (Delhi)Call Us ≽ 8377877756 ≼ Call Girls In Shastri Nagar (Delhi)
Call Us ≽ 8377877756 ≼ Call Girls In Shastri Nagar (Delhi)dollysharma2066
 
main PPT.pptx of girls hostel security using rfid
main PPT.pptx of girls hostel security using rfidmain PPT.pptx of girls hostel security using rfid
main PPT.pptx of girls hostel security using rfidNikhilNagaraju
 
HARMONY IN THE NATURE AND EXISTENCE - Unit-IV
HARMONY IN THE NATURE AND EXISTENCE - Unit-IVHARMONY IN THE NATURE AND EXISTENCE - Unit-IV
HARMONY IN THE NATURE AND EXISTENCE - Unit-IVRajaP95
 
chaitra-1.pptx fake news detection using machine learning
chaitra-1.pptx  fake news detection using machine learningchaitra-1.pptx  fake news detection using machine learning
chaitra-1.pptx fake news detection using machine learningmisbanausheenparvam
 
complete construction, environmental and economics information of biomass com...
complete construction, environmental and economics information of biomass com...complete construction, environmental and economics information of biomass com...
complete construction, environmental and economics information of biomass com...asadnawaz62
 
Past, Present and Future of Generative AI
Past, Present and Future of Generative AIPast, Present and Future of Generative AI
Past, Present and Future of Generative AIabhishek36461
 
Gurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort service
Gurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort serviceGurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort service
Gurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort servicejennyeacort
 
IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024Mark Billinghurst
 
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICSAPPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICSKurinjimalarL3
 
Software and Systems Engineering Standards: Verification and Validation of Sy...
Software and Systems Engineering Standards: Verification and Validation of Sy...Software and Systems Engineering Standards: Verification and Validation of Sy...
Software and Systems Engineering Standards: Verification and Validation of Sy...VICTOR MAESTRE RAMIREZ
 
Architect Hassan Khalil Portfolio for 2024
Architect Hassan Khalil Portfolio for 2024Architect Hassan Khalil Portfolio for 2024
Architect Hassan Khalil Portfolio for 2024hassan khalil
 
SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )Tsuyoshi Horigome
 
What are the advantages and disadvantages of membrane structures.pptx
What are the advantages and disadvantages of membrane structures.pptxWhat are the advantages and disadvantages of membrane structures.pptx
What are the advantages and disadvantages of membrane structures.pptxwendy cai
 
Current Transformer Drawing and GTP for MSETCL
Current Transformer Drawing and GTP for MSETCLCurrent Transformer Drawing and GTP for MSETCL
Current Transformer Drawing and GTP for MSETCLDeelipZope
 

Recently uploaded (20)

Concrete Mix Design - IS 10262-2019 - .pptx
Concrete Mix Design - IS 10262-2019 - .pptxConcrete Mix Design - IS 10262-2019 - .pptx
Concrete Mix Design - IS 10262-2019 - .pptx
 
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
 
Call Girls Narol 7397865700 Independent Call Girls
Call Girls Narol 7397865700 Independent Call GirlsCall Girls Narol 7397865700 Independent Call Girls
Call Girls Narol 7397865700 Independent Call Girls
 
Call Us ≽ 8377877756 ≼ Call Girls In Shastri Nagar (Delhi)
Call Us ≽ 8377877756 ≼ Call Girls In Shastri Nagar (Delhi)Call Us ≽ 8377877756 ≼ Call Girls In Shastri Nagar (Delhi)
Call Us ≽ 8377877756 ≼ Call Girls In Shastri Nagar (Delhi)
 
main PPT.pptx of girls hostel security using rfid
main PPT.pptx of girls hostel security using rfidmain PPT.pptx of girls hostel security using rfid
main PPT.pptx of girls hostel security using rfid
 
HARMONY IN THE NATURE AND EXISTENCE - Unit-IV
HARMONY IN THE NATURE AND EXISTENCE - Unit-IVHARMONY IN THE NATURE AND EXISTENCE - Unit-IV
HARMONY IN THE NATURE AND EXISTENCE - Unit-IV
 
chaitra-1.pptx fake news detection using machine learning
chaitra-1.pptx  fake news detection using machine learningchaitra-1.pptx  fake news detection using machine learning
chaitra-1.pptx fake news detection using machine learning
 
young call girls in Rajiv Chowk🔝 9953056974 🔝 Delhi escort Service
young call girls in Rajiv Chowk🔝 9953056974 🔝 Delhi escort Serviceyoung call girls in Rajiv Chowk🔝 9953056974 🔝 Delhi escort Service
young call girls in Rajiv Chowk🔝 9953056974 🔝 Delhi escort Service
 
complete construction, environmental and economics information of biomass com...
complete construction, environmental and economics information of biomass com...complete construction, environmental and economics information of biomass com...
complete construction, environmental and economics information of biomass com...
 
Past, Present and Future of Generative AI
Past, Present and Future of Generative AIPast, Present and Future of Generative AI
Past, Present and Future of Generative AI
 
Gurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort service
Gurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort serviceGurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort service
Gurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort service
 
IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024
 
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICSAPPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
 
★ CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCR
★ CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCR★ CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCR
★ CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCR
 
Software and Systems Engineering Standards: Verification and Validation of Sy...
Software and Systems Engineering Standards: Verification and Validation of Sy...Software and Systems Engineering Standards: Verification and Validation of Sy...
Software and Systems Engineering Standards: Verification and Validation of Sy...
 
Architect Hassan Khalil Portfolio for 2024
Architect Hassan Khalil Portfolio for 2024Architect Hassan Khalil Portfolio for 2024
Architect Hassan Khalil Portfolio for 2024
 
🔝9953056974🔝!!-YOUNG call girls in Rajendra Nagar Escort rvice Shot 2000 nigh...
🔝9953056974🔝!!-YOUNG call girls in Rajendra Nagar Escort rvice Shot 2000 nigh...🔝9953056974🔝!!-YOUNG call girls in Rajendra Nagar Escort rvice Shot 2000 nigh...
🔝9953056974🔝!!-YOUNG call girls in Rajendra Nagar Escort rvice Shot 2000 nigh...
 
SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )
 
What are the advantages and disadvantages of membrane structures.pptx
What are the advantages and disadvantages of membrane structures.pptxWhat are the advantages and disadvantages of membrane structures.pptx
What are the advantages and disadvantages of membrane structures.pptx
 
Current Transformer Drawing and GTP for MSETCL
Current Transformer Drawing and GTP for MSETCLCurrent Transformer Drawing and GTP for MSETCL
Current Transformer Drawing and GTP for MSETCL
 

Video 1A Handout 2023.pptx

  • 1. AIHA VIDEO SERIES: MAKING ACCURATE EXPOSURE RISK DECISIONS Video 1A Exposure Variability and the Importance of Using Statistics to Improve Judgements 1 John R. Mulhausen, PhD, CIH, CSP, FAIHA
  • 2. Disclaimer & Copyright Although the information contained in this session has been compiled from sources believed to be reliable, the presenter and AIHA® make no guarantee as to, and assumes no responsibility for, the correctness, sufficiency, or completeness of such information. Since standards and codes vary from one place to another, consult with your local Occupational or Environmental Health and Safety professional to determine the current state of the art before applying what you learn from this webinar. AIHA must ensure balance, independence, objectivity, and scientific rigor in its educational events. Instructors are expected to disclose any significant financial interests or other relationships. The intent of this disclosure is not to prevent an instructor from presenting, but to provide participants with information to base their own judgments. It remains up to the participant to determine whether an instructor’s interests or relationships may influence the presentation. Session presentation material belongs to the presenter with usage rights given to AIHA. This session and associated materials can be reproduced, rebroadcast, or made into derivative works without express written permission.
  • 3. Disclaimer & Copyright Handout Information All AIHA University session handouts are produced by AIHA as submitted by the instructors, and in the instructor determined order. AIHA does not change or modify handout content; we may adjust images to improve layout and clarity.
  • 4. AGENDA • Why Important? • Decision Statistic • AIHA Categories • Exposure Judgment Accuracy • Exposure Variability • Inferential IH Statistics • Data Interpretation Using IHSTAT™ • Examples • Review: Data Interpretation • Key Resources
  • 5. CLICK TO EDIT MASTER TITLE STYLE 5 WHY IMPORTANT?
  • 6. Effective and Efficient Exposure Risk Management Effective: Ensure that no worker has unacceptable exposures Efficient: Do it for minimum cost 6
  • 7. 7 7 What if our exposure assessment is wrong? If we underestimate the exposure? • Increased risk to employees If we overestimate the exposure? • Unnecessary expenditures for controls • Unnecessary constraints for employees and production 7 Well-Designed Exposure Risk Management Strategy We Want: We Don’t Want: Good Data Bad Data To Be Effective To Not Be Protective To Be Efficient To Waste Resources No Biases Biases (High or Low) Low Uncertainty High Uncertainty Correct Decisions Wrong Decisions
  • 8. AIHA Exposure Risk Management Process Comprehensive Exposure Assessment and Management • Goal is to understand and manage all exposures • Document both qualitative and quantitative exposure assessments • Document low exposures • Emphasize Accurate and Efficient Exposure Decisions • Drive Effective and Efficient Exposure Risk Management • Devise OELs when needed • Continuous Prioritization • Continuous Improvement • Identify the critical SEGs • Anticipate and manage change 8
  • 9. CLICK TO EDIT MASTER TITLE STYLE 9 DECISION STATISTIC
  • 10. Decision Statistic: •Relative to Appropriate OEL •Defined BEFORE conducting exposure risk assessment Defines Objective for Acceptable Exposure (i.e. No Further Intervention Needed) 10
  • 11. Decision Statistic: 1st Framing Question An employee performs a job 100 days per year. If you collected personal samples on the employee all 100 days, how many days is it acceptable for exposures to exceed the Occupational Exposure Limit (OEL) without a respirator? 1) 0 days? 2) 1 days? 3) 5 days? 4) 10 days? 5) 25 days? 6) 50 days? 11
  • 12. Decision Statistic: 1st Framing Question An employee performs a job 100 days per year. If you collected personal samples on the employee all 100 days, how many days is it acceptable for exposures to exceed the Occupational Exposure Limit (OEL) without a respirator? 1) 0 days? 2) 1 days? 3) 5 days? 4) 10 days? 5) 25 days? 6) 50 days? 12 • Answers emphasize the desire for very few days above the OEL • Professional consensus developing around targeting for no more than 5 days out of 100 above the OEL (i.e. 95th Percentile) 95%ile 5/100 (5%) above 95/100 (95%) below
  • 16. Decision Statistic: 2nd Framing Question How sure do you want to be in your judgment? 16 ? ? 1) 100% Sure? 2) 99%? 3) 95%? 4) 90%? 5) 70%? 6) 50%?
  • 17. Decision Statistic: 2nd Framing Question How sure do you want to be in your judgment? 17 ? ? 1) 100% Sure? 2) 99%? 3) 95%? 4) 90%? 5) 70%? 6) 50%? • Answers express the desire for high confidence that employees are protected. • Implementing the AIHA Strategy with its emphasis on driving follow-up actions and continuous improvement enables a program to strive for high confidence. • Common to strive for 95% confidence.
  • 18. Decision Statistic: “Strive for at least 95% confidence that the true 95th percentile is less than the OEL” OEL 95%ile 95%ile UCL 0 1 2 3 4 -2 0 2 4 6 8 10 0 0.2 0.4 0.6 0.8 1 1.2 Best Estimate 95% Upper Confidence Best Estimate Exposure Profile 95% Upper Confidence Exposure Profile Pulling Together 1st and 2nd Framing Questions: 18
  • 19. CLICK TO EDIT MASTER TITLE STYLE 19 AIHA CATEGORIES
  • 20. Exposure Rating Category** Recommended Control 0 (<1% of OEL) No action 1 (<10% of OEL) Procedures and Training; General Hazard Communication 2 (10-50% of OEL) + Chemical Specific Hazard Communication; Periodic Exposure Monitoring, 3 (50-100% of OEL) + Required Exposure Monitoring, Workplace Inspections to Verify Work Practice Controls; Medical Surveillance, Biological Monitoring 4 (>100% of OEL) + Implement Hierarchy of Controls; Monitoring to Validate Respirator Protection Factor Selection. Multiples of OEL (>500% of OEL or others based on respirator APF) +Immediate Engineering Controls or Process Shut Down, Validate Acceptable Respirators ** Decision statistic = 95th percentile AIHA Exposure Rating and Control Categories 20
  • 21. AIHA Exposure Rating and Control Categories Increase Effectiveness and Efficiency • Avoid diminishing returns from “over-refining” exposure estimates • Streamline Documentation • Facilitate Qualitative Exposure Judgements • Drive consistent follow-up management and control activities which lead to consistent risk management. 21
  • 22. CLICK TO EDIT MASTER TITLE STYLE 22 EXPOSURE JUDGMENT ACCURACY
  • 23. ? Exposure Risk Decisions: How Accurate Are We? ** Decision statistic = 95th percentile Sample Results (ppm) 18 15 5 8 12 When We Have Monitoring Data . . . 23
  • 24. Video Tasks: Quantitative Judgment Accuracy Pre- and Post- Statistical Training 24 P. Logan, G. Ramachandran, J. Mulhausen and P. Hewett “Occupational Exposure Decisions: Can Limited Data Interpretation Training Help Improve Accuracy?”. Annals of Occupational Hygiene - 2009 Biased Low Pre-Training Statistical Training Increased Accuracy and Eliminated Bias
  • 25. What About Real Life? . . . 25
  • 26. Task results, Pre and Post training 7% 18% 28% 46% 1% 0% 0% 2% 11% 16% 69% 1% 0% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% -3 -2 -1 0 1 2 3 % correct judgments Pre Training Post training Number of AIHA Categories Away From the Correct Category Vadali, Ramachandran, Mulhausen & Banerjee (2012): Effect of Training on Exposure Judgment Accuracy of Industrial Hygienists, Journal of Occupational and Environmental Hygiene, 9:4, 242-256 Statistical Training Increased Accuracy NIOSH Funded U of MN Study Actual Workplace Assessments 26
  • 27. Monitoring-Based Exposure Judgments • Bad News • Often incorrect • Good News • Simple statistical training improves judgments • GREAT NEWS!!! • Using statistical tools when we make monitoring-based exposure judgments will greatly improve accuracy 27 Industrial Hygiene Statistics Beta 0.9 - For trial and testing only - Please do not distribute Data Description: John Mulhausen OEL DESCRIPTIVE STATISTICS 5 Number of Samples (n) 15 Maximum (max) 5.5 Sample Data Minimum (min) 1.2 (max n=50) Range 4.3 No less-than (<) Percent above OEL (%>OEL) 6.667 or greater-than (>) Mean 2.680 1.3 Median 2.500 1.8 Standard Deviation (s) 1.138 1.2 Mean of Log (LN) Transformed Data 0.908 4.5 Std Deviation of Log (LN) Transformed Data 0.407 2 Geometric Mean (GM) 2.479 2.1 Geometric Standard Deviation (GSD) 1.502 5.5 2.2 TEST FOR DISTRIBUTION FIT 3 W Test of Log (LN) Transformed Data 0.974 2.4 Lognormal (a=0.05)? Yes 2.5 2.5 W Test of Data 0.904 3.5 Normal (a=0.05)? Yes 2.8 2.9 LOGNORMAL PARAMETRIC STATISTICS Estimated Arithmetic Mean - MVUE 2.677 1,95%LCL - Land's "Exact" 2.257 1,95%UCL - Land's "Exact" 3.327 95th Percentile 4.843 Upper Tolerance Limit (95%, 95%) 7.046 Percent Exceeding OEL (% > OEL) 4.241 1,95% LCL % > OEL 0.855 1,95% UCL % > OEL 15.271 NORMAL PARAMETRIC STATISTICS Mean 2.680 1,95%LCL - t stats 2.162 1,95%UCL- t stats 3.198 95th Percentile - Z 4.553 Upper Tolerance Limit (95%, 95%) 5.60 Percent Exceeding OEL (% > OEL) 2.078 Linear Probability Plot and Least Squares Best Fit Line 1% 2% 5% 10% 16% 25% 50% 75% 84% 90% 95% 98% 99% -5 0 5 10 Concentration Log-Probability Plot and Least Squares Best Fit Line 1% 2% 5% 10% 16% 25% 50% 75% 84% 90% 95% 98% 99% 0 1 10 Concentration Idealized Lognormal Distribution AM and CI's 95%ile 0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0 1 2 3 4 5 6 7 Concentration Sequential Data Plot 0 1 2 3 4 5 6 0 2 4 6 8 10 12 14 16 Sample Number Concentration AIHA IHSTAT
  • 28. Use Statistical Tools!! 28 95%ile = 1.2 0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0 0.5 1.0 1.5 2.0 Concentration (mg/M3) UTL95%,95% = 16 mg/M3 AIHA IHSTAT Industrial Hygiene Statistics Beta 0.9 - For trial and testing only - Please do not distribute Data Description: John Mulhausen OEL DESCRIPTIVE STATISTICS 5 Number of Samples (n) 15 Maximum (max) 5.5 Sample Data Minimum (min) 1.2 (max n=50) Range 4.3 No less-than (<) Percent above OEL (%>OEL) 6.667 or greater-than (>) Mean 2.680 1.3 Median 2.500 1.8 Standard Deviation (s) 1.138 1.2 Mean of Log (LN) Transformed Data 0.908 4.5 Std Deviation of Log (LN) Transformed Data 0.407 2 Geometric Mean (GM) 2.479 2.1 Geometric Standard Deviation (GSD) 1.502 5.5 2.2 TEST FOR DISTRIBUTION FIT 3 W Test of Log (LN) Transformed Data 0.974 2.4 Lognormal (a=0.05)? Yes 2.5 2.5 W Test of Data 0.904 3.5 Normal (a=0.05)? Yes 2.8 2.9 LOGNORMAL PARAMETRIC STATISTICS Estimated Arithmetic Mean - MVUE 2.677 1,95%LCL - Land's "Exact" 2.257 1,95%UCL - Land's "Exact" 3.327 95th Percentile 4.843 Upper Tolerance Limit (95%, 95%) 7.046 Percent Exceeding OEL (% > OEL) 4.241 1,95% LCL % > OEL 0.855 1,95% UCL % > OEL 15.271 NORMAL PARAMETRIC STATISTICS Mean 2.680 1,95%LCL - t stats 2.162 1,95%UCL- t stats 3.198 95th Percentile - Z 4.553 Upper Tolerance Limit (95%, 95%) 5.60 Percent Exceeding OEL (% > OEL) 2.078 Linear Probability Plot and Least Squares Best Fit Line 1% 2% 5% 10% 16% 25% 50% 75% 84% 90% 95% 98% 99% -5 0 5 10 Concentration Log-Probability Plot and Least Squares Best Fit Line 1% 2% 5% 10% 16% 25% 50% 75% 84% 90% 95% 98% 99% 0 1 10 Concentration Idealized Lognormal Distribution AM and CI's 95%ile 0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0 1 2 3 4 5 6 7 Concentration Sequential Data Plot 0 1 2 3 4 5 6 0 2 4 6 8 10 12 14 16 Sample Number Concentration IH Data Analyst Exposure Rating Category <1%OEL <10% OEL 10 – 50% 50 – 100% >100% OEL Probability 1 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0 0 0 0.087 0.4 0.513 OEL Likelihood that 95%ile falls into indicated Exposure Rating Category Initial Qualitative Assessment or Validated Model Prior Exposure Rating 0 1 2 3 4 Decision Probability 1 0.8 0.6 0.4 0.2 0 0.05 0.2 0.5 0.2 0.05 Monitoring Results Likelihood Exposure Rating 0 1 2 3 4 Decision Probability 1 0.8 0.6 0.4 0.2 0 0 0 0.06 0.376 0.564 Integrated Exposure Assessment Posterior Exposure Rating 0 1 2 3 4 Decision Probability 1 0.8 0.6 0.4 0.2 0 0 0 0.225 0.564 0.211 Expostats Traditional Statistics Bayesian Statistics 28
  • 29. CLICK TO EDIT MASTER TITLE STYLE 29 EXPOSURE VARIABILITY
  • 30. Our Fundamental Issue: Exposure Variability + Very Low Numbers of Samples 30
  • 31. Annual population of exposures for one worker: 250 Worker-days per Year Measurement 250 200 150 100 50 0 Concentration 6.5 6 5.5 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Trying to understand this . . . . 31
  • 32. Annual population of exposures for one worker: 250 Worker-days per Year Measurement 250 200 150 100 50 0 Concentration 6.5 6 5.5 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Based on this (n=5 samples) . . . . “See” Only 2% of Exposures 32
  • 33. Measurement 250 200 150 100 50 0 Concentration 6.5 6 5.5 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Measurement 250 200 150 100 50 0 Concentration 7 6 5 4 3 2 1 0 Measurement 250 200 150 100 50 0 Concentration 8 7 6 5 4 3 2 1 0 Measurement 250 200 150 100 50 0 Concentration 6.5 6 5.5 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Measurement 250 200 150 100 50 0 Concentration 6.5 6 5.5 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Measurement 250 200 150 100 50 0 Concentration 7 6 5 4 3 2 1 0 Measurement 250 200 150 100 50 0 Concentration 7 6 5 4 3 2 1 0 Measurement 250 200 150 100 50 0 Concentration 9 8 7 6 5 4 3 2 1 0 Measurement 250 200 150 100 50 0 Concentration 8 7 6 5 4 3 2 1 0 Measurement 250 200 150 100 50 0 Concentration 6 5.5 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 10 Worker SEG: 2500 Worker-days per year “See” Only 0.2% of Exposures 33
  • 34. CLICK TO EDIT MASTER TITLE STYLE 34 INFERENTIAL IH STATISTICS
  • 35. Solution: Inferential Statistics . . . . Estimate From What We Looked At (Our Five Samples) . . . The Actual Population Exposure Profile (SEG of 10 Workers) Using Knowledge of Underlying Shape (Lognormal Distribution) . . . 35
  • 36. Things can go wrong at several stages when extrapolating sample data to make inferences about the underlying population Data (measurements) Sample (Actual exposure levels during measurements) Distribution of which the sample is representative • Intrument quality • Interferences • Exposure periods missed • Worst case • Night shift • Summer/winter • Process changes • Selection of workers Inductive Inference Target population (exposure distribution) • Sample size Confidence intervals 36
  • 37. Things can go wrong at several stages when extrapolating sample data to make inferences about the underlying population Data (measurements) Sample (Actual exposure levels during measurements) Distribution of which the sample is representative • Intrument quality • Interferences • Exposure periods missed • Worst case • Night shift • Summer/winter • Process changes • Selection of workers Inductive Inference Target population (exposure distribution) • Sample size Confidence intervals Critical Data Quality Considerations • Defined decision statistic • Well defined SEG • Appropriate OEL • Well described exposure question • Appropriate sampling strategy • Valid and appropriate monitoring method • Validated analytical method 37
  • 38. Lognormal Model Most Appropriate? 38 • Many papers dating back to the 60s, in Europe and the US, have shown the lognormal distribution to fit occupational exposure data reasonably well. • Noise exposure data also follow a lognormal distribution when expressed as dose. • Formal statistical tests exist but they have low power for small sample sizes, and reject lognormality very (too) quickly for large sample sizes.
  • 39. Lognormal Model Most Appropriate? 39 • Many papers dating back to the 60s, in Europe and the US, have shown the lognormal distribution to fit occupational exposure data reasonably well. • Noise exposure data also follow a lognormal distribution when expressed as dose. • Formal statistical tests exist but they have low power for small sample sizes, and reject lognormality very (too) quickly for large sample sizes. A Pragmatic Approach: • Assume lognormality based on historical weight of evidence • Make a graphical check (Quantile - Quantile or log – probit plot) to detect obvious departures from the model “All models are wrong, some are useful” - George E. P. Box
  • 40. Always Check the Lognormal Assumption • Check your monitoring data for lognormal distribution fit before detailed analysis. • If data is not lognormal go back and verify SEG is constructed well. • Are jobs/tasks truly similar? • Does the data have errors? • Should SEG be broken down to smaller levels? • Challenge your SEG assumptions. • Many other factors . . . 40 Probability Probit 3 2 1 0 -1 -2 -3 99 98 95 90 84 75 50 25 16 10 5 2 1 99 98 95 90 84 75 50 25 16 10 5 2 1 Concentration 0.01 0.1 1
  • 41. Lognormal Distribution: A model for exposure variability 41 Simple scatterplot Histogram Probability density curve 41
  • 42. probability density Less frequent More frequent Area under the curve sums to 100% of the population Values of the quantity of interest Less frequent 𝑋𝑃%ile = 𝐺𝑀 ⋅ 𝐺𝑆𝐷𝑍𝑝 Interpreting a probability density curve is just like interpreting a histogram . . . 42
  • 43. 95%ile = 𝐺𝑀 ⋅ 𝐺𝑆𝐷1.645 95%ile 95% 5% probability density
  • 44. Lognormal Distribution Defined by GM and GSD Geometric mean (GM) Measure location. Central parameter. Cuts the distribution into 2 equal parts (median). Geometric standard deviation (GSD) Measure variability (~ distance between the lowest and highest values) Concentration Concentration Median = GM Mean Mode 44
  • 45. Calculate GM and GSD Samples xi (mg/m3) 0.84 0.98 0.42 1.16 1.36 2.66
  • 46. Calculate GM and GSD Samples xi (mg/m3) 0.84 0.98 0.42 1.16 1.36 2.66 yi=ln(xi) -0.1744 -0.0202 -0.8675 0.1484 0.3075 0.9783 1. Log-Transform Data: e.g. yi=ln(xi)
  • 47. Calculate GM and GSD Samples xi (mg/m3) 0.84 0.98 0.42 1.16 1.36 2.66 yi=ln(xi) -0.1744 -0.0202 -0.8675 0.1484 0.3075 0.9783 2. Calculate Parameter of Interest: e.g. mean (y) and standard deviation (sy) 1. Log-Transform Data: e.g. yi=ln(xi) y = 0.062 sy = 0.606
  • 48. Calculate GM and GSD Samples xi (mg/m3) 0.84 0.98 0.42 1.16 1.36 2.66 yi=ln(xi) -0.1744 -0.0202 -0.8675 0.1484 0.3075 0.9783 2. Calculate Parameter of Interest: e.g. mean (y) and standard deviation (sy) 1. Log-Transform Data: e.g. yi=ln(xi) 3. Calculate Anti-Log of the Parameter of Interest: e.g. GM=exp(y) and GSD=exp(sy) GM = 1.06 GSD = 1.83 y = 0.062 sy = 0.606
  • 49. Calculate GM and GSD Worked Example for Reference Welding Fume Sample Data Case Samples xi (mg/m3) yi=ln(xi) (yi-y)2 1 0.84 -0.1744 0.055877 2 0.98 -0.0202 0.006762 3 0.42 -0.8675 0.864025 4 1.16 0.1484 0.007463 5 1.36 0.3075 0.060248 6 2.66 0.9783 0.839600 Sum = 0.3722 1.833976 y = 0.0620 GM = 1.06 GSD = 1.83 49 _ _ 𝐺𝑀 = exp 𝑦𝑖 𝑛 𝐺𝑆𝐷 = exp 𝑦𝑖 − 𝑦 2 𝑛 − 1 𝐺𝑀 = exp 0.3722 6 𝐺𝑀 = 1.06 𝐺𝑆𝐷 = exp 1.833976 6 − 1 𝐺𝑆𝐷 = 1.83 𝑦𝑖 = ln 𝑥𝑖
  • 50. Calculate 95%ile Worked Example for Reference Welding Fume Sample Data 𝑋𝑃%ile = 𝐺𝑀 ⋅ 𝐺𝑆𝐷𝑍𝑝 95%ile = 𝐺𝑀 ⋅ 𝐺𝑆𝐷1.645 • Six full-shift TWA welding fume measurements resulted in the following statistics: GM = 1.06 mg/m3 GSD = 1.83 • What is the point estimate (i.e., best estimate) of the true 95th percentile? 95%ile = 1.06 ⋅ 1.831.645 95%ile = 2.86 mg/m3 95%ile = 2.86 mg/m3 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0 2 4 6 8 10 50
  • 51. Upper Tolerance Limit (UTL) for the 95th Percentile [Same as 95%ile Upper Confidence Limit (UCL)] • Concept • Calculate the 95% upper tolerance limit (same as upper confidence limit) for the 95th percentile statistic to characterize uncertainty in the point estimate • Interpretation • If the UTL95%,95% is less than the OEL, then we can say that we are at least 95% confident that the true 95th percentile is less than the OEL 95%ile 0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1 Distribution of SEG Exposures (Exposure Profile) 51
  • 52. Upper Tolerance Limit (UTL) for the 95th Percentile [Same as 95%ile Upper Confidence Limit (UCL)] • Concept • Calculate the 95% upper tolerance limit (same as upper confidence limit) for the 95th percentile statistic to characterize uncertainty in the point estimate • Interpretation • If the UTL95%,95% is less than the OEL, then we can say that we are at least 95% confident that the true 95th percentile is less than the OEL 95%ile 0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1 95%ile point estimate 95%ile point estimate uncertainty distribution Distribution of SEG Exposures (Exposure Profile) 52
  • 53. Upper Tolerance Limit (UTL) for the 95th Percentile [Same as 95%ile Upper Confidence Limit (UCL)] • Concept • Calculate the 95% upper tolerance limit (same as upper confidence limit) for the 95th percentile statistic to characterize uncertainty in the point estimate • Interpretation • If the UTL95%,95% is less than the OEL, then we can say that we are at least 95% confident that the true 95th percentile is less than the OEL 95%ile 0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1 95%ile point estimate 95%ile point estimate uncertainty distribution 95% upper confidence limit for the 95%ile estimate UTL95%,95% Distribution of SEG Exposures (Exposure Profile) 53
  • 54. Upper Tolerance Limit (UTL) for the 95th Percentile [Same as 95%ile Upper Confidence Limit (UCL)] • Concept • Calculate the 95% upper tolerance limit (same as upper confidence limit) for the 95th percentile statistic to characterize uncertainty in the point estimate • Interpretation • If the UTL95%,95% is less than the OEL, then we can say that we are at least 95% confident that the true 95th percentile is less than the OEL 95%ile 0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1 95%ile point estimate 95%ile point estimate uncertainty distribution 95% upper confidence limit for the 95%ile estimate UTL95%,95% UTL95%,95% = UCL95,95 Distribution of SEG Exposures (Exposure Profile) 54
  • 55. Upper Tolerance Limit (UTL) for the 95th Percentile [Same as 95%ile Upper Confidence Limit (UCL)] • Concept • Calculate the 95% upper tolerance limit (same as upper confidence limit) for the 95th percentile statistic to characterize uncertainty in the point estimate • Interpretation • If the UTL95%,95% is less than the OEL, then we can say that we are at least 95% confident that the true 95th percentile is less than the OEL 95%ile 0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1 UTL95%,95% = UCL95,95 Distribution of SEG Exposures (Exposure Profile) 55
  • 56. Calculate UTL95%,95% for the 95th Percentile (UTL95%,95% = UCL95%,95%) Procedure: 1.Calculate the GM and GSD 2.Using n, read the UTL K-value from the appropriate table g = confidence level, e.g., 0.95 p = proportion, e.g., 0.95 n = sample size 3.Using GM, GSD, and K, calculate the UTL95%,95%: 56 𝑦 = ln 𝐺𝑀 𝑠𝑦 = ln 𝐺𝑆𝐷 𝑈𝑇𝐿95%,95% = exp 𝑦 + 𝐾 ⋅ 𝑠𝑦 Factors for one-sided tolerance limits for normal distributions* *Partial Table IV.11 - A Strategy for Assessing and Managing Occupational Exposures, Fourth Edition. AIHA Press 2015.
  • 57. Worked Example for Reference: Calculate 95%ile UTL95%,95 Welding Fume Sample Data • Six full-shift TWA welding fume measurements: GM = 1.06 mg/m3 GSD = 1.83 • What is the 95th percentile UTL95%,95%? 𝑈𝑇𝐿95%,95% = exp 𝑦 + 𝐾 ⋅ 𝑠𝑦 𝑈𝑇𝐿95%,95% = exp 0.058 + 3.707 ⋅ 0.604 𝑠𝑦 = ln 𝐺𝑆𝐷 = ln( 1.83) = 0.604 𝑦 = ln 𝐺𝑀 = ln 1.06 = 0.058 𝑈𝑇𝐿95%,95% = 10mg/m3 95%ile = 2.86 mg/m3 UTL95%,95% = 10 mg/m3 0 0.2 0.4 0.6 0.8 0 2 4 6 8 10 57 Factors for one-sided tolerance limits for normal distributions
  • 58. CLICK TO EDIT MASTER TITLE STYLE 58 aiha.org | 58 DATA INTERPRETATION USING IHSTAT
  • 59. Use Statistical Tools!! 59 95%ile = 1.2 0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0 0.5 1.0 1.5 2.0 Concentration (mg/M3) UTL95%,95% = 16 mg/M3 AIHA IHSTAT Industrial Hygiene Statistics Beta 0.9 - For trial and testing only - Please do not distribute Data Description: John Mulhausen OEL DESCRIPTIVE STATISTICS 5 Number of Samples (n) 15 Maximum (max) 5.5 Sample Data Minimum (min) 1.2 (max n=50) Range 4.3 No less-than (<) Percent above OEL (%>OEL) 6.667 or greater-than (>) Mean 2.680 1.3 Median 2.500 1.8 Standard Deviation (s) 1.138 1.2 Mean of Log (LN) Transformed Data 0.908 4.5 Std Deviation of Log (LN) Transformed Data 0.407 2 Geometric Mean (GM) 2.479 2.1 Geometric Standard Deviation (GSD) 1.502 5.5 2.2 TEST FOR DISTRIBUTION FIT 3 W Test of Log (LN) Transformed Data 0.974 2.4 Lognormal (a=0.05)? Yes 2.5 2.5 W Test of Data 0.904 3.5 Normal (a=0.05)? Yes 2.8 2.9 LOGNORMAL PARAMETRIC STATISTICS Estimated Arithmetic Mean - MVUE 2.677 1,95%LCL - Land's "Exact" 2.257 1,95%UCL - Land's "Exact" 3.327 95th Percentile 4.843 Upper Tolerance Limit (95%, 95%) 7.046 Percent Exceeding OEL (% > OEL) 4.241 1,95% LCL % > OEL 0.855 1,95% UCL % > OEL 15.271 NORMAL PARAMETRIC STATISTICS Mean 2.680 1,95%LCL - t stats 2.162 1,95%UCL- t stats 3.198 95th Percentile - Z 4.553 Upper Tolerance Limit (95%, 95%) 5.60 Percent Exceeding OEL (% > OEL) 2.078 Linear Probability Plot and Least Squares Best Fit Line 1% 2% 5% 10% 16% 25% 50% 75% 84% 90% 95% 98% 99% -5 0 5 10 Concentration Log-Probability Plot and Least Squares Best Fit Line 1% 2% 5% 10% 16% 25% 50% 75% 84% 90% 95% 98% 99% 0 1 10 Concentration Idealized Lognormal Distribution AM and CI's 95%ile 0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0 1 2 3 4 5 6 7 Concentration Sequential Data Plot 0 1 2 3 4 5 6 0 2 4 6 8 10 12 14 16 Sample Number Concentration IH Data Analyst Exposure Rating Category <1%OEL <10% OEL 10 – 50% 50 – 100% >100% OEL Probability 1 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0 0 0 0.087 0.4 0.513 OEL Likelihood that 95%ile falls into indicated Exposure Rating Category Initial Qualitative Assessment or Validated Model Prior Exposure Rating 0 1 2 3 4 Decision Probability 1 0.8 0.6 0.4 0.2 0 0.05 0.2 0.5 0.2 0.05 Monitoring Results Likelihood Exposure Rating 0 1 2 3 4 Decision Probability 1 0.8 0.6 0.4 0.2 0 0 0 0.06 0.376 0.564 Integrated Exposure Assessment Posterior Exposure Rating 0 1 2 3 4 Decision Probability 1 0.8 0.6 0.4 0.2 0 0 0 0.225 0.564 0.211 Expostats Traditional Statistics Bayesian Statistics Focus on Traditional IH Statistics 59
  • 60. FREE Traditional Statistical Tools • IHSTAT (macro-free version) https://www.aiha.org/public- resources/consumer-resources/topics-of- interest/ih-apps-tools • IHSTAT (multi-language version) https://www.aiha.org/public- resources/consumer-resources/topics-of- interest/ih-apps-tools • HYGINIST http://www.tsac.nl/hyginist.html FREE TOOLS!! 60
  • 63. AIHA IHSTAT Plot to check for sample data lognormality 63
  • 64. AIHA IHSTAT Plot of “Best Guess” SEG exposure profile 64
  • 65. * Decision statistic = 95th percentile ? Into which AIHA Exposure Category will the 95th percentile MOST LIKELY fall? OEL = 100 ppm Sample Results (ppm) 18 15 5 8 12 65
  • 66. Into which AIHA Exposure Category will the 95th percentile MOST LIKELY fall? OEL = 100 ppm Inferential Statistics OEL 95%ile 95%ile UCL -0.01 0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0 20 40 60 80 100 120 GM = 10.5 ppm GSD = 1.67 95%ile = 24.5 ppm 95%ile UCL95,95 (UTL) = 91.6 ppm Exposure Category Sample Results (ppm) 18 15 5 8 12 “Best Guess” Population (SEG) Exposure Profile Follow-Up Actions 66
  • 67. Steps in Data Analysis and Interpretation* 1. Enter Data Into Appropriate Statistical Tool 2. Evaluate the Goodness-of-fit 3. Review Descriptive and Inferential Statistics Compare… • the “decision statistic” (e.g., sample 95th percentile) to the OEL. • the 95%UCL to the OEL. 4. Assign a Final Rating and Certainty Level • Final Rating: Compare the sample 95th percentile to the Exposure Control Categories (ECCs) and select a category. • Certainty Level: Compare the 95%UCL to the ECCs: • Low certainty if > 2 categories above the chosen ECC • Medium certainty if only 1 category above • High certainty if within chosen category 5. Document the Analysis and Recommendations Recommend controls and/or PPE; work practice evaluation; additional sampling; surveillance sampling, etc. 67 *After Executing a Carefully Defined Monitoring Plan: • Defined decision statistic • Well defined SEG • Appropriate OEL • Well described exposure question • Appropriate sampling strategy • Valid and appropriate monitoring method • Validated analytical method Hewett’s ROT 67
  • 68. CLICK TO EDIT MASTER TITLE STYLE 68 EXAMPLES
  • 69. * Decision statistic = 95th percentile ? Into which AIHA Exposure Category will the 95th percentile MOST LIKELY fall? OEL = 100 ppm Sample Results (ppm) 18 15 5 8 12 69 Example 1
  • 70. Sample Results (ppm) 18 15 5 8 12 OEL = 100 ppm GM = 10.5 ppm GSD = 1.67 95%ile = 24.5 ppm 95%ile UCL95,95 = 91.6 ppm 70
  • 71. Exposure Rating Category* 0 (<1% of OEL) 1 (<10% of OEL) 2 (10-50% of OEL) 3 (50-100% of OEL) 4 (>100% of OEL) Multiples of OEL (>500% of OEL or others based on respirator APF) Recommended Control No action Procedures and Training; General Hazard Communication + Chemical Specific Hazard Communication; Periodic Exposure Monitoring, + Required Exposure Monitoring, Workplace Inspections to Verify Work Practice Controls; Medical Surveillance, Biological Monitoring + Implement Hierarchy of Controls; Monitoring to Validate Respirator Protection Factor Selection. +Immediate Engineering Controls or Process Shut Down, Validate Acceptable Respirators OEL 95%ile 95%ile UCL -0.01 0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0 20 40 60 80 100 120 Sample Results (ppm) 18 15 5 8 12 OEL = 100 ppm GM = 10.5 ppm GSD = 1.67 95%ile = 24.5 ppm 95%ile UCL95,95 = 91.6 ppm 71
  • 72. Exposure Rating Category* 0 (<1% of OEL) 1 (<10% of OEL) 2 (10-50% of OEL) 3 (50-100% of OEL) 4 (>100% of OEL) Multiples of OEL (>500% of OEL or others based on respirator APF) Recommended Control No action Procedures and Training; General Hazard Communication + Chemical Specific Hazard Communication; Periodic Exposure Monitoring, + Required Exposure Monitoring, Workplace Inspections to Verify Work Practice Controls; Medical Surveillance, Biological Monitoring + Implement Hierarchy of Controls; Monitoring to Validate Respirator Protection Factor Selection. +Immediate Engineering Controls or Process Shut Down, Validate Acceptable Respirators OEL 95%ile 95%ile UCL -0.01 0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0 20 40 60 80 100 120 95%ile Most Likely in Category 2 (Medium Certainty) Sample Results (ppm) 18 15 5 8 12 OEL = 100 ppm GM = 10.5 ppm GSD = 1.67 95%ile = 24.5 ppm 95%ile UCL95,95 = 91.6 ppm 72
  • 73. Exposure Rating Category* 0 (<1% of OEL) 1 (<10% of OEL) 2 (10-50% of OEL) 3 (50-100% of OEL) 4 (>100% of OEL) Multiples of OEL (>500% of OEL or others based on respirator APF) Recommended Control No action Procedures and Training; General Hazard Communication + Chemical Specific Hazard Communication; Periodic Exposure Monitoring, + Required Exposure Monitoring, Workplace Inspections to Verify Work Practice Controls; Medical Surveillance, Biological Monitoring + Implement Hierarchy of Controls; Monitoring to Validate Respirator Protection Factor Selection. +Immediate Engineering Controls or Process Shut Down, Validate Acceptable Respirators OEL 95%ile 95%ile UCL -0.01 0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0 20 40 60 80 100 120 95%ile Most Likely in Category 2 (Medium Certainty) More Than 95% Confident That True 95%ile Exposure <OEL Sample Results (ppm) 18 15 5 8 12 OEL = 100 ppm GM = 10.5 ppm GSD = 1.67 95%ile = 24.5 ppm 95%ile UCL95,95 = 91.6 ppm 73
  • 74. Exposure Rating Category* 0 (<1% of OEL) 1 (<10% of OEL) 2 (10-50% of OEL) 3 (50-100% of OEL) 4 (>100% of OEL) Multiples of OEL (>500% of OEL or others based on respirator APF) Recommended Control No action Procedures and Training; General Hazard Communication + Chemical Specific Hazard Communication; Periodic Exposure Monitoring, + Required Exposure Monitoring, Workplace Inspections to Verify Work Practice Controls; Medical Surveillance, Biological Monitoring + Implement Hierarchy of Controls; Monitoring to Validate Respirator Protection Factor Selection. +Immediate Engineering Controls or Process Shut Down, Validate Acceptable Respirators OEL 95%ile 95%ile UCL -0.01 0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0 20 40 60 80 100 120 95%ile Most Likely in Category 2 (Medium Certainty) More Than 95% Confident That True 95%ile Exposure <OEL Sample Results (ppm) 18 15 5 8 12 OEL = 100 ppm GM = 10.5 ppm GSD = 1.67 95%ile = 24.5 ppm 95%ile UCL95,95 = 91.6 ppm Follow-Up Actions: • Procedures and Training; General Haz. Com. • + Chemical Specific Haz. Com.; Periodic Exposure Monitoring, 74
  • 75. * Decision statistic = 95th percentile ? Into which AIHA Exposure Category will the 95th percentile MOST LIKELY fall? OEL = 100 ppm 75 Example 2 Sample Results (ppm) 8 75 5 37 12
  • 76. Exposure Rating Category* 0 (<1% of OEL) 1 (<10% of OEL) 2 (10-50% of OEL) 3 (50-100% of OEL) 4 (>100% of OEL) Multiples of OEL (>500% of OEL or others based on respirator APF) Recommended Control No action Procedures and Training; General Hazard Communication + Chemical Specific Hazard Communication; Periodic Exposure Monitoring, + Required Exposure Monitoring, Workplace Inspections to Verify Work Practice Controls; Medical Surveillance, Biological Monitoring + Implement Hierarchy of Controls; Monitoring to Validate Respirator Protection Factor Selection. +Immediate Engineering Controls or Process Shut Down, Validate Acceptable Respirators OEL 95%ile 0 0.005 0.01 0.015 0.02 0.025 0.03 0.035 0.04 0.045 0 20 40 60 80 100 120 95%ile Most Likely in Category 4 (High Certainty) Far Less Than 95% Confident That True 95%ile Exposure <OEL as 95%ile Point Estimate >OEL Sample Results (ppm) 8 75 5 37 12 OEL = 100 ppm GM = 16.8 ppm GSD = 3.06 95%ile = 105 ppm 95%ile UCL95,95 = 1836 ppm Follow-Up Actions: + Implement Hierarchy of Controls; Monitoring to Validate Respirator Protection Factor Selection. 76
  • 77. * Decision statistic = 95th percentile ? Into which AIHA Exposure Category will the 95th percentile MOST LIKELY fall? OEL = 100 ppm 77 Example 3 Sample Results (ppm) 0.75 5 2 1 3
  • 78. Exposure Rating Category* 0 (<1% of OEL) 1 (<10% of OEL) 2 (10-50% of OEL) 3 (50-100% of OEL) 4 (>100% of OEL) Multiples of OEL (>500% of OEL or others based on respirator APF) Recommended Control No action Procedures and Training; General Hazard Communication + Chemical Specific Hazard Communication; Periodic Exposure Monitoring, + Required Exposure Monitoring, Workplace Inspections to Verify Work Practice Controls; Medical Surveillance, Biological Monitoring + Implement Hierarchy of Controls; Monitoring to Validate Respirator Protection Factor Selection. +Immediate Engineering Controls or Process Shut Down, Validate Acceptable Respirators Sample Results (ppm) 0.75 5 2 1 3 OEL = 100 ppm GM = 1.9 ppm GSD = 2.18 95%ile = 6.7 ppm 95%ile UCL95,95 = 49 ppm 95%ile 95%ile UCL 0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0 20 40 60 OEL 95%ile Most Likely in Category 1 (Medium Certainty) More Than 95% Confident That True 95%ile Exposure <OEL Follow-Up Actions: • Procedures and Training; General Haz. Com. • Consider Periodic Monitoring 78
  • 79. * Decision statistic = 95th percentile ? Into which AIHA Exposure Category will the 95th percentile MOST LIKELY fall? OEL = 100 ppm 79 Example 4 Sample Results (ppm) 8 25 5
  • 80. Exposure Rating Category* 0 (<1% of OEL) 1 (<10% of OEL) 2 (10-50% of OEL) 3 (50-100% of OEL) 4 (>100% of OEL) Multiples of OEL (>500% of OEL or others based on respirator APF) Recommended Control No action Procedures and Training; General Hazard Communication + Chemical Specific Hazard Communication; Periodic Exposure Monitoring, + Required Exposure Monitoring, Workplace Inspections to Verify Work Practice Controls; Medical Surveillance, Biological Monitoring + Implement Hierarchy of Controls; Monitoring to Validate Respirator Protection Factor Selection. +Immediate Engineering Controls or Process Shut Down, Validate Acceptable Respirators Sample Results (ppm) 8 25 5 OEL = 100 ppm GM = 10.0 ppm GSD = 2.3 95%ile = 39.0 ppm 95%ile UCL95,95 = 5641.1 ppm OEL 95%ile 0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0 20 40 60 80 100 120 95% UCL 95%ile Likely in Category 2 ??? (Low Certainty) Less Than 95% Confident That True 95%ile Exposure <OEL Follow-Up Actions: • Procedures and Training; General Haz. Com. • + Chemical Specific Haz. Com.; Required Exposure Monitoring, 80
  • 81. OEL = 100 ppm Sample Results (ppm) 8 25 5 10 3 OEL = 100 ppm Sample Results (ppm) 8 25 5 10 3 7 11 OEL = 100 ppm Sample Results (ppm) 8 25 5 GM = 10.0 ppm GSD = 2.3 95%ile = 39.0 ppm 95%ile UCL95,95 =5641.1 ppm GM = 7.9 ppm GSD = 2.2 95%ile = 29.1 ppm 95%ile UCL95,95 = 222.1 ppm GM = 8.1 ppm GSD = 1.9 95%ile = 24.2 ppm 95%ile UCL95,95 = 77.6 ppm OEL 95%ile 95%ile UCL 01 2 3 4 -0.02 0 0.02 0.04 0.06 0.08 0.1 0 20 40 60 80 100 120 OEL 95%ile 95%ile UCL 0 1 2 3 4 -0.02 -0.01 0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0 1000 2000 3000 4000 5000 6000 OEL 95%ile 95%ile UCL 0 1 2 3 4 -0.02 0 0.02 0.04 0.06 0.08 0.1 0 50 100 150 200 250 81
  • 82. Change in UCL95%,95% and LCL95%,95% With Increasing Number of Samples Idealized GSD = 2 Random measurements generated from a distribution where the true GSD=3.0 and the true 95%ile=1. Simulated Number of Samples Number of Samples 82
  • 83. * Decision statistic = 95th percentile ? Into which AIHA Exposure Category will the 95th percentile MOST LIKELY fall? OEL = 100 ppm 83 Example 5 Sample Results (ppm) 8 55 5 37 12
  • 84. Exposure Rating Category* 0 (<1% of OEL) 1 (<10% of OEL) 2 (10-50% of OEL) 3 (50-100% of OEL) 4 (>100% of OEL) Multiples of OEL (>500% of OEL or others based on respirator APF) Recommended Control No action Procedures and Training; General Hazard Communication + Chemical Specific Hazard Communication; Periodic Exposure Monitoring, + Required Exposure Monitoring, Workplace Inspections to Verify Work Practice Controls; Medical Surveillance, Biological Monitoring + Implement Hierarchy of Controls; Monitoring to Validate Respirator Protection Factor Selection. +Immediate Engineering Controls or Process Shut Down, Validate Acceptable Respirators Sample Results (ppm) 8 55 5 37 12 OEL = 100 ppm GM = 15.8 ppm GSD = 2.8 95%ile =84.1 ppm 95%ile UCL95,95 = 1135.3 ppm OEL 95%ile 0 0.005 0.01 0.015 0.02 0.025 0.03 0.035 0.04 0.045 0 20 40 60 80 100 120 95% UCL 95%ile Likely in Category 3 ? 4 ??? (Low Certainty) Less Than 95% Confident That True 95%ile Exposure <OEL Follow-Up Actions: + Required Exposure Monitoring, Workplace Inspections to Verify Work Practice Controls; Medical Surveillance, Biological Monitoring + Consider Implementing Hierarchy of Controls; 84
  • 85. A Few Words About Handling Censored Data . . . Sample Results (ppm) 8 25 <5 10 <3 7 11
  • 86. A Few Words About Handling Censored Data . . . Do: • Minimize the Likelihood and Impact of Censored Data with Good Sample Planning • Strive for a detection limit that is less than 10% of the OEL. • Ask the laboratory performing sample analysis if they would calculate results down to their limit of detection (LOD) in addition to their limit of quantification (LOQ) as the LOD is often significantly lower than the LOQ. Sample Results (ppm) 8 25 <5 10 <3 7 11
  • 87. A Few Words About Handling Censored Data . . . Do: • Minimize the Likelihood and Impact of Censored Data with Good Sample Planning • Strive for a detection limit that is less than 10% of the OEL. • Ask the laboratory performing sample analysis if they would calculate results down to their limit of detection (LOD) in addition to their limit of quantification (LOQ) as the LOD is often significantly lower than the LOQ. Don’t: • Remove the non-detects from the statistical analysis. • Perform data analysis with the detection limit substituted for the less-than values. Sample Results (ppm) 8 25 <5 10 <3 7 11
  • 88. Parametric Censored Data Analysis Methods (Assumes Lognormal Distribution) • Simple Substitution - DL/2 or DL/sqrt(2) • Very easy to implement • Reasonable performance [particularly DL/sqrt(2) for 95%ile estimation] for low n (<20) and low (<25%) to moderate (25-50%) censoring. • Maximum Likelihood Estimates (MLE) • Complex calculations • Closest to best universal method • Beta Substitution • Straight forward to program in a spreadsheet • Performance similar to MLE • Log-Probit Regression (LPR) - also called Regression on Order Statistics (ROS) • Straight forward to program in a spreadsheet • Good choice for 25% to 50% censored data if n greater than 10 or 15. Sample Results (ppm) 8 25 <5 10 <3 7 11
  • 89. Parametric Censored Data Analysis Methods (Assumes Lognormal Distribution) • Simple Substitution - DL/2 or DL/sqrt(2) • Very easy to implement • Reasonable performance [particularly DL/sqrt(2) for 95%ile estimation] for low n (<20) and low (<25%) to moderate (25-50%) censoring. • Maximum Likelihood Estimates (MLE) • Complex calculations • Closest to best universal method • Beta Substitution • Straight forward to program in a spreadsheet • Performance similar to MLE • Log-Probit Regression (LPR) - also called Regression on Order Statistics (ROS) • Straight forward to program in a spreadsheet • Good choice for 25% to 50% censored data if n greater than 10 or 15. Simple Option for IHSTAT Sample Results (ppm) 8 25 <5 10 <3 7 11
  • 90. Parametric Censored Data Analysis Methods (Assumes Lognormal Distribution) • Simple Substitution - DL/2 or DL/sqrt(2) • Very easy to implement • Reasonable performance [particularly DL/sqrt(2) for 95%ile estimation] for low n (<20) and low (<25%) to moderate (25-50%) censoring. • Maximum Likelihood Estimates (MLE) • Complex calculations • Closest to best universal method • Beta Substitution • Straight forward to program in a spreadsheet • Performance similar to MLE • Log-Probit Regression (LPR) - also called Regression on Order Statistics (ROS) • Straight forward to program in a spreadsheet • Good choice for 25% to 50% censored data if n greater than 10 or 15. • Bayesian Decision Analysis • BDA uses same equations as MLE • Superior performance for characterizing parameter uncertainty • Can readily analyze censored data, including fully censored datasets Simple Option for IHSTAT Sample Results (ppm) 8 25 <5 10 <3 7 11
  • 91. Parametric Censored Data Analysis Methods (Assumes Lognormal Distribution) • Simple Substitution - DL/2 or DL/sqrt(2) • Very easy to implement • Reasonable performance [particularly DL/sqrt(2) for 95%ile estimation] for low n (<20) and low (<25%) to moderate (25-50%) censoring. • Maximum Likelihood Estimates (MLE) • Complex calculations • Closest to best universal method • Beta Substitution • Straight forward to program in a spreadsheet • Performance similar to MLE • Log-Probit Regression (LPR) - also called Regression on Order Statistics (ROS) • Straight forward to program in a spreadsheet • Good choice for 25% to 50% censored data if n greater than 10 or 15. • Bayesian Decision Analysis • BDA uses same equations as MLE • Superior performance for characterizing parameter uncertainty • Can readily analyze censored data, including fully censored datasets Simple Option for IHSTAT Sample Results (ppm) 8 25 <5 10 <3 7 11
  • 92. Sample Results (ppm) 8 25 <5 10 <3 7 11 OEL = 100 ppm Example: IHSTAT Analysis of Censored Data Using Simple Substitution: Detection Limit Divided by Square Root of Two [DL / sqrt(2)] 29% censored
  • 93. Sample Results (ppm) 8 25 <5 10 <3 7 11 OEL = 100 ppm Sample Results With Substitutions for Non-Detects (ppm) 8 25 3.54 10 2.12 7 11 Substitute 𝐷𝐿 2 = 𝐷𝐿 1.4142 Example: IHSTAT Analysis of Censored Data Using Simple Substitution: Detection Limit Divided by Square Root of Two [DL / sqrt(2)] 29% censored
  • 94. Sample Results (ppm) 8 25 <5 10 <3 7 11 OEL = 100 ppm Sample Results With Substitutions for Non-Detects (ppm) 8 25 3.54 10 2.12 7 11 Substitute 𝐷𝐿 2 = 𝐷𝐿 1.4142 Example: IHSTAT Analysis of Censored Data Using Simple Substitution: Detection Limit Divided by Square Root of Two [DL / sqrt(2)] 29% censored
  • 95. Exposure Rating Category* 0 (<1% of OEL) 1 (<10% of OEL) 2 (10-50% of OEL) 3 (50-100% of OEL) 4 (>100% of OEL) Multiples of OEL (>500% of OEL or others based on respirator APF) Recommended Control No action Procedures and Training; General Hazard Communication + Chemical Specific Hazard Communicatio n; Periodic Exposure Monitoring, + Required Exposure Monitoring, Workplace Inspections to Verify Work Practice Controls; Medical Surveillance, Biological Monitoring + Implement Hierarchy of Controls; Monitoring to Validate Respirator Protection Factor Selection. +Immediate Engineering Controls or Process Shut Down, Validate Acceptable Respirators OEL 95%ile 95%ile UCL 0 0.005 0.01 0.015 0.02 0.025 0.03 0 20 40 60 80 100 120 140 160 180 200 OEL = 100 ppm Sample Results DL/sqrt(2) Substitution for Non-Detects (ppm) 8 25 <5  3.54 10 <3  2.12 7 11 GM = 7.35 ppm GSD = 2.3 95%ile =27.4 ppm UTL95%,95% = 112 ppm 95%ile Most Likely in Category 2 (Low Certainty) Less Than 95% Confident That True 95%ile Exposure <OEL 29% censored
  • 96. Example: BDA Analysis of Censored Data Sample Results (ppm) 8 25 <5 10 <3 7 11 OEL = 100 ppm 29% censored
  • 97. Example: BDA Analysis of Censored Data No Substitution Needed Enter Directly Into Bayesian Statistical Analysis Tool (IHDA or Expostats) Sample Results (ppm) 8 25 <5 10 <3 7 11 OEL = 100 ppm 29% censored Expostats
  • 98. Learn More: Censored Data References • IHDA Help File • Hewett, P. Appendix VIII: Analysis of Censored Data. A Strategy for Assessing and Managing Occupational Exposures. 4th Ed. AIHA Press. 2015. • Hewett, P., and G. Ganser. “A Comparison of Several Methods for Analyzing Censored Data”. Ann. Occup. Hyg., Vol. 51, No. 7, pp. 611–632, 2007 • Ganser, G. and P. Hewett. “An Accurate Substitution Method for Analyzing Censored Data”. Journal of Occupational and Environmental Hygiene, 7:4, 233-244, 2010. • Huynh, Tran, Harrison Quick, Gurumurthy Ramachandran, Sudipto Banerjee, Mark Stenzel, Dale P Sandler, Lawrence S Engel, Richard K Kwok, Aaron Blair, and Patricia A Stewart. “A Comparison of the β-Substitution Method and a Bayesian Method for Analyzing Left- Censored Data.” The Annals of Occupational Hygiene 60, no. 1 (January 2016): 56–73. • Helsel, D. Non Detects and Data Analysis - Statistics for Censored Environmental Data. Hoboken, NJ: John Wiley & Sons, Inc., 2005. • Helsel, Dennis R. Statistics for Censored Environmental Data Using Minitab and R (CourseSmart). Wiley, 2012.
  • 99. CLICK TO EDIT MASTER TITLE STYLE 99 aiha.org | 99 REVIEW: DATA INTERPRETATION
  • 100. REVIEW: Steps in Data Analysis and Interpretation* 100 *After Executing a Carefully Defined Monitoring Plan: • Defined decision statistic • Well defined SEG • Appropriate OEL • Well described exposure question • Appropriate sampling strategy • Valid and appropriate monitoring method • Validated analytical method 100 Preparation: Collect High Quality Data
  • 101. *After Executing a Carefully Defined Monitoring Plan: • Defined decision statistic • Well defined SEG • Appropriate OEL • Well described exposure question • Appropriate sampling strategy • Valid and appropriate monitoring method • Validated analytical method REVIEW: Steps in Data Analysis and Interpretation* 1. Enter Data Into Appropriate Statistical Tool 2. Evaluate the Goodness-of-fit 101 101 Evaluate Lognormal Assumption
  • 102. *After Executing a Carefully Defined Monitoring Plan: • Defined decision statistic • Well defined SEG • Appropriate OEL • Well described exposure question • Appropriate sampling strategy • Valid and appropriate monitoring method • Validated analytical method REVIEW: Steps in Data Analysis and Interpretation* 1. Enter Data Into Appropriate Statistical Tool 2. Evaluate the Goodness-of-fit 3. Review Descriptive and Inferential Statistics Compare… • the “decision statistic” (e.g., sample 95th percentile) to the OEL. • the 95%UCL to the OEL. 102 102 Compare 95%ile Estimate and 95%UCL to OEL OEL 95%ile 95%ile UCL 0 1 2 3 4 -0.02 0 0.02 0.04 0.06 0.08 0.1 0 20 40 60 80 100 120
  • 103. REVIEW: Steps in Data Analysis and Interpretation* 1. Enter Data Into Appropriate Statistical Tool 2. Evaluate the Goodness-of-fit 3. Review Descriptive and Inferential Statistics Compare… • the “decision statistic” (e.g., sample 95th percentile) to the OEL. • the 95%UCL to the OEL. 4. Assign a Final Rating and Certainty Level • Final Rating: Compare the sample 95th percentile to the Exposure Control Categories (ECCs) and select a category. • Certainty Level: Compare the 95%UCL to the ECCs: • Low certainty if > 2 categories above the chosen ECC • Medium certainty if only 1 category above • High certainty if within chosen category 103 *After Executing a Carefully Defined Monitoring Plan: • Defined decision statistic • Well defined SEG • Appropriate OEL • Well described exposure question • Appropriate sampling strategy • Valid and appropriate monitoring method • Validated analytical method Hewett’s ROT 103 Assign Exposure Rating and Certainty OEL 95%ile 95%il e UCL 01 2 3 4 -0.02 0 0.02 0.04 0.06 0.08 0.1 0 20 40 60 80 100 120 Category 2 Medium Certainty
  • 104. REVIEW: Steps in Data Analysis and Interpretation* 1. Enter Data Into Appropriate Statistical Tool 2. Evaluate the Goodness-of-fit 3. Review Descriptive and Inferential Statistics Compare… • the “decision statistic” (e.g., sample 95th percentile) to the OEL. • the 95%UCL to the OEL. 4. Assign a Final Rating and Certainty Level • Final Rating: Compare the sample 95th percentile to the Exposure Control Categories (ECCs) and select a category. • Certainty Level: Compare the 95%UCL to the ECCs: • Low certainty if > 2 categories above the chosen ECC • Medium certainty if only 1 category above • High certainty if within chosen category 5. Document the Analysis and Recommendations Recommend controls and/or PPE; work practice evaluation; additional sampling; surveillance sampling, etc. 104 *After Executing a Carefully Defined Monitoring Plan: • Defined decision statistic • Well defined SEG • Appropriate OEL • Well described exposure question • Appropriate sampling strategy • Valid and appropriate monitoring method • Validated analytical method Hewett’s ROT 104 Document Results and Implement Follow-Up Actions
  • 105. CLICK TO EDIT MASTER TITLE STYLE 105 KEY RESOURCES
  • 106. Key References • Papers: • Hewett, P., Logan, P., Mulhausen, J., Ramachandran, G., and Banerjee, S.: “Rating Exposure Control using Bayesian Decision Analysis”, Journal of Occupational and Environmental Hygiene, 3: 568–581, 2006 • Logan P., G. Ramachandran, J. Mulhausen, S. Banerjee, and P. Hewett “Desktop Study of Occupational Exposure Judgments: Do Education and Experience Influence Accuracy?” Journal of Occupational and Environmental Hygiene, 8:12, 746-758, 2011. • Logan P., G. Ramachandran, J. Mulhausen, and P. Hewett:” Occupational Exposure Decisions: Can Limited Data Interpretation Training Help Improve Accuracy?” Annals of Occupational Hygiene, Vol. 53, No. 4, pp. 311–324, 2009. • Vadali, M. G. Ramachandran, J. Mulhausen, S. Banerjee, "Effect of Training on Exposure Judgment Accuracy of Industrial Hygienists”. Journal of Occupational & Environmental Hygiene. 9: 242–256, 2012. • Vadali, M., G. Ramachandran, and J. Mulhausen, “Exposure Modeling in Occupational Hygiene Decision Making”, Journal of Occupational and Environmental Hygiene: 6,353 — 362, 2009. 106
  • 107. Key References - Continued • Papers: • Hewett, P., and G. Ganser. “A Comparison of Several Methods for Analyzing Censored Data”. Ann. Occup. Hyg., Vol. 51, No. 7, pp. 611–632, 2007 • Ganser, G. and P.Hewett. “An Accurate Substitution Method for Analyzing Censored Data”. Journal of Occupational and Environmental Hygiene, 7:4, 233-244, 2010. • Arnold S., M. Stenzel, D. Drolet, G. Ramachandran; Journal of Occupational and Environmental Hygiene, 13, 159-168, 2016 • Jérôme Lavoué, Lawrence Joseph, Peter Knott, Hugh Davies, France Labrèche, Frédéric Clerc, Gautier Mater, Tracy Kirkham, “Expostats: A Bayesian Toolkit to Aid the Interpretation of Occupational Exposure Measurements”, Annals of Work Exposures and Health, Volume 63, Issue 3, April 2019, Pages 267–279, • Books: • A Strategy for Assessing and Managing Occupational Exposures. 4th Ed. AIHA Press. 2015. 107
  • 108. Key Resources • IH Stats and Other Exposure Assessment Tools: AIHA Exposure Assessment Strategies Committee Website “Tools and Links for Exposure Assessment Strategies”: https://www.aiha.org/public-resources/consumer-resources/topics-of-interest/ih-apps-tools • BDA Computer Tool: Paul Hewett’s Website - Exposure Assessment Solutions: http://www.EASInc.co • ExpoStats Bayesian IH Data Analysis Tools http://expostats.ca/site/en/index.html • Competency Demonstration: AIHA Exposure Decision Analysis Registry 108
  • 109. Exposure Decision Analysis: Competency Assessment Exposure Decision Criteria • Allowable Exceedance • Needed Confidence • Use of Exposure Categories Traditional Industrial Hygiene Stats • Properties of a lognormal distribution • Upper percentile estimate calculation & interpretation • Tolerance Limit calculation & interpretation Bayesian Decision Analysis (BDA) • Properties of a lognormal distribution • Upper percentile estimate calculation & interpretation • Tolerance Limit calculation & interpretation Data and Similar Exposure Groups (SEGs) • Rules for combining data • Indications that a SEG may need refining Decision Heuristics and Human Biases • ​Common sources of bias in data interpretation and exposure assessment • How to avoid bias in data interpretation Exposure Data Interpretation • ​Most likely exposure category given data • Meet the certainty requirement given data Techniques for Improving Professional Judgments • ​Feedback loops (quantitative judgment > monitoring > qualitative judgment) • Group judgment sessions • Documentation of rationale • Break decisions into aggregate parts (Modeling) 109
  • 110. AIHA VIDEO SERIES: MAKING ACCURATE EXPOSURE RISK DECISIONS Video 1A Exposure Variability and the Importance of Using Statistics to Improve Judgements 110 John R. Mulhausen, PhD, CIH, CSP, FAIHA
  • 111. AIHA VIDEO SERIES: MAKING ACCURATE EXPOSURE RISK DECISIONS Video 1A: Exposure Variability and the Importance of Using Statistics to Improve Judgements Video 1B: Rules of Thumb for Interpreting Exposure Monitoring Data Video 2: Introduction to Bayesian Statistical Approaches and Their Advantages Video 3A: Free Bayesian Statistical Tools: IHDA Student Edition Video 3B: Free Bayesian Statistical Tools: Expostats Video 4: Implementing AIHA Strategy Using Statistical Tools: Examples 111 Join us for the next video in the series . . .