SlideShare a Scribd company logo
1 of 23
Download to read offline
Page 1 of 23
Introduction and Summary
A thorough review of Brower Psychological Services’ (BPS) evaluation practices from 2018 through 03/2022 was
completed to uncover the possible presence of racially and/or ethnically driven adverse impact against police applicants
for the Aurora Police Department considered in insolation and for all of the agencies serviced by BPS. Typically, adverse
impact is determined by using the four-fifths or eighty percent rule. The four-fifths or 80% rule is described by the
Uniform Guidelines for Employee Selection Procedures as “a selection rate for any race, sex, or ethnic group which is less
than four-fifths (or 80%) of the rate for the group with the highest rate will generally be regarded by the Federal
enforcement agencies as evidence of adverse impact, while a greater than four-fifths rate will generally not be regarded
by Federal enforcement agencies as evidence of adverse impact.” Since the 80% test does not involve probability
distributions to determine whether the disparity is a “beyond chance” occurrence, we have additionally included tests of
statistical significance where the 80% rule may have been violated, as well as observations to assess practical significance
of the results.
No violations of the 80% rule or any statistically significant correlation between race/ethnicity and pass rate were
found when all of the area agencies serviced by BPS were viewed in aggregate, regardless of stage of evaluation. No 80%
violations were found for the Aurora Police Department in any year or stage of evaluation; however, Fisher’s Exact Test of
first-stage evaluations (“JSAs”) conducted in 2021 suggested a possibly significant relationship between race/ethnicity and
pass rate. Though there was no violation of the 80% rule despite this possible relationship, additional practical analyses
were conducted to uncover the presence of confounds or unaccounted for factors that may explain the disparity found in
this one department during a singular year. These analyses suggest that Aurora PD was engaged in either an official or
informal special recruiting program resulting in a demographic distribution that was atypical of the normal pool of
applicants from that group. Such demographic shifts in an applicant pool have been established in the literature and are
referenced specifically in the Uniform Guidelines on Employee Selection Procedures (1978) as a known source of data
distortion likely to create a specious impression of adverse impact. We find a potentially undisclosed hiring initiative to be
Page 2 of 23
the most likely explanation for this deviation that is confined both temporally and organizationally, as the uniformity and
stability of our processes across time and agency are observable throughout our data.
Page 3 of 23
Analyses
All Agency Applicants 01/2021-03/2022
Filtered By: All Agencies and Type (First)
Descriptives
Introduction
Frequencies and percentages were calculated for Pass_Fail split by Race_Ethnicity.
Results
Frequencies and Percentages
The most frequently observed category of Pass_Fail within the White category of Race_Ethnicity was Pass (n =
419, 79.06%). The most frequently observed category of Pass_Fail within the Hispanic category of Race_Ethnicity was Pass
(n = 140, 74.07%). The most frequently observed category of Pass_Fail within the Black category of Race_Ethnicity was
Pass (n = 57, 67.86%). The most frequently observed category of Pass_Fail within the Other category of Race_Ethnicity
was Pass (n = 50, 79.37%). Frequencies and percentages are presented in Table 1.
Table 1
Frequency Table for Nominal Variables
Race_Ethnicity
Variable White Hispanic Black Other Missing
Pass_Fail
Fail 111 (20.94%) 49 (25.93%) 27 (32.14%) 13 (20.63%) 0 (0.00%)
Pass 419 (79.06%) 140 (74.07%) 57 (67.86%) 50 (79.37%) 0 (0.00%)
Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%)
Total 530 (100.00%) 189 (100.00%) 84 (100.00%) 63 (100.00%) 0 (100.00%)
Note. Due to rounding error, percentages may not sum to 100%.
Filtered By: All Agencies and Type (Second)
Descriptives
Introduction
Frequencies and percentages were calculated for Pass_Fail split by Race_Ethnicity.
Results
Frequencies and Percentages
The most frequently observed category of Pass_Fail within the White category of Race_Ethnicity was Pass (n =
158, 90.80%). The most frequently observed category of Pass_Fail within the Hispanic category of Race_Ethnicity was Pass
Page 4 of 23
(n = 48, 88.89%). The most frequently observed category of Pass_Fail within the Black category of Race_Ethnicity was Pass
(n = 20, 86.96%). The most frequently observed category of Pass_Fail within the Other category of Race_Ethnicity was
Pass (n = 18, 90.00%). Frequencies and percentages are presented in Table 2.
Table 2
Frequency Table for Nominal Variables
Race_Ethnicity
Variable White Hispanic Black Other Missing
Pass_Fail
Fail 16 (9.20%) 6 (11.11%) 3 (13.04%) 2 (10.00%) 0 (0.00%)
Pass 158 (90.80%) 48 (88.89%) 20 (86.96%) 18 (90.00%) 0 (0.00%)
Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%)
Total 174 (100.00%) 54 (100.00%) 23 (100.00%) 20 (100.00%) 0 (100.00%)
Note. Due to rounding error, percentages may not sum to 100%.
Filtered By: All Agencies and Type (Post)
Descriptives
Introduction
Frequencies and percentages were calculated for Pass_Fail split by Race_Ethnicity.
Results
Frequencies and Percentages
The most frequently observed category of Pass_Fail within the White category of Race_Ethnicity was Pass (n =
355, 74.27%). The most frequently observed category of Pass_Fail within the Hispanic category of Race_Ethnicity was Pass
(n = 47, 66.20%). The most frequently observed category of Pass_Fail within the Black category of Race_Ethnicity was Pass
(n = 20, 66.67%). The most frequently observed category of Pass_Fail within the Other category of Race_Ethnicity was
Pass (n = 13, 59.09%). Frequencies and percentages are presented in Table 3.
Page 5 of 23
Table 3
Frequency Table for Nominal Variables
Race_Ethnicity
Variable White Hispanic Black Other Missing
Pass_Fail
Fail 123 (25.73%) 24 (33.80%) 10 (33.33%) 9 (40.91%) 0 (0.00%)
Pass 355 (74.27%) 47 (66.20%) 20 (66.67%) 13 (59.09%) 0 (0.00%)
Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%)
Total 478 (100.00%) 71 (100.00%) 30 (100.00%) 22 (100.00%) 0 (100.00%)
Note. Due to rounding error, percentages may not sum to 100%.
Filtered By: All Agencies and Type (First)
Fisher's Exact Test
Introduction
A Fisher's exact test was conducted to examine whether Pass_Fail and Race_Ethnicity were independent. There
were 2 levels in Pass_Fail: Fail and Pass. There were 4 levels in Race_Ethnicity: White, Hispanic, Black, and Other.
Results
The results of the Fisher exact test were not significant based on an alpha value of .05, p = .100, suggesting that
Pass_Fail and Race_Ethnicity could be independent of one another. This implies that the observed frequencies were not
significantly different than the expected frequencies. Table 4 presents the results of the Fisher's exact test.
Table 4
Observed and Expected Frequencies
Pass_Fail
Race_Ethnicity Fail Pass p
White 111[122.40] 419[407.60] .100
Hispanic 49[43.65] 140[145.35]
Black 27[19.40] 57[64.60]
Other 13[14.55] 50[48.45]
Note. Values formatted as Observed[Expected].
Filtered By: All Agencies and Type (Second)
Fisher's Exact Test
Introduction
A Fisher's exact test was conducted to examine whether Pass_Fail and Race_Ethnicity were independent. There
were 2 levels in Pass_Fail: Fail and Pass. There were 4 levels in Race_Ethnicity: White, Hispanic, Black, and Other.
Page 6 of 23
Results
The results of the Fisher exact test were not significant based on an alpha value of .05, p = .870, suggesting that
Pass_Fail and Race_Ethnicity could be independent of one another. This implies that the observed frequencies were not
significantly different than the expected frequencies. Table 5 presents the results of the Fisher's exact test.
Table 5
Observed and Expected Frequencies
Pass_Fail
Race_Ethnicity Fail Pass p
White 16[17.34] 158[156.66] .870
Hispanic 6[5.38] 48[48.62]
Black 3[2.29] 20[20.71]
Other 2[1.99] 18[18.01]
Note. Values formatted as Observed[Expected].
Page 7 of 23
Aurora PD Police Applicants 2018 – 03/2022
Filtered By: Stage (First)
Descriptives
Introduction
Frequencies and percentages were calculated for Bivariate_Pass split by Year_Nominal.
Results
Frequencies and Percentages
The most frequently observed category of Bivariate_Pass within the 2018 category of Year_Nominal was Pass (n =
151, 70.56%). The most frequently observed category of Bivariate_Pass within the 2019 category of Year_Nominal was
Pass (n = 263, 70.70%). The most frequently observed category of Bivariate_Pass within the 2020 category of
Year_Nominal was Pass (n = 160, 68.67%). The most frequently observed category of Bivariate_Pass within the 2021
category of Year_Nominal was Pass (n = 245, 69.80%). The most frequently observed category of Bivariate_Pass within the
2022 category of Year_Nominal was Pass (n = 34, 66.67%). Frequencies and percentages are presented in Table 1.
Table 1
Frequency Table for Nominal Variables
Year_Nominal
Variable 2018 2019 2020 2021 2022 Missing
Bivariate_Pass
Fail 63 (29.44%) 109 (29.30%) 73 (31.33%) 106 (30.20%) 17 (33.33%) 0 (0.00%)
Pass 151 (70.56%) 263 (70.70%) 160 (68.67%) 245 (69.80%) 34 (66.67%) 0 (0.00%)
Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%)
Total 214 (100.00%) 372 (100.00%) 233 (100.00%) 351 (100.00%) 51 (100.00%) 0 (100.00%)
Note. Due to rounding error, percentages may not sum to 100%.
Page 8 of 23
Filtered By: Stage (Second)
Descriptives
Introduction
Frequencies and percentages were calculated for Bivariate_Pass split by Year_Nominal.
Results
Frequencies and Percentages
All observations were missing for the 2018 category of Year_Nominal within each category of Bivariate_Pass. The
most frequently observed category of Bivariate_Pass within the 2019 category of Year_Nominal was Pass (n = 79,
96.34%). The most frequently observed category of Bivariate_Pass within the 2020 category of Year_Nominal was Pass (n
= 77, 81.05%). The most frequently observed category of Bivariate_Pass within the 2021 category of Year_Nominal was
Pass (n = 83, 90.22%). The most frequently observed category of Bivariate_Pass within the 2022 category of Year_Nominal
was Pass (n = 12, 92.31%). Frequencies and percentages are presented in Table 2.
Table 2
Frequency Table for Nominal Variables
Year_Nominal
Variable 2018 2019 2020 2021 2022 Missing
Bivariate_Pass
Fail 0 (0.00%) 3 (3.66%) 18 (18.95%) 9 (9.78%) 1 (7.69%) 0 (0.00%)
Pass 0 (0.00%) 79 (96.34%) 77 (81.05%) 83 (90.22%) 12 (92.31%) 0 (0.00%)
Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%)
Total 0 (100.00%) 82 (100.00%) 95 (100.00%) 92 (100.00%) 13 (100.00%) 0 (100.00%)
Note. Due to rounding error, percentages may not sum to 100%.
Filtered By: Stage (First)
Descriptives
Introduction
Frequencies and percentages were calculated for Race_Ethnicity_Simplified split by Year_Nominal.
Results
Frequencies and Percentages
The most frequently observed category of Race_Ethnicity_Simplified within the 2018 category of Year_Nominal
was White (n = 128, 59.81%). The most frequently observed category of Race_Ethnicity_Simplified within the 2019
category of Year_Nominal was White (n = 238, 63.98%). The most frequently observed category of
Race_Ethnicity_Simplified within the 2020 category of Year_Nominal was White (n = 139, 59.66%). The most frequently
Page 9 of 23
observed category of Race_Ethnicity_Simplified within the 2021 category of Year_Nominal was White (n = 194, 55.27%).
The most frequently observed category of Race_Ethnicity_Simplified within the 2022 category of Year_Nominal was
White (n = 27, 52.94%). Frequencies and percentages are presented in Table 3.
Table 3
Frequency Table for Nominal Variables
Year_Nominal
Variable 2018 2019 2020 2021 2022 Missing
Race_Ethnicity_Simplified
White 128 (59.81%) 238 (63.98%) 139 (59.66%) 194 (55.27%) 27 (52.94%) 0 (0.00%)
Hispanic 51 (23.83%) 67 (18.01%) 47 (20.17%) 90 (25.64%) 11 (21.57%) 0 (0.00%)
Other 13 (6.07%) 39 (10.48%) 23 (9.87%) 31 (8.83%) 2 (3.92%) 0 (0.00%)
Black 22 (10.28%) 28 (7.53%) 24 (10.30%) 36 (10.26%) 11 (21.57%) 0 (0.00%)
Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%)
Total
214
(100.00%)
372
(100.00%)
233
(100.00%)
351
(100.00%)
51
(100.00%)
0
(100.00%)
Note. Due to rounding error, percentages may not sum to 100%.
Filtered By: Stage (Second)
Descriptives
Introduction
Frequencies and percentages were calculated for Race_Ethnicity_Simplified split by Year_Nominal.
Results
Frequencies and Percentages
All observations were missing for the 2018 category of Year_Nominal within each category of
Race_Ethnicity_Simplified. The most frequently observed category of Race_Ethnicity_Simplified within the 2019 category
of Year_Nominal was White (n = 60, 73.17%). The most frequently observed category of Race_Ethnicity_Simplified within
the 2020 category of Year_Nominal was White (n = 60, 63.16%). The most frequently observed category of
Race_Ethnicity_Simplified within the 2021 category of Year_Nominal was White (n = 58, 63.04%). The most frequently
observed category of Race_Ethnicity_Simplified within the 2022 category of Year_Nominal was White (n = 9, 69.23%).
Frequencies and percentages are presented in Table 4.
Page 10 of 23
Table 4
Frequency Table for Nominal Variables
Year_Nominal
Variable 2018 2019 2020 2021 2022 Missing
Race_Ethnicity_Simplified
White 0 (0.00%) 60 (73.17%) 60 (63.16%) 58 (63.04%) 9 (69.23%) 0 (0.00%)
Hispanic 0 (0.00%) 13 (15.85%) 20 (21.05%) 22 (23.91%) 3 (23.08%) 0 (0.00%)
Other 0 (0.00%) 6 (7.32%) 11 (11.58%) 6 (6.52%) 1 (7.69%) 0 (0.00%)
Black 0 (0.00%) 3 (3.66%) 4 (4.21%) 6 (6.52%) 0 (0.00%) 0 (0.00%)
Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%)
Total 0 (100.00%) 82 (100.00%) 95 (100.00%) 92 (100.00%) 13 (100.00%) 0 (100.00%)
Note. Due to rounding error, percentages may not sum to 100%.
Filtered By: Stage (First)
Descriptives
Introduction
Frequencies and percentages were calculated for Year_Nominal and Bivariate_Pass split by
Race_Ethnicity_Simplified.
Results
Frequencies and Percentages
The most frequently observed category of Year_Nominal within the White category of Race_Ethnicity_Simplified
was 2019 (n = 238, 32.78%). The most frequently observed category of Year_Nominal within the Hispanic category of
Race_Ethnicity_Simplified was 2021 (n = 90, 33.83%). The most frequently observed category of Year_Nominal within the
Other category of Race_Ethnicity_Simplified was 2019 (n = 39, 36.11%). The most frequently observed category of
Year_Nominal within the Black category of Race_Ethnicity_Simplified was 2021 (n = 36, 29.75%). The most frequently
observed category of Bivariate_Pass within the White category of Race_Ethnicity_Simplified was Pass (n = 519, 71.49%).
The most frequently observed category of Bivariate_Pass within the Hispanic category of Race_Ethnicity_Simplified was
Pass (n = 183, 68.80%). The most frequently observed category of Bivariate_Pass within the Other category of
Race_Ethnicity_Simplified was Pass (n = 80, 74.07%). The most frequently observed category of Bivariate_Pass within the
Black category of Race_Ethnicity_Simplified was Pass (n = 71, 58.68%). Frequencies and percentages are presented in
Table 5.
Page 11 of 23
Table 5
Frequency Table for Nominal Variables
Race_Ethnicity_Simplified
Variable White Hispanic Other Black Missing
Year_Nominal
2018 128 (17.63%) 51 (19.17%) 13 (12.04%) 22 (18.18%) 0 (0.00%)
2019 238 (32.78%) 67 (25.19%) 39 (36.11%) 28 (23.14%) 0 (0.00%)
2020 139 (19.15%) 47 (17.67%) 23 (21.30%) 24 (19.83%) 0 (0.00%)
2021 194 (26.72%) 90 (33.83%) 31 (28.70%) 36 (29.75%) 0 (0.00%)
2022 27 (3.72%) 11 (4.14%) 2 (1.85%) 11 (9.09%) 0 (0.00%)
Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%)
Total 726 (100.00%) 266 (100.00%) 108 (100.00%) 121 (100.00%) 0 (100.00%)
Bivariate_Pass
Fail 207 (28.51%) 83 (31.20%) 28 (25.93%) 50 (41.32%) 0 (0.00%)
Pass 519 (71.49%) 183 (68.80%) 80 (74.07%) 71 (58.68%) 0 (0.00%)
Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%)
Total 726 (100.00%) 266 (100.00%) 108 (100.00%) 121 (100.00%) 0 (100.00%)
Note. Due to rounding error, percentages may not sum to 100%.
Filtered By: Stage (Second)
Descriptives
Introduction
Frequencies and percentages were calculated for Year_Nominal and Bivariate_Pass split by
Race_Ethnicity_Simplified.
Results
Frequencies and Percentages
The most frequently observed categories of Year_Nominal within the White category of Race_Ethnicity_Simplified
were 2019 and 2020 (n = 60, 32.09%). The most frequently observed category of Year_Nominal within the Hispanic
category of Race_Ethnicity_Simplified was 2021 (n = 22, 37.93%). The most frequently observed category of
Year_Nominal within the Other category of Race_Ethnicity_Simplified was 2020 (n = 11, 45.83%). The most frequently
observed category of Year_Nominal within the Black category of Race_Ethnicity_Simplified was 2021 (n = 6, 46.15%). The
most frequently observed category of Bivariate_Pass within the White category of Race_Ethnicity_Simplified was Pass (n =
165, 88.24%). The most frequently observed category of Bivariate_Pass within the Hispanic category of
Race_Ethnicity_Simplified was Pass (n = 55, 94.83%). The most frequently observed category of Bivariate_Pass within the
Other category of Race_Ethnicity_Simplified was Pass (n = 20, 83.33%). The most frequently observed category of
Bivariate_Pass within the Black category of Race_Ethnicity_Simplified was Pass (n = 11, 84.62%). Frequencies and
percentages are presented in Table 6.
Page 12 of 23
Table 6
Frequency Table for Nominal Variables
Race_Ethnicity_Simplified
Variable White Hispanic Other Black Missing
Year_Nominal
2018 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%)
2019 60 (32.09%) 13 (22.41%) 6 (25.00%) 3 (23.08%) 0 (0.00%)
2020 60 (32.09%) 20 (34.48%) 11 (45.83%) 4 (30.77%) 0 (0.00%)
2021 58 (31.02%) 22 (37.93%) 6 (25.00%) 6 (46.15%) 0 (0.00%)
2022 9 (4.81%) 3 (5.17%) 1 (4.17%) 0 (0.00%) 0 (0.00%)
Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%)
Total 187 (100.00%) 58 (100.00%) 24 (100.00%) 13 (100.00%) 0 (100.00%)
Bivariate_Pass
Fail 22 (11.76%) 3 (5.17%) 4 (16.67%) 2 (15.38%) 0 (0.00%)
Pass 165 (88.24%) 55 (94.83%) 20 (83.33%) 11 (84.62%) 0 (0.00%)
Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%)
Total 187 (100.00%) 58 (100.00%) 24 (100.00%) 13 (100.00%) 0 (100.00%)
Note. Due to rounding error, percentages may not sum to 100%.
Filtered By: Year_Nominal (2018) and Stage (First)
Fisher's Exact Test
Introduction
A Fisher's exact test was conducted to examine whether Bivariate_Pass and Race_Ethnicity_Simplified were
independent. There were 2 levels in Bivariate_Pass: Fail and Pass. There were 4 levels in Race_Ethnicity_Simplified: White,
Hispanic, Other, and Black.
Results
The results of the Fisher exact test were not significant based on an alpha value of .05, p = .734, suggesting that
Bivariate_Pass and Race_Ethnicity_Simplified could be independent of one another. This implies that the observed
frequencies were not significantly different than the expected frequencies. Table 7 presents the results of the Fisher's
exact test.
Table 7
Observed and Expected Frequencies
Bivariate_Pass
Race_Ethnicity_Simplified Fail Pass p
White 41[37.68] 87[90.32] .734
Hispanic 12[15.01] 39[35.99]
Other 4[3.83] 9[9.17]
Black 6[6.48] 16[15.52]
Note. Values formatted as Observed[Expected].
Page 13 of 23
Filtered By: Year_Nominal (2019) and Stage (First)
Fisher's Exact Test
Introduction
A Fisher's exact test was conducted to examine whether Bivariate_Pass and Race_Ethnicity_Simplified were
independent. There were 2 levels in Bivariate_Pass: Fail and Pass. There were 4 levels in Race_Ethnicity_Simplified: White,
Hispanic, Other, and Black.
Results
The results of the Fisher exact test were not significant based on an alpha value of .05, p = .453, suggesting that
Bivariate_Pass and Race_Ethnicity_Simplified could be independent of one another. This implies that the observed
frequencies were not significantly different than the expected frequencies. Table 8 presents the results of the Fisher's
exact test.
Table 8
Observed and Expected Frequencies
Bivariate_Pass
Race_Ethnicity_Simplified Fail Pass p
White 67[69.74] 171[168.26] .453
Hispanic 19[19.63] 48[47.37]
Other 11[11.43] 28[27.57]
Black 12[8.20] 16[19.80]
Note. Values formatted as Observed[Expected].
Filtered By: Year_Nominal (2020) and Stage (First)
Fisher's Exact Test
Introduction
A Fisher's exact test was conducted to examine whether Bivariate_Pass and Race_Ethnicity_Simplified were
independent. There were 2 levels in Bivariate_Pass: Fail and Pass. There were 4 levels in Race_Ethnicity_Simplified: White,
Hispanic, Other, and Black.
Results
The results of the Fisher exact test were not significant based on an alpha value of .05, p = .680, suggesting that
Bivariate_Pass and Race_Ethnicity_Simplified could be independent of one another. This implies that the observed
frequencies were not significantly different than the expected frequencies. Table 9 presents the results of the Fisher's
exact test.
Page 14 of 23
Table 9
Observed and Expected Frequencies
Bivariate_Pass
Race_Ethnicity_Simplified Fail Pass p
White 43[43.55] 96[95.45] .680
Hispanic 13[14.73] 34[32.27]
Other 7[7.21] 16[15.79]
Black 10[7.52] 14[16.48]
Note. Values formatted as Observed[Expected].
Filtered By: Year_Nominal (2021) and Stage (First)
Fisher's Exact Test
Introduction
A Fisher's exact test was conducted to examine whether Bivariate_Pass and Race_Ethnicity_Simplified were
independent. There were 2 levels in Bivariate_Pass: Fail and Pass. There were 4 levels in Race_Ethnicity_Simplified: White,
Hispanic, Other, and Black.
Results
The results of the Fisher exact test were significant based on an alpha value of .05, p = .006, suggesting that
Bivariate_Pass and Race_Ethnicity_Simplified are related to one another. The following level combinations had observed
values that were greater than their expected values: Race_Ethnicity_Simplified (Hispanic):Bivariate_Pass (Fail),
Race_Ethnicity_Simplified (Black):Bivariate_Pass (Fail), Race_Ethnicity_Simplified (White):Bivariate_Pass (Pass), and
Race_Ethnicity_Simplified (Other):Bivariate_Pass (Pass). The following level combinations had observed values that were
less than their expected values: Race_Ethnicity_Simplified (White):Bivariate_Pass (Fail), Race_Ethnicity_Simplified
(Other):Bivariate_Pass (Fail), Race_Ethnicity_Simplified (Hispanic):Bivariate_Pass (Pass), and Race_Ethnicity_Simplified
(Black):Bivariate_Pass (Pass). Table 10 presents the results of the Fisher's exact test.
Table 10
Observed and Expected Frequencies
Bivariate_Pass
Race_Ethnicity_Simplified Fail Pass p
White 48[58.59] 146[135.41] .006
Hispanic 35[27.18] 55[62.82]
Other 6[9.36] 25[21.64]
Black 17[10.87] 19[25.13]
Note. Values formatted as Observed[Expected].
Page 15 of 23
Filtered By: Year_Nominal (2022) and Stage (First)
Fisher's Exact Test
Introduction
A Fisher's exact test was conducted to examine whether Bivariate_Pass and Race_Ethnicity_Simplified were
independent. There were 2 levels in Bivariate_Pass: Fail and Pass. There were 4 levels in Race_Ethnicity_Simplified: White,
Hispanic, Other, and Black.
Results
The results of the Fisher exact test were not significant based on an alpha value of .05, p = .698, suggesting that
Bivariate_Pass and Race_Ethnicity_Simplified could be independent of one another. This implies that the observed
frequencies were not significantly different than the expected frequencies. Table 11 presents the results of the Fisher's
exact test.
Table 11
Observed and Expected Frequencies
Bivariate_Pass
Race_Ethnicity_Simplified Fail Pass p
White 8[9.00] 19[18.00] .698
Hispanic 4[3.67] 7[7.33]
Other 0[0.67] 2[1.33]
Black 5[3.67] 6[7.33]
Note. Values formatted as Observed[Expected].
Filtered By: Year_Nominal (2019) and Stage (Second)
Fisher's Exact Test
Introduction
A Fisher's exact test was conducted to examine whether Bivariate_Pass and Race_Ethnicity_Simplified were
independent. There were 2 levels in Bivariate_Pass: Fail and Pass. There were 4 levels in Race_Ethnicity_Simplified: White,
Hispanic, Other, and Black.
Results
The results of the Fisher exact test were not significant based on an alpha value of .05, p = 1.000, suggesting that
Bivariate_Pass and Race_Ethnicity_Simplified could be independent of one another. This implies that the observed
frequencies were not significantly different than the expected frequencies. Table 12 presents the results of the Fisher's
exact test.
Table 12
Page 16 of 23
Observed and Expected Frequencies
Bivariate_Pass
Race_Ethnicity_Simplified Fail Pass p
White 3[2.20] 57[57.80] 1.000
Hispanic 0[0.48] 13[12.52]
Other 0[0.22] 6[5.78]
Black 0[0.11] 3[2.89]
Note. Values formatted as Observed[Expected].
Filtered By: Year_Nominal (2020) and Stage (Second)
Fisher's Exact Test
Introduction
A Fisher's exact test was conducted to examine whether Bivariate_Pass and Race_Ethnicity_Simplified were
independent. There were 2 levels in Bivariate_Pass: Fail and Pass. There were 4 levels in Race_Ethnicity_Simplified: White,
Hispanic, Other, and Black.
Results
The results of the Fisher exact test were not significant based on an alpha value of .05, p = .227, suggesting that
Bivariate_Pass and Race_Ethnicity_Simplified could be independent of one another. This implies that the observed
frequencies were not significantly different than the expected frequencies. Table 13 presents the results of the Fisher's
exact test.
Table 13
Observed and Expected Frequencies
Bivariate_Pass
Race_Ethnicity_Simplified Fail Pass p
White 13[11.37] 47[48.63] .227
Hispanic 1[3.79] 19[16.21]
Other 3[2.08] 8[8.92]
Black 1[0.76] 3[3.24]
Note. Values formatted as Observed[Expected].
Filtered By: Year_Nominal (2021) and Stage (Second)
Fisher's Exact Test
Introduction
A Fisher's exact test was conducted to examine whether Bivariate_Pass and Race_Ethnicity_Simplified were
independent. There were 2 levels in Bivariate_Pass: Fail and Pass. There were 4 levels in Race_Ethnicity_Simplified: White,
Hispanic, Other, and Black.
Page 17 of 23
Results
The results of the Fisher exact test were not significant based on an alpha value of .05, p = .399, suggesting that
Bivariate_Pass and Race_Ethnicity_Simplified could be independent of one another. This implies that the observed
frequencies were not significantly different than the expected frequencies. Table 14 presents the results of the Fisher's
exact test.
Table 14
Observed and Expected Frequencies
Bivariate_Pass
Race_Ethnicity_Simplified Fail Pass p
White 6[5.67] 52[52.33] .399
Hispanic 1[2.15] 21[19.85]
Other 1[0.59] 5[5.41]
Black 1[0.59] 5[5.41]
Note. Values formatted as Observed[Expected].
Page 18 of 23
Filtered By: Year_Nominal (2022) and Stage (Second)
Fisher's Exact Test
Introduction
A Fisher's exact test was conducted to examine whether Bivariate_Pass and Race_Ethnicity_Simplified were
independent. There were 2 levels in Bivariate_Pass: Fail and Pass. There were 4 levels in Race_Ethnicity_Simplified: White,
Hispanic, Other, and Black.
Results
The results of the Fisher exact test were not significant based on an alpha value of .05, p = .308, suggesting that
Bivariate_Pass and Race_Ethnicity_Simplified could be independent of one another. This implies that the observed
frequencies were not significantly different than the expected frequencies. Table 15 presents the results of the Fisher's
exact test.
Table 15
Observed and Expected Frequencies
Bivariate_Pass
Race_Ethnicity_Simplified Fail Pass p
White 0[0.69] 9[8.31] .308
Hispanic 1[0.23] 2[2.77]
Other 0[0.08] 1[0.92]
Black 0[0.00] 0[0.00]
Note. Values formatted as Observed[Expected].
Page 19 of 23
Aurora PD Observations
Adverse Impact: 4/5ths - 80/20 Rule
The following figures were published/distributed by Aurora PD describing the demographic composition and
selection rates for police academies held 2018-2020 titled “Passing Job Suitability Interview”:
Table 16
Aurora PD’s Figures for Passing Job Suitability Interview, from “APD Academies from 2018-2020”
Race/Ethnicity
White or Caucasian Black or African American Hispanic or Latino Asian 2+ or Other
Passing Job
Suitability
Interview
413 (42.4%) 42 (34.4%) 112 (37.7%) 18 (37.5%) 80 (44.7%)
According to these figures, the 4/5ths – 80/20 rule would have been violated for “Black or African American”
applicants when compared to the group with the highest passing rate, “2+ or Other.” These figures are substantially
different than the figures we have for police applicants referred by Aurora PD for JSA’s from 2018-2020, which appear in
the table below.
Table 17
Frequency Table for Nominal Variables
Race_Ethnicity_Simplified
Variable White Hispanic Other Black Missing
Bivariate_Pass
Fail 151 (29.90%) 44 (26.67%) 22 (29.33%) 28 (37.84%) 0 (0.00%)
Pass 354 (70.10%) 121 (73.33%) 53 (70.67%) 46 (62.16%) 0 (0.00%)
Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%)
Total 505 (100.00%) 165 (100.00%) 75 (100.00%) 74 (100.00%) 0 (100.00%)
Note. Due to rounding error, percentages may not sum to 100%.
Not only do our figures represent a far higher passing percentage for applicants, there is no violation of the 4/5ths
– 80/20 rule when comparing the demographic group with the highest passing rate (Hispanic; 73.33%) to the
demographic group with the lowest passing rate (Black; 62.16%).
When 2018-2022 JSAs are viewed in aggregate, Other is the demographic group with the highest passing
percentage (~74%) and Black is the demographic group with the lowest passing percentage (~59%). White and Hispanic
Page 20 of 23
groupings showed passing rates within a few percent (~71% and ~69%, respectively). When the 4/5ths rule is applied to
measure the difference between Black and Other applicants, an ~20% difference is observed, suggesting that adverse
impact is not present at a level surpassing prevailing/traditional Federal guidelines. When Black applicants are compared
to White applicants, the demographic group comprising the majority of all applicants, a 17% difference is seen, again
suggesting that adverse impact is not present at a level surpassing prevailing/traditional Federal guidelines.
When the same aggregated approach is applied to Aurora PD 2nd
Stage evaluations, there is no observable
difference indicating violation of the 4/5ths rule. The demographic group with the highest passing rate amongst 2nd
Stage
evaluations from 2018-2022 is Hispanic (~95%) while the lowest passing rate being found in the Other demographic group
(~83%); a 13% difference. Among all 2nd
Stages from 2018-2022, members of the White group passed at ~88%, while
members of the Black group passed at approximately ~85%.
0%
10%
20%
30%
40%
50%
60%
70%
80%
2018-2022 JSA Passing Rates
White Black Hispanic Other
Page 21 of 23
Adverse Impact: Statistical Significance
Fisher’s Exact Tests split by year and stage of evaluation for Aurora PD suggest that there is no difference between
observed and expected frequencies of passing among the four demographic groups for JSAs conducted in 2018, 2019,
2020, and 2022 and for 2nd
Stage evaluations conducted from 2018-2022. Among 2021 JSAs there is a possible
relationship suggested between Race/Ethnicity and Passing; specifically, that members of the White and Other
demographic groups are more likely to pass, while members of the Black and Hispanic demographic groups are less likely
to pass.
Adverse Impact: Practical Significance (Demographic Shifts)
When comparing demographic distributions of applicants referred for JSAs by Aurora PD from 2019 to 2022, the
percentage of all applicants self-identifying as White, decreased by ~10%. Between 2020 and 2021, the percentage of
applicants self-identifying as Hispanic nearly doubled (~18% vs ~34%), and between 2019 and 2022, the percentage of
applicant’s self-identifying as Black more than doubled, increasing by ~96% (from ~8% to ~22%).
62%
96%
-10%
Applicant Demographic Changes JSAs
Hispanic Black White
76%
78%
80%
82%
84%
86%
88%
90%
92%
94%
96%
2018-2022 2nd Stage Passing Rates
White Black Hispanic Other
Page 22 of 23
When looking at 2nd Stage evaluations for Aurora PD, a similar 10% decrease in White applicants is observable
when comparing 2019’s ~73% proportion to 2020 and 2021’s ~63%. When comparing the number of Black applicants
referred for 2nd
Stage evaluations from 2019 to 2021, a 56% increase is observable. The percentage of Hispanic applicants
also increased by more than 50% from 2019 (~22%) to 2021 (~38%).
Adverse Impact: Practical Significance (Inclusion/Exclusion Shifts)
In 2021, Aurora PD referred 351 applicants for JSAs, ~40% more applicants than were referred in the preceding
year (233). The same increase in applicant referrals was not witnessed for 2nd
Stage evaluations; in fact, there was a slight
decrease observed from 2020 to 2021 (95 vs. 92; ~3% decrease). This absence of a difference between the number of
applicants referred for 2nd
Stage referrals, despite the marked increase in the number of applicants referred for JSAs is
notable. In 2020, ~41% of the applicants seen for a JSA returned for a 2nd
Stage, but in 2021, only 26% of applicants seen
for a JSA were referred for a 2nd
Stage evaluation, a decrease of ~45%.
51%
56%
-10%
Applicant Demographic Changes 2nd Stage
Hispanic Black White
Page 23 of 23
Adverse Impact: Conclusion
The observable dramatic demographic shifts which accompany the only indication of possible adverse impacts
suggests the presence of an overt or covert modification in the early portion of the hiring process creating an atypical
demographic distribution that is being reflected in the seemingly disproportionate fail rates of Black and Hispanic
applicants that becomes undetectable when examining the demographic distribution of Aurora PD applicants who
returned for 2nd
Stage evaluations.

More Related Content

Similar to Impact of Race and Ethnicity on Preemployment Psychological Assessment

Tunisie sondage : Une économie en manque de performance et la corruption cont...
Tunisie sondage : Une économie en manque de performance et la corruption cont...Tunisie sondage : Une économie en manque de performance et la corruption cont...
Tunisie sondage : Une économie en manque de performance et la corruption cont...
Jamaity
 
Shrm poll whistleblowing_final
Shrm poll whistleblowing_finalShrm poll whistleblowing_final
Shrm poll whistleblowing_final
shrm
 

Similar to Impact of Race and Ethnicity on Preemployment Psychological Assessment (20)

Patterns of political elite formation in post soviet Armenia (ASCN funded res...
Patterns of political elite formation in post soviet Armenia (ASCN funded res...Patterns of political elite formation in post soviet Armenia (ASCN funded res...
Patterns of political elite formation in post soviet Armenia (ASCN funded res...
 
Qnt 275 final exam new 2016
Qnt 275 final exam new 2016Qnt 275 final exam new 2016
Qnt 275 final exam new 2016
 
Reuters/Ipsos Core Political Survey: Coronavirus Tracker (04/01/2020)
Reuters/Ipsos Core Political Survey: Coronavirus Tracker (04/01/2020)Reuters/Ipsos Core Political Survey: Coronavirus Tracker (04/01/2020)
Reuters/Ipsos Core Political Survey: Coronavirus Tracker (04/01/2020)
 
Magellan Strategies Montana US Senate Survey Release April 10, 2014
Magellan Strategies Montana US Senate Survey Release April 10, 2014Magellan Strategies Montana US Senate Survey Release April 10, 2014
Magellan Strategies Montana US Senate Survey Release April 10, 2014
 
Spss comd interpret
Spss comd interpretSpss comd interpret
Spss comd interpret
 
A Tutorial to AI Ethics - Fairness, Bias & Perception
A Tutorial to AI Ethics - Fairness, Bias & Perception A Tutorial to AI Ethics - Fairness, Bias & Perception
A Tutorial to AI Ethics - Fairness, Bias & Perception
 
Tunisie sondage : Une économie en manque de performance et la corruption cont...
Tunisie sondage : Une économie en manque de performance et la corruption cont...Tunisie sondage : Une économie en manque de performance et la corruption cont...
Tunisie sondage : Une économie en manque de performance et la corruption cont...
 
A 2016 Election Post-Mortem: The ABC News/Washington Post Tracking Poll
A 2016 Election Post-Mortem: The ABC News/Washington Post Tracking PollA 2016 Election Post-Mortem: The ABC News/Washington Post Tracking Poll
A 2016 Election Post-Mortem: The ABC News/Washington Post Tracking Poll
 
Reuters/Ipsos Core Political: Presidential Approval Tracker (06/10/2020)
Reuters/Ipsos Core Political: Presidential Approval Tracker (06/10/2020)Reuters/Ipsos Core Political: Presidential Approval Tracker (06/10/2020)
Reuters/Ipsos Core Political: Presidential Approval Tracker (06/10/2020)
 
Reuters/Ipsos Core Political: Coronavirus Tracker (05/20/2020)
Reuters/Ipsos Core Political: Coronavirus Tracker (05/20/2020)Reuters/Ipsos Core Political: Coronavirus Tracker (05/20/2020)
Reuters/Ipsos Core Political: Coronavirus Tracker (05/20/2020)
 
Reuters/Ipsos Core Political: Coronavirus Tracker (04/08/2020)
Reuters/Ipsos Core Political: Coronavirus Tracker (04/08/2020)Reuters/Ipsos Core Political: Coronavirus Tracker (04/08/2020)
Reuters/Ipsos Core Political: Coronavirus Tracker (04/08/2020)
 
Public Support For Half Price Fares
Public Support For Half Price FaresPublic Support For Half Price Fares
Public Support For Half Price Fares
 
Reuters/Ipsos Core Political: Coronavirus Tracker (06/03/2020)
Reuters/Ipsos Core Political: Coronavirus Tracker (06/03/2020)Reuters/Ipsos Core Political: Coronavirus Tracker (06/03/2020)
Reuters/Ipsos Core Political: Coronavirus Tracker (06/03/2020)
 
A Correction for the Full-Supplement Imputation Bias in the Current Populatio...
A Correction for the Full-Supplement Imputation Bias in the Current Populatio...A Correction for the Full-Supplement Imputation Bias in the Current Populatio...
A Correction for the Full-Supplement Imputation Bias in the Current Populatio...
 
KyotoJALT 2015
KyotoJALT 2015KyotoJALT 2015
KyotoJALT 2015
 
2016 State of Small Business in Austin
2016 State of Small Business in Austin2016 State of Small Business in Austin
2016 State of Small Business in Austin
 
2016 Democrat Primary: Prediction of results For New York Counties
2016 Democrat Primary: Prediction of results For New York Counties2016 Democrat Primary: Prediction of results For New York Counties
2016 Democrat Primary: Prediction of results For New York Counties
 
Reuters/Ipsos Core Political Survey: 2020 Democratic Primary (07/03/2019)
Reuters/Ipsos Core Political Survey: 2020 Democratic Primary (07/03/2019)Reuters/Ipsos Core Political Survey: 2020 Democratic Primary (07/03/2019)
Reuters/Ipsos Core Political Survey: 2020 Democratic Primary (07/03/2019)
 
5
55
5
 
Shrm poll whistleblowing_final
Shrm poll whistleblowing_finalShrm poll whistleblowing_final
Shrm poll whistleblowing_final
 

Recently uploaded

The Philosophy of Science
The Philosophy of ScienceThe Philosophy of Science
The Philosophy of Science
University of Hertfordshire
 
DIFFERENCE IN BACK CROSS AND TEST CROSS
DIFFERENCE IN  BACK CROSS AND TEST CROSSDIFFERENCE IN  BACK CROSS AND TEST CROSS
DIFFERENCE IN BACK CROSS AND TEST CROSS
LeenakshiTyagi
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdf
PirithiRaju
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
gindu3009
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx  .This slides helps to know the different types of biop...Biopesticide (2).pptx  .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...
RohitNehra6
 
Formation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksFormation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disks
Sérgio Sacani
 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Sérgio Sacani
 
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
PirithiRaju
 

Recently uploaded (20)

The Philosophy of Science
The Philosophy of ScienceThe Philosophy of Science
The Philosophy of Science
 
DIFFERENCE IN BACK CROSS AND TEST CROSS
DIFFERENCE IN  BACK CROSS AND TEST CROSSDIFFERENCE IN  BACK CROSS AND TEST CROSS
DIFFERENCE IN BACK CROSS AND TEST CROSS
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdf
 
CELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdfCELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdf
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx  .This slides helps to know the different types of biop...Biopesticide (2).pptx  .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...
 
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
 
Animal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptxAnimal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptx
 
Botany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdfBotany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdf
 
Formation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksFormation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disks
 
Chromatin Structure | EUCHROMATIN | HETEROCHROMATIN
Chromatin Structure | EUCHROMATIN | HETEROCHROMATINChromatin Structure | EUCHROMATIN | HETEROCHROMATIN
Chromatin Structure | EUCHROMATIN | HETEROCHROMATIN
 
Nanoparticles synthesis and characterization​ ​
Nanoparticles synthesis and characterization​  ​Nanoparticles synthesis and characterization​  ​
Nanoparticles synthesis and characterization​ ​
 
VIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PVIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C P
 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
 
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
 
Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )
 
Natural Polymer Based Nanomaterials
Natural Polymer Based NanomaterialsNatural Polymer Based Nanomaterials
Natural Polymer Based Nanomaterials
 
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSpermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
 
GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)
 
Unlocking the Potential: Deep dive into ocean of Ceramic Magnets.pptx
Unlocking  the Potential: Deep dive into ocean of Ceramic Magnets.pptxUnlocking  the Potential: Deep dive into ocean of Ceramic Magnets.pptx
Unlocking the Potential: Deep dive into ocean of Ceramic Magnets.pptx
 

Impact of Race and Ethnicity on Preemployment Psychological Assessment

  • 1. Page 1 of 23 Introduction and Summary A thorough review of Brower Psychological Services’ (BPS) evaluation practices from 2018 through 03/2022 was completed to uncover the possible presence of racially and/or ethnically driven adverse impact against police applicants for the Aurora Police Department considered in insolation and for all of the agencies serviced by BPS. Typically, adverse impact is determined by using the four-fifths or eighty percent rule. The four-fifths or 80% rule is described by the Uniform Guidelines for Employee Selection Procedures as “a selection rate for any race, sex, or ethnic group which is less than four-fifths (or 80%) of the rate for the group with the highest rate will generally be regarded by the Federal enforcement agencies as evidence of adverse impact, while a greater than four-fifths rate will generally not be regarded by Federal enforcement agencies as evidence of adverse impact.” Since the 80% test does not involve probability distributions to determine whether the disparity is a “beyond chance” occurrence, we have additionally included tests of statistical significance where the 80% rule may have been violated, as well as observations to assess practical significance of the results. No violations of the 80% rule or any statistically significant correlation between race/ethnicity and pass rate were found when all of the area agencies serviced by BPS were viewed in aggregate, regardless of stage of evaluation. No 80% violations were found for the Aurora Police Department in any year or stage of evaluation; however, Fisher’s Exact Test of first-stage evaluations (“JSAs”) conducted in 2021 suggested a possibly significant relationship between race/ethnicity and pass rate. Though there was no violation of the 80% rule despite this possible relationship, additional practical analyses were conducted to uncover the presence of confounds or unaccounted for factors that may explain the disparity found in this one department during a singular year. These analyses suggest that Aurora PD was engaged in either an official or informal special recruiting program resulting in a demographic distribution that was atypical of the normal pool of applicants from that group. Such demographic shifts in an applicant pool have been established in the literature and are referenced specifically in the Uniform Guidelines on Employee Selection Procedures (1978) as a known source of data distortion likely to create a specious impression of adverse impact. We find a potentially undisclosed hiring initiative to be
  • 2. Page 2 of 23 the most likely explanation for this deviation that is confined both temporally and organizationally, as the uniformity and stability of our processes across time and agency are observable throughout our data.
  • 3. Page 3 of 23 Analyses All Agency Applicants 01/2021-03/2022 Filtered By: All Agencies and Type (First) Descriptives Introduction Frequencies and percentages were calculated for Pass_Fail split by Race_Ethnicity. Results Frequencies and Percentages The most frequently observed category of Pass_Fail within the White category of Race_Ethnicity was Pass (n = 419, 79.06%). The most frequently observed category of Pass_Fail within the Hispanic category of Race_Ethnicity was Pass (n = 140, 74.07%). The most frequently observed category of Pass_Fail within the Black category of Race_Ethnicity was Pass (n = 57, 67.86%). The most frequently observed category of Pass_Fail within the Other category of Race_Ethnicity was Pass (n = 50, 79.37%). Frequencies and percentages are presented in Table 1. Table 1 Frequency Table for Nominal Variables Race_Ethnicity Variable White Hispanic Black Other Missing Pass_Fail Fail 111 (20.94%) 49 (25.93%) 27 (32.14%) 13 (20.63%) 0 (0.00%) Pass 419 (79.06%) 140 (74.07%) 57 (67.86%) 50 (79.37%) 0 (0.00%) Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) Total 530 (100.00%) 189 (100.00%) 84 (100.00%) 63 (100.00%) 0 (100.00%) Note. Due to rounding error, percentages may not sum to 100%. Filtered By: All Agencies and Type (Second) Descriptives Introduction Frequencies and percentages were calculated for Pass_Fail split by Race_Ethnicity. Results Frequencies and Percentages The most frequently observed category of Pass_Fail within the White category of Race_Ethnicity was Pass (n = 158, 90.80%). The most frequently observed category of Pass_Fail within the Hispanic category of Race_Ethnicity was Pass
  • 4. Page 4 of 23 (n = 48, 88.89%). The most frequently observed category of Pass_Fail within the Black category of Race_Ethnicity was Pass (n = 20, 86.96%). The most frequently observed category of Pass_Fail within the Other category of Race_Ethnicity was Pass (n = 18, 90.00%). Frequencies and percentages are presented in Table 2. Table 2 Frequency Table for Nominal Variables Race_Ethnicity Variable White Hispanic Black Other Missing Pass_Fail Fail 16 (9.20%) 6 (11.11%) 3 (13.04%) 2 (10.00%) 0 (0.00%) Pass 158 (90.80%) 48 (88.89%) 20 (86.96%) 18 (90.00%) 0 (0.00%) Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) Total 174 (100.00%) 54 (100.00%) 23 (100.00%) 20 (100.00%) 0 (100.00%) Note. Due to rounding error, percentages may not sum to 100%. Filtered By: All Agencies and Type (Post) Descriptives Introduction Frequencies and percentages were calculated for Pass_Fail split by Race_Ethnicity. Results Frequencies and Percentages The most frequently observed category of Pass_Fail within the White category of Race_Ethnicity was Pass (n = 355, 74.27%). The most frequently observed category of Pass_Fail within the Hispanic category of Race_Ethnicity was Pass (n = 47, 66.20%). The most frequently observed category of Pass_Fail within the Black category of Race_Ethnicity was Pass (n = 20, 66.67%). The most frequently observed category of Pass_Fail within the Other category of Race_Ethnicity was Pass (n = 13, 59.09%). Frequencies and percentages are presented in Table 3.
  • 5. Page 5 of 23 Table 3 Frequency Table for Nominal Variables Race_Ethnicity Variable White Hispanic Black Other Missing Pass_Fail Fail 123 (25.73%) 24 (33.80%) 10 (33.33%) 9 (40.91%) 0 (0.00%) Pass 355 (74.27%) 47 (66.20%) 20 (66.67%) 13 (59.09%) 0 (0.00%) Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) Total 478 (100.00%) 71 (100.00%) 30 (100.00%) 22 (100.00%) 0 (100.00%) Note. Due to rounding error, percentages may not sum to 100%. Filtered By: All Agencies and Type (First) Fisher's Exact Test Introduction A Fisher's exact test was conducted to examine whether Pass_Fail and Race_Ethnicity were independent. There were 2 levels in Pass_Fail: Fail and Pass. There were 4 levels in Race_Ethnicity: White, Hispanic, Black, and Other. Results The results of the Fisher exact test were not significant based on an alpha value of .05, p = .100, suggesting that Pass_Fail and Race_Ethnicity could be independent of one another. This implies that the observed frequencies were not significantly different than the expected frequencies. Table 4 presents the results of the Fisher's exact test. Table 4 Observed and Expected Frequencies Pass_Fail Race_Ethnicity Fail Pass p White 111[122.40] 419[407.60] .100 Hispanic 49[43.65] 140[145.35] Black 27[19.40] 57[64.60] Other 13[14.55] 50[48.45] Note. Values formatted as Observed[Expected]. Filtered By: All Agencies and Type (Second) Fisher's Exact Test Introduction A Fisher's exact test was conducted to examine whether Pass_Fail and Race_Ethnicity were independent. There were 2 levels in Pass_Fail: Fail and Pass. There were 4 levels in Race_Ethnicity: White, Hispanic, Black, and Other.
  • 6. Page 6 of 23 Results The results of the Fisher exact test were not significant based on an alpha value of .05, p = .870, suggesting that Pass_Fail and Race_Ethnicity could be independent of one another. This implies that the observed frequencies were not significantly different than the expected frequencies. Table 5 presents the results of the Fisher's exact test. Table 5 Observed and Expected Frequencies Pass_Fail Race_Ethnicity Fail Pass p White 16[17.34] 158[156.66] .870 Hispanic 6[5.38] 48[48.62] Black 3[2.29] 20[20.71] Other 2[1.99] 18[18.01] Note. Values formatted as Observed[Expected].
  • 7. Page 7 of 23 Aurora PD Police Applicants 2018 – 03/2022 Filtered By: Stage (First) Descriptives Introduction Frequencies and percentages were calculated for Bivariate_Pass split by Year_Nominal. Results Frequencies and Percentages The most frequently observed category of Bivariate_Pass within the 2018 category of Year_Nominal was Pass (n = 151, 70.56%). The most frequently observed category of Bivariate_Pass within the 2019 category of Year_Nominal was Pass (n = 263, 70.70%). The most frequently observed category of Bivariate_Pass within the 2020 category of Year_Nominal was Pass (n = 160, 68.67%). The most frequently observed category of Bivariate_Pass within the 2021 category of Year_Nominal was Pass (n = 245, 69.80%). The most frequently observed category of Bivariate_Pass within the 2022 category of Year_Nominal was Pass (n = 34, 66.67%). Frequencies and percentages are presented in Table 1. Table 1 Frequency Table for Nominal Variables Year_Nominal Variable 2018 2019 2020 2021 2022 Missing Bivariate_Pass Fail 63 (29.44%) 109 (29.30%) 73 (31.33%) 106 (30.20%) 17 (33.33%) 0 (0.00%) Pass 151 (70.56%) 263 (70.70%) 160 (68.67%) 245 (69.80%) 34 (66.67%) 0 (0.00%) Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) Total 214 (100.00%) 372 (100.00%) 233 (100.00%) 351 (100.00%) 51 (100.00%) 0 (100.00%) Note. Due to rounding error, percentages may not sum to 100%.
  • 8. Page 8 of 23 Filtered By: Stage (Second) Descriptives Introduction Frequencies and percentages were calculated for Bivariate_Pass split by Year_Nominal. Results Frequencies and Percentages All observations were missing for the 2018 category of Year_Nominal within each category of Bivariate_Pass. The most frequently observed category of Bivariate_Pass within the 2019 category of Year_Nominal was Pass (n = 79, 96.34%). The most frequently observed category of Bivariate_Pass within the 2020 category of Year_Nominal was Pass (n = 77, 81.05%). The most frequently observed category of Bivariate_Pass within the 2021 category of Year_Nominal was Pass (n = 83, 90.22%). The most frequently observed category of Bivariate_Pass within the 2022 category of Year_Nominal was Pass (n = 12, 92.31%). Frequencies and percentages are presented in Table 2. Table 2 Frequency Table for Nominal Variables Year_Nominal Variable 2018 2019 2020 2021 2022 Missing Bivariate_Pass Fail 0 (0.00%) 3 (3.66%) 18 (18.95%) 9 (9.78%) 1 (7.69%) 0 (0.00%) Pass 0 (0.00%) 79 (96.34%) 77 (81.05%) 83 (90.22%) 12 (92.31%) 0 (0.00%) Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) Total 0 (100.00%) 82 (100.00%) 95 (100.00%) 92 (100.00%) 13 (100.00%) 0 (100.00%) Note. Due to rounding error, percentages may not sum to 100%. Filtered By: Stage (First) Descriptives Introduction Frequencies and percentages were calculated for Race_Ethnicity_Simplified split by Year_Nominal. Results Frequencies and Percentages The most frequently observed category of Race_Ethnicity_Simplified within the 2018 category of Year_Nominal was White (n = 128, 59.81%). The most frequently observed category of Race_Ethnicity_Simplified within the 2019 category of Year_Nominal was White (n = 238, 63.98%). The most frequently observed category of Race_Ethnicity_Simplified within the 2020 category of Year_Nominal was White (n = 139, 59.66%). The most frequently
  • 9. Page 9 of 23 observed category of Race_Ethnicity_Simplified within the 2021 category of Year_Nominal was White (n = 194, 55.27%). The most frequently observed category of Race_Ethnicity_Simplified within the 2022 category of Year_Nominal was White (n = 27, 52.94%). Frequencies and percentages are presented in Table 3. Table 3 Frequency Table for Nominal Variables Year_Nominal Variable 2018 2019 2020 2021 2022 Missing Race_Ethnicity_Simplified White 128 (59.81%) 238 (63.98%) 139 (59.66%) 194 (55.27%) 27 (52.94%) 0 (0.00%) Hispanic 51 (23.83%) 67 (18.01%) 47 (20.17%) 90 (25.64%) 11 (21.57%) 0 (0.00%) Other 13 (6.07%) 39 (10.48%) 23 (9.87%) 31 (8.83%) 2 (3.92%) 0 (0.00%) Black 22 (10.28%) 28 (7.53%) 24 (10.30%) 36 (10.26%) 11 (21.57%) 0 (0.00%) Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) Total 214 (100.00%) 372 (100.00%) 233 (100.00%) 351 (100.00%) 51 (100.00%) 0 (100.00%) Note. Due to rounding error, percentages may not sum to 100%. Filtered By: Stage (Second) Descriptives Introduction Frequencies and percentages were calculated for Race_Ethnicity_Simplified split by Year_Nominal. Results Frequencies and Percentages All observations were missing for the 2018 category of Year_Nominal within each category of Race_Ethnicity_Simplified. The most frequently observed category of Race_Ethnicity_Simplified within the 2019 category of Year_Nominal was White (n = 60, 73.17%). The most frequently observed category of Race_Ethnicity_Simplified within the 2020 category of Year_Nominal was White (n = 60, 63.16%). The most frequently observed category of Race_Ethnicity_Simplified within the 2021 category of Year_Nominal was White (n = 58, 63.04%). The most frequently observed category of Race_Ethnicity_Simplified within the 2022 category of Year_Nominal was White (n = 9, 69.23%). Frequencies and percentages are presented in Table 4.
  • 10. Page 10 of 23 Table 4 Frequency Table for Nominal Variables Year_Nominal Variable 2018 2019 2020 2021 2022 Missing Race_Ethnicity_Simplified White 0 (0.00%) 60 (73.17%) 60 (63.16%) 58 (63.04%) 9 (69.23%) 0 (0.00%) Hispanic 0 (0.00%) 13 (15.85%) 20 (21.05%) 22 (23.91%) 3 (23.08%) 0 (0.00%) Other 0 (0.00%) 6 (7.32%) 11 (11.58%) 6 (6.52%) 1 (7.69%) 0 (0.00%) Black 0 (0.00%) 3 (3.66%) 4 (4.21%) 6 (6.52%) 0 (0.00%) 0 (0.00%) Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) Total 0 (100.00%) 82 (100.00%) 95 (100.00%) 92 (100.00%) 13 (100.00%) 0 (100.00%) Note. Due to rounding error, percentages may not sum to 100%. Filtered By: Stage (First) Descriptives Introduction Frequencies and percentages were calculated for Year_Nominal and Bivariate_Pass split by Race_Ethnicity_Simplified. Results Frequencies and Percentages The most frequently observed category of Year_Nominal within the White category of Race_Ethnicity_Simplified was 2019 (n = 238, 32.78%). The most frequently observed category of Year_Nominal within the Hispanic category of Race_Ethnicity_Simplified was 2021 (n = 90, 33.83%). The most frequently observed category of Year_Nominal within the Other category of Race_Ethnicity_Simplified was 2019 (n = 39, 36.11%). The most frequently observed category of Year_Nominal within the Black category of Race_Ethnicity_Simplified was 2021 (n = 36, 29.75%). The most frequently observed category of Bivariate_Pass within the White category of Race_Ethnicity_Simplified was Pass (n = 519, 71.49%). The most frequently observed category of Bivariate_Pass within the Hispanic category of Race_Ethnicity_Simplified was Pass (n = 183, 68.80%). The most frequently observed category of Bivariate_Pass within the Other category of Race_Ethnicity_Simplified was Pass (n = 80, 74.07%). The most frequently observed category of Bivariate_Pass within the Black category of Race_Ethnicity_Simplified was Pass (n = 71, 58.68%). Frequencies and percentages are presented in Table 5.
  • 11. Page 11 of 23 Table 5 Frequency Table for Nominal Variables Race_Ethnicity_Simplified Variable White Hispanic Other Black Missing Year_Nominal 2018 128 (17.63%) 51 (19.17%) 13 (12.04%) 22 (18.18%) 0 (0.00%) 2019 238 (32.78%) 67 (25.19%) 39 (36.11%) 28 (23.14%) 0 (0.00%) 2020 139 (19.15%) 47 (17.67%) 23 (21.30%) 24 (19.83%) 0 (0.00%) 2021 194 (26.72%) 90 (33.83%) 31 (28.70%) 36 (29.75%) 0 (0.00%) 2022 27 (3.72%) 11 (4.14%) 2 (1.85%) 11 (9.09%) 0 (0.00%) Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) Total 726 (100.00%) 266 (100.00%) 108 (100.00%) 121 (100.00%) 0 (100.00%) Bivariate_Pass Fail 207 (28.51%) 83 (31.20%) 28 (25.93%) 50 (41.32%) 0 (0.00%) Pass 519 (71.49%) 183 (68.80%) 80 (74.07%) 71 (58.68%) 0 (0.00%) Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) Total 726 (100.00%) 266 (100.00%) 108 (100.00%) 121 (100.00%) 0 (100.00%) Note. Due to rounding error, percentages may not sum to 100%. Filtered By: Stage (Second) Descriptives Introduction Frequencies and percentages were calculated for Year_Nominal and Bivariate_Pass split by Race_Ethnicity_Simplified. Results Frequencies and Percentages The most frequently observed categories of Year_Nominal within the White category of Race_Ethnicity_Simplified were 2019 and 2020 (n = 60, 32.09%). The most frequently observed category of Year_Nominal within the Hispanic category of Race_Ethnicity_Simplified was 2021 (n = 22, 37.93%). The most frequently observed category of Year_Nominal within the Other category of Race_Ethnicity_Simplified was 2020 (n = 11, 45.83%). The most frequently observed category of Year_Nominal within the Black category of Race_Ethnicity_Simplified was 2021 (n = 6, 46.15%). The most frequently observed category of Bivariate_Pass within the White category of Race_Ethnicity_Simplified was Pass (n = 165, 88.24%). The most frequently observed category of Bivariate_Pass within the Hispanic category of Race_Ethnicity_Simplified was Pass (n = 55, 94.83%). The most frequently observed category of Bivariate_Pass within the Other category of Race_Ethnicity_Simplified was Pass (n = 20, 83.33%). The most frequently observed category of Bivariate_Pass within the Black category of Race_Ethnicity_Simplified was Pass (n = 11, 84.62%). Frequencies and percentages are presented in Table 6.
  • 12. Page 12 of 23 Table 6 Frequency Table for Nominal Variables Race_Ethnicity_Simplified Variable White Hispanic Other Black Missing Year_Nominal 2018 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 2019 60 (32.09%) 13 (22.41%) 6 (25.00%) 3 (23.08%) 0 (0.00%) 2020 60 (32.09%) 20 (34.48%) 11 (45.83%) 4 (30.77%) 0 (0.00%) 2021 58 (31.02%) 22 (37.93%) 6 (25.00%) 6 (46.15%) 0 (0.00%) 2022 9 (4.81%) 3 (5.17%) 1 (4.17%) 0 (0.00%) 0 (0.00%) Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) Total 187 (100.00%) 58 (100.00%) 24 (100.00%) 13 (100.00%) 0 (100.00%) Bivariate_Pass Fail 22 (11.76%) 3 (5.17%) 4 (16.67%) 2 (15.38%) 0 (0.00%) Pass 165 (88.24%) 55 (94.83%) 20 (83.33%) 11 (84.62%) 0 (0.00%) Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) Total 187 (100.00%) 58 (100.00%) 24 (100.00%) 13 (100.00%) 0 (100.00%) Note. Due to rounding error, percentages may not sum to 100%. Filtered By: Year_Nominal (2018) and Stage (First) Fisher's Exact Test Introduction A Fisher's exact test was conducted to examine whether Bivariate_Pass and Race_Ethnicity_Simplified were independent. There were 2 levels in Bivariate_Pass: Fail and Pass. There were 4 levels in Race_Ethnicity_Simplified: White, Hispanic, Other, and Black. Results The results of the Fisher exact test were not significant based on an alpha value of .05, p = .734, suggesting that Bivariate_Pass and Race_Ethnicity_Simplified could be independent of one another. This implies that the observed frequencies were not significantly different than the expected frequencies. Table 7 presents the results of the Fisher's exact test. Table 7 Observed and Expected Frequencies Bivariate_Pass Race_Ethnicity_Simplified Fail Pass p White 41[37.68] 87[90.32] .734 Hispanic 12[15.01] 39[35.99] Other 4[3.83] 9[9.17] Black 6[6.48] 16[15.52] Note. Values formatted as Observed[Expected].
  • 13. Page 13 of 23 Filtered By: Year_Nominal (2019) and Stage (First) Fisher's Exact Test Introduction A Fisher's exact test was conducted to examine whether Bivariate_Pass and Race_Ethnicity_Simplified were independent. There were 2 levels in Bivariate_Pass: Fail and Pass. There were 4 levels in Race_Ethnicity_Simplified: White, Hispanic, Other, and Black. Results The results of the Fisher exact test were not significant based on an alpha value of .05, p = .453, suggesting that Bivariate_Pass and Race_Ethnicity_Simplified could be independent of one another. This implies that the observed frequencies were not significantly different than the expected frequencies. Table 8 presents the results of the Fisher's exact test. Table 8 Observed and Expected Frequencies Bivariate_Pass Race_Ethnicity_Simplified Fail Pass p White 67[69.74] 171[168.26] .453 Hispanic 19[19.63] 48[47.37] Other 11[11.43] 28[27.57] Black 12[8.20] 16[19.80] Note. Values formatted as Observed[Expected]. Filtered By: Year_Nominal (2020) and Stage (First) Fisher's Exact Test Introduction A Fisher's exact test was conducted to examine whether Bivariate_Pass and Race_Ethnicity_Simplified were independent. There were 2 levels in Bivariate_Pass: Fail and Pass. There were 4 levels in Race_Ethnicity_Simplified: White, Hispanic, Other, and Black. Results The results of the Fisher exact test were not significant based on an alpha value of .05, p = .680, suggesting that Bivariate_Pass and Race_Ethnicity_Simplified could be independent of one another. This implies that the observed frequencies were not significantly different than the expected frequencies. Table 9 presents the results of the Fisher's exact test.
  • 14. Page 14 of 23 Table 9 Observed and Expected Frequencies Bivariate_Pass Race_Ethnicity_Simplified Fail Pass p White 43[43.55] 96[95.45] .680 Hispanic 13[14.73] 34[32.27] Other 7[7.21] 16[15.79] Black 10[7.52] 14[16.48] Note. Values formatted as Observed[Expected]. Filtered By: Year_Nominal (2021) and Stage (First) Fisher's Exact Test Introduction A Fisher's exact test was conducted to examine whether Bivariate_Pass and Race_Ethnicity_Simplified were independent. There were 2 levels in Bivariate_Pass: Fail and Pass. There were 4 levels in Race_Ethnicity_Simplified: White, Hispanic, Other, and Black. Results The results of the Fisher exact test were significant based on an alpha value of .05, p = .006, suggesting that Bivariate_Pass and Race_Ethnicity_Simplified are related to one another. The following level combinations had observed values that were greater than their expected values: Race_Ethnicity_Simplified (Hispanic):Bivariate_Pass (Fail), Race_Ethnicity_Simplified (Black):Bivariate_Pass (Fail), Race_Ethnicity_Simplified (White):Bivariate_Pass (Pass), and Race_Ethnicity_Simplified (Other):Bivariate_Pass (Pass). The following level combinations had observed values that were less than their expected values: Race_Ethnicity_Simplified (White):Bivariate_Pass (Fail), Race_Ethnicity_Simplified (Other):Bivariate_Pass (Fail), Race_Ethnicity_Simplified (Hispanic):Bivariate_Pass (Pass), and Race_Ethnicity_Simplified (Black):Bivariate_Pass (Pass). Table 10 presents the results of the Fisher's exact test. Table 10 Observed and Expected Frequencies Bivariate_Pass Race_Ethnicity_Simplified Fail Pass p White 48[58.59] 146[135.41] .006 Hispanic 35[27.18] 55[62.82] Other 6[9.36] 25[21.64] Black 17[10.87] 19[25.13] Note. Values formatted as Observed[Expected].
  • 15. Page 15 of 23 Filtered By: Year_Nominal (2022) and Stage (First) Fisher's Exact Test Introduction A Fisher's exact test was conducted to examine whether Bivariate_Pass and Race_Ethnicity_Simplified were independent. There were 2 levels in Bivariate_Pass: Fail and Pass. There were 4 levels in Race_Ethnicity_Simplified: White, Hispanic, Other, and Black. Results The results of the Fisher exact test were not significant based on an alpha value of .05, p = .698, suggesting that Bivariate_Pass and Race_Ethnicity_Simplified could be independent of one another. This implies that the observed frequencies were not significantly different than the expected frequencies. Table 11 presents the results of the Fisher's exact test. Table 11 Observed and Expected Frequencies Bivariate_Pass Race_Ethnicity_Simplified Fail Pass p White 8[9.00] 19[18.00] .698 Hispanic 4[3.67] 7[7.33] Other 0[0.67] 2[1.33] Black 5[3.67] 6[7.33] Note. Values formatted as Observed[Expected]. Filtered By: Year_Nominal (2019) and Stage (Second) Fisher's Exact Test Introduction A Fisher's exact test was conducted to examine whether Bivariate_Pass and Race_Ethnicity_Simplified were independent. There were 2 levels in Bivariate_Pass: Fail and Pass. There were 4 levels in Race_Ethnicity_Simplified: White, Hispanic, Other, and Black. Results The results of the Fisher exact test were not significant based on an alpha value of .05, p = 1.000, suggesting that Bivariate_Pass and Race_Ethnicity_Simplified could be independent of one another. This implies that the observed frequencies were not significantly different than the expected frequencies. Table 12 presents the results of the Fisher's exact test. Table 12
  • 16. Page 16 of 23 Observed and Expected Frequencies Bivariate_Pass Race_Ethnicity_Simplified Fail Pass p White 3[2.20] 57[57.80] 1.000 Hispanic 0[0.48] 13[12.52] Other 0[0.22] 6[5.78] Black 0[0.11] 3[2.89] Note. Values formatted as Observed[Expected]. Filtered By: Year_Nominal (2020) and Stage (Second) Fisher's Exact Test Introduction A Fisher's exact test was conducted to examine whether Bivariate_Pass and Race_Ethnicity_Simplified were independent. There were 2 levels in Bivariate_Pass: Fail and Pass. There were 4 levels in Race_Ethnicity_Simplified: White, Hispanic, Other, and Black. Results The results of the Fisher exact test were not significant based on an alpha value of .05, p = .227, suggesting that Bivariate_Pass and Race_Ethnicity_Simplified could be independent of one another. This implies that the observed frequencies were not significantly different than the expected frequencies. Table 13 presents the results of the Fisher's exact test. Table 13 Observed and Expected Frequencies Bivariate_Pass Race_Ethnicity_Simplified Fail Pass p White 13[11.37] 47[48.63] .227 Hispanic 1[3.79] 19[16.21] Other 3[2.08] 8[8.92] Black 1[0.76] 3[3.24] Note. Values formatted as Observed[Expected]. Filtered By: Year_Nominal (2021) and Stage (Second) Fisher's Exact Test Introduction A Fisher's exact test was conducted to examine whether Bivariate_Pass and Race_Ethnicity_Simplified were independent. There were 2 levels in Bivariate_Pass: Fail and Pass. There were 4 levels in Race_Ethnicity_Simplified: White, Hispanic, Other, and Black.
  • 17. Page 17 of 23 Results The results of the Fisher exact test were not significant based on an alpha value of .05, p = .399, suggesting that Bivariate_Pass and Race_Ethnicity_Simplified could be independent of one another. This implies that the observed frequencies were not significantly different than the expected frequencies. Table 14 presents the results of the Fisher's exact test. Table 14 Observed and Expected Frequencies Bivariate_Pass Race_Ethnicity_Simplified Fail Pass p White 6[5.67] 52[52.33] .399 Hispanic 1[2.15] 21[19.85] Other 1[0.59] 5[5.41] Black 1[0.59] 5[5.41] Note. Values formatted as Observed[Expected].
  • 18. Page 18 of 23 Filtered By: Year_Nominal (2022) and Stage (Second) Fisher's Exact Test Introduction A Fisher's exact test was conducted to examine whether Bivariate_Pass and Race_Ethnicity_Simplified were independent. There were 2 levels in Bivariate_Pass: Fail and Pass. There were 4 levels in Race_Ethnicity_Simplified: White, Hispanic, Other, and Black. Results The results of the Fisher exact test were not significant based on an alpha value of .05, p = .308, suggesting that Bivariate_Pass and Race_Ethnicity_Simplified could be independent of one another. This implies that the observed frequencies were not significantly different than the expected frequencies. Table 15 presents the results of the Fisher's exact test. Table 15 Observed and Expected Frequencies Bivariate_Pass Race_Ethnicity_Simplified Fail Pass p White 0[0.69] 9[8.31] .308 Hispanic 1[0.23] 2[2.77] Other 0[0.08] 1[0.92] Black 0[0.00] 0[0.00] Note. Values formatted as Observed[Expected].
  • 19. Page 19 of 23 Aurora PD Observations Adverse Impact: 4/5ths - 80/20 Rule The following figures were published/distributed by Aurora PD describing the demographic composition and selection rates for police academies held 2018-2020 titled “Passing Job Suitability Interview”: Table 16 Aurora PD’s Figures for Passing Job Suitability Interview, from “APD Academies from 2018-2020” Race/Ethnicity White or Caucasian Black or African American Hispanic or Latino Asian 2+ or Other Passing Job Suitability Interview 413 (42.4%) 42 (34.4%) 112 (37.7%) 18 (37.5%) 80 (44.7%) According to these figures, the 4/5ths – 80/20 rule would have been violated for “Black or African American” applicants when compared to the group with the highest passing rate, “2+ or Other.” These figures are substantially different than the figures we have for police applicants referred by Aurora PD for JSA’s from 2018-2020, which appear in the table below. Table 17 Frequency Table for Nominal Variables Race_Ethnicity_Simplified Variable White Hispanic Other Black Missing Bivariate_Pass Fail 151 (29.90%) 44 (26.67%) 22 (29.33%) 28 (37.84%) 0 (0.00%) Pass 354 (70.10%) 121 (73.33%) 53 (70.67%) 46 (62.16%) 0 (0.00%) Missing 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) 0 (0.00%) Total 505 (100.00%) 165 (100.00%) 75 (100.00%) 74 (100.00%) 0 (100.00%) Note. Due to rounding error, percentages may not sum to 100%. Not only do our figures represent a far higher passing percentage for applicants, there is no violation of the 4/5ths – 80/20 rule when comparing the demographic group with the highest passing rate (Hispanic; 73.33%) to the demographic group with the lowest passing rate (Black; 62.16%). When 2018-2022 JSAs are viewed in aggregate, Other is the demographic group with the highest passing percentage (~74%) and Black is the demographic group with the lowest passing percentage (~59%). White and Hispanic
  • 20. Page 20 of 23 groupings showed passing rates within a few percent (~71% and ~69%, respectively). When the 4/5ths rule is applied to measure the difference between Black and Other applicants, an ~20% difference is observed, suggesting that adverse impact is not present at a level surpassing prevailing/traditional Federal guidelines. When Black applicants are compared to White applicants, the demographic group comprising the majority of all applicants, a 17% difference is seen, again suggesting that adverse impact is not present at a level surpassing prevailing/traditional Federal guidelines. When the same aggregated approach is applied to Aurora PD 2nd Stage evaluations, there is no observable difference indicating violation of the 4/5ths rule. The demographic group with the highest passing rate amongst 2nd Stage evaluations from 2018-2022 is Hispanic (~95%) while the lowest passing rate being found in the Other demographic group (~83%); a 13% difference. Among all 2nd Stages from 2018-2022, members of the White group passed at ~88%, while members of the Black group passed at approximately ~85%. 0% 10% 20% 30% 40% 50% 60% 70% 80% 2018-2022 JSA Passing Rates White Black Hispanic Other
  • 21. Page 21 of 23 Adverse Impact: Statistical Significance Fisher’s Exact Tests split by year and stage of evaluation for Aurora PD suggest that there is no difference between observed and expected frequencies of passing among the four demographic groups for JSAs conducted in 2018, 2019, 2020, and 2022 and for 2nd Stage evaluations conducted from 2018-2022. Among 2021 JSAs there is a possible relationship suggested between Race/Ethnicity and Passing; specifically, that members of the White and Other demographic groups are more likely to pass, while members of the Black and Hispanic demographic groups are less likely to pass. Adverse Impact: Practical Significance (Demographic Shifts) When comparing demographic distributions of applicants referred for JSAs by Aurora PD from 2019 to 2022, the percentage of all applicants self-identifying as White, decreased by ~10%. Between 2020 and 2021, the percentage of applicants self-identifying as Hispanic nearly doubled (~18% vs ~34%), and between 2019 and 2022, the percentage of applicant’s self-identifying as Black more than doubled, increasing by ~96% (from ~8% to ~22%). 62% 96% -10% Applicant Demographic Changes JSAs Hispanic Black White 76% 78% 80% 82% 84% 86% 88% 90% 92% 94% 96% 2018-2022 2nd Stage Passing Rates White Black Hispanic Other
  • 22. Page 22 of 23 When looking at 2nd Stage evaluations for Aurora PD, a similar 10% decrease in White applicants is observable when comparing 2019’s ~73% proportion to 2020 and 2021’s ~63%. When comparing the number of Black applicants referred for 2nd Stage evaluations from 2019 to 2021, a 56% increase is observable. The percentage of Hispanic applicants also increased by more than 50% from 2019 (~22%) to 2021 (~38%). Adverse Impact: Practical Significance (Inclusion/Exclusion Shifts) In 2021, Aurora PD referred 351 applicants for JSAs, ~40% more applicants than were referred in the preceding year (233). The same increase in applicant referrals was not witnessed for 2nd Stage evaluations; in fact, there was a slight decrease observed from 2020 to 2021 (95 vs. 92; ~3% decrease). This absence of a difference between the number of applicants referred for 2nd Stage referrals, despite the marked increase in the number of applicants referred for JSAs is notable. In 2020, ~41% of the applicants seen for a JSA returned for a 2nd Stage, but in 2021, only 26% of applicants seen for a JSA were referred for a 2nd Stage evaluation, a decrease of ~45%. 51% 56% -10% Applicant Demographic Changes 2nd Stage Hispanic Black White
  • 23. Page 23 of 23 Adverse Impact: Conclusion The observable dramatic demographic shifts which accompany the only indication of possible adverse impacts suggests the presence of an overt or covert modification in the early portion of the hiring process creating an atypical demographic distribution that is being reflected in the seemingly disproportionate fail rates of Black and Hispanic applicants that becomes undetectable when examining the demographic distribution of Aurora PD applicants who returned for 2nd Stage evaluations.