Foundation of Psychological Testing - big five personality trait short questionnaire (BFPTSQ) vs HEXACO-60 for similarities, differences, standardization: (test norms, standardization groups), reliability :(coefficient correlation), validity (content validity, criterion-related validity, construct validity)
3. Introduction
Similarities
• OCEAN Model and HEXACO Model are popular personality tests that
consist of universal structure.
• Their purpose is to evaluate the personality and the measure applied
to examine behaviours or attitudes.
• The four similar personality traits in these two models are Openness,
Conscientiousness, Extraversion and Agreeableness.
4. Differences
OCEAN Model
• It was developed in 1936.
• Authors - Gordon Allport and Henry Odbert.
• It has five factors.
• The difference of the personality trait is Neuroticism.
• This model has fifteen versions.
5. Fifteen OCEAN Model Versions
• 100 Trait Descriptive Adjectives (TDA)
• Big Five Mini Markers (BFMM)
• 240-item NEO Personality Inventory, Revised (NEO-PI-R)
• 60-item NEO Five-Factor Inventory (NEO-FFI)
• 50-item IPIP Measures
• 20-item Mini International Personality Item Pool personality measure (Mini-IPIP)
• Single Item Measures of Personality (SIMP)
• 5-item Measure of the Big Five
• Ten-Item Personality Measure (TIPI)
• Five Factor Model Rating Form (FFMRF)
• 44-item Big-Five Inventory (FBI)
• Big Five Questionnaire-Children Version (BFQ-C)
• Big Five Personality Trait Short Questionnaire (BFPTSQ)
• 10-item Big Five Inventory (BFI-10)
• Big Five Inventory-Short form (BFI-S)
6. Differences
HEXACO Model
• It was developed in the early 2000s.
• Authors - Organisational Psychologist Kibeom Lee and Michael C. Ashton from
Canada.
• It has six factors.
• The difference of the personality trait is Honesty-Humility and Emotional
Stability.
• Unlike OCEAN Model, this model has four versions.
7. • Brief HEXACO Inventory-24 (BHI)
• HEXACO-60
• HEXACO-100
• HEXACO-SJT (Situational Judgement Test) Items-24
Four HEXACO Model Versions
8. OCEAN Model Version
- Big Five Personality Trait Short Questionnaire (BFPTSQ) -
5-point Likert-type response format:
Totally disagree = 0
Disagree a little = 1
Neutral opinion = 2
Agree a little = 3
Totally agree = 4
9. HEXACO
Model Version :
HEXACO-60
5 = strongly agree
4 = agree
3 = neutral
(neither agree nor disagree)
2 = disagree
1 = strongly disagree
11. Test Norms of BFPTSQ
• BFPTSQ is a new short questionnaire
• It is modified with the standard of BFI
• Which is for adults,
• Because its psychometric properties and content validity
• They are adequate
• The questionnaires of BFI
• consist of short verbal statement questions
• Easier to understand than single-trait adjectives
• which would be difficult to translate precisely
12. Test Norms of BFPTSQ
• BFPTSQ has 50 questions. Each question was simplified and reviewed for the
language level of early adolescent
• Adult questions from FBI were removed, and added questions that are relevant
to essential primary personality traits
• BFPTSQ can be finished around 10 to 15 minutes
• These personality scales are correlated with three consequential outcomes:
psychopathology, substance use and Grade Point Average (GPA)
13. Test Norms of BFPTSQ
• Psychopathology:
• the Youth Inventory Version 4 has seven scales
• as self-report questions related to the symptoms
• of the most popular mental disorder among adolescents in DSM-IV
• Substance use:
• was examined with the adjusted questions
• based on Quebec Adolescents’ Social and Personal Adjustment Measures
• GPA scale
• was measured by using grades
• in the official final report cards from schools
• with the passing mark of 60
14. Test Norms of BFPTSQ
• To conduct the analyses, used
• Mplus Version 6.12
• Robust maximum likelihood estimator (MLR)
• Confidence intervals (95%) were used
• in the calculation
• for the precision of parameter estimates
15. Test Norms of HEXACO-60
✓ HEXACO keeps much of the Big Five model, but redefines some of the
personality characteristics and adds a sixth.
✓ English and later developed in other languages like French, Filipino,
German.
✓ HEXACO contains 60 questions.
✓ A ten-point measure that is adjusting from “strongly disagree” to
“strongly agree was utilized for whole personality measurements.
✓ There is a strong correlation between HEXACO-60's six facet criteria
with their counterpart in the Big Five Personality (BFP).
16. Test Norms of HEXACO-60
✓ The HEXACO explains several benchmarks that relate to
self-serving or anti-social behaviors, like academic and
work-place failures.
✓ Honesty-Humility can be considered as a critical
predictor of values and socio-political perspectives.
✓ Agreeableness in this inventory against Anger and
Emotionality would demonstrate positively correlate with
respectively Agreeableness and Neuroticism in Big Five.
17. Standardization Group of BFPTSQ
• BFPTSQ was tested
• 1,036 early adolescents
• French Canadian
• Equal gender
• Between the age of 12 and 13
• From eight French-language high school
• In the province of Quebec in Canada
• From a wide range of
• Ethnic groups
• Family backgrounds
• Socioeconomic statuses
18. ❑ Adult
❑ College student communities
❑ Equal gender
❑ English language
❑ Questionnaire demonstrated the desired
and expected effects
Standardization Group of HEXACO-60
20. Correlation Coefficient of BFPTSQ
• BFPTSQ scales show that all the estimates are acceptable in reliability
• When the scales of BFI and BFPTSQ are compared by delta parameters
• the new questions did not show any improvement
• in reliability and negative impact
• Since not many questions were added in each scale,
• the reliability estimates is not expected to have a significant
decrease,
• because some of the new questions have slightly low factor loadings
21. Correlation Coefficient of BFPTSQ
• When models include correlated uniquenesses, the latent variable
model composite reliability estimates were consistently lower
• The Cronbach’s alpha coefficient will be traditionally accurate when
the questions are one-dimensional, fundamentally tau-equivalent
and the uniquenesses are not related
• This result has proven that correlated uniquenesses that are not
included will expand the reliability estimates of these personality
trait scales
22. Correlation Coefficient of HEXACO-60
❖ Conscientiousness, and Openness to Experience scales in HEXACO-
60 has strongly correlation with their NEO-FFI counterpart.
❖ HEXACO-60 Emotionality and Agreeableness scale in HEXACO
exhibited moderately, or relatively robust relations with NEO-FFI
Neuroticism and Agreeableness, respectively.
❖ HEXACO-60 Honesty-Humility was the only weak related to the NEO-
FFI scales, which illustrated only modest or no substantial
correlations even with NEO-FFI Agreeableness.
23. Correlation Coefficient of HEXACO-60
❖ Cronbach’s alpha estimated averaged in all languages and kinds of the
HEXACO-personal inventory were moderately.
❖ One of the main disadvantages of short personality inventory like HEXACO-60
in comparison to HEXACO-PI-R, is low reliability, especially in alpha reliability.
❖ The researcher may solve this problem by selecting consistency over
coverage, therefore increase the alpha reliability.
25. Content Validity of BFPTSQ
• Six specialists in personality theory and construction with validation,
• Antonio Terracciano, Brent Donnellan, Brent Roberts, Dave Miranda, Julie
Pozzebon and Lewis Goldberg
• rated the adequacy for all questions concerning to the Big Five scale
• Overall, these questions are recognized as valid indicators
• with the measure criteria of Content Validity Index
• That means, the content validity is adequate for the BFPTSQ scales
• Nevertheless, three new questions, were marked as slightly less adequate
which is below criterion of .78
• specifically Items 48 (Machiavellianism), 45 (Low Self-Worth), and 42
(Sensation Seeking)
26. Content Validity of HEXACO-60
➢ Content validity refers to how much an assessment inventory is
relevant to the target constructed, designed to measure.
➢ It may be considered as a criterion-related validity of individual report
estimates, probably less than optimum, and the reason is that they
measure noncontectualized and personality facets.
➢ In HEXACO-60 despite illustrating moderate to high construct validity
levels, the BHI is associated with low internal consistency.
27. Criterion-related Validity of BFPTSQ
• Correlations of BFPTSQ scales with three outcomes have adequate concurrent
validity
• Externalizing psychopathology scales have the highest levels of Extraversion
• as expected in meta-analytic findings
• except that the substance use was not in a prominently higher correlation
• Conversely, internalizing psychopathology scales have the lowest level of
Extraversion
• Being the highest level of Extraversion, bipolar disorder is an exception
although it is a mood disorder
28. Criterion-related Validity of BFPTSQ
• The level of Openness is low,
• and yet it is significantly related to psychopathology scales positively
• as expected in the same findings
• In BFPTSQ, Openness has negative connection with Conduct Disorder,
• but positive connection with
• Bipolar Disorder
• Generalized Anxiety Disorder
• Major Depression Disorder
• which are small in other correlations
29. Criterion-related Validity of BFPTSQ
• Openness and Conscientiousness have positive connection
with GPA as expected in meta-analysis findings
• Agreeableness has a clear connection to GPA among these
adolescents, which are notably stronger than in adult samples
• The comparison tests between BFI scales and BFPTSQ scales
proved that new questions offer several remarkably higher
correlations with the outcome scales
• With the confidence intervals, all slightly overlap
30. Criterion-related Validity of HEXACO-60
❖ It was deduced that there is huge degree of content overlap between the sixth domain
of the HEXACO, the Honesty-Humility, and the Agreeableness domain.
❖ Criterion validity estimates how sufficiently one test indicates an output for one more
measure.
❖ Many studies and researchers have discovered that the HEXACO, particularly the
Honesty-Humility aspect, has greater predictive validity than the Five Factor Model
(FFM) across several variables.
❖ The predictive validity of the HEXACO due to its inclusion of the Honesty-Humility
domain has seen the HEXACO outperform the FFM fields in the foretelling of
pretentiousness, immorality, and egoism.
31. Criterion-related Validity of HEXACO-60
❖ The HEXACO as a better predictor of overt integrity measures.
❖ Weller and Tikir (2010) found that Honesty-Humility was associated with
tendency for ethical and safety risk-taking.
❖ These outcomes indicate that the HEXACO is appearing as an
increasingly widespread and popular instrument between applied
psychologists and also there is obvious proof of its accumulative validity
over the FFM in fields of relevant to personnel selection procedures.
32. ● The questionnaire of NEO-PI-3 scales has a gold standard for convergent validity
● It was compared with BFPTSQ scales by using statistical tests
● For convergent validity, every correlation indicates that the BFPTSQ scales are adequate.
● These scales are notably improved convergent validity based on the delta parameters
● Certainly, every correlation between the broad scales of the Big Five trait are notably
higher
● Additionally, other several correlations with NEO-PI-3 primary-trait scales were considerably
expanded as expected
● It is because every primary trait has a similar variance related to the broad trait of Big
Five
● Nevertheless, every correlation pairs in the confidence intervals slightly overlap
Construct Validity of BFPTSQ
33. Construct Validity HEXACO -60
❖ HEXACO characteristics have been established in order approximately coordinate
and revolved several of “Big Five” Emotional Stability and Agreeableness.
❖ For Emotionality and Agreeableness seem there is a low convergent correlations.
❖ They as well discovered low convergence between Emotionality and
Agreeableness as estimated with HEXACO-60.
34. Conclusion
❖ The HEXACO model is more or less similar to OCEAN models except it adds Honesty.
❖ There are some small differences between this two models like, Humility, which makes
it a little more reliable and valid Agreeableness.
❖ The HEXACO model has a weaker connection with attitude than its counterpart in OCEAN
Model; on the other hand, there are no differences in its relationship with behaviors.
❖ The Openness in the HEXACO has a more substantial connection or association with
behavior.
❖ Both of these two personality models are among the more reliable and valid
psychological self-report tests.