Question Answers Possible Points Is the study population identified and   described? Are eligibility criteria specified?  - - Study Population 5 Eligibility criteria 5 2. Dependent   variable 6 3. Independent   variable 6 What approach do the authors use to   establish content validity? Content validity is the “degree to which an   instrument has an appropriate sample of items for the construct being   measured and adequately covers the construct domain.” To ensure a   “content-valid” instrument, researchers should start with a conceptualization   of the construct. This can be based on: · First-hand   knowledge · Literature   review · Expert   consultations · Preliminary   qualitative studies 6 What type of sampling plan was used?   Would an alternative sampling plan have been preferable? Was the sampling   plan one that could be expected to yield a representative sample? - - Sampling plan.  5 Alternative sampling plan 2 Sampling plan yielding representative   sample 2 If sampling was stratified, was a useful   stratification variable selected? If a consecutive sample was used, was the   time period long enough to address seasonal or temporal variation? - - Stratification 1 Consecutive sampling 1 7. If    cluster sampling was utilized, what were the clusters and   how was sampling done within clusters?  2 How were people recruited into the   sample? Does the method suggest potential biases? - - Recruitment 4 Potential biases 4 Did some factor other than the   sampling plan affect the representativeness of the sample? 5 Are possible sample biases or   weaknesses identified by the researchers themselves? 5 Are key characteristics of the sample   described (e. g., mean age, percent female)? If yes, please provide detailed   information on sample characteristics. 12 Was the sample size justified on the   basis of a power analysis or other rationale? 5 13. What approach do the authors use to check   for internal reliability?  5 14. What approach do the authors use to   establish interrater reliability? 2 15. What approach do the authors use to   establish test-retest reliability? 2 16. What approach do the authors use to   establish discriminant validity? Discriminant   validity is “the ability to differentiate a construct from other similar   constructs.” 5 Does the sample support inferences   about external validity? To whom can the study results reasonably be   generalized? - - External validity 5 Generalizability 5 ...

1. Question
Answers
Possible Points
Is the study population identified and described? Are
eligibility criteria specified?
-
-
Study Population
5
Eligibility criteria

2. 5
2.
Dependent variable
6
3.
Independent variable
6
What approach do the authors use to establish content
validity?
Content validity is the “degree to which an instrument has an
appropriate sample of items for the construct being measured
and adequately covers the construct domain.” To ensure a
“content-valid” instrument, researchers should start with a

3. conceptualization of the construct. This can be based on:
·
First-hand knowledge
·
Literature review
·
Expert consultations
·
Preliminary qualitative studies
6
What type of sampling plan was used? Would an alternative
sampling plan have been preferable? Was the sampling plan
one that could be expected to yield a representative sample?
-
-
Sampling plan.

4. 5
Alternative sampling plan
2
Sampling plan yielding representative sample
2
If
sampling was stratified, was a useful stratification variable
selected? If a consecutive sample was used, was the time
period long enough to address seasonal or temporal variation?
-
-
Stratification

5. 1
Consecutive sampling
1
7.
If
cluster sampling was utilized, what were the clusters and how
was sampling done within clusters?
2
How were people recruited into the sample? Does the method
suggest potential biases?
-
-

6. Recruitment
4
Potential biases
4
Did some factor other than the sampling plan affect the
representativeness of the sample?
5
Are possible sample biases or weaknesses identified by the
researchers themselves?
5

7. Are key characteristics of the sample described (e. g., mean
age, percent female)? If yes, please provide
detailed
information on sample characteristics.
12
Was the sample size justified on the basis of a power analysis
or other rationale?
5
13.
What approach do the authors use to check for internal
reliability?
5
14.

8. What approach do the authors use to establish interrater
reliability?
2
15.
What approach do the authors use to establish test-retest
reliability?
2
16.
What approach do the authors use to establish discriminant
validity?
Discriminant validity is “the ability to differentiate a construct
from other similar constructs.”
5

9. Does the sample support inferences about external validity? To
whom can the study results reasonably be generalized?
-
-
External validity
5
Generalizability
5