Critical Analysis of Research Article (Team Assignment) · · Due Jan 11 Read the article provided by your instructor, and discuss it with your Learning Team. Discuss the research question posed, the authors' hypotheses, the research methodology, and the statistical concepts used. Consider the implications of the study. How did the authors interpret the results? Discuss the meaning and importance of the study. Create a list of questions for those areas you know little about, and save these questions for discussion in the classroom. Include statistical questions, concepts, terminology, or anything that may be confusing to you. Complete the Research Evaluation Form provided. The completed form--one per Learning Team--and the list of questions are due this week. Note. There may be questions you are not able to answer at this time, but do your best. Confer with your Learning Team for clarification and assistance. Research Evaluation Form CCMH/525 Version 2 1 University of Phoenix Material Research Evaluation Form Use this form for both your individual and Learning Team article reviews. Name(s): ______________________________________________ Quantitative study: __________ Qualitative study: _____________ Location of Researcher’s Observation or Experiment none _________ home ________ clinic _________ lab __________ residential facility ________ school _________ hospital _________ other __________ Were children involved? Yes _____ No ______ If your answer is yes, how many? _________ Introduction Research hypothesis or research questions/problem behaviors: ________________________ _______________________________________________________________________________________________________________________________________________________________________________________________________________________________________ __________________________________________________________________________________________________________________________________________________________ Operational definitions: ____________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Consider the following questions: Is the need for the study clearly stated in the introduction? _____________________________________________________________________________ Were the research questions and hypothesis clearly stated? Note that research questions are often presented implicitly within a description of the purpose of the study section. Review of literature as relevant to the study: _________________________________________ _____________________________________________________________________________________________________________________________________________________________________________________________________________.

1. Critical Analysis of Research Article (Team Assignment)
·
· Due Jan 11
Read the article provided by your instructor, and discuss it with
your Learning Team. Discuss the research question posed, the
authors' hypotheses, the research methodology, and the
statistical concepts used. Consider the implications of the study.
How did the authors interpret the results? Discuss the meaning
and importance of the study.
Create a list of questions for those areas you know little about,
and save these questions for discussion in the classroom.
Include statistical questions, concepts, terminology, or anything
that may be confusing to you.
Complete the Research Evaluation Form provided. The
completed form--one per Learning Team--and the list of
questions are due this week.
Note. There may be questions you are not able to answer at this
time, but do your best. Confer with your Learning Team for
clarification and assistance.
Research Evaluation Form
CCMH/525 Version 2
1
University of Phoenix Material

2. Research Evaluation Form
Use this form for both your individual and Learning Team
article reviews.
Name(s):
______________________________________________
Quantitative study: __________
Qualitative study: _____________
Location of Researcher’s Observation or Experiment
none _________ home ________ clinic _________ lab
__________
residential facility ________ school _________ hospital
_________ other __________
Were children involved? Yes _____ No ______ If your answer
is yes, how many? _________
Introduction
Research hypothesis or research questions/problem behaviors:
________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
___________________
_____________________________________________________
_____________________________________________________
________________________________________________
Operational definitions:

3. _____________________________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
___________________________________________
Consider the following questions:
Is the need for the study clearly stated in the introduction?
_____________________________________________________
________________________
Were the research questions and hypothesis clearly stated? Note
that research questions are often presented implicitly within a
description of the purpose of the study section.
Review of literature as relevant to the study:
_________________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
___________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
___________________
Method
Sample size (total): ________________
Size per group or cell: _______________

4. Consider the Following Questions:
_______ Were the methods described so that the study could be
replicated without further information?
Subjects
_______ Were subject recruitments and selection methods
described?
_______ Were subjects randomly selected? Were there any
biases in sampling?
_______ Were the samples appropriate for the population to
which the researcher wished to generalize?
_______ Were characteristics of the sample adequately
described?
_______ Are two or more groups being compared? Are they
shown to be comparable on potentially confounding variables?
If they are not comparable, is this incomparability handled
properly?
_______ Was informed consent obtained?
_______ Was the size of the sample large enough for the
number of measures and for the effect being sought?
Research Design
_______ Single group, time series study
_______ Multiple baseline (sequential) design:
______________

5. _______ Single group, no measurement
_______ Single group with measurement: Pre ______ During
_____ Post _____
_______ Two groups classic experimental versus control group,
randomly assigned
_______ (Quasi-experimental) two groups experimental versus
control group,
not randomly assigned
_______ Correlation research, not manipulated, degree of
relationship
_______ Descriptive research (qualitative study)
_______ Natural observation
_______ Analytical research
_______ Interview research
_______ Historical study
_______ Survey research

6. _______ Legal study
_______ Ethnography research
_______ Policy analysis
_______ Fieldwork research
_______ Evaluation study
_______ Phenomenology
_______ Grounded theory
_______ Protocol analysis (collection and analysis of verbatim
reports)
_______ Case study, no measurement
_______ Case study, with measurement: Pre _________ During
_______ Post _________
_______ Developmental research
_______ Longitudinal (same group of subjects over a period of
time)
_______ Cross-sectional (subjects from different age groups
compared)
_______ Cross-sequential (subjects from different age groups,

7. shorter period of time)
_______ Correlation, more than two groups: control, treatment,
and other treatment comparisons
_______ Factorial design, two or more groups: other treatment
differences, no untreated controls
_______ Two or more dependent variables (MANOVA)
_______ Other design:
_____________________________________________________
_____
Consider the Following Yes/No Questions:
_______ If appropriate, was a control group used?
_______ Was the control method for the study appropriate?
_______ What variable was being controlled for?
_______ In the case of an experimental study, were subject
randomly assigned to groups?
Measures
Type of dependent measures or instruments used:
____________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
___________________________________________
Measurement or instrument validity information:
_______________________________________
_____________________________________________________

8. _____________________________________________________
________________________________________________
Measurement or instrument reliability information:
_____________________________________
_____________________________________________________
_____________________________________________________
________________________________________________
Consider the Following Yes/No Questions:
_______ For all measures—measures to classify subjects,
dependent variables, and so forth—was evidence of reliability
and validity provided, either through summarizing the data or
by referring the reader to an available source for that
information?
_______ Do the reliability and validity data justify the use of
the measure? Specific evidence is particularly important if a
measure is created just for this particular study.
_______ Do the measures match the researchers questions and
hypothesis being addressed?
_______ In the case that different tasks or measures are used,
was their order counterbalanced? Do the researchers analyze for
potential order effects?
_______ Are multiple measures used, particularly those that
sample the same domains or constructs but with different
methods, such as self-report, rating scales, self-monitoring, or
direct observation?
_______ If human observers, judges, or raters were involved,
was inter-observer or inter-rater agreement (reliability)
assessed? Was it obtained for a representative sample of the
data? Did the two raters do their ratings independently? Was
their reliability satisfactory?

9. Independent and Dependent Variables
Independent variables:
_____________________________________________________
___
_____________________________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
___________________
Dependent variables:
_____________________________________________________
_____
_____________________________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
___________________
Data Analysis
Scales of Measurement:
Nominal _______ Ordinal _______ Interval _______ Ratio
_______
What type of statistical techniques are used?
_____________________________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
___________________________________________

10. What type of tables and graphs are used?
_____________________________________________________
________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
___________________________________________
Consider the Following Yes/No Questions:
_______ Do the data fulfill the assumptions and requirements of
the statistics?
_______ Were tests of significance used and reported
appropriately, such as with sufficient detail to understand what
analysis was being conducted?
_______ In correlation studies, did the researchers interpret low
but significant correlations as though they indicated a great deal
of shared variance between the measures? Are the correlations
limited by restricted ranges on one or more measures? Are
means and standard deviations provided so that you may
determine this?
_______ Do the researchers report means and standard
deviations, if relevant, so that the reader can examine whether
statistically significant differences are large enough to be
meaningful?
Limitations of the study:
_____________________________________________________
___
_____________________________________________________
_____________________________________________________
_____________________________________________________

11. _____________________________________________________
_____________________________________________________
___________________________________________
Discussion
Summary and conclusions (usefulness):
____________________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
___________________________________________
Consider the Following Yes/No Questions:
_______
Do the researchers discuss marginally or insignificant results as
though they were significant?
_______ Do the researchers overinterpret the data? For
example, do they use casual language to integrate correlation
findings or consider self-report of behavior to be equivalent to
direct observation?
_______ Do the researchers consider alternative explanations
for the findings?
_______ Do the researchers have a humility section that
describes the limitations of the research?
_______ Do the researchers point out aspects of subject
selection, procedures, and dependent variables that limit
generalizability of the findings?
Rate the writing style on a scale of 1 to 10:
Overall clarity?
1-------------5-------------10

12. Easy to read?
1-------------5-------------10
Organized?
1-------------5-------------10
Describe what you learned from the study:
_____________________________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
_____________________________________________________
___________________________________________
__________________________________
________________________________
Group member
Group member
___________________________________
________________________________
Group member
Group member
___________________________________

13. ________________________________
Group member
Group member
*Adapted from form created by Dr. Randy Buckner, University
of Phoenix instructor
Copyright © 2015 by University of Phoenix. All rights reserved.