SlideShare a Scribd company logo
1 of 7
Download to read offline
ARTICLE
Application of Single Subject Randomization Designs to
Communicative Disorders Research
Susan Rvachew
Speech-Language Department
Alberta Children's Hospital, Alberta
Abstract
Single-subject randomization designs differ from traditional
single-subject designs in that they involve random assignment
of treatments to treatment times. This use of random assign-
ment allowsfor the application ofa randomization test to the
data, thus combining the advantages ofsingle-subjectresearch
with the advantages of statistical analysis. Hypothetical ex-
amples are used to demonstrate howfour single-subject ran-
domization designs can be appliedto communicativedisorders
research.
Application of Single Subject Randomiza-
tion Designs to Communicative Disorders
Research
The value of single-subject designs for communicative disor-
ders research has been discussed recently by McReynolds and
Kearns (1983). Briefly, the primary advantages of single-
subject designs over multiple-subject designs include: (1)
greater control over subject variability, (2) economy. and (3)
the ability to study unique patients. In addition, single-subject
designs are attractive because clinicians are primarily con-
cerned with the effects oftreatments on individuals, rather than
on groups of subjects. A treatment which has been shown to
have a beneficial effect on group performance may not be
useful with any particular patient on a clinician's caseload.
Single-Subject Randomizatlon Designs
McReynolds and Keams (1983) have described a variety of
single-subject designs, most of which are variations on the
withdrawal. reversal. or multiple baseline designs. Although
these designs can be applied to a large number of clinical
problems, there are many situations in which none of these
designs can be used effectively. In some cases, a withdrawal of
the treatment will not result in the necessary performance
decrement. In many cases, the use of a reversal design will be
ethically questionable. Finally, the multiple baseline (across
behaviors) design cannot be オウセ、@ when there is only one target
behavior, or when the target behaviors are very similar.
Adesign which canbe applied in those situations where the
traditional single-subject design is not feasible has been de-
scribed by Edgington (1987). Single-subject randomization
designs involve the random assignment of treatment times to
treatments, thus controlling for variation over time in the same
way that multiple-subject designs control for variation over
subjects. This use ofrandom assignment allows the researcher
to apply a randomization test to the experimental results in
order to determine statistical significance.
The use of statistical tests in single-subject research has
been criticizedon anumberofgrounds. Mostofthese criticisms
are specific to the use of parametric, inferential statistical
analyses, which are problematic with single-subject designs
because of the serial dependence of within-subject data. Al-
though independence of scores is a basic assumption underly-
ing the use of parametric tests, randomization tests are valid
even when the scores are not independent. Therefore, the use of
randomization tests with single-subject designs involving ran-
dom assignment of treatments to sessions circumvents this
problem.
Other criticisms apply to the use of any statistical proce-
dures as a substitute for visual analysis of single-subject data.
It is often said that clinical researchers are concerned only with
clinically significant results, and thus, statistical significance is
irrelevant in applied research. Implicit in this criticism is the
assumption that statistical analysis is required for the detection
of small effects, but not necessary for the detection of large
effects (McReynolds & Kearns, 1983). However, clinical sig-
nificance and statistical significance are two quite different
ways ofjudging experimental outcomes. Clinical significance
is concerned with the size of the observed effect. while statis-
tical significance is concerned with the source ofthe effect. An
effect large enough to be ofclinical interest may well have been
caused by an extraneous variable. For this reason all experi-
ments, including traditional single-subject experiments, re-
quire some judgement about the probability that the results
reflect a true treatment effect. regardless of the size of the
observed effect.
Clinical significance is determined by relating the size of
the observed treatment effect to the effect size that can be
expected based on one's knowledge of the clinical population
under study. Often the effect will not be judged to be clinically
significant unless it is fairly large. However, there are cases
when small effects are of clinical interest. For example. a
researcher comparing the relative effectiveness of the individ-
ual components of a treatment program may expect the pro-
gram components to have relatively small effects when applied
individually. Another experimenter may conclude that a small
Human Communication Canada/Communication Humaine Canada, VoL 12, No. 4, December 1988 7
advantage ofone treatmenttechnique over another is clinically
significant when the superior treatment is less costly to apply
than the inferior treatment.
Internal Validity in Multiple-Subject Designs
Clinically significant effect sizes are ofno interest unless it can
be shown thatthe observed effect is caused by the treatment. In
other words, the experiment must be shown to be internally
valid. In multiple-subject research, internal validity can be
threatened by intersubject variability and by uncontrolled ex-
traneous variables which are associated with the environment.
The basis for control of intersubject variability is random
assignment of subjects to groups. This procedure does not, as
is commonly believed, "equalize" the groups with respect to
subject variables; rather, random assignment satisfies one of
the primary assumptions underlying the use of statistical tests.
In fact. the statistical analysis is predicated on the assumption
thatthe groups may be different before the treatment is applied.
The purpose of the statistical analysis is to determine the
probability of the observed between-group difference occur-
ring when the null hypothesis is true. When this probability is
low. the researcher assumes that differences between groups
are due to the treatment.
Statistical analysis does not control for extraneous vari-
ables which emanate from the environment. and consequently
the researcher must take every precaution to ensure that such
variables areheldconstant across groups oreliminatedentirely.
For example, when studying a treatment designed to improve
reading ability, both control and treatment subjects must re-
ceive their reading test under identical lighting conditions.
Internal Validity in Traditional Single-Subject
Experiments
While intersubject variability is not an issue in single-subject
experiments, other sources of extraneous variation can pose a
serious threat to internal validity. The first technique used to
control for this kind ofvariation is the establishment ofa stable
baseline. When a stable baseline has been obtained, it is
assumed that sources of extraneous variation have been
brought under control, and that the subject will experience the
same extraneous variables during the treatment phase as were
experienced during the baseline phase.
In addition, treatment and no-treatment phases are se-
quencedovertimeinordertodemonstrateexperimental control
ofthe dependent variable. Ifchanges in the dependent variable
are coincident with introduction of the treatment on more than
one occasion, then the researcher can be reasonably confident
that the observed effect is due to the treatment manipulation
(McReynolds & Thompson, 1986).
Internal Validity in Single-Subject Randomization
Designs
The designs discussed above are internally valid to the extent
that the researcher can be sure that extrinsic extraneous vari-
abies have been controlled. In contrast to these designs, ran-
domized single-subject designs do not assume that extraneous
variables are constant across the treatment and control condi-
tions. Rather, these extraneous variables are controlled in a
manner similar to the control of intersubject variability in
multiple-subject research. First, extraneous variables are as-
sumed to be independent of the treatment manipulation. In
otherwords, an extraneous variable operating during any given
session is assumed to exist regardless of whether the treatment
condition orthe controlcondition is applied during thatsession.
Secondly, the treatment and control conditions are randomly
assigned to sessions, thus allowing for the application of a
randomization test to the data. The randomization test yields a
numerical probability value which indicates the likelihood of
the obtained results occurring when the null hypothesis is true.
The size of the resulting probability value determines the
researcher's confidence in assuming that the observed effect
was caused by the treatment.
This is not to say that a researcher using the design should
ignore potential sources of extraneous variation. Extraneous
variables can seriously undermine the sensitivity of the ran-
domization test. Ifsuch sources ofextraneous variation are not
controlled, true treatment effects may be masked and go unde-
tected. However, a failure to control for all possible sources of
extraneous variation does not affect the internal validity ofthe
experiment.
This paper presents hypothetical examples of single-sub-
ject experiments illustrating four different single-subject de-
signs.1 Although it is hoped that these examples will give the
reader some idea of the potential usefulness of this design for
communicative disorders research, the paper does not include
sufficientdetail toallow aresearchertoapply any ofthedesigns
without first consulting other sources. These other sources.
especially Edgington (1987). will give the reader a fuller
understanding ofthe logic and assumptions underlying the use
of randomization tests, as well as specific instructions for
applying randomization tests in different experimental situ-
ations.
A Completely Randomlzed Design
The most basic form of this design is the completely random-
ized design in which any assignment of treatment times to
treatments is possible (given certain sample size constraints).
This design can be used to compare a treatment with no
treatment, one treatment with any number ofother treatments,
or one component of a treatment program with other compo-
1. The purpose of these hypothetical examples is to demonstrate how
the design might be used and to show how the randomization test
would be applied to data resulting from similar experiments. I am not
suggesting that these designs are the best way to study the problems
considered in the examples. Neither am I suggesting that these
hypothetical experiments could be conducted without modification.
8 Human Communication Canada/Communication Humaine Canada, Vol. 12, No. 4, December 1988
nents of the same program. This design was used to investigate
the effect of food colouring on children's behavior (Weiss,
Williams, Margen, Abrams, Caan, Citron, Cox, McKibben,
Ogar, & Schultz, 1980).
This example illustrates how the completely randomized
design could be used to test the following hypothesis: a fluency
enhancement training procedure will be more effective in
reducing dysfluencies than a contingency management proce-
dure. In this hypothetical example, the fluency enhancement
(FE) treatment involves modelling and reinforcing the use of
easy onset, irrespective ofthe presence or absence ofdysfluen-
cies in the subject's speech. The contingency management
(CM) procedure involves reinforcing fluent utterances and
punishing dysfluent utterances while paying no attention to
speaking style. The dependent measure is the average number
of dysfluencies per minute.
In order to apply the completely randomized design to this
problem it is necessary to schedule a number of treatment
sessions. The number and length of these sessions and the
interval oftime separating them will be determined bypractical
and theoretical considerations. In this example, six 10 minute
sessions are scheduled to occur consecutively over a 1 hour
period. Treatment FE is assigned at random to three of the
sessions, whiletreatmentCM is assigned to the remaining three
sessions.2
The subject is encouraged to converse on a number
oftopics while the experimenter applies the treatments accord-
ing to the randomly determined sequence shown in Table 1. A
tape recording ofthe six sessions is scored, yielding an average
number of dysfluencies per minute for each session.
Table 1. Hypothetical outcome of a fully randomlzed
experiment.
Session:
Treatment:
Score:
CM
10
2
FE
8
3
CM
9
3
CM
9
5
FE
7
6
FE
5
Note: CM =contingency management and FE =fluency enhance-
ment(seetext for amoredetaileddescription ofthesetreatments).
The dependent variable is the mean number of dysfluencies per
minute.
2. A researcher may wish to obselVe the effects of each treatment as
they occur over time. In this case, each "session" would consist of a
longer period oftime (e.g., a week or a month) during-which repeated
applications of the treatment (or control condition) and repeated
probes would occur. A graphic representation of the data would then
show multiple data points per session. For statistical analysis, how-
ever, all ofthe data collected during each session would be treated like
a single data point.
The null hypothesis is that the obtained scores are inde-
pendent of the treatment administered at any given time. Ifthe
null hypothesis is true, any differences between scores are due
to a difference in the times that the treatments were admini-
stered, and not to differences in treatment effectiveness. In
order to test this hypothesis it is necessary to calculate the test
statistic, which in this case, is MCM - MFE for a one-tailed test,
or the absolute value of MCM
- MFE for a two-tailed test. Since
CM is expected to yield higher rates of dysfluency, the test
statistic is MCM - MFE =2.67.
Next, each possible way of assigning treatments to ses-
sions is determined, and the test statistic is calculated for each
ofthese possible assignments. In thisexample, there are 61/3!31
= 20 equally probable assignments of treatments to treatment
times. These assignments and the associated test statistics are
called the reference set and are shown in Table 2. The probabil-
ity (P) value associated with the obtained result is the propor-
tion of test statistics greater than or equal to the obtained test
statistic value3
• Inspection ofTable 2 shows that there is one test
statistic equal to or greater than 2.67, and therefore, p = 1/20 =
0,05.
Control of Temporal Trends
The data shown in Table 1 illustrate a temporal trend: The
subject's rate of dysfluency is decreasing over time in a way
that does not appear to be dependent on the treatment admini-
stered at any given time. This improvement is probably due to
the subject's growing familiarity with the experimenterand the
experimental situation. This trend also may be due tocarry over
of the effects of the treatments from session to session. This
kind of temporal trend may occur as a result ofpractice effects,
fatigue effects, maturation, or historical factors.
Although this kind of consistent trend does not affect the
validity ofthe randomization test, it may reduce the sensitivity
of the statistical test. Therefore, it is important to schedule the
desired number of treatment sessions in a way that will mini-
mize the likelihood of such a trend occurring. With respect to
the previous example, the treatment sessions could have been
scheduled to occur once a week over a six week period. In
addition, a different examinercouldhave been assigned to each
of the sessions.
3. Although this statistical test can be calculated by hand. randomiza-
tion tests are usually performed by computer. The comput(;rprograms
necessary for performing randomization tests can be found in Edging-
ton (1987). The specific programs used to determine the p values for
the first three examples were Program 4.4 for the completely random-
ized design. Program 4.2 for the randomized block design, and
Program 6,1 for the factorial design. These programs were developed
for use with multiple-subject designs but are equally appropriate for
use with single-subjectdata. Acomputerprogram. written in Basic, for
calculating the test used in the last example can be obtained from the
author.
Human Communication Canada/Communication Humaine Canada. Vol. 12, No. 4. December 1988 9
Table 2. Reference set for example 1.
Test
Session: 1 2 3 4 5 6 Statistic
Score: 10 8 9 9 7 5
1. CM CM CM FE FE FE 2.000
2. CM CM FE CM FE FE 2.000
3. CM CM FE FE CM FE .667
4. CM CM FE FE FE CM -.667
5. CM FE CM CM FE FE 2.667'
6. CM FE CM FE CM FE 1.330
7. CM FE CM FE FE CM 0.000
8. CM FE FE CM CM FE 1.330
9. CM FE FE CM FE CM 0.000
10. CM FE FE FE CM CM -1.330
11. FE CM CM CM FE FE 1.330
12. FE CM CM FE CM FE 0.000
13. FE CM CM FE FE CM -1.330
14. FE CM FE CM CM FE 0.000
15. FE CM FE CM FE CM -1.330
16. FE CM FE FE CM CM -2.667
17. FE FE CM CM CM FE .667
18. FE FE CM CM FE CM -.667
19. FE FE CM FE CM CM -2.000
20. FE FE FE CM CM CM -2.000
'This line shows the actual assignment of treatments to
sessions and the obtained test statistic value.
Randomized Block Design
An alternative to the completely randomized design which
provides greatercontrol ofsystematic variation overtime is the
randomized block design. This design involves dividing the
total number of treatment sessions into blocks, and then ad-
ministering all of the treatments within each block. The order
in which the treatments are administered is randomly deter-
mined for each individual block. Smith (1963) used this design
(with adifferent statistical analysis) to study the effects ofthree
drugs on narcolepsy. This example illustrates how this design
could be used to study the relative effects ofdifferent language
stimulation techniques.
In the following hypothetical example, three different
language stimulation techniques will be used with a young,
language-delayed child: (I) providing social reinforcement
contingent upon correct imitations (IM) ofsingle-words in the
presence of an appropriate model and stimulus object; (2)
providing parallel talk (PT) at the single-word level while
observing the child at play with a variety of objects; and (3)
playing turn-taking (TT) games with the child in which the
examiner follows the child's lead while providing appropriate
verbal models when taking his or her turn. The dependent
measure is a count of the number ofdifferent words spoken by
the child during each session.
Treatment sessions are scheduled for each Monday,
Wednesday, and Friday morning over a 4 week period. Each
week of sessions constitutes a block, and each of the 3 days is
assigned, atrandom, tooneofthe three treatments. Thisrandom
assignment of days to treatments is made individually for each
block, yielding the sequence of treatments shown in Table 3.
The number of new words spoken during each session also is
shown. These data clearly demonstrate a temporal trend which
could be due to maturation on the part of the child and the
cumulative effects of the treatments over time. However, the
particular random assignment used assures that the effects of
this trend are more or less equal for each of the three treatments
and allows for statistical control of this trend.
This design is analogous to a repeated measures design in
which four subjects receive each of three treatments, and
therefore, the appropriate test statistic is F for repeated meas-
ures analysis ofvariance. For this example, F =4.69. There are
(3!)4 =1,296 equally probable assignments, 36 of which yield
a test statistic greater than or equal to 4.69; therefore, p = 0.03.
Factorial Design
The development of phonological process treatment ap-
proaches has led to a resurgence of interest in minimal pair
contrasting and auditory bombardment as techniques for the
remediation of speech sound errors (Tyler, Edwards, &
Saxman, 1987). The single-subject randomization design
could be used to study both ofthese treatmentvariables with the
same subject. In this hypothetical example, a subject who
presents with fricative stopping is scheduled to participate in
two half-hour treatment sessions per week over a 6 week
period. Each session consists of the following activities: (1) a
pre-treatment probe which measures the proportion ofstopped
fricatives observed during a picture discussion task; (2) audi-
tory bombardment with stimuli which are either appropriate
(Auditory Bombardment Treatment; ABT) or inappropriate
(Auditory Bombardment - Control; ABC), given the target
process; (3) phonological process therapy using a minimal
pairs technique (Therapy - Treatment; THT), or articulation
therapy using traditional techniques (Therapy - Control; THC);
and finally, (4) a post-treatment probe.
Six of the treatment sessions are randomly assigned to the
ABTcondition while the remaining sessions are assignedto the
10 Human Communication Canada/Communication Humaine Canada. Vol. 12. No. 4. December 1988
Table 3 Hypothetical outcome of a randomlzed block experiment.
Block (Week): Block 1 Block 2 Block 3 Block 4
Day: M W F M W F M W F M W F
Treatment: IM PT IT PT IM IT IM IT PT IT IM PT
Score: 1 3 7 5 6 8 7 10 9 12 10 12
Note: M=Monday, W=Wednesday, F=Friday, IM =imitation with reinforcement, PT =parallel talk, IT =turn-taking
games (see text for amore detailed description of these treatments). The dependent variable is the number of different
words spoken by the child during the session.
ABC procedure. Next, three ofthe ABT sessions are randomly
assigned to THT, and the remaining three ABT sessions are
assigned to the THC procedure. This process is then repeated
with the six ABC sessions. One possible outcome of this
random assignmentprocedure is shown in Table 4. Table4 also
shows the hypothetical results of this experiment.
it is expected that the traditional procedure will provide the
larger measurements, indicating less improvement in phonol-
ogical ability (see Edgington (1987) for a more detailed discus-
sion of test statistics for factorial randomization designs). The
number of test statistics in the reference set is the number of
possible assignments for the ABT condition, times the number
Table 4. Hypothetical outcome of a 2 x 2 factorial experiment.
Session: 1 2 3 4 5 6 7 8 9 10 11 12
Variable 1: ABC ABT ABT ABC ABC ABC ABT ABT ABT ABT ABC ABC
Variable 2: THC THT THT THT THC THT THT THC THC THC THT THC
Pre-test: .10 .10 .10 .20 .25 .30 .30 .40 .45 .50 .50 .60
Post·test: .30 .20 .20 .50 .40 .50 .40 .55 .60 .70 .90 1.00
Difference Score: .20 .10 .10 .30 .15 .20 .10 .15 .15 .20 .40 .40
Note:ABT=auditorybombardment-treatment(auditorybomardmentwHh stimulithatcontain thetargetphoneme), ABC =auditorybombardment
-control (auditory bombardment with stimuli that do not contain the target phoneme), THT =therapy -treatment (minimal pairs training), THC =
therapy -control (traditional articulation therapy). The dependent variable is 1-the proportion of stopped fricatives in aspeech sample.
Since a consistent improvement in probe scores can be ex-
pected to occur over the course ofthis experiment, the depend-
ent measure is the difference between the post- and pre-treat-
ment probe scores for each session. Table 5 shows these
difference scores rearranged into cells representing the four
possible combinations of treatment conditions.
As with a traditional factorial design, we can now test for
the main effect of each of the variables over all levels of the
other variable. For example, we could compare the effects of
the speech therapy procedures overbothtypes ofauditorybom-
bardment. Foraone-tailed test, the test statistic is the total ofthe
measurements in the second row of the table, or 1.25, because
of possible assignments for the ABC condition (Le., 6!/3!3! x
6!/3!3! 20 x 20 =400). For this example, the null hypothesis
is accepted because p = 0.32, one-tailed.
The statistical test used for the completely randomized
design can be applied to these data to compare levels of either
variable within any level of the other variable. For example, in
order to examine the effect of the auditory bombardment
variable for the minimal pairs training sessions, the test de-
scribed for the first example above would be applied to the six
measurements shown in the top row ofTable 5. In this case the
test statistic is 0.27 -0.10 =0.17, because the ABC condition is
expected to provide larger measurements than the ABT condi-
Human Communication CanadalCommunication Humaine Canada, Vol. 12. No. 4. December 1988 11
Table 5. Hypothetical factorial experimental data arranged
for statistical analysis.
Auditory Bombardment
Minimal Pairs Training
(THT)
Traditional Therapy
(THC)
Control
(ABC)
0.20
0.20
0.40
M= 0.27
0.20
0.15
0.40
M= 0.25
Treatment
(ABT)
0.10
0.10
0.10
M= 0.10
0.15
0.15
0.20
M 0.17
tion. There are 6!/3!3! == 20 equally probably assignments, and
only one of these yields a test statistic value equal to or greater
than 0.17. Therefore, p =1/20 =0.05, one-tailed, and the null
hypothesis is rejected.
Test for Treatment Intervention
This design is superficially similar to the non-experimental AB
single-subject design: Initially, the subject's performance on
the dependant measure is monitored over a period of time
during which no treatment is administered; then the treatment
is introduced and maintained over a number of sessions, while
monitoring of the subject's performance on the dependent
measure continues. The subject's performance during treat-
ment sessions is compared with his or her performance during
control sessions.
Usually, the treatment is introduced when the subject's
performance during control sessions has stabilized.This proce-
dure does not allow for statistical analysis of the data because
the assignment oftreatment sessions to the control or treatment
condition is non-random. However, ifthe decision to introduce
the treatment is made by randomly selecting the session during
which this will occur, a randomization test can be applied to the
data, and the design becomes fully experimental.
This design is especially useful when the treatment under
study is expected to produce permanent, or relatively perma-
nent, effects which would carry over to control sessions. For
this reason, this design was chosen to test the hypothesis that a
sound identification training procedure would facilitate sound
production learning by children with functional articulation
errors (specifically, the substitution ofIslfor If/ or the substitu-
tion ofIfj/ for Is/). Although this experiment has been carried
out and statistically significant results were obtained, the fol-
Table 6. Hypothetical outcome of a test for treatment
intervention.
Session: 1 2 3 4 5 6 7 8 9 10
Score: 10 10 40 20 10 10 30 10 20 30
Session: 11 12 13 14 15 16 17 18 19 20
Score: セ@ セ@ セ@
セ@ セ@
セ@ セqq@ セ@ QQ
Session: 21 22 23 24 25 26 27 28 29 30
Score: QQ QQ QQ QQ IQ aoao IQ !ill セ@
Note: Underlined scores were obtained during treatment
sessions, while the other scores were obtained during
control sessions.
lowing example uses hypothetical data in order to simplify the
demonstration.4
Each treatment session lasted no longer than ten minutes
and consisted of repeated sound identification training trials
(using either control or treatment stimuli) followed by a 10
item, imitative production probe. Three 1 hour periods, sched-
uled tooccuronconsecutivedays, were required tocomplete 30
such treatment sessions. The first five sessions were reserved
for the control condition, and the last five sessions were
reserved for the treatment condition. The starting session for
treatment intervention was chosen randomly from among ses-
sions 6 to 25.
The hypothetical results of this experiment are shown in
Table 6. For this example, the control procedure was admini-
stered during sessions 1 through 10, and the treatment proce-
dure was administered during sessions 11 through 30. The
nurnber ofcorrectproductions ofthe target phoneme during the
production probe are shown for each session. The measures
obtained during treatment sessions are underlined.
The one-tailed test statistic is the difference between the
mean probe score for treatment sessions and the mean probe
score for control sessions, which in this case is 5.75 1.90 =
3.85. This test statistic was calculated for each of the 20
possible assignments of sessions to treatments. Only one test
statistic in the reference set is equal to or greater than 3.85, and
consequently p = 1/20 =0.05, one-tailed.
4. A detailed description of this study is currently being prepared for
publication, More infonnation about the sound identification training
procedure and the actual results of the study can be obtained from Dr.
D, G. Jamieson, Speech Communication Laboratory, Department of
Communicative Disorders, Elborn College, University of Western
Ontario, London, Ontario, N6G IHI, or from the author.
12 Human Communication Canada/Communication Humaine Canada. Vol. 12, No. 4, December 1988
Conclusion
Recently the difficulties inherent in the application of basic,
traditional single-subject designs have been discussed, and the
need for flexibility in the use ofsingle-subject designs has been
noted (Connell &Thompson, 1986; Keams, 1986). The single-
subject randomization design adds to the flexibility of single-
subject designs. It can be used in any situation where the
traditional single-subjectdesign might be applied. It alsocan be
used in situations where the traditional designs would be
difficult to apply (e.g., a factorial single-subject experiment or
an experiment in which the treatment has irreversible effects).
The examples discussed above are only some ofmany possible
randomized single-subject designs. In fact, a randomization
test can be applied to any conceivable single-subject experi-
ment in which there is random assignment oftreatment times to
treatments. Further information and additional examples can
be found in Edgington (1984), Edgington (1987), Kazden
(1976), and Levin, Marascuito, and Hubert (1978).
Address all correspondence to:
Susan Rvachew
Speech-Language Department, Alberta Children's Hospital
1820 Richmond Rd. S.W.
Calgary, Alberta, T2T 5C7
Acknowledgements
I am grateful to Dr. Edgington (Department of Psychology,
University of Calgary) for his comments on this manuscript.
References
Connell, P. J. & Thompson, C. K. (1986). Flexibility ofsingle-subject
experimental designs. Part Ill: Using flexibility to design or modify
experiments. Journal ofSpeech andHearing Disorders. 51, 214-225.
Edgington, E. S. (1984). Statistics and single case analysis. In M.
Hersen, R. M. Eisler, & P. Miller (Eds.). Progress in Behavior
Modification, (pp. 83-119. VoI.16). New York: Academic Press, Inc..
Edgington, E. S. (1987). Randomization Tests (2nd edition). New
York: Marcel Dekker, Inc.
Kazdin, A. E. (1976). Statistical analyses for single-caseexperimental
designs. In M. Hersen & D. H. Barlow (Eds.). Single-case Experimen-
tal Designs: StrategiesforStudying BehaviorChange. Oxford: Perga-
mono
Kearns, K. P. (1986). Flexibility of single-subject experimental de-
signs. Part 11: Design selection and arrangement of experimental
phases. Journal ofSpeech and Hearing Disorders. 51, 204-214.
Levin, J. R., Marascuito, L. A., & Hubert, L. 1. (1978) Nonparametric
randomization tests. In T. R. Kratochwill, (Ed.), Single Subject Re-
search: Strategies for Evaluating Change. New York: Academic
Press.
McReynolds, L. V_, & Kearns, K. (1983). Single-subject experimental
designs in communicative disorders. Austin, Texas: Pro-Ed.
McReynolds, L. V. & Thompson, C. K. (1986). Flexibility of single-
subject experimental designs. Part I: Review of the basics of single-
subject designs. Journal ofSpeech and Hearing Disorders. 51, 194-
203.
Smith, C M. (1963). Controlled observations on the single case.
Canadian Medical Association Journal, 88, 410-412.
Tyler, A. A., Edwards, M. L., & Saxman, J. H. (1987). Clinical
applications of two phonologically based treatment procedures. Jour-
nal ofSpeech and Hearing Disorders, 52, 393-409.
Weiss, B., Williams, J. H., Margen, S., Abrams, B., Caan, B., Citron,
L. 1., Cox, C, McKibben, l., Ogar, D., & Schultz, S. (1980). Behav-
ioral responses to artificial food colors. Science. 297, 1487-1489.
Human Communication Canada/Communication Humaine Canada. Vol. 12. No. 4. December 1988 13

More Related Content

Similar to Application Of Single Subject Randomization Designs To Communicative Disorders Research

Investigation modes in ayurveda
Investigation modes in ayurvedaInvestigation modes in ayurveda
Investigation modes in ayurvedaAyurdata
 
Applying evidence based
Applying evidence basedApplying evidence based
Applying evidence basedislam kassem
 
Common statistical pitfalls in basic science research
Common statistical pitfalls in basic science researchCommon statistical pitfalls in basic science research
Common statistical pitfalls in basic science researchRamachandra Barik
 
Quantitative Research Essay Discussion Paper.docx
Quantitative Research Essay Discussion Paper.docxQuantitative Research Essay Discussion Paper.docx
Quantitative Research Essay Discussion Paper.docxwrite22
 
presentation for basic research1.ppt
presentation for basic research1.pptpresentation for basic research1.ppt
presentation for basic research1.pptjakjak36
 
Biostatistics_Unit_II_ResearchMethodologyBiostatistics.pptx
Biostatistics_Unit_II_ResearchMethodologyBiostatistics.pptxBiostatistics_Unit_II_ResearchMethodologyBiostatistics.pptx
Biostatistics_Unit_II_ResearchMethodologyBiostatistics.pptxPrachi Pandey
 
Biostatistics_Unit_II_Research Methodology & Biostatistics_M. Pharm (Pharmace...
Biostatistics_Unit_II_Research Methodology & Biostatistics_M. Pharm (Pharmace...Biostatistics_Unit_II_Research Methodology & Biostatistics_M. Pharm (Pharmace...
Biostatistics_Unit_II_Research Methodology & Biostatistics_M. Pharm (Pharmace...RAHUL PAL
 
#1 Characteristics, Strengths, Weaknesses, Kinds of.pptx
#1 Characteristics, Strengths, Weaknesses, Kinds of.pptx#1 Characteristics, Strengths, Weaknesses, Kinds of.pptx
#1 Characteristics, Strengths, Weaknesses, Kinds of.pptxJessaMaeGastar1
 
Non randomized controlled trial
Non randomized controlled trial Non randomized controlled trial
Non randomized controlled trial HimikaRathi
 
Evidence based surgery
Evidence based surgeryEvidence based surgery
Evidence based surgeryDeepak Kumar
 
Guide for conducting meta analysis in health research
Guide for conducting meta analysis in health researchGuide for conducting meta analysis in health research
Guide for conducting meta analysis in health researchYogitha P
 
Quantitative Research designs
Quantitative Research designs Quantitative Research designs
Quantitative Research designs DEVA PON PUSHPAM I
 
(clinical trial overview)
 (clinical trial overview) (clinical trial overview)
(clinical trial overview)Rajesh Yadav
 
How Randomized Controlled Trials are Used in Meta-Analysis
How Randomized Controlled Trials are Used in Meta-Analysis How Randomized Controlled Trials are Used in Meta-Analysis
How Randomized Controlled Trials are Used in Meta-Analysis Pubrica
 
Clinical trial design, Trial Size, and Study Population
Clinical trial design, Trial Size, and Study Population Clinical trial design, Trial Size, and Study Population
Clinical trial design, Trial Size, and Study Population Shubham Chinchulkar
 

Similar to Application Of Single Subject Randomization Designs To Communicative Disorders Research (20)

Investigation modes in ayurveda
Investigation modes in ayurvedaInvestigation modes in ayurveda
Investigation modes in ayurveda
 
Research methodology
Research methodologyResearch methodology
Research methodology
 
Applying evidence based
Applying evidence basedApplying evidence based
Applying evidence based
 
Common statistical pitfalls in basic science research
Common statistical pitfalls in basic science researchCommon statistical pitfalls in basic science research
Common statistical pitfalls in basic science research
 
Quantitative Research Essay Discussion Paper.docx
Quantitative Research Essay Discussion Paper.docxQuantitative Research Essay Discussion Paper.docx
Quantitative Research Essay Discussion Paper.docx
 
presentation for basic research1.ppt
presentation for basic research1.pptpresentation for basic research1.ppt
presentation for basic research1.ppt
 
Biostatistics_Unit_II_ResearchMethodologyBiostatistics.pptx
Biostatistics_Unit_II_ResearchMethodologyBiostatistics.pptxBiostatistics_Unit_II_ResearchMethodologyBiostatistics.pptx
Biostatistics_Unit_II_ResearchMethodologyBiostatistics.pptx
 
Biostatistics_Unit_II_Research Methodology & Biostatistics_M. Pharm (Pharmace...
Biostatistics_Unit_II_Research Methodology & Biostatistics_M. Pharm (Pharmace...Biostatistics_Unit_II_Research Methodology & Biostatistics_M. Pharm (Pharmace...
Biostatistics_Unit_II_Research Methodology & Biostatistics_M. Pharm (Pharmace...
 
pengajian malaysia
pengajian malaysiapengajian malaysia
pengajian malaysia
 
#1 Characteristics, Strengths, Weaknesses, Kinds of.pptx
#1 Characteristics, Strengths, Weaknesses, Kinds of.pptx#1 Characteristics, Strengths, Weaknesses, Kinds of.pptx
#1 Characteristics, Strengths, Weaknesses, Kinds of.pptx
 
Non randomized controlled trial
Non randomized controlled trial Non randomized controlled trial
Non randomized controlled trial
 
Evidence based surgery
Evidence based surgeryEvidence based surgery
Evidence based surgery
 
Meta analysis
Meta analysisMeta analysis
Meta analysis
 
Guide for conducting meta analysis in health research
Guide for conducting meta analysis in health researchGuide for conducting meta analysis in health research
Guide for conducting meta analysis in health research
 
Mpharm RA 103.pdf
Mpharm RA 103.pdfMpharm RA 103.pdf
Mpharm RA 103.pdf
 
Quantitative Research designs
Quantitative Research designs Quantitative Research designs
Quantitative Research designs
 
(clinical trial overview)
 (clinical trial overview) (clinical trial overview)
(clinical trial overview)
 
How Randomized Controlled Trials are Used in Meta-Analysis
How Randomized Controlled Trials are Used in Meta-Analysis How Randomized Controlled Trials are Used in Meta-Analysis
How Randomized Controlled Trials are Used in Meta-Analysis
 
Quantitative research design
Quantitative research designQuantitative research design
Quantitative research design
 
Clinical trial design, Trial Size, and Study Population
Clinical trial design, Trial Size, and Study Population Clinical trial design, Trial Size, and Study Population
Clinical trial design, Trial Size, and Study Population
 

More from Courtney Esco

I Need Someone To Write My Essay - UK Essay Writing
I Need Someone To Write My Essay - UK Essay WritingI Need Someone To Write My Essay - UK Essay Writing
I Need Someone To Write My Essay - UK Essay WritingCourtney Esco
 
Do Urgent Essay Writing ,Research Writing ,Summary And Report Writi
Do Urgent Essay Writing ,Research Writing ,Summary And Report WritiDo Urgent Essay Writing ,Research Writing ,Summary And Report Writi
Do Urgent Essay Writing ,Research Writing ,Summary And Report WritiCourtney Esco
 
003 Compare And Contrast Essay Intro Example Fres
003 Compare And Contrast Essay Intro Example Fres003 Compare And Contrast Essay Intro Example Fres
003 Compare And Contrast Essay Intro Example FresCourtney Esco
 
Pencil And Paper Games For Kids Fo
Pencil And Paper Games For Kids FoPencil And Paper Games For Kids Fo
Pencil And Paper Games For Kids FoCourtney Esco
 
Essay Written For Me. Do Essay For Me Write Essay
Essay Written For Me. Do Essay For Me Write EssayEssay Written For Me. Do Essay For Me Write Essay
Essay Written For Me. Do Essay For Me Write EssayCourtney Esco
 
ValentineS Day Writing Paper Heart Writing Pape
ValentineS Day Writing Paper Heart Writing PapeValentineS Day Writing Paper Heart Writing Pape
ValentineS Day Writing Paper Heart Writing PapeCourtney Esco
 
Cloud Writing Paper - Printable Teaching Resources - Print Play Learn
Cloud Writing Paper - Printable Teaching Resources - Print Play LearnCloud Writing Paper - Printable Teaching Resources - Print Play Learn
Cloud Writing Paper - Printable Teaching Resources - Print Play LearnCourtney Esco
 
Literature Review Example Harvard Style
Literature Review Example Harvard StyleLiterature Review Example Harvard Style
Literature Review Example Harvard StyleCourtney Esco
 
When I Look Back To My First Experience Teaching Five P
When I Look Back To My First Experience Teaching Five PWhen I Look Back To My First Experience Teaching Five P
When I Look Back To My First Experience Teaching Five PCourtney Esco
 
ACS Citation Sample By Annotatedbib-S
ACS Citation Sample By Annotatedbib-SACS Citation Sample By Annotatedbib-S
ACS Citation Sample By Annotatedbib-SCourtney Esco
 
WhoLl Generate Eyes Watching Go
WhoLl Generate Eyes Watching GoWhoLl Generate Eyes Watching Go
WhoLl Generate Eyes Watching GoCourtney Esco
 
Thesis Essay Examples Telegr
Thesis Essay Examples  TelegrThesis Essay Examples  Telegr
Thesis Essay Examples TelegrCourtney Esco
 
010 English Essays Essay Example Student ~ Thatsn
010 English Essays Essay Example Student ~ Thatsn010 English Essays Essay Example Student ~ Thatsn
010 English Essays Essay Example Student ~ ThatsnCourtney Esco
 
Free Printable Polar Bear Craftivity Creative Writin
Free Printable Polar Bear Craftivity  Creative WritinFree Printable Polar Bear Craftivity  Creative Writin
Free Printable Polar Bear Craftivity Creative WritinCourtney Esco
 
Write My Apa Paper For Me For Free Write My Paper Fo
Write My Apa Paper For Me For Free Write My Paper FoWrite My Apa Paper For Me For Free Write My Paper Fo
Write My Apa Paper For Me For Free Write My Paper FoCourtney Esco
 
How Important It Is To Help Others Who Are In Need F
How Important It Is To Help Others Who Are In Need FHow Important It Is To Help Others Who Are In Need F
How Important It Is To Help Others Who Are In Need FCourtney Esco
 
🏷️ Ama Essay Format Example. AMA Style Form
🏷️ Ama Essay Format Example. AMA Style Form🏷️ Ama Essay Format Example. AMA Style Form
🏷️ Ama Essay Format Example. AMA Style FormCourtney Esco
 
Printable Paper With Lines For Wr
Printable Paper With Lines For WrPrintable Paper With Lines For Wr
Printable Paper With Lines For WrCourtney Esco
 

More from Courtney Esco (20)

I Need Someone To Write My Essay - UK Essay Writing
I Need Someone To Write My Essay - UK Essay WritingI Need Someone To Write My Essay - UK Essay Writing
I Need Someone To Write My Essay - UK Essay Writing
 
Do Urgent Essay Writing ,Research Writing ,Summary And Report Writi
Do Urgent Essay Writing ,Research Writing ,Summary And Report WritiDo Urgent Essay Writing ,Research Writing ,Summary And Report Writi
Do Urgent Essay Writing ,Research Writing ,Summary And Report Writi
 
003 Compare And Contrast Essay Intro Example Fres
003 Compare And Contrast Essay Intro Example Fres003 Compare And Contrast Essay Intro Example Fres
003 Compare And Contrast Essay Intro Example Fres
 
Pencil And Paper Games For Kids Fo
Pencil And Paper Games For Kids FoPencil And Paper Games For Kids Fo
Pencil And Paper Games For Kids Fo
 
Essay Written For Me. Do Essay For Me Write Essay
Essay Written For Me. Do Essay For Me Write EssayEssay Written For Me. Do Essay For Me Write Essay
Essay Written For Me. Do Essay For Me Write Essay
 
ValentineS Day Writing Paper Heart Writing Pape
ValentineS Day Writing Paper Heart Writing PapeValentineS Day Writing Paper Heart Writing Pape
ValentineS Day Writing Paper Heart Writing Pape
 
Speech Sample Essay
Speech Sample EssaySpeech Sample Essay
Speech Sample Essay
 
Cloud Writing Paper - Printable Teaching Resources - Print Play Learn
Cloud Writing Paper - Printable Teaching Resources - Print Play LearnCloud Writing Paper - Printable Teaching Resources - Print Play Learn
Cloud Writing Paper - Printable Teaching Resources - Print Play Learn
 
Literature Review Example Harvard Style
Literature Review Example Harvard StyleLiterature Review Example Harvard Style
Literature Review Example Harvard Style
 
When I Look Back To My First Experience Teaching Five P
When I Look Back To My First Experience Teaching Five PWhen I Look Back To My First Experience Teaching Five P
When I Look Back To My First Experience Teaching Five P
 
Buy Essay
Buy EssayBuy Essay
Buy Essay
 
ACS Citation Sample By Annotatedbib-S
ACS Citation Sample By Annotatedbib-SACS Citation Sample By Annotatedbib-S
ACS Citation Sample By Annotatedbib-S
 
WhoLl Generate Eyes Watching Go
WhoLl Generate Eyes Watching GoWhoLl Generate Eyes Watching Go
WhoLl Generate Eyes Watching Go
 
Thesis Essay Examples Telegr
Thesis Essay Examples  TelegrThesis Essay Examples  Telegr
Thesis Essay Examples Telegr
 
010 English Essays Essay Example Student ~ Thatsn
010 English Essays Essay Example Student ~ Thatsn010 English Essays Essay Example Student ~ Thatsn
010 English Essays Essay Example Student ~ Thatsn
 
Free Printable Polar Bear Craftivity Creative Writin
Free Printable Polar Bear Craftivity  Creative WritinFree Printable Polar Bear Craftivity  Creative Writin
Free Printable Polar Bear Craftivity Creative Writin
 
Write My Apa Paper For Me For Free Write My Paper Fo
Write My Apa Paper For Me For Free Write My Paper FoWrite My Apa Paper For Me For Free Write My Paper Fo
Write My Apa Paper For Me For Free Write My Paper Fo
 
How Important It Is To Help Others Who Are In Need F
How Important It Is To Help Others Who Are In Need FHow Important It Is To Help Others Who Are In Need F
How Important It Is To Help Others Who Are In Need F
 
🏷️ Ama Essay Format Example. AMA Style Form
🏷️ Ama Essay Format Example. AMA Style Form🏷️ Ama Essay Format Example. AMA Style Form
🏷️ Ama Essay Format Example. AMA Style Form
 
Printable Paper With Lines For Wr
Printable Paper With Lines For WrPrintable Paper With Lines For Wr
Printable Paper With Lines For Wr
 

Recently uploaded

ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTiammrhaywood
 
Presiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsPresiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsanshu789521
 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for BeginnersSabitha Banu
 
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdfFraming an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdfUjwalaBharambe
 
भारत-रोम व्यापार.pptx, Indo-Roman Trade,
भारत-रोम व्यापार.pptx, Indo-Roman Trade,भारत-रोम व्यापार.pptx, Indo-Roman Trade,
भारत-रोम व्यापार.pptx, Indo-Roman Trade,Virag Sontakke
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxSayali Powar
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxthorishapillay1
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceSamikshaHamane
 
DATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersDATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersSabitha Banu
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxNirmalaLoungPoorunde1
 
MARGINALIZATION (Different learners in Marginalized Group
MARGINALIZATION (Different learners in Marginalized GroupMARGINALIZATION (Different learners in Marginalized Group
MARGINALIZATION (Different learners in Marginalized GroupJonathanParaisoCruz
 
Meghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentMeghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentInMediaRes1
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17Celine George
 
Painted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaPainted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaVirag Sontakke
 
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfEnzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfSumit Tiwari
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...Marc Dusseiller Dusjagr
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentInMediaRes1
 

Recently uploaded (20)

ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
 
Presiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsPresiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha elections
 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for Beginners
 
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdfFraming an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
 
भारत-रोम व्यापार.pptx, Indo-Roman Trade,
भारत-रोम व्यापार.pptx, Indo-Roman Trade,भारत-रोम व्यापार.pptx, Indo-Roman Trade,
भारत-रोम व्यापार.pptx, Indo-Roman Trade,
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptx
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in Pharmacovigilance
 
DATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersDATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginners
 
9953330565 Low Rate Call Girls In Rohini Delhi NCR
9953330565 Low Rate Call Girls In Rohini  Delhi NCR9953330565 Low Rate Call Girls In Rohini  Delhi NCR
9953330565 Low Rate Call Girls In Rohini Delhi NCR
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptx
 
MARGINALIZATION (Different learners in Marginalized Group
MARGINALIZATION (Different learners in Marginalized GroupMARGINALIZATION (Different learners in Marginalized Group
MARGINALIZATION (Different learners in Marginalized Group
 
Meghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentMeghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media Component
 
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17
 
Painted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaPainted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of India
 
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfEnzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media Component
 

Application Of Single Subject Randomization Designs To Communicative Disorders Research

  • 1. ARTICLE Application of Single Subject Randomization Designs to Communicative Disorders Research Susan Rvachew Speech-Language Department Alberta Children's Hospital, Alberta Abstract Single-subject randomization designs differ from traditional single-subject designs in that they involve random assignment of treatments to treatment times. This use of random assign- ment allowsfor the application ofa randomization test to the data, thus combining the advantages ofsingle-subjectresearch with the advantages of statistical analysis. Hypothetical ex- amples are used to demonstrate howfour single-subject ran- domization designs can be appliedto communicativedisorders research. Application of Single Subject Randomiza- tion Designs to Communicative Disorders Research The value of single-subject designs for communicative disor- ders research has been discussed recently by McReynolds and Kearns (1983). Briefly, the primary advantages of single- subject designs over multiple-subject designs include: (1) greater control over subject variability, (2) economy. and (3) the ability to study unique patients. In addition, single-subject designs are attractive because clinicians are primarily con- cerned with the effects oftreatments on individuals, rather than on groups of subjects. A treatment which has been shown to have a beneficial effect on group performance may not be useful with any particular patient on a clinician's caseload. Single-Subject Randomizatlon Designs McReynolds and Keams (1983) have described a variety of single-subject designs, most of which are variations on the withdrawal. reversal. or multiple baseline designs. Although these designs can be applied to a large number of clinical problems, there are many situations in which none of these designs can be used effectively. In some cases, a withdrawal of the treatment will not result in the necessary performance decrement. In many cases, the use of a reversal design will be ethically questionable. Finally, the multiple baseline (across behaviors) design cannot be オウセ、@ when there is only one target behavior, or when the target behaviors are very similar. Adesign which canbe applied in those situations where the traditional single-subject design is not feasible has been de- scribed by Edgington (1987). Single-subject randomization designs involve the random assignment of treatment times to treatments, thus controlling for variation over time in the same way that multiple-subject designs control for variation over subjects. This use ofrandom assignment allows the researcher to apply a randomization test to the experimental results in order to determine statistical significance. The use of statistical tests in single-subject research has been criticizedon anumberofgrounds. Mostofthese criticisms are specific to the use of parametric, inferential statistical analyses, which are problematic with single-subject designs because of the serial dependence of within-subject data. Al- though independence of scores is a basic assumption underly- ing the use of parametric tests, randomization tests are valid even when the scores are not independent. Therefore, the use of randomization tests with single-subject designs involving ran- dom assignment of treatments to sessions circumvents this problem. Other criticisms apply to the use of any statistical proce- dures as a substitute for visual analysis of single-subject data. It is often said that clinical researchers are concerned only with clinically significant results, and thus, statistical significance is irrelevant in applied research. Implicit in this criticism is the assumption that statistical analysis is required for the detection of small effects, but not necessary for the detection of large effects (McReynolds & Kearns, 1983). However, clinical sig- nificance and statistical significance are two quite different ways ofjudging experimental outcomes. Clinical significance is concerned with the size of the observed effect. while statis- tical significance is concerned with the source ofthe effect. An effect large enough to be ofclinical interest may well have been caused by an extraneous variable. For this reason all experi- ments, including traditional single-subject experiments, re- quire some judgement about the probability that the results reflect a true treatment effect. regardless of the size of the observed effect. Clinical significance is determined by relating the size of the observed treatment effect to the effect size that can be expected based on one's knowledge of the clinical population under study. Often the effect will not be judged to be clinically significant unless it is fairly large. However, there are cases when small effects are of clinical interest. For example. a researcher comparing the relative effectiveness of the individ- ual components of a treatment program may expect the pro- gram components to have relatively small effects when applied individually. Another experimenter may conclude that a small Human Communication Canada/Communication Humaine Canada, VoL 12, No. 4, December 1988 7
  • 2. advantage ofone treatmenttechnique over another is clinically significant when the superior treatment is less costly to apply than the inferior treatment. Internal Validity in Multiple-Subject Designs Clinically significant effect sizes are ofno interest unless it can be shown thatthe observed effect is caused by the treatment. In other words, the experiment must be shown to be internally valid. In multiple-subject research, internal validity can be threatened by intersubject variability and by uncontrolled ex- traneous variables which are associated with the environment. The basis for control of intersubject variability is random assignment of subjects to groups. This procedure does not, as is commonly believed, "equalize" the groups with respect to subject variables; rather, random assignment satisfies one of the primary assumptions underlying the use of statistical tests. In fact. the statistical analysis is predicated on the assumption thatthe groups may be different before the treatment is applied. The purpose of the statistical analysis is to determine the probability of the observed between-group difference occur- ring when the null hypothesis is true. When this probability is low. the researcher assumes that differences between groups are due to the treatment. Statistical analysis does not control for extraneous vari- ables which emanate from the environment. and consequently the researcher must take every precaution to ensure that such variables areheldconstant across groups oreliminatedentirely. For example, when studying a treatment designed to improve reading ability, both control and treatment subjects must re- ceive their reading test under identical lighting conditions. Internal Validity in Traditional Single-Subject Experiments While intersubject variability is not an issue in single-subject experiments, other sources of extraneous variation can pose a serious threat to internal validity. The first technique used to control for this kind ofvariation is the establishment ofa stable baseline. When a stable baseline has been obtained, it is assumed that sources of extraneous variation have been brought under control, and that the subject will experience the same extraneous variables during the treatment phase as were experienced during the baseline phase. In addition, treatment and no-treatment phases are se- quencedovertimeinordertodemonstrateexperimental control ofthe dependent variable. Ifchanges in the dependent variable are coincident with introduction of the treatment on more than one occasion, then the researcher can be reasonably confident that the observed effect is due to the treatment manipulation (McReynolds & Thompson, 1986). Internal Validity in Single-Subject Randomization Designs The designs discussed above are internally valid to the extent that the researcher can be sure that extrinsic extraneous vari- abies have been controlled. In contrast to these designs, ran- domized single-subject designs do not assume that extraneous variables are constant across the treatment and control condi- tions. Rather, these extraneous variables are controlled in a manner similar to the control of intersubject variability in multiple-subject research. First, extraneous variables are as- sumed to be independent of the treatment manipulation. In otherwords, an extraneous variable operating during any given session is assumed to exist regardless of whether the treatment condition orthe controlcondition is applied during thatsession. Secondly, the treatment and control conditions are randomly assigned to sessions, thus allowing for the application of a randomization test to the data. The randomization test yields a numerical probability value which indicates the likelihood of the obtained results occurring when the null hypothesis is true. The size of the resulting probability value determines the researcher's confidence in assuming that the observed effect was caused by the treatment. This is not to say that a researcher using the design should ignore potential sources of extraneous variation. Extraneous variables can seriously undermine the sensitivity of the ran- domization test. Ifsuch sources ofextraneous variation are not controlled, true treatment effects may be masked and go unde- tected. However, a failure to control for all possible sources of extraneous variation does not affect the internal validity ofthe experiment. This paper presents hypothetical examples of single-sub- ject experiments illustrating four different single-subject de- signs.1 Although it is hoped that these examples will give the reader some idea of the potential usefulness of this design for communicative disorders research, the paper does not include sufficientdetail toallow aresearchertoapply any ofthedesigns without first consulting other sources. These other sources. especially Edgington (1987). will give the reader a fuller understanding ofthe logic and assumptions underlying the use of randomization tests, as well as specific instructions for applying randomization tests in different experimental situ- ations. A Completely Randomlzed Design The most basic form of this design is the completely random- ized design in which any assignment of treatment times to treatments is possible (given certain sample size constraints). This design can be used to compare a treatment with no treatment, one treatment with any number ofother treatments, or one component of a treatment program with other compo- 1. The purpose of these hypothetical examples is to demonstrate how the design might be used and to show how the randomization test would be applied to data resulting from similar experiments. I am not suggesting that these designs are the best way to study the problems considered in the examples. Neither am I suggesting that these hypothetical experiments could be conducted without modification. 8 Human Communication Canada/Communication Humaine Canada, Vol. 12, No. 4, December 1988
  • 3. nents of the same program. This design was used to investigate the effect of food colouring on children's behavior (Weiss, Williams, Margen, Abrams, Caan, Citron, Cox, McKibben, Ogar, & Schultz, 1980). This example illustrates how the completely randomized design could be used to test the following hypothesis: a fluency enhancement training procedure will be more effective in reducing dysfluencies than a contingency management proce- dure. In this hypothetical example, the fluency enhancement (FE) treatment involves modelling and reinforcing the use of easy onset, irrespective ofthe presence or absence ofdysfluen- cies in the subject's speech. The contingency management (CM) procedure involves reinforcing fluent utterances and punishing dysfluent utterances while paying no attention to speaking style. The dependent measure is the average number of dysfluencies per minute. In order to apply the completely randomized design to this problem it is necessary to schedule a number of treatment sessions. The number and length of these sessions and the interval oftime separating them will be determined bypractical and theoretical considerations. In this example, six 10 minute sessions are scheduled to occur consecutively over a 1 hour period. Treatment FE is assigned at random to three of the sessions, whiletreatmentCM is assigned to the remaining three sessions.2 The subject is encouraged to converse on a number oftopics while the experimenter applies the treatments accord- ing to the randomly determined sequence shown in Table 1. A tape recording ofthe six sessions is scored, yielding an average number of dysfluencies per minute for each session. Table 1. Hypothetical outcome of a fully randomlzed experiment. Session: Treatment: Score: CM 10 2 FE 8 3 CM 9 3 CM 9 5 FE 7 6 FE 5 Note: CM =contingency management and FE =fluency enhance- ment(seetext for amoredetaileddescription ofthesetreatments). The dependent variable is the mean number of dysfluencies per minute. 2. A researcher may wish to obselVe the effects of each treatment as they occur over time. In this case, each "session" would consist of a longer period oftime (e.g., a week or a month) during-which repeated applications of the treatment (or control condition) and repeated probes would occur. A graphic representation of the data would then show multiple data points per session. For statistical analysis, how- ever, all ofthe data collected during each session would be treated like a single data point. The null hypothesis is that the obtained scores are inde- pendent of the treatment administered at any given time. Ifthe null hypothesis is true, any differences between scores are due to a difference in the times that the treatments were admini- stered, and not to differences in treatment effectiveness. In order to test this hypothesis it is necessary to calculate the test statistic, which in this case, is MCM - MFE for a one-tailed test, or the absolute value of MCM - MFE for a two-tailed test. Since CM is expected to yield higher rates of dysfluency, the test statistic is MCM - MFE =2.67. Next, each possible way of assigning treatments to ses- sions is determined, and the test statistic is calculated for each ofthese possible assignments. In thisexample, there are 61/3!31 = 20 equally probable assignments of treatments to treatment times. These assignments and the associated test statistics are called the reference set and are shown in Table 2. The probabil- ity (P) value associated with the obtained result is the propor- tion of test statistics greater than or equal to the obtained test statistic value3 • Inspection ofTable 2 shows that there is one test statistic equal to or greater than 2.67, and therefore, p = 1/20 = 0,05. Control of Temporal Trends The data shown in Table 1 illustrate a temporal trend: The subject's rate of dysfluency is decreasing over time in a way that does not appear to be dependent on the treatment admini- stered at any given time. This improvement is probably due to the subject's growing familiarity with the experimenterand the experimental situation. This trend also may be due tocarry over of the effects of the treatments from session to session. This kind of temporal trend may occur as a result ofpractice effects, fatigue effects, maturation, or historical factors. Although this kind of consistent trend does not affect the validity ofthe randomization test, it may reduce the sensitivity of the statistical test. Therefore, it is important to schedule the desired number of treatment sessions in a way that will mini- mize the likelihood of such a trend occurring. With respect to the previous example, the treatment sessions could have been scheduled to occur once a week over a six week period. In addition, a different examinercouldhave been assigned to each of the sessions. 3. Although this statistical test can be calculated by hand. randomiza- tion tests are usually performed by computer. The comput(;rprograms necessary for performing randomization tests can be found in Edging- ton (1987). The specific programs used to determine the p values for the first three examples were Program 4.4 for the completely random- ized design. Program 4.2 for the randomized block design, and Program 6,1 for the factorial design. These programs were developed for use with multiple-subject designs but are equally appropriate for use with single-subjectdata. Acomputerprogram. written in Basic, for calculating the test used in the last example can be obtained from the author. Human Communication Canada/Communication Humaine Canada. Vol. 12, No. 4. December 1988 9
  • 4. Table 2. Reference set for example 1. Test Session: 1 2 3 4 5 6 Statistic Score: 10 8 9 9 7 5 1. CM CM CM FE FE FE 2.000 2. CM CM FE CM FE FE 2.000 3. CM CM FE FE CM FE .667 4. CM CM FE FE FE CM -.667 5. CM FE CM CM FE FE 2.667' 6. CM FE CM FE CM FE 1.330 7. CM FE CM FE FE CM 0.000 8. CM FE FE CM CM FE 1.330 9. CM FE FE CM FE CM 0.000 10. CM FE FE FE CM CM -1.330 11. FE CM CM CM FE FE 1.330 12. FE CM CM FE CM FE 0.000 13. FE CM CM FE FE CM -1.330 14. FE CM FE CM CM FE 0.000 15. FE CM FE CM FE CM -1.330 16. FE CM FE FE CM CM -2.667 17. FE FE CM CM CM FE .667 18. FE FE CM CM FE CM -.667 19. FE FE CM FE CM CM -2.000 20. FE FE FE CM CM CM -2.000 'This line shows the actual assignment of treatments to sessions and the obtained test statistic value. Randomized Block Design An alternative to the completely randomized design which provides greatercontrol ofsystematic variation overtime is the randomized block design. This design involves dividing the total number of treatment sessions into blocks, and then ad- ministering all of the treatments within each block. The order in which the treatments are administered is randomly deter- mined for each individual block. Smith (1963) used this design (with adifferent statistical analysis) to study the effects ofthree drugs on narcolepsy. This example illustrates how this design could be used to study the relative effects ofdifferent language stimulation techniques. In the following hypothetical example, three different language stimulation techniques will be used with a young, language-delayed child: (I) providing social reinforcement contingent upon correct imitations (IM) ofsingle-words in the presence of an appropriate model and stimulus object; (2) providing parallel talk (PT) at the single-word level while observing the child at play with a variety of objects; and (3) playing turn-taking (TT) games with the child in which the examiner follows the child's lead while providing appropriate verbal models when taking his or her turn. The dependent measure is a count of the number ofdifferent words spoken by the child during each session. Treatment sessions are scheduled for each Monday, Wednesday, and Friday morning over a 4 week period. Each week of sessions constitutes a block, and each of the 3 days is assigned, atrandom, tooneofthe three treatments. Thisrandom assignment of days to treatments is made individually for each block, yielding the sequence of treatments shown in Table 3. The number of new words spoken during each session also is shown. These data clearly demonstrate a temporal trend which could be due to maturation on the part of the child and the cumulative effects of the treatments over time. However, the particular random assignment used assures that the effects of this trend are more or less equal for each of the three treatments and allows for statistical control of this trend. This design is analogous to a repeated measures design in which four subjects receive each of three treatments, and therefore, the appropriate test statistic is F for repeated meas- ures analysis ofvariance. For this example, F =4.69. There are (3!)4 =1,296 equally probable assignments, 36 of which yield a test statistic greater than or equal to 4.69; therefore, p = 0.03. Factorial Design The development of phonological process treatment ap- proaches has led to a resurgence of interest in minimal pair contrasting and auditory bombardment as techniques for the remediation of speech sound errors (Tyler, Edwards, & Saxman, 1987). The single-subject randomization design could be used to study both ofthese treatmentvariables with the same subject. In this hypothetical example, a subject who presents with fricative stopping is scheduled to participate in two half-hour treatment sessions per week over a 6 week period. Each session consists of the following activities: (1) a pre-treatment probe which measures the proportion ofstopped fricatives observed during a picture discussion task; (2) audi- tory bombardment with stimuli which are either appropriate (Auditory Bombardment Treatment; ABT) or inappropriate (Auditory Bombardment - Control; ABC), given the target process; (3) phonological process therapy using a minimal pairs technique (Therapy - Treatment; THT), or articulation therapy using traditional techniques (Therapy - Control; THC); and finally, (4) a post-treatment probe. Six of the treatment sessions are randomly assigned to the ABTcondition while the remaining sessions are assignedto the 10 Human Communication Canada/Communication Humaine Canada. Vol. 12. No. 4. December 1988
  • 5. Table 3 Hypothetical outcome of a randomlzed block experiment. Block (Week): Block 1 Block 2 Block 3 Block 4 Day: M W F M W F M W F M W F Treatment: IM PT IT PT IM IT IM IT PT IT IM PT Score: 1 3 7 5 6 8 7 10 9 12 10 12 Note: M=Monday, W=Wednesday, F=Friday, IM =imitation with reinforcement, PT =parallel talk, IT =turn-taking games (see text for amore detailed description of these treatments). The dependent variable is the number of different words spoken by the child during the session. ABC procedure. Next, three ofthe ABT sessions are randomly assigned to THT, and the remaining three ABT sessions are assigned to the THC procedure. This process is then repeated with the six ABC sessions. One possible outcome of this random assignmentprocedure is shown in Table 4. Table4 also shows the hypothetical results of this experiment. it is expected that the traditional procedure will provide the larger measurements, indicating less improvement in phonol- ogical ability (see Edgington (1987) for a more detailed discus- sion of test statistics for factorial randomization designs). The number of test statistics in the reference set is the number of possible assignments for the ABT condition, times the number Table 4. Hypothetical outcome of a 2 x 2 factorial experiment. Session: 1 2 3 4 5 6 7 8 9 10 11 12 Variable 1: ABC ABT ABT ABC ABC ABC ABT ABT ABT ABT ABC ABC Variable 2: THC THT THT THT THC THT THT THC THC THC THT THC Pre-test: .10 .10 .10 .20 .25 .30 .30 .40 .45 .50 .50 .60 Post·test: .30 .20 .20 .50 .40 .50 .40 .55 .60 .70 .90 1.00 Difference Score: .20 .10 .10 .30 .15 .20 .10 .15 .15 .20 .40 .40 Note:ABT=auditorybombardment-treatment(auditorybomardmentwHh stimulithatcontain thetargetphoneme), ABC =auditorybombardment -control (auditory bombardment with stimuli that do not contain the target phoneme), THT =therapy -treatment (minimal pairs training), THC = therapy -control (traditional articulation therapy). The dependent variable is 1-the proportion of stopped fricatives in aspeech sample. Since a consistent improvement in probe scores can be ex- pected to occur over the course ofthis experiment, the depend- ent measure is the difference between the post- and pre-treat- ment probe scores for each session. Table 5 shows these difference scores rearranged into cells representing the four possible combinations of treatment conditions. As with a traditional factorial design, we can now test for the main effect of each of the variables over all levels of the other variable. For example, we could compare the effects of the speech therapy procedures overbothtypes ofauditorybom- bardment. Foraone-tailed test, the test statistic is the total ofthe measurements in the second row of the table, or 1.25, because of possible assignments for the ABC condition (Le., 6!/3!3! x 6!/3!3! 20 x 20 =400). For this example, the null hypothesis is accepted because p = 0.32, one-tailed. The statistical test used for the completely randomized design can be applied to these data to compare levels of either variable within any level of the other variable. For example, in order to examine the effect of the auditory bombardment variable for the minimal pairs training sessions, the test de- scribed for the first example above would be applied to the six measurements shown in the top row ofTable 5. In this case the test statistic is 0.27 -0.10 =0.17, because the ABC condition is expected to provide larger measurements than the ABT condi- Human Communication CanadalCommunication Humaine Canada, Vol. 12. No. 4. December 1988 11
  • 6. Table 5. Hypothetical factorial experimental data arranged for statistical analysis. Auditory Bombardment Minimal Pairs Training (THT) Traditional Therapy (THC) Control (ABC) 0.20 0.20 0.40 M= 0.27 0.20 0.15 0.40 M= 0.25 Treatment (ABT) 0.10 0.10 0.10 M= 0.10 0.15 0.15 0.20 M 0.17 tion. There are 6!/3!3! == 20 equally probably assignments, and only one of these yields a test statistic value equal to or greater than 0.17. Therefore, p =1/20 =0.05, one-tailed, and the null hypothesis is rejected. Test for Treatment Intervention This design is superficially similar to the non-experimental AB single-subject design: Initially, the subject's performance on the dependant measure is monitored over a period of time during which no treatment is administered; then the treatment is introduced and maintained over a number of sessions, while monitoring of the subject's performance on the dependent measure continues. The subject's performance during treat- ment sessions is compared with his or her performance during control sessions. Usually, the treatment is introduced when the subject's performance during control sessions has stabilized.This proce- dure does not allow for statistical analysis of the data because the assignment oftreatment sessions to the control or treatment condition is non-random. However, ifthe decision to introduce the treatment is made by randomly selecting the session during which this will occur, a randomization test can be applied to the data, and the design becomes fully experimental. This design is especially useful when the treatment under study is expected to produce permanent, or relatively perma- nent, effects which would carry over to control sessions. For this reason, this design was chosen to test the hypothesis that a sound identification training procedure would facilitate sound production learning by children with functional articulation errors (specifically, the substitution ofIslfor If/ or the substitu- tion ofIfj/ for Is/). Although this experiment has been carried out and statistically significant results were obtained, the fol- Table 6. Hypothetical outcome of a test for treatment intervention. Session: 1 2 3 4 5 6 7 8 9 10 Score: 10 10 40 20 10 10 30 10 20 30 Session: 11 12 13 14 15 16 17 18 19 20 Score: セ@ セ@ セ@ セ@ セ@ セ@ セqq@ セ@ QQ Session: 21 22 23 24 25 26 27 28 29 30 Score: QQ QQ QQ QQ IQ aoao IQ !ill セ@ Note: Underlined scores were obtained during treatment sessions, while the other scores were obtained during control sessions. lowing example uses hypothetical data in order to simplify the demonstration.4 Each treatment session lasted no longer than ten minutes and consisted of repeated sound identification training trials (using either control or treatment stimuli) followed by a 10 item, imitative production probe. Three 1 hour periods, sched- uled tooccuronconsecutivedays, were required tocomplete 30 such treatment sessions. The first five sessions were reserved for the control condition, and the last five sessions were reserved for the treatment condition. The starting session for treatment intervention was chosen randomly from among ses- sions 6 to 25. The hypothetical results of this experiment are shown in Table 6. For this example, the control procedure was admini- stered during sessions 1 through 10, and the treatment proce- dure was administered during sessions 11 through 30. The nurnber ofcorrectproductions ofthe target phoneme during the production probe are shown for each session. The measures obtained during treatment sessions are underlined. The one-tailed test statistic is the difference between the mean probe score for treatment sessions and the mean probe score for control sessions, which in this case is 5.75 1.90 = 3.85. This test statistic was calculated for each of the 20 possible assignments of sessions to treatments. Only one test statistic in the reference set is equal to or greater than 3.85, and consequently p = 1/20 =0.05, one-tailed. 4. A detailed description of this study is currently being prepared for publication, More infonnation about the sound identification training procedure and the actual results of the study can be obtained from Dr. D, G. Jamieson, Speech Communication Laboratory, Department of Communicative Disorders, Elborn College, University of Western Ontario, London, Ontario, N6G IHI, or from the author. 12 Human Communication Canada/Communication Humaine Canada. Vol. 12, No. 4, December 1988
  • 7. Conclusion Recently the difficulties inherent in the application of basic, traditional single-subject designs have been discussed, and the need for flexibility in the use ofsingle-subject designs has been noted (Connell &Thompson, 1986; Keams, 1986). The single- subject randomization design adds to the flexibility of single- subject designs. It can be used in any situation where the traditional single-subjectdesign might be applied. It alsocan be used in situations where the traditional designs would be difficult to apply (e.g., a factorial single-subject experiment or an experiment in which the treatment has irreversible effects). The examples discussed above are only some ofmany possible randomized single-subject designs. In fact, a randomization test can be applied to any conceivable single-subject experi- ment in which there is random assignment oftreatment times to treatments. Further information and additional examples can be found in Edgington (1984), Edgington (1987), Kazden (1976), and Levin, Marascuito, and Hubert (1978). Address all correspondence to: Susan Rvachew Speech-Language Department, Alberta Children's Hospital 1820 Richmond Rd. S.W. Calgary, Alberta, T2T 5C7 Acknowledgements I am grateful to Dr. Edgington (Department of Psychology, University of Calgary) for his comments on this manuscript. References Connell, P. J. & Thompson, C. K. (1986). Flexibility ofsingle-subject experimental designs. Part Ill: Using flexibility to design or modify experiments. Journal ofSpeech andHearing Disorders. 51, 214-225. Edgington, E. S. (1984). Statistics and single case analysis. In M. Hersen, R. M. Eisler, & P. Miller (Eds.). Progress in Behavior Modification, (pp. 83-119. VoI.16). New York: Academic Press, Inc.. Edgington, E. S. (1987). Randomization Tests (2nd edition). New York: Marcel Dekker, Inc. Kazdin, A. E. (1976). Statistical analyses for single-caseexperimental designs. In M. Hersen & D. H. Barlow (Eds.). Single-case Experimen- tal Designs: StrategiesforStudying BehaviorChange. Oxford: Perga- mono Kearns, K. P. (1986). Flexibility of single-subject experimental de- signs. Part 11: Design selection and arrangement of experimental phases. Journal ofSpeech and Hearing Disorders. 51, 204-214. Levin, J. R., Marascuito, L. A., & Hubert, L. 1. (1978) Nonparametric randomization tests. In T. R. Kratochwill, (Ed.), Single Subject Re- search: Strategies for Evaluating Change. New York: Academic Press. McReynolds, L. V_, & Kearns, K. (1983). Single-subject experimental designs in communicative disorders. Austin, Texas: Pro-Ed. McReynolds, L. V. & Thompson, C. K. (1986). Flexibility of single- subject experimental designs. Part I: Review of the basics of single- subject designs. Journal ofSpeech and Hearing Disorders. 51, 194- 203. Smith, C M. (1963). Controlled observations on the single case. Canadian Medical Association Journal, 88, 410-412. Tyler, A. A., Edwards, M. L., & Saxman, J. H. (1987). Clinical applications of two phonologically based treatment procedures. Jour- nal ofSpeech and Hearing Disorders, 52, 393-409. Weiss, B., Williams, J. H., Margen, S., Abrams, B., Caan, B., Citron, L. 1., Cox, C, McKibben, l., Ogar, D., & Schultz, S. (1980). Behav- ioral responses to artificial food colors. Science. 297, 1487-1489. Human Communication Canada/Communication Humaine Canada. Vol. 12. No. 4. December 1988 13