SlideShare a Scribd company logo
1 of 98
Advance Clinical Practice II
Group A Wiki Timeline/Assignment
Description of the family system:
Case Study: Michelle Due: Dec 21
Family System: Father: Tom Smith (42) Mother: Tina (42)
Children: Tom Jr. (16), Paul (13), Lucy (5). Presenting problem:
Family of 5 enter treatment because parents announced they are
getting divorced. Children are upset.
Scope of the Issue:
Ellis
Engagement & Assessment:
Cynthia, Daniel
Literature Review:
Michelle, Tiffany
Interventions:
Michelle, Tiffany
Advantages and Disadvantages of Interventions:
Cynthia, Ellis
Recommendations for treatment:
Tiffany, Daniel
Evaluation:
Cynthia, Daniel
References:
Cynthia, Michelle, Tiffany, Ellis, Daniel
Additional Suspense:
APA Template hung NLT Dec 16th
Rough draft due by week 7, NLT Jan 13th.
Final draft due by week, NLT Jan 27th.
All group members will be responsible for editing,
proofreading, and adding additional information where needed
to strengthen other sections of the Group Project.
Assignment 2: Assessing Group Process 1
Reflection and self-awareness are important exercises when
practicing as a clinical social worker. Journaling is not only
useful for clients, but it is a useful exercise for social workers
in clinical practice. Understanding one’s own comfort levels is
part of practicing as a competent social worker.
· Reflect on your experience so far in starting the Group Wiki
Project. – I had shoulder surgery on 12/12/2018 and was slow to
get started due to not being able to type, recovering, and on
medication. I was able to communicate with Cynthia and be
added to duties on the timeline. My responsibilities in the group
project are doing the engagement and assessment;
recommendations for treatment; and evaluation. Most of my
group members came up with the following family scenario:
Case Study: Michelle Due: Dec 21
Family System: Father: Tom Smith (42) Mother: Tina (42)
Children: Tom Jr. (16), Paul (13), Lucy (5). Presenting problem:
Family of 5 enter treatment because parents announced they are
getting divorced. Children are upset.
· Describe how your group initiated contact and your level of
comfort in working on a project with a group online. – It feels
odd to me to have to work as a group online without seeing
group members face to face. Our group initiated contact via
email and phone texting.
· Discuss the advantages and disadvantages of completing this
project as a group. - Some disadvantages are having to accept
other people’s ideas whether you agree or like it or not, having
to wait on other people to complete their part of the project; and
trying to bring everyone together at the same time for
collaborations. Some of the advantages are that you are not
having to do all the work of the project yourself and you will
have access to different ideas and experiences from group
members.
Group Process Assignments should integrate course concepts
related to group process. Assignments should demonstrate
critical thought when applying course material to your group
experience. Support ideas in your Assignment with
APA citations from this week's required resources (required
resources list below).
Submit your Assignment (3 pages).
Required Resources
Wheeler, D. P., & Bragin, M. (2007). Bringing it all back home:
Social work and the challenge of returning veterans. Health &
Social Work, 32(4), 297–300. (ATTACHED)
Mullen, E. J., Bledsoe, S. E., & Bellamy, J. L. (2008).
Implementing evidence-based social work practice. Research on
Social Work Practice, 18(4), 325–338. (ATTACHED)
Rhubric/Grading CriteriaContent Accuracy and Application--
Excellent 36 (36%) - 40 (40%)
Content includes excellent answers, specific to the questions
asked and issues presented, and additional overview information
on the topic. All information is accurate; all facts are precise
and explicit. A clear connection to the concepts presented in
readings and resources is applied to the journal.
Good 32 (32%) - 35.96 (35.96%)
Content includes answers specific to the questions asked and
issues presented, and additional overview information on the
topic. Information is mostly accurate; most facts are precise and
explicit. A few of the concepts from the readings and resources
are applied to the journal.
Fair 28 (28%) - 31.96 (31.96%)
Content includes some answers specific to the questions asked
and issues presented, but little additional overview information
on the topic. Information is somewhat accurate; some facts are
precise and explicit. Some concepts from the readings and
resources are applied to the journal.
Poor 0 (0%) - 27.96 (27.96%)
Content does not include answers specific to the questions
asked and issues presented or additional overview information
on the topic. Information is inaccurate; facts are not precise and
explicit. None of the concepts from the readings and resources
was mentioned or applied to the journal.Critical Thinking and
Reflection--
Excellent 36 (36%) - 40 (40%)
Content demonstrates a high level of critical thinking and
understanding of personal perspective. Student demonstrates a
proficiency in assessing and articulating personal interactions.
Good 32 (32%) - 35.96 (35.96%)
Content demonstrates a moderate level of critical thinking and
understanding of personal perspective. Student demonstrates
moderate proficiency in assessing and articulating personal
interactions.
Fair 28 (28%) - 31.96 (31.96%)
Content demonstrates some critical thinking and understanding
of personal perspective. Student demonstrates little proficiency
in assessing and articulating personal interactions.
Poor 0 (0%) - 27.96 (27.96%)
Content demonstrates little critical thinking or understanding of
personal perspective. Student demonstrates no proficiency in
assessing and articulating personal interactions.Writing--
Excellent 18 (18%) - 20 (20%)
The Journal is well organized. The format is easy to follow,
flows smoothly from one idea to another, and logically conveys
key ideas. Excellent grammar, spelling, and APA style.
Good 16 (16%) - 17.98 (17.98%)
The Journal is presented in a thoughtful manner, fairly well
organized. Most transitions are easy to follow, but at times
ideas are unclear.
Fair 14 (14%) - 15.98 (15.98%)
The Journal is not presented in a thoughtful manner and is not
very well organized. Some transitions are easy to follow, but at
times ideas are unclear.
Poor 0 (0%) - 13.98 (13.98%)
The Journal is choppy and confusing; format is difficult to
follow; transitions of ideas are abrupt and distracting.
325
Implementing Evidence-Based Social Work Practice
Edward J. Mullen
Columbia University School of Social Work
Sarah E. Bledsoe
University of North Carolina School of Social Work
Jennifer L. Bellamy
Washington University at St. Louis George Warren Brown
School of Social Work
Recently, social work has been influenced by new forms of
practice that hold promise for bringing practice and
research together to strengthen the scientific knowledge base
supporting social work intervention. The most recent
new practice framework is evidence-based practice. However,
although evidence-based practice has many qualities
that might attract social workers to adopt it, use in practice is
limited. Accordingly, attention is being given to deter-
mine effective strategies for the dissemination, adoption, and
implementation of evidence-based practice. This article
examines the implementation literature, describes alternative
strategies for implementation of evidence-based prac-
tice in social work, describes an implementation study to
illustrate concepts discussed, and specifies needed research.
Keywords: evidence-based practice; implementation;
dissemination; social work practice
Social work policy, administration, and direct practice
based on scientific knowledge rather than authority, tradi-
tion, or common sense can lead to better outcomes for
clients. Those doubting this claim need only peruse the
systematic reviews and meta-analyses included in the
Cochrane Collaboration and the Campbell Collaboration
libraries. Also see American Psychological Association
(2005),
A sizeable body of scientific evidence drawn from a variety of
research designs and methodologies attests to the effectiveness
of psychological practices. The research literature on the effect
of psychological interventions indicates that these interventions
are safe and effective for a large number of children and youth
(Weisz, Hawley & Doss, 2004; Kazdin & Weisz, 2003), adults
(Barlow, 2004; Nathan & Gorman, 2002; Roth & Fonagy,
2004; Wampold et al., 1997) and older adults (Zarit & Knight,
1996; Duffy, 1999) across a wide range of psychological,
addictive, health, and relational problems. More recent research
indicates that compared to alternative approaches, such as med-
ications, psychological treatments are particularly enduring
(Hollon, Stewart, & Strunk, in press). Further, research demon-
strates that psychotherapy can and often does pay for itself in
terms of medical costs offset, increased productivity, and life
satisfaction (Chiles, Lambert, & Hatch, 2002; Yates, 1994).
(p. 6)
Unfortunately, available scientific knowledge is too
often underutilized by social workers (Kirk, 1990;
Mullen, in press; Mullen & Bacon, 2004; Weissman &
Sanderson, 2001). The gap between what has been
learned through scientific research and what is used in
social work policy, administration, and direct practice
has been a concern throughout social work’s modern
history (Hess & Mullen, 1995; Kirk & Reid, 2002).
This gap is not found only in social work, but it is also
a troubling situation throughout the health and human
services. It is widely recognized that there is a discrep-
ancy between what research has demonstrated to be
effective and what is actually found to be occurring in
practice (Fixsen, Naoom, Blase, Friedman, & Wallace,
2005; Panzano & Herman, 2005; Torrey & Gorman,
2005). In the influential report Bridging Science and
Service, the U.S. National Advisory Mental Health
Council concluded that
Authors’ Note: This work was supported in part by the National
Institute of
Mental Health Training Grant 5T32MH014623 (S. E. Bledsoe, J.
Bellamy, J.
Manuel) and the Willma and Albert Musher Program at
Columbia University.
Portions of this article were presented at the University of
Texas School of
Social Work National Symposium titled Improving the Teaching
of Evidence-
based Practice, October 16 to 18, 2006, Austin, Texas.
Correspondence con-
cerning this article should be addressed to Edward J. Mullen,
Columbia
University School of Social Work, 1225 Amsterdam Ave., New
York, NY
10027; e-mail: [email protected]
Research on Social Work Practice, Vol. 18 No. 4, July 2008
325-338
DOI: 10.1177/1049731506297827
© 2008 Sage Publications
326 RESEARCH ON SOCIAL WORK PRACTICE
many people are unable to obtain, for themselves or for one
close to them, appropriate, state-of-the-art treatment for a
mental illness. All too often, clinical practices and service
system innovations that are validated by research are not fully
adopted in treatment settings and service systems for individ-
uals with mental illnesses. The substantial disparity between
what is known through research and what is actually provided
in routine care is not limited to mental illnesses. (National
Institute of Mental Health [NIMH], 1999, p. 7)
This gap has been identified again in the recent NIMH
report The Road Ahead, when it notes,
Simply creating an inventory of evidence-based treatments
will not result in their broad implementation in practice. In
fact, it has been well documented that, for various reasons,
health care delivery systems do not implement interventions
that have been shown to be effective in a small number of
settings and were published in journal articles. A key question
the Workgroup grappled with was, how can NIMH enhance
the likelihood that effective interventions are implemented
and sustained in real-world settings? (U.S. Department of
Health and Human Services, 2006, p. 7)
In recent years, social work has been influenced by
new forms of practice that hold promise for bringing
practice and research together so as to strengthen the sci-
entific knowledge base supporting social work interven-
tion. The most recent of these new practice frameworks is
evidence-based practice (EBP). However, although EBP
has many qualities that might attract social workers to
adopt it as a practice framework, its current use in prac-
tice is limited (Mullen & Bacon, 2004). Accordingly,
increased attention is being given to determine effective
strategies for the dissemination, adoption, and implemen-
tation of EBP in social work practice. This article exam-
ines the implementation literature, describes alternative
strategies for the implementation of EBP in social work
practice, describes a pilot implementation study we have
recently completed to illustrate concepts discussed, and
specifies needed research.
Because EBP is a new practice framework that is
poorly understood by social work educators and practi-
tioners, we first describe what is meant by EBP
(Bledsoe et al., in press; Mullen & Bacon, 2004; Rubin
& Parrish, in press; Weissman et al., 2006).
EBP, EMPIRICALLY SUPPORTED
INTERVENTIONS (ESIS), AND
PRACTICE GUIDELINES
Evidence-based practice, empirically supported inter-
ventions (also called empirically informed interventions
and evidence-based practices), and practice guidelines
are terms that are frequently, although inappropriately,
interchangeably used (Rubin & Parrish, in press). This is
unfortunate because each refers to distinctly different
ideas. Different implementation strategies apply depend-
ing on which of these innovations are referenced. Before
discussing implementation strategies, this section briefly
describes each of these concepts.
EBP1
EBP is a way of doing practice—a way of assessing,
intervening, and evaluating based on a set of assumptions
and values. EBP was originally developed in medicine as
a way of training medical residents for a new form of med-
ical practice (Evidence-Based Medicine Working Group,
1992; Sackett, Rosenberg, Gray, Haynes, & Richardson,
1996; Straus, Richardson, Glasziou, & Haynes, 2005).
The original emphasis was on teaching medical residents
critical-assessment skills so as to strengthen the scientific
base used by physicians in decision making. During the
past decade, EBP has received widespread attention
throughout the health care professions (Gray, 2001).
As described by Mills, Montori, and Guyatt (2004),
Although the concepts of evidence based medicine (EBM)
have been developing since clinical trial publications became
available—the formal construct of devising a clinical question
and searching available evidence with a critical eye toward
applying it to patient problems has evolved in the last 20
years—the term evidence-based medicine first appeared in a
description of the McMaster University internal medicine res-
idency program—and the first published use of this term was
in 1991 (Guyatt, 1991).
Subsequently, the Journal of the American Medical
Association published a series of 32 articles entitled User’s
Guides that made available the fundamental concepts of
EBP—and were followed by a number of texts that further
developed these principles. (pp. 188-189)
Because of its origin in health care, the language used
to describe EBP reflects the health care fields of prac-
tice. Three highly compatible definitions of EBP are,
the conscientious, explicit, and judicious use of current best
evidence in making decisions about the care of individual
patients. (Sackett et al., 1996, p. 71)
the integration of best research evidence with clinical expertise
and patient values. (Sackett, Straus, Richardson, Rosenberg, &
Haynes, 2000, p. 1)
the integration of best research evidence with clinical exper-
tise, and patient values. Where:
Best research evidence refers to clinically relevant research,
often from the basic health and medical sciences, but especially
from patient-centered clinical research into the accuracy and
Mullen et al. / IMPLEMENTING EVIDENCE-BASED
PRACTICE 327
precision of diagnostic tests (including the clinical examina-
tion); the power of prognostic markers; and the efficacy and
safety of therapeutic, rehabilitative, and preventive regimens.
Clinical expertise means the ability to use clinical skills
and past experience to rapidly identify each patient’s unique
health state and diagnosis, individual risks and benefits of
potential interventions, and personal values and expectations.
Patient values refers to the unique preferences, concerns,
and expectations that each patient brings to a clinical encounter
and that must be integrated into clinical decisions if they are to
serve the patient. (Institute of Medicine, 2000, p. 147)
EBP is typically described as involving six steps
(Gibbs, 2003; Sackett et al., 2000; Straus et al., 2005).
In the real practice world, however, these steps may not
be pursued in the following order:
1. Convert information needs into an answerable question. An
initial assessment of the client must be done to determine
what questions are important. The assessment should be
used as a basis for a well-formulated question that must be
not only answerable but also phrased in a way that a search
of existing research literature can be conducted to answer
this question. The question can be about assessment,
description, prevention, or intervention.
2. Track down the best evidence to answer the question.
3. Critically appraise the evidence for its validity (closeness
to the truth), impact (size of the effect), and applicability
(usefulness in practice).
4. Integrate the critical appraisal with practice experience
and client’s strengths, values, and circumstances.
5. Evaluate effectiveness and efficiency in exercising Steps
1 to 4 and seek ways to improve on them next time.
6. Teach others to follow the same process.
At each step in the process, the practitioner’s expertise,
experience, and constraints (e.g., practical, financial, eth-
ical) are considered together with practitioner and client
values and preferences.
This approach has been adopted by many of the
health care professions. It has been adapted for use in
health care policy, procurement, and management where
the focus is on populations rather than individual clients.
J. A. Muir Gray (2001, xxi—xxiii) proposes that there
are three key steps in evidence-based health care: find-
ing and appraising the evidence, developing the capac-
ity of individuals and organizations to use the evidence
wisely, and getting the evidence into practice.
ESIs
ESIs are specific interventions (e.g., assessment instru-
ments, treatment and prevention protocols, etc.) deter-
mined to have a reasonable degree of empirical support
(e.g., two randomized, controlled clinical trials conducted
by different investigatory teams; Chambless et al., 1996;
Chambless et al., 1998; Roth & Fonagy, 2004). In health
and mental health, ESIs most often are called EBPs or
empirically supported treatments (Bledsoe et al., in press;
Drake, Merrens, & Lynde, 2005; Weissman et al., 2006).
At times they are called empirically informed interven-
tions. To avoid confusion, we adopt the term ESIs in the
remainder of this article, intending to encompass the terms
EBP and empirically supported or informed treatments.
It is important to realize that EBP and ESIs are com-
plimentary when brought together. Fundamentally, EBP
is a process that includes finding empirical evidence
regarding the effectiveness and/or efficiency of various
intervention options (or for assessment instruments their
psychometric properties) and then determining the rele-
vance of those options to specific client conditions, cir-
cumstances, and preferences. The search process should
result in the identification of ESIs when they exist. This
information is then critically considered in making the
final intervention plan.
There are a growing number of ESIs relevant to social
work. For example, there are now approximately 20 psy-
chotherapies for the treatment of psychiatric disorders for
which there is clear evidence of efficacy for specific prob-
lems or populations (Roth & Fonagy, 2004). There is also
a range of community mental health programs that have
empirical support for beneficial effects with the severely
mentally ill (Drake et al., 2005). Since the early 1990s,
various efforts have been made to systematically examine
the empirical evidence supporting interventions and to
classify the level and strength of this evidence. Many
interventions of relevance to social work practice are now
known to be efficacious, and for some there is effective-
ness evidence. Attention has now turned to how to imple-
ment these in routine social work practice as discussed
below.
Practice Guidelines
Related to the efforts to classify practices by level and
strength of empirical support is a parallel development—
the publication of practice guidelines—sometimes called
best practices. These practice guidelines are described by
the Institute of Medicine as “systematically developed
statements to assist practitioner and patient decisions about
appropriate health care for specific clinical circumstances”
(Field & Lohr, 1990, p. 38).
Since the early 1990s, professional organizations and
government agencies have formulated practice guidelines
for various clinical conditions such as depression and schiz-
ophrenia (American Academy of Child and Adolescent
Psychiatry, 1998; American Psychiatric Association, 1993,
1994, 1997; US Preventive Services Task Force, 2002).
These guidelines prescribe how practitioners should
assess and treat clients. Sometimes the guidelines are
328 RESEARCH ON SOCIAL WORK PRACTICE
based on research findings, sometimes not; that is, often
research studies are not available, and, therefore, the
guidelines are based on “professional consensus.” Rosen
and Proctor (2003) provide a review of practice guide-
lines in social work. Recent research indicates that prac-
tice guidelines are not yet widely used in routine social
work practice (Mullen & Bacon, 2004). Accordingly, as
with ESIs, attention is now turning to dissemination and
implementation strategies.
IMPLEMENTATION
In this section, we describe the context of implemen-
tation, we distinguish between dissemination and imple-
mentation, we describe strategies for dissemination and
implementation of EBP and ESIs, and we conclude with
comments on what is reported regarding the effective-
ness of implementation strategies, including attempts to
specify explanatory concepts and processes.
Implementation in Context
Knowledge creation, diffusion, utilization, and imple-
mentation as areas of study and application were exten-
sively developed in the last half of the 20th century
(Glaser, Abelson, & Garrison, 1983; Rogers, 1995). It
was in this larger framework that much of the work on
implementation theory and research was developed in
social work (Rothman & Thomas, 1993). Now, imple-
mentation can be considered to be one component of a
larger area of study sometimes referred to as knowledge
management, a discipline that has emerged focusing on
how organizations can generate, communicate, and
leverage their intellectual assets (Harvard Business
Review, 1998). Rogers (1995) considers any idea, object,
or practice perceived as new by organizational stake-
holders as an innovation. Because EBP and ESIs can be
considered innovations when applied to social work,
valuable insights can be gained from the extensive
literature examining implementation of innovations. Accord-
ingly, there is an extensive literature pertaining to the
adoption, diffusion, utilization, and implementation of
innovations to draw on when considering how EBP and
ESIs might be effectively implemented in social work
(Rogers, 1995).
Distinguishing Between Dissemination
and Implementation
In this article, we are most interested in the implemen-
tation of EBP and ESIs. However, there is a close link
between efforts to disseminate and efforts to implement
EBP and ESIs. Although this article focuses on implemen-
tation, because of the close link with dissemination, we
comment on dissemination to provide a broader context.
An NIMH (2005) program announcement calling for
research on dissemination and implementation of EBP
(including ESIs and practice guidelines) clarifies how
these two processes differ. That announcement describes
dissemination as the targeted distribution of information
and intervention materials to a specific practice audience.
The intent is to spread knowledge and the associated
interventions. Implementation, in contrast, is described as
the use of strategies to introduce or change interventions
within specific settings. Implementation efforts must go
beyond dissemination if they are to penetrate and change
service delivery practices. Previous efforts in dissemina-
tion research have often been carried out under the
assumption that interventions can be transferred into ser-
vice settings without modification and that a unidirec-
tional flow of information (e.g., publishing a guideline or
manual) is sufficient to achieve practice change. Success
of the transfer has been largely assessed based on struc-
tural measures (e.g., counts of personnel or contacts) or
other outcome measures that do not specifically assess
how the intervention was implemented or whether the
implementation maintained fidelity to the original con-
ceptualization and intent of the intervention. How inter-
ventions or models of practice can be transported to
real-world practice settings is an implementation ques-
tion. Conceptual frameworks that take into account the
resources of local settings and the needs of multiple
stakeholders are required to create and monitor success-
ful implementation strategies.
Unfortunately, to date, efforts made to develop and
test the outcomes of interventions far outweigh efforts
to determine effective strategies for implementation of
these interventions in practice contexts (Corrigan,
Steiner, McCracken, Blaser, & Barr, 2001).
STRATEGIES FOR DISSEMINATION
AND IMPLEMENTATION
Previously, we have described five broad strategies
for dissemination and implementation of EBP and ESIs:
(a) the teaching model, (b) direct implementation of
ESIs, (c) a model combining evidence and stakeholder
consensus, (d) combining staff training and organiza-
tional development, and (e) development of professional
infrastructure as agent (Mullen, Bellamy, & Bledsoe,
2005). Next, each of these is described as adapted from
Mullen et al. (2005).
Mullen et al. / IMPLEMENTING EVIDENCE-BASED
PRACTICE 329
Teaching Model
The EBP framework described above stresses an
approach to implementation that primarily relies on teach-
ing individual practitioners the evidence-based process in
the context of formal education. Emphasis is on enhanc-
ing professional motivation to engage in lifetime learning
and the teaching of necessary learning and application
skills. As described above, this model is most often
applied to individuals wishing to learn the process of EBP.
As previously stated, this evidence-based approach first
emerged as the clinical problem-based learning strategy
that had been developed during the 1970s and 1980s at the
McMaster Medical School (Evidence-Based Medicine
Working Group, 1992; Guyatt, 1991; Rosenberg &
Donald, 1995). This approach involves teaching individ-
ual professionals specific skills to convert information
needs into search questions, to conduct efficient evi-
dence searches, to correctly appraise evidence quality and
strength, to integrate the information found, to self-evaluate
how well the prior steps were conducted and methods for
improving these steps in the future, and to teach others
how to do EBP. More recently, emphasis has been placed
on teaching skills for the integration of information from
research evidence, client preferences and actions, and
knowledge of the client’s state and circumstances. In addi-
tion when practitioner motivation for engaging in EBP is
absent, a first step in the teaching process is enhancing
motivation for EBP. In social work, this approach is
reflected in the work of Gambrill (2006) and Gibbs
(2003). In these approaches, students and professionals
are taught critical thinking and EBP knowledge, attitudes,
and skills.
Implementation of EBP is seen as closely intertwined
with the use of effective teaching methods. Accordingly,
in the classic evidence-based medicine text Evidence-
Based Medicine: How to Practice and Teach EBM,
Straus et al. (2005) include extensive information about
their experience with effective and ineffective EBP
teaching methods. They observe,
From what we’ve done, seen or heard about, we’ve noticed
that although there may be as many ways to teach EBM as
there are teachers, most of these methods fall into one of three
categories or teaching modes: role-modeling evidence-based
care; teaching clinical medicine using evidence; and teaching
specific EBM skills. (p. 200)
Although all three modes reportedly are useful, they
note, “We find that using evidence in our practice and
teaching (Modes 1 and 2) gives us more legitimacy and
realism when we teach our learners about the specific
EBM skills (Mode 3)” (p. 202). Straus et al. describe
techniques for teaching EBP in different settings, cur-
ricula areas, and educational events.
We were struck with Straus et al.’s (2005) observation
that, in spite of the fact that EBM has been taught for
nearly 30 years and that these authors are among the most
experienced of the teachers, little is known (based on
research) about how to effectively teach EBM. In their
introduction to the teaching methods chapter, they write,
We’d like to draw upon high-quality evidence from educa-
tional research to guide our recommendations about what
works and what doesn’t in teaching EBM. However, little
research has been conducted to date on how best we can teach
the knowledge, attitudes, and skills of practicing and teaching
EBM. Thus, the suggestions in this chapter are primarily
based on the teaching experiences we’ve had ourselves or col-
lected from others. (p. 200)
Although Straus et al. discuss variations in teaching
methods depending on setting, this is restricted to teach-
ing medical residents rotating through inpatient services
and outpatient clinics. There is a notable lack of attention
to teaching EBP outside of these formal educational con-
texts, such as in community settings and human service
agencies. It is for this reason that we undertook a small-
scale, exploratory pilot study that sought to implement in
three social service organizations aspects of the teaching
approach to implementation of EBP. In this study, our aim
was to examine the feasibility of teaching experienced
social work professionals the philosophy and process of
EBP in the day-to-day context of organizational practice.
Lessons learned from this experience are incorporated
into our concluding discussion of promising strategies for
implementing EBP in social work.
Direct Implementation of ESIs
A second dissemination and implementation strategy
with widespread support in the United States is some-
times called the Top Down strategy. As noted by Walter,
Nutley, and Davies (2005), two major approaches to dis-
semination and implementation of best practices have
been used, namely, macro and micro, or what we call top-
down and bottom-up strategies. In top-down strategies,
findings are disseminated for use by frontline practition-
ers through agency directives, guidelines, manualized
interventions, accreditation requirements, algorithms,
tool kits, and so forth. In this approach, specialized tools
are developed, such as application kits, manuals, and
guidelines, with the specific purpose of using these tools
while engaging in broad-scale efforts to disseminate and
facilitate local adoption of specific practices that have
been identified without direct initial input from agencies
330 RESEARCH ON SOCIAL WORK PRACTICE
or practitioners. Instead, stakeholder groups are asked to
sign on to and support training in these techniques.
National- and state-level efforts have been under-
taken to disseminate and support implementation of
ESIs (e.g., Carpinello, Rosenberg, Stone, Schwager, &
Felton, 2002; Chorpita et al., 2002; Drake et al., 2001;
Magnabosco, 2006; National Institutes of Health, 2004;
Tanenbaum, 2005). The Implementing Evidence-Based
Practice Project (Mueser, Torrey, Lynde, Singer, &
Drake, 2003) is promoting adoption of six specific EBPs
for assisting mentally ill adults. Magnabosco (2006,
p. 1) reports results of an effort to identify and classify
state-level implementation activities and strategies
employed across the eight states participating in the
Evidence-Based Practices Project. Since 2001, the EBP
Project has been investigating the implementation of
evidence-based mental health practices in state public
mental health systems for adult persons with serious
mental illness. She notes that
a key objective of the Project has been to collect data that help
to better understand barriers and facilitators to the implemen-
tation of ESIs in mental health service delivery, as well as how
stakeholders in community-based and state agencies interact
to implement, achieve and sustain evidence-based service
delivery cultures. (p. 4)
As noted by Magnabosco, the project has yielded “valu-
able insights into implementation strategy characteristics
and effectiveness” (p. 1). Nevertheless, the effectiveness
of the top-down strategy remains to be demonstrated,
especially in the context of social work organizations.
This implementation strategy has been carefully
reviewed by Fixsen et al. (2005). Based on their com-
prehensive review of implementation research, Fixsen
et al. propose that this implementation strategy, to be
successful, should involve identifiable phases, including
(a) exploration and adoption, (b) program installation,
(c) initial implementation, (d) full operation, (e) innova-
tion, and (f) sustainability. They suggest that implemen-
tation should begin with a deliberate and careful
selection of qualified practitioners, training in the core
components of the ESI, continuing consultation and sup-
port as the ESI is being implemented, evaluation of prac-
titioner performance, program evaluation to determine if
intended outcomes are being achieved with the clients
receiving the new ESI, ongoing provision of facilitative
administrative supports needed for implementation, and
purposeful intervention into the environmental systems
to support delivery of the ESI. These core components
are viewed as integrated and compensatory. This means
that should one core component be weak, such as pre-
service training, it is possible that another component
can make up the shortfall, for instance, by increasing
consultation and coaching during service delivery. These
authors view successful implementation to be a function
of interrelated, multilevel influences emanating from the
larger environment, the agency, and the core implemen-
tation components themselves.
Although the effectiveness of the top-down strategy
remains to be demonstrated, especially in the context of
social work organizations, recent work on the availability,
responsiveness and continuity (ARC) model described by
Glisson and Schoenwald (2005) offers an innovative orga-
nizational and community intervention option intended to
support the top-down implementation of multisystemic
therapy (MST), a well-tested ESI. Glisson and Schoenwald
have demonstrated some success with this model, which
is guided by three principles: (a) implementation of ESIs
is a social and a technical process, (b) mental health ser-
vices are embedded in layers of context that include indi-
vidual providers, organizations, and the community, and
(c) effectiveness is determined by the fit between the orga-
nization and the core technology. The ARC employs
change agents at the organizational and interorganiza-
tional levels to address barriers to fit prior to, during, and
following implementation of the ESI. Although this
model has not been widely applied, it is currently being
tested in a National Institutes of Health–funded random-
ized, controlled trial comparing MST alone to the MST
and ARC combined approach (Glisson & Schoenwald,
2005). Results from earlier studies suggest that the inter-
vention can improve organizational climate and reduce
case manager turnover (Glisson, Dukes, & Green, 2006).
Combining Evidence and Stakeholder Consensus
The third strategy modifies the Top Down approach
by combining evidence (e.g., in ESIs) with stakeholder
consensus in an attempt to deal with the absence of evi-
dence when dealing with complex social problems and
the context that must be taken into account when seeking
local applications. An example is the Texas Benefit
Design Initiative (Cook, 2004). This is a hybrid strategy
designed to deal with gaps in empirically based knowl-
edge about effective interventions, the unevenness of
knowledge about how best to implement interventions,
the need to involve stakeholders in decision making,
especially in the context of limited resources, and the
need to adapt knowledge to local conditions. The project
sought to combine best evidence with community con-
sensus in designing a package of psychosocial rehabili-
tation services for people using public mental health
services. Experts in six areas of service reviewed the evi-
dence in each area and presented their findings at 2-day
Mullen et al. / IMPLEMENTING EVIDENCE-BASED
PRACTICE 331
consensus conferences that included more than 200 citi-
zens from Texas. On the second day of the conference, a
consensus panel of 40 of these individuals met to delib-
erate the quality of the evidence regarding each service
area and what was known about implementation issues.
Based on this deliberation, the consensus panel formu-
lated service package principles and recommendations
for service package organization and implementation.
The consensus panels included stakeholder group repre-
sentatives from consumer and family organizations, ser-
vice providers and provider groups, advocates, state-level
administrators, researchers, and other interested parties.
Pilot sites in four Texas regions were formed, and a
second-level consensus meeting was held in each of the
sites to review the principles and recommendations
developed during the first phase. These local consensus
groups then formulated specific benefit package designs
for local application (Cook, 2004).
This is a complex strategy addressing many aspects of
the implementation process. It would appear to have
many promising features when feasible. Nevertheless,
follow-up data are required to assess the long-term effec-
tiveness of this implementation strategy.
Combining Staff Training and Organizational
Development
We have described above the teaching of EBP as one
approach to implementation of EBP. When the EBP
framework is applied to work in organizations, it is gen-
erally recognized that implementation strategies must go
beyond the teaching of individual staff members. In addi-
tion, the organizational context must be addressed. For
example, at the policy and management levels of applica-
tion, Gray (2001) identifies two key interrelated objec-
tives that must be achieved for successful implementation
of evidence-based health care, namely development of
individual skills for performance of evidence-based
processes (policy makers, managers, etc.) and develop-
ment of the culture, systems, and structures within orga-
nizations supporting evidence-based processes. Gray
argues that implementation strategies must be directed
toward achievement of both objectives. Similarly, Panzano
and Herman (2005, p. 245) see an organization’s adoption
of an ESI as a three-phase process: an initiation phase
(awareness of a need, problem, opportunity; search for
solutions; evaluation of potential solutions for fit); a deci-
sion to implement the ESI, and an implementation in
which a plan is developed and the innovation is ultimately
routinized and assimilated. Reflecting this implementa-
tion strategy, two approaches emphasize a combined
approach involving both staff training and organizational
development using teams.
Interactive staff training. The first, interactive staff
training, has been developed by Patrick Corrigan and
Stanley McCracken (1997). When this model is applied
to EBP dissemination and implementation, the primary
task is staff training, which results from the interaction of
educational and organizational approaches. Here, the
educational approaches derive from learning theory and
are designed to help individual practitioners acquire the
principles and skills of EBP (McCracken & Corrigan,
2004). Organizational approaches “teach individual staff
members how to work as a team and develop evidence-
based treatment programs that are user-friendly and meet
consumer needs” (Corrigan & McCracken, 1997, p. 250).
The educational and organizational interventions are
interactive in this model. Based on this model and their
review of the literature, McCracken and Corrigan propose
a number of guidelines for disseminating and adopting
EBP innovations. Although they identify many specific
practice options, there are five principles: (a) engage and
prepare the organization, (b) form a working alliance with
the treatment team, (c) develop a user-friendly program
based on identified program-development priorities and
the innovation, (d) use established educational principles
in training, and (e) implement the program in a stepwise
manner and plan for maintenance (pp. 245-246).
Related to this approach is the work of Johnson and
Austin (2006), who note that one of the challenges fac-
ing efforts to incorporate research evidence into organi-
zational practice is the absence of “an evidence-based
organizational culture within human service agencies”
(p. 75). They identify multiple strategies and case
examples for creating such an organizational culture.
They cite three strategies for incorporating evidence
into organizational cultures: (a) agency-university part-
nerships to identify the data to support EBP, (b) staff
training (in the agencies and on campuses) that features
problem-based learning approaches to support the intro-
duction and utilization of EBP, and (c) the modification
of agency cultures to support and sustain EBP.
Outcomes and objectives orientation. The second
approach, which combines practitioner training and orga-
nizational development, is proposed by Aaron Rosen and
Enola Proctor (2003). In this approach, practitioners are
trained to use a critical-thinking process in which they
learn to specify outcomes sought, intermediate objectives
to be achieved so as to attain these outcomes, and self-
evaluation skills (Rosen, 1993). Having learned these
332 RESEARCH ON SOCIAL WORK PRACTICE
processes, practitioners are prepared to critically and
selectively use the ESIs and practice guidelines that are
made available to them by the agency. In addition, orga-
nizational barriers and necessary organizational supports
are identified and addressed as part of the implementation
strategy. Implementation of this approach requires a
series of steps:
1. Select a social work organization providing direct ser-
vices to clients;
2. Work with administrators, supervisors, practitioners to
identify important and frequently sought client outcomes;
3. Search and identify ESIs appropriate to achieving those
agency selected outcomes;
4. Train practitioners how to use these ESIs;
5. Train practitioners in an approach to practice that is prob-
lem focused, outcomes oriented, intervention specific,
evaluated;
6. Practitioners apply ESIs as appropriate for individual
client situation, values, preferences, and resources.
This implementation strategy has benefited from
research conducted by Rosen, Proctor, and colleagues.
In addition, it is our understanding that this approach to
implementation is now being used and evaluated at the
George Warren Brown School of Social Work,
Washington University (Edmond, Megivern, Williams,
Rochman, & Howard, 2006; Howard, McMillen, &
Pollio, 2003). Evidence regarding the effectiveness of
this strategy is awaited.
Professional Infrastructure as Agent
The fifth approach focuses more broadly on the social
work profession itself. Proctor (2004) describes a con-
ceptual framework based on the position that for EBP and
ESIs to be successfully implemented in social work as a
profession, the professional infrastructure—including the
research community, schools of social work, practice
organizations—must focus on achieving multiple, com-
ponent intermediate outcomes:
1. Identification and access of relevant and appropriate ESIs
2. Acceptance of the evidence and a decision to adopt ESIs
3. Implementation of ESIs
4. Evaluation of their usefulness
Proctor’s concern is with how these objectives can be
achieved across the profession. In the Proctor model,
leverage points or potential interventions for attaining
these intermediate outcomes are proposed. These inter-
ventions are specific to three areas of the practice infra-
structure: (a) research, (b) training, and (c) organizational
culture. For example, to attain the first outcome (identifi-
cation and access of relevant and appropriate ESIs),
Proctor proposes,
• The research infrastructure needs to produce ESIs, user-
friendly packaging of evidence, and ways to disseminate.
• The training infrastructure needs to provide evidence-
based professional curricula.
• The organizational culture infrastructure needs to pro-
vide for electronic or on-site materials, make accessible
evidence-informed supervisors, and create interpersonal
linkages to researchers.
Proctor bases her model on theories and research about
diffusion of innovations, knowledge utilization, quality
improvement, and Prochaska and Di Clemente’s (1983)
stages of change model. This strategy is by far the most
ambitious and comprehensive approach to implementa-
tion of EBP and ESIs. It is specifically focused on social
work and may serve as an important framework for the
profession’s consideration of a comprehensive implemen-
tation strategy.
WHAT IMPLEMENTATION STRATEGIES
ARE EFFECTIVE?
Having identified various strategies for disseminating
and implementing EBP and ESIs, we now examine what
is known about the effectiveness of implementation
strategies.
Gira, Kessler, and Poertner (2004) provide an overview
of research reviews examining strategies to influence
health care providers to use research evidence in their
practice. Their purpose was to draw out lessons for social
work and to foster the use of EBP and ESIs in social work
from what had been learned in medicine and health care.
They identified and summarized 12 reviews that exam-
ined a wide range of interventions, including distribution of
printed educational materials (n = 11), continuing educa-
tion (n = 32), educational outreach visits (n = 18), use of
local opinion leaders (n = 9), audit and feedback (n = 37),
physician profiling–peer feedback (n = 12), feedback
and reminders (n = 26), continuous quality improvement
(n = 55), general practitioner computing (n = 30), com-
puterized information services (n = 100), computer-based
clinical decision support systems (n = 68), and mass
media interventions (n = 17). These authors conclude,
“The literature from health care suggests that dissemi-
nating information alone is insufficient. Many interven-
tions have been designed to improve practitioners’
adherence to EBP guidelines and are differentially effec-
tive. To date, no intervention has demonstrated powerful
effects” (pp. 77-78). These authors conclude that multiple
strategies are needed, rather than relying on any single
approach. This conclusion is consistent with the position
taken in 2001 by Grimshaw et al.
Mullen et al. / IMPLEMENTING EVIDENCE-BASED
PRACTICE 333
Walter et al. (2005) set out to identify the core compo-
nents that can be said to influence implementation out-
comes. In accord with Pawson’s (2002) work, these
authors have proposed that it is not the implementation
interventions per se that are of importance, but rather it is
the underpinning reasons or resources they offer that
explain implementation results. “It involves hypothesising
the underlying mechanism or basic theories about how an
intervention works” (Walter et al., 2005, p. 336). These
authors present an update of their earlier review of the
effectiveness of different mechanisms for the promotion
of research use across the health, social care, criminal jus-
tice, and education sectors. Six mechanisms were identi-
fied and the evidence supporting each was examined using
a narrative, qualitative approach to the analysis.
The Walter et al. (2005) review focuses on specific
mechanisms that have been studied, but it does not place
them in an organized conceptual framework. Mechanisms
for research use include (a) dissemination or the simple
distribution of research findings, (b) interaction that cre-
ates links between researchers and practitioners, (c) social
influence using influential others to encourage research
uptake, (d) facilitation by providing tangible support for
the use of research, (e) reinforcement through feedback
and rewards to encourage research use, and (f) multifac-
eted interventions that deploy multiple mechanisms. They
concluded that, under some circumstances, each of these
mechanisms can be expected to have some effect on either
conceptual or instrumental implementation. However, it
appears that the evidence is thin and, at best, suggestive.
The two most promising mechanisms would appear to be
interaction and facilitation.
Following a comprehensive review of the literature
related to innovations in service organizations drawing
from diverse disciplines, Greenhalgh, Robert, Macfarlane,
Bate, and Kyriakidou (2004), like Walter et al. (2005), rec-
ommend that the next generation of research should be
theory driven and focus on explicit hypotheses that link
interventions and outcomes, or the mechanisms that are
responsible for success or failure in a particular context.
These authors further propose a complex conceptual
model of innovation, including implementation and the
processes that must precede implementation through a
complex exchange through linkages among resource sys-
tems, knowledge purveyors, change agencies, and the user
system.
Johnson and Austin (2006) note that one of the chal-
lenges facing efforts to incorporate research evidence into
organizational practice is the absence of “an evidence-
based organizational culture within human service agen-
cies” (p. 75). They identify multiple strategies and case
examples for creating such an organizational culture.
They cite three strategies for incorporating evidence into
organizational cultures: (a) agency-university partner-
ships to identify the data to support EBP, (b) staff train-
ing (in the agencies and on campuses) that features
problem-based learning approaches to support the intro-
duction and utilization of EBP, and (c) the modification
of agency cultures to support and sustain EBP.
Fixsen et al. (2005) report the most comprehensive
review and synthesis of EBP and ESI implementation
strategies to date. Their conclusions are in general agree-
ment with those of Gira et al. (2004). Fixsen et al. are
skeptical about the utility of strategies that primarily or
exclusively rely on dissemination of practice guidelines,
policy statements, or educational information or that
exclusively rely on practitioner training. They argue for
longer-term, multilevel implementation strategies and the
need for more research to identify the functional compo-
nents or core implementation mechanisms (p. 26).
AN IMPLEMENTATION PILOT STUDY
Recently, we have completed a small-scale pilot
study examining implementation of EBP in three New
York City social agencies. This study was designed to
examine questions about how social work organizations
and practitioners can be helped to engage in EBPs.
Because of the value of comparison across sites, we
have set out to build that comparison by including three
quite different social work agencies.
Design
The study used a social intervention research
methodology, providing for a process of intervention
design, piloting, and redesign based on feedback
(Rothman & Thomas, 1993). Four sequential phases
were implemented. In Phase 1, background research
was conducted to inform the development and design of
the dissemination project. This included conducting a
literature review to find what is known about dissemi-
nation and implementation strategies and interviewing
local research experts who were actively engaged in dis-
seminating and/or implementing EBP. The results of the
literature review and interviews have been reported
(Bellamy, Bledsoe, & Traube, 2006).
In Phase 2, exploratory meetings with administrators
of potential social work agency partners were conducted
to determine interest in collaboration. Also, included in
this phase were interviews with social work practition-
ers in those agencies to explore their current knowledge
of EBP, what would motivate them to engage in EBP,
334 RESEARCH ON SOCIAL WORK PRACTICE
how they would like to learn EBP, and what they per-
ceive to be barriers to learning and implementing such
practice. Three agencies were selected to participate in
the study. Agencies partnered with the university-based
research team to design the intervention using agency
practice staff, administrator knowledge, and data col-
lected from Phase 1. The results of this phase have been
reported (Mullen et al., 2005).
In Phase 3, the research team, together with agency
administrators, supervisors, and clinicians, implemented,
monitored, adjusted, and evaluated the intervention. The
intervention was the process designed and agreed to by all
participants in the partnership for disseminating and imple-
menting EBP within a specific area of the agency program
selected by the agency team. The results of this phase will
be reported in several publications in preparation.
Phase 4, which will occur after we have completed
the analysis, will include modifications of the interven-
tion based on the evaluative process and findings.
During Phase 4, the information from the evaluation
will be used to propose ways in which the program
intervention, the implementation strategy, and the eval-
uation design should be modified for future applica-
tions. This phase will also include formal reporting of
project findings.
Although we have not yet completed all of our
planned analyses, we draw from our experiences in this
section to describe the implementation strategy used and
to identify lessons learned.
Implementation Strategy
The strategy that we adopted for use in this pilot
emerged from a careful review of the literature, inter-
views with experts (Phase 1), discussions with agency
staff, and considerations of the research team resources.
The outcomes and objectives strategy as described above
was our original point of departure (Rosen, 1993). This
strategy had been suggested to us by Rosen and Proctor
during the initial planning stages.
Also, we had favorable experiences with the teaching
strategy outlined above. We had been using this method
teaching graduate social work students the assumptions,
values, and skills of EBP using the text authored by
Leonard Gibbs (2003). It seemed to us that our students
liked the framework and showed that they were able to
learn the skills within the context of a 7-week course
meeting once a week for 2 hours (Mullen et al., in
press). However, we were mindful that our students
expressed frustration because they were not able to use
EBP learned in the classroom in their field practicum
assignments because of lack of agency staff understand-
ing and support. As described above, this teaching was
restricted to Mode 3 (didactic, classroom-based skills
training) and did not use Modes 1 and 2 (role-modeling
EBP and teaching practice using evidence).
In our discussions with agency staff, it became clear
that they had negative experiences with funding and reg-
ulatory agencies’ attempts to impose ESIs on agency
practice. There was no interest in the top-down approach
as described above or in the research team taking respon-
sibility for identifying ESIs for the practitioners to learn
(as is the case for the objectives and outcomes strategy
described above). It became clear as well that the agency
administrators and supervisors preferred learning EBP in
teams rather than one-on-one. Teams were seen as a way
to capitalize on each other’s competencies and perspec-
tives and a way to share the learning burden. Teams also
expressed an organizational commitment rather than indi-
vidual practitioner commitments.
In our explorations with the agencies, the implementa-
tion strategy most desired by the agencies needed to
combine staff training and organizational development,
approximating the principles articulated above under the
interactive staff-training strategy (Johnson & Austin,
2006; McCracken & Corrigan, 2004). Our focus became
primarily staff training directed at helping individual
practitioners acquire the principles and skills of EBP
using a team approach so as to develop evidence-based
treatment programs that are user-friendly and meet con-
sumer needs (McCracken & Corrigan, 2004). We adopted
the strategies proposed by Johnson and Austin (2006) for
incorporating evidence into organizational cultures: (a)
agency-university partnerships to identify the data to sup-
port EBP, (b) staff training that features problem-based
learning approaches to support the introduction and uti-
lization of EBP, and (c) modification of agency cultures
to support and sustain EBP.
Lessons Learned—First Impressions
We plan to report results of this pilot study in future
publications, with attention to implementation of the team
format and the specific skills-training modules. The train-
ing modules and training resources developed for this pilot
are available at http://www.columbia.edu/cu/musher/. We
will report baseline data that describe practitioner attitudes
toward and understanding of EBP and ESIs and practi-
tioner use of research. We will report posttraining data
specifying changes in baseline variables, practitioner
assessment of the training program modules, and inten-
tions to use EBP in the future.
Mullen et al. / IMPLEMENTING EVIDENCE-BASED
PRACTICE 335
Here, we briefly and impressionistically comment
about our experiences as these pertain to the implemen-
tation strategies described above.
• Our prior experience (prepilot study), which involved
teaching graduate social work students EBP, showed that
Mode 3 teaching is very effective in creating an under-
standing of EBP and providing an introduction to EBP
skills. However, it is a limited strategy for developing EBP
skills because of the lack of practicum application oppor-
tunities in real-world practice contexts. As Weissman et al.
(2006) have argued, the gold standard for training in the
use of ESIs is a combination of class and practicum train-
ing (Modes 1, 2, and 3). It is doubtful that didactic class-
room teaching of EBP alone will provide depth or
sustainability of EBP.
• The pilot study suggests that the top-down implementa-
tion strategy generally does not work unless prior training
using the EBP teaching strategy is provided. In our expe-
rience, practitioners wanted and needed to develop skills
in critical assessment and develop motivation for EBP
before they would consider adopting an ESI. However,
we found that by the end of the program, practitioners
were rather highly motivated to identify (or have identi-
fied for them) specific ESIs and to receive training in their
use as relevant to their practice context. This suggests that
the top-down approach may be a very effective imple-
mentation strategy if it is preceded by attention to train-
ing in EBP and organizational intervention.
• The university-agency partnership used in this pilot was
highly regarded by all. Indeed, some of the practitioners
viewed on-going partnerships as essential to sustain EBP
in the agencies. University staff members were seen as
facilitators, especially in terms of bringing expertise in
research retrieval and assessment to the agency teams.
• Related to the above was the general sense expressed by
nearly all team members that although it was useful to train
practitioners in the skills of research retrieval and assess-
ment, this was not a realistic expectation in terms of what
could be expected in routine practice. The reasons expressed
were that most practitioners do not have nor necessarily
want to acquire the research knowledge and skills needed to
critically appraise the research literature. And even for those
who do have the skills, adequate time is not available, and
access to fee-based Internet databases is limited.
Our experiences suggest that all of the implementation
strategies described above have a place so long as they are
appropriately sequenced and adapted to local circum-
stances. Proctor’s professional infrastructure as agent is a
broad implementation framework that brings these strate-
gies together, suggesting that for the social work profes-
sion to adopt EBP and ESIs, there needs to be system
change.
CONCLUSION
We hesitated to report our pilot study research in
this article because it has many limitations and it can not
be considered representative. However, we decided to
include a brief overview because so little empirical
research has been published in social work evaluating
implementation of EBP or ESIs. Research is needed to
evaluate the implementation strategies described above.
Little is currently known about their relative effective-
ness. Fixsen et al. (2005) report, “While it is encouraging
to see some examples of experimental research on imple-
mentation strategies, the few examples pale in compari-
son to the need for clear and effective strategies to move
science to service and transform human service systems
nationally” (p. 21).
If the objective of research is to identify implementa-
tion strategies that work, then attention must be given to
separating the examination of the implementation inter-
vention from the intervention program being implemented.
Fixsen et al. (2005) have described implementation as a set
of activities designed to put into practice a well-defined
activity or program. Implementation processes are pur-
poseful and described in sufficient detail to allow inde-
pendent observers to detect the presence and strength of
the specific set of implementation activities. When con-
ducting implementation research, two sets of activities and
outcomes need to be defined and conceptually differenti-
ated. The first set of activities and outcomes pertains to the
EBP or ESI being implemented, namely the intervention-
level activity and outcomes of that activity. The second set
of activities and outcomes is those associated with the
effort to implement the chosen intervention, namely the
implementation-level activity and outcomes. These two
sets of activities and outcomes are linked but are driven
by unique theoretical frameworks and similarly require
independent research and evaluation. Klein and Sorre
(1996) distinguish between implementation effectiveness
and innovation effectiveness measures. A similar idea is
reflected by Panzano and Herman (2005) when they note
that implementation effectiveness is indicated by the accu-
rate, committed, and consistent use of a practice by practi-
tioners (e.g., fidelity and assimilation), whereas innovation
effectiveness is measured by the benefits that accrue
to stakeholders (improved outcomes attributable to the
innovation).
A major problem facing those attempting to imple-
ment EBP and ESIs is the absence of an integrating con-
ceptual framework that would facilitate a better
understanding of what is involved when planning imple-
mentation. Greenhalgh et al. (2004) conclude that
implementation studies to date have taken a pragmatic
rather than an academic approach, are difficult to distin-
guish from research on change management generally,
and lack sufficient process information. They recom-
mend that future implementation research focus on the
question, “By what processes are particular innovations
336 RESEARCH ON SOCIAL WORK PRACTICE
in health service delivery and organization implemented
and sustained (or not) in particular contexts and settings,
and can these processes be enhanced?” (p. 620). These
researchers suggest that what is needed is in-depth,
mixed-methodology studies aimed at both process and
impact.
There is a special need for research that will specify and
test the core implementation components and processes
such as those proposed in prior research, but there is a
need to further develop and empirically test the validity
and efficacy of these nascent models. Indeed Fixsen and
his colleagues (2005) proposed 15 hypotheses for further
research that, if studied, would help to further specify the
core components as they are conceptualized in their
model.
The recently released program announcement from
the NIMH (2005), which calls for dissemination and
implementation research, lists illustrative questions that
need to be addressed. These questions focus on analysis
of factors influencing the creation, packaging, transmis-
sion, and reception of valid health research knowledge,
ranging from psychological and sociocultural factors
affecting individual practitioners, consumers, primary
caregivers, and other stakeholder groups to investiga-
tions addressing large service-delivery systems and
funding sources. Many different studies that are needed
to further develop the nascent field of EBP implementa-
tion research are outlined in the program announcement.
Indeed, NIMH is assigning significant resources to dis-
semination and implementation research. According to
the report The Road Ahead, 24 grants totaling nearly $6
million were awarded in fiscal year 2005 to investigate
theory-based and empirically supported models of dis-
semination and implementation, which represented
approximately 11% of research funding through the
Clinical Epidemiology Branch, Division of Services and
Intervention Research (U.S. Department of Health and
Human Services, 2006, p. 37).
EBP and the use of ESIs in social work seem to be
gaining momentum. It is likely that both developments
will be on social work’s agenda in the years ahead. How
these new practice forms can best be implemented in
social work education and practice remains an open
question until further research is reported. Alternative
implementation strategies are now available for use, but
little is known about how they can be used singly or in
combination to achieve intended outcomes with mini-
mal harm to the profession and clients.
NOTE
1. This section is adapted from Mullen, Bellamy, and Bledsoe
(in press).
REFERENCES
American Academy of Child and Adolescent Psychiatry. (1998).
Practice parameter for the assessment and treatment of children
and adolescents with depressive disorders. Journal of the
American
Academy of Child Adolescent Psychiatry 37, 63-83.
American Psychiatric Association. (1993). Practice guideline
for major
depressive disorder in adults. American Journal of Psychiatry,
150,
1-26.
American Psychiatric Association. (1994). Practice guideline
for the
treatment of patients with bipolar disorder. American Journal of
Psychiatry, 151, 1-36.
American Psychiatric Association. (1997). Practice guideline
for the
treatment of patients with schizophrenia. American Journal of
Psychiatry 154, 1-63.
American Psychological Association. (2005). Report of the
2005
Presidential Task Force on Evidence-Based Practice.
Washington,
DC: Author.
Barlow, D. H. (2004). Psychological treatments. American
Psychologist, 59, 869-879.
Bellamy, J., Bledsoe, S. E., & Traube, D. (2006). The current
state of
evidence based practice in social work: A review of the
literature
and qualitative analysis of expert interviews. Journal of
Evidence-
Based Social Work, 3(1), 23-48.
Bledsoe, S. E., Weissman, M. M., Mullen, E. J., Betts, K.,
Gameroff,
M. J., Verdeli, H., et al. (in press). Empirically supported psy-
chotherapy in social work training programs: Does the
definition
of evidence matter? Research on Social Work Practice.
Carpinello, S. E., Rosenberg, L., Stone, J., Schwager, M., &
Felton,
C. J. (2002). New York State’s campaign to implement
evidence-
based practice for people with serious mental disorders.
Psychiatric Services, 53, 153-155.
Chambless, D. L., Baker, M. J., Baucom, D. H., Beutler, L. E.,
Calhoun, K. S., Crits-Christoph, P., et al. (1998). Update on
empir-
ically validated therapies, II. The Clinical Psychologist, 51, 3-
16.
Chambless, D. L., Sanderson, W. C., Shoham, V., Bennett
Johnson, S.,
Pope, K. S., Crits-Christoph, P., et al. (1996). Update on
empiri-
cally validated therapies. The Clinical Psychologist, 49, 5-18.
Chiles, J. A., Lambert, M. J., & Hatch, A. L. (2002). Medical
cost off-
set: A review of the impact of psychological interventions on
med-
ical utilization over the past three decades. In N. A. Cummings,
W.
T. O’Donohue, & K. E. Ferguson (Eds.), The impact of medical
cost offset on practice and research (pp. 47-56). Reno, NV:
Context Press.
Chorpita, B. F., Yim, L. M., Donkervoet, J. C., Arensdorf, A.,
Amundsen, M. J., McGee, C., et al. (2002). Toward large-scale
implementation of empirically supported treatments for
children: A
review and observations by the Hawaii empirical basis to
services
task force. Clinical Psychology: Science and Practice, 9, 165-
190.
Cook, J. A. (2004). Blazing new trails: Using evidence-based
practice
and stakeholder consensus to enhance psychosocial
rehabilitation
services in Texas. Psychiatric Rehabilitation Journal, 27, 305-
306.
Corrigan, P. W., & McCracken, S. G. (1997). Interactive staff
train-
ing: Rehabilitation teams that work. New York: Plenum.
Corrigan, P. W., Steiner, L., McCracken, S. G., Blaser, B., &
Barr, M.
(2001). Strategies for disseminating evidence-based practices to
staff who treat people with serious mental illness. Psychiatric
Services, 52, 1598-1606.
Drake, R. E., Goldman, H. H., Leff, H. S., Lehman, A. F.,
Dixon, L.,
Mueser, K. T., et al. (2001). Implementing evidence-based
Mullen et al. / IMPLEMENTING EVIDENCE-BASED
PRACTICE 337
practices in routine mental health service settings. Psychiatric
Services, 52, 179-182.
Drake, R. E., Merrens, M. R., & Lynde, D. (2005). Evidence-
based
mental health practice. New York: Norton.
Duffy, M. (Ed.). (1999). Handbook of counseling and
psychotherapy
with older adults. New York: John Wiley.
Edmond, T., Megivern, D., Williams, C., Rochman, E., &
Howard,
M. (2006). Integrating evidence-based practice and social work
field education. Journal of Social Work Education, 42, 377-396.
Evidence-Based Medicine Working Group. (1992). A new
approach
to teaching the practice of medicine. Journal of the American
Medical Association, 268, 2420-2425.
Field, M., & Lohr, K. (Eds.). (1990). Clinical practice
guidelines.
Washington, DC: National Academy Press.
Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., &
Wallace, F. (2005). Implementation research: A synthesis of the
literature (FMHI 231). Tampa: University of South Florida,
Louis de la Parte Florida Mental Health Institute, The National
Implementation Research Network.
Gambrill, E. (2006). Social work practice: A critical thinker’s
guide
(2nd ed.). New York: Oxford University Press.
Gibbs, L. E. (2003). Evidence-based practice for the helping
profes-
sions: A practical guide with integrated multimedia. Pacific
Grove,
CA: Brooks/Cole-Thompson.
Gira, E. C., Kessler, M. L., & Poertner, J. (2004). Influencing
social
workers to use research evidence in practice: Lessons from
med-
icine and the allied health professions. Research on Social Work
Practice, 14, 68-79.
Glaser, E. M., Abelson, H. H., & Garrison, K. N. (1983).
Putting
knowledge to use: Facilitating the diffusion of knowledge and
the
implementation of planned change. San Francisco: Jossey-Bass.
Glisson, C., Dukes, D., & Green, P. (2006). The effects of the
ARC
organizational intervention on caseworker turnover, climate,
and
culture in children’s service systems. Child Abuse and Neglect,
30, 855-880.
Glisson, C., & Schoenwald, S. K. (2005). The ARC
organizational and
community intervention strategy for implementing evidence-
based
children’s mental health treatments. Mental Health Services
Research, 7, 243-259.
Gray, J. A. M. (2001). Evidence-based healthcare (2nd ed.).
New
York: Churchill Livingstone.
Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., &
Kyriakidou, O.
(2004). Diffusion of innovations in service organizations:
Systematic review and recommendations. The Milbank
Quarterly,
82, 581-629.
Grimshaw, J. M., Shirran, L., Thomas, R., Mowatt, G., Fraser,
C.,
Bero, L., et al. (2001). Changing provider behavior: An
overview of
systematic reviews of interventions. Medical Care 39(8, Suppl.
2),
2-45.
Guyatt, G. H. (1991). Evidence-based medicine. ACP (American
College of Physicians) Journal Club, 114, A-16.
Harvard Business Review. (1998). Harvard Business Review on
knowledge management. Cambridge, MA: Author.
Hess, M., & Mullen, E. J. (Eds.). (1995). Practitioner-research
part-
nerships: Building knowledge from, in, and for practice.
Washington, DC: National Association of Social Workers Press.
Hollon, S. D., Stewart, M. O., & Strunk, D. R. (in press). Do
psy-
chosocial interventions have enduring effects? Annual Review
of
Psychology.
Howard, M. O., McMillen, C. J., & Pollio, D. E. (2003).
Teaching
evidence based practice: Toward a new paradigm in social work
education. Research on Social Work Practice, 13, 234-259.
Institute of Medicine. (2000). Crossing the quality chasm: A
new
health system for the 21st century. Washington, DC: National
Academy Press.
Johnson, M., & Austin, M. J. (2006). Evidence-based practice in
the social services: Implications for organizational change.
Administration in Social Work, 30(3), 75-104.
Kazdin, A. E., & Weisz, J. R. (Eds.). (2003). Evidence-based
psy-
chotherapies for children and adolescents. New York: Guilford.
Kirk, S. A. (1990). Research utilization: The substructure of
belief.
In L. Videka-Sherman & W. J. Reid (Eds.), Advances in clinical
social work research (pp. 233-250). Washington, DC: National
Association of Social Workers.
Kirk, S. A., & Reid, W. J. (2002). Science and social work: A
criti-
cal appraisal. New York: Columbia University Press.
Klein, K., & Sorre, J. S. (1996). The challenge of innovation
imple-
mentation. Academy of Management Reviews, 21, 1055-1080.
Magnabosco, J. L. (2006, May 30). Innovations in mental health
ser-
vices implementation: A report on state-level data from the U.S.
Evidence-Based Practices Project. Implementation Science,
1(13).
McCracken, S. G., & Corrigan, P. W. (2004). Staff development
in
mental health. In H. E. Briggs & T. L. Rzepnicki (Eds.), Using
evidence in social work practice: Behavioral perspectives (pp.
232-256). Chicago: Lyceum.
Mills, E. J., Montori, V. M., & Guyatt, G. H. (2004). Evidence-
based
clinical practice. Brief Treatment and Crisis Intervention, 4(2),
187-194.
Mueser, K. T., Torrey, W. C., Lynde, D., Singer, P., & Drake,
R. E.
(2003). Implementing evidence-based practices for people with
severe mental illness. Behavior Modification, 27, 387-411.
Mullen, E. J. (in press). Evidence-based policy & social work in
healthcare. Social Work in Mental Health.
Mullen, E. J., & Bacon, W. (2004). A survey of practitioner
adoption
and implementation of practice guidelines and evidence-based
treatments. In A. R. Roberts & K. Yeager (Eds.), Evidence-
based
practice manual: Research and outcome measures in health and
human services (pp. 210-218). New York: Oxford University
Press.
Mullen, E. J., Bellamy, J. L., & Bledsoe, S. E. (2005).
Implementing
evidence-based social work practice. In P. Sommerfeld (Ed.),
Evidence-based social work—Towards a new professionalism?
(pp. 149-172). Bern, Switzerland: Peter Lang.
Mullen, E. J., Bellamy, J. L., & Bledsoe, S. E. (in press).
Evidence-
based social work practice. In R. M. Grinnell & Y. A. Unrau
(Eds.),
Social work research and evaluation: Quantitative and
qualitative
approaches (8th ed.). New York: Oxford University Press.
Nathan, P. E., & Gorman, J. M. (2002). A guide to treatments
that
work. London: Oxford University Press.
National Institute of Mental Health. (1999). Bridging science
and
service: A report by the National Advisory Mental Health
Council’s Clinical Treatment and Services Research Workgroup.
Bethesda, MD: Author.
National Institute of Mental Health. (2005, October 25).
Dissemination
and implementation research in health (PAR-06-039). Bethesda,
MD: Author.
National Institutes of Health. (2004). State implementation of
evidence-based practices: Bridging science and service. (NIMH
and SAMHSA RFA MH-03-007). Retrieved November 19, 2004,
from http://grants1.nih.gov/grants/guide/rfa-files/RFA-MH-03-
007.html
Panzano, P., & Herman, L. (2005). Developing and sustaining
evidence-based systems of mental health services. In R. E.
Drake,
M. R. Merrens, & D. Lynde (Ed.), Evidence-based mental health
practice (pp. 167-187). New York: Norton.
338 RESEARCH ON SOCIAL WORK PRACTICE
Pawson, R. (2002). Evidence-based policy: In search of a
method.
Evaluation, 8, 157-181.
Prochaska, J. O., & Di Clemente, C. C. (1983). Stages and
processes
of self-change of smoking: Toward an integrative model of
change.
Journal of Clinical and Consulting Psychology, 5, 390-395.
Proctor, E. K. (2004). Leverage points for the implementation
of
evidence-based practice. Brief Treatment and Crisis
Intervention,
4(3), 227-242.
Rogers, E. M. (1995). Diffusion of innovations (4th ed.). New
York:
Free Press.
Rosen, A. (1993). Systematic planned practice. The Social
Service
Review, 67(1), 84.
Rosen, A., & Proctor, E. (Eds.). (2003). Developing practice
guide-
lines for social work intervention: Issues, methods, and a
research agenda. New York: Columbia University Press.
Rosenberg, W., & Donald, A. (1995). Evidence based medicine:
An
approach to clinical problem-solving. British Medical Journal,
310(6987), 1122.
Roth, A., & Fonagy, P. (2004). What works for whom? A
critical
review of psychotherapy research (2nd ed.). New York:
Guilford.
Rothman, J., & Thomas, E. J. (Eds.). (1993). Intervention
research:
design and development for the human services. New York:
Haworth.
Rubin, A., & Parrish, D. (in press). Views of evidence-based
practice
among faculty in MSW programs: A national survey. Research
on
Social Work Practice.
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R.
B., &
Richardson, W. S. (1996). Evidence based medicine: What it is
and
what it isn’t: It’s about integrating individual clinical expertise
and
the best external evidence. British Medical Journal, 312, 71-72.
Sackett, D. L., Straus, S. E., Richardson, W. S., Rosenberg, W.,
&
Haynes, R. B. (2000). Evidence based medicine: How to
practice
and teach EBM (2nd ed.). New York: Churchill Livingstone.
Straus, S. E., Richardson, W. S., Glasziou, P., & Haynes, R. B.
(2005). Evidence-based medicine: How to practice and teach
EBM (3rd ed.). Edinburgh, UK: Churchill Livingstone.
Tanenbaum, S. J. (2005). Evidence-based practice as mental
health pol-
icy: Three controversies and a caveat. Health Affairs, 24, 163-
173.
Torrey, W. C., & Gorman, P. G. (2005). Closing the gap
between
what services are and what they could be. In R. E. Drake, M. R.
Merrens, & D. W. Lynde (Eds.), Evidence-based mental health
services (pp. 167-188). New York: Norton.
U.S. Department of Health and Human Services. (2006). The
road
ahead: Research partnerships to transform services. A report by
the National Advisory Mental Health Council’s Workgroup on
Services and Clinical Epidemiology Research. Bethesda, MD:
National Institutes of Health, National Institute of Mental
Health.
US Preventive Services Task Force. (2002). Screening for
depres-
sion: Recommendations and rationale. Annals of Internal
Medicine, 136, 760-764.
Walter, I., Nutley, S., & Davies, H. (2005). What works to
promote
evidence-based practice? A cross-sector review. Evidence and
Policy: A Journal of Debate, Research, and Practice, 1(3), 335-
364.
Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson,
K.,
& Ahn, H. (1997). A metaanalysis of outcome studies
comparing
bona fide psychotherapies: Empirically, “all must have prizes.”
Psychological Bulletin, 122, 203-215.
Weissman, M. M., & Sanderson, W. C. (2001). Promises and
prob-
lems in modern psychotherapy: The need for increased training
in
evidence-based treatments. In M. Hager (Ed.), Modern psychia-
try: Challenges in educating health professionals to meet new
needs (pp. 132-165). New York: Josiah Macy Jr. Foundation.
Weissman, M. M., Verdeli, H., Gameroff, M. J., Bledsoe, S. E.,
Betts, K., Mufson, L., et al. (2006). National survey of psy-
chotherapy training in psychiatry, psychology, and social work.
Archives of General Psychiatry, 63, 925-934.
Weisz, J. R., Hawley, K. M., & Doss, A. J. (2004). Empirically
tested
psychotherapies for youth internalizing and externalizing prob-
lems and disorders. Child & Adolescent Psychiatric Clinics of
North America, 13, 729-815.
Yates, B. T. (1994). Toward the incorporation of costs, cost-
effectiveness analysis, and costbenefit analysis into clinical
research.
Journal of Consulting and Clinical Psychology, 62, 729-736.
Zarit, S. H., & Knight, B. G. (Eds.). (1996). A guide to
psychotherapy
and aging: Effective clinical interventions in a life-stage
context.
Washington, DC: American Psychological Association.
<<
/ASCII85EncodePages false
/AllowTransparency false
/AutoPositionEPSFiles true
/AutoRotatePages /None
/Binding /Left
/CalGrayProfile (Dot Gain 20%)
/CalRGBProfile (sRGB IEC61966-2.1)
/CalCMYKProfile (U.S. Web Coated 050SWOP051 v2)
/sRGBProfile (sRGB IEC61966-2.1)
/CannotEmbedFontPolicy /Error
/CompatibilityLevel 1.3
/CompressObjects /Off
/CompressPages true
/ConvertImagesToIndexed true
/PassThroughJPEGImages true
/CreateJobTicket false
/DefaultRenderingIntent /Default
/DetectBlends true
/DetectCurves 0.1000
/ColorConversionStrategy /LeaveColorUnchanged
/DoThumbnails false
/EmbedAllFonts true
/EmbedOpenType false
/ParseICCProfilesInComments true
/EmbedJobOptions true
/DSCReportingLevel 0
/EmitDSCWarnings false
/EndPage -1
/ImageMemory 1048576
/LockDistillerParams true
/MaxSubsetPct 100
/Optimize false
/OPM 1
/ParseDSCComments true
/ParseDSCCommentsForDocInfo true
/PreserveCopyPage true
/PreserveDICMYKValues true
/PreserveEPSInfo true
/PreserveFlatness true
/PreserveHalftoneInfo false
/PreserveOPIComments false
/PreserveOverprintSettings true
/StartPage 1
/SubsetFonts true
/TransferFunctionInfo /Apply
/UCRandBGInfo /Remove
/UsePrologue false
/ColorSettingsFile ()
/AlwaysEmbed [ true
/ACaslon-Ornaments
/AGaramond-BoldScaps
/AGaramond-Italic
/AGaramond-Regular
/AGaramond-RomanScaps
/AGaramond-Semibold
/AGaramond-SemiboldItalic
/AGar-Special
/AkzidenzGroteskBE-Bold
/AkzidenzGroteskBE-BoldIt
/AkzidenzGroteskBE-It
/AkzidenzGroteskBE-Light
/AkzidenzGroteskBE-LightOsF
/AkzidenzGroteskBE-Md
/AkzidenzGroteskBE-MdIt
/AkzidenzGroteskBE-Regular
/AkzidenzGroteskBE-Super
/AlbertusMT
/AlbertusMT-Italic
/AlbertusMT-Light
/Aldine401BT-BoldA
/Aldine401BT-BoldItalicA
/Aldine401BT-ItalicA
/Aldine401BT-RomanA
/Aldine401BTSPL-RomanA
/Aldine721BT-Bold
/Aldine721BT-BoldItalic
/Aldine721BT-Italic
/Aldine721BT-Light
/Aldine721BT-LightItalic
/Aldine721BT-Roman
/Aldus-Italic
/Aldus-Roman
/AlternateGothicNo2BT-Regular
/Anna
/AntiqueOlive-Bold
/AntiqueOlive-Compact
/AntiqueOlive-Italic
/AntiqueOlive-Roman
/Arcadia
/Arcadia-A
/Arkona-Medium
/Arkona-Regular
/AssemblyLightSSK
/AvantGarde-Book
/AvantGarde-BookOblique
/AvantGarde-Demi
/AvantGarde-DemiOblique
/BakerSignetBT-Roman
/BaskervilleBE-Italic
/BaskervilleBE-Medium
/BaskervilleBE-MediumItalic
/BaskervilleBE-Regular
/BaskervilleBook-Italic
/BaskervilleBook-MedItalic
/BaskervilleBook-Medium
/BaskervilleBook-Regular
/BaskervilleBT-Bold
/BaskervilleBT-BoldItalic
/BaskervilleBT-Italic
/BaskervilleBT-Roman
/BaskervilleMT
/BaskervilleMT-Bold
/BaskervilleMT-BoldItalic
/BaskervilleMT-Italic
/BaskervilleMT-SemiBold
/BaskervilleMT-SemiBoldItalic
/BaskervilleNo2BT-Bold
/BaskervilleNo2BT-BoldItalic
/BaskervilleNo2BT-Italic
/BaskervilleNo2BT-Roman
/Bauhaus-Bold
/Bauhaus-Demi
/Bauhaus-Heavy
/BauhausITCbyBT-Bold
/BauhausITCbyBT-Medium
/Bauhaus-Light
/Bauhaus-Medium
/BellCentennial-Address
/BellGothic-Black
/BellGothic-Bold
/Bell-GothicBoldItalicBT
/BellGothicBT-Bold
/BellGothicBT-Roman
/BellGothic-Light
/Bembo
/Bembo-Bold
/Bembo-BoldExpert
/Bembo-BoldItalic
/Bembo-BoldItalicExpert
/Bembo-Expert
/Bembo-ExtraBoldItalic
/Bembo-Italic
/Bembo-ItalicExpert
/Bembo-Semibold
/Bembo-SemiboldItalic
/Berkeley-Black
/Berkeley-BlackItalic
/Berkeley-Bold
/Berkeley-BoldItalic
/Berkeley-Book
/Berkeley-BookItalic
/Berkeley-Italic
/Berkeley-Medium
/Berling-Bold
/Berling-BoldItalic
/Berling-Italic
/Berling-Roman
/BernhardModernBT-Bold
/BernhardModernBT-BoldItalic
/BernhardModernBT-Italic
/BernhardModernBT-Roman
/Bodoni
/Bodoni-Bold
/Bodoni-BoldItalic
/Bodoni-Italic
/Bodoni-Poster
/Bodoni-PosterCompressed
/Bookman-Demi
/Bookman-DemiItalic
/Bookman-Light
/Bookman-LightItalic
/Boton-Italic
/Boton-Medium
/Boton-MediumItalic
/Boton-Regular
/Boulevard
/BremenBT-Black
/BremenBT-Bold
/CaflischScript-Bold
/CaflischScript-Regular
/Carta
/Caslon224ITCbyBT-Bold
/Caslon224ITCbyBT-BoldItalic
/Caslon224ITCbyBT-Book
/Caslon224ITCbyBT-BookItalic
/Caslon540BT-Italic
/Caslon540BT-Roman
/CaslonBT-Bold
/CaslonBT-BoldItalic
/CaslonTwoTwentyFour-Black
/CaslonTwoTwentyFour-BlackIt
/CaslonTwoTwentyFour-Bold
/CaslonTwoTwentyFour-BoldIt
/CaslonTwoTwentyFour-Book
/CaslonTwoTwentyFour-BookIt
/CaslonTwoTwentyFour-Medium
/CaslonTwoTwentyFour-MediumIt
/CastleT-Bold
/CastleT-Book
/Caxton-Bold
/Caxton-BoldItalic
/Caxton-Book
/Caxton-BookItalic
/Caxton-Light
/Caxton-LightItalic
/CelestiaAntiqua-Ornaments
/Centennial-BlackItalicOsF
/Centennial-BlackOsF
/Centennial-BoldItalicOsF
/Centennial-BoldOsF
/Centennial-ItalicOsF
/Centennial-LightItalicOsF
/Centennial-LightSC
/Centennial-RomanSC
/CenturyOldStyle-Bold
/CenturyOldStyle-Italic
/CenturyOldStyle-Regular
/CheltenhamBT-Bold
/CheltenhamBT-BoldItalic
/CheltenhamBT-Italic
/CheltenhamBT-Roman
/Christiana-Bold
/Christiana-BoldItalic
/Christiana-Italic
/Christiana-Medium
/Christiana-MediumItalic
/Christiana-Regular
/Christiana-RegularExpert
/Christiana-RegularSC
/Clarendon
/Clarendon-Bold
/Clarendon-Light
/ClassicalGaramondBT-Bold
/ClassicalGaramondBT-BoldItalic
/ClassicalGaramondBT-Italic
/ClassicalGaramondBT-Roman
/CMTI10
/CommonBullets
/ConduitITC-Bold
/ConduitITC-BoldItalic
/ConduitITC-Light
/ConduitITC-LightItalic
/ConduitITC-Medium
/ConduitITC-MediumItalic
/CooperBlack
/CooperBlack-Italic
/CopperplateGothicBT-Bold
/CopperplateGothicBT-BoldCond
/CopperplateGothicBT-Heavy
/CopperplateGothicBT-Roman
/CopperplateGothicBT-RomanCond
/Copperplate-ThirtyThreeBC
/Copperplate-ThirtyTwoBC
/Coronet-Regular
/Courier
/Courier-Bold
/Courier-BoldOblique
/Courier-Oblique
/Critter
/CS-Special-font
/DextorD
/DextorOutD
/DidotLH-OrnamentsOne
/DidotLH-OrnamentsTwo
/DINEngschrift
/DINEngschrift-Alternate
/DINMittelschrift
/DINMittelschrift-Alternate
/DINNeuzeitGrotesk-BoldCond
/DINNeuzeitGrotesk-Light
/Dom-CasItalic
/Dom-CasualBT
/Ehrhard-Italic
/Ehrhard-Regular
/EhrhardSemi-Italic
/EhrhardtMT
/EhrhardtMT-Italic
/EhrhardtMT-SemiBold
/EhrhardtMT-SemiBoldItalic
/EhrharSemi
/ElectraLH-Bold
/ElectraLH-BoldCursive
/ElectraLH-Cursive
/ElectraLH-Regular
/EnglischeSchT-Bold
/EnglischeSchT-Regu
/ErasContour
/ErasITCbyBT-Bold
/ErasITCbyBT-Book
/ErasITCbyBT-Demi
/ErasITCbyBT-Light
/ErasITCbyBT-Medium
/ErasITCbyBT-Ultra
/EUEX10
/EUFB10
/EUFB5
/EUFB7
/EUFM10
/EUFM5
/EUFM7
/EURB10
/EURB5
/EURB7
/EURM10
/EURM5
/EURM7
/EuropeanPi-Four
/EuropeanPi-One
/EuropeanPi-Three
/EuropeanPi-Two
/Eurostile
/Eurostile-Bold
/Eurostile-BoldExtendedTwo
/Eurostile-ExtendedTwo
/EUSB10
/EUSB5
/EUSB7
/EUSM10
/EUSM5
/EUSM7
/ExPonto-Regular
/Fenice-Bold
/Fenice-BoldOblique
/FeniceITCbyBT-Bold
/FeniceITCbyBT-BoldItalic
/FeniceITCbyBT-Regular
/FeniceITCbyBT-RegularItalic
/Fenice-Light
/Fenice-LightOblique
/Fenice-Regular
/Fenice-RegularOblique
/Fenice-Ultra
/Fenice-UltraOblique
/FlashD-Ligh
/Folio-Bold
/Folio-BoldCondensed
/Folio-ExtraBold
/Folio-Light
/Folio-Medium
/FontanaNDEeOsF
/FontanaNDEeOsF-Semibold
/FormalScript421BT-Regular
/Formata-Bold
/Formata-MediumCondensed
/FournierMT-Ornaments
/FrakturBT-Regular
/FranklinGothic-Book
/FranklinGothic-BookItal
/FranklinGothic-BookOblique
/FranklinGothic-Condensed
/FranklinGothic-Demi
/FranklinGothic-DemiItal
/FranklinGothic-DemiOblique
/FranklinGothic-Heavy
/FranklinGothic-HeavyItal
/FranklinGothic-HeavyOblique
/FranklinGothic-Medium
/FranklinGothic-MediumItal
/FranklinGothic-Roman
/FrizQuadrataITCbyBT-Bold
/FrizQuadrataITCbyBT-Roman
/Frutiger-Black
/Frutiger-BlackCn
/Frutiger-BlackItalic
/Frutiger-Bold
/Frutiger-BoldCn
/Frutiger-BoldItalic
/Frutiger-Cn
/Frutiger-ExtraBlackCn
/Frutiger-Italic
/Frutiger-Light
/Frutiger-LightCn
/Frutiger-LightItalic
/Frutiger-Roman
/Frutiger-UltraBlack
/Futura
/FuturaBlackBT-Regular
/Futura-Bold
/Futura-BoldOblique
/Futura-Book
/Futura-BookOblique
/FuturaBT-Bold
/FuturaBT-BoldCondensed
/FuturaBT-BoldCondensedItalic
/FuturaBT-BoldItalic
/FuturaBT-Book
/FuturaBT-BookItalic
/FuturaBT-ExtraBlack
/FuturaBT-ExtraBlackCondensed
/FuturaBT-ExtraBlackCondItalic
/FuturaBT-ExtraBlackItalic
/FuturaBT-Heavy
/FuturaBT-HeavyItalic
/FuturaBT-Light
/FuturaBT-LightCondensed
/FuturaBT-LightItalic
/FuturaBT-Medium
/FuturaBT-MediumCondensed
/FuturaBT-MediumItalic
/Futura-ExtraBold
/Futura-ExtraBoldOblique
/Futura-Heavy
/Futura-HeavyOblique
/Futura-Light
/Futura-LightOblique
/Futura-Oblique
/GalliardITCbyBT-Italic
/GalliardITCbyBT-Roman
/Garamond-Antiqua
/Garamond-BoldCondensed
/Garamond-BoldCondensedItalic
/Garamond-BookCondensed
/Garamond-BookCondensedItalic
/Garamond-Halbfett
/GaramondITCbyBT-Bold
/GaramondITCbyBT-BoldCondensed
/GaramondITCbyBT-BoldCondItalic
/GaramondITCbyBT-BoldItalic
/GaramondITCbyBT-BoldNarrow
/GaramondITCbyBT-BoldNarrowItal
/GaramondITCbyBT-Book
/GaramondITCbyBT-BookCondensed
/GaramondITCbyBT-BookCondItalic
/GaramondITCbyBT-BookItalic
/GaramondITCbyBT-Light
/GaramondITCbyBT-LightCondensed
/GaramondITCbyBT-LightCondItalic
/GaramondITCbyBT-LightItalic
/GaramondITCbyBT-LightNarrow
/GaramondITCbyBT-LightNarrowItal
/GaramondITCbyBT-Ultra
/GaramondITCbyBT-UltraCondensed
/GaramondITCbyBT-UltraCondItalic
/GaramondITCbyBT-UltraItalic
/Garamond-Kursiv
/Garamond-KursivHalbfett
/Garamond-LightCondensed
/Garamond-LightCondensedItalic
/GaramondThree
/GaramondThree-Bold
/GaramondThree-BoldItalic
/GaramondThree-Italic
/GaramondThreeSMSspl
/GaramondThreespl
/GaramondThreeSpl-Bold
/GaramondThreeSpl-Italic
/GarthGraphic
/GarthGraphic-Black
/GarthGraphic-Bold
/GarthGraphic-BoldCondensed
/GarthGraphic-BoldItalic
/GarthGraphic-Condensed
/GarthGraphic-ExtraBold
/GarthGraphic-Italic
/Geometric231BT-HeavyC
/GeometricSlab712BT-BoldA
/GeometricSlab712BT-ExtraBoldA
/GeometricSlab712BT-LightA
/GeometricSlab712BT-LightItalicA
/GeometricSlab712BT-MediumA
/GeometricSlab712BT-MediumItalA
/Giddyup
/Giddyup-Thangs
/GillSans
/GillSans-Bold
/GillSans-BoldCondensed
/GillSans-BoldItalic
/GillSans-Condensed
/GillSans-ExtraBold
/GillSans-Italic
/GillSans-Light
/GillSans-LightItalic
/GillSans-UltraBold
/GillSans-UltraBoldCondensed
/Gill-Special
/Giovanni-Bold
/Giovanni-BoldItalic
/Giovanni-Book
/Giovanni-BookItalic
/Glypha
/Glypha-Bold
/Glypha-BoldOblique
/Glypha-Oblique
/Goudy
/Goudy-Bold
/Goudy-BoldItalic
/Goudy-ExtraBold
/Goudy-Italic
/GoudyOldStyleBT-Bold
/GoudyOldStyleBT-BoldItalic
/GoudyOldStyleBT-ExtraBold
/GoudyOldStyleBT-Italic
/GoudyOldStyleBT-Roman
/GoudySans-Bold
/GoudySans-BoldItalic
/GoudySansITCbyBT-Bold
/GoudySansITCbyBT-BoldItalic
/GoudySansITCbyBT-Medium
/GoudySansITCbyBT-MediumItalic
/GoudySans-Medium
/GoudySans-MediumItalic
/Granjon
/Granjon-Bold
/Granjon-BoldOsF
/Granjon-Italic
/Granjon-ItalicOsF
/Granjon-SC
/GreymantleMVB-Ornaments
/Helvetica
/Helvetica-Black
/Helvetica-BlackOblique
/Helvetica-Black-SemiBold
/Helvetica-Bold
/Helvetica-BoldOblique
/Helvetica-Condensed
/Helvetica-Condensed-Black
/Helvetica-Condensed-BlackObl
/Helvetica-Condensed-Bold
/Helvetica-Condensed-BoldObl
/Helvetica-Condensed-Light
/Helvetica-Condensed-LightObl
/Helvetica-Condensed-Oblique
/Helvetica-Light
/Helvetica-LightOblique
/Helvetica-Narrow
/Helvetica-Narrow-Bold
/Helvetica-Narrow-BoldOblique
/Helvetica-Narrow-Oblique
/HelveticaNeue-BlackCond
/HelveticaNeue-BlackCondObl
/HelveticaNeue-Bold
/HelveticaNeue-BoldCond
/HelveticaNeue-BoldCondObl
/HelveticaNeue-BoldExt
/HelveticaNeue-BoldExtObl
/HelveticaNeue-BoldItalic
/HelveticaNeue-Condensed
/HelveticaNeue-CondensedObl
/HelveticaNeue-ExtBlackCond
/HelveticaNeue-ExtBlackCondObl
/HelveticaNeue-Extended
/HelveticaNeue-ExtendedObl
/HelveticaNeue-Heavy
/HelveticaNeue-HeavyCond
/HelveticaNeue-HeavyCondObl
/HelveticaNeue-HeavyExt
/HelveticaNeue-HeavyExtObl
/HelveticaNeue-HeavyItalic
/HelveticaNeue-Italic
/HelveticaNeue-Light
/HelveticaNeue-LightCond
/HelveticaNeue-LightCondObl
/HelveticaNeue-LightItalic
/HelveticaNeueLTStd-Md
/HelveticaNeueLTStd-MdIt
/HelveticaNeue-Medium
/HelveticaNeue-MediumCond
/HelveticaNeue-MediumCondObl
/HelveticaNeue-MediumExt
/HelveticaNeue-MediumExtObl
/HelveticaNeue-MediumItalic
/HelveticaNeue-Roman
/HelveticaNeue-ThinCond
/HelveticaNeue-ThinCondObl
/HelveticaNeue-UltraLigCond
/HelveticaNeue-UltraLigCondObl
/Helvetica-Oblique
/HelvLight
/Humanist521BT-Bold
/Humanist521BT-BoldCondensed
/Humanist521BT-BoldItalic
/Humanist521BT-ExtraBold
/Humanist521BT-Italic
/Humanist521BT-Light
/Humanist521BT-LightItalic
/Humanist521BT-Roman
/Humanist521BT-RomanCondensed
/Humanist521BT-UltraBold
/Humanist521BT-XtraBoldCondensed
/Humanist777BT-BlackB
/Humanist777BT-BlackItalicB
/Humanist777BT-BoldB
/Humanist777BT-BoldItalicB
/Humanist777BT-ItalicB
/Humanist777BT-LightB
/Humanist777BT-LightItalicB
/Humanist777BT-RomanB
/ICMEX10
/ICMMI8
/ICMSY8
/ICMTT8
/ILASY8
/ILCMSS8
/ILCMSSB8
/ILCMSSI8
/Imago-Book
/Imago-BookItalic
/Imago-ExtraBold
/Imago-ExtraBoldItalic
/Imago-Medium
/Imago-MediumItalic
/Industria-Inline
/Industria-InlineA
/Industria-Solid
/Industria-SolidA
/Insignia
/Insignia-A
/IPAExtras
/IPAHighLow
/IPAKiel
/IPAKielSeven
/IPAsans
/JoannaMT
/JoannaMT-Bold
/JoannaMT-BoldItalic
/JoannaMT-Italic
/KlangMT
/Kuenstler480BT-Black
/Kuenstler480BT-Bold
/Kuenstler480BT-BoldItalic
/Kuenstler480BT-Italic
/Kuenstler480BT-Roman
/KunstlerschreibschD-Bold
/KunstlerschreibschD-Medi
/Lapidary333BT-Black
/Lapidary333BT-Bold
/Lapidary333BT-BoldItalic
/Lapidary333BT-Italic
/Lapidary333BT-Roman
/LASY10
/LASY5
/LASY6
/LASY7
/LASY8
/LASY9
/LASYB10
/LatinMT-Condensed
/LCIRCLE10
/LCIRCLEW10
/LCMSS8
/LCMSSB8
/LCMSSI8
/LDecorationPi-One
/LDecorationPi-Two
/Leawood-Black
/Leawood-BlackItalic
/Leawood-Bold
/Leawood-BoldItalic
/Leawood-Book
/Leawood-BookItalic
/Leawood-Medium
/Leawood-MediumItalic
/LegacySans-Bold
/LegacySans-BoldItalic
/LegacySans-Book
/LegacySans-BookItalic
/LegacySans-Medium
/LegacySans-MediumItalic
/LegacySans-Ultra
/LegacySerif-Bold
/LegacySerif-BoldItalic
/LegacySerif-Book
/LegacySerif-BookItalic
/LegacySerif-Medium
/LegacySerif-MediumItalic
/LegacySerif-Ultra
/LetterGothic
/LetterGothic-Bold
/LetterGothic-BoldSlanted
/LetterGothic-Slanted
/Life-Bold
/Life-Italic
/Life-Roman
/LINE10
/LINEW10
/Lithos-Black
/Lithos-Regular
/LOGO10
/LOGO8
/LOGO9
/LOGOBF10
/LOGOSL10
/LOMD-Normal
/LubalinGraph-Book
/LubalinGraph-BookOblique
/LubalinGraph-Demi
/LubalinGraph-DemiOblique
/LucidaMath-Symbol
/LydianBT-Bold
/LydianBT-BoldItalic
/LydianBT-Italic
/LydianBT-Roman
/LydianCursiveBT-Regular
/Marigold
/MathematicalPi-Five
/MathematicalPi-Four
/MathematicalPi-One
/MathematicalPi-Six
/MathematicalPi-Three
/MathematicalPi-Two
/Melior
/Melior-Bold
/Melior-BoldItalic
/Melior-Italic
/MercuriusCT-Black
/MercuriusCT-BlackItalic
/MercuriusCT-Light
/MercuriusCT-LightItalic
/MercuriusCT-Medium
/MercuriusCT-MediumItalic
/MercuriusMT-BoldScript
/Meridien-Medium
/Meridien-MediumItalic
/Meridien-Roman
/Minion-Black
/Minion-Bold
/Minion-BoldCondensed
/Minion-BoldCondensedItalic
/Minion-BoldItalic
/Minion-Condensed
/Minion-CondensedItalic
/MinionExp-Italic
/MinionExp-Semibold
/MinionExp-SemiboldItalic
/Minion-Italic
/Minion-Ornaments
/Minion-Regular
/Minion-Semibold
/Minion-SemiboldItalic
/MonaLisa-Recut
/MSAM10
/MSAM10A
/MSAM5
/MSAM6
/MSAM7
/MSAM8
/MSAM9
/MSBM10
/MSBM10A
/MSBM5
/MSBM6
/MSBM7
/MSBM8
/MSBM9
/MTEX
/MTEXB
/MTEXH
/MTGU
/MTGUB
/MTMI
/MTMIB
/MTMIH
/MTMS
/MTMSB
/MTMUB
/MTMUH
/MTSY
/MTSYB
/MTSYH
/MTSYN
/MusicalSymbols-Normal
/Myriad-Bold
/Myriad-BoldItalic
/Myriad-CnBold
/Myriad-CnBoldItalic
/Myriad-CnItalic
/Myriad-CnSemibold
/Myriad-CnSemiboldItalic
/Myriad-Condensed
/Myriad-Italic
/Myriad-Roman
/Myriad-Sketch
/Myriad-Tilt
/NeuzeitS-Book
]
/NeverEmbed [ true
]
/AntiAliasColorImages false
/CropColorImages true
/ColorImageMinResolution 150
/ColorImageMinResolutionPolicy /OK
/DownsampleColorImages true
/ColorImageDownsampleType /Bicubic
/ColorImageResolution 300
/ColorImageDepth -1
/ColorImageMinDownsampleDepth 1
/ColorImageDownsampleThreshold 1.50000
/EncodeColorImages true
/ColorImageFilter /DCTEncode
/AutoFilterColorImages true
/ColorImageAutoFilterStrategy /JPEG
/ColorACSImageDict <<
/QFactor 0.15
/HSamples [1 1 1 1] /VSamples [1 1 1 1]
>>
/ColorImageDict <<
/QFactor 0.15
/HSamples [1 1 1 1] /VSamples [1 1 1 1]
>>
/JPEG2000ColorACSImageDict <<
/TileWidth 256
/TileHeight 256
/Quality 30
>>
/JPEG2000ColorImageDict <<
/TileWidth 256
/TileHeight 256
/Quality 30
>>
/AntiAliasGrayImages false
/CropGrayImages true
/GrayImageMinResolution 150
/GrayImageMinResolutionPolicy /OK
/DownsampleGrayImages true
/GrayImageDownsampleType /Bicubic
/GrayImageResolution 300
/GrayImageDepth -1
/GrayImageMinDownsampleDepth 2
/GrayImageDownsampleThreshold 1.50000
/EncodeGrayImages true
/GrayImageFilter /DCTEncode
/AutoFilterGrayImages true
/GrayImageAutoFilterStrategy /JPEG
/GrayACSImageDict <<
/QFactor 0.15
/HSamples [1 1 1 1] /VSamples [1 1 1 1]
>>
/GrayImageDict <<
/QFactor 0.15
/HSamples [1 1 1 1] /VSamples [1 1 1 1]
>>
/JPEG2000GrayACSImageDict <<
/TileWidth 256
/TileHeight 256
/Quality 30
>>
/JPEG2000GrayImageDict <<
/TileWidth 256
/TileHeight 256
/Quality 30
>>
/AntiAliasMonoImages false
/CropMonoImages true
/MonoImageMinResolution 1200
/MonoImageMinResolutionPolicy /OK
/DownsampleMonoImages true
/MonoImageDownsampleType /Bicubic
/MonoImageResolution 1200
/MonoImageDepth -1
/MonoImageDownsampleThreshold 1.50000
/EncodeMonoImages true
/MonoImageFilter /CCITTFaxEncode
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx
Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx

More Related Content

Similar to Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx

Creativity Through Applying Ideas From Fields OtherThan One’.docx
Creativity Through Applying Ideas From Fields OtherThan One’.docxCreativity Through Applying Ideas From Fields OtherThan One’.docx
Creativity Through Applying Ideas From Fields OtherThan One’.docx
vanesaburnand
 
Click to view the Death with Dignity scenario.In the scenario as
Click to view the Death with Dignity scenario.In the scenario asClick to view the Death with Dignity scenario.In the scenario as
Click to view the Death with Dignity scenario.In the scenario as
WilheminaRossi174
 
Discussion 1 Relationship Between Purpose of Study and Data Analysi.docx
Discussion 1 Relationship Between Purpose of Study and Data Analysi.docxDiscussion 1 Relationship Between Purpose of Study and Data Analysi.docx
Discussion 1 Relationship Between Purpose of Study and Data Analysi.docx
owenhall46084
 
Critical Theories In Social Work Practice
Critical Theories In Social Work PracticeCritical Theories In Social Work Practice
Critical Theories In Social Work Practice
Monica Rivera
 
Social Psychology Research Project Grading Rubric W18CATEGORY5.docx
Social Psychology Research Project Grading Rubric W18CATEGORY5.docxSocial Psychology Research Project Grading Rubric W18CATEGORY5.docx
Social Psychology Research Project Grading Rubric W18CATEGORY5.docx
samuel699872
 
Social Psychology Research Project Grading Rubric W18CATEGORY5.docx
Social Psychology Research Project Grading Rubric W18CATEGORY5.docxSocial Psychology Research Project Grading Rubric W18CATEGORY5.docx
Social Psychology Research Project Grading Rubric W18CATEGORY5.docx
rosemariebrayshaw
 
See discussions, stats, and author profiles for this publica.docx
See discussions, stats, and author profiles for this publica.docxSee discussions, stats, and author profiles for this publica.docx
See discussions, stats, and author profiles for this publica.docx
edgar6wallace88877
 
How Youth Get Engaged Grounded-Theory Research on Motivationa.docx
How Youth Get Engaged Grounded-Theory Research on Motivationa.docxHow Youth Get Engaged Grounded-Theory Research on Motivationa.docx
How Youth Get Engaged Grounded-Theory Research on Motivationa.docx
pooleavelina
 
A4Step 4 in the Hybrid Frameworkmethod as noted may .docx
A4Step 4 in the Hybrid Frameworkmethod as noted may .docxA4Step 4 in the Hybrid Frameworkmethod as noted may .docx
A4Step 4 in the Hybrid Frameworkmethod as noted may .docx
ransayo
 
Technical And Business Of Entrepreneurship
Technical And Business Of EntrepreneurshipTechnical And Business Of Entrepreneurship
Technical And Business Of Entrepreneurship
Diane Allen
 
Example of an Annotated Bibliography (APA Style)Gipson, T., .docx
Example of an Annotated Bibliography (APA Style)Gipson, T., .docxExample of an Annotated Bibliography (APA Style)Gipson, T., .docx
Example of an Annotated Bibliography (APA Style)Gipson, T., .docx
elbanglis
 
1. Need all 3 article read and compared answering the questions I .docx
1. Need all 3 article read and compared answering the questions I .docx1. Need all 3 article read and compared answering the questions I .docx
1. Need all 3 article read and compared answering the questions I .docx
jackiewalcutt
 
What did you learn about yourself and your abilities to be a t.docx
What did you learn about yourself and your abilities to be a t.docxWhat did you learn about yourself and your abilities to be a t.docx
What did you learn about yourself and your abilities to be a t.docx
lillie234567
 
The Intersection of Attitudes and Organizational Factors by Provider Type in ...
The Intersection of Attitudes and Organizational Factors by Provider Type in ...The Intersection of Attitudes and Organizational Factors by Provider Type in ...
The Intersection of Attitudes and Organizational Factors by Provider Type in ...
Leonard Davis Institute of Health Economics
 

Similar to Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx (20)

Creativity Through Applying Ideas From Fields OtherThan One’.docx
Creativity Through Applying Ideas From Fields OtherThan One’.docxCreativity Through Applying Ideas From Fields OtherThan One’.docx
Creativity Through Applying Ideas From Fields OtherThan One’.docx
 
An Array Of Qualitative Data Analysis Tools A Call For Data Analysis Triangu...
An Array Of Qualitative Data Analysis Tools  A Call For Data Analysis Triangu...An Array Of Qualitative Data Analysis Tools  A Call For Data Analysis Triangu...
An Array Of Qualitative Data Analysis Tools A Call For Data Analysis Triangu...
 
Click to view the Death with Dignity scenario.In the scenario as
Click to view the Death with Dignity scenario.In the scenario asClick to view the Death with Dignity scenario.In the scenario as
Click to view the Death with Dignity scenario.In the scenario as
 
Qualitative research study guide
Qualitative research study guideQualitative research study guide
Qualitative research study guide
 
Discussion 1 Relationship Between Purpose of Study and Data Analysi.docx
Discussion 1 Relationship Between Purpose of Study and Data Analysi.docxDiscussion 1 Relationship Between Purpose of Study and Data Analysi.docx
Discussion 1 Relationship Between Purpose of Study and Data Analysi.docx
 
Critical Theories In Social Work Practice
Critical Theories In Social Work PracticeCritical Theories In Social Work Practice
Critical Theories In Social Work Practice
 
Social Psychology Research Project Grading Rubric W18CATEGORY5.docx
Social Psychology Research Project Grading Rubric W18CATEGORY5.docxSocial Psychology Research Project Grading Rubric W18CATEGORY5.docx
Social Psychology Research Project Grading Rubric W18CATEGORY5.docx
 
Social Psychology Research Project Grading Rubric W18CATEGORY5.docx
Social Psychology Research Project Grading Rubric W18CATEGORY5.docxSocial Psychology Research Project Grading Rubric W18CATEGORY5.docx
Social Psychology Research Project Grading Rubric W18CATEGORY5.docx
 
Appleby College Research
Appleby College ResearchAppleby College Research
Appleby College Research
 
See discussions, stats, and author profiles for this publica.docx
See discussions, stats, and author profiles for this publica.docxSee discussions, stats, and author profiles for this publica.docx
See discussions, stats, and author profiles for this publica.docx
 
K France Family Matters 2
K France Family Matters 2K France Family Matters 2
K France Family Matters 2
 
How Youth Get Engaged Grounded-Theory Research on Motivationa.docx
How Youth Get Engaged Grounded-Theory Research on Motivationa.docxHow Youth Get Engaged Grounded-Theory Research on Motivationa.docx
How Youth Get Engaged Grounded-Theory Research on Motivationa.docx
 
A4Step 4 in the Hybrid Frameworkmethod as noted may .docx
A4Step 4 in the Hybrid Frameworkmethod as noted may .docxA4Step 4 in the Hybrid Frameworkmethod as noted may .docx
A4Step 4 in the Hybrid Frameworkmethod as noted may .docx
 
Technical And Business Of Entrepreneurship
Technical And Business Of EntrepreneurshipTechnical And Business Of Entrepreneurship
Technical And Business Of Entrepreneurship
 
Example of an Annotated Bibliography (APA Style)Gipson, T., .docx
Example of an Annotated Bibliography (APA Style)Gipson, T., .docxExample of an Annotated Bibliography (APA Style)Gipson, T., .docx
Example of an Annotated Bibliography (APA Style)Gipson, T., .docx
 
1. Need all 3 article read and compared answering the questions I .docx
1. Need all 3 article read and compared answering the questions I .docx1. Need all 3 article read and compared answering the questions I .docx
1. Need all 3 article read and compared answering the questions I .docx
 
What did you learn about yourself and your abilities to be a t.docx
What did you learn about yourself and your abilities to be a t.docxWhat did you learn about yourself and your abilities to be a t.docx
What did you learn about yourself and your abilities to be a t.docx
 
Luttrell & Ward (2018) Looking in to see out: An Introspective Approach to Te...
Luttrell & Ward (2018) Looking in to see out: An Introspective Approach to Te...Luttrell & Ward (2018) Looking in to see out: An Introspective Approach to Te...
Luttrell & Ward (2018) Looking in to see out: An Introspective Approach to Te...
 
Addressing Gender Inequality In Science The Multifaceted Challenge Of Assess...
Addressing Gender Inequality In Science  The Multifaceted Challenge Of Assess...Addressing Gender Inequality In Science  The Multifaceted Challenge Of Assess...
Addressing Gender Inequality In Science The Multifaceted Challenge Of Assess...
 
The Intersection of Attitudes and Organizational Factors by Provider Type in ...
The Intersection of Attitudes and Organizational Factors by Provider Type in ...The Intersection of Attitudes and Organizational Factors by Provider Type in ...
The Intersection of Attitudes and Organizational Factors by Provider Type in ...
 

More from coubroughcosta

After reading The Cultural Meaning of Suicide What Does That Mean.docx
After reading The Cultural Meaning of Suicide What Does That Mean.docxAfter reading The Cultural Meaning of Suicide What Does That Mean.docx
After reading The Cultural Meaning of Suicide What Does That Mean.docx
coubroughcosta
 
AFTER READING THE BECOMING MODERN ESSAY, ANSWER THE FOLLOWING.docx
AFTER READING THE BECOMING MODERN ESSAY, ANSWER THE FOLLOWING.docxAFTER READING THE BECOMING MODERN ESSAY, ANSWER THE FOLLOWING.docx
AFTER READING THE BECOMING MODERN ESSAY, ANSWER THE FOLLOWING.docx
coubroughcosta
 
After reading the case study prepare Assignment One - Collecting I.docx
After reading the case study prepare Assignment One - Collecting I.docxAfter reading the case study prepare Assignment One - Collecting I.docx
After reading the case study prepare Assignment One - Collecting I.docx
coubroughcosta
 
After reading the assigned resources about leadership types and .docx
After reading the assigned resources about leadership types and .docxAfter reading the assigned resources about leadership types and .docx
After reading the assigned resources about leadership types and .docx
coubroughcosta
 

More from coubroughcosta (20)

After reviewing the policy brief by the Urban Institute on the pros .docx
After reviewing the policy brief by the Urban Institute on the pros .docxAfter reviewing the policy brief by the Urban Institute on the pros .docx
After reviewing the policy brief by the Urban Institute on the pros .docx
 
After reviewing the Psychosocial Care of the Elderly source found in.docx
After reviewing the Psychosocial Care of the Elderly source found in.docxAfter reviewing the Psychosocial Care of the Elderly source found in.docx
After reviewing the Psychosocial Care of the Elderly source found in.docx
 
After reviewing the Getta Byte Transcript (attached word document), .docx
After reviewing the Getta Byte Transcript (attached word document), .docxAfter reviewing the Getta Byte Transcript (attached word document), .docx
After reviewing the Getta Byte Transcript (attached word document), .docx
 
After reviewing chapter11( Facilitating Marketing Behaviors), chapte.docx
After reviewing chapter11( Facilitating Marketing Behaviors), chapte.docxAfter reviewing chapter11( Facilitating Marketing Behaviors), chapte.docx
After reviewing chapter11( Facilitating Marketing Behaviors), chapte.docx
 
After reading The Cultural Meaning of Suicide What Does That Mean.docx
After reading The Cultural Meaning of Suicide What Does That Mean.docxAfter reading The Cultural Meaning of Suicide What Does That Mean.docx
After reading The Cultural Meaning of Suicide What Does That Mean.docx
 
After reading through the Chapter1 to Chapter3, its reasonable to st.docx
After reading through the Chapter1 to Chapter3, its reasonable to st.docxAfter reading through the Chapter1 to Chapter3, its reasonable to st.docx
After reading through the Chapter1 to Chapter3, its reasonable to st.docx
 
After reading the SENSE4US document provided, what are your thou.docx
After reading the SENSE4US document provided, what are your thou.docxAfter reading the SENSE4US document provided, what are your thou.docx
After reading the SENSE4US document provided, what are your thou.docx
 
After reading the section titled Dominant Microprocessor Company In.docx
After reading the section titled Dominant Microprocessor Company In.docxAfter reading the section titled Dominant Microprocessor Company In.docx
After reading the section titled Dominant Microprocessor Company In.docx
 
After reading the SENSE4US document provided, what are your thoughts.docx
After reading the SENSE4US document provided, what are your thoughts.docxAfter reading the SENSE4US document provided, what are your thoughts.docx
After reading the SENSE4US document provided, what are your thoughts.docx
 
After reading the RN Safe Staffing Act and the role of the ANA.docx
After reading the RN Safe Staffing Act and the role of the ANA.docxAfter reading the RN Safe Staffing Act and the role of the ANA.docx
After reading the RN Safe Staffing Act and the role of the ANA.docx
 
After reading the reference documents attached, Discuss what p.docx
After reading the reference documents attached, Discuss what p.docxAfter reading the reference documents attached, Discuss what p.docx
After reading the reference documents attached, Discuss what p.docx
 
After reading the required articles this week .please write a resear.docx
After reading the required articles this week .please write a resear.docxAfter reading the required articles this week .please write a resear.docx
After reading the required articles this week .please write a resear.docx
 
After reading the information about James Bain and Craig Richard Col.docx
After reading the information about James Bain and Craig Richard Col.docxAfter reading the information about James Bain and Craig Richard Col.docx
After reading the information about James Bain and Craig Richard Col.docx
 
AFTER READING THE BECOMING MODERN ESSAY, ANSWER THE FOLLOWING.docx
AFTER READING THE BECOMING MODERN ESSAY, ANSWER THE FOLLOWING.docxAFTER READING THE BECOMING MODERN ESSAY, ANSWER THE FOLLOWING.docx
AFTER READING THE BECOMING MODERN ESSAY, ANSWER THE FOLLOWING.docx
 
After reading the case study prepare Assignment One - Collecting I.docx
After reading the case study prepare Assignment One - Collecting I.docxAfter reading the case study prepare Assignment One - Collecting I.docx
After reading the case study prepare Assignment One - Collecting I.docx
 
After reading the assigned resources about leadership types and .docx
After reading the assigned resources about leadership types and .docxAfter reading the assigned resources about leadership types and .docx
After reading the assigned resources about leadership types and .docx
 
After reading the assigned readings and The Loving Family Case .docx
After reading the assigned readings and The Loving Family Case .docxAfter reading the assigned readings and The Loving Family Case .docx
After reading the assigned readings and The Loving Family Case .docx
 
After reading the article by Leo, describe the difference between th.docx
After reading the article by Leo, describe the difference between th.docxAfter reading the article by Leo, describe the difference between th.docx
After reading the article by Leo, describe the difference between th.docx
 
After reading Rebore (2015), Chapter 9, discuss collective bargainin.docx
After reading Rebore (2015), Chapter 9, discuss collective bargainin.docxAfter reading Rebore (2015), Chapter 9, discuss collective bargainin.docx
After reading Rebore (2015), Chapter 9, discuss collective bargainin.docx
 
After reading Horace Miner’s Body Ritual Among the Nacirema,” r.docx
After reading Horace Miner’s Body Ritual Among the Nacirema,” r.docxAfter reading Horace Miner’s Body Ritual Among the Nacirema,” r.docx
After reading Horace Miner’s Body Ritual Among the Nacirema,” r.docx
 

Recently uploaded

QUATER-1-PE-HEALTH-LC2- this is just a sample of unpacked lesson
QUATER-1-PE-HEALTH-LC2- this is just a sample of unpacked lessonQUATER-1-PE-HEALTH-LC2- this is just a sample of unpacked lesson
QUATER-1-PE-HEALTH-LC2- this is just a sample of unpacked lesson
httgc7rh9c
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 

Recently uploaded (20)

Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
Simple, Complex, and Compound Sentences Exercises.pdf
Simple, Complex, and Compound Sentences Exercises.pdfSimple, Complex, and Compound Sentences Exercises.pdf
Simple, Complex, and Compound Sentences Exercises.pdf
 
VAMOS CUIDAR DO NOSSO PLANETA! .
VAMOS CUIDAR DO NOSSO PLANETA!                    .VAMOS CUIDAR DO NOSSO PLANETA!                    .
VAMOS CUIDAR DO NOSSO PLANETA! .
 
Tatlong Kwento ni Lola basyang-1.pdf arts
Tatlong Kwento ni Lola basyang-1.pdf artsTatlong Kwento ni Lola basyang-1.pdf arts
Tatlong Kwento ni Lola basyang-1.pdf arts
 
QUATER-1-PE-HEALTH-LC2- this is just a sample of unpacked lesson
QUATER-1-PE-HEALTH-LC2- this is just a sample of unpacked lessonQUATER-1-PE-HEALTH-LC2- this is just a sample of unpacked lesson
QUATER-1-PE-HEALTH-LC2- this is just a sample of unpacked lesson
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 
How to Manage Call for Tendor in Odoo 17
How to Manage Call for Tendor in Odoo 17How to Manage Call for Tendor in Odoo 17
How to Manage Call for Tendor in Odoo 17
 
REMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptxREMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptx
 
How to Add a Tool Tip to a Field in Odoo 17
How to Add a Tool Tip to a Field in Odoo 17How to Add a Tool Tip to a Field in Odoo 17
How to Add a Tool Tip to a Field in Odoo 17
 
21st_Century_Skills_Framework_Final_Presentation_2.pptx
21st_Century_Skills_Framework_Final_Presentation_2.pptx21st_Century_Skills_Framework_Final_Presentation_2.pptx
21st_Century_Skills_Framework_Final_Presentation_2.pptx
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
AIM of Education-Teachers Training-2024.ppt
AIM of Education-Teachers Training-2024.pptAIM of Education-Teachers Training-2024.ppt
AIM of Education-Teachers Training-2024.ppt
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
Our Environment Class 10 Science Notes pdf
Our Environment Class 10 Science Notes pdfOur Environment Class 10 Science Notes pdf
Our Environment Class 10 Science Notes pdf
 
OS-operating systems- ch05 (CPU Scheduling) ...
OS-operating systems- ch05 (CPU Scheduling) ...OS-operating systems- ch05 (CPU Scheduling) ...
OS-operating systems- ch05 (CPU Scheduling) ...
 
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptxExploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
 

Advance Clinical Practice IIGroup A Wiki TimelineAssignment.docx

  • 1. Advance Clinical Practice II Group A Wiki Timeline/Assignment Description of the family system: Case Study: Michelle Due: Dec 21 Family System: Father: Tom Smith (42) Mother: Tina (42) Children: Tom Jr. (16), Paul (13), Lucy (5). Presenting problem: Family of 5 enter treatment because parents announced they are getting divorced. Children are upset. Scope of the Issue: Ellis Engagement & Assessment: Cynthia, Daniel Literature Review: Michelle, Tiffany Interventions: Michelle, Tiffany Advantages and Disadvantages of Interventions: Cynthia, Ellis Recommendations for treatment: Tiffany, Daniel Evaluation: Cynthia, Daniel References: Cynthia, Michelle, Tiffany, Ellis, Daniel Additional Suspense: APA Template hung NLT Dec 16th Rough draft due by week 7, NLT Jan 13th. Final draft due by week, NLT Jan 27th. All group members will be responsible for editing, proofreading, and adding additional information where needed to strengthen other sections of the Group Project. Assignment 2: Assessing Group Process 1
  • 2. Reflection and self-awareness are important exercises when practicing as a clinical social worker. Journaling is not only useful for clients, but it is a useful exercise for social workers in clinical practice. Understanding one’s own comfort levels is part of practicing as a competent social worker. · Reflect on your experience so far in starting the Group Wiki Project. – I had shoulder surgery on 12/12/2018 and was slow to get started due to not being able to type, recovering, and on medication. I was able to communicate with Cynthia and be added to duties on the timeline. My responsibilities in the group project are doing the engagement and assessment; recommendations for treatment; and evaluation. Most of my group members came up with the following family scenario: Case Study: Michelle Due: Dec 21 Family System: Father: Tom Smith (42) Mother: Tina (42) Children: Tom Jr. (16), Paul (13), Lucy (5). Presenting problem: Family of 5 enter treatment because parents announced they are getting divorced. Children are upset. · Describe how your group initiated contact and your level of comfort in working on a project with a group online. – It feels odd to me to have to work as a group online without seeing group members face to face. Our group initiated contact via email and phone texting. · Discuss the advantages and disadvantages of completing this project as a group. - Some disadvantages are having to accept other people’s ideas whether you agree or like it or not, having to wait on other people to complete their part of the project; and trying to bring everyone together at the same time for collaborations. Some of the advantages are that you are not having to do all the work of the project yourself and you will have access to different ideas and experiences from group members.
  • 3. Group Process Assignments should integrate course concepts related to group process. Assignments should demonstrate critical thought when applying course material to your group experience. Support ideas in your Assignment with APA citations from this week's required resources (required resources list below). Submit your Assignment (3 pages). Required Resources Wheeler, D. P., & Bragin, M. (2007). Bringing it all back home: Social work and the challenge of returning veterans. Health & Social Work, 32(4), 297–300. (ATTACHED) Mullen, E. J., Bledsoe, S. E., & Bellamy, J. L. (2008). Implementing evidence-based social work practice. Research on Social Work Practice, 18(4), 325–338. (ATTACHED) Rhubric/Grading CriteriaContent Accuracy and Application-- Excellent 36 (36%) - 40 (40%) Content includes excellent answers, specific to the questions asked and issues presented, and additional overview information on the topic. All information is accurate; all facts are precise and explicit. A clear connection to the concepts presented in readings and resources is applied to the journal. Good 32 (32%) - 35.96 (35.96%) Content includes answers specific to the questions asked and issues presented, and additional overview information on the topic. Information is mostly accurate; most facts are precise and explicit. A few of the concepts from the readings and resources are applied to the journal. Fair 28 (28%) - 31.96 (31.96%) Content includes some answers specific to the questions asked and issues presented, but little additional overview information
  • 4. on the topic. Information is somewhat accurate; some facts are precise and explicit. Some concepts from the readings and resources are applied to the journal. Poor 0 (0%) - 27.96 (27.96%) Content does not include answers specific to the questions asked and issues presented or additional overview information on the topic. Information is inaccurate; facts are not precise and explicit. None of the concepts from the readings and resources was mentioned or applied to the journal.Critical Thinking and Reflection-- Excellent 36 (36%) - 40 (40%) Content demonstrates a high level of critical thinking and understanding of personal perspective. Student demonstrates a proficiency in assessing and articulating personal interactions. Good 32 (32%) - 35.96 (35.96%) Content demonstrates a moderate level of critical thinking and understanding of personal perspective. Student demonstrates moderate proficiency in assessing and articulating personal interactions. Fair 28 (28%) - 31.96 (31.96%) Content demonstrates some critical thinking and understanding of personal perspective. Student demonstrates little proficiency in assessing and articulating personal interactions. Poor 0 (0%) - 27.96 (27.96%) Content demonstrates little critical thinking or understanding of personal perspective. Student demonstrates no proficiency in assessing and articulating personal interactions.Writing-- Excellent 18 (18%) - 20 (20%) The Journal is well organized. The format is easy to follow, flows smoothly from one idea to another, and logically conveys key ideas. Excellent grammar, spelling, and APA style. Good 16 (16%) - 17.98 (17.98%) The Journal is presented in a thoughtful manner, fairly well organized. Most transitions are easy to follow, but at times ideas are unclear. Fair 14 (14%) - 15.98 (15.98%)
  • 5. The Journal is not presented in a thoughtful manner and is not very well organized. Some transitions are easy to follow, but at times ideas are unclear. Poor 0 (0%) - 13.98 (13.98%) The Journal is choppy and confusing; format is difficult to follow; transitions of ideas are abrupt and distracting. 325 Implementing Evidence-Based Social Work Practice Edward J. Mullen Columbia University School of Social Work Sarah E. Bledsoe University of North Carolina School of Social Work Jennifer L. Bellamy Washington University at St. Louis George Warren Brown School of Social Work Recently, social work has been influenced by new forms of practice that hold promise for bringing practice and research together to strengthen the scientific knowledge base supporting social work intervention. The most recent new practice framework is evidence-based practice. However, although evidence-based practice has many qualities that might attract social workers to adopt it, use in practice is limited. Accordingly, attention is being given to deter- mine effective strategies for the dissemination, adoption, and implementation of evidence-based practice. This article
  • 6. examines the implementation literature, describes alternative strategies for implementation of evidence-based prac- tice in social work, describes an implementation study to illustrate concepts discussed, and specifies needed research. Keywords: evidence-based practice; implementation; dissemination; social work practice Social work policy, administration, and direct practice based on scientific knowledge rather than authority, tradi- tion, or common sense can lead to better outcomes for clients. Those doubting this claim need only peruse the systematic reviews and meta-analyses included in the Cochrane Collaboration and the Campbell Collaboration libraries. Also see American Psychological Association (2005), A sizeable body of scientific evidence drawn from a variety of research designs and methodologies attests to the effectiveness of psychological practices. The research literature on the effect of psychological interventions indicates that these interventions are safe and effective for a large number of children and youth (Weisz, Hawley & Doss, 2004; Kazdin & Weisz, 2003), adults (Barlow, 2004; Nathan & Gorman, 2002; Roth & Fonagy, 2004; Wampold et al., 1997) and older adults (Zarit & Knight, 1996; Duffy, 1999) across a wide range of psychological, addictive, health, and relational problems. More recent research indicates that compared to alternative approaches, such as med- ications, psychological treatments are particularly enduring (Hollon, Stewart, & Strunk, in press). Further, research demon- strates that psychotherapy can and often does pay for itself in terms of medical costs offset, increased productivity, and life satisfaction (Chiles, Lambert, & Hatch, 2002; Yates, 1994). (p. 6)
  • 7. Unfortunately, available scientific knowledge is too often underutilized by social workers (Kirk, 1990; Mullen, in press; Mullen & Bacon, 2004; Weissman & Sanderson, 2001). The gap between what has been learned through scientific research and what is used in social work policy, administration, and direct practice has been a concern throughout social work’s modern history (Hess & Mullen, 1995; Kirk & Reid, 2002). This gap is not found only in social work, but it is also a troubling situation throughout the health and human services. It is widely recognized that there is a discrep- ancy between what research has demonstrated to be effective and what is actually found to be occurring in practice (Fixsen, Naoom, Blase, Friedman, & Wallace, 2005; Panzano & Herman, 2005; Torrey & Gorman, 2005). In the influential report Bridging Science and Service, the U.S. National Advisory Mental Health Council concluded that Authors’ Note: This work was supported in part by the National Institute of Mental Health Training Grant 5T32MH014623 (S. E. Bledsoe, J. Bellamy, J. Manuel) and the Willma and Albert Musher Program at Columbia University. Portions of this article were presented at the University of Texas School of Social Work National Symposium titled Improving the Teaching of Evidence- based Practice, October 16 to 18, 2006, Austin, Texas. Correspondence con- cerning this article should be addressed to Edward J. Mullen, Columbia University School of Social Work, 1225 Amsterdam Ave., New York, NY
  • 8. 10027; e-mail: [email protected] Research on Social Work Practice, Vol. 18 No. 4, July 2008 325-338 DOI: 10.1177/1049731506297827 © 2008 Sage Publications 326 RESEARCH ON SOCIAL WORK PRACTICE many people are unable to obtain, for themselves or for one close to them, appropriate, state-of-the-art treatment for a mental illness. All too often, clinical practices and service system innovations that are validated by research are not fully adopted in treatment settings and service systems for individ- uals with mental illnesses. The substantial disparity between what is known through research and what is actually provided in routine care is not limited to mental illnesses. (National Institute of Mental Health [NIMH], 1999, p. 7) This gap has been identified again in the recent NIMH report The Road Ahead, when it notes, Simply creating an inventory of evidence-based treatments will not result in their broad implementation in practice. In fact, it has been well documented that, for various reasons, health care delivery systems do not implement interventions that have been shown to be effective in a small number of settings and were published in journal articles. A key question the Workgroup grappled with was, how can NIMH enhance the likelihood that effective interventions are implemented and sustained in real-world settings? (U.S. Department of Health and Human Services, 2006, p. 7) In recent years, social work has been influenced by new forms of practice that hold promise for bringing
  • 9. practice and research together so as to strengthen the sci- entific knowledge base supporting social work interven- tion. The most recent of these new practice frameworks is evidence-based practice (EBP). However, although EBP has many qualities that might attract social workers to adopt it as a practice framework, its current use in prac- tice is limited (Mullen & Bacon, 2004). Accordingly, increased attention is being given to determine effective strategies for the dissemination, adoption, and implemen- tation of EBP in social work practice. This article exam- ines the implementation literature, describes alternative strategies for the implementation of EBP in social work practice, describes a pilot implementation study we have recently completed to illustrate concepts discussed, and specifies needed research. Because EBP is a new practice framework that is poorly understood by social work educators and practi- tioners, we first describe what is meant by EBP (Bledsoe et al., in press; Mullen & Bacon, 2004; Rubin & Parrish, in press; Weissman et al., 2006). EBP, EMPIRICALLY SUPPORTED INTERVENTIONS (ESIS), AND PRACTICE GUIDELINES Evidence-based practice, empirically supported inter- ventions (also called empirically informed interventions and evidence-based practices), and practice guidelines are terms that are frequently, although inappropriately, interchangeably used (Rubin & Parrish, in press). This is unfortunate because each refers to distinctly different ideas. Different implementation strategies apply depend- ing on which of these innovations are referenced. Before
  • 10. discussing implementation strategies, this section briefly describes each of these concepts. EBP1 EBP is a way of doing practice—a way of assessing, intervening, and evaluating based on a set of assumptions and values. EBP was originally developed in medicine as a way of training medical residents for a new form of med- ical practice (Evidence-Based Medicine Working Group, 1992; Sackett, Rosenberg, Gray, Haynes, & Richardson, 1996; Straus, Richardson, Glasziou, & Haynes, 2005). The original emphasis was on teaching medical residents critical-assessment skills so as to strengthen the scientific base used by physicians in decision making. During the past decade, EBP has received widespread attention throughout the health care professions (Gray, 2001). As described by Mills, Montori, and Guyatt (2004), Although the concepts of evidence based medicine (EBM) have been developing since clinical trial publications became available—the formal construct of devising a clinical question and searching available evidence with a critical eye toward applying it to patient problems has evolved in the last 20 years—the term evidence-based medicine first appeared in a description of the McMaster University internal medicine res- idency program—and the first published use of this term was in 1991 (Guyatt, 1991). Subsequently, the Journal of the American Medical Association published a series of 32 articles entitled User’s Guides that made available the fundamental concepts of EBP—and were followed by a number of texts that further developed these principles. (pp. 188-189)
  • 11. Because of its origin in health care, the language used to describe EBP reflects the health care fields of prac- tice. Three highly compatible definitions of EBP are, the conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual patients. (Sackett et al., 1996, p. 71) the integration of best research evidence with clinical expertise and patient values. (Sackett, Straus, Richardson, Rosenberg, & Haynes, 2000, p. 1) the integration of best research evidence with clinical exper- tise, and patient values. Where: Best research evidence refers to clinically relevant research, often from the basic health and medical sciences, but especially from patient-centered clinical research into the accuracy and Mullen et al. / IMPLEMENTING EVIDENCE-BASED PRACTICE 327 precision of diagnostic tests (including the clinical examina- tion); the power of prognostic markers; and the efficacy and safety of therapeutic, rehabilitative, and preventive regimens. Clinical expertise means the ability to use clinical skills and past experience to rapidly identify each patient’s unique health state and diagnosis, individual risks and benefits of potential interventions, and personal values and expectations. Patient values refers to the unique preferences, concerns, and expectations that each patient brings to a clinical encounter and that must be integrated into clinical decisions if they are to
  • 12. serve the patient. (Institute of Medicine, 2000, p. 147) EBP is typically described as involving six steps (Gibbs, 2003; Sackett et al., 2000; Straus et al., 2005). In the real practice world, however, these steps may not be pursued in the following order: 1. Convert information needs into an answerable question. An initial assessment of the client must be done to determine what questions are important. The assessment should be used as a basis for a well-formulated question that must be not only answerable but also phrased in a way that a search of existing research literature can be conducted to answer this question. The question can be about assessment, description, prevention, or intervention. 2. Track down the best evidence to answer the question. 3. Critically appraise the evidence for its validity (closeness to the truth), impact (size of the effect), and applicability (usefulness in practice). 4. Integrate the critical appraisal with practice experience and client’s strengths, values, and circumstances. 5. Evaluate effectiveness and efficiency in exercising Steps 1 to 4 and seek ways to improve on them next time. 6. Teach others to follow the same process. At each step in the process, the practitioner’s expertise, experience, and constraints (e.g., practical, financial, eth- ical) are considered together with practitioner and client values and preferences. This approach has been adopted by many of the
  • 13. health care professions. It has been adapted for use in health care policy, procurement, and management where the focus is on populations rather than individual clients. J. A. Muir Gray (2001, xxi—xxiii) proposes that there are three key steps in evidence-based health care: find- ing and appraising the evidence, developing the capac- ity of individuals and organizations to use the evidence wisely, and getting the evidence into practice. ESIs ESIs are specific interventions (e.g., assessment instru- ments, treatment and prevention protocols, etc.) deter- mined to have a reasonable degree of empirical support (e.g., two randomized, controlled clinical trials conducted by different investigatory teams; Chambless et al., 1996; Chambless et al., 1998; Roth & Fonagy, 2004). In health and mental health, ESIs most often are called EBPs or empirically supported treatments (Bledsoe et al., in press; Drake, Merrens, & Lynde, 2005; Weissman et al., 2006). At times they are called empirically informed interven- tions. To avoid confusion, we adopt the term ESIs in the remainder of this article, intending to encompass the terms EBP and empirically supported or informed treatments. It is important to realize that EBP and ESIs are com- plimentary when brought together. Fundamentally, EBP is a process that includes finding empirical evidence regarding the effectiveness and/or efficiency of various intervention options (or for assessment instruments their psychometric properties) and then determining the rele- vance of those options to specific client conditions, cir- cumstances, and preferences. The search process should result in the identification of ESIs when they exist. This information is then critically considered in making the
  • 14. final intervention plan. There are a growing number of ESIs relevant to social work. For example, there are now approximately 20 psy- chotherapies for the treatment of psychiatric disorders for which there is clear evidence of efficacy for specific prob- lems or populations (Roth & Fonagy, 2004). There is also a range of community mental health programs that have empirical support for beneficial effects with the severely mentally ill (Drake et al., 2005). Since the early 1990s, various efforts have been made to systematically examine the empirical evidence supporting interventions and to classify the level and strength of this evidence. Many interventions of relevance to social work practice are now known to be efficacious, and for some there is effective- ness evidence. Attention has now turned to how to imple- ment these in routine social work practice as discussed below. Practice Guidelines Related to the efforts to classify practices by level and strength of empirical support is a parallel development— the publication of practice guidelines—sometimes called best practices. These practice guidelines are described by the Institute of Medicine as “systematically developed statements to assist practitioner and patient decisions about appropriate health care for specific clinical circumstances” (Field & Lohr, 1990, p. 38). Since the early 1990s, professional organizations and government agencies have formulated practice guidelines for various clinical conditions such as depression and schiz- ophrenia (American Academy of Child and Adolescent Psychiatry, 1998; American Psychiatric Association, 1993, 1994, 1997; US Preventive Services Task Force, 2002).
  • 15. These guidelines prescribe how practitioners should assess and treat clients. Sometimes the guidelines are 328 RESEARCH ON SOCIAL WORK PRACTICE based on research findings, sometimes not; that is, often research studies are not available, and, therefore, the guidelines are based on “professional consensus.” Rosen and Proctor (2003) provide a review of practice guide- lines in social work. Recent research indicates that prac- tice guidelines are not yet widely used in routine social work practice (Mullen & Bacon, 2004). Accordingly, as with ESIs, attention is now turning to dissemination and implementation strategies. IMPLEMENTATION In this section, we describe the context of implemen- tation, we distinguish between dissemination and imple- mentation, we describe strategies for dissemination and implementation of EBP and ESIs, and we conclude with comments on what is reported regarding the effective- ness of implementation strategies, including attempts to specify explanatory concepts and processes. Implementation in Context Knowledge creation, diffusion, utilization, and imple- mentation as areas of study and application were exten- sively developed in the last half of the 20th century (Glaser, Abelson, & Garrison, 1983; Rogers, 1995). It was in this larger framework that much of the work on implementation theory and research was developed in social work (Rothman & Thomas, 1993). Now, imple-
  • 16. mentation can be considered to be one component of a larger area of study sometimes referred to as knowledge management, a discipline that has emerged focusing on how organizations can generate, communicate, and leverage their intellectual assets (Harvard Business Review, 1998). Rogers (1995) considers any idea, object, or practice perceived as new by organizational stake- holders as an innovation. Because EBP and ESIs can be considered innovations when applied to social work, valuable insights can be gained from the extensive literature examining implementation of innovations. Accord- ingly, there is an extensive literature pertaining to the adoption, diffusion, utilization, and implementation of innovations to draw on when considering how EBP and ESIs might be effectively implemented in social work (Rogers, 1995). Distinguishing Between Dissemination and Implementation In this article, we are most interested in the implemen- tation of EBP and ESIs. However, there is a close link between efforts to disseminate and efforts to implement EBP and ESIs. Although this article focuses on implemen- tation, because of the close link with dissemination, we comment on dissemination to provide a broader context. An NIMH (2005) program announcement calling for research on dissemination and implementation of EBP (including ESIs and practice guidelines) clarifies how these two processes differ. That announcement describes dissemination as the targeted distribution of information and intervention materials to a specific practice audience. The intent is to spread knowledge and the associated interventions. Implementation, in contrast, is described as
  • 17. the use of strategies to introduce or change interventions within specific settings. Implementation efforts must go beyond dissemination if they are to penetrate and change service delivery practices. Previous efforts in dissemina- tion research have often been carried out under the assumption that interventions can be transferred into ser- vice settings without modification and that a unidirec- tional flow of information (e.g., publishing a guideline or manual) is sufficient to achieve practice change. Success of the transfer has been largely assessed based on struc- tural measures (e.g., counts of personnel or contacts) or other outcome measures that do not specifically assess how the intervention was implemented or whether the implementation maintained fidelity to the original con- ceptualization and intent of the intervention. How inter- ventions or models of practice can be transported to real-world practice settings is an implementation ques- tion. Conceptual frameworks that take into account the resources of local settings and the needs of multiple stakeholders are required to create and monitor success- ful implementation strategies. Unfortunately, to date, efforts made to develop and test the outcomes of interventions far outweigh efforts to determine effective strategies for implementation of these interventions in practice contexts (Corrigan, Steiner, McCracken, Blaser, & Barr, 2001). STRATEGIES FOR DISSEMINATION AND IMPLEMENTATION Previously, we have described five broad strategies for dissemination and implementation of EBP and ESIs: (a) the teaching model, (b) direct implementation of ESIs, (c) a model combining evidence and stakeholder consensus, (d) combining staff training and organiza-
  • 18. tional development, and (e) development of professional infrastructure as agent (Mullen, Bellamy, & Bledsoe, 2005). Next, each of these is described as adapted from Mullen et al. (2005). Mullen et al. / IMPLEMENTING EVIDENCE-BASED PRACTICE 329 Teaching Model The EBP framework described above stresses an approach to implementation that primarily relies on teach- ing individual practitioners the evidence-based process in the context of formal education. Emphasis is on enhanc- ing professional motivation to engage in lifetime learning and the teaching of necessary learning and application skills. As described above, this model is most often applied to individuals wishing to learn the process of EBP. As previously stated, this evidence-based approach first emerged as the clinical problem-based learning strategy that had been developed during the 1970s and 1980s at the McMaster Medical School (Evidence-Based Medicine Working Group, 1992; Guyatt, 1991; Rosenberg & Donald, 1995). This approach involves teaching individ- ual professionals specific skills to convert information needs into search questions, to conduct efficient evi- dence searches, to correctly appraise evidence quality and strength, to integrate the information found, to self-evaluate how well the prior steps were conducted and methods for improving these steps in the future, and to teach others how to do EBP. More recently, emphasis has been placed on teaching skills for the integration of information from research evidence, client preferences and actions, and knowledge of the client’s state and circumstances. In addi-
  • 19. tion when practitioner motivation for engaging in EBP is absent, a first step in the teaching process is enhancing motivation for EBP. In social work, this approach is reflected in the work of Gambrill (2006) and Gibbs (2003). In these approaches, students and professionals are taught critical thinking and EBP knowledge, attitudes, and skills. Implementation of EBP is seen as closely intertwined with the use of effective teaching methods. Accordingly, in the classic evidence-based medicine text Evidence- Based Medicine: How to Practice and Teach EBM, Straus et al. (2005) include extensive information about their experience with effective and ineffective EBP teaching methods. They observe, From what we’ve done, seen or heard about, we’ve noticed that although there may be as many ways to teach EBM as there are teachers, most of these methods fall into one of three categories or teaching modes: role-modeling evidence-based care; teaching clinical medicine using evidence; and teaching specific EBM skills. (p. 200) Although all three modes reportedly are useful, they note, “We find that using evidence in our practice and teaching (Modes 1 and 2) gives us more legitimacy and realism when we teach our learners about the specific EBM skills (Mode 3)” (p. 202). Straus et al. describe techniques for teaching EBP in different settings, cur- ricula areas, and educational events. We were struck with Straus et al.’s (2005) observation that, in spite of the fact that EBM has been taught for nearly 30 years and that these authors are among the most experienced of the teachers, little is known (based on
  • 20. research) about how to effectively teach EBM. In their introduction to the teaching methods chapter, they write, We’d like to draw upon high-quality evidence from educa- tional research to guide our recommendations about what works and what doesn’t in teaching EBM. However, little research has been conducted to date on how best we can teach the knowledge, attitudes, and skills of practicing and teaching EBM. Thus, the suggestions in this chapter are primarily based on the teaching experiences we’ve had ourselves or col- lected from others. (p. 200) Although Straus et al. discuss variations in teaching methods depending on setting, this is restricted to teach- ing medical residents rotating through inpatient services and outpatient clinics. There is a notable lack of attention to teaching EBP outside of these formal educational con- texts, such as in community settings and human service agencies. It is for this reason that we undertook a small- scale, exploratory pilot study that sought to implement in three social service organizations aspects of the teaching approach to implementation of EBP. In this study, our aim was to examine the feasibility of teaching experienced social work professionals the philosophy and process of EBP in the day-to-day context of organizational practice. Lessons learned from this experience are incorporated into our concluding discussion of promising strategies for implementing EBP in social work. Direct Implementation of ESIs A second dissemination and implementation strategy with widespread support in the United States is some- times called the Top Down strategy. As noted by Walter, Nutley, and Davies (2005), two major approaches to dis- semination and implementation of best practices have
  • 21. been used, namely, macro and micro, or what we call top- down and bottom-up strategies. In top-down strategies, findings are disseminated for use by frontline practition- ers through agency directives, guidelines, manualized interventions, accreditation requirements, algorithms, tool kits, and so forth. In this approach, specialized tools are developed, such as application kits, manuals, and guidelines, with the specific purpose of using these tools while engaging in broad-scale efforts to disseminate and facilitate local adoption of specific practices that have been identified without direct initial input from agencies 330 RESEARCH ON SOCIAL WORK PRACTICE or practitioners. Instead, stakeholder groups are asked to sign on to and support training in these techniques. National- and state-level efforts have been under- taken to disseminate and support implementation of ESIs (e.g., Carpinello, Rosenberg, Stone, Schwager, & Felton, 2002; Chorpita et al., 2002; Drake et al., 2001; Magnabosco, 2006; National Institutes of Health, 2004; Tanenbaum, 2005). The Implementing Evidence-Based Practice Project (Mueser, Torrey, Lynde, Singer, & Drake, 2003) is promoting adoption of six specific EBPs for assisting mentally ill adults. Magnabosco (2006, p. 1) reports results of an effort to identify and classify state-level implementation activities and strategies employed across the eight states participating in the Evidence-Based Practices Project. Since 2001, the EBP Project has been investigating the implementation of evidence-based mental health practices in state public mental health systems for adult persons with serious mental illness. She notes that
  • 22. a key objective of the Project has been to collect data that help to better understand barriers and facilitators to the implemen- tation of ESIs in mental health service delivery, as well as how stakeholders in community-based and state agencies interact to implement, achieve and sustain evidence-based service delivery cultures. (p. 4) As noted by Magnabosco, the project has yielded “valu- able insights into implementation strategy characteristics and effectiveness” (p. 1). Nevertheless, the effectiveness of the top-down strategy remains to be demonstrated, especially in the context of social work organizations. This implementation strategy has been carefully reviewed by Fixsen et al. (2005). Based on their com- prehensive review of implementation research, Fixsen et al. propose that this implementation strategy, to be successful, should involve identifiable phases, including (a) exploration and adoption, (b) program installation, (c) initial implementation, (d) full operation, (e) innova- tion, and (f) sustainability. They suggest that implemen- tation should begin with a deliberate and careful selection of qualified practitioners, training in the core components of the ESI, continuing consultation and sup- port as the ESI is being implemented, evaluation of prac- titioner performance, program evaluation to determine if intended outcomes are being achieved with the clients receiving the new ESI, ongoing provision of facilitative administrative supports needed for implementation, and purposeful intervention into the environmental systems to support delivery of the ESI. These core components are viewed as integrated and compensatory. This means that should one core component be weak, such as pre- service training, it is possible that another component
  • 23. can make up the shortfall, for instance, by increasing consultation and coaching during service delivery. These authors view successful implementation to be a function of interrelated, multilevel influences emanating from the larger environment, the agency, and the core implemen- tation components themselves. Although the effectiveness of the top-down strategy remains to be demonstrated, especially in the context of social work organizations, recent work on the availability, responsiveness and continuity (ARC) model described by Glisson and Schoenwald (2005) offers an innovative orga- nizational and community intervention option intended to support the top-down implementation of multisystemic therapy (MST), a well-tested ESI. Glisson and Schoenwald have demonstrated some success with this model, which is guided by three principles: (a) implementation of ESIs is a social and a technical process, (b) mental health ser- vices are embedded in layers of context that include indi- vidual providers, organizations, and the community, and (c) effectiveness is determined by the fit between the orga- nization and the core technology. The ARC employs change agents at the organizational and interorganiza- tional levels to address barriers to fit prior to, during, and following implementation of the ESI. Although this model has not been widely applied, it is currently being tested in a National Institutes of Health–funded random- ized, controlled trial comparing MST alone to the MST and ARC combined approach (Glisson & Schoenwald, 2005). Results from earlier studies suggest that the inter- vention can improve organizational climate and reduce case manager turnover (Glisson, Dukes, & Green, 2006). Combining Evidence and Stakeholder Consensus The third strategy modifies the Top Down approach
  • 24. by combining evidence (e.g., in ESIs) with stakeholder consensus in an attempt to deal with the absence of evi- dence when dealing with complex social problems and the context that must be taken into account when seeking local applications. An example is the Texas Benefit Design Initiative (Cook, 2004). This is a hybrid strategy designed to deal with gaps in empirically based knowl- edge about effective interventions, the unevenness of knowledge about how best to implement interventions, the need to involve stakeholders in decision making, especially in the context of limited resources, and the need to adapt knowledge to local conditions. The project sought to combine best evidence with community con- sensus in designing a package of psychosocial rehabili- tation services for people using public mental health services. Experts in six areas of service reviewed the evi- dence in each area and presented their findings at 2-day Mullen et al. / IMPLEMENTING EVIDENCE-BASED PRACTICE 331 consensus conferences that included more than 200 citi- zens from Texas. On the second day of the conference, a consensus panel of 40 of these individuals met to delib- erate the quality of the evidence regarding each service area and what was known about implementation issues. Based on this deliberation, the consensus panel formu- lated service package principles and recommendations for service package organization and implementation. The consensus panels included stakeholder group repre- sentatives from consumer and family organizations, ser- vice providers and provider groups, advocates, state-level administrators, researchers, and other interested parties. Pilot sites in four Texas regions were formed, and a
  • 25. second-level consensus meeting was held in each of the sites to review the principles and recommendations developed during the first phase. These local consensus groups then formulated specific benefit package designs for local application (Cook, 2004). This is a complex strategy addressing many aspects of the implementation process. It would appear to have many promising features when feasible. Nevertheless, follow-up data are required to assess the long-term effec- tiveness of this implementation strategy. Combining Staff Training and Organizational Development We have described above the teaching of EBP as one approach to implementation of EBP. When the EBP framework is applied to work in organizations, it is gen- erally recognized that implementation strategies must go beyond the teaching of individual staff members. In addi- tion, the organizational context must be addressed. For example, at the policy and management levels of applica- tion, Gray (2001) identifies two key interrelated objec- tives that must be achieved for successful implementation of evidence-based health care, namely development of individual skills for performance of evidence-based processes (policy makers, managers, etc.) and develop- ment of the culture, systems, and structures within orga- nizations supporting evidence-based processes. Gray argues that implementation strategies must be directed toward achievement of both objectives. Similarly, Panzano and Herman (2005, p. 245) see an organization’s adoption of an ESI as a three-phase process: an initiation phase (awareness of a need, problem, opportunity; search for solutions; evaluation of potential solutions for fit); a deci- sion to implement the ESI, and an implementation in
  • 26. which a plan is developed and the innovation is ultimately routinized and assimilated. Reflecting this implementa- tion strategy, two approaches emphasize a combined approach involving both staff training and organizational development using teams. Interactive staff training. The first, interactive staff training, has been developed by Patrick Corrigan and Stanley McCracken (1997). When this model is applied to EBP dissemination and implementation, the primary task is staff training, which results from the interaction of educational and organizational approaches. Here, the educational approaches derive from learning theory and are designed to help individual practitioners acquire the principles and skills of EBP (McCracken & Corrigan, 2004). Organizational approaches “teach individual staff members how to work as a team and develop evidence- based treatment programs that are user-friendly and meet consumer needs” (Corrigan & McCracken, 1997, p. 250). The educational and organizational interventions are interactive in this model. Based on this model and their review of the literature, McCracken and Corrigan propose a number of guidelines for disseminating and adopting EBP innovations. Although they identify many specific practice options, there are five principles: (a) engage and prepare the organization, (b) form a working alliance with the treatment team, (c) develop a user-friendly program based on identified program-development priorities and the innovation, (d) use established educational principles in training, and (e) implement the program in a stepwise manner and plan for maintenance (pp. 245-246). Related to this approach is the work of Johnson and Austin (2006), who note that one of the challenges fac- ing efforts to incorporate research evidence into organi-
  • 27. zational practice is the absence of “an evidence-based organizational culture within human service agencies” (p. 75). They identify multiple strategies and case examples for creating such an organizational culture. They cite three strategies for incorporating evidence into organizational cultures: (a) agency-university part- nerships to identify the data to support EBP, (b) staff training (in the agencies and on campuses) that features problem-based learning approaches to support the intro- duction and utilization of EBP, and (c) the modification of agency cultures to support and sustain EBP. Outcomes and objectives orientation. The second approach, which combines practitioner training and orga- nizational development, is proposed by Aaron Rosen and Enola Proctor (2003). In this approach, practitioners are trained to use a critical-thinking process in which they learn to specify outcomes sought, intermediate objectives to be achieved so as to attain these outcomes, and self- evaluation skills (Rosen, 1993). Having learned these 332 RESEARCH ON SOCIAL WORK PRACTICE processes, practitioners are prepared to critically and selectively use the ESIs and practice guidelines that are made available to them by the agency. In addition, orga- nizational barriers and necessary organizational supports are identified and addressed as part of the implementation strategy. Implementation of this approach requires a series of steps: 1. Select a social work organization providing direct ser- vices to clients;
  • 28. 2. Work with administrators, supervisors, practitioners to identify important and frequently sought client outcomes; 3. Search and identify ESIs appropriate to achieving those agency selected outcomes; 4. Train practitioners how to use these ESIs; 5. Train practitioners in an approach to practice that is prob- lem focused, outcomes oriented, intervention specific, evaluated; 6. Practitioners apply ESIs as appropriate for individual client situation, values, preferences, and resources. This implementation strategy has benefited from research conducted by Rosen, Proctor, and colleagues. In addition, it is our understanding that this approach to implementation is now being used and evaluated at the George Warren Brown School of Social Work, Washington University (Edmond, Megivern, Williams, Rochman, & Howard, 2006; Howard, McMillen, & Pollio, 2003). Evidence regarding the effectiveness of this strategy is awaited. Professional Infrastructure as Agent The fifth approach focuses more broadly on the social work profession itself. Proctor (2004) describes a con- ceptual framework based on the position that for EBP and ESIs to be successfully implemented in social work as a profession, the professional infrastructure—including the research community, schools of social work, practice organizations—must focus on achieving multiple, com- ponent intermediate outcomes:
  • 29. 1. Identification and access of relevant and appropriate ESIs 2. Acceptance of the evidence and a decision to adopt ESIs 3. Implementation of ESIs 4. Evaluation of their usefulness Proctor’s concern is with how these objectives can be achieved across the profession. In the Proctor model, leverage points or potential interventions for attaining these intermediate outcomes are proposed. These inter- ventions are specific to three areas of the practice infra- structure: (a) research, (b) training, and (c) organizational culture. For example, to attain the first outcome (identifi- cation and access of relevant and appropriate ESIs), Proctor proposes, • The research infrastructure needs to produce ESIs, user- friendly packaging of evidence, and ways to disseminate. • The training infrastructure needs to provide evidence- based professional curricula. • The organizational culture infrastructure needs to pro- vide for electronic or on-site materials, make accessible evidence-informed supervisors, and create interpersonal linkages to researchers. Proctor bases her model on theories and research about diffusion of innovations, knowledge utilization, quality improvement, and Prochaska and Di Clemente’s (1983) stages of change model. This strategy is by far the most ambitious and comprehensive approach to implementa- tion of EBP and ESIs. It is specifically focused on social work and may serve as an important framework for the profession’s consideration of a comprehensive implemen- tation strategy.
  • 30. WHAT IMPLEMENTATION STRATEGIES ARE EFFECTIVE? Having identified various strategies for disseminating and implementing EBP and ESIs, we now examine what is known about the effectiveness of implementation strategies. Gira, Kessler, and Poertner (2004) provide an overview of research reviews examining strategies to influence health care providers to use research evidence in their practice. Their purpose was to draw out lessons for social work and to foster the use of EBP and ESIs in social work from what had been learned in medicine and health care. They identified and summarized 12 reviews that exam- ined a wide range of interventions, including distribution of printed educational materials (n = 11), continuing educa- tion (n = 32), educational outreach visits (n = 18), use of local opinion leaders (n = 9), audit and feedback (n = 37), physician profiling–peer feedback (n = 12), feedback and reminders (n = 26), continuous quality improvement (n = 55), general practitioner computing (n = 30), com- puterized information services (n = 100), computer-based clinical decision support systems (n = 68), and mass media interventions (n = 17). These authors conclude, “The literature from health care suggests that dissemi- nating information alone is insufficient. Many interven- tions have been designed to improve practitioners’ adherence to EBP guidelines and are differentially effec- tive. To date, no intervention has demonstrated powerful effects” (pp. 77-78). These authors conclude that multiple strategies are needed, rather than relying on any single approach. This conclusion is consistent with the position taken in 2001 by Grimshaw et al.
  • 31. Mullen et al. / IMPLEMENTING EVIDENCE-BASED PRACTICE 333 Walter et al. (2005) set out to identify the core compo- nents that can be said to influence implementation out- comes. In accord with Pawson’s (2002) work, these authors have proposed that it is not the implementation interventions per se that are of importance, but rather it is the underpinning reasons or resources they offer that explain implementation results. “It involves hypothesising the underlying mechanism or basic theories about how an intervention works” (Walter et al., 2005, p. 336). These authors present an update of their earlier review of the effectiveness of different mechanisms for the promotion of research use across the health, social care, criminal jus- tice, and education sectors. Six mechanisms were identi- fied and the evidence supporting each was examined using a narrative, qualitative approach to the analysis. The Walter et al. (2005) review focuses on specific mechanisms that have been studied, but it does not place them in an organized conceptual framework. Mechanisms for research use include (a) dissemination or the simple distribution of research findings, (b) interaction that cre- ates links between researchers and practitioners, (c) social influence using influential others to encourage research uptake, (d) facilitation by providing tangible support for the use of research, (e) reinforcement through feedback and rewards to encourage research use, and (f) multifac- eted interventions that deploy multiple mechanisms. They concluded that, under some circumstances, each of these mechanisms can be expected to have some effect on either conceptual or instrumental implementation. However, it appears that the evidence is thin and, at best, suggestive. The two most promising mechanisms would appear to be
  • 32. interaction and facilitation. Following a comprehensive review of the literature related to innovations in service organizations drawing from diverse disciplines, Greenhalgh, Robert, Macfarlane, Bate, and Kyriakidou (2004), like Walter et al. (2005), rec- ommend that the next generation of research should be theory driven and focus on explicit hypotheses that link interventions and outcomes, or the mechanisms that are responsible for success or failure in a particular context. These authors further propose a complex conceptual model of innovation, including implementation and the processes that must precede implementation through a complex exchange through linkages among resource sys- tems, knowledge purveyors, change agencies, and the user system. Johnson and Austin (2006) note that one of the chal- lenges facing efforts to incorporate research evidence into organizational practice is the absence of “an evidence- based organizational culture within human service agen- cies” (p. 75). They identify multiple strategies and case examples for creating such an organizational culture. They cite three strategies for incorporating evidence into organizational cultures: (a) agency-university partner- ships to identify the data to support EBP, (b) staff train- ing (in the agencies and on campuses) that features problem-based learning approaches to support the intro- duction and utilization of EBP, and (c) the modification of agency cultures to support and sustain EBP. Fixsen et al. (2005) report the most comprehensive review and synthesis of EBP and ESI implementation strategies to date. Their conclusions are in general agree- ment with those of Gira et al. (2004). Fixsen et al. are
  • 33. skeptical about the utility of strategies that primarily or exclusively rely on dissemination of practice guidelines, policy statements, or educational information or that exclusively rely on practitioner training. They argue for longer-term, multilevel implementation strategies and the need for more research to identify the functional compo- nents or core implementation mechanisms (p. 26). AN IMPLEMENTATION PILOT STUDY Recently, we have completed a small-scale pilot study examining implementation of EBP in three New York City social agencies. This study was designed to examine questions about how social work organizations and practitioners can be helped to engage in EBPs. Because of the value of comparison across sites, we have set out to build that comparison by including three quite different social work agencies. Design The study used a social intervention research methodology, providing for a process of intervention design, piloting, and redesign based on feedback (Rothman & Thomas, 1993). Four sequential phases were implemented. In Phase 1, background research was conducted to inform the development and design of the dissemination project. This included conducting a literature review to find what is known about dissemi- nation and implementation strategies and interviewing local research experts who were actively engaged in dis- seminating and/or implementing EBP. The results of the literature review and interviews have been reported (Bellamy, Bledsoe, & Traube, 2006). In Phase 2, exploratory meetings with administrators
  • 34. of potential social work agency partners were conducted to determine interest in collaboration. Also, included in this phase were interviews with social work practition- ers in those agencies to explore their current knowledge of EBP, what would motivate them to engage in EBP, 334 RESEARCH ON SOCIAL WORK PRACTICE how they would like to learn EBP, and what they per- ceive to be barriers to learning and implementing such practice. Three agencies were selected to participate in the study. Agencies partnered with the university-based research team to design the intervention using agency practice staff, administrator knowledge, and data col- lected from Phase 1. The results of this phase have been reported (Mullen et al., 2005). In Phase 3, the research team, together with agency administrators, supervisors, and clinicians, implemented, monitored, adjusted, and evaluated the intervention. The intervention was the process designed and agreed to by all participants in the partnership for disseminating and imple- menting EBP within a specific area of the agency program selected by the agency team. The results of this phase will be reported in several publications in preparation. Phase 4, which will occur after we have completed the analysis, will include modifications of the interven- tion based on the evaluative process and findings. During Phase 4, the information from the evaluation will be used to propose ways in which the program intervention, the implementation strategy, and the eval- uation design should be modified for future applica- tions. This phase will also include formal reporting of
  • 35. project findings. Although we have not yet completed all of our planned analyses, we draw from our experiences in this section to describe the implementation strategy used and to identify lessons learned. Implementation Strategy The strategy that we adopted for use in this pilot emerged from a careful review of the literature, inter- views with experts (Phase 1), discussions with agency staff, and considerations of the research team resources. The outcomes and objectives strategy as described above was our original point of departure (Rosen, 1993). This strategy had been suggested to us by Rosen and Proctor during the initial planning stages. Also, we had favorable experiences with the teaching strategy outlined above. We had been using this method teaching graduate social work students the assumptions, values, and skills of EBP using the text authored by Leonard Gibbs (2003). It seemed to us that our students liked the framework and showed that they were able to learn the skills within the context of a 7-week course meeting once a week for 2 hours (Mullen et al., in press). However, we were mindful that our students expressed frustration because they were not able to use EBP learned in the classroom in their field practicum assignments because of lack of agency staff understand- ing and support. As described above, this teaching was restricted to Mode 3 (didactic, classroom-based skills training) and did not use Modes 1 and 2 (role-modeling EBP and teaching practice using evidence).
  • 36. In our discussions with agency staff, it became clear that they had negative experiences with funding and reg- ulatory agencies’ attempts to impose ESIs on agency practice. There was no interest in the top-down approach as described above or in the research team taking respon- sibility for identifying ESIs for the practitioners to learn (as is the case for the objectives and outcomes strategy described above). It became clear as well that the agency administrators and supervisors preferred learning EBP in teams rather than one-on-one. Teams were seen as a way to capitalize on each other’s competencies and perspec- tives and a way to share the learning burden. Teams also expressed an organizational commitment rather than indi- vidual practitioner commitments. In our explorations with the agencies, the implementa- tion strategy most desired by the agencies needed to combine staff training and organizational development, approximating the principles articulated above under the interactive staff-training strategy (Johnson & Austin, 2006; McCracken & Corrigan, 2004). Our focus became primarily staff training directed at helping individual practitioners acquire the principles and skills of EBP using a team approach so as to develop evidence-based treatment programs that are user-friendly and meet con- sumer needs (McCracken & Corrigan, 2004). We adopted the strategies proposed by Johnson and Austin (2006) for incorporating evidence into organizational cultures: (a) agency-university partnerships to identify the data to sup- port EBP, (b) staff training that features problem-based learning approaches to support the introduction and uti- lization of EBP, and (c) modification of agency cultures to support and sustain EBP. Lessons Learned—First Impressions
  • 37. We plan to report results of this pilot study in future publications, with attention to implementation of the team format and the specific skills-training modules. The train- ing modules and training resources developed for this pilot are available at http://www.columbia.edu/cu/musher/. We will report baseline data that describe practitioner attitudes toward and understanding of EBP and ESIs and practi- tioner use of research. We will report posttraining data specifying changes in baseline variables, practitioner assessment of the training program modules, and inten- tions to use EBP in the future. Mullen et al. / IMPLEMENTING EVIDENCE-BASED PRACTICE 335 Here, we briefly and impressionistically comment about our experiences as these pertain to the implemen- tation strategies described above. • Our prior experience (prepilot study), which involved teaching graduate social work students EBP, showed that Mode 3 teaching is very effective in creating an under- standing of EBP and providing an introduction to EBP skills. However, it is a limited strategy for developing EBP skills because of the lack of practicum application oppor- tunities in real-world practice contexts. As Weissman et al. (2006) have argued, the gold standard for training in the use of ESIs is a combination of class and practicum train- ing (Modes 1, 2, and 3). It is doubtful that didactic class- room teaching of EBP alone will provide depth or sustainability of EBP. • The pilot study suggests that the top-down implementa- tion strategy generally does not work unless prior training
  • 38. using the EBP teaching strategy is provided. In our expe- rience, practitioners wanted and needed to develop skills in critical assessment and develop motivation for EBP before they would consider adopting an ESI. However, we found that by the end of the program, practitioners were rather highly motivated to identify (or have identi- fied for them) specific ESIs and to receive training in their use as relevant to their practice context. This suggests that the top-down approach may be a very effective imple- mentation strategy if it is preceded by attention to train- ing in EBP and organizational intervention. • The university-agency partnership used in this pilot was highly regarded by all. Indeed, some of the practitioners viewed on-going partnerships as essential to sustain EBP in the agencies. University staff members were seen as facilitators, especially in terms of bringing expertise in research retrieval and assessment to the agency teams. • Related to the above was the general sense expressed by nearly all team members that although it was useful to train practitioners in the skills of research retrieval and assess- ment, this was not a realistic expectation in terms of what could be expected in routine practice. The reasons expressed were that most practitioners do not have nor necessarily want to acquire the research knowledge and skills needed to critically appraise the research literature. And even for those who do have the skills, adequate time is not available, and access to fee-based Internet databases is limited. Our experiences suggest that all of the implementation strategies described above have a place so long as they are appropriately sequenced and adapted to local circum- stances. Proctor’s professional infrastructure as agent is a broad implementation framework that brings these strate- gies together, suggesting that for the social work profes-
  • 39. sion to adopt EBP and ESIs, there needs to be system change. CONCLUSION We hesitated to report our pilot study research in this article because it has many limitations and it can not be considered representative. However, we decided to include a brief overview because so little empirical research has been published in social work evaluating implementation of EBP or ESIs. Research is needed to evaluate the implementation strategies described above. Little is currently known about their relative effective- ness. Fixsen et al. (2005) report, “While it is encouraging to see some examples of experimental research on imple- mentation strategies, the few examples pale in compari- son to the need for clear and effective strategies to move science to service and transform human service systems nationally” (p. 21). If the objective of research is to identify implementa- tion strategies that work, then attention must be given to separating the examination of the implementation inter- vention from the intervention program being implemented. Fixsen et al. (2005) have described implementation as a set of activities designed to put into practice a well-defined activity or program. Implementation processes are pur- poseful and described in sufficient detail to allow inde- pendent observers to detect the presence and strength of the specific set of implementation activities. When con- ducting implementation research, two sets of activities and outcomes need to be defined and conceptually differenti- ated. The first set of activities and outcomes pertains to the EBP or ESI being implemented, namely the intervention- level activity and outcomes of that activity. The second set
  • 40. of activities and outcomes is those associated with the effort to implement the chosen intervention, namely the implementation-level activity and outcomes. These two sets of activities and outcomes are linked but are driven by unique theoretical frameworks and similarly require independent research and evaluation. Klein and Sorre (1996) distinguish between implementation effectiveness and innovation effectiveness measures. A similar idea is reflected by Panzano and Herman (2005) when they note that implementation effectiveness is indicated by the accu- rate, committed, and consistent use of a practice by practi- tioners (e.g., fidelity and assimilation), whereas innovation effectiveness is measured by the benefits that accrue to stakeholders (improved outcomes attributable to the innovation). A major problem facing those attempting to imple- ment EBP and ESIs is the absence of an integrating con- ceptual framework that would facilitate a better understanding of what is involved when planning imple- mentation. Greenhalgh et al. (2004) conclude that implementation studies to date have taken a pragmatic rather than an academic approach, are difficult to distin- guish from research on change management generally, and lack sufficient process information. They recom- mend that future implementation research focus on the question, “By what processes are particular innovations 336 RESEARCH ON SOCIAL WORK PRACTICE in health service delivery and organization implemented and sustained (or not) in particular contexts and settings, and can these processes be enhanced?” (p. 620). These researchers suggest that what is needed is in-depth,
  • 41. mixed-methodology studies aimed at both process and impact. There is a special need for research that will specify and test the core implementation components and processes such as those proposed in prior research, but there is a need to further develop and empirically test the validity and efficacy of these nascent models. Indeed Fixsen and his colleagues (2005) proposed 15 hypotheses for further research that, if studied, would help to further specify the core components as they are conceptualized in their model. The recently released program announcement from the NIMH (2005), which calls for dissemination and implementation research, lists illustrative questions that need to be addressed. These questions focus on analysis of factors influencing the creation, packaging, transmis- sion, and reception of valid health research knowledge, ranging from psychological and sociocultural factors affecting individual practitioners, consumers, primary caregivers, and other stakeholder groups to investiga- tions addressing large service-delivery systems and funding sources. Many different studies that are needed to further develop the nascent field of EBP implementa- tion research are outlined in the program announcement. Indeed, NIMH is assigning significant resources to dis- semination and implementation research. According to the report The Road Ahead, 24 grants totaling nearly $6 million were awarded in fiscal year 2005 to investigate theory-based and empirically supported models of dis- semination and implementation, which represented approximately 11% of research funding through the Clinical Epidemiology Branch, Division of Services and Intervention Research (U.S. Department of Health and Human Services, 2006, p. 37).
  • 42. EBP and the use of ESIs in social work seem to be gaining momentum. It is likely that both developments will be on social work’s agenda in the years ahead. How these new practice forms can best be implemented in social work education and practice remains an open question until further research is reported. Alternative implementation strategies are now available for use, but little is known about how they can be used singly or in combination to achieve intended outcomes with mini- mal harm to the profession and clients. NOTE 1. This section is adapted from Mullen, Bellamy, and Bledsoe (in press). REFERENCES American Academy of Child and Adolescent Psychiatry. (1998). Practice parameter for the assessment and treatment of children and adolescents with depressive disorders. Journal of the American Academy of Child Adolescent Psychiatry 37, 63-83. American Psychiatric Association. (1993). Practice guideline for major depressive disorder in adults. American Journal of Psychiatry, 150, 1-26. American Psychiatric Association. (1994). Practice guideline for the treatment of patients with bipolar disorder. American Journal of Psychiatry, 151, 1-36.
  • 43. American Psychiatric Association. (1997). Practice guideline for the treatment of patients with schizophrenia. American Journal of Psychiatry 154, 1-63. American Psychological Association. (2005). Report of the 2005 Presidential Task Force on Evidence-Based Practice. Washington, DC: Author. Barlow, D. H. (2004). Psychological treatments. American Psychologist, 59, 869-879. Bellamy, J., Bledsoe, S. E., & Traube, D. (2006). The current state of evidence based practice in social work: A review of the literature and qualitative analysis of expert interviews. Journal of Evidence- Based Social Work, 3(1), 23-48. Bledsoe, S. E., Weissman, M. M., Mullen, E. J., Betts, K., Gameroff, M. J., Verdeli, H., et al. (in press). Empirically supported psy- chotherapy in social work training programs: Does the definition of evidence matter? Research on Social Work Practice. Carpinello, S. E., Rosenberg, L., Stone, J., Schwager, M., & Felton, C. J. (2002). New York State’s campaign to implement evidence- based practice for people with serious mental disorders. Psychiatric Services, 53, 153-155.
  • 44. Chambless, D. L., Baker, M. J., Baucom, D. H., Beutler, L. E., Calhoun, K. S., Crits-Christoph, P., et al. (1998). Update on empir- ically validated therapies, II. The Clinical Psychologist, 51, 3- 16. Chambless, D. L., Sanderson, W. C., Shoham, V., Bennett Johnson, S., Pope, K. S., Crits-Christoph, P., et al. (1996). Update on empiri- cally validated therapies. The Clinical Psychologist, 49, 5-18. Chiles, J. A., Lambert, M. J., & Hatch, A. L. (2002). Medical cost off- set: A review of the impact of psychological interventions on med- ical utilization over the past three decades. In N. A. Cummings, W. T. O’Donohue, & K. E. Ferguson (Eds.), The impact of medical cost offset on practice and research (pp. 47-56). Reno, NV: Context Press. Chorpita, B. F., Yim, L. M., Donkervoet, J. C., Arensdorf, A., Amundsen, M. J., McGee, C., et al. (2002). Toward large-scale implementation of empirically supported treatments for children: A review and observations by the Hawaii empirical basis to services task force. Clinical Psychology: Science and Practice, 9, 165- 190. Cook, J. A. (2004). Blazing new trails: Using evidence-based practice and stakeholder consensus to enhance psychosocial rehabilitation services in Texas. Psychiatric Rehabilitation Journal, 27, 305-
  • 45. 306. Corrigan, P. W., & McCracken, S. G. (1997). Interactive staff train- ing: Rehabilitation teams that work. New York: Plenum. Corrigan, P. W., Steiner, L., McCracken, S. G., Blaser, B., & Barr, M. (2001). Strategies for disseminating evidence-based practices to staff who treat people with serious mental illness. Psychiatric Services, 52, 1598-1606. Drake, R. E., Goldman, H. H., Leff, H. S., Lehman, A. F., Dixon, L., Mueser, K. T., et al. (2001). Implementing evidence-based Mullen et al. / IMPLEMENTING EVIDENCE-BASED PRACTICE 337 practices in routine mental health service settings. Psychiatric Services, 52, 179-182. Drake, R. E., Merrens, M. R., & Lynde, D. (2005). Evidence- based mental health practice. New York: Norton. Duffy, M. (Ed.). (1999). Handbook of counseling and psychotherapy with older adults. New York: John Wiley. Edmond, T., Megivern, D., Williams, C., Rochman, E., & Howard, M. (2006). Integrating evidence-based practice and social work field education. Journal of Social Work Education, 42, 377-396.
  • 46. Evidence-Based Medicine Working Group. (1992). A new approach to teaching the practice of medicine. Journal of the American Medical Association, 268, 2420-2425. Field, M., & Lohr, K. (Eds.). (1990). Clinical practice guidelines. Washington, DC: National Academy Press. Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature (FMHI 231). Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network. Gambrill, E. (2006). Social work practice: A critical thinker’s guide (2nd ed.). New York: Oxford University Press. Gibbs, L. E. (2003). Evidence-based practice for the helping profes- sions: A practical guide with integrated multimedia. Pacific Grove, CA: Brooks/Cole-Thompson. Gira, E. C., Kessler, M. L., & Poertner, J. (2004). Influencing social workers to use research evidence in practice: Lessons from med- icine and the allied health professions. Research on Social Work Practice, 14, 68-79. Glaser, E. M., Abelson, H. H., & Garrison, K. N. (1983). Putting knowledge to use: Facilitating the diffusion of knowledge and
  • 47. the implementation of planned change. San Francisco: Jossey-Bass. Glisson, C., Dukes, D., & Green, P. (2006). The effects of the ARC organizational intervention on caseworker turnover, climate, and culture in children’s service systems. Child Abuse and Neglect, 30, 855-880. Glisson, C., & Schoenwald, S. K. (2005). The ARC organizational and community intervention strategy for implementing evidence- based children’s mental health treatments. Mental Health Services Research, 7, 243-259. Gray, J. A. M. (2001). Evidence-based healthcare (2nd ed.). New York: Churchill Livingstone. Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. The Milbank Quarterly, 82, 581-629. Grimshaw, J. M., Shirran, L., Thomas, R., Mowatt, G., Fraser, C., Bero, L., et al. (2001). Changing provider behavior: An overview of systematic reviews of interventions. Medical Care 39(8, Suppl. 2), 2-45.
  • 48. Guyatt, G. H. (1991). Evidence-based medicine. ACP (American College of Physicians) Journal Club, 114, A-16. Harvard Business Review. (1998). Harvard Business Review on knowledge management. Cambridge, MA: Author. Hess, M., & Mullen, E. J. (Eds.). (1995). Practitioner-research part- nerships: Building knowledge from, in, and for practice. Washington, DC: National Association of Social Workers Press. Hollon, S. D., Stewart, M. O., & Strunk, D. R. (in press). Do psy- chosocial interventions have enduring effects? Annual Review of Psychology. Howard, M. O., McMillen, C. J., & Pollio, D. E. (2003). Teaching evidence based practice: Toward a new paradigm in social work education. Research on Social Work Practice, 13, 234-259. Institute of Medicine. (2000). Crossing the quality chasm: A new health system for the 21st century. Washington, DC: National Academy Press. Johnson, M., & Austin, M. J. (2006). Evidence-based practice in the social services: Implications for organizational change. Administration in Social Work, 30(3), 75-104. Kazdin, A. E., & Weisz, J. R. (Eds.). (2003). Evidence-based psy- chotherapies for children and adolescents. New York: Guilford. Kirk, S. A. (1990). Research utilization: The substructure of
  • 49. belief. In L. Videka-Sherman & W. J. Reid (Eds.), Advances in clinical social work research (pp. 233-250). Washington, DC: National Association of Social Workers. Kirk, S. A., & Reid, W. J. (2002). Science and social work: A criti- cal appraisal. New York: Columbia University Press. Klein, K., & Sorre, J. S. (1996). The challenge of innovation imple- mentation. Academy of Management Reviews, 21, 1055-1080. Magnabosco, J. L. (2006, May 30). Innovations in mental health ser- vices implementation: A report on state-level data from the U.S. Evidence-Based Practices Project. Implementation Science, 1(13). McCracken, S. G., & Corrigan, P. W. (2004). Staff development in mental health. In H. E. Briggs & T. L. Rzepnicki (Eds.), Using evidence in social work practice: Behavioral perspectives (pp. 232-256). Chicago: Lyceum. Mills, E. J., Montori, V. M., & Guyatt, G. H. (2004). Evidence- based clinical practice. Brief Treatment and Crisis Intervention, 4(2), 187-194. Mueser, K. T., Torrey, W. C., Lynde, D., Singer, P., & Drake, R. E. (2003). Implementing evidence-based practices for people with severe mental illness. Behavior Modification, 27, 387-411. Mullen, E. J. (in press). Evidence-based policy & social work in
  • 50. healthcare. Social Work in Mental Health. Mullen, E. J., & Bacon, W. (2004). A survey of practitioner adoption and implementation of practice guidelines and evidence-based treatments. In A. R. Roberts & K. Yeager (Eds.), Evidence- based practice manual: Research and outcome measures in health and human services (pp. 210-218). New York: Oxford University Press. Mullen, E. J., Bellamy, J. L., & Bledsoe, S. E. (2005). Implementing evidence-based social work practice. In P. Sommerfeld (Ed.), Evidence-based social work—Towards a new professionalism? (pp. 149-172). Bern, Switzerland: Peter Lang. Mullen, E. J., Bellamy, J. L., & Bledsoe, S. E. (in press). Evidence- based social work practice. In R. M. Grinnell & Y. A. Unrau (Eds.), Social work research and evaluation: Quantitative and qualitative approaches (8th ed.). New York: Oxford University Press. Nathan, P. E., & Gorman, J. M. (2002). A guide to treatments that work. London: Oxford University Press. National Institute of Mental Health. (1999). Bridging science and service: A report by the National Advisory Mental Health Council’s Clinical Treatment and Services Research Workgroup. Bethesda, MD: Author. National Institute of Mental Health. (2005, October 25).
  • 51. Dissemination and implementation research in health (PAR-06-039). Bethesda, MD: Author. National Institutes of Health. (2004). State implementation of evidence-based practices: Bridging science and service. (NIMH and SAMHSA RFA MH-03-007). Retrieved November 19, 2004, from http://grants1.nih.gov/grants/guide/rfa-files/RFA-MH-03- 007.html Panzano, P., & Herman, L. (2005). Developing and sustaining evidence-based systems of mental health services. In R. E. Drake, M. R. Merrens, & D. Lynde (Ed.), Evidence-based mental health practice (pp. 167-187). New York: Norton. 338 RESEARCH ON SOCIAL WORK PRACTICE Pawson, R. (2002). Evidence-based policy: In search of a method. Evaluation, 8, 157-181. Prochaska, J. O., & Di Clemente, C. C. (1983). Stages and processes of self-change of smoking: Toward an integrative model of change. Journal of Clinical and Consulting Psychology, 5, 390-395. Proctor, E. K. (2004). Leverage points for the implementation of evidence-based practice. Brief Treatment and Crisis Intervention, 4(3), 227-242.
  • 52. Rogers, E. M. (1995). Diffusion of innovations (4th ed.). New York: Free Press. Rosen, A. (1993). Systematic planned practice. The Social Service Review, 67(1), 84. Rosen, A., & Proctor, E. (Eds.). (2003). Developing practice guide- lines for social work intervention: Issues, methods, and a research agenda. New York: Columbia University Press. Rosenberg, W., & Donald, A. (1995). Evidence based medicine: An approach to clinical problem-solving. British Medical Journal, 310(6987), 1122. Roth, A., & Fonagy, P. (2004). What works for whom? A critical review of psychotherapy research (2nd ed.). New York: Guilford. Rothman, J., & Thomas, E. J. (Eds.). (1993). Intervention research: design and development for the human services. New York: Haworth. Rubin, A., & Parrish, D. (in press). Views of evidence-based practice among faculty in MSW programs: A national survey. Research on Social Work Practice. Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., &
  • 53. Richardson, W. S. (1996). Evidence based medicine: What it is and what it isn’t: It’s about integrating individual clinical expertise and the best external evidence. British Medical Journal, 312, 71-72. Sackett, D. L., Straus, S. E., Richardson, W. S., Rosenberg, W., & Haynes, R. B. (2000). Evidence based medicine: How to practice and teach EBM (2nd ed.). New York: Churchill Livingstone. Straus, S. E., Richardson, W. S., Glasziou, P., & Haynes, R. B. (2005). Evidence-based medicine: How to practice and teach EBM (3rd ed.). Edinburgh, UK: Churchill Livingstone. Tanenbaum, S. J. (2005). Evidence-based practice as mental health pol- icy: Three controversies and a caveat. Health Affairs, 24, 163- 173. Torrey, W. C., & Gorman, P. G. (2005). Closing the gap between what services are and what they could be. In R. E. Drake, M. R. Merrens, & D. W. Lynde (Eds.), Evidence-based mental health services (pp. 167-188). New York: Norton. U.S. Department of Health and Human Services. (2006). The road ahead: Research partnerships to transform services. A report by the National Advisory Mental Health Council’s Workgroup on Services and Clinical Epidemiology Research. Bethesda, MD: National Institutes of Health, National Institute of Mental Health. US Preventive Services Task Force. (2002). Screening for
  • 54. depres- sion: Recommendations and rationale. Annals of Internal Medicine, 136, 760-764. Walter, I., Nutley, S., & Davies, H. (2005). What works to promote evidence-based practice? A cross-sector review. Evidence and Policy: A Journal of Debate, Research, and Practice, 1(3), 335- 364. Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H. (1997). A metaanalysis of outcome studies comparing bona fide psychotherapies: Empirically, “all must have prizes.” Psychological Bulletin, 122, 203-215. Weissman, M. M., & Sanderson, W. C. (2001). Promises and prob- lems in modern psychotherapy: The need for increased training in evidence-based treatments. In M. Hager (Ed.), Modern psychia- try: Challenges in educating health professionals to meet new needs (pp. 132-165). New York: Josiah Macy Jr. Foundation. Weissman, M. M., Verdeli, H., Gameroff, M. J., Bledsoe, S. E., Betts, K., Mufson, L., et al. (2006). National survey of psy- chotherapy training in psychiatry, psychology, and social work. Archives of General Psychiatry, 63, 925-934. Weisz, J. R., Hawley, K. M., & Doss, A. J. (2004). Empirically tested psychotherapies for youth internalizing and externalizing prob- lems and disorders. Child & Adolescent Psychiatric Clinics of North America, 13, 729-815.
  • 55. Yates, B. T. (1994). Toward the incorporation of costs, cost- effectiveness analysis, and costbenefit analysis into clinical research. Journal of Consulting and Clinical Psychology, 62, 729-736. Zarit, S. H., & Knight, B. G. (Eds.). (1996). A guide to psychotherapy and aging: Effective clinical interventions in a life-stage context. Washington, DC: American Psychological Association. << /ASCII85EncodePages false /AllowTransparency false /AutoPositionEPSFiles true /AutoRotatePages /None /Binding /Left /CalGrayProfile (Dot Gain 20%) /CalRGBProfile (sRGB IEC61966-2.1) /CalCMYKProfile (U.S. Web Coated 050SWOP051 v2) /sRGBProfile (sRGB IEC61966-2.1) /CannotEmbedFontPolicy /Error /CompatibilityLevel 1.3 /CompressObjects /Off /CompressPages true /ConvertImagesToIndexed true /PassThroughJPEGImages true /CreateJobTicket false /DefaultRenderingIntent /Default /DetectBlends true /DetectCurves 0.1000 /ColorConversionStrategy /LeaveColorUnchanged /DoThumbnails false /EmbedAllFonts true /EmbedOpenType false /ParseICCProfilesInComments true
  • 56. /EmbedJobOptions true /DSCReportingLevel 0 /EmitDSCWarnings false /EndPage -1 /ImageMemory 1048576 /LockDistillerParams true /MaxSubsetPct 100 /Optimize false /OPM 1 /ParseDSCComments true /ParseDSCCommentsForDocInfo true /PreserveCopyPage true /PreserveDICMYKValues true /PreserveEPSInfo true /PreserveFlatness true /PreserveHalftoneInfo false /PreserveOPIComments false /PreserveOverprintSettings true /StartPage 1 /SubsetFonts true /TransferFunctionInfo /Apply /UCRandBGInfo /Remove /UsePrologue false /ColorSettingsFile () /AlwaysEmbed [ true /ACaslon-Ornaments /AGaramond-BoldScaps /AGaramond-Italic /AGaramond-Regular /AGaramond-RomanScaps /AGaramond-Semibold /AGaramond-SemiboldItalic /AGar-Special /AkzidenzGroteskBE-Bold /AkzidenzGroteskBE-BoldIt /AkzidenzGroteskBE-It
  • 66. /FuturaBT-BoldItalic /FuturaBT-Book /FuturaBT-BookItalic /FuturaBT-ExtraBlack /FuturaBT-ExtraBlackCondensed /FuturaBT-ExtraBlackCondItalic /FuturaBT-ExtraBlackItalic /FuturaBT-Heavy /FuturaBT-HeavyItalic /FuturaBT-Light /FuturaBT-LightCondensed /FuturaBT-LightItalic /FuturaBT-Medium /FuturaBT-MediumCondensed /FuturaBT-MediumItalic /Futura-ExtraBold /Futura-ExtraBoldOblique /Futura-Heavy /Futura-HeavyOblique /Futura-Light /Futura-LightOblique /Futura-Oblique /GalliardITCbyBT-Italic /GalliardITCbyBT-Roman /Garamond-Antiqua /Garamond-BoldCondensed /Garamond-BoldCondensedItalic /Garamond-BookCondensed /Garamond-BookCondensedItalic /Garamond-Halbfett /GaramondITCbyBT-Bold /GaramondITCbyBT-BoldCondensed /GaramondITCbyBT-BoldCondItalic /GaramondITCbyBT-BoldItalic /GaramondITCbyBT-BoldNarrow /GaramondITCbyBT-BoldNarrowItal
  • 67. /GaramondITCbyBT-Book /GaramondITCbyBT-BookCondensed /GaramondITCbyBT-BookCondItalic /GaramondITCbyBT-BookItalic /GaramondITCbyBT-Light /GaramondITCbyBT-LightCondensed /GaramondITCbyBT-LightCondItalic /GaramondITCbyBT-LightItalic /GaramondITCbyBT-LightNarrow /GaramondITCbyBT-LightNarrowItal /GaramondITCbyBT-Ultra /GaramondITCbyBT-UltraCondensed /GaramondITCbyBT-UltraCondItalic /GaramondITCbyBT-UltraItalic /Garamond-Kursiv /Garamond-KursivHalbfett /Garamond-LightCondensed /Garamond-LightCondensedItalic /GaramondThree /GaramondThree-Bold /GaramondThree-BoldItalic /GaramondThree-Italic /GaramondThreeSMSspl /GaramondThreespl /GaramondThreeSpl-Bold /GaramondThreeSpl-Italic /GarthGraphic /GarthGraphic-Black /GarthGraphic-Bold /GarthGraphic-BoldCondensed /GarthGraphic-BoldItalic /GarthGraphic-Condensed /GarthGraphic-ExtraBold /GarthGraphic-Italic /Geometric231BT-HeavyC /GeometricSlab712BT-BoldA
  • 69. /GoudyOldStyleBT-Roman /GoudySans-Bold /GoudySans-BoldItalic /GoudySansITCbyBT-Bold /GoudySansITCbyBT-BoldItalic /GoudySansITCbyBT-Medium /GoudySansITCbyBT-MediumItalic /GoudySans-Medium /GoudySans-MediumItalic /Granjon /Granjon-Bold /Granjon-BoldOsF /Granjon-Italic /Granjon-ItalicOsF /Granjon-SC /GreymantleMVB-Ornaments /Helvetica /Helvetica-Black /Helvetica-BlackOblique /Helvetica-Black-SemiBold /Helvetica-Bold /Helvetica-BoldOblique /Helvetica-Condensed /Helvetica-Condensed-Black /Helvetica-Condensed-BlackObl /Helvetica-Condensed-Bold /Helvetica-Condensed-BoldObl /Helvetica-Condensed-Light /Helvetica-Condensed-LightObl /Helvetica-Condensed-Oblique /Helvetica-Light /Helvetica-LightOblique /Helvetica-Narrow /Helvetica-Narrow-Bold /Helvetica-Narrow-BoldOblique /Helvetica-Narrow-Oblique
  • 70. /HelveticaNeue-BlackCond /HelveticaNeue-BlackCondObl /HelveticaNeue-Bold /HelveticaNeue-BoldCond /HelveticaNeue-BoldCondObl /HelveticaNeue-BoldExt /HelveticaNeue-BoldExtObl /HelveticaNeue-BoldItalic /HelveticaNeue-Condensed /HelveticaNeue-CondensedObl /HelveticaNeue-ExtBlackCond /HelveticaNeue-ExtBlackCondObl /HelveticaNeue-Extended /HelveticaNeue-ExtendedObl /HelveticaNeue-Heavy /HelveticaNeue-HeavyCond /HelveticaNeue-HeavyCondObl /HelveticaNeue-HeavyExt /HelveticaNeue-HeavyExtObl /HelveticaNeue-HeavyItalic /HelveticaNeue-Italic /HelveticaNeue-Light /HelveticaNeue-LightCond /HelveticaNeue-LightCondObl /HelveticaNeue-LightItalic /HelveticaNeueLTStd-Md /HelveticaNeueLTStd-MdIt /HelveticaNeue-Medium /HelveticaNeue-MediumCond /HelveticaNeue-MediumCondObl /HelveticaNeue-MediumExt /HelveticaNeue-MediumExtObl /HelveticaNeue-MediumItalic /HelveticaNeue-Roman /HelveticaNeue-ThinCond /HelveticaNeue-ThinCondObl
  • 77. /ColorImageMinResolutionPolicy /OK /DownsampleColorImages true /ColorImageDownsampleType /Bicubic /ColorImageResolution 300 /ColorImageDepth -1 /ColorImageMinDownsampleDepth 1 /ColorImageDownsampleThreshold 1.50000 /EncodeColorImages true /ColorImageFilter /DCTEncode /AutoFilterColorImages true /ColorImageAutoFilterStrategy /JPEG /ColorACSImageDict << /QFactor 0.15 /HSamples [1 1 1 1] /VSamples [1 1 1 1] >> /ColorImageDict << /QFactor 0.15 /HSamples [1 1 1 1] /VSamples [1 1 1 1] >> /JPEG2000ColorACSImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /JPEG2000ColorImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /AntiAliasGrayImages false /CropGrayImages true /GrayImageMinResolution 150 /GrayImageMinResolutionPolicy /OK /DownsampleGrayImages true /GrayImageDownsampleType /Bicubic /GrayImageResolution 300
  • 78. /GrayImageDepth -1 /GrayImageMinDownsampleDepth 2 /GrayImageDownsampleThreshold 1.50000 /EncodeGrayImages true /GrayImageFilter /DCTEncode /AutoFilterGrayImages true /GrayImageAutoFilterStrategy /JPEG /GrayACSImageDict << /QFactor 0.15 /HSamples [1 1 1 1] /VSamples [1 1 1 1] >> /GrayImageDict << /QFactor 0.15 /HSamples [1 1 1 1] /VSamples [1 1 1 1] >> /JPEG2000GrayACSImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /JPEG2000GrayImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /AntiAliasMonoImages false /CropMonoImages true /MonoImageMinResolution 1200 /MonoImageMinResolutionPolicy /OK /DownsampleMonoImages true /MonoImageDownsampleType /Bicubic /MonoImageResolution 1200 /MonoImageDepth -1 /MonoImageDownsampleThreshold 1.50000 /EncodeMonoImages true /MonoImageFilter /CCITTFaxEncode