November 1, 2017
Isomi Miake-Lye, PhD
VA Greater Los Angeles Healthcare System
“Unpacking Organizational Readiness for Change: Mapping Organizational Readiness Assessments to an Implementation Framework”
A presentation of the Southern California Regional Dissemination, Implementation and Improvement Science Webinar Series
Provided by the UCLA CTSI
DII - Mapping Organizational Readiness Assessments to an Implementation Framework
1. Unpacking Organizational
Readiness for Change
Mapping Organizational Readiness
Assessments to an Implementation Framework
Isomi Miake-Lye, PhD1,2, David Ganz, MD1,2,
Brian Mittman, PhD1,3, Deborah Delevan1 and Erin Finley,
PhD4,5
(1) VA Greater Los Angeles Healthcare System; (2) University of
California, Los Angeles; (3) Kaiser Permanente Southern California;
(4)The University of Texas Health Science Center at San Antonio; (5)
South Texas Veterans Health Care System
9. Organizational Readiness Assessments
A Goldilocks Problem
• Our projects wanted to:
– Select sites/use as diagnostic
– Tailor
intervention/implementation
– Explain outcomes and
implementation success
• Emphasis on:
– Parsimony
– Practicality
10. Readiness
Assessments
Organizational Readiness Assessments
A Goldilocks Problem
• Our projects wanted to:
– Select sites/use as diagnostic
– Tailor
intervention/implementation
– Explain outcomes and
implementation success
• Emphasis on:
– Parsimony
– Practicality
11. Readiness
Assessments
Organizational Readiness Assessments
A Goldilocks Problem
TOO LONG
• Our projects wanted to:
– Select sites/use as diagnostic
– Tailor
intervention/implementation
– Explain outcomes and
implementation success
• Emphasis on:
– Parsimony
– Practicality
12. Readiness
Assessments
Organizational Readiness Assessments
A Goldilocks Problem
TOO LONG
TOO NARROW
• Our projects wanted to:
– Select sites/use as diagnostic
– Tailor
intervention/implementation
– Explain outcomes and
implementation success
• Emphasis on:
– Parsimony
– Practicality
14. What are core components of
organizational readiness for change
to measure to get
best implementation outcomes?
15. capability
The extent to which organizational
members are psychologically and
behaviorally prepared to implement
organizational change
collective
motivation efficacy
multilevel
Readiness Defined
A comprehensive attitude influenced
simultaneously by the nature of the
change, the change process, the
organization’s context and the attributes
of individuals
Holt
Weiner
17. V.
Process
CFIR Domains
Consolidated Framework For Implementation Research
I. Intervention
Characteristics
IV. Characteristics
of Individuals
III. Inner setting
II. Outer setting
Damschroder, Laura J., et al. Implementation science 2009
23. Searches
• Started from a 2014
systematic review*
• Conducted an update
search
• Additional relevant
references
Screening Criteria
• Deployed in a healthcare
delivery setting
• Measured organizational
readiness
• Provided actual assessment
used
Identification and Screening
*Gagnon, Marie-Pierre, et al. PloS one 9.12 (2014): e114338
38. Readiness for Implementation
This organization’s most
senior leader is committed
to changes related to the
move to the new hospital
PPOE
39. Readiness for Implementation
Our senior leaders have
encouraged all of us to
embrace changes related
to the move to the new
hospital
People who work here feel
confident that the organization can
get people invested in
implementing this change.
PPOE
ORIC
40. Readiness for Implementation
Our senior leaders have
encouraged all of us to
embrace changes related
to the move to the new
hospital
(e.g., buy-in, prior experiences)
People who work here feel
confident that the organization can
get people invested in
implementing this change.
Financial resources for initial
and ongoing training are
adequate.
PPOE
ORIC
Cherry
41. “The absorptive capacity for
change, shared receptivity of
involved individuals to an
intervention and the extent to
which use of that intervention
will be rewarded, supported,
and expected within their
organization.”
Implementation Climate
42. Implementation Climate
My unit needs guidance in
developing services to
address alcohol and drug
behaviors presented by
our patients.
MORC
43. Implementation Climate
My unit needs guidance in
developing services to
address alcohol and drug
behaviors presented by
our patients.
Using e-health technology can
improve my efficiency.
SoOR
MORC
44. Implementation Climate
My unit needs guidance in
developing services to
address alcohol and drug
behaviors presented by
our patients.
Using e-health technology can
improve my efficiency.
I think we are spending a lot of time on
this change when the senior managers
don't even want it implemented.
Holt
SoOR
MORC
46. “The nature and quality of
webs of social networks and
the nature and quality of
formal and informal
communications within an
organization.”
Networks & Communications
48. Networks & Communications
Different parts of the
organization work together
well; when conflict arises,
it is often productive.
I am clear about my responsibility in
the team.
Gibb
STSS
49. Networks & Communications
Different parts of the
organization work together
well; when conflict arises,
it is often productive.
I am clear about my responsibility in
the team.
I am encouraged here to try new and
different techniques.
MORC
Gibb
STSS
50. “A broad construct to include
other personal traits such as
tolerance of ambiguity,
intellectual ability, motivation,
values, competence, capacity,
and learning style.”
Other Personal Attributes
52. Other Personal Attributes
Clinical experience
is more important
than randomized
controlled trials.
Other staff often
ask your advice
about program
procedures.
ORC-S; Guerrero
PSS
53. Other Personal Attributes
Clinical experience
is more important
than randomized
controlled trials.
Other staff often
ask your advice
about program
procedures.
Learning and using new
procedures are easy for me.
ORC-D/S; Guerrero
ORC-S; Guerrero
PSS
56. Structural Characteristics
Our medical group has
well-developed
administrative structures
and processes in place to
create change.
A larger support staff is needed to
help meet program needs
ORC-D/S; Guerrero
Rubenstein
57. Structural Characteristics
Our medical group has
well-developed
administrative structures
and processes in place to
create change.
A larger support staff is needed to
help meet program needs
More computers are needed in
this program for staff to use
ORC-D/S; Guerrero
ORC-D/S; Guerrero
Rubenstein
58. Assessment Size Over Time
Number of items per assessment by year
0
20
40
60
80
100
120
140
1985 1990 1995 2000 2005 2010 2015 2020
NumberofItemsinassessment
Year
ORC Melnyk Holt Other
59. Constructs over Time
Number constructs per Assessment by Year
0
2
4
6
8
10
12
14
1985 1990 1995 2000 2005 2010 2015 2020
Numberofcostructsinassessment
Year
ORC Mel Holt Other
61. Readiness is…
• A multi-level problem
• Mostly captured within:
– Inner Setting
– Characteristics of Individuals
Popular Constructs
Summary of Findings
62. Do you
have what
you need
for X?
Are
people
into X?
Do people
work well
together?
Is X
wanted
and
needed?
63. Implications
• Assessments demonstrate need for tailoring to particular
projects/settings
• Relationships/team functioning are critical components of
organizational readiness, pervasive throughout items in
various constructs
64. Limitations
• “Little consistency in terminology or conceptualization”*
• Identifying all relevant literature without standardized search
terms (MeSH)
• Only published assessments included
– Counted by study, rather than assessment
*Weiner, et al. Med Care Res Rev 65.4 (2008):379-436
68. THANK YOU
Funded by QUE 15-276: Improving Patient-Centered Care Coordination for
High-Risk Veterans in PACT (VA Care Coordination QUERI)
If you have further questions, feel free to contact:
isomi.miake-lye@va.gov
70. References
• Aarons, Gregory A. "Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based
Practice Attitude Scale (EBPAS)." Mental health services research 6.2 (2004): 61-74.
• Anderson, Neil R., and Michael A. West. "Measuring climate for work group innovation: development and validation of the
team climate inventory." Journal of organizational behavior (1998): 235-258.
• Armenakis, Achilles A., et al. "Organizational change recipients' beliefs scale: Development of an assessment instrument."
The Journal of applied behavioral science 43.4 (2007): 481-505.
• Bobiak SN, Zyzanski SJ, Ruhe MC, Carter CA, Ragan B, et al. (2009) Measuring practice capacity for change: a tool for
guiding quality improvement in primary care settings. Qual Manag Health Care 18(4):278–284.
• Bohman, Thomas M., et al. "Assessing health care organizations’ ability to implement screening, brief intervention, and
referral to treatment." Journal of addiction medicine 2.3 (2008): 151-157.
• Cherry, Barbara. "Assessing organizational readiness for electronic health record adoption in long-term care facilities."
Journal of gerontological nursing 37.10 (2011): 14-19.
• Demiris G, Courtney KL, Meyer W (2007) Current status and perceived needs of information technology in Critical Access
Hospitals: a survey study. Inform Prim Care 15(1):45–51.
• Helfrich, Christian D., et al. "Organizational readiness to change assessment (ORCA): development of an instrument based
on the Promoting Action on Research in Health Services (PARIHS) framework." Implementation Science 4.1 (2009): 38.
• Holt DT, Armenakis AA, Feild HS, Harris SG (2007) Readiness for Organizational Change: The Systematic Development of
a Scale. J Appl Behav Sci. 43(2): p. 232–255.
• Lehman, Wayne EK, Jack M. Greener, and D. Dwayne Simpson. "Assessing organizational readiness for change." Journal
of substance abuse treatment 22.4 (2002): 197-209.
• Melnyk B, Fineout-Overholt E, Mays M (2008) The evidence-based practice beliefs and implementation scales: psy-
chometric properties of two new instruments. Worldviews Evid Based Nurs 5(4):208–216.
• Nelson JC, Raskind-Hood C, Galvin VG, Essien JD, Levine LM (1999) Positioning for partnerships. Assessing public health
agency readiness. Am J Prev Med, 16(3 Suppl): 103–117.
• Pasmore W (1988) Designing Effective Organizations: The Sociotechnical Systems Perspective. New York: John Wiley &
Sons
• Toure M, Poissant L. BR (2012) Assessment of organizational readiness for e-health in a rehabilitation centre. Disabil
Rehabil 34(2):167–173.