From the 4/23/2021 newsletter
Perspective/Opinion
Implementation Science and Medical Education Transformation
Jeffrey Amundson, PhD, Michael
Braun, PhD, and M. Chris Decker, MD
Drs. Amundson, Braun, and Decker provide an
overview of the basic stages of Implementation Sciences, acknowledging that the
process must attend to the people and culture where it occurs …
Implementation science - a thoughtful,
structured rollout of a new initiative - can help make new programs more
successful. In the April 2, 2021 issue of the Transformational Times,
Drs. Amundson, Webb, Prunuske, and Kalet discussed the use of implementation science methods in
the curriculum transformation process. As we move forward with this change, and
with the broader transformation of medical education driven by the Kern
Institute, let’s take some time to reflect on implementation science: why it’s
important, and what it tells us about how and why to start off right.
Why are we talking about Implementation Science?
Successful implementation and maintenance of evidence-based practices for organizational changes or programs are a necessary precondition at Kern for providing successful programs, driving innovation at MCW and elsewhere, and generating scholarship. But there’s no guarantee that merely using an evidence-based practice (EBP) will lead to its adoption. For example, here is a story from Bauer and Kirchner’s (2020) article in Psychiatry Research:
“It was, by all estimations, a successful research effort. We had mounted a randomized, controlled clinical trial across eleven sites in the US Department of Veterans Affairs (USVA), testing an organization of care called the Collaborative Chronic Care Model (CCM) for bipolar disorder versus treatment as usual. Over three years of follow-up, the CCM showed significant positive impact on weeks in mood episode, mental health quality of life, social role function, and satisfaction with care - all at no increased cost to the healthcare system. In parallel, a two-year, four-site randomized controlled clinical trial of the bipolar CCM in the Group Health Cooperative of Puget Sound (now Kaiser Permanente), showed very similar outcomes at minimal cost, compared to treatment as usual. Both studies were published in the same year in mainstream psychiatric journals that are read and respected by mental health researchers, clinicians, and administrators. The CCM for bipolar disorders began to be endorsed by national clinical practice guidelines in the USVA and in Canada, and the bipolar CCM was listed on the US Substance Abuse and Mental Health Services Administration's prestigious National Registry of Evidence-Based Programs and Practices.
And yet, within a year of the end of the studies, none of the 15 sites had incorporated the CCM into their usual workflow. The clinicians who had participated in the CCM went back to their usual duties, and the individuals with bipolar disorder went back to receiving their usual form of care.” (Emphasis added)
Something more than sound evidence is
needed for a program to be successful, and implementation science is an
approach designed to address the how and the why of getting started right, once
the “what” has been defined.
What is Implementation Science?
Implementation science is the systematic study and practice of program implementation to increase chances of acceptance, adoption, fidelity, and success. For a new initiative, this means the program is supported and practiced by a broad range of practitioners and stakeholders. It also means the practice of the program adheres to the program’s tenets and dictates. And it means that the program achieves desired outcomes predicted by theory and evidence. Notably, this process involves many similar components of continuous quality improvement (CQI). CQI also involves the continual review of an ongoing program’s implementation, fidelity, and outcomes to adjust the program while it remains in operation.
Basic Stages of Implementation Science
There are numerous specific models of
implementation, and all identify similar stages of the process. Here are five
basic steps to the process of implementation as guided by implementation
science.
Exploration – Needs, Options, and Partners
The implementation
team is responsible for getting the stakeholders and learning environments
ready. They explore and research different EBPs to share. This might
involve reaching out to other organizations who have implemented similar
practices, literature reviews, and mock learning environment experiences to
familiarize stakeholders with what evidence-based approach looks and feels
like. The implementation team develops needs-assessments to ready
stakeholders for the next stage of Installation.
Installation - Who, What, When, and How
During this
phase, the implementation team identifies human and operational resources that become
part of an implementation plan. This plan lays out who will be using the
new program, where it will be used, who will be asked to do their work
differently. It anticipates necessary training to prepare others for changes and
details how the new program will be evaluated.
Initial Implementation - Measurement,
Meetings, Learning Environment, Support, and Observation
When
practitioners use the innovation for the first time, implementation teams help
develop competencies required by the EBP, help administrators adjust
organization roles and functions, and help leaders fully support the process.
During this process, the team is rolling out the implementation plan, sharing
EBPs chosen to implement, and displaying and modeling the use of resources. The team is using valid tools to measure
effective EBPs, look-fors (things that represent expected strategies and
outcomes), peer support opportunities, plans for observation, and plans for touch-base/how
are things going meetings.
Full Implementation - How Many People? Fidelity,
Good Outcomes, New Standard of Work
During this
stage, stakeholders involved are using an effective intervention with fidelity
and good outcomes. Notably, expected outcomes should be realistic and aligned
with theoretical predictions. The new ways are now the standard ways of work
and Implementation Teams ensure that the gains in the use of effective
practices are maintained and improved over time and through transitions of
leaders and staff. This can involve follow-up meetings with staff, review
progress monitoring with educators and administrators to ensure fidelity.
Sustainability - Financial and Programmatic
Sustainability
planning and activities need to be an active component of every stage. These
activities can involve ensuring that the funding streams are established,
adequate, and sustainable (financial sustainability, e.g., funding
for educators, staff, and administrative time) and ensuring that the
implementation infrastructure is established, reliable, effective, and
sustainable (programmatic sustainability, e.g., vertical
articulation with new stakeholders to identify what worked for which stakeholders).
Attending to People and Culture
Another critical dimension for successful
implementation in every stage is the people and cultural changes required.
Though we may discuss implementation science as a prescriptive way to implement
a new program, we would be remiss if we ignored the fact that any change within
an organization requires extraordinary commitment and sacrifice from the
individuals who are asked to carry out the change and live with the
consequences (both good and bad) from the change. These changes will impact
personal mattering, professional identity, feelings of purpose, and other emotional
elements and must be treated by all with humility, empathy, and compassion. And as organizations learn
within the implementation, rate of implementation, which can add to the impact
of change, is an important consideration. We look forward to exploring
these elements of implementation science in a future article.
In sum, Implementation Science can help
effectively identify and validate a need, strategically plan for change through
implementation plans, and provide structure for data collection and reporting
on the impact of the change. Engaging employees at all levels (e.g., faculty,
staff, learners, etc.) early in the implementation process is key to aligning an
EBP with the values and culture of the organization. In future issues of the Transformational
Times, we look forward to writing about additional important elements of
successful implementation and also about the transformational journey of the MCW
curriculum reimagining. Stay tuned!
Jeffrey Amundson, PhD is
a postdoctoral fellow in the Robert D. and Patricia E. Kern Institute for
the Transformation of Medical Education.
Michael
Braun, PhD is a program manager with Robert D. and Patricia E. Kern
Institute for the Transformation of Medical Education.
M. Chris Decker, MD is Chief Transformation
Officer and a Professor of Emergency Medicine at MCW. He is a member of the
Human-Centered Design Lab, and has leadership roles in the Design Sprint
Program and the Transformational Ideas Initiative (TI2) seed grant program for
the Robert
D. and Patricia E. Kern Institute for the Transformation of Medical
Education.