Professional Documents
Culture Documents
Building the
Evidence-Based Organization
Supporting System-Wide Clinical Practice Change
Project Director
Megan Zweig
Contributing Consultants
Cassie Dormond, MA
Chloe Lewis, MPH
Design Consultant
Nate Smith
Executive Directors
Allison Cuff Shimooka, MBA
Amanda Shoemaker Berra, MA
Executive Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Adopting Evidence-Based Practice Is a Winning Strategy to Advance Care Quality and Efficiency
The market is challenging health care organizations with a dual mandate: be more cost-efficient, and boost the quality and coordination of care. Clinical
executives are in a linchpin role to advance these aims by ensuring patients receive the right care, and the right amount of care. To that end, most
organizations are currently investing significant time and resources into the creation and adoption of evidence-based clinical guidelines. This work is
hugely challenging because standards of care are moving targets. Guidelines do not exist for every scenario. This publication does not strive to create
certainty where there is none, but to help organizations implement the protocols that are known to produce better outcomes.
Clinical Guidelines Do Not Typically Translate into Consistent Practice
Despite the high level of activity to advance evidence-based practice, most organizations are not seeing the desired return. It is one thing to have clinical
guidelines in place. It is entirely another to have a medical staff that consistently follows those guidelines. While physicians may no longer be
philosophically opposed to evidence-based practice, over half of physicians do not use guidelines when they are available. Clinical executives struggle to
pinpoint, and solve, the precise breakdown causing this knowledge-to-practice gap. As a starting point, executives tend to focus on physicians with outlier
performance, or on campaign-type initiatives, to advance EBP adoption. Though effective in the short term, both of these strategies reflect the same
problem—the efforts are not scalable. Executives are outnumbered by both physicians and initiatives.
Three Strategies for Clinical Executives to Build an Evidence-Based Organization
Some organizations have overcome these challenges and achieved a “culture of adherence” in which clinicians more consistently follow guidelines. This
publication outlines what those organizations do differently, so that other physician executives can accomplish the same transformation. The key is
building a scalable infrastructure and processes that accelerate the adoption of EBP across the entire medical staff, and bolster the performance of all
initiatives. Readers will learn how to build an evidence-based organization through three primary strategies:
1 Identify underleveraged EBP support tactics: Use the Evidence-Based Practice Leadership Audit, a custom benchmarking tool from
the Physician Executive Council, to pinpoint and address organization-specific shortfalls hindering EBP adoption
Overcome the adherence challenge: Enfranchise physicians in EBP strategy and surround them with effective messaging, data,
2 and workflow supports to promote EBP uptake
3 Capitalize on system advantage: Ensure maximum return on EBP efforts by scaling clinical best practices organization-wide
A Call to Action
Cost reduction has been a mainstay With Little Running Room Left on Operational Efficiency,
on hospital leaders’ top priority list for
Attention Turns to Clinical Care
the past decade. Historically,
organizations realized cost-savings
through greater operational Average Length of Stay (Nationwide) System CEO Throws Down the Gauntlet
efficiencies. This is evidenced by the
dramatic decline in length of stay over In Days
the past couple of decades. However, 7
average LOS has plateaued in the
past few years, indicating that
organizations may have largely • System CEO convenes
tapped out traditional, operational hospital CMO council $100 M
cost-savings opportunities. • Delivers system-wide
goal for inpatient cost Savings target for
To address intensifying cost savings inpatient care redesign
pressures, hospital executives are
• Savings to be achieved
turning their attention to care delivery. through LOS and cost-
As a result, CMOs are increasingly per-case reductions
accountable for system-level cost
initiatives. For example, the CEO of a 0
large system tasked the CMO council 1990 2010
with finding $100 million in cost-
savings from inpatient care redesign.
Case in Brief: Star Health1
Medical leaders increased focus on
• Integrated health care system comprised of 25+
cost-savings is not intended to take
hospitals, employed medical group, and an
precedence over or even be distinct insurance plan
from quality responsibilities. Instead,
• System CEO sets ambitious goal of $100M in
acute care transformation seeks to
savings through inpatient care redesign over a
deliver the right care (and the right three-year period
amount of care) to patients, with the
goal of finding clinical solutions that
both improve quality and efficiency.
Source: Health, United States 2012, U.S. Department of Health and Human Services, Centers for
1) Pseudonym. Disease Control and Prevention, May 2013; Physician Executive Council analysis.
Many studies have evaluated the 27% “Differences in physician beliefs about
prevalence and drivers of care the effectiveness of treatments are the
variation. For example, Harvard and primary source of variation in Medicare
Dartmouth researchers classified 27%
expenditures… Were physicians to
follow professional guidelines, end-of-
of practicing cardiologists as
life Medicare expenditures would be
“cowboys”—meaning they consistently
recommend the most invasive care
41% 36% less, and overall expenditures
17% lower.”
option. Additionally, nearly half of Percentage of physicians who sometimes
physicians who had performed a or frequently perform a cardiac “Physician Beliefs and Patient Preferences:
cardiac catheterization did so because catheterization because of colleagues’ A New Look at Regional Variation in
expectations, rather than for clinical reason Health Care Spending”
of colleagues’ expectations rather than
out of medical necessity.
This study starkly showcases the dual
opportunity of curbing clinical variation. Study in Brief: “Physician Beliefs and Patient Preferences: A New Look at Regional Variation
First, it is troubling from a quality in Health Care Spending”
perspective to consider that variations
• Harvard University and Dartmouth’s Geisel School of Medicine researchers surveyed a national sample of
abound for no clinical reason. And
cardiologists and primary care physicians to assess physician practice styles using clinical vignettes.
second, reducing variation would yield
• Researchers labeled physicians who consistently preferred interventional care as “cowboys” and classified
tremendous savings opportunities. The
physicians who indicated they would discuss palliative care options with the sickest patients as “comforters.”
study estimated that if physicians Overall, 27% of cardiologists and 19% of PCPs qualified as cowboys, 29% of cardiologists and 44% of PCPs
followed professional guidelines, end- qualified as comforters.
of-life Medicare expenditures would be
• The researchers concluded that patient demand is relatively unimportant in explaining variations in Medicare
36% less, and overall Medicare spending. The single most important factor is physician perception of treatment effectiveness. As much as
expenditures would be 17% less. 36% of end-of-life Medicare expenditures and 17% of overall Medicare expenditures are explained by
physician beliefs that cannot be justified either by patient preferences or by clinical effectiveness.
Source: David Cutler and Jonathan Skinner, “Physician Beliefs and Patient Preferences: A New Look at Regional Variation in Health Care
Spending,” Working Paper 19320, National Bureau of Economic Research, August 2013; Physician Executive Council interviews and analysis.
Source: Health Care Advisory Board and Physician Executive Council interviews and analysis.
Source: Health Care Advisory Board and Physician Executive Council interviews and analysis.
Among all EBP activities, the area Common Guideline Development Process
where most organizations are
strongest today is the process for
producing clinical guidelines. It can
involve some intense deliberation and 1 2 3
consensus building, but at its core, the Allow physician
Send draft to Discuss concerns
champions, content
process is straightforward: convene department chairs and one-on-one, obtain
experts to draft internal
select clinicians to draft the guideline, medical directors, evidence to support
guidelines based on
Iterative request feedback suggested changes
solicit clinician feedback, and roll latest evidence
process
them out. This scalable process has repeated
allowed most organizations to as new 6 5 4
implement an impressive number of evidence Present guidelines at Send final draft to all
published Incorporate evidence-
department meetings physicians, other
order sets and guidelines. based feedback into
to promote utilization, stakeholders affected
guidelines
solicit feedback by guidelines
In addition to having guidelines in Moving from Accusations of “Cookbook Medicine” to General Acceptance of EBP
place, physician support for evidence-
based practice is generally strong. In
the Physician Executive Council’s
2013 Physician Executive Survey,
76% of Chief Medical Officers
“There Is Broad Cultural Buy-in “Physicians Should Adhere to
for EBP Among Medical Staff”1 Cost-Effective Clinical Guidelines”
reported broad cultural buy-in for EBP
among their medical staff. Data from n=18 CMOs n=2,434 physicians
over 2,400 physicians validates this
assessment—nearly 80% of
physicians agree they should adhere
to cost-effective clinical guidelines.
This signals a considerable shift in
Disagree2 24% 76% Agree3 Disagree4 Agree5
physician attitude since, in the last 21% 79%
decade, many considered EBP to be
“cookbook medicine” and destructive
to the patient-provider relationship.
Physician resistance to EBP puts a
hard stop on guideline creation and
rollout. So, physician engagement—
combined with momentum from value-
based care, organizational investment
in EBP, and a mature guideline
creation process—all suggest that
EBP must be coming into widespread
use in hospitals. However, the real-
world experiences of physician
executives are less positive.
1) From the PEC 2013 Physician Executive Survey. Survey asked physician executives to evaluate the statement: “My
organization has achieved broad cultural acceptance of evidence-based practice across the medical staff.”
2) Includes responses of “Tend to Disagree,” “Disagree,” and “Strongly Disagree.”
3) Includes responses of “Tend to Agree,” “Agree,” and “Strongly Agree.”
4) Includes responses of “Strongly Disagree,” and “Moderately Disagree.” Source: Tilburt J MD, Wynia M MD, “Views of US Physicians About Controlling Health Care Costs”, JAMA; 310, no. 4;
5) Includes responses of “Strongly Agree,” and “Moderately Agree.” PEC 2013 Physician Executive Survey analysis; Physician Executive Council interviews and analysis.
It is one thing to have guidelines in Existing Guidelines Don’t Necessarily Translate into Consistent Practice
place. It is entirely another to ensure
that guidelines are consistently used.
While physicians may no longer be
philosophically opposed to evidence- Physician Use of Clinical “I Am Having Difficulty
based practice, they are typically not Guidelines When Available Successfully Promoting EBP”1
incorporating guidelines into their
n=231 physicians n=37 system-level CMOs
practice. Over half of physicians do
not use guidelines when they are
available. System CMOs view this as
a major problem, with 72% reporting
that they are having difficulty
promoting EBP at their organizations. Yes,
Do Not Use
Consistently 44% 56% Disagree2 28% 72% Agree3
Consistently
Use
Low adherence to EBP has real Three Representative Examples of the Impact of Low EBP Adherence on Patients
consequences for hospitals and, as
shown here, patients.
1 2 LA Times, 2011
For example, the sepsis bundle,
Sepsis Guidelines Effective,
proven to reduce mortality, has Nearly 70,000 Americans
but Underutilized
existed for over a decade. Yet only die needlessly each year
19% of physicians follow the pediatric because they are not
guidelines, and anecdotal evidence 25% Mortality reduction with
introduction of sepsis bundle given optimal heart failure
therapy
suggests the rate is similarly low for
the adult population. Meanwhile
hospital deaths due to sepsis 19% Physicians who follow
pediatric sepsis guidelines
Physicians have been slow to
implement many of the procedures
increased 17% over the past decade. called for in the guidelines…
Increase in sepsis inpatient
Despite the high adherence rate
required to prevent infections, a
17% hospital death rates in the
past decade1
recent study found relatively low rates
of clinician adherence to prevention 3
policies for central line-associated
Adherence to Prevention Policies in the ICU
blood infections, ventilator-associated
pneumonia, and catheter-associated
urinary tract infections. 37%-71% 45%-55% 6%-27%
Central line-associated Ventilator-associated Catheter-associated
bloodstream infections pneumonia urinary tract infections
“Establishing policies does not ensure clinician adherence at the bedside. Previous studies
have found that an extremely high rate of clinician adherence to infection prevention policies
is needed to lead to a decrease in health care associated infections.”
Patricia W. Stone, et al.
“State of Infection Prevention in US Hospitals Enrolled in the
National Health and Safety Network”
Source: Paul R, et al., “Adherence to PALS Sepsis Guidelines and Hospital Length of Stay,” 2012, Pediatrics; Los Angeles Times, http://articles.latimes.com/2011/jun/06/news/la-heb-heart-failure-06062011, June 6,
2011; CDCNCHS, National Hospital Discharge Survey, 2000-2010; Stoneking L, Denninghoff K, “Sepsis Bundles and Compliance with Clinical Guidelines,” Journal of Intensive Care Medicine, 26, no.3 (2011); Stone,
et al., “State of Infection Prevention in US Hospitals Enrolled in the National Health and Safety Network,” American Journal of Infection Control, 2014; Physician Executive Council interviews and analysis.
1) From 2000-2010.
What causes the gap between EBP Change Agents Face Hurdles at Every Turn
guideline creation and adoption?
First, pinning the failure to adopt
guidelines solely on physicians is
unfair and inaccurate. On the whole,
Representative Challenges of EBP Implementation
physicians want to practice evidence-
based care. Second, no one If it takes five
seconds longer, Leaders roll out an
monolithic barrier stands in the way of physicians will intensive campaign;
EBP adoption—physician leaders are not do it practice patterns
barraged with many different Physicians expressing improve but then
frustration with volume of fall off
obstacles, some of which are outlined clinical practice changes Specialty group
here. For example, specialty groups focuses on low-
work on quality initiatives but not in ROI EBP initiative
the areas with the greatest return. Or, Order sets not Groups at different
different facilities spend considerable updated because Physicians facilities reinvent
physician with that practice defensive the wheel on
time creating duplicative guidelines.
responsibility left Successful unit medicine similar projects
Also, physicians may not know about organization pilots left under
a new guideline or it may impede their the radar and not
brought to scale Some physicians
workflow. say they are
Any one of these challenges might be simply acceding to
Outlier physician is family demands
manageable in isolation. But in the outspoken critic of
aggregate, they lead to the grim guidelines and
adherence statistics outlined earlier. influences peers
There are two standard ways to tackle Outlier-Focused Strategy Yields Diminishing Returns
the challenges and promote the
adoption of EBP.
The first is to focus on physician
outliers, conducting one-on-one
performance conversations with Physician Common Performance
physicians with low adherence rates.
Performance Distribution Improvement Trajectory
In the short term, this strategy pays
off by motivating behavior change. But
it will hit a point of diminishing returns
and does not elevate EBP adherence
among the entire medical staff; it is
Aggregate
not particularly scalable or efficient. Physician
Performance
The second approach is an intensive Where Are the Economies of Effort Across EBP Work?
focus on individual care improvement
or guideline adherence initiatives. The
physician executive provides
Most
executive oversight for a specific organizations Sepsis Mortality Reduce Improve
campaign. focusing on Initiative Readmissions CAUTI1 Rates
discrete
Like the outlier strategy, this approach initiatives
also works in the short term. The
initiative greatly benefits from
Underlying Components of a Quality Infrastructure
executive support and accountability.
However, physician executives do not • Executive leadership • Clinical decision-making tools
Building
have the time to replicate this level of • Physician champions • Accountability mechanisms robust EBP
effort for every clinical initiative at their infrastructure
• Workflow integration • Education and training
organization. considered
• Data collection, analysis • Clinical knowledge management “important but
Both the targeted outlier and initiative not urgent”
strategies reflect the same problem—
even an organization’s best efforts at ”
EBP are not scalable.
A better approach is to build a
scalable platform for EBP that In Need of a Scalable Strategy
includes elements of leadership, data “I have 100 improvement initiatives on my plate. Each initiative
analysis, accountability, education, takes nine months. I don’t have nine months times 100.”
and other supports that can be CEO, Medical Group
applied to all EBP efforts.
1) Catheter-associated urinary tract infection. Source: Medical Group Strategy Council and Physician Executive Council interviews and analysis.
The three strategies outlined here Three Inflection Points to Accelerate EBP
differentiate organizations with cultures
in which more clinicians follow
evidence-based guidelines more of the
time. All three strategies promote a
scalable approach to EBP. Investing in Overcoming the Capitalizing on
Right Resources Adherence Challenge System Advantage
First, these organizations invest in
high-impact resources, including
physician leaders and data systems,
largely performance-tracking systems
and clinical decision-making support.
For more resources on building Pitfalls: Limited EBP staff, Pitfalls: Organization takes Pitfalls: Pockets of success
physician champions; data narrow, fragmented do not spur system-wide
physician leadership structures and
systems do not support approach to secure clinician change; duplicative efforts
analytic capabilities to support substantive performance buy-in for EBP adoption and gaps remain
performance improvement, see page 4. reporting
Second, they use a multifaceted
Goal: Organization deploys Goal: Organizational Goal: EBP leadership and
approach to support EBP adherence.
robust team of EBP staff structures surround infrastructure efficiently
Instead of focusing on outliers, they and physician leaders; physicians with effective support standardization
surround physicians with support installs and fully leverages messaging, data, and other across all services and
structures that promote EBP uptake. performance reporting IT supports to promote sites
capabilities EBP uptake
Finally, they capitalize on their system
advantage. Most organizations have
select pockets where EBP has taken
The Focus of This Publication
hold, leaving many missed
opportunities and redundancies
throughout the organization. Top-
performing organizations maximize the
return of their EBP initiatives by
ensuring best practices pervade all
services and sites.
The clinical leadership team is Clinical Leadership Team Best Positioned to Drive Organizational EBP Strategy
uniquely positioned to credibly
navigate the delicate balance required
to build an evidence-based
organization. Clinical leaders
understand, and can represent, the
organizational mandate to advance
efficiency and quality.
Simultaneously, clinical leaders
understand the opportunities and
challenges associated with changing
clinical practice patterns. They deeply
respect the core physician mission of Oversight of
Input into Voice in
determining the best way to treat each Physician
Resource System Strategy
patient and can ensure this mission Performance
Allocation Discussions
underpins all EBP efforts, thereby Improvement
engendering trust among the
medical staff.
Knowledge of Insight into
Clinical
Physician Clinical Issues
Credentials
Culture
To help clinical leaders advance EBP Nine Lessons for Supporting System-Wide Clinical Practice Change
at their organization, the Physician
Executive Council has identified nine I II III
imperatives for building an evidence-
based organization. Identifying Overcoming the Capitalizing
Underleveraged Adherence on System
• Chapter one introduces a new tool,
EBP Support Challenge Advantage
The Evidence-Based Practice Tactics
Leadership Audit, to help clinical
leaders pinpoint organization- Use EBP Leadership Audit Surround physicians with Lead and support clinical
specific opportunities to support to pinpoint greatest effective messaging, standardization efficiently
EBP adoption. opportunities for fostering data, and other supports across all services
EBP adoption at your to promote EBP uptake and sites
• Chapter two focuses on how to organization
build a culture of adherence
1. Craft an EBP PR campaign 7. Use a centralized, data-
among the medical staff. driven approach to
2. Rightsize physician input into prioritize system-wide
• Chapter three showcases guidelines opportunities
strategies to ensure best practice
clinical standardization permeates 3. Leverage noncompliance to 8. Hold executive leaders
drive guideline evolution directly accountable for
the entire organization.
advancing EBP
4. Ensure guideline use is path
of least resistance 9. Scale best practices
system-wide
5. Refine data-sharing
approaches to maximize
efficacy
The Evidence-Based Practice Four Performance Domains of the Evidence-Based Practice Leadership Audit
Leadership Audit is organized into
four performance domains, and
assesses adoption of EBP support
tactics within each. These domains
represent the most important focus
areas for building an evidence-based Prioritization Correctness Adherence Scalability
organization—executing against all
four is necessary to achieve Do we prioritize our Are our guidelines Do we surround our Looking across the
widespread EBP adoption. standardization efforts trustworthy sources of physicians with organization, does our
based on our greatest the most up-to-date effective messaging, EBP leadership and
1. Prioritization: Does the opportunities? clinical evidence? data, and other infrastructure efficiently
organization prioritize EBP efforts supports to promote support standardization
by highest-return opportunities? EBP uptake? across all our services
and sites?
2. Correctness: Does the
organization ensure guidelines
are trustworthy and contain the
most up-to-date evidence?
3. Adherence: Does the organization
make it easy and rational for
physicians to use EBP whenever
they can?
4. Scalability: Do EBP leadership
and processes support
standardization across services
and sites, without unnecessary
duplication?
To advance within each domain,
organizations should use the Audit to
identify and direct resources to
underleveraged tactics.
Source: Physician Executive Council interviews and analysis.
An interactive, automated version of Audit Provides Snapshot of Organizational Readiness to Support EBP
the Evidence-Based Practice
Leadership Audit is available on
advisory.com. The Audit provides on- In-the-Moment Targeted Best Custom Analysis Facility
demand access to custom analyses Results Practices to Follow Comparison Support
that pinpoint specific opportunities—
and accompanying resources—to
help organizations focus their EBP
adoption efforts. Members can access
the tool 24/7, including benchmarking Review custom list of Access suggested best Receive follow-up custom Distribute Audit to facility-level
data from the PEC member cohort. your organization’s practices to address your benchmarking report or service-line leaders to
greatest opportunities organization-specific detailing your opportunities conduct comparison analyses;
Facility leaders and service-line
to accelerate EBP shortfalls against peer group uncover system-wide
leaders can conduct comparison adoption performance improvement areas or
analyses by completing the audit. opportunities to scale
Leadership teams can use these expertise and practices
analyses to assess system-wide
improvement areas and opportunities No “A” for Effort: Avoid Grade Inflation While Taking the Audit
to scale existing expertise.1 Before
taking the audit, a word of caution: 1. At your organization, how Never Rarely Sometimes Often Always
many leaders respond to the frequently do executives
questions with the aspiration they discuss strategies or goals for
have for their organization rather than achieving greater organization-
today’s actual state. Please pause for wide adoption of EBP?
Pause for an “Internal Reality Check”
an “internal reality check” when taking
the audit (see example shown here). Can I remember the last executive team meeting
when we discussed EBP strategy?
All benchmarking data is blinded to
protect the confidentiality of all Have we formalized EBP strategy in some way
responses. (e.g., through our strategic plan)?
Can I name one of our EBP goals?
Do we have a targeted strategy for EBP rather
than a general “Quality” strategy?
1) For more information on this service, please email ZweigM@advisory.com or your
Advisory Board representative. Source: Physician Executive Council interviews and analysis.
Results from the initial cohort Audit Results from the Physician Executive Council Member Cohort
completing the Evidence-Based
Practice Leadership Audit revealed
EBP Support Tactics Distribution1
significant opportunities to
strengthen existing EBP Based on Physician and Quality Leader Responses to, “At your
infrastructure and processes. organization, how frequently do you use [EBP support tactic]?”
n=79
In the first cohort, over 75
physician and quality leaders
completed the Evidence-Based 5 = Always
Practice Leadership Audit. Each
leader ranked the frequency with
3.9
which their organization uses each 4 = Often
EBP support tactic along a five-
point scale. Shown here is the
distribution of the cohort’s average 3 = Sometimes
responses to each tactic in the
Audit. The highest-scoring tactic
2.0
scored a 3.9, and the lowest 2 = Rarely
scored a 2.0.
Most tactics are being used at
least rarely or sometimes, 1 = Never
indicating that these tactics are not
entirely new ideas. But, while Average response for most
organizations have made tactics fell between “Rarely”
foundational strides in EBP, results and “Sometimes,”
highlighting inconsistency of
also suggest that all organizations use of known best practices
have the opportunity to strengthen
their use of existing tactics.
Access the full cohort results at: advisory.com/pec (available in Spring 2014)
The clear Achilles heel of EBP is Analysis Reveals Low Adoption of Adherence Support Tactics
adherence. Results from the audit
show that all five of the lowest-scoring
tactics fall in the adherence domain.
This validates an earlier point— Score
Rank Least-Used EBP-Support Tactics Domain
(Out of 5) 1
physicians are not single-handedly to
blame for not adopting guidelines. The Physician opt-outs of clinical guidelines are tracked and
analysis reveals that organizations 1 analyzed so that appropriate adjustments to guidelines 2.0 Adherence
can be made
have not effectively implemented
tactics that promote EBP adoption Experts in workflow efficiency vet clinical guidelines to
among the medical staff, such as 2 ensure they can be practically incorporated into clinician 2.4 Adherence
incorporating guidelines into clinician workflow
workflow, regularly sharing individual Physician performance or OPPE assessments include
performance data with physicians, 3 metrics tracking the physician’s adherence to clinical 2.5 Adherence
and tracking guideline opt-outs to guidelines
uncover barriers to compliance.
Physicians receive data on their own individual-level
The good news is physician leaders 4 2.5 Adherence
clinical guideline adherence
do not need to find a new set of
tactics to improve guideline
Individual physicians who have patterns of unwarranted
adherence—they need to make better 5 variation receive follow-up communications and 2.6 Adherence
use of the tactics that have already corrective actions
been proven to be effective.
Unlike the bottom-ranked tactics, the Most-Used Tactics May Be Adopted—but Not Organization-Wide
top five most-used EBP support
tactics do not cluster within any
particular domain.
PEC researchers were eager to learn Conversations with CMOs
how these tactics were being Most-Used Score Underscore Lack of
Rank Domain
EBP-Support Tactics (Out of 5) Organization-Wide Adoption
”
executed at different organizations.
What they found in speaking with
Guidelines incorporate input from
clinical leaders is reflected in the
non-physician multidisciplinary “Our community hospital
quotes on the right—even where EBP
1 stakeholders (e.g., nursing, 3.9 Correctness increased sepsis bundle
tactics were successfully used, they pharmacy, behavioral health) compliance by 40% in the ED.”
were largely limited to a small pocket prior to rollout ”
of the organization, not at scale.
Clinical guidelines are drafted
Of course, achieving clinical scale is a and/or reviewed (if coming from
complex endeavor. But in the long a vendor) by a dedicated group “Pediatrics is by far the most
2 3.6 Scalability advanced with their guidelines
term, taking a decentralized approach prior to being tested for approval
with any broader group of They have a tremendous leader.”
to EBP rollout will require more work
because of redundancies and clinicians ”
disconnects across the organization. Organizational metrics (e.g.,
financial, quality) are used to
The next two chapters offer nine 3 evaluate the success of 3.4 Prioritization “We incorporated order sets into
lessons to address the two most initiatives to reduce clinical CPOE at half our hospitals; the
common shortfalls of EBP strategy variation other half are still paper based.”
(as revealed by the EBP Leadership
Clinical guidelines exist for top
Audit)—bolstering adherence and 4 3.3 Prioritization
variation opportunities
promoting scalability.
Executives discuss strategies or
goals for achieving greater
5 3.3 Prioritization
organization-wide adoption of
EBP
Complex factors underlie physicians’ Physician Perception of Cost Responsibility Not Captured with a Single Statistic
decisions with cost implications, some
Groups with Major Responsibility for Health Care Cost Reduction
of which were explored in a recent
As Identified by Physicians
2013 JAMA study. Researchers
n=2,556
asked physicians, “who is responsible 60% 59%
56% 56%
for reducing health care costs?” The 52%
bar chart shows most physicians think 44%
trial lawyers, insurance companies, 36%
and pharmaceutical and device 27%
manufacturers have a major 19%
responsibility. About one-third of
physicians indicate they have a major
role to play.
On the surface, this data seems to
imply physicians blame everyone but
themselves, leading some to pin the
problem of nonadherence on
physicians. However, this is not the
full story. Additional data from the
study reveals physicians do think cost
reduction is their role, they just don’t
want to cut costs at the expense of
Physicians Agree That Cost …But Not at Patients’ Expense
their patients. This likely explains why
Reduction Is Important…
physicians philosophically agree with
EBP, but do not follow guidelines. 78% Percentage of physicians who agree
Many physician executives are Physician Executives Seek “Silver Bullet” to Gain Physician Buy-In
working on overcoming physician
skepticism of guidelines. Two real
CMO requests are shown here. Both
asked for presentations or evidence to
convince physicians to follow
guidelines. The problem is, skeptical
physicians are skilled at contesting the
validity of any given study. There is
not a single case study or “silver
bullet” presentation that can single- Member Requests Submitted to Potential Physician Pushback
handedly secure physician trust in Physician Executive Council to EBP Case Studies
guidelines.
“I want a short PPT presentation to Case studies evaluate single
Cultivating physician buy-in for clinical prove to my physicians why they guideline, do not prove efficacy
guidelines will require ongoing, should adopt guidelines.” of other guidelines
complex discussions. But, the goal of
“My surgeons get the idea of care Guideline worked at a single
leaders should be to have fewer institution, but may not work
pathways, but I need to sell them
discussions about the validity of on it. Do you have a catalogue of for different patient population
clinical standardization as a concept, case studies where outcomes
and instead, spend more time on improved because physicians Study methodology lacks
determining how to implement credible adopted protocols?” credibility
care standards across the
organization.
Clinical leaders should strive to build a
culture of adherence in which the
default for clinicians is to trust the
validity of, and regularly use, their
organization’s clinical protocols, but
also exercise clinical judgment to
determine when opting out of a
protocol is the best option for a patient.
Source: Physician Executive Council interviews and analysis.
Children’s Hospital Boston has At Children’s Hospital Boston, Adherence Supported At Every Turn
cultivated a culture of adherence
among their medical staff through their Physicians’ Trust in SCAMPs1 Relies
Standardized Clinical Assessment and on Multifaceted Approach to
Physicians Trust and
Management Plans (SCAMPs) Physician Involvement
Adhere to SCAMPs
initiative.
Physician and nurse experts
SCAMPs provide clinicians with a Physicians with an
decision tree to promote a defined care
lead the guideline
creation process
90% overall positive
pathway for particular diagnoses. opinion of SCAMPs
Multiple clinicians contribute to the
Guidelines designed to
SCAMP creation process, and Adherence rate to
outcomes are monitored on an ongoing
capture clinician input as a
source of innovation
80% SCAMPs
basis to inform revisions. SCAMPs
were created largely for diagnoses
without clear evidence, so having this Outcomes data related to
SCAMPs enjoy widespread trust
feedback loop ensures the guidelines SCAMPS guidelines shared among physicians despite lack of
with clinicians to prove efficacy preexisting, clear clinical evidence
evolve to reflect new learning.
SCAMPs enjoy broad physician
support—90% of physicians think
positively of them and 80% adhere to Case in Brief: Children’s Hospital Boston
them. This is particularly remarkable
• 360-bed pediatric hospital in Boston, Massachusetts
because SCAMPs are not supported
by an undisputable evidence base. • For any medical condition or set of symptoms, a committee of physician and nursing experts create a
Standardized Clinical Assessment and Management Plan (SCAMP)—an algorithm with a decision tree guiding
This case study illustrates that a clinicians on how to manage patients with that particular condition
punitive strategy to get physicians to • SCAMPs are intended to be refined over time—this is achieved through robust data-tracking to fine-tune the
adhere is not the most effective. guideline based on outcomes and analysis of physician opt-outs
Instead, partnering with and • Boston Children’s has developed SCAMPs for 49 medical conditions. Results include: Decreased the cost of
empowering clinicians throughout the caring for children with six different conditions by 11% to 51% when compared with a historical cohort;
EBP process promotes sustained Increased the rate of "ideal" outcomes for children with a congenital condition from 40% to 69% over one year;
adherence. Increased the rate of physicians who complied with recommended specialist referrals from 20% to 75%
Source: Farias M, MD, Ziniel S, PhD, “Provider Attitudes Toward Standardized Clinical Assessment and Management
Plans (SCAMPs),”Congenital Heart Disease, 6, no.6 (2011); Klein S, Hostetter M, “Quality Matters in Focus: Learning
1) Standardized Clinical Assessment and Management Plans. Health Care Systems,” The Commonwealth Fund, 2013; Physician Executive Council interviews and analysis.
Other organizations with high levels of Distilling Constellation of Adherence-Support Practices into Key Lessons
guidelines adoption use a
constellation of tactics to promote the
use of evidence-based practice. Six Lessons for Overcoming the Adherence Challenge
These tactics are reflected in the six
lessons shown here. 1 Craft an EBP PR campaign
These lessons are not particularly
effective in isolation. To build a culture
2 Right-size physician input into guidelines
of adherence, organizations should
utilize most, if not all, of these tactics
together.
3 Leverage noncompliance to drive guideline evolution
The following sections offers case
studies and implementation advice for
each of these lessons. 4 Ensure guideline use is path of least resistance
The first lesson for promoting EBP Key Elements of Medical Staff Communication at MemorialCare
adherence is “Craft an EBP PR
Campaign.” Communication around
EBP usually focuses on specific
initiatives. For instance, physicians may
receive an overview of a new surgical
checklist or learn the new sepsis Campaign Branding Multiple Channels Creative Communication
protocol. But, typically the
Crafted communication plan Coupled broader communication System tapped medical staff
communication fails to connect these
around theme, “Data is for strategies such as emails and members to star in videos to
initiatives to the overall concept that learning, not judgment,” to newsletters with more signal their support for, and
evidence-based clinical standardization emphasize opportunity for personalized physician meetings explain, performance
will produce better results for patients. collective improvement improvement initiative
Physicians can lose sight of the value of
these initiatives when inundated with
new, mandated protocols.
To keep EBP principles top of mind and Case in Brief: MemorialCare Health System
reinforce the importance of various sub- • Seven-hospital system based in Long Beach, California
initiatives, MemorialCare Health System
• System leaders and physician champions crafted a multichannel communication
uses a dedicated branding effort. Their
plan using unified messaging on the importance of data and opportunity to minimize
tag-line, “data is for learning, not clinical variation as a means of improving performance
judgment,” coincides with an effort to
• Campaign coincided with rollout of The Advisory Board Company’s Crimson
give physicians access to performance Continuum of Care technology to enable individual physician performance tracking
data. Leaders broadcast the message
through several traditional and creative
channels, including funny videos
starring physician leaders. The
campaign connects the dots for
physicians—they see how their day-to-
day practice contributes to the overall
goal of providing better, more consistent
clinical care.
Source: MemorialCare Health System, Long Beach, CA; The
Advisory Board Company Crimson Continuum of Care; Physician
Executive Council analysis.
A top-down approach, like that at Physician Luncheon Facilitates Peer-Led, Data-Focused Conversations
MemorialCare, is important for
signaling organizational commitment. Three Key Components of Clinical Variation
However, this strategy works best in Working Lunches at Acorn Hill Health Care1
tandem with a grassroots approach to
cultivate EBP awareness among the
medical staff. For example, at Acorn
Hill Health Care, a pseudonym, a
physician leader hosted a lunch with
1 2 3
10 colleagues to share and discuss
blinded performance data. The Key Stakeholders Nonpunitive Peer-to-Peer
lunches were effective for three in Attendance Data Sharing Learning
reasons.
• Physician champion invites • Physician champion shares • Physician champion
First, the guest list included five top
five top-performing and five blinded performance data, encourages physicians to
performers and five low performers, bottom-performing physicians highlights opportunity for share clinical experiences
though this was not revealed to the (rankings are not disclosed) improvement by reducing and discuss ways to improve
attendees. This ensured the group variation quality and efficiency of care
• Invite list intended to secure
would have an outsized impact on help from highly effective and • Physicians discuss data in • Lunch cultivates shared
EBP adherence, either by being influential physicians, as well informal atmosphere, without sense of accountability to
thought leaders or by improving their as engage those most in need fear of consequence improve performance
own performance. of improvement
Once an organization communicates Balancing Expedited Guideline Rollout with Physician Engagement
the EBP vision, the next challenges is
to find a way to judiciously involve
physicians in the execution of that The Sweet Spot of Physician Participation
vision.
There is a careful balance to strike
between expediting rollout while also
maintaining the integrity of guidelines The Factory Top-of-License Too Many Cooks
and physician trust, which requires Model Physician in the Kitchen
Involvement
investments of physicians’ time—a
Promotes efficiency at the Judiciously leverages Overutilizes physicians in
scarce resource.
expense of physician physician participation in EBP guideline development and
The challenge of best utilizing involvement—likely to yield efforts to secure physician rollout—process often stalls, time
strong clinician resistance confidence while spent on redundant activities, and
physician time is illustrated in the to EBP rollout promoting efficiency physicians reluctant to participate
Venn diagram. The left circle due to time commitment
represents a model that creates Representative activity: Representative activity: Representative activity:
guidelines too quickly and without • Implements vendor- • Small group of clinical • Clinicians are free to
sufficient clinical input, built order sets, experts vets predrafted edit order sets, yielding
disenfranchising physicians. The right guidelines without clinical guidelines lack of standardization
physician vetting process
circle represents a model that over-
utilizes physicians, leading to
prolonged deliberations, delayed
rollouts, and frustrated physicians.
Organizations need to find the middle
“sweet spot,” in which select
physicians contribute top-of-license
input but are not overtaxed. The next
two case studies show how two
organizations achieve this delicate
balance during guideline creation and
revision processes.
Henry Ford Health System uses a Key Steps in Henry Ford’s System-Wide Order Set Rollout
standard process for guideline
creation—draft, incorporate physician
Order Set Draft Specialist Input Revisions Vetted Final Sign-Off
input, and implement. But, leaders are
strategic about when and how they Four physician leaders Cross-system Physician leaders vet Facility-specific
dedicated to clinical specialty teams and implement specialists sign-off on
bring the wider physician community
standardization efforts review order sets and revisions, consulting final order sets and are
into the process. When they do, it’s specialty team leads
finalize ProVation1 solicit feedback from expected to promote
within carefully defined parameters order set drafts colleagues via email when necessary adoption among peers
that balance input and efficiency.
For instance, a select group of
Implementation Tips:
physician leaders dedicated to clinical
Balancing Efficiency and System-Wide Physician Input
standardization vet all order set drafts
before requesting specialist review.
This ensures specialists are
consulted, but are not responsible for Create draft before Vet order sets with Solicit feedback via Solicit cross-system Only make revisions
the background work of collecting the sharing with larger small, dedicated email to offer physicians’ physician input at validated by evidence
literature or creating the order set. group physician group flexibility to respond all stages or consensus
Most feedback is solicited via email to
limit in-person meetings. Engagement
of medical staff representing the
entire system begins during order set Case in Brief: Henry Ford Health System
creation, promoting system-wide
• Four-hospital system based in Detroit, Michigan; includes two behavioral health centers
adoption of the clinical standard.
• Currently leveraging Epic implementation to promote clinical and process standardization system-wide
Organizations should consider the
preferences of their unique medical • Four-physician leadership team works nearly full time on clinical standardization efforts; team edits ProVation
order set drafts before soliciting feedback from specialist teams
staff when creating opportunities for
feedback and involvement. For • Specialty teams, consisting of trusted physicians and cross-system representation, send feedback on order sets
via email through ProVation; teams may solicit feedback from additional colleagues at their discretion. Specialty
instance, one physician executive
teams include: ED, obstetrics, cardiology, oncology, etc.
reported that his medical staff would
not comply with order sets until they • Physician leadership team reviews suggestions and selects revisions based on evidence and consensus; they
consult with specialty team leads when necessary
met in person to discuss them—online
feedback was not sufficient. 1) ProVation is a health information technology company which sells evidence-based order set templates
co-developed with authors from UpToDate. Visit http://www.provationmedical.com/ for more information. Source: Henry Ford Health System, Detroit, MI; Physician Executive Council interviews and analysis.
By right-sizing physicians’ upfront Specialty Groups Expected to Remedy Low Order Set Adoption
involvement in order set creation,
Henry Ford gains a significant benefit
on the back end—physician leaders
invested in promoting widespread
System-Wide Order Set Ongoing Analysis of
adoption.
Usage Rates at Henry Ford1 Low-Use Order Sets
The facility-specific specialists, who
give final sign-off on order sets, are
informally accountable for ensuring
their colleagues use them. Henry Ford
monitors order set usage on an
ongoing basis. Low-use order sets are
Clinical Specialty leads
flagged and sent to the specialty leads
standardization must either
who originally approved them. The leadership team remove, revise, or
specialists have three options: modify flags order sets promote use of
the order set, delete it, or encourage with low adoption flagged order sets
their colleagues to use the order
set as is.
Order Sets
1) Illustrative.
Of course, guideline creation is only Process for Ongoing Clinical Content Revisions at HealthEast
the beginning of guideline
management. Many organizations
lose momentum in EBP efforts when it
comes to managing revisions. Many Electronic Physician
Feedback Revision Prioritization
use, by default, a laissez-faire
approach. One organization allows
any physician to revise order sets, Limited Order Set
which only ends up formalizing On ongoing basis, Dedicated informatics group Revisions Made
physicians vets and prioritizes
variation. To avoid this, organizations
electronically submit suggestions based on
should adopt a process that suggested revisions to defined criteria
incorporates new evidence and order sets Closing the Loop
Group follows up with
physician feedback while maintaining each physician to
the integrity of the care standard. communicate if revision
was implemented or
HealthEast Care System limits provide rationale for not
revisions to those that are necessary making revision
and appropriate through the process
shown here. Physicians submit
feedback electronically, which is
reviewed by a dedicated informatics Case in Brief: HealthEast Care System
group. The groups vets change
requests and, if warranted, makes the • Four-hospital system, with 18 clinics, headquartered in St. Paul, Minnesota
revisions. They notify every physician • Physicians electronically submit order set revisions to be considered by a designated group consisting of
who makes a suggestion as to Chief Medical Informatics Officer, Director of Nursing Informatics, Director of Pharmacy Informatics, and
Director of Clinical Applications
whether the change was made, and
why. • Informatics group vets and prioritizes every revision suggestion against defined criteria; this method
judiciously allocates time of informatics staff, reduces unnecessary variation in order sets, and allows for
HealthEast physicians trust this ongoing physician engagement with order set revision process
revision process because it is
• Informatics group also makes revisions in response to vendor content updates and regulatory requirements
consistent, fair, and transparent. This
• A full version of HealthEast’s “Order Set Management Procedure” is available at:
trust has a positive impact on
advisory.com/PEC/2013meetingresources
adherence—physicians are likelier to
trust that guidelines are up to date, Source: HealthEast Care System, St. Paul, MN; Physician Executive Council interviews and analysis.
In addition to physician suggestions, Team and Criteria Boost Credibility of Guideline Revision Process
the dedicated revision team at
HealthEast considers changes from
the order set content vendor and
regulatory requirements. It could Dedicated Defined Order Set Revision
quickly become burdensome to make Revision Team Prioritization Criteria
all these changes. That’s why
HealthEast uses the criteria shown
here to prioritize revisions. A revision
has to meet one of the five listed
criteria to be made at all. And, the • Consists of CMIO1 and informatics staff Documented patient risk
criteria prioritize revisions based on from pharmacy and nursing
1 (confirmed by Patient Safety Officer)
urgency. For instance, if the FDA • Reviews and makes order set revisions
Regulatory compliance
rescinds a drug for safety concerns, based on: 2 (confirmed by Compliance Officer)
changing the affected order sets – Physician suggestions, typically made
becomes first priority. through Clinical Councils2 Evidence-based care change
– New clinical findings from third-party
3 (confirmed by Quality Officer)
This triage system allows for ongoing
physician input, preserves the content provider
ROI/financial benefit
integrity of guidelines, and judiciously – Regulatory requirements from Quality 4 (confirmed by financial analyst)
focuses the informatics group on high- or Compliance departments
priority revisions. 5 Workflow improvement
Organizations are likelier to garner the 100% Compliance an Unrealistic, and Undesirable, Target
trust of physicians, and provide better
care to patients if they use guideline
deviations as an opportunity for
learning. To that end, the third lesson
is leveraging noncompliance to drive Spectrum of Target Levels for Guideline Adherence
guideline evolution.
While most organizations strive to
increase EBP adherence rates, the
No Guideline Use Strict Protocol
Adherence
goal should not be 100% adherence.
0% 70%-90% 100%
This would stifle innovation and cause
potential harm to patients by limiting
warranted variation. Adherence Innovation Friendly
should fall in the “innovation-friendly” • Broad adherence to
zone, between 70%-90%, suggesting care standards drives
physicians are consistently following consistency, outcomes
improvement
the best practice standards but have
No defined standard of • Allows sufficient No innovation—
flexibility for improvements and their
care—variability likely to flexibility for physicians physicians simply
own discretion. to improve on
yield wide cost and comply with protocol
quality variation existing methods
Intermountain typifies what the
“innovation-friendly” zone looks like in
practice. Leaders track and analyze
physician deviations from guidelines
to determine whether deviations are
yielding a better outcome than
standard practice. If they are, leaders
adjust the standard.
Intermountain benefits from a robust
data infrastructure and dedicated
group to run these analyses. Next,
MultiCare offers a less resource-
intensive option. Source: Physician Executive Council interviews and analysis.
Even if physicians entirely trust the Three Methods to Minimize Disruption to Physician Workflow
validity of guidelines, they will not use
them if they are hard to follow. The next
lesson for promoting adherence is
ensuring guideline use is the path of
least resistance.
Shown here are three methods for
minimizing the disruption EBP causes
to physician workflow. Moving toward
the upper right, the methods require
greater physician involvement in Degree of Offer Point-of-Care
workflow redesign, as well as greater Required Support
Physician
changes in physician practice. Practice
Change Make EBP the
The first method involves shifting some
of the responsibility for following Default Option
protocols from physicians to non- Enfranchise Non- Many alert systems
physician providers. The second Physician Care considered ineffective
Team Members in today; new technological
method is making the protocol the innovations on the horizon
default option so that a physician has to
EBP Delivery
expend extra effort to opt out. The third
method is improving point-of-care
technologies to facilitate evidence- Level of Physician Involvement
in Workflow Redesign
based, real-time decision making. The
third method is a hotbed of innovation,
though most organizations are just at
the brink of experimenting with these
technologies.
In the first example, John Muir Health Enfranchise Non-physician Care Team Members in EBP Delivery
introduced a new standard of practice
largely implemented by nurse Challenges in Pre-Op Assessment Status Quo Goals of John Muir’s Pre-Op Clinic Pilot
practitioners. John Muir leaders Stratify patients based on surgical
uncovered consequential Ineffective Risk Stratification risk factors and initiate efforts to
inconsistencies in pre-op care, RN phone interviews and PCP mitigate perioperative risk
evaluations not always flagging patients
including ineffective risk-stratification
in need of further assessment Uncover and communicate critical
of patients and poor provider patient information to care providers
communication, which meant many Communication Breakdown
patients were not benefitting from Information collected during pre-op Provide patient education on surgical
proven risk-reduction strategies. phase often failing to reach downstream process and medical management
care providers
In response, John Muir piloted a pre-
op clinic. Nurse practitioners, under Underutilized Risk-Reduction
the supervision of a hospitalist, staff Strategies Outcomes Linked to Pre-Op Clinics
the clinic and assess patient risk Patients not connecting to appropriate • Improved patient satisfaction and
using a standard checklist. The NPs care pathway with targeted and timely resource utilization
risk-reduction techniques
notify the care team of any risks so • Decreased length of stay, surgery
they can introduce timely and targeted delays, and cancellations
risk-reduction techniques.
1) Access John Muir’s Pre-Op Assessment NP Checklist at: Source: John Muir Health, Walnut Creek, CA; Kalamas A, “Preoperative Evaluation and Management” in
advisory.com/PEC/2013meetingresources Operating Room Leadership and Management, Kaye AD, et al. (eds), Cambridge: Cambridge University Press,
2012; Physician Executive Council interviews and analysis.
Because of the reliance on NPs, John New Activities Associated with John Muir’s Pre-Op Clinic
Muir hardwired standard practice while
limiting the impact on physicians.
Source: John Muir Health, Walnut Creek, CA; Physician Executive Council interviews and analysis.
In addition to making it harder to Two Models for Enlisting Redesign Expert Help
override EBP prompts and cues,
organizations should make the
Guideline Workflow Guideline
practices themselves easy to follow. Development Redesign Rollout
According to the Evidence-Based
Practice Leadership Audit,
organizations rarely consult workflow
redesign experts when implementing
clinical guidelines. This is a significant Physician Advisory Redesign Expert Teams
missed opportunity—EBP rollout Group at Sentara at Luther Midelfort
should be done in conjunction with
process redesign because conflicts
with workflow preclude uniform
adoption.
• Physician advisory group provides input • Multidisciplinary frontline staff attend
Two groups are critical for workflow on workflow redesign, ways to minimize specialized process improvement training,
impact insight—frontline physicians disruption for staff join “process management teams”
and process improvement experts. • Advisory group members act as super • Teams support work of clinical content
Sentara Healthcare uses members of users for new processes expert teams; drive continuous workflow
its Physician Advisory Group as super optimization on units
users for new processes to check for
any flaws. Luther Midelfort has
redesign teams comprised of frontline Case in Brief: Sentara Healthcare Case in Brief: Luther Midelfort
staff that have completed process
• 10-hospital health system based in Norfolk, VA • 305-bed hospital located in Eau Claire,
improvement training. They partner Wisconsin; part of the Mayo Clinic Health System
• Developed a Physician Advisory Group to assist
with clinical content experts to ensure
with process redesign efforts across the system • Developed dedicated clinical process
guidelines complement unit workflow. management infrastructure with specialized care
• Group offers input on workflow redesign and
acts as super users for new processes teams responsible for the implementation of
workflow redesign across the system
• Dedicated IT liaison (one per hospital) interfaces
with physicians to address technical problems
post-process redesign
Once organizations remove “ease of Known Improvement Lever Requires Clearing Many Hurdles
use” as a barrier, performance data on
adherence becomes valuable because
it more accurately reflects physician opt-
Performance Data-Sharing Tactics Are on …Likely Due to
outs rather than systemic barriers.
EBP Leadership Audit Least-Used List… Common Hurdles
Performance transparency benefits
everyone—those who are doing well are
1 Physician opt-outs of clinical guidelines are
recognized, those who are doing poorly
tracked and analyzed so that appropriate
are motivated, and those in the middle Physicians distrust individual
adjustments to guidelines can be made
have examples to emulate—and to performance data
Experts in workflow efficiency vet clinical
avoid. 2 guidelines to ensure they can be practically
However, data should be used as an incorporated into clinician workflow
improvement tool, not punishment. The
Physician performance or OPPE
goal is for organizations to migrate 3 assessments include metrics tracking the Physician leaders avoid
toward a culture that embraces performance conversations
physician’s adherence to clinical guidelines
performance transparency as the norm,
in which physicians proactively seek out Physicians receive data on their own
data rather than having it forced upon 4 individual-level clinical guideline adherence
them.
Individual physicians who have patterns of
Physicians ignore data and
Most organizations have not made this 5 unwarranted variation receive follow-up
fail to adopt desired behavior
culture shift. Three tactics for tracking communications and corrective actions
and sharing adherence performance
data ended up in the bottom five least-
used tactics from the EBP Leadership
Audit. Physician leaders know sharing
data is critical to promoting performance
improvement, but common barriers
often stand in the way, such as
physician attribution issues and a
reluctance to have uncomfortable
performance conversations.
Source: “Evidence Based Practice Leadership Audit,” Physician Executive
Council, 2014; Physician Executive Council interviews and analysis.
Source: Gundersen Health System, La Crosse, WI; Physician Executive Council interviews and analysis.
Some organizations with mixed More Hospitals Evaluating Adherence Alongside Other Performance Metrics
medical staffs are beginning to
embed performance expectations
related to EBP into the OPPE Sample Clinical Practice
process. Sample adherence-related Guidelines Included in OPPE1
metrics are shown here.
The appropriate weighting to give Specialty Sample Metric
EBP-related metrics remains an
Compliance to ventilator
open question. But including Intensive
bundle interventions to
Including EBP
adherence metrics as part of OPPE Medicine adherence in OPPE
reduce VAP
and FPPE2 metric
sends a strong signal about the sets signals
Compliance with prophylactic
importance of EBP. Orthosurgery antibiotics within 0-60 importance of EBP
minutes of incision adoption
Episodes of noncompliance
Radiology with central line insertion
bundle
Regardless of the formal incorporation Formal Intervention Scale for Physician Underperformance
of adherence metrics into OPPE or
physician performance evaluations,
organizations should link EBP non-
adherence to escalating CMO Interview
consequences.
Formal CMO leads formal
Johnston Memorial Hospital manages Follow-Up meeting and frames
correction in terms
underperformers through a Informal Peer PI champion or of negative
transparent, escalating intervention Intensity of Meeting VPMA convenes consequences
Intervention more formal
process. First, a noncompliant PI champion
Written meeting to
physician will receive a written Notification meets with low- discuss
notification communicating the case performing corrective steps
Hospital provides colleague to
for guideline adherence. If the notice about make case
behavior continues, a physician importance of for adherence
following EBP
quality champion meets with the
colleague to review performance data, Frequency of Physician Underperformance
answer questions, and again
encourage compliance. The meeting
is entirely collegial and informal. If the
physician still does not improve, the
interventions become more formalized
Case in Brief: Johnston Memorial Hospital
and involve meetings with medical
staff leaders and ultimately the CMO. • 135-bed hospital based in Abingdon, Virginia
These targeted conversations • CMO holds one-on-one conversations only with those physicians
typically provide powerful motivation, who have not responded to previous interventions
and the escalating intervention model
ensures physician executive time is
reserved for the most-critical
conversations.
Organizations sharing financial risk EBP Adherence Critical to Meet CI Incentives for Improved Cost, Quality
with physicians under value-based
payment models can take
consequences for nonadherence a
step further—the financial viability of
the network depends on improving
quality and becoming more efficient.
In other words, while EBP is important • Peripheral players not fully committed • Physicians must meet minimal threshold
for all organizations now, it becomes to network on Vienna’s “CI score,” which includes
a necessary core competency once EBP adherence metrics
• Characterized by unwillingness to
organizations and physicians are coordinate care, join hospital’s • Physicians who score below minimum
sharing performance risk. EMR platform threshold placed on probation for one year
At Vienna Health Care, a pseudonym,
leaders of the clinical integration
network assign physicians a “CI CI Score
score” based on performance • In 2011, score included 149 different Case in Brief:
measures, which include protocol metrics, of which any given group Vienna Physician Network2
compliance. Physicians missing the was accountable for 10-25 • Clinically integrated physician network
threshold CI score have a year to • Metrics include patient registry usage, affiliated with six Vienna Health Care
effective use of hospital resources, hospitals in the Southwest
improve or they are removed from the
network. clinical outcomes, adherence to • Instituted CI score, non-negotiable
screening protocols membership requirements to improve unity,
As more organizations adopt risk- quality of physician partners in network
based contracts, success will depend
in part on finding ways to instill EBP
adherence as a standard physician
competency. The good news is, as
physicians financially align with health
care organizations, they are likelier to
lead and be fully engaged in EBP
adoption efforts.
1) Clinical integration. Source: Health Care Advisory Board interviews and analysis;
2) Pseudonym. Physician Executive Council interviews and analysis.
The tactics thus far have focused Recognizing Top Performance a Proven Engagement Driver
primarily on how to use data to
identify and address
underperformance. However,
“This organization recognizes clinicians for excellent work.”
organizations should also use data to
recognize excellent physician n=3,711 economically affiliated physicians
1) Includes physicians who answered “Agree” or “Strongly Agree” for this driver.
2) Includes physicians who answered “Tend to Agree”, “Tend to Disagree”, “Disagree”, Source: Advisory Board Survey Solutions’ national physician database, 2013;
“Strongly Disagree” for this driver. Physician Executive Council interviews and analysis.
but all of the names are blinded, with 5. Dr. Sail 4.50 16 2.73 5. Dr. Sail 4.50 16 2.73
the exception of the top performers 6. Dr. Sun 6.10 30 5.50 6.10 30 5.50
and the physician’s own data. This 6. -----------
7. Dr. Wood 8.27 22 9.75 8.27 22 9.75
publicly acknowledges top 7. -----------
8. Dr. Rose 11.00 2 12.73 11.00 2 12.73
performers, promotes a healthy dose 8. -----------
of competition, and allows other
physicians to seek advice from top CMO reviews Top five names not blinded Each physician receives
performers. Additionally, this method individual physician to recognize performance, report with his or her
utilization encourage lower performers performance highlighted
does not shame underperformers.
to seek mentorship from top
performers2
1) All names are illustrative. Source: Intermountain Healthcare, Salt Lake City, UT; Physician
2) This feature is on some, but not all, reports. Executive Council interviews and analysis.
Though not currently a widespread Showing Individual Performance in Context of Campus-Wide Goal Prompts Gains
practice, linking EBP adherence to
physician compensation will likely Memorial Hermann Financial Incentive Order Set Compliance Across
become more common as the Program for Order Set Compliance Memorial Hermann Campuses
industry shifts away from productivity-
In 2011
based plans to rewarding value.
At Memorial Hermann Healthcare 91% 90%
77% 81%
System, physician incentives are
60%
linked to compliance with order sets, Group Performance Threshold 48% January
but not individual compliance.
Campus-wide order set compliance June
Incentive payouts depend on must reach 60% for any campus
physicians at an entire campus— physician to receive incentive payout
across all specialties—adhering to Sugar Land Northeast The Woodlands
order sets for six high-volume, high-
cost DRGs. For any single physician
Efficiency Gains
to receive a payout, physicians must
collectively achieve 60% compliance. After Six Months
Memorial Hermann sends out monthly Individual Performance Reports System Length
Costs of Stay
compliance reports with individual Monthly campus-specific reports
physician compliance. This ensures list individual physician order
the goal stays top of mind, and set compliance 4%
Reductions
informs physicians if their compliance attributed to order
rates are dragging down the group set adoption
rate. It promotes collective
accountability—a physician may 16%
encourage a peer to comply if they
are consistently deviating from the
standard order set. Case in Brief: Memorial Hermann Healthcare System
Just six months into the program, • 13-hospital health system with 3,500-physician CI network based in Houston, Texas
compliance increased across • To drive group-level quality performance, portion of physician financial incentive tied to campus-wide
facilities. The system realized compliance with six high-volume DRG order sets1; physicians gain understanding that decision to not follow
reductions in cost and length of stay care standards affects peers in the network
from increased order set use. • Incentives improved order set compliance and yielded significant cost reductions
1) Order sets include community-acquired pneumonia, CHF, COPD, chest pain, GI hemorrhage, and sepsis. Source: Next-Generation Clinical Integration, Health Care Advisory Board, 2012.
The five lessons covered thus far Adherence Case Study: Inova Mount Vernon Hospital
illustrate that there is no single
solution for overcoming the
A Targeted System Campaign… …Without a Clear Impact
adherence challenge. It takes
pursuing a culture of adherence, Identified sepsis as a system priority
which requires a multifaceted strategy through LOS, mortality data
of EBP supports such as messaging,
workflow support, data, and
Provided physician education on
incentives.
sepsis guidelines
The next case study from Inova
Health System provides a real-world Created sepsis bundle order set
example of how using all of the EBP
support principles benefits a specific Before After
Provided facilities with monthly Campaign Campaign
initiative. data reports
In 2012, Inova rolled out a system-
wide sepsis campaign that seemed to
have all the makings of a successful Case in Brief: Inova Mount Vernon Hospital and Inova Alexandria Hospital
initiative. Leaders had identified a
high-ROI opportunity, educated • Inova Mount Vernon Hospital (IMVH) and Inova Alexandria Hospital (IAH) are 237-bed and 318-bed
physicians, created order sets, and community hospitals, respectively
reported compliance data to facilities. • Both hospitals are part of a five-hospital, not-for-profit health system located in Northern Virginia
Despite these efforts, Inova did not • In 2012, the VPMA at IMVH and CMO at Inova Alexandria, Dr. Donald Brideau and Dr. Jack Audette, piloted
realize performance gains. an ED sepsis initiative which leveraged real-time tracking and analysis to identify and remove barriers to
adherence
• Preliminary results at IMVH and IAH include:
– Reduced time of bundle completion from 142 to 97 minutes (IMVH) and 125 to 80 minutes (IAH)
– Increased sepsis bundle adherence rate from 20% to 64% (IMVH) and 23% to 38% (IAH)
– Reduced LOS from 8.3 to 6.1 days (IMVH) and 9.6 to 7.9 days (IAH)
The CMO at Inova Alexandria Three Data Shortfalls Inhibit Sepsis Practice Change
Hospital convened a multidisciplinary
team from pharmacy, the ED, and
infectious disease to determine why
the system initiative was not
producing the desired practice
change.
They determined the system’s
Data Not
monthly data reports were not Too Many Metrics Delayed Reports
Physician Specific
providing physicians with actionable,
timely data. The reports were very Physicians receive long Patient-specific data Adherence data
long and tracked adherence to over spreadsheet detailing 20 provided in aggregate reports provided six
20 sepsis metrics for every patient. metrics on sepsis report, but not to eight weeks after
protocol adherence organized by physician patient encounter
The reports were also provided six to
eight weeks after the patient
encounter. Even if physicians wanted Non-actionable Data
to act on this data, it was extremely • Physicians largely ignore reports
difficult to remember the particular
• Physicians do not feel accountable
cases and reflect on the care they
for adherence
provided.
• Facilities cannot determine root causes
In response, the multidisciplinary of nonadherence because of time lag
team decided to pilot a new approach
in the ED, since this where the
majority of sepsis cases present. The
ED pilot team made two big changes.
First, they made it very clear to
physicians what were the highest-
impact steps. Second, they helped
them learn from care breakdowns
quickly. These changes are outlined
in detail on the following pages.
Source: Inova Mount Vernon Hospital, Falls Church, VA:
Physician Executive Council interviews and analysis.
Inova did not change the system Imperative: Complete Care Steps in Critical Time Window
evidence-based sepsis protocol, but
they did double-down on adherence
to select, highest-priority components
of the sepsis bundle. The ED pilot Simplified ED Pilot Sepsis Bundle Goal1
team set a goal for clinicians to
complete the four bundle components 20-Metric, System-Wide
1 Measure lactate levels
listed here. Importantly, they set the Sepsis Protocol:
expectation that all four care activities
be completed within an hour for every
patient diagnosed with sepsis. The
2 Obtain blood cultures Target:
goal has changed clinician behavior
because it is easy to remember and Complete all four
clinicians can be held accountable care activities
within one hour
for it.
of diagnosis
3 Administer antibiotics
In addition to streamlining the sepsis IMV’s1 Data Strategy to Track Sepsis Bundle Adherence Daily
goal, the ED pilot team aimed to
generate actionable insights in real
time so that all clinical staff could
learn from their mistakes and improve
What is our purpose What type of data do How do we collect How often do we need
performance. This required the team
for collecting data? we need to collect? this data? to collect the data?
to change its approach to data
collection.
The day after treating a septic patient Next-Day Sepsis Huddle at Inova Mount Vernon Hospital
in the ED, key ED clinicians huddle to
review the performance report and
investigate any sepsis cases falling
short of the four-part sepsis goal. The
huddle participants may discuss the
cases with the entire care team to System
determine the root cause for Improvement
noncompliance and address relevant Care team identifies and
barriers. Decide corrects work-flow and
Appropriate system barriers to
The next-day adherence data is the
Course of noncompliance
linchpin component of the huddle. The Action
team immediately feels the
consequences of not hitting the goal,
Next-Day Huddle Discuss Defects
and they can fix process breakdowns
because the cases are fresh in In the morning, ED director, ED leadership team
clinicians' minds. clinical pharmacist, and reviews cases falling short
charge nurse review of goal and discusses Real-Time Coaching
adherence to sepsis bundle barriers to achievement
on yesterday’s cases with care team ED director or CMO offers
feedback, advice to
physicians not meeting goal
Inova Mount Vernon’s focus on the Pre- and Post-ED Pilot Sepsis Outcomes at IMVH2 and IAH3
four-part bundle and next-day
assessments has yielded positive
results, including improved
adherence, reduced time to complete Sepsis Goal Average Time to Average Length of Stay
the bundle, and reduced length of Adherence Rate Complete Sepsis Bundle for Sepsis Patients
stay.1 In Minutes In Days
81% 142
This case study illustrates the 63% 125 9.0 9.6
Pre-Pilot 7.1 7.9
tremendous impact wraparound
63 80
support—clear goals, timely data, and Post-Pilot 20% 23%
shared responsibility—can have on
promoting adherence to a known, ” IMVH IAH IMVH IAH IMVH IAH
effective guideline, and ultimately
improving outcomes.
Improving Adherence Without Changing the Guideline
“We’re going to narrow our focus to the ED and four major metrics. When a patient comes in
with sepsis they are going to get all those interventions, and we are going to track it and look at
the data the very next day. That’s the thing that changed. There was no change in the
guidelines. The guidelines were from the system-wide initiative. But, how physicians reacted to
the data was much more personalized when we took it in-house rather than having all this data
poured out to them with no direction on how to use it.”
Dr. Donald Brideau, CMO, Inova Mount Vernon Hospital
Before moving on to more discussion Sepsis Resources Available Through the Physician Executive Council
of fostering EBP, please note that
many hospitals have an opportunity to
Available on Advisory.com
improve mortality outcomes and
reduce cost per case by hardwiring
evidence-based sepsis care.
The Physician Executive Council has
extensive resources to guide hospitals
in building a system of care that
“Ten Imperatives to Reduce “Playbook for Elevating
coordinates care team responsibilities
Sepsis Mortality” Publication Sepsis Care” Webconference
and delivers timely treatment for every
A Playbook for Elevating Sepsis Care Research from Crimson
sepsis patient. Labs and the Physician
Reduce sepsis mortality rates with 10 Executive Council
tactics to build a system of care that
coordinates care team responsibilities Strategies to hardwire early sepsis
and delivers timely treatment for every detection and accelerate sepsis care
sepsis patient, every time delivery
Currently, clinical guidelines tend to EBP Guidelines Promote Quality, but Often Do Not Curb Overutilization
define a standard practice that
optimizes quality. However, most
guidelines are not particularly Factors Contributing to Migrating Evidence-Based Practice
effective in curbing unnecessary (and Excess Physician Ordering Toward Cost-Effectiveness
often expensive) utilization. For
instance, physicians may follow an
Advances in Technology Conventional Optimized
order set, but still order additional
EBP Clinical Care
tests. Many factors contribute to Proliferation of new tests and
excess utilization, including a diagnostic procedures Clinician practice Clinician practice
reflects quality reflects quality
proliferation of new technologies, the
considerations, considerations
ease of electronic ordering, and fear but orders may go and limits overuse
Ease of Electronic Ordering
of malpractice. beyond of clinical services
Growing adoption of
Curbing unnecessary utilization is necessary care
computerized physician
critical both for reducing cost per case order entry
and managing total costs of care. It Literature is not conclusive on
requires a shift from the conventional appropriate use levels for tests
Defensive Medicine
quality focus of EBP to guidelines that and procedures (e.g.,
Fear of malpractice and echocardiogram); clinicians
promote both quality and resource malpractice claims have an opportunity to define,
stewardship. and refine, appropriate
standard of care.
Organizations pushing forward most
effectively with reducing unnecessary
utilization are careful not to prioritize
cost reduction over quality—reducing
utilization must never come at the
expense of patient care. Instead,
these organizations are focusing on
how to provide the right care, and the
right amount of care, to patients. This
vision resonates with physicians and
is one reason Danbury Hospital in
Connecticut has successfully Source: Physician Executive Council interviews and analysis.
engaged physicians in these efforts.
©2014 The Advisory Board Company • 28311 68 advisory.com
Lesson #6: Make Physicians the Trailblazers of Rationalizing Resource Use
Danbury Hospital models the sixth Physician Champions Create, Promote Utilization Targets Among Peers
and final lesson on adherence: make
physicians the trailblazers of
Partnership Between Data Analysts Representative Opportunities
rationalizing resource use.
and Physician Champions Dashboard (CHF)
A few years ago, Danbury Hospital
launched a comprehensive efficiency
initiative to reduce variation for eight
Current Utilization
high-cost, high-volume DRGs. The Measure Rationale Action Plan
Utilization Goal
CMO knew physician engagement • Physician champion, data analyst pairs Educate
was critical for any meaningful dedicated to specific DRG evaluate utilization Not needed if
house staff,
Echo recent study or 43% 35%
progress, so he involved physicians trends, identify improvement opportunities well identified
hospitalists;
track trends
from the outset. A physician champion • Physicians and analysts work together to
Educate
was assigned to each DRG and create an “opportunity dashboard” with house staff,
explicit goals for improving utilization Telemetry Not indicated in
paired with a data analyst to review for over uncomplicated
hospitalists;
42% 25%
track trends;
physician performance data. Together • Goals established based on evidence and 48 hours heart failure
change order
they created dashboards, like the one clinical consensus set
shown here, with utilization targets
and action steps to curb
overutilization of resources such as
echocardiograms, telemetry, and
blood. These utilization targets
Case in Brief: Danbury Hospital
typically do not exist in the literature,
so the physicians set them based on • 370-bed teaching hospital in Danbury, Connecticut
clinical experience and consensus.
• Using the Crimson platform, launched a DRG efficiency initiative to reduce
Danbury also ensured physician and unnecessary costs and variation in care without compromising quality
data analysts have the analytic
• The initiative yielded a $2.9 million reduction in charges over FY 2009-2010
capabilities to track and report
performance.
Announcing utilization targets to Committee Uses Multiple Tactics to Reduce Unnecessary Utilization
physicians is not sufficient to produce
practice change. Instead, Danbury’s
DRG committees surrounded
physicians with checks and supports
to encourage the desired behavior
change. They modified order sets and
DRG Committee Tactics to Encourage Reduction in Unnecessary Utilization
Members
implemented rounding checklists to
inflect desired behaviors in real time.
They provided online education, and
kept clinicians up-to-date on
performance against utilization Hardwired Ongoing Accountability
targets. They promoted accountability • Chaired by CMO Guidelines Education Mechanisms
by discussing questionable choices • Physician champions • Modified order sets • Developed online • Discuss utilization
during rounds. And they put utilization (department chairs/chiefs) and implemented mandatory targets during daily
barriers in place, such as requiring • Nursing CPOE direct CPOE-based alerts educational rounds: “Why did
specialist approval for certain tests or seminars, testing you order that?”
• Service line directors • Created rounding
placing restrictions on certain high- checklist (e.g., • Presented • Require specialist
cost, high-risk items. • Data analyst
review orders for performance data at approval before
telemetry, foley) service line ordering certain
committees and tests
hospitalist meetings • Enforce restrictions
for certain high-cost,
high-risk items
The impact of these tactics is evident A Closer Look at Rationalizing Use Within a Specific Clinical Area
through Danbury team leads’ work to
right-size telemetry use.
Leaders pinpointed three reasons for Drivers of High Telemetry Targeted Tactics to
high telemetry use at Danbury— Use at Danbury Reduce Utilization
abundance of telemetry beds,
House-wide availability of Reduced number of telemetry beds
inconsistent physician adherence to
telemetry beds on med-surg floors
use criteria, and failure to discontinue
telemetry orders. They addressed Inconsistent adherence to Educated ED physicians on criteria
each problem driver directly— established criteria for use for telemetry orders
reducing number of beds, educating
Failure to discontinue telemetry Option to discontinue telemetry order
clinicians, and evaluating the
order as appropriate included in daily rounding checklist
telemetry order in the daily rounding
checklist.
These steps cut the percentage of
patients on telemetry in half, and Reduced Telemetry Use at Danbury Hospital
significantly reduced the percentage
of patients on telemetry for over 48 Percentage of Patients Percentage of Patients
hours. on Telemetry on Telemetry More Than 48 Hours
Hospitals have been using mergers Intent of Mergers and Affiliations Rapidly Evolving
and acquisitions as a growth lever for
decades, but the goals behind M&A
strategy are changing. Traditionally,
M&A was used to realize financial and
operational efficiencies. However,
Scale Scope Reach
now organizations are using M&A to
realize clinical and geographic scale. Financial Operational Clinical Geographic
Stake regional
The final chapter of this publication footprint
focuses on clinical scale. To achieve
Establish
this, organizations must embed national
Evidence-based
evidence-based practice across all its network
practice,
services and sites as efficiently as standardization
possible.
Integrate
Though physician executives tend to “New Market” services
Partnership across care
share this common vision, execution Merge back continuum
Value
has been inconsistent. Results from office functions
the Evidence-Based Practice Increase
Leadership Audit found that most operational
efficiency
organizations are successful in Consolidate
building an evidence-based unit or local position
Source: Health Care Advisory Board interviews and analysis, The Advisory
Board Company; Physician Executive Council analysis.
A best practice standard of care System-Wide Performance Variation Persists, Despite Known Best Practice
typically exists within an organization,
but has not been scaled across
hospitals.
The graph shows the readmission
rates for six hospitals of a health
Pneumonia Readmission Rates Across ”
system. Performance varies
Hospitals of Walnut Field Health System1
significantly, which is typical of most
systems that have not adopted a
23% Hard to Ensure Even EBP
standard, best practice approach. Of 22%
course, confounding factors may 20% Support Across Sites
19% 18%
come into play, but a standard 16% “We’re doing well at our hospital, but we
approach can contribute to reducing just acquired a couple other hospitals
this performance variation. and I’m not sure what they do. We don’t
have an established way of coming to
However, at most systems, consensus on the best approach. And it
performance variation remains doesn’t seem to be on the top of
because of significant barriers to anyone’s priority list.”
implementing a system-wide clinical Facility CMO
standard, including, but not limited to,
A B C D E F
geographic dispersion, unique facility
cultures, clinical skill mix, and
available resources.
Source: “The New Breed Health System,” The Advisory Board Company;
Physician Executive Council interviews and analysis.
While most organizations are Example Hurdles to Strategic EBP Initiative Prioritization
structured as systems, they are not
using the system purview to prioritize
EBP efforts. This means they are not
unearthing system-wide improvement
opportunities with the greatest
potential for cost and quality
improvement.
Decentralized Decision Making An Overabundance of Options
The four hurdles outlined here hinder
Key example: OB-GYN group decides to Key example: CMO relies on bottom-up
effective, system-wide prioritization of
focus on new intervention without proven innovation due to expansive list of potential
EBP initiatives. The most common are ROI after attending conference stakeholders and areas of focus
the two on the left. First, some
organizations favor decentralized
decision making to enfranchise
physicians in the process. However,
this can lead to highly localized, and
Opportunistic Selections Lack of Continuous Monitoring
often redundant or low-ROI, efforts to
create guidelines. Second, Key example: Organization focuses on ED Key example: System maintains sepsis as
organizations may make opportunistic frequent fliers because ED physicians priority for three years without analysis of
are engaged new opportunities
selections based on factors such as
availability of a physician champion or
a path of least resistance.
Yields nonoptimal selection of
All of these approaches suffer from projects and duplication of work
the same pitfall—they allow pockets
of EBP to sprout rather than
strategically selecting which projects
will generate the greatest return for
the entire organization.
The seventh lesson proposes an
alternative—use a centralized, data-
driven approach to prioritize system-
wide opportunities. Source: Physician Executive Council interviews and analysis.
Banner Health, a 24-hospital system, System-Level Group Conducts EBP Prioritization Analysis at Banner Health
strikes the right balance between
centralized prioritization (which
Five Clinical Suggest high-ROI cross- 17 Clinical
ensures that EBP efforts are focused
Performance system opportunities Consensus Groups
on the most impactful opportunities) Groups (CP Groups) (CCGs)
and specialty-led execution (which
ensures that standards of care are
relevant and credible). Rather than Each CP Group staffed by Devise and disseminate
having one entity try to accomplish physician lead1, RN, and evidence-based practice system-wide
both goals, they established two process engineer
separate but complementary efforts.
CP Group uses data-driven
The Clinical Performance Groups (CP approach to compare system-
Groups) are wholly dedicated to wide standardization
uncovering variation in the system, opportunities
quantifying it, and using those insights
to prioritize opportunities. Based on CP Group vets each
this analysis, they define the areas for opportunity against set cost
and quality criteria
which Banner should create
guidelines.
These insights inform the work of the
Clinical Consensus Groups (CCGs).
Case in Brief: Banner Health
These are system-level groups,
• 24-hospital, not-for-profit system headquartered in Phoenix, Arizona
organized by clinical area, that
develop the standards of care in the • Facilities located throughout Arizona, Alaska, California, Colorado, Nevada,
areas identified by the CP Groups. Nebraska, Utah, and Wyoming
• In 2009, Banner introduced Clinical Consensus Groups (CCGs) dedicated to
Many systems use groups like the
defining, designing, and implementing evidence-based practice; currently 17
CCGs—specialty groups that create CCGs operating
guidelines. But by having different
• Created five Clinical Performance Groups responsible for uncovering top
teams focus on prioritization, Banner system opportunities to minimize variation
ensures the very resource-intensive
efforts of the CCGs are directed
against the biggest opportunities. 1) Spends a quarter of time on CP Group work. Source: Banner Health, Phoenix, AZ; Physician Executive Council interviews and analysis.
The table shown here outlines Features of System-Level EBP Groups at Banner Health
defining characteristics of the Clinical
Performance Groups and Clinical
Consensus Groups.
Banner used two tactics to
successfully position the CP Groups System-Level
Function Leadership Membership Number, Specialization
EBP Group
so the CCGs, comprised of many
influential clinicians, would follow the Take a data-driven • Physician lead • Physician lead • Five CP Groups
approach to evaluating • Clinician lead (25% time) • Each CP Group
recommendations of the much smaller Clinical and prioritizing system- (typically an • Clinician lead partners with specific
CP Groups. Performance wide opportunities to RN) (full time) CCGs
Groups minimize variation;
First, the CP Groups are led by a well- • Process engineer
(CP Groups) suggest opportunities
respected physician who dedicates a (full time)
for CCGs to build
quarter of his or her time to the group. clinical guidelines
This add clinical credibility to what Develop and implement • Physician lead Multidisciplinary, cross- • 17 CCGs
would otherwise be a data-centric care processes across • Clinician lead system teams: • Each CCG focuses on
the system based on • Bedside clinicians, specific clinical area
team. • Facility CMO
Clinical best available evidence physicians (surgery, cardiology,
Second, the CP Groups follow Consensus and consensus • Regional CMO
• Clinical Informatics ED, pharmacy, etc.)
consistent criteria to evaluate any Groups
(CCGs) • Pharmacy
variation opportunity, eliminating any • Supply chain
potential bias. • Therapy (occupational,
respiratory, physical)
Source: Banner Health, Phoenix, AZ; Physician Executive Council interviews and analysis.
”
“Although the Clinical Consensus Groups know effective standardization is
dependent on balancing clinical quality, safety, cost, and patient
experience, they are still most focused on clinical quality—that is our
physician culture.”
Dr. Marjorie Bessel
Regional Medical Officer, Banner Health
1) Adapted from a framework in the New England Journal of Medicine. Source: Banner Health, Phoenix, AZ; Physician Executive Council interviews and analysis.
When selecting clinical areas to Physicians Calculate and Pitch ROI During Initiative Selection Process
develop guidelines for, physician
leaders typically do not consider the
ROI calculation associated with
reducing variation. In contrast, Initiative Selection Process at University Hospitals
University Hospitals in Cleveland
cultivates a cost-consciousness
among their physician leaders by Quantify Expected Share Monthly Demonstrate ROI
having them quantify the expected ROI Progress Updates Results
ROI of any EBP initiative before the
Every initiative leader Clinical leaders host Initiative leaders present
system will resource it. The leaders
must quantify expected monthly meeting to track findings to the board
then have to prove they are achieving ROI based on LOS, cost progress made on specific and aim to demonstrate
the expected return by presenting per case, and mortality initiatives results within 90-120
monthly progress reports to clinical days
leaders. After 90 days, they are
expected to demonstrate hard ROI.
This selection process ensures Case in Brief: University Hospitals
system resources go to the highest-
potential projects. And, physicians • 10-hospital system based in Cleveland, Ohio
gain greater understanding into the • Implemented a strategic selection process for vetting possible EBP projects
cost dimension of care, which is a • Each initiative leader must quantify the initiative’s expected ROI and aim to realize it
desirable competency for physician within 90 to120 days
leadership within the current value- • The system has been able to remove $150 million in costs over the past three years
based market.
The Physician Executive Council Highlighting Organization-Specific Cost and LOS Opportunities
offers a tool, the Physician Care
Variation Assessment, to provide a Sample Excerpt from the Physician Executive Council’s
starting point for organizations to Physician Care Variation Assessment
quantify and prioritize variation Key Functionalities
opportunities. 40%
1) Percentages are represented as ranges because incentive opportunity differs between some positions.
2) Includes system Chief Medical Officer.
3) Administrative and operational leadership includes hospital administrators, operations officers, and regional VPs. Source: Intermountain Healthcare, Salt Lake City, UT; Physician Executive Center interviews and analysis.
Within the “Clinical Excellence” domain, Intermountain’s Clinical Goals Assess Adoption of EBP Organization-Wide
Intermountain sets annual goals that
directly measure whether or not the
entire organization is following
Past System-Wide Goals for
evidence-based guidelines. Additionally,
Intensive Medicine
these goals are set for every clinical
program so EBP permeates the entire
2013 System-Wide Clinical Goals Summary
Goal Baseline Target
medical staff. Pediatric Specialties Clinical Program:
Increase proportion Implement newly established national guidelines for
For example, the chart outlines past of eligible stroke
the treatment of community acquired pneumonia
goals for intensive medicine. patients receiving 70% compliance
five measures of in children
Intermountain leaders set a high bar for appropriate care Surgical Services Clinical Program: Reduce
compliance to specific evidence-based clinically unnecessary transfusions
Increase compliance • 80% compliance
protocols, such as the sepsis bundle. to ventilator bundle • <6.65 cases per Intensive Medicine Clinical Program: Implement
An excerpt of Intermountain’s 2013 interventions to 1,000 ventilator a disease-specific computerized order entry system
reduce VAP days to guide evidence-based care
clinical goals is shown on the right (the
full version is available online). Each Increase compliance Cardiovascular Clinical Program: Integrate the
with 11 elements of 60% compliance
goal is a specific action item to advance treatment of heart failure patients across the
sepsis bundle
standardized practice, such as continuum of care
implementing national guidelines or
incorporating evidence-based practices
into CPOE.
Intermountain uses the three-step Overview of Intermountain’s Clinical Program Goal-Setting Process
process shown here to set system-
wide clinical goals.
Similar to Banner Health,
Intermountain prioritizes system-wide
variation opportunities based on the
anticipated cost and quality impact. Select Opportunities Set System Goals
Identify Clinical
With this information, clinical program That Align with for Clinical
Variation
System Priorities Programs
leaders develop a draft of the goals,
which are then vetted by system • Data analysts • System executives • Board approves a
leaders and board members. This embedded within and board members system-wide, annual
ensures clinical programs, whose clinical programs evaluate potential goal focused on a
compare and prioritize Clinical Program goals major initiative for each
members are responsible for crafting
opportunities to based on internal data Clinical Program
guidelines, are focusing on system- minimize variation and new scientific
endorsed goals rather than pet • Board goals drive
findings
• Data analysts base budget and planning of
projects.
comparison on metrics • Vetting process Clinical Programs
Additionally, board oversight provides such as volume, cost ensures every Clinical
additional motivation to system per case, LOS, and Program targets
readmission and opportunities aligned
leaders for achieving EBP-related,
complication rates with system strategy
clinical goals
Source: Intermountain Healthcare, Salt Lake City, UT; Physician Executive Center interviews and analysis.
priority.
1) Includes guidelines for PCI, CTPA, ICD, stress echo, nuclear stress, pacemaker, and external defibrillator.
2) Electronic health record. Source: Intermountain Healthcare, Salt Lake City, UT; Physician Executive Center interviews and analysis.
The final lesson for capitalizing on Commonly Overlooked Steps of Scaling Pilot System-Wide
system advantage is to scale best
practices system-wide. To do this,
organizations need a process to
translate pilot efforts into a full-scale
Set ambition to
rollout. Shown here are five critical Evaluate lessons learned
scale up front and Assess which pilots
from scaling pilot to
steps for scaling a pilot. define success should be scaled
inform future rollouts
metrics
First, make sure the ambition for scale
is clear from the outset. Then, support 1 3 5
pilot teams and enable performance
comparisons by creating a consistent
structure (e.g., data tracking and Initiate Pilot Scale Pilot System-Wide
reporting, executive sponsors).
Methodically assess which pilots to
2 4
scale so the organization can shift its
attention from innovation to the Create Reward
equally (if not more) challenging task consistency implementation, not
of implementation. Reward early across pilots just innovation
adopters. And finally, evaluate
lessons learned to inform future
rollouts.
None of these steps are particularly
novel, but organizations rarely use a
consistent, standard approach.
Alegent Health developed a standard Care Teams Pilot Pathways for System-Wide High-Variation DRGs
process to scale facility-specific care
pathways across its 10-hospital System Analysis Yields Top Each Facility Assigned a
system. Variation Opportunities 100-Day Care Redesign Project
At the outset of this initiative, Alegent
analyzed system-level data and
High-volume, high-cost DRGs
identified 20 diagnoses accounting for
90% of care in the system (e.g., heart DRG-Campus Match
failure, stroke, pneumonia, etc.). To
Greatest performance variability • Each campus tackles one DRG care
build a standard of care for each
(e.g., charges, LOS, readmissions) redesign project per 100-day cycle
DRG, they created a system-wide
• Preexisting initiatives, team interests
pilot initiative.
drive selections
System leaders assigned one DRG to Tied to core quality measures
each campus. They charged each
multidisciplinary campus team with
creating a new standard care pathway
Campus Team Members
in 100 days. This approach focused
20 diagnoses represent 90% of • Physicians • Project managers
facilities on high-priority DRGs, total care across the system
enfranchised frontline staff, and (e.g., HF, stroke, • Administrators • LEAN experts
safeguarded against duplicative work. pneumonia, psychosis) • Nurses and NPs
At the outset of the pilot initiative, Facility Care Teams Enter Pilot with Expectation to Scale
system leaders set the expectation
that each care pathway eventually be
scaled system-wide. By the 100-day
mark, every initiative leader was
System Sharing
expected to teach their new care
pathway at a system-wide “trade At 100 days, initiative
Campus leaders craft leader presents to
show” to their peers from all the other Tool Creation
initiative with end goal other campuses to
campuses. This ensured campus in mind of disseminating spur implementation;
teams were mindful to create a new Team creates presentations made
practices system-wide
Solution protocols, order every 30 days until all
pathway that addressed the barriers Generation sets to facilitate initiatives rolled out
to care across the system, not just at implementation system-wide
Team reworks at other care
their own organization. Additionally, care protocols
Root-Cause sites; hardwires
campus teams were responsible for and defines changes into
creating EBP support tactics that method for IT system
Team studies
tracking progress
would be rolled out system-wide, such current practice and
and outcomes
Pilot Initiation brainstorms causes
as protocols, order sets, and patient
for system-wide
education materials. Campus leaders receive
variation
DRG-specific EBP
initiative from system
steering committee
The Alegent pilots successfully Cost-Savings from DRG Initiatives at Alegent Health
transitioned into system-wide care
pathways, realizing system-wide
savings of $2.7 million in 18 months.
This publication has largely focused CMOs Increasingly Focused on Ambulatory Care
on driving EBP adoption in the
inpatient setting. But physician
executives are increasingly turning
their attention to ambulatory care.
Average Percentage of Time CMOs Estimate
Like health systems, physician and Spending on Ambulatory Care Responsibilities1
quality leaders have a “foot in two
2012 Physician Executive Survey
boats.” They are taking on emerging,
cross-continuum responsibilities on n=73
1) Ambulatory settings of care are defined as hospital outpatient and physician network settings. Responses include
CMO and VPMA responses to the survey question, “Approximately what percentage of your time do you spend on
management responsibilities related to each of the settings of care listed below: hospital inpatient, hospital Source: 2012 Physician Executive Survey; Physician Executive
outpatient, and physician network?” Council interviews and analysis.
On one hand, most health systems Increasing Focus on Building Population Health Management Capacity
are placing big bets on redesigning or
rethinking outpatient services for a
value-based care strategy. Physician
and quality executives are more-than-
logical participants in these
conversations. Opportunities for
Coordinated and
On the other hand, this outpatient Centralized Oversight
focus risks diluting organizational Practice-Centered
focus on the critical work still Medical Home
remaining on the inpatient side. In Ongoing Chronic Staffing
fact, the mantra that “population Management Disease
management is all about primary Support Coaching
care” probably undersells how much
innovation is still needed on the
inpatient side. Yes, organizations Information
need to avoid hospitalizations. But, Technology
Investments
there is a lot organizations can still do Care Low-Acuity
to reduce the cost, and improve the Transitions Access
care, of those hospitalizations. Points