Professional Documents
Culture Documents
j o u r n a l h o m e p a g e : w w w. a j i c j o u r n a l . o r g
Major article
Key Words: Background: Ventilator-associated pneumonia (VAP) is among the most common type of health care–
Ventilator-associated pneumonia associated infection in the intensive care unit and is associated with significant morbidity and mortality.
quality improvement Existing VAP prevention intervention bundles vary widely on the interventions included and in the ap-
prevention
proaches used to develop these bundles. The objective of this study was to develop a new VAP prevention
bundle
bundle using a systematic approach that elicits clinician perceptions on which interventions are most
important and feasible to implement.
Methods: We identified potential interventions to include through a review of current guidelines and
literature. We implemented a 2-step modified Delphi method to gain consensus on the final list of in-
terventions. An interdisciplinary group of clinical experts participated in the Delphi process, which was
guided by a technical expert panel.
Results: We identified 65 possible interventions. Through the Delphi method, we narrowed that list to
19 interventions that included 5 process and 14 structural measures.
Conclusions: We described a structured approach for developing a new VAP prevention bundle. Obtain-
ing clinician input on what interventions to include increases the likelihood that providers will adhere
to the bundle.
© 2016 Association for Professionals in Infection Control and Epidemiology, Inc. Published by Elsevier
Inc. All rights reserved.
* Address correspondence to Kathleen Speck, MPH, 750 E Pratt St, 15th Fl,
Ventilator-associated pneumonia (VAP) is among the most
Baltimore, MD 21202.
E-mail address: kspeck2@jhmi.edu (K. Speck). common type of health care–associated infection in the intensive
Author Contributions: Ms. Speck carried out the literature and guideline review, care unit (ICU) and is associated with significant morbidity and
coordinated the modified Delphi method, and helped draft the manuscript. Dr Rawat mortality.1-3 Between 10% and 20% of patients ventilated for a du-
interpreted the results of the modified Delphi method and helped draft the manu- ration of >48 hours develop VAP.1 In addition, VAP is associated with
script. Mr. Weiner and Mr. Tujuba carried out the literature and guideline review,
implemented the modified Delphi method, and carried out data collection. Dr Farley
a longer duration of mechanical ventilation, longer hospital length
participated in the design of the study and analysis and interpretation of its results. of stay, longer ICU length of stay, and higher hospital charges.1,4,5
Dr Berenholtz conceived the study, participated in its design, participated in inter- Several published guidelines summarize effective interven-
pretation of results, and helped draft the manuscript. All authors read and approved tions and infection control practices and provide recommendations
the final manuscript.
to prevent VAP.6-9 Some of these guidelines are now close to 10 years
Funding/Support: This work has been funded by the National Institutes of Health
(grant no. R01HL105903). old and fail to include more recent evidence. Some recommenda-
Conflicts of Interest: Dr Berenholtz receives support from the National Insti- tions are inconsistent across these guidelines. Furthermore, despite
tutes of Health and Agency for Healthcare Research and Quality for grants and these guidelines, many patients do not receive the recommended
contracts focused on improving patient safety and quality, including ventilator- interventions because translation of evidence into practice remains
associated pneumonia prevention, and receives honoraria and travel expenses from
challenging.10 Effective strategies to increase adherence to the guide-
various hospitals and hospital associations for consulting and speaking on topics
related to improving patient safety and quality. The other authors have nothing to lines and reduce related public health consequences associated with
disclose. VAP are paramount.
0196-6553/© 2016 Association for Professionals in Infection Control and Epidemiology, Inc. Published by Elsevier Inc. All rights reserved.
http://dx.doi.org/10.1016/j.ajic.2015.12.020
K. Speck et al. / American Journal of Infection Control 44 (2016) 652-6 653
One commonly used approach to increase adherence to VAP Modified Delphi technique
guidelines is to aggregate care processes into a bundle of care. The
use of bundles improves process reliability and clinical outcomes.11 We used a 2-step modified Delphi method developed by the
Implementation of bundles designed to improve care for mechan- RAND Corporation to determine which interventions to include in
ically ventilated patients has been associated with significant our proposed VAP prevention bundle (Fig 1). The modified Delphi
reductions in VAP rates.11-15 Nevertheless, the specific care pro- method obtains a reliable consensus among a group of experts by
cesses included in these bundles vary,16,17 and the approach to select eliciting individual opinions on the subject of interest, providing feed-
specific bundle components in the United States has not been well back about these initial opinions to the participants, allowing the
articulated. Furthermore, the most widely used ventilator bundle opportunity for individual reassessment, and assuring anonymity
in the United States was originally developed to reduce various com- of individual responses. The Delphi method allows participants to
plications associated with mechanical ventilation, not just VAP.11,18 express their opinions independently and avoid confrontation that
As a result, concerns exist regarding the internal validity of this can hinder arriving at an accurate consensus. Each participant’s
bundle and its use as a potential quality indicator for reducing VAP opinion has an equal weight in the consensus reached by the
rates.16,18 group.19,20
In this article we describe a systematic approach for develop- An interdisciplinary group of clinical experts completed the 2-step
ing a VAP prevention bundle. Specifically, we focus on the process modified Delphi method. We first recruited known experts in the
we used to summarize guideline recommendations and systemat- field of VAP prevention, and then we used a snowball invitation
ically seek clinician perspectives in identifying interventions for process. Clinicians who had agreed to participate were asked to
inclusion in a new VAP prevention bundle. The Institutional Review forward information regarding the project to other clinicians they
Board at The Johns Hopkins University School of Medicine ap- felt might be interested in participating in the project. We also
proved this study. e-mailed potential participants via LISTSERVs of national profes-
sional societies, including the Society of Critical Care Medicine,
Society of Healthcare Epidemiology of America, and American As-
METHODS sociation for Respiratory Care. Participants were self-selected, based
on their own interest and expertise. We restricted participation pre-
We reviewed current VAP prevention guidelines and recently pub- dominantly to U.S. providers to capture U.S. perceptions of VAP
lished literature to identify candidate interventions, convened an prevention interventions. We collected from each Delphi partici-
interdisciplinary group of experts, and implemented a 2-step modi- pant demographic information, including age, sex, health care role,
fied Delphi method to gain consensus on a final set of interventions primary department, size of hospital, hospital location (urban, sub-
to include in our VAP prevention bundle. To provide guidance urban, and rural), experience treating VAP, perceived knowledge of
throughout the bundle development process, we convened a 15- both original and current literature on VAP prevention, and poten-
member technical expert panel (TEP) in August 2011. The TEP was tial conflicts of interest.
made up of experts from the disciplines of critical care, pulmo- Delphi participants completed 2 rounds of rating VAP preven-
nary, and infectious disease and researchers with an expertise in tion interventions. Prior to each round, we provided participants
basic measurement and implementation science. The TEP met via with the list of VAP prevention interventions, organized by the
a conference call on a quarterly basis and as needed. 5-group framework previously described, a summary of recom-
mendations in the guideline for each specific intervention, and
We examined and summarized all interventions listed in VAP Step 1: Evaluate and Rank 65 Candidate Interventions
• 37 interventions from VAP Prevention Guidelines
prevention guidelines published during the last 15 years by the • 28 interventions from literature review
American Thoracic Society,6 Society for Healthcare Epidemiology of
America/Infectious Diseases Society of America,8 Canadian Criti-
cal Trials Group,7 and Centers for Disease Control and Prevention.9 Technical Expert Panel (TEP) Review
We tracked articles cited in each of these sources back through 3-4 • 19 survived; 46 rejected
generations to identify additional original research, scientific reviews, • 25 added
• 3 new interventions
and meta-analyses. • 3 interventions re-worded
Using relevant key words, we searched the literature to identi- • 19 choices added to reduce ambiguity
fy relevant articles published after the release of each guideline
previously referenced above and articles not cited in the guide-
lines. Additionally, we researched articles referencing particular
interventions to identify competing findings or opinions in the Step 2: Evaluate and Rank 44 Candidate Interventions
field. To ensure that we received information published by all
health care provider types, we searched PubMed, CINAHL, and
Google Scholar.
Technical Expert Panel (TEP) Review
We sorted the VAP prevention interventions into 5 topic groups
• 23 selected; 21 rejected
based on the framework used in the Society for Healthcare Epide- • Confirmed 46 candidate interventions rejected from Step 1
miology of America/Infectious Diseases Society of America guideline.8
These groups were (1) prevention of transmission of bacteria; (2)
aspiration prevention; (3) reduce colonization of the aerodigestive Final Selection: 19 interventions identified by combining 23
tract; (4) prophylactic procedures for prevention of pneumonia; and candidate interventions
(5) minimize contamination of equipment. We chose to limit cat-
egorization of each intervention to the most appropriate group; Fig 1. Schematic of 2-step modified Delphi method used to develop proposed VAP
however, some could have been included in >1 group. prevention bundle. VAP, ventilator-associated pneumonia.
654 K. Speck et al. / American Journal of Infection Control 44 (2016) 652-6
pertinent references. In the list of interventions, we intentionally nursing, or respiratory therapy policies and procedures, and ad-
presented all identified interventions, including those that were mu- herence could likely be evaluated less frequently.
tually exclusive interventions (eg, use the supine position, avoid the
supine position). This thorough presentation of interventions allowed RESULTS
participants an opportunity to express their preferences during the
rating process. Participants rated the interventions using a Web- Guideline and primary literature review
based instrument. For each of the 5 groups of candidate
interventions, we provided text boxes in which participants could We identified 65 candidate interventions. Of these, 37 came from
write explanations, suggestions, or other comments about the in- existing guidelines. We identified the remaining 28 through the lit-
terventions being considered. erature review.
In the first round of rating, we instructed participants to rate each
intervention based on their perceived importance of the interven-
tion in preventing VAP. Participants used a Likert scale of 1-9, where Interdisciplinary VAP prevention committee and Delphi method
1 was least important and 9 was the most important. We also offered
a cannot rate option to participants to use if they perceived that they Overall, 171 health care providers agreed to participate in the
did not have a clear opinion or had insufficient knowledge of the Delphi method. Nine of these participants reported a possible con-
intervention, or if the intervention as presented in the Web-based flict of interest.
instrument was ambiguous.
Using Stata software (version 9.1; StataCorp, College Station, TX), Delphi results
we calculated mean values (with SDs) to summarize the overall
rating given to each candidate intervention. The TEP reviewed these In the first round of ratings, 155 (90.6%) participants responded.
results and identified the mean cutoff point to determine the short The mean score (SD) ranged (on 1- to 9-point Likert scale) from 8.80
list of candidate interventions for Delphi participants to rate in the ± 0.57 for the make a daily assessment of readiness to wean inter-
second round. After the first round of rating, and based on feed- vention to 1.48 ± 1.10 for the routinely administer intravenous
back from the Delphi participants and the TEP, we modified several immunoglobulins or white-cell stimulating factors intervention. All
existing interventions and added new interventions. The TEP made interventions received at least 1 rating of 1 and 1 rating of 9 on the
all decisions based on a consensus. Likert scale.
In preparation for the second round of rating, the Delphi par- The TEP established a cutoff point at a mean score of ≥6.00. The
ticipants received a packet with the results of the first round of TEP’s goal was to achieve a significant reduction in the number of
rating; a summary of comments from participants and responses surviving interventions, but not exclude potentially important in-
from the TEP; and lists of the surviving, revised, and dropped in- terventions. As a result, the TEP selected 19 interventions that were
terventions from the first round of rating. We instructed participants part of the first round of rating for inclusion in the second round
to rate the surviving and revised list of interventions based on their of rating and added 25 interventions. The addition of the 25 new
perceived importance of each intervention in preventing VAP pre- interventions was because of comments from the Delphi partici-
vention and on the feasibility of implementing each intervention. pants and the TEP. Of these 25, 3 were new interventions and 3 were
The participants rated each intervention using a Likert scale of 1-9, interventions reworded to eliminate ambiguity. The remaining 19
where 1 meant that they would definitely exclude the interven- focused on when the intervention should be used (eg, use silver-
tion from the VAP prevention bundle, and 9 meant that they would coated endotracheal tubes was changed to 3 separate candidate
definitely include the intervention in the VAP prevention bundle. interventions: routinely use silver-coated endotracheal tubes; use
They were also asked to indicate whether we should reinstate the silver-coated endotracheal tubes for patients who are at a high risk
interventions dropped after the first round of rating. We wanted for VAP; and use silver-coated endotracheal tubes in units where
to ensure that the Delphi participants had the opportunity to re- VAP rates are high). The second round of rating included a total of
evaluate results from the first round of ratings. 44 candidate interventions.
Using Stata software (version 9.1), we calculated mean values In the second round of ratings, we only asked the 155 individu-
(with SDs) to summarize the rating results. The TEP reviewed the als who responded in the first round to participate. In this second
results of the second round of ratings and again chose the cutoff round, 143 (92.3%) participants responded. The mean (SD) scores
point to determine which interventions to include in our pro- ranged from 8.83 ± 0.43 for the make a daily assessment of readi-
posed VAP prevention bundle. We sent these rating results and the ness to wean intervention to 3.38 ± 2.17 for the routinely use silver-
proposed VAP prevention bundle of interventions to the Delphi par- coated endotracheal tubes intervention. All interventions received
ticipants. We invited all TEP and Delphi participants to participate at least 1 rating of 9 on the Likert scale. All dropped interventions
in 2 telephone conference calls to review the results of the ratings received at least 1 vote for reinstatement; however, none of the in-
and discuss findings. terventions met the a priori threshold of 25% (maximum 17%) to
be reinstated for further consideration.
After the first round of rating, the TEP established a mean score
Categorization of process and structural interventions of ≥6.8 as the cutoff point for selecting the final set of interven-
tions to include in the VAP prevention bundle. Some interventions
The TEP further categorized the proposed interventions in the were in competition with similar interventions which had re-
VAP prevention bundle as process or structural measures. We ceived higher ratings. For example, use chlorhexidine gluconate when
achieved consensus through an iterative process in which the TEP performing oral care (mean, 7.8) was rated higher than use anti-
members, on the basis of their knowledge and clinical experience, septics when performing oral care (mean, 6.7).
considered the likely focus of improvement efforts in preventing VAP. The second round of rating yielded 23 candidate interventions.
For example, variation in adherence to process interventions would The TEP further modified selected interventions based on clinical
likely reflect individual provider performance, and adherence would and implementation experience, with the intent of reducing am-
likely need to be frequently evaluated. Variation in adherence to biguity of each intervention during improvement efforts. For example,
structural interventions would likely reflect hospital, local ICU, use a sedation protocol with sedation vacation was combined with
K. Speck et al. / American Journal of Infection Control 44 (2016) 652-6 655
Table 1
Process and structural measures in proposed ventilator-associated pneumonia prevention bundle
MV, mechanical ventilation; SAT, spontaneous awakening trial; SBT, spontaneous breathing trial.
use a validated sedation scale at least daily (ie, RASS - the Rich- The process of developing a VAP prevention bundle is impor-
mond Agitation-Sedation Scale) to create the final intervention: use tant given the increasing focus on VAP prevention as a national
a sedation protocol with a sedation vacation and validated seda- priority and because existing clinical guidelines make different rec-
tion scale at least daily. After these modifications, 19 interventions ommendations, some of which may be contradictory. These
remained: 5 were process measures, and 14 were structural mea- differences likely reflect that guidelines are published at different
sures (Table 1). times and based on the literature available at the time. In addi-
We sent the results of the second round of rating to all TEP tion, the primary literature may be interpreted differently by expert
members and Delphi participants and discussed the final bundle panels. Furthermore, many guidelines lack practical advice to assist
of interventions during debriefing calls. The main topics dis- readers with implementation of the recommendations.23
cussed during these calls were challenges associated with diagnosing Although implementation of care bundles has been associated
VAP, proposed changes to the Centers for Disease Control and Pr- with improved outcomes, there are currently no published stan-
evention’s VAP surveillance definition, and next steps in dards for bundle development. Concerns exist regarding existing VAP
implementing our VAP prevention bundle and evaluating its impact prevention bundles. Specifically, current VAP prevention bundles
on VAP rates. During these telephone calls, the Delphi partici- vary widely with respect to care practices and approach to devel-
pants did not express concerns about the results of the modified opment. The widely used Institute for Healthcare Improvement’s
Delphi method, and many thought the new VAP prevention bundle ventilator bundle, for example, was developed by a national “col-
was important and advanced the field. laborative faculty’s review of interventions a patient on mechanical
ventilation should receive.”11 Although not specifically termed
DISCUSSION bundles, 14 evidence-based recommendations for VAP preven-
tion, diagnosis, and treatment implemented in 11 Canadian ICUs,
We have described a systematic approach to elicit clinician per- and an 8-item multifaceted intervention implemented at an aca-
ceptions regarding which interventions are most important to include demic French ICU, were developed by multidisciplinary panels.12,22
in a VAP prevention bundle. The Delphi participants, including 171 No further details were published regarding the development of the
interdisciplinary members, reviewed 65 recommendations from pub- Canadian or French bundles, aside from reviewing available liter-
lished VAP prevention guidelines and primary literature and identified ature. In addition, a 7-item VAP prevention protocol decreased VAP
23 interventions as the most important and feasible to implement. in trauma patients, but the origins of this protocol are not described.14
After additional modifications, 19 interventions reflecting bedside In contrast, the development of a European VAP prevention bundle
care, and structure-related processes were included in the pro- that uses multicriteria decision analysis is described in detail4;
posed VAP prevention bundle. The bundle’s focus includes 5 bedside however, this bundle may not reflect the perceptions of U.S.
care processes, which are evidence-based and manageable inter- providers.
ventions and which were selected by a large and diverse group of We described a structured approach for developing a proposed
clinical experts that kept the bundle’s implementation in mind. VAP prevention bundle. This approach has many advantages com-
The implementation of bundles of care processes has been as- pared with other methodologies. First, the modified Delphi method
sociated with significant and sustained reductions in health care– minimized the potential impact of variability in guideline recom-
associated conditions, including central line–associated bloodstream mendations by galvanizing expert opinion from a very large and
infections21 and VAP.11-14,22 Although a causal inference remains diverse group of experts and building a consensus regarding the
elusive, these bundles are likely effective because they provide a clear most effective VAP prevention interventions. Variation in local prac-
and manageable set of expectations in a complex health care en- tice was mitigated by involving experts and providers from multiple
vironment. Bundles help providers translate evidence into practice institutions, including those in community, rural, and academic set-
by summarizing and simplifying the strongest evidence and pro- tings around the United States. By presenting the Delphi participants
viding reminders to adhere to evidence-based practices. The goal- with a comprehensive list of candidate interventions, we an-
oriented and multifaceted nature of bundles also provoke providers chored the process in the established body of VAP prevention
to adapt the care delivery system, specifically implement structur- knowledge. Participants responded anonymously, allowing open
al changes, and improve teamwork, resulting in improved patient expression and critique of opinions, while eliminating the pros-
outcomes.11 pect of control by a few participants and biases from group
656 K. Speck et al. / American Journal of Infection Control 44 (2016) 652-6