Professional Documents
Culture Documents
Respiratory Medicine
journal homepage: www.elsevier.com/locate/rmed
a r t i c l e i n f o a b s t r a c t
Article history: Background: Exhaled breath analysis is an emerging technology in respiratory disease and infection.
Received 13 February 2015 Electronic nose devices (e-nose) are small and portable with a potential for point of care application.
Received in revised form Ventilator-associated pneumonia (VAP) is a common nosocomial infection occurring in the intensive care
21 September 2015
unit (ICU). The current best diagnostic approach is based on clinical criteria combined with bron-
Accepted 25 September 2015
choalveolar lavage (BAL) and subsequent bacterial culture analysis. BAL is invasive, laborious and time
Available online 30 September 2015
consuming. Exhaled breath analysis by e-nose is non-invasive, easy to perform and could reduce diag-
nostic time. Aim of this study was to explore whether an e-nose can be used as a non-invasive in vivo
Keywords:
Electronic nose
diagnostic tool for VAP.
Bronchoalveolar lavage Methods: Seventy-two patients met the clinical diagnostic criteria of VAP and underwent BAL. In thirty-
Pneumonia three patients BAL analysis confirmed the diagnosis of VAP [BALþ(VAPþ)], in thirty-nine patients the
Critical care diagnosis was rejected [BAL]. Before BAL was performed, exhaled breath was sampled from the expi-
ratory limb of the ventilator into sterile Tedlar bags and subsequently analysed by an e-nose with metal
oxide sensors (DiagNose, C-it, Zutphen, The Netherlands). From further fifty-three patients without
clinical suspicion of VAP or signs of respiratory disease exhaled breath was collected to serve as a control
group [control(VAP]). The e-nose data from exhaled breath were analysed using logistic regression.
Results: The ROC curve comparing [BALþ(VAPþ)] and [control(VAP)] patients had an area under the
curve (AUC) of 0.82 (95% CI 0.73e0.9). The sensitivity was 88% with a specificity of 66%. The comparison
of [BALþ(VAPþ)] and [BAL] patients revealed an AUC of 0.69; 95% CI 0.57e0.81) with a sensitivity of
76% with a specificity of 56%.
Conclusion: E-nose lacked sensitivity and specificity in the diagnosis of VAP in the present study for
current clinical application. Further investigation into this field is warranted to explore the diagnostic
possibilities of this promising new technique.
© 2015 Elsevier Ltd. All rights reserved.
http://dx.doi.org/10.1016/j.rmed.2015.09.014
0954-6111/© 2015 Elsevier Ltd. All rights reserved.
R.M. Schnabel et al. / Respiratory Medicine 109 (2015) 1454e1459 1455
that detects patterns of volatile organic compounds (VOCs) in mL, the presence of squamous epithelial cells was >1%, the pres-
breath. It has been applied for various industrial purposes like ence of bronchial epithelial cells was >5% or in the presence of
environmental monitoring, pesticide detection and aroma detec- extensive amounts of debris and damaged cells. A clinically sus-
tion [1]. In the field of medicine, studies have demonstrated that e- pected VAP episode was considered microbiologically confirmed
nose technology can be used to identify patients with colorectal when the following criteria were met in BAL fluid: presence of 2%
cancer [2], head and neck cancer [3], tuberculosis [4], cystic fibrosis cells containing intracellular organisms (ICO) and/or quantitative
[5], chronic obstructive lung disease and asthma [6]. It has been culture results of 104 colony forming units (cfu) per millilitre of
suggested that e-nose could be used to diagnose patients suffering BAL fluid [11,12]. Before BAL was conducted, exhaled breath sam-
from pneumonia [7]. In vitro studies have demonstrated that e- ples were collected into a sterile Tedlar bag from the expiratory
nose sensors are able to discriminate between potential pathogens limb of the Draeger® Evita XL ventilator for subsequent e-nose
by analysing the air above bacterial culture medium [8]. Compari- analysis. The study patients were distributed into three groups. The
son of the predictive value of e-nose to the clinical pulmonary first group comprises patients with clinical suspicion of VAP
infection score (CPIS) found e-nose capable of distinguishing be- confirmed by BAL results [BALþ(VAPþ)]. The second group were
tween infected and uninfected state [9]. Furthermore, the prog- patients with clinical suspicion of VAP rejected by BAL results [BAL-
nostic value of e-nose in the prediction of VAP was compared with ]. Only patients without any bacterial growth in BAL fluid were
chest computer tomography (CT) with 80% accuracy predicting the selected. Four individuals were represented twice. A third group
results of chest CT scans [10]. To the best of our knowledge it has was formed by mechanically ventilated patients without clinical
never been investigated, whether e-nose technology is able to suspicion of VAP or signs of respiratory disease [control (VAP-)].
identify patients with VAP when measuring directly in exhaled The inclusion of patients for the study is outlined in Fig. 1. De-
breath samples. But only if this would be possible, eliminating mographic data, clinical data and the sequential organ failure
preliminary invasive sampling and the need for culturing sample assessment score (SOFA) as a measurement of the seriousness of
material, e-nose could be a truly non-invasive, easily operated, fast illness at the moment of exhaled breath collection were all regis-
diagnostic tool at bedside. Aim of this investigation is therefore to tered in a data base. Breath samples were analysed using an e-nose
study whether e-nose can be used for non-invasive in vivo diag- (DiagNose®, C-it, Zutphen, The Netherlands). (Fig. 2) This device
nosis of VAP. It was hypothesised that with a sample size of 100 consists of three different hybrid metal oxide semiconductor sensor
patients under the assumption that the sensitivity is 95%, this en- types: AS-MLN (NOx detection), AS-MLK (methane (alkane)
ables us to ensure that the lower limit of the 95% confidence in- detection) and AS-MLV (VOC detection). The DiagNose® is equipped
terval exceeded 85% for the detection of VAP. A rapid, non-invasive with a pump, where the inlet is controlled by a solenoid switching
detection of patients who develop pneumonia by e-nose could then between 2 different inlets, to create an active airflow across the
potentially speed up adequate and timely antibiotic treatment. sensors. One inlet is connected to a syringe filled with active carbon
to provide a baseline almost free from environmental influence
2. Materials and methods while the second inlet is attached to the sample bag. (Fig. 2) The
DiagNose® analyses the breath composition every 20 s using a 32-
The prospective study was conducted at the Maastricht Uni- step sinusoidal modulation of the sensor surface temperature be-
versity Medical Centreþ, a tertiary-care, university hospital in the tween 200 C and 320 C, resulting in a vector of 32 values each 20 s
Netherlands with 1700 ICU admissions per year. The inclusion for each sensor. In this range, the metal-oxide sensors behave as
period was between 2009 and 2011. Adult patients (18 years) semiconductors. The redox reaction, taking place at the sensor
admitted to the ICU were included. The exhaled breath study was surface, results in a measurable change of conductivity. These types
evaluated by the institutional medical ethics commission. Informed of redox reactions are dependent on the nature of the metal-oxide
consent was waived, as no direct patient intervention was required catalyst, the reacting gases, and the temperature [4]. A single
and results of the analyses did not influence therapy. measurement lasts approximately 20 min composed of 5 min
A patient was clinically suspected of VAP after 48 h of me- exposure and 15 min recovery, resulting in 3 matrices of 32 23
chanical ventilation according to the criteria depicted in (Table 1). (temperature time). Due to the fact that the syringe containing
Patients were screened daily for VAP using these clinical criteria. charcoal was not able to filter all the environmental influences, an
BAL was performed on the day of clinical suspicion for VAP. A unexpected variance could have occurred in every measurement.
fibreoptic bronchoscope (Pentax FB-15H/FB-15X, Pentax Medicals, To guarantee that only VOCs from the exhaled breath samples were
Tokyo, Japan) was introduced and ‘wedged’ into the affected used for further analysis only data from the plateau of the ab-
segmental or subsegmental bronchus. Sterile saline (0.9% sodium sorption time curve between 2.5 and 4.5 min from the start were
chloride at room temperature) was instilled in four aliquots of included. (Fig. 3) Data processing: 1. data were minemax normal-
50 mL, immediately aspirated and recovered. Samples were directly ized within the vector of 32 values of the heat modulation. 2. the
transported towards the microbiological laboratory and were mean value of the plateau of the time curve was computed and 3.
further processed. Information about the quality of BAL sampling the mean of the sensors of one sensor type was taken, resulting in
was collected. The BAL fluid was regarded non-representative if the 3 32 parameters for one sample. For statistical analysis the pro-
volume of recovery was <20 mL, the total cell count was <60.000/ gram IBM SPSS statistic 22 was used. Factor analysis grouped
correlated parameters resulting in 5 uncorrelated factors to avoid
the influence of multicollinearity in the analysis. The applied
Table 1
method was principal components with extraction criteria eigen-
Diagnostic clinical criteria of VAP.
values >1, rotation varimax, suppress small coefficients below 0.4,
I. Three or more positive out of the following four save Anderson-Rubin factor scores. Two different analysis groups
1. Rectal temperature >38 C or <35.5 C
were used to create a prediction model, [BALþ(VAPþ)] versus
2. Blood leukocytosis (>10.000/ml) and/or left shift or blood leukopenia
(<3.000/ml) [control(VAP)] and [BALþ(VAPþ)] versus [BAL]. Factor scores
3. More than ten leukocytes in Gram stain of tracheal aspirate saved for each different analysis group were used to predict a
(in high-flow field) model by logistic regression analysis (method: forward Likelihood
4. Positive culture of tracheal aspirate and Ratio). The outcome of the logistic regression was used to construct
II. New, persistent, or progressive infiltrate on chest radiograph
a ROC-curve. The model was made with [BALþ(VAPþ)] versus
1456 R.M. Schnabel et al. / Respiratory Medicine 109 (2015) 1454e1459
[control(VAP)] and prediction values of [BAL] were computed calculate the performance of the RF classification model. This
with this model. A boxplot is made of these prediction values and produces class probability values, which are used to calculate
significant difference between the groups were calculated with t- sensitivity and specificity illustrated by Receiver Operating Char-
test for equality of means, equal variances not assumed. The acteristic (ROC) curves. For the ROC analysis the 95% confidence
multivariate statistical analysis method Random Forest (RF) was interval was calculated. The ROC curve is a graphical representation
used to search for linear as well as non-linear patterns in the data of the performance of the predictive model established by RF. The
[13]. This machine learning method constructs a multitude of de- area under the curve (AUC) is most commonly used as an indicator
correlated decision trees to classify samples into the appropriate of predictive performance: a value close to 1 indicates high pre-
disease state. Decision trees are predictive models that try to dictive power of the model, whereas an AUC close to 0.5 means that
classify samples based on a specific subset of e-nose data. RF creates the model has no predictive power [14]. For visualization purposes,
many decision trees (e.g. 1000) comprising of a small and randomly principal component analysis (PCA) score plots of the RF proxim-
selected subset of e-nose data and tries to predict the class ities were created. The proximities are distance parameters ranging
outcome. The most discriminatory subset of e-nose data is then from 0 to 1 that visualize similarities of the selected e-nose data
used to create the final classification model. Validation of the RF profile between individual samples. A small proximity value in-
model was done by calculating the “out-of-bag error”. In this pro- dicates similarity, while a large proximity value indicates dissimi-
cedure 66.7% of the samples are randomly selected with replace- larity between individuals. A PCA plot of proximities can therefore
ment for each decision tree. The remaining 33.3% are used to demonstrate groupings of samples and trends in the data.
R.M. Schnabel et al. / Respiratory Medicine 109 (2015) 1454e1459 1457
Fig. 2. Collecting exhaled breath at the Draeger® Evita XL ventilator in a Tedlar bag
(upper part). The DiagNose® electronic nose (lower part).
Table 2
Demographic data.
Number of samples 33 39 53
Male/female 26/7 18/21 p ¼ 0.004 32/21 p ¼ 0.7
Average age 62 (20e82) 57 (23e82) p ¼ 0.21 60 (34e85) p ¼ 0.66
Diagnostic group at admission p ¼ 0.02 p ¼ 0.49
1. Gastrointestinal 3 (10%) 3 (8%) 11 (21%)
2. Cardiologic 7 (21%) 5 (13%) 11 (21%)
3. Hematologic 5 (15%) 10 (26%) 5 (9%)
4. Neurologic 5 (15%) 2 (5%) 8 (15%)
5. Orthopaedic/trauma 6 (18%) 0 (0%) 9 (17%)
6. Respiratory 7 (21%) 17 (43%) 6 (11%)
7. Other 0 (0%) 2 (5%) 3 (6%)
SOFA average (median) 6.7 (6) 7.2 (7) p ¼ 0.5 5.2 (5) p ¼ 0.03
active malignancy 5 (15%) 11 (28%) p ¼ 0.18 11 (21%) p ¼ 0.51
immunosuppression 10(30%) 10 (26%) p ¼ 0.5 5 (9%) p ¼ 0.03
Fig. 5. Predicted probability that a patient has VAP ranging from 0 ¼ unlikely to
1 ¼ certainly. E-nose cannot reliably predict patients with VAP. [Control (VAP¡)]:
patients without clinical suspicion of VAP [BAL¡]: patients with clinical suspicion of
VAP, diagnosis rejected by BAL analysis [BALþ(VAPþ)]: patients with clinical suspicion
of VAP confirmed by BAL analysis [Control (VAP-)] versus [BALþ(VAPþ)] p < 0.001;
[BAL] versus [BALþ(VAPþ)] p ¼ 0.001; [Control (VAP)] versus [BAL] p ¼ 0.23 In an
ideal model all predictions for [control(VAP)] and [BAL] patients should be close to
0 whereas all prediction in the [BALþ (VAPþ)] group should be close to 1.
either caused by the presence of bacteria and their metabolites or by Intensive Care Medicine. On behalf of all authors, the corresponding
the hosts inflammatory response towards infection. The expected author states that there is no conflict of interest.
signal of a change in VOCs in the presence of VAP in vivo is very likely
much less pronounced than in case of in vitro measurement of air
above a bacterial culture medium. Conflict of interest
E-nose does not detect the pathogenic agent directly because
the technique is based on pattern recognition and depends on the All authors report no conflict of interest regarding the subjects
composition of VOCs in exhaled breath. Therefore an adequate and the findings of this study.
selection of the control group might be essential to avoid false
positive interpretations of e-nose data in general. In the present
study the control group patients without VAP were otherwise Appendix A. Supplementary data
comparably ill with similar distribution of admission diagnoses to
the ICU. In earlier e-nose studies a discriminating ability was found, Supplementary data related to this article can be found at http://
but this could have been due to relevant differences between the dx.doi.org/10.1016/j.rmed.2015.09.014.
diseased patients and the control groups. VOCs derived from the
environment, diet or medication can interfere with exhaled breath
References
tests [20]. Thus, differences in social background and socioeco-
nomic status could have influenced the results between patients [1] A.D. Wilson, Diverse applications of electronic-nose technologies in agricul-
diagnosed with tuberculosis by e-nose and healthy controls [4]. In ture and forestry, Sensors 13 (2) (2013) 2295e2348.
the study detecting colorectal carcinoma by e-nose, a 31-year dif- [2] T.G. de Meij, I.B. Larbi, M.P. van der Schee, Y.E. Lentferink, T. Paff, J.S. Terhaar
Sive Droste, et al., Electronic nose can discriminate colorectal carcinoma and
ference in age between the patient and the control group could advanced adenomas by fecal volatile biomarker analysis: proof of principle
have been of influence [2]. Age related differences or associated study, Int. J. Cancer J. Int. Du Cancer 134 (5) (2014) 1132e1138.
divergent common diets could cause differences in the VOC [3] N. Leunis, M.L. Boumans, B. Kremer, S. Din, E. Stobberingh, A.G. Kessels, et al.,
Application of an electronic nose in the diagnosis of head and neck cancer,
composition of faecal gas. The importance of a smoking history Laryngoscope 124 (6) (2014 Jun) 1377e1381.
might explain why in an earlier study by Fens and colleagues, e- [4] M. Bruins, Z. Rahim, A. Bos, W.W. van de Sande, H.P. Endtz, A. van Belkum,
nose could discriminate between patients with asthma and pa- Diagnosis of active tuberculosis by e-nose analysis of exhaled air, Tuberculosis
93 (2) (2013) 232e238.
tients with COPD but not between COPD (among them 90%
[5] T. Paff, M.P. van der Schee, J.M. Daniels, G. Pals, P.E. Postmus, P.J. Sterk, et al.,
smokers) and healthy smokers [6]. Exhaled molecular profiles in the assessment of cystic fibrosis and primary
Limitations of the present study are the number of patients ciliary dyskinesia, J. Cyst. Fibros.: off. J. Eur. Cyst. Fibros. Soc. 12 (5) (2013)
distributed over multiple diagnostic groups at admission. Although 454e460.
[6] N. Fens, A.H. Zwinderman, M.P. van der Schee, S.B. de Nijs, E. Dijkers,
this reflected a typical heterogeneous ICU population it could have A.C. Roldaan, et al., Exhaled breath profiling enables discrimination of chronic
created a background noise of various factors associated with obstructive pulmonary disease and asthma, Am. J. Respir. Crit. Care Med. 180
critical illness itself that made it difficult for e-nose to differentiate (11) (2009) 1076e1082.
[7] P. Montuschi, N. Mores, A. Trove, C. Mondino, P.J. Barnes, The electronic nose
between possible minor differences due to the presence of VAP. in respiratory medicine, Respir. Int. Rev. Thorac. Dis. 85 (1) (2013) 72e84.
Subgroup analysis in one single diagnostic group was not feasible [8] L. Humphreys, R.M. Orme, P. Moore, N. Charaklias, N. Sahgal, N.P. Pont, et al.,
due to the small sample size. For the same reason there was no Electronic nose analysis of bronchoalveolar lavage fluid, Eur. J. Clin. Investig.
41 (1) (2011) 52e58.
bacterial strain specific analysis possible. [9] C.W. Hanson 3rd, E.R. Thaler, Electronic nose prediction of a clinical pneu-
In the present study, direct e-nose analysis of exhaled breath monia score: biosensors and microbes, Anesthesiology 102 (1) (2005) 63e68.
was unable to identify patients with VAP with a sufficient speci- [10] N.G. Hockstein, E.R. Thaler, D. Torigian, W.T. Miller Jr., O. Deffenderfer,
C.W. Hanson, Diagnosis of pneumonia with an electronic nose: correlation of
ficity. There is no current clinical application, as a diagnostic test for vapor signature with chest computed tomography scan findings, Laryngo-
VAP requires a high sensitivity to identify all patients with VAP and scope 114 (10) (2004) 1701e1705.
a high specificity to guarantee that only patients with a true bac- [11] C.F. Linssen, O. Bekers, M. Drent, J.A. Jacobs, C-reactive protein and procalci-
tonin concentrations in bronchoalveolar lavage fluid as a predictor of
terial infection are treated with antibiotics. This kind of tailored
ventilator-associated pneumonia, Ann. Clin. Biochem. 45 (3) (2008) 293e298.
antibiotic treatment becomes increasingly important with the [12] C.F. Linssen, J.A. Jacobs, J.S. Schouten, W.N. van Mook, G. Ramsay, M. Drent,
rapid emergence and dissemination of multi-drug resistant mi- Influence of antibiotic therapy on the cytological diagnosis of ventilator-
croorganisms particularly in the ICU environment worldwide [21]. associated pneumonia, Intensive Care Med. 34 (5) (2008) 865e872.
[13] L. Breiman, Random forest, Mach. Learn. 45 (2001) 5e32.
However, as the e-nose technique in itself has many practical and [14] J.A. Hanley, B.J. McNeil, The meaning and use of the area under a receiver
clinical advantages, further meticulous and repeated validation for operating characteristic (ROC) curve, Radiology 143 (1) (1982) 29e36.
all its potential diagnostic purposes is definitely warranted. After [15] J.Y. Fagon, Diagnosis and treatment of ventilator-associated pneumonia:
fiberoptic bronchoscopy with bronchoalveolar lavage is essential, Semin.
all, single diagnostic tests often lack sensitivity and specificity. Respir. Crit. Care Med. 27 (1) (2006) 34e44.
Combining different tests and probability scores could thereby [16] A. Torres, M. El-Ebiary, Bronchoscopic BAL in the diagnosis of ventilator-
provide an improvement in the diagnostic accuracy. In the present associated pneumonia, Chest 117 (4 suppl. 2) (2000) 198Se202S.
[17] J. Chastre, J.Y. Fagon, M. Bornet-Lecso, S. Calvat, M.C. Dombret, R. al Khani, et
study the number of patients and the effect size were too small for al., Evaluation of bronchoscopic techniques for the diagnosis of nosocomial
further analysis in this direction. The development of e-nose for pneumonia, Am. J. Respir. Crit. Care Med. 152 (1) (1995) 231e240.
non-invasive diagnostics in respiratory medicine could benefit [18] C.H. Marquette, M.C. Copin, F. Wallet, R. Neviere, F. Saulnier, D. Mathieu, et al.,
Diagnostic tests for pneumonia in ventilated patients: prospective evaluation
from gas chromatography e mass spectrometry studies in exhaled of diagnostic accuracy using histology as a diagnostic gold standard, Am. J.
breath. When sets of VOCs serving as biomarkers of certain diseases Respir. Crit. care Med. 151 (6) (1995) 1878e1888.
or of the presence of microorganisms can be identified, this [19] J.P. Sharpe, L.J. Magnotti, J.A. Weinberg, J.A. Brocker, T.J. Schroeppel,
B.L. Zarzaur, et al., Gender disparity in ventilator-associated pneumonia
knowledge could be applied to specify e-nose sensors and increase
following trauma: identifying risk factors for mortality, J. Trauma Acute Care
their sensitivity and specificity. This requires further study [20]. Surg. 77 (1) (2014) 161e165.
[20] L.D. Bos, P.J. Sterk, M.J. Schultz, Volatile metabolites of pathogens: a systematic
Disclosure review, PLoS Pathog. 9 (5) (2013) e1003311.
[21] R. Laxminarayan, A. Duse, C. Wattal, A.K. Zaidi, H.F. Wertheim, N. Sumpradit,
et al., Antibiotic resistance-the need for global solutions, Lancet Infect. Dis. 13
This work was supported by a grant of the Dutch Society of (12) (2013) 1057e1098.