Professional Documents
Culture Documents
(Received 6 September 2015; revised 4 February 2016; accepted for publication 26 February 2016;
published 22 March 2016)
Purpose: Automatic measurement of the intima-media thickness (IMT) from ultrasound carotid
images is an important task in clinical diagnosis. Many computer-based techniques for IMT measurement have been proposed to overcome the limits of manual segmentation. However, the robustness
of the algorithms would be influenced by the inherent speckle noise of ultrasound image. This paper
proposed a curvelet guided ant colony optimization (CGACO) strategy that could achieve satisfied
accuracy for IMT measurement with improved robustness to noise.
Methods: The curvelet-based orientation-selective (CBOS) filter was first introduced for speckle
removal and edge enhancement. Different from conventional methods, CBOS filter processes the
curvelet coefficients by orientations rather than by magnitude. Then, a specially designed two-leg
ant colony optimization technique, combined with Otsu thresholding and Sobel edge detector, was
proposed as a novel segmentation method to extract the media-adventitia (MA) and the lumen-intima
(LI) boundaries. Finally, a coupled snake model was employed to further smooth the contours of MA
and LI.
Results: In addition to 224 carotid artery images acquired from 34 participants, simulated speckled
images with nine levels of noise were also included in the database. The mean absolute distance
errors of CGACO for LI interface tracings, MA interface tracings, and IMT measurements were
0.030 0.027, 0.039 0.036, and 0.041 0.036 mm, respectively. Besides, CGACO had a correlation
coefficient as high as 0.992 and a bias as low as 0.008. All these measures were comparable
to or better than a previous technique and the manual segmentation. On the other hand, CGACO
had the highest success rate of 98.7% in the segmentation of real data. It also maintained a
much higher success rate in the segmentation of simulated images with different levels of speckle
noise.
Conclusions: The proposed technique showed accurate IMT measurement results. Furthermore,
benefiting from the CBOS filter, the robustness to noise of the algorithm was substantially
improved. Therefore, CGACO could provide a reliable way to segment the carotid artery
from ultrasound images and could be used in clinical practice of IMT measurement, particularly in early atherosclerotic stages. C 2016 American Association of Physicists in Medicine.
[http://dx.doi.org/10.1118/1.4943567]
Key words: intima-media thickness, curvelet transform, ant colony optimization, image
segmentation, ultrasound imaging
1. INTRODUCTION
Cardiovascular diseases (CVDs) are the leading cause of
morbidity and mortality in industrialized nations.1 The atherosclerotic process, which causes thickening of the artery wall
and reduction of the artery lumen, is the early manifestation
of the possible onset of CVDs.2,3 Studies have shown that the
increase in the intima-media thickness (IMT) of the carotid
artery is one of the prominent clinical signs of an ongoing
1795
0094-2405/2016/43(4)/1795/13/$30.00
1795
1796
1796
1797
1797
which enclose the ROI for IMT measurement. The two points
need to be located on or near the intima. Let Ps
= (x s , ys ) and Pe = (x e , ye ). Thus an ROI can be determined by
WR = Rec[(x S , ymin c),(x e , ymax + c)], where Rec represents
a rectangular area defined by the left-top and right-bottom
coordinates, c is a constant to ensure that the ROI includes
all of the possible vessel wall layers, and ymin and ymax are
the minimum and of maximum of ys and ye , respectively.
Besides, the orientation of carotid artery can be determined by
calculating the slope k = ( ye ys )/(x e x s ). Here, we chose
c = 40 pixels, which refers to 2.5 mm in this study.
(1)
(2)
n AB 2
C
),
(3)
where
2.A.2. Decomposition in the curvelet domain
2 2 +2
tan1 k,
m
m
2 2 + 0.5, 1 n 32 2
m
m
m
B=
52 2 + 0.5, 32 2 < n 72 2 ,
92 m2 + 0.5, 72 m2 < n 82 m2
m
C = b2 2 ,
A=
(4)
(5)
(6)
1798
1798
F. 2. Curvelet coefficients intensity of the test image. (a) The test carotid ultrasound image. (b) The curvelet decomposition of Fig. 2(a) into four frequency
scales with 16 orientations at the second coarsest level. (c) The sub-band of orientation index 4 at the fourth coarsest level (solid border), which corresponds to
the orientation vertical to the vessel. (d) The sub-band of orientation index 13 at the fourth coarsest level (dashed border), which corresponds to the orientation
parallel to the vessel.
where
G1 (x, y) =
2.A.4. Reconstruction
G i
max 0,
I (x, y) ,
y
i=1
x 2+y 2
2 12
, G2 ( y) =
y 2
e 222 ,
22
(8)
1
e
212
(7)
1799
1799
F. 4. Results of each steps of initial edge detection. (a) The edge map obtained by previous procedures. (b) Binary image acquired by Otsu thresholding. (c)
Edge lines acquired by vertical Sobel detector (white lines for the upper edges of LI and MA interfaces and gray lines for the lower edges). (d) The selected
qualified edge lines. (e) Final edge lines acquired by taking the midpoints of the upper and lower edge lines.
the left side of the vessel wall to the right sides. The two
ants, one fixed on top of the other, would move step by step
synchronously, and thus can be seen as the two legs of one
ant. The line segments obtained by initial edge detection are
defined as mandatory paths in which the ants are required to
move along. The gaps between the segments need to be filled
up by the ACO algorithm described as follows.
The ant moves from left to right, starting from Ps (x s , ys )
that we selected previously. At time t, the leg l (l = 1,2) of
antk moves from the pixel (x,i) to its neighboring pixel (x + 1, j)
according to a transition probability that is defined as
(10)
k,l
(t)
p(x,i,
j)
k,l
k,l
, j N(x,i),s N(x,i),
(t)
(t)
=
(x+1, s)
(x+1, s)
0,
otherwise,
(9)
where is the pheromone and is the intensity of pixels in the
edge map. and are two parameters determining the relative
influence of the pheromone trail and heuristic information.
k,l
N(x,i)
represents the set of positions that is allowed for
the leg l of antk in the next step. It corresponds to the right
neighborhood pixels of pixel (x,i). It should be pointed out
that any neighborhood pixel cannot be shared by the two legs.
Therefore, the shared right neighborhood needs to be excluded
k,l
from N(x,i)
during evolution. In this way, the upper leg is
determined to be on top of the lower leg and the final contours
will not crossover or overlap.
k,l
Figure 5 shows typical position sets N(x,i)
during two-leg
ant exploration. The ant locates in the abscissa of x and is moving to x + 1. The blue and green blocks denote the permitted
positions. The red block is a forbidden position because it
exists in both the right neighborhoods of the positions of upper
and lower legs.
Medical Physics, Vol. 43, No. 4, April 2016
F. 5. An example of possible positions that the upper and lower legs can
go to. The light grey blocks denote the permitted positions, and the dark grey
block refers to the forbidden position.
1800
Q
,
(x,i) =
C (k)
k=1
(11)
(12)
1
yi
E ( y1, y2) =
dx
f (x, yi )dx
2 i=1
x
i=1
smoothing energy
+
2
boundary energy
2
( y2 y1)
dx ,
x
(13)
uniform energy
where y1 (x) and y2 (x) represent the contours of the LI and the
MA interface, respectively. Parameter controls the weight of
the smoothing energy term. The boundary energy refers to the
external force which drives the contours toward the expected
edges. Parameter controls the weight of the uniform energy
Medical Physics, Vol. 43, No. 4, April 2016
1800
3. EXPERIMENT
3.A. Data acquisition
The image database consisted of 224 2D B-mode longitudinal ultrasound images of the carotid artery. They were
taken from 34 participants (19 male and 15 female, age
46 22): six of them were patients with atherosclerosis, and
the others were healthy participants. Among the 224 B-mode
images, 192 were with normal carotid arteries, 28 had an
increased IMT, and 4 had plaques. In addition to the 224
actual B-mode images, 270 images with different levels of
simulated speckle noise were included as our simulated
database.
All the images were acquired by a Vinno G60 device
[VINNO Technology (Suzhou) Co., Ltd, China] equipped with
a linear probe working in the frequency range 7.314 MHz. All
participants provided written informed consent. These images
were resampled at a standard density of 16 pixels/mm.29 Thus,
the axial resolution was equal to 0.0625 mm. These images
were captured by the ultrasound device and transferred to a
computer (Intel Core i7-3610M, 12GB memory) to perform
the manual and automatic IMT measurement. All the programs
were written in .
One technician and two clinical experts were involved in the
performance evaluation. The technician first chose the starting
and end point on or near the intima of the proximal carotid
artery for each image to determine a rectangular ROI. Then the
IMT measurement procedure was run in the ROI only. Manual
tracings were performed by a previously developed graphical
user interface. For each ROI, the LI and MA boundaries were
manually delineated by two skilled operators. The first operator (OP1) performed three manual tracings and the second
operator (OP2) performed one manual tracing. The GT was
defined as the average profile of OP1s three manual tracings.
OP2s tracing was defined as another manual tracing (MAN)
and was compared with GT.
3.B. Speckled image simulation
Speckled images were simulated to investigate the robustness of the methods under different levels of noise. The speckle
noise model35 can be approximated as
g(x, y) = f (x, y) n(x, y) + a(x, y),
x, y R2,
(14)
where f (x, y) represents the noise-free image, g(x, y) represents the noisy observation of f (x, y), and n(x, y) and a(x, y)
represent the multiplicative and additive noise, respectively,
and are the spatial location indices that belong in the 2-D space
of real numbers.
Since the effect of additive noise is considerably small
compared to the effect of multiplicative noise in ultrasound
images, Eq. (14) can be approximated as
g(x, y) = f (x, y) n(x, y),
x, y R2.
(15)
1801
1801
4. RESULT
4.A. Example images
F. 6. Three examples illustrating the performance of CGACO. The left column presents the original images; the right column presents the automatic tracings
overlaid on the original images. [(a) and (b)] Carotid artery image with excessive noise. [(c) and (d)] Carotid artery with curvature. [(e) and (f)] Carotid artery
with thickened intima-media complex.
Medical Physics, Vol. 43, No. 4, April 2016
1802
LI error
MA error
IMT error
Units
CGACO
LDLD
Pixel
mm
Pixel
mm
Pixel
mm
0.48 0.43
0.030 0.027
0.63 0.57
0.039 0.036
0.66 0.58
0.041 0.036
0.51 0.42
0.032 0.026
0.61 0.51
0.038 0.032
0.68 0.55
0.042 0.035
0.57 0.50
0.036 0.031
0.64 0.53
0.040 0.034
0.85 0.73
0.053 0.045
shows the intima-media complex with obvious local thickening. Figures 6(d) and 6(f) show the corresponding correct
performance.
4.B. Accuracy performance
1802
T II. Mean IMT values, bias, correlation coefficient, and success rate of automatic methods, manual method,
and GT.
IMT
Bias
Corr.a
SR (%)
a
Ground truth
CGACO
ACO
LDLD
0.75 0.24
0.74 0.23
0.008
0.992
98.7
0.73 0.24
0.016
0.988
93.3
0.75 0.23
0.005
0.989
94.6
0.76 0.24
0.009
0.986
Corr. denotes the correlation coefficient between GT IMT values and the measured IMT values.
1803
1803
F. 7. Regression analysis plots comparing CGACO, LDLD, and OP2s measurements with GT measurements. (a) CGACO. (b) LDLD. (c) OP2.
F. 8. BlandAltman plots comparing CGACO, LDLD, and OP2s measurements with GT measurements. (a) CGACO. (b) LDLD. (c) OP2.
Medical Physics, Vol. 43, No. 4, April 2016
1804
1804
F. 9. Sample performances of CGACO, ACO without CBOS filter, and LDLD under different levels of speckle noise.
F. 10. The success rate of CGACO, ACO without CBOS filter, and LDLD
under different levels of speckle noise.
Medical Physics, Vol. 43, No. 4, April 2016
1805
1805
F. 11. The denoising and edge enhancing effect of CBOS filter and scale multiplication. [(a) and (c)] Images polluted by simulated speckle noise. [(b) and (d)]
The corresponding edge maps obtained from the polluted images.
Many completely automatic approaches have been proposed in recent years. Representatives of them include a series
of approaches proposed by Molinari.14,28,29 These approaches
do not require any user interactions and therefore have higher
efficiency. However, for low-quality images with severe noise
or misleading artifact, necessary manual operations could
F. 12. The performance of the CBOS filter under different settings of a and b. (a) The original image. (b) The images processed by the CBOS filter.
Medical Physics, Vol. 43, No. 4, April 2016
1806
LI errors
MA errors
IMT errors
81 99
91 93
59.4 65
210 130
60 30
29 15
30 27
82 197
25 55
48.1 50
160 70
80 40
47.1 23
39 36
78 112
54 35
63 49.1
38.1 16.4
41 30
All data come from the published papers. The database adopted by different
methods is not the same.
6. CONCLUSION
We have described and evaluated a semiautomatic technique (CGACO) for layers extraction of the carotid artery wall
in ultrasound images. Ant colony optimization is proved to
be feasible for the segmentation of intima-media complex.
Based on curvelet transform, a specially designed orientation
selective filter (CBOS filter) was used to improve its robustness
Medical Physics, Vol. 43, No. 4, April 2016
1806
1807
15D. Cheng and X. Jiang, Detections of arterial wall in sonographic artery im-
ages using dual dynamic programming, IEEE Trans. Inf. Technol. Biomed.
12, 792799 (2008).
16Y. Zhou, X. Cheng, X. Xu, and E. Song, Dynamic programming in parallel
boundary detection with application to ultrasound intima-media segmentation, Med. Image Anal. 17, 892906 (2013).
17D. Cheng, A. Schmidt-Trucksss, K. Cheng, and H. Burkhardt, Using
snakes to detect the intimal and adventitial layers of the common carotid
artery wall in sonographic images, Comput. Methods Programs Biomed.
67, 2737 (2002).
18M. Gutierrez, P. Pilon, S. Lage, L. Kopel, R. Carvalho, and S. Furuie, Automatic measurement of carotid diameter and wall thickness in ultrasound
images, Comput. Cardiol. 29, 359362 (2002).
19S. Delsanto, F. Molinari, P. Giustetto, W. Liboni, S. Badalamenti, and J.
S. Suri, Characterization of a completely user-independent algorithm for
carotid artery segmentation in 2-D ultrasound images, IEEE Trans. Instrum.
Meas. 56, 12651274 (2007).
20C. P. Loizou, C. S. Pattichis, M. Pantziaris, T. Tyllis, and A. Nicolaides,
Snakes based segmentation of the common carotid artery intima media,
Med. Biol. Eng. Comput. 45, 3549 (2007).
21X. Xu, Y. Zhou, X. Cheng, E. Song, and G. Li, Ultrasound intima-media
segmentation using Hough transform and dual snake model, Comput. Med.
Imaging Graphics 36, 248258 (2012).
22S. Petroudi, C. Loizou, M. Pantziaris, and C. Pattichis, Segmentation of the
common carotid intima-media complex in ultrasound images using active
contours, IEEE Trans. Biomed. Eng. 59, 30603069 (2012).
23C. P. Loizou, C. S. Pattichis, A. N. Nicolaides, and M. Pantziaris, Manual
and automated media and intima thickness measurements of the common carotid artery, IEEE Trans. Ultrason., Ferroelectr., Freq. Control 56, 983994
(2009).
24F. Molinari, K. M. Meiburger, L. Saba, G. Zeng, U. R. Acharya, M. Ledda, A.
Nicolaides, and J. S. Suri, Fully automated dual-snake formulation for carotid intima-media thickness measurement. A new approach, J. Ultrasound
Med. 31, 11231136 (2012).
25S. Golemati, J. Stoitsis, E. G. Sifakis, T. Balkizas, and K. S. Nikita, Using the Hough transform to segment ultrasound images of longitudinal
and transverse sections of the carotid artery, Ultrasound Med. Biol. 33,
19181932 (2007).
26F. Destrempes, J. Meunier, M. F. Giroux, G. Soulez, and G. Cloutier,
Segmentation in ultrasonic B-mode images of healthy carotid arteries using
mixtures of Nakagami distributions and stochastic optimization, IEEE
Trans. Med. Imaging 28, 215229 (2009).
27R.-M. Menchn-Lara, M.-C. Bastida-Jumilla, J. Morales-Snchez, and
J.-L. Sancho-Gmez, Automatic detection of the intima-media thickness
in ultrasound images of the common carotid artery using neural networks,
Med. Biol. Eng. Comput. 52, 169181 (2014).
28F.
1807
Molinari, G. Zeng, and J. Suri, An integrated approach to computerbased automated tracing and its validation for 200 common carotid arterial
wall ultrasound images a new technique, J. Ultrasound Med. 29, 399418
(2010).
29F. Molinari, G. Zeng, and J. S. Suri, Intima-media thickness: Setting
a standard for a completely automated method of ultrasound measurement, IEEE Trans. Ultrason., Ferroelectr., Freq. Control 57, 11121124
(2010).
30E. Cands, L. Demanet, D. Donoho, and L. Ying, Fast discrete curvelet
transforms, Multiscale Model. Simul. 5, 861899 (2006).
31J.-L. Starck, E. J. Cands, and D. L. Donoho, The curvelet transform for
image denoising, IEEE Trans. Image Process. 11, 670684 (2002).
32M. Dorigo, V. Maniezzo, and A. Colorni, Positive feedback as a search
strategy, Technical Report No. 91-016 (1991).
33M. Dorigo, G. Di Caro, and L. M. Gambardella, Ant algorithms for discrete
optimization, Artif. Life 5, 137172 (1999).
34M. Dorigo, V. Maniezzo, and A. Colorni, Ant system: Optimization by a
colony of cooperating agents, IEEE Trans. Syst., Man, Cybern., Part B 26,
2941 (1996).
35T. Loupas, W. N. McDicken, and P. L. Allan, Adaptive weighted median
filter for speckle suppression in medical ultrasonic images, IEEE Trans.
Circuits Syst. 36, 129135 (1989).
36F. Sattar, L. Floreby, G. Salomonsson, and B. Lovstrom, Image enhancement based on a nonlinear multiscale method, IEEE Trans. Image Process.
6, 888895 (1997).
37A. Achim, A. Bezerianos, and P. Tsakalides, Novel Bayesian multiscale
method for speckle removal in medical ultrasound images, IEEE Trans.
Med. Imaging 20, 772783 (2001).
38M. Dorigo and T. Sttzle, Ant Colony Optimization (The MIT Press, Cambridge, MA, 2004).
39J.-L. Starck, F. Murtagh, E. J. Cands, and D. L. Donoho, Gray and color
image contrast enhancement by the curvelet transform, IEEE Trans. Image
Process. 12, 706717 (2003).
40J. Ma and G. Plonka, Combined curvelet shrinkage and nonlinear anisotropic diffusion, IEEE Trans. Image Process. 16, 21982206 (2007).
41K. V. Devarapu, S. Murala, and V. Kumar, Denoising of ultrasound
images using curvelet transform, in 2nd International Conference on
Computer and Automation Engineering (ICCAE) (IEEE, Singapore, 2010),
Vol. 3, pp. 447451.
42G. G. Bhutada, R. S. Anand, and S. C. Saxena, Edge preserved image
enhancement using adaptive fusion of images denoised by wavelet and
curvelet transform, Digital Signal Process. 21, 118130 (2011).
43D. E. Ilea, C. Duffy, L. Kavanagh, A. Stanton, and P. F. Whelan, Fully
automated segmentation and tracking of the intima media thickness in
ultrasound video sequences of the common carotid artery, IEEE Trans.
Ultrason., Ferroelectr., Freq. Control 60, 158177 (2013).