Tracking of arterial walls in ultrasound image sequences is useful for studying the dynamics of arteries. Manual delineation is prohibitively labour intensive and existing methods of computerized segmentation are limited in terms of applicability and availability. This paper presents a probabilistic approach to the computerized tracking of arterial walls that is effective and easy to implement. In the probabilistic approach, given a point B with a probability Pb of being in an arterial lumen of interest, the probability Pa that a neighbouring point A is also a part of the same lumen is proportional to Pb with a Gaussian fall in probability with increasing grayscale contrast between the two points. Efficacy of the probabilistic algorithm was evaluated by testing it on ultrasound images and image sequences of the carotid arteries and the abdominal aorta and various laboratory, ultrasound test objects. The results showed that the probabilistic algorithm produced robust and effective lumen segmentation in the majority of cases encountered. Comparison with a conventional region growing technique based on intensity thresholding with a running, regional intensity average identified the main benefits of the probabilistic approach as increased immunity to speckle noise within the arterial lumen and a reduced susceptibility to region overflowing at boundary imperfections.
1. Introduction
Greyscale ultrasound imaging (B-mode) is an established tool for the noninvasive imaging of the human body. Such imaging procedures are often accompanied by measurements that are conveniently performed using the ultrasonic calipers. However, it becomes a time-consuming manual task for the operator if the measurements need to be repeated a large number of times, for example, over a time series. In B-Mode vascular ultrasound, such a situation arises when one needs to track the position of the arterial walls over many frames in order to study to distension of the arteries throughout the cardiac cycle. Although specific solutions for tracking the position of the arterial walls using B-Mode ultrasound are available (Table 1), for example, by region tracking/block matching [1] or computerized edge detection [2], many of these techniques are limited in terms of applicability and some techniques have particular vulnerability to image noise. Also, a general purpose segmentation algorithm should be able to track the position of the arterial walls over a sizeable length of the artery and for any vessel orientation and morphology.
A selection of specific solutions reported to date applicable to the problem of tracking the vascular walls in B-mode ultrasound image sequences.
Reference
Basis of technique
Applications
Limitations
[3]
Cost function minimization
Intima-media thickness (IMT) and arterial lumen diameter measurement.
Extensive manual corrections were reported to be required
[5]
Greyscale intensity and gradient thresholding
Endothelium-dependent dilation of the brachial artery.
Dependence on vessel orientation, curvature, and appearance
[2]
Edge detection
Carotid artery diameter and intima-media thickness (IMT) measurement.
Operator intervention is frequently needed during the systolic expansion of the artery when the arterial wall moves a relatively large distance between frames
[6]
Active contours
Detection of the intima-media complex of the far wall of the common carotid artery.
Long processing times
[7]
Artificial neural networks
Detection of the near and far walls of the artery in the longitudinal plane.
Relatively horizontal and straight vessel assumed
[1]
Region tracking/block matching
Estimation of carotid artery wall motion.
Limited number of points can be tracked due to computational cost and speckle decorrelation
[8]
Fast marching algorithm
Segmentation of intravascular ultrasound images in 3D.
Required manual delineation of initial contours close to the arterial lumen boundaries
[9]
Hough transform
Extraction of carotid artery surface in the longitudinal and transverse planes.
Longitudinal and transverse arterial sections approximated as straight lines and circles
[10]
Polar representation, grey-level histograms, cost function minimization, and probabilistic considerations
Delineation of lumen boundaries in intravascular ultrasound (IVUS) images.
Specific to IVUS, modeled the lumen surface as a mixture of Gaussians placing limitations on the type of contour that can be traced
[11]
Edge detection and mathematical morphology
Delineate vessel lumen boundaries in transverse cross-sections of the common carotid artery.
Whether the method is also expected to work for longitudinal cross sections of arteries is not known. Also, edge detection techniques have an inherent vulnerability to image noise
One solution to the problem of arterial wall tracking was by Wendelhag et al. [3] who described a method for measuring the intima-media thickness (IMT) and the lumen diameter for the carotid and femoral arteries by means of an analysis system based on dynamic programming [4]. However, it was reported that manual corrections were required in a significant portion of the images. Beux et al. [5] presented an automatic procedure to study the endothelium-dependent dilation of the brachial artery which involved imposing a threshold on the normalized greyscale intensity to locate the arterial lumen and an intensity gradient criterion to subsequently locate the arterial lumen boundaries. However, this technique worked only in longitudinal cross-sectional views of arteries with specific assumptions made regarding the orientation, curvature, and appearance of the artery. Cheng et al. [6] described a method for detecting the intima-media complex of the far wall of the common carotid artery using active contour models; however, the processing of a single frame of ultrasound image was reported to have taken between 30 seconds and 1 minute which was a major drawback.
Newey and Nassiri [7] employed artificial neural networks to detect the anterior and posterior vessel walls of arteries in the longitudinal plane, but it was clear that this technique was directly applicable only to relatively straight and horizontal sections of arteries. The technique described by Cardinal et al. [8] for the segmentation of intravascular ultrasound (IVUS) images worked by detecting a mixture of the Rayleigh distributions in the IVUS data followed by a fast marching algorithm which converged on the boundaries of interest; however, the method required the manual delineation of initial contours near the contours of interest to operate. Golemati et al. [9] used the Hough transform (HT) to extract the carotid artery lumen surface from the longitudinal and transverse sections of arteries, but the arterial shapes were modelled as straight lines and circles, respectively, limiting applicability in real-life situations. Mendizabal-Ruiz et al. [10] described a probabilistic segmentation method for IVUS, modeling the lumen contour as a periodic mixture of Gaussians and once again placing constraints on the type of contour that can be tracked. Yang et al. [11] employed edge detection and mathematical morphology techniques to delineate vessel lumen boundaries in transverse cross-sections of the common carotid artery (CCA), but it was not specified whether the method is also expected to work for longitudinal cross-sections.
A recent survey of ultrasound image segmentation methods [12] presented a selection of methodologies for various clinical applications, including intravascular ultrasound; however, segmentation of longitudinal cross-sections of arteries was not covered. Thus, although specific methods for B-Mode ultrasound carotid artery image segmentation have been developed, there appears to be currently no simple solution that can be applied to the diverse range of arterial configurations and imaging conditions encountered and yet be easily implementable by different centres. Also, some techniques, such as those based on edge detection, are particularly vulnerable to speckle noise as the latter produces false edge signals. The efficiency of the method is also important as long processing times hinder the practical analysis of long-duration ultrasound image sequences and any possible implementation in real-time.
We have developed a probabilistic approach to segmentation of ultrasound images of the carotid artery and demonstrated good arterial wall tracking, comparable to a more established tissue Doppler imaging technique [13, 14]. In this paper, we describe our algorithm that effectively segments arterial images in both the longitudinal and transverse cross-sections with little effort on the operators’ part.
2. Methods
In our probabilistic approach, the probabilities of individual neighbouring points being in an arterial lumen were associated using a Gaussian relationship. Given a greyscale ultrasound image, a corresponding probability matrix was evaluated where each matrix element represented the probability of that element's respective image point being in the artery of interest. The probabilities were computed as follows: given a point B which had a probability Pb of belonging to a certain arterial lumen, the probability Pa that a neighbouring point A also belonged to the same lumen was evaluated as being directly proportional to Pb with a Gaussian dependence on the greyscale contrast between two points, and an average was taken over all 8 immediate neighbours (1). Here Gb and Ga were the greyscale intensities of points B and A, and the constant ζ was determined by considering the amount of greyscale contrast (Gth) required to reduce Pa to 1/2 that of Pb. In the case of multiple seed points, the maximum of the probabilities evaluated using each of the seed points were used
(1)Pa=(18)*∑Pbexp(-(Gb-Ga)2ζ),
where ζ=Gth2/log2 and the sum was taken over the 8 immediate neighbours.
The value of Gth was set at 1% of the full range by default but could be altered by the operator if necessary. The operator provided one or more initial seed points which were assigned a probability of 1 and the probabilities of the remaining points were determined using (1). Images were preprocessed by applying a circular averaging filter of radius R=5 pixels.
Efficacy of the algorithm was evaluated by testing it on clinical images of the carotid arteries and the abdominal aorta and various laboratory, ultrasound test objects. Clinical data included B-Mode carotid artery image sequences from patients acquired using a Philips HDI5000 scanner with an L12-5 probe and a Philips iU22 scanner with an L9-3 probe (Philips Healthcare, Eindhoven, The Netherlands). Image sequences were also obtained from a healthy volunteer using an Aixplorer scanner (Supersonic Imagine, Aix-en-Provence, France) with the L15-4 probe. The use of the clinical data for this purpose was approved by the Leicestershire and Rutland Medical Ethics Committee, and patients and the volunteer gave their informed consent to participate in the study.
Laboratory data included ultrasound image sequences from walled and wall-less flow phantoms and various laboratory test objects acquired using the Philips HDI5000 scanner with the L12-5 probe. The tissue mimicking material used in the construction of the hypo- and hyper-echoic test objects, and the wall-less flow phantom was an agar-based formulation [15]. In the flow circuit of the walled (C-FLEX, Cole-Pamer, IL, USA) and wall-less flow phantoms, a blood mimicking fluid was circulated [16, 17]. A computer controlled fluid pump was used to circulate the blood mimicking fluid using a carefully selected input waveform to induce dilations in the phantom similar to the dilation characteristics of a real carotid artery [18].
Performance was also compared against a conventional region growing technique based on intensity thresholding with a running average region intensity [19]. Images were preprocessed using the same filter, and same the seed points and threshold values were used in both the case of the probabilistic algorithm and the conventional region growing technique.
The efficiency of the probabilistic algorithm was also evaluated under high image-noise conditions by means of adding zero-mean, single-sided Gaussian noise of varying strengths to the carotid artery ultrasound images and by testing the method on noisy image sequences from the abdominal aorta and walled and wall-less vessel phantoms (speckle noise within the vessel lumen).
All implementations were carried out using MATLAB (MathWorks, Natick, MA, USA) with portions of the probabilistic algorithm written in the C language to speed up the process. The analyses were performed on a personal computer with a Intel Core i5-2500K CPU (Intel Corporation, CA, USA) running at 3.30 GHz. The PC was running the 64-bit version of Windows 7 Ultimate (Microsoft Corporation, Washington, DC, USA).
3. Results
Setting the algorithm threshold to 2% and choosing a point inside the arterial lumen in a carotid artery image with atherosclerotic plaque buildup on the far-wall, the probabilistic algorithm produced the first pass estimate boundary outline and the corresponding probability map seen in Figure 1. Adding another seed point produced the overall probability map and segmentation result seen in Figure 2. The final arterial boundary outline including that of the plaque surface obtained by adding three additional seed points was as shown in Figure 3. A close-up view of the segmentation result over the plaque surface can be seen in Figure 4.
First pass segmentation result (a) for a carotid artery image with plaque buildup on the far wall of the artery. The corresponding probability map (b).
The results of adding another seed point. Segmentation result (a) and combined probability map (b).
Final segmentation result (a) and probability map (b) with an additional 3 seed points.
A close-up view of the segmentation result over the plaque surface.
The result of tracking the arterial lumen for a longitudinal image sequence with one seed point was as shown in Figure 5. Investigations made on the processing of this 90 frame image sequence of dimensions 263 (height) × 256 (width) pixels indicated a processing time of approximately 33 milliseconds/frame on the analysis computer used. However, since the implementation was not designed to take full advantage of the multicore CPU architecture and was not optimised, it was also observed that the processor as a whole was only running at approximately 30% of full capacity during the analysis.
Tracking of the arterial lumen for an image sequence (single frame shown). The whole image sequence is available at https://dl.dropbox.com/u/13857734/pp/tt.avi.
Arterial lumens could be effectively segmented with a few seed points in a variety of arterial configurations and image noise conditions (Figure 6). The result of segmentation and tracking of the residual arterial lumen and plaque surface in the transverse plane was as in Figure 7. Investigation of segmentation performance in the presence of artificially added Gaussian image noise produced the results seen in Figure 8. In an image sequence from the abdominal aorta, wall tracking in the presence of ultrasound artifacts and substantial amounts of image noise was as in Figure 9.
Arterial lumen segmentation in a variety of vessel configurations and image-noise conditions.
Tracking of the residual arterial lumen and plaque surface in the transverse plane (single frame shown). The whole image sequence is available at http://dl.dropbox.com/u/13857734/pp/T1.avi.
Results of segmentation of the arterial lumen and plaque surface in the presence of artificially added Gaussian noise of varying strengths. Each row gives the probability map (right) and segmentation result (middle) for given noise and threshold settings (left). sqrt(Noise level) × 255 gives the approximate standard deviation of the Gaussian noise added in grey levels (e.g., noise level = 0.02 corresponds to a standard deviation of approximately 36.1 grey levels, cf., maximum range of 255 grey levels).
Tracking of the arterial lumen in the abdominal aorta (single frame shown). The whole image sequence is available at http://dl.dropbox.com/u/13857734/pp/AA_1.avi.
The results of lumen surface tracking for a walled flow phantom with blood mimicking fluid in the flow circuit produced the results in Figure 10. Tracking results for the laboratory test objects and a comparison between Vernier caliper measured and algorithm-determined dimensions were as in Figure 11 and Table 2.
Comparison between caliper (dcal) and algorithm (dal) made diameter measurements for the laboratory test objects.
Object
Type
dcal [mm] (±0.5 mm)
dal [mm]
1
Hypoechoic
4.0
3.9 ± 0.2
8
Hyperechoic
9.0
8.8 ± 0.2
2
Hypoechoic
12.0
12.4 ± 0.2
7
Hyperechoic
14.2
14.0 ± 0.3
3
Hypoechoic
24.0
24.3 ± 0.6
6
Hyperechoic
23.2
23.4 ± 0.2
4
Hypoechoic
37.5
37.4 ± 0.2
5
Hyperechoic
39.0
38.9 ± 0.2
Tracking of the lumen surface for a walled flow phantom (single frame shown). The whole image sequence available at http://dl.dropbox.com/u/13857734/pp/WFP_1.avi.
A selection of test results for the delineation of the boundaries of agar based hypo- and hyperechoic test objects.
Tracking of the vessel lumen diameter for the common carotid artery from the healthy volunteer using an image sequence obtained on the AIXplorer platform produced the arterial dilation waveform seen in Figure 12.
Variation of the arterial lumen diameter of the common carotid artery from a healthy volunteer.
Comparison of algorithm efficacy against the conventional region growing technique showed that the performance of the probabilistic algorithm surpassed that of the conventional region growing algorithm with differences more apparent under high image-noise conditions (Figure 13).
Comparison between the probabilistic algorithm (first and third columns) and conventional region growing based on intensity thresholding (second and fourth columns). Results are given in pairs and labels indicate file reference and threshold settings used. The two left-most figures on the bottom-most row are from the walled-flow phantom, and the two right-most figures on the same row are from the wall-less flow phantom.
4. Discussion
This paper presented a method based on a probabilistic approach that can be used to efficiently segment out and track blood vessel boundaries in B-Mode ultrasound images and image sequences. The results showed that the technique can be used to track arterial lumens simply and efficiently in both the longitudinal and transverse imaging planes, including in the presence of substantial amounts of speckle noise. Boundary segmentation was robust in the presence of significantly strong, artificially added image noise and in an ultrasound image sequence from the abdominal aorta with ultrasound artifacts. In the case of the walled and wall-less laboratory flow phantoms, good boundary tracking was obtained in the presence of high-intensity reflections within the vessel lumen. Tracking the lumen diameter of the common carotid artery in a healthy volunteer produced a detailed waveform showing the variation of the lumen diameter over the cardiac cycles including the dicrotic notch.
In a separate validation of the method, dimensions of various hyper- and hypoechoic laboratory, ultrasound test objects measured using the probabilistic method were compared with the Vernier caliper measured physical dimensions and similar values were obtained within the error ranges of the measurements. A comparison with a conventional region growing algorithm showed that the probabilistic approach had better immunity to noise and less susceptibility to region overflowing at boundary imperfections.
The method described in this paper addresses the limitations of the existing arterial lumen detection techniques based on B-Mode ultrasound image analysis. The limitations of the existing techniques included dependence on vessel orientation, curvature, scan plane, and long processing times. The probabilistic technique was found to be sufficiently efficient to allow practical analysis of long image sequences and make real time implementation feasible. The measured average processing time of 33 ms/frame per seed point for an image sequence of dimensions similar to a typical carotid artery scan indicated that frame rates as high as 30 Hz may be achieved in real time even with the highly unoptimized implementation used in the study.
The advantages of the probabilistic method include its simplicity and wide area of applicability. This technique was previously found to have good arterial wall tracking performance, comparable to that of tissue Doppler imaging [13] which benefits from access to radiofrequency data. The algorithm can be easily adopted in 3 dimensions, and it would be interesting to see what results this would produce in further studies. It is possible that the implementation can be enhanced further, for example, by extending the consideration to texture measures (e.g., local greyscale characteristics).
In conclusion, the method presented in this paper, based on a probabilistic approach to the segmentation of B-Mode ultrasound carotid artery images, produces robust segmentation results, including in the presence of substantial amounts of image noise, with little effort on the user's part.
Conflict of Interests
The authors confirm that there is no known conflict of interests associated with this publication and that they do not have any direct or indirect relationship with any commercial identity mentioned in this paper.
Acknowledgments
The authors are grateful to Professor A. R. Naylor and his team at the Department of Cardiovascular Sciences, particularly Mr. Tim Hartshorne, Chief Vascular Scientist, for the collection of the clinical data. They also thank Professor Thompson Robinson and Dr. Mark Horsfield for their kind support of this study. Funding is gratefully acknowledged from the National Institute for Health Research Collaboration in Applied Health Research and Care for Leicestershire, Northamptonshire, and Rutland (NIHR CLAHRC).
GolematiS.SassanoA.LeverM. J.BharathA. A.DhanjilS.NicolaidesA. N.Carotid artery wall motion estimated from b-mode ultrasound using region tracking and block matching20032933873992-s2.0-1244431993810.1016/S0301-5629(02)00760-3SelzerR. H.MackW. J.LeeP. L.Kwong-FuH.HodisH. N.Improved common carotid elasticity and intima-media thickness measurements from computer analysis of sequential ultrasound frames200115411851932-s2.0-003520012410.1016/S0021-9150(00)00461-5WendelhagI.LiangQ.GustavssonT.WikstrandJ.A new automated computerized analyzing system simplifies readings and reduces the variability in ultrasound measurement of intima-media thickness19972811219522002-s2.0-0030710511BellmanR. E.DreyfusS.1962Princeton, NJ, USAPrinceton University PressBeuxF.CarmassiS.SalvettiM. V.GhiadoniL.HuangY.TaddeiS.SalvettiA.Automatic evaluation of arterial diameter variation from vascular echographic images20012712162116292-s2.0-003571271710.1016/S0301-5629(01)00450-1ChengD. C.Schmidt-TrucksässA.ChengK. S.BurkhardtH.Using snakes to detect the intimal and adventitial layers of the common carotid artery wall in sonographic images200267127372-s2.0-003613907110.1016/S0169-2607(00)00149-8NeweyV. R.NassiriD. K.Online artery diameter measurement in ultrasound images using artificial neural networks20022822092162-s2.0-003621905910.1016/S0301-5629(01)00505-1CardinalM. H.MeunierJ.SoulezG.MauriceR. L.TherasseE.CloutierG.Intravascular ultrasound image segmentation: a three-dimensional fast-marching method based on gray level distributions20062555906012-s2.0-3364639971710.1109/TMI.2006.872142GolematiS.StoitsisJ.SifakisE. G.BalkizasT.NikitaK. S.Using the Hough transform to segment ultrasound images of longitudinal and transverse sections of the carotid artery20073312191819322-s2.0-3684902592710.1016/j.ultrasmedbio.2007.05.021Mendizabal-RuizG.RiveraM.KakadiarisI. A.A probabilistic segmentation method for the identification of luminal borders in intravascular ultrasound imagesProceedings of the 26th IEEE Conference on Computer Vision and Pattern Recognition (CVPR '08)June 2008182-s2.0-5194908985110.1109/CVPR.2008.4587484YangX.DingM.LouL.YuchiM.QiuW.SunY.Common carotid artery lumen segmentation in B-mode ultrasound transverse view images201151521NobleJ. A.BoukerrouiD.Ultrasound image segmentation: a survey200625898710102-s2.0-3374688587810.1109/TMI.2006.877092RamnarineK. V.KanberB.PaneraiR. B.Assessing the performance of vessel wall tracking algorithms: the importance of the test phantom20041199204ClaridgeM. W.BateG. R.DineleyJ. A.HoskinsP. R.MarshallT.AdamD. A.BradburyA. W.WilminkA. B.A reproducibility study of a TDI-based method to calculate indices of arterial stiffness20073422152202-s2.0-38349092789TeirlinckC. J. P. M.BezemerR. A.KollmannC.LubbersJ.HoskinsP. R.FishP.FredfeldtK. E.SchaarschmidtU. G.Development of an example flow test object and comparison of five of these test objects, constructed in various laboratories1998361–56536602-s2.0-0031987372RamnarineK. V.NassiriD. K.HoskinsP. R.LubbersJ.Validation of a new blood-mimicking fluid for use in Doppler flow test objects19982434514592-s2.0-003203349910.1016/S0301-5629(97)00277-9RamnarineK. V.HoskinsP. R.RouthH. F.DavidsonF.Doppler backscatter properties of a blood-mimicking fluid for doppler performance assessment19992511051102-s2.0-003292437810.1016/S0301-5629(98)00139-2GermondL.BonnefousO.LoupasT.Quantitative assessment of the artery dilation measurements with an arterial phantomProceedings of the 2001 Ultrasonics SymposiumOctober 2001141314162-s2.0-00357312282011, Region Growing (2D/3D greyscale). MATLAB Central File Exchange, http://www.mathworks.com/matlabcentral/fileexchange/32532