Computational and Mathematical Methods in Medicine

Volume 2014 (2014), Article ID 401201, 6 pages

http://dx.doi.org/10.1155/2014/401201

Research Article

Automatic Lung Tumor Segmentation on PET/CT Images Using Fuzzy Markov Random Field Model

Yu Guo,¹ Yuanming Feng,1,2 Jian Sun,² Ning Zhang,¹ Wang Lin,¹ Yu Sa,¹ and Ping Wang²

¹Tianjin Key Lab of BME Measurement, Tianjin University, Tianjin 300072, China

²Department of Radiation Oncology, Tianjin Medical University Cancer Institute and Hospital, Tianjin 300060, China

Received 28 March 2014; Accepted 12 May 2014; Published 29 May 2014

Academic Editor: Lei Chen

Copyright © 2014 Yu Guo et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

The combination of positron emission tomography (PET) and CT images provides complementary functional and anatomical information of human tissues and it has been used for better tumor volume definition of lung cancer. This paper proposed a robust method for automatic lung tumor segmentation on PET/CT images. The new method is based on fuzzy Markov random field (MRF) model. The combination of PET and CT image information is achieved by using a proper joint posterior probability distribution of observed features in the fuzzy MRF model which performs better than the commonly used Gaussian joint distribution. In this study, the PET and CT simulation images of 7 non-small cell lung cancer (NSCLC) patients were used to evaluate the proposed method. Tumor segmentations with the proposed method and manual method by an experienced radiation oncologist on the fused images were performed, respectively. Segmentation results obtained with the two methods were similar and Dice’s similarity coefficient (DSC) was 0.85 ± 0.013. It has been shown that effective and automatic segmentations can be achieved with this method for lung tumors which locate near other organs with similar intensities in PET and CT images, such as when the tumors extend into chest wall or mediastinum.

1. Instruction

Combination of positron emission tomography (PET) and CT images provides complementary functional and anatomical information which has been used for tumor volume definition in radiation treatment (RT) planning for lung cancer patients [1]. Automatic methods for tumor segmentation on PET/CT images are highly desired to avoid the inter- and intraobserver variability caused by manual method.

Many automatic tumor segmentation techniques for identification and delineation of cancerous tissues have been reported such as for brain tumor [2], lung tumor [3], and prostate tumor [4]. The segmentation can be performed either on a single image set, such as CT [5], PET [6], or MRI images [7], or on the fused image set of different image modalities such as CT/PET [8–10] or multiparametric MRI images [2, 11]. Different types of tumors and image modalities have different image features, and thus different segmentation strategy should be developed for effective and accurate tumor segmentations.

CT images provide anatomical information with high spatial resolution. However, for the lung tumors abutting or involved in adjacent structures such as chest wall, mediastinum, or diaphragm which show intensities similar to those of tumors on the images, it is difficult to distinguish them from the adjacent tissues with commonly used autosegmentation algorithms. Lung tumors can be distinguished from the adjacent tissues on PET images, but the segmentation accuracy is still limited due to the coarser spatial resolution of the image data and motion artifacts as the result of time-consuming procedure of data acquisition. Therefore, one of the key points of lung tumor segmentation on PET/CT images is to combine the advantages of the two image modalities effectively.

Several methods [8–10] are proposed for lung tumor segmentation on PET/CT images. Most of the reported methods fuse different features extracted from PET and CT images inside one single -dimensional vector. In this paper, we propose a new strategy for fusing PET and CT information. The method is based on fuzzy Markov random field (MRF) model which has shown effective performance for unsupervised image segmentation [12, 13]. Different from traditional fuzzy MRF method, the proposed method designs a new joint posterior probabilistic model for effective combination of PET and CT image information. The new method was evaluated using image data of 7 patients with lung cancer in this study and experimental results showed its good performance in automatic tumor delineation.

This paper is organized as follows. We first present the basic theory about image segmentation using fuzzy MRF model in Section 2.1. The framework of lung tumor segmentation on CT/PET images using fuzzy MRF model is then described in Section 2.2. The evaluation of the proposed method and quantification results are shown in Section 3. Finally, discussion and conclusion are presented at the end.

2. Materials and Methods

2.1. Image Segmentation Based on Fuzzy MRF Model

The fuzzy MRF model is an unsupervised statistical methodology that takes place in Bayesian framework. Image segmentation based on fuzzy MRF model requires modeling two random fields [14]. For the set of pixels of an image to be segmented, is the observed random field which represents the observed image and takes its value in the set of real numbers, while is the unobserved random field, which corresponds to the final segmentation results and takes its value in the set of , with being the number of classes. In comparison to the standard implementation where only a finite number of hard classes are considered, fuzzy segmentations allow each pixel to belong simultaneously to more than one class. From this point of view, which is the realization of the random field for the pixel at location should be associated with a vector with , where is the membership degree of the pixel to class . The segmentation problem consists of estimating () from the available noisy observation.

The relationship between and can be modeled by the joint distribution . According to Bayesian principle, we have , where is the prior distribution of and is the posterior distribution. In the fuzzy MRF model, is assumed to be stationary and Markovian.

Image segmentation problem is considered as a maximum a posteriori (MAP) problem. That is to estimate the membership degree matrix of the studied image which maximizes probability density function (PDF) , where is the number of pixels in the image and represents the intensity or feature vector of the image. There is . In Bayesian framework, , where can be considered independent of . Therefore, we have

The probabilistic models used for and are based on the prior knowledge of the studied image. In fuzzy MRF model, is set as Gibbs distribution for the reason that pixels tend to belong to the same class with their neighbors. For the posterior distribution , Gaussian distribution is usually used, since, for a region with common properties in images, it is reasonable to assume that the intensity or other feature values are distributed around the mean value of the class. As long as proper probabilistic models are determined, the membership degree matrix can be estimated by solving the maximization problem in (2).

2.2. Tumor Segmentation on PET/CT Images Using Fuzzy MRF Model

In this subsection, the fuzzy MRF method for tumor segmentation on PET/CT images is described in detail. For segmenting tumor on PET/CT images, is the membership degree of the voxel at location to tumor class. is related to some image features of the voxel at location extracted from PET and CT images. Here, the CT image intensity and the standardized uptake value (SUV) derived from PET images are used. Therefore, tumor segmentation on PET/CT image using fuzzy MRF model is actually done to estimate the membership degree to tumor class of each voxel by solving the maximization problem as shown in

One of the key points about the above maximization problem is to choose proper probabilistic models for and . Since regions which show tumor features on both PET and CT images may be tumor regions with higher possibility, we set as , where and are the PDFs of the two features given that the studied voxels belong to tumor class, while and are the PDFs of the two features given that the voxels belong to normal tissue class. and are set as Gaussian functions, since the CT intensities of tumor tissues and normal tissues around the tumor tissues are usually assumed to be distributed around the mean value of their own class. Besides, it is reasonable to assume that SUVs of normal tissues have a normal distribution, so is also set as a Gaussian function. For , a uniform distribution is used, which means that voxels with a SUV value greater than a threshold have the same possibility to be tumor class. The parameters of , , , and are estimated by fitting the histogram of the region obtained from -means clustering with the selected distributions. The prior distribution of is set as Gibbs distribution as in other fuzzy MRF methods [13]. As a result, the final maximization problem can be noted as

with

where and are the image indexes, is the membership degree of the th voxel belonging to tumor class, is the neighborhood of the th voxel, and is the smoothing parameter which affects the smoothness of segmentation results. Besides, can be computed with the following function:

where and are, respectively, the mean and variance of the Gaussian function in (5). The function is shown as follows;

where is a SUV threshold to distinguish tumor tissues from normal tissues and is the maximum SUV value of the PET image studied.

Gradient decent algorithm is used to solve the optimization problem in (3). The iterative form of the proposed method can be summarized as follows.

(1)Initialize the vector of membership degree .(2)Update , where and .(3)Repeat step (2) until , where represent 2-norm and is the stopping threshold set as a small positive real number.

In the proposed method, the step size and the smoothing parameter need to be selected. A large step size may make the algorithm divergent, so using a small step size is common practice. should be selected according to the smoothness of tumor tissues on images. Once the membership degree vector is estimated, we determine the final tumor regions using a simple threshold method.

3. Experiments and Results

The PET and CT simulation images of 7 non-small cell lung cancer (NSCLC) patients were used to evaluate the proposed method. PET and CT fusion results of studied images using MIM 5.2 (MIM Software) were exported to in-house-developed software for the study. Gross tumor volume (GTV) delineation with the proposed MRF method and manual method by an experienced radiation oncologist on the fused images were performed, respectively. The manually contoured GTVs were checked and confirmed by another experienced radiation oncologist. The robustness of MRF method was evaluated by comparing the overlap of the two delineations using Dice’s similarity coefficient (DSC) expressed as , where is the manually delineated GTV volume and is the GTV volume obtained with the new automatic method.

Some lung tumors in the studied cases locate near other organs with similar intensities to tumor tissues in PET and CT images (such as the chest wall or the mediastinum), and it is difficult to segment these lung tumors. Figure 1(a) shows a fused PET/CT image of a patient with lung cancer; the tumor locates close to the mediastinum and has image features similar to those of the mediastinum. Figure 1(b) shows another case in which the tumor is close to the chest wall.

(a)

(b)

Figure 1: Fused PET/CT images of two patients with lung tumors delineated by radiation oncologist shown in red lines.

The proposed segmentation algorithm performs on a manually selected region rather than the whole volume enclosed by the image set. Lung tumors locate in the selected regions, as shown in Figure 2. There are much fewer tissue components in the selected region than in the whole volume which makes the segmentation easier. In order to obtain the probabilistic model parameters of , , , and in (3), the fuzzy -means clustering [15] is applied to the regions of interest in the studied PET and CT images. Figure 3 shows the estimated membership degrees of the selected region in Figure 2 to tumor class with fuzzy -means clustering. It is assumed that the voxels which have the membership degrees greater than 0.1 belong to tumor class. Then, we can have a rough segmentation of the selected region. According to the segmentation result, the desired probabilistic model parameters, such as the means and deviations of Gaussian models in (5), can be estimated. Figure 4 shows the probabilities of tumor class of the voxels in the selected region of Figure 2, which are computed based on the probabilistic model parameters estimated in the previous step.

Figure 2: An axial CT slice of a patient with the region to be segmented marked.

(a)

(b)

Figure 3: Membership degrees to tumor class of the selected region in Figure 2 obtained with fuzzy -means clustering; (a) only CT intensity feature is used; (b) only SUV feature is used.

(a)

(b)

Figure 4: Probabilities of tumor class of the voxels within the selected region in Figure 2, (a) ; (b) .

Figure 5 shows the tumor segmentation results of 3 patients obtained, respectively, with the manual method, fuzzy MRF method using only PET images, and the proposed method using CT/PET images. As shown in Figure 5, lung tumors in these cases are close to other tissues with similar image features. We can also see that GTVs determined by using only PET images are bigger than the ones obtained with the other two methods in most cases, while GTVs obtained with the manual method and the proposed method are similar. For the other cases, we obtained the same results.

(a)

(b)

(c)

Figure 5: GTVs in axial CT slices of patient (a), (b), and (c). GTVs in blue are the results with fuzzy MRF method using only PET images and GTVs in red and green are the results with the new method and manual method, respectively, using both PET and CT images.

In our work, the traditional MRF model method in [13] and fuzzy -means clustering are also used to segment lung tumors. CT/PET image based segmentation results obtained with the two methods are much worse than the results of the two methods using only PET images. The DSCs of the two methods for all the studied cases were 0.59 ± 0.034 and 0.62 ± 0.029, respectively. It means that the two methods cannot effectively combine CT and PET image information to achieve accurate lung tumor segmentation. DSC of the proposed method for all the studied cases was 0.85 ± 0.013. Therefore, the proposed method is able to effectively utilize CT and PET image information and achieves good lung tumor segmentation.

4. Conclusions

CT/PET images provide complementary functional and anatomical information of human tissues and lead to better lung tumor definition. This paper proposes a fuzzy MRF model based method for automatic lung tumor segmentation on CT/PET images. Different from traditional fuzzy MRF model method, it utilizes a new joint posterior probabilistic model, which can effectively take advantage of both CT and PET image information for the identification and delineation of tumor volume. Experimental results show its good performance. For lung tumors which locate near other tissues with similar intensities in PET and CT images, such as when they extend into the chest wall or the mediastinum, this method was able to achieve more effective tumor segmentation. In future work, we will further test the reliability of this method with more clinical data.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This work was supported by Grants from the National Natural Science Foundation of China (81171342, 81201148), Tianjin Research Program of Application Foundation and Advanced Technology (14JCQNJC09500), the National Research Foundation for the Doctoral Program of Higher Education of China (20130032120070, 20120032120073), and Independent Innovation Foundation of Tianjin University (60302064, 60302069).

References

S. Katsuyuki, N. Akiko, A. Takanori, et al., “Use of FDG-PET in radiation treatment planning for thoracic cancers,” International Journal of Molecular Imaging, vol. 2012, Article ID 609545, 9 pages, 2012.

W. Dou, S. Ruan, Y. Chen, D. Bloyet, and J.-M. Constans, “A framework of fuzzy information fusion for the segmentation of brain tumor tissues on MR images,” Image and Vision Computing, vol. 25, no. 2, pp. 164–171, 2007.

Y. Gu, V. Kumar, L. O. Hall et al., “Automated delineation of lung tumors from CT images using a single click ensemble segmentation approach,” Pattern Recognition, vol. 46, no. 3, pp. 692–702, 2013.

Y. Artan, M. A. Haider, D. L. Langer et al., “Prostate cancer localization with multispectral MRI using cost-sensitive support vector machines and conditional random fields,” IEEE Transactions on Image Processing, vol. 19, no. 9, pp. 2444–2455, 2010.

C. Li, X. Wang, S. Eberl, et al., “A likelihood and local constraint level set model for liver tumor segmentation from CT volumes,” IEEE Transctions on Biomedical Engineering, vol. 60, no. 10, pp. 2967–2977, 2013.

M. Halt, C. C. le Rest, A. Turzo, C. Roux, and D. Visvikis, “A fuzzy locally adaptive Bayesian segmentation approach for volume determination in PET,” IEEE Transactions on Medical Imaging, vol. 28, no. 6, pp. 881–893, 2009.

H. Cui, X. Wang, and D. Feng, “Automated localization and segmentation of lung tumor from PET-CT thorax volumes based on image feature analysis,” in Proceedings of the 34th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS '12), pp. 5384–5387, San Diego, Calif, USA, September 2012.

J. Wojak, E. D. Angelini, and I. Bloch, “Joint variational segmentation of CT-PET data for tumoral lesions,” in Proceedings of the 7th IEEE International Symposium on Biomedical Imaging: From Nano to Macro (ISBI '10), pp. 217–220, April 2010.

H. Gribben, P. Miller, G. G. Hanna, K. J. Carson, and A. R. Hounsell, “Map-Mrf Segmentation of lung tumours in pet/ct images,” in Proceedings of the IEEE International Symposium on Biomedical Imaging: From Nano to Macro (ISBI '09), pp. 290–293, July 2009.

C. Ballangan, X. Wang, S. Eberl, M. Fulham, and D. Feng, “Automated detection and delineation of lung tumors in PET-CT volumes using a lung atlas and iterative mean-SUV threshold,” in International Society for Optics and Photonics, Image Processing, vol. 72593 of Proceedings of SPIE Medical Imaging, February 2009.

N. Zhang, S. Ruan, S. Lebonvallet, Q. Liao, and Y. Zhu, “Kernel feature selection to fuse multi-spectral MRI images for brain tumor segmentation,” Computer Vision and Image Understanding, vol. 115, no. 2, pp. 256–269, 2011.

S. Ruan, S. Lebonvallet, A. Merabet, and J.-M. Constans, “Tumor segmentation from a multispectral MRI images by using support vector machine classification,” in Proceedings of the 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro (ISBI '07), pp. 1236–1239, April 2007.

X. Liu, D. L. Langer, M. A. Haider, Y. Yang, M. N. Wernick, and I. Š. Yetik, “Prostate cancer segmentation with simultaneous estimation of Markov random field parameters and class,” IEEE Transactions on Medical Imaging, vol. 28, no. 6, pp. 906–915, 2009.

H. Caillol, W. Pieczynski, and A. Hillon, “Estimation of fuzzy Gaussian mixture and unsupervised statistical image segmentation,” IEEE Transation on Image Processing, vol. 6, no. 3, pp. 425–440, 1997.

K.-S. Chuang, H.-L. Tzeng, S. Chen, J. Wu, and T.-J. Chen, “Fuzzy c-means clustering with spatial information for image segmentation,” Computerized Medical Imaging and Graphics, vol. 30, no. 1, pp. 9–15, 2006.