Unsupervised Joint Image Denoising and Active Contour Segmentation in Multidimensional Feature Space

We describe a new method for simultaneous image denoising and level set-based active contour segmentation using multidimensional features. We consider an image to be a surface embedded in a Riemannian manifold. By defining a metric in the embedded space, which in our case includes multidimensional image features as well as a level set-based active contourmodel, a minimization problem in the image space can be obtained through the Polyakov action framework.The resultingminimization problem is solved with a dual algorithm for efficiency. Benefits of this new method include the fact that it is independent of any artificial “running” parameters, and experiments using both synthetic and real images show that the method is robust with respect to noise and blurry object boundaries.


Introduction
Unsupervised image segmentation is an important problem with many applications in science, including medical imaging.Image segmentation is a postprocessing problem in many computer vision tasks; its aim is to divide an image into finite number of subregions.The features of different subregions are utilized as the segmentation criteria.The statistical methods, such as expectation-maximization (EM) algorithm [1] and fuzzy C-means clustering (FCM) algorithm [2], are applied in classifying the pixels based on some particular image features segmentation criteria.In general, the statistical methods achieve the classification based on only one segmentation criterion.However, there is various kinds of features in an image and the features may vary spatially.Therefore it will be not precise to use one kind of these methods.How to extract the features of an image and how to utilize these features as the segmentation criterion are significant for segmentation.
Many works utilize the difference between invariable pixel intensities, as well as their spatial connectivity, in assessing whether two pixels belong to the same object.
These active contour models based on the level set method [3] classify the pixels by only one image feature, that is, the image intensity based on uniform distribution [4][5][6].Nevertheless, the image intensity varies spatially; thus the image intensity is not necessarily described by one kind of specific distribution.For improving the precision, the works of [7,8] extract the multifeature to deal with more complex information content.Simultaneously, the additional artificial parameters are introduced; thus it needs the experience to set the parameters.
The Polyakov action was introduced in image processing by Sochen et al. in [9].This segmentation model is different from the other segmentation methods in two ways.First, images are represented as Riemannian manifolds embedded in a higher dimensional spatial-feature manifold.Second, the Polyakov action provides an efficient mathematical framework to embed the multifeature of images in higherdimensional Riemannian manifolds by harmonic maps.Bresson et al. [10] propose active contour models based on the Polyakov action.These models map several kinds of features, for example, color and texture, into higher dimensional space.Because these models choose a metric with artificial parameters on the feature space, it requires careful manual parameter-tuning.
In this paper, the proposed active contour model is formulated in the framework of the Polyakov action [9].Unlike the other related works [7][8][9], a metric on the feature space manifold is defined by the invariant geometry of images.Consequently, the proposed method is purely based on the geometrical features of images without any artificial parameters.We implement the segmentation through two steps.First, an approximated image, removing the noise while preserving the main structures, is found in the feature space built on geometrical features of the original image.Second, the active contour is embedded into the feature space built on both the statistical and geometrical features of the approximated image.For efficiency, we solve the proposed model via the improved Chambolle dual formulation [10] of the minimization problem.
The paper is organized as follows.In Section 2, we introduce the mathematical framework based on the Polyakov action.In Section 3, we introduce the proposed model and the numerical algorithm of the proposed method is also summarized.In Section 4, we validate our model by some experiments on medical images.In Section 5, we end the paper by a brief conclusion.

Geometrical Framework Based on Weighted Polyakov Action
Sochen et al. introduce a general geometrical framework for low-level vision, based on the Polyakov action [9].In this framework, images are represented as the surfaces on a Riemannian manifold.The Polyakov action is a functional that measures the weight of a mapping X = ( 1 (), . . .,   ()) between an -dimensional embedded manifold (e.g., the image manifold) Σ with coordinates  = ( 1 , . . .,   ) and the -dimensional manifold  with the coordinates ( 1 (), . . .,   ()),  > .A Riemannian structure metric  V can be introduced to measure the local distances on the embedded manifold Σ, whereas we use the metric ℎ  to measure the distance on the manifold .To measure the weight of the mapping X : Σ  → , the Polyakov action is used as a generalization of the  2 -norm on the embedded image to space feature manifold : where  is the determinant of the image metric tensor  V and   is its inverse.The metric  is chosen as the induced metric, obtained by the pullback relation:  V = ℎ          ; the Polyakov energy is shortened to In the relevant works [7,8], the authors get the denoised image and the segmentation results by minimizing the energy functional (2) with respect to denoising and segmentation, respectively.In seminal work [9], they embed grey images in the feature (, , (, )), where (, ) is the grey intensity value for pixel (, ).They choose a metric [ℎ  ] = diag(1, 1,  2 );  > 0 is a constant.Based on this metric on feature space and the Polyakov energy, the regularization term on the intensity values is given by ∫ √1 +  2 |∇| 2 .Although it allows setting the scale of the feature dimension independently of the spatial dimensions, the accuracy of the scale is subject to the artificial parameter .

The Active Contour Model in Multifeature Space
In this work, we utilize an improved geometrical framework based on the weighted Polyakov action without any artificial parameter.First, we get an approximated image by embedding it into the feature space constituted by the features of the original image.Second, given the approximated image, active contour is driven by embedding the level set function into the higher dimensional feature space composed of the geometrical and statistical features of the approximated image.

The pullback relation yields the determinant of metric tensor
( Analogizing based on the Polyakov energy (2), we get the approximated image  by minimizing the energy functional as follows: ( According to the Polyakov energy (2), we drive the curve evolution by minimizing the energy functional as follows: where the weight of first term is actually an edge detector.
The curve evolution tends to stop when it decreases to zero, whereas the evolution goes on.

Dual Algorithm.
To apply the dual gradient algorithm, we introduce the dual variable, .The total variation term in ( 4) and ( 6) can be formulated as follows: The approximation formulation of the energy of our model can be rewritten as min where We then apply the split Chambolle dual algorithm [10] to solve the optimization problem.
(a) Given image , V 1 , update .we search for  as the solution of  The solution of ( 10) is given by where  1 = ( 1 ,  2 ) can be updated by fixed point method: initializing  1 = 0 and updating In this paper, we choose  ≤ 1/8 to ensure convergence.(b) Given , V 2 , we search for  by solving the minimization problem as follows: The solution of ( 13) is given by Equation ( 14) is solved by a fixed point method: (c) Given the solution of , we search V 2 by solving min The solution of ( 16) is given by (d) Given , , we search for V 1 as the solution of min , The solution of ( 18) is given by After V 1 is solved, it is utilized in (12) for next iteration.
The algorithm of minimizing our model is described in the following.
Step 2. Given the fixed threshold of iterations  iteration > 0, if  =  iteration , then stop; else go to Step 3. Step 3. Do the iteration for solving subproblem.

Experimental Results
All the experiments are run with Matlab code on the PC of CPU 3.2 GHz, RAM 728 M. we show the experiments results for medical image segmentation of Chan-Vese model (CV) [11], the structure-based level set method (SLM) [12], and the region-scale fitting model (RSF) [4].Figure 1 shows the experiments on the synthesized noisy images.This image is of size 266 × 313 with 10% white Gaussian noise.
As shown in Figures 1(b) and 1(c), the CV model and the SLM models are sensitive to noise.As shown in Figure 1(d), the proposed model is robust to noise and obtain the correct boundary.The CV model generates the unwanted contours because of the strong noise.Based on the edge detector function, the SLM model is more robust to the noise than the CV model.The result of the proposed model shows that it is able to extract the real object boundary even when the noise is strong.
Figure 2 is brain magnetic resonance image (MRI) of size 397 × 397 with 2% noise and 10% level intensity nonuniformity.The brain MRI mainly consists of three parts: the cerebrospinal fluid, the gray matter, and the white matter.The cerebrospinal fluid is the dark matter which exists in two places: the middle of the brain surrounded by the gray matter and the gap between the cranium and the brain.The task of segmenting the brain MRI is to extract the contour profile between the white matter and the gray matter.Since the  Figure 4 show the segmentation results of the active contour methods based on multilayer level set functions.By the multilayer level set functions, the cerebrospinal fluid, the gray matter, and the white matter can be extracted simultaneously.In Figures 4(b) and 4(f), the results of CV model show that the cerebrospinal fluid is not extracted completely.
As shown in Figures 4(c) and 4(g), the boundaries between the white and gray matters are not extracted completely by SLM model.We can observe that in Figures 4(d) and 4(h), the results of the proposed method based on multilayer level set functions show that the completed boundaries of the cerebrospinal fluid, the gray matter, and the white matter are extracted simultaneously.To show the convergence speed of the compared methods, Table 1 shows the iteration numbers and processing time in each iteration for the CV model, the SLM model based on the steepest descent method, and the proposed model with both single-and multilayer level set functions.Table 2 shows the segmentation accuracy of the compared active contour models based on multilayer level set functions.
The data in Figure 5 is download from the website [13].We also show the segmentation accuracy in Table 3 by the DICE metric [14], compared with the ground truth given in this website.We can see from Figures 5(c) and 5(d) that the CV model and the SLM model only extract the boundaries with high contrast, while the object boundaries between the gray matter and white matter are not extracted.And some CSF of the image is not extracted.The proposed method can   extract the more completed CSF and can preserve the cerebral cortex more efficiently.

Conclusion
In this paper, we propose a new variational model for image segmentation and image denoising simultaneously.We obtain the approximated image by embedding the approximating criteria into a specific multifeature space.And then the segmentation result is obtained by embedding the active contour into another multifeature space which is composed by the segmentation criteria depending on the approximated image.The segmentation and the denoising problems are solved by the split Chambolle dual algorithm alternately.The comparisons of the other popular segmentation models demonstrate the accuracy and efficiency of the proposed model.

Additional Points
The following are the research highlights of this paper.The proposed variational model incorporates segmentation and denoising together.Segmentation and denoising processing are achieved alternately by the Polyakov action framework.An improved Polyakov action framework is purely based on the geometric features of the image without any manual

Figure 2 :
Figure 2: Segmentation for brain MRI.(a) Original image and initial level set contour.(b) Segmentation result of the CV model with 200 iterations.(c) Segmentation result of the SLM with 100 iterations.(d) Segmentation result of the RSF model with 200 iterations.(e) Segmentation result of the proposed model with 30 iterations.(f) The approximated result of the proposed model.

Figure 3 :
Figure 3: Segmentation for brain MRI.(a) Original image and initial level set contour.(b) Segmentation result of the CV model with 200 iterations.(c) Segmentation result of the SLM with 100 iterations.(d) Segmentation result of the RSF model with 200 iterations.(e) Segmentation result of the proposed model with 30 iterations.(f) The approximated result of the proposed model.

Figure 3
is a brain MRI of size 258 × 258 with 5% noise and 40% intensity nonuniformity.As shown in Figures3(b) and 3(c), the drawbacks of the RSF model and the SLM model still exist.Compared with the other methods, the proposed method clearly extracts more object boundaries with lowcontrast between the gray matter and the white matter.

Figure 4 :
Figure 4: Segmentation for brain MRIs by the active contour methods based on multilayer level set functions.(a) and (e) are original images and initial level set contours.(b) and (f) are segmentation results of the CV model with 100 iterations.(c) and (g) are segmentation results of the SLM with 50 iterations.(d) and (h) are the results of the proposed method with 30 iterations.
], denotes the coefficients of first fundamental form in differential geometry.When this weight coefficient is larger, the edge structure is enhanced in the vicinity of the edges; otherwise, smoothing the image is strengthened.The weight coefficient of the third term, corresponding to the last element of the metric [ℎ  ], denotes the coefficients of second fundamental form in differential geometry.Approximating the intensity (, ) is strengthened when this coefficient is larger, whereas smoothing the image is strengthened when the weight is smaller.

Table 1 :
Iteration numbers and processing time in each iteration.

Table 2 :
Quantitative evaluation for brain MR-data in Figure4.