The restoration of blurred images corrupted by Poisson noise is an important topic in imaging science. The problem has recently received considerable attention in recent years. In this paper, we propose a combined first-order and second-order variation model to restore blurred images corrupted by Poisson noise. Our model can substantially reduce the staircase effect, while preserving edges in the restored images, since it combines advantages of the first-order and second-order total variation. We study the issues of existence and uniqueness of a minimizer for this variational model. Moreover, we employ a gradient descent method to solve the associated Euler-Lagrange equation. Numerical results demonstrate the validity and efficiency of the proposed method for
Poisson noise removal problem.
1. Introduction
Image restoration problem has been widely studied in the areas of image processing. The goal of image restoration is to reconstruct an approximation of an original image from a blurred and noisy one [1–4]. Over the last decades, most of the literature deal with the additive noise and multiplicative noise model [5–11]. Given a blurred and noisy image g=Ku+v or g=Kuv, where u is the original image, v represents the noise, and the blurring operator K is a point spread function (PSF); the restoration problem involving the additive noise or multiplicative noise is to recover u from the observed image g. The additive noise and multiplicative noise models have been extensively studied. We refer the reader to [12–19] and references therein for a review of various methods. In fact, there are other types of noise such as Poisson noise. In this paper, we consider the problem of seeking the approximations of original images from blurred images corrupted by Poisson noise. The restoration of blurred images corrupted by Poisson noise is an important task in various applications such as astronomical imaging, electronic microscopy, single-particle emission-computed tomography (SPECT), and positron emission tomography (PET) [20–24]. In a Poisson noise model, the recorded image g is a realization of a random variable g^. A statistical model for g^ is given by
(1)g^~Poiss(Ku+b),
where b>0 is the expected value of the background which is assumed to be constant. The given data of the problem are the imaging operator K, the expected value of the background b, and the detected image g. It is known that the major difficulty for finding the original image u of (1) is the models and algorithms developed for deconvolution of additive noise, or multiplicative noise images cannot be directly applied to the restoration of Poissonian images. Therefore, it is important to devise efficient and reliable algorithms for restoring blurred images corrupted by Poisson noise. The problem of restoration of Poissonian images has received considerable attention in recent years.
We note that, in a discrete setting, the intensity gi in the pixel i is a random variable that follows a Poisson law of mean (Ku+b)i where the structured matrix K related to the boundary conditions is called a blurring matrix. Considering that these random variables are independent, the probability distribution of g, for given K, u, and b, can be written as
(2)ℒ(u)=P(g∣u)=∏i[(Ku+b)i]gigi!exp-(Ku+b)i.
The use of Stirlings formula leads to the well-known Csiszár [25] I-divergence measure between Kx+b and g. Indeed, by taking the negative logarithm of the likelihood function, we obtain
(3)𝒯0(u)=-log[L(u)]=∑i(Ku+b)i-gi+giloggi(Ku+b)i.
This measure generalizes the Kullback-Leibler divergence or cross-entropy measure to accommodate functions whose integrals are not constant, as they would be if they were probability distributions. Dropping the terms independent of u in ℒ(u), we obtain
(4)𝒥0(u)=∑i(Ku+b)i-gilog(Ku+b)i.
Therefore, the maximum likelihood estimator of the original image is the minimizer with respect to u of the negative-log Poisson likelihood functional 𝒥0(u).
As is well known, the structured matrix K has many singular values of different orders of magnitude close to the origin. This makes the minimizer of (4) very sensitive to the noise in the right-hand side g. Thus a regularization method may be employed to compute the approximate solution that is less sensitive to noise than the naive solution. In general, regularization methods formulate the image restoration problem as a minimization problem of the form:
(5)𝒥(u)=𝒥0(u)+α𝒥R(u),
where 𝒥R(u) is a regularization function and α>0 is the regularization parameter that controls the balance between 𝒥0 and 𝒥R. We note that the regularization parameter α is an important quantity which controls the properties of the regularized solution, and α should therefore be chosen with care. Throughout the years a variety of parameter choice strategies such as the discrepancy principle, the L-curve, and generalized cross-validation (GCV) have been proposed for Poisson noise removal problem [26–28].
It is shown in [29] that the choice of the regularization function 𝒥R(u) is related to the features of the images to be restored. The use of different regularization functions is an active research area. Probably one of the most popular regularization functions is the Tikhonov regularization function 𝒥R(u)=(1/2)∥Lu∥22, where L is an auxiliary operator chosen among the identity and low-order differential operators; see [30] for more details. In [31], Landi and Piccolomini proposed a quasi-Newton projection method for deblurring Poisson-corrupted images after formulating the image restoration problem as a nonnegatively constrained minimization problem where the objective function is the sum of the Kullback-Leibler divergence, used to express fidelity to the data in the presence of Poisson noise, and of a Tikhonov regularization term. Their numerical results show the potential of the method both in terms of relative error reduction and computational efficiency. In [32, 33], the authors developed a cost functional which incorporates the statistics of the noise in the image data and Tikhonov regularization to induce stability and employed an efficient hybrid gradient projection-reduced Newton (GPRNCG) method for the problem of restoration of Poissonian images. Finally, they gave a comparison between the Richardson-Lucy [34, 35] iterative regularization method and GPRNCG algorithm for the restoration of blurred images corrupted by Poisson noise. By the measures of performance used in this comparison, GPRNCG was more efficient than Richardson-Lucy iteration.
It is known that Tikhonov regularization estimate is similar to low-pass filtering; therefore, it produces a smoothing effect on the restored images; that is, it penalizes edges, which is not a good approximation of the original image if it contains edges. To overcome this shortcoming, Rudin et al. [5] proposed a total variation- (TV-) based regularization technique, which preserves the edge information in the restored image. In the case of TV regularization, the estimated solution is obtained by minimizing the object function:
(6)𝒥(u)=𝒥0(u)+α∥u∥TV,
where ∥u∥TV=∥∇u∥1 is the discrete TV regularization term. It is shown in [36] that the TV penalty function acts more like a model selection device by identifying a small number of critical points at which u is allowed to jump. The number of these selected jump points is controlled by α. Especially, if u is piecewise constant with a finite number of jump discontinuities, then ∥u∥TV gives the sum of magnitudes of the jumps.
In [21], Bardsley and Luttman considered the TV regularization for poissonian images and showed that the problem of computing the minimizer of the resulting TV-penalized Poisson likelihood functional is well posed. They then proved that as the errors in the data and in the blurring operator tend to zero, the resulting minimizer converges to the minimizer of the exact likelihood function. Finally, the practical effectiveness of the approach is demonstrated on synthetically generated data, and a nonnegatively constrained, projected quasi-Newton method was introduced. In [22], Figueiredo and Bioucas-Dias proposed an approach to deconvolving Poissonian images with the TV function, which is based upon an alternating direction optimization method. Using standard convex analysis tools, they presented sufficient conditions for existence and uniqueness of solutions of these optimization problems. In [23], Setzer et al. considered the restoration of blurred images corrupted by Poisson noise by minimizing an energy functional consisting of the Kullback-Leibler divergence as similarity term and the TV regularization term. Their minimizing algorithm uses alternating split Bregman techniques which can be reinterpreted as Douglas-Rachford splitting applied to the dual problem. In contrast to recently developed iterative algorithms, their algorithm contains no inner iterations and produces nonnegative images. The high efficiency of their algorithm in comparison to other recently developed algorithms is demonstrated by artificial and real-world numerical examples. We refer the reader to [24, 37] and references therein for other efficient methods solving the restoration of blurred images corrupted by Poisson noise with the TV function.
Although the total variation regularization is extremely popular in a variety of applications, it also gives rise to some undesired effects. Both from a theoretical and experimental point of view, it has been shown that the TV norm transforms smooth signal into piecewise constants, the so-called staircase effect. Staircase solutions fail to satisfy the evaluation of visual quality, and they can develop false edges that do not exist in the true image. To attenuate the staircase effect, there is a growing interest in the literature for replacing the TV norm by a high-order TV norm. The motivation behind such attempt is to restore potentially a wider range of images, which comprise more than merely piecewise constant regions. The majority of the high-order norms involve second-order differential operators because piecewise-vanishing second-order derivatives lead to piecewise-linear solutions that better fit smooth intensity changes; see [38] for more details.
Second-order regularization schemes have been considered so far in the literature mainly for dealing with the staircase effect while preserving the edge information in the restored image. There are two classes of second-order regularization methods for image restoration problems. The first class combines a second-order regularizer with the TV norm. For example, a technique in [39, 40] combining the TV filter with a fourth-order PDE filter was proposed to preserve edges and at the same time avoid the staircase effect in smooth regions for noise removal. In [41], Papafitsoros and Schönlieb considered a high-order model involving convex functions of the TV and the TV of the first derivatives for image restoration problems and used the split Bregman method to solve numerically the corresponding discretized problem. Chan et al. proposed a second-order model to substantially reduce the staircase effect, while preserving sharp jump discontinuities for image restoration in [42]. The second class employs a second-order regularizer in a standalone way. The second-order regularizer was first proposed in [43] for additive noise removal in medical magnetic resonance images. The LLT model presented in [43] can overcome the staircase effect that occurs with the TV norm filter and better preserve the fine details in nonblocky images. In order to test its practical potential the authors have applied their method to a wide range of real images, including structural and functional MRI data sets. The main strength of their method was the ability to process signals with a smooth change in the intensity value. Numerical results have shown that, compared with some related partial differential equation (PDE) models, the LLT model is rather robust in removing noise and handling edges. In [44, 45], the authors reconsidered the fourth-order PDE model for additive noise removal and employed the dual algorithm of Chambolle for solving the high-order problems.
In order to get restored images with edge preserved and simultaneously smooth region reconstructed for Poisson noise removal, it is natural to utilize a combined first-order and second-order total variation technique. In this paper, we consider to modify the total variation model by adding a high-order functional for restoring blurred images corrupted by Poisson noise. Our model can substantially reduce the staircase effect, while preserving edges in the restored images, since it combines advantages of the first-order and second-order total variation. We study the issues of existence and uniqueness of a minimizer for this variational model. Moreover, we employ a gradient descent method to solve the associated Euler-Lagrange equation. Some numerical results demonstrate the validity and efficiency of the proposed method for Poisson noise removal problem.
The organization of this paper is outlined as follows. In the next section, we present a combined first-order and second-order variation model to restore blurred images corrupted by Poisson noise and study the issues of existence and uniqueness of a minimizer for this variational model. A gradient descent method to solve the associated Euler-Lagrange equation is presented in Section 3. Some numerical experiments are given to illustrate the performance of the proposed algorithm in Section 4. We give concluding remarks in the last section.
2. A Combined First-Order and Second-Order Variation Model
In the Bayesian approach, a prior probability density Pu(u) for u is also specified, and the posterior density:
(7)Pu(u∣g)=Pg(g∣u)Pu(u)Pg(g),
given by Bayes’s law, is maximized with respect to u. In (7), Pg(g) defines the prior probability distribution of the measurements g, which are given by measurements, and the likelihood function Pg(g∣u) is the conditional probability of observing a fixed g for a variable u. The maximizer of Pu(u∣g) is called the maximum a posteriori (MAP) estimate. Since Pg(g) does not depend on u, it is not needed in the computation of the MAP estimate and thus can be ignored. Taking the natural logarithm of (7) and dropping the terms independent of u, we obtain that maximizing (7) is equivalent to minimizing
(8)E(u)=𝒥0(u)-logPu(u)
with respect to u, where 𝒥0(u)=∫Ω((Ku+b)-glog(Ku+b))dxdy. It is clear that -logPu(u) corresponds to the regularization term in the classical penalized likelihood approach to regularization. However in the Bayesian setting, Pu(u) is the probability density known as the prior from which the unknown u is assumed to arise. Thus the prior knowledge regarding the characteristics of u can be formulated in the form of a probability density Pu(u), and this yields to a natural, and statistically rigorous, motivation for the regularization method [27].
Standard Tikhonov regularization corresponds to the following choice of the prior:
(9)Pu(u)=exp-(α/2)∥u∥22.
This corresponds to the assumption that the prior for u is a zero-mean Gaussian random variable with covariance matrix α-1I, which has the effect of penalizing reconstructions with large L2 norm. For L2 norm of the gradient regularization, the penalty has the similar form
(10)Pu(u)=exp-(α/2)∥∇u∥22,
where ∇ is the gradient operator. The use of this regularization function has the effect of penalizing reconstructions that are not smooth. As an alternative to Tikhonov regularization including standard Tikhonov regularization and gradient regularization for Poisson noise removal problem, total variation regularization is another regularization technique that allows for the presence of sharp edges in the resulting reconstruction. In the case of total variation regularization, we have
(11)Pu(u)=exp-α∥∇u∥1,
where ∥∇u∥1=∫Ωux2+uy2dxdy.
Optimization techniques such as alternation direction method of multipliers (ADMM) and alternating split Bregman algorithm were proposed for the restoration of blurred images corrupted by Poisson noise by minimizing an energy functional consisting of the Kullback-Leibler divergence as the similarity term and the TV regularization term; see [21–24] for more details. In the other hand, some Newton-related gradient methods were proposed for deblurring Poisson-corrupted images by formulating the image restoration problem as a nonnegatively constrained minimization problem where the objective function is the sum of the Kullback-Leibler divergence, used to express fidelity to the data in the presence of Poisson noise, and of a Tikhonov regularization term; see [31–33] for more details.
To attenuate the staircase effect in the TV regularization, we consider a combined first-order and second-order variation model to restore blurred images corrupted by Poisson noise in this work. In the proposed model, the prior probability density is of the form:
(12)Pu(u)=exp-α(θ∥∇u∥1+(1-θ)∥∇2u∥1),
where ∥∇2u∥1=∫Ωuxx2+uxy2+uyx2+uyy2dxdy. It leads to present the following functional for restoring blurred images corrupted with Poisson noise:
(13)minu{tjE(u)=𝒥0(u)+α𝒥R(u)=∫Ω(tj(Ku+b)-glog(Ku+b)+α(θ|∇u|+(1-θ)|∇2u|)tj)dxdy},
where the parameter θ∈[0,1] is used to control the balance between the edges and the smooth surface and α is the regularization parameter which measures the tradeoff between the fidelity term and the regularized term. The parameter θ can be computed by using the information of the edges and smooth regions of the resulting image obtained by smoothing the observed image g with the low-pass filters such as the median filter and the Gauss filter.
The functional E(u) in (13) is defined on the set of u∈BV(Ω)∩BV2(Ω) such that logu∈L1(Ω); in particular, u must be positive almost everywhere. Some basic notations and properties concerning the BV space and BV2 space can be found in [39, 40]. Motivated by [46], we have the following result to show the existence and uniqueness of the minimizer for the model (13).
Theorem 1.
Let Ω be a bounded, open subset of ℝ2 with Lipschitz boundary. Assume that g is a positive bounded function and K is positive definite. Then E(u) for u∈BV(Ω)∩BV2(Ω) such that logu∈L1(Ω) has a unique minimizer for the model (13).
Proof.
First, a straightforward computation can show that 𝒥0(u) is bounded below by g-glogg. Since the penalty function 𝒥R(u)≥0, we obtain that E(u) is bounded below. Thus, we can choose a sequence {un} such that E(un)≥E(un+1). Hence, 𝒥0(un) and 𝒥R(un) are bounded. Using Jensen’s inequality, we have
(14)𝒥0(un)≥∥un∥1-∥g∥log∥un∥1,
which indicates that ∥un∥1 is bounded. This and the boundedness of 𝒥R(un) yields that the sequence {un} is bounded in BV(Ω)∩BV2(Ω). Following the compactness of L1(Ω) in BV(Ω)∩BV2(Ω), we deduce that there exists u*∈BV(Ω)∩BV2(Ω) such that a subsequence {unk} converges to u* pointwise almost everywhere in L1. By the lower semicontinuity of the BV(Ω)∩BV2(Ω) space, we obtain that liminf𝒥R(unk)≥𝒥R(u*). Since 𝒥0(unk) is bounded below, we get that lim𝒥0(unk)≥𝒥0(u*) by using Fatou’s lemma. Therefore, liminfE(unk)≥E(u*) and u* minimizes E(u) for all u∈BV(Ω)∩BV2(Ω) such that logu∈L1(Ω).
Since K is positive definite and g is positive, it immediately follows that 𝒥0(u) is strictly convex. Obviously, 𝒥R(u) is a convex function. We conclude that E(u) is strictly convex, as the sum of a convex function and of a strictly convex function. Therefore, the minimizer u* is unique.
3. Computational Method
In this section, our aim is to propose a time-marching gradient descent method for computing the minimizer of the model (13). From [5, 39, 40] we know that minimizing (13) for a given constant θ yields the associate Euler-Lagrange equation:
(15)0=-θ∇·(∇u|∇u|)+(1-θ)[(∇·(∇ux|∇2u|))x+(∇·(∇uy|∇2u|))y]+KTKu+b-gα(Ku+b)
with the boundary conditions
(16)∇u·N=0,∇ux·N=0,∇uy·N=0,∇·(∇ux|∇2u|)n1=0,∇·(∇uy|∇2u|)n2=0,
where N=(n1,n2) denotes the unit outernormal vector of ∂Ω.
Using the gradient descent method, we are able to derive the associated heat flow for the model (13):
(17)∂u∂t=θ∇·(∇u|∇u|)-(1-θ)×[(uxx|∇2u|)xx+(uxy|∇2u|)yx+(uyx|∇2u|)xy+(uyy|∇2u|)yy]-KTKu+b-gα(Ku+b).
In this work, we use the finite difference scheme to discretize (17); see [5, 39, 40] for more details. Denoting the step space by h=1, we employ the following discretization used in the implementations; see Table 1.
Dx±ui,j
±(ui±1,j-ui,j)
Dy±ui,j
±(ui,j±1-ui,j)
Dxxui,j
Dx±ui,j-Dx±ui-1,j
Dxy±ui,j
±[Dx±ui,j-Dx±ui-1,j]
Dyx±ui,j
±[Dy±ui±1,j-Dy±(ui,j)]
Dyyui,j
Dx±ui,j-Dx±ui,j-1
|Dxui,j|
(Dx+ui,j)2+(m[Dy+ui,j,Dy-ui,j])2+δ
|Dyui,j|
(m[Dx+ui,j,Dx-ui,j])2+(Dy+ui,j)2+δ
|D2ui,j|
(Dxxui,j)2+(Dxy+ui,j)2+(Dyx+ui,j)2+(Dyyui,j)2+δ
In the discretization, the notation m[a,b]=((sgna+sgnb)/2)·min(|a|,|b|) and δ>0 is near 0. Denoting the time step by τ, we get the following explicit computational scheme:
(18)uk+1=uk+τθ[Dx-Dx+uk|Dxuk|+Dy-Dy+uk|Dyuk|]+τ(1-θ)×[Dxx(Dxxuk|D2uk|)+Dyx-(Dxy+uk|D2uk|)+Dxy+(Dyx-uk|D2uk|)+Dyy(Dyyuk|D2uk|)]-τKTKuk+b-gα(Kuk+b).
Now we discuss the choice of the weighting parameter θ in (18). Due to the strengths and weaknesses of the first-order and second-order variation approach, it is desirable that the weighting parameter θ=1 along edges and in flat regions, emphasizing the restoration properties for the first-order total variation. To emphasize the restoration properties of the second-order total variation in smooth regions, we want 0≤θ<1. Specially, the resulting algorithm of (18) is just the TV regularization method for Poisson noise removal problem when θ=1, while the resulting algorithm is the high-order TV regularization method when θ=0. Usually, we may compute the parameter θ by using the information of the edges and smooth regions of the resulting image obtained by smoothing the observed image g with the low-pass filters such as the median filter and the Gauss filter. We have carried out some numerical experiments. We observe that the fixed θ obtained by computing the observed image can give very good results. In this work, in order to detect edges and smoothing regions much better, we adopt the method for updating θ as proposed in [40]. The results obtained by carrying out various numerical examples show that the updating procedure behaves better for our model than the fixed θ. It is because, as the iteration proceeds, the edges and smoothing regions of recovered image are closer to the original image, then the parameter θ computed by the updating scheme can be better suitable for restoration. So we employ the method in [40] for updating θ in our numerical experiments. More precisely, suppose that uk is the kth iterative solution, and we update the parameter θ as follows:
(19)θi,j={1,if|∇ui,jk|maxi,j(|∇ui,jk|)≥c,12cos(2π|∇ui,jk|cmaxi,j(|∇ui,jk|))+12,otherwise,
where 0≪c<1, and it means that only the absolute largest jumps are unaffected of the high-order regularization. As reported in [40], for large and small values of |∇ui,jk| the parameter θ is closer to 1, and for intermediate values of |∇ui,jk| the parameter θ approaches 0, which means that the high-order filter dominates the computation and the staircase effect is suppressed. Since only small jumps should be suppressed with the high-order regularization, it is a good choice for c=1/8.
We are now in a position to describe the time-marching gradient descent algorithm (Algorithm 1) for restoring blurred images corrupted by Poisson noise.
Algorithm 1: The time-marching gradient descent algorithm for solving (13).
In this section, we present some numerical results to illustrate the performance of the proposed model for Poisson noise removal problem. We compare our model with the one proposed in [21] (TV method), the one proposed in [31] (Tikhonov method), and the one proposed in [47] (HTV method). All computations of the present paper were carried out in Matlab 7.10. The results were obtained by running the Matlab codes on an Intel(R) Core(TM) i3 CPU (2.27 GHz, 2.27 GHz) computer with RAM of 2048 M.
The quality of the restoration results with different methods is compared quantitatively by using the signal-to-noise ratio (SNR), the relative error (ReErr), and structural SIMilarity index (SSIM). They are defined as follows:
(20)SNR=20log10(∥utrue∥2∥uk-utrue∥2),ReErr=∥uk-utrue∥2∥utrue∥2,
where utrue and uk are the ideal image and the restored image, respectively, and
(21)SSIM=(2μ1μ2+C1)(2σ12+C2)(μ12+μ22+C1)(σ12+σ22+C2),
where μ1 and μ2 are averages of utrue and uk, respectively, σf and σf~ are the variance of utrue and uk, respectively, and σ12 is the covariance of utrue and uk. The positive constants C1 and C2 can be thought of as stabilizing constants for near-zero denominator values. The SSIM is a well-known quality metric used to measure the similarity between two images. The SSIM method was developed by Wang et al. [48] and is based on three specific statistical measures that are much closer to how the human eye perceives differences between images. In the following experiments, we will use SSIM map to reveal areas of high or low similarity between two images, the whiter SSIM map, and the closer between the two images.
In order to give a good comparison, we employ the time-marching gradient descent algorithm for the four models. In the time-marching gradient descent algorithm, the parameter ϵ=10-4 is introduced to avoid divisions by zero. The initial guess is chosen to be the degraded image in all tests. We set the step size τ as 0.1 in order to obtain a stable iterative procedure. We terminate the iterations for the methods and accept uk as the computed approximation of the ideal image as soon as the maximum number of allowed outer iterations has been carried out or the relative differences between consecutive iterates u1,u2,u3,… satisfy
(22)∥uk+1-uk∥2∥uk+1∥2<10-4.
In addition, we carry out many experiments with different regularization parameters in the models, andthe one with the best results is presented in this work. In this way, we have a fair comparison since we compare the restorations for four different methods.
In the first experiment, we consider the “Cameraman” image of size 256×256. The degraded image in Figure 1(b) is obtained by performing the blurring operation psfGauss (5,1) proposed in [49] on the original image in Figure 1(a) with the background b=10 and adding the Poisson noise. Note that there is no parameter associated with the Poisson noise, but the noise magnitude depends on the absolute image intensities. The amount of noise in a region of the image increases with the intensity of the image there. The restored images by all four methods are shown in Figures 1(c)–1(f). From these figures, compared with the tikhonov regularization method, the TV regularization method, and the high TV regularization method, the proposed approach yields better results in image restoration since it avoids the staircase effect of the general TV methods, and the edges are preserved as well as the general TV methods. In Figures 2(c)–2(f), we have enlarged some details of the four restored images. As it is seen in the zoomed parts, the proposed method outperforms the other three methods. In Figures 2(c)–2(f), we also present the SSIM maps of the restored images in Figures 2(g)–2(j). Note that the SSIM maps of the restored image by the proposed method are whiter than the other methods; that is, our method can get better results. In Table 2, we compare their restoration results in SNRs and ReErrs. We observe from Table 2 that both the SNR and ReErr values of the restored images by the proposed method are better than those by the other three methods.
Restoration results with different methods for Example 1, Example 2, and Example 3.
Method
Parameter
SNR
ReErr
Example 1
Tikhonov
α=400
8.725
0.2657
TV
α=65
14.321
0.0895
HTV
α=80
14.001
0.0930
Hybrid TV
α=60
14.538
0.0871
Example 2
Tikhonov
α=500
9.728
0.2223
TV
α=30
15.811
0.0758
HTV
α=80
16.022
0.0740
Hybrid TV
α=40
16.323
0.0718
Example 3
Tikhonov
α=400
6.924
0.4369
TV
α=50
13.675
0.2007
HTV
α=15
11.566
0.2559
Hybrid TV
α=70
14.912
0.1690
The “Cameraman” image is degraded by the Gaussian blur and Poisson noise.
True image
Degraded image
Tikhonov
TV
HTV
Hybrid TV
Comparison of a small portion of the restored images and SSIM maps for Example 1.
True
Degraded
Tikhonov
TV
HTV
Hybrid TV
Tikhonov
TV
HTV
Hybrid TV
Moffat blur is considered in the second example. It is known that the PSF of an astronomical telescope is often modeled by the Moffat function. The 256×256 “Lena” image shown in Figure 3(a) is degraded by the Moffat blur psfMoffat (5,2,5) proposed in [50] with b=10 and the Poisson noise. The information of restored images by the four methods is displayed in Figures 3(c)–3(f). From the visual quality of restored images, the proposed regularization method is better than the other three methods. In Figures 4(c)–4(f), we display the zoom parts of the restored images (the part shown as the white rectangle in Figure 3(a)). From Figures 4(c)–4(f), we see that the restored image obtained by our method has more details than those by the other methods. The comparison of SSIM maps shown in Figures 4(g)–4(j) also proves that our method can get better results. We report the SNR and RelErr values in Table 2. From the table, we know that our method behaves much better.
The “Barbara” image is degraded by the Moffat blur and Poisson noise.
True image
Degraded image
Tikhonov
TV
HTV
Hybrid TV
Comparison of a small portion of the restored images and SSIM maps for Example 2.
True
Degraded
Tikhonov
TV
HTV
Hybrid TV
Tikhonov
TV
HTV
Hybrid TV
In the third example, the 256×256 original astronomical object shown in Figure 5(a) is degraded by the given PSF in Figure 5(b) and the Poisson noise. The degraded image is displayed in Figure 5(c). The relative error between the noisy image and the original image is 0.3150.
Results of different methods for Example 3.
True image
PSF
Degraded image
Theta
Tikhonov
TV
HTV
Hybrid TV
In Figures 5(e)–5(h), we show the restored images by the four different methods. From these figures, we observe that the restored image by our model is more better than the other models in terms of the staircase effect and edge preservation. In addition, we plot the choice of θ in Figure 5(d). From the figure, we see that only small jumps are suppressed with the second-order regularization. The SNRs and relative errors are reported in Table 2. The SNR by our method is higher than those by the other methods, and the relative error by our method is smaller than those by the other methods. From these figures and Table 2, we observe that the proposed method outperforms the tikhonov regularization method, the TV regularization method, and the high TV regularization method.
5. Conclusions
In this paper, we propose a new variational model to restore blurred images corrupted by Poisson noise. Based on the good feature of high-order functional, we propose a model by adding an extra high-order functional term in the total variation model. Our model combines advantages of the first-order and second-order total variation. It can substantially reduce the staircase effect, while preserving edges in the restored images. The issues of existence and uniqueness of a minimizer for this variational model is discussed. At last, we employ a gradient descent method to solve the associated Euler-Lagrange equation. The numerical experiments show that the proposed method outperforms some existing restoration methods in terms of the SNR, relative error, and SSIM map for Poisson noise removal problem. The comparisons between the reconstructed images obtained by the four methods show that the proposed one can alleviate the staircase effect significantly while preserve edges.
Conflict of Interests
All of the coauthors do not have a direct financial relation with the trademarks mentioned in our paper that might lead to a conflict of interests for any of the coauthors.
Acknowledgment
L. Jiang and J. Huang are supported by NSFC (10871034), X.-G. Lv and J. Liu are supported by NSFC (60973015 and 61170311), Sichuan Province Sci. & Tech. Research Project (2011JY0002 and 12ZC1802), and Chinese Universities Specialized Research Fund for the Doctoral Program (20110185110020).
AndrewH.HuntB.1977Englewood Cliffs, NJ, USAPrentice HallBerteroM.BoccacciP.1998London, UKInstitute of Physics Publishing10.1887/0750304359MR1640759ZBL0924.65136ChanT. F.ShenJ.2005Philadelphia, Pa, USASIAM10.1137/1.9780898717877MR2143289ZBL1250.97004BanhamM.KatsaggelosA.Digital image restoration19971422441RudinL.OsherS.FatemiE.Nonlinear total variation based noise removal algorithms1992601–425926810.1016/0167-2789(92)90242-FChambolleA.LionsP. L.Image recovery via total variation minimization and related problems199776216718810.1007/s002110050258MR1440119ZBL0874.68299RudinL.LionsP. L.OsherS.OsherS.ParagiosN.Multiplicative denoising and deblurring: theory and algorithms2003New York, NY, USASpringer10311910.1007/0-387-21810-6_6MR2070067AubertG.AujolJ. F.A variational approach to removing multiplicative noise200868492594610.1137/060671814MR2390974ZBL1151.68713HuangY. M.NgM. K.WenY. W.A new total variation method for multiplicative noise removal200921204010.1137/080712593MR2486520ChenB.CaiJ. L.ChenW. S.LiY.A multiplicative noise removal approach based on partial differential equation model2012201214242043MR292894110.1155/2012/242043CorreiaS.CarbilletM.BoccacciP.BerteroM.FiniL.Restoration of interferometric images—I. The software package AIRY2002387273374310.1051/0004-6361:20020370ChambolleA.An algorithm for total variation minimization and applications2004201-2899710.1023/B:JMIV.0000011320.81911.38MR2049783ChanT.EsedogluS.ParkF.Image decomposition combining staircase reduction and texture extraction200718646448610.1016/j.jvcir.2006.12.004BeckerS.BobinJ.CandèsE. J.NESTA: a fast and accurate first-order method for sparse recovery20114113910.1137/090756855MR2765668ZBL1209.90265BeckA.TeboulleM.Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems200918112419243410.1109/TIP.2009.2028250MR2722312WangY. L.YangJ. F.YinW. T.ZhangY.A new alternating minimization algorithm for total variation image reconstruction20081324827210.1137/080724265MR2486032ZBL1187.68665Bioucas-DiasJ. M.FigueiredoM. A. T.Multiplicative noise removal using variable splitting and constrained optimization20101971720173010.1109/TIP.2010.2045029MR2790463YunS.WooH.A new multiplicative denoising variational model based on mth root transformation20122152523253310.1109/TIP.2012.2185942MR2952118WooH.YunS.Alternating minimization algorithm for speckle reduction with a shifting technique20122141701171410.1109/TIP.2011.2176345MR2959482BerteroM.BoccacciP.DesideràG.VicidominiG.Image deblurring with Poisson data: from cells to galaxies200925122612300610.1088/0266-5611/25/12/123006MR2565572ZBL1186.85001BardsleyJ. M.LuttmanA.Total variation-penalized Poisson likelihood estimation for ill-posed problems2009311-3355910.1007/s10444-008-9081-8MR2511573ZBL1171.94001FigueiredoM. A. T.Bioucas-DiasJ. M.Restoration of Poissonian images using alternating direction optimization201019123133314510.1109/TIP.2010.2053941MR2789706SetzerS.SteidlG.TeuberT.Deblurring Poissonian images by split Bregman techniques201021319319910.1016/j.jvcir.2009.10.006ChenD. Q.ChengL. Z.Deconvolving Poissonian images by a novel hybrid variational model201122764365210.1016/j.jvcir.2011.07.007CsiszárI.Why least squares and maximum entropy? An axiomatic approach to inference for linear inverse problems19911942032206610.1214/aos/1176348385MR1135163ZBL0753.62003BardsleyJ. M.GoldesJ.Techniques for regularization parameter and hyper-parameter selection in PET and SPECT imaging201119226728010.1080/17415977.2010.550048MR2783573ZBL1217.62092BardsleyJ. M.GoldesJ.Regularization parameter selection methods for ill-posed Poisson maximum likelihood estimation20092591809500510.1088/0266-5611/25/9/095005MR2540885ZBL1176.68225ChenD. Q.ChengL. Z.Spatially adapted regularization parameter selection based on the local discrepancy function for Poissonian image deblurring20122812401500410.1088/0266-5611/28/1/015004MR2864509ZBL1252.68329LandiG.PiccolominiE. L.NPTool: a Matlab software for nonnegative image restoration with Newton projection methods201210.1007/s11075-012-9602-xTikhonovA.ArseninV.1977Washington, DC, USAWinstonLandiG.PiccolominiE. L.An improved Newton projection method for nonnegative deblurring of Poisson-corrupted images with Tikhonov regularization201260116918810.1007/s11075-011-9517-yMR2903975ZBL1241.65059BardsleyJ. M.VogelC. R.A nonnegatively constrained convex programming method for image reconstruction2003/042541326134310.1137/S1064827502410451MR2045059BardsleyJ. M.LaobeulN.Tikhonov regularized Poisson likelihood estimation: theoretical justification and a computational method200816219921510.1080/17415970701404235MR2408505RichardsonW. H.Bayesan-based iterative methods of image restoration1972621555910.1364/JOSA.62.000055LucyL. B.An iterative technique for the rectification of observed images19747974575410.1086/111605AgarwalV.GribokA. V.AbidiM. A.Image restoration using L1 norm penalty function200715878580910.1080/17415970600971987MR2374286LandiG.PiccolominiE. L.An efficient method for nonnegatively constrained total variation-based denoising of medical images corrupted by Poisson noise2012361384610.1016/j.compmedimag.2011.07.002LefkimmiatisS.BourquardA.UnserM.Hessian-based norm regularization for image restoration with biomedical applications201221398399510.1109/TIP.2011.2168232MR2951273LiF.ShenC. M.FanJ. S.ShenC. L.Image restoration combining a total variational filter and a fourth-order filter200718432233010.1016/j.jvcir.2007.04.005LyskerM.TaiX. C.Iterative image restoration combining total varition minimization and a second-order functional200666151810.1007/s11263-005-3219-7PapafitsorosK.SchönliebC. B.A combined first and second order variational approach for image reconstructionhttp://arxiv.org/abs/1202.6341ChanT.MarquinaA.MuletP.High-order total variation-based image restoration200022250351610.1137/S1064827598344169MR1780611ZBL0968.68175LysakerM.LundervoldA.TaiX. C.Noise removal using fourth-order partial differential equation with applications to medical magnetic resonance images in space and time2003121215791590SteidlG.A note on the dual treatment of higher-order regularization functionals2006761-213514810.1007/s00607-005-0129-zMR2174675ZBL1087.65067ChenH. Z.SongJ. P.TaiX. C.A dual algorithm for minimization of the LLT model2009311–311513010.1007/s10444-008-9097-0MR2511576ZBL1170.94006LeT.ChartrandR.AsakiT. J.A variational approach to reconstructing images corrupted by Poisson noise200727325726310.1007/s10851-007-0652-yMR2325852ZhouW. F.LiQ. G.Poisson noise removal scheme based on fourth-order PDE by alternating minimization algorithm201220121496528110.1155/2012/965281MR2889091WangZ.BovikA. C.SheikhH. R.SimoncelliE. P.Image quality assessment: from error visibility to structural similarity200413460061210.1109/TIP.2003.819861NagyJ. G.PalmerK.PerroneL.Iterative methods for image deblurring: a Matlab object-oriented approach2004361739310.1023/B:NUMA.0000027762.08431.64MR2063574ZBL1048.65039HansenP. C.NagyJ. G.O'LearyD. P.20063Philadelphia, Pa, USASIAMFundamentals of Algorithms10.1137/1.9780898718874MR2271138