The Restoration of Textured Images Using Fractional-Order Regularization

Image restoration problem is ill-posed, somost image restoration algorithms exploit sparse prior in gradient domain to regularize it to yield high-quality results, reconstructing an image with piecewise smooth characteristics. While sparse gradient prior has good performance in noise removal and edge preservation, it also tends to remove midfrequency component such as texture. In this paper, we introduce the sparse prior in fractional-order gradient domain as texture-preserving strategy to restore textured images degraded by blur and/or noise. And we solve the unknown variables in the proposed model using method based on half-quadratic splitting by minimizing the nonconvex energy functional. Numerical experiments show our algorithm’s robust outperformance.


Introduction
Mathematically, the image degradation is modeled as where x is the original latent image and y is an observed image degraded by blur and/or noise, which is produced by convolving x with a blur point-spread-function (a.k.a.kernel) h and adding zero mean Gaussian noise n.Image restoration is recovering latent image from observed image.Image restoration is ill-posed problem, so many methods introducing priors based on natural image statistics can regularize it.Total variation regularization is originally used for noise reduction [1,2] and has also been used for image deblurring [3].Chan and Wong [4] introduced total variational blind deconvolution method for motion blur kernel and out-of-focus kernel.Heavy-tailed natural image priors [5,6] and hyper-Laplacian priors [7][8][9][10] were also extensively introduced.Numerous regularization approaches have been proposed too.Wang et al. [7] presented a fast total variation deconvolution algorithm to compute TV image deconvolution.Krishnan and Fergus [8] take a novel approach to the image restoration problem arising from the use of a hyper-Laplacian prior.Xu and Jia [11] developed a fast TV- 1 deconvolution method based on half-quadratic splitting.
While image reconstructed by algorithms above suppresses noise and preserve edges, it has piecewise smooth characteristic that the mid-frequency components such as textures are removed too.
In digital images, the gray values between neighboring pixels have high correlation.This highly self-similar fractal information of image fractal information is usually represented by complex textural features, and the works in [12][13][14][15][16][17][18] showed that fractional-order gradient is more suitable to deal with fractal-like textures.It has been proved in [12] that the fractional-order derivative satisfies the lateral inhibition principle of biologic visual system better than the integerorder derivative.The fractional-order derivative operators have been used in texture enhancement [13], image denoising [14,15], and image inpainting [16,17].Jun and Zhihui [14] replaced the first-order derivative in the regularized term of ROF model with the fractional-order derivative.Bai and Feng [15] designed fractional-order anisotropic diffusion equation to remove noise.Zhang et al. [16] exploited fractional-order TV sinogram inpainting model to reduce metal artifacts for X-ray computed tomography.In [18], fractional total variation method was introduced to restore textured image.This work shows that the fractional-order derivative not only nonlinearly preserves the textural details but also eliminates the staircase effect caused by low integral-order derivative in image processing.Different from work in [18], the sparse prior in fractional-order gradient domain is considered in our work, which is more suitable for the texture of image.It is explained clearly in Figures 2 and 3.
This paper presents fractional-order regularization for the restoration of textured image degraded by blur and/or additive noise.R. Tony uses the Laplacian prior in fractional-order gradient domain for  = 1 to preserve the texture.According to our analysis in the next section, hyper-Laplacian image prior in fractional-order gradient domain for 0 <  ≤ 1 is more suitable to keep different texture for different texture image.
The outline of this paper is as follows.In Section 2, we analyze the reason why integral-order regularization fails to restore image texture.In Section 3, our fractional-order regularization model is proposed and based on half-quadratic splitting, we solve model using efficient alternating minimization method.Numerical experiments and comments are provided in Section 4 and the paper is concluded in Section 5.

Motivation
The prior (x) favors natural image, usually based on the observation that their heavy-tailed gradient distribution is sparse.For example, Figure 1 shows textured image and a histogram of its gradient magnitudes in x-direction and ydirection, respectively.The distribution shows that the image Mathematical Problems in Engineering contains primarily small or zero gradients, but a few gradients have large magnitudes.A common measure [19] where  , (x) and  , (x) denote the horizontal and vertical The image restoration methods use the sparse prior term as a regularized term of variational energy functional [19], which is The failure of restoring texture with the sparse gradient prior depends on the fact that the value of energy does not always decrease during restoration process, so the no-blur explanation is usually favored.To understand this, consider the 1D signals in Figure 2.
For sharp edge in Figure 2(a), while Gaussian prior favors the blurry explanation, the sparse prior ( < 1) favors the correct sharp explanation in Figure 2 in Figure 2(c) illustrates that natural image contains a lot of medium contrast textures, which dominate the statistics more than step edges.As a result, blurring natural image reduces the overall contrast which cannot be restored by Gaussian prior or even sparse priors as in Figure 2(d).
The reason is that the gradient profile in fractal-like textures is close to Gaussian distribution and these small values are severely penalized by the sparse gradient prior.
A fractional-order gradient log distribution can be expressed as follows [18]: where  V , x and  V , x denote the horizontal and vertical fractional-order derivatives at pixel  and V is the fractional order V ∈ (0, 4].The exponent value is the same as  value in (2).
Compared with result in Figure 3(b), the sharp explanation in Figure 3(c) is favored by sparse prior even by Gaussian prior in fractional-order gradient domain.

The Proposed Model and Algorithm
The corresponding energy functional is as follows [18]: where  is the pixel index and ⊗ is the 2-dimensional convolution operator, and a weighting term  = 3 3 controls the strength of the regularization. V , x and  V , x denote the horizontal and vertical fractional-order derivatives at pixel  defined by our coauthor as Tables 1 and 2 [16].
The coefficients of the operator in Tables 1 and 2 are . . .
Equation ( 5) contains nonlinear penalties for regularization term, so we propose alternating minimization (AM) method, based on a half-quadratic splitting to solve it [18,20].We introduce auxiliary variables  and w = (  ,   ) at each pixel, so the energy functional in ( 5) can be modified as min where the first two terms are used to ensure the similarity between the measures and the corresponding auxiliary variables.As  → ∞ and  → ∞ the solution of ( 6) converges to that of (5).Equation ( 7) can be solved by AM method through fixing other variables to solve x, w, and  independently.)) .
The optimal x is where Hx = h ⊗ x.According to Parseval's theorem after the Fourier transform, (8) has the closed form solution in minimization, which enables us to find the optimal x directly: ) , where (⋅) and (⋅) −1 denote the fast Fourier transform and inverse fast Fourier transform, respectively.* is the complex conjugate operator.

𝑢 Subsolution.
Here,  and w belong to different terms.They are not coupled with each other in the functional, so their optimization is independent.Given fixed value of x, we compute  by minimizing According to shrinkage formula [21], the optimal  is ) .

(13)
Input: observed image y, PSF h, penalty parameters , exponent  and fractional-order V Input:  0 ,  Max ,  0 ,  Max Initialize x = y,  =  0 ,  =  0 while  <  Max , do solve for  using (12) while  <  Max do Given x, solve for w according to our discussion Given w, solve for x using (10)  = 2 end while  = 2 end while Output: Estimated image x Algorithm 1: Fractional-order regularization.For  = 2 case, the subproblem about   and   is quadratic.
For  = 1 case, the optimal solution for   and   can be derived by shrinkage formula too: For the other  case, setting the derivative of ( 13) with regard to   and   to zero gives Two special  cases are discussed here.
For  = 1/2 case, about   , (15) becomes Because  V  x is fixed and   lies between 0 and  V  x, we can replace sign(  ) with sign( V  x).Equation ( 17) can be rewritten as The value of   and   is either 0 or the root of cubic polynomial in (19).
For  = 2/3 case, we can get the quartic polynomials about   and   : The value of   and   is either 0 or the root of cubic polynomial in (20).
Given the roots of cubic and quartic polynomials and zero solution, we need to determine which one corresponds to the global minima of (12), which can be confirmed by the following scheme.
Let  be the nonzero real root.If 0 value is the optimum solution of (13), for  V  x, this implies We can use (15) to eliminate sign()|| (−1) from ( 15) and ( 22), yielding the condition since sign() = sign( V  x).So   =  if  is between 2 V  x/3 and  V  x in the  = 1/2 case or between  V  x/2 and  V  x in the  = 2/3 case.Otherwise,   = 0.The same scheme applies to  V  x.
For other  cases,   and   can be computed by Newton method.
3.4.Algorithm. and  are positive values to enforce the similarity between the auxiliary variables and the respective terms.We empirically set  0 = 1,  Max = 256 and  0 = 1,  Max = .
The algorithm of this fractional-order regularization model is shown in Algorithm 1.

Numerical Experiments
We consider the restoration of a blur-and noisecontaminated test image represented by 255 × 255 pixels.In order to compare the accuracy of FOR (fractional order regularization) and IOR (integer order regularization) more precisely, we list in Table 3 the peak signal-to-noise ratio (PSNR) and gray-scale structural similarity (SSIM) as quality metric.PSNR is most easily defined via the mean squared error (MSE).Given a noise-free  by  image  and its noisy approximation Î, MSE is defined as PSNR is defined as and SSIM is defined as where  and  are different images,   and   are the average of  and , respectively,  2  and  2  are the variance of  and , respectively, and   is the covariance of  and . 1 and  2 are constant.
The desired blur-and noise-free image is depicted in Figure 4.The image is contaminated by motion blur generated by Matlab function (fspecial("motion",10,20)).The resulting image is displayed in Figure 4(f).In Table 3 the second column, with header PSNR and SSIM values for images that have been corrupted by motion blur, is characterized by V = 0.4 and  = 0.3.
The desired blur-and noise-contaminated image is depicted in Figure 5.The image is contaminated by motion blur, adding white Gaussian noise (its standard variance is 0.003).The resulting image is displayed in Figure 5(d).In Table 3 the third column, with header PSNR and SSIM values for images that have been corrupted by motion blur, is characterized by V = 1.8 and  = 0.4.
Figure 6 shows the result of deconvolving a real blurry image.We estimate the blur kernel using the algorithm in [9].Again, textured regions are better reconstructed using our method in visual quality.

Conclusion
By introducing sparse prior in fractional-order gradient domain, we propose a fractional-order regularization method for the restoration of textured image degraded by blur and/or noise.The regularizer is constructed by using fractionalorder derivatives, where the choice of the fractional-order is driven by different textured image.This makes the proposed model an efficient tool to preserve texture well.Numerical results show that the proposed model yields better SSIM and PSNR value and visual effects than using integral-order regularization method.
Our following work is to use an automatic texture detection procedure for textured image restoration.Different parameters are applied for different textures.

2 MathematicalFigure 1 :
Figure 1: (a) A textured image.(b) The -direction log distribution of gradient magnitudes.(c) The -direction log distribution of gradient magnitudes.

Figure 3 :
Figure 3: Analysis of restoration on 1D signal: (a) sharp versus blurred signal; (b) sum of gradients − log (x) = ∑  |  (x)|  as a function of ; (c) sum of gradients − log (x) = ∑  | V  (x)|  as a function of  (the value of V is 0.3).

Figure 5 :
Figure 5: Deblurring and denoising: (a) clear image; (b) synthesized blurred image and adding white Gaussian noise (its standard variance is 0.003); (c) image restoration by IOR; (d) image restoration by FOR.

Figure 6 :
Figure 6: Testing our algorithm with real-life blurry images.(a) Blurry image.(b) Restored image by using the algorithm in [9].(c) Restored image by our algorithm.(d) Comparison of details of image window.Left: details in (a), middle: details in (b), and right: details in (c).
Figure 6(b) is restored by total variation.Figure 6(c) is restored by fractional-order total variation.Figure 6(d) shows the details in Figure 6(b) and Figure 6(c).

Table 1 :
Operator of -direction:  V  x.

Table 2 :
Operator of -direction:  V  x.

Table 3 :
PSNR and SSIM of image restoration by IOR and FOR.So we can get the cubic polynomials about   and   :