We propose a residual-based method for denoising images corrupted by Gaussian noise. In the method, by combining bilateral filter and structure adaptive kernel filter together with the use of the image residuals, the noise is suppressed efficiently while the fine features, such as edges, of the images are well preserved. Our experimental results show that, in comparison with several traditional filters and state-of-the-art denoising methods, the proposed method can improve the quality of the restored images significantly.
1. Introduction
In image processing, noise reduction with preserving fine features is a long-standing research problem. Many applications such as image segmentation and medical image analysis require effective noise suppression to obtain reliable results. In recent years, many efficient mathematical methods such as kernel regression based methods and locally adaptive based methods for the purpose of image denoising have been developed in the literature (see [1–10] and the references cited therein). For example, Tomasi and Manduchi proposed the well-known bilateral filtering for image filtering in [1], which exploits the local structural patterns to regularize the image filtering procedure and assume that images are locally smooth except at edges. The bilateral filter can preserve certain details of images, while more information inherent in the image still remains to be discovered and utilized. Tschumperlé [2] proposed a common framework for image filtering which is based on the iterative local diffusion in the image guided by the local structure tensor. The method makes use of the local gradients of the image to control the shape of the kernel and hence to keep texture details of the image efficiently. However, for a very noisy image, the gradients of the image are likely to be corrupted by the noise and thus might raise huge errors in terms of gradient estimator in smooth areas, which might generate negatively “ripple” phenomena. To overcome the drawbacks mentioned above, Takeda et al. [3] further proposed an iterative steering kernel regression filter, of which an iterative filtering procedure is used to exploit the output (less noisy) image of each iteration to improve the local orientation estimates used in the kernel in the next iteration. The implementation of the method is very time-consuming, even exceeding that of nonlocal methods [11, 12]; and it shows instability in estimating the local gradients of the image under high-level noisy case. López-Rubio and Florentín-Núñez [4] proposed to adopt a general kernel regression framework to 3D MR image denoising. The method is rooted on a zeroth-order 3D kernel regression, which calculates a weighted average of the pixels over a regression window; and the weights are obtained from the similarities among small sized feature vectors associated to each pixel. One common feature for these kernel regression methods is the exploration of the local structural regularity properties in natural images/videos. Based on this observation, the kernel regression based methods (or combined with other methods) are also successfully applied to image and video deblurring, upscaling, interpolation, fusion [3], superresolution [6, 13–16], registration [17], JPEG image deblocking [18], and so forth. On the other hand, the residual-based image denoising methods have also been studied. For instance, in [19], the corrupted image was first denoised with the total variation minimization algorithm; then the residual image was denoised with the adaptive Wiener filter; and finally, based on a statistical test, the filtered residuals were added back to the denoised image. Similarly, in [20], the authors first adopted nonlocal means filter to denoise the degraded image and added the final filtered residual image to the denoised image to recover the lost image details. In [21], the image denoising was implemented in the wavelet transform domain. In the method, based on the kurtosis statistic of the residual image, a criterion was proposed for determining wavelet coefficient thresholds.
In this paper, different from the residual-based methods in [19–21], we propose a new residual-based denoising method, which combines the bilateral filter and the local structure adaptive kernel filter by making use of their respective advantages. The proposed method can prevent the fine details loss caused by the bilateral kernel regression method and avoid image ripple phenomena produced from the local structure adaptive kernel method. Numerical experiments demonstrate that, for images contaminated with Gaussian noise, the performance of our combined approach is generally superior to those of some traditional and state-of-the-art restoration methods in terms of the image quality measured by PSNR and SSIM [22].
2. Classic Kernel Regression Methods
In this section, we briefly review bilateral kernel and structural adaptive kernel methods which will be used in the development of our new method later.
Classical regression methods for image processing rely on a specific model of the signal of interest and calculate the parameters of the model in the presence of noise. Compared to the parametric methods, kernel regression methods [23, 24] rely on the data itself to dominate the structure of the model. Generally, the traditional kernel regression methods are based on solving the following optimization problem: (1)y~x=argminβ0∑j∈Nxyj-β02Kxj-x,where N(x) is a set that consists of the index numbers of the neighbors of x; yj is the pixel observation at xj; y~(x) denotes the estimate of the pixel at location x of the image. K(xj-x) is a generic kernel (e.g., Gaussian, exponential, or other forms) which is used as the penalty for distance between xj and x, so that the influence of x on xj decreases as the distance between these two points increases. Considering β0 as the first coefficient of some regression function on the coordinates x, (1) is essentially a zero-order estimation. In order to approximate the image local structure better, higher order estimation was used in [3, 25]. Specifically, assuming that the image is locally smooth to some order, we can relay on the local expansion of the function using the Taylor series (2)yxi=β0+β1⊤xi-x+β2⊤trilxi-xxi-x⊤+⋯,where tril denotes the operator that extracts the lower triangular part of a matrix and stacks it to a column vector. Then, the optimal regression coefficients {βk}k=0N can be calculated from the following optimization problem: (3)βkk=0N=argminβk∑j∈Nxyj-β0-β1⊤xj-x-β2⊤trilxj-xxj-x⊤-⋯Kxj-x.Although all regression coefficients {βk}k=0N can be estimated effectively, the first element β0 is the desired pixel value estimation at x. For the details of computing β0, one can refer to [3, 23, 24].
As mentioned above, the traditional kernel methods simply take the distance of the pixels into consideration. That is, large weight is assigned to nearby pixels, while smaller weights are assigned to farther pixels. This may lead to obscurity of the image, especially on the edges. To relieve the problem, Tomasi and Manduchi [1] proposed the bilateral filter as solving the following optimization problem: (4)y~x=argminβ0∑j∈Nxyj-β02Kxj-x,yj-y,where K(xj-x,yj-y)=K1(xj-x)·K2(yj-y). Here, the kernel functions K1 and K2 are used for penalizing the spatial distance between the pixel of interest x and its neighbors {xj} and the radiometric “distance” between the corresponding pixels y and {yj}. The main idea of bilateral kernel is that, when calculating weights, it considers both the pixel distance and space distance between the points at x and xj. Then, due to considerable variation of the pixel values around the image edges, the values of the associated weights K2 are relatively small, which contributes to preserving the edges of the image. In addition, the generalizations of the bilateral filter, including the choices of various kernels and higher order estimation, were reported in [10, 26, 27].
Although the bilateral filter can solve the indistinction problem of image margins to some extent, only distance information of the pixels is used, which might make a loss of details in the textures of image margins. Tschumperlé [2] further proposed to utilize correlation information of pixels to estimate the local directions of the image. And he constructed a local structure adaptive kernel as follows: (5)Kx=12πδ2detT·exp-12δ2x⊤T-1x,where T is the diffusion tensor controlling the spatial structure of the kernel and δ is the parameter that controls the bandwidth of the structural kernel. In order to obtain T, we construct a structure tensor, which can be defined as follows: (6)Sx=∑j∈Nxwxj-xdxxj2∑j∈Nxwxj-xdxxjdyxj∑j∈Nxwxj-xdxxjdyxj∑j∈Nxwxj-xdyxj2,where w(·) is a Gaussian kernel and dx(x) and dy(x) are the x-gradient and y-gradient at coordinates x, respectively. Here we use Prewitt operator [23, 24] to estimate the gradient. After performing eigenvalue decomposition on S(x), we get (7)Sx=uvα100α2u⊤v⊤,where α1,α2 are the eigenvalues of S(x) with α1≤α2≠0, reflecting the strength of the gradient along each eigenvector direction and u and v are the eigenvectors of S(x). According to methods for finding diffusion tensor described in [2, 24], we set (8)T=fuu⊤+1fvv⊤,where (9)f=α2+γα1+γ.Here, γ≥0 is a sensible parameter so that the shape of the local structure adaptive kernel will respond to the local gradient of the image.
3. A Residual-Based Joint Denoising Method
Bilateral filter and structure adaptive denoising methods described above can restore the noisy images efficiently. For example, the original noise-free image “Lena” shown in Figure 1(a) is degraded by an additive white Gaussian noise with noise variances σ2=202, as shown in Figure 2(a). We test the two methods on the Noisy “Lena" image, respectively. As we can see, the bilateral filter with PSNR = 27.56 dB, SSIM = 0.86 and the structure adaptive denoising method with PSNR = 30.20 dB, SSIM = 0.84 exhibit acceptable image quality as shown in Figures 2(b) and 2(c), respectively. On the other hand, as shown in the figure, the bilateral filter can smooth the Noisy “Lena” efficiently but erase certain details of the image in the meanwhile; and the local self-adaptive method can deliver the fine features, such edges, of the image, whereas it might generate image ripples caused by noise in the smooth area. Based on this observation, we here propose a new method, that is, a residual feedback-based joint image denoising method using bilateral filter and structure adaptive methods.
Four test images.
Lena
Pirate
Boat
House
Comparison of the three denoising methods: (a) noise image with σ=20, (b) bilateral filter, (c) structure adaptive filter, and (d) the proposed method.
Firstly, we define an image residual model as follows: (10)ϵ^i=gxi-yxi,i=1,…,M,where g(xi) is the pixel value at point xi of the noisy image with M pixels; y(xi) is the pixel value at point xi of the denoised image; and ϵ^i is the estimate of the location disturbance of xi, namely, image residual. We assume that image residual ϵ^i still obeys Gaussian distribution with mean of 0 and a low-level variance; that is, (11)Eϵ^i=0,i=1,…,M.We next define a criterion for testing image residual as follows: (12)Gxi=∑j∈Nh1xiϵ^j,i=1,…,M, where Nh1(xi) denotes a neighbor of xi with the radius being h1. As the expectation of image disturbance is 0, the criterion G(·) should not be too large or too small in a flat area. Thus we can tag abnormal points by (13)I1xi=1,Gxi<θ1 or Gxi>θ20,otherwise,where θ is a preprescribed value, used as an indicator of the toughness of tagging. As an example, the image residual ϵ between Figures 2(a) and 2(b) is shown in Figure 3(a) and I1 shown in Figure 3(b) is obtained by using (13). From Figure 3(b), we can see that the details are tagged to some extent, but the noise still remains. So, for a tagged residual figure I1(xi), we need to “filter” it a second time. Define (14)I2xi=1,∑t∈Nh2xiI1t>β1,I1xi=1,0,otherwise.Here, similarly to Nh1(xi), Nh2(xi) is a neighbor of xi and h2 is its radius; and β1 is a preselected threshold. The main idea of designing I2 in (14) is based on the fact that the useful information, such as edges, in the residual tagged image I1(x) tends to be clustered while the noise-tags distribute randomly in the image I1(x). Thus we can determine whether a given pixel, say xi, is informative or noisy by simply calculating I2(xi). As shown in Figure 3(c), the noise scattered in the tagged image has been eliminated visibly after the second filtering process. In addition, it is worth noting that there exist some interrupted points in image I2(x), which might result from the fact that some useful and informative areas are covered by the noise. So, we further expand the tagged information by linking those unconnected abutting areas with following function: (15)I3xi=1,∑t∈Nh3xiI2t>β2 or I2xi=1,0,otherwise.After the operation using I3, we get a binary image shown as in Figure 3(d), which just tags useful information, such as edges, and meaningless noise has been eliminated clearly.
Tagging procedure of bilateral filter.
According to the analysis described above, I3 can clearly indicate the indistinct margins caused by bilateral denoising. On the other hand, as discussed in Section 2, the structure adaptive kernel based methods can protect fine features, such as edges, of an image as well as possible. So, we can avoid the appearance of indistinct margins and ripples in the restored image by combining the favorite properties of these two methods. Detailedly, let y1 and y2 be the images denoised by using structure adaptive kernel method and bilateral filter, respectively. Then the resulting image y3 can be formulated as follows: (16)y3x=I3xy1x+1-I3xy2x.It is worth noting that in order to get y3, instead of filtering the whole noisy image to obtain y1 by structure adaptive kernel method, we only need to get some parts of y1 by filtering those pixels satisfying the first restriction in (15), which can reduce the computation complexity greatly. In addition, in order to erase those image edges caused by splicing, a smoothing formula is defined as (17)I3′xi=0.3,∑t∈N2xiI3t≠#N2xi,I3xi=1,I3xi,otherwise,where #A denotes the number of elements of set A. Thus we can replace I3′ with I3 in (16) to gain a smoothed splicing image.
In summary, the main steps of our proposed method are as follows:
Restore the noisy image g by bilateral filter and get the restored image y2.
Calculate the residual ϵ^ by (10).
Compute I3′ by (13), (14), (15), and (17).
Apply structure adaptive method to denoise those pixels xi of the noisy image g satisfying the first restriction of (15) and get y1.
Get the restored image y3 by(18)y3x=I3′xy1x+1-I3′xy2x.
Figure 2(d) illustrates the restored “Lena” image by using our proposed method. This image has PSNR = 31.65 dB and SSIM = 0.92. As we can see, the proposed method performs remarkably better than the bilateral filter and structure adaptive kernel method. Furthermore, the execution time of our proposed method with 55.16 seconds is much faster than that of the structure adaptive kernel method with 78.12 seconds. This can be explained by the fact that our proposed method only performs structure filter on tagged points indicated by I3, instead of the whole image, leading to decrease of the computation complexity.
4. Numerical Experiments
In this section, we present numerical results on simulated and read data to demonstrate the performance of the proposed method and compare it with several traditional methods and some existing state-of-the-art methods, which include bilateral filter, structure adaptive kernel method described in the previous Section 2, Wiener filter [28], Kuwahara filter [29], nonlinear complex diffusion (NCD) processes [30], BiShrink [31], NeighShrinkSURE [32], OWT-SURELET [33], FP2O-ITV [34], and BM3D [35]. We note that all algorithms are implemented by using MATLAB (version 7.10) and preformed on Windows 7 with CPU E3V2 3.3 GHz and 8 GB memory. The denoising image quality is measured by Peak Signal-to-Noise Ratio (PSNR) defined by (19)PSNR=10log1025521/N∑i=1Nfi-f^i2,where fi and f^i are the pixel intensity of the original image and the retrieved image, respectively. N denotes the total number of pixels. Moreover, we here also use the Structural SIMilarity (SSIM) Index introduced by [22] to measure the similarity between the original image f and the restored image f^.
Note that in this paper we use Gaussian type kernel functions in the three kernel based methods. For parameters in bilateral filter, corresponding to K1 and K2, we choose δ1=δ2=3 and the window size h=4; for structure adaptive kernel method, we choose δ=3, h=5; and for our proposed joint method, we choose h1=3 in (12), θ1 and θ2, respectively, being 15% quantile and 85% quantile of the residuals in the set Nh1(·) in (13), ρ1=ρ2=15 in (14) and (15), and h1=h2=h3=3 in all the three equations. For the other test denoising methods, we experimentally select the parameters according to the suggestions discussed in the literature. For example, in the Wiener filter [28] and Kuwahara filter [29], we set the window size being 6×6 and 5×5, respectively; in the BiShrink [31], we use the separable discrete wavelet transform with Daubechies’ least asymmetric compactly supported wavelet with eight vanishing moments with four scales; also in the NeighShrinkSURE [32] and OWT-SURELET [33] methods, the wavelet type used in the method is “sym8” with the number of wavelet decomposition levels equal to four, and we assume that the noise variances were known; in the algorithm FP2O-ITV [34], we fix μ=1/0.05 and λ=0.25 for convenience.
We first choose the 512×512 standard test images, “Lena,” “Pirate,” “Boat,” and “House” shown as in Figure 1, in our experiments. They were contaminated by the Gaussian random noise with standard deviation varying from σ=20 to σ=40 and the step size being 5. As we can see from Table 1, when the quality of the restored images is measured by PSNR and SSIM, the proposed method significantly performs better than the traditional methods, bilateral filer, structure adaptive kernel method, Wiener filter, and Kuwahara filter; and it generally outperforms the NCD, BiShrink, and FP2O-ITV, especially for high-level noisy cases (e.g., σ≥30). When compared with NeighShrinkSURE and OWT-SURELET methods, it is also promising. In addition, when only focusing on the SSIM-values of the table, our proposed method possesses particularly favorable results in comparison with all others except BM3D, which can be explained by the fact that the proposed method inherits the advantages of the bilateral filter and the local structure adaptive kernel filter, coinciding with our aforementioned analysis in Section 3. Note that the performance of BM3D nonlocal method is superior to all the other methods.
A comparison of different denosing methods.
Image
Method
σ=20
σ=25
σ=30
σ=35
σ=40
PSNR
SSIM
PSNR
SSIM
PSNR
SSIM
PSNR
SSIM
PSNR
SSIM
Lena
BF
27.56
0.86
27.36
0.85
27.12
0.83
26.83
0.81
26.51
0.79
SAF
30.20
0.84
28.73
0.78
27.43
0.73
26.30
0.68
25.30
0.63
Proposed
31.65
0.92
30.64
0.89
29.67
0.87
28.78
0.84
27.95
0.81
Wiener [28]
28.98
0.85
28.57
0.82
27.71
0.80
26.98
0.78
26.27
0.76
Kuwahara [29]
27.16
0.82
26.14
0.77
25.12
0.72
24.26
0.68
23.44
0.63
NCD [30]
29.94
0.86
28.99
0.82
27.92
0.76
26.94
0.71
25.90
0.67
BiShrink [31]
31.17
0.90
30.16
0.88
29.41
0.87
28.64
0.84
28.18
0.83
NeighShrinkSURE [32]
31.52
0.91
30.53
0.89
29.69
0.87
29.01
0.85
28.40
0.84
OWT-SURELET [33]
31.37
0.91
30.35
0.89
29.56
0.87
28.88
0.85
28.31
0.84
FP2O-ITV [34]
30.78
0.91
30.04
0.88
28.72
0.84
26.79
0.76
24.81
0.67
BM3D [35]
33.02
0.93
32.05
0.92
31.25
0.91
30.53
0.89
29.85
0.87
Pirate
BF
26.04
0.81
25.91
0.80
25.74
0.78
25.54
0.77
25.29
0.75
SAF
29.03
0.86
27.85
0.82
26.77
0.77
25.78
0.73
24.88
0.69
Proposed
29.15
0.89
28.50
0.87
27.83
0.85
27.17
0.82
26.52
0.80
Wiener [28]
28.41
0.85
27.21
0.83
26.53
0.81
25.93
0.78
25.31
0.76
Kuwahara [29]
26.48
0.83
25.54
0.79
24.63
0.75
23.77
0.70
23.03
0.66
NCD [30]
28.50
0.87
27.88
0.84
27.12
0.80
26.34
0.76
25.52
0.72
BiShrink [31]
29.01
0.88
28.09
0.84
27.29
0.81
26.69
0.79
26.17
0.76
NeighShrinkSURE [32]
29.30
0.88
28.30
0.85
27.51
0.83
26.90
0.80
26.36
0.78
OWT-SURELET [33]
29.41
0.89
28.44
0.86
27.69
0.83
27.08
0.81
26.57
0.78
FP2O-ITV [34]
29.05
0.87
28.61
0.86
27.65
0.83
26.09
0.77
24.34
0.71
BM3D [35]
30.20
0.91
29.17
0.89
28.36
0.87
28.19
0.85
27.61
0.83
Boat
BF
24.95
0.79
24.83
0.78
24.69
0.76
24.51
0.75
24.30
0.73
SAF
28.79
0.86
27.66
0.81
26.60
0.76
25.61
0.72
24.70
0.67
Proposed
28.85
0.88
28.18
0.87
27.51
0.84
26.85
0.82
26.18
0.79
Wiener [28]
28.21
0.85
26.76
0.82
26.07
0.80
25.43
0.77
24.90
0.74
Kuwahara [29]
25.90
0.82
25.04
0.77
24.23
0.73
23.44
0.69
22.72
0.65
NCD [30]
27.93
0.86
27.34
0.82
26.65
0.78
25.80
0.74
24.94
0.69
BiShrink [31]
29.18
0.89
28.15
0.86
27.32
0.83
26.72
0.81
26.08
0.78
NeighShrinkSURE [32]
29.41
0.89
28.36
0.87
27.52
0.84
26.84
0.81
26.26
0.79
OWT-SURELET [33]
29.47
0.89
28.44
0.86
27.63
0.84
26.97
0.81
26.41
0.79
FP2O-ITV [34]
28.82
0.87
28.32
0.86
27.25
0.83
25.86
0.77
24.30
0.70
BM3D [35]
30.76
0.92
29.80
0.90
28.99
0.88
28.43
0.86
27.74
0.84
House
BF
30.77
0.88
30.32
0.86
29.81
0.84
29.26
0.82
28.68
0.80
SAF
31.41
0.80
29.59
0.73
28.11
0.67
26.87
0.62
25.80
0.57
Proposed
34.14
0.91
32.62
0.88
31.28
0.85
30.08
0.82
29.01
0.78
Wiener [28]
31.57
0.89
30.33
0.86
29.34
0.82
28.33
0.78
27.49
0.75
Kuwahara [29]
28.25
0.80
27.01
0.74
25.88
0.68
24.93
0.63
24.01
0.58
NCD [30]
32.08
0.84
30.50
0.78
29.10
0.72
27.73
0.66
26.46
0.61
BiShrink [31]
34.25
0.90
33.15
0.88
32.24
0.86
31.36
0.84
30.87
0.83
NeighShrinkSURE [32]
34.90
0.91
33.75
0.89
32.81
0.87
32.00
0.86
31.28
0.84
OWT-SURELET [33]
34.30
0.91
33.15
0.89
32.33
0.87
31.46
0.86
30.79
0.85
FP2O-ITV [34]
33.88
0.91
32.62
0.89
30.34
0.82
27.76
0.71
25.37
0.61
BM3D [35]
36.47
0.93
35.60
0.92
34.67
0.91
34.03
0.90
33.30
0.88
Figures 4–7 illustrate the comparative results of the corrupted “Lena” and “Pirate” images with noise-levels, σ=30 and σ=40, respectively. As shown in the figures, the proposed method can preserve the fine features of the images favorably in visual effects.
Comparison of the eleven denoising methods: (a) Noisy “Lena” image with σ=30; (b) bilateral filter; (c) structure adaptive kernel; (d) the proposed method; (e) Wiener filter; (f) Kuwahara filter; (g) NCD method; (h) BiShrink; (i) NeighShrinkSURE; (j) OWT-SURELET; (k) FP2O-ITV; (l) BM3D.
Comparison of the eleven denoising methods: (a) Noisy “Pirate” image with σ=30; (b) bilateral filter; (c) structure adaptive kernel; (d) the proposed method; (e) Wiener filter; (f) Kuwahara filter; (g) NCD method; (h) BiShrink; (i) NeighShrinkSURE; (j) OWT-SURELET; (k) FP2O-ITV; (l) BM3D.
Comparison of the eleven denoising methods: (a) Noisy “Lena” image with σ=40; (b) bilateral filter; (c) structure adaptive kernel; (d) the proposed method; (e) Wiener filter; (f) Kuwahara filter; (g) NCD method; (h) BiShrink; (i) NeighShrinkSURE; (j) OWT-SURELET; (k) FP2O-ITV; (l) BM3D.
Comparison of the eleven denoising methods: (a) Noisy “Pirate” image with σ=40; (b) bilateral filter; (c) structure adaptive kernel; (d) the proposed method; (e) Wiener filter; (f) Kuwahara filter; (g) NCD method; (h) BiShrink; (i) NeighShrinkSURE; (j) OWT-SURELET; (k) FP2O-ITV; (l) BM3D.
Finally, we apply the three denoising methods on the color image shown in Figure 8, which is contaminated by real film grain and scanning process noise. To obtain better color evaluations, we transform the RGB image to the YCrCb representation. Here, Y represents the luminance component and Cr and Cb denote the chrominance components. Then we apply the bilateral filter, the structure adaptive filter, and our proposed denoising method on each channel separately. The results are shown in Figures 8(b)–8(d), respectively. As we can see, the image in Figure 8(d) appears clearer than that in Figure 8(b). To further demonstrate this, Figures 8(e) and 8(f) show the absolute values of the residuals on the Y channel. It can be seen that the proposed method produces less features than bilateral filter and more noise-like residuals than structure adaptive method, which, in the absence of original noise-free image, is a reasonable indicator of superior performance.
Performance of different denoising methods is compared on a color image with real noise; (e)–(g) show the residual between given noisy image and the respective estimates. (a) Real noisy image; (b) bilateral filter; (c) structure adaptive filter; (d) the proposed method; (e) bilateral filter; (f) structure adaptive filter; (g) the proposed method.
5. Conclusion
In this paper, we propose a new method for joint denoising with the help of residual feedbacks. This method combines favorable properties of bilateral filter and local self-adaptive kernel; and it can efficiently preserve the fine structure of the image. Numerical experiments show that our new combined method has acceptable denoising performance even for handling images with heavy Gaussian noise. It remarkably exceeds traditional bilateral filter, local self-adaptive kernel, Wiener filter, and Kuwahara filter methods and generally outperforms some state-of-the-art ones in terms of the quality of the restored images.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
Acknowledgments
This work was supported by the US National Science Foundation #DMS-1522332, the National Natural Science Foundation of China #61373087, #11201312, #61472257, and #61401283, the Foundation for Distinguished Young Teachers in Guangdong, China, #Yq2013144, the Guangdong Natural Science Foundation of China #2015A030313557 and #2015A030313550, the Specialized Research Fund for the Doctoral Program of Higher Education of China #20134408110001, the HD Video R & D Platform for Intelligent Analysis and Processing in Guangdong Engineering Technology Research Centre of Colleges and Universities #GCZX-A1409, and the Shenzhen Key Laboratory of Media Security.
TomasiC.ManduchiR.Bilateral filtering for gray and color imagesProceedings of the IEEE 6th International Conference on Computer VisionJanuary 1998Bombay, IndiaIEEE8398462-s2.0-0032319446TschumperléD.2002Nice, FranceUniversité de Nice Sophia-AntipolisTakedaH.FarsiuS.MilanfarP.Kernel regression for image processing and reconstruction200716234936610.1109/TIP.2006.888330MR24627282-s2.0-33847712243López-RubioE.Florentín-NúñezM. N.Kernel regression based feature extraction for 3D MR image denoising201115449851310.1016/j.media.2011.02.0062-s2.0-79958765594TakedaH.FarsiuS.MilanfarP.Higher order bilateral filters and their properties6498Computational Imaging VJanuary 2007San Jose, Calif, USAProceedings of SPIE10.1117/12.714507ZhangH.YangJ.ZhangY.HuangT. S.Image and video restorations via nonlocal kernel regression20134331035104610.1109/TSMCB.2012.22223752-s2.0-84884536129ZhangH.YangJ.ZhangY.HuangT. S.Non-local kernel regression for image and video restoration20106313Berlin, GermanySpringer566579Lecture Notes in Computer Science10.1007/978-3-642-15558-1_41TakedaH.FarsiuS.MilanfarP.Deblurring using regularized locally adaptive kernel regression200817455056310.1109/tip.2007.918028MR25124592-s2.0-41849138999LuJ.YeZ.ZouY.Huber fractal image coding based on a fitting plane201322113414510.1109/TIP.2012.2215619MR30174522-s2.0-84871659360TakedaH.FarsiuS.MilanfarP.Regularized kernel regression for image deblurringProceedings of the 40th Asilomar Conference on Signals, Systems, and Computers (ACSSC '06)November 2006Pacific Grove, Calif, USA1914191810.1109/acssc.2006.3550962-s2.0-47049106172BuadesA.CollB.MorelJ.-M.A non-local algorithm for image denoisingProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '05)June 2005San Diego, Calif, USA606510.1109/cvpr.2005.382-s2.0-24644478715DabovK.FoiA.KatkovnikV.EgiazarianK.Image denoising by sparse 3-D transform-domain collaborative filtering20071682080209510.1109/TIP.2007.901238MR24606262-s2.0-34547760736TakedaH.MilanfarP.ProtterM.EladM.Super-resolution without explicit subpixel motion estimatin20091891958197510.1109/tip.2009.2023703ZhangH.YangJ.ZhangY.HuangT. S.Multi-scale non-local kernel regression for super resolutionProceedings of the 18th IEEE International Conference on Image Processing (ICIP '11)September 2011Brussels, BelgiumIEEE1353135610.1109/icip.2011.61156882-s2.0-84863070599HuangC.LiangY.DingX.FangC.Generalized joint kernel regression and adaptive dictionary learning for single-image super-resolution201410314215410.1016/j.sigpro.2013.11.0422-s2.0-84901237580YuH.ChenF.-S.ZhangZ.-J.WangC.-S.Single infrared image super-resolution combining non-local means with kernel regression201361505910.1016/j.infrared.2013.07.0062-s2.0-84882786344GalleaR.ArdizzoneE.PirroneR.GambinoO.Three-dimensional fuzzy kernel regression framework for registration of medical volume data201346113000301610.1016/j.patcog.2013.03.0252-s2.0-84878884163Florentín-NúñezM. N.López-RubioE.López-RubioF. J.Adaptive kernel regression and probabilistic self-organizing maps for JPEG image deblocking2013121323910.1016/j.neucom.2012.10.0292-s2.0-84884149139BrunetD.VrscayE. R.WangZ.KamelM.CampilhoA.The use of residuals in image denoising20095627Springer112Lecture Notes in Computer Science10.1007/978-3-642-02611-9_1ZhouM.YanX.XieH.ZhengH.YangG.An effective method for signal extraction from residual image, with application to denoising algorithms20137951Berlin, GermanySpringer657663Lecture Notes in Computer Science10.1007/978-3-642-39065-4_79HearnT. A.ReichelL.Image denoising via residual kurtosis minimization20158340642410.4208/nmtma.2015.m1337MR3395399WangZ.BovikA. C.SheikhH. R.SimoncelliE. P.Image quality assessment: from error visibility to structural similarity200413460061210.1109/tip.2003.8198612-s2.0-1942436689EubandR. L.19992ndNew York, NY, USAMarcel DekkerStatistics, Textbooks and MonographsHärdleW.1990Cambridge, UKCambridge University Press10.1017/ccol0521382483MR1161622PhamT. Q.Van VlietL. J.SchutteK.Robust fusion of irregularly sampled data using adaptive normalized convolution2006200608326810.1155/asp/2006/832682-s2.0-33645144260EladM.On the origin of the bilateral filter and ways to improve it200211101141115110.1109/tip.2002.801126MR19660432-s2.0-0036810576BarashD.A fundamental relationship between bilateral filtering, adaptive smoothing, and the nonlinear diffusion equation200224684484710.1109/TPAMI.2002.10083902-s2.0-0036603206GonzalezR. C.WoodsR. E.20073rdPrentice HallKuwaharaM.HachimuraK.EihoS.KinoshitaM.PrestonK.Jr.OnoeM.Processing of RI-angiocardiographic images1976New York, NY, USAPlenum187202GilboaG.SochenN.ZeeviY. Y.Image enhancement and denoising by complex diffusion processes20042681020103610.1109/tpami.2004.472-s2.0-3242723371ŞendurL.SelesnickI. W.Bivariate shrinkage with local variance estimation200291243844110.1109/LSP.2002.8060542-s2.0-0036959297ZhouD.ChengW.Image denoising with an optimal threshold and neighbouring window200829111694169710.1016/j.patrec.2008.04.0142-s2.0-45449108009LuisierF.BluT.UnserM.A new SURE approach to image denoising: interscale orthonormal wavelet thresholding200716359360610.1109/tip.2007.891064MR24601762-s2.0-33947206581MicchelliC. A.ShenL.XuY.Proximity algorithms for image models: denoising201127404500910.1088/0266-5611/27/4/045009MR27810332-s2.0-79953645045DabovK.FoiA.KatkovnikV.EgiazarianK.Image denoising by sparse 3-D transform-domain collaborative filtering20071682080209510.1109/tip.2007.901238MR24606262-s2.0-34547760736