Mathematical Problems in Engineering
Volume 2016 (2016), Article ID 6153749, 14 pages
http://dx.doi.org/10.1155/2016/6153749

Research Article

Neural Architectures for Correlated Noise Removal in Image Processing

Cătălina Cocianu and Alexandru Stan

Computer Science Department, Bucharest University of Economics, 010552 Bucharest, Romania

Received 21 January 2016; Accepted 24 March 2016

Academic Editor: Marco Perez-Cisneros

Copyright © 2016 Cătălina Cocianu and Alexandru Stan. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

The paper proposes a new method that combines the decorrelation and shrinkage techniques to neural network-based approaches for noise removal purposes. The images are represented as sequences of equal sized blocks, each block being distorted by a stationary statistical correlated noise. Some significant amount of the induced noise in the blocks is removed in a preprocessing step, using a decorrelation method combined with a standard shrinkage-based technique. The preprocessing step provides for each initial image a sequence of blocks that are further compressed at a certain rate, each component of the resulting sequence being supplied as inputs to a feed-forward neural architecture . The local memories of the neurons of the layers and are generated through a supervised learning process based on the compressed versions of blocks of the same index value supplied as inputs and the compressed versions of them resulting as the mean of their preprocessed versions. Finally, using the standard decompression technique, the sequence of the decompressed blocks is the cleaned representation of the initial image. The performance of the proposed method is evaluated by a long series of tests, the results being very encouraging as compared to similar developments for noise removal purposes.

1. Introduction

There have been proposed a long series of digital image manipulation techniques, general and special tailored ones for different particular purposes. Digital image processing involves procedures including the acquisition and codification of images in digital files and the transmission of the resulting digital files of some communication channels, usually affected by noise [1, 2]. Consequently, a significant part of digital image procedures are devoted to noise removal and image reconstruction, most of them being developed in the framework represented by the assumptions that the superimposed noise is uncorrelated and normally distributed [3, 4]. Our approach is somehow different, keeping the assumption about normality but relaxing the constraint that the superimposed noise affects neighbor image pixels in a correlated way.

There are two basic mathematical characterizations of images, deterministic and statistical. In deterministic image representation, the image pixels are defined in terms of a certain function, possibly unknown, while, in statistical image representation, the images are specified in probabilistic terms as means, covariances, and higher degree moments [5–7]. In the past years, a series of techniques have been developed in order to involve neural architectures in image compression and denoising processes [8–13].

A neural network is a massively parallel-distributed processor made up of simple processing units, which has a natural propensity for storing experiential knowledge and making it available for use [14]. The neural networks methodology is of biological inspiration, a neural network resembling the biological brain in two respects; on one hand the knowledge is acquired by the network for its environment through a learning process, and on the other hand the interneuron connection strengths are used to store the acquired knowledge.

The “shrinkage” is a method for reducing the uncorrelated Gaussian noise affecting additively a signal image by soft thresholding applied to the sparse components [15–17]. Its use in neural network-based approach is intuitively explained by the fact that when only a few of the neurons are simultaneously active, it makes sense to assume that the activities of neurons with small absolute values correspond to noise; therefore they should be set to zero, and only the neurons whose absolute values of their activities are relatively large contain relevant information about the signal.

Recently, a series of correlated noise removal techniques have been reported. Some approaches focus on estimating spatial correlation characteristics of noise for a given image either when noise type and statistics like variance are known [18] or in case the noise variance and spatial spectrum have to be estimated [19] and then use a DCT-based method for noise removal. Wavelet-based approaches mainly include noise prewhitening technique followed by the wavelet-based thresholding [20], additive stationary correlated noise removal by modeling the noise-free coefficients using a multivariate Gaussian Scale Mixture [21], and image denoising using HMM in the wavelet domain based on the concept of signal of interest [22, 23]. Since the sparsity of signals can be exploited for noise removal purpose when different representations are used (Fourier, wavelet, principal components, independent components, etc.), a series of results concerning this property could be of interest in image denoising [24–26] and artifact (noise) removal in magnetic resonance imaging [27].

The outline of the paper is as follows. The general model of image transmission through a noisy corrupted channel is described in Section 2. Each image is transmitted several times as a sequence of equal sized blocks, each block being disturbed by a correlated Gaussian noise whose statistical properties are not known. All variants of each block are submitted to a sequence of transforms that decorrelate, shrink, and average the pixel values.

A special tailored family of feed-forward single-hidden-layer neural networks is described in Section 3, their memories being generated using a supervised learning algorithm of gradient descent type.

A suitable methodology aiming to implement a noise removal method on neural network for image processing purposes is then described in the fourth section of the paper. The proposed methodology was applied to process images from different standard databases, the conclusions experimentally derived from the tests performed on two standard databases, the former containing images of human faces and the latter containing images of landscapes being reported in the next section.

The final section of the paper contains a series of conclusive remarks.

2. Image Preprocessing Based on Decorrelation and Shrinkage Techniques

We assume that the images are transmitted through a noisy channel, each image being transmitted as a sequence of   -dimensional blocks, , , and we denote by the received image. A working assumption of our model is that the noise modeled by the -dimensional random vectors , , affects the blocks in a similar way, where are independent identically distributed; , .

In case images, , are transmitted sequentially through the channel we denote by , the sequence of received disturbed variants. In our model, we adopt the additional working assumption that, for each , is a realization of a -dimensional random vector , where is a random vector of mean and covariance matrix , and that and are independent; therefore the covariance matrix of is . The working assumptions included in our model seem to be quite realistic according to the currently used information transmission frameworks. According to the second working assumption, for each index value , the sequence of blocks could represent fragments of possibly different images taken at the counterpart positions, as, for instance, in case of face images the areas of eyes or mouths and so on. Therefore the assumption that each is a random vector corresponds to a model for each particular block, the parameters and expressing the variability existing in the sequence of images at the level of th block.

On one hand, the maximum likelihood estimates (MLE) of the parameters and are given by

respectively. On the other hand, the values of the parameters and are also unknown and moreover it is quite inconvenient to estimate them before the transmission of the sequence of images is over.

The covariance matrix corresponding to the noise component can be estimated before the transmission is performed by different methods, as, for instance, the white wall method; therefore, without loss of generality, the matrix can be assumed to be known; therefore, can be taken as an estimate of .

Also, in case each sequence is processed separately, we can assume that the data are centered; that is, , .

Consequently, the available information in developing a denoising procedure is represented by the sequences , the estimates , , and .

In our work we consider the following shrinkage type denoising method.

For each , we denote by a matrix that diagonalizes simultaneously the matrices and . According to the celebrated W theorem [28, 29], the columns of are eigenvectors of and the following equations hold:

where are the eigenvalues of the matrix . Note that although is not a symmetric matrix, its eigenvalues are proved to be real positive numbers [29].

Let , , be the random vectors:

Note that the linear transform of matrix allows obtaining the representation , where the most amount of noise is contained in the second term. Moreover, since

the linear transform of matrix decorrelates the noise components.

Let , , be the sequence of variants of using the code shrinkage method [16], where each entry , , of is

Then is a variant of where the noise distributed is partially removed. Since a variant of where the noise was partially removed can be taken as

Obviously, from (3) we get ; that is,

Note that, although the eigenvalues of are theoretically guaranteed to be positive numbers, in real world applications frequently arise situations when this matrix is ill conditioned. In order to overpass this difficulty, in our tests we implemented the code shrinkage method using

where is a conventionally selected positive threshold value. Also, instead of (8) we use

where is the generalized inverse (Penrose pseudoinverse) of [30].

In our approach we assumed the source of noise (namely, the communication channel used to transmit the image) can be observed. This hypothesis is frequently used in image restauration techniques [26]. In preprocessing and training stages, undisturbed original versions of the images transmitted are not available; instead, a series of perturbed versions are available and also through white wall technique noise component characteristics may be estimated. Working hypothesis includes the fact that images come from a common probability repartition (maybe a mixture); that is, they share the same statistical characteristics. This hypothesis is frequently used when sets of images are captured and processed [16]. The purpose of this method is, on one hand, to eliminate correlated noise, and, on the other hand, to eliminate the noise from new images transmitted through a communication channel, when they come from the same probability distribution as the images in the initially observed set.

3. Neural Networks Based Approach to Image Denoising

The aim of this section is to present an image denoising method in the framework described in the previous section implemented on a family of standard feed-forward neural architectures , , working in parallel.

Let us assume that is the noisy received version of the image transmitted through the channel. The training process of the architectures , , is organized such that the resulting memories encode the associations of the type (input block, sample mean), the purpose being the noise removal according to the method presented in the previous section.

In order to reduce in some extent the computational complexity, a preprocessing step aiming dimensionality reduction is required. In our work we use -PCA method to compress the blocks. Since the particular positions of the blocks correspond to different models, their compressed versions could be of different sizes. Indeed, according to (2), the estimates of the autocorrelation matrices , , are different for different values of the index ; therefore, the numbers of the most significant directions are different for different values of index ; that is, the sizes of the compressed variants of blocks are, in general, different. Consequently, the sizes of and depend on , these sizes resulting in the preprocessing step by applying the -PCA method [31, 32].

The hidden neurons influence the error on the nodes to which their output is connected. The use of too many hidden neurons could cause the so-called overfitting effect which means the overestimate of the complexity corresponding to the target problem. Maybe the most unpleasant consequence is that this way the generalization capability is decreased; therefore, the capacity of prediction is degraded too. On the other hand, at least in image processing, the use of fewer hidden neurons implies that less information extracted from the inputs is processed and consequently less accuracy should be expected. Consequently, the determining of the right size of the hidden layer results as a trade-off between accuracy and generalization capacity.

There have been proposed several expressions to compute the number of neurons in the hidden layers [33, 34]. Denoting by the number of elements of the argument, the sizes of the hidden layers can be computed many ways, some of the most frequent expressions being [34]

The aim of the training is that, for each value of the index to obtain on the output on the layer , a compressed cleaned version of the input applied to the layer , the output being computed according to the method presented in the previous section.

According to the approach described in the previous section, all blocks of the same index say are processed by the same compression method yielding to compressed variants, the size of compressed variants being the same for all these blocks. The compressed variants corresponding to the blocks of index are next fed as inputs to th neural architecture. Consequently, the denoising process of an image consisting of blocks is implemented on a family of neural architectures operating in parallel (, ), where ; the sequence of denoised variants resulted as outputs of the layers being next decompressed. The cleaned variant of each input image is taken as the sequence of the decompressed cleaned variants of its blocks.

The preprocessing step producing the compressed variants fed as input blocks is described as follows. For each index value , the sequence of compressed versions of the blocks denoted by is

where the columns of the matrix are the most significant unit eigenvectors of . The most significant unit eigenvectors of are computed as follows. Let be the eigenvalues of and a conventionally selected threshold value. If is the smallest value such that (14) holds, then the columns of are unit eigenvectors of   corresponding to the largest eigenvalues:

therefore, .

Assuming that the sequence of blocks are cleaned versions of computed according to (11), we denote by their compressed variants:

where the columns of the matrix are the most significant unit eigenvectors of the autocorrelation matrix . The most significant eigenvectors of are computed in a similar way as in the compression step applied to input blocks using possibly a different threshold value . Note that, in tests, the threshold values , are experimentally tuned to the particular sequence of images.

To summarize, the preprocessing scheme consists of applying -PCA method to both noisy sequence of blocks and their cleaned versions causing the sequence of inputs to be applied to the input layer and to their compressed cleaned versions :

The aim of the training is to produce on each output layer the sequence , the decompressed versions of its blocks being :

therefore, the blocks of are denoised versions of , respectively.

The training of each neural architecture is of supervised type using a gradient descent approach, the local memories of and being determined using the Levenberg-Marquardt variant of the backpropagation learning algorithm (LM-BP algorithm) [35].

We organized the training process for the m neural networks by transmitting through the channel each available image several times, say times; the reason of doing that is that this way better estimates of the covariance matrices , , of the proposed stochastic models are expected to be obtained.

Consequently, the whole available data is the collection (, , ); therefore, for each index value , the inputs applied to the th neural network are the sequence of compressed versions of the blocks :

The linear compression filter is a matrix whose columns are the most significant unit eigenvectors of the matrix .

Let be the sequence of the cleaned variants of computed using (11) and, for each , let be the sample mean of cleaned blocks :

We denote by a linear compression filter whose columns are the most significant unit eigenvectors of the matrix computed in a similar way as (15) using a threshold value and let .

The learning process for each neural architecture , , is developed to encode the associations , . The reason of using the means , , and their corresponding compressed versions instead of the associations , , resides in the fact that taking the means and their compressed versions some amount of noise is expected to be removed, for each value of the index ; that is, the compressed versions of the means are expected to be better cleaned variants of the compressed blocks.

Summarizing, the memory of each neural architecture is computed by the Levenberg-Marquardt algorithm applied to the input/output sequence  , , .

Once the training phase is over, the family of ’s is used to remove the noise from a noisy version of an image received through the channel according to the following scheme. Let be the initial image transmitted through the channel and the received noisy version.

Step 1. Compress each block of using the filter and get its compressed version ; that is, is a dynamically block-compressed version of .

Step 2. Apply as inputs to the architectures ’s,   applied as input to the layer , , and get the outputs ’s.

Step 3. Decompress each block using the decompression filter , .

Step 4. Get the cleaned version of .

4. Description of the Methodology Applied in the Implementations of the Proposed Method on Neural Architectures

The aim of this section is to describe the methodology followed in implementing the neural network-based noise removal method for image processing purposes. The proposed methodology was applied to process images from different standard databases, the conclusions experimentally derived from the tests performed on two standard databases, the former containing images of human faces and the latter containing images of landscapes being reported in the next section.

We performed the experiments according to the following methodology.

(1) The quality of the a certain test image versus a reference image of the same size is evaluated in terms of the Signal-to-Noise Ratio (SNR), Peak Signal-to-Noise Ratio (PSNR), Root Mean Squared Signal-to-Noise Ratio () indicators [36], and the Structural Similarity Metric (SSIM) [37], where

Let and be spatial patches extracted from the images and , respectively. The two patches correspond to the same spatial window of the images and . The original standard SSIM value computed for the patches and is defined by

where denotes the mean value of , is the standard deviation of , and represents the cross-correlation of the mean shifted patches and . The constants and are small positive numbers included to avoid instability when either or is very close to zero, respectively. The overall SSIM index for the images and is computed as the mean value of the SSIM measures computed for all pairs of patches and of and , respectively.

(2) The size of the blocks and the model of noise in transmitting data through the channel are selected for each database. The size of the blocks is established by taking into account the size of the available images in order to assure reasonable complexity to the noise removal process. In our tests the size of input blocks is about 150 and the sizes of images are in case of the database containing images of human faces and in case of the database containing images of landscapes. We assumed that the components of the noise induced by the channel are possibly correlated; in our tests, the noise model is of Gaussian type, , where is a symmetric positive defined matrix.

(3) The compression thresholds , in (14) and (15) are established in order to assure some desired accuracy. In our tests we used , , where , are positive constants. The reason for selecting different magnitude orders of these thresholds stems from the fact that is used in compressing noise affected images, while is used for compressing noise cleaned images [32]. The sizes of the input and output layers , of the neural network result in terms of the established values of and accordingly.

(4) The quality evaluation of the preprocessing step consisting in noise cleaning data is performed in terms of the indicators (20) and (21), by comparing the initial data against the noisy transmitted images through the channel and against their corresponding cleaned versions , respectively.

(5) In order to implement the noise removal method on a family of neural networks , , the sizes of the input and the output layers are determined by -PCA compression/decompression method and the established values of , . The sizes of the layers are determined as approximations of the recommended values cited in the published literature (12a) and (12b). In order to assure a reasonable tractability of the data, in our tests we were forced to use a less number of neurons than it is recommended, on the hidden layers .

For fixed values of , , the use of the recommended number of neurons as in (12a) and (12b) usually yields to either the impossibility of implementing the learning process or to too lengthy training processes. Therefore, in such case we are forced to reconsider the values of , by increasing them, therefore decreasing the numbers of neurons on the input and the output layers and consequently the number of neurons on the hidden layers too. Obviously, by reconsidering this way the values of , , inherently imply that some larger amount of information about data is lost. The effects of losing information are manifold, one of them being that the cleaned versions resulted from decompressing the outputs of ’s yield to poorer approximation of the initial image .

This way we arrive at the conclusion that, in practice, we have to solve a trade-off problem between the magnitude of the compression rates and the number of neurons on the hidden layers ’s. In order to solve this trade-off, in our tests we used smaller numbers of neurons than recommended on the hidden layers and developed a comparative analysis on the quality of the resulting cleaned images.

(6) The activation functions of the neurons belonging to the hidden and output layers can be selected from very large family. In our tests, we considered the logistic type to model the activation functions of the neurons belonging to the hidden layers and the unit functions to model the outputs of the neurons belonging to the output layers. Also, the learning process involved the task of splitting the available data into training, validation, and test data. In our tests the sizes of the subcollections were 80%, 10%, and 10%, respectively.

(7) The evaluation of the overall quality of the noise removal process implemented on the set of neural networks, as previously described, is performed in terms of the indicators (20) and (21), on one hand by comparing the initial data to the noisy transmitted images through the channel and on the other hand by comparing to their cleaned versions .

(8) The comparative analysis between the performances corresponding to the decorrelation and shrinkage method and its implementation on neural networks is developed in terms of the indicators (20) and (21).

5. Experimentally Derived Conclusions on the Performance of the Proposed Method

In this section we present the results in evaluating both the quality of the proposed decorrelation and shrinkage method and the power of the neural network-based approach in simulating it for noise removal purposes. The tests were performed in a similar way on two standard databases, the former, referred to as Senthil, containing images of 5 human faces and 16 images for each person [38] and the latter containing 42 images of landscapes [39]. In case of the Senthil database, the preprocessing step used 75 images; for each human face 15 of its available versions are being used. The tests performed in order to evaluate the quality of the trained family of neural networks used the rest of 5 images, one for each person. In case of the database containing images of landscapes, we identified three types of quite similar images, and we used 13 images of each type in the training process, the tests being performed on the rest of three ones.

The sizes of hidden layers were set to smaller values than recommended by (12a) and (12b). For instance, when and the resulting sizes of the layers and are about 115 and 30, respectively, the recommended sizes of the layers being about 65.

The results of a long series of tests pointed out that one can use hidden layers of smaller sizes than recommended without decreasing dramatically the accuracy. For instance, in this work, we used only half of recommended sizes; that is,

In our test, the memory of each neural architecture is computed by the LM-BP algorithm, often the fastest variant of the backpropagation algorithm and one of the most commonly used in supervised learning. The available data was split into training set, validation set, and test set, the sizes of the subcollections being 80%, 10%, and 10%, respectively. The main parameters of the LM-BP training process are specified in Table 1.

Table 1

The maximum number of epochs
The minimum value of the performance (Jacobian computation)
The maximum validation failures
The minimum performance gradient
The initial/maximum factor (in the LM adaptive learning rule)

1000
0
5

In order to experimentally establish the quality of the proposed method, a comparative analysis against three of the most used and suitable algorithms for correlated noise removal, namely, BM3D (block-matching and 3D filtering [25]), NLMF (Nonlocal Means Noise Filtering [40]), and ProbShrink (correlated noise removal algorithm using nondecimated wavelet transform and generalized Laplacian [22]), was conducted. The reported results include both quantitative and qualitative comparisons.

In the following, we summarize some of our results.

The quality evaluation of the preprocessing step in terms of the indicators (20) and (21) is as follows:

In Figure 1(a), a sample of five face images belonging to the Senthil database is presented, their cleaned versions resulted from applying the decorrelation and shrinkage method being shown in Figure 1(e), where each image was transmitted 30 times through the channel. In Figures 1(b), 1(c), and 1(d) the restored versions resulting from applying the NLMF algorithm, ProbShrink algorithm, and BM3D method, respectively, are depicted. Table 2 contains the values of the indicators (20) and (21) corresponding to these five pairs of noisy-cleaned versions of these images.  Note that, on average, the best results were obtained when our method was used.A sample of three images of landscapes, one from each class, is presented in Figure 2(a) together with their cleaned versions resulting from applying the decorrelation and shrinkage method shown in Figure 2(e), where each image was transmitted 30 times through the channel. In Figure 2(b) the restored variants using NLMF algorithm are exhibited, while in Figure 2(c) the restored variants using ProbShrink method are shown. The cleaned version using the BM3D algorithm is presented in Figure 2(d). The values of the indicators (20) and (21) are given in Table 3.  Note that, on average, the best results were obtained when our method was used.

As it was previously described, the images resulting from the preprocessing step are used in the supervised training of the family of neural networks. Once the training process is over, the family of neural networks are used to remove noise from new unseen-yet images. Obviously, it is impossible to guarantee that the new test images share the same statistical properties with the images used during the training process, the unique criterion being that they are visually enough similar. In order to take into account this constraint, we split each of these two databases containing similar images into training and testing subsets, the sizes being 75/5 for Senthil dataset and 39/3 for the second database.

The test images from the Senthil database and their versions resulting from applying the preprocessing step are shown in Figures 3(a) and 3(b), respectively. Their cleaned versions computed by the resulting family of trained neural networks are shown in Figure 3(f), while their restored versions when NLMF algorithm, ProbShrink method, and BM3D method are used are presented in Figures 3(c), 3(d), and 3(e), respectively. In terms of the indicators (20) and (21), the results are summarized in Table 4.  Note that in this case our method, ProbShrink algorithm, and BM3D method produce similar results, according to both SNR measure and SSIM metric.Similar tests were performed on the database containing images of landscapes. The tests were performed on three new images shown in Figure 4(a), the results of the preprocessing step being given in Figure 4(b). The cleaned versions computed by the resulting family of trained neural networks are shown in Figure 4(f) and the clean versions given by the BM3D algorithm are presented in Figure 4(e). The results obtained when the NLMF algorithm and ProbShrink method are used are displayed in Figures 4(c) and 4(d), respectively. The numerical evaluation in terms of the indicators (20) and (21) is summarized in Table 5.  Note that, in this case, the BM3D algorithm proved to smooth the results too much. Also, the images obtained when NLMF algorithm was used are of poor visual quality. The ProbShrink algorithm performed better than BM3D and NLMF, but, on average, the best results were obtained when our method was used.

Table 2

SNR-RMS (the mean value)
SNR (the mean value)
Mean Peak SNR (the mean value)
SSIM (the mean value)

Noisy images versus original images
7.3128
17.2193
26.3217
0.5838

Cleaned images versus original images (NLMF)
12.1367
21.6369
30.8944
0.8377

Cleaned images versus original images (ProbShrink)
15.3787
23.7071
33.1043
0.8782

Cleaned images versus original images (BM3D)
15.0573
23.5242
33.3160
0.8867

Cleaned images versus original images (the proposed method)
19.5967
25.8067
35.0112
0.9163

Table 3

SNR-RMS (the mean value)
SNR (the mean value)
Mean Peak SNR (the mean value)
SSIM (the mean value)

Noisy images versus original images
7.1013
17.0083
24.6427
0.6868

Cleaned images versus original images (NLMF)
7.5050
17.4992
25.8548
0.6503

Cleaned images versus original images (ProbShrink)
9.6534
19.7858
27.7324
0.8002

Cleaned images versus original images (BM3D)
8.7304
18.8084
27.6967
0.7389

Cleaned images versus original images (the proposed method)
20.8267
26.2779
34.0215
0.9341

Table 4

SNR-RMS/new image
SNR/new image
Mean Peak SNR/new image
SSIM/new image

Noisy images versus original images
7.1352
7.7979
6.7452
9.0387
6.1524
17.0681
17.8395
16.5800
19.1221
15.7809
26.3356
26.4804
26.2165
26.4122
26.5486
0.5700
0.5693
0.5733
0.6410
0.5513

Cleaned images (using the preprocessing step) versus original images
8.4056
9.6450
8.3065
9.5696
7.4780
18.4914
19.6860
18.3883
19.6179
17.4758
27.8057
28.3873
28.0880
26.9517
28.2541
0.6328
0.6411
0.6392
0.6643
0.6308

Cleaned images versus original images (NLMF)
12.1067
13.6918
11.9228
14.5670
10.8248
21.6605
22.7292
21.5275
23.2674
20.6884
31.0955
31.5051
31.3547
30.6666
31.6597
0.8474
0.8448
0.8424
0.8588
0.8619

Cleaned images versus original images (ProbShrink)
15.6521
15.5453
14.6064
17.5242
13.2653
23.8914
23.8320
23.2909
24.8728
22.1486
33.2490
32.5356
33.0326
32.2178
33.5365
0.8834
0.8648
0.8705
0.8836
0.8812

Cleaned images versus original images (BM3D)
14.8333
16.3388
14.7108
17.7965
13.4046
23.4248
24.2644
23.3527
25.0067
22.4632
33.34
33.59
33.68
33.00
33.63
0.8824
0.8854
0.8991
0.8525
0.9074

Cleaned images (using NN’s) versus original images (the proposed method)
13.7982
16.9576
16.5712
12.6325
13.4488
22.7964
24.5873
24.3871
22.0298
22.5737
32.2178
33.0786
33.8409
29.6259
33.6427
0.8850
0.8781
0.8968
0.8454
0.8939

Table 5

SNR-RMS/new image
SNR/new image
Mean Peak SNR/new image
SSIM/new image

Noisy images versus original images
6.7603
6.5259
7.7468
16.5994
16.2928
17.7824
24.6606
24.6103
24.7497
0.6564
0.6796
0.6157

Cleaned images versus original images
6.8194
7.8383
7.3444
16.6749
17.8845
17.3191
24.7947
26.2810
24.3228
0.6590
0.7203
0.6990

Cleaned images versus original images (NLMF)
7.7084
6.9041
8.2267
17.7393
16.7822
18.3045
26.0425
25.3903
25.4729
0.6773
0.6025
0.6830

Cleaned images versus original images (ProbShrink)
9.5398
9.0598
10.0007
19.6813
19.1423
20.0039
27.7907
27.6171
27.5228
0.8060
0.7732
0.8218

Cleaned images versus original images (BM3D)
9.0589
7.8517
9.7064
19.1415
17.8993
19.7412
27.95
26.99
27.89
0.7265
0.6969
0.7688

Cleaned images (using NN’s) versus original images (the proposed method)
9.4599
13.1507
10.0606
19.5177
22.3790
20.0525
27.6939
30.8164
27.1269
0.8090
0.8770
0.8412

(a)

(b)

(c)

(d)

(e)

Figure 1

(a)

(b)

(c)

(d)

(e)

Figure 2

(a)

(b)

(c)

(d)

(e)

(f)

Figure 3

(a)

(b)

(c)

(d)

(e)

(f)

Figure 4

6. Conclusive Remarks and Suggestions for Further Work

The proposed method combines the decorrelation and shrinkage techniques to neural network-based approaches for noise removal purposes. The images are assumed to be transmitted as sequences of blocks of equal sizes, each block being distorted by a stationary statistical correlated noise and some amount of the noise being partially removed using the method that combines noise decorrelation and standard shrinkage technique. The preprocessing step provides, for each initial image, a sequence of blocks that are further PCA-compressed at a certain rate, each component of the resulting sequence being supplied as inputs to a feed-forward neural architecture . Therefore, each indexed block is processed by a neural network corresponding to that index value. The local memories of the neurons of the layers and are generated through a supervised learning process based on the compressed versions of blocks of the same index value supplied as inputs and the compressed versions of them resulting as the mean of their preprocessed versions. Finally, using the standard PCA-decompression technique, the sequence of the decompressed blocks is the cleaned representation of the initial image. The performance of the proposed method is evaluated by a long series of tests, the results being very encouraging as compared to similar developments for noise removal purposes. The evaluation of the amount of the noise removed is done in terms of some of the most frequently used similarity indicators, SNR, SNR-RMS, Peak SNR, and SSIM.

The results produced by applying the proposed method were compared to those produced by applying three of the most widely used algorithms for eliminating correlated noise. NLMF algorithm consistently produces weaker results than the proposed method. Using ProbShrink or BM3D, the results are similar to or weaker than those yielded by the proposed method, in both quality and quantity.

The long series of tests proved good results of the above-described methodology entailing the hope that further and possibly more sophisticated extensions can be expected to improve it. Among several possible extensions, some work is still in progress concerning the use of different output functions for the hidden and output neurons and the use of more hidden layers in the neural architectures. Also, some other compression techniques combined with new techniques for feature extraction as well as the use of other learning schemes to generate the local memories of the neurons are expected to allow the removal of a larger amount of noise.

Competing Interests

The authors declare that they have no competing interests.

Acknowledgments

A major contribution to the research work reported in this paper belongs to Mrs. Luminita State, a Professor and a Ph.D. Distinguished Member of the Romanian academic community; Professor Luminita State passed away in January 2016. The authors will always remember her amazing spirit, as well as her brilliant mind. May God rest her soul in peace!

References

W. Pratt, Digital Image Processing, Wiley-Interscience, Hoboken, NJ, USA, 4th edition, 2007.

E. López-Rubio, “Restoration of images corrupted by Gaussian and uniform impulsive noise,” Pattern Recognition, vol. 43, no. 5, pp. 1835–1846, 2010.

L. State, C. Cocianu, C. Săraru, and P. Vlamos, “New approaches in image compression and noise removal,” in Proceedings of the 1st International Conference on Advances in Satellite and Space Communications (SPACOMM '09), pp. 96–101, IEEE, Colmar, France, July 2009.

Z. H. Shamsi and D.-G. Kim, “Multiscale hybrid nonlocal means filtering using modified similarity measure,” Mathematical Problems in Engineering, vol. 2015, Article ID 318341, 17 pages, 2015.

P. Fieguth, Statistical Image Processing and Multidimensional Modeling, Springer, New York, NY, USA, 2011.

L. Tan and J. Jiang, Digital Signal Processing. Fundamentals and Applications, Academic Press, Elsevier, 2nd edition, 2013.

S. Kay, Fundamentals of Statistical Signal Processing, Volume III: Practical Algorithm Development, Prentice Hall, New York, NY, USA, 2013.

M. Egmont-Petersen, D. de Ridder, and H. Handels, “Image processing with neural networks—a review,” Pattern Recognition, vol. 35, no. 10, pp. 2279–2301, 2002.

F. Hussain and J. Jeong, “Efficient deep neural network for digital image compression employing rectified linear neurons,” Journal of Sensors, vol. 2016, Article ID 3184840, 7 pages, 2016.

A. J. Hussain, D. Al-Jumeily, N. Radi, and P. Lisboa, “Hybrid neural network predictive-wavelet image compression system,” Neurocomputing, vol. 151, no. 3, pp. 975–984, 2015.

S. Bhattacharyya, P. Pal, and S. Bhowmick, “Binary image denoising using a quantum multilayer self organizing neural network,” Applied Soft Computing Journal, vol. 24, pp. 717–729, 2014.

Y. Li, J. Lu, L. Wang, and Y. Takashi, “Denoising by using multineural networks for medical X-ray imaging applications,” Neurocomputing, vol. 72, no. 13–15, pp. 2884–2891, 2009.

I. Turkmen, “The ANN based detector to remove random-valued impulse noise in images,” Journal of Visual Communication and Image Representation, vol. 34, pp. 28–36, 2016.

S. Haykin, Neural Networks A Comprehensive Foundation, Prentice Hall, 1999.

Y. Wu, B. H. Tracey, P. Natarajan, and J. P. Noonan, “Fast blockwise SURE shrinkage for image denoising,” Signal Processing, vol. 103, pp. 45–59, 2014.

A. Hyvarinen, J. Karhunen, and E. Oja, Independent Component Analysis, John Wiley & Sons, New York, NY, USA, 2001.

L. Shang, D.-S. Huang, C.-H. Zheng, and Z.-L. Sun, “Noise removal using a novel non-negative sparse coding shrinkage technique,” Neurocomputing, vol. 69, no. 7–9, pp. 874–877, 2006.

N. N. Popomarenko, V. V. Lukin, A. A. Zelensky, J. T. Astola, and J. T. Astola, “Adaptive DCT-based filtering of images corrupted by spatially correlated noise,” in Image Processing: Algorithms and Systems VI, vol. 6812 of Proceedings of SPIE, San Jose, Calif, USA, January 2008.

N. N. Popomarenko, V. V. Lukin, K. O. Egiazarian, and J. T. Astola, “A method for blind estimation of spatially correlated noise characteristics,” in Image Processing: Algorithms and Systems VIII, vol. 7532 of Proceedings of SPIE, February 2010.

I. M. Johnstone and B. W. Silverman, “Wavelet threshold estimators for data with correlated noise,” Journal of the Royal Statistical Society. Series B. Methodological, vol. 59, no. 2, pp. 319–351, 1997.

J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli, “Image denoising using scale mixtures of Gaussians in the wavelet domain,” IEEE Transactions on Image Processing, vol. 12, no. 11, pp. 1338–1351, 2003.

A. Pižurica and W. Philips, “Estimating the probability of the presence of a signal of interest in multiresolution single- and multiband image denoising,” IEEE Transactions on Image Processing, vol. 15, no. 3, pp. 654–665, 2006.

B. Goossens, Q. Luong, A. Pizurica, and W. Philips, “An improved non-local denoising algorithm,” in Proceedings of the International Workshop on Local and Non-Local Approximation in Image Processing (LNLA '08), pp. 143–156, Lausanne, Switzerland, August 2008.

M. Jansen, Noise Reduction by Wavelet Thresholding, Springer, Berlin, Germany, 2001.

K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, “Image denoising by sparse 3-D transform-domain collaborative filtering,” IEEE Transactions on Image Processing, vol. 16, no. 8, pp. 2080–2095, 2007.

M. P. S. Chawla, “PCA and ICA processing methods for removal of artifacts and noise in electrocardiograms: a survey and comparison,” Applied Soft Computing Journal, vol. 11, no. 2, pp. 2216–2226, 2011.

L. Griffanti, G. Salimi-Khorshidi, C. F. Beckmann et al., “ICA-based artefact removal and accelerated fMRI acquisition for improved resting state network imaging,” NeuroImage, vol. 95, pp. 232–247, 2014.

P. Common and C. Jutten, Handbook of Blind Source Separation: Independent Component Analysis and Applications, Academic Press, Elsevier, 2010.

K. Fukunaga, Introduction to Statistical Pattern Recognition, Academic Press, 2nd edition, 1990.

J. E. Gentle, Matrix Algebra. Theory, Computations, and Applications in Statistics, Springer Texts in Statistics, Springer, New York, NY, USA, 2007.

I. T. Jolliffe, Principal Component Analysis, Springer Series in Statistics, Springer, Berlin, Germany, 2nd edition, 2002.

C. Cocianu, L. State, and P. Vlamos, “Neural implementation of a class of PCA learning algorithms,” Economic Computation and Economic Cybernetics Studies and Research no. 3/2009, 2009.

K. Gnana Sheela and S. N. Deepa, “Review on methods to fix number of hidden neurons in neural networks,” Mathematical Problems in Engineering, vol. 2013, Article ID 425740, 11 pages, 2013.

G.-B. Huang, “Learning capability and storage capacity of two-hidden-layer feedforward networks,” IEEE Transactions on Neural Networks, vol. 14, no. 2, pp. 274–281, 2003.

G. A. F. Seber and C. J. Wild, Nonlinear Regression, John Wiley & Sons, New York, NY, USA, 2003.

R. Gonzales and R. Woods, Digital Image Processing, Prentice Hall, 5th edition, 2008.

Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image quality assessment: from error visibility to structural similarity,” IEEE Transactions on Image Processing, vol. 13, no. 4, pp. 600–612, 2004.

http://www.geocities.ws/senthilirtt/Senthil%20Face%20Database%20Version1

http://sipi.usc.edu/database/database.php?volume=sequences

A. Buades, B. Coll, and J.-M. Morel, “A non-local algorithm for image denoising,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '05), vol. 2, pp. 60–65, IEEE, San Diego, Calif, USA, June 2005.