Compressed Sensing and Low-Rank Matrix Decomposition in Multisource Images Fusion

We propose a novel super-resolution multisource images fusion scheme via compressive sensing and dictionary learning theory. Under the sparsity prior of images patches and the framework of the compressive sensing theory, the multisource images fusion is reduced to a signal recovery problem from the compressive measurements. Then, a set of multiscale dictionaries are learned from several groups of high-resolution sample image’s patches via a nonlinear optimization algorithm. Moreover, a new linear weights fusion rule is proposed to obtain the high-resolution image. Some experiments are taken to investigate the performance of our proposed method, and the results prove its superiority to its counterparts.


Introduction
Fusion of multisource images that came from different modalities is very useful for obtaining a better understanding of the environmental conditions, for example, the fusion of multifocus images, the infrared (IR) images and visible images, the medical CT images and MRI images, and the multispectrum images and panchromatic images.Nowadays multiresolution based fusion approaches have been one of the popular techniques that is investigated by many researches and proves to present state-of-the-art result [1][2][3][4], including pyramid-based methods and discrete wavelet transform-(DWT-) based methods.In recent years, a new developed compressive sensing (CS) [5][6][7][8] theory is introduced into image fusion.It is well known that the compressive sensing theory provides a possible way of recovering sparse signals from their projection onto a small number of random vectors, so compressive sensing indicated a possible way of recovering high-resolution signals from their low-resolution version.
Assume that a signal x ∈ R  is compressible under a dictionary Ψ ∈ R × : x = Ψ, where ‖‖ 0 =  is the number of nonzero components of .The main idea of CS is to recover the original signal x from its compressive measurements y = Φx ∈ R  , where N ≫ M.Under the condition that the matrix ΦΨ satisfies the restricted isometry property (RIP), the signal x can be accurately recovered from only  ≥  measurements [5], by solving such an optimization problem, Therefore, there are many advantages of combining the CS technique and image fusion application [9][10][11][12][13][14].
Nowadays the applications of compressive sensing technology into image processing can be classified into three categories: compressive sensing based imaging [15][16][17][18][19][20][21], compressive sensing based image processing [22][23][24][25][26], and "compressive sensing" form applications [27][28][29].Imaging is one of the most successful applications of compressive sensing theory, where a few sensors or low-resolution sensors are employed to achieve high-resolution imaging, such as optical imaging [16,17], medical imaging [18,19], and hyperspectral imaging [20,21].Compressive sensing is also used to transform images to other spaces to obtain more efficient analysis, such as the texture classification [22] and superresolution image construction [23].Numerous works are of the "compressive sensing" form applications; that is, if the task can be reduced to the optimization problem shown in 2 Mathematical Problems in Engineering (1), these works are also called compressive sensing based applications.
In image fusion, most of the available compressive sensing based fusion schemes are of "compressive sensing" form [9-14, 27, 28]; that is, they did not consider the simultaneous fusion and super-resolution of multisource images.In this paper, we indicate another solution for simultaneous fusion and super-resolution of multisource images via the recent developed compressive sampling theory.Under the sparsity prior of images patches and the framework of the compressive sensing theory, the multisource images fusion is reduced to a signal recovery problem from the compressive measurements.A set of multiscale dictionaries are learned from some groups of high-resolution sample image's patches via a nonlinear optimization algorithm.Moreover, a new linear weights fusion rule is proposed.Some experiments are taken to investigate the performance of our proposed method, and the results prove its superiority to its counterparts.
The rest of this paper is organized as follows.Our proposed simultaneous fusion and super-resolution scheme of multisource images is expounded in Section 2. In Section 3, some experiments are made to compare the proposed method with other related segmentation approaches.The conclusions are finally summarized in Section 4.

Simultaneous Fusion and Super-Resolution Scheme of Multisource Images
In this section, the foundations of our proposed method are illustrated, including the super-resolution multisource images fusion, the super-resolution multisource images fusion via compressive sensing, and the dictionary learning algorithm used in our approach.

Super-Resolution Multisource Images Fusion.
Assume that the multisource images {Y low  ,  = 1, 2, . . .} to be fused are low-resolution images; that is, the th source images Y low  are a low-resolution version of X high  : where  is the number of source images, M is the downresolution operator, and k  is the measurement noise of the th source image.We aim to recover a high-resolution image X high from the multisource low-resolution images {Y low  ,  = 1, 2, . . .}.

Super-Resolution Multisource Images Fusion via Compressive Sensing.
According to the recent developed compressive sampling theory [5,6], it is capable of recovering x high , ( = 1, . . ., ;  = 1, . . ., ) from y low , under the sparsity prior of x high , ; that is, x high , can be represented as a sparse linear combination by an overcomplete dictionary D high  ∈ R × that is not coherent with the measurement (or sampling) matrix H; that is, Here the "sparsity" of the decomposition coefficient   Therefore, its high-resolution version can be written as In our proposed method, we determine the weights according to the following formula: ) .
Because patches {x high  } are highly redundant and the recovery of X from {x high  } becomes an overdetermined system, it is straightforward to obtain the following least-square solution in the patch aggregation: 2.3.Dictionary Learning Algorithm.The compressibility of patches shown in ( 5) is the sparsity prior used in our method.
In order to generate several overcomplete dictionaries D high  ( = 1, 2, . . ., ) that can represent well the underlying HR patches, we propose an algorithm to adaptively tune the dictionary from a set of High-Resolution multisource sample image's patches.In this section, we will reduce the learning of dictionary D high  ( = 1, 2, . . ., ) as another sparsity-oriented optimization problem.Recent research on image statistics suggests that image patches can be well represented as a sparse linear combination of elements from an appropriately We reformulate (12) as follows: min where Β  = [ 1  ,  2  , . . .,    ] is the coefficients matrix.In order to solve it, the KSVD dictionary learning algorithm is used ( = 1, . . ., ) [30,31].

Experiment Results
For evaluating the performance of the proposed fusion algorithm, in this section we have implemented them on some multisource images, including the multifocus images, infrared (IR) images, and visual images, as shown in Figure 1.The size of all images used in the test is 256 lines × 256 columns and we aim to recover the 512 lines × 512 columns images.We compare our method with the following two related methods.
Method (2).Consider the image features extraction and fusion based on joint sparse representation [33].
For evaluating the performance of the proposed algorithm, the computed results are compared by visual quality subjectively and by some guidelines in fusion.The simulations are conducted in MATLAB R2009 on PC with Intel Core 2/1.8 G/1 G.
The fusion results of three methods are shown in Figures 2, 3, 4, and 5, and from left to right are Method 1, our method, and Method 2. From them we can see that the fusion images of our method can get higher-resolution images at the same time of fusing the multisource images.Compared with the rules in [32,33], our proposed method has better preservation of directional information.The numerical guidelines are shown in Table 1, where some measures including the entropy (), mutual information (MI), average gradient (AG), standard deviation (SD), cross entropy (), universal image quality index (UIQI) [34], and correlation coefficient (CC) are calculated from the fusion images derived by different methods.
Here UIQI is used to estimate the subjective vision effect, which combined the spatial correlation, wrap of mean, and variance together, and it can embody the comparability between the fused image and original images.It is defined as where   is the covariance of the fused source images  and  and   and   are the standard variance and the mean of the image , respectively.From it we can see that the numerical result accords with the subjective result.

Conclusions
In this paper we propose a novel super-resolution multisource images fusion scheme based on compressive sensing and dictionary learning.Under the sparsity prior of images patches and the framework of the compressive sensing theory, the multisource images fusion is reduced to a signal recovery problem from the compressive measurements.A new linear weights fusion rule is proposed.A set of multiscale dictionaries are learned from several groups of high-resolution (HR) sample image's patches, and a higher resolution fusion image can be obtained from multisource images.Some experiments are taken and the results prove its superiority to its counterparts.
can thus be reconstructed by taking only  ≥ ( log ) measurements.As soon as the sparse coefficient  , is determined by and  is the number of elements (or atoms) in the dictionary D  , Y low 2 , . . ., Y low  } with each Y low i = {y low ,1 , y low ,2 , . . ., y low , }.  ∑ =1  , y low , .

Table 1 :
The fusion result of different methods.