Distributed Kalman-Consensus Filtering for Sparse Signal Estimation

A Kalman filtering-based distributed algorithm is proposed to deal with the sparse signal estimation problem. The pseudomeasurement-embedded Kalman filter is rebuilt in the information form, and an improved parameter selection approach is discussed. By introducing the pseudomeasurement technology into Kalman-consensus filter, a distributed estimation algorithm is developed to fuse the measurements from different nodes in the network, such that all filters can reach a consensus on the estimate of sparse signals. Some numerical examples are provided to demonstrate the effectiveness of the proposed approach.


Introduction
In the past few years, the problems of sparse signal recovery have received a great deal of attention since the emergence of the new signal sampling theory which is known as compressed sampling or compressed sensing [1][2][3].Using fewer observations than what is required in the Shannon sample principle, sparse signals can be recovered with overwhelming probability through solving a 1-norm minimization problem.A variety of approaches have been developed for this convex optimization problem, for example, Least Absolute Shrinkage and Selection Operator (LASSO), Basis Pursuit Denoising (BPDN), and Dantzig Selector (DS).
Recently, many researchers have attempted to deal with the sparse signal recovery problem in the classic framework of signal estimation, such as the Kalman filter.In fact, the traditional Kalman filter is not effective for the sparse signals estimation [4]; therefore some improved approaches were proposed.In [5], the problem of reconstructing time sequences of spatially sparse signals was considered.Compressed sensing was used to estimate the support set of the initial signal's transform vector, and a reduced-order Kalman filter was designed to recover the signal.Based on a pseudomeasurement technology of the underlying constrained optimization problem, Carmi et al. proposed a new Kalman filtering approach for the recovery of possibly time-varying sparse signals in [6].In [7], an algorithm based on a hierarchical probabilistic model was proposed, which used reweighted ℓ 1 minimization as its core computation and propagated second order statistics through time similar to the classic Kalman filtering.
Encouraged by the exciting progress on sensor networks and multiagent systems, the distributed technology is having an important role in many fields, such as communication, multirobot systems, and production scheduling.Recently, the study of the distributed estimation or filtering has attracted considerable research interests, and some results have been reported in the literature.In [8,9], a diffusion strategy was established for the design of distributed Kalman filtering and smoothing, in which nodes communicate with their direct neighbors only, and the information is diffused across the network through a sequence of Kalman iterations and data aggregation.A class of diffusion LMS strategies was proposed for distributed estimation over adaptive networks in [10].These methods can make the network with the ability to learn the sparse structure from the incoming data in real time and also track variations in the sparsity of the model.Recently, the consensus protocol has been introduced into distributed 2 Mathematical Problems in Engineering filtering problems.In [11], three types of distributed Kalman filtering algorithms were proposed.A distributed high-pass filter was used to fuse the local sensor measurements based on average consensus, such that the nodes in sensor network track the average measurement of the overall network.The algorithms were established based on the information form of Kalman filter and the analysis of stability and performance of the Kalman-consensus filter was provided in [12].
In this paper, we aim to develop a distributed filtering method to estimate a sparse signal using some measurements from a sensor network.The proposed method is established by means of the Kalman-consensus filter and the pseudomeasurement technology.The remainder of this paper is organized as follows.Section 2 gives a brief overview of the basic problems in compressed sampling and summarizes the Kalman filter with embedded pseudomeasurement equation.A dynamic parameter selection strategy is discussed as well to improve the performance.In Section 3, the Kalman filtering with embedded pseudomeasurement is rebuilt in the information form.The pseudomeasurement equation is introduced into the Kalman-consensus filter to develop a distributed sparse signal estimation algorithm.Simulation results are given in Section 4 to demonstrate the effectiveness of the proposed method.Some concluding remarks are provided in Section 5.
Notation.The notation used here is fairly standard except where otherwise stated.R denotes the set of real numbers, and R  denotes the  dimensional Euclidean space whose elements are  × 1 column vectors.The support set of  ∈ R  is defined as Supp{} := { | () ̸ = 0}, and ‖‖ 0 is the cardinality of Supp{}.

Sparse Signal Estimation Using Kalman Filter
This section briefly overviews some basic concepts in compressed sensing and the method proposed in [6].In order to recover a sparse signal, a pseudomeasurement equation is embedded into the classic Kalman filter.Some more details can be found in [1,6,13].
is an unknown sparse discrete-time process in R  ;   evolves according to the following dynamic model: where   ∈ R × is the state transition matrix; {  } ∞ =0 is a zero-mean white Gaussian sequence with covariance   ⪰ 0 and  0 ∼ N( 0 ,  0 ).The -dimensional linear measurement of   is where   ∈ R × is the measurement matrix and {V  } ∞ =0 is a zero-mean white Gaussian sequence with covariance   ⪰ 0. The scenario we are interested in is the underdetermined case, that is, when  < .
As shown in [1,13],   can be accurately recovered by solving the following optimization problem: But the optimization problem ( 3) is NP-hard and cannot be solved effectively.Fortunately, it has been proved in [1] that if the measurement matrix   obeys the so-called Restricted Isometry Property (RIP), the solution of ( 3) can be obtained with overwhelming probability by solving the following convex optimization problem: For -sparse signal  ∈ R  , only on the order of  =  log  samples are needed to reconstruct it.

Sparse Signal Estimation Using Kalman
Filter with Pseudomeasurement.For the system given in ( 1) and ( 2), the classic Kalman filter can provide an estimate of   which is the solution of the following unconstrained ℓ 2 minimization problem: In [6], Carmi et al. have discussed the stochastic case of (4): and its dual problem By constructing a pseudomeasurement equation where H = sign(   );   is the fictitious measurement noise assumed to obey N(0,  2 ), and the constrained optimization problem (7) can be solved in the framework of Kalman filter.The specific method has been summarized as CSKF-1 algorithm in [6].
In pseudomeasurement equation ( 8), the measurement matrix H is state dependent and it can be approximated by Ĥ = sign( x |−1 ).The divergence of this approximation has been discussed by Theorem 1 in [14].Furthermore,  is a tunable parameter which determines the tightness of the constraint on 1-norm of the state estimate x.In [14], the authors have proved that the performance of CSKF-1 algorithm can be improved by increasing parameter  and the pseudomeasurement update time .However, a big  means a loose constraint on sparseness and thus leads to slow convergence.On the contrary, a tiny  can result in fast convergence, but there is a big overshoot at the beginning and an enormous steady-state error.Therefore, in this paper we employ a dynamic parameter  which increases over time from a specific initial value, for example, set  2 = +, where  determines the initial convergence rate and  determines the increase rate of parameter .By selecting the parameters  and  properly, the convergence rate and the steady-state error of CSKF-1 algorithm can be significantly improved.The effectiveness will be demonstrated by an example in Section 4.

Distributed Sparse Signal Estimation
Kalman-consensus filter (KCF) is a distributed estimation algorithm in sensor networks proposed in [11].A detailed analysis on its stability and performance is given in [12].The KCF is developed based on the information form of Kalman filter by attaching a consensus update structure on the measurement update procedure.In this section, CSKF-1 algorithm will be rebuilt in the information form of Kalman filter, and the pseudomeasurement technology will be embedded in the KCF to develop a distributed sparse signal estimation algorithm in sensor networks.
Consider a sensor network whose topology is represented by an undirected graph G = (V, E, A) of order  with the set of nodes V = {1, 2, . . ., }, the set of edges E ⊆ V × V, and the adjacency matrix A = [  ] with nonnegative adjacency element   .An edge of G is denoted by unordered pair (, ).The adjacency elements associated with the edges of the graph are positive; that is,   > 0 ⇔ (, ) ∈ E. The node  is called a neighbor of node  if (, ) ∈ E and  ̸ = .The set of neighbors of node  is denoted by N  .Assume that G is strongly connected.
Assume that the measurement of sensor node  is in accordance with the linear model (2).Denote  , = [ ], and V , = [ We can get the following augmented measurement equation of sensor : where  , is the measurement matrix of sensor , V , is zero-mean Gaussian white noise with covariance  , , H = sign(   ), and    is the fictitious measurement noise which obeys N(0, The state estimates of (1) from Kalman filter based on {Y 1 , . . ., Y  } can be defined as and the estimate error covariance matrices can be obtained by The inverses of estimate error covariance matrices, Σ |−1 =  −1 |−1 and Σ | =  −1 | , are known as information matrices.According to the information form of Kalman filter, defining where Ω  = sign(  )sign(   ), we can get The state estimate from the filter is and the time update procedure is Equations ( 13)-( 18) have defined the Kalman information filter with embedded pseudomeasurement.
Remark 1. From ( 14) and (15), it is obvious that the introduction of pseudomeasurement equation impacts on the evolution of state error covariance by the sparseness of state since TrΩ  = ‖  ‖ 0 .As mentioned in Section 2, Ω  will be approximated by Ω = sign( x|−1 )sign( x |−1 ) in applications.
Based on the conclusion of Theorem 2 in [12], we can construct the following Kalman-consensus information filter  with embedded pseudomeasurement (KCIF-PM) on each node in the network: x,| = x,|−1 + Σ −1 ,| ( , −  , x,|−1 ) where   = /(1 + ‖Σ −1 ,|−1 ‖  ) and  is a tunable parameter which determines the weight of the consensus update, such that the error dynamics is globally asymptotically stable and all filters asymptotically reach a consensus on state estimates; that is, Remark 2. The global sensing matrix H  is assumed to satisfy the Restricted Isometry Property and the -dimensional global measurement Y  is obtained through the sensor network.It is important that, for any one node in the network, there is no constraint on the dimension of its measurement, which means it can be less than the lower bound  log .
Even though each node can only get a one-dimensional measurement, we can still recover the signal as long as the global measurement meets the lower bound and there are enough communications between nodes.This will be verified by an example in the next section.
Remark 3. Unlike CSKF-1 algorithm, there are no iterative pseudomeasurement updates in the filter.This procedure is implemented simultaneously with the consensus update during the communications between the nodes in the network.
The intact version of the algorithm given by ( 19)-( 24) is summarized as Algorithm 1.

Illustrative Examples
In this section, we will verify the effectiveness of the methods proposed in the previous sections by some numerical examples.

Sparse Signal Estimation Using CSKF-1 with Dynamic
Parameter  2 .In this part, we will test CSKF-1 algorithm with two constant parameters  2 and a dynamic parameter  2 which varies according to a linear function of time.Here, we attempt to estimate a static sparse signal  ∈ R 256 which is 10 sparse.For system (1), we have  =  256 and   = 0.The index  in Supp{} and the values of () are unknown.The sparse signal  is generated by creating the support set from  ∼ U int [1,256] and setting the value () ∼ N(0, 5).The sensing matrix  ∈ R 72×256 consisted of entries sampled according to N(0, 1/72).This type of matrix has been shown to satisfy the Restricted Isometry Property with overwhelming probability.The measurement noise is V ∼ N(0, 0.01 2 ×  72 ).Set x0 = 0; define the a posteriori estimation error   =  − x| .The parameter  2 is set to be 500, 80, and 10 + 19, respectively.The results are shown in Figures 1 and 2. The actual signal  and its estimates with parameter  2 = 500, 80, and 10 + 19 are shown in Figure 1, respectively.It is evident that the best estimate of  can be obtained with the dynamic parameter  2 = 10 + 19.The evolutions of ‖ x‖ 1 and ‖‖ 2 are shown in Figure 2.These results imply that the dynamic parameter  with properly selected  and  can lead to superior performance of CSKF-1 algorithm, on both the rate of convergence and the steadystate error.

Sparse Signal Estimation Using KCIF-PM in All-to-All
Network.In this part, an extreme example is presented to demonstrate the ability of Algorithm 1 to fuse the measurements in the whole network.Assume that each node only gets a one-dimensional measurement, that is,   ∈ R 1×256 with its entries sampled according to N(0, 1/72).Every node  communicates with all the others.Set parameters  2  = 150 + 7 and  = 0.2.As shown in Figures 7 and 8, the 1-norm of all of x reaches to a consensus gradually and converges to ‖‖ 1 .‖  ‖ 2 converges to zero, which means all of the node filters are stable, and satisfactory estimates of the actual signal  can be obtained.

Conclusion
This paper has demonstrated an effective approach to the problem of distributed sparse signal estimation in sensor networks.The filter has been designed by introducing the pseudomeasurement equation into the Kalman-consensus filter.A dynamic parameter selection strategy has been discussed to improve the performance of the existed algorithm.Some numerical examples have verified the effectiveness of the proposed method.In the future, we will try to test our

Figure 1 :
Figure 1: Sparse signal  and its estimate x using CSKF-1 algorithm with different  2 .

Figure 7 :
Figure 7: The sparse signal  and its estimates x using Algorithm 1 in all-to-all network.

2 Figure 8 :
Figure 8: The evolution of ‖ x ‖ 1 and ‖  ‖ 2 in all of nodes in the allto-all network.