Performance Analysis for Distributed Fusion with Different Dimensional Data

Different sensors or estimators may have different capability to provide data. Some sensors can provide a relatively higher dimensional data, while other sensors can only provide part of them. Some estimators can estimate full dimensional quantity of interest, while othersmay only estimate part of it due to some constraints. How is such kind of data with different dimensions fused? How do the common part and the uncommon part affect each other during fusion? To answer these questions, a fusion algorithm based on linear minimum mean-square error (LMMSE) estimation is provided in this paper. Then the fusion performance is analyzed, which is themain contribution of this work.The conclusions are as follows. First, the fused common part is not affected by the uncommon part. Second, the fused uncommon part will benefit from the common part through the cross-correlation. Finally, under certain conditions, both the more accurate common part and the stronger correlation can result in more accurate fused uncommon part. The conclusions are all supported by some tracking application examples.


Introduction
Estimation of the stochastic system state or parameters has wide applications.For example, in target tracking applications, the evolution of the target state can often be represented by a stochastic dynamic system, where the state transition model is driven by some process noise.The observations of the measurement model are also corrupted by some measurement noise in general.Since the state model and measurement model are both stochastic, the output of the estimators, for example, a Kalman filter, is also stochastic.When there are multiple sensors or estimators, the data fusion techniques are usually used for potential better estimation purpose.
Data fusion is the problem of how to utilize useful information contained in multiple sets of data for the purpose of estimation of an unknown quantity-a parameter or a process [1].The most common situation is that the data to be fused are of the same dimensions.But, in some cases, the data of different dimensions may need to be fused.The following are some examples to show the different dimensional data fusion in target tracking applications.
Measurement-to-Measurement Fusion.Suppose that we have two radars, A and B. Radar A can sense target 1 and target 2 simultaneously, while radar B can only sense target 1.Then the measurement-to-measurement fusion for such a scenario is a fusion problem with different dimensionalities.
Track-to-Track Fusion.Constant velocity (CV) model based estimator can only provide estimation of position and velocity, while constant acceleration (CA) model based estimator can provide estimation of position, velocity, and acceleration.The fusion of such two estimators is also a fusion problem with different dimensionalities.This is very common in maneuvering target tracking using the interacting multiple model (IMM) algorithm.

Measurement-to-Track Fusion.
A CV model based estimator provides the target's state estimation of position and velocity, while a sensor (a radar or GPS) provides the target's position measurement.This is a measurement-to-track fusion problem with different dimensional data.
The reason for such phenomenons is that some sensors or estimators may be subject to some constraints compared to the full dimensional data provider.In the above examples, radar B may have narrower coverage than radar A; the CV model based estimator cannot provide acceleration estimation due to the model itself; the sensor cannot provide target velocity measurement because of its sensing capability.
For such kind of fusion with different dimensional data, how to deal with the uncommon part is a problem which needed to be considered.A simple way is to abandon the uncommon part when fusing.This is quite natural but some useful information will be lost.To fully use all available information, an LMMSE estimator is provided in this work.In fact, if the uncommon part and the common part have some kind of cross-correlation, the correlation will help in fusion.
The relationship between the correlation and the estimator's performance has been discussed in some literatures.For example, Doppler radar's range and range rate measurement errors are often correlated.Reference [2] concluded that negative correlation has the best tracking performance.With more detailed simulation and analysis, [3] concluded that, for steady state estimation, negative correlation has the best tracking performance, positive correlation is not always worse than without correlation.Reference [3] also discussed the coefficient selection strategy for one step state estimation.Reference [4] proposed a fusion algorithm in which local estimates have correlations.Reference [5] analyzed the fusion performance with the correlation for the scalar case.Reference [6][7][8][9] also disscussed the fusion algorithm in the existence of correlation.Although these literatures discussed the relationship between correlation and the fusion performance, the fusion performance analysis of the different dimensional data fusion is very rare.To reveal the factors which affect the fusion performance, the performance is analyzed in this paper.
The rest of the paper is organized as follows.Section 2 is the problem formulation part.Fusion algorithm is proposed in Section 3. Performance analysis is given in Section 4, which is the main contribution of this work.Some examples are given in Section 5 and Section 6 is the conclusion.

Problem Formulation
In general, filter or model's output can be seen as an estimator.In this work, for the unification of the problem formulation, sensor's measurement is also treated as an "estimator" in which the filter's output is the same as the input, the original measurement.
The following problem is considered.There are two estimators.One can provide the full dimensional estimate of an estimand (the quantity to be estimated), and the other can only provide partial estimate of the estimand.In this paper, the estimators are stochastic, which means estimators are affected by some noises.
Assume  is the estimand, which can be written as  = [    ]  .
Estimator 1 is as follows: Estimator 2 is as follows: It can be seen that  is the common part and  is the uncommon part.The dimensions of those vectors are The mean, covariance, and cross covariance of the noises are where  1 ,  2 > 0 means  1 ,  2 are positive definite matrices.Since the distributional information needed for the evaluation of the conditional mean is not always available, the linear minimum mean-square error (LMMSE) estimator is often used in practice.LMMSE estimator yields the estimate as a linear function of the observation and requires only the first two moments.It is a widely used estimation method.

Fusion Algorithm with Different Dimensional Data
Consider the vector-valued random variables  and , where  is a measurement of .The best estimate of  in terms of  in LMMSE sense [10] is where  is the prior mean of ,   is the prior covariance matrix of ,  is the prior mean of , and   is the prior covariance matrix of .  is the cross covariance matrix between  and .
The LMMSE estimator of one random vector in terms of another random vector (the measurement) is such that the estimation error is (1) zero-mean, (2) uncorrelated from the measurements.LMMSE estimator has the following properties.
(1) It is the best estimator (in the MMSE sense) for Gaussian random variables.
(2) It is the best estimator within the class of linear estimators.
LMMSE estimation is essentially known as best linear unbiased estimation (BLUE) [1], which is proved to be identical to the linear weighted least squares (WLS) estimation [11].

Fusion Algorithm Using the LMMSE Estimation. Since X1
can provide the full estimate of , X1 can be regarded as the prior information.The prior information is as follows: = cov ([ Next, X2 is regarded as the measurement.Since X1 is the prior information, The cross covariance between the prior information and the measurement is then ] . ( Here it is assumed that   > 0, which means  or x2 can also provide some new information.
The LMMSE fuser for this problem is the following: It is the updated covariance  | which is used for performance analysis. | can be rearranged as where   stands for the updated  part's (common data) covariance matrix: It is the same as the fusion algorithm in [4].  stands for the updated  part's (uncommon data) covariance matrix: It is affected by the  part.The following performance analysis is on the updated uncommon part ( part).From (12), it is very clear that the fused common part will not be affected by the uncommon part.

The Cross-Correlation's Impact on the Fused Uncommon
Part.From (13), it can be easily seen that the fused uncommon part is affected by the common part.First, some properties of the positive matrix are introduced.If ,  ∈  × are positive definite matrices, then they have the following properties [12].
Before fusion, the covariance matrix of  part is   11 .After fusion, it becomes   .From (13), it can be seen that where   =  Proof.Because   > 0, from Property (II), it follows that  −1  > 0.
The conclusion can then be directly obtained from (14) and Property (I).
It can be seen from ( 14) that if   = 0,   11 −   = 0 The following are the conclusions from the above.
(1) If   = 0, which means there is no cross-correlation between  and , the fused uncommon part will be the same as the unfused one.
(2) If rank(  ) = , which means the cross-correlation is full row rank, the fused uncommon part is definitely better than the unfused one.
If   ̸ = 0 and rank(  ) < , the following shows which component of  will benefit from the fusion.Assume that where    ,  = 1, . . ., , are row vectors.If only the th component of  is considered, the following corollaries can be obtained.Proof.It can be seen from ( 14) that  It can be seen from Corollary 2 that if one certain component of the uncommon part  is cross-correlated with the common part , then its fused result is better than the unfused one.Proof.If  = 1, then   is a row vector.
It can be seen from Corollary 3 that if the uncommon part  is a scalar and the cross-correlation exists, the fused result is better than the unfused one.It can be seen from Theorem 4 that increasing the independent common part's accuracy can improve the fused performance of uncommon part.

The Accuracy of the Independent Common
The following two corollaries can be easily obtained.The proof is similar to that of Corollaries 2 and 3 and will be omitted here.
Corollaries 5 and 6 are the supplement of Theorem 4 for the single component case and scalar case, which also mean that increasing the independent common part accuracy can improve the fused result of the uncommon part.
where  , is the correlation coefficient.
It can be seen from Theorem 7 that under some condition, stronger cross-correlation can result in better fused result.
When  = 1,    is a scalar, and the corresponding correlation coefficient is   .The following corollary can be obtained.
The proof is the same as that of Theorem 7. It can be seen from Corollary 8 that if the common part is a scalar, stronger cross-correlation can lead to better fused result.to be the common part and acceleration is considered to be the uncommon part.Assume the two estimators are independent.

Illustrative Examples
Assume there is a target moving with constant velocity motion.Two estimators are used to estimate the target's state.
It can be seen that without cross-correlation, the performance of the uncommon part cannot be improved.
However, with correlation, we have 6.33 < 10, which means that the existence of cross-correlation can help improve the fusion result.]  and , respectively.The corresponding covariance matrices are

The Examples for
After fusion, ) .
When  2 = 10, the covariance after fusion is Since 7.73 < 8.75, it can be easily seen that more accurate common part estimation can lead to more accurate fusion result.
Figure 3 shows  ṙ as a function of  2 2 , which changes from 0 to 10. From the figure, it can be clearly seen that when improving the regular radar's range accuracy, the range rate accuracy will be improved.

The Example for the
Since 5.95 < 8.75, it can be easily seen that stronger correlation can lead to better fusion result.
Figure 4 shows  ṙ as a function of ||, which changes from 0 to 1.
It can be seen that the stronger the correlation, the better the fused result.decreases,  ṙ will decrease.And if || → 1 and  2 2 → 0,  ṙ → 0.
Figure 5 shows  ṙ as a function of  2 2 and ||.Figure 5 supports the conclusion that fusion result benefits from stronger correlation and more accurate common part.

Conclusion
Some sensors or estimators can provide higher dimensional measurement or estimation.But due to some constraints, other sensors or estimators can only provide partial measurement or estimation.To fuse such kind of data with different dimensions, a fusion algorithm based on LMMSE estimation is provided.To reveal the relationship between the common part and the uncommon part, the fusion performance is analyzed and the following four conclusions are obtained.(1) The fused common part is not affected by the uncommon part.(2) The fused uncommon part benefits from the common part through the cross-correlation.(3) The more accurate independent common part will result in better performance of the fused uncommon part.(4) In some cases, stronger cross-correlation will result in better performance of the fused uncommon part.The above conclusions are all supported by some target tracking examples.

4. 1 .
The Uncommon Part's Impact on the Fused Common Part.

4. 4 .
The Level of Correlation's Impact on the Fused Uncommon Part.Assume that    () is the th component of vector    and it is the only nonzero component of    :

3 )
One estimator uses the CA model and the other one uses the CV model.The two estimators' initial covariance matrices are  CA position can be observed by the sensors and the measurement noise variances are both  = 100.The sampling interval is  = 1.Both estimators' updated state covariance matrices are achieved by the Kalman filter.Because the CV model cannot provide estimation of the acceleration part, there are two ways to achieve the acceleration's estimation.One way is to use the CA model's acceleration estimation directly and the other way is to use the fusion result.Figure1shows the acceleration variance of the two ways.Acceleration estimate from the CA model is always correlated with the velocity and position estimates because of the state equation.The fusion results should benefit from the correlation and Figure1supports this analysis.The following are some analyses for one step fusion.Assume the covariance matrices of the two models are  CA cross covariance vector between the common part and uncommon part is   = [6 8].Using(10), the fusion result is Acceleration variance fusion with R = 100 Acceleration variance fusion with R = 1

Figure 2 :
Figure 2: Acceleration fusion performance enhancement with more accurate estimator.

Figure 3 :
Figure 3: The relationship between regular radar's range accuracy and fused range rate accuracy.
Part's Impact on the Fused Uncommon Part.Assume that estimator X2 can be obtained with different precision.The covariance matrix of higher precision is   22, and the covariance matrix of lower precision is   22, .The corresponding fused covariance matrix of  is 12 = 0 and   12 = 0, the following theorem can be obtained.Theorem 4.Under the condition that X1 and X2 are independent, if rank(  11 ) = , then

Theorem 7 .
Under the condition that there is only one nonzero component in    , if the absolute value of the correlation coefficient | , | increases, the fused covariance   (, ) will decrease.Proof.If there is only one nonzero component in Increasing the Accuracy of the Independent Common Part to Improve the Fusion Result Example 2. The simulation setting is the same as in Example 1, which is a CA-CV fusion problem.In Example 2, CA model is the same as in Example 1, CV model's measurement is more accurate than in Example 1, and the measurement noise variance is  = 1.There are two radars which observe the same target.One is a Doppler radar, which can provide range and range rate measurements.The other is a regular radar, which can only provide range measurement.Doppler radar's range and range rate measurement errors are sometimes correlated.The two radars' measurement errors are independent of each other.The state vectors are [ ṙ