Track-to-Track Association Based on Structural Similarity in the Presence of Sensor Biases

. Thepaper addressestheproblem of track-to-track association in thepresence of sensorbiases. Insomechallenging scenarios, it may be infeasible to implement bias estimation and compensation in time due to the computational intractability or weak observability about sensor biases. In this paper, we introduce the structural feature for each local track, which describes the spatial relationship with its neighboring targets. Although the absolute coordinates of local tracks from the same target are severely different in the presence of sensor biases, their structural features may be similar. As a result, instead of using the absolute kinematic states only, we employee the structural similarity to define the association cost. When there are missed detections, the structural similarity between local tracks is evaluated by solving another 2D assignment subproblem. Simulation results demonstrated the power of the proposed approach.


Introduction
The potential advantages of fusing information from disparate sensor systems to achieve better surveillance have been recognized.Track-to-track association [1,2] is a crucial step in the distributed estimation fusion system, which seeks to determine the correspondence between local tracks from different sensors.Unfortunately, sensor reports may be influenced by systematic errors (sensor biases) besides random errors.In this case, sensor registration [3,4] is required to remove the sensor biases from the biased reports.When track association and sensor registration meet each other, there are more challenges.On the one hand, sensor registration is based on the common sensor reports from the same target.On the other hand, the removal of the sensor biases contributes greatly to making correct association assignments.In this sense, sensor registration and track association are tightly coupled together.
An alternative way to tackle this problem is to implement bias estimates and track-to-track association jointly.Several heuristic algorithms, including centroid matching and singleton matching algorithms, for estimating the relative sensor biases in track-to-track association were explored in [5].Considering the effects of biases, Stone et al. estimated the relative biases based on the fast Fourier transform (FFT) and multiple dimensional spatial cross-correlation function in [6].In [7], Levedahl modeled this problem as a global nearest pattern (GNP) problem.It produced the bias estimates for each association hypothesis firstly, and the association probability was computed based on the given bias estimates.The final association hypothesis was determined with the maximum probability.In [8], Papageorgiou and Sergi optimized the computation complexity of the GNP algorithm to get the trading-off between the optimality and computation time.In [9,10], Papageorgiou et al. computed the pure association probability by assuming a prior distribution of sensor biases.However, it is hard to get the prior distribution of sensor biases.A joint track association and relative bias estimation problem was formulated and a solution based on the Dijkstra search was developed in [11].A solution based on the branchand-bound framework for the same problem was described in [12].In [13], the performance comparisons of several algorithms for estimating relative sensor bias were given.In [14], a feature called "reference topology" based on the relative coordinates is presented.However, its association performance depends on the granularity of cell partitions greatly.Moreover, no systematic method is given to handle the case of missed detections.In [15,16], the joint approaches to data association, sensor registration, and track fusion were given by means of the expectation-maximization (EM) algorithm.
In some challenging scenarios, it is impossible in practice to implement bias estimation and compensation in time due to the computational intractability or weak observability about sensor biases.In this paper, we turned to implement track-to-track association without bias estimation.As we know, it is extremely essential to establish a reasonable metric to measure the similarity of local tracks in trackto-track association problem.In general, the similarity of local tracks is based on the absolute kinematic parameters.However, the absolute kinematic parameters are corrupted greatly in the presence of sensor biases.For example, when given the azimuth bias of 3 degrees, the position deviation could reach up to 10 kilometers for a target located 200 km from the sensor.In this case, the similarity measure based on absolute coordinates is unbelievable anymore.In this paper, we introduce the structural feature for each local track describing the spatial relationship with its neighboring targets.Although the absolute coordinates of local tracks from the same target are severely different in the presence of sensor biases, their structural features may be similar.So, instead of using the absolute kinematic states only, we employ the structural similarity to measure the distance of two local tracks from different sensors.
In this paper, we develop a structural similarity-based approach to deal with the problem of track association in the presence of sensor biases.Main contributions are given as follows.Firstly, under appropriate assumptions, the distance invariance between two targets detected by different sensors is verified in the presence of sensor biases.Secondly, the structural feature is introduced for each local track, which is represented by the distance set from the track to all the other tracks from the same sensor.Thirdly, a two-dimensional (2D) assignment model is established to implement track-to-track association in the presence of sensor biases.Instead of using the absolute kinematic states only, the structural similarity between local tracks is adopted to measure the association cost and is evaluated by solving another 2D assignment subproblem.Moreover, the dummy track is introduced for each sensor to cope with possibly missed detections.Simulation results demonstrated the power of the proposed approaches.
The rest of the paper is organized as follows.In Section 2 we describe the measurement model and formulate the problem of track-to-track association.Section 3 shows how to implement the track association based on structural similarity.Simulation results are given in Section 4 to demonstrate the effectiveness of the proposed approaches.Finally, concluding remarks and further research directions are in Section 5.

Problem Formulation
Consider a multitarget tracking scenario with two sensors and   targets in the surveillance region.In this paper, false alarms are not considered since they can also be viewed as the targets.In references with the radar sensor which measures the range and azimuth to the target, the measurement process is implemented in the local polar coordinate system (LPCS).Let  , ≜ { , ,  , } be the ith measurement ( = 1, 2, . . .,   ) from sensor  ( = 1, 2) at the time instant , in which  , and  , mean the range and angle measurement, respectively.
Two kinds of sensor biases are considered in general: range bias and azimuth bias.Since there are systematic biases and random errors, the original measurement { , ,  , } from sensor m can be modeled as where  2 , respectively.Figure 1 depicts a scenario with two sensors and two targets.T  (  ,   ) and T  (  ,   ) are the real positions of targets.T , ( , ,  , ) and T , ( , ,  , ) are the position measurements given by sensor  ( = 1, 2).
Based on the biased measurements { , ,  , }, each sensor  produces its own local tracks represented by two tuples {x , , P , } ( = 1, 2;  = 1, 2, . . .,   ).x, and P , mean the state estimate and error covariance, respectively.For simplicity, we omit the time index here.Track-to-track association seeks to determine the correspondence between local tracks from different sensors.The key point is to measure the similarity of local tracks.Traditionally, it is defined by the weighted statistical distance under the independence assumption: However, local tracks are biased estimates in the presence of sensor biases.The direct association of biased estimates will not produce a satisfactory result.

Track Association Based on Structural Similarity
In traditional approaches to track-to-track association, only the absolute kinematic states of targets are considered.In the presence of sensor biases, it does not work well especially for the large azimuth bias, since it may result in severe deviations of absolute coordinates.In this section, the basic principle of the structural similarity is firstly verified, and then the structural similarity is used to measure the distance of local tracks instead of using the absolute kinematic states only.A complete 2D assignment model to deal with possible missed detections is also addressed.

Basic Principle of Structural Similarity.
In what follows, by assuming small range biases, the distance invariance between two targets detected by different sensors is verified in the presence of sensor biases.We introduce a structural feature for each local track, which describes the spatial relationship with its neighboring targets.According to the distance invariance, the structural feature of local tracks from the same target is similar.As a result, the structural similarity is employed to define the association cost between local tracks.
The random error Ṽ ( = 1,2) is ignored in the following derivation for the simplicity; thus we have In the absence of sensor biases, the real position measurement of the target state is In the presence of sensor biases, it becomes Manipulating the items in the above equations, we have From ( 6), it can be observed that the range bias Δ  brings about the translation for targets, and the azimuth bias Δ  produces the rotation and also contributes to the translation of targets when the range bias is nonzero.Moreover, the azimuth bias is the critical factor compared with the range bias, which produces more severe influence on the target's abstract coordinate and will be enlarged as the distance from the sensor to the target increases.
The real squared distance between two targets T  and T  is For sensor  ( = 1, 2), the squared distance  2  (T  , T  ) between two position measurements T , and T , is In this way, the difference between  2  (T  , T  ) and  2 (T  , T  ) can be expressed by From ( 9), it is seen that the difference  is only influenced by the range bias Δ  and the real position of the target but is independent of azimuth bias Δ  .This reveals that although the azimuth bias may cause a severe impact on the absolute coordinate, it causes less impact on the relative coordinate.When the range bias is too large, the difference  may be severe.Fortunately, the range bias in practical applications is generally at a low level.That means that the distance between two targets detected by different sensors differs slightly, which is less sensitive to sensor biases.In what follows, we employ the structural similarity to measure the distance between two local tracks from different sensors.

2D Assignment Model for Track Association.
As we know, it is very important to establish a reasonable metric to measure the similarity of local tracks from different sensors.This problem becomes extremely complicated in the presence of sensor bias, random errors, and missed tracks.Figure 2 Measurement from sensor 1

Measurement from sensor 2
In which measurements from the same target  illustrates a scenario with two sensors and six targets.Here, sensor 1 detects 4 targets, and sensor 2 detects 5 targets.That means that  1 = 4,  2 = 5, and there are 3 common targets.
For the scenario in Figure 2, a graphical representation of track association is shown in Figure 3.We introduce a node for each local track.To deal with possible missed detections, a dummy node is introduced for each local sensor which provides the access to link an isolated track with the dummy track.The edges mean possible links between different local tracks.
In the following, a 2D assignment model with given constraints is established by minimizing the sum of all pairwise costs: min (10)

Association Cost of Local Nodes Based on the Structural
Similarity.The model ( 10) can be solved efficiently and optimally by the general 2D assignment algorithms, such as auction algorithm and Hungarian algorithm.Now, the remaining problem in solving (10) is how to define the connecting cost   1  2 .Instead of using the absolute kinematic states only, the structural similarity of local tracks is employed here.Three kinds of costs need to be specified: between local tracks, between dummy tracks, and between local track and the dummy track.
Firstly, we define a structural feature for each node    ( = 1, 2;   = 1, . . .,   ), which is represented by the set    including all the distances from local track   to  ( = 1, 2, . . .,   ,  ̸ =   ); that is, We discuss the definition of   1  2 in terms of the following three cases.
As far, a complete 2D assignment subproblem ( 13) is well defined.By solving it, the optimal fitness  *  1  2 can be obtained.It is noted that   1  2 cannot be defined directly by  *  1  2 ; further processing is required considering possible isolated tracks.We denote the number of valid associations by , which is defined as the number of association assignments between local tracks (not with dummy nodes).If  is close enough to the expected number  of common targets (| − | ≤ ,  is a small positive integer), then   1  2 =  *  1  2 .Otherwise, set   1  2 = Γ, where the expected number  of common targets is computed by It is proportional to the detection probability (3) Connection Cost with Dummy Node.When a local node ( 1 or  2 ) is declared isolated, we set  0 2 =   1 0 = 10 −2 Γ to encourage it to link with the dummy node.In addition, we set  00 = Γ to discourage the association between dummy tracks.

Discussions
(1) Approximation Solution Based on the Nearest Neighborhood Method.A new approach to track-to-track association in the presence of sensor biases is given in Sections 3.2 and 3.3, which requires solving two 2D optimal assignment models.One serves to compute the connecting cost between two local tracks, and the other one is to determine the final association assignment between two sets of local tracks.To simplify, we call this method "structural similarity-based 2D assignment" (SS-based 2D assignment).Considering the complexity of the proposed model, an approximation solution can be obtained by using the nearest neighborhood (NN) method when determining the final association assignment, instead of using the optimal assignment.Such a scheme is denoted by structural similarity-based nearest neighborhood (SS-based NN).Simulation results provided before indicate that such an approximate method can also provide a better association result, because the structural property is considered when constructing the connection cost between local tracks.
(2) Possible Extensions.In practical fusion applications, heterogeneous sensors are commonly found.The proposed approach can also work well in this case, since what we handle here are local tracks after local processing.Although the measuring process is implemented in the local measurement coordinate system, local tracks from heterogeneous sensors may be in the common Cartesian coordinate system.In addition, in short-range applications or for maritime surveillance, different scattering centres of the objects under consideration may give rise to several distinct detections.At this time, what one is concerned with includes the state for both the target kinematics and the target extension.The proposed approach fails to deal with the case that the targets have more than one scattering centers.Readers may refer to literatures concerning extended target tracking [17,18].It is still a problem which few people get into to implement trackto-track association between extended targets.

Simulation Results
4.1.Scenario Setup and Results.In this section, we provide some simulation results to illustrate the efficiencies of the proposed approaches ("SS-based 2D assignment" and "SSbased NN").Here, we consider a multiple target tracking scenario with two sensors.At the beginning of the tracking process, 30 targets are distributed uniformly in the region [20 km, 40 km]×[20 km, 40 km].The motion of all the targets follows the constant acceleration (CA) model with acceleration 1 m/s 2 .The process noise is assumed white Gaussian with zero mean and covariance matrix  = (0.1 m/s 3 )I 2 , where I 2 is an 2 × 2 identity matrix.The initial direction of velocity occurs randomly in [0, 2] with the amplitude 100 m/s.The sample interval  is set to 1 s, and the tracking time is 30 s. Two sensors are located at (40000 m, 5000 m) and (15000 m, 10000 m) in the global Cartesian coordinate system (GCCS), respectively.Each sensor measures the range and angle to the target.The random range error for both sensors is modelled as white Gaussian noises with the standard deviations  1  = 30 m and  2  = 40 m, respectively.The random angle error is also modelled as white Gaussian noises with standard deviations  1  = 0.2 ∘ and  2  = 0.1 ∘ .Both of the sensors employ EKF to obtain the local tracks based on their own measurement information.The measurements are supported by 50 Monte-Carlo runs performed on the same target trajectories but with independently generated measurements for each trial.Except for the special declaration in the following simulations, the detection probabilities of the two sensors are   1 = 0.8 and   2 = 0.7; the systematic biases are set to Δ 1 = 400 m, Δ 2 = 500 m, Δ 1 = 6 ∘ , Δ 2 = −5 ∘ .
Performance comparisons are made between the proposed approaches and the competing algorithms.In competing algorithms, the square Mahalanobis distance is chosen as the similarity measure of two local tracks.The final association assignment is determined based on the 2D assignment algorithm and the nearest neighborhood (NN) algorithm, respectively.To simplify, they are called "bias-ignorant 2D assignment" and "bias-ignorant NN. " We adopt the probability of correct association   () at the time  to evaluate the association performance: where   () denotes the number of tracks with correct association at time  at the th Monte-Carlo run,  is the total number of Monte-Carlo runs, and  is the number of targets.The average probability of correct association   is computed by where  is the overall tracking time.
Figure 5 shows sensor locations and target trajectories during the whole tracking time in one run.The probability comparison of the correct association via the tracking time is shown in Figure 6.
Figures 7-10 illustrate the average probabilities of correct association via different detection probability, angle bias, range bias, and the total number of targets, respectively.In Figure 7, the detection probability   1 of sensor 1 is set to 0.8, and the detection probability   2 of sensor 2 varies from 0.5 to 1.In Figure 8, the angle bias Δ 1 of sensor 1 is 1 ∘ , and the angle bias Δ 2 of sensor 2 varies from 0 ∘ to 7 ∘ .In Figure 9,   the range bias of sensor 1 Δ 1 varies from 0 m to 1000 m, and the one of sensor 2 Δ 2 is 500 m.In Figure 10, the total number of targets varies from 10 to 70. 6-10, it is shown that the proposed "SS-based 2D assignment" and "SS-based NN" outperform the competing algorithms.Moreover, "SS-based NN" is inferior to "SS-based 2D assignment" just a little bit due to the fact that the structural property is considered when constructing the association cost.From Figure 8, it is seen that, as the angle bias increases, the association performances of the "bias-ignorant 2D assignment" and "bias-ignorant NN" experience severe degradations.However, the proposed approaches still perform well, which are insensitive to the angle bias.In addition, it is observed from Figure 10 that the probabilities of correct association given by all methods  decrease to some extent as the total number of targets becomes large.

Result Analysis. From Figures
Although the proposed approach performs well in the simulation experiments, it has some flaws.Firstly, the range bias is assumed to be a small one when using the proposed approach; otherwise, the distance invariance between two targets detected by different sensors cannot hold.Secondly, it is required to solve a 2D assignment model when computing the association cost.Doing so may result in a high computational burden, especially for a large number of targets.

Conclusions
The sensor reports are disturbed by not only random errors, but also sensor biases.When track-to-track association and sensor registration meet each other, some challenging problems arise since they are tightly coupled together.In this paper, instead of using the absolute kinematic states only, the structural features of local tracks are employed for track-totrack association in the presence of sensor biases.A complete 2D assignment model for track-to-track association is given to deal with possibly missed detections.Lots of simulation results demonstrated the power of the proposed approaches.Further work includes the utilization of multiscan information and the extension of the proposed approach to the multisensor case.

Figure 2 :
Figure 2: Distribution of measurements from different sensors.

Figure 3 :
Figure 3: Graphical representation of track association problem.

3 Figure 4 :
Figure 4: Graphical representation of 2D assignment subproblem to compute the cost  23 .

Figure 6 :
Figure 6: Probability of correct association via the whole tracking time.

Figure 7 :
Figure 7: Average probability of correct association via different detection probabilities.

Figure 8 :
Figure 8: Average probability of correct association via different angle biases.

2 Figure 9 :
Figure 9: Average probability of correct association via different range biases.

Figure 10 :
Figure 10: Average probability of correct association via the total number of targets.
, and