Discrete Dynamics in Nature and Society
Volume 2015 (2015), Article ID 809734, 11 pages
http://dx.doi.org/10.1155/2015/809734

Research Article

Kalman Filtering for Discrete Stochastic Systems with Multiplicative Noises and Random Two-Step Sensor Delays

Dongyan Chen,¹ Yonglong Yu,¹ Long Xu,¹ and Xiaohui Liu2,3

¹Department of Applied Mathematics, Harbin University of Science and Technology, Harbin 150080, China
²Department of Computer Science, Brunel University London, Uxbridge, Middlesex UB8 3PH, UK
³Faculty of Engineering, King Abdulaziz University, Jeddah 21589, Saudi Arabia

Received 4 January 2015; Accepted 25 January 2015

Academic Editor: Zidong Wang

Copyright © 2015 Dongyan Chen et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

This paper is concerned with the optimal Kalman filtering problem for a class of discrete stochastic systems with multiplicative noises and random two-step sensor delays. Three Bernoulli distributed random variables with known conditional probabilities are introduced to characterize the phenomena of the random two-step sensor delays which may happen during the data transmission. By using the state augmentation approach and innovation analysis technique, an optimal Kalman filter is constructed for the augmented system in the sense of the minimum mean square error (MMSE). Subsequently, the optimal Kalman filtering is derived for corresponding augmented system in initial instants. Finally, a simulation example is provided to demonstrate the feasibility and effectiveness of the proposed filtering method.

1. Introduction

The filtering problem has been a mainstream research topic in the control theory due to its wide and important engineering applications such as signal processing, econometrics communication, guidance, navigation, and control of vehicles [1–4]. Kalman filtering, also known as linear optimal quadratic estimation, has attracted much research interests due to its good filtering performance and simple filtering structure [5, 6]. In [7], based on the minimum mean square error (MMSE) principle and the projection theory, the traditional Kalman filtering algorithm has been proposed for a class of linear discrete stochastic systems. Subsequently, the Kalman filtering problems have been widely investigated for different systems [8, 9]. For the nonlinear model, the theoretical results of the extended Kalman filter (EKF) have been proposed and applied in many practical engineering problems [10–13]. For example, in [14], the EKF algorithm has been employed to deal with the mobile robot localization problem with intermittent measurements, where the cases of missing measurements and uncertainties have been addressed. For the microelectromechanical systems, a new terminal sliding-mode control scheme has been designed in [15] by using the EKF observer.

During the processes of signal measurement, transmission, and computation, the sensor delays are frequently encountered and are inevitable especially in the networked systems [16–21]. The existence of the sensor delays would deteriorate the filtering accuracy and even influence the control system performance [22–26]. Hence, it is not a surprise that a great number of results have been reported to handle the Kalman filtering problems with the sensor delays [8, 9, 27]. To mention a few, the optimal Kalman filtering problem has been investigated in [8] for linear discrete system with sensor delays, packet dropouts, and uncertain observations. It has been shown that a unified augmentation method has been proposed in [8] by applying the projection theory and recursive projection formula, which can reduce the amount of correlated parameters. Motivated by the method in [8], the optimal Kalman filtering algorithm has been given in [9] for the systems with random sensor delays. Based on the unbiasedness and MMSE of the optimal Kalman filtering, the recursive optimal Kalman filtering approaches have been developed in [27, 28] for linear stochastic systems with random sensor delays. Compared with the methods in [27, 28], the developed approach in [9] can reduce the amount of correlated parameters when tackling the optimal filtering problem for systems with random sensor delays.

Note that a great deal of effort has been devoted to address the problems of optimal Kalman filtering with one-step sensor delay in the past years [29, 30]. Nevertheless, it should be pointed out that randomly occurring two-step sensor delays are also encountered in some networked systems [31]. Recently, the case of the noisy observation measurements with random one-step or two-step sample delays has been investigated and a novel unscented filtering algorithm has been given in [31] for a class of nonlinear discrete-time stochastic systems. On the other hand, it is necessary to deal with the multiplicative noises when designing the Kalman filtering [32–34]. The optimal nonfragile Kalman-type filtering problem has been investigated in [32] for a class of systems with multiplicative noises, finite-step autocorrelated measurement noises, and multiple packet dropouts, where the state-dependent multiplicative noises have been used to account for the stochastic uncertainties. In [33], a new nonlinear filter has been constructed to attenuate the effects from the multiplicative noises and the signal quantization. In [34], the linear minimum mean square estimator has been designed for linear discrete-time systems with state and measurement multiplicative noises and Markov jumps on the parameters. It is worth pointing out that, however, the optimal Kalman filtering problem has not been investigated for linear stochastic systems with multiplicative noises and random two-step sensor delays yet.

Motivated by the above discussions, in this paper, we aim to discuss the problem of optimal Kalman filtering for linear discrete stochastic system with multiplicative noises and random two-step sensor delays. The state-dependent multiplicative noises are considered to account for the stochastic uncertainties. The phenomena of two-step sensor delays may happen in data transmission and are described by using three Bernoulli distributed random variables with known conditional probabilities. Based on the MMSE estimation principle, the optimal Kalman filtering problem has been discussed for system with multiplicative noises and random two-step sensor delays. Firstly, we consider a general case for the original system where . By using the state augmentation approach and the projection theory, the optimal Kalman filtering algorithm has been given for augmented system. Then, the optimal Kalman filtering for the original system can be obtained easily. Secondly, we discuss the initial case when () and give some parameters to help algorithm developments. The main contributions of this paper can be highlighted as follows: (1) the system model is more general where the multiplicative noises and randomly occurring two-step sensor delays are considered simultaneously and (2) a new Kalman filter is designed to handle the addressed complex phenomena. Finally, an illustrative example is provided to verify the feasibility and effectiveness of the proposed result.

The rest of this paper is organized as follows. In Section 2, the problem addressed is formulated and some preliminaries are briefly introduced. In Section 3, a new Kalman filtering algorithm is proposed to deal with the systems with multiplicative noises and random two-step sensor delays and the explicit form of the filter gain is given. In Section 4, an illustrative example is used to show the effectiveness of the proposed filtering method. Finally, we provide the conclusions in Section 5.

Notations. The notations used throughout the paper are standard. and denote the -dimensional Euclidean space and the set of all matrices, respectively. For a matrix , the and represent its transpose and inverse, respectively. stands for the expectation of a stochastic variable . stands for a block-diagonal matrix with matrices on the diagonal. and represent the identity matrix and the zero matrix with appropriate dimensions, respectively. Matrices are assumed to be compatible with algebraic operations if their dimensions are not explicitly stated.

2. Problem Formulation and Preliminaries

In this paper, we consider the following class of discrete uncertain stochastic systems with multiplicative noises and random two-step sensor delays:

where is the system state vector to be estimated, is measured output, and is measurement received by the sensor. and are uncorrelated white noises with zero means and variance matrices and . and are multiplicative noises with zero means and unity covariances and are uncorrelated with other noise signals. , , , , and are known real time-varying matrices with appropriate dimensions.

The random variables obey the Bernoulli distribution and have the following statistical properties:

where are known positive scalars. Assume that are mutually independent of other noise signals.

Remark 1. As in [31], for , if , , and in model 3, one has ; that is, the sensor receives the data at the time instant ; if , , and , one has ; that is, there exists the one-step time delay; if , , and , one has ; that is, there exists the two-step time delays. For special cases, when , the sensor receives the signal on time, with . When , the sensor receives the signal on time or the one-step sensor delay occurs, ; here , or , and ; that is, . In other words, these Bernoulli distributed variables satisfy for all .

Assumption 2. The initial state is uncorrelated with other noise signals, and

Without loss of generality, for , we can rewrite 3 as follows:

By defining , the systems 1, 2, and 6 can be rewritten as the following compact form:

where

For convenience of the subsequent developments, set

Then, it is easy to obtain that

The purpose of this paper is to design the optimal Kalman filter for the addressed discrete uncertain stochastic systems 1–3 based on the observation sequence . Noting the relationship between the original system and the augmented system, we know .

3. Main Results

In this section, by using the projection theory, the recursion of the Kalman filtering is derived and the explicit expression of the filter gain is given.

To facilitate the subsequent developments, we introduce the following definition and lemmas.

Definition 3 (see [8]). Let be the state covariance matrix. Then, one has

where and are time-varying stochastic matrices.

Motivated by the excellent results in [8], we can obtain the following lemmas which would be helpful for the further calculation.

Lemma 4. According to the definition of the and , one has

where

Proof. By using Definition 3 and noting the expressions of and , one has

where is defined in 15. Then, the proof of this lemma is complete.

Lemma 5. The state covariance matrix of system 7 satisfies the following recursion:

with the initial value .

Proof. It follows from 7 that

The proof of this lemma is complete.

Now, we are ready to design the optimal Kalman filter for system 7-8 based on the observation sequence . By employing Lemmas 4 and 5, we have the following theorem.

Theorem 6. The optimal Kalman filtering for system 7-8 is given as follows:

where

Proof. According to the projection theory, it is easy to obtain 19. Moreover, the filter gain matrix is calculated by

Taking projection on both sides of 7 onto the linear space spanned by , we have

From the projection theory, we have . Then, 20 can be obtained directly.
Set the innovation

Taking projection on both sides of 8 onto the linear space spanned by , we have

where the one-step prediction of the measurement noise is calculated by

Here, the one-step prediction gain of the measurement noise is defined by

Moreover, the two-step prediction of the measurement noise in 34 is computed by

where the two-step prediction gain of the measurement noise is defined by

From the projection theory, , where the symbol denotes the orthogonality. Then, it is not difficult to see that . Subsequently, substituting 34 and 36 into 33 yields

Then, it follows from 32 and 38 that 21 is true.
The innovation can be rewritten as follows:

where is the one-step prediction error. Substitute 39 with into 35. Noting

the one-step prediction gain of the measurement noise can be calculated

When deriving 41, we have used the fact that and . Then, we have 22. Similarly, substituting 39 with into 37, one has 23.
Subsequently, we are in a position to obtain the filtering error covariance matrix and the prediction error covariance matrix . Subtracting 19 from , the filtering error equation can be obtained:

Then, we have

Notice that , , , and are all uncorrelated with , we have

Thus, 24 is obtained.
Similarly, the one-step prediction error equation can be obtained as follows:

According to 45, we have the following equation:

where

Noting , we have

Then, it is concluded that 25 holds.
Next, we aim to derive the filter gain . Firstly, substitute 39 into 30. Secondly, by using and , we obtain

where . When deriving 49, we have used the fact that is uncorrelated with . Setting

we have . By using 7 and noting , the term can be obtained as follows:

Substituting 51 into 49 and noting , we have 26.
Furthermore, it follows from that

Substituting 52 into 50, we can see that 27 is true.
Finally, we will derive the term in 28. According to 39, we have

where

and are defined in 29. When deriving 53, we have used the fact that , , and is uncorrelated with . Up to now, the proof of Theorem 6 is complete.

So far, we have derived the Kalman filtering for the addressed linear stochastic systems with multiplicative noises and random two-step sensor delays. In the following, let us discuss the initial time instant.

Particularly, when , 3 becomes . In the augmented system 7-8, letting , we have

where

and is defined in 29.

Similarly, when , 3 becomes . In the augmented system 7-8, letting , one has

where

and is defined in 29.

Remark 7. It is worth mentioning that when and , the developed optimal filtering is reduced to the traditional Kalman filtering algorithm. On the other hand, when and , the proposed filtering algorithm is the optimal Kalman filtering with one-step sensor delay.

To help understand, the calculation process of the proposed optimal Kalman filtering scheme in Theorem 6 can be summarized as follows.

Algorithm 8 (Kalman filtering with multiplicative noises and random two-step sensor delays). Step 1. Give the initial values , , , , , , , , , , , , and .
Step 2. Compute in turn.
Step 3. When is obtained, compute in turn.
Step 4. In general, calculate by 20.
Step 5. Compute by 23. Substituting 23 into 22, we obtain . Then, we can obtain by substituting 22 and 23 into 21.
Step 6. Calculate by 13 and compute by 17. By substituting into 14, we have .
Step 7. Calculate by substituting 13 into 25.
Step 8. Substituting 14, 22, 23, and 25 into 28, we obtain .
Step 9. Compute by substituting 22, 23, 25, and 28 into 27.
Step 10. Substituting 25, 27, and 28 into 26, we obtain .
Step 11. By using 19 and 24, we calculate the optimal estimation and obtain . Then, letting , go back to Step 4.

Remark 9. In this paper, we have used the state augmentation approach and innovation analysis technique to design the optimal Kalman filter contaminated with multiplicative noises and randomly occurring two-step sensor delays. Compared with the existing results, these two phenomena addressed have constituted the main differences and have been explicitly reflected in the main results, such as the terms , , , and . During the implementation of the proposed filtering algorithm, it is worth mentioning that more efforts should be made to derive the terms and in 27 and 28 due to the consideration of the randomly occurring sensor delays. From the above algorithm, it is easy to see that Steps 5–10 in Algorithm 8 are important especially those involved terms.

4. An Illustrative Example

In this section, a numerical example is proposed to show the feasibility and effectiveness of the proposed main results.

Consider the following system:

where is the system state and and are uncorrelated white noises with zero means and variances and , respectively.

Let

According to Theorem 6, the optimal recursive filter can be obtained. The values of the filter gains are given as in Table 1. The trajectories of the actual states and their estimates are plotted in Figures 1 and 2. Let MSE denote the mean square error for the estimations of and ; that is, MSE (), where is the number of simulation tests. Then, the of the proposed filtering algorithm are plotted in Figures 3 and 4.

Table 1: Filter gains (Case I).

Figure 1: The trajectories of and (Case I).

Figure 2: The trajectories of and (Case I).

Figure 3: log(MSE1) (Case I).

Figure 4: log(MSE2) (Case I).

In order to further discuss the effects from the randomly occurring two-step sensor delays, we make the comparison where the different probabilities of the sensor delays (i.e., Case I: , , and ; Case II: , , and ) are considered. The corresponding simulations are given in Figures 5–8. According to the simulations, we can see that the filtering performance is indeed influenced by the probabilities of the sensor delays. From the simulations, we can conclude that the developed filtering scheme performs well to estimate the addressed system with multiplicative noises and random two-step sensor delays. The reason is that we have made additional efforts during the algorithm design to attenuate the effects from the multiplicative noises and randomly occurring two-step sensor delays.

Figure 5: The trajectories of and (Case II).

Figure 6: The trajectories of and (Case II).

Figure 7: log(MSE1) (Case II).

Figure 8: log(MSE2) (Case II).

5. Conclusion

The problem of the optimal Kalman filtering has been investigated for a class of linear discrete stochastic systems with multiplicative noises and random two-step sensor delays. Three Bernoulli distributed random variables with known conditional probabilities have been introduced to describe the phenomena of two-step sensor delays. Based on the innovation analysis approach and the recursive projection formula, for both the multiplicative noises and the random two-step sensor delays, a new optimal Kalman filtering has been proposed for the addressed linear stochastic system. Further research topics include the extension of the developed optimal filtering strategy to the prevalent event-triggered case [35], more networked induced phenomena as in [36], and the random delays modeled by the Markov chain [37]. Moreover, it would be interesting and important to deal with the stability analysis issue for the proposed filtering algorithm.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

The authors would like to thank the associate editor and the anonymous reviewers for their detailed comments and valuable suggestions. This work was supported in part by the National Natural Science Foundation of China (NSFC) under Grants 11271103 and 11301118.

References

M. Darouach and H. S. Ali, “Optimal unbiased functional filtering in the frequency domain,” Systems Science & Control Engineering, vol. 2, no. 1, pp. 308–315, 2014.

J. Hu, Z. Wang, H. Gao, and L. K. Stergioulas, “Probability-guaranteed finite-horizon filtering for a class of nonlinear time-varying systems with sensor saturations,” Systems & Control Letters, vol. 61, no. 4, pp. 477–484, 2012.

H. R. Karimi, M. Zapateiro, and N. Luo, “A linear matrix inequality approach to robust fault detection filter design of linear systems with mixed time-varying delays and nonlinear perturbations,” Journal of the Franklin Institute, vol. 347, no. 6, pp. 957–973, 2010.

H. Dong, Z. Wang, S. X. Ding, and H. Gao, “Finite-horizon estimation of randomly occurring faults for a class of nonlinear time-varying systems,” Automatica, vol. 50, no. 12, pp. 3182–3189, 2014.

M. Z. A. Bhotto and I. V. Bajic, “Constant modulus blind adaptive beamforming based on unscented Kalman filtering,” IEEE Signal Processing Letters, vol. 22, no. 4, pp. 474–478, 2015.

H. Rezaei, M. Reza, and M. H. Sedaaghi, “Improved robust finite-horizon Kalman filtering for uncertain networked time-varying systems,” Information Sciences, vol. 293, pp. 263–274, 2015.

R. E. Kalman, “A new approach to linear filtering and prediction problems,” Journal of Fluids Engineering, vol. 82, no. 1, pp. 35–45, 1960.

J. Ma and S. Sun, “Optimal linear estimators for systems with random sensor delays, multiple packet dropouts and uncertain observations,” IEEE Transactions on Signal Processing, vol. 59, no. 11, pp. 5181–5192, 2011.

H.-X. Chen and S.-L. Sun, “Optimal linear estimators for networked control systems with finite consecutive packet dropouts,” Control Theory and Applications, vol. 29, no. 10, pp. 1317–1324, 2012.

T. Utz, C. Fleck, J. Frauhammer, D. Seiler-Thull, and A. Kugi, “Extended Kalman filter and adaptive backstepping for mean temperature control of a three-way catalytic converter,” International Journal of Robust and Nonlinear Control, vol. 24, no. 18, pp. 3437–3453, 2013.

Z. Wang, X. Liu, Y. Liu, J. Liang, and V. Vinciotti, “An extended Kalman filtering approach to modeling nonlinear dynamic gene regulatory networks via short gene expression time series,” IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 6, no. 3, pp. 410–419, 2009.

J. Hu, Z. Wang, H. Dong, and H. Gao, “Recent advances on recursive filtering and sliding mode design for networked nonlinear stochastic systems: a survey,” Mathematical Problems in Engineering, vol. 2013, Article ID 646059, 12 pages, 2013.

K. Q. Nguyen, T. H. Nguyen, and Q. P. Ha, “FPGA-based sensorless PMSM speed control using reduced-order extendedKalman filters,” IEEE Transactions on Industrial Electronics, vol. 61, no. 12, pp. 6574–6582, 2014.

H. Ahmada and T. Namerikawa, “Extended Kalman filter-based mobile robot localization with intermittent measurements,” Systems Science & Control Engineering, vol. 1, no. 1, pp. 113–126, 2013.

A. Ghanbari and M. Moghanni-Bavil-Olyaei, “Adaptive fuzzy terminal sliding-mode control of MEMS z-axis gyroscopewith extended Kalman filter observer,” Systems Science and Control Engineering, vol. 2, no. 1, pp. 183–191, 2014.

J. Hu, Z. Wang, Y. Niu, and L. K. Stergioulas, “ sliding mode observer design for a class of nonlinear discrete time-delay systems: a delay-fractioning approach,” International Journal of Robust and Nonlinear Control, vol. 22, no. 16, pp. 1806–1826, 2012.

Y. Halevi and A. Ray, “Integrated communication and control systems. Part 1—analysis,” Transactions of the ASME—Journal of Dynamic Systems, Measurement and Control, vol. 110, no. 4, pp. 367–373, 1988.

L. Wang, G. Wei, and H. Shu, “State estimation for complex networks with randomly occurring coupling delays,” Neurocomputing, vol. 122, pp. 513–520, 2013.

A. Ray and Y. Halevi, “Integrated communication and control systems: part II—design considerations,” Journal of Dynamic Systems, Measurement and Control, vol. 110, no. 4, pp. 374–381, 1988.

J. Liang, B. Shen, H. Dong, and J. Lam, “Robust distributed state estimation for sensor networks with multiple stochastic communication delays,” International Journal of Systems Science, vol. 42, no. 9, pp. 1459–1471, 2011.

J. Nilsson, B. Bernhardsson, and B. Wittenmark, “Stochastic analysis and control of real-time systems with random time delays,” Automatica, vol. 34, no. 1, pp. 57–64, 1998.

Y. Luo, G. Wei, X. Ding, and Y. Liu, “Controller design for 2-D stochastic nonlinear Roesser model: a probability-dependent gain-scheduling approach,” Journal of the Franklin Institute. Engineering and Applied Mathematics, vol. 351, no. 11, pp. 5182–5203, 2014.

J. Hu, D. Chen, and J. Du, “State estimation for a class of discrete nonlinear systems with randomly occurring uncertainties and distributed sensor delays,” International Journal of General Systems, vol. 43, no. 3-4, pp. 387–401, 2014.

J. Liang and J. Cao, “Global output convergence of recurrent neural networks with distributed delays,” Nonlinear Analysis: Real World Applications, vol. 8, no. 1, pp. 187–197, 2007.

J. Liang, Z. Wang, Y. Liu, and X. Liu, “State estimation for two-dimensional complex networks with randomly occurring nonlinearities and randomly varying sensor delays,” International Journal of Robust and Nonlinear Control, vol. 24, no. 1, pp. 18–38, 2014.

L. Wang, G. Wei, and W. Li, “Probability-dependent synchronization control for dynamical networks with randomly varying nonlinearities,” Neurocomputing, vol. 133, pp. 369–376, 2014.

S. L. Sun, “Optimal linear estimation for networked systems with one-step random delays and multiple packet dropouts,” Acta Automatica Sinica, vol. 38, no. 3, pp. 349–356, 2012.

S. Sun, L. Xie, W. Xiao, and N. Xiao, “Optimal filtering for systems with multiple packet dropouts,” IEEE Transactions on Circuits and Systems II: Express Briefs, vol. 55, no. 7, pp. 695–699, 2008.

J. Hu, Z. Wang, B. Shen, and H. Gao, “Gain-constrained recursive filtering with stochastic nonlinearities and probabilistic sensor delays,” IEEE Transactions on Signal Processing, vol. 61, no. 5, pp. 1230–1238, 2013.

D. Chen and L. Xu, “Optimal Kalman filtering for a class of state delay systems with randomly multiple sensor delays,” Abstract and Applied Analysis, vol. 2014, Article ID 716716, 10 pages, 2014.

A. Hermoso-Carazo and J. Linares-Pérez, “Unscented filtering algorithm using two-step randomly delayed observations in nonlinear systems,” Applied Mathematical Modelling: Simulation and Computation for Engineering and Environmental Systems, vol. 33, no. 9, pp. 3705–3717, 2009.

J. Feng, Z. Wang, and M. Zeng, “Optimal robust non-fragile Kalman-type recursive filtering with finite-step autocorrelated noises and multiple packet dropouts,” Aerospace Science and Technology, vol. 15, no. 6, pp. 486–494, 2011.

J. Hu, Z. Wang, B. Shen, and H. Gao, “Quantised recursive filtering for a class of nonlinear systems with multiplicative noises and missing measurements,” International Journal of Control, vol. 86, no. 4, pp. 650–663, 2013.

O. L. V. Costa and G. R. A. M. Benites, “Linear minimum mean square filter for discrete-time linear systems with Markov jumps and multiplicative noises,” Automatica, vol. 47, no. 3, pp. 466–476, 2011.

S. Trimpe and R. D'Andrea, “Event-based state estimation with variance-based triggering,” IEEE Transactions on Automatic Control, vol. 59, no. 12, pp. 3266–3281, 2014.

Z. Wang, H. Dong, B. Shen, and H. Gao, “Finite-horizon filtering with missing measurements and quantization effects,” IEEE Transactions on Automatic Control, vol. 58, no. 7, pp. 1707–1718, 2013.

M. J. García-Ligero, A. Hermoso-Carazo, and J. Linares-Pérez, “Distributed fusion estimation in networked systems with uncertain observations and Markovian random delays,” Signal Processing, vol. 106, pp. 114–122, 2015.