Mathematical Problems in Engineering
Volume 2015 (2015), Article ID 217253, 10 pages
http://dx.doi.org/10.1155/2015/217253

Research Article

Estimation of Nonlinear Functions of State Vector for Linear Systems with Time-Delays and Uncertainties

Il Young Song,¹ Georgy Shevlyakov,² and Vladimir Shin³

¹Department of Sensor Systems, Hanwha Corporation R&D Center, 52-1 Oesam-dong, Yuseong-gu, Daejeon 305-106, Republic of Korea
²Department of Applied Mathematics, Saint Petersburg State Polytechnic University, 29 Polytechnicheskaya Street, Saint Petersburg 195251, Russia
³Department of Information and Statistics, Research Institute of Natural Science, Gyeongsang National University, 501 Jinjudaero, Jinju, Gyeongsangnam-do 660-701, Republic of Korea

Received 4 June 2014; Revised 1 August 2014; Accepted 2 August 2014

Academic Editor: Yuxin Zhao

Copyright © 2015 Il Young Song et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

This paper focuses on estimation of a nonlinear function of state vector (NFS) in discrete-time linear systems with time-delays and model uncertainties. The NFS represents a multivariate nonlinear function of state variables, which can indicate useful information of a target system for control. The optimal nonlinear estimator of an NFS (in mean square sense) represents a function of the receding horizon estimate and its error covariance. The proposed receding horizon filter represents the standard Kalman filter with time-delays and special initial horizon conditions described by the Lyapunov-like equations. In general case to calculate an optimal estimator of an NFS we propose using the unscented transformation. Important class of polynomial NFS is considered in detail. In the case of polynomial NFS an optimal estimator has a closed-form computational procedure. The subsequent application of the proposed receding horizon filter and nonlinear estimator to a linear stochastic system with time-delays and uncertainties demonstrates their effectiveness.

1. Introduction

The Kalman filtering for dynamic systems with time-delays and its variations are well-known state estimation techniques in wide use in a variety of applications such as navigation, target tracking, vehicle state estimation, communications engineering, air traffic control, biomedical and chemical processing, and many other areas [1–6]. Ignorance of the effect of time- delays could cause unpredictable and unsatisfactory system performance with traditional Kalman filters [3, 6, 7]. These applications have motivated researchers to study the control and filtering problem for systems with time-delays.

However, some applications require the estimation of not only a state vector but also a nonlinear function of the state (NFS), which expresses practical and worthwhile information for control systems. For instance, in a mechanical application, such measurands include displacement (linear and angular), which can be interpreted as a quadratic form of a state vector, mass (weight, load, and density), and force (absolute, relative, static, torque, and pressure) [8]. In particular, prediction of future measurands depicted by an NFS can be helpful in several applications, such as system control and target tracking. It is well known that, for dynamical systems in which the stability issue depends explicitly on the time-delay and model uncertainty, in order to overcome this practical issue, it is necessary to study the estimation of NFS in dynamical systems with time-delay and model uncertainty. Most authors have not focused on estimation of NFS but have considered state estimation (filtering) only. To the best of our knowledge, there are no effective methods for estimation of an NFS in a dynamic system with time-delay and model uncertainty in the literature.

The Kalman filters are very difficult to be applied to dynamic system with uncertainty. The standard Kalman filter estimates the state of system if it fully fits the system model; that is, there are no model uncertainties. Otherwise, its algorithm may become unstable [9] and the estimate diverges [10] due to the limited knowledge of the system’s dynamic model and unestimated measurement noise. Thus, it is not robust against modeling uncertainty and disturbances [1]. For estimation problems where we attempt to achieve robustness against temporary uncertainty, numerous strategies have been suggested, rigorously investigated, and implemented over the past few decades. For this reason, in terms of structural adaptation, there are a number of methods currently available for such systems [11, 12]. The structure adaptation filters are based on the Bayesian approach in which the unknown parameter is assumed to be random with a prior known probability [13–15]. Next approach relative to the robust filtering problem with respect to various filtering performance criteria, such as -infinity filtering and energy-to-peak for linear continuous and discrete-time-delay systems [2, 6, 16, 17].

In this paper, we are concerned with usage of the receding horizon strategy for designing robust receding horizon (finite-memory) filter/estimator for time-delay stochastic systems with model uncertainties. In this way the information obtained over the most recent time interval is only used [15, 18, 19]. As a result, the receding horizon filters are more robust against model uncertainties and numerical errors than standard Kalman filters, which utilize all measurements [20, 21]. Based on aforementioned literature, and to the best of the authors’ knowledge, there are no existing results for the receding horizon estimation of NFS for linear systems with time-delays.

Motivated by the above problems, in this paper, we focus on estimating an arbitrary nonlinear function of the state in a linear system with time-delay and model uncertainty. The main contribution of the paper is derivation of receding horizon estimators based on the crucial Lyapunov-like equations for receding horizon initial conditions.

This paper is organized as follows. Section 2 presents a statement of the estimation problem for NFS within the linear system with time-delays. The optimal estimator for NFS is proposed. In Section 3, we present the receding horizon filter/estimator for discrete-time linear system with time-delays. Here, the exact recursive equations for determining receding horizon initial conditions (mean and covariance) are derived and discussed. In Section 4, we present several practical examples of NFS. In Section 5, we derive effective closed-form computational procedure for polynomial NFS. In Section 6, the unscented transformation is introduced, and its application for estimation of NFS is proposed. In Section 7, the efficiency of the proposed receding horizon estimators is studied on real dynamical model with time-delays. Finally, a brief conclusion is given in Section 8.

2. Problem Statement

We first consider a discrete-time linear system described by stochastic recursive equation with time-delays:

where is an unknown state, , , are time-varying matrices, , , are initial conditions, is a zero-mean white Gaussian noise with covariance , and is the Kronecker function.

The discrete measurement is also described by recursive equation with time- delays:

where is the measurement matrix, , and is a zero-mean white Gaussian noise with covariance .

We also assume that the initial states , , system noise , and measurement error are mutually uncorrelated; that is,

A problem associated with such system (1), (2) is that of estimation of the nonlinear function of state (NFS) variables

from the overall noisy sensor measurements

Typical examples of such an NFS may be an arbitrary quadratic form , representing an energy-like function of an object or square distance between the current and nominal states, respectively.

We propose an optimal estimation algorithm for NFS and its performance in the subsequent sections.

The optimal mean square estimate of the NFS based on the overall sensor measurements (5) represents a conditional mean:

where is a conditional probability density function (pdf).

To calculate a conditional pdf we need to solve the filtering problem consisting in calculation of good estimates of the state of a stochastic dynamical system based on noisy partial measurements (5).

Next we propose the new receding horizon filtering algorithm for discrete-time linear systems with time-delays and uncertainties (1), (2) determining the conditional pdf in (6).

3. Receding Horizon Filter and Nonlinear Estimator

At first assume that the system model (1), (2) does not contain any uncertainties.

3.1. Kalman Filtering with Time-Delays for Model without Uncertainties

According to [22, 23] the optimal mean square estimate of state based on all current measurements (5) represents conditional mean which is described by the Kalman filter equations with time-delays (KFTD):

where Kalman gains , , and error covariances

are given by

To run KFTD equations (7)–(9) we need to know the initial conditions for estimates and error covariances, which represent a priori mean and covariance; that is,

In practice any system model contains uncertainties; therefore, to achieve robustness against temporary uncertainty, numerous strategies have been proposed. In the paper we use the effective receding horizon (finite-memory) strategy using only the measurements obtained over the most recent time interval (receding horizon) [10, 20, 21].

3.2. Receding Horizon Filtering with Time-Delays for Model with Uncertainties

According to the receding horizon strategy the optimal (in mean square sense) estimate of the unknown state based on the overall receding horizon sensor measurements,

with horizon time interval , represents the conditional mean,

Using KFTD’s equations (7)–(9) we propose their receding horizon version for estimation of the state using receding horizon measurements on the interval . We obtain

where the receding horizon filter gains , , and error autocovariances

are described by

In contrast to KFTD (7)–(9) the receding horizon filter (RHF) (13)–(15) needs to initialize horizon initial conditions at which represent unconditional means and covariances of the state ; that is,

We have the following.

Theorem 1. The horizon initial means (16) are described by

Theorem 2. The horizon initial covariances (17) satisfy Lyapunov-like recursive equations

Derivation of Lyapunov-like equations for mean and covariances (18), (19a), and (19b) is given in the appendix.

Remark 3. Original initial conditions (10) for the KFTD (7)–(9) at different time instants are identical in contrast to new horizon initial conditions (18), (19a), and (19b) which are more realistic for practice.

Remark 4 (real-time implementation of RHF). The RHF equations (13)–(19b) can be divided into two parts as follows.
Part 1 (offline equations). We may note that the RHF gains and error autocovariances can be precomputed, since they do not depend on the receding horizon measurements , but only on the system matrices , , noise statistics , , and horizon initial conditions (18), (19a), and (19b) which are the part of system model (1) and (2).
Part 2 (online equations). Thus, once the measurement schedule has been settled, the real-time implementation of the RHF requires only the computation of the RHF estimates , , , using only current measurements .

3.3. Conditional PDF and Optimal Receding Horizon Estimator

From (6) the optimal mean square estimate of the NCF based on the receding horizon sensor measurements (11) also represents a conditional mean:

where is a Gaussian probability density function with conditional mean and covariance determined by RHF equations (13) and (15).

Thus, the estimate in (20) represents the optimal receding horizon estimator (RHE):

which depends on the receding horizon estimate and its error covariance .

Further, we consider several examples of application of the general nonlinear estimator (20).

4. Examples of Optimal Nonlinear Estimator

4.1. Estimation of Distance

Consider an NFS representing a distance between an unknown scalar position and given point . In this case an NFS becomes . Using (20) the best estimate of the distance between an unknown position and moving point , , is

where and are determined by (13) and (15) (or (7) and (9)), respectively, and is the error function.

In the particular case with , the estimate of an unknown modulus takes the form

4.2. Quadratic Function of State Vector

Consider an arbitrary quadratic function of a state vector ,

Then optimal nonlinear estimate (20) can be explicitly calculated in terms of a state estimate and its error covariance . Using the formula [24]

we obtain an optimal estimate for the quadratic function

In (25) and (26), is the trace of a matrix .

In the particular case a quadratic function represents a power of a signal . Using (26) at , , we obtain

4.3. Estimation of Sine and Cosine Functions

In this case an NCF becomes

where is an unknown angle.

Then the best estimates of the trigonometrical functions of an unknown angle are

5. Multivariate Polynomial Nonlinear Function

Here we consider a special NFS representing an arbitrary multivariate polynomial function of the form

In this case, the algorithm for calculation of the optimal estimator has a closed form because conditional expectation

depends on high-order moments of a multivariate Gaussian distribution, which can be explicitly calculated in terms of first- and second-order conditional moments [24–26]. For example,

where

Here and are determined by the RHF equations.

For general NFS the unscented transformation serves as a useful tool for their calculations.

Remark 5. For typical NFS the integral (20) for normal distribution is known; that is, it can be explicitly expressed in terms of a receding horizon state estimate and its error covariance (see examples in Sections 4 and 5). But for general NFS the integral (20) can be calculated only approximately, for example, using the unscented transformation.

6. General Nonlinear Function and Unscented Transformation

The unscented transformation (UT) was first proposed by Julier and Uhlmann in light of the intuition that it is significantly easier to approximate the statistics of a transformed random variable, for example, the mean and covariance [27, 28]. During the last decade, the UT has become a powerful approach for designing new filtering and control algorithms for nonlinear dynamic models [29, 30]. Following this approach, the procedure to calculate the best estimate of an NFS (conditional mean)

using the UT can be summarized as follows.

Generate the sigma points with corresponding weights :

where is the th column of the matrix square root of and is the scaling parameter influencing the spreading of the points in the state space and thus the accuracy of the approximation [31]. Propagate each of these sigma points through a nonlinear function as

and the resulting best estimate of the NFS is given as

Thus, the estimate (37) is approximately represented by known function of the receding horizon estimate and error covariance .

Application of the obtained results is illustrated by example of wind tunnel system with model uncertainties.

7. Numerical Example: The Wind Tunnel System

A comparative experimental analysis of the proposed RHF (11)–(19b) and KFTD (7)–(10) is considered on example of nonlinear estimation of a kinetic energy of the wind tunnel system with two model time-invariant uncertainties and . In this case, we numerically evaluate and compare three mean square errors (MSEs) of the RHF, KFTD, and nonlinear estimator for kinetic energy.

A discretization of the state differential equations and the design based on a discrete-time model has been applied to the high-speed closed-air unit wind tunnel model by Armstrong and Tripp [32]. The state vector consists of the state variables , , and , representing derivatives from a chosen equilibrium point of the following quantities: = Mach number, = actuator position guide vane angle in a driving fan, and = actuator rate. Then the discretized system model with a sampling period of (sec) is given by

where and are unknown time-invariant model parameters and a wind tunnel system with the initial mean and covariance is and . The covariance of the system white Gaussian noise is subjected to .

The first coordinate , related to Mach number of the wind tunnel system, is observable through a measurement model. We have

where is zero-mean white Gaussian measurement noise with covariance . We assume that the true values of the model uncertainties and on the given uncertainty interval (UI) are

and without it, that is,

The horizon length of the RHF (13)–(19b) and RHE (20) takes three values as , and .

The total kinetic energy of an actuator representing the NFS, , can be expressed as the sum of the translational kinetic energy of the center of mass and the rotational kinetic energy about the center of mass . The kinetic energies can be expressed in the following quadratic form (see Section 4.2):

where is rotational inertia, is angular velocity, is mass, and is linear velocity. Concrete numerical values for , , , and .

7.1. Simulation Results with Parametric Uncertainty

We assume that time-invariant uncertain model parameters take the form (40). We specially focus on comparing the MSEs of the Mach number of the wind tunnel system that directly contain the uncertainties in (38) and the total kinetic energy in (42).

Our point of interest is the behavior of the nonlinear RHE using proposed RHF around the uncertainty interval . Here we describe the results of simulations of two filters (KFTD, RHF) and RHE with three different receding horizon lengths in terms of MSEs such that

In Figures 1 and 2, we observe that, within the uncertainty interval , the time histories of the MSEs for the KFTD are notably larger than the other RHFs. However, the KFTD performs slightly worse than the RHF with the biggest horizon length of . Also, the RHF/RHE with the small horizon length is more accurate than the RHF/RHE with the big horizon lengths and . Therefore,

The reason for the presence of such a robustness property (44) is to compensate for the given uncertainties , as the horizon length for sensor (memory of RHF) should be minimal. In this case, it is equal, as .

Figure 1: MSEs of the Mach number comparison among KFTD and three RHFs with different horizon lengths: (red line); (green line); (blue line); KFTD (black line). The -axis represents time and -axis represents MSEs.

Figure 2: Comparison of MSEs of the total kinetic energy using KFTD and three RHFs with horizon lengths: (red line); (green line); (blue line); KFTD (black line). The -axis represents time and -axis represents MSEs.

The comparison shows us that performance of the RHF/RHE is quite good and it can be widely used in different areas of applications: industrial, military, space, inertial navigation, and others [33].

8. Conclusion

In this paper we propose a new RHF for discrete-time linear system with time-delays and model uncertainties with application to estimation of nonlinear functions of state vector. We have derived the Lyapunov-like recursive equations for horizon initial mean and covariance of a system state with an arbitrary number of time-delays and verified the effectiveness of the proposed filter RHF through numerical simulation and comparison with KFTD.

In order to estimate an arbitrary NCF in uncertain environment, a new RHE is proposed. Two important classes of an NCF (quadratic, polynomial) are considered in detail, and effective computational procedures based on formulas for high-order moments of a Gaussian distribution and UT transformation are proposed.

In verifying we implemented example for real dynamic system with time-delays and parametric model uncertainty . Through the implementations, the robustness of the RHF/RHE in terms of MSEs is demonstrated and the proposed receding horizon estimators have a potential to be used in a wide range of practical applications.

During the last decades, there has been extensive interest in the study of a class of physical systems modeled by hybrid system dynamics known as Markovian jump systems including multiple delays [34], mode-dependent delays [35], singular time-delays [36], and time-variant delays [37]. As a generalization of the obtained results for linear stochastic systems with time-delays and uncertainties we would like to point out that it is possible to extend the main results to Markovian jump systems with time-delays and complex dynamical systems with prevalent network induced phenomena such as missing measurements, sensor delays, multiple fading measurements, and signal quantization.

Appendix

Derivation of Equation for Horizon Initial Mean (18). Taking expectation on both sides of (1) and using we immediately obtain recursive equation (18) for mean .

Derivation of Equation For Horizon Initial Covariance (19a). Subtracting (18) from (1) we obtain time propagation of the centered state:

Next we have

Taking expectation on both sides of (A.2) and using the fact that current noise does not depend on current and past states , we obtain recursive equation for covariances (19a) and (19b),

Note that (A.3) contains autocovariance:

Derivation of Equation for Autocovariance (19b). Using “symmetric” property of autocovariance and without loss of generality we can assume that . Substituting in (A.1) we obtain

Multiplying both sides of (A.6) by and using (A.5) we obtain

It remains to calculate expectation in (A.8); that is,

Calculating product using (A.6) and after that taking expectation we get

According to assumption , “future” noise does not depend on current and past states ; therefore . Next using property of white noise we obtain

Finally using (A.8), (A.10), and (A.11) we get equation for autocovariance (19b).

This completes the derivation Lyapunov-like equations for receding horizon mean and covariances.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgment

This work was supported in part by the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology (no. 2012R1A1A2000679).

References

B. D. O. Anderson and J. B. Moore, Optimal Filtering, Prentice-Hall, Englewood Cliffs, NJ, USA, 1979.

E. K. Boukas and Z.-K. Liu, Deterministic and Stochastic Time-Delay Systems, Birkhauser, Boston, Mass, USA, 2002.

M. Malek-Zavarei and M. Jamshidi, Time-Delay Systems: Analysis, Optimization and Application, North-Holland, Amsterdam, The Netherlands, 1987.

J. Chiasson and J. J. Loiseau, Applications of Time Delay Systems, vol. 352 of Lecture Notes in Control and Information Sciences, Springer, London, UK, 2007.

R. Sipahi, T. Vyhlidal, S.-I. Niculescu, and P. Pepe, Eds., Time Delay Systems: Methods, Applications and New Trends, vol. 423 of Lecture Notes in Control and Information Sciences, Springer, London, UK, 2012.

M. S. Mahmoud, Robust Control and Filtering for Time-Delay Systems, Marcel Dekker, New York, NY, USA, 2000.

H. Kwakernaak, “Optimal filtering in linear systems with time delays,” IEEE Transactions on Automatic Control, vol. 12, no. 2, pp. 169–173, 1967.

A. G. O. Mutambara, Decentralized Estimation and Control for Multisensor Systems, CRC Press, New York, NY, USA, 1998.

K. Kobayashi, K. C. Cheok, K. Watanabe, and F. Munekata, “Accurate differential global positioning system via fuzzy logic kaiman filter sensor fusion technique,” IEEE Transactions on Industrial Electronics, vol. 45, no. 3, pp. 510–518, 1998.

W. H. Kwon and S. Han, Receding Horizon Control: Model Predictive Control for State Models, Springer, London, UK, 2005.

W. Watanabe, Adaptive Estimation and Control, Prentice-Hall, New York, NY, USA, 1991.

F. C. Schweppe, Uncertain Dynamic Systems, Prentice-Hall, Upper Saddle River, NJ, USA, 1973.

D. Y. Kim, J. I. Ahn, and V. Shin, “Suboptimal filter for continuous-time linear systems with unknown parameters,” Asian Journal of Control, vol. 10, no. 5, pp. 525–534, 2008.

V. Shin, J. I. Ahn, and D. Y. Kim, “New algorithm for recursive estimation in linear discrete-time systems with unknown parameters,” International Journal of Control, Automation and Systems, vol. 4, no. 4, pp. 456–465, 2006.

A. H. Jazwinski, Stochastic Processes and Filtering Theory, Academic Press, New York, NY, USA, 1970.

H. Gao, J. Lam, and C. Wang, “Robust energy-to-peak filter design for stochastic time-delay systems,” Systems and Control Letters, vol. 55, no. 2, pp. 101–111, 2006.

P. Shi, “Robust filtering for uncertain delay systems under sampled measurements,” Signal Processing, vol. 58, no. 2, pp. 131–151, 1997.

A. Alessandri, M. Baglietto, and G. Battistelli, “Receding-horizon estimation for discrete-time linear systems,” IEEE Transactions on Automatic Control, vol. 48, no. 3, pp. 473–478, 2003.

A. Alessandri, M. Baglietto, and G. Battistelli, “Receding-horizon estimation for switching discrete-time linear systems,” IEEE Transactions on Automatic Control, vol. 50, no. 11, pp. 1736–1748, 2005.

W. H. Kwon, P. S. Kim, and P. Park, “A receding horizon Kalman FIR filter for discrete time-invariant systems,” IEEE Transactions on Automatic Control, vol. 44, no. 9, pp. 1787–1791, 1999.

D. Y. Kim and V. Shin, “Optimal receding horizon filter for continuous-time nonlinear stochastic systems,” in Proceedings of the 6th WSEAS International Conference on Signal Processing (WSEAS '07), pp. 112–116, Dallas, Tex, USA, 2007.

J. Mishra and V. S. Rajamani, “Least-squares state estimation in time-delay systems with colored observation noise: an innovation approach,” IEEE Transactions on Automatic Control, vol. 20, no. 1, pp. 140–142, 1975.

R. Priemer and A. G. Vacroux, “Estimation in linear discrete systems with multiple time delays,” IEEE Transactions on Automatic Control, vol. 14, pp. 384–387, 1969.

V. S. Pugachev and I. N. Sinitsyn, Stochastic Differential Systems. Analysis and Filtering, Wiley & Sons, New York, NY, USA, 1987.

R. Kan, “From moments of sum to moments of product,” Journal of Multivariate Analysis, vol. 99, no. 3, pp. 542–554, 2008.

B. Holmquist, “Expectations of products of quadratic forms in normal variables,” Stochastic Analysis and Applications, vol. 14, no. 2, pp. 149–164, 1996.

S. Julier, J. Uhlmann, and H. F. Durrant-Whyte, “A new method for the nonlinear transformation of means and covariances in filters and estimators,” IEEE Transactions on Automatic Control, vol. 45, no. 3, pp. 477–482, 2000.

S. J. Julier and J. K. Uhlmann, “Unscented filtering and nonlinear estimation,” Proceedings of the IEEE, vol. 92, no. 3, pp. 401–422, 2004.

D. J. Lee, “Nonlinear estimation and multiple sensor fusion using unscented information filtering,” IEEE Signal Processing Letters, vol. 15, pp. 861–864, 2008.

F. Gustafsson and G. Hendeby, “Some relations between extended and unscented Kalman filters,” IEEE Transactions on Signal Processing, vol. 60, no. 2, pp. 545–555, 2012.

L. Chang, B. Hu, A. Li, and F. Qin, “Transformed unscented Kalman filter,” IEEE Transactions on Automatic Control, vol. 58, no. 1, pp. 252–257, 2013.

E. S. Armstrong and J. S. Tripp, “An application of multivariable design techniques to the control of the National Transonic Facility,” NASA Technical Reports 1887, 1981.

R. C. Luo and M. G. Kay, “Multisensor integration and fusion in intelligent systems,” IEEE Transactions on Systems, Man and Cybernetics, vol. 19, no. 5, pp. 901–931, 1989.

F. Li, P. Shi, L. Wu, and X. Zhang, “Fuzzy-model-based D-stability and non-fragile control for discrete-time descriptor systems with multiple selays,” IEEE Transactions on Fuzzy Systems, vol. 22, no. 4, pp. 1019–1025, 2014.

F. Li, L. Wu, and P. Shi, “Stochastic stability of semi-Markovian jump systems with mode-dependent delays,” International Journal of Robust and Nonlinear Control, 2014.

L. Wu, X. Su, and P. Shi, “Slidin g mode control with bounded gain performance of Markovian jump singular time-delay systems,” Automatica, vol. 48, no. 8, pp. 1929–1933, 2012.

F. Li and X. Zhang, “A delay-dependent bounded real lemma for singular LPV systems with time-variant delay,” International Journal of Robust and Nonlinear Control, vol. 22, no. 5, pp. 559–574, 2012.