Discrete Dynamics in Nature and Society
Volume 2015 (2015), Article ID 953831, 10 pages
http://dx.doi.org/10.1155/2015/953831

Research Article

Index for Stochastic Linear Discrete-Time Systems

Yan Li,¹ Weihai Zhang,¹ and Xikui Liu²

¹College of Electrical Engineering and Automation, Shandong University of Science and Technology, Qingdao, Shandong 266590, China
²College of Mathematics and System Science, Shandong University of Science and Technology, Qingdao, Shandong 266590, China

Received 26 January 2015; Accepted 20 April 2015

Academic Editor: Zidong Wang

Copyright © 2015 Yan Li et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

This paper discusses the index problem for stochastic linear discrete-time systems. A necessary and sufficient condition of index is given for such systems in finite horizon. It is proved that when the index is greater than a given value, the feasibility of index is equivalent to the solvability of a constrained difference equation. The above result can be applied to the fault detection observer design. Finally, some examples are presented to illustrate the proposed theoretical results.

1. Introduction

Model-based fault detection has attracted increasing attention in recent years because of its importance in reliability, security, and fault tolerance of dynamic systems; see [1–3]. In general, model-based fault detection is related to residual generation, that is, constructing a residual signal and comparing it with a predefined threshold. If the residual exceeds the threshold, an alarm is ringed. However, the residual can change due to the effects of external disturbance and model uncertainty. So fault detection observers must be insensitive to external disturbance and model uncertainty. Some approaches have been given for the design of fault detection observers, such as norm, norm, and index, which are to evaluate the effectiveness of a fault detection observer design [2, 3]. The norm characterizes the maximum effect of an input on an output, which plays an important role in robust control and was widely generalized by [4–9]. An upper bound of norm can be described by means of the bounded real lemma. On the contrary, index is used for measuring the sensitivity of residual to fault, which aims to maximize the minimum effect of fault on the residual output of a fault detection observer; see [3, 10–16] and the reference therein. In [3], index in zero frequency was defined by using the minimum nonzero singular value. In [13], index was defined as the minimum singular value over a given frequency range. A necessary and sufficient condition was given by LMIs for the infinite frequency range. The case for finite frequency range was obtained in terms of frequency weighting.

In recent years, the index in time domain has attracted more attention. In [16], the authors developed a fault residual generator to maximize the fault sensitivity by index in the finite time domain. Based on index, the problems considered in [17, 18] were about the optimal fault detection for discrete time-varying linear systems. In [19], a necessary and sufficient condition of the index for linear continuous time-varying systems in finite horizon was given. Characterization of index for linear discrete time-varying systems was discussed in [20]. The index was described by the existence of the solution to a backward difference Riccati equation.

Although there was much work on the index, little work was concerned with the the index in stochastic linear systems. In this paper, the characterization of the index for stochastic linear systems in finite horizon is presented. The definition of the index is extended to stochastic systems. New necessary and sufficient conditions are given for the index. The feasibility of the index is shown to be equivalent to the solvability of a constrained difference equation. As a special case, the stochastic of square systems is addressed in this paper. Our results can be viewed as the extensions of deterministic systems, which can be applied to the fault detection.

The outline of the paper is organized as follows. Section 2 is devoted to developing some efficient criteria for the linear stochastic index in finite horizon. Section 3 contains some examples provided to show the efficiency of the proposed results. Finally, we end this paper in Section 4 with a brief conclusion.

Notations. is the field of real numbers. is the vector space of all matrices with entries in . is the set of all real symmetric matrices . denotes the transpose of the complex matrix . is the inverse of . Given a positive semidefinite (positive definite) matrix , we denote it by (). Let denote the mathematical expectation. is identity matrix. is zero matrix. Consider , . A system refers to a system when the number of inputs is less than that of outputs. A wide system is the case of more inputs than outputs. A square system denotes a system when the number of inputs equals the output number.

2. Finite Horizon Stochastic Index

In this section, we will discuss the finite horizon stochastic index problem. We give a necessary and sufficient condition for the finite horizon stochastic index.

Consider the following stochastic system:

where is a sequence of one-dimensional independent real random variables defined on the complete probability space with and , , where is the Kronecker delta. Suppose and are independent. , , , , , and . , , and are the state, input, and output, respectively.

We define the -algebra generated by , , , . is an increasing sequence of -algebra and is adapted to for all . Let be the space of -valued random vectors with . denotes the space of all sequences that are measurable for all . The -norm of is defined by . We suppose that is deterministic. For any and , there exists a unique solution of (1) with .

The finite horizon stochastic index problem of system (1) can be stated as follows.

Definition 1. For stochastic system (1), given , define

which is called index of (1) in .

Remark 2. Definition 1 describes the smallest sensitivity of stochastic system (1) from input to output in time domain. Assume that is fault signal and is the residual; then characterizes the minimal fault sensitivity.

Remark 3. When system (1) is wide, (see [20]). In this paper, we suppose that system (1) is tall or square.

For any given , and , let

where is the solution of (1) and is the corresponding output. We will discuss the following optimal control problem:

Remark 4. Obviously, is equivalent to the following inequality:

for all , , .

Remark 5. When , (2) and (5) correspond to the infinite horizon index case.

In the following, we present some useful lemmas, which play important roles throughout the paper.

Lemma 6. For given , if is an arbitrary family of matrices in , then for any

where

Proof. Since is independent of , we conclude that and are measurable and independent of , so

It follows that

where

where

Take summation from to ; it yields that

From (3), we get

which completes the proof.

Theorem 7. For (1) and given , if the following equation

has a solution , , then .

Proof. For any , , , by Lemma 6, we have

By completing squares and considering the first equality in (14), we obtain that

where .
From , it is obvious that and if and only if . Let us substitute into system (1). It must be , on the basis of the fact , which results in , . Therefore, it is deduced that if and only if , which contradicts the condition . Without loss of generality, we assume that , . Then, (16) indicates that , which implies that . Theorem 7 is proved.

The necessity of Theorem 7 will be proved by a sequence of lemmas. To this end, we consider the following backward matrix equation:

where is a given finite sequence of matrices. This equation has a unique solution , , satisfying .

By the above, is the solution of the following equation:

Lemma 8. For the given , , and , if the following equation

admits a solution , then the cost function is given by

where , is the solution of (18) and

Furthermore, for ,

Proof. By Lemma 6, we can derive that

For , (22) is obvious.

Next, we will show that matrices , , are invertible.

Lemma 9. For system (1), assume that, for given , . For given and , if is the solution of (18), then

Proof. We first prove on . Suppose that there exist , , , and such that . Set , , and

According to Lemma 8, we have

From the definition of , , and (19), it follows that for . Additionally, in view of , we conclude that

which leads to a contradiction. So, for any .
Now let for and . Replacing with in (18), we obtain the corresponding solution . As in the preceding proof, we have that . For any and , define . Let , , be the solution of (18) with and replaced by and , respectively. Then , . By (22), it follows that

Therefore, , which means that for all and arbitrary . So .
This completes the proof.

Remark 10. From (24), for , . If system (1) is time-invariant and satisfies Lemma 9, then

Remark 11. If or is invertible, then . By this equality, we see that . If system (1) is square and time-invariant, from (29), we can conclude that

However, the above is not true for tall systems.

Now, we discuss the necessity of Theorem 7 and present the following theorem.

Theorem 12. For system (1), if for given , then (14) has a unique solution , , for any . Furthermore, is minimized with the optimal cost given by

and the optimal control is determined by

where satisfies

Proof. We first prove that means that (14) admits a solution on . As , it is clear that there exists a solution to (14) at ; that is,

Suppose (14) does not have a solution on ; then there must exist a minimum number , , such that (14) is solvable backward up to . That is to say, satisfy (14) but does not, or is not a positive definite matrix.
Set , , and then is well defined. Let

Consider the following equation:

Equation (36) admits a solution , . Comparing (36) with (14), we arrive at for . Moreover, along the same line of Lemma 9, we have that on . In particular, . This is inconsistent with the nonpositiveness of . Hence, (14) has a unique solution , , for any .
Next, we suppose that the following equation

admits a solution , , and then is well defined by (32). If we replace in (17) by , then (18) becomes (37) with , so for all . By (21), when , it yields . By (20), we come to a conclusion that for

By (24), we deduce that minimizes with the optimal value expressed by (31). This proof is complete.

Lemma 13. If system (1) is time-invaint, square and , then, for any fixed , ,

Proof. Since system (1) is time-invaint, by the time invariance of (37), we have . Without loss of generality, we assume that , , and is optimal for on . Let

and . By (31) and Remark 11,

This implies (39).

Based on Theorems 7 and 12, it is easy to get the following main result.

Theorem 14. For system (1) and a given , the following are equivalent.

(a).(b)The following equation

admits a unique solution on . Moreover, .

Remark 15. The solution of (42) is not necessarily negative or positive definite.

Theorem 16. For given , if system (1) is time-invariant and square, then the following are equivalent.

(a).(b)The following equation

admits a unique solution on . Moreover, .

Proof. By Theorem 14, Theorem 16 is established as long as we prove .
For any , from Lemma 6 and (43), using completing squares method, it follows that

where .
Set . By completing squares, we have

where .
Based on the above and Remark 11, it is easy to see that

for arbitrary . This implies , .

Remark 17. For given , if system (1) is time-invariant and square, replacing by , by , by , by , and by in (1), we have the corresponding index and the cost

When , . Applying Theorem 16 to the modified data, we find that the following equation

has a unique solution on . Moreover, .

3. Examples

In this section, we present some simple examples to illustrate applications of the results developed in this paper.

Example 1. Consider system (1) with

By Theorem 14, we have

We can see that is not necessarily negative definite or positive definite.
Consider the following system:

where is the state, is the measurement output, and is the fault input.
The fault detection observer has the form

where is the state estimation, is the gain matrix to be designed, and is a nonsingular weighting matrix.
From the filter and system (51), let , and we can express the residual error equation as

where , , , , , and . We note that (53) is of the same form as (1). If we take as input and as the output, the worst-case fault sensitivity of system (53) is the index problem discussed in Section 2, and the index gives a guarantee on the performance of a fault detection observer.

Example 2. Consider system formed (53) with coefficients

For , that is, , by Theorem 14, (42) admits a unique solution . Figure 1 shows the minimum eigenvalue of .
If system is the same as system except and ,

with , that is, , by Theorem 14, (42) admits a unique solution . Figure 2 shows the minimum eigenvalue of .
By comparing the indexes of system and system , system has higher fault detection ability as .

Figure 1: The minimum eigenvalue of .

Figure 2: The minimum eigenvalue of .

4. Conclusion

In this paper, we have discussed the stochastic index of linear discrete-time systems with state and input dependent noise. A necessary and sufficient condition has been presented in finite time horizon. The condition is given by means of the solvability of a constrained difference equation. These results can be used in fault detection. The numerical examples are given to illustrate the proposed methods.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This work is supported by the National Natural Science Foundation of China (Grants nos. 61174078, 61170054, and 61402265), the Research Fund for the Taishan Scholar Project of Shandong Province of China, and the SDUST Research Fund (Grant no. 2011KYTD105).

References

P. M. Frank and X. Ding, “Survey of robust residual generation and evaluation methods in observer-based fault detection systems,” Journal of Process Control, vol. 7, no. 6, pp. 403–424, 1997.

R. J. Patton, “Robustness in model-based fault diagnosis: the 1995 situation,” Annual Reviews in Control, vol. 21, pp. 103–123, 1997.

J. Chen and R. J. Patton, Robust Model-Based Fault Diagnosis for Dynamic Systems, Kluwer Academic Publishers, Boston, Mass, USA, 1999.

G. L. Wei and H. S. Shu, “H ∞ filtering on nonlinear stochastic systems with delay,” Chaos, Solitons and Fractals, vol. 33, no. 2, pp. 663–670, 2007.

L. Ma, Z. Wang, Y. Bo, and Z. Guo, “A game theory approach to mixed control for a class of stochastic time-varying systems with randomly occurring nonlinearities,” Systems and Control Letters, vol. 60, no. 12, pp. 1009–1015, 2011.

G. Wei, Z. Wang, J. Lam, K. Fraser, G. P. Rao, and X. Liu, “Robust filtering for stochastic genetic regulatory networks with time-varying delay,” Mathematical Biosciences, vol. 220, no. 2, pp. 73–80, 2009.

B.-S. Chen and W. H. Zhang, “Stochastic / control with state-dependent noise,” IEEE Transactions on Automatic Control, vol. 49, no. 1, pp. 45–57, 2004.

W. H. Zhang, Y. L. Huang, and H. S. Zhang, “Stochastic / control for discrete-time systems with state and disturbance dependent noise,” Automatica, vol. 43, no. 3, pp. 513–521, 2007.

W. Zhang, Y. Huang, and L. Xie, “Infinite horizon stochastic control for discrete-time systems with state and disturbance dependent noise,” Automatica, vol. 44, no. 9, pp. 2306–2316, 2008.

S. X. Ding, T. Jeinsch, P. M. Frank, and E. L. Ding, “A unified approach to the optimization of fault detection systems,” International Journal of Adaptive Control and Signal Processing, vol. 14, no. 7, pp. 725–745, 2000.

I. M. Jaimoukha and V. Papakos, “A matrix factorization solution to the fault detection problem,” Automatica, vol. 42, no. 11, pp. 1907–1912, 2006.

M. Hou and R. J. Patton, “An LMI approach to fault detection observers,” in Proceedings of the UKACC International Conference on Control, pp. 305–310, Stevenage, UK, September 1996.

J. Liu, J. L. Wang, and G.-H. Yang, “An LMI approach to minimum sensitivity analysis with application to fault detection,” Automatica, vol. 41, no. 11, pp. 1995–2004, 2005.

N. K. Liu and K. M. Zhou, “Optimal solutions to multi-objective robust fault detection problems,” in Proceedings of the 46th IEEE Conference on Decision and Control (CDC '07), pp. 981–988, IEEE, New Orleans, La, USA, December 2007.

N. Liu and K. Zhou, “Optimal robust fault detection for linear discrete time systems,” Journal of Control Science and Engineering, vol. 2008, Article ID 829459, 16 pages, 2008.

X. Li and K. Zhou, “A time domain approach to robust fault detection of linear time-varying systems,” Automatica, vol. 45, no. 1, pp. 94–102, 2009.

X. B. Li, S.-F. Mo, and K. M. Zhou, “Fault detection for linear discrete time-varying systems,” in Proceedings of the 49th IEEE Conference on Decision and Control (CDC '10), pp. 762–767, December 2010.

M. Zhong, S. X. Ding, and E. L. Ding, “Optimal fault detection for linear discrete time-varying systems,” Automatica, vol. 46, no. 8, pp. 1395–1400, 2010.

X. B. Li and H. H. T. Liu, “Characterization of index for linear time-varying systems,” Automatica, vol. 49, no. 5, pp. 1449–1457, 2013.

X. Li and H. H. T. Liu, “Minimum system sensitivity study of linear discrete time systems for fault detection,” Mathematical Problems in Engineering, vol. 2013, Article ID 276987, 13 pages, 2013.