Discrete Dynamics in Nature and Society
Volume 2018 (2018), Article ID 3676083, 9 pages
https://doi.org/10.1155/2018/3676083

Research Article

Exponential Stability and Robust Control for Discrete-Time Time-Delay Infinite Markov Jump Systems

Yueying Liu and Ting Hou

College of Mathematics and Systems Science, Shandong University of Science and Technology, Qingdao 266590, China

Correspondence should be addressed to Ting Hou; ht_math@sina.com

Received 4 August 2018; Revised 7 October 2018; Accepted 16 October 2018; Published 22 October 2018

Guest Editor: Abdul Qadeer Khan

Copyright © 2018 Yueying Liu and Ting Hou. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

In this paper, exponential stability and robust control problem are investigated for a class of discrete-time time-delay stochastic systems with infinite Markov jump and multiplicative noises. The jumping parameters are modeled as an infinite-state Markov chain. By using a novel Lyapunov-Krasovskii functional, a new sufficient condition in terms of matrix inequalities is derived to guarantee the mean square exponential stability of the equilibrium point. Then some sufficient conditions for the existence of feedback controller are presented to guarantee that the resulting closed-loop system has mean square exponential stability for the zero exogenous disturbance and satisfies a prescribed performance level. Numerical simulations are exploited to validate the applicability of developed theoretical results.

1. Introduction

During the past decades, Markov jump systems have been the subject of a great deal of research since they have been used extensively both in theory and in applications. Markov jump systems are hybrid dynamical systems composed of subsystems with the transitions determined by a Markov chain. A number of results that focused on Markov jump systems have been published ranging from filtering, stability, observability, and control to engineering application; see, for example, [1–15] and the references therein.

Note that most of the theoretical works related to Markov jump systems in the literatures concentrated on the case where the state space of the Markov chain is finite. However, it may be more appropriate to characterize abrupt changes in many real plants via an infinite-state Markov chain. As far as applications are concerned, infinite Markov jump systems are critical in some physics plants, such as solar thermal receiver, aircraft, and robotic manipulator systems. Theoretically, finite Markov jump systems are fundamentally different from those governed by infinite-state space. The work in [14] studied exponential almost sure stability of random jump systems. The work in [16] considered the definition and computation of an -type norm for stochastic systems with infinite Markov jump and periodic coefficients. LQ-optimal control problem has been dealt with for discrete-time infinite Markov jump systems in [17]. The work in [18] demonstrated the inequivalence between stochastic stability and mean square exponential stability in discrete-time case. With this motivation, infinite Markov jump systems have stirred widespread research interests.

Time-delay is one of the inherent features of many practical systems and also is the big source of instability and poor performances in systems [19]. Moreover, stochastic modeling has had extensive applications. Hence, dynamical time-delay stochastic systems deserve our consideration. Stability analysis and controller design of time-delay Markov jump systems have been investigated by many authors [15, 20, 21]. Unfortunately, the literature about these issues for infinite Markov jump case is less developed. And, to the best of our knowledge, only a few results have been presented so far [18, 22, 23], let alone the problem involving time-delay. Actually, [18, 23] investigated the exponential stability and infinite horizon control problem for discrete-time infinite Markov jump systems with multiplicative noises, respectively, but they neglected the effects of time-delay. Meanwhile, the authors in [22] considered time-delay, when discussing the stabilization problem for linear stochastic delay differential equations with infinite Markovian switching, but it was hard for the obtained stability results to deal with control problem. As mentioned above, stability and control for time-delay stochastic systems with infinite Markov jump and multiplicative noises have not received enough attention despite their importance in practical applications, which motivates us for the present research.

We aim to address the exponential stability and control problem for a class of discrete-time time-delay stochastic systems with infinite Markov jumps and multiplicative noises in this paper. The main contributions of this paper are as follows: First of all, we investigate exponential stability of the equilibrium point for the considered systems by employing a novel Lyapunov-Krasovskii functional. Further, a sufficient condition is established to ensure exponential stability with a given performance index of the closed-loop system. And we introduce the slack matrix to decouple the Lyapunov matrices, which makes the controller design feasible. Moreover, some numerical examples are provided to show the effectiveness of the proposed design approaches.

The remaining part of this paper is constructed as follows. In Section 2, we formulate the system model and recall some definitions and lemmas. In Section 3, we present our main results, where we derive some sufficient conditions for exponential stability with a given performance index. Two numerical examples and their simulations are given to illustrate the effectiveness of the obtained results in Section 4. Conclusions are made in Section 5.

For convenience, we fix some notations that will be used throughout this paper. The -dimensional real Euclidean space is denoted by . stands for the linear space of all by real matrices. Let be the Euclidean norm of or the operator norm of . By and we denote the set of all symmetric matrices and the identity (zero) matrix, respectively. denotes the transpose of a matrix (or vector) . We say that is positive (semipositive) definite if . represent the maximum (minimum) eigenvalue of . is called the Kronecker function. . . is -measurable, and .

2. Preliminaries

Consider the following discrete-time time-delay stochastic system with infinite Markov jump parameter and multiplicative noises:

where represents the system state, is the control input, denotes the disturbance, and is the system output. is a sequence of independent random vectors defined on a given complete probability space , which satisfies and . is a vector-valued initial condition. is the bounded constant delay with . Markov chain takes values in a countably infinite set with transition probability matrix , where , and is nondegenerate, for all . Assume and are mutually independent, and , . Assume belongs to .

We introduce the Banach spaces and . The notations will be written as (resp., ) and (resp., ) if and only if and , , , respectively. When , means that , . Therefore, we have . For all coefficients of the considered systems, we suppose they have a finite norm .

Definition 1 (see [10, 18]). System (1) with and is called mean square exponential stability if there exist and such that

for all , and Further, system (1) with is called exponential stabilizable if there exists a sequence such that the closed-loop system

with has mean square exponential stability, where is called exponentially stabilizing feedback.

Definition 2. Closed-loop system (3) is said to have an noise disturbance attenuation level , if under zero initial value the following condition is satisfied:

for any .

Lemma 3 (see [22]). We denote . Let

Assume that for all for some . Then, if and only if , where and is called the Schur complement of in .

Remark 4. Lemma 3 is the infinite-dimensional version of Schur complements (see [24]).

3. Main Results

Firstly, stability will be analyzed, and a sufficient condition is obtained for system (1) with and to have mean square exponential stability.

Theorem 5. System (1) with and is exponentially mean square stable, if we can find matrices , such that the following matrix inequality holds:

uniformly with respect to , where

Proof. Construct the following Lyapunov-Krasovskii functional:

By the assumption that is independent of the Markov chain and , besides , we have

and

and

Thus, combining (8) with (9)-(11), we get

where

with and is defined as
Applying Lemma 3 to (6) leads to

where . Further, we have . It is clear from that there exists a sufficiently small scalar such that . Therefore, it follows that

On the other hand, by using (8), we deduce that

where

Noting (15) and (16), for any constant , we obtain that

where . By taking summation from 0 to on both sides of (18), for , it implies that

Recalling (8) and (16), denoting and , we have

and

respectively. Furthermore, it suffices to show that there exists a constant such that

Actually, letting , then we have and . Therefore, (22) has a unique solution . By substituting (20)-(22) into (19), we obtain

where . This indicates that system (1) with and has mean square exponential stability. The proof is completed.

Remark 6. Due to the consideration of an infinite-state Markov chain, the infinite dimension Banach spaces have been introduced. Furthermore, it should be pointed out that a novel Lyapunov-Krasovskii functional (8) has been constructed to analyze the mean square exponential stability for system (1) with and .

Next, we prove that system (1) with verifies the performance disturbance attenuation .

Theorem 7. System (1) has mean square exponential stability for and with a prescribed performance for , if we can find matrices , such that the following matrix inequality holds:

uniformly with respect to , where

Proof. It is well established that (24) implies (6). Applying Theorem 5 one obtains that system (1) has mean square exponential stability for and .
Let us now show that system (1) with satisfies a prescribed performance level. To this end, constructing the same Lyapunov-Krasovskii functional as in Theorem 5 and under the zero initial condition, the following index is introduced:

where

and is defined as The last ‘≤’ in (26) holds as a result of the similar line with (12). Then, by using Lemma 3 in (24), we obtain that . Thus, . Taking the limit in (26), we have

This ends the proof.

Combining Theorem 5 with Theorem 7, the following corollary can be easily derived for closed-loop system (3).

Corollary 8. Let the feedback control gain , , be given. Then closed-loop system (3) has mean square exponential stability for with a prescribed performance if there exist two matrices and , such that

uniformly with respect to , where

Below, based on Corollary 8, we are ready to present the controller design for system (1).

Theorem 9. For system (1), a state feedback controller can be designed such that closed-loop system (3) has mean square exponential stability for and a given performance can be ensured if there exist matrices , , , and such that

uniformly with respect to , where

Moreover, if matrix inequalities (31) are feasible, then an exponentially stabilizing feedback gain can be given by

Proof. Via Lemma 3, we conclude that (29) is equivalent to the following matrix inequality:

Premultiply and postmultiply with (34), and let

By a tedious calculation, one can rewrite (34) as

where

According to Corollary 8 and the fact that

namely,

the desired result is derived.

Remark 10. The work in [20] presented a necessary and sufficient condition for the existence of the mixed control by four coupled matrix Riccati equations (CMREs). Note that CMREs are hardly solved in practice, and this motivates us to find a new sufficient condition in terms of matrix inequalities that can be easily solved to guarantee that the resulting closed-loop system has mean square exponential stability for the zero exogenous disturbance and satisfies a prescribed performance level.

Remark 11. With the introduction of a slack matrix , a sufficient condition is obtained in Theorem 9, in which the Lyapunov matrices are not involved in any product with system matrices. This makes the controller design feasible and can be easily carried out by solving corresponding matrix inequalities.

Remark 12. It is worth noting that the obtained results can be extended to discrete-time time-delay infinite Markov jump stochastic systems with time-varying delays. Assume that the time-varying delay satisfies ; then by similar procedures to the above and choosing the following Lyapunov-Krasovskii function

the corresponding results can be derived.

4. Illustrative Example

In this section, some illustrative examples are presented to demonstrate the effectiveness of the developed method.

Example 1. Consider the following one-dimensional discrete-time time-delay stochastic system with infinite Markov jumps:

where the transition probability is defined by , , , , . Now take

Let , , and time-delay . By direct computation, (6) holds. According to Theorem 5, we deduce that system (41) has mean square exponential stability, and Figure 1 presents the state response of system (41) with initial conditions for .

Figure 1: System state response in Example 1.

Example 2. Consider the following one-dimensional discrete-time time-delay stochastic system with infinite Markov jumps:

where the transition probability is defined by , , , , . The coefficients of system (43) are reset to be

The purpose here is to design an controller such that the closed-loop system has mean square exponential stability and with a given norm bound . Applying Theorem 9, the controller can be designed as

With the initial conditions for and the exogenous disturbance , Figures 2 and 3 show the state and output responses, respectively.

Figure 2: System state response in Example 2.

Figure 3: System output response in Example 2.

5. Conclusions

In this paper, the issue of exponential stability and robust control for a class of discrete-time time-delay stochastic systems with infinite Markov jumps and multiplicative noises has been studied. Time-delay and infinite Markov jump are taken into consideration simultaneously. By using Lyapunov-Krasovskii functional and introducing slack matrix, an matrix inequality approach has been adopted to ensure the mean square exponential stability and satisfy a prescribed performance level. Finally, some illustrative examples are given to demonstrate the usefulness of the proposed design methods. Further research directions would include the investigation on control problem and asynchronous control problem for discrete-time time-delay stochastic systems with infinite Markov jumps.

Data Availability

The data used to support the findings of this study are included within the article.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

This work is supported by National Natural Science Foundation of China under Grant 61673013, Natural Science Foundation of Shandong Province under Grant ZR2016JL022, and the SDUST Research Fund under Grant 2015TDJH105.

References

Z. Lin, Y. Lin, and W. Zhang, “H∞ filtering for nonlinear stochastic Markovian jump systems,” IET Control Theory & Applications, vol. 4, no. 12, pp. 2743–2756, 2010.

Y. Ni, W. Zhang, and H. Fang, “On the observability and detectability of linear stochastic systems with Markov jumps and multiplicative noise,” Journal of Systems Science & Complexity, vol. 23, no. 1, pp. 102–115, 2010.

Z. G. Wu, P. Shi, H. Su, and J. Chu, “Asynchronous filtering for discrete-time stochastic Markov jump systems with randomly occurred sensor nonlinearities,” Automatica, vol. 50, no. 1, pp. 180–186, 2014.

C. Tan and W. H. Zhang, “On observability and detectability of continuous-time stochastic Markov jump systems,” Journal of Systems Science & Complexity, vol. 28, no. 4, pp. 830–847, 2015.

Z.-G. Wu, J. H. Park, H. Su, and J. Chu, “Stochastic stability analysis for discrete-time singular Markov jump systems with time-varying delay and piecewise-constant transition probabilities,” Journal of The Franklin Institute, vol. 349, no. 9, pp. 2889–2902, 2012.

L. Zhang, Y. Leng, and P. Colaneri, “Stability and stabilization of discrete-time semi-MARkov jump linear systems via semi-Markov kernel approach,” Institute of Electrical and Electronics Engineers Transactions on Automatic Control, vol. 61, no. 2, pp. 503–508, 2016.

S. Zhou, X. Liu, B. Chen, and H. Liu, “Stability analysis for a class of discrete-time nonhomogeneous markov jump systems with multiplicative noises,” Complexity, vol. 2018, Article ID 1586846, 9 pages, 2018.

Y. Zhao and W. Zhang, “Observer-based controller design for singular stochastic Markov jump systems with state dependent noise,” Journal of Systems Science & Complexity, vol. 29, no. 4, pp. 946–958, 2016.

Y. Wang, Z. Pan, Y. Li, and W. Zhang, “H∞ control for nonlinear stochastic Markov systems with time-delay and multiplicative noise,” Journal of Systems Science & Complexity, vol. 30, no. 6, pp. 1–23, 2017.

V. Dragan, T. Morozan, and A. M. Stoica, Mathematical Methods in Robust Control of Discrete-Time Linear Stochastic Systems, Springer, New York, NY, USA, 2010.

Z. J. Wu, J. Yang, and P. Shi, “Adaptive tracking for stochastic nonlinear systems with Markovian switching,” IEEE Transactions on Automatic Control, vol. 55, no. 9, pp. 2135–2141, 2010.

X. Luan, S. Zhao, and F. Liu, “H∞ control for discrete-time Markov jump systems with uncertain transition probabilities,” IEEE Transactions on Automatic Control, vol. 58, no. 6, pp. 1566–1572, 2013.

L. Wu, X. Yao, and W. X. Zheng, “Generalized H₂ fault detection for two-dimensional Markovian jump systems,” Automatica, vol. 48, no. 8, pp. 1741–1750, 2012.

C. Li, M. Z. Chen, J. Lam, and X. Mao, “On exponential almost sure stability of random jump systems,” Institute of Electrical and Electronics Engineers Transactions on Automatic Control, vol. 57, no. 12, pp. 3064–3077, 2012.

L. Wu, X. Su, and P. Shi, “Sliding mode control with bounded gain performance of Markovian jump singular time-delay systems,” Automatica, vol. 48, no. 8, pp. 1929–1933, 2012.

T. Morozan and V. Dragan, “An H₂ type norm of a discrete-time linear sotchastic systems with periodic coefficients simultaneously affected by an infinite Markov chain and multiplicative white noise perterbations,” Stochastic Analysis and Applications, vol. 32, no. 5, pp. 776–801, 2014.

O. L. V. Costa and M. D. Fragoso, “Discrete-time LQ-optimal control problems for infinite Markov jump parameter systems,” IEEE Transactions on Automatic Control, vol. 40, no. 12, pp. 2076–2088, 1995.

T. Hou and H. Ma, “Exponential stability for discrete-time infinite Markov jump systems,” IEEE Transactions on Automatic Control, vol. 61, no. 12, pp. 4241–4246, 2016.

M. Gao, L. Sheng, and W. Zhang, “Stochastic H₂/H∞ control of nonlinear systems with time-delay and state-dependent noise,” Applied Mathematics and Computation, vol. 266, pp. 429–440, 2015.

Z. Wang, H. Qiao, and K. J. Burnham, “On stabilization of bilinear uncertain time-delay stochastic systems with Markovian jumping parameters,” Institute of Electrical and Electronics Engineers Transactions on Automatic Control, vol. 47, no. 4, pp. 640–646, 2002.

Z. Fei, H. Gao, and P. Shi, “New results on stabilization of Markovian jump systems with time delay,” Automatica, vol. 45, no. 10, pp. 2300–2306, 2009.

R. Song and Q. Zhu, “Stability of linear stochastic delay differential equations with infinite Markovian switchings,” International Journal of Robust and Nonlinear Control, vol. 28, no. 3, pp. 825–837, 2018.

Y. Liu, T. Hou, and X. Bai, “Infinite horizon H₂/H∞ optimal control for discrete-time infinite Markov jump systems with (x, u, v)-dependent noise,” in Proceedings of the 36th Chinese Control Conference, pp. 1955–1960, 2017.

G. Corach, A. Maestripieri, and D. Stojanoff, “Generalized Schur complements and oblique projections,” Linear Algebra and Its Applications, vol. 341, no. 1–3, pp. 259–272, 2002.