Exponential Stability and Robust H ∞ Control for Discrete-Time Time-Delay Infinite Markov Jump Systems

In this paper, exponential stability and robustH∞ control problem are investigated for a class of discrete-time time-delay stochastic systems with infinite Markov jump and multiplicative noises. The jumping parameters are modeled as an infinite-state Markov chain. By using a novel Lyapunov-Krasovskii functional, a new sufficient condition in terms of matrix inequalities is derived to guarantee the mean square exponential stability of the equilibrium point. Then some sufficient conditions for the existence of feedback controller are presented to guarantee that the resulting closed-loop system has mean square exponential stability for the zero exogenous disturbance and satisfies a prescribed H∞ performance level. Numerical simulations are exploited to validate the applicability of developed theoretical results.


Introduction
During the past decades, Markov jump systems have been the subject of a great deal of research since they have been used extensively both in theory and in applications.Markov jump systems are hybrid dynamical systems composed of subsystems with the transitions determined by a Markov chain.A number of results that focused on Markov jump systems have been published ranging from filtering, stability, observability, and control to engineering application; see, for example, [1][2][3][4][5][6][7][8][9][10][11][12][13][14][15] and the references therein.
Note that most of the theoretical works related to Markov jump systems in the literatures concentrated on the case where the state space of the Markov chain is finite.However, it may be more appropriate to characterize abrupt changes in many real plants via an infinite-state Markov chain.As far as applications are concerned, infinite Markov jump systems are critical in some physics plants, such as solar thermal receiver, aircraft, and robotic manipulator systems.Theoretically, finite Markov jump systems are fundamentally different from those governed by infinite-state space.The work in [14] studied exponential almost sure stability of random jump systems.The work in [16] considered the definition and computation of an  2 -type norm for stochastic systems with infinite Markov jump and periodic coefficients.LQ-optimal control problem has been dealt with for discretetime infinite Markov jump systems in [17].The work in [18] demonstrated the inequivalence between stochastic stability and mean square exponential stability in discrete-time case.With this motivation, infinite Markov jump systems have stirred widespread research interests.
Time-delay is one of the inherent features of many practical systems and also is the big source of instability and poor performances in systems [19].Moreover, stochastic modeling has had extensive applications.Hence, dynamical time-delay stochastic systems deserve our consideration.Stability analysis and controller design of time-delay Markov jump systems have been investigated by many authors [15,20,21].Unfortunately, the literature about these issues for infinite Markov jump case is less developed.And, to the best of our knowledge, only a few results have been presented so far [18,22,23], let alone the problem involving time-delay.Actually, [18,23] investigated the exponential stability and infinite horizon  2 / ∞ control problem for discrete-time infinite Markov jump systems with multiplicative noises, respectively, but they neglected the effects of time-delay.Meanwhile, the authors in [22] considered time-delay, when discussing the stabilization problem for linear stochastic delay differential equations with infinite Markovian switching, but it was hard for the obtained stability results to deal with control problem.As mentioned above, stability and control for time-delay stochastic systems with infinite Markov jump and multiplicative noises have not received enough attention despite their importance in practical applications, which motivates us for the present research.
We aim to address the exponential stability and  ∞ control problem for a class of discrete-time time-delay stochastic systems with infinite Markov jumps and multiplicative noises in this paper.The main contributions of this paper are as follows: First of all, we investigate exponential stability of the equilibrium point for the considered systems by employing a novel Lyapunov-Krasovskii functional.Further, a sufficient condition is established to ensure exponential stability with a given  ∞ performance index of the closed-loop system.And we introduce the slack matrix to decouple the Lyapunov matrices, which makes the  ∞ controller design feasible.Moreover, some numerical examples are provided to show the effectiveness of the proposed design approaches.
The remaining part of this paper is constructed as follows.In Section 2, we formulate the system model and recall some definitions and lemmas.In Section 3, we present our main results, where we derive some sufficient conditions for exponential stability with a given  ∞ performance index.
Two numerical examples and their simulations are given to illustrate the effectiveness of the obtained results in Section 4. Conclusions are made in Section 5.
For convenience, we fix some notations that will be used throughout this paper.The -dimensional real Euclidean space is denoted by R  .R × stands for the linear space of all  by  real matrices.Let ‖ ⋅ ‖ be the Euclidean norm of R  or the operator norm of R × .By   and (0) we denote the set of all  ×  symmetric matrices and the identity (zero) matrix, respectively.  denotes the transpose of a matrix (or vector) .We say that  is positive (semipositive) definite if  > 0(≥ 0). max ()( min ()) represent the maximum (minimum) eigenvalue of . (⋅) is called the Kronecker function.
Definition .Closed-loop system (3) is said to have an  ∞ noise disturbance attenuation level  > 0, if under zero initial value the following condition is satisfied: Lemma 3 (see [22]).We denote Remark .Lemma 3 is the infinite-dimensional version of Schur complements (see [24]).
Remark .Due to the consideration of an infinite-state Markov chain, the infinite dimension Banach spaces have been introduced.Furthermore, it should be pointed out that a novel Lyapunov-Krasovskii functional (8) has been constructed to analyze the mean square exponential stability for system (1) with () = 0 and V() = 0.
Combining Theorem 5 with Theorem 7, the following corollary can be easily derived for closed-loop system (3).Corollary 8. Let the feedback control gain (),  ∈ D, be given.en closed-loop system ( ) has mean square exponential stability for V() = 0 with a prescribed  ∞ performance  if there exist two matrices  ∈ Ã+ ∞ and  ∈ Ã+ ∞ , such that Below, based on Corollary 8, we are ready to present the  ∞ controller design for system (1).Theorem 9.For system ( ), a state feedback controller can be designed such that closed-loop system ( ) has mean square exponential stability for V() = 0 and a given  ∞ performance  can be ensured if there exist matrices uniformly with respect to (, ) ∈ D × D, where Moreover, if matrix inequalities ( ) are feasible, then an exponentially stabilizing feedback gain can be given by Proof.Via Lemma 3, we conclude that (29) is equivalent to the following matrix inequality: where According to Corollary 8 and the fact that the desired result is derived.
Remark .The work in [20] presented a necessary and sufficient condition for the existence of the mixed  2 / ∞ control by four coupled matrix Riccati equations (CMREs).Note that CMREs are hardly solved in practice, and this motivates us to find a new sufficient condition in terms of matrix inequalities that can be easily solved to guarantee that the resulting closed-loop system has mean square exponential stability for the zero exogenous disturbance and satisfies a prescribed  ∞ performance level.
Remark .With the introduction of a slack matrix , a sufficient condition is obtained in Theorem 9, in which the Lyapunov matrices are not involved in any product with system matrices.This makes the  ∞ controller design feasible and can be easily carried out by solving corresponding matrix inequalities.

Remark
the corresponding results can be derived.

Illustrative Example
In this section, some illustrative examples are presented to demonstrate the effectiveness of the developed method.

Conclusions
In this paper, the issue of exponential stability and robust  ∞ control for a class of discrete-time time-delay stochastic systems with infinite Markov jumps and multiplicative noises has been studied.Time-delay and infinite Markov jump are taken into consideration simultaneously.By using Lyapunov-Krasovskii functional and introducing slack matrix, an matrix inequality approach has been adopted to ensure the mean square exponential stability and satisfy a prescribed  ∞ performance level.Finally, some illustrative examples are given to demonstrate the usefulness of the proposed design methods.Further research directions would include the investigation on  2 / ∞ control problem and asynchronous control problem for discrete-time time-delay stochastic systems with infinite Markov jumps.

Figure 1 :
Figure 1: System state response in Example 1.

Figure 2 :
Figure 2: System state response in Example 2.

Figure 3 :
Figure 3: System output response in Example 2.
. It is worth noting that the obtained results can be extended to discrete-time time-delay infinite Markov jump stochastic systems with time-varying delays.Assume that the time-varying delay () satisfies   ≤ () ≤   ; then by similar procedures to the above and choosing the following Lyapunov-Krasovskii function  ( () ,   ) =  ()   (  )  ()