Journal of Control Science and Engineering

Volume 2013 (2013), Article ID 697849, 14 pages

http://dx.doi.org/10.1155/2013/697849

Research Article

Stochastic Stabilization of Itô Stochastic Systems with Markov Jumping and Linear Fractional Uncertainty

Fei Long,1,2 Hongmei Huang,1,2 and Adan Ding1,2

¹Institute of Intelligent Information Processing, Guizhou University, Guiyang 550025, China

²College of Computer Science and Information, Guizhou University, Guiyang 550025, China

Received 17 September 2012; Revised 19 December 2012; Accepted 6 January 2013

Academic Editor: Derong Liu

Copyright © 2013 Fei Long et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

For a class of Itô stochastic linear systems with the Markov jumping and linear fractional uncertainty, the stochastic stabilization problem is investigated via state feedback and dynamic output feedback, respectively. In order to guarantee the stochastic stability of such uncertain systems, state feedback and dynamic output control law are, respectively, designed by using multiple Lyapunov function technique and LMI approach. Finally, two numerical examples are presented to illustrate our results.

1. Introduction

Modeled by a set of linear systems with the transitions among the linear systems governed by the Markov chain, the Markov jumping linear system (MJLS) can characterize and model different types of systems [1], for instance, fault-tolerant systems, target tracking systems, manufactory processes, networked control systems, multiagent systems, and so on. In the past years, many important results on MJLS have been addressed in the literature, such as, the stability analysis and control design which were discussed in [2–8]. Besides the aforementioned theoretical studies, MJLS also found applications in practical systems, such as networked direct current motor systems [9].

The interest of this topic lies in the fact that many practical systems, with random abrupt changes, sudden environmental changes, and so on, can be modeled by Itô stochastic linear systems with Markov jumping and configurable uncertainty [10]. Therefore, it is very important to investigate robustly stochastic stabilization problem for the aforementioned Itô stochastic MJLS with linear fractional uncertainties. Recently, some results for Itô stochastic MJLS have been addressed in [11–18].

In this paper, motivated by the recent work [19], we consider robustly stochastic stabilization problem for Markov jumping Itô stochastic linear system subject to linear fractional uncertainty. An effective LMI-based approach for state feedback and dynamic output feedback controller is designed such that the closed-loop system is robust stable in the mean square sense, respectively.

The reminder of this paper is organized as follows: the problem statement is described in Section 2, while in Section 3 the stochastic stability for Itô stochastic MJLS with linear fractional uncertainty is addressed. In Section 4, the robustly stochastic stabilization of Itô stochastic MJLS with linear fractional uncertainty is investigated via state feedback and dynamical output feedback, respectively. Two numerical examples are presented in Section 5 to illustrate the obtained results. Finally, some conclusions are drawn in Section 6.

2. Problem Formulation

Consider the following unforced Itô stochastic MJLS with linear fractional uncertainties:

where is a Markov process taking values in a finite space and is the state vector. is a standard Wiener process that is supposed to be independent of the Markov process . denotes the initial state of system at , and stands for the initial mode in the Markov process at . and , are system matrices with compatible dimensions that depend on and , and

where , , , and are known real constant matrices with appropriate dimensions. is an unknown real matrix function with Lebesgue-measurable elements, satisfying with being the identity matrix.

The evolution of the Markov process is governed by the following probability transitions:

where is the transition rate from mode to mode at time instant when , and is the little- notation defined by .

For the stochastic stability, we adopt the following definition. For more details, please refer to [18] and the references therein.

Definition 1. The Itô stochastic MJLS in (1) with all modes and all is said to achieve stochastic stability if there exists a finite positive constant such that the following inequality holds for any initial condition :

where is the expectation conditioning on the initial value of .

3. Stochastic Stability

Before proceeding further, we recall the following lemma, which will be used in the proof of the stochastic stability of the Itô stochastic MJLS in (1).

Lemma 2 (see [20]). Let be given constant matrices with appropriate dimensions and norm-bounded time-varying uncertain matrix with . For any , one has

Lemma 3 (see [19]). Let the matrix G satisfy ; define the following set:

Then, the set can be rewritten as

Theorem 4. The Itô stochastic uncertain MJLS in (1) is stochastically stable if there exists a set of symmetric and positive-definite matrices and a set of positive scalars such that the following sets of coupled inequalities hold for each and all admissible linear fractional uncertainties:

where represents the blocks that are induced by symmetry and

Proof. Consider the following Lyapunov-like function:

where denotes the positive symmetric matrix. The infinitesimal generator can be considered as a derivative of the Lyapunov function along the trajectory of the Markov process in point at time . We need to derive the infinitesimal generator of first of all. According to the definition of , we have

where is a small positive number. Setting and applying the law of total probability and the probability transition of the Markov process yield

According to the Itô stochastic differential coefficient theorem [18], we have

Note that and , then the infinitesimal generator becomes

where .

Using Lemmas 2 and 3, we have

where , .

Hence , where

According to the Schur complement, , implies

Therefore .

By the generalized Dynkin formula, we have

The last inequality implies

Furthermore, the condition in (8) indicates , so

holds for any . Letting go to infinity, then, we know that

According to Definition 1, the Itô stochastic uncertain MJLS in (1) is stochastically stable. This ends the proof.

4. Stochastic Stabilization

4.1. State Feedback Stochastic Stabilization

In this subsection, we discuss how to design the robust state feedback control law for the following Itô stochastic uncertain MJLS:

where , are system matrices with compatible dimensions that depend on and , and

where , , , and are known real constant matrices with appropriate dimensions. is an unknown real matrix function with Lebesgue-measurable elements, satisfying with being the identity matrix. The robust state feedback control law to be designed is

where is a gain with appropriate dimension to be determined for each mode . Notice that the gain of the above controller is model dependent, which requires the knowledge of the model at time to choose the appropriate gain among . Thus when the model switches from mode , which uses the gain , to mode, the controller gains must be switched instantaneously to the gain to guarantee the desired performances.

Theorem 5. Suppose that there exists a set of symmetric and positive-definite matrices , a set of matrices , and a set of positive scalars and such that the following sets of coupled inequalities hold for each and all admissible linear fractional uncertainties. Then the controller (24) with gain can stabilize stochastically the Itô stochastic uncertain MJLS in (22)

where represents the blocks that are induced by symmetry and

Proof. With the use of the state feedback control law in (24) for system (22), the closed-loop system becomes

In order to guarantee the stochastic stability of system (27), using the stochastically stable condition in Theorem 4, we know that the following inequality should be satisfied for each :

Let , and before and after multiplying the matrix inequality (28) by , then, we have

Applying expressions (2) and (23) of the linear fractional uncertainties, the above inequality can be described as

Again in view of Lemmas 2 and 3, the following two matrix inequalities are obvious:

where

Setting

Then can be rewritten as follows:

Let , and by means of the matrix inequalities (31) and (34), the closed-loop system (27) will be stochastically stable if the following matrix inequality holds:

After using the Schur complement, we can get the LMIs (25), which end the proof of Theorem 5.

4.2. Dynamic Output Feedback Stochastic Stabilization

In Section 4.1, the design method of state feedback controller had been given under that the state vector and the mode are available at each time . However, some of the state variables are not measurable by their construction or the lack of appropriate sensors to give information. Alternatively we can use dynamic output feedback controller that uses the system’s measurement to design and to compute the control gains in this subsection.

In this subsection, we discuss how to design the dynamic output feedback control law for the following Itô stochastic uncertain MJLS:

where , are system matrices with compatible dimensions that depend on and , and

where , , , and are known real constant matrices with appropriate dimensions. is an unknown real matrix function with Lebesgue-measurable elements, satisfying with being the identity matrix. The dynamic output feedback control law is to be described by the following structure:

where is the controller state and , , and are the controller gains to be determined.

Theorem 6. If there exists a set of matrices , , , and and a set of positive scalars , , and such that the following sets of inequalities (39)–(41) hold for each and all admissible linear fractional uncertainties, then the dynamic output feedback controller (38) with control gain (43) can stabilize stochastically the Itô stochastic uncertain MJLS in  (36)

where represents the blocks that are induced by symmetry and

The dynamical output feedback controller gain is given by

Proof. Combining the dynamic system (36) with controller dynamics (38), we can obtain the following extended dynamics:

where and , are system matrices with compatible dimensions that depend on and , and

Applying Theorem 4, the dynamics (44) is stochastically stable if there exists a set of symmetric and positive-definite matrices such that the following inequalities hold for every :

Let , , and   , and using Lemma 3, we have

In view of (47) and Lemma 2, we have

Based on the matrix inequality (48), the condition (46) will be satisfied if the following holds:

It is obvious that inequality (49) is nonlinear in the design parameters , , , and , . In order to transform inequality (49) into an LMI, define , , , and as follows:

where , are symmetric and positive-define matrices.

Before and after multiply inequality (49) by and , respectively, we have

Using all these transformation, the condition (49) becomes

with

Since   and , we can obtain the following equivalent condition of (52) as follows:

Let , , and , then,

Define and by

then applying all the previous algebraic manipulations, we have

Using the expression of the controller given by (43), we have . This implies that the stability condition (54) is equivalent to the following conditions:

Let

Then,

According to the Schur complement and

the stability conditions (58) become (39) and (40). Finally, notice that

We get (41), which ends the proof of Theorem 6.

5. Numerical Example

The aim of the following two examples is used to illustrate the theoretical results in Section 4.

Example 7 (state feedback stochastic stabilization). Consider the Itô stochastic uncertain MJLS in (22) with and

mode no. 1

Mode no. 2

The jumping between the different modes is described by the transition rate matrix:

Setting and . By means of inequality (25), we have

Then applying Theorem 5, the state feedback controller gains are obtained as follows:

Therefore, the designed state feedback controller (24) is feasible and can guarantee the stochastic stability of the Itô stochastic uncertain MJLS in (22).

Example 8 (dynamic output feedback stochastic stabilization). Consider the Itô stochastic uncertain MJLS in (36) with and

mode no. 1

Mode no. 2

The transition probability rate matrix between the two modes is given by

Let , and ; in view of inequalities (39)–(41), we have

Then according to Theorem 6, the dynamic output feedback controller gains are obtained as follows:

Therefore, the designed dynamic output feedback controller (38) is feasible and guarantees the stochastic stability of the Itô stochastic uncertain MJLS in (36).

6. Conclusions

The robustly stochastic stabilization problem for the Markov jumping Itô stochastic linear systems with linear fractional uncertainties had been investigated via state feedback and dynamic output feedback. Sufficient conditions, by solving linear matrix inequalities, are presented to realize the design of controller. The robust control problem via state feedback and dynamic output feedback for such Itô stochastic MJLS with linear fractional uncertainties should be studied in future work.

Acknowledgments

The authors also gratefully acknowledge the helpful comments and suggestions of the reviewers, which have improved the presentation. This work was partially supported by the Natural Science Foundation of China under Grant (nos. 61263005 and 61065010), the Research Fund for the Doctoral Program of Higher Education under Grant no. 20105201120003, the Program for New Century Excellent Talents in University, and the Graduate School Innovation Foundation of Guizhou University.

References

Z. Wu, P. Shi, H. Su, and J. Chu, “Passivity analysis for discrete-time stochastic Markovian jump neural networks with mixed time delays,” IEEE Transactions on Neural Networks, vol. 22, no. 10, pp. 1566–1575, 2011.

Y. Fang and K. A. Loparo, “Stochastic stability of jump linear systems,” IEEE Transactions on Automatic Control, vol. 47, no. 7, pp. 1204–1208, 2002.

J. Xiong and J. Lam, “Stabilization of discrete-time Markovian jump linear systems via time-delayed controllers,” Automatica, vol. 42, no. 5, pp. 747–753, 2006.

L. Zhang and J. Lam, “Necessary and sufficient conditions for analysis and synthesis of markov jump linear systems with incomplete transition descriptions,” IEEE Transactions on Automatic Control, vol. 55, no. 7, pp. 1695–1701, 2010.

D. Yue, J. Fang, and S. Won, “Delay-dependent robust stability of stochastic uncertain systems with time delay and markovian jump parameters,” Circuits, Systems, and Signal Processing, vol. 22, no. 4, pp. 351–365, 2003.

P. Bolzern, P. Colaneri, and G. De Nicolao, “Markov Jump Linear Systems with switching transition rates: mean square stability with dwell-time,” Automatica, vol. 46, no. 6, pp. 1081–1088, 2010.

J. Wang and H. Yang, “Output-feedback stabilization of Markovian jump linear systems over networks with time delays,” Journal of Information and Computational Science, vol. 8, no. 13, pp. 2545–2552, 2011.

N. Xiao, L. Xie, and M. Fu, “Stabilization of Markov jump linear systems using quantized state feedback,” Automatica, vol. 46, no. 10, pp. 1696–1702, 2010.

H. Zhang, Y. Shi, and A. Mehr, “Robust static output feedback control and remote PID design for networked motor systems,” IEEE Transactions on Industrial Electronics, vol. 58, no. 12, pp. 5396–5405, 2011.

Z. Shu, J. Lam, and J. Xiong, “Non-fragile exponential stability assignment of discrete-time linear systems with missing data in actuators,” IEEE Transactions on Automatic Control, vol. 54, no. 3, pp. 625–630, 2009.

L. Ma and F. Da, “Exponential filter design for stochastic time-varying delay systems with Markovian jumping parameters,” International Journal of Robust and Nonlinear Control, vol. 20, no. 7, pp. 802–817, 2010.

W. Chen, Q. Ma, G. Miao, and Y. Zhang, “Stability analysis of stochastic neural networks with Markovian jump parameters using delay-partitioning approach,” Neurocomputing, vol. 103, pp. 22–28, 2013.

S. Wen, Z. Zeng, and T. Huang, “Reliable H∞ filter design for a class of mixed-delay markovian jump systems with stochastic nonlinearities and multiplicative noises via delay-partitioning method,” International Journal of Control, Automation and Systems, vol. 10, no. 4, pp. 711–720, 2012.

S. Sathananthan, C. Beane, G. S. Ladde, and L. H. Keel, “Stabilization of stochastic systems under Markovian switching,” Nonlinear Analysis: Hybrid Systems, vol. 4, no. 4, pp. 804–817, 2010.

C. Yuan and J. Lygeros, “Stabilization of a class of stochastic differential equations with Markovian switching,” Systems and Control Letters, vol. 54, no. 9, pp. 819–833, 2005.

C. Yuan and X. Mao, “Robust stability and controllability of stochastic differential delay equations with Markovian switching,” Automatica, vol. 40, no. 3, pp. 343–354, 2004.

Y. Niu, D. W. C. Ho, and X. Wang, “Sliding mode control for Itô stochastic systems with Markovian switching,” Automatica, vol. 43, no. 10, pp. 1784–1790, 2007.

E. K. Boukas, Stochastic Switching Systems: Analysis and Design, Birkhauser, Boston, Mass, USA, 2005.

F. Long, S. Fei, Z. Fu, S. Zheng, and W. Wei, “ control and quadratic stabilization of switched linear systems with linear fractional uncertainties via output feedback,” Nonlinear Analysis: Hybrid Systems, vol. 2, no. 1, pp. 18–27, 2008.

L. Xie, “Output feedback control of systems with parameter uncertainty,” International Journal of Control, vol. 63, no. 4, pp. 741–750, 1996.