Journal of Applied MathematicsVolume 2012 (2012), Article ID 950590, 24 pagesdoi:10.1155/2012/950590

Research Article

Exponential Passification of Markovian Jump Nonlinear Systems with Partially Known Transition Rates

Mengzhuo Luo¹ and Shouming Zhong1,2

¹School of Mathematical Sciences, University of Electronic Science and Technology of China, Chengdu, Sichuan 611731, China²Key Laboratory for Neuroinformation of Ministry of Education, University of Electronic Science and Technology of China, Chengdu, Sichuan 611731, China

Received 24 August 2011; Accepted 28 November 2011

Academic Editor: Ying U. Hu

Copyright © 2012 Mengzhuo Luo and Shouming Zhong. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

The problems of delay-dependent exponential passivity analysis and exponential passification of uncertain Markovian jump systems (MJSs) with partially known transition rates are investigated. In the deterministic model, the time-varying delay is in a given range and the uncertainties are assumed to be norm bounded. With constructing appropriate Lyapunov-Krasovskii functional (LKF) combining with Jensen’s inequality and the free-weighting matrix method, delay-dependent exponential passification conditions are obtained in terms of linear matrix inequalities (LMI). Based on the condition, desired state-feedback controllers are designed, which guarantee that the closed-loop MJS is exponentially passive. Finally, a numerical example is given to illustrate the effectiveness of the proposed approach.

1. Introduction

In recent years, more and more attention has been devoted to the Markovian jump systems since they are introduced by Krasovskii and Lidskii [1]. It is known that systems with Markovian jump parameters are a set of systems with transition among the models governed by a Markov chain taking values in a finite set. They have the character of stochastic hybrid systems with two components in the state. The first one refers to the mode which is described by a continuous-time finite-state Markov process, and the second one refers to the state which is represented by a system of differential equations. Markovian jump systems have got the virtue of modeling the abrupt phenomena such as random failures and repairs of the components changes in the interconnections of subsystems, sudden environment changes, and so forth, which often takes place in many dynamical systems [2–4]. So due to extensive applications of such systems in manufacturing systems, power systems, communication systems, and network-based control systems, recently, many works have been reported about MJSs, which including filtering problems [5–7], stability analysis problems [8–12], and control problems [13–20], and so forth.

However, the aforementioned references almost considered that the transition probabilities are known exactly. In some practical applications, the mode information is transmitted through unreliable networks, it may be lost or observed simultaneously. That means the systems mode is neither totally accessible or inaccessible. So the ideal assumption on the transition probabilities inevitably limits the application of the traditional Markovian jump systems theory. Therefore, whether in theory or in practice, it is necessary to further consider more general systems with partially mode information [21–27].

Recently, the passivity problems for a variety of practical systems have been attracting renewing attention [28–31]. The passivity theory was first proposed in the circuit analysis [32] so it has played an efficient role in both electrical network and nonlinear control systems. The main point of passivity theory is that the passive properties of system can keep the system internal stability. Thus, the passivity theory provides a nice tool for analyzing the stability of a nonlinear system, and the passivity analysis has received a lot of attention and has found applications in diverse areas such as signal processing, complexity, chaos control and synchronization, and fuzzy control [33–38]. In [33] authors dealt with global robust passivity analysis for stochastic interval neural networks with interval time varying delays and Markovian jumping parameter; in [34] both delay-independent and delay-dependent stochastic passivity conditions are presented for uncertain neural networks; in [35–37] authors discussed the robust passivity and passification of Markovian jump systems and fuzzy time-delay systems; in [38], the exponential passivity of neural networks with time-varying are studied and the results are extended to two types of uncertainties.

In practice, input delays are often encountered in control systems because of the transmission of measurement information. Especially, in networked control systems, sensors controllers, and plants are often connected by a net medium hence it is quite meaningful to study the effect of the input delay in the design of controllers. However, to the best of the authors’ knowledge providing less conservative delay-dependent exponential passification criteria for uncertain MJS with input delays and partially known transition rates to desired performance are still open problems.

Motivated by this observation, in this paper, we study the exponential passification problem of nonlinear Markovian jump systems with partially known transition rates, including state and input delays, the aim of this problem is to design a controller such that the resulting closed-loop systems satisfy a certain passivity performance index. Comparing with the large amount of the literature on the analysis of stability of Markovian jump systems, passivity analysis and passification for these systems have many obvious advantages. Thus, research in this area should be of both theoretical and practical importance, which motivates us to carry out the present work. Based on the LKF theory and the free-weighting matrix method, some desired exponentially passification controllers are designed, which guarantee that the closed-loop MJS is exponential passive. Finally, a numerical example is used to illustrate the designed method.

Notations.

The notations are quite standard. Throughout this letter and denote, resp., the -dimensioned Euclidean space and the set of all real matrices. The notation (resp., means that and are symmetric matrices, and that is positive semidefinitive (resp., positive definite). is the Euclidean norm in . is the identity matrix with compatible dimension. If is a matrix, (respective ) means the largest (respective smallest) eigervalue of . Moreover, let be a complete probability space with a filteration. satisfies the usual conditions (i.e, the filtration contains all -null sets and is right continuous). stands for the mathematical expectation operator with respect to the given probability measure. Denote by the family of all measurable -valued random variables such that . The asterisk * in a matrix is used to denote term that is induced by symmetry. Matrices, if not explicitly specified, are assumed to have appropriate dimensions. Sometimes, the arguments of function will be omitted in the analysis when no confusion can be arised.

2. Problem Formulation and Preliminaries

Consider the following uncertain MJS with time-varying delays Here is the state vector, is the control input, is the control output, and is the exogenous disturbance input which belongs to is a homogenous finite-state Markov process with right continuous trajectories, which takes value in a finite-state space with generator and has the mode transition probabilities where is the transition rete from to , and

For notational simplicity, which , the matrices , , , ,  , , and will be described by , , , , and . We denote that where , and are known constant matrices with appropriate dimensions. In this paper, the transition rates of Markov chain are partially known, that is, some elements in matrix are unknown. We denote that moreover, if , it is further described as .

Remark 2.1. represents the index of the known element in the row of transition rate matrix. The case is excluded, which means if we have only one unknown element, one can naturally calculate it from the known elements in each row and the transition rate matrix property.

Now the mode-dependent state-feedback controller is taken to be as follows: then, the closed-loop MJS can be represented as

Before proceeding further, we will introduce the following assumptions, definition and some lemmas which will be used in the next section.

Assumption 1. The uncertain parameters are assumed to be of the form: where , and are known real constant matrices with appropriate dimensions and , are unknown time-varying matrix functions satisfying

Remark 2.2. It is assumed that all the elements , are Lebesgue measurable. The matrices , and are said to be admissible if and only if both (2.9) and (2.10) hold. The parameter uncertainty structure as in Assumption 1 is an extension of the so-called matching condition, which has been widely used in the problems of control and robust filtering of uncertain linear systems.

Assumption 2. The time-varying delay satisfies , with , and being real constant scalars for each for all .

Assumption 3. For a fixed system mode , there exists a know real constant mode-dependent matrix such that the nonlinear vector function satisfy the following conditions:

Definition 2.3 (see [39]). The MJS (2.8) is said to be passive if there exists a constant such that holds for all .

Definition 2.4. The MJS (2.8) is said to be exponentially passive from input to output , if there exists an exponential Lyapunov function (or called the exponential storage funtion) defined on , and positive scalars , such that for all , all initial conditions , all , the following inequality holds:

Remark 2.5. From Definition 2.4, if , then the MJS in the form (2.8) is passive, in other words, exponential passivity implies passivity. It follows from (2.13) that Then from Definition 2.3, we can see that MJS (2.8) is passive. But the converse does not necessarily hold, that is, we can not obtain the exponential passive if systems are passive.

Lemma 2.6 (see [36]). Let , and depend affinely on . Then the following linear matrix inequality: holds if and only if one of the following conditions holds: (1);(2).

Lemma 2.7 (see [40]). Let , and be real matrices of appropriate dimensions with and satisfy . Then the following statement holds. (1)For any scalar (2)For any vectors and with appropriate dimensions

Lemma 2.8 (see [41]). Let be real matrices with appropriate dimensions. Then there exist a matrix such that , if and only if, there exists a scalar and such that

3. Main Results

3.1. Exponential Passivity Analysis

In this section, we assumed the transition rates are partially known and given the state-feedback controller gain matrix , at first, we will present a sufficient condition, which guarantees the MLS (2.8) is exponential passive.

Theorem 3.1. Given the state-feedback controller gain matrix , the uncertain MJS (2.8) is exponentially passive in the sense of expectation if there exists positive definite matrices , positive scalars , and for any matrices with appropriate dimensions such that the following matrices inequalities hold for all : Case 1. If Case 2. If where

Proof. First, in order to cast our model involved in the framework of the Markov process, we define a new process , and let be the weak infinitesimal generator of the random process and Now consider the Lyapunov-Krasovskii functional as follows for : where where In order to show the exponential passivity of the MJS (2.8) under the given controller gain matrix , we set Notice thatThen using Newton-Leibniz formula, for any matrices we have where From the Lemma 2.7 (2.2), it is easy to see thatNow by Assumption 3, it can be deduced that for any positive scalar , Then from the above discussion, we can see that where other terms of are similar to . In order to get our results, we will describe that the and . By the Schur complement, and under the restriction of (3.14) if and only if where is the nominal matrix of . Then from the Lemma 2.7 (2.1), above matrix inequality holds, which is equivalent to Case 1. If then (3.24) is equivalent to Obviously, we can see that if (3.1) and (3.4) hold, then and under the restriction of (3.14). Next we will further consider the equivalent form of (3.14). is equivalent to If we have the following matrix inequalities hold, we can have that (3.14) is satisfied Obviously, (3.27) is equivalent to (3.2) and (3.3) by the Schur complement. Case 2. If then (3.24) is equivalent to Then if (3.1), (3.8), and (3.9) hold, then and under the restriction of (3.14), furthermore, with the similar consideration, we can deduce that if (3.5)–(3.7) are established, then (3.14) is founded. So there exists a positive scalar , then On the other hand, it is easy to obtain that where , .Let be sufficiently small such that So, by Definition 2.4, the MJS (2.8) is exponentially passive. This completes the proof.

Remark 3.2. It is easy to derive that the MJS (2.8) is exponential mean square stability with if the MJS (2.8) is exponentially passive. Moreover, the result of Theorem 3.1 makes use of the information of the subsystems upper bounds of the time varying delays, which may bring us less conservativeness, and from the free-weighting matrix and Newton-Leibnitz formula, the upper bounds of are not restricted to be less than 1 in this paper. Therefore, our result is more natural and reasonable to the Markovian jump systems.

Remark 3.3. In order to obtain the gain matrices for convenience in the next section, (3.1) is not LMI, if we substitute by and use the Lemma 2.7 (2.1), we can obtain the equivalent form of LMI.

3.2. Exponential Passification

In this section, we will determine the feedback controller gain matrices in (2.7), which guarantee that the closed-loop MJS (2.8) is exponentially passive with partially known transition rates.

Theorem 3.4. Given a positive constant , there exists a state-feedback controller in the form (2.7) such that the closed-loop MJS (2.8) is exponentially passive if there exist positive definite matrices , positive scalar , and for any matrices with appropriate dimensions satisfying the following LMIs under the two cases for all . Case 1. If Case 2. If where when the LMIs are feasible, a desired state-feedback controller can be obtained in the form of (2.7) with the controller gains given by for all.

Proof. At first, we list the following fact: which implies that Now perform a congruence transformation to (3.1) byIf , then by the Schur complement and (3.44), we can infer that (3.34) is established. In the same way, if , (3.39) is established.From Lemma 2.8, we can see that (3.35) is equivalent to , so (3.4) can be established. Furthermore, using the same method that proposed above, we can deduced that (3.32), (3.33), (3.36)–(3.38), and (3.40) are equivalent to (3.2) (3.3), (3.5)–(3.7), and (3.8), respectively. In conclusion, the gain matrix of desired controller in the form of (2.7) is given by . This completes the proof.

Remark 3.5. To reduce the conservatism, when estimating is not simply enlarged as , but , are considered as well, and different free-weighting matrices are introduced. This method above may lead to obtain improved feasible region for delay-dependent exponential passivity criteria.

Remark 3.6. In fact, Theorem 3.1 gives a exponential passivity criteria for MJS (2.8) with , where is a given constant. In many cases, is unknown. Considering this case, a rate-independent criteria for a delay satisfying is derived as follows by setting in the proof of Theorem 3.1.

4. Examples

In this section, we will consider a interval time-varying delay MJS in the form of (2.8) with three modes, and the parameters of the system are given as follows: The two cases of the transition rates matrices are described as follows: where means the unknown element. With the choice of and , we can obtain the feasibility solution of case 1 and case 2 as follows. Case 1: case 2:

Under the two cases above, Table 1 lists the state-feedback controller gains matrix , which can be determined by the method of Theorem 3.4. If the is sufficiently small, we can check that the MJS (2.8) is exponentially passive under the condition of Theorem 3.4. Given the initial condition as and , from Figures 1 and 2, we can easily see that the closed-loop system in (2.8) is mean square exponential stable with .

Table 1: Calculated the controller gains matrix for different cases.

Case 1
Case 2

Figure 1: State response of case 1 and the switch signal.

Figure 2: State response of case 2 and the switch signal.

Remark 4.1. In order to illustrate the effectiveness of the proposed approach, a numerical example is given which included two cases, that is, case 1, the transition rate matrix is completely known; case 2, some elements in the transition rate matrix are inaccessible. By using Matlab Toolbox, we can obtain the gain matrix , which guarantees that the Markovian jump systems (2.8) is robust exponential passivity. If we choose the switch signal as Figures 1 and 2, we can know that the closed-loop system (2.8) is exponentially stable in the mean square under the state-feedback controllers obtained above, which have been listed in Table 1.

5. Conclusions

In this paper, the problems of exponential passification of uncertain MJS have been investigated. To reflect more realistic dynamical behaviors of the system, both the partially known transition rates, state and input delays have been considered. With utilizing the Lyapunov functional method and free-weighting matrix method, delay-dependent exponential passivity conditions are established. Finally, an illustrative example has been given to demonstrate the effectiveness of the proposed approach.

Acknowledgments

This work was supported in part by the Opening Fund of Geomathematics Key Laboratory of Sichuan Province (scsxdz2011001) and the National Basic Research Program of China (2010CB732501).

References

N. N. Krasovskii and E. A. Lidskii, “Analysis and design of controllers in systems with random attributes,” Automatic Remote Control, vol. 22, pp. 1021–1025, 1961.

B. García-Mora, C. Santamaría, E. Navarro, and G. Rubio, “Modeling bladder cancer using a Markov process with multiple absorbing states,” Mathematical and Computer Modelling, vol. 52, no. 7-8, pp. 977–982, 2010.

K. P. Chung, “Steady state solution and convergence rate of time-dependent Markov chains of queuing networks,” Computers & Mathematics with Applications, vol. 15, no. 5, pp. 351–358, 1988.

Z. Wang, Y. Liu, L. Yu, and X. Liu, “Exponential stability of delayed recurrent neural networks with Markovian jumping parameters,” Physics Letters A, vol. 356, no. 4-5, pp. 346–352, 2006.

P. Shi, M. Mahmoud, S. K. Nguang, and A. Ismail, “Robust filtering for jumping systems with mode-dependent delays,” Signal Processing, vol. 86, no. 1, pp. 140–152, 2006.

Z. Wang, J. Lam, and X. Liu, “Robust filtering for discrete-time Markovian jump delay systems,” IEEE Signal Processing Letters, vol. 11, no. 8, pp. 659–662, 2004.

Q. Ding and M. Zhong, “On designing fault detection filter for markovian jump linear systems with polytopic uncertainties,” International Journal of Innovative Computing, Information and Control, vol. 6, no. 3, pp. 995–1004, 2010.

X. Zhao and Q. Zeng, “New robust delay-dependent stability and analysis for uncertain Markovian jump systems with time-varying delays,” Journal of the Franklin Institute, vol. 347, no. 5, pp. 863–874, 2010.

X. D. Zhao and Q. S. Zeng, “Delay-dependent stability analysis for Markovian jump systems with interval time-varying-delays,” International Journal of Automation and Computing, vol. 7, no. 2, pp. 224–229, 2010.

B. Chen, H. Li, P. Shi, C. Lin, and Q. Zhou, “Delay-dependent stability analysis and controller synthesis for Markovian jump systems with state and input delays,” Information Sciences, vol. 179, no. 16, pp. 2851–2860, 2009.

Z. Shu, J. Lam, and J. Xiong, “Static output-feedback stabilization of discrete-time Markovian jump linear systems: a system augmentation approach,” Automatica, vol. 46, no. 4, pp. 687–694, 2010.

J. Qiu and K. Lu, “New robust passive stability criteria for uncertain singularly Markov jumpsystems with time delays,” ICIC Express Letters, vol. 3, no. 3, pp. 651–656, 2009.

Y. Kang, J. F. Zhang, and S. S. Ge, “Robust output feedback control of uncertain Markovian jump systems with mode-dependent time-delays,” International Journal of Control, vol. 81, no. 1, pp. 43–61, 2008.

E. K. Boukas and Z. K. Liu, “Robust control of discrete-time Markovian jump linear systems with mode-dependent time-delays,” IEEE Transactions on Automatic Control, vol. 46, no. 12, pp. 1918–1924, 2001.

W.-H. Chen, Z.-H. Guan, and P. Yu, “Delay-dependent stability and control of uncertain discrete-time Markovian jump systems with mode-dependent time delays,” Systems & Control Letters, vol. 52, no. 5, pp. 361–376, 2004.

P. Shi, E.-K. Boukas, and R. K. Agarwal, “Control of Markovian jump discrete-time systems with norm bounded uncertainty and unknown delay,” IEEE Transactions on Automatic Control, vol. 44, no. 11, pp. 2139–2144, 1999.

G. Nakura, “Stochastic optimal tracking with preview by state feedback for linear discrete-time markovian jump systems,” International Journal of Innovative Computing, Information and Control, vol. 6, no. 1, pp. 15–28, 2010.

X. Luan, F. Liu, and P. Shi, “Neural network based stochastic optimal control for nonlinear Markov jump systems,” International Journal of Innovative Computing, Information and Control, vol. 6, no. 8, pp. 3715–3723, 2010.

Y. Xia, Z. Zhu, and M. S. Mahmoud, “H₂ control for networked control systems with Markovian datalosses and delays,” ICIC Express Letters, vol. 3, no. 3, pp. 271–276, 2009.

T. Senthilkumar and P. Balasubramaniam, “Delay-dependent robust stabilization and control for nonlinear stochastic systemswith Markovian jump parameters and interval time-varying delays,” Journal of Optimization Theory and Applications, vol. 151, pp. 100–120, 2011.

X. Zhao and Q. Zeng, “Delay-dependent performance analysis for markovian jump systems with mode-dependent time varying delays and partially known transition rates,” International Journal of Control, Automation and Systems, vol. 8, no. 2, pp. 482–489, 2010.

L. Zhang and E.-K. Boukas, “Stability and stabilization of Markovian jump linear systems with partly unknown transition probabilities,” Automatica, vol. 45, no. 2, pp. 463–468, 2009.

L. Zhang, E.-K. Boukas, and J. Lam, “Analysis and synthesis of Markov jump linear systems with time-varying delays and partially known transition probabilities,” IEEE Transactions on Automatic Control, vol. 53, no. 10, pp. 2458–2464, 2008.

Y. Yin, P. Shi, F. Liu, and J. S. Pan, “Gain-scheduled fault detection on stochastic nonlinear systems with partially known transition jump rates,” Nonlinear Analysis, vol. 13, no. 1, pp. 359–369, 2011.

Y. Yin, P. Shi, and F. Liu, “Gain-scheduled PI tracking control on stochastic nonlinear systems with partially known transition probabilities,” Journal of the Franklin Institute, vol. 348, no. 4, pp. 685–702, 2011.

X. L. Luan, F. Liu, and P. Shi, “Finite-time stabilization of stochastic systems with partially known transition probabilities,” Journal of Dynamic Systems, Measurement and Control, Transactions of the ASME, vol. 133, no. 1, Article ID 014504, 6 pages, 2011.

L. Zhang, E. K. Boukas, and P. Shi, “ model reduction for discrete-time Markov jump linear systems with partially known transition probabilities,” International Journal of Control, vol. 82, no. 2, pp. 343–351, 2009.

P. Balasubramaniam and G. Nagamani, “A delay decomposition approach to delay-dependent passivity analysis for interval neural networks with time-varying delay,” Neurocomputing, vol. 74, no. 10, pp. 1646–1653, 2011.

P. Balasubramaniam, G. Nagamani, and R. Rakkiyappan, “Global passivity analysis of interval neural networks with discrete and distributed delays of neutral type,” Neural Processing Letters, vol. 32, no. 2, pp. 109–130, 2010.

P. Balasubramaniam, G. Nagamani, and R. Rakkiyappan, “Passivity analysis for neural networks of neutral type with Markovian jumping parameters and time delay in the leakage term,” Communications in Nonlinear Science and Numerical Simulation, vol. 16, no. 11, pp. 4422–4437, 2011.

P. Balasubramaniam and G. Nagamani, “Passivity analysis of neural networks with Markovian jumping parameters and interval time-varying delays,” Nonlinear Analysis, vol. 4, no. 4, pp. 853–864, 2010.

V. Bevelevich, Classical Network Synthesis, Van Nostrand, New York, NY, USA, 1968.

P. Balasubramaniam and G. Nagamani, “Global robust passivity analysis for stochastic interval neural networks with interval time-varying delays and Markovian jumping parameters,” Journal of Optimization Theory and Applications, vol. 149, no. 1, pp. 197–215, 2011.

Y. Chen, H. Wang, A. Xue, and R. Lu, “Passivity analysis of stochastic time-delay neural networks,” Nonlinear Dynamics, vol. 61, no. 1-2, pp. 71–82, 2010.

X. Yao, L. Wu, W. X. Zheng, and C. Wang, “Passivity analysis and passification of Markovian jump systems,” Circuits, Systems, and Signal Processing, vol. 29, no. 4, pp. 709–725, 2010.

J. Liang, Z. Wang, and X. Liu, “Robust passivity and passification of stochastic fuzzy time-delay systems,” Information Sciences, vol. 180, no. 9, pp. 1725–1737, 2010.

C. Li, H. Zhang, and X. Liao, “Passivity and passification of fuzzy systems with time delays,” Computers & Mathematics with Applications, vol. 52, no. 6-7, pp. 1067–1078, 2006.

S. Zhu, Y. Shen, and G. Chen, “Exponential passivity of neural networks with time-varying delay and uncertainty,” Physics Letters A, vol. 375, no. 2, pp. 136–142, 2010.

B. Brogliato, R. Lozano, B. Maschke, and O. Egeland, Dissipative Systems Analysis and Control: Theory and Applications, Springer, London, UK, 2nd edition, 2007.

C. Y. Lu, H. H. Tsai, T. J. Su, J. S. H. Tsai, and C. W. Liao, “A delay-dependent approach to passivity analysis for uncertain neural networks with time-varying delay,” Neural Processing Letters, vol. 27, no. 3, pp. 237–246, 2008.

H. N. Wu and K. Y. Cai, “Mode-independent robust stabilization for uncertain Markovian jump nonlinear systems via fuzzy control,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 36, no. 3, pp. 509–519, 2006.