Abstract and Applied Analysis

Volume 2014 (2014), Article ID 182613, 7 pages

http://dx.doi.org/10.1155/2014/182613

Research Article

Finite-Time Control for Discrete-Time Markov Jump Systems with Actuator Saturation

Bo Li and Junjie Zhao

School of Automation, Nanjing University of Science and Technology, Nanjing 210094, China

Received 28 December 2013; Accepted 15 February 2014; Published 9 April 2014

Academic Editor: Hao Shen

Copyright © 2014 Bo Li and Junjie Zhao. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

This paper investigates the finite-time control problem for discrete-time Markov jump systems subject to saturating actuators. A finite-state Markovian process is given to govern the transition of the jumping parameters. The finite-time controller via state feedback is designed to guarantee that the resulting system is mean-square locally asymptotically finite-time stabilizable. Based on stochastic finite-time stability analysis, sufficient conditions that ensure stochastic control performance of discrete-time Markov jump systems are derived in the form of linear matrix inequalities. Finally, a numerical example is provided to illustrate the effectiveness of the proposed approach.

1. Introduction

During the past several decades, the issue of finite-time control has drawn increasing attention of academic researchers in the area of control field, and various results have been reported. To this end, a considerable amount of research has been carried out; see Hong et al. [1]; He and Liu [2, 3]; Li et al. [4]; Song et al. [5]; Lan et al. [6]. Among the proposed solutions, state feedback control is an important approach to improve finite-time control performance. For instance, by using both state feedback and dynamic output feedback control, finite-time control of the robot system is studied in Hong et al. [7]. Furthermore, based on dynamic observer-based state feedback and Lyapunov-Krasovskii functional approach, the finite-time control problem for time-delay nonlinear jump systems was addressed in the work of He and Liu [2, 3, 8].

On the other hand, more and more attention has been paid to the study of actuator saturation due to its practical and theoretical importance. Therefore, various approaches were investigated to handle systems with actuator saturation, such as in the work of Cao and Lin [9]; the stability of discrete-time systems with actuator saturation was analyzed by a saturation-dependent Lyapunov function. By introducing a time-varying sliding surface, the robust stabilization problem of linear unstable plants with saturating actuators was studied in Corradini and Orlando [10]. Furthermore, the controller design method of Markov jumping systems subject to actuator saturation was presented in Liu et al. [11]. Via dynamic anti-windup fuzzy design, the robust stabilization problem of state delayed T-S fuzzy systems with input saturation was proposed in Song et al. [12]. Other results can refer to [13–17] and references therein.

It is well known that the control problem of Markov jump systems has also been extensively studied and a large variety of control problems have been widely investigated, for instance, the stabilization of Markov jump systems with time delays [18–24], robust control [25], control of singular Markov systems [26], control of discrete-time stochastic Markov jump systems [27, 28], and fuzzy dissipative control for nonlinear Markovian jump systems [29]. Furthermore, robust stability for uncertain delayed neural networks with Markov jumping parameters was analyzed in Li et al. [30]. Robust filter was designed for uncertain discrete Markov jump singular systems with mode-dependent time delay in Ma and Boukas [31]. Delay-dependent robust stabilization problem for uncertain stochastic switching systems with distributed delays was studied in Shen et al. [32]. Via retarded output feedback, passivity-based control problem for Markov jump systems was addressed in Shen et al. [33]. Observer based finite-time control problem of discrete-time Markov jump systems was studied in Zhang and Liu [34]. However, to the best of our knowledge, the problem of finite-time stabilization of discrete-time stochastic systems has not been fully investigated and it is the main purpose of our study.

In this paper, the attention is focused on the finite-time control problem of discrete-time Markov jump systems with actuator saturation. A state feedback controller is designed to ensure the stochastic finite-time boundedness and stochastic finite-time stabilization of the resulting closed-loop system for all admissible disturbances. The desired controller can be designed via solving a convex optimization problem. Finally, a numerical example is employed to show the effectiveness of the proposed method.

Notation. Throughout the paper, for symmetric matrices and , the notation (resp., ) means that the matrix is positive semidefinite (resp., positive definite). is the identity matrix with appropriate dimension. The notation represents the transpose of the matrix (resp., ) means the largest (resp., smallest) eigenvalue of the matrix ; is a probability space; is the sample space, is the -algebra of subsets of the sample space, and is the probability measure on denotes the expectation operator with respect to some probability measure . Matrices, if not explicitly stated, are assumed to have compatible dimensions. The symbol is used to denote a matrix which can be inferred by symmetry, .

2. Preliminaries and Problem Description

2.1. Preliminaries

Throughout this paper, we will use the following definitions and lemmas.

Lemma 1 (see [12]). For the matrix and the system , the appropriate matrix is given if is in the set , where is defined as follows:

then for any diagonal positive matrix , we derive

Lemma 2 (see [32]). For the given symmetric matrix :

where , , and ; the following conditions are equivalent:

(1), (2), (3).

Definition 3 (see [34]). The resulting closed-loop system (12) is stochastic finite-time stable (SFTB) with respect to with , , and if there exists state feedback controller such that

Definition 4 (see [34]). The resulting closed-loop system (12) is said to be stochastic finite-time stable via state feedback with respect to with , , , and if the system (11)-(12) is SFTB with respect to and under the zero-initial condition the output satisfies

for any nonzero which satisfies (10), where is a prescribed positive scalar. Moreover, the state feedback controller (11) is called controller of MJS (12).

2.2. Problem Description

Consider the following discrete-time Markov jump system in the probability space :

where is the state vector, is the controlled output, and is the saturated control input. is the external disturbances. is a discrete-time Markov process and takes values from a finite set with transition probabilities given by

where , for , and . Moreover, the transition rates matrix of the system is defined by

The inputs of the plant are supposed to be bounded as follows:

For the system , to simplify the notation, we denote for each , and the other symbols are similarly denoted. , , , , , and are known mode-dependent constant matrices with appropriate dimensions.

Assumption 5 (see [34]). The external disturbance is varying and satisfies the following constraint condition:

For the system , we construct the following state feedback controller:

Then, the resulting closed-loop discrete-time Markov jump system (MJS) is as follows:

where .

3. Main Results

In this section, we investigate the design of a state feedback controller which guarantees the locally finite-time stabilizable of the resulting closed-loop system. Some sufficient conditions and the method of designing state feedback controller are given.

Theorem 6. For each , there exists a feedback controller , , such that the resulting closed-loop system (12) is SFTB with respect to with , if there exist scalars , , and , three sets of mode-dependent symmetric matrices , , and , and two sets of mode-dependent matrices and , such that the following conditions hold:

where

Proof. Define the following Lyapunov function for each :

It is readily obtained that

where

Then by pre- and postmultiplying (13) by with , , we have

By using Schur complement lemma, we derive

It follows that

Since , we get

It is shown that

Then we have

Since , it is easily found that

Let

and noting that

it can be verified that

Similarly, for all , we can obtain

Then it is not difficult to find that

which implies

Then, one can obtain that

Set

it is easy to see that

It is obvious that (37) is equivalent to (14). Based on Lemma 1, it is easy to obtain condition (15). This completes the proof.

Theorem 7. For each , there exists a feedback controller , , such that the resulting closed-loop system (12) is said to be stochastic finite-time stable via state feedback with respect to , if there exist three scalars , , and , two sets of mode-dependent symmetric matrices and , and two sets of mode-dependent matrices and , such that the following conditions hold:

Proof. Choose the similar Lyapunov function as Theorem 6 and denote

Thus, in the light of Theorem 6, we have

Then by pre- and postmultiplying (38) by and considering Schur complement Lemma and (43), we derive

holds for all . According to (44), one can obtain that

Then, we have

Under the zero-value initial condition and noting that , for all , it is shown that

Since and from (47), we have

The following proof is similar to the process of Zhang and Liu [34].

Since , it follows that

and then by pre- and postmultiplying (49) by and its transpose, respectively, we derive condition (40). This completes the proof.

Remark 8. For the given scalars , we can take as the optimized variable to obtain an optimized finite-time stabilized controller. The attenuation lever can be reduced to the minimum possible value such that LMIs (38)–(41) hold. The optimization problem can be described as follows:

4. Illustrative Examples

In this section, a numerical example is provided to demonstrate the effectiveness of the proposed method. Consider the following systems with four operation modes.

Mode 1. Consider

Mode 2. Consider

Mode 3. Consider

Mode 4. Consider

The transition rate matrix is given as follows:

In this case, we choose the initial values for , , , , , , and ; Theorem 6 yields to , , , and the bounds of the input saturation .

Based on Theorem 7, we derive

Remark 9. The figures are given on the last page. In this part Figure 1 is of the jump rates; Figure 2 shows the states of the open-loop Markovian jump system; Figure 3 shows the states of the closed-loop Markovian jump system. By applying the controller studied in this paper to the closed-loop plant, it is obviously noticed that and converge to zero quickly. Based on the figures provided, the controller we designed guarantees that the resulting closed-loop systems are mean-square locally asymptotically finite-time stabilizable.

Figure 1: of jump rates.

Figure 2: of open-loop system.

Figure 3: of closed-loop system.

5. Conclusions

This paper considers the finite-time stabilization problem for a class of discrete-time Markov jump systems with input saturation. The finite-time controller via state feedback is designed to guarantee the stochastic finite-time boundedness and stochastic finite-time stabilization of the considered closed-loop system for all admissible disturbances. Based on stochastic finite-time stability analysis, sufficient conditions are derived in the form of linear matrix inequalities. Finally, simulation results are given to illustrate the effectiveness of the proposed approach. In the future, we will study the finite-time stabilization problem for a class of Markov jump systems with constrained input and time delay.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This work was supported by the National Natural Science Foundation of China under Grant 61203047, the Natural Science Foundation of Anhui Province under Grant 1308085QF119, and the Key Foundation of Natural Science for Colleges and Universities in Anhui province under Grant KJ2012A049.

References

Y. Hong, J. Wang, and D. Cheng, “Adaptive finite-time control of nonlinear systems with parametric uncertainty,” IEEE Transactions on Automatic Control, vol. 51, no. 5, pp. 858–862, 2006.

S. He and F. Liu, “Finite-time filtering of time-delay stochastic jump systems with unbiased estimation,” Journal of Systems and Control Engineering, vol. 224, no. 8, pp. 947–959, 2010.

S. He and F. Liu, “Observer-based finite-time control of time-delayed jump systems,” Applied Mathematics and Computation, vol. 217, no. 6, pp. 2327–2338, 2010.

S. Li, H. Liu, and S. Ding, “A speed control for a PMSM using finite-time feedback control and disturbance compensation,” Transactions of the Institute of Measurement and Control, vol. 32, no. 2, pp. 170–187, 2010.

H. Song, L. Yu, D. Zhang, and W.-A. Zhang, “Finite-time control for a class of discrete-time switched time-delay systems with quantized feedback,” Communications in Nonlinear Science and Numerical Simulation, vol. 17, no. 12, pp. 4802–4814, 2012.

Q. Lan, S. Li, J. Yang, and L. Guo, “Finite-time soft landing on asteroids using nonsingular terminal sliding mode control,” Transactions of the Institute of Measurement and Control, 2013.

Y. Hong, Y. Xu, and J. Huang, “Finite-time control for robot manipulators,” Systems & Control Letters, vol. 46, no. 4, pp. 243–253, 2002.

S. He and F. Liu, “Finite-time fuzzy control of nonlinear jump system with time delays via dynamic observer-based state feedback,” IEEE Transactions on Fuzzy Systems, vol. 20, no. 4, pp. 605–614, 2012.

Y.-Y. Cao and Z. Lin, “Stability analysis of discrete-time systems with actuator saturation by a saturation-dependent Lyapunov function,” Automatica, vol. 39, no. 7, pp. 1235–1241, 2003.

M. L. Corradini and G. Orlando, “Linear unstable plants with saturating actuators: robust stabilization by a time varying sliding surface,” Automatica, vol. 43, no. 1, pp. 88–94, 2007.

H. Liu, E.-K. Boukas, F. Sun, and D. W. C. Ho, “Controller design for Markov jumping systems subject to actuator saturation,” Automatica, vol. 42, no. 3, pp. 459–465, 2006.

X. Song, J. Lu, S. Xu, H. Shen, and J. Lu, “Robust stabilization of state delayed T-S fuzzy systems with input saturation via dynamic anti-windup fuzzy design,” International Journal of Innovative Computing, Information and Control, vol. 7, no. 12, pp. 6665–6676, 2011.

B. M. Chen, T. H. Lee, K. Peng, and V. Venkataramanan, “Composite nonlinear feedback control for linear systems with input saturation: theory and an application,” IEEE Transactions on Automatic Control, vol. 48, no. 3, pp. 427–439, 2003.

W. Lan and J. Huang, “Semiglobal stabilization and output regulation of singular linear systems with input saturation,” IEEE Transactions on Automatic Control, vol. 48, no. 7, pp. 1274–1280, 2003.

T. Hu, A. R. Teel, and L. Zaccarian, “Anti-windup synthesis for linear control systems with input saturation: achieving regional, nonlinear performance,” Automatica, vol. 44, no. 2, pp. 512–519, 2008.

J. M. Araujo, P. R. Barros, and C. E. T. Dórea, “Dynamic output feedback control of constrained descriptor systems,” Transactions of the Institute of Measurement and Control, vol. 35, no. 8, pp. 1129–1138, 2013.

H. Shen, X. Song, and Z. Wang, “Robust fault-tolerant control of uncertain fractional-order systems against actuator faults,” IET Control Theory & Applications, vol. 7, no. 9, pp. 1233–1241, 2013.

H. Gao and T. Chen, “New results on stability of discrete-time systems with time-varying state delay,” IEEE Transactions on Automatic Control, vol. 52, no. 2, pp. 328–334, 2007.

P. Park and J. Wan Ko, “Stability and robust stability for systems with a time-varying delay,” Automatica, vol. 43, no. 10, pp. 1855–1858, 2007.

H. Shen, S. Xu, J. Lu, and J. Zhou, “Passivity-based control for uncertain stochastic jumping systems with mode-dependent round-trip time delays,” Journal of the Franklin Institute, vol. 349, no. 5, pp. 1665–1680, 2012.

M. Wu, Y. He, J.-H. She, and G.-P. Liu, “Delay-dependent criteria for robust stability of time-varying delay systems,” Automatica, vol. 40, no. 8, pp. 1435–1439, 2004.

Z. Wu, P. Shi, H. Su, and J. Chu, “Passivity analysis for discrete-time stochastic Markovian jump neural networks with mixed time delays,” IEEE Transactions on Neural Networks, vol. 22, no. 10, pp. 1566–1575, 2011.

Z. Wu, P. Shi, H. Su, and J. Chu, “Stability analysis for discrete-time Markovian jump neural networks with mixed time-delays,” Expert Systems with Applications, vol. 39, no. 6, pp. 6174–6181, 2012.

Z. Wu, P. Shi, H. Su, and J. Chu, “Stochastic synchronization of Markovian jump neural networks with time-varying delay using sampled-data,” IEEE Transactions on Cybernetics, vol. 43, no. 6, pp. 1796–1806, 2013.

H. Liu, F. Sun, and E. K. Boukas, “Robust control of uncertain discrete-time Markovian jump systems with actuator saturation,” International Journal of Control, vol. 79, no. 7, pp. 805–812, 2006.

J. Raouf and E. K. Boukas, “Stabilisation of singular Markovian jump systems with discontinuities and saturating inputs,” IET Control Theory & Applications, vol. 3, no. 7, pp. 971–982, 2009.

Z. Wu, P. Shi, H. Su, and J. Chu, “Asynchronous filtering for discrete-time stochastic Markov jump systems with randomly occurred sensor nonlinearities,” Automatica, vol. 50, no. 1, pp. 180–186, 2014.

H. Shen, J. H. Park, L. Zhang, and Z.-G. Wu, “Robust extended dissipative control for sampled-data Markov jump systems,” International Journal of Control, 2014.

H. Shen, Z. Wang, X. Huang, and J. Wang, “Fuzzy dissipative control for nonlinear Markovian jump systems via retarded feedback,” Journal of the Franklin Institute, 2013.

H. Li, B. Chen, Q. Zhou, and W. Qian, “Robust stability for uncertain delayed fuzzy hopfield neural networks with Markovian jumping parameters,” IEEE Transactions on Systems, Man, and Cybernetics B: Cybernetics, vol. 39, no. 1, pp. 94–102, 2009.

S. Ma and E. K. Boukas, “Robust filtering for uncertain discrete Markov jump singular systems with mode-dependent time delay,” IET Control Theory & Applications, vol. 3, no. 3, pp. 351–361, 2009.

H. Shen, S. Xu, X. Song, and J. Luo, “Delay-dependent robust stabilization for uncertain stochastic switching systems with distributed delays,” Asian Journal of Control, vol. 11, no. 5, pp. 527–535, 2009.

H. Shen, S. Xu, X. Song, and G. Shi, “Passivity-based control for Markovian jump systems via retarded output feedback,” Circuits, Systems, and Signal Processing, vol. 31, no. 1, pp. 189–202, 2012.

Y. Zhang and C. Liu, “Observer-based finite-time control of discrete-time Markovian jump systems,” Applied Mathematical Modelling, vol. 37, no. 6, pp. 3748–3760, 2013.