Abstract and Applied Analysis

Volume 2014 (2014), Article ID 809290, 10 pages

http://dx.doi.org/10.1155/2014/809290

Research Article

Finite-Time Control for Time-Delayed Stochastic Systems with Markovian Switching

Wenhua Gao,¹ Feiqi Deng,² Ruiqiu Zhang,³ and Wenhui Liu²

¹Department of Mathematics, School of Science, South China University of Technology, Wushan Road, Tianhe, Guangzhou 510641, China

²Systems Engineering Institute, South China University of Technology, Guangzhou, China

³School of Design, South China University of Technology, Guangzhou, China

Received 15 August 2013; Revised 1 October 2013; Accepted 4 October 2013; Published 20 February 2014

Academic Editor: Khalil Ezzinbi

Copyright © 2014 Wenhua Gao et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

This paper studies the problem of finite-time control for time-delayed Itô stochastic systems with Markovian switching. By using the appropriate Lyapunov-Krasovskii functional and free-weighting matrix techniques, some sufficient conditions of finite-time stability for time-delayed stochastic systems with Markovian switching are proposed. Based on constructing new Lyapunov-Krasovskii functional, the mode-dependent state feedback controller for the finite-time control is obtained. Simulation results illustrate the effectiveness of the proposed method.

1. Introduction

Finite-time stability is different from the usual Lyapunov stability. Lyapunov stability is always used to deal with the asymptotic pattern of system trajectories by applying the steady-state behavior of control dynamics over an infinite-time interval [1]. Often Lyapunov asymptotic stability is not enough for practical applications, because there are some cases where large values of the state are not acceptable, for instance, in the presence of saturations [2]. Lyapunov asymptotic stability depicts steady-state performance of a dynamic system, and it could not reflect transient state performance [3]. A finite-time stable system may not be Lyapunov stable, and a Lyapunov stable system may not be finite-time stable. To study the transient performances of a system, the concept of finite-time stability was introduced by Dorato in [4]. Finite-time stability (or short-time stability) is also called finite-time boundness. A system is said to be finite-time stable if, once a time interval is fixed, its state does not exceed some bounds during this time interval. Because the working time of many systems such as communication network system, missile system, and robot control system is short, people are more interested in finite-time stability of these systems.

Early results on finite-time stability are mostly confined to the stability analysis and lack of design and comprehensiveness of control systems (see [5–9]). During the nineteen seventies, scholars began to discuss the control design method of finite-time stabilization (see [10–13]). In recent years, the development of the theory of linear matrix inequalities promotes the research on finite-time stability and makes this research field a new breakthrough [14–20].

In particular, for systems with time delay or Markov switching or random disturbance, there are some significant research results on finite-time stability and stabilization. For example, finite-time stability and stabilization problem for Itô stochastic systems was studied in [21–27], finite-time stability and stabilization problem for Markovian jump systems was studied in [28–31], and finite-time stability and stabilization problem for time-delay systems was studied in [2, 32].

With the development of finite-time [33] stability, the problem of finite-time control has received a lot of attention [1, 3, 34–39]. For example, using the average dwell time method and the multiple Lyapunov-like function technique, some sufficient conditions are proposed to guarantee the finite-time properties for the switched Itô stochastic systems in the form of matrix inequalities and a state feedback controller for the finite-time control problem is also obtained in [36]. Delay-dependent observer-based finite-time control for switched systems with time-varying delay was investigated in [34]. The robust finite-time control problem for a class of uncertain switched neutral systems with unknown time-varying disturbance was developed in [3]. The problem of robust finite-time control of singular Itô stochastic systems via static output feedback was addressed in [38]. However, the systems discussed in [3, 34, 36] are general switched systems rather than Markovian jump systems. Markovian jump systems [40–45] (also called systems with Markovian switching) are frequently used to model the dynamics behavior of the process in which variable parameters or structures subject to random abrupt changes occur, for example, sudden environment changes, system noises, subsystem switching, and failures that occurred in interconnections or components and executor faults [46]. On the other hand, most work on the problem of finite-time control focused on the determination of linear or nonlinear system. As is known, stochastic modeling plays an important role in many branches of science and engineering (see [47, 48]). At present, the research of finite-time control for Itô stochastic system is still at the beginning stage. To the best of the authors' knowledge, the problem of finite-time control for time-delayed Itô stochastic systems with Markovian switching has not been investigated, which motivated our study.

In this paper, we will focus on the finite-time state feedback control problem for time-delayed Itô stochastic systems with Markovian switching. The aim is to find a state feedback controller

for system (2) such that the corresponding closed-loop system is finite-time stochastically bounded with a weighted performance . The rest of the paper is organized as follows. In Section 2, problem description and some definitions are given. In Section 3, finite-time stochastic stability and bounded conditions for time-delayed Itô stochastic systems with Markovian switching are presented. The corresponding results of finite-time stochastic control problem for time-delayed Itô stochastic systems with Markovian switching are proposed in Section 4. An illustrative example is given in Section 5, and conclusions are given in Section 6.

Notation. Throughout this paper, if not explicit, matrices are assumed to have compatible dimensions. The notation means that the symmetric matrix is positive-definite (positive-semidefinite, negative, and negative-semidefinite). and denote the minimum and the maximum eigenvalue of the corresponding matrix. represents the Euclidean norm for vector or the spectral norm of matrices. refers to an identity matrix of appropriate dimensions. stands for the mathematical expectation. The symbol “*” within a matrix denotes a term that is induced by symmetry.

2. Problem Description

In this paper, we consider the following time-delayed stochastic systems with Markovian switching:

where is the system state, is the control input, is the control output, and is exogenous disturbance that satisfies . , , , , , , , , , , and are known mode-dependent constant matrices with appropriate dimensions. is a zero-mean real scalar Wiener process on a complete probability space with a natural filtration , where is the sample space, is the -algebras of sets of the sample space, and is the probability measure on . is an initial condition. It is known that system (2) has a unique solution, denoted by . is the time-varying delay and satisfies , , where , are constants.

The jump parameter is a continuous-time discrete-state Markov stochastic process taking values on a finite set with transition rate matrix given by

where , , for , and , for .

Definition 1. For given time-constant , system (2) with and is said to be stochastically finite-time stable with respect to , where , , if

Definition 2. For given time-constant , system (2) with is said to be finite-time stochastically bounded with respect to , where , , if

Definition 3. For given time-constant , , system (2) with is said to be finite-time stochastically bounded with respect to , where , , if

(i)system (2) is finite-time stochastically bounded with respect to ;(ii)under zero-initial condition, the output satisfies

Definition 4. For given time-constant , , systems (2) are said to be finite-time stabilizable with disturbance attenuation level , if there exists a controller such that

(i) the corresponding closed-loop system is finite-time stochastically bounded with respect to ;

(ii) under zero-initial condition, (6) holds for any satisfying .

Lemma 5. Given constant matrices , , and with appropriate dimensions, where , , then if and only if

3. Finite-Time Stochastic Stability and Bounded Analysis

In this section, we consider the systems (2) with :

Let be the stochastic Lyapunov Krasovskii functional; define its weak infinitesimal operator as

Theorem 6. System (2) with is finite-time stochastically bounded with respect to , where , , if there exist positive-definite symmetric matrices , , , and and positive scalars , , , and , such that the following conditions hold:

Proof. We denote that . For convenience, we also denote , , , , , , , , , , and as , , , , , , , , , , and . Take the Lyapunov-Krasovskii functional for systems (8) as

where is the given mode-dependent symmetric positive-definite matrix for each mode and is the symmetric positive-definite matrix.

Along the trajectory of system (8), we have

where .

Consider the following:

where

Set , ; we have

From (15) to (19), we obtain

where

Using weak infinitesimal operator and (8), we can get

By integrating both sides of (22) from 0 to , taking expectations, and by (10)–(12), it follows that

On the other hand, by (11), it is easy to see that

Now, (24) together with (13) and (23) implies that

The proof is completed.

Remark 7. It should be pointed out that the upper bound of the derivative of time-varying delay in this paper allows or . When , we have . When , we have whether or . So the function in (16) is introduced. It should be noted that the upper bound in [49] only allows . Moreover, as explained above, the inequality amplification result on (14) in [49] is not true. So our results can be applied to more general systems.

Remark 8. From (13), we can obtain the upper bound of the delay ; that is,

Remark 9. Assuming that , for certain and , by Lemma 5, we can obtain the following linear matrix inequalities (LMIs) that are equivalent to condition (13):

Corollary 10. System (8) with is stochastically finite-time stable with respect to , where , , if there exist positive-definite symmetric matrices , , and and positive scalars , , , and , such that the following conditions hold:

4. Finite-Time Stochastic Control

In this section, we consider the problem of finite-time stochastic control for time-delayed Itô stochastic systems with Markovian switching. We consider the mode-dependent controller , , where is the state feedback gain that has to be determined. Applying the state feedback controller into system (2) and denoting , we can obtain the corresponding closed-loop system as follows:

where , , and .

Theorem 11. System (29) is finite-time stabilizable with disturbance attenuation level , if there exist positive-definite symmetric matrices , , and and positive scalars , , , and , such that conditions (11)-(12) and the following conditions hold:

Proof. Choose the Lyapunov-Krasovskii functional for systems (29) as

where is the given mode-dependent symmetric positive-definite matrix for each mode and is the symmetric positive-definite matrix.

Along the trajectory of system (29), we have

Set , ; we have

From (33) to (34), we obtain

where

Using Lemma 5, we have that (30) is equivalent to . Then (35) becomes

Under zero initial condition, we have

Thus

Let ; then is performance index. When , similar to the proof of Theorem 6, it can be obtained that

From (31), we can get

The proof is completed.

Theorem 12. System (29) is finite-time stabilizable with disturbance attenuation level , if there exist positive-definite symmetric matrices , , , and , appropriate dimensions matrices , and positive scalars , , , and , such that conditions (11)-(12), (31) and the following conditions hold:

Moreover, a state feedback controller gain is given by .

Proof. Replacing , , and in (30) with , , and , then premultiplying and postmultiplying it by , and denoting , , , , and , we can obtain (42).

The proof is completed.

Remark 13. Replacing in (27) with , then it is equivalent to (31). For certain and , all the conditions of Theorem 12 can be expressed as linear matrix inequalities. In this way, finite-time state feedback stabilization conditions for time-delayed Itô stochastic systems with Markovian switching are based entirely on linear matrix inequalities. In the practical application of dynamical systems, we can obtain the controller effectively with the help of LMI toolbox in MATLAB.

Remark 14. In order to obtain the finite-time stabilization conditions based on LMIs for time-delayed Itô stochastic systems with Markovian switching, new Lyapunov-Krasovskii functional (32) is introduced.

Remark 15. In the sense of Lyapunov stability, the problem of control for systems with Markovian switching and time delay has attracted a lot of research (e.g., see [40, 41]). Different from these studies, this paper focuses on this problem under the sense of finite-time stability. The latter is suitable for transient performance of actual systems such as communication network system, missile system, and robot control system.

5. Illustrative Example

In this section, we will discuss one example to illustrate our results.

Example 16. Consider time-delayed Itô stochastic systems with Markovian switching (29) with the following parameters:

Denote transition probabilities by and . By using and , we can obtain and . Figure 1 shows the Markovian switching signal within 100 times according to the above transition probabilities.

Choose , , , , , , , , and . Then, solving conditions (41), (11), (12), and (31) in Theorem 12 for and yields

The state trajectories of the closed-loop system are shown in Figure 2. It is easy to see that the system is finite-time stochastically bounded.

Figure 1: Markovian switching signal.

Figure 2: State trajectory of the closed-loop system.

6. Conclusions

In this paper, finite-time stochastic stability and finite-time stochastic control problem for time-delayed Itô stochastic systems with Markovian switching are investigated with Lyapunov-Krasovskii functional approach and free-weighting matrix techniques. Some criteria are established. One example is given for illustration.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This work was supported by the Fundamental Research Funds for the Central Universities under Grants 2012ZM0059 and 2012ZM0079, the Natural Science Foundation of Guangdong Province under Grant 10251064101000008, and the National Natural Science Foundation of China under Grant 61273126. The authors would like to thank the editors and anonymous reviewers for their constructive comments and suggestions for improving the quality of the work.

References

S. He and F. Liu, “Finite-time filtering of time-delay stochastic jump systems with unbiased estimation,” Proceedings of the Institution of Mechanical Engineers, vol. 224, no. 8, pp. 947–959, 2010.

S. B. Stojanović, D. Lj. Debeljković, and D. S. Antić, “Finite-time stability and stabilization of linear time-delay systems,” Facta Universitatis, vol. 11, no. 1, pp. 25–36, 2012.

Z. Xiang, Y.-N. Sun, and M. S. Mahmoud, “Robust finite-time control for a class of uncertain switched neutral systems,” Communications in Nonlinear Science and Numerical Simulation, vol. 17, no. 4, pp. 1766–1778, 2012.

P. Dorato, “Short-time stability in linear time-varying systems,” IRE International Convention Record, pp. 83–87, 1961.

P. Dorato, “Short-time stability,” IRE Transactions on Automatic Control, pp. 6–86, 1961.

L. Weiss and E. F. Infante, “Finite time stability under perturbing forces and on product spaces,” Institute of Electrical and Electronics Engineers. Transactions on Automatic Control, vol. 12, pp. 54–59, 1967.

A. N. Michel and S. H. Wu, “Stability of discrete systems over a finite interval of time,” International Journal of Control, vol. 9, pp. 679–693, 1969.

H. J. Kushner, “Finite time stochastic stability and the analysis of tracking systems,” Institute of Electrical and Electronics Engineers. Transactions on Automatic Control, vol. 11, pp. 219–227, 1966.

H. J. Kushner, Stochastic Stability and Control, vol. 33 of Mathematics in Science and Engineering, Academic Press, New York, NY, USA, 1967.

W. L. Garrard, “Further results on the synthesis of finite-time stable systems,” Institute of Electrical and Electronics Engineers. Transactions on Automatic Control, vol. 17, pp. 142–144, 1972.

L. Van Mellaert and P. Dorato, “Numerical solution of an optimal control problem with a probability criterion,” IEEE Transactions on Automatic Control, vol. 17, no. 4, pp. 543–546, 1972.

L. Van Mellaert, Inclusion-probability-optimal control [Ph.D. thesis], Polytechnic Institute of Brooklyn, 1967.

F. A. San Filippo and P. Dorato, “Short-time parameter optimization with flight control application,” Automatica, vol. 10, no. 4, pp. 425–430, 1974.

P. Dorato, C. T. Abdallah, and D. Famularo, “Robust finite-time stability design via linear matrix inequalities,” in Proceedings of the 36th IEEE Conference on Decision and Control, pp. 1305–1306, San Diego, Calif, USA, December 1997.

F. Amato, M. Ariola, and P. Dorato, “Finite-time control of linear systems subject to parametric uncertainties and disturbances,” Automatica, vol. 37, no. 9, pp. 1459–1463, 2001.

F. Amato and M. Ariola, “Finite-time control of discrete-time linear systems,” Institute of Electrical and Electronics Engineers. Transactions on Automatic Control, vol. 50, no. 5, pp. 724–729, 2005.

F. Amato, M. Ariola, and C. Cosentino, “Finite-time stabilization via dynamic output feedback,” Automatica, vol. 42, no. 2, pp. 337–342, 2006.

S. Xing, Q. Zhang, and Y. Zhang, “Finite-time stability analysis and control for a class of stochastic singular biological economic systems based on T-S fuzzy model,” Abstract and Applied Analysis, vol. 2013, Article ID 946491, 10 pages, 2013.

R. Wang, J. Xing, P. Wang, Q. Yang, and Z. Xiang, “ control with finite-time stability for switched systems under asynchronous switching,” Mathematical Problems in Engineering, vol. 2012, Article ID 929503, 16 pages, 2012.

L. Hou, G. Zong, and Y. Wu, “Finite-time control for switched delay systems via dynamic output feedback,” International Journal of Innovative Computing, Information and Control, vol. 8, no. 7A, pp. 4901–4913, 2012.

W. H. Zhang and X. Y. An, “Finite-time control of linear stochastic systems,” International Journal of Innovative Computing, Information and Control, vol. 4, no. 3, pp. 687–694, 2008.

J. Zhou, S. Xu, and H. Shen, “Finite-time robust stochastic stability of uncertain stochastic delayed reaction-diffusion genetic regulatory networks,” Neurocomputing, vol. 74, no. 17, pp. 2790–2796, 2011.

Z. Yan, G. Zhang, and J. Wang, “Finite-time stability and stabilization of linear stochastic systems,” in Proceedings of the 29th Chinese Control Conference (CCC '10), pp. 1115–1120, Beijing, China, July 2010.

Z. Yan, G. Zhang, and J. Wang, “Finite-time guaranteed cost control for linear stochastic systems,” in Proceedings of the 30th Chinese Control Conference (CCC '11), pp. 1389–1394, Yantai, China, July 2011.

A. N. Michel and L. Hou, “Finite-time and practical stability of a class of stochastic dynamical systems,” in Proceedings of the 47th IEEE Conference on Decision and Control (CDC '08), pp. 3452–3456, Cancun, Mexico, December 2008.

Y. Yang, J. Li, and G. Chen, “Finite-time stability and stabilization of Markovian switching stochastic systems with impulsive effects,” Journal of Systems Engineering and Electronics, vol. 21, no. 2, pp. 254–260, 2010.

Y. Yang, J. Li, and G. Chen, “Finite-time stability and stabilization of nonlinear stochastic hybrid systems,” Journal of Mathematical Analysis and Applications, vol. 356, no. 1, pp. 338–345, 2009.

H. Ma and Y. Jia, “Input-output finite-time stability and stabilization of stochastic Markovian jump systems,” in Proceedings of the 50th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC '11), Orlando, Fla, USA, December 2011.

S. He and F. Liu, “Observer-based finite-time control of time-delayed jump systems,” Applied Mathematics and Computation, vol. 217, no. 6, pp. 2327–2338, 2010.

Z. Zuo, H. Li, Y. Liu, and Y. Wang, “On finite-time stochastic stability and stabilization of markovian jump systems subject to partial information on transition probabilities,” Circuits, Systems and Signal Processing, vol. 31, no. 6, pp. 1973–1983, 2012.

Y. Zhang, C. Liu, and X. Mu, “Robust finite-time stabilization of uncertain singular Markovian jump systems,” Applied Mathematical Modelling, vol. 36, no. 10, pp. 5109–5121, 2012.

Y. Sun and J. Xu, “Finite-time boundedness and stabilization of networked control systems with time delay,” Mathematical Problems in Engineering, vol. 2012, Article ID 705828, 12 pages, 2012.

X. Zhang, H. Zhang, X. Wang, and Y. Luo, “A new iteration approach to solve a class of finite-horizon continuous-time nonaffine nonlinear zero-sum game,” International Journal of Innovative Computing, Information and Control, vol. 7, no. 2, pp. 597–608, 2011.

H. Liu, Y. Shen, and X. Zhao, “Delay-dependent observer-based finite-time control for switched systems with time-varying delay,” Nonlinear Analysis: Hybrid Systems, vol. 6, no. 3, pp. 885–898, 2012.

H. Song, L. Yu, D. Zhang, and W.-A. Zhang, “Finite-time control for a class of discrete-time switched time-delay systems with quantized feedback,” Communications in Nonlinear Science and Numerical Simulation, vol. 17, no. 12, pp. 4802–4814, 2012.

Z. Xiang, C. Qiao, and M. S. Mahmoud, “Finite-time analysis and control for switched stochastic systems,” Journal of the Franklin Institute, vol. 349, no. 3, pp. 915–927, 2012.

Y. Zhang, W. Cheng, X. Mu, and X. Guo, “Observer-based finite-time control of singular Markovian jump systems,” Journal of Applied Mathematics, vol. 2012, Article ID 205727, 19 pages, 2012.

Y. Zhang, C. Liu, and X. Mu, “Robust finite-time control of singular stochastic systems via static output feedback,” Applied Mathematics and Computation, vol. 218, no. 9, pp. 5629–5640, 2012.

Y. Zhang, W. Cheng, X. Mu, and C. Liu, “Stochastic finite-time control of discrete-time systems with packet loss,” Mathematical Problems in Engineering, vol. 2012, Article ID 897481, 15 pages, 2012.

Y. Wang, P. Shi, Q. Wang, and D. Duan, “Exponential filtering for singular Markovian jump systems with mixed mode-dependent time-varying delay,” IEEE Transactions on Circuits and Systems, vol. 60, no. 9, pp. 2440–2452, 2013.

F. Li, X. Wang, and P. Shi, “Robust quantized control for networked control systems with Markovian jumps and time delays,” International Journal of Innovative Computing, Information and Control, vol. 9, no. 12, pp. 4889–4902, 2013.

L. Wu, X. Su, and P. Shi, “Sliding mode control with bounded gain performance of Markovian jump singular time-delay systems,” Automatica, vol. 48, no. 8, pp. 1929–1933, 2012.

P. Shi and M. Liu, “Discussion on: ‘On the filtering problem for continuous-time Markov jump linear systems with no observation of the Markov chain’,” European Journal of Control, vol. 17, no. 4, pp. 355–356, 2011.

M. Liu, P. Shi, L. Zhang, and X. Zhao, “Fault-tolerant control for nonlinear Markovian jump systems via proportional and derivative sliding mode observer technique,” IEEE Transactions on Circuits and Systems, vol. 58, no. 11, pp. 2755–2764, 2011.

P. Shi, Y. Xia, G. P. Liu, and D. Rees, “On designing of sliding-mode control for stochastic jump systems,” Institute of Electrical and Electronics Engineers. Transactions on Automatic Control, vol. 51, no. 1, pp. 97–103, 2006.

S. He and F. Liu, “Stochastic finite-time boundedness of Markovian jumping neural network with uncertain transition probabilities,” Applied Mathematical Modelling, vol. 35, no. 6, pp. 2631–2638, 2011.

W. Gao and F. Deng, “Delay-dependent exponential stability of uncertain stochastic systems with discrete and distributed delays,” Dynamics of Continuous, Discrete & Impulsive Systems B, vol. 16, no. 5, pp. 617–629, 2009.

X. Mao, Stochastic Differential Equations and Applications, Horwood, Chichester, UK, 1997.

H. Liu and Y. Shen, “ finite-time control for switched linear systems with time-varying delay,” Interlligent Control and Automation, vol. 2, no. 2, pp. 203–213, 2011.