Discrete Dynamics in Nature and Society
Volume 2019 (2019), Article ID 5036917, 12 pages
https://doi.org/10.1155/2019/5036917

Research Article

Observer-Based Sliding Mode Control for Stochastic Nonlinear Markovian Jump Systems

Xiaohan Yin1,2 and Quanxin Zhu¹

¹MOE-LCSM, School of Mathematics and Statistics, Hunan Normal University, Changsha, 410081, Hunan, China
²School of Mathematical Sciences and Institute of Finance and Statistics, Nanjing Normal University, Nanjing, 210023, Jiangsu, China

Correspondence should be addressed to Quanxin Zhu; zqx22@126.com

Received 18 July 2018; Accepted 29 November 2018; Published 1 January 2019

Academic Editor: Yong Zhou

Copyright © 2019 Xiaohan Yin and Quanxin Zhu. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

We consider a class of stochastic nonlinear Markovian jump systems (MJSs) with partly unknown transition rate and time-varying delays. The system under consideration is subject to the mode uncertainties and nonlinear term and disturbance term which are unknown. The main mission is to design the observer-based sliding mode controller for such a complex system. An observer is first constructed, and then we design an integral sliding mode surface such that the MJSs satisfy the reaching condition. The sliding mode control law ensures the stochastic stability of the closed-loop system. Finally, an example is given to illustrate the proposed results.

1. Introduction

The sliding mode control (SMC) has attractive features to keep systems insensitive to the parameter uncertainties and external disturbances on the sliding mode plane [1]. Many practical dynamics, for example, manufacturing systems, chemical process systems, computer controlled systems and communication systems, solar receiver control, and power systems, experience abrupt random changes in their structure. These changes are usually caused by random failure or repairs of the components, changing in subsystems interconnections, sudden environmental changes, and so forth. Such systems can be modeled as hybrid systems. One special class of hybrid systems is named Markovian jump systems (MJSs), whose system mode is governed by a Markov process.

On the other hand, stability is one of the best topics in dynamic systems and a large number of results have appeared in the literature (e.g., see [2–28] and references therein). For MJSs, considerable attention has been recently paid to the problems of stability and stabilization [29–33], control and filtering [34–36], optimal tracking problem [37], etc. The robust stability and stabilization of uncertain stochastic systems with time-varying delays are investigated by using the linear matrix inequality approach (LMI) [38]. Huang and Mao [39] investigated the stabilization of stochastic linear systems by delayed state feedback controller. In [40], the method of Lyapunov functional is employed to study p-moment stability of nonlinear stochastic systems with impulsive and Markovian switching.

The SMC for stochastic systems has received an increasing attention. For example, see [41–51]. K. Chang and W. Chang [52] developd a SMC method to guarantee the robust state covariance assignment for perturbed stochastic multivariable systems via variable structure control. In [53], robust observer design for It’s stochastic time-delay systems was studied via sliding mode control and the sufficient conditions for the asymptotic stability (in probability) of the sliding motion were derived. Niu [54] dealed with the connection among the designed sliding surface corresponding to every mode for MJSs. However, there has been few results reported on the SMC of stochastic systems with Markovian switching. The existence of uncertainties, time-varying delays, Markovian switching with partly unknown transition probability will make the problem more complex and challenging.

Motivated by the above discussion, in this paper we investigate the problem of SMC problem for a class of stochastic nonlinear Markovian jump systems (MJSs) with partly unknown transition probabilities and time-varying delay. Firstly, an appropriate integral sliding mode surface is constructed. Secondly, the observer-based sliding mode controller is designed to guarantee the stochastic stability of the closed-loop system. Finally, a numerical example is provided to show the effectiveness of the proposed scheme.

The organization of this paper is given as follows. The system description and some preliminaries are given in Section 2. Section 3 presents the design of an integral sliding mode surface function and designs a sliding mode controller. Section 4 provides a numerical example to certify the feasibility of the mentioned method, and we conclude this paper in Section 5.

Notations. is a probability space, where denotes the sample space, represents the of subsets of the sample space and denotes the probability measure. means that is symmetric positive definite. denotes the identity matrix. refers to the Euclidean norm of a vector.

2. Preliminaries

In this section, we consider a class of stochastic nonlinear Markovian jump systems (MJSs) with partly unknown transition rates and time-varying delays on a complete probability space :

where represents the state vector, represents control input, is the nonlinear function, and is the system disturbance. denotes the measured output. , , , , and are the constant matrices and    are the system uncertainties. is a standard Brownian motion defined on the complete probability spare . is time-varying delay and supposed to satisfy

where is known real constant scalar and is a continuous vector-valued initial function. represent the system mode, which take values in a given state space . Let represent the transition rate matrix. The mode transition probabilities can be denoted as follows:

where and , satisfies with , and for each mode . In addition, we assume that the probabilities of the Markovain jump system are partly unknown; for example, if there are four operation modes in system (1), the matrix of transition rates may be described as

where “?” denotes the unknown elements. We represent with and . We denote . We can rewrite MJSs for notational convenience when the system mode is :

where , , , , and .

Throughout this paper, we assume that the following conditions are satisfied.

Assumption 1. and satisfy the following form:

where , , , and are the constant matrices with appropriate dimensions and , are unknown time-varying matrix function satisfying

Assumption 2. The external disturbance vector is an unknown function which satisfies

where is an unknown scalar.

Assumption 3. has full column rank and the pair is controllable.

Assumption 4. The nonlinear function satisfies

where is a constant scalar.

Obviously, under Assumptions 1–4, it follows from [55] that there exists a unique global solution for any initial data ,

For any given , we define an operator from to by

Next, we will gave a lemma.

Lemma 5 (see [43]). For any positive constant , , and , the following inequality holds:

Finally, we give the definition of stochastic stability to end this section.

Definition 6 (see [56]). The stochastic system (1) is said to be stochastically stable when , if the condition satisfies

where and is the initial mode.

3. Main Results

We first design a state observer to estimate unmeasured state components. Then we construct an integral sliding mode surface which is based on the state observer as the first step of SMC design. The state observer we synthesize is as follows:

where represents the estimation of , , is the observer gain matrix, and is chosen to reduce the effect of unknown nonlinear function and unknown external disturbance .

Remark 7. We can notice that the state observer not only contains state observation without time delays but also contains state observation with time delays; this can be a simplification of the controller.

The solution of the state observer can be expressed as follows:

Let be the estimation error:

and then we can obtain the following estimated dynamic:

Obviously, it follows from (16) that depends on . The integral sliding mode surface is constructed as follows:

where satisfies that is Hurwitz and is a constant matrix such that is nonsingular and . Combining (14) and (17), we have

According to SMC theory, when the system trajectory reaches the sliding surface, it follows that and .

Remark 8. The linear term is continuous in the integral sliding mode surface (17), the integral term is continuous, and then the integral sliding mode surface (17) is continuous when the MJS states switch.

Remark 9. It follows from (17) that the integral sliding mode surface depends on a specific set of matrices , , which means that switching effect from one state to another of the Markovian jump system is reflected on by the matrix . Thus, in the sliding mode control system accompanied by Markovian jump systems, the sliding mode surfaces establish contact with each other through .

By (18), we have

Based on the state observer , we design a new sliding mode control (SMC) law as follows:

where .

The control term is designed as

where .

Theorem 10. Assume that Assumptions 1–4 hold and the integral sliding mode controller is given by (18). Then, the reachabilty of the sliding mode surface can be satisfied under the action of the SMC law (20).

Proof. Taking

then it follows from (2.14) that

Substituting into , we get

Thus, the reachabilty of the sliding mode surface can be satisfied.

The equivalent control law in the sliding mode can be obtained by solving as

Substituting into , then the state observer can be written as

The stability of system (1) can be determined by analyzing the stability of the closed-loop system which consists of (16) and (26).

The following theorem gives sufficient conditions for the stability of the closed-loop system, which is expressed in terms of linear matrix inequalities (LMIs).

Theorem 11. Considering system (16) and (26) with Assumptions 1–4, the sliding mode surface function is given by (18). If there exist positive definite symmetric matrix , matrices and , matrix , matrix , and positive scalars , , , and satisfy the following LMIs and the inequalities:

where

and then the overall closed-loop system composed of (16) and (26) is stochastically stable.

Proof. Take

Then,

According to (29),

Using Assumption 1 and Lemma 5, we have

where is the largest eigenvalue of .
Let , and then ,
where

For , the term can be rewritten as follows:

Then it follows from (28) and (32) that . For , ,

Then, combining (29), (32), and (33), we obtain .
Similarly, for , the term can be rewritten as follows:

According to (28) and (34), . For ,  ,

Then, combining (29), (34), and (35), we get .
Hence, we obtain , , , and and and , which implies . Thus, we have

which implies that the overall closed-loop system composed of (27) and (35) is stochastically stable.

Remark 12. Our result extends and improves those given in the previous literature. For example, if , then the system (1) is reduced to that in [36]; if , then the system (1) is reduced to that in [52]. Moreover, the transition rates in this paper are partially unknown, which is quite different from those in [36, 52].

Remark 13. When analyzing the stability of the stochastic system with Markovian switching and time-varying delay, Theorem 11 considers both state observer system and error system, which can conform the reality better and get better stability. When we construct the controller, because the system contains a Markovain stochastic term, we cannot directly apply the equivalent control method, so we construct the integral sliding surface and get our controller through the reachability of the integral sliding surface.

4. An Example

Let us consider system (1) above with the following matrix parameters:

The transition matrix is given as follows:

where “?” represents the unknown element. We select the matrices , , , and as follows:

Let , , and , The nonlinear function , external disturbance , and time-varying matrix function are given, respectively, as follows:

The initial conditions are given as and . Select the constant matrix . The adaptive laws are governed by (20); by solving the conditions (28)-(35), the observer is obtained as follows:

Then, the integral sliding mode surface in (18) for the 4 operating modes is synthesized as

Selecting , then we get

Finally, we use Figures 1–5 to show our results. In fact, Figure 1 shows the shows the trajectory of the Markov jumping signal with state 1,2,3. Figures 2–4 show state trajectory , state estimation trajectory , and state estimation error trajectory , respectively with state 1,2,3. Figure 5 shows the sliding mode surface function .

Figure 1: Trajectory of .

Figure 2: State trajectories .

Figure 3: State estimation trajectories .

Figure 4: State estimation error trajectories of .

Figure 5: Sliding mode surface function .

5. Conclusion

Because systems are inevitably influenced by stochastic factors, nonlinear factors, and time delay in the actual situation, discussing reachablity and stability of sliding mode control (SMC) in the context of stochastic system with time delay has more practical significance. This paper has investigated the SMC problem for stochastic nonlinear Markovian jump systems (MJSs) with partly unknown transition rates and time-varying delays. A SMC law has been synthesized such that the sliding mode surface can satisfy the reachable conditions. Sufficient conditions for the stability of the closed-loop system composed of the state observer system and error system have been proposed in terms of LMIs. A simulation result has been given to illustrate the feasibility of the results. Furture work will consider the SMC problem with Markov and impulse for nonlinear SDEs.

Data Availability

No data were used to support this study.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

This work was jointly supported by the National Natural Science Foundation of China (61773217, 61374080), the Natural Science Foundation of Jiangsu Province (BK20161552), and the Construct Program of the Key Discipline in Hunan Province.

References

P. Singh, V. Goyal, V. K. Deolia, and T. N. Sharma, Sliding mode control of uncertain nonlinear discrete delayed time system using Chebyshev neural network, Advances in Computer and Computational Sciences, Springer, Singapore, 2017.

G. Wang, “Existence-stability theorems for strong vector set-valued equilibrium problems in reflexive Banach spaces,” Journal of Inequalities and Applications, vol. 239, pp. 1–14, 2015.

Y. Bai and X. Mu, “Global asymptotic stability of a generalized SIRS epidemic model with transfer from infectious to susceptible,” Journal of Applied Analysis and Computation, vol. 8, no. 2, pp. 402–412, 2018.

L. Gao, D. Wang, and G. Wang, “Further results on exponential stability for impulsive switched nonlinear time-delay systems with delayed impulse effects,” Applied Mathematics and Computation, vol. 268, pp. 186–200, 2015.

Y. Guo, “Exponential stability analysis of travelling waves solutions for nonlinear delayed cellular neural networks,” Dynamical Systems. An International Journal, vol. 32, no. 4, pp. 490–503, 2017.

Y. Li, Y. Sun, and F. Meng, “New criteria for exponential stability of switched time-varying systems with delays and nonlinear disturbances,” Nonlinear Analysis: Hybrid Systems, vol. 26, pp. 284–291, 2017.

L. G. Wang, K. P. Xu, and Q. W. Liu, “On the stability of a mixed functional equation deriving from additive, quadratic and cubic mappings,” Acta Mathematica Sinica, vol. 30, no. 6, pp. 1033–1049, 2014.

L. G. Wang and J. Li, “On the stability of a functional equation deriving from additive and quadratic functions,” Advances in Difference Equations, vol. 2012, no. 1, pp. 1–12, 2012.

F. Li and Y. Bao, “Uniform stability of the solution for a memory-type elasticity system with nonhomogeneous boundary control condition,” Journal of Dynamical and Control Systems, vol. 23, no. 2, pp. 301–315, 2017.

Y.-H. Feng and C.-M. Liu, “Stability of steady-state solutions to Navier-Stokes-Poisson systems,” Journal of Mathematical Analysis and Applications, vol. 462, no. 2, pp. 1679–1694, 2018.

Y. Guo, “Global asymptotic stability analysis for integro-differential systems modeling neural networks with delays,” Zeitschrift für Angewandte Mathematik und Physik, vol. 61, no. 6, pp. 971–978, 2010.

Y. Guo, “Globally robust stability analysis for stochastic Cohen-Grossberg neural networks with impulse and time-varying delays,” Ukrainian Mathematical Journal, vol. 69, no. 8, pp. 1049–1060, 2017.

L. G. Wang and B. Liu, “The Hyers-Ulam stability of a functional equation deriving from quadratic and cubic functions in quasi-β-normed spaces,” Acta Mathematica Sinica, vol. 26, no. 12, pp. 2335–2348, 2010.

M. Li and J. Wang, “Exploring delayed Mittag-Leffler type matrix functions to study finite time stability of fractional delay differential equations,” Applied Mathematics and Computation, vol. 324, pp. 254–265, 2018.

Y. Guo, “Nontrivial periodic solutions of nonlinear functional differential systems with feedback control,” Turkish Journal of Mathematics, vol. 34, no. 1, pp. 35–44, 2010.

L. Li, F. Meng, and P. Ju, “Some new integral inequalities and their applications in studying the stability of nonlinear integro-differential equations with time delay,” Journal of Mathematical Analysis and Applications, vol. 377, no. 2, pp. 853–862, 2011.

Y. Guo, “Mean square exponential stability of stochastic delay cellular neural networks,” Electronic Journal of Qualitative Theory of Differential Equations, No. 34, 10 pages, 2013.

Y. Guo, “Mean square global asymptotic stability of stochastic recurrent neural networks with distributed delays,” Applied Mathematics and Computation, vol. 215, no. 2, pp. 791–795, 2009.

W. Sun and L. Peng, “Observer-based robust adaptive control for uncertain stochastic Hamiltonian systems with state and input delays,” Nonlinear Analysis: Modelling and Control, vol. 19, no. 4, pp. 626–645, 2014.

W. Qi, Y. Kao, X. Gao, and Y. Wei, “Controller design for time-delay system with stochastic disturbance and actuator saturation via a new criterion,” Applied Mathematics and Computation, vol. 320, pp. 535–546, 2018.

G. Liu, S. Xu, Y. Wei, Z. Qi, and Z. Zhang, “New insight into reachable set estimation for uncertain singular time-delay systems,” Applied Mathematics and Computation, vol. 320, pp. 769–780, 2018.

W. Sun, Y. Wang, and R. Yang, “L2 disturbance attenuation for a class of time delay Hamiltonian systems,” Journal of Systems Science & Complexity, vol. 24, no. 4, pp. 672–682, 2011.

Y. Guo, “Global stability analysis for a class of Cohen-Grossberg neural network models,” Bulletin of the Korean Mathematical Society, vol. 49, no. 6, pp. 1193–1198, 2012.

J. Hu and A. Xu, “On stability of F-Gorenstein flat categories,” Algebra Colloquium, vol. 23, no. 2, pp. 251–262, 2016.

W. W. Sun, “Stabilization analysis of time-delay Hamiltonian systems in the presence of saturation,” Applied Mathematics and Computation, vol. 217, no. 23, pp. 9625–9634, 2011.

X. Zheng, Y. Shang, and X. Peng, “Orbital stability of solitary waves of the coupled Klein-Gordon-Zakharov equations,” Mathematical Methods in the Applied Sciences, vol. 40, no. 7, pp. 2623–2633, 2017.

C. Liu and Y.-J. Peng, “Stability of periodic steady-state solutions to a non-isentropic Euler-Maxwell system,” Zeitschrift für Angewandte Mathematik und Physik, vol. 68, no. 5, 2017.

X. Zheng, Y. Shang, and X. Peng, “Orbital stability of periodic traveling wave solutions to the generalized Zakharov equations,” Acta Mathematica Scientia, vol. 37, no. 4, pp. 998–1018, 2017.

L. Li, W. Qi, X. Chen, Y. Kao, X. Gao, and Y. Wei, “Stability analysis and control synthesis for positive semi-Markov jump systems with time-varying delay,” Applied Mathematics and Computation, vol. 332, pp. 363–375, 2018.

Xingang Zhao, Jianda Han, and Yiwen Zhao, “Further Results on Stability Analysis of Discrete-Time Markov Jump Linear Systems with Time-Varying Delay and Partly Known Transition Probabilities,” Mathematical Problems in Engineering, vol. 2015, Article ID 524584, 6 pages, 2015.

R. Manivannan, R. Samidurai, and Q. Zhu, “Further improved results on stability and dissipativity analysis of static impulsive neural networks with interval time-varying delays,” Journal of The Franklin Institute, vol. 354, no. 14, pp. 6312–6340, 2017.

G. Nagamani and T. Radhika, “Dissipativity and Passivity Analysis of Markovian Jump Neural Networks with Two Additive Time-Varying Delays,” Neural Processing Letters, vol. 44, no. 2, pp. 571–592, 2016.

H. Shen, L. Su, and J. H. Park, “Further results on stochastic admissibility for singular Markov jump systems using a dissipative constrained condition,” ISA Transactions, vol. 59, pp. 65–71, 2015.

H. Ren and G. Zong, “Robust input-output finite-time filtering for uncertain Markovian jump nonlinear systems with partially known transition probabilities,” International Journal of Adaptive Control and Signal Processing, vol. 31, no. 10, pp. 1437–1455, 2017.

X. Luan, S. Zhao, P. Shi, and F. Liu, “H∞ filtering for discrete-time Markov jump systems with unknown transition probabilities,” International Journal of Adaptive Control and Signal Processing, vol. 28, no. 2, pp. 138–148, 2014.

D. Yao, M. Liu, H. Li, and H. Ma, “Robust Adaptive Sliding Mode Control for Nonlinear Uncertain Neutral Markovian Jump Systems,” Circuits, Systems and Signal Processing, vol. 35, no. 8, pp. 2741–2761, 2016.

S. Y. Xu and T. W. Chen, “H∞ output feedback control for uncertain stochastic systems with time-varying delays,” in Pergamon Press, pp. 2091–2098, 2004.

H. Shen, S. Xu, X. Song, and G. Shi, “Passivity-based control for Markovian jump systems via retarded output feedback,” Circuits, Systems and Signal Processing, vol. 31, no. 1, pp. 189–202, 2012.

M. S. Alwan, X. Liu, and W.-C. Xie, “On design of robust reliable H∞ control and input-to-state stabilization of uncertain stochastic systems with state delay,” Communications in Nonlinear Science and Numerical Simulation, vol. 18, no. 4, pp. 1047–1056, 2013.

Z. Liu and J. Peng, “p-moment stability of stochastic nonlinear delay systems with impulsive jump and Markovian switching,” Stochastic Analysis and Applications, vol. 27, no. 5, pp. 911–923, 2009.

B. Chen, J. Huang, and Y. Niu, “Sliding mode control for Markovian jumping systems with actuator nonlinearities,” International Journal of Systems Science, vol. 43, no. 4, pp. 656–664, 2012.

Y. Niu, D. W. C. Ho, and J. Lam, “Robust integral sliding mode control for uncertain stochastic systems with time-varying delay,” Automatica, vol. 41, no. 5, pp. 873–880, 2005.

Y. Niu and D. W. Ho, “Stabilization of discrete-time stochastic systems via sliding mode technique,” Journal of The Franklin Institute, vol. 349, no. 4, pp. 1497–1508, 2012.

L. Wu, W. X. Zheng, and H. Gao, “Dissipativity-based sliding mode control of switched stochastic systems,” IEEE Transactions on Automatic Control, vol. 58, no. 3, pp. 785–791, 2013.

D. W. C. Ho and Y. Niu, “Robust fuzzy design for nonlinear uncertain stochastic systems via sliding-mode control,” IEEE Transactions on Fuzzy Systems, vol. 15, no. 3, pp. 350–358, 2007.

L. G. Wu and D. W. C. Ho, “Sliding mode control of singular stochastic hybrid systems,” Automatica, vol. 46, no. 4, pp. 779–783, 2010.

K. Sen, M. Viswanathan, and G. Agha, “On statistical model checking of stochastic systems,” Computer Aided Verification, vol. 3576, pp. 266–280, 2005.

H. Xing, C. Gao, G. Tang, and D. Li, “Variable structure sliding mode control for a class of uncertain distributed parameter systems with time-varying delays,” International Journal of Control, vol. 82, no. 2, pp. 287–297, 2009.

M. Liu, L. Zhang, P. Shi, and H. R. Karimi, “Robust control of stochastic systems against bounded disturbances with application to flight control,” IEEE Transactions on Industrial Electronics, vol. 61, no. 3, pp. 1504–1515, 2014.

B. Chen, Y. Niu, and Y. Zou, “Adaptive sliding mode control for stochastic Markovian jumping systems with actuator degradation,” Automatica, vol. 49, no. 6, pp. 1748–1754, 2013.

Y. Niu and D. W. Ho, “Design of sliding mode control for nonlinear stochastic systems subject to actuator nonlinearity,” IEE Proceedings. Control Theory & Applications, vol. 153, no. 6, pp. 737–744, 2006.

K.-Y. Chang and W.-J. Wang, “Covariance assignment for stochastic model reference systems via sliding mode control concept,” in Proceedings of the American Control Conference, (ACC 1998), pp. 289-290, IEEE, USA, 1998.

Y. G. Niu and D. W. C. Ho, “Robust observer design for Itô stochastic time-delay systems via sliding mode control,” Systems & Control Letters, vol. 55, no. 10, pp. 781–793, 2006.

Y. Niu, D. W. Ho, and X. Wang, “Sliding mode control for Itô stochastic systems with Markovian switching,” Automatica, vol. 43, no. 10, pp. 1784–1790, 2007.

Y. Hu and C. Huang, “Existence results and the moment estimate for nonlocal stochastic differential equations with time-varying delay,” Nonlinear Analysis: Theory, Methods & Applications, vol. 75, no. 1, pp. 405–416, 2012.

X. Mao, “Stability of stochastic differential equations with Markovian switching,” Stochastic Processes and Their Applications, vol. 79, no. 1, pp. 45–67, 1999.