Journal of Applied Mathematics

Volume 2013 (2013), Article ID 715072, 10 pages

http://dx.doi.org/10.1155/2013/715072

Research Article

Stability Analysis of Networked Control Systems with Random Time Delays and Packet Dropouts Modeled by Markov Chains

Li Qiu,¹ Fengqi Yao,² and Xiaopin Zhong¹

¹Shenzhen Key Laboratory of Urban Rail Transit, College of Mechatronics and Control Engineering, Shenzhen University, Shenzhen 518060, China

²School of Electrical Engineering & Information, Anhui University of Technology, Ma'anshan 243000, China

Received 27 May 2013; Revised 30 July 2013; Accepted 31 July 2013

Academic Editor: Baocang Ding

Copyright © 2013 Li Qiu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

This paper investigates the stability analysis problem for a class of discrete-time networked control systems (NCSs) with random time delays and packet dropouts based on unified Markov jump model. The random time delays and packet dropouts existed in feedback communication link are modeled by two independent Markov chains; the resulting closed-loop system is described by a new Markovian jump linear system (MJLS) with Markov delays. Sufficient conditions of the stochastic stability for NCSs is obtained by constructing a novel Lyapunov functional, and the mode-dependent output feedback controller design method is presented based on linear matrix inequality (LMI) technique. A numerical example is given to illustrate the effectiveness of the proposed method.

1. Introduction

Networked control systems (NCSs) are a type of closed-loop systems, in which the control loops are closed through communication networks. Compared with the traditional control systems, the use of the communication networks bring many advantages such as low cost, reduced weight, and simple installation and maintenance as well as high efficiency, flexibility, and reliability. Consequently, NCSs are applied in a broad range such as manufacturing plants, vehicles, aircrafts, spacecrafts, and remote surgery [1]. However, the communication networks in control loops also present some constraints such as time delays and packet dropouts due to limited bandwidth; quantization errors caused by hybrid nature of NCSs; variable sampling or transmission intervals due to multiple nodes; clock asynchronization among local and remote nodes; network security and safety and network security due to shared communication networks [2, 3]. It is generally known that any of these networked-induced communication imperfections and constraints can degrade closed-loop performance or, even worse, can harm closed-loop stability of NCSs. Therefore, it is important to know how these effects influence the stability properties. Recently, some important results of NCSs have been reported in the existing literature for instance, the discussions of packet dropouts [4–13], time delays [14–24], quantization [25], distributed synchronization [26], communication constraints [27], stability and controller design [28–33], both data quantizations and packet losses [34], both time delays and packet dropouts [35–44], and output feedback control problem [19, 45, 46].

In NCSs, time delays and packet dropouts are two important issues. To study these issues, many efforts have been made for NCSs with time delays [14–24] and packet dropouts [4–13]; for more details review, please refer to the literature therein. However, both time delays and packet dropouts exist in NCSs by the insertion of communication network in the feedback control loop. Xie and Xia [35] studied the robust fault tolerant controller design for NCSs with fast varying delay and packet dropout. Zhang and Yu [36] presented a switched system model to describe the NCSs with both delay and packet dropout, and the state feedback stabilizing controllers are designed by augmenting technique. Yu and Shi [37] addressed the two-mode-dependent state feedback controller design in NCSs with time delays and packet dropouts by augmenting the state variable approach. Dong et al. [38] studied the robust filtering problem for a class of uncertain nonlinear networked systems with both stochastic time-varying communication delays and packet dropouts. Jiang et al. [39] introduced the design of observer-based controller for NCSs with network induced delay and packet dropout. Li et al. [40] considered the observer-based fault detection problem for NCSs with long time delays and packet dropout by modeling the observers system as an uncertain switched system. Li et al. [41] studied the guaranteed const control of NCSs with the S-C packet dropouts and time delays. Wang and Yang [42] considered the problem of controller design for NCSs with time delay and packet dropout by applying the linear estimation-based time delay and packet dropout compensation method. Liu et al. [43] investigated the receding horizon control problem for a class NCSs with random delay and packet disordering by using the receding optimization principle. Qiu et al. [44] considered the state feedback control problem of NCS with both time delays and packet dropouts. In [19, 45, 46], the output feedback control problem of NCSs were investigated. To the best of the authors’ knowledge, up to now, little attention has been paid to the study of NCSs with random time delays and packet dropouts based on Markov jump unified model, which motivates our investigation.

In this paper, we address the unified model and stability analysis problem of NCSs with the random time delays and packet dropouts under a Markovian jump linear system (MJLS) framework. The feedback communication link random time delays and packet dropouts are modeled by two independent Markov chains, the resulting closed-loop system is modeled as a new MJLS with Markov delays. Then, we give stability analysis and output feedback controller design which are for discrete-time NCSs with both time delays and packet dropouts by the Lyapunov stability theory and linear matrix inequality method.

Notations. In the sequel, if not explicit, matrices are assumed to have appropriate dimensions. and denote, respectively, the dimensional Euclidean space and the set of all real matrices. The notations and are used to denote the positive and negative definite matrix, respectively. refers to a diagonal matrix with as its th diagonal entry. and denote the identity matrix and zero matrix with appropriate dimensions, respectively. The superscript denotes the transpose for vectors or matrices. denotes the mathematical expectation operator. The symbol denotes blocks that are readily inferred by symmetry.

2. Problem Description

The framework of the system over a network medium is depicted in Figure 1. Considering the same assumption in [14], the sensor, the controller, and the actuator are time-driven and are connected over a network medium. Under the assumption, it is known that the controller updates at the instant will always use the most recent data; otherwise, it will maintain the old data. In the NCS as Figure 1, network induced time delays and packet dropouts exist in the feedback communication link.

Figure 1: The structure of the NCS with random delays and/or packet dropouts.

The discrete-time plant with a time-varying controller is described as

where is the system state, is the control input, and is measurable output. , , and are known real constant matrices with appropriate dimensions. Random time delays and packet dropouts exist in link from sensor-to-controller (S-C), as shown in Figure 1. Here, represents the bounded random S-C time delays. One way to model the delays is using the finite state Markov chain as shown in [17–19]. The main advantage of the Markov model is that the dependencies between the delays are taken into account since the current time delays in real networks are usually related with the previous delays [17]. In this paper is modeled as a homogeneous Markov chain that take values in . denotes the network switches between the S-C. denotes the states of . When is in state , the packet is received successfully and the . Whereas when is in state , the packet is lost and the switch output is held at the previous value . The behavior of the S-C time delays and packet dropouts can be modeled as

where

Considering the mode-dependent output feedback controller:

where is the output feedback controller gain.

Let be the augmented state vector. Under the control (4), the closed-loop system of (1) is

where , , , , and is the initial condition of .

In system (5), and are two independent discrete-time homogeneous Markov chains taking value in a finite set and with transition probabilities:

where and for all , and

For , , when in mode and , the in (5) take value and , respectively. and are known constant matrices of appropriate dimensions.

Remark 1. The closed-loop system (5) is a MJLS with two Markov chains, which describe the behavior of the S-C time delays and packet dropouts, respectively. This enables us to analyze and synthesize such NCSs by applying MJLS theory. Note that modeling the S-C time delays and packet dropouts simultaneously in NCSs based on unified Markov jump model has not been done in the literature.

Definition 2 (see [19]). The system in (5) is stochastically stable if for every finite , initial mode , and , there exists a finite such that the following holds:

3. Main Results

By applying a new Lyapunov functional, sufficient conditions for the stochastic stability and synthesis of the mode-dependent output feedback controller design for system (5) will be established in this section.

Theorem 3. For system (5), given random but bounded scalar , if for each mode , , there exist matrices , , , , , and such that the following matrix inequalities:

where

and is defined in (5).

Hold for all and ; then system (5) is stochastically stable.

Proof. For the closed-loop system (5), stochastic Lyapunov functional is constructed as follows:

where

and . In the following when and , we will write , , and as , , , and , respectively. We denote:

Let . Then, along the solution of system (5) we have

where is defined in Theorem 3.

We have

Note that

By combining (16) and (17), we have

By Jensen’s inequality, we can get

Similarly, we have

By combining (19), (20), and (21), we have

where is defined in Theorem 3.

By combining (14), (15), (18), and (22), we have

where and are defined in Theorem 3.

By Schur complement and from (9), we have . Therefore,

where denotes the minimal eigenvalue of and . From (24), it is seen that for any

Furthermore

By taking limit as , we have

According to Definition 2, the closed-loop system (5) is stochastically stable. This completes the proof.

Theorem 3 gives the sufficient conditions for the stochastic stability of system (5). However, it should be noted that the conditions (9) are no more LMI conditions. To handle this, the equivalent LMI conditions are given in Theorem 4 by Cone Complementarity Linearization (CCL) algorithm.

Theorem 4. Consider system (5) with random but bounded scalar . There exists an output feedback controller (4) such the resulting closed-loop system is stochastically stable if for each mode , , there exist matrices , , , , , , , , , and such that

where

and are defined in Theorem 3. Moreover, if (28) (29) have solutions, the controller gain is given by .

Proof. By Schur complement, (28) is equivalent to

Let , , and ; we can obtain (28), (29). This completes the proof.

The conditions state in Theorem 4 are a set of LMIs with some matrix inverse constraints. Although they are nonconvex, which prevents us from solving them using the existing convex optimization tool, we can use the con complementary linearization to algorithm transform this problem into the nonlinear minimization problem with LMI constraints as follows:

The above nonlinear minimization problem can be solved by an iterative algorithm presented in the following.

Algorithm 5. Step 1. Find a feasible solution satisfying LMIs , , and in (32); set as and .

Step 2. Solve the following LMI optimization problem for variables . Minimize trace , subject to LMIs (32). Set , , , , , , and .

Step 3. If (31) is satisfied, then exit the iteration. If (31) is not satisfied, let , and then return to Step 2.

4. Numerical Example

To illustrate the effectiveness of the proposed method, we apply the results in Section 3 to a classical angular positioning system [43] in Figure 2, where is the angular position of the antenna, is the angular position of the moving object, and the angular velocity of the antenna is measurable. The control problem is to use the input voltage to the motor to rotate the antenna so that it always points in the direction of a moving object in the plant. The output feedback controller is designed for the following values of the matrices , , and :

Figure 2: The angular positioning system.

The stochastic jumping parameter and the random delays involved in system (5) are ; the transition probability matrices and are taken by

Figures 3 and 4 show part of the simulation of the stochastic jumping parameter and S-C delay governed by their corresponding transition probability matrices, respectively.

Figure 3: Values of .

Figure 4: S-C random delays .

The initial value . By Theorem 4, we can obtain the gain matrices of controller (4) which are constructed as

The state trajectories and the delay output trajectories are shown in Figures 5 and 6, where four curves represent state trajectories and the delay output trajectories under the controller gains . Figures 5 and 6 indicate that system (5) is stochastically stable. In contrast with the proposed method, the controller gain of a standard linear-quadratic regulator for nominal discrete-time systems designed by MATLAB command dlqr is

The eigenvalues of are 1.1686 and 0.9567. Hence, cannot stabilize the system in this case. The proposed controller works much better for networked control system than the contrastive dlqr method.

Figure 5: State trajectories under .

Figure 6: The trajectories of delay output .

5. Conclusion

The stability analysis problem for NCSs with random time delays and packet dropouts is investigated in this paper. The random time delays and packet dropouts existed in feedback communication link are modeled by two independent Markov chains. Then the resulting closed-loop system is modeled as a MJLS with Markov delays. Sufficient conditions on stochastic stability and stabilization are obtained by the Lyapunov stability theory and LMI method. The CCL algorithm is employed to obtain the mode-dependent output feedback controller. Finally, an example is presented to illustrate the effectiveness of the approach. Although the NCSs with random time delays and packet dropouts on only sensor to controller link are considered in this paper, the method of unified modeling and the Lyapunov functional constructing can be extended to the NCSs with the random time delays and packet dropouts existing in both the sensor to controller and controller to actuator.

Acknowledgments

The research is supported by the National Natural Science Foundation of China (Grant no. 61203184) and the Natural Science Foundation of SZU (Grant no. 201207).

References

J. P. Hespanha, P. Naghshtabrizi, and Y. Xu, “A survey of recent results in networked control systems,” Proceedings of the IEEE, vol. 95, no. 1, pp. 138–172, 2007.

M. C. F. Donkers, W. P. M. H. Heemels, N. van de Wouw, and L. Hetel, “Stability analysis of networked control systems using a switched linear systems approach,” IEEE Transactions on Automatic Control, vol. 56, no. 9, pp. 2101–2115, 2011.

L. X. Zhang, H. J. Gao, and O. Kaynak, “Network-induced constraints in networked control systems—a survey,” IEEE Transactions on Automatic Control, vol. 9, no. 1, pp. 403–416, 2013.

J. Xiong and J. Lam, “Stabilization of linear systems over networks with bounded packet loss,” Automatica, vol. 43, no. 1, pp. 80–87, 2007.

Z. Wang, F. Yang, D. W. C. Ho, and X. Liu, “Robust control for networked systems with random packet losses,” IEEE Transactions on Systems, Man, and Cybernetics B, vol. 37, no. 4, pp. 916–924, 2007.

W.-A. Zhang and L. Yu, “Output feedback stabilization of networked control systems with packet dropouts,” IEEE Transactions on Automatic Control, vol. 52, no. 9, pp. 1705–1710, 2007.

T. Jia, Y. Niu, and X. Wang, “ control for networked systems with data packet dropout,” International Journal of Control, Automation and Systems, vol. 8, no. 2, pp. 198–203, 2010.

J. Wu and T. Chen, “Design of networked control systems with packet dropouts,” IEEE Transactions on Automatic Control, vol. 52, no. 7, pp. 1314–1319, 2007.

B. Xue, S. Li, and Q. Zhu, “Moving horizon state estimation for networked control system with multiple packet dropouts,” IEEE Transactions on Automatic Control, vol. 57, no. 9, pp. 2360–2366, 2012.

Q. Lu, L. Zhang, M. Basin, and H. Tian, “Analysis and synthesis for networked control systems with uncertain rate of packet losses,” Journal of the Franklin Institute, vol. 349, no. 7, pp. 2500–2514, 2012.

B. Ding, “Stabilization of linear systems over networks with bounded packet loss and its use in model predictive control,” Automatica, vol. 47, no. 11, pp. 2526–2533, 2011.

D. E. Quevedo and D. Nešić, “Robust stability of packetized predictive control of nonlinear systems with disturbances and Markovian packet losses,” Automatica, vol. 48, no. 8, pp. 1803–1811, 2012.

B. Ding and L. Xie, “Stabilization of linear systems over networks with double-sided, finite bounded, arbitrary packet loss,” in Proceedings of the IEEE International Conference on Control and Automation (ICCA '09), pp. 920–925, December 2009.

E. Tian and D. Yue, “A new state feedback control of networked control systems with time-varying network conditions,” Journal of the Franklin Institute, vol. 349, no. 3, pp. 891–914, 2012.

D. Yue, E. Tian, and Q.-L. Han, “A delay system method for designing event-triggered controllers of networked control systems,” IEEE Transactions on Automatic Control, vol. 58, no. 2, pp. 475–481, 2013.

M. Azadegan, M. T. H. Beheshti, and B. Tavassoli, “Robust output feedback control of networked control systems with random delay modeled by Markov chain,” in Proceedings of the 20th Iranian Conference on Electrical Engineering, pp. 587–592, Tehran, Iran, 2012.

J. Nilsson, Real-Time Control Systems with Delays, Lund Institute of Technology, Lund, Sweden, 1998.

L. Xiao, A. Hassibi, and J. P. How, “Control with random communication delays via a discrete-time jump system approach,” in Proceedings of the 2000 American Control Conference, pp. 3545–3550, June 2000.

Y. Shi and B. Yu, “Output feedback stabilization of networked control systems with random delays modeled by Markov chains,” IEEE Transactions on Automatic Control, vol. 54, no. 7, pp. 1668–1674, 2009.

M. B. G. Cloosterman, N. van de Wouw, W. P. M. H. Heemels, and H. Nijmeijer, “Stability of networked control systems with uncertain time-varying delays,” IEEE Transactions on Automatic Control, vol. 54, no. 7, pp. 1575–1579, 2009.

L. Qiu, B. Xu, and S. Li, “Guaranteed cost control for discrete-time networked control systems with random Markov delays,” Journal of Systems Engineering and Electronics, vol. 22, no. 4, pp. 661–671, 2011.

E. C. Martins and F. G. Jota, “Design of networked control systems with explicit compensation for time-delay variations,” IEEE Transactions on Systems, Man and Cybernetics C, vol. 40, no. 3, pp. 308–318, 2010.

I. Pan, S. Das, and A. Gupta, “Tuning of an optimal fuzzy PID controller with stochastic algorithms for networked control systems with random time delay,” ISA Transactions, vol. 50, no. 1, pp. 28–36, 2011.

L. Qiu, B. Xu, and S. Li, “/ control of networked control system with random time delays,” Science China. Information Sciences, vol. 54, no. 12, pp. 2615–2630, 2011.

Y. Ishido, K. Takaba, and D. E. Quevedo, “Stability analysis of networked control systems subject to packet-dropouts and finite-level quantization,” Systems & Control Letters, vol. 60, no. 5, pp. 325–332, 2011.

Y. Tang, H. J. Gao, W. Zou, and J. Kurths, “Distributed synchronization in networks of agent systems with nonlinearities and random switchings,” IEEE Transactions on Systems, Man, and Cybernetics B, vol. 43, pp. 358–370, 2013.

Z.-H. Guan, C.-Y. Chen, G. Feng, and T. Li, “Optimal tracking performance limitation of networked control systems with limited bandwidth and additive colored white Gaussian noise,” IEEE Transactions on Circuits and Systems I, vol. 60, no. 1, pp. 189–198, 2013.

J. Yu, L. Wang, and M. Yu, “Switched system approach to stabilization of networked control systems,” International Journal of Robust and Nonlinear Control, vol. 21, no. 17, pp. 1925–1946, 2011.

T. Suzuki, M. Kono, N. Takahashi, and O. Sato, “Controllability and stabilizability of a networked control system with periodic communication constraints,” Systems & Control Letters, vol. 60, no. 12, pp. 977–984, 2011.

D. Wu, J. Wu, S. Chen, and J. Chu, “Stability of networked control systems with polytopic uncertainty and buffer constraint,” IEEE Transactions on Automatic Control, vol. 55, no. 5, pp. 1202–1208, 2010.

B. Zhu and K. Xia, “Design of subsidence monitoring system based on wireless sensor networks,” in Proceedings of the 6th International Conference on Wireless Communications, Networking and Mobile Computing (WiCOM '10), pp. 1–4, September 2010.

Y. Xia, L. Li, G.-P. Liu, and P. Shi, “ predictive control of networked control systems,” International Journal of Control, vol. 84, no. 6, pp. 1080–1097, 2011.

P. Wang, C. Han, and B. Ding, “Stability of discrete-time networked control systems and its extension for robust control,” International Journal of Systems Science, vol. 44, no. 2, pp. 275–288, 2013.

X. Tang and B. Ding, “Model predictive control of linear systems over networks with data quantizations and packet losses,” Automatica, vol. 49, no. 5, pp. 1333–1339, 2013.

N. Xie and B. Xia, “Robust fault tolerant controller design for uncertain networked control systems with fast-varying delay and packet-dropout,” in Proceedings of the 6th International Conference on Wireless Communications, Networking and Mobile Computing (WiCOM '10), pp. 1–4, September 2010.

W.-A. Zhang and L. Yu, “Modelling and control of networked control systems with both network-induced delay and packet-dropout,” Automatica, vol. 44, no. 12, pp. 3206–3210, 2008.

B. Yu and Y. Shi, “State feedback stabilization of networked control systems with random time delays and packet dropout,” in Proceedings of the ASME Dynamic Systems and Control Conference (DSCC '08), pp. 1–7, October 2008.

H. Dong, Z. Wang, and H. Gao, “Robust filtering for a class of nonlinear networked systems with multiple stochastic communication delays and packet dropouts,” IEEE Transactions on Signal Processing, vol. 58, no. 4, pp. 1957–1966, 2010.

C. Jiang, D. X. Zou, and Q. L. Zhang, “Observer-based control for networked control systems with network induced delay and packet dropout,” in Proceedings of the 8th World Congress on Intelligent Control and Automation (WCICA '10), pp. 4376–4379, July 2010.

X. Li, X. Wu, Z. Xu, and C. Huang, “Fault detection observer design for networked control system with long time-delays and data packet dropout,” Journal of Systems Engineering and Electronics, vol. 21, no. 5, pp. 877–882, 2010.

S. B. Li, Y. Q. Wang, F. Xia, et al., “Guaranteed cost control of networked guaranteed cost control of networked control systems with time-delays and packet losses,” International Journal of Wavelets, Multiresolution and Information Processing, vol. 4, no. 4, pp. 691–7066, 2006.

Y.-L. Wang and G.-H. Yang, “Time delay and packet dropout compensation for networked control systems: a linear estimation method,” International Journal of Control, vol. 83, no. 1, pp. 115–124, 2010.

A. Liu, L. Yu, and W. Zhang, “One-step receding horizon control for networked control systems with random delay and packet disordering,” ISA Transactions, vol. 50, no. 1, pp. 44–52, 2011.

L. Qiu, Q. Luo, F. Gong, S. B. Li, and B. G. Xu, “Stability and stabilization of networked control systems with random time delays and packet dropouts,” Journal of the Franklin Institute, vol. 350, no. 7, pp. 1886–1907, 2013.

Y. Sun and Y. Huo, “Robust static output feedback control for networked control system with random time delay,” in Proceedings of the 2nd International Conference on Advanced Computer Control (ICACC '10), pp. 547–551, March 2010.

C. Peng, Y. Tian, and D. Yue, “Output feedback control of discrete-time systems in networked environments,” IEEE Transactions on Systems, Man, and Cybernetics A, vol. 41, no. 1, pp. 185–190, 2011.