Modeling and Output Feedback Control of Networked Control Systems with Both Time Delays ; and Packet Dropouts

This paper is concerned with the problem of modeling and output feedback controller design for a class of discrete-time networked control systems (NCSs) with time delays and packet dropouts. A Markovian jumping method is proposed to deal with random time delays and packet dropouts. Different from the previous studies on the issue, the characteristics of networked communication delays and packet dropouts can be truly reflected by the unified model; namely, both sensor-to-controller (S-C) and controller-toactuator (C-A) time delays, and packet dropouts are modeled and their history behavior is described by multiple Markov chains. The resulting closed-loop system is described by a new Markovian jump linear system (MJLS) with Markov delays model. Based on Lyapunov stability theory and linear matrix inequality (LMI) method, sufficient conditions of the stochastic stability and output feedback controller design method for NCSs with random time delays and packet dropouts are presented. A numerical example is given to illustrate the effectiveness of the proposed method.


Introduction
Networked control systems (NCSs) are systems in which control loops are closed over a real-time communication network.The fact that controllers, sensors, and actuators are not connected through point-to-point connections but through a multipurpose network offers advantages, such as low cost, decreased wiring, ease of installation and maintenance, and high efficiency, reliability, and flexibility [1][2][3][4][5].Consequently, NCSs are applied in a broad range such as manufacturing plants, vehicles, aircrafts, spacecrafts, and remote surgery.However, incorporation of a network in control loops results in various constraints such as time delays and packet dropouts, due to limited bandwidth, quantization errors caused by hybrid nature of NCSs, variable sampling or transmission intervals due to multiple nodes, clock asynchronization among local and remote nodes, network security and safety, and network security due to shared communication networks [6][7][8].It is generally known that any of these networked-induced communication imperfections and constraints can degrade closed-loop performance or, even worse, can harm closed-loop stability of NCSs.Therefore, it is important to know how these effects influence the stability properties.
In fact, packet dropout and time delay are both important issues that could severely destabilize NCSs.To study these issues, much research has been done on the effect of packet dropout and time delay on NCSs.As to the packet dropout, many approaches have been developed.Stabilization problem of NCSs with both arbitrary and Markovian packet losses is considered in [9].The  ∞ control problem for NCSs with packet dropouts is studied in [10,13].A new NCSs model is considered for NCSs with single-and multiple-packet transmissions in [11].The control problem for NCSs with Bernoulli-distributed stochastic packet losses is revisited in [14].As to the time delay, great efforts have been made on stability analysis and controller design for NCSs with interval time-varying delay, uncertain time delay, large time delay, or random time delay, as presented in [15][16][17][18][19][20][21][22][23] (for more details, please refer to the literature therein).
So far, most of the results considered the networkinduced delay and data packet loss separately, while in practice, the time delay and packet dropout are present simultaneously in NCSs.Fewer results are available that study combinations of time delay and packet dropout in the literature [36][37][38][39][40][41][42].Furthermore, in [36][37][38], the switched system method is studied for NCSs with both delay and packet dropout.The two-mode-dependent state feedback controller design for NCSs with time delays and packet dropouts is addressed by augmenting the state variable approach in [39].In [40] the robust  ∞ filtering problem for a class of uncertain nonlinear networked systems with both stochastic time-varying communication delays and packet dropouts is investigated.In [41] the problem of  ∞ controller design for NCSs with time delay and packet dropout by applying the linear estimation-based time delay and packet dropout compensation method is considered.The receding horizon  ∞ control problem for a class of NCSs with random delay and packet disordering is investigated by using the receding optimization principle in [42].To the best of the authors' knowledge, up to now, little attention has been paid to the study of unified time delays and packet dropouts model and output feedback controller design for NCSs based on Markovian jump linear system (MJLS) with Markovian time delays model, which motivates the study of this paper.
In this paper, we address the unified model, stability analysis, and output feedback controller design of NCSs with the sensor-to-controller (S-C) and controller-to-actuator (C-A) random time delays and packet dropouts under an MJLS [43] framework.The present paper involves three contributions compared to the previous relevant works.The first is in the unified new model of NCSs with random network time delays and packet dropouts.The second one is that the Lyapunov functional method is used for stochastic stability analysis for NCSs.Compared with the extended matrix method, the Lyapunov functional avoids augmenting the dimension of the closed-loop system state, thus avoiding the complicated computation and conservatism caused by extended matrix method.The third one is the output feedback controller which is used to stabilize the closed-loop system, and the results are applied to a classical angular positioning system to illustrate the effectiveness of the approach.
Notations.In the sequel, matrices are assumed to have appropriate dimensions.R  and R × denote, respectively, the  dimensional Euclidean space and the set of all  ×  real matrices.The notations  > 0 and  < 0 are used to denote a positive and negative definite matrices, respectively.diag( 1 , . . .,   ) refers to an  ×  diagonal matrix with   as its th diagonal entry. and 0 denote identity matrix and zero matrix with appropriate dimensions, respectively.The superscript  denotes the transpose for vectors or matrices.E[⋅] denotes the mathematical expectation operator.The symbol * within a matrix represents the symmetric entries.

Problem Description
In this paper, we consider the following linear discrete-time system: (( + 1) ) =   () +  () , where   () ∈ R  is the system state, () ∈ R  is the control input, and () ∈ R  is the measurable output. and  are the sampling instant and the sampling period of the sensor., , and  are known real constant matrices with appropriate dimensions.In this paper, for simplicity of presentation,  is denoted by .
Considering the same assumption in [16], the sensor, the controller, and the actuator are time driven and are connected over a network medium.The framework of the system over a network medium is depicted in Figure 1.The holder is chosen as zero-order hold (ZOH) holder.Under these assumptions, it is known that the controller and actuator update at the instant  only will always use the most recent data; otherwise, it will maintain the old data.In the NCS as in Figure 1, network-induced time delays and packet dropouts exist in the communication links between the S-C and C-A.
In Figure 1,  1 and  2 denote the network switches between the S-C and C-A, respectively. and ( = 0, 1;  = 0, 1) denote the states of  1 and  2 .When  1 ( 2 ) is in state  = 0( = 0), the packet is received successfully and the ), the packet is lost and the switch output (control input) is held at the previous value () = ( − 1)(() = ( − 1)).The behavior of the S-C and C-A time delays and packet dropouts can be modeled as where From the above analysis, the random data packet dropouts in S-C and C-A can be modeled a discrete-time homogeneous Markov chain () with four modes.Four modes of Markov chain () = 1, () = 2, () = 3, and () = 4 are corresponding to four states ( = 0,  = 0), ( = 0,  = 1), ( = 1,  = 0), and ( = 1,  = 1) of network switches  1 and  2 .This paper studies the stability of system (1) under an output feedback controller; that is, where  is the output feedback controller gain.
Remark 1.There are two ways to design the controller (4).
One is adopting a mode-independent controller, and another one is using a mode-dependent controller (the controller gain dependent on the information of time delays and packet losses).However, the mode-independent controller (4) can avoid the controller gain switching in high frequency following the multimodes of Markov chains (), (), and () in system (5).Hence, in this paper, we choose the modeindependent controller.
Remark 3. The closed-loop system ( 5) is a Markovian jump linear system with multiple Markov chains, which describe the behavior of the S-C and C-A time delays and packet dropouts, respectively.This enables us to analyze and synthesize such NCSs by applying Markovian jump linear system theory.Note that the problem of unified modeling and output feedback control for NCSs with both S-C and C-A time delays and packet dropouts modeled by multiple Markov chains has not been done in the literature.

Main Results
By applying a new Lyapunov functional, sufficient conditions for the stochastic stability, the synthesis of controller design for system (5) will be established in this section.
Proof.It is given in the appendix.
The conditions in Theorem 6 are a set of LMIs with some matrix inverse constraints.Although they are nonconvex, which prevents us from solving them using the existing convex optimization tool, we can use the CCL algorithm to transform this problem into the nonlinear minimization problem with LMI constraints as follows: The above nonlinear minimization problem can be solved by the CCL algorithm presented in the following.
Algorithm 7. Consider the following steps.

Numerical Example
In this section, a simulation example is given to illustrate the usefulness of the developed method.Consider a classical angular positioning system [42,48,49] in Figure 2, which consists of a rotating antenna at the origin of the plane, driven by an electric motor.Assume that the angular position of the antenna  (rad), the angular position of the moving object   (rad), and the angular velocity of the antenna θ (rad s −1 ) are measurable.The state variables are chosen as [  θ ]  and the output is  =   .The control problem is to use the input voltage to the motor to rotate the antenna so that it always point in the direction of a moving object in the plant.The output feedback controller is designed for the following values of the matrices , , and : () Figures 3, 4, and 5 show part of the simulation of the stochastic jumping parameter (), S-C delay (), and C-A delay () governed by their corresponding transition probability matrices, respectively.
The state trajectories are shown in Figure 6, where two curves represent state trajectories under the controller gains  and Figure 6 indicates that system (5) is stochastically stable.

Conclusion
The output feedback stabilization problem for NCSs with both S-C and C-A random time delays and packet dropouts is investigated in this paper.The S-C and C-A random time delays and packet dropouts are modeled by independent multiple Markov chains.Then the resulting closed-loop system is modeled as a Markovian jump linear system with Markov delays.Sufficient conditions on stochastic stability and stabilization are obtained by Lyapunov stability theory and linear matrix inequalities method.The CCL algorithm is employed to obtain the output feedback controller.Finally, an example is presented to illustrate the effectiveness of the approach.

Mathematical Problems in Engineering 9
By combining (A.9), (A.10), and (A.11), we have According to Definition 4, the closed-loop system ( 5) is stochastically stable.This completes the proof.

Figure 1 :
Figure 1: The structure of the NCS with random delays and/or packet dropouts.