Stabilization of Discrete-Time Markovian Jump Systems via Controllers with Partially Mode-Dependent Characterization

A kind of stabilizing controller in terms of being partially mode-dependent is developed for discrete-timeMarkovian jump systems (MJSs).Theproperty referred to be partiallymode-dependent is described by theBernoulli variable. Based on the establishedmodel, the stabilization forMJSs over unreliable networks is considered, where both network-induced delay and packet dropout take place in system modes and states. Such effects of network are taken into account in controller design. All the conditions are derived in terms of linear matrix inequalities (LMIs). Finally, illustrative examples are presented to show the effectiveness and applicability of the proposed method.


Introduction
Markovian jump systems (MJSs) [1][2][3][4][5][6][7][8][9] are regarded as a special class of hybrid systems with finite operation modes.Their structures are subject to random abrupt changes, which may result from abrupt phenomena such as random component failures or repairs, changes in subsystem interconnections, and sudden environmental changes and modification of the operating point of a linearized model of a nonlinear system.Over the past decade, many important issues have been investigated for discrete-time Markovian jump systems (DMJSs), such as stability and stabilization [10,11] and  2 and  ∞ control [12][13][14][15].By investigating such references, it is known that system mode is assumed to be available online and plays important roles in system analysis and synthesis.This will have the application scope of mode-dependent results limited.In order to remove such ideal assumption, a mode-independent stabilization problem for DMJSs was considered in [16].The operation mode is not necessary in the work of the designed controller and is totally ignored.
However, the feedback control systems are usually closed via real time networks.Instead of point-to-point wiring, the use of shared communication networks is mainly due to its great advantages, such as low cost, reduced weight and power requirements, simple installation and maintenance, and high reliability.Despite the advantages and potentials, the introduction of communication networks in feedback control loops complicates the networked control systems (NCSs) analysis and synthesis [17], which also proposes new interesting and challenging problems.Network-induced delays and packet dropouts are usually considered in NCSs.Because of such effects, the data transmitted through networks is usually accessible with some probability.Based on this fact, it is said that the mode-independent control method is an overdesign method, which sometimes will lead to no solution to the desired control law.Since mode-independent and modedependent controller designs are worst-case and best-case design methods, respectively, a question whether there is a control method to bridge the aforementioned two extreme cases is proposed naturally.
Via modeling two random delays as two independent Markov chains, sufficient and necessary condition on the existence of stabilizing controller is established in [18].On the other hand, [19,20] considered the stability and controller design of NCSs with packet dropouts modeled as Markov chains.It is seen that the plant of the underlying NCSs in most literature is a deterministic system.That means that there is only one operation mode in the original system.When the controlled plant is an MJS, few results are available.Then, it is natural to consider how the insertion of networks affects the stability and performance of the closed-loop MJSs.Recently, for DMJSs with time-delays in both system state and mode signal, the authors in [21] first showed that the closed-loop system is a time-varying delayed MJS with extended state space.A general case that the time delays in signal mode and system state are the same and time-varying is considered in [22].To the best of the authors' knowledge, the stabilization problem of MJSs via networks has not been investigated fully and still remains challenging.All the observations motivate the current research.
In this paper, a partially mode-dependent controller design method is developed to solve the stabilization problem of DMJS.Instead of a common Lyapunov function selected for all system modes, a stochastic Lyapunov function is exploited.Moreover, we utilize the proposed technique to stabilize NCSs, whose controlled plant is an MJS.Both timeinduced delays and packet dropouts are taken into account in controller design.All the conditions for the solvability of the stabilizing controllers are established in terms of LMIs.
Notation.R  denotes the  dimensional Euclidean space and R × is the set of all  ×  real matrices.| ⋅ | denotes the Euclidean norm.E{⋅} is the expectation operator with respect to some probability measure.In symmetric block matrices, we use " * " as an ellipsis for the terms induced by symmetry, diag{⋅ ⋅ ⋅ } for a block-diagonal matrix, and () ⋆ ≜  +   .

Preliminaries
Fix the probability space (Ω, F, P) and consider the following DMJS  ( + 1) =  ( ())  () +  ( ())  () , where () ∈ R  is the state vector, () ∈ R  is the control input, and {(),  ≥ 0} is a discrete-time homogeneous Markov chain taking values in a finite set S = {1, 2, . . ., } with generator Λ = (  ); that is where   ≥ 0 ∀,  ∈ S, and ∑  =1   = 1.For notation simplification, a matrix (()) will be denoted by   .Now, consider a partially mode-dependent, state feedback control law where (()) and  are control gains to be determined and () is a Bernoulli distributed sequence with where 0 ≤  ≤ 1 is a constant.Furthermore, from (4), we have Remark 1.It is said that the stochastic variable () is used to reflect the observation probability of system mode.If  = 1, controller (3) will become a mode-dependent controller, and, when  = 0, we will have a mode-independent controller.It is worth mentioning that controller (3) is more advantageous than a totally mode-dependent or mode-independent controller.Compared with mode-independent controller in [16], one advantage of (3) avoids the overdesign problem which may lead to no solution to the desired control law.To the contrary, compared with mode-dependent control methods [11][12][13][14], another advantage is that it can reduce the burden of data transmission.That is, we can measure mode signal with some probability instead of measuring them exactly online.
Both the two advantages are shown via numerical examples.
Remark 2. It should be remarked that the introduction of (3) applied to (1) does not destroy the Markov process in (1) with respect to ().Because the Bernoulli process is a special case of Markov process, it is seen as another Markov process.In this paper, two stochastic variables () and () are assumed to be independent from each other.
Applying the controller in (3) to the system in (1) results in the following closed-loop system: where for all () =  ∈ S.
Theorem 4. Considering DMJS (1), there exists a controller (3) such that closed-loop system (6) is stochastically stable if there exist matrices P > 0,   , , and , satisfying the following LMIs, for all  ∈ S: Moreover, the corresponding control laws are given by Proof.Choose a stochastic Lyapunov function for the system in (6) as By condition ( 5), one has where From ( 8), it is concluded that  is nonsingular.Pre-and postmultiplying (8) with diag{ − , , } and its transpose, respectively, and letting   =  − P  −1 , we have Since ∑  =1        =      > 0, we have By the Schur complement and ( 14), it is known that (13) implies Φ  < 0. Therefore, we have where  = inf ∈S (−Φ  ) > 0. From Dynkin's formula and summing up (15) form 0 to ∞ with respect to  yields, we obtain By Definition 3, system ( 6) is stochastically stable.This completes the proof.(6).On the other hand, this general case can be done by use an adaptive control.The unknown probability  will be estimated by an adaption law.
Next, we will apply key idea of (3) to NCSs.The controlled plant is an MJS as shown in Figure 1.
As demonstrated in Figure 1, system state () and mode signal () are transmitted through networks with communication delays () and (), respectively.Considering the effect of random delays () and (), the control law is described as where   ≤ () ≤   and   ≤ () ≤   .
Remark 6.If delay () of system mode is constant, controller ( 17) is similar to that in [21] where the authors first showed that the resulting closed-loop system is a new time-varying delayed MJS with extended state space.For the case that delay () is similar to delay (), the resulting closed-loop system is modeled as an MJS with two modes via augmentation technique [22].Both of the aforesaid references constructed a mode-dependent stabilizing controller with an assumption that there is no packet missing in channel 1.However, it is a more realistic situation that not only network-induced delays but also packet dropouts exist in channel 1, when system mode is transmitted.Since both network-induced delays and packet dropouts affect system mode (), it is natural to consider both of them in the controller design.Unfortunately, controller (17) will not be applicable to this case.Based on the key idea of (3), we know that the effect of dropouts on system mode () does not destroy the Markov process with respect to ().So we construct the following controller: (18) where () is function as 1,  () =   and transmitted successfully, 0, otherwise.
Thus, () is a Bernoulli distributed sequence satisfying (4) and (5).From [11], we know that constant delay in system mode () results in the original system being no longer traditional MJSs.However, the closed system is a time-varying delayed MJS with extended state space.In addition to Remark 2, we know that the closed-loop system (1) via controller ( 18) is also an MJS with respect to θ() ≜ [() ( − 1) ⋅ ⋅ ⋅ ( −   )]  .
Remark 9.It should be pointed out that it is not appreciate to model transmission delays or packet losses as Markov process, since both of them occur in channel 1 simultaneously.However, the control technique based on partially modependent controller can be used to tackle this case.The scalar  may reflect the jam degree of networks.That is, the lager value of  denotes the more expedite of networks.Comparing to mode-independent controller with  = 0, it is less conservative in the sense that the desired controller is also constructed, when there is no solution to a totally modeindependent controller.When  = 1 in terms of being a mode-dependent controller, a partially mode-dependent controller ( 18) is less dependent on the transmitted system modes, which could reduce the burden of communication networks.Both of the advantages can be shown via a numerical example.In addition, the solvability of controller ( 18) is established in terms of LMIs, which is solved directly by Matlab LMI toolbox.

Numerical Examples
In this section, two examples are given to demonstrate the effectiveness of the proposed approaches in this paper.
Example 1.Consider the following inverted pendulum system [23]: where G = 9.8 m/s 2 ,  is the half length of the pendulum, and  and  are the masses of the cart and the pendulum, respectively.Here, we choose two samples; that is,  1 = 8,  1 = 2, and  1 = 0.5 and  2 = 6,  2 = 3, and  2 = 0.7, respectively.Assuming the sampling period   = 0.01s, we have two discrete-time models for the system in (35) described as  Applying such controllers to the above system, the trajectory of the closed loop is illustrated in Figure 3.
Example 2. Consider the following Markovian jump system described as The transition probability matrix is given by The state trajectories  1 () of the closed-loop system via controllers K and Ǩ are shown in Figure 5, respectively, so is  2 () shown in Figure 6.Though Ǩ is a partially modependent controller, it can also stabilize this system.Because  = 0.4, it means that the system mode of controller Ǩ is not necessarily transmitted through network online.In this sense, it is said that the partially mode-pendent controller is advantageous over a mode-dependent controller in terms of reducing network expedite.

Conclusions
This paper has investigated the stabilization problem for DMJSs via a partially mode-dependent controller.Sufficient condition for such controller is developed within LMI framework.Moreover, the key idea of this control scheme has been utilized to networked control system.In this case, the controlled plant is an MJS with simultaneous consideration of network-induced delays and data packet dropouts in system mode transmission.Numerical simulations are used to illustrate the effectiveness and applicability of the developed results.

Figure 1 :
Figure 1: Structure of NCS with network-induced delays.
Remark 5.It is worth mentioning that controller with partially mode-dependent property (3) is established in terms of LMIs via a stochastic Lyapunov function instead of a common Lyapunov function, where both totally mode-dependent and mode-independent controllers are contained.It is said that controller (3) bridges such two extreme cases.It is also seen that  in partially mode-dependent method plays an important role, which should be known.When it is unknown or unavailable, how to design an effective controller is necessary to be considered.Two possible ways may deal with such problem.The first one is to use a robust method to handle