The problem of the asymptotic stabilizability in probability of a class of stochastic nonlinear control hybrid systems (with a linear dependence of the control) with state dependent, Markovian, and any switching rule is considered in the paper. To solve the issue, the Lyapunov technique, including a common, single, and multiple Lyapunov function, the hybrid control theory, and some results for stochastic nonhybrid systems are used. Sufficient conditions for the asymptotic stabilizability in probability for a considered class of hybrid systems are formulated. Also the stabilizing control in a feedback form is considered. Furthermore, in the case of hybrid systems with the state dependent switching rule, a method for a construction of stabilizing switching rules is proposed. Obtained results are illustrated by examples and numerical simulations.
1. Introduction
In recent years there has been a growing interest in hybrid systems. At the same time one of the basic problems in the control theory is the problem of the stability and the stabilizability of dynamic systems. For this reason, in the paper we deal with the stabilizability problem of nonlinear stochastic hybrid systems.
It is known that, if a common Lyapunov function exists, then the hybrid system is stable for any switching [1, 2]. In the absence of the common Lyapunov function, stability properties of the hybrid system in general depend on the switching signal, and in this case the hybrid system is not stable for any switching rules, but only for the so-called stabilizing switching rules [1]. In this case more general single Lyapunov, multiple Lyapunov, and single Lyapunov-like functions have been introduced [1–5].
Stability problem for stochastic hybrid systems with any switching is considered in [2], for stochastic hybrid systems with state dependent switching in [6–8], and for stochastic hybrid systems with Markovian switching in [8–10]. Stabilization problem for hybrid systems is considered for Markovian switching rule in [11–14] and for state dependent switching rule in [4]. For more details concerning the stability and stabilization problem of hybrid systems, the author refers the reader to [15] and its references.
In the present paper ideas of a feedback control, proposed by Florchinger for nonhybrid stochastic nonlinear control systems [16], are used and combined with the concept of the hybrid control theory [1, 3, 6, 10] to derive results for the asymptotic stabilizability of stochastic nonlinear control hybrid systems (with a linear dependence of the control) described by Itô stochastic differential equations with any, state dependent, and Markovian switching rule. It is assumed that the trivial solution of unforced hybrid system is stable in probability (wherein some of subsystems of unforced hybrid systems can be unstable). By applying the obtained control the trivial solution of hybrid system becomes asymptotically stable in probability. To find sufficient conditions for the asymptotic stabilizability in probability of considered class of hybrid systems and to determine the control in the feedback form the Lyapunov function technique including common, single, and multiple Lyapunov function is applied. In the case of state dependent switching rules author proposes also a design method for stabilizing switching rules, which are based on the knowledge of regions of decreasing a Lyapunov function along solution.
This paper is divided into three sections and is organized as follows. In the first section we recall some basic definitions related to the issue of stability of stochastic systems and some stability results of hybrid systems. In the second section we present main results regarding the asymptotic stabilizability of stochastic nonlinear hybrid systems with any, state dependent, and Markovian switching rule. Also we give two examples to illustrate obtained stabilizability criteria. In the third section we summarize the obtained results.
2. Mathematical Preliminaries
Throughout this paper we use the following notation. We mark T=[t0,∞),t0≥0. Let Ξ=Ω,F,{Ft}t≥0,P be a complete probability space with a filtration {Ft}t≥0 satisfying usual conditions. Let (w(t))t≥0=[w1(t),…,wM(t)]t≥0T be the m-dimensional standard Wiener process defined on the probability space Ξ. Let S={1,…,N} be the set of states and let σ:T→S be the switching rule. We assume that processes wk(t) and σ(t) are both {Ft}t≥0 adapted.
Let us consider a stochastic nonlinear hybrid system described by vector Itô differential equations as follows:
(1)dxt=f(x(t),σ(t))dt+∑k=1Mgk(x(t),σ(t))dwk(t),llllllllllllllllllllllllllllllll(x(t0),σ(t0))=(x0,σ0),
where x∈Rn is the state vector, (x0,σ0)∈Rn×S is an initial condition, and t∈T. Functions f:Rn×S→Rn, f=[f1,f2,…,fn]T, and gk:Rn×S→Rn, gk=[gk1,gk2,…,gkn]T, k=1,2,…,M, are continuous and locally Lipschitz and satisfy the following conditions:
(2)∀l∈Sf(0,l)=g1(0,l)=g2(0,l)=⋯=gM(0,l)=0.
We consider three types of the switching rules σ: Markovian, any, and state dependent switching rule.
Markovian switching σ is given by a right–continuous Markov chain r defined on the probability space Ξ and taking values in a finite state space S=1,2,…,N with a generator Γ=[γij]N×N, that is,
(3)P{r(t+δ)=j∣r(t)=i}=γijδ+o(δ),ifi≠j,1+γiiδ+o(δ),ifi=j,
where δ>0, γij≥0 is the transition rate from i to j if i≠j, γii=-∑i≠jγij. We assume that the Markov chain is irreducible, that is, rank(Γ)=N-1, and has a unique stationary distribution P=[π1,π2,…,πN]T∈RN which can be determined by solving
(4)lllllllllllllllllPΓ=0subjectto∑i=1Nπi=1,πi>0∀i∈S.
In the case of Markovian switching rule we mean the switching rule with fixed and given matrix Γ. To ensure the existence of the solution of the hybrid system (1) in the case of any switching rule we assume in addition that it is any Markovian switching rule that is with any matrix Γ. In the further part of this paper we use the formulation “any switching rule,” when we mean that “any Markovian switching rule.” In the case of the state dependent switching rule we will assume that the switching times are stopping times.
We use the following definitions.
Definition 1.
The null solution x≡0 of the stochastic differential equation (1) is
stable in probability if
(5)∀ϵ>0∀r>0∃δ(ϵ)>0x0<δ⟹∀t≥t0Pxt,x0,t0>r<ϵ,
asymptotically stable in probability if it is stable in probability and
(6)∀(x0,t0)∈Rn×[0,∞)Plimt→∞xt,x0,t0=0=1.
Definition 2.
We say that a continuous function V:Rn→R is a Lyapunov function if
V∈C2(Rn;R);
V(0)=0 and ∀x∈Rn∖{0}V(x)>0;
V is proper, that is, lim|x|→∞V(x)=∞.
For any twice differentiable function ϕ(x) (i.e., ϕ(x)∈C2(Rn;R)) the lth subsystem of the hybrid system (1) has a generator Ll acting on ϕ(x) (the Itô operator for the lth subsystem of system (1)) defined for every subsystem by
(7)Llϕx=∑μ=1nfμ(x,l)∂ϕ(x)∂xμ+12∑r,s=1n∑k=1Mgkr(x,l)gks(x,l)∂2ϕ(x)∂xr∂xs,llllllllllllllllllllllllllllllllllllllllllllll∈S.
The hybrid system (x(t),σ(t)) for σ(t)=r(t) has a generator L~l, l∈S, acting on any twice differentiable function ϕl∈C2(Rn;R) in the following way:
(8)L~lϕlx=∑μ=1nfμ(x,l)∂ϕl(x)∂xμ+12∑r,s=1n∑k=1Mgkr(x,l)gks(x,l)∂2ϕl(x)∂xr∂xs+∑j=1Nγljϕj(x).
Sufficient conditions for the asymptotic stability in probability of the null solution x≡0 of the hybrid system (1) with Markovian switching rule r in terms of the Lyapunov function are given by the following theorem.
Theorem 3 (see [10]).
Let D⊂Rn be an open neighborhood of 0. Suppose that for each l∈S there exists a Lyapunov function Vl:D→R such that
(9)∀l∈S∀x∈D∖{0}L~lVl(x)≤0(<0).
Then the null solution x≡0 is (asymptotically) stable in probability.
Definition 4.
A Lyapunov function V:Rn→R satisfying
(10)∀l∈S∀x≠0LlV(x)<0
is called a common Lyapunov function for the hybrid system (1).
Using Theorem 3 it is easy to conclude the following.
Fact 1.
Note that it is a known fact that if there exists a common Lyapunov function for the hybrid system (1), then the null solution of (1) is asymptotically stable for any Markovian switching rule.
Definition 5.
A Lyapunov function V:Rn→R satisfying
(11)∀x≠0LσstV(x)<0
for a switching rule σst is called a single Lyapunov function for the hybrid system (1).
Fact 2 (see [6]).
Note that it is a known fact that if there exists a single Lyapunov function for the hybrid system (1) for a switching rule σst, then the null solution of (1) is asymptotically stable for the switching rule σst. Such switching rules are called stabilizing switching rules.
Definition 6.
A family of Lyapunov functions Vl:Rn→R, l∈S satisfying
(12)∀l∈S∀x≠0LlVl(x)<0
is called a multiple Lyapunov function for the hybrid system (1).
Since we deal only with the stability problem of the null solution in the further part of this paper we use the formulation “system is stable,” when we mean that “the null solution of system is stable.”
3. Stabilizability of Hybrid Systems
The aim of this paper is to establish sufficient conditions for the asymptotic stabilizability in probability for the stochastic nonlinear control hybrid system given by vector Itô differential equations as follows:
(13)dxt=f0(x(t),σ(t))+∑i=1muixt,σtfixt,σtdt+∑k=1Mgk(x(t),σ(t))dwk(t),lllllllllll(x(t0),σ(t0))=(x0,σ0),
where x∈Rn is the state vector, u∈Rm is the control vector, (x0,σ0)∈Rn×S is an initial condition, and t∈T. Functions fi:Rn×S→Rn, fi=[fi1,…,fin]T, and gk:Rn×S→Rn, gk=[gk1,…,gkn]T, i=0,1,…,m, k=1,2,…,M, are continuous and Lipschitz and satisfy the following conditions:
(14)∀l∈Sf00,l=f1(0,l)=⋯=fm(0,l)=g1(0,l)=g2(0,l)=⋯=gM(0,l)=0.
We use the following definition of the stabilizability.
Definition 7.
The hybrid system (13) is said to be asymptotically stabilizable in probability, if there exists a switching signal σ:T→S and the associated feedback control law u:Rn×S→Rm, such that the hybrid system (13) is asymptotically stable in probability.
Let us consider nonhybrid stochastic control nonlinear systems given by [16]:
(15)dxt=f0xt+∑i=1muixtfixtdt+∑k=1Mgkxtdwkt,xt0=x0.
We introduce the following notation. The second order differential operator L (infinitesimal generator for the unforced stochastic differential system deduced from (15)) acting on any function ϕ∈C2(Rn;R)(16)Lϕ(x)=∑μ=1nf0μ(x)∂ϕ(x)∂xμ+12∑r,s=1n∑k=1Mgkr(x)gks(x)∂2ϕ(x)∂xr∂xs
and associated with this operator set W(17)W=x∈Rn:Lϕ(x)=0.
The differential operator Li acting on any function ϕ∈C2(Rn;R)(18)Liϕ(x)=∑μ=1nfiμ(x)∂ϕ(x)∂xμ,i=1,2,…,m
and associated with this operator set Wu(19)Wu=x∈Rn:Liϕx=0∀i=1,…,m.
Then the following corollary can be formulated from theorem given by Florchinger in [16].
Corollary 8.
Assume that there exists a Lyapunov function V:Rn→R such that
∀x∈RnLV(x)≤0,
W∩Wu={0}.
Then, the control law u:Rn→Rm defined as follows:
(20)ui(x)=-LiV(x),i=1,2,…,m,
stabilizes asymptotically in probability the stochastic control system (15).
3.1. Hybrid Systems with Markovian Switching Rule
Using Theorem of Khasminskii et al. [10] we can also formulate sufficient conditions for the asymptotic stabilizability in probability for a stochastic nonlinear control hybrid system with Markovian switching rule described by vector Itô differential equations as follows:
(21)dxt=f0xt,σt+∑i=1muixt,σtfixt,σtdt+∑k=1Mgk(x(t),σ(t))dwk(t),lllllllllll(x(t0),σ(t0))=(x0,σ0),
where x∈Rn is the state vector, u∈Rm is the control vector, (x0,σ0)∈Rn×S is an initial condition, and t∈T. Switching rule σ(t) is given by Markovian switching rule r(t) described by (3). Functions fi:Rn×S→Rn, fi=[fi1,…,fin]T, and gk:Rn×S→Rn, gk=[gk1,…,gkn]T, i=0,1,…,m, k=1,2,…,M, are continuous and Lipschitz and satisfy conditions (14).
Following the idea of Florchinger [16] we introduce the following notation. The second order differential operator L~l (infinitesimal generator for the lth subsystem of the unforced stochastic differential hybrid system with Markovian switching rule deduced from (21)) acting on any function ϕl∈C2(Rn;R)(22)L~lϕlx=∑μ=1nf0μ(x,l)∂ϕl(x)∂xμ+12∑r,s=1n∑k=1Mgkr(x,l)gks(x,l)∂2ϕl(x)∂xr∂xs+∑j=1Nγljϕjx,l∈S
and associated with this operator set W~l(23)W~l=x∈Rn:L~lϕl(x)=0,l∈S.
The differential operator L~li acting on any function ϕl∈C2(Rn;R)(24)L~liϕlx=∑μ=1nfiμx,l∂ϕlx∂xμ,i=1,2,…,m,l∈S
and associated with this operator set W~lu(25)W~lu=x∈Rn:L~liϕlx=0∀i=1,…,m,l∈S,
where the superindex u indicates the influence of the control coefficients fi.
The following theorem gives sufficient conditions for the asymptotic stabilizability in probability of the stochastic hybrid system (21).
Theorem 9.
Assume that there exist Lyapunov functions Vl:Rn→R, l∈S, such that
∀l∈S∀x∈RnL~lVl(x)≤0,
∀l∈SW~l∩W~lu=0.
Then, the control law u:Rn×S→Rm defined as follows:
(26)ui(x,l)=-L~liVl(x),i=1,2,…,m,l∈S,
stabilizes asymptotically in probability the stochastic control hybrid system (21).
Proof.
Using Assumption (i) we can conclude that the infinitesimal generator L~l for the lth subsystem of the hybrid system (21) can be estimated as follows:
(27)∀l∈S∀x∈RnL~lVlx=L~lVlx-∑i=1mL~liVlx2≤0,L~lVl(x)=0⟺L~lVl(x)=∑i=1mL~liVl(x)2=0.
Hence we can conclude that
(28)∀l∈SL~lVlx=0forx∈W~l∩W~lu,∀l∈SL~lVl(x)<0forx∈Rn∖W~l∩W~lu
and since condition (ii) is satisfied we obtain
(29)∀l∈SL~lVl(x)<0forx∈Rn∖{0}.
Now the thesis follows from Theorem 3.
The family of Lyapunov functions satisfying (29) is called the multiple Lyapunov function for the hybrid system (21).
3.2. Hybrid Systems with Any Switching Rule
Let us consider a stochastic nonlinear control hybrid system with any switching rule described by the following vector Itô differential equations:
(30)dxt=f0(x(t),σ(t))+∑i=1mui(x(t),σ(t))fi(x(t),σ(t))dt+∑k=1Mgk(x(t),σ(t))dwk(t),lllllllllll(x(t0),σ(t0))=(x0,σ0),
where x∈Rn is the state vector, u∈Rm is the control vector, (x0,σ0)∈Rn×S is an initial condition, and t∈T. Switching rule σ is any Markovian switching rule. Functions fi:Rn×S→Rn, fi=[fi1,…,fin]T, and gk:Rn×S→Rn, gk=[gk1,…,gkn]T, i=0,1,…,m, k=1,2,…,M, are continuous and Lipschitz and satisfy conditions (14).
Following the idea of Florchinger [16] we introduce the notation. The second order differential operator Ll (infinitesimal generator for the lth subsystem of the unforced stochastic differential hybrid system with any switching rule deduced from (30)) acting on any function ϕ∈C2(Rn;R)(31)Llϕx=∑μ=1nf0μ(x,l)∂ϕ(x)∂xμ+12∑r,s=1n∑k=1Mgkr(x,l)gks(x,l)∂2ϕ(x)∂xr∂xs,l∈S
and associated with this operator set Wl(32)Wl=x∈Rn:Llϕ(x)=0,l∈S.
The differential operator Lli acting on any function ϕ∈C2(Rn;R)(33)Lliϕ(x)=∑μ=1nfiμ(x,l)∂ϕ(x)∂xμ,i=1,2,…,m,l∈S
and associated with this operator set Wlu(34)Wlu=x∈Rn:Lliϕx=0∀i=1,…,m,l∈S.
Using this notation we formulate the next theorem that gives sufficient conditions for the asymptotic stabilizability in probability of the stochastic hybrid system (30).
Theorem 10.
Assume that there exists a Lyapunov function V:Rn→R such that
∀l∈S∀x∈RnLlV(x)≤0
∀l∈SWl∩Wlu={0}.
Then, the control law u:Rn×S→Rm defined as follows:
(35)ui(x,l)=-LliV(x),i=1,2,…,m,l∈S,
stabilizes asymptotically in probability the stochastic control hybrid system (30).
Proof.
Using Assumption (i) we can conclude that the infinitesimal generator Ll for the lth subsystem of the hybrid system (30) can be estimated as follows:
(36)∀l∈S∀x∈RnLlV(x)=LlV(x)-∑i=1mLliVx2≤0,LlV(x)=0⟺LlV(x)=∑i=1mLliV(x)2=0.
Hence we can conclude that
(37)∀l∈SLlVx=0forx∈Wl∩Wlu,∀l∈SLlV(x)<0forx∈Rn∖Wl∩Wlu
and since condition (ii) is satisfied we obtain
(38)∀l∈SLlV(x)<0forx∈Rn∖{0}.
By means of equation (38) one can conclude that function V(x) is the common Lyapunov function for the hybrid system (30) and hence from Fact 1 it follows that the hybrid system (30) is asymptotically stable in probability under the control law given by (35).
Remark 11.
Note that from condition (38) and assumption (iii) of Definition 2 it follows that every subsystem of hybrid system (30) with control u is globally asymptotically stable in probability (see [17]) and hence the set of initial conditions from which stability of hybrid system (30) can be achieved (the so-called null controllable region) is the whole Rn.
Example 12 (stabilizability of hybrid systems with any switching rule).
Let us consider a particular case of hybrid system (30)(39)dxt=-0.5-0.5sat2(x1)x(t)dt+u1x10dt+u20x2dt+x2satx1x1dw(t),forσ=1,(40)dxt=-0.02sat2(x2)-0.02x(t)dt+u1x1x2dt+0.2x20.2x1satx2dw(t),forσ=2,lllllllllllllllllll(x(0),σ(0))=(x0,σ0),
where x=[x1,x2]T∈R2, u=[u1,u2]T∈R2, S={1,2}, and function sat:R→R is given as follows:
(41)sat(y)=-1y<-1yy∈[-1,1]1y>1.
We look for the feedback u:R2×S→R2 under which the hybrid system (39) is asymptotycally stable in probability for any switching. Let us choose the Lyapunov function as follows:
(42)V(x)=12xTx.
We obtain
(43)L1V(x)=0,W1=R2,L11V(x)=x12,L12V(x)=x22,W1u={(0,0)},L2V(x)=0,W2=R2,L21V(x)=x12+x22,L22V(x)=0,W2u={(0,0)}.
We note that Wl∩Wlu={(0,0)} for l∈S={1,2} and hence from Theorem 10 it follows that the hybrid system (39) is asymptotically stable in probability for any switching under the feedback control given as follows:
(44)u(x,1)=[-x12,-x22],u(x,2)=[-x12-x22,0].
Note that function V(x)=(1/2)xTx is a common Lyapunov function for the hybrid system (39).
An examplary simulation of a trajectory of the hybrid system (39) is shown in Figures 1 and 2.
An exemplary stable path of system (39) without control u.
An exemplary asymptotically stable path of system (39) with control u given by (44).
3.3. Hybrid Systems with State Dependent Switching Rule
In this section we consider a stochastic nonlinear control hybrid system with state dependent switching rule described by vector Itô differential equations as follows:
(45)dxt=f0(x(t),σ(t))+∑i=1mui(x(t),σ(t))fi(x(t),σ(t))dt+∑k=1Mgk(x(t),σ(t))dwk(t),lllllllllll(x(t0),σ(t0))=(x0,σ0),
where x∈Rn is the state vector, u∈Rm is the control vector, (x0,σ0)∈Rn×S is an initial condition, and t∈T. Functions fi:Rn×S→Rn, fi=[fi1,…,fin]T, and gk:Rn×S→Rn, gk=[gk1,…,gkn]T, i=0,1,…,m, k=1,2,…,M, are continuous and Lipschitz and satisfy conditions (14).
Following the methodology introduced in [6] we assume that
(46)σ(t)=lj,t∈[τj,τj+1),j=0,…,j*,
where τ0=t0, and lj∈S with lj≠lj+1 and j* is the number of switches. Here j*≤∞ and τj*+1≤∞. The preliminary assumption about switching is that switching instants τj are stopping times and the corresponding active system has a unique solution in the interval [τj,τj+1).
A set of regions {Ωl,l∈S} is called an active-region set of (45) if the lth subsystem is active on Ωl and Rn∖{0}⊂⋃l∈SΩl. Let int(Ωl) denote the interior of Ωl and we say {int(Ωl),l∈S} is an interior of {Ωl,l∈S}. To ensure the existance of the solution of hybrid system (45) we assume also that [6].
Property A.
The interior of {Ωl,l∈S} is still an active-region set of system (45), that is,
(47)Rn∖{0}⊂⋃l∈Sint(Ωl).
Let us denote the domain of the active-region set of system (45) by
(48)Dom=⋃l∈Sl×intΩl.
We choose times of switches as follows [18]:
(49)τj=inf{t>t0:(σ(t),x(t))∉Dom},j=1,2,….
This is well-defined stopping time for the diffusion process described by (45) [18]. We denote such special class of state dependent switching rules satysfing (46)–(49) by Σ. Note that a switching rule σ∈Σ is a stochastic switching rule because of its dependence on stochastic process x(t). Our aim is to find a special partition Ωl such that every switching rule σ∈Σ is a stabilizing switching rule for considered class of stochastic hybrid systems.
Following the idea of Florchinger [16] we introduce the notation. The second order differential operator Ll, l∈S, (infinitesimal generator for the lth subsystem of the unforced stochastic differential hybrid system with state dependent switching rule deduced from (45)) acting on any function ϕ∈C2(Rn;R) is defined by (31). Sets Wl are given as follows:
(50)Wl=x∈Ωl:Llϕ(x)=0,l∈S.
The differential operator Lli, l∈S, i=1,2,…,m, acting on any function ϕ∈C2(Rn;R), is defined by (33). Set Wlu is given as follows:
(51)Wlu=x∈Ωl:Lliϕx=0∀i=1,…,m,l∈S.
The following theorem gives sufficient conditions for the asymptotic stabilizability of the stochastic hybrid system (45).
Theorem 13.
Assume that there exists a Lyapunov function V:Rn→R such that
⋃l∈SΩl=Rn, where Ωl={x∈Rn:LlV(x)≤0},
∀l∈SWl∩Wlu={0}.
Then, the control law u:Rn×S→Rm defined as follows:
(52)uix,l=-LliVx,i=1,2,…,m,l∈S,
stabilizes asymptotically in probability the stochastic control hybrid system (45).
Proof.
Using Assumption (i) similarly as in the proof of Theorem 10 we can conclude that the infinitesimal generator Ll for the lth subsystem of the hybrid system (45) can be estimated as follows:
(53)LlVx<0forx∈Ωl∖Wl∩Wlu,l∈S.
And hence
(54)LσstxV(x)<0forx≠0,σst∈Σ.
By means of (54) we can conclude that function V(x) is the single Lyapunov function for the hybrid system (45) and hence from Fact 2 it follows that the hybrid system (45) is asymptotically stable in probablity under the control law (52).
We note that in the assumptions of Theorems 9–13 condition (i) (different in each theorem) guarantees that the corresponding unforced hybrid system is stable in probability, but since sets W~l, Wl can contain some vectors x≠0 the corresponding unforced system does not need to be asymptotically stable in probability.
Remark 14.
Note that in general, the presence of input constraints inherently limits the set of initial conditions from which stability can be achieved (the so-called null controllable region) [19]. For considered hybrid systems with any switching the null controllable region is the whole Rn. In the case of the hybrid system with Markovian and state-dependent switching rule the important problem of the characterization of the null-controllable region is not discussed in this paper.
Example 15 (stabilizability of hybrid systems with the state dependent switching rule).
Let us consider a particular case of the hybrid system (45) which is a modification of the example considered by Florchinger [16]
(55)dxt=-0.810.0-0.8x(t)dt+ux1-x2dt+0110x(t)dw(t),forσ=1,(56)dxt=-0.50.0-0.8-0.5x(t)dt+ux1x2dt+0110x(t)dw(t),forσ=2,lllllllllllllll(x(0),σ(0))=(x0,σ0),
where x=[x1,x2]T∈R2, u=u∈R, S={1,2}.
We look for the stabilizing switching rule σst∈Σ and the feedback control u:R2×S→R under which the hybrid system (55) is asymptotically stable in probability. Let us choose a Lyapunov function of the form
(57)V(x)=12xTx.
We obtain
(58)L1V(x)=x1x2-0.3x12-0.3x22,Ω1=x2-x13x∈R2:x1x2-0.3x12-0.3x22llllllllllllllllllllll=-0.3x2-3x1x2-x13≤0,L11V(x)=x12-x22,L2V(x)=-0.8x1x2,Ω2=x∈R2:x1x2≥0,L21V(x)=x12+x22.
From (58) it follows that the sets Wl, Wlu, l=1,2, defined by (50) and (51), respectively, have the form
(59)W1={x=(x1,x2)∈Ω1:x2=3x1∨x2=x13},W2={x=(x1,x2)∈Ω2:x1=0∨x2=0},W1u=x=x1,x2∈Ω1:x1=x2∨x1=-x2,W2u={(0,0)}.
The illustration of regions Ωl and sets Wl, Wlu, l=1,2, defined by (58)-(59), is given in Figure 3.
We note that
(60)W1∩W1u=0,0,W2∩W2u={(0,0)}
and hence from Theorem 13 it follows that the hybrid system (55) is asymptotically stable in probability under feedback given as follows:
(61)u(x,1)=-x12+x22,u(x,2)=-x12-x22,
and the stabilizing switching rule of the form
(62)σst(t)=1ifx(t)∈Ω12ifxt∈Ω2.
We can conclude also that function V(x)=(1/2)xTx is the single Lyapunov function for the hybrid system (55).
An examplary simulation of a trajectory of the hybrid system (55) is shown in Figures 4 and 5.
Regions Ω1 and Ω2 with nonempty intersection and sets Wl, Wlu, l=1,2, defined by (58)-(59).
An exemplary stable path of system (55) without control u.
An exemplary asymptotically stable path of system (55) with control u defined by (61)-(62).
4. Conclusions
In this paper stochastic nonlinear control hybrid systems, consisting of unstable and stable subsystems described by Itô stochastic differential equations, have been analyzed in terms of the stabilizability. The asymptotic stabilizability in probability problem, for considered class of hybrid systems with any, state dependent, and Markovian switching rules, has been discussed. It has been assumed that the trivial solution of unforced hybrid system is stable in probability while some subsystems of unforced hybrid systems still can be unstable. By applying the obtained control the trivial solution of hybrid system becomes asymptotically stable in probability.
To find sufficient stabilizability conditions and to obtain the control law in a feedback form, the Lyapunov function technique (including a common, single, and a multiple Lyapunov function), the hybrid control theory, and some results of Florchinger [16] and Khasminskii et al. [10] have been used. Furthermore a method for a construction of stabilizing switching rules in the case of hybrid systems with state dependent switching rule has been given. The obtained results have been illustrated by examples.
Conflict of Interests
The author declares that there is no conflict of interests regarding the publication of this paper.
Acknowledgment
The author gratefully acknowledges the research support from Cardinal Stefan Wyszyński University in Warsaw.
LiberzonD.2003Boston, Mass, USABirkhäauserSystems & Control: Foundations & Applications10.1007/978-1-4612-0017-8MR1987806ChatterjeeD.LiberzonD.On stability of stochastic switched systemsProceedings of the 43rd IEEE Conference on Decision and Control (CDC '04)December 2004Bahamas, NC, USA2338ZhaiG.ChenX.Stability analysis of switched linear stochastic systems2008222766166910.1243/09596518jsce5692-s2.0-54549119120WangM.ZhaoJ.Quadratic stabilization of a class of switched nonlinear systems via single Lyapunov function20104144532-s2.0-7035057338010.1016/j.nahs.2009.07.005MR2570181DimarogonasD. V.KyriakopoulosK. J.Lyapunov-like stability of switched stochastic systemsProceedings of the American Control Conference (AAC '04)July 2004Boston, Mass, USA186818722-s2.0-8744293472WuZ.CuiM.ShiP.KarimiH. R.Stability of stochastic nonlinear systems with state-dependent switching20135881904191810.1109/tac.2013.2246094MR30900222-s2.0-84880897462SerokaE.SochaL.p-stability and p-stabilizability of stochastic nonlinear and bilinear hybrid systems under stabilizing switching rules2013201310206190MR303516810.1155/2013/206190YinG. G.ZhuC.201063New York, NY, USASpringer10.1007/978-1-4419-1105-6MR2559912PangS.DengF.MaoX.Almost sure and moment exponential stability of Euler-Maruyama discretizations for hybrid stochastic differential equations2008213112714110.1016/j.cam.2007.01.003MR23826992-s2.0-37549032519KhasminskiiR. Z.ZhuC.YinG. G.Stability of regime-switching diffusions200711781037105110.1016/j.spa.2006.12.001MR23408782-s2.0-34347331359BoukasE. K.Stabilization of stochastic singular nonlinear hybrid systems200664221722810.1016/j.na.2005.05.066MR21884542-s2.0-28244499344YuanC.LygerosJ.Stabilization of a class of stochastic differential equations with Markovian switching200554981983310.1016/j.sysconle.2005.01.001MR21528612-s2.0-21444461366DengF.LuoQ.MaoX.Stochastic stabilization of hybrid differential equations201248923212328MR29569142-s2.0-8486499141910.1016/j.automatica.2012.06.044SerokaE.SochaL.Stabilizability of a class of stochastic bilinear hybrid systems2011384265866910.1016/j.jmaa.2011.06.006MR28252142-s2.0-79961030699TeelA. R.SubbaramanA.SferlazzaA.Stability analysis for stochastic hybrid systems: a survey201450102435245610.1016/j.automatica.2014.08.006MR3267445FlorchingerP.A stochastic Jurdjevic-Quinn theorem2002411838810.1137/s03630129003707882-s2.0-0037225385MR1920157KhasminskiiR. Z.1980Alphen aan den Rijn, The NetherlandsSijthoff and NoordhoffLunzeJ.Lamnabhi-LagarrigueF.2009Cambridge, UKCambridge University PressMahmoodM.MhaskarP.Lyapunov-based model predictive control of stochastic nonlinear systems20124892271227610.1016/j.automatica.2012.06.033MR29569072-s2.0-84865001328