This paper presents results concerning the global external stochastic stabilization for linear systems with input saturation and stochastic external disturbances under random Gaussian distributed initial conditions. The objective is to construct a class of control laws that achieve global asymptotic stability in the absence of disturbances, while guaranteeing a bounded variance of the state for all the time in the presence of disturbances. By using an alternative approach, a new class of scheduled control laws are proposed, and the global external stochastic stabilization problem can be solved only through some routine manipulations. Furthermore, the reported approach allows a larger range of the design parameter. Finally, two numerical examples are provided to validate the theoretical results.
National Natural Science Foundation of China61503079Natural Science Foundation of Jiangsu ProvinceBK20150625Fundamental Research Funds for the Central UniversitiesPriority Academic Program Development of Jiangsu Higher Education Institutions1. Introduction
In decades, the stabilization of linear systems with input saturation has been widely studied by many researchers; see, for instance, [1–4] and the references therein, and in general, internal stabilization and external stabilization are two kinds of main research focus on this subject [5]. It is now well known [6] that global internal stabilization is possible if and only if the linear system is asymptotically null controllable with bounded controls (ANCBC); that is, the linear system is stabilizable and all its open-loop poles are located in the closed left-half plane. Generally speaking, a class of nonlinear control laws should be constructed to achieve global internal stabilization; see, for instance, [7, 8]. By designing a class of low gain control laws, the semiglobal internal stabilization framework was introduced in [9, 10] with linear control laws.
On the other hand, external stabilization requires that internal stabilization is guaranteed when considering input saturation, which means external and internal stabilization have to be achieved simultaneously. By introducing the framework of external Lp stability, it was proved in [11] that the general ANCBC systems with input saturation can achieve external Lp stability with a linear control law when the external disturbance is input-additive and the global/semiglobal internal stabilization is guaranteed with this linear law in the absence of the external disturbance. For the non-input-additive disturbance, it is known [12] that in general external Lp stability via a linear control law is almost never possible. Notable results from [13] reveal that, for double-integrator systems with input saturation and the non-input-additive disturbance, any linear control laws achieve external Lp stability for p∈1,2, but no linear control laws can achieve external Lp stability for p∈2,∞. Considering the input-to-state stability (ISS) framework, it is pointed out [14] that the external and internal stabilization of double-integrator systems can not be achieved via a linear control law. Moreover, it is impossible to get a good stable response if we consider such systems with the non-input-additive disturbance. Based on these observations, the external stochastic stabilization problem should be considered, where the considered ANCBC system is subject to input saturation, stochastic external disturbances, and random Gaussian distributed initial conditions; see, for instance, [5] for neutrally stable systems, [15] for a chain of integrators, and [16] for general ANCBC systems. The objective is to construct a class of nonlinear control laws that achieve global asymptotic stability in the absence of disturbances, while guaranteeing a bounded variance of the state in the presence of disturbances.
A common feature in the aforementioned works of [15, 16] lies in a conjecture, and some additional restrictions have been imposed on certain design parameter. In this paper, we revisit the simultaneous external and internal stabilization of general ANCBC systems with input saturation and stochastic external disturbances. The main challenge of this study is how to solve the global external stochastic stabilization problem only through some routine manipulations. Moreover, it is worth pointing out that the main contributions are stated as follows.
An alternative approach is first introduced, and the global external stochastic stabilization can be solved through some routine manipulations, which means that the conjecture/lemma in [15, 16] is no longer needed.
Compared with existing results [15, 16], there is no restriction imposed on the design parameter, which allows a larger range.
Notations. The notations AT and tr(A) denote the transpose and trace of matrix A, respectively. Matrices, if their dimensions are not explicitly stated, are assumed to be compatible for algebraic operations. The notation P>0 (≥0) means that P is a real symmetric positive (semipositive) definite matrix. In∈Rn×n and 0 represent, respectively, the identity matrix and zero matrix.
2. Problem Formulation
We consider the following stochastic differential equation:(1)dxt=Axtdt+Bδutdt+Edwt,where the state x, the control input u, and the disturbance w are vector-valued signals of dimensions n, m, and l, respectively. Here w is a Wiener process (a Brownian motion) with mean 0 and rate Q. The initial condition xi(0)∈Rn of (1) is a Gaussian random vector which is independent of w, and δ· is a standard saturation function given as (2)δu=u,ifu≤1,signu,ifu>1. We firstly assume that the pair A,B is stabilizable and all the eigenvalues of A are in the closed left-half plane. As is well known, all eigenvalues of A that have negative real parts will not affect the stabilizability property of the system. Without loss of generality, we will give the following assumption.
Assumption 1.
The pair A,B is controllable and all the eigenvalues of A are on the imaginary axis.
In what follows, the global external stochastic stabilization problem can be defined as follows.
Definition 2.
Consider system (1); the global external stochastic stabilization problem is to find a control law u=f(x) such that, for all possible values for the rate Q of the stochastic process w, the following properties hold.
In the absence of the disturbance w, the equilibrium point x=0 of system (1) with u=f(x) is globally asymptotically stable.
In the presence of the disturbance w, the variance of the state of the controlled system (1) with u=f(x) is bounded over t≥0.
To solve the global external stochastic stabilization problem, a class of possibly nonlinear control laws are proposed in [15] as(3)u=Fεxx,where the parameter εx is scheduled according to(4)εx=maxεx∈0,1∣εxxTPεxx≤cprovided c is sufficiently small, and the state control gain is given as (5)Fεx=-BTPεx, where Pεx is the positive definite solution to the following parameter dependent algebraic Riccati equation (ARE): (6)ATPεx+PεxA-PεxBBTPεx=-εxPεx, where εx>0.
To avoid the trivial results, the case that εx=0 is not considered in this paper. Meanwhile, it has been shown in [15], using a class of possibly nonlinear control laws (3), that the global external stochastic stabilization problem is solved provided the following conjecture holds.
Conjecture 3.
There exists a scalar α such that(7)εxdPεxdε≤αPεx,for all εx∈0,1.
Although it is proved in [16] that the above conjecture always holds, it is noted that the parameter εx is restricted to the interval 0,1. As can be seen in the following section, the above conjecture/lemma is no longer needed, a new class of scheduled control laws will be proposed, and we can solve the global external stochastic stabilization only through some routine manipulations. Furthermore, there is no restriction imposed on the positive design parameter εx, which allows a larger range.
3. Main Results
To find a solution to the problem of global external stochastic stabilization, the following parameter dependent ARE should be revisited:(8)ATPε+PεA-PεBBTPε=-εPε,where ε>0 is a scalar. This parameter dependent ARE was first introduced in [17] for a linear system, and the properties can be summarized as follows.
Lemma 4 (see [17]).
Let Assumption 1 hold. Then, for an arbitrary ε>0, the ARE (8) has a unique positive solution P(ε)=W-1(ε), where W(ε) satisfies the parametric Lyapunov equation:(9)WA+ε2InT+A+ε2InW=BBT,dPεdε>0,∀ε>0,limε→0Pε=0.Furthermore, P(ε) is a polynomial function in ε for a scalar input. In general, P(ε) is a rational function in ε.
Remark 5.
According to [18], one property of (8) can be found as(10)trBTPεB=nε.
In what follows, we propose a new class of scheduled control laws to solve the global external stochastic stabilization problem, which can be carried out in three steps.
Step 1.
Let(11)εx=maxεx∈0,γ∣trBTPεxBxTPεxx≤1,where γ>0 is a scalar.
Step 2.
Solve the following ARE:(12)ATPεx+PεxA-PεxBBTPεx=-εxPεx,where the existence of Pεx is guaranteed by Lemma 4.
Step 3.
Construct a control law u=f(x) as(13)u=Fεxx,where Fεx=-BTPεx is the state control gain.
Remark 6.
It is observed from (11) that if needed, the scalar γ>0 can be given by any positive values, which means there is no restriction imposed on the positive parameter εx. Compared with the scheduled parameter εx in (4), the positive parameter εx in (11) allows a larger range. Furthermore, it is known from [17] that e-εx/2 represents the convergence rate of the closed-loop system. In fact, a larger parameter εx may indicate a slower convergence speed.
The following lemmas play crucial roles.
Lemma 7.
For any positive scalar γ and all εx∈0,γ, one has(14)dPεxdε=-1εxPεx,where Pε(x)∈Rn×n is defined in (12).
Proof.
Define(15)Vx=xTPεxx,where x is the state of system (1). Note from (11) that trBTPεxBxTPεxx≤1, and we have(16)dtrBTPεxBxTPεxx=0.According to the Ito^ stochastic differential rule, we obtain(17)trBTPεxBxTdPεxdεxdε+2xTPεxdx=-xTPεxxdtrBTPεxBdεdε-trBTPεxBtrETPεxEdt.Note that(18)dVx=xTdPεxdεxdε+2xTPεxdx+trETPεxEdt,and substituting (17), we find that(19)dVx=-tr-1BTPεxBxTPεxxdtrBTPεxBdεdε.According to (10), we can continue (19) as(20)dVxdε=-1εxxTPεxx.It follows from (15) that (21)xTdPεxdεx=-1εxxTPεxx. This implies (22)dPεxdε=-1εxPεx, which completes the proof.
Remark 8.
Compared with (7) in Conjecture 3, the above relationship between dPεx/dε and Pεx in Lemma 7 is analytically discovered through some routine manipulations. Meanwhile, if needed, the scalar γ can be given by any positive values, which indicates a larger range.
Lemma 9.
Let Assumption 1 hold. Then one has(23)Fεxx≤1.
Proof.
In view of (11), it is clear that (24)Fεxx2=-BTPεxx2=xTPεxBBTPεxx≤trBTPεxBxTPεxx, which is less than or equal to 1.
Lemma 10 (see [19]).
Let Vn≥0 be random variables and let Fn be a filtration to which Vn is adapted and suppose that there exist constants a>0, J and M<∞, and p>2 such that EV0s is bounded for s∈1,p and for all n(25)EVn+1-Vn∣Fn<-a,ontheeventthatVn>J,(26)EVn+1-Vnp∣Fn≤M.Then for any r∈0,p-1, there is c=ca,J,M,p,r such that EVnr<c for all n.
The following is the main result on the global external stochastic stabilization problem.
Theorem 11.
Let Assumption 1 hold. Consider the system described by stochastic differential equation (1); the control law (13) can solve the global external stochastic stabilization problem as defined in Definition 2.
Proof.
By using (1) and (13), we obtain(27)dx=Axdt+BδFεxxdt+Edw.Recalling from Lemma 9 that Fεxx≤1, we can continue (27) as follows:(28)dx=A-BBTPεxxdt+Edw.Consider a Lyapunov function as (29)Vx=xTPεxx.According to Lemma 4, it is easily verified that V(x) is a global Lyapunov function for system (28) in the absence of the disturbance w, which establishes global asymptotic stability.
It remains to show that the variance of the state of system (28) is bounded in the presence of the disturbance w. According to Lemma 10, we will use Vt=xTPεxx for t=n and Ft is the natural filtration generated by the stochastic process x.
Firstly, we will prove (26) for arbitrary integers p. According to the Ito^ stochastic differential rule, we obtain(30)dVx=∂Vx∂εdt+2xTPεxdx+trETPεxEdt=xTdPεxdεxdt+2xTPεxdx+trETPεxEdt.Note from Lemma 7 that (31)dPεxdε=-1εxPεx. It follows that(32)dV=-1εxxTPεxx+2xTPεxdx+trETPεxEdt=-1εx+εxxTPεxxdt+trETPεxEdt+2xTPεxEdw.Define (33)f1x=-1εx+εxxTPεxx+trETPεxE which satisfies (34)f1x≤1εx+εxxTPεxx+trETPεxE≤1εx+εx1nεx+trETPεxE≤M1, for some suitable constant M1, where we have used trBTPεxBxTPεxx≤1. Moreover, define (35)f2x=2xTPεxE which satisfies (36)f2x≤2xTPεxx1/2Pεx1/2E=2trBTPεxBxTPεxx1/2trBTPεxB-1/2Pεx1/2E≤2nεx-1/2Pεx1/2E≤M2, for some suitable constant M2. Thus we have (37)Vt-Vn≤∫ntf1xdt+∫ntf2xdω. It follows from [20] that all higher order moments of ∫ntf2(x)dω are bounded, and given that f1(x) is bounded, we trivially find that EVt-Vnp∣Fn is bounded for any p and for any t∈n,n+1 which implies (26).
Next, we will prove (25). Since trBTPεxBxTPεxx≤1, there exists κ>0 such that xTPεxx≥κ. Consider J1 such that V>J1 implies that (38)trETPεxE≤κ21εx+εx. According to (32), we have (39)EVn+1-Vnp∣Fn≤∫nn+1-κεx-κεx+trETPεxEdt. Assuming Vn>J with J>J1, and using Doob’s martingale inequality [21], we have (40)Psupt∈n,n+1Vt-Vn>J-J1≤EVt-Vn2J-J12. That is, for any ρ, we can choose J such that (41)Pinft∈n,n+1Vt<J1∣Vn>J<ρ. However, for Vn>J, we have (42)EVn+1-Vn∣Fn≤-Pinft∈n,n+1Vt>J1∣Vn>JT1+Pinft∈n,n+1Vt<J1∣Vn>JT2, where -T1=(κ/2)1/εx+εx is an upper bound for -κ1/εx+εx+trETPεxE and T2=trETPεxE. Since we have given V>J1, we obtain (43)EVn+1-Vn∣Fn≤-T11-ρ+T2ρ, which is less than -a for a=T1/2 provided ρ is small enough. This implies that (25) is satisfied. Therefore, we conclude from Lemma 10 that EVtr is bounded for all positive integers r.
In what follows, we will prove that the variance of x is bounded under the condition that EVtr is bounded for all positive integers r. Since Pεx-1 is a rational function in εx, there exist η>0 and an integer q such that (44)Pεx-1≤ηεx-q, which implies (45)Pεx≥η-1εxq. This yields (46)xTPεxx≥η-1εxqxTx. It follows from trBTPεxBxTPεxx≤1 that (47)xTx≤ηεx-qxTPεxx≤ηnεxq+1, which implies the expectation of the term on the right is bounded. Therefore, we have ExTx<∞, which completes the proof.
Remark 12.
From Theorem 11, we can know that the global external stochastic stabilization problem is solved for the case of Assumption 1. Moreover, it is easy to prove that the results can be extended to the case that the pair A,B is stabilizable and all the eigenvalues of A are in the closed left-half plane.
4. Simulation Examples
In this section, we provide two numerical examples to illustrate the effectiveness of the proposed control laws.
Example 1.
Consider a one-link manipulator with an elastic joint actuated by a DC motor [22, 23] with stochastic disturbances. Then, the dynamics are given as (48)dxt=Axtdt+Bδutdt+Edωt, where (49)A=0100-48.6-1.2648.60000101.950-1.950,B=021.600,E=0001.Since the eigenvalues of A are -0.3625,-0.4487+8.2203i,-0.4487-8.2203i,0, it is easily verified that the pair (A,B) is stabilizable and all the eigenvalues of A are in the closed left-half plane. We choose γ=1.5, which means εx∈0,1.5. Following the design procedure from (11) to (13) in this paper, the simulation results are given in Figure 1, where Figure 1(a) shows the state trajectories and Figure 1(b) shows the evolution of scheduled parameter ε(x(t)). It is seen that the results yield a bounded variance of the state, and the state is bounded by 0.1. Moreover, it seems that the state responses converge to constant values. However, from the data sheet of the simulation example, the state response of zero eigenvalue converges to zero with very small stochastic values (see the green line), and state responses of other eigenvalues converge to constant values. This may arise from the reason that three eigenvalues are on the left-half plane and only one zero eigenvalue is on the imaginary axis.
The state trajectories of one-link manipulator and the evolution of the scheduled parameter ε(x(t)).
Example 2.
In this example, to make a comparison, we consider a double integrator with input saturation and stochastic external disturbances (borrowed from [16]): (50)x˙1=x2,x˙2=δu+w,which indicates that the system matrices are (51)A=0100,B=01,E=01.It is well known that, for the above system, the pair (A,B) is stabilizable and all the eigenvalues of A are in the closed left-half plane. Solving the ARE (8), we obtain (52)Pε=ε3ε2ε22ε. We choose γ=1, which means εx∈0,1. According to the design procedure from (11) to (13), the simulation results are given in Figure 2 with red and solid line. It is shown that the variance of the state is bounded, and the convergence time is less than 10 seconds. Furthermore, we conduct additional simulations to compare the performance between the proposed control laws in this paper and the class of control laws of (2) in [16]. Based on the same conditions, the simulation results are shown in Figure 2 with blue and dotted line. It is observed from Figure 2 that the proposed control laws in this paper need less time to achieve global external stochastic stabilization. This may arise from the reason that the positive scalar c in (4) is sufficiently small, which may indicate a slower convergence speed.
The state trajectories of double integrator and the evolution of the scheduled parameter ε(x(t)).
5. Conclusions
This paper presents results on the global external stochastic stabilization of linear systems with input saturation. A new scheduled nonlinear controller design procedure is presented for the general ANCBC systems with input saturation and stochastic external disturbances. By making use of some routine manipulations, the global external stochastic stabilization has been achieved without the conjecture required in existing results. Moreover, the reported approach allows a larger range of certain design parameter.
Conflicts of Interest
The author declares that they have no conflicts of interest.
Acknowledgments
This work was partially supported by the National Natural Science Foundation of China (61503079), the Jiangsu Natural Science Foundation (BK20150625), the Fundamental Research Funds for the Central Universities, and a project funded by the Priority Academic Program Development of Jiangsu Higher Education Institutions.
FullerA. T..In-the-large stability of relay and saturating control systems with linear controllers19691045748010.1080/00207176908905846MR0258494Zbl0176.393022-s2.0-0014581463SussmannH. J.SontagE. D.YangY. D.A general result on the stabilization of linear systems using bounded controls199439122411242510.1109/9.362853MR1337566Zbl0811.930462-s2.0-0028712602KapilaV.GrigoriadisK.2002New York, NY, UKMarcel DekkerZhouB.DuanG.-R.Global stabilisation of multiple integrators via saturated controls200716158615932-s2.0-3624898476610.1049/iet-cta:20060541SaberiA.StoorvogelA.SannutiP.2012Boston, MA, USABirkhauserZbl1302.93003SontagE. D.An algebraic approach to bounded controllability of linear systems198439118118810.1080/00207178408933158MR730505Zbl0531.930132-s2.0-0021196599TeelA.Global stabilization and restricted tracking for multiple integrators with bounded controls199218316517110.1016/0167-6911(92)90001-92-s2.0-0026840020MarchandN.HablyA.Global stabilization of multiple integrators with bounded controls200541122147215210.1016/j.automatica.2005.07.004MR2174811Zbl1100.930362-s2.0-27344455935LinZ.SaberiA.StoorvogelA. A.Semiglobal stabilization of linear discrete-time systems subject to input saturation via linear feedback---an ARE-based approach19964181203120710.1109/9.533685MR1407210LinZ.StoorvogelA. A.SaberiA.Output regulation for linear systems subject to input saturation1996321294710.1016/0005-1098(95)00110-7MR1365602Zbl0847.930242-s2.0-0029777189SaberiA.HouP.StoorvogelA. A.On simultaneous global external and global internal stabilization of critically unstable linear systems with saturating actuators20004561042105210.1109/9.863591MR1778365StoorvogelA.SaberiA.ShiG.On achieving Lp performance with global internal stability for linear plants with saturating actuators3Proceedings of the 38th IEEE Conference on Decision and Control1999Phoenix, AZ, USA27622767StoorvogelA.ShiG.SaberiA.External stability of a double integrator with saturated linear control laws200411429451ShiG.SaberiA.On the input-to-state stability (ISS) of a double integrator with saturated linear control laws1Proceedings of the 2002 American Control ConferenceAnchorage, AK, USA596110.1109/ACC.2002.1024780StoorvogelA. A.SaberiA.On global external stochastic stabilization of linear systems with input saturation20155191310.1016/j.automatica.2014.10.060MR3284747Zbl1309.931812-s2.0-84920639994StoorvogelA. A.SaberiA.Necessary and sufficient conditions for global external stochastic stabilization of linear systems with input saturation20166151368137210.1109/TAC.2015.2471676MR34982702-s2.0-84964687574ZhouB.DuanG.LinZ.A parametric Lyapunov equation approach to the design of low gain feedback20085361548155410.1109/TAC.2008.921036MR24512472-s2.0-51449086246ZhouB.LinZ.DuanG.Robust global stabilization of linear systems with input saturation via gain scheduling201020442444710.1002/rnc.1436MR2599493Zbl1298.932982-s2.0-76649084198PemantleR.RosenthalJ. S.Moment conditions for a sequence with negative drift to be uniformly bounded in Lr199982114315510.1016/S0304-4149(99)00012-5MR1695073LangovoyM.Algebraic polynomials and moments of stochastic integrals201181662763110.1016/j.spl.2011.01.0222-s2.0-79951786396OksendalB.2013Springer Science & Business Media10.1007/978-3-662-13050-6MR804391RajamaniR.ChoY. M.Existence and design of observers for nonlinear systems: relation to distance to unobservability199869571773110.1080/002071798222640MR16913602-s2.0-0032022294ZhuF.HanZ.A note on observers for Lipschitz nonlinear systems200247101751175410.1109/TAC.2002.803552MR19299542-s2.0-0036805156