Offset-Free Strategy by Double-Layered Linear Model Predictive Control

In the real applications, the model predictive control MPC technology is separated into two layers, that is, a layer of conventional dynamic controller, based on which is an added layer of steady-state target calculation. In the literature, conditions for offset-free linear model predictive control are given for combined estimator for both the artificial disturbance and system state , steady-state target calculation, and dynamic controller. Usually, the offset-free property of the double-layered MPC is obtained under the assumption that the system is asymptotically stable. This paper considers the dynamic stability property of the double-layered MPC.


Introduction
The technique model predictive control MPC differs from other control methods mainly in its implementation of the control actions.Usually, MPC solves a finite-horizon optimal control problem at each control interval, so that the control moves for the current time and a period of future time say, totally N control intervals are obtained.However, only the current control move is applied to the plant.At the next control interval, the same kind of optimization is repeated with the new measurements 1 .The MPC procedures applied in the industrial processes lack theoretical guarantee of stability.Usually, industrial MPC adopts a finite-horizon optimization, without a special weighting on the output prediction at the end of the prediction horizon.
Theoretically, the regulation problem for the nominal MPC can have guarantee of stability by imposing special weight and constraint on the terminal state prediction 2 .The authors in 2 give a comprehensive framework.However, 2 does not solve everything for the stability of MPC.In the past 10 years, the studies on the robust MPC for regulation problem go far beyond 2 .We could say that, for the case of regulation problem when the system state is measurable, the research on MPC is becoming mature see e.g., 3-8 .For the case of regulation problem when the system state is unmeasurable, and there is no model parametric uncertainty, the research on MPC is becoming mature see e.g.9-11 .For other cases output feedback MPC for the systems with parametric uncertainties, tracking MPC, etc. , there are many undergoing researches see e.g., 12-16 .A synthesis approach of MPC is that with guaranteed stability.However, the industrial MPC adopts a more complex framework than the existing synthesis approaches of MPC.Its hierarchy is shown in, for example 17 .In other words, the synthesis approaches of MPC have not been sufficiently developed to include the industrial MPC.Today, the separation of the MPC algorithm into steady-state target and dynamic control move calculations is a common part of industrial MPC technology 17 .The use of steady-state target calculation is necessary, since the disturbances entering the systems or new input information from the operator may change the location of the optimal steady-state at any control interval see e.g., 18 .The goal of the steady-state target calculation is to recalculate the targets from the local optimizer every time the MPC controller executes.
In the linear MPC framework, offset-free control is usually achieved by adding step disturbance to the process model.The most widely used industrial MPC implementations assume a constant output disturbance that can lead to sluggish rejections of disturbances that enter the process elsewhere.In 19, 20 , some general disturbance models that accommodate unmeasured disturbances entering through the process input, state, or output, have been proposed.In a more general sense, the disturbance model can incorporate any nonlinearity, uncertainty, and physical disturbance measured or unmeasured .The disturbance can be estimated by the Kalman filter or the usual observer .The estimated disturbance is assumed to be step-like, that is unchanging in the future, at each control interval MPC refreshes its solution at each control interval .The estimated disturbance drives the steady-state target calculation, in order to refresh the new target value for the control move optimization.
This paper visits some preliminary results for the stability of double-layered MPC or output tracking MPC.These results could be useful for incorporating the industrial MPC into the synthesis approaches of MPC.The preliminary results for this paper can be found in 21, 22 .
Notations 1.For any vector x and positive-definite matrix M, x 2 M : x T Mx. x k i | k is the value of vector x at time k i, predicted at time k.I is the identity matrix with appropriate dimension.All vector inequalities are interpreted in an element-wise sense.The symbol induces a symmetric structure in the matrix inequalities.An optimal solution to the MPC optimization problem is marked with superscript .The time-dependence of the MPC decision variables is often omitted for brevity.

System Description and Observer Design
Consider the following discrete-time model: where u ∈ m denotes the control input variables, x ∈ n the state variables, y ∈ p the output variables, and d ∈ q the unmeasured signals including all disturbances and plantmodel mismatches.
Assumption 2.1.The augmented pair is detectable, and the following condition holds: The augmented observer is where is the prespecified observer gain.Define the estimation error x k x k − x k and d k d k − d k ; then one has the following observer error dynamic equation: Assumption 2.2.Δd k is an asymptotically vanishing item, and the observer error dynamics is asymptotically stable, that is, lim k → ∞ {Δd k , x k , d k } {0, 0, 0}.

Double-Layered MPC with Off-Set Property
For the system 2.1 , its steady-state state and input target vectors, x t k and u t k , can be determined from the solution of the following quadratic programming QP problems steady-state target calculation, steady-state controller : where y r is the desired steady-state output e.g., from the local optimizer , u r is the desired steady-state input, and u min , u max are the input bounds.Problems 3.1 and 3.2 is solved; when 3.1 and 3.2 is feasible, y t y r and 3.3 and 3.4 is not solved; when 3.1 and 3.2 is infeasible, 3.3 and 3.4 is solved.
When this target generation problem is feasible, one has 3.5 Subtracting 3.5 from 2.1 and utilizing 2.5 yield where the shifted variables χ •, k : The following nominal model of the transformed system 3.6 is used for prediction Its infinite horizon predictive control performance cost is defined as where By substituting 3.10 into 3.8 , one can get Here J χ k , π k gives an upper bound of J ∞ 0 k ; so we can formulate the MPC as an equivalent minimization problem on J χ, π with respect to the optimal control sequence with the shifted control sequence

3.14
We can explicitly derive the multi-step-ahead state and output prediction: where for all x 1 , x 2 ∈ X, u 1 , u 2 ∈ U, where X, U are bounded regions.Similarly, for a quadratic function V x x T Px, P > 0, there exists a finite Lipschitz constant L V > 0 such that Clearly, L x , L u , L V depend on X, U.However, it is unnecessary to specify X, U in the following.Moreover, L V depends on P , which is time varying; this paper assumes taking L V for all possible P .Lemma 3.2.Consider the prediction model 3.7 .Then, with the shifted control sequence π k 1 ,

3.21
Proof .It is easy to show that

3.23
By induction, one can easily show the claimed result, and thus the proof is completed.
≥ 0, j 1, . . ., m, 3.29 where U j is the jth row of the m-ordered identity matrix, Q . ., I m T , and u j min{ u max − u t k j , u t k − u min j }.
c By applying u k u t k ω * k | k , where ω * k | k is obtained by solving 3.25 -3.30 , the closed-loop system is asymptotically stable.
Proof.The matrix inequality 3.28 implies that A BK T P A BK − P Q K T RK ≤ 0.

3.31
By referring to 23 , it is easy to prove that 3.9 holds for all i ≥ N.
, which is guaranteed by 3.27 , where P γ 2 X −1 .Meanwhile, it is easy to show that, by applying 3.26 , the optimal γ * 1 k is exactly the optimal value of 3.32 Now we check if each element of the predictive control inputs satisfies the constraints u j,min ≤ u j k i | k ≤ u j,max , i ≥ 0, j 1, . . ., m.For any i within the finite horizon N, the input constraints are satisfied since Π m u min − u t k ≤ π ≤ Π m u max − u t k , as shown in 3.30 .Otherwise, beyond the finite horizon i ≥ N, χ k i | k belongs to the constraint set , which is guaranteed by 3.27 .In this case, by referring to 23 , it is easy to show that, 3.27 -3.29 guarantee that the feedback control law Since point c is assumed, the offset-free property can be referred to as in 19, 20, 22 .

Improved Procedure for Double-Layered MPC
At each time k 1 ≥ 0, we consider the following constraints: 4.1 where b There exist feasible solutions, including a control sequence π * k , a positive-definite matrix X, and any matrix Y , at time k 0, to the dynamic optimization problem 3.25 -3.30 .
Proof.By applying the shifted control sequence π k 1 , at time k 1, one has

4.5
By applying Lemmas 3.1-3.2, it is shown that

4.6
By further applying it is shown that where L x , L u > 0 are appropriate scalars.On the other hand, at time k 1, since the target generation problem is feasible, it is feasible to choose

4.9
Hence, γ * 1 k γ * 2 k can serve as an ISS for the definition of this term, see 22 Lyapunov function, and the closed-loop system is input-to-state stable.
If we use the terminal equality constraint, rather than the terminal inequality constraint, then 3.27 should be revised as A N χ k A B π 0 4.10 and 3.28 , 3.29 should be removed; moreover, 4.3 should be revised as with the shifted control sequence

4.13
By analogy to Theorem 4.1, it is shown that γ * 1 k can serve as an ISS Lyapunov function, and the closed-loop system is input-to-state stable.
Assume that A is nonsingular.Then, applying 4.11 yields 4.14 Further applying 4.3 yields Hence, by applying 4.10 -4.11 , an analytical solution of the steady-state controller may be obtained.

Numerical Example
Let us consider the heavy fractionator, which is a Shell standard problem, with the following model: where G U s is the transfer function matrix between inputs and outputs, and G F s between disturbances and outputs.The three inputs of the process are the product draw rates from the top and side of the column u 1 , u 2 , and the reflux heat duty for the bottom of the column u 3 .The three outputs of the process represent the draw composition y 1 from the top of the column, the draw composition y 2 , and the reflux temperature at the bottom of the column y 3 .The two disturbances are the reflux heat duties for the intermediate section and top of the column d 1 , d 2 .
The inputs are constrained between −0.5 and 0.5, while the outputs between −0.5 and 0.5.The weighting matrices are identity matrices.N 3.The sampling interval is 3 seconds.With the algorithm as in Theorem 3.3 applied, the simulation results are shown in Figure 1.The steady-state calculation begins running at instant k 20, when the optimizer finds the optimum target y t −0.5, 0.5, −0.4269 T .The objective value is −0.3538, indicating that −0.3538 unit benefits are obtained.During time k 200-300, the disturbances d 1 −1.3 and d 2 1 are added.The simulation verifies our theoretical results.

Conclusions
We have given some preliminary results for the stability of double-layered MPC.The results cannot be seen as the strict synthesis approaches; rather, they are endeavors towards this kind of approaches.Instead of asymptotic stability, we obtain the input-to-state stability, as in 22 .The results are inspired by 22 ; but they are much different, as shown in Remarks 1-11 of 21 .
We believe that several works need to be continued.Indeed, assuming feasibility of the target generation problem at each control interval is very restrictive, and overlooking the uncertainties in the prediction model brings difficulties for proving both the asymptotic stability and offset-free property.It may be necessary to develop a whole procedure, where the target generation problem is guaranteed rather than assumed to be feasible at each control interval and an augmented system is used for the stability analysis.

Figure 1 :
Figure 1: The closed-loop output trajectories, the corresponding control input signals, and the disturbances.
Theorem 3.3.For the system 2.1 subject to the input constraints u min ≤ u ≤ u max , 3.24 under Assumptions 2.1-2.2, the closed-loop output feedback model predictive control system, with objective function J χ k , π k , augmented observer 2.4 , and target generation procedure 3.1 -3.4 , achieves the offset-free reference tracking performance if the following three conditions are satisfied.a There exist feasible solutions x t k , u t k to the target generation problem 3.1 -3.4 , at each time k.
1 being a given design parameter.Equation 4.1 is utilized for 3.1 ; 4.2 is utilized for 3.3 .For the system 2.1 subject to the input constraints under Assumptions 2.1-2.2, the closed-loop output feedback model predictive control system, with objective function J χ k , π k , augmented observer 2.4 , target generation procedure (at k 0, 3.1 -3.4 ; at any k 1, 3.1 , 3.3 , 4.1 -4.4 ), and dynamic optimization problem 3.25 -3.30 , is input-to-state (ISS) stable if the following two conditions are satisfied.a There exist feasible solutions x t k , u t k to the target generation problem, at each control interval.
For the system 2.1 subject to the input constraints under Assumptions 2.1-2.2, the closed-loop output feedback model predictive control system, with objective function J χ k , π k , augmented observer 2.4 , target generation procedure (at k 0, 3.1 -3.4 ; at any k 1, 3.1 , 3.3 , 4.1 , 4.2 , 4.11 ), and dynamic optimization problem 3.25 , 3.26 , 4.10 , 3.30 , is inputto-state stable if the following two conditions are satisfied.a There exist feasible solutions x t k , u t k to the target generation problem, at each time k.b There exist feasible solutions π * k , at time k 0, to the dynamic optimization problem 3.25 , 3.26 , 4.10 , 3.30 .Proof.By applying the shifted control sequence π k 1 , at time k 1, one has