Application of the Preview Control Method to the Optimal Tracking Control Problem for Continuous-Time Systems with Time-Delay

This paper considers the application of the preview controlmethod to the optimal tracking control problem for a class of continuoustime systemswith state and input delays. First, through a transformation, the system is transformed into a nondelayed one.Then, the tracking problem of the time-delay system is transformed into one of a nondelayed system via processing of the reference signal.We then apply preview control theory to derive an augmented system for the nondelayed system and design a controller with preview function assuming that the reference signal is previewable. Finally, we obtain the optimal control law of the augmented error system and thus obtain that of the original system by letting the preview length of the reference signal go to zero. Numerical simulations are provided to illustrate the effectiveness and validity of our conclusions.


Introduction
As we all know, a time-delay phenomenon exists widely in practical engineering, and it is usually the main source of instability and performance degradation in various control systems.Therefore, considerable research has been devoted to study and analysis of time-delay systems.It is a common practice to transform the time-delay system into a nondelayed system in research work of control theory.Actually, discrete time-delay systems can eliminate delay by using the discrete lifting technique [1].As for continuous timedelay systems, these usually can be converted to nondelayed systems by a transformation.References [2,3] introduced state-delay systems according to this insight, and in the literature [4][5][6] they have studied input-delay systems.Reference [7] has discussed systems with state and input delays.
In many industrial applications, optimal tracking control [8][9][10][11], as the combination of optimal control and tracking control, aims at looking for an optimal control law to minimize the given performance index function, that is to say, to make the system output track the reference signal in an optimal way.Thus, optimal tracking control has been a goal pursued unremittingly in many fields.Preview control is a control technique to improve the performance of a closedloop system via sufficient utilization of the known future information on the reference signals or disturbances.Preview control theory has attracted academic attention since it was proposed 50 years ago [12][13][14][15][16].In the existing literature, the most extensive research into preview control centers on the linear quadratic optimal control problem with preview compensation [17][18][19][20][21].
We notice that [7] studied sliding mode control and the regulator problem, but the method of eliminating time-delay is universally applicable.Furthermore, a preview control system will be a normal control system when the preview length goes to zero.Based on these observations, the contribution of this paper is to apply preview control theory to the optimal tracking control problem for continuous-time control systems that are subject to state and input delays.First, according to a transformation in the literature [7], the timedelay system is transformed into the form of a nondelayed system.Second, by dealing with the reference signal, the 2 Mathematical Problems in Engineering tracking problem of the time-delay system is converted to the tracking problem of the nondelayed system.Then, taking advantage of the methods of preview control theory to derive an augmented error system for the nondelayed system, a controller with preview action for the augmented error system can be obtained, assuming that the reference signal is previewable.Finally, we propose an optimal control law for the augmented error system when the preview length of the reference signal goes to zero and obtain the optimal control law of the original time-delay system.Numerical simulations show the effectiveness and validity of the proposed conclusions in this paper.
The paper is organized as follows.Section 2 proposes the problem and states the basic assumptions.In Section 3, a transformation is introduced that transforms the timedelay system into the form of a nondelayed system.An augmented error system is derived and the optimal controller is presented in Section 4. The existence conditions of the controller are discussed in Section 5. Section 6 provides numerical simulations and Section 7 is the brief conclusion.

Problem Statement and Basic Assumptions
Consider a continuous-time control system with state and input delays described as where () ∈   is the state vector, () ∈   is the input control vector, () ∈   is the output vector, the matrices  0 ,  1 ∈  × ,  1 ∈  × , and  ∈  × are known real constant matrices with appropriate dimensions, and ,  > 0 denotes the constant time-delay, which appears in the state and input vectors, respectively.
We have the following assumptions for system (1).
0 ] is of full row rank; the pair ( 0 +  1 ,  1 ) is stabilizable; the pair (,  0 +  1 ) is detectable.Here, Define the subtraction of the reference signal   () from the output vector () as the tracking error: The objective of this paper is to design a controller to make the output vector () accurately track the reference signal   () without static errors; namely, lim For this, we introduce the quadratic performance index: where   ∈  × and  ∈  × are both positive definite matrices.
As has been pointed out in [16], introducing the derivative of the input control vector u () into the quadratic performance index  can create the controller with integral action, which helps the system eliminate static errors.

System Transformation
First, we eliminate the time-delay of system (1) through a transformation.Utilizing the transformation in the literature [7], where ,  satisfy and the state equation of system (1) is converted to the nondelayed form: Now, we solve  and  from (7).Treat  as a variable.Left multiply   on both sides of (7), which by transposition gives that is, Then, right multiplying  − 0  on both sides, we obtain namely, Integrate [0, ] on both sides and get Therefore, Thus, we have Then, substituting (15) into the first formula of ( 7) obtains : Similarly, substituting (15) into the second formula of (7) gives : According to () = () + ∫  −  (−−)  1 ()  + ∫  −  (−) () , we know () is reasonable to be the state vector of (8).Considering the output equation () = () of system (1) and the relationship of () and (), we can take () = () as the output equation of system (8).
Hence, time-delay system (1) is reduced to the following nondelayed system: Then, we make a transformation to the reference signal.Let Treating ( 18) as the control system equation and (19) as the reference signal, we determine that the tracking error of system (1) remains identical with the tracking error of system (18); that is, Thus, the performance index (5) can be directly applied to system (18).Note that ∫  −  (−−)  1 ()  and ∫  −  (−) () , as the integrations for historical values of the state vector and the input control vector, respectively, are both known at each instant of time ; therefore, () is a known vector.It is shown that taking () as the reference signal of system ( 18) is reasonable.Now, the problem is converted to designing the optimal control law of system (18) under performance index (5), where () = () − () is the tracking error.

Augmented Error System and Optimal Control
At first, the methods of preview control theory are adopted deriving an augmented error system that transforms the tracking problem into a regulator problem.We derive tracking error () and get Differentiating both sides of (8), we have Combining ( 21) and (22) gives where (), Ã, B, and D are, respectively, given by According to the output equation of system (18), we now take () = [ 0]() as the output equation and get where C = [ 0] ∈  + .
To utilize the research results of preview control, we assume that the reference signal () is previewable and the preview length is   .After obtaining the control input and letting   → 0 + , we can obtain the solution of the problem in this paper.
Equations (25) are the needed augmented error system.Our basic ideas are as follows: applying the idea of optimal preview control, designing the controller of system (25), and then obtaining the controller of system (1).It is easy to see that if we can design a state feedback to make the closedloop system of system (25) asymptotically stable, we will have lim  → ∞ () = 0. Hence, the error signal () as a partial component of the state vector () will satisfy (4).
According to the state and input vectors of (25), the performance index function ( 5) can be denoted as follows: where Q = C   C = [   0 0 0 ].Meanwhile, noting that the form of system (25) and the performance index function are similar to those mentioned in the literature [22], we obtain the following theorem by using similar derivations of [22].Theorem 4. Suppose ( Ã, B) is stabilizable and ( Q1/2 , Ã) is detectable.The optimal control input of system (25) to minimize performance index function ( 26) is given by where and  is a positive semidefinite matrix satisfying the algebraic Riccati equation Proof.According to the results of [22], when ( Ã, B) is stabilizable, ( Q1/2 , Ã) is detectable, and   is the preview length of the reference signal (), the optimal preview control input of system (25) is where is the desired output preview compensation of system (25) and Ã and  are described by ( 28) and (29), respectively.Because () is not previewable, ṙ () is not previewable.Therefore, (,   ) is unsolvable.To overcome the difficulty, we let   → 0 + utilize the property of integration and get lim   → 0 +  (,   ) = 0. (32) Making   → 0 + on both sides of (30), we give (27) immediately because (,   ) is only related to   .The proof is complete.

Existence Conditions of the Controller
In this section, we discuss conditions of the original system (1) that can make ( Ã, B) stabilizable and ( Q1/2 , Ã) detectable.

Lemma 6. The pair ( Ã, B) is stabilizable if and only if (𝐴, 𝐵) is stabilizable and the matrix [ 𝐴 𝐵
0 ] is of full row rank.
Lemmas 6 and 7 are both the results of [22].Note that we can put assumption 3 another way: suppose the matrix [    0 ] is of full row rank, the pair (, ) is stabilizable, and (, ) is detectable.
In summary, we obtain the main theorem in this paper.
(4)   and  are both positive definite matrices.
We then have the following closed-loop system: where   ,   , and  are all defined in Theorem 5 and the output vector () of the closed-loop system can track the reference signal   () asymptotically without static errors.

Numerical Simulation
Consider the system ]  ( − ) , In comparison with system (1), the coefficient matrices are as follows: Taking the sampling period  = 0.01 s and using the discretization technique for (35), we obtain the following discrete-time system: (38) Take the step signal below as the reference signal: and the weight matrices   = 1,  = 50.Now we do numerical simulations for several different time-delay combinations.
(1) The state delay is  = 0.30, and the input delays are  = 0,  = 0.15, and  = 0.30, respectively.Here,  = 0 means that the system has no input delay.In each case,  and  separately are  = 0.30,  = 0: It is verified that (, ) is stabilizable and (, ) is detectable in any case.Together with the reference signal   (), which is piecewise-continuously differentiable, the conditions of Theorem 8 are all satisfied.
In each case, we can get Ã, B, D, and C (omitted here) and have the solutions of Riccati equations,   and   :  = 0.30,  = 0: Take the allowed initial state to be (0) = [ 0 0 ] and define () = [ 0 0 ] and () = 0 when  < 0. Figure 1 shows the situation in which the output response of the closed-loop system tracks the reference signal.As the input delay  decreases, the effect of tracking improves when the state delay  is fixed.The control input curves of the closed-loop system are shown in Figure 2, in each case.
(2) The input delay is  = 0.20, and the state delays are  = 0.01,  = 0.15, and  = 0.30, respectively.Figure 3 shows the situation in which the output response of the closedloop system tracks the reference signal.As the state delay  decreases, the effect of tracking improves when the input delay  is fixed.The control input curves of the closed-loop system are shown in Figure 4, in each case.

Conclusions
In this paper, we have studied the optimal tracking control for a class of linear continuous-time control systems with state and input delays.The main contribution of this paper is applying the methods of preview control to the optimal tracking control of linear continuous time-delay control systems.First, the time-delay system is converted to a nondelayed system in form, by a transformation.Second, utilizing the methods of preview control theory to derive an augmented system for the nondelayed system, we can design a controller with preview function, assuming that the reference signal is previewable.Finally, we propose an optimal control law of the augmented error system when the preview length of the reference signal goes to zero and obtain the optimal control law of the original time-delay system.Numerical simulations show the effectiveness and validity of the conclusions in this paper.

3 Figure 1 : 3 Figure 2 :
Figure 1: Closed-loop responses for different input delays with a fixed state delay.

3 Figure 3 : 3 Figure 4 :
Figure 3: Closed-loop responses for different state delays with a fixed input delay.