Decreasing the Value of Specified Cost Function by Adaptive Controller Based on Modified ACLF for a Class of Nonlinear Systems

A newnonlinear adaptive control law for a class of uncertain nonlinear systems is proposed.Theproposed control law is designed by a modified adaptive control Lyapunov function (ACLF) which satisfies a Hamilton-Jacobi-Bellman (HJB) equation. The modified ACLF is derived from transformation of an ACLF.The proposed control law is different from the inverse optimal one in decreasing the value of a cost function specified by a designer. In this paper, we show a transformation coefficient for an ACLF and a design method of a nonlinear adaptive controller. Finally, it is shown by a numerical simulation that the proposed control law decreases the value of a given cost function and achieves the desirable trajectory.


Introduction
Design of control laws considering stability and optimality is the central issue in control theory [1].For stability, Lyapunov theory is a strong tool to design controllers and to assure the stability of systems.For optimality, a value function which is the solution to a Hamilton-Jacobi-Bellman (HJB) equation is derived from dynamic programming.If a value function and an optimal control law can be found, then the closed system possesses robustness such as gain margin, phase margin, and low sensitivity against parameter variations [2,3].
However, a general approach to find the value function has not been shown and it is not easy to design the optimal control.Due to the difficulty, the inverse optimal control problem which minimizes a meaningful cost function was proposed by Freeman and Kokotovic.If the inverse optimal problem is solved, namely, a control Lyapunov function (CLF) is found, it is possible to design a control law with the good characteristics mentioned above by applying a CLF to the Pointwise Min-Norm (PMN) control law [4].But the minimized cost function and the trajectory may not be desirable.In order to improve this problem, a locally approximate approach around the origin by numerical calculation and transformation of a CLF was proposed.The approach gives characteristics of local optimality without loss of characteristics of the global inverse optimality [5,6], and it is based on the fact that the PMN control law can minimize the desired cost function if a CLF has the same level sets as the value function [7].
The inverse optimal control law was applied to robust control and adaptive control [8,9].Moreover, a control law in which a Sontag type control law and a PMN control law were generalized has been proposed [10][11][12].Also, many approaches to approximate the value function have been proposed.They are based on numerical calculation and focus on improvement of calculation speed and accuracy of approximation [5,13].
Recently, a new approach has been provided by [14].The new approach in [14] is different from the inverse optimal and approximate approaches in directly considering a cost function specified by a designer and provides a modified ACLF by introducing a transformation coefficient.This paper expands [14] and proves a modified ACLF and a control 2 Journal of Control Science and Engineering law designed by a modified ACLF minimize the value of a cost function specified by a designer in the set of control laws based on an ACLF.Also, the condition under which a controller and a transformation coefficient are continuous is provided and the problem of overparameterization which is to increase the number of parameter estimation according to the order of a system is solved.
In this paper, the design of a modified ACLF and a nonlinear adaptive control law is shown in Sections 3 and 4 and effectiveness of the proposed controller is shown by a numerical simulation in Section 5.
The following notations are used in this paper.R denotes the sets of real value.R + denotes the sets of positive real value.V  () denotes the derivative of V() with respect to .For a matrix A, A > 0 (≥ 0) denotes that a matrix A is positive definite (semipositive definite) matrix.A  denotes transpose of matrix A.
It is well known that the optimal control problem which minimizes the cost function ( 4) is reduced to the problem to find the value function satisfying the following HJB equation [10]: where the optimal control law () is given by However, it is generally difficult to solve the HJB equation and to find the value function.In this paper, assuming that there exists an ACLF for the system (1), a certain transformation coefficient is introduced and a nonlinear adaptive control law is constructed by a modified ACLF based on an original ACLF.

Main Results
In this section, we show the controller based on a modified ACLF by a certain transformation coefficient.First, an ACLF with unknown parameters and an adaptive law is defined as the following definition.Definition 1. V(, θ) : R + → R + is called an ACLF for the system (2) and (3) if it is a positive definite function which is continuous and radially unbounded and satisfies the following inequality: The following theorem gives the transformation coefficient for the modified ACLF and the control law based on an ACLF.
Theorems about the cost function (4), the transformation coefficient (, θ), and the control input (12) are given as follows.
Corollary 3. The value of cost function is given by the following equation if the transformation coefficient (9a)-(9c) and control law (12) are applied: Proof.Equation ( 18) is given from (13): By integrating of (18) from 0 to ∞, we obtain Theorem 4. The control law ( 12) with (9a)-(9c) minimizes the cost function (4) in the set of control laws based on the ACLF V(, θ).
Proof.It is assumed that the control (20) stabilizes the system: By substituting (20) for the cost function (4) and applying (13), we obtain Since the first term in (21) is positive, (21) is minimized when V() = 0. Therefore, the cost function ( 4) is minimized by the control law (12) using the ACLF V(, θ).
Remark 7. The control law includes the unknown parameters in (10).Therefore, it is required to estimate them by an adaptive law.The adaptive law is given in Section 4.
Remark 8.The proposed approach does not provide the value function but the transformation coefficient is determined such that the modified ACLF (8) satisfies the HJB equation.Since the modified ACLF (8) depends on the original ACLF, the value of the cost function (17) varies depending on the selection of the original ACLF.

Application of Theorem 2 to ACLF Obtained by Backstepping
In this section, the transformation coefficient, the modified ACLF, and a nonlinear adaptive control law are designed by applying Theorem 2 to the ACLF which is chosen in the following backstepping.Backstepping can be applied to the strict-feedback system (1) by the following procedure [16].
From the above, it is confirmed that Theorem 2 is satisfied.

Numerical Example
The effectiveness of the proposed control law is shown by a numerical example of a system with an unknown parameter.The numerical simulation is done for the second order system (40) and the cost function (41) [10]: where the true value of the unknown parameter is  = 0.5.
The value function of the optimal control problem for the system (40) with the cost function (41) is given by the following equation if the true value of  in (40) is 0.5 (the value function of the HJB equation is given in the existing result [10]): and the optimal control law is () = −3 2 () from ( 6).On the other hand, using the ACLF which is given by (43) from (27), the control law is derived as (44) by backstepping: Then, applying Theorem 2 to ACLF (43), the proposed control is and the transformation coefficient is It should be noted that if  1 () ̸ = 0 and  2 () = 0, then ( 2 ) = 0.In this case, we need to show that  ⋆ 1 ( 2 , θ) ̸ = 0 mentioned in Remark 6.Actually, we can obtain (48) from (47) when  2 () = 0:  Therefore, the proposed approach can be applied to ACLF (43).
The simulation results are shown in Figures 1, 2, 3, and 4. The initial state is  2 (0) = (−1.05.0) and design parameters are   = 1 and Γ = 1.The value of the cost function J is shown in Table 1.
Figures 1-3 show that the trajectories by the proposed control law are close to the optimal trajectories and Table 1 shows that the value of the cost function by the proposed control law is smaller than the one by backstepping and close to the optimal value for the system of which parameter  is known.

Conclusions
In this paper, a nonlinear adaptive control law is proposed.The control law is designed by a modified ACLF which satisfies the HJB equation.It is proved that a cost function specified by a designer is minimized in the set of the control laws based on an ACLF for the strict-feedback system.The condition under which the proposed control law and the transformation coefficient are continuous is provided.The effectiveness of the proposed control law is shown by the simple numerical simulation.If an ACLF is given, then the proposed approach enables designing a control law.Therefore, the proposed approach can also be applied to other nonlinear systems compared to strict-feedback systems.
Research subject in the future is extension to systems in which all the states cannot be accessed.