Control System Design for a Ducted-Fan Unmanned Aerial Vehicle Using Linear Quadratic Tracker

the original


Introduction
A ducted-fan UAV is tactically useful for a battlefield.In particular small military units can operate this UAV for various missions such as reconnaissance, surveillance, and communication relay because it has capability of hovering without a runway.Also, it has unlimited hovering capability to land on the top of building in the battlefield or urban area without concerning weather conditions or fuel consumption.The ducted-fan vehicle also has aerodynamic advantages to generate more lift by the duct effect than unducted-fan configuration [1].Moreover, the UAV has shrouded configuration by duct, which is good for mobility and operator safety.The duct can improve the rotor safety by protecting from foreign object damages.In addition, unlike normal VTOL UAVs, it is easy to transit to cruise flight with regard to operating speeds.The ducted-fan UAVs can also be designed in a variety of sizes from micro to medium.However, the ducted-fan UAV is inherently an unstable system, and each axis is dynamically coupled multiple-input multiple-output (MIMO) system.Furthermore, this vehicle is too sensitive to overcoming wind disturbance because the duct generates drag by crosswind.Therefore, the operation of the ducted-fan UAVs is limited by weather condition.In order to cope with these circumstances, a robust control system should be considered for autonomous flight.
The ducted fan has capabilities of fixed wing and vertical take-off and landing (VTOL) UAVs as the above-mentioned flight features.Also, operation modes can be classified by three modes as hover, transition, and cruise modes.Therefore, an operation concept takes these advantages into account.For instance, the vehicle vertically takes off from an unmanned ground vehicle (UGV) or a military jeep and goes up to proper altitude, when the ducted-fan UAV is operated in the battlefield for a reconnaissance mission.Then, the mode is changed from the hover through the transition to the cruise mode during this climbing phase.When this UAV reaches the operation area for the mission, the flight mode is changed to the hover mode as shown in Figure 1.
Control methods for the ducted-fan type UAV are researched in various places.One of the effective approaches to control this vehicle is based on a nonlinear control theory [2][3][4][5][6][7][8][9].Hess and Ussery proposed a sliding mode control (SMC) with the feedback linearization for a linearized sixdegree-of-freedom model to consider a hover flight, and the robustness of the applied controller was verified via waypoint simulation [2].Spaulding  UAV to consider explicitly interaction with the external environment [8].In the presence of external disturbances, adaptive positon-tracking controllers were researched by Roberts and Tayebi [9].Also, a fuzzy logic is applied for this type's vehicles [10,11].Takagi-Sugeno fuzzy gain-scheduler and PD controller were applied by Lee and Bang for the HeliSpy model.The control scheme was validated via a waypoint guidance simulation for hover flight [10].Also, a fuzzy logic controller was proposed by Omar et al. for a ductedfan VTOL UAV with fixed wing to cope with transition manoeuvre to consider wind disturbance [11].Moreover, linear control method is studied based on a classical controller with an optimal control theory.Shin et al. developed a position control scheme of a small flying robot which has the ducted-fan type configuration.A PD controller was designed for an attitude system, and a linear quadratic integrator (LQI) was designed for a hovering control.Then the designed control system was verified indoor flight test [12].In this research, a tracking controller based on an optimal control theory is proposed considering entire flight conditions: hover mode, transition mode, and cruise mode for the Chungnam National University (CNU) ducted-fan UAV that has been developed.In order to reduce steady-state error, linear quadratic tracker with integrator (LQTI) is designed to augment an integral term of the tracking state in the state vector to be suitable for the highly coupled system.The proposed controller can reduce computation power compared to the compensator method with neural network adaptation law [4,6].Moreover, the LQTI is designed for an attitude control to compare with the linear approach [12].In addition, to guarantee reality of the controller design, this study presents extensive modeling and trim/linearization analysis of the CNU ducted-fan UAV by carrying out wind tunnel tests.They are performed with a wind tunnel velocity from 0 m/s to 15 m/s to cover the full flight modes against the previous studies to consider hovering operation [2,5,6,9,10,12].Also, the robustness against wind disturbances is validated through numerical simulations.
This paper is organized as follows.Section 1 describes the background and motivation of the paper and summarizes the related researches on controller algorithms for the ducted-fan type UAVs.Section 2 presents dynamic equations of motion of the CNU ducted-fan UAV briefly.Section 3 covers the tracking controller based on the optimal control theory and deals with an augmented tracker to use an integral control element.Section 4 reports the numerical simulation results of the tracking and three-dimensional waypoint cases.Finally, Section 5 concludes the paper.

Dynamic Modeling
A configuration of the CNU ducted-fan UAV is introduced in this section.Also, precise linearized modeling data of the UAV at each flight condition is established using mathematical approach which is divided into three modes with respect to airspeed: hover mode (0 m/s), transition mode (5 and 10 m/s), and cruise mode (15 m/s).

Configuration and Coordinate System.
A configuration of the CNU ducted-fan UAV is conventional ring-wing type as shown in Figure 2. It has four control surfaces that are located at the end of the duct.Also, it contains fixed stators for reducing an antitorque effect and additional lift.A fuselage is in center of the vehicle, and avionics are mounted in the duct or the fuselage.In addition, payload bay is placed on top of the fuselage.For various missions, operating equipment such as camera and spot light and communication relay can be located at this bay.
A coordinate system shown in Figure 3 has dynamic features similar to a helicopter: thrust vector, antitorque effect, gyroscopic coupling, and velocity induced by a main rotor.Pitch angle and angle of attack are zero at hover flight: as the vehicle goes forward, it becomes negative [13].In addition, moment of inertia is completely the same about -axis and -axis because of symmetricity.
The control surfaces are defined in Figure 4: the control surfaces 1 and 3 are ailerons, 2 and 4 are elevators, and deflecting all of control surfaces are rudders.These deflect from −30 to +30 degrees.The sign convention of the control surfaces angle is set to "+" for generating positive moment as indicated in Table 1.

Dynamic Equations.
The dynamics for the CNU ductedfan UAV can be represented as where [ V ] and [  ] represent velocity and angular rate components in , , and  directions of the coordinate system of this vehicle, respectively.[  ] are Euler angles. is control input vector, and each component of the vector consists of throttle, aileron, elevator, and rudder inputs.Six-degree-of-freedom nonlinear equations of motion are derived by considering total force and moment acting on the vehicle as [13] where   ,   , and   denote force components, and   ,   , and   are moment components of each element ( = [fuse duct cs ⋅ ⋅ ⋅]) along the body axis.  ,   , and   represent moment of inertia on each axis.Product of inertia can be neglected according to the symmetric configuration along -axis.The detailed procedure about the dynamics can be found in [13].

Trim Analysis.
In order to measure total force and moment on the body axis of the CNU ducted-fan UAV, the wind tunnel test results are used in this study.The tests perform with a wind tunnel velocity from 0 m/s to 15 m/s, which includes full flight modes.Figure 5 represents the pitching moment of the vehicle at 4,500 RPM [13].However, the wind tunnel test could not be experimented over the operating RPM because structural problems occurs by a strong vibration when the RPM exceeds 4,500.Therefore, an interpolation technique is applied for getting data over 4,500 RPM.Figures 6 and 7 show the interpolated wind tunnel test data to compare with numerical data by the modeled dynamics [14].These comparison results show that a precise dynamic modeling is constructed from the force and moment analysis.
In this research, the trim point is defined as 0, 5, 10, and 15 m/s, and each speed denotes hover, transition, and cruise flight modes.The mathematical trim results are calculated by the gradient method based on nonlinear dynamic equations International Journal of Aerospace Engineering  as described in Section 2.2.Moreover, the trim conditions from the wind tunnel test are determined using iteration of its data.Figure 8 shows the process of the trim calculation of the wind tunnel test.The trim states are obtained for both mathematical modeling and wind tunnel tests, which are summarized in Table 2.The mathematical modeling shows similar tendency to the experimental data.The trim pitch angle  trim is generally assumed to be zero in a conventional UAV for linearization.However, the trim pitch angle of the ducted-fan UAV is too significant to ignore during the full flight envelope.Thus,  trim is considered as nonzero in the state-space equation.Then linear models are extracted by using a small-disturbance theory for the trim condition of each operating mode as indicated in Table 2. Also, the linearized models from hover mode to cruise flight mode are applied to design the control system based on the optimal control theory in Section 3.

Optimal Control System Design
The optimal controller is designed for the CNU ducted-fan UAV which, as mentioned in Section 1, is a highly coupled MIMO system.A linear quadratic regulator (LQR) has been shown to be efficient and relatively simpler than classical control system design to apply to the MIMO system.This section briefly describes the optimal control theory.Next, the tracking problem is introduced since the desired output is not zero.A linear quadratic tracker (LQT) is designed for the tracking problem, but the steady-state error may occur.To reduce the steady-state error, a linear quadratic tracker with integrator (LQTI) is proposed for the CNU ducted-fan UAV.

Optimal Control Theory.
The linear quadratic regulator is basic technique by using the optimal control theory.Designing the LQR, the linearized model can be derived from mathematical modeling as the six-degree-of-freedom nonlinear equations of motion such as the Jacobian linearization method.The time-invariant linear model is described by where  ∈ R × ,  ∈ R × , () ∈ R  , and () ∈ R  .Also, () is the  × 1 state vector, and () represents the  × 1 control vector.
The performance index to be minimized is where  ∈ R × and  ∈ R × . is a real symmetric positive semidefinite state-weighting matrix, and  is a real symmetric positive definite control input weighting matrix.
Each weighting matrix can be chosen using Bryson's rule as where   and   mean maximum acceptable values of each variable: the states and the control inputs.Bryson's rule gives reasonable starting values to iterate the weighting matrices  and  [15,16].The Riccati equation should be considered to design the optimal controller.Then the Riccati equation is obtained as () can be found from the set of quadratic equations obtained by setting Ṡ () = 0 for a suboptimal regulator.Defining the optimal gain as the LQR control input is designed as [17]  () = − () .
3.2.Linear Quadratic Tracker.An optimal tracker, the LQ tracker, can be extended based on the LQR [16].When the full state feedback is designed for the tracker, it starts by considering a linearized model based on (3) as where the state vector () can be classified into the regulating state (  ∈ R − ) and tracking state (  ∈ R  ,  ≤ ).
Solving the tracking problem, a tracking error term should be replaced in the dynamic model.The state-space equation is rewritten in terms of the tracking error (  ∈ R  ) as where  ref denotes the tracking reference input.To design LQR controller to use the optimal control theory, the reference input ( ref ) must be removed in (10).Therefore, ( 10) is differentiated with respect to time as when  ref is constant.The state feedback gain is able to obtain with (11).Thus, the differential control input is written as where the control gain  LQT is a set of gains which consists of the regulation gain (  ) and tracking gain (  ).The LQ tracker (LQT) can be designed to integrate (12) in time, and the tracker system is shown as Figure 9.However, the tracking term will not converge to the steady-state error because all of the state variables are differential terms to include the tracking error term.Hence, a new state vector is defined with the tracking error term as where the augmented term   is  × 1 vector.Then the state equation becomes where  Σ and  Σ denote augmented matrices of the state equation. new is a new control variable defined as  new () ≡ u () and  add denotes an additional state matrix due to the additional state   .Also, the performance index is redefined with the augmented states as where the states weighting matrix is expanded as  LQTI ∈ R (+)×(+) and  LQTI ∈ R × .Now the control input of the LQ tracker can be calculated by using the LQR method as and then the closed-loop plant becomes (2) the closed-loop plant equation ( 17) is asymptotically stable, where  = (∞).
To design the weighting matrices  LQTI and  LQTI , controllability and observability should be considered according to Theorem 1 [17].In order to adopt the dynamic system, the new control input equation ( 16) should be integrated with respect to time.Then finally the LQ tracker is derived as where the control gain  LQTI is augmented with the integral tracking gain (  ) based on  LQT in (12).Figure 10 shows control system structure of the LQ tracker with the integral element (LQTI).

Numerical Simulations
The simulations are separated into two cases.Firstly, a speed tracking control is designed by using LQT and LQTI based on the optimal control theory and performed in Case 1. Then waypoint guidance simulation is carried out to evaluate the performances under wind disturbances in Case 2. Both cases are considered for a real experimental platform which has a GPS receiver, gyro sensors, and a magnetic sensor to acquire state data.The angular rates (, , and ) and the Euler angles (, , and ) are measured using the gyro sensors and the magnetic sensor.Moreover, the velocities (, V, and ) can be determined by using GPS speeds (  ,   , and   ) and the Euler angles.The simulation environment is built with the Matlab/Simulink and sampling time is 0.02 sec.

Case 1: Speed Tracking Control.
This simulation is assumed that the CNU ducted-fan UAV can be divided into the longitudinal mode and the lateral/directional mode as fixed-wing aircraft for validating performance of the proposed controller.Let us consider a longitudinal motion of the vehicle at hovering mode.A linearized longitudinal model is where the state vector, the control vector, the system state matrix, and the control input matrix are given as ] . (20) The control vector consists of a throttle input and an elevator deflection angle.
To design the LQT, the velocity states should be chosen for the speed tracking control system.Then the regulating and tracking states are The state equation is rewritten as Then the optimal gain is calculated by solving continuoustime algebraic Riccati equation (CARE).By using the care algorithm, the control gains for this simulation are when each element of the weighting matrices, based on Bryson's rule in (5), is chosen by trial and error as Then the state and the control input weighting matrices are Also, the LQ tracker with the integrator can be designed for the speed tracking.The LQTI reduces the steady-state error of the tracking variables to improve performance of the control system.Designing the LQTI, the state equation ( 22) should be augmented with the tracking error terms as −20.9 0 0 6.34 Therefore, the elements of weighting matrices, (24), extend with integral terms as Thus, the weighting matrices for the LQTI are designed as Then the optimal gain matrix is The simulation Case 1 represents a step response of the tracking variables and compares tracking performance between the LQT and LQTI methods.Figures 11 and 12 show the simulation results based on the LQT and LQTI methods.Figure 11 shows comparison results between controllers for the states histories of the UAV.The LQT has the steady-state errors to the tracking commad, but the LQTI can reduce the steady-state errors as shown in Figure 11.In addition, control inputs of both controllers are shown in Figure 12. 4.2.Case 2: Waypoint Navigation.The waypoint navigation is simulated over the entire flight conditions in a threedimensional space.The control system consists of the proportional-integral-derivative (PID) and LQTI controllers as shown in Figure 13.The proposed LQTI controller is applied for attitude control, and the PID controller is used for the trajectory tracking for an outer loop.

International Journal of Aerospace Engineering
The second-order command filter is applied for each desired position to smooth tracking performance as follows: where   and  indicate the natural frequency and the damping ratio, respectively.For designing this filter, each parameter is chosen as   = 2 and  = 1.Commands consisted of the three-dimensional position information of four points.The initial position of the UAV is (0, 0, 0), and it moves to two points: (10, 0, −2.5) and (10, 10, −5).Then the vehicle reaches the final point (0, 0, −10).In addition, the simulation and visualization environments are built as shown in Figure 14.Each point indicates the waypoints, and blue line represents the flight path of the CNU ducted-fan UAV.Moreover, wind disturbance is considered for this simulation to verify the performance of the proposed controller.The Dryden wind turbulence model is used for the disturbance as shown in Figure 15.

Conclusions
In this research, the control system was designed for the ducted-fan type UAV because this system is inherently unstable and dynamically coupled.The tracking controller based on the optimal control theory was applied considering entire flight modes for the CNU ducted-fan UAV under unknown disturbance.In order to construct the precise dynamic modeling, the basic dynamics were modified by using the wind tunnel test data, and the modified model was verified to compare the wind test and numerical modeling results.International Journal of Aerospace Engineering Also, the trim analysis was carried out for the linearization of the dynamic equations to design of the optimal tracker.Then, the LQ tracker was derived to extend LQR design procedure based on the linearized model.However, the basic LQ tracker cannot eliminate the steady-state error.In order to cope with the steady-state error, the integral element was augmented based on the LQ tracker structure.The designed controllers were verified via numerical simulations which were sorted into two cases.The longitudinal simulation was performed in Case 1 to compare between the LQT and LQTI controllers.This simulation result showed that the LQTI controller reduced the steady-state error.Then, the LQTI controller has better tracking performance than the LQT controller.In addition, the three-dimensional waypoint navigation was simulated under the entire flight envelope which includes hover, transition, and cruise flight modes in Case 2. Additionally, the robustness against wind disturbances is validated through numerical simulations as well.The result of the second simulation shows a feasibility of the LQTI controller to be used for the operation of the ducted-fan UAV.

International Journal of Aerospace Engineering
The proposed controller will be applied for an experimental system.In addition, a numerical solution will be applied to solve the Riccati equation to implement the LQTI for flight tests.Also, an observer will be designed to improve the control performance.Then, the procedures and results including modeling, trim/linearization analysis, and optimal control design in this study will be devoted to further theoretical study for ducted-fan UAVs and putting them to practical use.

Figure 2 :
Figure 2: A configuration of the CNU ducted-fan UAV.

Figure 3 :Figure 4 :
Figure 3: A coordinate system of the CNU ducted-fan UAV.
d v e lo c it y ( m / s ) 0 10 20 30 40 50 60 70 80 90 A n gl e o f at ta ck (d eg .)

Figure 9 :
Figure 9: Structure of the LQ tracker.

Figure 10 :
Figure 10: Structure of the LQ tracker with the integrator.

Figure 14 :
Figure 14: Visualization environment of the simulation.

Figures 16 ,
19, and 22 show -- axis position histories of each flight condition.The vehicle approaches each waypoint accurately.Figures 17, 20, and 23 show time histories of the velocity.Control inputs of this simulation are shown in Figures 18, 21, and 24, respectively.In conclusion, the simulation results show that the proposed controller (LQTI) has good tracking performance and proper control consumption even if wind disturbance exists.

Table 1 :
Control surface sign conventions.