Design of a Control System for an Organic Flight Array Based on a Neural Network Controller

This paper presents a flight control system for an organic flight array (OFA) with a new configuration consisting of multimodularized ducted-fan unmanned aerial vehicles. The OFA has a distinguished advantage of assembling or separating with respect to its missions or operational conditions because of its reconfigurable structure. Therefore, designing a controller that can be flexibly applied in each situation is necessary. First, a dynamic modeling of the OFA based on a single ducted-fan vehicle is performed. Second, the inner loop for attitude control is designed through dynamic model inversion and a PD controller. However, an adaptive control component is needed to flexibly cope with the uncertainty because the operating environment of the OFA is varied, and uncertainty exists depending on the number of modules to be assembled and disturbances. In addition, the performance of the neural network adaptive controller is verified through a numerical simulation according to two scenarios.


Introduction
Unmanned aerial vehicles (UAVs) with many types, sizes, and ways of flight have been used in various fields during the past decades.Interest in vertical take-off and landing (VTOL) vehicles, in particular, greatly increased because having a space for a runway is not necessary, and hovering is easier than in fixed-wing UAVs.These features have recently been used for military purposes, such as surveillance of urban warfare and near-field reconnaissance.In addition, performing missions (e.g., communication relay, wide-area reconnaissance, and radar jamming) is possible because the field of application is diversified and because of the growth of technology.The VTOL UAVs are also utilized in the civil field for image photographing and in the aviation transport industry because of their advantages.Moreover, the VTOL UAVs have also been actively utilized for hobby and leisure and are classified into multirotor [1], coaxial [2], Coanda [3], and ducted-fan type [4].
Although various VTOL UAVs are capable of hovering, their operation is restricted in the environment, where gusts or strong winds are constantly blown.Moreover, a disadvantage of having the thrust-to-weight ratio lower than that of a fixed-wing also exists.Therefore, many studies were conducted to overcome the disadvantages of the VTOL UAVs.Accordingly, studies have also been recently conducted to overcome the instability of the vehicle by using a controller that can more robustly cope with gusts and disturbances [5,6].Several studies were also performed to complement the disadvantages and overcome the payload limitation through the cooperation of several VTOL UAVs [7].However, there is a limit in overcoming the disadvantages through the existing flight module in the situation when the mission becomes more diverse.Hence, a study is proposed to overcome the disadvantages by constructing a vehicle through physical assembling.In this way, the vehicle can have a higher robustness than when it is operated as a single vehicle.The vehicle can also have an advantage of increasing the payload according to the number of assembled vehicles.Moreover, organically coping with the mission becomes possible by changing the assembled shape in an environment, where reconnaissance is difficult in the field, such as indoor or in a narrow road.One of these studies is on the distributed flight array (DFA) conducted by the ETH Zurich of Switzerland.The vehicle used consisted of autonomous hexagonal single-rotor modules that are able to drive, dock with its peers, and fly in a coordinated fashion.The DFA can generate the thrust but cannot fly with a single module because it cannot remove the antitorque.Hence, the single-rotor modules must be combined to fly with other modules [8,9].The International Islamic University of Malaysia also conducted a study on autonomous flight vehicles with distributed flight array concepts.This module had triangular frames that can be combined with each module.In flight mode, the control gains are changed based on the in-flight data [10].In this study, a similar concept with the DFA was used to overcome various disadvantages by assembling a ducted-fan vehicle.The operational concept that can be assembled and separated freely during flight was defined as shown in Figure 1 to adapt to the diversity of the mission [11].However, the control performance greatly deteriorated because of the model uncertainty and the nonlinear disturbance when the assembling and separation modes were performed in flight.So, the model uncertainty that can occur in accordance with the operational concept of the organic flight array composed of ducted-fan vehicles is defined as the model inversion error of the process of DMI, and it is significant to verify whether such uncertainty is mitigated through the radial basis function neural network controller which enables control.This study proposed an adaptive control method to cope with the disadvantages and limitations of other studies on flight array by using the radial basis function neural network that can consider the nonlinear characteristics and model uncertainties.The dynamic model of the OFA in this process was defined based on the single ducted-fan vehicle [4].A dynamic model of the OFA was then transformed into the affine system form to apply the dynamic model inversion technique [12].Subsequently, the attitude control system was designed through a PD controller based on the affine system [13].However, the model error was present between the model simulated by the model inversion process and the actual model.In addition, the adaptive control system that can compensate for the model error by applying the neural network control technique was also designed and added to the existing controller [14].A radial basis function neural network with a simple structure that can guarantee the performance and minimize the amount of computation was applied because generating the adaptive control input in real time was necessary.The activation function of the hidden layer in this process was constructed by using a Gaussian function [15].This paper is structured as follows: Section 2 describes the detailed modeling of a ducted-fan vehicle adopted in the OFA.The OFA dynamic equation of the affine system was then derived.Section 3 describes the design of the controller through a dynamic model inversion and a PD controller, which is the basic controller for attitude control.The adaptive controller of the neural network to cope with the uncertainty was also derived.Section 4 presents the numerical simulation results for each scenario.Section 5 summarizes the research conclusions.

Dynamic Model
2.1.Ducted-Fan Model Dynamics.Figure 2 shows the simulation model defined based on the ducted-fan vehicle.The x-axis is defined as the direction similar to that of the aileron control surface, whereas the y-axis is defined as the direction similar to that of the elevator control surface.The z-axis is defined as the downward direction in which the yaw angle of the clockwise direction is set to a plus sign.The simulation model is basically composed of the duct, fuselage, rotor, stator, and control surfaces.The rotor that generates the thrust and the stator that counteracts the antitorque are placed inside the duct.Thus, the yaw axis stability is secured using the stator.Each control surface located directly under the duct structure is designed in a cross shape around the z-axis.This design creates a moment for the control of the roll, pitch, and yaw Euler angles.Defining the translational motion direction in advance is necessary because the ducted-fan vehicle has a symmetrical structure with respect to the z-axis.The coordinate axes are defined herein in accordance with the direction of the control surface.Table 1 shows the control surface direction and effect.
The acceleration and angular acceleration can generally be defined based on the coordinate system of Figure 2 as follows.In particular, the coupling components J xy , J yx , J xz , J zx ,   International Journal of Aerospace Engineering J yz , and J zy of the moment of inertia are not considered in this research because of the symmetry characteristic [16].
where u, v, and w are the linear velocities and p, q, and r are the angular velocities in the body frame.In (1), F x , F y , and F z are the total forces in the x, y, and z directions, respectively.The moment vectors M x , M y , and M z are a combination of the moments produced by each of the control surfaces.These forces and moments are generated by the duct, fuselage, rotor, stator, and control surfaces in the respective directions as follows: The moment variables of (2) must be considered by the entire center of gravity if two or more ducted-fan vehicles are assembled into the OFA.In this study, modeling was performed considering the moment arm that changes as the OFA shape changes.Each component of ( 2) is defined accordingly [4].2).
(2) Fuselage: the fuselage generates a drag force proportional to the area along each axis.The force and the moment by the fuselage are defined as follows: Here, S top and S side are the cross-sectional areas along the direction of the fuselage, and ρ ∞ is the density.The drag coefficients along each axis are defined as C D .The distance between the aerodynamic center and the center of gravity is defined as l fuse .
(3) Duct: the duct has a circular symmetrical shape around the z-axis.Therefore, duct modeling is performed by integrating the lift and the drag forces generated from the unit duct from 0 to 360 °.The flow velocity around the duct surface is defined as the function of θ duct as follows: where V r is the flow velocity of the radial direction and V z is the flow velocity in the direction of the rotation axis.The rotation angle about the z-axis, which rotates along the duct plane, is defined as θ duct .The dynamic pressure and angle of attack can be written as follows using the flow velocity defined in (6): The force and the drag per unit angle generated by the airfoil using ( 7) are as follows: where C L,duct and C D,duct represent the lift and drag coefficients for the duct airfoil, respectively.These parameters are derived from the empirical formulas.
The total lift and drag can be defined by integrating the lift and the drag per unit angle from 0 to 2π as follows: The lip moment induced by the lift imbalance phenomenon and the momentum drag generated by the reaction of the duct during the translational motion are included in the duct component.
Each component can be expressed as follows: where m is the mass flow through the rotor and C m,duct is the duct moment coefficient.The moments and forces generated by the duct considering ( 9) and ( 10) are as follows: The l duct of (11) is the distance between the aerodynamic center of the duct having an airfoil shape and the center of the gravity point.
(4) Control surfaces: the control surfaces, which change the attitude of the vehicle by adjusting the direction of the wake generated by the rotor, are located directly below the duct.They perform the roles of an aileron, elevator, and rudder.The forces and moments generated by the control surfaces are defined as follows: where δ r , S r , l r , C L , and Q e represent the deflection angle, area, distance between the aerodynamic center and the center of the gravity point, lift coefficient of the control surface, and dynamic pressure, respectively.
(5) Gravity: the gravity generates a force based on the body-fixed coordinate system whenever the attitude of the vehicle changes.The forces generated by the roll and pitch motion of the vehicle are defined as follows: Gyroscopic moment: the gyroscopic moment is defined as a moment that is incidentally induced to the vehicle by the rotating rotor.Each component can be expressed as follows: The gyroscopic moment is a value proportional to the angular velocity and the RPM of the rotor.In (14), N b , J b , and ω r denote the number of blades, moment of inertia, and angular velocity of the rotor.

Organic Flight Array Model Dynamics.
The OFA generally means a combined vehicle of two or more single ducted-fan modules.In this research, each ducted-fan vehicle was assembled to have the same control surface direction for the simplification of the dynamic modeling.In addition, all modules were located on the same plane, so as not to consider the z-axis moment arm in the assembling mode.Figure 3 shows the assembling concept of the OFA.The dynamic model in the assembling mode must simultaneously consider the forces and moments generated by each module.The force and moment defined in (1) are replaced by the sum of each component as follows: 4 International Journal of Aerospace Engineering where l denotes the moment arm from each module to the center of the gravity point and i is the module number of each vehicle.l z i is defined as zero because we assumed that the force generated by each module acts at the same height.
Equation (1) shows that designing a controller by directly using the nonlinear dynamic equation is not generally easy.Moreover, the OFA is characterized by a high nonlinearity depending on the operation mode.Hence, the nonlinear dynamic equation is transformed into an affine system to apply the dynamic model inversion method that eliminates the nonlinearity.The affine system is a form that makes it easy to control the state variables according to the control input.The system consists of the state matrix, control matrix, and input and is presented as follows: where the variable x means the translational velocities u, v, and w and the rotational angular velocities p, q, and r.Here, if two or more modules are assembled into the OFA, the variable x is defined as the translational velocity and angular velocity of the combined whole modules.The state matrix F is a component generated by the fuselage, duct, gyroscopic moment, and gravity.The state matrix F is defined as follows: where the matrix F has a matrix size of F x ∈ R 6×1 regardless of the number of modules that make up the OFA.The control matrix induced by the control surfaces and the RPM of the rotor is expressed as follows:

J zz 18
The control matrix G is defined by the area of the control surface of each module, induced velocity, and vertical velocity of the vehicle.The size of the matrix G varies depending on the number of combined vehicles, unlike the F matrix.Hence, the matrix size of G can be defined as G x ∈ R 6×4N .

Dynamic Model Inversion. The model dynamic inversion technique can linearly convert nonlinear dynamic equations
to cancel the nonlinearities.Applying a linear controller to such nonlinear engineering models is not easy because most engineering models have nonlinearities.The dynamic equation can be expressed as follows if the state variables of the dynamic model are measurable [12]: where u denotes the control input of the dynamic system and ν is the pseudo control input.If f x, x, u is invertible and all states are measurable, the inverse conversion of the dynamic system in accordance with the control input is presented as follows: The nonlinearity of the system can be canceled, and the system can be controlled in a stable state if the pseudo control input can be appropriately designed.Furthermore, the system can be controlled using a linear controller if the nonlinearity is removed by applying the model inversion technique to a nonlinear system.However, perfectly implementing the same model as that of the actual aircraft is impossible because the aircraft model can be changed due to the mission environment or arbitrary influence even in actual flight situations.Therefore, a complete model cannot be implemented, and an error occurs when applying the DMI technique.This process is called the model inversion error.The dynamic model considering the model error can be expressed as follows: where Δ x, x, ν is the model error.Therefore, considering an adaptive control input that can compensate for the model error is necessary when designing a pseudo input.The pseudo input including the PD input, command, and adaptive input is defined herein as follows: where the vector x is composed of the roll, pitch, and yaw Euler angles.Each axis of the Euler angles is considered separately for ease of designing the adaptive controller.Each ν pd,i t is determined by using the PD control theory as follows: As a result, the error equations can now be defined by ( 21) and ( 23).
The objective of the adaptive control input is to design ν ad,i that can make the right side zero (i.e., ν ad,i and Δ x, x, ν ) to be the same value.Equation ( 24) can be expressed in the state space form as follows: In this case, a value can be defined as follows if it is obtained by the weight that can generate an optimal adaptive control input on d = x, x, ν domain as ω * i : The absolute difference between the estimated and actual values of the model error is given by (28) if ∈ i > 0 is defined as the boundary of the abovementioned optimal problem.
On the compact domain, it is possible to assume that ν ad that always satisfies Assumption 1 is present.
There is a fixed point ν ad of Δ at all d ∈ D .
As a result, the model error can be canceled through the adaptive input and can be defined as Δ x, x, ν = ν ad,i using the components of ( 26) and (29). 6 International Journal of Aerospace Engineering ω i t ∈ R N denotes the weight updated in real time by connecting the hidden and output layers and is defined as follows [14,17]: , when e i2 > e 0 , 0, when e i2 < e 0 , 30 The weights designed in (30) are defined through the Lyapunov stability analysis involving the adaptive control input applied only to the dead zone, where the norm of the state error vector is defined as e 0 .In (30), γ i is the learning rate or adaptation gain, and β i is the basis function of each node comprising the hidden layer.P 0 is a symmetric, positive, and definite matrix satisfying the Lyapunov equations as follows: The P 0 that satisfies (31) can be defined in the Lyapunov analysis process and include the control gain of the PD controller as follows: 3.3.Basis Function.Figure 4 shows the control system designed using a radial basis function neural network with a single hidden layer.In the process of designing a neural network, the basis function β i ′ x, x, v must be defined.The Gaussian function and the general combination of the Gaussian function were applied as the basis function in the same way as Figure 5 in this study.In the neural network, the basis function played a role of activating the variable value coming into the hidden layer.The Gaussian function has the advantage of a variable entering through the centers.The deviation can also be efficiently activated.The Gaussian functions used as basis functions are generally expressed as follows:

33
where c is the center of the Gaussian function and σ is the deviation.These values are variables that determined the degree of activation of the values input to the hidden layer.Tuning these values can change the performance of the adaptive controller.The radial basis function neural network has the feature of an input value directly entering the hidden layer without considering the weight.The input variables to the neural network in the attitude control system of the OFA were divided into roll, pitch, and yaw channels in the same manner as the PD controller.Table 3 basically shows the parameters input to the input layer.The variables input to each channel were angular velocity, Euler angle, Euler angular error, Euler angular error differential value, and each control surface deflection angle.The number of the variables input to the neural network according to each channel was 4 + N. The number of the input variables increased as the number of the assembled modules increased.

Control System Structure.
A PD controller was used, and the DMI method was applied herein as an inner loop for attitude control.A controller structure with an adaptive control input based on the neural network was additionally considered in a situation where a model error occurs.Figure 6 shows the control structure for the attitude control of the OFA.

Numerical Simulation
A numerical simulation was performed herein by applying the dynamic model inversion technique and the PD controller.The simulation result was analyzed according to the presence or absence of the NN by defining the scenario in which the uncertainty or the disturbance occurred.Each of the scenarios simulated the attitude control assuming a situation, in which an arbitrary model uncertainty is given, and simulated the path control in the situation where the strong disturbance continuously influences.Figure 7 shows the OFA model used in each scenario.

Scenario 1.
The first scenario assumed that the model uncertainty increases as the number of ducted-fan vehicles increases.It is assumed that 0 to 30% model uncertainty is generated in real time when two modules are added to the existing module.A simulation was performed to verify the control performance according to the application of the neural network.Figure 8 shows a relatively large overshoot and a slow follow-up when the neural network was not applied because the PD controller alone cannot compensate for the model error.On the contrary, each attitude response followed the command relatively quickly when the neural network was applied.However, as shown in Figures 9 and 10, the control input was excessively generated when the neural network was considered.The control allocation problem was not considered separately in this study.Hence, the  7 International Journal of Aerospace Engineering control surfaces of the three modules moved in the same angle and direction.Each control surface deflection response was illustrated in a common graph.Meanwhile, the RPM control inputs showed different values to make the thrust difference by the center of the gravity.Figure 11 shows the weight of each channel when the neural network was applied.The weight change amount becomes large at the time of the command change, such that a deficient control input is generated.

Scenario 2.
The second scenario presented a situation where the OFA consisting of three modules performed path control to combine with the other arrays in a strong disturbance environment.The attitude controller of the inner loop was generally classified according to whether the neural network was applied.
The outer loop for the path control adopted the PID controller.The disturbance was also assumed to be a uniform wind of 1.5 m/s along the x-axis of the body-fixed coordinate.As a result, the path control was not possible when the NN was not considered, as shown in Figure 12.
However, when the neural network controller is applied, it is observed that the position command is slightly slower but follows normally.Figure 13 shows the changes in the attitude of the UAV when the path control is normally performed in Figure 12.Through this result, it is confirmed that the attitude control system applying the neural network guarantees stability of the UAV in a strong disturbance environment.Figures 14 and 15 represent the control inputs when the neural network controller is applied.The oscillation of the elevator control surface in Figure 15 is caused to control the pitch angle in order to secure stability of the UAV and to follow the x-axis position command under the strong disturbance.This oscillation is caused by the changes in the cross-sectional force component, induced velocity, and z-axis translational velocity depending on the RPM, as shown in (18).This implies that the simulation results presented in this paper are under marginally stable conditions in which the ducted-fan UAV can operate.
Since harsh disturbance is injected from the beginning of the simulation, such oscillation may be observed until the weights between the neural network layers are adjusted with sufficient samples of the system inputs/outputs.Furthermore, we considered the HS-5070MH servo motor as the control surface actuator that can deflect 60 deg for 0.12 sec at no load condition.Even if the full actuator performance cannot be guaranteed due to the aerodynamic load to the servo during the flight, there is still a sufficient margin to accommodate the maximum angular velocity (200 deg/s) observed in the simulation results.Figure 16 presents the weight update value of the neural network.The weight update value was confirmed to converge to a constant value after the position control is normally performed.

Conclusion
This study presented a concept of the organic flight array that can simultaneously perform various missions with a single ducted-fan vehicle through the assembling, separation, and cooperation modes.First, this study proposed a dynamic model for a single ducted-fan vehicle and defined the OFA dynamic model of the affine form, which is specified by the number of assembling modules.A control system was designed based on this through a dynamic model inversion and a PD controller.The adaptive controller based on the radial basis function neural network was also designed for the control system that can avoid model uncertainty or disturbance.Subsequently, the integrated simulation environment was constructed to verify the controller performance.The simulation results confirmed that the control performance was improved when the adaptive controller using the radial basis function neural network was considered in the case of model uncertainty or disturbance.Consequently,        10 International Journal of Aerospace Engineering the control stability can be guaranteed when the neural network is used as an adaptive controller in a situation where the model uncertainty is large or the disturbance is strong.

Figure 1 :
Figure 1: Operational concept of the OFA.

Figure 3 :
Figure 3: Arrangement of the control surfaces in the assembling mode.

2 .
Adaptive Control System of the Neural Network.The adaptive control input was designed to compensate for the model error, which changes in real time.A model error can generally be implemented by the neural network with a finite number of basis functions as follows:

Figure 4 :
Figure 4: Schematic of the radial basis function neural network.

Figure 5 :
Figure 5: Gaussian function used as basis.

Figure 6 :
Figure 6: Controller structure of the adaptive neural network.

Figure 7 :
Figure 7: Simulation model consisting of three single modules.

Table 1 :
Control surface sign conventions.

Table 2 :
Coefficients of the rotor component by DFDC.

Table 3 :
Input variables of the neural network.