Position Control of a Pneumatic Muscle Actuator Using RBF Neural Network Tuned PID Controller

Pneumatic Muscle Actuator (PMA) has a broad application prospect in soft robotics. However, PMA has highly nonlinear and hysteretic properties among force, displacement, and pressure, which lead to difficulty in accurate position control. A phenomenological model is developed to portray the hysteretic behavior of PMA.This phenomenological model consists of linear component and hysteretic component force.The latter component is described byDuhemmodel. An experimental apparatus is built up and sets of experimental data are acquired. Based on the experimental data, parameters of the model are identified. Validation of the model is performed.Then a novel cascade position PID controller is devised for a 1-DOFmanipulator actuated by PMA.The outer loop of the controller is to cope with position control whilst the inner loop deals with pressure dynamics within PMA. To enhance the adaptability of the PID algorithm to the high nonlinearities of the manipulator, PID parameters are tuned online using RBF Neural Network. Experiments are performed and comparison between position response of RBF Neural Network based PID controller and that of classic PID controller demonstrates the effectiveness of the novel adaptive controller on the manipulator.


Introduction
Pneumatic Muscle Actuator (PMA) has been widely applied for soft robotics, flexible surgical tools, and prosthetic applications because of its similarity in compliance with natural muscle [1][2][3][4][5][6][7].PMA is not complicated in construction.It mainly includes two components: a flexible inner cylindrical containment layer and an outer cylindrical braided woven layer with end caps to seal the cylinders.The braided layer is made of nylon threads of high stiffness.These threads are placed in double helix form in outer surface or mixed with inner bladder.The inner tube, made of latex material or silicone, exhibits the capacity of large deformation.When the inner rubber bladder is pressurized, it produces elastic deformation and imposes elastic forces on the outer braided mesh; due to strong stiffness of nylon lines, the fiber layer drives latex rubber to inflate in radial direction and shorten in axial direction [8][9][10][11][12].
1.1.Review of Modeling PMA.Despite attractive advantages, PMA has high nonlinear properties and hysteretic characteristics which are produced by air complexity and nonlinearity of its own geometric construction.To describe its nonlinear properties, many researchers have proposed various static and/or dynamic mathematical models [13][14][15][16][17][18][19][20].Schulte proposed the earliest static model to describe the relationship among output force of PMA, supplied pressure, and contractile displacement [19].Subsequently, Chou developed his static model based on principle of virtual work [13].In his model, finite thickness of the containment layers and strandon-strand friction were considered.Tsagarakis and Caldwell used force balancing equations to study the static properties of PMA and similar model with Chou was derived [21].Stretch of the braid fiber during contracting process was considered by researchers [22].The elasticity of the bladder has been considered to be an important factor influencing PMA [23,24].Friction within PMA causes hysteresis in increasing and decreasing contraction and was considered in some theoretical models [13,25].Another approach is modeling from phenomenological behaviors of PMA.Minh et al. [26] developed an attractive static model based on Maxwell-slip model; Wickramatunge and Leephakpreeda [27] regarded the PMA as a mechanical spring with variable stiffness and initial length at different pressures within PMA.
In this paper a new phenomenological model is proposed to portray the hysteresis and nonlinearity among actuating force, contractile displacement, and pressurized pressure using Duhem model.Compared with Maxwell-slip model in [26] and polynomial equation in [27], Duhem model is easier to be calculated and programmed in C++ language, which is important in real-time control.

Review of Controlling PMA.
Owing to the high nonlinearities and hysteresis inside PMA, it is not easy to implement position control accurately.Many attempts have been made to improve the control algorithm for PMA.Caldwell et al. proposed adaptive pole-placement scheme to address the nonlinearity of PMA [28].Repperger et al. used gain scheduling approach [29], and fuzzy PD+I controller by Chan et al. in [30].Carbonell et al. [31] developed a robust backstepping controller on the basis of a three-element actuator model.Sliding model [32,33], saturated adaptive robust control [34], and predictive control [35] have been developed for position control.In [36] adaptive fuzzy sliding-mode control was applied to muscle position control and inversion based control concept was used in [37].
Although kinds of advanced controlling techniques have been developed, most adopted control algorithm in industry is still PID controller.To realize position control of PMA in industrial production, improvements of classic PID controller must be made.To better handle the nonlinearity and hysteresis in PMA, a cascade PID based controller is devised.Inner loop of the novel controller is to manipulate the pressure dynamics and the outer loop is to handle position control problem.To enhance the adaptiveness of the controller, RBF Neural Network is used to online tune the parameters of PID controller.
This paper is organized as follows.Section 2 develops the phenomenological model for PMA, Section 3 designs the cascade position controller using RBF Neural Network, and Section 4 designs the 1-DOF manipulator actuated by PMA and gives the experimental validation of the proposed controller.

Introduction of Duhem Model.
Duhem model, which was originally developed to describe magnetic hysteresis, has proven suitable for describing piezoelectric hysteresis in [38].In this research, Duhem model will be adopted to describe the hysteretic component force of contractile force of PMA.As a first-order differential equation, it has a compact form in where  represents the hysteretic component force in this paper,  is the contractile displacement of PMA, and parameters , , and  characterize the hysteretic loop's magnitude and shape.In order to better describe the hysteretic behavior of PMA, the total contractile force is divided into linear component and hysteretic component in When ( 2) is employed to portray the hysteretic behavior of PMA, five parameters ,  0 , , , and  need to be identified.Firstly, parameters  and  0 in linear component are optimized by least squares method; then parameters , , and  which control the shape and magnitude of hysteretic loop are identified.

Design the Setup for Modeling.
Experimental apparatus for modeling PMA is shown in Figure 1.A PMA (FESTO Corporation, type of DMSP-20-120RMCM) is characterized in this experiment.This setup consists of three sensors: force sensor, displacement sensor, and pressure sensor.Three types of information about force, displacement, and pressure, are sampled by data acquisition card.Proportional regulator (SMC, type of ITV1050-212N) and manual regulator (SMC, type of AR20-02) are used to tune the amount of air flowed to pneumatic cylinder and PMA, respectively.

Parameter Identification and Validation of the Phenomenological Model.
In parameter identification procedure, predetermined pressure is applied to the muscle first and then triangular waves of pressure with frequency 0.1 Hz but different magnitudes are applied to pneumatic cylinder.By tuning pressure within the PMA, sets of experimental forces and displacements are sampled, one of which is plotted in Figure 2. Pressure of 0.3102 MPa is applied to PMA.By applying least square curve method, the hysteresis is divided into linear component and hysteretic component, respectively  data, parameters of the proposed model are grouped and fitted into five quadratic polynomial equations with respect to pressure within PMA (Table 1).
To verify the proposed model, validation experiments are conducted.PMA is pressurized to 0.3984 MPa.Pressure applied to pneumatic cylinder is shown in Figure 3(a) while the experimental and simulated displacement-force hysteretic curves are plotted in Figure 3

Cascade Position Controller for PMA
3.1.Dynamic RBF Neural Network.As a feed-forward neural network, RBF Neural Network (RBFNN) consists of three layers (Figure 5).Considering the actual situation in this paper, these three layers are supposed to have three, four, and one nodes, respectively.Usually, the nonlinear transfer function in hidden node is chosen as Gaussian transfer function.Values of hidden nodes are derived from (4) and the output of the RBFNN is calculated using (5) as follows: where  = [ 1 ,  2 ,  3 ]  is the input vector of RBFNN,   ( = 1, 2, 3, 4) the base width of the th node in hidden layer,   = [ 1 ,  2 ,  3 ]  the center vector of th node in hidden layer, and   ( = 1, 2, 3, 4) the connection weight of the th node to the output layer.
Adopting the gradient descent algorithm as the learning algorithm, the instantaneous cost function is defined as where  out () is the desired output.If we define  as the learning rate and  the inertia factor, then weights of RBFNN, node base widths, and node vector are updated as follows:

Adaptive PID Controller Based on Dynamic RBFNN.
If parameters of digital incremental PID controller are tuned automatically according to actual situation, it could improve the performance of the plant.In this paper, RBFNN is adopted in tuning PID parameters and the principle is shown in Figure 6.The input vector of RBFNN is [(),  out (),  out ( − 1)]  .The criteria used in tuning PID parameters are listed as follows:

Inner Loop for Pressure Regulation.
Modeling proportional pressure regulator is complicated and usually consists of a chamber continuity equation, an orifice flow equation, and a force balance equation of the spool, all of which are listed as follows: where  is the ratio of specific heat and  = 1.4 for air,  is the universal gas constant and  = 287 J/kgK,   is the volume of the sealed chamber,   is the flow coefficient,   is the effective opening area of the orifice that changes with spool position,  and   are the upstream and downstream pressure, respectively,  is the mass of the spool,  0 is the initial position and  V is current displacement of the spool, and   is the effective cross-sectional area of the bottom of spool.The detailed process is in [39].The pressure dynamics within PMA is obtained with the assumption that both charging and discharging process are in isothermal and adiabatic states.Based on the polytropic gas law, the relationship among air mass , muscle volume , and the inertial pressure  is expressed as follows: Performing differential action of above equation and combining the law  =  for ideal gas, one can get the building up pressure process inside PMA The muscle volume varies along with contracting position and its accurate value is difficult to acquire.Assuming the shape of PMA to be cylindrical in order to simplify the complex problem, approximate volume is calculated as follows: where  is the length of PMA in contractile process,  0 the length of single fiber thread surrounding around bladder, and  the number of times a thread encircles the PMA circumference from one end cap to the another end cap.
From above dynamic models, we find that the pressure building up process depends not only on nonlinear flow function, but also on muscle volume variation and air temperature.In order to regulate the pressure within PMA, these high nonlinear dependencies should be handled properly.However, geometric parameters of regulator and PMA are difficult to measure.In this paper, nonparametric RBFNN-PID controller is adopted to handle the high nonlinear pressure building up process.The schematic is shown in Figure 7.The inputs of the RBFNN for inner loop are [V(),  out (),  out ( − 1)]  , where V() is the input voltage of the regulator and  out is the sampled pressure value within PMA.

Outer Loop for Position Control.
To realize accurately position tracking, PMA model (2) and manipulator dynamics ( 16) are incorporated to devise the outer loop for position control.The scheme is shown in Figure 8.The outer loop also uses RBFNN tuned PID algorithm to handle model uncertainties and high nonlinear properties inside PMA and the manipulator.The output of the outer loop is the desired torque  ref for manipulator, which is used to calculate the desired pressure for inner loop control.The desired velocity and acceleration of PMA are obtained from first-order differential and second-order differential of desired position and then used in calculating desired pressure.The PID parameters   ,   , and   are updated using RBFNN algorithm.

1-DOF Manipulator Actuated by PMA.
The manipulator designed in our lab is shown in Figure 9.This 1-DOF setup is driven by a PMA and its reset motion to equilibrium position is realized by the spring's restoring force.This manipulator works in a horizontal plane.PMA (DMSP-20-120RMCM, FESTO Corporation) with a maximum contractile ratio of 25% at 0.6 MPa pressure is used in this setup.The initial parameters of this PMA are inner diameter of 20 mm and length of 120 mm.The charging/discharging process for PMA is controlled by a proportional regulator (ITV1050-212N, SMC corporation).Displacement of PMA is sampled by a displacement sensor.Gauge pressure sensor (type of PSE510-R06, SMC) is to sample real-time pressure inside PMA.Data acquisition card (DAQ) is used to communicate with host computer and send command to proportional regulator.Obviously, the only controllable variable is the command voltage to pressure regulator.Load dynamics is built up as follows: where  [N⋅cm] is the resultant torque,  is moment of inertia, and  [N] and  spring [N] are PMA force and spring force, respectively. [m] is the radius of rotary base and  [rad] is the angular displacement.

Validation of RBFNN PID Algorithm for Pressure Loop.
Figure 10 shows the response of convention PID controller under the input command of square wave with frequency 0.1 Hz and magnitude 0.5 MPa.Obviously, square wave command essentially provides step inputs in both directions repeatedly.Response of RBFNN PID controller under the identical input command is also plotted in Figure 10.Comparison between the two response curves demonstrates that    are equal to the corresponding values of conventional PID controller, which are tuned by trials and errors.Obviously, parameters   ,   , and   vary around their initial values, respectively.

Validation of RBFNN PID Algorithm for Position Loop.
Experiments are performed to validate the proposed cascade controller.In this paper, square wave and sinusoidal wave excitations are applied to the manipulator.To show the capacity of RBFNN PID algorithm, classic PID algorithm is also applied to the manipulator and response curves are plotted together.Note that the classic PID controller here means that outer position loop adopts classic PID algorithm, whilst the inner pressure loop uses RBFNN PID algorithm.RBFNN PID in this section refers to that both outer position loop and inner pressure loop adopt RBFNN PID algorithm.
Figure 13 shows the position response to square wave input of 0.1 Hz and amplitude 20 mm.To perform the validation of the proposed controller, step response of classic PID cascade position controller is also plotted in Figure 13.Comparison between two response curves indicates that RBFNN PID response has less overshoot than classic PID response.The maximum overshoot of position response from classic PID controller is about 12.5%, while the RBFNN PID experimental curves have maximum overshoot of 5% in [0, 2] (s) and about 4% in [10,12] (s).Reduction in maximum overshoot is because of adaptive tuning capacity on PID parameters.Enlarged view for A portion on the top right of Figure 13 shows details more clearly, from which the settling time for classic PID response and RBFNN PID response are 0.8 (s) and 1.5 (s), respectively.Enlarged view for B portion on the bottom right of Figure 13 shows response in descending stage in time interval [4,7] (s), from which we observe that response curve of RBFNN PID algorithm descends more rapidly than that of classic PID algorithm.The faster descending capacity is owed to the continuously PID parameter selftuning action.Steady state error of BPNNPID controller is  found to be smaller than that of classic PID algorithm.The global performance of RBFNN PID algorithm is better than that of classic PID algorithm, not only in reduction of overshoot and oscillation, but also in steady state error.Figure 14 shows the desired pressure and response of inner pressure RBFNN PID loop. Figure 15 shows the varying process of PID parameters   ,   , and   along with tracking process.The values of   ,   , and   for outer classic PID algorithm are equal to   (0),   (0), and   (0) of outer RBFNN PID controller whilst   ,   , and   for inner pressure classic PID algorithm are equal to   (0),   (0), and   (0) of inner RBFNN PID controller.From Figure 15 we find that parameters of RBFNN PID controller vary around their initial values, respectively.
Another experimental curve set is plotted in Figure 16.A square wave excitation with frequency 0.1 Hz and amplitude 15 mm is applied to the manipulator.Observing the response curve of classic PID algorithm, we find maximum overshoot at the rising stage [0, 2] (s) and [10,12] (s) is about 20% and large oscillation occurs at the beginning of descending stage.Maximum overshoot in curves of RBFNN PID controller is obviously less than that of classic PID controller, and small

Conclusion
The paper focuses on the accurate position tracking problem of PMA.To depict the nonlinear behavior of PMA, a phenomenological model is developed.By dividing the contractile force into linear and hysteretic component, corresponding parameters are identified on the basis of experimental data.Based on the phenomenological model, cascade position PID controller is proposed for a 1-DOF setup.The outer loop of the controller is to manipulate the position tracking problem, and the inner loop manipulates pressure dynamics within PMA.RBF Neural Network is introduced to the PID algorithm.Model errors caused by high nonlinearities inside PMA and external disturbances can be dealt with by automatically tuning controller parameters of outer loop.Pressure dynamics within PMA is a high nonlinear process and RBFNN tuned PID controller shows flexibility on its uncertain nonlinearities.Results show the effectiveness of the novel controller on the manipulator.Limitations of this method are that the updating algorithm of RBFNN is complicated and initial parameters of PID controller should be tuned by trials and errors.Further work is to develop more simple updating criteria by adopting other learning algorithms and develop bionic robots using PMA.
. The parameters of linear component and hysteretic component force are optimized and their values are listed as follows:

( 3 )Figure 2 :
Figure 2: The hysteretic curve of the output displacement versus force with pressure of 0.3102 MPa within PMA.
(b).Comparison between experimental and simulated curves shows good capacity of the phenomenological model in describing PMA's nonlinearity.Figure4(a) shows another sinusoidal wave pressure with frequency 0.2 Hz and magnitude 0.31 MPa applied to pneumatic cylinder when PMA is at pressure of 0.451 MPa.Corresponding experimental and simulated hysteretic loops are plotted in Figure4(b), which further indicates the ability of the model to portray the behavior of PMA.

Figure 3 :Figure 4 :
Figure 3: Time histories of the pressure applied to pneumatic cylinder and the displacement/force hysteretic curves with pressure of 0.3984 MPa in PMA: (a) the pressure applied to pneumatic cylinder and (b) experimental and predicted displacement/force hysteretic curves.

Figure 10 :
Figure 10: Response of RBFNN PID controller and that of classic PID controller for pressure loop.

Figure 11 :
Figure 11: Pressure tracking error of classic PID controller and RBFNN PID controller.

Figure 12 :
Figure 12: Variance of parameters of RBFNN PID controller   ,   ,   under square excitation of 0.1 Hz and amplitude of 0.5 MPa.

Figure 13 :
Figure 13: Comparison between responses of the RBFNN PID cascade position controller and that of classic PID cascade controller under a square wave of 0.1 Hz with amplitude 20 mm.

Figure 14 :
Figure 14: Inner desired pressure loop and responses of RBFNN PID pressure controller under square excitation of 0.1 Hz and amplitude of 20 mm.

Figure 19 :
Figure 19: Comparison between response of the proposed cascade position controller and that of conventional cascade controller under sinusoid waves of 0.1 Hz with amplitude 15 mm.

Figure 20 :
Figure 20: Inner desired pressure loop and responses of inner pressure loop under sinusoid excitation of 0.1 Hz and amplitude of 15 mm.

Table 1 :
Polynomial equations between parameters of Duhem model and pressure within PMA.