A Driver Modeling Based on the Preview-Follower Theory and the Jerky Dynamics

Based on the preview optimal simple artificial neural network driver model (POSANN), a new driver model, considering jerky dynamics and the tracing error between the real track and the planned path, is established. In this paper, themodeling for the drivervehicle system is firstly described, and the relationship between weighting coefficients of driver model and system parameters is examined through test data. Secondly, the corresponding road test results are presented in order to verify the vehicle model and obtain the information on drive model and vehicle parameters. Finally, the simulations are carried out via CarSim. Simulation results indicate that the jerky dynamics need to be considered and the proposed new driver model can achieve a better pathfollowing performance compared with the POSANN driver model.


Introduction
Although the chassis control systems of a vehicle can improve vehicle dynamics performances, enhance active safety, and reduce driver load, they bring more challenges for the evaluation of vehicle performance, especially for the evaluation of handling and stability in terms of subjective sense [1,2].Previous studies [3,4] reveal that the driver-vehicle-road closed-loop system works effectively when investigating the performances of vehicle handling and stability.In order to evaluate the handling quality of a vehicle and avoid potential risk in actual tests, the study on driver modeling is essential.This research field has drawn significant attention and several typical models have been carried out by many researchers in an early time.In 1953, Kondo [5] started with driver modeling in Japan.His research is based on the 2-wheel vehicle model on a straight line, running at a constant speed with side wind disturbances.In addition, McRuer and Jex [6] extended pilot models to road driver models by considering the factors of reaction time and inertial delay and a compensation driver model was presented.However, the preview characteristics of the driver were not taken into consideration in the studies.Macadam [7] established a driver model by using optimal preview closed-loop control in 1980.Moreover, the Preview-Follower theory [8] was proposed for the purpose of modeling the driver's path-following behaviors.The driver's behaviors were assumed based on the path-following theory in which the driver's operation always aims at minimizing the errors between the desired and actual vehicle trajectory [9].With the development of intelligence technology, several artificial neural network driver models were proposed in order to accurately imitate human driving behaviors.For instance, Fujioka et al. [10] presented a NN driver model, in which the steering angle was mapped as a function of lateral deviation and heading angle.The model was trained by a human driver in a simulator environment.Neusser et al. [11] also proposed a neurocontroller for lateral vehicle guidance.This driver model was trained with measured human-driving data.In addition, Macadam and Johnson [12] constructed a two-layer neural network to represent driver steering behaviors.Sampled data collected by the sensors of an on-road car was employed to train the network.Guo et al. [13] proposed a preview optimal artificial neural network (ANN) driver model, whose training sample was the ideal following path instead of experimental data.The global optimization of the closed-loop system was carried out in the training process of the network through the Genetic Algorithm.Further research showed that the weight factors of this artificial neural network could be calculated analytically through the Error Elimination Algorithm [14].For the sake of simulating driver behaviors under some severe or critical scenarios, Edelmann et al. [15] presented a driver model for higher lateral accelerations.The driver model was able to perform a good tracking behavior even at higher lateral accelerations.Tracking accuracy was further enhanced by incorporating information on the change of curvature and the local curvature of vehicle motion in the prediction of anticipated vehicle positions.The above-mentioned models were established based on the driver's visual sensory inputs; kinesthetic (steering torque) or vestibular (lateral acceleration, yaw rate, and slip angle) sensory was not taken into account.Recently, some driver models were proposed in [16][17][18]; those models integrate both anticipatory and compensatory visual strategies and take into account both visual perception and kinesthetic perception.Little amount of the literature gives information on how vestibular information is used.
Many driver models have been established based on many kinds of modern control theories and methods.Unlike acceleration, velocity, and displacement of vehicle, the time derivative of acceleration (TDoA) of vehicle motion, which is used to show the vestibular information, has not been extensively studied in those studies.The TDoA, also referred to in the literature as jerk, is one of the parameters considered in vibration control [19] and comfort evaluation [20,21].It is a physical property that is felt by humans when a sudden change of motion occurs.Consequently, it is closely monitored for discomfort caused to a passenger in a vehicle.As a sudden change of motion occurs, the vehicle might drop into the boundary area of stability, and the tire forces are prone to sudden change.The driver response can be made according to the steering torque feedback and the jerk dynamics on the vehicle response to lateral force change.Thus, the optimal preview control driver model cannot achieve accurate vehicle performance, especially when the tires are in the sudden change conditions.
Hence, it is essential to consider the TDoA of vehicle motion in the preview-follower driver model.Based on the preview-follower driver modeling approach and ANN, a modified driver model considering the jerky dynamics is investigated.The drivers' behaviors are described with the parameters of preview and jerk characteristic.The steering angle is obtained according to the error between the real track and the planned path and modified by the jerky dynamics under lateral force mutation.This paper is organized as follows.A modified driver model is presented in Section 1. Internal vehicle model is built and simplified in Section 2. The parameters of driver and vehicle characteristics are analyzed and calculated according to the driving conditions in Section 3, where road tests are used to verify vehicle model and calculate the closed-loop system parameters.Numerical simulations are employed to verify the proposed driver model in Section 4. Conclusions are given in Section 7.

Modeling of Driver-Vehicle System
Many driver models have been established to simulate the characteristics of driving behaviors on the desired trajectory.On the basis of the previous researches, the paper explores the driver model based on the combination of the previewfollower theory and the jerky dynamics.
2.1.Preview-Follower Theory.Preview-Follower theory describes the following properties in accordance with the future input information.The theory can be demonstrated generally with the following points.
(1) Since the drivers operation is a low frequency process under usual driving, the transfer function of the closed-loop system should always be 1 at low frequency range.That is, () ⋅ () ≈ 1.The theory is realized by a cascade system, which is composed of a preview and a follower.() and () denote the preview and follower transfer functions, respectively.
(2) Figure 1 shows the diagram of the preview-follower's structure, where  denotes the vehicle's actual lateral position and  and   denote the vehicle lateral position on the absolute and vehicle coordinate system, respectively [8].

Preview Optimal Simple Artificial Neural Network Driver
Model.Generally, the behaviors of a qualified and excellent driver fit with the Preview-Follower theory.According to this knowledge, the preview optimal simple artificial neural network (POSANN) driver model is built in Figure 2.
In the preview module (), the driver can acquire the effective road information   from target course  through preview process, whose transfer function is     , in which   indicates the driver preview time for path following.The input  represents the function of the lateral displacement of the target course, and the output   indicates the lateral displacement of the target course at look-ahead point.
In the follower module (), the driver uses the motion information of the vehicle to decide on the optimal steering wheel angle .However, since there are response delays of both human and vehicle, the real steering wheel angle of vehicle should be  sw . 1 ∼  4 are the ANN weight coefficients of   , lateral displacement , lateral speed ẏ , and lateral acceleration ÿ , respectively.Here, human factors are taken into account, which are expressed by the reaction delay of the driver with the transfer function  −   .In this transfer function,   is the lag of the driver's neural reaction system.1/(1 +  ℎ ) reflects the inertial delay of the steering system.

A Modified ANN Driver Model with Jerky Dynamics.
An unequivocal definition of the jerk as "the derivative of acceleration with respect to time" was given by Melchior who justifies the use of the term by referring to the physiological sensation experienced by large changes in acceleration [22].
Jerk has been used by many researchers to quantify aggressive driving behavior [23].Based on Newton's second law both sides of (1) with respect to time are differentiated; it can be seen that Thus, if the net external force is not constant, a system of constant mass will move with a jerk.That jerk is directly proportional to the time rate of change of the force and inversely proportional to the mass.Hence, the driver's sense of discomfort may rise rapidly whenever there is the unpredictable lateral acceleration.Considering the motion parallel to the -axis, let ,   , V  , and  be the -components of the jerk, acceleration, velocity, and position, respectively.According to the expression, Equation ( 3) was rewritten, letting  1 =  0 (the acceleration at  = 0, so  1 = 0) and  2 =   (the acceleration at a time , so  2 = ).The average jerk equals the instantaneous jerk when the jerk is constant.So, (3) becomes so that The similarities between ( 5) and ( 6) are obvious Consider the method(s) it uses to obtain It can use the same methods (integration, area under a curve, or whatever) to derive It can be seen that it can move from a constant acceleration relationship to a constant jerk equation by replacing  by V  , V  by   , and   by .With calculus and V  = /, it is easy to obtain For the lateral motion of the vehicle, ( 9) was rewritten, letting  = ( + ) (the new position of vehicle,  is a period of look-ahead time),  0 = () (the current lateral position of vehicle), V  =   () (the current lateral speed of vehicle),   =   () (the current lateral acceleration of vehicle), and  =   () (the jerk motion of the vehicle).Equation ( 9) becomes So, it is feasible to eliminate the error of trajectory caused by the variations of driving condition through compensation control of jerk characteristic between acceleration of present moment and previous moment.Based on the previewfollower driver modeling approach and ANN, this paper establishes the preview-compensation ANN (PCANN) driver model, which is shown in Figure 3.In this figure, (), (), and () are the transfer functions of the preview, follower, and jerk character, respectively.The compensator () is introduced in order to simulate driver behaviors under lateral force disturbances.() contains compensation gain and internal model.It is noted that () will not be necessary unless there is transient and unpredictable vehicle motion.The relationship between the steering wheel change and the lateral acceleration change can be expressed as follows: In Figure 3, Δ is the change of steering wheel. sw is the steering wheel angle.  is the lateral acceleration of the previous moment.  is the lateral acceleration ÿ of the present moment, which is the real response of vehicle under various operating conditions.Δ is the lateral acceleration change. is the compensation gain.The internal model is the driver's recognition and understanding of the vehicle, which can be obtained through vehicle model linearization under the steady-state condition of the previous moment.It means that internal model can produce the same outputs for the same inputs with vehicle under the steady-state condition.To be specific,   and   cancel out each other, Δ = 0 leads to Δ = 0 under the steady-state condition.In this case, it is unnecessary for the driver to compensate control since the vehicle is at lateral steady-state.When there are variations of the driving condition or the vehicle dynamic characteristics, the performances of vehicle and internal model cannot stay the same, indicating that the internal model cannot produce the same outputs for the same inputs with vehicle under lateral force disturbances.In this condition,   is different from   , Δ ̸ = 0, and Δ ̸ = 0.The driver may have a feeling of discomfort and then () will be activated to make the necessary corrections for the steering wheel.The corrected steering wheel angle  sw is defined as follows: If there are more differences between   and   that the driver can feel, more corrections of the steering wheel angle will be made.

Internal Vehicle Model
Research in the field of neuroscience has been undertaken in recent decades with the goal of understanding how humans plan and carry out physical motion tasks through the use of the central nervous system (CNS) and the neuromuscular system (NMS).Research in this area of neuroscience has increasingly pointed to the conclusion that the human CNS learns and stores multiple sets of "internal models" for use when interacting with the external world [24].The internal model paradigm postulates that the CNS generates and stores models that represent the dynamics of the physical systems of interest to the CNS, allowing the CNS to then recall and use these models to predict the behavior of the dynamic system in question.Hence, the driver can predict the vehicle motion within the preview horizon and compensate the transient vehicle motion based on internal models according to vehicle state.The driver models were used in a linear 2wheel vehicle model and rarely in the complex vehicle model.Keen proposed the derivation of a nonlinear driver steering controller using multiple linearized models of the vehicle dynamics and Model Predictive Control (MPC) theory [25].In order to simulate the vehicle more accurately, the vehicle model is built up in CarSim.However, it is difficult to calculate the parameters of the driver model with the complex vehicle model directly.Therefore, the kinematic equations of a linear 2-wheel vehicle model are employed as a driver's internal vehicle model, by which the parameters of the driver model can be calculated.The corresponding transfer function of the internal vehicle can be represented as follows: where () is the transfer function from the vehicle lateral acceleration to steering wheel angle,   is the vehicle lateral acceleration gain to steering wheel angle,  1 ,  2 ,  1 , and  2 are the parameters which present the vehicle's dynamic response property, and  1 and  2 can be calculated using  1 ,  2 ,  1 , and  2 , respectively.
Different vehicles lead to different second order systems.Based on step test data, the parameters ( 1 ,  2 ,  1 , and  2 ) of the second order system were identified by LSM (Least-Square Method) in this paper.

Parameters of Closed-Loop System
In this section, the parameters of closed-loop system are calculated with regard to the test data and road condition.Those parameters represent common behaviors of the driver and vehicle, including the preview time   , neural reaction time   , and inertial delay  ℎ of steering system.In a real world application, most of those parameters are uncertain factors.The ∞ control and robust control have been also paid considerable attention to eliminate the impact of uncertainty [26][27][28], According to some particular parameters values, we can obtain the weighting parameters of the driver model by the Error Elimination Algorithm.The meaning and features of each parameter will be described in detail in the following part.
4.1.Preview Time   .Preview time   can be considered mathematically as a negative delay time, which can compensate the delay characteristics of the driver and vehicle, and is one of the key parameters to express the characters of drivers.It relates not only to the driver's characteristic but also to the driving condition.The computational method of preview time was not given in the optimal preview control driver model under complicated operation conditions [29].The preview time is set by a time constant, and the range of values selected for the general driver model is 0.5 to 2.0 s.The fixed preview time driver models have a good tracking reference trajectory when the speed of the vehicle is low and lateral motion is not in the nonlinear area.Under high speed, complex trajectory, and bounded constraint conditions, it is difficult to complete the driving tasks for the fixed preview time driver models.When the vehicle runs from a small curvature path into a big curvature path or the vehicle speed becomes faster, the driver may reduce the preview time instinctively.Hence,   is related to the curvature and vehicle speed.In the big curvature path and high speed,   is small, and vice versa.Define that the curvature of the follow path  = () is  and the speed is V  .The preview time can be expressed as   = (V  , ).The calculation schematic diagram of preview time is shown in Figure 4.In Figure 4,  and       are the global coordinate system and vehicle coordinate system, respectively.The trajectory  = () in  can be transformed into   = (  ) in       .Whether the vehicle is safe within the range of preview or deviates from the planned trajectories is an important criterion for a driver after preview time   .The offset  between the vehicle driving prediction route and the center of the path can be determined by the driver's characteristic, which is acceptance of course error for a driver.We can define the point of the maximum offset in the range of vision as the preview point of driver.When the offset reaches maximum value, which is constant for one driver, the driver will operate the steering wheel to reduce the offset and make vehicle run into a safe area.The preview distance  is defined from driver position to preview point.In Figure 4,   0 =  and   0 = .Since the radius of the desired path  = 1/ is much larger than that of ,  ≈  + .Because   is a right-angled triangle, we can obtain that According to the previous equation, the preview time can be expressed as Through the above analysis, it has been seen that  has an influence on the key parameter   .The value of  can be measured through the road test as shown in Figure 4.   can be estimated based on (15).

Reaction Time 𝑡 𝑑 .
The time gap between receiving information and operating the steering wheel is defined as the reaction time   , which reflects the response capacity and affects safe driving.The simple reaction time  is defined as the reaction time   without considering the driving conditions and complex driving behavior. is a psychological, physical index and an innate character of humans, which is related to personal experience, proficiency, character, age, gender, and so on.The reaction time   may be influenced by the environment and driving conditions.Both road curvature and vehicle speed are the key factors of vehicle handling stability throughout the turn.Generally, the driver may be sensitive to large curvature and high speed, which will lead to the tension of the driver.For example, when the vehicle enters the corner, the curvature begins to increase and   will decrease, but on the contrary the curvature starts to decrease and   will increase.The same principles can be applied to vehicle speed; for instance, the reaction time decreases when vehicle accelerates.Curvature and speed affect the change of reaction time together.In brief, the relationship between   , curvature, and speed is a decreasing function [9], as follows: where  is curvature and ,  are the weight coefficients of curvature and speed, respectively.When one factor, curvature or speed, becomes the main status, its corresponding coefficient is large which exercises an important influence on the reaction time.Meanwhile, the driver is sensitive to lateral acceleration while turning usually takes one lateral acceleration   as threshold value of discomfort feeling.There is a certain functional relation between curvature and speed, and the function is   ≈ V 2  /.If   is determined by the drivers' feeling, high speed directly corresponds to small curvature and   is mainly affected by speed, and vice versa.So the weight coefficients can be obtained as follows: 4.3.Inertial Delay  ℎ .This paper proposes the cross-correlation method to calculate the inertial delay  ℎ which is an important parameter between steering wheel and vehicle response.Generally, for single-input-single-output system, the signals of input and output are utilized to find out the largest cross-correlation and consequently calculate the time delay between input and output.In this paper, the crosscorrelation   between the steering wheel angle () and yaw rate ( +  ℎ ) is achieved to calculate the inertial delay  ℎ , as shown in (18).The values of () and (+ ℎ ) are measured by the road tests, as shown in Figure 5. Consider the following: In (19), the cross-correlation coefficient can be expressed as a function of  ℎ as follows: where   ,   are the arithmetic means of () and ( +  ℎ ), respectively.  ,   are the variances of () and ( +  ℎ ), respectively.The curve of   ( ℎ ) is shown in Figure 6.When   ( ℎ ) reaches its largest value,  ℎ is equal to the steering system delay time  * ℎ , as follows:

Weight Parameters of Driver Model.
The closed-loop system should be an ideal low-frequency following system, which can meet the requirement as follows: That is to say, () −1 , the inverse function of the follower, should be an approximation of ().
The Taylor series expansions of () −1 and () are presented as follows: If   =   ( = 0, 1, . . ., ), () can be called "follower, " which is compensated by the ().Moreover, vehicle's motion is a low-pass filter [13], so the high-frequency signals can be ignored, which leads to an ideal following system.By using the Error Elimination Analysis method, the weight parameters of the closed-loop system are obtained based on the driver's basic parameters and vehicle parameters.The weight parameters can be calculated as follows:

Test Identification and Model Verification
In order to obtain the model parameters, a lot of experiments have been carried out using a small car as test vehicle.Furthermore, the vehicle model will be verified to ensure the effectiveness of vehicle model in simulations.

Vehicle Model Verification.
The simulations are carried out in CarSim, in which complex vehicle model can be built up to operate in nonlinear region.The vehicle model is verified by comparing the simulations and test results.Two typical tests including step input and pulse input of steering wheel angle are presented and shown in Figures 7 and 8, respectively.From the figures it can be seen that the simulation results fit the test results well, indicating that the vehicle model can be used in simulation with sufficient accuracy.

Calculation of Model Parameters
(1) The Offset .Based on Section 4.1, the road tests are carried out to calculate the offset .Typical driver A is selected for road tests.Driver A is skilled and professional with high driving proficiency.In the tests, the initial positions of the steering wheel change and speed had been recorded when the driver saw the first bend and intended to enter the bend.The offset  was calculated and the average of results is 0.843 m.
(2) Simple Reaction Time .In order to get actual simple reaction time  of drivers, the tests are carried out in a  proving ground, in which the environmental distraction can be eliminated.The test method is to record the procedure of simple stimuli-human reaction-execution behavior using a high-speed digital camera.The test system is composed of a test car, a camera, a signal lamp, and a data collector, as shown in Figure 9.The camera is Redlake Y3 high-speed digital camera, which can provide very high sample frequency up to 2000 fps.Eight men and one woman are selected to complete this test.During the test, each subject sits in the stationary vehicle and observes the signal light.Once the signal lamp is lighted, the subject should turn the steering wheel immediately.Meanwhile, the camera records the whole process of the steering wheel operation.The time difference from the time when the signal lamp is lighted to the time when the subject starts to turn the steering wheel is the simple reaction time .Each subject should complete the test 10 times, and the average value of these data is taken as the final result.All test results are presented in Table 1.
(3) Inertial Delay  ℎ .According to Figure 5, (19), and (20), the delay time of the steering system is determined by the maximum value of   .When the value of the correlation From these two figures, it can be obtained that the vehicle with the PCANN driver model has better performance of the lateral acceleration and the lateral displacement than that the POSANN driver model.The sway of the vehicle with the PCANN driver model is smaller than that the POSANN driver model.It is obvious that the PCANN driver model of driver A can adapt to environmental changes more rapidly.The above results in two emergency cases show that compared with the POSANN driver model, the proposed PCANN driver model can adapt to the changes of road condition more quickly, implying that the driving compensation is very necessary especially in emergency cases for the driver.The compensator will exhibit more potential benefits when the road is worse.

Conclusion
A new POSANN-based driver model with compensator controller using the jerky dynamics is investigated.The compensator controller is built using linearized models of the nonlinear vehicle dynamics and vehicle current states to generate a steering corrected value for the POSANN driver model.The key model parameters reflecting the driving behaviors, such as preview time and reaction time, are calculated according to the test data which can vary with changes under operating conditions.The inertial delay of the steering system is obtained by the cross-correlation method, which is applied to eliminate random fluctuation of experimental data.Simulation results demonstrated that the proposed driver model can achieve better path-following performance than the POSANN driver model under critical maneuvering conditions.Furthermore, the driver model can be used effectively for representing driver steering control behaviors to some extent.Consequently, the proposed driver model presented in this study can be used in a closed-loop simulation and in the development of the vehicle's intelligent safety system.

Figure 3 :
Figure 3: Block diagram of preview-compensation ANN driver model.

Figure 4 :
Figure 4: The calculation of preview time.

Figure 5 :Figure 6 :
Figure 5: The relationship between steering wheel angle and yaw rate.

Figure 8 :
Figure 8: Result comparison for pulse input test.

Figure 9 :
Figure 9: Test system for simple reaction time .