Study of On-Ramp PI Controller Based on Dural Group QPSO with Different Well Centers Algorithm

A novel quantum-behaved particle swarm optimization (QPSO) algorithm, dual-group QPSO with different well centers (DWCQPSO) algorithm, is proposed by constructing the master-slave subswarms. The new algorithm was applied in the parameter optimization of on-ramp traffic PI controller combining with nonlinear feedback theory.With the critical information contained in the searching space and results of the basic QPSO algorithm, this algorithm avoids the rapid disappearance of swarm diversity and enhances the global searching ability through collaboration between subswarms. Experiment results on an on-ramp traffic control simulation show that DWC-QPSO can be well applied in the study of on-ramp traffic PI controller and the comparison results illustrate that DWC-QPSO outperforms other evolutionary algorithms with enhancement in both adaptability and stability.


Introduction
Interference caused by intersection and convergence between different traffic flows at the traffic bottlenecks such as onramp not only seriously reduces the efficiency of freeway but also leads to a reduction of the entire traffic network efficiency.On-ramp control is the most effective way to improve traffic condition of freeway.Therefore, it is necessary to study the traffic flow and develop effective traffic management and control measures on the basis of existing facilities at the onramp.With the development of computer technology, computational intelligence provides an effective method which can select the optimal control parameters for ramp traffic control strategy according to different conditions to solve the on-ramp traffic flow control problem.Now, the ant colony optimization (ACO) [1], particle swarm optimization (PSO) [2], artificial neural network (ANN) [3], cellular automata (CA) [4], and genetic algorithms (GA) [5,6] have been used in on-ramp control.
Although the computational intelligence methods above have made some achievements on on-ramp traffic control, they still have the following limitations: firstly, the convergence rate of PSO, ACO, and GA is so slow as to result in premature convergence and low precision.Secondly, due to the fact that traffic flows have real-time and nonlinear characteristics, the existing models are not fast enough to respond to real-time information, thus having limited applications.To solve these problems, a novel quantum-behaved particle swarm optimization (QPSO) algorithm, the dualgroup QPSO with different well centers (DWC-QPSO) algorithm, is proposed in this paper based on quantum-behaved particle swarm optimization (QPSO) algorithm.With the critical information contained in the searching space, DWC-QPSO avoids the rapid disappearance of swarm diversity and enhances the global searching ability through collaboration between subswarms.Then the on-ramp traffic PI controller is designed based on DWC-QPSO algorithm by optimizing the values of parameters   and   .Experiment results show that DWC-QPSO algorithm can be applicable in the ramp traffic PI controller and the comparison results illustrate that DWC-QPSO outperforms other evolutionary algorithms with enhancement in both adaptability and stability.

Mathematical Problems in Engineering
This paper is organized as follows.Section 1 gave an introduction of on-ramp control problem; Section 2 introduced the PSO algorithm and QPSO algorithm.Then, a new algorithm, DWC-QPSO algorithm, is proposed in Section 3, and the convergence performance of the novel method is analysed by test functions experiment results; Section 4 explained the on-ramp traffic model and illustrated the computation process of DWC-QPSO algorithm optimizing the parameters of the on-ramp PI controller.In the end, Section 5 focuses on the simulation results analysis and Section 6 is the conclusion of this work.

PSO Algorithm and QPSO Algorithm
2.1.PSO Algorithm.Particle swarm optimization (PSO) algorithm is an evolutionary computation method proposed by Kennedy and Eberhart in 1995 [7][8][9].It is one pattern of the latest swarm intelligence (SI) optimization algorithms.The basic idea of PSO algorithm derived from the study of bird behavior, through simulating birds' prey behavior to achieve the purpose of problem optimization.
In the PSO algorithm, each potential solution of the problem is abstracted as a particle with no weight and no volume.These particles fly at a certain speed in the -dimensional search space [10].Assuming the particle swarm population size is , the particle 's position and velocity at time step  are, respectively, expressed as follows.
As PSO has simple concept, a small number of parameters, and desirable performance, PSO has become a very promising optimization tool and attracted extensive attention and has been successfully applied in many areas, such as function optimization, power systems, data mining, and wireless sensor network.However, some problems of this novel algorithm remain to be solved.One of these problems is that particle swarm cannot converge on the global optimal solution with one hundred percent probability, which has been proven by Bergh [11].

Quantum-Behaved Particle Swarm Optimization Algorithm.
In order to solve this problem, Sun [12] proposed the quantum-behaved particle swarm optimization algorithm in the quantum space.According to the results Clerc and Kennedy [13] analyzed the particles' orbit in the PSO algorithm, and QPSO algorithm establishes a  potential well to impact particles' convergence at the local attraction points   = ( 1 ,  2 , . . .,   ).The position of   is calculated by the following equations: where where  , () ∼ (0, 1),  , () is the length of the  potential well, which is evaluated by formula (6).() is defined as the population gravity center which is the average of all the best individual locations.It is calculated as follows: where is contraction-expansion coefficient.In order to improve the performance of QPSO algorithm, this paper proposes the DWC-QPSO algorithm, which enhances the QPSO's convergence properties by increasing wait effects between particles to avoid population excessive accumulation.
The specific idea of DWC-QPSO algorithm is as follows: dividing the particle swarm into two separate subgroups after randomizing the individual's position in the solution space.
One subgroup establishes a  potential well at the position of   in accordance with the rules of standards QPSO algorithm.The particles of the second subgroup are iteratively searching in the solution space under the influence of the other  potential well which is established with    as the center.Given the entire population , the first subgroup is called master subgroup, represented by  1 , and the second subgroup is called secondary subgroup, represented by  2 ; thus,  1 ∪  2 = .The position of    is calculated as in formula (8).Evolutionary formula of particles' positions in DWC-QPSO algorithm is as follows: These two subgroups exchange information by means of the best individual during the searching period in DWC-QPSO algorithm that is comparing the best fitness value of  1 and  2 at the end of each iteration.Given that  best1 is  1 's global best solution and  best2 is  2 's global best solution, we compare the fitness values corresponding to  best1 and  best2 , respectively.If the latter one is superior than the former one,  best2 is assigned to  best1 ; otherwise  best1 remains unchanged.The essence of the above operation is an update of the whole swarm's global best solution  best to help subgroups escape from local optima.By analyzing the displacement formula, the result shows that   and    are symmetry in point of the center of  best and  best .In the convergence process, all particles'  best will gradually move closer to the  best .Due to the gravity of  potential well,   of master subgroup and    of secondary subgroup will overlap at the same place in the solution space eventually.Therefore, the convergence of the DWC-QPSO algorithm can be achieved.

Experiment and Simulation.
In order to verify the novel algorithm, the optimization results of DWC-QPSO algorithm are compared with the performance of standard PSO algorithm and QPSO algorithm using 6 standard test functions.Since many practical projects, including single-peak and multipeak problems, choose two single peak functions (Sphere function and Rosenbrock function) and five multipeak functions (Rastrigin function, Griewank function, Ackley function, Schaffer function, and Schwefel function) as the experimental test functions, we will give some information about these test functions, including expressions, the ranges of variables, dimensions, the optimal solutions, and optimal values of test functions as follows: (1) Sphere function: (2) Rosenbrock function: (3) Rastrigin function: ∈ [−5.12, 5.12] ,  = 20, min  3 (0, 0, . . ., 0) = 0, (4) Griewank function: (5) Ackley function: ∈ [−32.786,32.786] ,  = 20, min  5 (0, 0, . . ., 0) = 0, (14) In the experiment simulation, the parameter  linearly decreases from 1 to 0.5.The maximum number of iterations iterMax is set to 1000.The population sizes are set to 30 and 50, respectively.The size of the master cluster is  1 and the size of the secondary cluster is  2 , using the average distribution strategy, which is  1 =  2 .Each test case runs 30 times independently, then calculate the average results of the test function.Experimental environment is MATLAB 7.9.0,Intel Core (TM) 2, 1.80 GHz, 2.50 GB RAM.
Mean fitness value and CPU time per round of PSO, QPSO, and DWC-QPSO algorithm to optimize the various functions are as shown in Tables 1 and 2.
Tables 1 and 2 illustrate that the DWC-QPSO has the best performance compared with the PSO algorithm and the QPSO algorithm.This is because the DWC-QPSO algorithm has two subgroups, which are master subgroup  1 and secondary subgroup  2 , respectively. 1 and  2 complement each other and coevolve by exchanging the optimal location information constantly.
This pattern of two subgroups searching in solving space at the same time and learning from each other increases the probability of finding the optimal solution and improves the convergence performance of the new algorithm.
Figures 1(a) and 1(b) show the convergence curves of the PSO, QPSO, and DWC-QPSO algorithm solving 20 dimensions of unimodal functions with 30 particles, respectively.Sphere function is relatively simple, which can be used to test the accuracy of optimization algorithms to study the implementation of the algorithm performance.It is learned from Figure 1(a) that DWC-QPSO has the similar performance.Rastrigin's function is difficult to optimize as it has a large number of local optimums.The novel one gets the best results of these three algorithms for solving this function.
Figures 1(c)∼1(e) illustrate the convergence curves of the PSO, QPSO, and DWC-QPSO algorithm solving 20 dimensions of multimodal functions with 30 particles, respectively.Rastrigin function is easy to fall into local minima.The pattern of dural subgroups interaction allows DWC-QPSO algorithm to have a better ability to escape from local optima to get the better optimization.From Figures 1(d) to 1(f) are the curves of Griewank function, Ackley function, and Schwefel function.There are correlations between the variables of these three functions.The experiment results show that the DWC-QPSO algorithm has better performance in this type of problem.
In summary, the DWC-QPSO algorithm proposed by this study obtained outstanding global search capability in limited iterative steps because it could get more useful information.  (): the increased traffic flow of  + 1th section from th segment during the th period;   (): the on-ramp metering rate of th section during the th period;   (): the total number of vehicles in th section during the th period; : the number of main lanes of freeway;   : the length of the th section; : the discrete time steps.

The On-Ramp PI Controller Based on DWC-QPSO Algorithm
According to the law of vehicles conservation, the total number of vehicles in th section during the ( + 1)th period is as follows: The traffic density of th section can be calculated through (9) in line with the definition of the traffic density: Then, The parabolic flow-density model can be deduced: After the combination of ( 16) and ( 17), the complete traffic flow of the on-ramp of freeway is shown as formula (18): where V  is the free-flow speed and  jam is the jamming density of the freeway.In fact, the flow-density model also creates a critical density   corresponding to the maximum flow rate   .  () increases with the increase of   () value in [0,   ] interval, while   () decreases with the increase of   () value in [  ,  jam ] interval.When   () is equal to  jam , the   () is 0; therefore, the traffic jam occurs.

The On-Ramp PI Controller Based on DWC-QPSO.
As a feedback control system, PI controller becomes one of the main methods of engineering controls because of its simple structure, good stability, reliability, and easy adjustment.
Performance of PI controller depends on the reasonable values of parameters   and   .At present, PI controller parameters rely mainly on manual adjustment.However, this traditional approach is not only time consuming but also unable to guarantee the best performance.In this paper, DWC-QPSO algorithm is used to optimize the value of   and   , which is shown in Figure 3. expected traffic density:   () =   − ,  is an appropriate small positive number.This system's objective is to control the mediation rate of the on-ramp   () and avoid the traffic congestion through maintaining the traffic density of main lane   () at a negative neighborhood of critical density   .Therefore, the square sum of the differences between actual traffic flow density   () and expected traffic density   () can be used as the system objective function: Each particle of the swarm corresponds to a pair of values of parameters   and   when using the DWC-QPSO algorithm optimizing the PI controller.Due to the fact that the square sum of the differences between actual traffic flow density   () and expected traffic density   () is larger, the corresponding adjustment of on-ramp rate   () value should be smaller and the DWC-QPSO adaptation algorithm corresponding value should also be smaller; the reciprocal of the sum of squared deviations can be selected as the fitness function of the DWC-QPSO algorithm: Figure 4 illustrates the process of using DWC-QPSO algorithm optimizing the PI controller parameters.
The specific process is as follows.
Step 1 (setting parameters).This includes the acceleration factors  1 and  2 , the contraction-expansion factor , the swarm population , the maximum allowed times of iterations iterMax or error accuracy, and the population of subgroups, where  1 and  2 are the population of master subgroup  1 and secondary subgroup  2 , respectively.
Step 3. Calculate the fitness value of all particles in  1 and  2 according to (22).The particle location of the smallest fitness value is assigned to the global best solution; that is, min((  )),  ∈ {1, . . ., } →  best .

DWC-QPSO PI controller
Traffic model of freeway on-ramp Step 4. Calculate the mean best position () of the particle swarm based on (7), using it to evaluate  , (), where  is the length of  potential well.
Step 6. Recalculate the fitness value of the particle 's new position in the solution space according to the objective function.
Step Step 10.Determine the termination conditions of the algorithm.If the end conditions are not reached (usually the end condition is the expected fitness value or the maximum number of iterations), do  =  + 1 and return to Step 3.
Step 11.Output the optimal solution.

On-Ramp PI Controller Simulation and Results Analysis
In order to demonstrate the effectiveness of the new algorithm, an experiment for on-ramp PI controller based on DWC-QPSO algorithm is conducted.In the simulation, the acceleration coefficients of DWC-QPSO  1 and  2 are set to be 2, and the contraction-expansion factor  decreases linearly from 1 to 0.5.The maximum number of iteration steps itemMax is 150 and the entire population size  is 30.All particles are evenly distributed to two subgroups, which means that the population size of master subgroup  1 is equal to the population size of secondary subgroup  1 .The system prototype is implemented in MATLAB 7.9.0.Typical parameters of on-ramp traffic flow model are shown in Table 3. Assume the curve of the traffic  −1 () is shown in  It is learned from Figure 5(c) that the error between   () and   () is very small, which means that the expected traffic density can be well tracked by the actual traffic density in the system using DWC-QPSO algorithm optimization.As can be seen from Figure 5(d), the on-ramp mediation rate increases with time at the beginning, and there is a surge during this period.Since the traffic of ( − 1)th section of lane remains unchanged in the initial stage, while the expected traffic density is linearly growing from 24.06 vel/km⋅lane −1 to  34.16 vel/km⋅lane −1 , then traffic increment is mainly coming from the on-ramp.In the following stage, the expected traffic density remains at vel/km⋅lane −1 , while the on-ramp mediation rate changes with the traffic variation of ( − 1)th section.The on-ramp mediation rate would be decreasing and the vehicles entering to the main lane from on-ramp would be reducing when the traffic of  − 1 section is increasing; however, when the traffic of  − 1 section is reducing, the on-ramp mediation rate would be increasing and the vehicles entering to the main lane from on-ramp would be increasing as well.The on-ramp control strategies above could avoid traffic congestion, keeping the traffic smooth and maximizing the utilization of the main lane.
In order to verify the effectiveness of the algorithm, the optimization performances of ant colony optimization (ACO) algorithm and particle swarm optimization (PSO) algorithm are compared with the performance of DWC-QPSO.The PI controller parameters and the optimal value of objective function corresponding to these three algorithms are shown in Table 4, and the curve of the fitness value is shown in Figure 6.
The simulation illustrates that the minimum fitness value of on-ramp PI controller system can be obtained by DWC-QPSO in these three algorithms.The results reveal that the actual traffic flow density   () is closest to the expected traffic density   () and the system has the highest stabilities under this condition.As a real-time traffic control system, if the reaction is too slow, the input information would be useless for the system and the outputs would lose effectiveness for inducing actual traffic.Therefore, the timeliness is an important evaluation standard for optimization algorithms in real-time applications.It can be learned that the DWC-QPSO algorithm has the fastest convergence speed comparing with the ant colony algorithm and the standard particle swarm optimization from Figure 6.Because the novel algorithm has high-speed response capabilities in avoiding cumbersome and complex human intervention, it is able to quickly find the optimal value of parameters   and   .In summary, because the system is capable of adjusting the on-ramp traffic dynamically in real-time according to the traffic condition of upper section, the DWC-QPSO algorithm is quite applicable in on-ramp traffic PI controller and outperforms other evolutionary algorithms with enhancement in both adaptability and stability.

Conclusion
On-ramp control is a significant way to control the traffic density of freeway.Furthermore, it is also an important foundation for the traffic guidance systems and other decisionmaking systems in ITS.In this paper, the on-ramp traffic PI controller based on the DWC-QPSO algorithm is proposed, which is designed on the assumption that all sections of lanes have the abilities of measuring the average vehicle speed and the traffic density.The DWC-QPSO algorithm is applied in optimizing the PI controller parameters   and   in order to achieve the traffic density control at the onramp.Experimental results show that the on-ramp traffic PI controller based on DWC-QPSO algorithm has better adaptability and stability compared to the other evolutionary algorithms.

4. 1 .
On-Ramp Traffic Model.Consider that the on-ramp has one lane, and the main lane of freeway is divided into  sections with length   .The traffic model is shown in Figure2, where  = 1, 2, . . ., .The traffic flow model in the th section of freeway is discrete in both space and time domains.It includes the following variables:   (): the traffic flow density of th section during the th period;V  (): the average vehicle speed in th section during the th period;

Figure 2 :
Figure 2: On-Ramp traffic model of freeway.

Figure 5 :
Figure 5: Comparison of actual and expected traffic density: (a) traffic flow of  − 1 section; (b) expected traffic density; (c) traffic density comparison; (d) on-ramp mediation rate.
Figure 5(a).And Figure 5(b) illustrates that the expected traffic density of th section   () linearly increases from the initial 24.06 vel/km⋅lane −1 to 34.16 vel/km⋅lane −1 , and since then it has been maintained at 34.16 vel/km⋅lane −1 .The values of parameters of the on-ramp traffic PI controller optimized by
, and   denote the -dimensional components of

Table 3 :
Parameters of on-ramp traffic flow model.PSO algorithm are   = 186.6008and   = 330.000,which corresponds to the minimum fitness value  = 2.054.

Table 4 :
Parameters of PI controller and the objective function values.