Freeway Traffic Density and On-Ramp Queue Control via ILC Approach

1 School of Automation & Electronics Engineering, Qingdao University of Science & Technology, Qingdao 266042, China 2 School of Information Science and Engineering, East China University of Science & Technology, Shanghai 201424, China 3 School of Electronics & Information Engineering, Beijing Jiaotong University, Beijing 100044, China 4 School of Polymer Science and Engineering, Qingdao University of Science & Technology, Qingdao 266042, China


Introduction
Freeway traffic control [1][2][3] is an important area in the field of traffic engineering and intelligent transportation systems.Frequent congestion on freeway during rush hours deteriorates traffic conditions.The most common reasons causing freeway congestion include traffic demand being greater than capacity, as well as traffic accidents, road works, and weather [3].For better utilization of freeway capacity, ramp metering [2,[4][5][6][7] is a commonly implemented strategy.The purpose of ramp metering is to regulate the amount of traffic entering a given freeway at its entry ramps to maximize throughput by maintaining a desired (or optimal) occupancy on the downstream mainline freeway.
Recently, various model-based control methods were developed to solve the problem, for instance, numerical methods [4,5], function approximation based on neural network [6,8], linearization method [2], one-step ahead prediction and multiple prediction adaptive control [7], and so forth.A limitation of model-based control is its sensitivity to modeling accuracy.Note that the scale of freeway traffic system expands with its dynamics becoming more complex nowadays.Consequently, an accurate freeway traffic model is hardly available in practice and it is highly nonlinear.Thus, model-based control methods may not be able to produce satisfactory performance.It is desirable to develop a new control method that is less dependent on the model accuracy.
It is noted that traffic flow patterns are in general repeated every day.For instance, the traffic flow will start from a very low level at midnight and increase gradually up to the first peak of morning rush hour, which is often from 7 to 9 a.m., and the second one, which is from 5 to 7 p.m. [9].Congestion typically starts at the same locations every day.Based on this observation, the iterative learning control (ILC) based ramp metering strategy has been proposed for the freeway density control [9][10][11].Iterative learning control was first proposed in [12] for the control of a system that repeats the same task in a finite interval and has been extensively studied and achieved significant progress in both theory and applications [13][14][15][16][17]. ILC has a very simple structure and requires very little system knowledge, which is a very desirable feature in traffic control since the traffic model and the exogenous factors may not be well known in practice.
In [9], only the pure ILC based ramp metering and speed control were discussed.In [10], the learning mechanism combined with an error feedback in a complementary manner was studied and the simulation results have shown its superiority to the pure ILC scheme.Recently, the ILC based ramp metering and the modified modularized ramp metering based on ILC and ALINEA in the presence of input constraints were also analyzed to enhance the robustness of the proposed methods [11].
It is worth pointing out that the control input signals in [9][10][11] are updated based on the error information of the freeway traffic density only.Actually, the queue length of on-ramp is a significant factor [18].Whenever the on-ramp demand exceeds the desired metering rate, a queue will form.However, the storage capacity of an on-ramp is often very limited.Therefore, if without proper control, the vehicle queue length will quickly exceed this capacity, causing the vehicles to spill over into the surface streets and interfere with street traffic.
Note that the current work is to consider the queuing demands as a constraint on the ramp metering [9][10][11]; that is, the on-ramp volumes cannot exceed the current demands plus the existing waiting queues at on-ramps.However, it is a queue-override scheme in nature [18].If the queue detector occupancy is above the threshold, the metering rate is increased by a certain level.When the queue detector occupancy falls below the threshold, the metering rate is reset to the value determined by the controller.It has been noted [19,20] that this queue-override scheme leads to oscillatory behavior and underutilization of on-ramp storage capacities.
In this paper, we present a new queue length information fusion based iterative learning control approach (QLIF-ILC) for freeway traffic responsive ramp-metering by using the repeated traffic patterns.The proposed control scheme consists of a feedforward learning part, used to learn from the past control data in the previous trial to meet the performance requirement, and a feedback stabilizing parts, designed to restrain the state error and input disturbance such that the closed-loop output tracking error is within a reasonable bound.A most distinct feature of the proposed QLIF-ILC is that the error information of the on-ramp queue length is used to prevent excessively long queues from interfering with surface street traffic and achieve a better performance.Both the rigorous analysis and the simulation results are given to demonstrate the efficiency and applicability of the proposed QLIF-ILC.
The rest of this paper is organized as follows.Section 2 introduces the traffic flow model and gives the problem formulation.The iterative learning controller based on the queue length information is designed and analyzed in Section 3. Section 4 provides some simulation results to illustrate the applicability and effectiveness of the proposed approach.Finally, some conclusions are given in Section 5.

Traffic Flow Model and Problem Formulation
The macroscopic traffic flow model [21] of a section is shown in Figure 1, where () is the traffic flow entering the section (veh/hour), () is the traffic flow leaving the section (veh/ hour), () is the traffic flow density at time  (veh/lane/km), () is the flow rate entering the mainline from the ramp (veh/hour), () is the queue length in the ramp, () is the inflow entering the ramp (veh/hour),  is the length of the section, and  is the time instant.
Let the total number of vehicles in the section at time instant  be given by ().At time ( + 1), the number of vehicles is given by ( + 1).Accordingly, the traffic density () is changed to be ( + 1) and thus we have where  is the number of lanes of the freeway mainline.
In addition, the change in the number of vehicles in the section can be expressed as where  is the sampling time.
Apparently, it is easy to obtain from (1) and ( 2) that ( ( + 1) −  ()) ⋅  ⋅  = (− () +  () +  ()) ⋅ , or According to Greenshield's model [22], one has where  max is the maximum possible density per lane and V  is the free speed.Thus, the relationship among traffic flow, density, and velocity can be expressed as Substituting ( 6) into (4) yields Mathematical Problems in Engineering 3 According to the conservation law, the number of vehicles that stay in the on-ramp at time  is equal to the difference between the inflow volume and outflow volume; that is, From ( 7) and ( 8), we have the macroscopic traffic model as follows: Let () ], and C = [ 1 0 0 1 ]; we can rewrite (9) as where g(, x  ()) is a corresponding vector-valued function and y() is the system output.
To show the repeatable property and the strong uncertainties of the freeway traffic system, we denote the above macroscopic traffic flow model as follows: x  ( + 1) = g (, x  ()) + b  () + Ds () +   () , where   () and   () are added as the bounded state disturbances and output noises, respectively,  denotes the iteration number,  ∈ {0, 1, . . ., } belongs to a finite time interval, and s() is regarded as an unknown repeatable disturbance in the following controller design and analysis.
The control objective of this work is to find a proper control input   () driving the traffic flow density to track the desired traffic density   and the desired queue length of the on-ramp,   .
Remark 1.In this paper, the control objective considered is only for some idea cases, where the traffic demand is not too heavy and one can manipulate the flow rate entering the mainline from the on-ramp to achieve the desired traffic density and to arrive at the desired queue length meanwhile.
Remark 2. In fact, there are more practical cases where the traffic demands of the mainline and on-ramp are heavy but not causing congestion.For such cases, it is better to consider a balance between the traffic density of the mainline and the queue length of the on-ramp by setting their proper desired values.Then, the control objective is to make the traffic density and the queue length track the desired values, respectively, as much as possible and the final tracking errors may not be zeros but some minimum values.

Controller Design and Convergence Analysis
3.1.Controller Design.Design a PD-type ILC law based on the queue length information fusion (QLIF-ILC) as follows: where Γ 1 and Γ 2 are learning gain vectors and e  ( + 1) = y  ( + 1) − y  ( + 1) with y  () being the desired output at time .
Remark 3. Expand control law (12) as where    () =   () −   () is the tracking error of the traffic density and    () =   () −   () is the tracking error of the queue length of the on-ramp.Hence, the weighted sum of the tracking errors of the traffic density and the queue length is utilized in the QLIF-ILC to achieve a better performance.
Remark 4. The proposed ILC approach consists of a feedforward learning part Γ 1 [e  ( + 1) − e  ()] and a feedback stabilizing part Γ 2 e +1 ().The feedforward learning part is designed to meet the performance requirement.And the feedback stabilizing part is designed to accommodate the uncertainties and disturbances.

Convergence Analysis.
Before the convergence analysis, some assumptions should be given as follows for the rigorous analysis.
Assumption 5.There exists a control input   () such that the system output can be driven to track the desired trajectory y  () for the system (11) over the finite time interval {0, 1, . . ., }.Assumption 6.The reinitialization condition is satisfied throughout the repeated iterations; that is, where x  (0) and y  (0) are the initial values of the desired states.
Assumption 7. The function g(, x()) is Lipschitz continuous; that is, where  > 0 is the Lipschitz constant.
where  g ,  b ,   , and   are some positive constants.
Remark 9. Assumption 5 is very common in the control theory field.Assumption 6 is the standard condition for ILC analysis using contraction mapping approach.Although there exists a quadratic term in g(, x()), it is noted that () is always less than  jam .So, Assumption 7 is automatically satisfied for the freeway traffic system.Note that, in Assumption 8, we just need the existence of the positive constants instead of their exact values.
The validity of the above presented optimal terminal ILC is verified by the following theorem.
Similarly, multiplying (1/)  for both sides of ( 19), one has Because  > max{1, ,  +  b  Γ 2 }, then (/) < 1.Hence, (32) implies that when   = 0,   = 0, and  = 0. Hence, (35) implies Remark 11.It is noticeable from the analysis that the convergence of the learning system can be guaranteed under some sufficient conditions, which are independent of the stabilizing controller.This means that the feedforward learning mechanism can still work in the uncertain environment without the stabilizing controller, but the learning rate can be improved if a suitable one is used.

Simulation Study
Consider a long segment of freeway with the length of 3 km, and there is only one on-ramp located in the segment.The maximum traffic density  max = 80 veh/lane/km.The traffic flow entering the mainline () and the inflow entering the ramp () are given in Figure 2, respectively.Consider an on-ramp with about 100 m length; the desired queue length is   = 7veh.The free speed V  = 120 km/hour, the sampling time  = 30 s, and the finite sampling time instants  = 60.In the simulation, considering the inevitable initial resetting error, we assume that both the initial traffic density,    (0) = 40 + rand (veh/lane/km), and the queue length,   (0) = 7 + rand  veh, are nonstrictly repeatable.In addition, to show the robustness of the proposed approach, we set Applying the proposed QLIF-ILC approach (12) with Γ 1 = [1.53,0.27] and Γ 2 = [18.7,3.3], the simulation results are shown as the red solid lines in Figures 3 and 4, respectively.Figure 3 shows the learning convergence of traffic density with respect to the iteration number .The horizon is the iteration number and the vertical axis is the maximum absolute values of the traffic density tracking error  1 max, = max ∈{0,...,60} |  −   ()|.Figure 4 shows the learning convergence of queue length with iterations, where the vertical axis is the maximum absolute values of the queue length tracking error  2 max, = max ∈{0,...,60} |  −   ()|.From Figures 3 and 4, the asymptotic learning convergence along iteration axis of traffic density and queue length can be clearly seen, and the fluctuation in mainline flow and queue length is considerably reduced with iterations.Further, the proposed approach is robust for the uncertain disturbances that existed in system states, outputs, and initial conditions.
For the purpose of comparison, we design a PD-type ILC law similar to (12) according to [9] as follows: where  +1 () =   ()− +1 () is the traffic density error only and  1 and  2 are constants denoting the learning gains.The only difference between ( 12) and ( 38) is that the latter does not contain information of the queue length directly in the control law and the queue length is used as the constraints exposed on the control input signals.
Applying the ILC scheme (38) with  1 = 1.53 and  2 = 18.7, the simulation results are shown as the blue dash lines in    Figures 3 and 4, respectively.It is noticeable that the proposed QLIF-ILC approach has a better performance than the ILC scheme (38) without using queue length information.
When applying the proposed QLIF-ILC law (12) and the ILC law (38), respectively, the mean speed values are presented in Table 1.It can be seen that the proposed QLIF-ILC achieves an improved performance over the traditional iterative learning ramp metering schemes [9][10][11].

Conclusion
In this paper, a discrete iterative learning control based on the queue length information fusion (QLIF-ILC) is proposed for the nonlinear freeway traffic systems with input disturbance and output measurement noise, where a feedforward learning part is combined with a feedback stabilizing part.The onramp queue length is explicitly fused into the designed ILC mechanism to achieve a better performance.A systematic approach is developed to analyze the convergence and robustness of the proposed learning scheme.It is shown that the uniform boundedness between the system output and the desired output is achieved in each iteration.When all the uncertainties tend to zero, the system output will converge uniformly to the desired one.The simulation study on a macroscopic level freeway model confirms the validity of the proposed QLIF-ILC.

Figure 2 :
Figure 2: The traffic demands of the mainline and the on-ramp.

Figure 3 :
Figure 3: Maximum tracking error of macroscopic traffic flow density.

Figure 4 :
Figure 4: Maximum tracking error of ramp queue length.

Table 1 :
The mean speed with iterations (km/hour).