Multiobjective Traffic Signal Control Model for Intersection Based on Dynamic Turning Movements Estimation

The real-time traffic signal control for intersection requires dynamic turning movements as the basic input data. It is impossible to detect dynamic turning movements directly through current traffic surveillance systems, but dynamic origin-destination (OD) estimation can obtain it. However, the combined models of dynamic O-D estimation and real-time traffic signal control are rare in the literature. A framework for the multiobjective traffic signal control model for intersection based on dynamic O-D estimation (MSC-DODE) is presented. A state-space model using Kalman filtering is first formulated to estimate the dynamic turning movements; then a revised sequential Kalman filtering algorithm is designed to solve the model, and the root mean square error and mean percentage error are used to evaluate the accuracy of estimated dynamic turning proportions. Furthermore, a multiobjective traffic signal control model is put forward to achieve real-time signal control parameters and evaluation indices. Finally, based on practical survey data, the evaluation indices from MSC-DODE are compared with those from Webster method. The actual and estimated turning movements are further input into MSC-DODE, respectively, and results are also compared. Case studies show that results of MSC-DODE are better than those of Webster method and are very close to unavailable actual values.


Introduction
Real-time traffic signal control system is most important for alleviating urban traffic congestion problems.As the basic input data of traffic signal control models, traffic counts at intersections are time-variant, nonlinear, and random.Therefore, to achieve the real-time link counts of entrance and exiting legs, as well as the turning movements at the intersection, is the key for decision of the traffic signal control scheme.Under the existing traffic surveillance systems, it is impossible to obtain the turning movements of intersections directly.However, based on the detected time-series of link counts of entrance and exiting legs, the real-time turning movements can be obtained using dynamic origin-destination (O-D) flows estimation (DODE) technique.Therefore, the traffic signal control model based on DODE is most important for the optimization of intersection signal control schemes.
Existing researches about dynamic O-D estimation can be generally classified into three categories according to the target network: for intersection, for freeway segment, and for general road network.
For intersection, Cremer and Keller [1] first used the timeseries of link counts at entering and exiting legs as input data and formulated a least-square model to estimate the turning movement flows at intersection.Nihan and Davis [2] further put forward a recursive least-square formulation using the measurements of all past intervals and considered the reduction of early intervals.Nihan and Davis [3] presented a maximum likelihood estimation model, as well as an expectancy maximization algorithm.Bell [4] proposed a revised optimization model considering the platoon dispersion between entering and exiting flows.Li and De Moor [5] further introduced the equality constraint and formulated a new least-square model.Jiao et al. [6] noticed that the leastsquare formulation will enlarge the occasional outliers of input flows, presented an optimization model to minimize the sum of absolute deviations between observed and estimated traffic counts, and designed a genetic algorithm for solution.Based on the above work, Jiao et al. [7] further proposed a real-time arterial coordination control method.Moreover, Jiao et al. [8,9] put forward a Bayesian combined model to estimate time-varying turning movement flows at intersections, as well as a bi-Bayesian combined framework for twostep prediction of such flows.Without considering dynamic travel time and route choice of vehicles, the above models are only applicable for intersections.
Introduction of dynamic travel time extended intersection models to freeway segment.Chang and Wu [10] first formulated a state-space model using Kalman filtering method.Sherali et al. [11] introduced the travel time to conventional least-square models and designed a projected conjugate gradient method for solving.Lin and Chang [12] further employed the dynamic travel time in the state-space model and put forward an efficient and robust on-line estimation method.Li et al. [13] formulated a nonlinear statespace model using unscented Kalman filtering.Considering dynamic travel time but without route choice, the above models are applicable for freeway segment.
Further introduction of dynamic route choice extended freeway segment models to general road network.Okutani [14] employed a strengthened state variable including all past intervals and put forward a network estimation model based on freeway segment models.Ashok and Ben-Akiva [15] used deviations of O-D flows from prior estimates based on corresponding historical data as state variables, improved the system observability, and revised Okutani's model [14].Ashok and Ben-Akiva [16] further put forward an estimation model integrating random dynamic traffic assignment, solved the problem that assignment matrix was unavailable in conventional models, and considered the random travel demand.Zhou and Mahmassani [17] also employed O-D deviations as state variables and formulated an estimation method based on self-learning mechanism.To avoid the errors inherent in the dynamic route choice, Sherali and Park [18] used real-time path flows as state variables and presented an optimization model.Along another line, Nie and Zhang [19] introduced the variational inequality method to the DODE problem and formulated a series of new models.More recently, Cheng et al. [20] proposed a Bayesian network model for O-D matrices estimation using prior and some observed link flows, but it was for static condition.Considering both dynamic travel time and route choice, most of the above models are applicable for general road network.
With respect to the researches on traffic signal control for intersections, genetic reinforcement learning [21], fuzzy computing [22], artificial neural network (ANN) [23], and genetic algorithm [24] methods have been extensively studied over the past two decades, and many signal control models based on historical information have been formulated, as well as the revised Webster method [25] and many multiobjective optimization methods [26].Under the signal control, the delay, queue length, and capacity have been improved greatly.However, the real-time turning movements, which are most important but cannot be detected directly, are still left unused.
To the best of our knowledge, there is no existing research which takes the real-time turning movements estimation into account in the traffic signal control model.Therefore, the key feature of this paper is to employ the estimated turning movements in the signal control at intersections.The rest of this paper is organized as follows.The basic problem statement, as well as the interrelation between dynamic O-D estimation and signal control, is presented in Section 2. A Kalman filtering based state-space model is formulated to estimate real-time turning movements in Section 3. A multiobjective traffic signal control model using estimated turning movements as input data is put forward in Section 4. Two algorithms are designed to solve the above two models, respectively, in Section 5.The evaluation results based on practical traffic data are reported in Section 6. Conclusions and further researches are summarized in the last section.

Problem Statement
For a typical intersection with  entrance legs and  exiting legs, detectors are placed at all legs to get the entering and exiting link flows, as shown in Figure 1.
This paper uses a 4-phase signal control for the intersection, as shown in Figure 2.There is no right-turn restriction in the timing plan.
Combining the DODE model based on Kalman filtering and the signal control model based on multiobjective optimization together, this paper puts forward a multiobjective signal control model based on DODE (MSC-DODE).The interrelation between dynamic O-D flows and signal control is shown in Figure 3.
This model takes the estimated turning movement proportions   () as input data for the signal control and aims to realize the real-time signal control and to achieve the comprehensive optimization of delay time, queue length, and effective capacity.

Dynamic Turning Movements Estimation for Intersection
To meet the accuracy and efficiency needs for on-line application, a Kalman filtering based state-space model is used to estimate the dynamic turning movement proportions.
We define variables in this model as follows: Since we can obtain   () and   () in real-time from traffic detectors placed at entrance and exiting legs, the key point of this section can be represented as how to formulate a model to estimate the time-dependent turning movement fractions   () from the detected time-series of link counts   () and   ().
The split parameter   () is used as the state variable to reflect the interrelation between the link counts of entrance and exiting legs; then the state transition equation is represented as where B() is the vector form of   () and W() is a vector of random errors.It is a column Gaussian white noise vector with zero mean and covariance D  , where D is a constant semipositive matrix and   is the Kronecker delta; that is,   = 1 when  = ; otherwise   = 0.
Assuming there is no U-turn at the intersection, that is,   () = 0, then the measurement equation can be represented as where Y() is a column vector of link counts at exiting legs, Q() is the measurement matrix, e() is the column vector of link volume measurement errors with zero mean and covariance R  , and R is also a constant semipositive matrix.

Traffic Signal Control Model Based on Dynamic O-D Estimation
The notations used in this model description are defined in the Notation section.
The displayed green time is defined as In order to optimize the signal timing plan, a multiobjective optimization model is formulated, and three indices are integrated to evaluate the model, including delay time, queue length, and effective capacity.Based on the estimated dynamic turning movements in Section 3 and the detected saturation headways,   ,   , ,   , , and  can be determined.These parameters are the basis to solve the optimization model.
The abovementioned three evaluation indices are defined as follows.
(1) Average delay time of arrival vehicles during phase :   .
It is equal to the difference between the travel time with and without control devices: where  is the number of phases during a cycle (4 in this paper).
It is equal to the average value of maximum queue length of each lane from the start of green phase: (3) Effective capacity during phase :   .
It is a most important index for intersection and denotes the total saturation flow during all effective green times during a certain period: To integrate the above three indices together, three weighting coefficients,  1  ,  2  , and  3  , are defined as Equation ( 7) reflects the following influences.
(1)  1  and  2  decrease with the increase of , while  3  increases with the increase of .The objective is to place the optimization emphasis on delay time and queue length during nonpeak hours, while it is placed on effective capacity during peak hours.
(2) Introduction of  into  2  means that the weight of queue length increases with the extension of cycle length.
Based on the above three weighting coefficients, the nonlinear optimization model is formulated as follows, with cycle and effective green time as the independent variables and with minimum delay, minimum queue length, and maximum capacity as the objectives: where green ,min is the minimum green time during phase  (15 seconds in this paper) and green ,max is the maximum green time during phase  (60 seconds in this paper).In this model,   and  are obtained based on the estimated dynamic turning movements proportions   (), which reflect the relation between DODE and traffic signal control.

Estimation Algorithm for Intersection Turning Movement
Proportions.An efficient sequential Kalman filtering algorithm is designed to estimate the dynamic turning movement proportions, and the truncation and normalization process [2] are used to modify the results to satisfy the inherent constraints of   () in its definition.A step-by-step description of the estimation algorithm for the proposed model is presented below.
Step 5. Assume P() = P  and B() = B  ; then return to Step 2 for the next round of iteration.
In the above algorithm, we improved the calculation efficiency by using the sequential Kalman filtering technique to avoid inverse matrix computation.Additionally,   () is assumed to be 0 to neglect the U-turn phenomena at the intersection, and we incorporated it in the algorithm programing using M language of Matlab software.

Optimization for MSC-DODE Model.
A normal nonlinear optimization algorithm is developed to solve the multiobjective signal control model to achieve the timing plan parameters and evaluation indices, which is implemented using Lingo software.

Case Study
To testify the accuracy and efficiency of the MSC-DODE model, we collected the field data of 3 hours through a survey during morning peak hour at Zhaodengyu-Pinganli west intersection in Beijing city and obtained enough data for the case study, including time-dependent link counts on all entrance and exiting legs, delay time, queue length, and saturation headway.Furthermore, we implemented the algorithm in Section 5 and achieved all estimated turning movement proportions and signal timing parameters.For the purpose of accuracy, a time interval of 2 minutes is used in the DODE model; therefore there are totally 90 intervals.

Comparison between Estimated and Actual Turning Movement Proportions.
Taking the right-turn at east entrance, go straight at west entrance and left-turn at west entrance, for instance, that is,  14 (),  31 (), and  34 (); the comparison results are illustrated in Figures 4, 5, and 6.We can further find out that the root mean square error (RMSE) range is below 0.1 and the mean percentage error is no more than about 0.01.Here results of the first five intervals are excluded from the RMSE and mean percentage error statistics because the estimation results of Kalman filtering during its initialization period are usually unreliable.Obviously the estimation results are accurate enough to support traffic signal control systems.

Comparison between MSC-DODE and Webster Method.
To reflect the effectiveness of MSC-DODE model, 10 sets of data were used to achieve the signal parameters using MSC-DODE model and classical Webster method, respectively.The results of three evaluation indices are reported in Figures 7-9, including delay time, queue length, and effective capacity.From Figures 7, 8, and 9 we can find out the following results: (1) total sum and average delay time of MSC-DODE model are both much less than those of Webster model; (2) total sum and average queue length of MSC-DODE model are both much less than those of Webster model; (3) total sum and average effective capacity of MSC-DODE model are both greater than those of Webster model.
In a word, the signal timing plan from MSC-DODE model is much more optimized than that from Webster method.

Comparison between Inputting Actual and Estimated
Turning Movements.To further testify the influences of DODE results on signal control, we input the estimated and actually collected turning movements (unavailable in realtime systems) into the MSC-DODE model, respectively, and the comparison results are shown in Figures 10,11,and 12. From the above figures we can find out that the results of inputting estimated values are much close to and sometimes even better than those of inputting actual values.Meanwhile the changing trends are much similar.Finally, the above case studies show that MSC-DODE model is much accurate and efficient for intersection signal control, especially under the current condition that it is impossible to detect dynamic turning movements directly through traffic surveillance systems.

Conclusions
In

Figure 7 :
Figure 7: Delay time comparison between MSC-DODE and Webster method.

Figure 10 :Figure 11 :
Figure 10: Delay time comparison between inputting estimated and actual turning movements.

Figure 12 :
Figure 12: Effective capacity comparison between inputting estimated and actual turning movements.
this paper, we integrate dynamic turning movements estimation and signal control together and put forward a multiobjective traffic signal control model based on dynamic O-D flows estimation (MSC-DODE).To optimize the delay time, queue length, and effective capacity together, this model is not only capable of taking advantage of intersection turning movements to further improve the effects of signal control, but also able to capture the temporal interdependency among turning movements and link counts.The reported examples have demonstrated that the proposed model is much more outstanding than classical Webster method and is accurate and efficient enough for on-line traffic signal control application.Furthermore, the signal timing plans from MSC-DODE model remain time-varying; that is, this paper presents a realtime signal control framework.