Multipath Adaptive Tabu Search for a Vehicle Control Problem

1 Control and Automation Research Unit, Power Electronics, Machines, and Control Research Group, School of Electrical Engineering, Suranaree University of Technology, Nakhon Ratchasima 30000, Thailand 2 Department of Electrical Engineering, Rajamangala University of Technology Lanna Tak, Tak 63000, Thailand 3 Department of Electrical Engineering, South-East Asia University, Bangkok 10160, Thailand


Introduction
The tabu search TS 1 , one of the most widely used local search techniques, was proposed to solve the combinatorial optimization problems.The TS is based on the neighbourhood search approach and adaptive memory.With the common deterministic scheme, the search process of the TS is commonly based on the recency and the frequency approaches 2, 3 .The high-quality solution found by each search round is stored in the tabu list TL .In case of entrapment deadlock problems caused by some local minima, the elite solutions stored in the TL are retrieved according to the aspiration criteria AC for starting a new search such that the search could be released from the deadlock.By literatures, the TS has been successfully applied to solve optimization problems in various fields, for examples, power systems 4, 5 , transportation 6 , flow shop 7 , food processing 8 , and so forth.However,

Adaptive Tabu Search Algorithms
Regarding the original TS as the predecessor, the adaptive tabu search ATS consists of two additional mechanisms, that is, the backtracking BT regarded as a diversification strategy and the adaptive search radius AR regarded as an intensification strategy.The ATS begins the search with some random initial solutions belonging to an entire search space.In practice, the users may implement heuristically seeded initial solutions instead.All solutions in a neighbourhood search space within a certain search radius are evaluated via the objective function.The solution giving the minimum objective value cost value is set as a new starting point for the next search round and memorized in the tabu list TL .According to the original TS algorithm and the TL property, the visited search spaces or visited solutions are prohibited for consecutively generated solutions.These search spaces are remarked as tabu.However, once the search is held by a local minimum deadlock problem , the BT is activated.The BT looks up the TL and selects one of the memorized solutions as a new starting point.A new search could begin in a new direction.Hence, the search can possibly be released from the deadlock, and the search proceeds towards a better local minimum.Once the search approaches an elite local solution, the AR is invoked to speed up the search Step 0: Initialization solution, AC, TC, TL and iteration counter.Step  Step 3: Return to ATS Exit BT and return to ATS.
Step 1: Retrieving Set the solution from step 1 as the next solution of c Reduce the search radius by an amount related to the cost value.
If the AR criterion is not met, use the default search radius and exit AR.
Step process.The search radius is subsequently decreased in accordance with the cost value of the current solution to provide finer and finer solutions within a short duration.The less the cost value, the smaller the search radius becomes.With these two mechanisms, a sequence of solutions obtained by the ATS is efficiently and rapidly converged towards the global minimum.Figure 1 expresses the generic algorithms of the original TS and the ATS with the BT and the AR mechanisms, respectively, while Figure 2 depicts the diagram representing some movements of the ATS.Both figures give a clear view for the reader to follow.Following the recommendations 30 , the parameter settings of the ATS for each tested function are declared in the Table 2, where Re max is the maximum allowance of the solution cycling before invoking the BT, kth is the backward-selected solution by the BT, count max is maximum search round, R is search radius, J is the cost value, and J min is minimum cost value used as the termination criteria TC for all tests in order to assure the global minimum found.The performance tests were conducted 50 trials against each tested function to obtain the average search round and time consumed.Each trial starts with a random initial solution generated by MATLAB using a seed number.The initial solution forms the center of a uniformly distributed hypersphere of a given radius, from which a neighbourhood is generated.The ATS stops when J < J min or count ≥ count max .

Performance Evaluation of the ATS
The results obtained are summarized in Table 3, where the first row stands for the average time consumed, the second row is the average search round, and the third row expresses the average time consumed per one search round.It is found that the ATS yields very satisfactory search performance in terms of solution convergence and the search time consumed for all surface optimization problems.

Multipath Adaptive Tabu Search (MATS)
In order to improve the search performance of the ATS, one may utilize an exploration strategy proposed by this paper.The implementation is suitable for use on a single CPU platform.The proposed MATS consists of partitioning, sequencing, and discarding mechanisms PM, SM, and DM , respectively.Each mechanism is described next.
Load number of search paths, N, and original search space.
Step 1: Search parameters loading

Partitioning Mechanism (PM)
This mechanism operates only once at the beginning of the search.The PM starts with decomposing the entire search space into a number of sub-search-spaces defined by the user.The PM also defines explicit boundaries for the sub-search-spaces, each of which is given an individual initial solution and an independent ATS path.Since all ATS paths as the search cores of the MATS use the same set of search parameters, this approach is referred to as the multiple points single strategy MPSS .Just before launching the search paths, the PM removes the predefined boundaries such that all ATS paths could search freely on the originally entire search space.This technique helps to reduce any conflicts that may arise during the search along the border lines.Figure 3 summarizes the PM procedures.
As an example, the surface of the Shekel's foxholes function SF partitioned into 4 sub-search-spaces is shown in Figure 4.The boundaries of the sub-search-spaces are defined in the form of upper limit of the 1st variable upper limit of the 2nd variable ; lower limit of the 1st variable lower limit of the 2nd variable .
Regarding this notion, the entire search space can be defined as 40 40;−40 −40 , and the sub-search-spaces #1, 2, 3, and 4 are confined within 40 40; 0 0 , 0 40; −40 0 , 0 0; −40 −40 and 40 0; 0 −40 , respectively.In practice, any geometrical forms and coordinates are possible for the partitioning process to suit the applications.The number of sub-search-spaces must be finite and not too great, and the problem dimensions are not limited.Subsequently, an ATS path is assigned to each sub-search-space, and the boundaries are then removed.

Sequencing Mechanism (SM)
As mentioned earlier, the proposed MATS is intended for the use on a single CPU platform.
Since the MATS possesses a few to many search paths, it needs some organizing mechanisms for its correct sequential operations.The SM is implemented to accomplish this, and can be represented by the simple diagram in Figure 5. Assuming that there are n search paths organized by the SM, the first ATS path #1ATS begins its first trial.Afterward, it goes to the wait state.Once the CPU finishes its service to the #1ATS, it provides the service to the second path.Once the #2ATS finishes its first search trial, it has to wait.The operation goes on in this manner until the #nATS finishes its first search trial.The CPU then returns to service the #1ATS for its second search trial, then the #2, #3, . . .and #nATS, in sequential manner.The operation is repeated until one of the ATS paths hits the solution, and requests for exiting the search according to the satisfied termination criterion.Either an equal or an unequal number of search rounds constitutes one search trial.The works by this paper utilize an equal number of search rounds for all ATS paths to work on one search trial.Readers may notice that organizing the search this way, more search paths would result in more wait states making the search process very time consuming.Hence, the number of search paths employed must be limited.Moreover, another mechanism, namely, the discarding mechanism DM is introduced and explained in the next section.With the DM, as time goes by, more and more search paths will be cut off from the search process until only one path is left to continue searching for most cases.However, an individual ATS can request for a complete termination once the global solution is found at any time.The SM needs to communicate with the DM to learn about the existing and the forcedly terminated or discarded ATS paths.Thus, the SM can be summarized by the procedures shown in Figure 6.

Discarding Mechanism (DM)
The DM is designed to reduce the overall search time of the MATS based on the idea of forcing some low-quality search paths to stop as soon as possible.Various possible approaches can be used to implement this idea including evaluation of the search-path quality based on the cost values of the current best-solutions or a set of previous elite solutions of the specific Communicate with the DM to receive information .
Step 1: Communicating concerning the discarded search paths.
Step 2: Organizing search Launch all existing search paths one-by-one for each trial in a sequential manner.
Exit the search iff the TC is met, otherwise go to step 1.

Figure 6:
The SM procedures.
Keep the search paths from the top to the middle of the sorted list as active, terminate the rest of the search paths.
Transfer information and search control to the SM.
Step  search path, the probability or the possibility of the search path to hit some higher quality solutions, and so forth.A simple implementation of the recency strategy via the evaluation of the cost values of the current best-solutions of the search paths is demonstrated.Each time the DM operates, the number of search paths is reduced by half.However, the number of search paths to be reduced can be arbitrarily adjusted to suit an application.After this forced termination made to the low-quality paths, the DM transfers the information concerning the being-terminated and the existing paths to the SM. Figure 7 summarizes the DM procedures.
According to the previous explanation, the MATS algorithms can be described by the list in Figure 8 due to the fact that the ATS is used as the core search algorithms.

Performance Evaluation
Evaluation of the performance of any search algorithms can be done in several ways, for example, using data mining, logistic, surface optimization problems, and so forth.The works reported here have applied the six surface optimization problems described in Section 2 for the purposes.These test functions are referred to shortly as the BF, RF, SF, ShF, ScF#1, and ScF#2, respectively, and summarized by the Table 1.Performance comparisons are made among the ATS, the MATS with 2, 4, 8, 16, 32, and 64 paths denoted as MATS#2, MATS#4, MATS#8, MATS#16, MATS#32 and MATS#64, respectively.
The PM and the DM settings are rather complicated for the performance investigations.The SM simple settings can be either fixed or adjustable search rounds for each ATS path.The fixed numbers of search rounds as well as the same ATS search parameters have been used throughout the studies.As mentioned earlier, the proposed MATS employs the multiple points single strategy MPSS method.
Release all search paths to perform freely on the original search space.
Exit with the global optimum solution if the TC is (are) met, otherwise go to step 1.
Step 0: Initialization (PM, SM and ATS) Decompose the search domain, initialize all ATS paths.
Step 1: Iteration (SM and ATS) Perform sequential search using ATS.The PM settings are now explained by referring to Table 4, which declares the boundaries of the sub-search-spaces for 2, 4, . . ., 64 paths.As an example, consider the ShF having its entire space defined by 10 10; −10 −10 .For MATS#32, the ShF is decomposed into #1 10 10; 7.5 5 for the 1st region, #2 7.5 10; 5 5 for the 2nd, #3 5 10; 2.5 5 for the 3rd, and so on.The similar approach for space partitioning can be applied to the other surface functions.In addition, other geometric partitioning techniques and coordinates could be employed to suit particular applications.
The DM employs the recency strategy by comparing the cost values of the current bestsolutions of the ATS paths.Only the paths with the cost values lower than a preset limit are kept, otherwise they are discarded.The number of the paths being discarded can be set in the manner of either a gradual cut or a sudden cut.For the MATS with many search paths, the sudden cut is preferable such that the wait-state time be minimum.For a moderate to a few numbers of search paths inside the MATS, the gradual cut is more suitable.Table 5 reveals the DM settings in details.Let us consider the SF case of 8, 32, and 64 paths as examples.For the case of SF with MATS#8, the DM becomes active firstly at the 2nd iteration, and 4 search paths are discarded.The DM becomes active again at the 4th and 6th iterations; 2 and 1 paths are forced to stop, respectively.Eventually, there is 1 path left to continue searching.This is one example of using the gradual cut technique.Different approaches, that is, the sudden cuts, are found for the cases of MATS#32 and #64.At the 1st iteration of both cases, 31 and 63 search paths are discarded correspondingly.This means that only one path is left after the 1st iteration to track down the solution as for the cases of MATS#32 and #64.It is found in some cases, that is, the ShF problem, that good performances are obtained via having more than one path left for searching and competing for solutions.Note that, for an effective operation, the qth iteration at which the DM is invoked should be less than half of the average search rounds consumed by the single path ATS SR ATS .The SR ATS data are presented in row 2, Table 3. Due to the fact that the MATS utilizes more than 1 search path, the inequality k i 1 dm i × n i < SR ATS must hold.Consider the case of BF with MATS#4, k i 1 dm i × n i 5 × 4 10 × 2 < 556, for instance.The investigations of the search performance of the proposed MATS were conducted against the six surface optimization problems on the Intel Celeron R , 2.6 GHz, 250 MB-RAM and 30 GB-HDD platform.Each figure of the results reported herein is an average of 50 trials.Tables 6-9 reveal the detailed results.The averages of search rounds are summarized in Table 6.However, the figures do not disclose the actual activities performed by the ATS used as the search core of the MATS.These figures are therefore converted into the equivalent BF and RF 0 2; −2 −2 #1 2 2; 0 −2 #1 2 2; 0 0 #1 2 2; 1 0 #1 2 2; 1 1 #1 2 2; 1.5 1 #1 2 2; 1.5 1.5 #2 0 2;−2 −2 #2 0 2;−2 0 #2 1 2; 0 0 #2 1 2; 0 1 #2 1.5 2; 1 1 #2 1.5 2; 1 1.5 #3 0 0;−2 −2 #3 0 2;−1 0 #3 0 2;−1 1 #3 1 2; 0.5 1 #3 1 2; 0.

Table 5:
The DM settings.averages with-respect-to the ATS as shown in the Table 7. Noticeably, all cases, but the ScF#2, the MATS search rounds are actually less than those performed by the single path ATS.The average values of search time tabulated in Table 8 also confirm this.The figures indicating search time in seconds in Table 8 are  The percent reduction figures summarized in Table 9 reflect the merits of the MATS.The proposed MATS can effectively reduce the search time in the range of 4.08-56.79%,except that it is not efficient for the ScF#2 problem.Among the six test functions, only the ScF#2 is actually smooth over the entire search space whereas the MATS is not aimed for.The conventional optimization methods should be favourable to this kind of problems.The contemporary search methods, for example, the MATS and those of the local search algorithms, and so forth, are more suitable to the problems having Pareto front, nonsmooth surfaces, and multiple global solutions in nature.The numeric figures in Table 9 are displayed as bar graphs in Figure 9 to give a clear view of the merits of the MATS whereas the negative values indicate the nonproductive domain of the MATS.
To complement the revealed results, the cost values are also monitored and plotted as the convergence curves illustrated in Figure 10, for instance.Referring to Figure 10, the accepted solutions must have the costs of less than 1e-9; the ATS hits the solution within 5.7650 s.; path#1 of the MATS#2 succeeds within 5.3440 s.; path#3 of the MATS#4 succeeds within 4.7500 s., and so forth.At present, it can be said that the proposed MATS performs faster than the single-path ATS; its speed for the best case on a single CPU platform is twice as much of the ATS speed; for the worst case its performance is about the same as the ATS, and the MATS can effectively reduce the search time by 30% as an average figure.

An Application: Car Control System in Roadway Simulator
This section presents the application of the proposed MATS algorithms for solving a realworld control problem of a car model.
The Illinois Roadway Simulator IRS has been proposed 36 to study the effects of road surface on car dynamics.The IRS is a reduced scale car model for a laboratory use.It  possesses the dynamics very similar to those of an actual car.In this, the yaw rate control is the issue of interest.The transfer function models of the IRS have been developed by applying the Buckingham-Pi theorem as well as system identification.The obtained transfer functions consist of the plant dynamic G and the disturbance dynamic G d constituting

5.1
Note that the controllers G ff and G fb have the same poles.Referring to Figure 11, the system transfer function, G irs can be expressed as where the coefficients a i , i 0, 1, 2, . . ., 27 and b i , i 0, 1, 2, . . ., 23 are summarized in Table 10.The unit step response of the original control system is depicted in Figure 12.The response possesses 40 ms delay time, and smoothly rises to the final value in 0.552 s.
To compensate for the delay time, an additional PD-controller is proposed in cascade connection to the G ff .The theoretical PD-controller of the form G PD K D s K P is considered.Thus, the G ff block is modified to be G PD • G ff .The design of the PDcontroller is not straight-forward because of the complexity of the existing control system structure.So, the search method has been applied to find an optimum PD-controller such that the following objectives are satisfied: P.O.< 0.1% no overshoot preferred , risetime t r < 0.231 s., and settling-time t s < 5t r s.The control design problem becomes a multiobjective optimization problem in which the surrogate objective function, J, is formed such that J α 1 t sj α 2 t rj α 3 P.O., 5.4 where t rj % rise-time normalized , t sj % settling-time normalized , P.O.% overshoot, and α 1 , α 2 , and α 3 weighting factors.In this application, the factors α 1 α 2 α 3 1, and the penalty concept is applied to t rj , t sj , P.O. and J, respectively.Figure 13 provides the list of the objective function procedures.
The max-min ranges of both K P and K D for the search are 2, 0 .The MATS with two ATS-paths is used with the following settings: 2 2; 1 0 and 1 2; 0 0 for the PM, and the qth iteration 50 for the DM.The initial solutions for the ATS#1 and #2 are K P 1.824, K D 0.153 and K P 0.329, K D 0.776 , respectively.The search parameters of the ATS are as follows: initial R 0.2, N 5, N re max 5, kth backward for the BT 5, J < 90 → R 0.1 and J < 70 → R 0.05 for the AR, and count max 10, 000 or J < 65 for the TC.As a result shown in Figure 14, path#1 of the MATS#2 spent 217.1648 s to track down the solutions K P 1.0 and K D 0.07 at the 326th iteration with the cost J 61.7234.Figure 15 illustrates the step responses of the original and the enhanced systems for comparison purposes.It can be observed that the delay time is reduced by 97%, and the rise-time and settling-time are reduced by 30%, approximately.

Conclusion
The development of the multipath adaptive tabu search MATS has been reported by this paper.The algorithms incorporates the partitioning, sequencing, and discarding mechanisms, respectively, to the ATS, and can be run efficiently on a single CPU platform as being confirmed by the detailed performance assessment results using the well-known surface optimization problems.According to the assessment results, the MATS is about two-times faster than the ATS as the best case.Moderately, the MATS renders 30% reduction in the search time compared to the ATS.However, the MATS is not suitable for some smooth problems as it consumes more search time than the single ATS does.The paper has been Simulate the control system.
Calculate the cost value and exit.

1 :Figure 1 :
Figure 1: Generic algorithms of the TS and the ATS: a generic TS algorithms, b generic ATS algorithms, c the BT mechanism of the ATS, and d the AR mechanism of the ATS.

Figure 2 :
Figure 2: Movements of the ATS.

Step 2: Partitioning Step 3 :
Initial solutions generatingPartition the search space into N sub-search-spaces.Generate initial solutions for each sub-search-space and remove partitions.

Figure 5 :
Figure 5: Diagram representing n paths of the ATS.

1 :
Cost values loading all active search paths.Step 2: Sorting Do min-max sorting of the cost values.Step 3: Discarding.Step 4: Transferring Load cost values of the current best-solutions of
qth iteration at which the DM is invoked and the number of discarded path s converted into percent reduction of search time using the following relation for comparison purposes: Percent reduction of search time average search time of ATS − average search time of MATS average search time of ATS ×100 4.1

Figure 9 :
Figure 9: Bar graphs of the reduction of search time in percentages.

Step 1 :
Input argument loading Load values of K P and K D as input arguments.Step 2: Simulation Return step response as the simulation results.Step 3: Performance extraction Extract P.O., rise-time and settling-time from the output.Step 4: Cost generation

Figure 13 :
Figure 13: The objective function procedures for the control problem.

Figure 14 :
Figure 14: Convergence curves of the PD-controller design problem.

Figure 15 :
Figure 15: Comparison of the step responses.

Table 1 :
Summary of the surface optimization problems.

Table 2 :
Setting of the ATS search parameters.

Table 3 :
Results of the ATS's performance evaluation.

Table 4 :
Sub-search-spaces partitioned by PM.

Table 6 :
Average values of search rounds.

Table 7 :
Equivalent average search rounds with respect to the ATS.

Table 8 :
Average values of search time in seconds.

Table 9 :
Percent reduction of search time.

Table 10 :
The coefficients of the transfer function in 5.3 .