The Improved Ant Colony Optimization Algorithm for MLP considering the Advantage from Relationship

An improved ant colony optimization (ACO) is presented to solve the machine layout problem (MLP), and the concept is categorized as follows: firstly, an ideology on “advantage from quantity” and “advantage from relationship” is proposed and an example is demonstrated. In addition, the strategy of attached variables under local polar coordinate systems is employed to maintain search efficiency, that is, “advantage from relationship”; thus, a mathematical model is formulated under a single rectangular coordinate system in which the relative distance and azimuth between machines are taken as attached design variables. Further, the aforementioned strategies are adopted into the ant colony optimization (ACO) algorithm, thereby employing the inverse feedback mechanism for dissemination of pheromone and the positive feedback mechanism for pheromone concentration. Finally, the effectiveness of the proposed improved ACO is tested through comparative experiments, in which the results have shown both the reliability of convergence and the improvement in optimization degree of solutions.


Introductions
A machine layout problem (MLP) is categorized under a quadratic assignment problem (QAP) which is known as NPhard and unsolvable with traditional optimization methods [1,2].Thus, bionic algorithms which mimic the principles or behaviors of living organisms to achieve optimization in an objective function, have achieved some progress in solving MLP [3,4].For instance, Samarghandi and Eshghi [5] proposed a new method based on tabu search for a single row facility layout problem (SRFLP) and they have reported better solutions than other methods in the literature.Further, Selvakumar et al. were able to optimize the equipment layout by employing an improved artificial neural network [6].Meanwhile, GA improvements, such as in the permutationbased [7] and the reverse constraint satisfied tactics [8], have been applied to determine the optimal solutions as well.Further, the application of swarm intelligence such as artificial bee colony (ABC) [9][10][11], Particle Swarm Optimization (PSO) [12,13], and the ACO [14,15] have contributed significantly to solving combinatorial problems.Nevertheless, literature is widely dominated by applications of the swarm intelligence in tackling MLP, especially, the ACO [16].Ulutas and Kulturel-Konak [17] have indicated that research in MLP is most significant and fruitful.
Notwithstanding all the progress in solving MLP, however, majority of the research concentrates on the smallsize and standardized problems, which are mainly focused on linear placement of rectangular facilities with varying dimensions on some straight lines such as the single row [18] and double row layout [19].Although few researchers tried to solve the multiline and flexible layout problems [20,21], search efficiency and convergence cannot be guaranteed.As pointed out in [22] satisfactory solutions to large-scale problems are difficult to obtain.In addition, as far as the literature is concerned, no research existed on exploring the reasons of inefficiency in convergence and search in the large instance of MLP, except some attempts by Drira et al. [23] and Saravanan and Arulkumar [24].Therefore, research on MLP under a flexible manufacturing environment with minimum constraints is still in a primary stage.As based on the analysis of the key reasons for the inefficiency of search and poor

(Advantage from Quantity) and
(Advantage from Relationship) From optimization perception, two kinds of advantages, named "advantage from quantity" and "advantage from relationship" [25], are constructed based on natural behaviors in insects, animal, or human, and, as the names sound, no such strategy has been reported in the wide literature of computational intelligence.
Advantage from Quantity.It means an advantage usually comes from the quantity of a certain property, which is contingent on the measurement of a certain value.For example, the loading capacity of a lorry depends on its volume; the viability of a giraffe depends on the length of its neck; the survival chance of a locust depends on its similarity in color with grass.Consequently, these examples, the volume, length, and the degree of a certain property are all advantages from quantity.Advantage from Relationship.It is from a relationship, which is not contingent on the independent features of properties but on the relationship among them; for example, the equilibrium of a plane lies not on the independent loading capacity of the front cabin, middle cabin, or the rear cabin but on proportion of them, and the balance of a dragonfly lies not in the weight of the head or the independent value of the length of torso but in the ratio between them.Therefore, from these examples, advantages are contingent on the relationship among properties and, thus, belong to the advantage from relationship.
Furthermore, the major difference between the two kinds of advantages is that the advantage from quantity is convergent in a normal bionic algorithm whereas the advantage from relationship is not, because distribution of values in the feasible regions of these two advantages is quite different.Hence, the differences can be illustrated by examples as follows.
Example 1.Let us determine the values of , , and : From the genetic algorithm, binary design variables are defined as follows: where  = [1 1 1 1 0 1 1 1 0 1 0 1], and then  = 15,  = 7, and  = 5 If the coding method above is adopted and run in 10 iterations, numerous individuals in the population can be updated as  = [1 1 1 1 1 1 1 1 1 1 1 1], whereby the optimal individuals are  = 15,  = 15, and  = 15.Further, if the coding is run 20 times of iterations, all individuals are updated to their optimal position and also stability is maintained.
Again if genetic algorithm principle is adopted, the search efficiency is low, because of the variant factors involved; additionally, the optimal population cannot be maintained because the solution space takes on a status of divergence in further iterations.
The reason for difference can be seen in Example 1, a problem with "advantage from quantity" which has a feasible region with a good property though is monotonic.Moreover, the population formed by fit individuals that are more capable of generating fitted offspring, as such, is shown by the following.
Let us assume that Hence, from (4), individuals 1 and 2 are better than 3 and 4, where their offspring have high possibility of achieving better fitness compared to those from 3 and 4.Therefore, the search process of problem with "advantage from quantity" is convergent and the optimized population is stable.On the contrary, as is seen in Example 2, a problem with "advantage from relationship," where the offspring produced by fitted parents are not better than those produced by random individuals in the feasible region, is shown below: The individuals 1 and 2 are optimal; meanwhile, individuals 3 and 4 are not optimal, but, after crossover operations, individuals updated by 1 and 2 are not optimal whereas those updated by 3 and 4 are likely to be optimal individuals.In addition, for a population formed by fit individuals, those having "advantage from relationship" do not necessarily have to be fit to generate fit offspring, hence, that can lead to inefficiency in convergence and search process.
A machine layout problem (MLP) is a typical problem, with "advantage from relationship."That is, the efficiency of materials flow (logistic) in the machines is not contingent on the independent locations of each machine but on the relationship among them.Further, inefficiency in logistics can be realized still, if a rectangular coordinate system is considered for the logistic in MLP, where the coordinates of locations for machines are changed but relative positions relationships are maintained.On the contrary, efficiency in logistics can be increased if the locations of few machines are changed; meanwhile, other locations of machines are kept still.Therefore, the interaction between the locations of machines and the efficiency in logistics cannot be illustrated by considering rectangular coordinates of machines as design variables only but also by controlling the design variables in order to illustrate the relationship of the relative positions of machines.

Basic MLP Model under Rectangular Coordinate System
A MLP can be described as follows:  machines are arranged in a workshop with the dimensions such as length () and width ().And each geometry of a machine is denoted by a rectangular box whereby  and  are represented by   and   , respectively.In addition, the objective function is a minimization of the total cost of material flow in the machines under geometric constraint of the workspace, where the geometric description of workshop is shown in Figure 1.
The optimization model for minimization of the total cost for material flow (logistic) can be described mathematically as follows: Equation (7) describes the logistic distance between machines  and : Equation ( 8) is for logistic frequency matrix among machines: Equation ( 9) is for logistic distance matrix among machines: Equation ( 10) is used to determine the unit-distance logistic cost matrix among machines: Equation ( 12) is devised for boundary constraints of length and width in the geometric space: Meanwhile, Equations ( 13)-( 14) are for interference and tolerance constraints, respectively, where the tolerance zones are represented by   and   .Therefore, MLP is a typical example of a problem with "advantage from relationship," where the location of a certain single machine makes no meaning to the optimization of a layout, as the logistic efficiency is determined by relative position relationship among machines.In addition, if a mathematical model is formulated based on independent position coordinates of machines, that is, design variables, the reliability and efficiency of the search process will be poor still, and, in order to improve the efficiency and search reliability, a technique of controlling design variables under local polar coordinate systems is proposed; consequently, a correlation between design variables and objective function is effectively demonstrated.

The Attached Design Variables and Mathematical Model under Local Polar Coordinate Systems
In this section, the design variables and mathematical model which influence the performance of ACO are constructed under polar coordinates.Moreover, main objective is improvement by considering a relative position relationship of machines.Firstly, a transformation of the rectangular coordinate geometry into a series of local polar coordinate systems is devised as depicted in Figure 2, in which the first local polar coordinate system is set as in Figure 1; thus, every geometric center of machines is set as a local polar origin, and their local polar axes are directed as -axis.
From Figure 2, the search strategy of the ant colony under local polar coordinate systems can be explained as follows: first, let us assume the machines are in any numbered permutation and say if the location of first machine is determined then the search will automatically go to the next machine that follows, in which search is determine by the azimuth and relative distance of the machines.Additionally, search on a path is completed in a stepwise procedure.Intuitively, design variables and the objective function are significantly correlated.Moreover, fit individuals have high probability to produced fit offspring; as a consequence, the "advantage from relationship" can be maintained in any iteration.Hence, the design variables and objective function can be defined as follows: To clarify more on the position relationship where the distance between two machines under polar coordinate is to be determined, let us assume  machines are denoted as 1, 2, 3, and 4 as depicted in Figure 3.The attached design variables, key parameter   , boundary constraint, and the interference free constraint can be expressed mathematically as follows: where where the formula for calculating distances between machines at positions  and  is Further, expressions that can maintain boundary constraints in abscissas and ordinates of all machines are as follows. Abscissa where  is the sum of center for abscissa,   is the length of machine, and   is the tolerance zone. Ordinate where  is sum of the ordinate centers and   is the width of machine and   the tolerance zone Equations ( 20) and ( 21) are for interference-free constraint among machines.

An Improved ACO Algorithm Based on Attached Design Variables under Local Polar Coordinate Systems
The perceptive unit of a regular ACO algorithm is the small neighborhood around the ant, and here the position relationship of two close ordinal machines is taken as the perceptive unit whereby a search mechanism can be seen as in Figure 4, in which each machine is considered to be a node for state transition and the position relationship between two close ordinal machines as the perceptive unit of an ant.Furthermore, an ant is considered to move along the coordinates to disseminate pheromone, and thereby the location of a machine is determined based on the movement.Additionally, negative feedback mechanism occurs after an ant has disseminated pheromone, and also the concentration of the pheromone is perceived using the positive feedback mechanism.
With the fact that design variables  and  are interconnected, decision on their property is not made on one variable.For instance, for a different value of , the property of design variables can vary, even though the value of  is kept the same.Therefore, the neighborhood of the state nodes is taken as the perceptive area of disseminated pheromone in order to assure the optimized region sustains the property of "advantage from relationship," which is shown as in Figure 5.
Different from regular ACO algorithm, the dissemination of pheromone in this research adopts the inverse feedback mechanism: ants do not disseminate pheromone in the process of search; in addition, the pheromone is updated only after finding the whole path for the machine layout is searched and pheromone is given to the neighbor node by using formula (22) which combines the objective function and a constraint, and also  in (22) lies in shaded area of the graph as in Figure 5.
In formula (22),  is a pheromone value for the path in a neighbor node and is assigned inversely, whereas  is a constant;  1 and  2 are penalty coefficients, and these penalty coefficients take effect when an ant is outside the geometry of the workshop.
where, in (22),  is set to a large number and  to a small number.If overlap is experienced then interferences  3 and  4 are equal to zero,  is redundant, and the reciprocal of  is a large value, and thus, the penalty function works.In case of no overlap, interferences  3 and  4 are not equal to zero, and  is a large value.Hence, the reciprocal of penalty term is rather small; therefore, the penalty function does not work.After the completion of the whole path for machine layout is searched, the disseminated pheromone in the neighborhood of every machine is placed under local polar coordinate.Thereby, an accumulative pheromone space is located in a polar angle of [0, 2] and polar radius [0, √  2 +  2 ] which are under a polar coordinate system.In addition, because the length of the diagonal is the longest linear distance in the workshop, the maximum value of polar radius cannot exceed √  2 +  2 and is graphically depicted in Figure 6 in which the maximum distance an ant must cover under the polar coordinates which corresponds to the geometric movement of the ant under polar coordinates as shown in Figures 4 and 5.
The positive feedback mechanism is adopted to perceive pheromone concentration, whereby machines are considered as nodes; each time the ant passes a node, the pheromone of that node is distributed under the local polar coordinate system and, hence, is used as a probability condition to choose a relative location of a next node.Thus, the pheromone concentration of point in any local polar coordinate system is calculated by where   is the pheromone concentration and   is the pheromone value of a certain point all under the local polar coordinate.The selection criterion for a machine (node) placement is based on the probability given by ( 25), which is under a local polar coordinate.Meanwhile, a minimum error of probability is set and a random point is selected as the placement point.Therefore, from the two strategies aforementioned the placement of any machine will have the following three characteristics: (1) The location of a machine is considered based on the relative location relationship between the predecessor and the successor machine, and that can reflect the relevancy between design variables and the advantage from relationship.
(2) The node with a high concentration of pheromone has a high probability to be chosen as next placement point.
(3) The node with a low concentration of pheromone is not necessarily excluded from the placement point and only has low probability to be selected.Hence, a minimum error of probability exists during a node selection.These conditions are preserved to avoid local optimum solution.
Based on the strategy of local polar coordinate system, pheromone inverse feedback disseminating mechanism and the positive feedback perceiving mechanism mentioned before result in an improvement of the ACO algorithm.

Illustrative Example
In order to illustrate the superiority of improved ACO algorithm under local polar coordinate system, a comparative experiment is performed between GA and ACO and improved ACO are considered under rectangular coordinate system.The data considered in this research have been used by many researchers; thus, numerous experiments have been carried out, and, as a consequence, the results found are good.Further, considering the length of the paper, only one of the cases is detailed in this paper.The case is as follows: eight machines are arranged into a workshop with a length of 36 meters and width of 21 meters as shown in Figure 7.The 1 meter is kept as peripheral length, where all machines are kept away from the workshop walls.In addition, the distance of geometric centers of any two machines is required to be no less than 6 meters.The geometry values for machines placement including tolerance zones are calculated by (26).The unit-distance material flow (logistic) cost matrix is determined by (27) and the logistic frequency among machines is calculated by (28).The experiment for layout is performed by considering generations as the abscissa and logistic cost  as the ordinate.Additionally, the values of logistic cost  and design variables for the optimal individuals in different generations are shown in Table 1.The experimental results of 40000 generations are shown in Figure 8, where genetic algorithm is adopted under rectangular coordinate system.As is seen from Figure 8 after 40000 iterations, there is no sign of convergence and the  value in population fluctuates from around 20000 to 30000.Further, other considerations were made such as cross factors are set from 0.2 to 0.9 and variation factor is set from 0.02 to 0.2; however, the same results are obtained.It is worth mentioning that the best fitness is maintained during the variations of the cross factors and variation factor.Therefore, it is concluded that when the problem has no less than 8 machines, the iteration process is not convergent for a genetic algorithm under rectangular coordinate system.
In Tables 1 and 2, the results obtained by employing GA and regular ACO, respectively, under polar coordinates are shown.The  and  values are for the local optimal value in which a machine layout is to be located, whereas the  value is the cost of material flow (logistic flow) in the machines.And, from these results in Tables 1 and 2, as is seen  values are increasing or fluctuating within a trapped local optimal value as the number of generations is increased, and also more evidence on that is depicted in Figure 9.However, as can be seen in Table 3, the convergence results for the improved ACO are better as can be noticed in  values, when the number of generations is increased.
Furthermore, an experiment is conducted by employing the regular ACO algorithm under rectangular coordinate system, and it was noticeable that the trait is trapped into the local optimal value.However, several experiments are performed and only after 500 iterations is the optimal search found in the local optimal value which is even far from the global solution.The search trait can be seen in Figure 9.In addition, some local optimal value which are obtained from numerous searches are reported in Table 2.
When the improved ACO was run under the same conditions of GA and ACO, in the 750 iterations the optimal-seeking appears to be convergent and finally optimal solution is reached in around 900 iterations.Hence, the  optimal-seeking results of critical iterations are shown in Table 3.As can be seen, after 916 iterations, the optimal solution is obtained which corresponds to the logistic cost 11768.Figure 10 shows reliability results for 25 independent runs executed by the improved ACO algorithm under Cartesian coordinates.Moreover, as can be seen in Figure 11, the infeasible layout during critical iterations is observed.
Further, every machine location has impact on logistic cost; thus, in Figure 11 locations of the machines are different in the layouts; for instance, location of machine 5 in 100 iterations (Figure 11(a)) is different from that in 200 iterations and that supposedly is to change the logistic cost () for the layout when convergence is feasible.Moreover, placement of machine is based on ant movement as depicted in Figure 2, which means that, for the ant to find a better location, the angle and distance between adjacent machines are decisive.

Conclusions
This paper presents an improved ACO based on analysis of the difference between "advantage from quantity" and "advantage from relationship," for the machine layout problem which is featured as "advantage from relationship."There exist a problem of inefficient convergence and search in bionic algorithm when used for solving MLP.Therefore, a methodology for improving ACO is formulated by considering the attached design variables under local polar coordinate.In addition, the positive feedback mechanism of pheromone perception and the inverse feedback mechanism which assigns value inversely at the end of search process significantly contribute to the improvement of ACO algorithm.
Consequently, comparative experiments are performed and the improved ACO algorithm is shown in both the

Figure 1 :Figure 2 :
Figure 1: The geometric description of machine layout problem.

Figure 3 :
Figure 3: The geometric description of the distance between machines.

Figure 4 :Figure 5 :
Figure 4: Ant perceptive unit model based on attached design variables under local polar coordinate systems.

Figure 7 :
Figure 7: The physical dimension of the case.

Figure 8 :
Figure 8: The curve of iterations adopting genetic algorithm under rectangular coordinate system.

Figure 9 :Figure 10 :
Figure 9: The curve of searching adopting regular ACO algorithm under rectangular coordinate system.

Figure 11 :
Figure 11: The layout situation of critical iterations.

Table 1 :
Results of genetic algorithm under rectangular coordinate system.

Table 2 :
Results on different local optimal values obtained in numerous searches.: times of iterations when sinking into the local optimal solution.

Table 3 :
Critical iterations of improved ACO algorithm under local polar coordinate systems.