Flower Pollination Algorithm with Dimension by Dimension Improvement

Flower pollination algorithm (FPA) is a new nature-inspired intelligent algorithm which uses the whole update and evaluation strategy on solutions. For solving multidimension function optimization problems, this strategy may deteriorate the convergence speed and the quality of solution of algorithm due to interference phenomena among dimensions. To overcome this shortage, in this paper a dimension by dimension improvement based flower pollination algorithm is proposed. In the progress of iteration of improved algorithm, a dimension by dimension based update and evaluation strategy on solutions is used. And, in order to enhance the local searching ability, local neighborhood search strategy is also applied in this improved algorithm. The simulation experiments show that the proposed strategies can improve the convergence speed and the quality of solutions effectively.

Flower pollination algorithm (proposed by Yang in 2012) [11] is a new population-based intelligent optimization algorithm by simulating flower pollination behavior.And FPA has been extensively researched to solve Integer Programming Problems [12], Sudoku Puzzles [13], and Wireless Sensor Network Lifetime Global Optimization [14] in the last two years by scholars.It is estimated that there are over 250,000 types of flowering plants in nature.And researchers of biology considered that almost four-fifths of all plant species are flowering species.Flower pollination behavior stems from the purpose of reproduction.From the biological evolution point of view, the objective of flower pollination is the survival of the fittest and the optimal reproduction of species.All these factors and processes of flower pollination interact so as to achieve optimal reproduction of the flowering plants.In nature, pollination can be divided into two parts: abiotic and biotic.Almost 90% pollen grains are transferred by insects and animals; we call this biotic pollination.The other 10% pollen grains are transferred by wind [15,16].They do not need pollinators.And we call this form abiotic pollination.Pollinators can be very diverse; researches show almost 200,000 kinds of pollinators.
Self-pollination and cross-pollination are two different ways of pollination [17].Cross-pollination means pollination can occur from pollen of a flower of a different plant, and self-pollination is just the opposite.Biotic, cross-pollination can occur at long distance; the pollinators such as bees, bats, birds can fly a long distance; thus they can be considered as the global pollinators.And these pollinators can fly as Lévy flight behavior [18], with fly distance steps obeying a Lévy distribution.Thus, this can inspire to design new optimization algorithm.Flower pollination algorithm is an optimization algorithm which simulates the flower pollination behavior mentioned above; flower pollination algorithm can also be divided into global pollination process and local pollination process.

FPA with Dimension by Dimension Improvement
In order to enhance the global searching and local searching abilities, we applied three optimization strategies to basic flower pollination algorithm (FPA); those were local neighborhood searching strategy (LNSS) [19], dimension by dimension evaluation and improvement strategy (DDEIS), and dynamic switching probability strategy (DSPS).

Local Neighborhood Search Strategy (LNSS)
. FPA (developed by Yang and Deb) uses differential evolution (DE) algorithm [20] to do local search.And experiment results show that the local search ability of DE is limited.Thus, we add LNSS to local search process to enhance its exploitation ability.Firstly, we should explain a model (local neighborhood model).In this model, each vector uses the best vector of only a small neighborhood rather than the entire population to do the mutation.We suppose that there exists a differential evolutionary population   = [ 1, ,  2, , . . .,  +1, ], and each  , ( = 1, 2, 3, . . ., ) is a parameter vector, and its dimension is .Each vector subscript index is randomly divided to ensure the diversity of each neighborhood.For each vector  , , we can define a neighborhood, and the radius is  (2 + 1 < ).The neighborhood consists of vector  −, , . . .,  , , . . .,  +, .Assume that the vectors accord the subscript indices in a ring topology structure.We can take  , and  2, as two direct neighbors of  1, .The concept of local neighborhood model is shown in Figures 1 and 2. The neighborhood topology here is static and determined by the collection of vector subscript indices.And the local neighborhood model can be expressed in the following formula: where   best  , is the best vector of  , neighborhood, ,  ∈ [ − ,  + ] ( ̸ =  ̸ = ), and ,  are two scale factors.

Dimension by Dimension Evaluation and Improvement Strategy (DDEIS).
Flower pollination algorithm uses the whole update and evaluation strategy on solutions.For solving multidimensional function optimization problems, this strategy may deteriorate the convergence speed and the quality of solution due to interference phenomena among dimensions.To overcome this shortage, we add this strategy to FPA in local search process.
In FPA, Lévy flight can improve the diversity of population and strengthen the global search ability of the algorithm.But for multidimensional objective function, overall update evaluation strategy will affect the convergence rate and quality of solutions.DDEIS updates dimension by dimension.Assume that objective function is () =  2 1 +  2 2 +  2 3 and  , = (0.5, 0.5, 0.5) is a solution to().

Dynamic Switching Probability Strategy (DSPS).
In FPA, local search and global search are controlled by a switching probability  ∈ [0, 1], and it is a constant value.We suppose that a reasonable algorithm should do more global search at the beginning of searching process and global search should be less in the end.Thus, we applied the dynamic switching probability strategy (DSPS) to adjust the proportion of two kinds of searching process.Switching probability  can alter according to the following formula: where Max iter is the maximum iterations of the DDIFPA and  is current iteration.Specific implementation steps of FPA with dimension by dimension improvement (DDIFPA) can be summarized in the pseudocode shown in Algorithm 2.

Numerical Simulation Experiments
In this section, we applied 12 standard test functions [21] to evaluate the optimal performance of FPA with dimension by dimension improvement (DDIFPA).The mean and standard deviation results of 20 independent runs for each algorithm have been summarized in Table 2.The 12 standard benchmark functions have been widely used in the literature.The dimensions, scopes, optimal values, and iterations of 12 functions are in Table 1.We also do some high-dimensional tests, and the results are showed in Table 3.

Experimental Setup.
All of the algorithm was programmed in MATLAB R2012a; numerical experiment was set up on AMD Athlont (tm) II * 4640 processor and 2 GB memory.

Comparison of Each Algorithm
Performance.The proposed DDIFPA algorithm is compared with mainstream swarm intelligence algorithms FPA [11], PSO [22], DE [23], RCBBO [24], GSA [25], FA [26], CS [27], and ABC [28], respectively, using the mean and standard deviations to compare their optimal performances.The setting values of algorithm control parameters of the mentioned algorithms are given as follows.
DE parameters setting:  = 0.5 and CR = 0.9 in accordance with the suggestions given in [23]; the population size is 100.
ABC parameters setting: limit = 5D has been used as recommended in [22]; the population size is 50 because this algorithm has two phases.
RCBBC parameters setting: maximum immigration rate: I = 1, maximum emigration rate:  = 1, and mutation probability:  max = 0.005 have been used as recommended in [24]; the population size is 100.
CS parameters setting:  = 1.5 and  0 = 1.5 have been used as recommended in [27]; the population size is 50 because this algorithm has two phases.
GSA parameters setting:  0 = 100,  = 20 and  0 which is set to NP and is decreased linearly to 1 have been used as recommended in [25]; the population size is 100.
FPA parameters setting: the population size is 50 because this algorithm has two phases [11].
DDIFPA parameters setting: the population size is 50 because this algorithm has two phases.
From the rank of each function in Table 2, we can conclude that DDIFPA provides many of the best results are better than FPA and other algorithms, especially for functions  01 ,  03 , and  05 .For  01 the mean and standard deviation of DDIFPA are much higher than FPA.For  03 , the mean and standard deviation of DDIFPA are 117 orders of magnitude higher than GSA and 127 orders of magnitude higher than FPA.For  04 , DDIFPA and FPA fail to give the best optimal solution.For  05 , the mean and standard deviation of DDIFPA are 2 orders of magnitude higher than FPA.
Figures 2 and 3 show the graphical analysis results of ANOVA test.As can be seen in Figure 2, when solving function  01 , most of the algorithms can obtain the stable optimal value after 20 independent runs except RCBBO algorithm, and, in Figure 3, when solving the function  05 , DDIFPA is more stable than other algorithms.
Figures 4 and 5 show the fitness function curve evolution of each algorithm for  01 and  05 .From the two figures, we can conclude that DDIFPA has a faster convergence rate and a higher optimizing precision.
For multimodal functions  06 to  10 with many local minima, the final results are more important because these functions can reflect the ability of algorithm to escape from poor local optima and obtain the global optimum.
As can be seen in Table 2, for  06 and  07 , DDIFPA are in first place; ABC achieve the optimal value when solving  07 .For  08 the mean and standard deviation of DDIFPA are 15 orders of magnitude higher than FPA.For  09 , ABC and DDIFPA all achieve the optimal value and the standard  deviations are all 0. For  10 , the mean of DDIFPA is 11 orders of magnitude higher than ABC, and the standard deviation of DDIFPA is 27 orders of magnitude higher than ABC.Figures 6 and 7 show the graphical analysis results of the ANOVA tests.Figure 6 shows that RCBBO, ABC, and DDIFPA can obtain the relatively stable optimal values.Figure 7 shows that when solving function  10 , most of the algorithms can obtain the stable optimal value after 20 independent runs.Figures 8 and 9 show the fitness function curve evolution.From Figure 9, we can conclude that both ABC and DDIFPA converge to the optimal solution.From Figure 9, we can conclude that DDIFPA converges to a more precise point than other algorithms, and its convergence speed is faster.
From Table 2,  11 and  12 are multimodal lowdimensional functions.For  11 , the solutions of most of the algorithms are accurate in 3 to 4 decimal places, and the rank of DDIFPA is second.For  12 , the rank is second too, and the experiment results show that DDIFPA can do a good job in solving multimodal low-dimensional problems.

Experimental Analysis.
We have carried out benchmark validations for unimodal and multimodal test functions using the proposed algorithm (DDIFPA) with three improvement strategies (local neighborhood search strategy, dimension by dimension evaluation and improvement strategy, and dynamic switching probability strategy).An optimization [0, 10] −10.5364 100 process can be divided into two key components (local search and global search); we use a dynamic switching probability  ∈ [0, 1] to control the whole searching process.LNSS and DDEIS are applied to the local search process and enhance its exploitation ability.Among 12 test functions listed above,  01 to  05 are unimodal, and the remarkable achievements confirm that DDIFPA have stronger exploitation ability than FPA and other algorithms.And DSPS, which could improve the ability of escape from poor local optima, was applied to enhance the exploration ability.That also balanced exploitation and exploration dynamically.For multimodal benchmark functions ( 06 to  12 ), we can conclude that DDIFPA converges to a more precise point than other algorithms, and its convergence speed is faster.Our simulation results for finding the global optima of various test functions suggest that DDIFPA can outperform the FPA and other mentioned algorithms in terms of both precision and convergence speed.

High-Dimensional Functions Test.
In previous sections, 12 standard test functions are applied to evaluate the optimal performances of the FPA with dimension by dimension improvement (DDIFPA) in the case of low dimension.
In order to evaluate the performances of DDIFPA comprehensively, we also do some high-dimensional tests in  1 ,  2 ,  4 ,  7 ,  10 .The test results are shown in Table 3.As can be seen in Table 3, DDIFPA can also solve high-dimensional problems efficiently and stably.

Conclusions
In this paper, three optimization strategies (local neighborhood search strategy, dimension by dimension evaluation and improvement strategy, and dynamic switching probability strategy) have been applied to FPA to improve its deficiencies.By 12 typical standard benchmark functions simulation,    optimization problem.In addition, many engineering design problems are typically difficult to solve.The application of the proposed FPA with dimension by dimension improvement in engineering design optimization may prove fruitful.

Table 2 :
Experiment results of bench mark functions for different algorithms.

Table 3 :
High-dimensional functions test results.