Multiobjective Differential Evolution Algorithm with Multiple Trial Vectors

and Applied Analysis 3 Definition 2.3 decision vector relations of domination . If the decision vector z z1, z2, . . . , zn Pareto-dominates w w1, w2, . . . , wn if and only if f z Pareto is superior to f w , we call the decision vector z Pareto-dominatingw or the decision vectorw is Pareto dominated by z. Definition 2.4 Pareto optimal solution . Decision vector xu ∈ F F is the feasible solution set is a Pareto optimal solution, if and only if an individual does not exist in the feasible solution set F dominate xu, then xu is called the MOPs’ Pareto optimal solution, or xu is called the MOPs’ nondominated optimal solution. The set of all Pareto optimal solution is known as the MOPs’ Pareto optimal solution set or nondominated optimal solution set. Definition 2.5 Pareto front . For given MOPs, Pareto optimal solution set corresponding to the objective function value vector is known as the MOPs’ Pareto front. Therefore, our task is to make the current nondominated optimal solution set as close as possible to the theoretical Pareto optimal solution set, from the view of Pareto front is to ask the Pareto front as possible as close to the theoretical Pareto front and uniformly distributed. Definition 2.6 individual nondominant relationship sort, INDR . There are n individuals in the population P . For each individual xi, i 1, 2, . . . , n, Si represents the set of individuals that are dominated by xi, ni represents the number of individuals dominating the individual xi. Finally, if ni 0, then xi belongs to the first level. The sequence of xi is ranki 1, xi joined to F1 F1 indicates the individual set of ordinal value is 1 . The counter of the initial sequence value rank 1, if Frank / φ, Frank represents the set of individuals’ sequence value rank 1 each individual xi in Frank, each individual xi, nj nj − 1 in the corresponding Si. Finally, if ni 0, then xj belongs to the rank 1 level. The sequence value of xj is rankj rank 1. Update sequence value’s counter rank rank 1, xj joined to Frank. As a result, we can calculate the ordinal value of each individual in the population P . Definition 2.7 the same level of individuals’ crowding distance ICD . Let I be a set of individuals of a certain grade. All the targetm m 1, 2, . . . individuals are sorted according to the objective function value in I. The first and the last individuals’ crowding distances are infinite. The other individuals’ crowding distance is calculated as subtract the two neighbor individuals’ objective function and then square it. Then sum the crowding distance on all objective functions as the individuals’ crowding distance. The individuals are sorted according to crowding distance in the same level. 3. Multiobjective Differential Evolution Algorithm with Multiple Trial Vectors (MTVDE) 3.1. The Mutation Operation Mutation components are difference vectors of the parent generation. Each vector is generated by the different individuals in the parent population. The mutation operation on the basis of the difference vector and its equation is vi1t xit F xr1t − xr2t , vi2t xr1t F xr2t − xr3t , vi3t xit F xr1t − xr2t F xr3t − xr4t , 3.1 4 Abstract and Applied Analysis where vi1t, vi2t, vi3t are the mutated individuals, xit is individual of parent population. xr1t, xr2t, xr3t, xr4t are different from each other, and they are different from xit. F ∈ 0, 2 is the scaling factor. It indicates the influence degree of the difference vector to the offspring. From the mutation operator, each individual in parent population produces three individuals through the mutation operator, which can enhance the diversity of the population. The value of F has a certain influence on the algorithm performance. If F is too large, the convergence rate slows, and the algorithm runs longer. If F is too small, the diversity of the population decreases, according to experimental tests, and F is often set to 0.5. 3.2. Crossover Operator The mutated individual vi t 1 , i i1, i2, i3 , and the individual xi t in parent population use the crossover operator to generate the trial individual ui t 1 , i i1, i2, i3 . The crossover operator is expressed as uij t 1 ⎧ ⎨ ⎩ vij t 1 , if rand 0, 1 ≤ CR or ( j rand i 1, D ) , xij t , otherwise, 3.2 where rand 0, 1 is an uniformly distributed random number between 0, 1 , rand i 1, D is the integer randomly selected from {1, 2, . . . , D}, which can insure at least one ui t 1 is from vi t 1 . CR ∈ 0, 1 is the crossover probability. It is used to control the variable in ui t 1 to be from vi t 1 or xi t . If CR 1, then ui t 1 vi t 1 . 3.3. Selecting Operation For MOPs, this paper uses the following criteria to select the next evolution population. 1 For each individual in the parent population, three different mutated operators and a crossover operator are used to produce three trial individuals. For the three trial individuals and the parent individual, the one who Pareto-dominates another is retained in the intermediate population. If the two individuals do not dominate each other, both are retained. 2 Some low-quality individuals in the intermediate population need elimination. Individuals are sorted in the intermediate population according to the Pareto dominance relations and the crowding distance of individuals. First of all, the individuals are divided into several levels according to the non-dominant relations in the intermediate population. Individuals in the same level are sorted according to the crowding distance. We choose the former NP individuals to form the next evolution population. 3.4. MTVDE Description of the Algorithm Step 1. Set the basic parameters: the population size NP, the scaling factor F, the maximum evolution generation, and the crossover probability factor CR. Abstract and Applied Analysis 5and Applied Analysis 5 Step 2. Initialize the population. Step 3. Mutation is according to the mutation operation 3.1 to generate three variation individuals. Step 4. Crossover is according to the crossover operation 3.2 to generate three test individuals. Step 5. Select the next evolution population. Step 6. If the maximum iteration is reached, stop and output optimal solution, otherwise return to Step 3. 4. Numerical Experiments 4.1. Algorithm Performance Evaluation Criteria Multiobjective optimization algorithm performance can be evaluated by two criteria. 1 The obtained nondominated optimal solution set needs to be as close as possible to the true Pareto front. 2 The obtained nondominated optimal solution set need as possible as uniformly distribute to the true Pareto front. The two indexes are used to test the convergence and distribution of the solution set, respectively. The definitions of the approximation index and the uniformity index are given below. a Approximation index is defined as follows:


Introduction
Multiobjective optimization problems MOPs are different from single objective optimization problems SOPs .For MOPs, the objective functions are often conflict, so the best solution often does not exist.It is difficult to find the optimal solution.The MOPs need to find a noninferior solution set that is called Pareto optimal solution set or nondominated optimal solution set .The key is to find a solution set which is as close to the Pareto front and uniformly distributed as possible.In the past ten years, evolutionary algorithms have been widely used for solving multiobjective optimization problems.The typical algorithm contains NSGA 1 , NSGA-II 2 , SPEA 3 , SPEA2 4 , and so on.
Differential evolution DE 5 is an important branch of the evolutionary algorithms.Because of its easiness to use and robustness, it has been widely applied in many fields.The basic DE algorithm is a greedy algorithm and is used to solve the SOPs.The individual choice is based on the objective function value.In solving MOPs, the objective function value is a vector value and the individual choice is based on the vector value.Some scholars have improved DE algorithm to solve MOPs.Abbass et al. 6 proposed a differential evolution algorithm based on the Pareto front's PDE to solve MOPs.Later, the PDE algorithm is improved to an adaptive PDE algorithm SPDE 7 .Madavan

Multiobjective Optimization Problem and Related Concepts
Below, we give several concepts related to this paper.Because the maximum optimization problems and minimum optimization problem can be transformed into each other, here we only consider the minimum multiobjective optimization problem.Definition 2.1 multiobjective optimization problems, MOPs .The MOPs are described as follows: where y ∈ R k indicates the target vector, x ∈ R n indicates the decision vector, X indicates decision space of the decision vector x, Y indicates the target space of the target vector y.
Definition 2.2 the dominance relationship of the target vector .The target vector u u 1 , u 2 , . . ., u k is better than v v 1 , v 2 , . . ., v k if and only if for all i ∈ 1, 2, . . ., k u l ≤ v l and there exists at least one i ∈ 1, 2, . . ., k such that u i < v i was established, then the target the vector u Pareto better than v, or v Pareto inferior to u. Definition 2.3 decision vector relations of domination .If the decision vector z z 1 , z 2 , . . ., z n Pareto-dominates w w 1 , w 2 , . . ., w n if and only if f z Pareto is superior to f w , we call the decision vector z Pareto-dominating w or the decision vector w is Pareto dominated by z.Definition 2.4 Pareto optimal solution .Decision vector x u ∈ F F is the feasible solution set is a Pareto optimal solution, if and only if an individual does not exist in the feasible solution set F dominate x u , then x u is called the MOPs' Pareto optimal solution, or x u is called the MOPs' nondominated optimal solution.The set of all Pareto optimal solution is known as the MOPs' Pareto optimal solution set or nondominated optimal solution set.Definition 2.5 Pareto front .For given MOPs, Pareto optimal solution set corresponding to the objective function value vector is known as the MOPs' Pareto front.Therefore, our task is to make the current nondominated optimal solution set as close as possible to the theoretical Pareto optimal solution set, from the view of Pareto front is to ask the Pareto front as possible as close to the theoretical Pareto front and uniformly distributed.

Definition 2.6 individual nondominant relationship sort, INDR .
There are n individuals in the population P .For each individual x i , i 1, 2, . . ., n, S i represents the set of individuals that are dominated by x i , n i represents the number of individuals dominating the individual x i .Finally, if n i 0, then x i belongs to the first level.The sequence of x i is rank i 1, x i joined to F 1 F 1 indicates the individual set of ordinal value is 1 .The counter of the initial sequence value rank 1, if F rank / φ, F rank represents the set of individuals' sequence value rank 1 each individual x i in F rank , each individual x i , n j n j − 1 in the corresponding S i .Finally, if n i 0, then x j belongs to the rank 1 level.The sequence value of x j is rank j rank 1. Update sequence value's counter rank rank 1, x j joined to F rank .As a result, we can calculate the ordinal value of each individual in the population P .

Multiobjective Differential Evolution Algorithm with Multiple Trial
Vectors (MTVDE)

The Mutation Operation
Mutation components are difference vectors of the parent generation.Each vector is generated by the different individuals in the parent population.The mutation operation on the basis of the difference vector and its equation is where v i1t , v i2t , v i3t are the mutated individuals, x it is individual of parent population.
x r 1 t , x r 2 t , x r 3 t , x r 4 t are different from each other, and they are different from x it .F ∈ 0, 2 is the scaling factor.It indicates the influence degree of the difference vector to the offspring.From the mutation operator, each individual in parent population produces three individuals through the mutation operator, which can enhance the diversity of the population.
The value of F has a certain influence on the algorithm performance.If F is too large, the convergence rate slows, and the algorithm runs longer.If F is too small, the diversity of the population decreases, according to experimental tests, and F is often set to 0.5.

Crossover Operator
The mutated individual v i t 1 , i i 1 , i 2 , i 3 , and the individual x i t in parent population use the crossover operator to generate the trial individual u i t 1 , i i 1 , i 2 , i 3 .The crossover operator is expressed as where rand 0, 1 is an uniformly distributed random number between 0, 1 , rand i 1, D is the integer randomly selected from {1, 2, . . ., D}, which can insure at least one u i t 1 is from v i t 1 .CR ∈ 0, 1 is the crossover probability.It is used to control the variable in u i t 1 to be from v i t 1 or x i t .If CR 1, then u i t 1 v i t 1 .

Selecting Operation
For MOPs, this paper uses the following criteria to select the next evolution population.

MTVDE Description of the Algorithm
Step 1. Set the basic parameters: the population size NP, the scaling factor F, the maximum evolution generation, and the crossover probability factor CR.
Step 2. Initialize the population.
Step 3. Mutation is according to the mutation operation 3.1 to generate three variation individuals.
Step 4. Crossover is according to the crossover operation 3.2 to generate three test individuals.
Step 5. Select the next evolution population.
Step 6.If the maximum iteration is reached, stop and output optimal solution, otherwise return to Step 3.

Algorithm Performance Evaluation Criteria
Multiobjective optimization algorithm performance can be evaluated by two criteria.
1 The obtained nondominated optimal solution set needs to be as close as possible to the true Pareto front.
2 The obtained nondominated optimal solution set need as possible as uniformly distribute to the true Pareto front.
The two indexes are used to test the convergence and distribution of the solution set, respectively.The definitions of the approximation index and the uniformity index are given below.
a Approximation index is defined as follows: where n is the number of vectors in the set of nondominated solutions found so far, d i is the Euclidean distance measured in objective space between each of these solutions and the nearest member of the Pareto optimal set.d i is calculated as d i min{|X i − Y j |, j 1, 2, . . ., N}, where N denotes the total number of the true Pareto front vectors, X i denotes the nondominated optimal solutions set, Y j denotes the true Pareto front, and | • | denotes Euclidean distance.The value of γ is smaller, the degree of algorithm approximating to true Pareto front is higher.It is clear that a value γ 0 indicates that all the generated elements are in the Pareto front.
b The uniformity index is defined as follows: where d i is the Euclidean distance between neighboring solutions in the obtained nondominated solutions set and d is the mean of all d i .The parameters d f and d l are the Euclidean distances between the extreme solutions and the boundary solutions of the obtained nondominated set.d f is calculated as , where X f is the leftmost vector of obtained nondominated optimal target vector, Y f is the leftmost vector of theoretical Pareto front.d l is calculated as , where X l is the rightmost vector of obtained nondominated optimal target vector, Y f is the rightmost vector of theoretical Pareto front, | • | denotes Euclidean distance.The value of Δ is smaller, the degree of obtained nondominated solutions' diversity and uniform distribution is better.

Numerical Experiments and Analysis
In order to know how competitive the MTVDE algorithm was, it was compared with NSGA-II.In algorithm NSGA-II, η c 20, η m 20 Pool size 100, Tour size 2. In MTVDE algorithm, CR 0.9 except the problem ZDT4 that CR 0.3.For all test functions, the population size of the two algorithms is taken as 100, and the number of iterations is taken as 250.Figures 1, 2, 3, 4, 5, 6, 7 and 8 show the results of the MTVDE algorithm by testing eight multiobjective functions.It can be seen from the figures the MTVDE algorithm produces a more uniform solution, and the solution quality is better than NSGA-II.
From Tables 1, 2, 3, 4, 5 and 6 eight testing functions are chosen to test the approximation index, uniformity index mean value and variance in 10 runs .For the first five functions, the MTVDE algorithm is compared with the five classic algorithms in 8, 9, 11, 12 .For the rest three functions, the MTVDE algorithm is compared with NSGA2.
N/A denotes the algorithm does not calculate the index; the PDEA algorithm in 7 calculates the index GD generational distance instead of calculating the index the convergence metric .The MODE algorithm in 7 did not calculate the index diversity metric .We can be seen from Tables 1-6 that MTVDE algorithm has better convergence solutions except the problems ZDT1, ZDT2, and SCH.
In this paper, the population size is 250.Through experiments, we found that the increasing of population size has no effect on performance of the algorithm but only can increase the running time.In order to detect the impact of the scaling factor and the crossover probability on performance of algorithm, we make 50 times independent experiments for problem SCH.In order to test the impact of F and CR on the algorithm performance, it can be found that the F and CR have little effect on the algorithm performance by the testing data.Through comparison, F 0.5, CR 0.9 results are a little better, but the algorithm performance approximation index and uniformity index is not particularly sensitive to the values of F and CR Table 7 .

Summary
In MTVDE algorithm, the improved DE algorithm is used to solve MOPs.The main difference between MTVDE algorithm and other MOEA algorithms is the three test vectors and the new select method.Eight benchmark functions are used to test the MTVDE algorithm.Experimental results show that MTVDE algorithm is better than most MOEA.In order to find the best solution, different values of crossover probability are tested, the results of ZDT4 are very sensitive to the crossover probability crossover probability is 0.3 better results .In short, the algorithm in this paper can effectively converge to the Pareto front of the problem Abstract and Applied Analysis   and maintain the diversity of the Pareto optimal solution set.It is an effective algorithm for solving multiobjective optimization problems.In the future work, we intend to use MTVDE algorithm or appropriate improved MTVDE algorithms for solving other complex constrained MOPs.
8 proposed the differential evolution algorithm based on the Pareto PDEA .Xue et al. 9 and Robi and Filipi 10 and Qian and Li 11 proposed the different kind of multiobjective differential evolution algorithm.Gong and Cai 12 proposed an improved multiobjective differential evolution based on the Pareto-adaptive ε-dominance and the orthogonal design.Here, a multiobjective differential evolution algorithm with multiple trial vectors MTVDE is proposed.In this algorithm, for each individual in the parent, three different mutation operators and a crossover operator are used to produce three trial individuals.First, we compare the three trial individuals.If an individual Pareto-dominate another, the better one is retained.If two individuals do not dominate each other, both two individuals are retained.Secondly, retained trial individuals compare with the parent individual: if an individual Pareto-dominate another, put the nondominated individual in the intermediate population, and if the two individuals do not dominate each other, two individuals are put in the intermediate population.Finally, in the intermediate population, the individuals are sorted according to the Pareto dominance relations and the crowding distance.We eliminate some low-quality individuals from the intermediate population and retain some fine individuals to form the next evolutionary population.The individuals are sorted according to the nondominated relations, and individuals with low ordinal value are better individuals.When individuals are with the same ordinal, the individual of larger crowding distance is better than the individual of smaller crowding distance.

Definition 2 . 7
the same level of individuals' crowding distance ICD .Let I be a set of individuals of a certain grade.All the target m m 1, 2, . . .individuals are sorted according to the objective function value in I.The first and the last individuals' crowding distances are infinite.The other individuals' crowding distance is calculated as subtract the two neighbor individuals' objective function and then square it.Then sum the crowding distance on all objective functions as the individuals' crowding distance.The individuals are sorted according to crowding distance in the same level.

1
For each individual in the parent population, three different mutated operators and a crossover operator are used to produce three trial individuals.For the three trial individuals and the parent individual, the one who Pareto-dominates another is retained in the intermediate population.If the two individuals do not dominate each other, both are retained.2 Some low-quality individuals in the intermediate population need elimination.Individuals are sorted in the intermediate population according to the Pareto dominance relations and the crowding distance of individuals.First of all, the individuals are divided into several levels according to the non-dominant relations in the intermediate population.Individuals in the same level are sorted according to the crowding distance.We choose the former NP individuals to form the next evolution population.

Table 1 :
Testing result's statistics of the problem ZDT1.

Table 2 :
Testing result's statistics of the problem ZDT2.

Table 3 :
Testing result's statistics of the problem ZDT3.

Table 4 :
Testing result's statistics of the problem ZDT4.

Table 5 :
Testing result's statistics of the problem ZDT6.

Table 6 :
Testing result's statistics of the problems SCH, DTLZ1, and DTLZ2.