A Variable Neighborhood MOEA / D for Multiobjective Test Task Scheduling Problem

Test task scheduling problem (TTSP) is a typical combinational optimization scheduling problem. This paper proposes a variable neighborhood MOEA/D (VNM) to solve the multiobjective TTSP. Two minimization objectives, the maximal completion time (makespan) and the mean workload, are considered together. In order to make solutions obtained more close to the real Pareto Front, variable neighborhood strategy is adopted. Variable neighborhood approach is proposed to render the crossover span reasonable. Additionally, because the search space of the TTSP is so large that many duplicate solutions and local optima will exist, the Starting Mutation is applied to prevent solutions from becoming trapped in local optima. It is proved that the solutions got by VNM can converge to the global optimum by using Markov Chain and Transition Matrix, respectively. The experiments of comparisons of VNM, MOEA/D, and CNSGA (chaotic nondominated sorting genetic algorithm) indicate that VNM performs better than theMOEA/D and theCNSGA in solving the TTSP.The results demonstrate that proposed algorithmVNM is an efficient approach to solve the multiobjective TTSP.


Introduction
During recent decades, the manufacturing of electronic devices has become highly integrated and increasingly complex.As a result, the resource and time consumption expended on the test of electronic devices became a crucial problem in engineering application.Therefore, the research for improving the test efficiency is a topic that has attracted extensive attention.To address this situation, the objective of this research is to solve the test task scheduling problem (TTSP) more efficiently.
The goal of the TTSP is to arrange the execution of  tasks on  instruments.It is a difficult nondeterministic polynomial (NP) problem [1] for optimization.TTSP has some similarities with flexible job shop scheduling problem (FJSP) [2,3], but the resource configuration of the TTSP is more flexible.For example, in the TTSP, one task can be performed on more than one instrument at a time.The precedence relationships in the TTSP resemble a network.One task can have one or more former or latter tasks in the TTSP.Generally speaking, feasible solutions are more difficult to be obtained in the TTSP than that in the FJSP.TTSP, FJSP, and most scheduling problems belong to combinational optimization problems.For combinational optimization problems, the search space is too large that the best solution cannot be obtained by adopting the method of enumeration for even small-scale problem.Therefore, the intelligent algorithms based on integer programming model are devoted to solving these kinds of problems.Take FJSP as the example; genetic algorithm (GA) [4][5][6][7], simulated annealing (SA) [8][9][10], and the tabu search (TS) [11] have been successfully applied in solving scheduling optimization problem.FJSP receives extensive attention and researches, and many hybrid intelligent algorithms are invented for improving the performance of the solutions.For example, a combination of shuffled frog leaping and fuzzy logic is proposed to solve FJSP [12].A particle swarm optimization (PSO) algorithm and TS algorithm are combined to solve the multiobjective FJSP [13].A biogeography-based optimization (BBO) algorithm [14] was proposed for FJSP for finding optimum or near-optimum solution.Hybrid discrete particle swarm optimization for multiobjective flexible job-shop scheduling problem was proposed in article [15] especially for large-scale problems.The objective functions are different in 2 Mathematical Problems in Engineering each literature, but the makespan, the total tardiness, the critical machine workload, and the total workload of machines are frequently considered factors in those researches.
Different from the research of FJSP, the research of TTSP is relatively few because of the development of automatic test system.However, there are still some achievements in TTSP.Xia et al. [16] proposed a method that combined GA and simulated SA to optimize the parallel efficiency and speed up ratio of the multi-UUT parallel test.Genetic Algorithm-Ant Colony Algorithm (GA-ACA) [17], hybrid particle swarm and tabu search [18] and Ant Colony Algorithm [19] are used to solve parallel test tasks scheduling to obtain the minimum makespan.A chaotic nondominated sorting genetic algorithm is proposed to solve multiobjective TTSP [20].The chaotic operations are combined with NSGA-II [21] in this approach.Those algorithms have shown excellent property in decreasing costs and improving efficiencies in automatic test system.
There are also some intelligent algorithms used to solve power dispatch problems and other scheduling problems.For example, opposition-based learning is employed in opposition-based gravitational search algorithm (OGSA) to solve optimal reactive power dispatch [22].A fuzzified multiobjective PSO (FMOPSO) algorithm is proposed and implemented to dispatch the electric power [23].An interactive artificial bee colony algorithm was proposed for the multiobjective environmental/economic dispatch problem [24].
In summary, most of the researches of scheduling problems focus on the single-objective problem or adopt weighted sum approach to convert the multiobjective problem into a single-objective problem.However, the weighting coefficients are difficult to choose, and human factors will greatly impact the performance of the algorithms.In fact, there are another two kinds of methods for solving the multiobjective problem.One method is the non-Pareto approach utilizing operators for processing the different objectives in a separated way.Another is the Pareto approaches which are directly based on the Pareto optimality concept.They aim at satisfying two goals: converging towards the Pareto front and also obtaining diversified solutions scattered all over the Pareto front.Those two kinds of methods mainly rely on the performance and strategies of the algorithms used in the multiobjective problems.
In this paper, the method based on Tchebycheff decomposition for multiobjective functions was adopted and the algorithm named MOEA/D is used to solve TTSP.MOEA/D is a typical evolutionary algorithm based on decomposition proposed by Zhang and Li [25].This method decomposes a multiobjective optimization problem into a number of scalar optimization subproblems and optimizes them simultaneously.The results show that MOEA/D has a good performance for the ZDT and DTLZ test problems.MOEA/D is very efficient in solving multiobjective problems.Research on MOEA/D has also been performed in recent years.For example, Tan et al. [26] proposed a new version of MOEA/D with a uniform design to deal with the multiobjective problem in higher-dimensional objective spaces.This method can render the distribution of the weighting vectors more uniform, especially for problems with high dimension.Chen et al. [27] introduced a guided mutation operator and priority update to enhance the ability of MOEA/D.Stochastic ranking and constraint-domination principle are adopted in MOEA/D to improve the ability of the algorithm to deal with constrained multiobjective optimization problems [28].Although these studies have improved the ability of MOEA/D for solving multi-objective problems, MOEA/D is mainly used to solve standard test cases like ZDT, DTLZ, and F1.However, MOEA/D is rarely used to solve combinational optimization problems such as FJSP, TTSP.Peng et al. applied MOEA/D to solve Travelling Salesman Problem (TSP) [29].However, there is no special improvement for MOEA/D according to the feature of MOEA/D and the property of TSP.
The scheduling problems, such as TTSP, FJSP, and TSP, and power dispatching problem are a branch of combinational optimization problems.Because of the properties of the combinational optimization problems, the final best solutions only account for a rather small subset of the search space.How to avoid the solutions obtained being trapped in local optima is the key to improve the ability of algorithms to deal with combinational optimization problems.Considering the fact that the size of the neighborhood is important in MOEA/D [25], too large size will lead to degradation and too small size will weaken the effect of evolutionary process.Moreover, there will be many duplicate solutions due to the influence of neighborhood updating of MOEA/D [25].The population diversity will decrease obviously.Based on the analyses above, variable neighborhood based on a quadratic curve is adopted to ensure that the crossover span is more reasonable, and Gauss mutation is adopted at the beginning of iteration to maintain the diversity of the population.These two improvements can efficiently enhance the ability of MOEA/D for avoiding the solutions obtained from being trapped in local optima.The proposed approach cannot only solve TTSP but also deal with other scheduling problems, because the feasible solutions of TTSP are more difficult to obtain than most scheduling problems such as FJSP, TSP.
The organization of this paper is as follows.A brief introduction of TTSP is introduced in Section 2. The new method for TTSP, variable neighborhood MOEA/D (VNM), is proposed in Section 3. The convergence analysis of VNM is also presented in Section 4. A large number of experimental results and discussions are covered in Section 5. Conclusions are given in Section 6.

The Formulation of TTSP
2.1.The Mathematical Model for TTSP.The goal of the TTSP is to arrange the execution of  tasks on  instruments.There are three main mathematical models for TTSP.One model is based on Petri net.The second is based on Graph theory.And the third model is based on integer programming.Our work in this paper is mainly based on the integer programming proposed by us in paper [20].

The Petri Net Model for TTSP.
Petri net [30,31] was proposed in 1962.Petri net focuses on the changes of the system, the conditions for changes, the influence of changes, and the relationships between changes.We assume that there is one test task  1 in TTSP.The instruments occupied for  1 are  1 ,  2 , and  3 .The Petri net model for this TTSP can be shown as Figure 1.In this model, there are four places ( 1 ,  2 ,  3 , and  4 ), one transition ( 1 ), three tokens ( 1 ,  2 , and  3 ), three variables (V 1 , V 2 , and V 3 ), four arc expressions )), and a guard ([ 1 ,  2 ,  3 ]), where V 1 , V 2 , and V 3 are bound to  1 ,  2 , and  3 .
In Figure 1, at the beginning, test resources  1 ,  2 , and  3 are vacant.The corresponding tokens for three places  1 ,  2 , and  3 are  1 ,  2 , and  3 , respectively.Therefore,  1 ,  2 , and  3 can be allocated to  1 .When the  1 is finished, the tokens in  1 ,  2 , and  3 will be transferred to place  4 .The tokens in  4 are V 1 , V 2 , and V 3 .This means that resources  1 ,  2 , and  3 are released.The Petri net can describe the relationships between tasks by the places and transitions, but the complex models are needed to be established.The process will increase the development cost and extend the development cycle.[32] is an important branch of mathematics.By adopting the Graph theory, the complex project planning and processing can be described using "graphs." In TTSP, the vertexes of the graph represent the test tasks, and the lines between vertexes mean that some test instruments are common for these two tasks.For example, there are four test tasks ( 1 ,  2 ,  3 , and  4 ) and four test instruments ( 1 ,  2 ,  3 , and  4 ).The instruments set needed by  1 ,  2 ,  3 ,  4 are { 1 ,  2 }, { 2 ,  4 } { 3 ,  4 }, and { 1 ,  3 }, respectively.The graph for this TTSP example is shown in Figure 2.

The Graph Theory Model for TTSP. Graph theory
Graph theory model can only be adopted by typical optimization methods.With the increment of the scale of TTSP, the computation expense will greatly increase, but In the TTSP, one task can be tested on more than one instrument.A judgment matrix is used to express whether instrument   is needed for   .The judgment matrix is defined as the following: In general, task   may have several possible test schemes.The set of test schemes for   is defined as Basic hypothesis includes three factors.At a given time, an instrument can only execute one task; each task must be completed without interruption once it starts.Assume    =    ,    =    +    to simplify the problem.

The Objective Functions for TTSP.
The objective functions are very important in the study of multiobjective optimization problem.The makespan is very important in scheduling problems such as TTSP and FJSP, because the completion time is an essential factor for scheduling problem in product process.In additional, for TTSP, the test instruments have high integration, and the test instruments have become increasingly expensive.Therefore, the demand for reducing the workload of the instruments and increasing the service life of the test instruments has great significance in TTSP.Therefore, our work focuses on two main objectives.
One is to minimize the maximal test completion time, and the other is to minimize the mean workload of the instruments.These objectives are represented by  1 () and  2 ().
(1) The Maximal Test Completion Time  1 ().The notification    = max   ∈      is the test completion time of   for    .Thus, the maximal test completion time of all tasks can be defined as follows: (2) The Mean Workload of the Instruments  2 ().First, a new notation  is introduced to describe the parallel steps.The initial value of  is 1.Assign the instruments for all of the tasks, if   *  * = 1,  =  + 1.Therefore, the mean workload of the instruments can be defined as follows:

The Variable Neighborhood MOEA/D Algorithm
In this section, we proposed a variable neighborhood MOEA/D algorithm (VNM).To obtain solutions close to the real Pareto Front (PF) of the TTSP, two strategies are adopted.The variable neighborhood strategy helps to make the crossover span more reasonable.Moreover, Gauss mutation is adopted at the beginning of the iteration to maintain the diversity of the population.

The Main Strategy of the VNM.
The VNM is an evolutionary algorithm based on decomposition.The main strategy of the VNM is to decompose a multiobjective optimization problem into a number of scalar optimization subproblems and optimize these subproblems simultaneously.The decomposition method used is the Tchebycheff approach [33].Each subproblem is bound with a weight vector, and then each subproblem is updated by obtaining information from its neighborhood [25].The neighborhood of each subproblem is determined by its weighting vector.Let { 1 ,  2 , . . .,   } be a set of weight vectors, and  * = ( * 1 ,  * 2 , . . .,  *  )  is defined as the reference point.The problem of the Pareto Front approximation can be decomposed into  scalar optimization subproblems using the Tchebycheff approach, and the objective function of the th subproblem is defined as  where Ω is the decision space and   = ( The main procedure of the VNM can be described as shown in Figure 3. In the part of parameter setting, the iteration number , the subproblem number , the size of neighborhood  (which ranges from beginning size  to stopping size ), and the population for saving the optimal solutions EP are set.
The crossover operation in VNM is as follows.
For each individual    in generation , the child  +1  can be obtained by the following equation: CR,  1 , and  2 are the three control variables for the crossover;   1 and   2 are two individuals chosen in the neighborhood of    .This crossover method can make full use of the information from the neighborhood and render the information exchange more sufficient.
The main idea of VNM is given above.Two improvements are involved in the VNM algorithm.Variable neighborhood strategy is adopted to make the crossover span more reasonable.Moreover, Starting Mutation is used to enhance the diversity of the population.

Variable Neighborhood.
In the VNM, the size of the neighborhood  has a high impact on the performance of the algorithm.If  is too large, the two solutions chosen (  and   ) for the genetic operation may be unsuitable for the subproblem, and degradation may occur during the progress of the evolution.In contrast, if  is too small, the subproblems are all similar.The child individual will be so similar to its parents that the crossover operation will have a weak effect.
is the neighborhood size which determines the crossover and neighborhood updating span.Too large and too small  will both have a negative influence on VNM.Therefore,  should be large enough at the beginning of the evolution period to ensure sufficient information exchange of the solutions, and  should be sufficiently small in the latter portion of the evolution period such that degradation can be avoided.Motivated by this ideology, we designed and tested three curves to find the best  controlling curve.
The three curves are shown in Figure 4.In this figure, the abscissa is the number of iterations, and the ordinate is the size of the neighborhood.1, 2, and 3 represent the straight line, the monotonic parabolic and the nonmonotonic parabolic curves, respectively.It is worth noting that in curve 2, the curvature will be 0 at the end of the evolution period.This means that the rate of change of curvature for 2 is the fastest of all of the concave monotone parabolas during the period of evolution.Because the curvature goes to 0 in the end, curve 2 is determined.Assume that if the number of iterations is 125, the neighborhood of curves 1, 2, and 3 are  1 ,  2 , and  3 , respectively, in accordance with the equation:  1 −  2 =  2 −  3 .Thus, curve 3 can be also determined.Curve 3 is a nonmonotonic parabolic curve.A series of experiments should be performed to compare the influence of the three curves on the algorithm to identify the best controlling curve.

Starting Mutation.
The TTSP represents a typical combinational optimization problem.The final best solutions may be limited to only several points in the solution space.Because of the neighborhood updating effect of the VNM, there will be many duplicate solutions so that the crossover operation will have little effect.Therefore, how to maintain the diversity of the population is the key question for enhancing the algorithm effect.
Motivated by the ideology above, a starting Gauss mutation is adopted at the beginning of the iteration.For a solution   = (  1 ,   2 , . . .,    ) ( is the number of variables), Gauss mutation is described as the following: represents the individual after mutation,  is the mutation probability, normal (   , ) is a number that obeys the normal distribution,    is the mean value, and  is the variance.With Starting Mutation, the problem with the initially invalid crossover operation can be resolved.Therefore, we can avoid the solutions from becoming trapped in local optima, and thus solutions with higher quality are obtained.

The Convergence Analysis of VNM
The convergence analysis of VNM in this section provides the theory ground for its application.The convergence behavior of VNM is analyzed according to the Markov Chain and the transfer matrix, respectively.

Strong and Weak
Convergence.This section proposes the basic theories of convergence and proves the strong and weak convergence of VNM from the perspective of Markov Chain.
There is a global optimal solution set  for MOPs (multiobjective problem). is defined as  = {; ∀ ∈ , () ≥ ()}.It is assumed that ⃗ () is the population in evolutionary algorithms.
A detailed demonstration for the convergence of MOEA has been proposed in paper [34].Based on it, the definitions are described as follows.
It means that ⃗ () converges to global optimal solution weakly.
It means that ⃗ () converges to global optimal solution strongly.

Convergence to Global
Optimal.This part focuses on the elitist strategy and proves that the VNM converges to the global optimum from the perspective of transfer matrix.
Theorem 3 (see [35]). = (  0   ) is a reducible stochastic matrix, where  :  ×  is primitive stochastic matrix and ,  ̸ = 0.Then, where  ∞ is a stable stochastic matrix with According to the previous description of VNM, the extended transition matrices for crossover  + , mutation  + 1 ,  + 2 , selection  + can be written as block diagonal matrix and upgrade matrix  is lower triangular: + ,  + 1 ,  + ,  + 2 , and  are with 2  square matrices.,  1 ,  2 , , and   (1 ≤ ,  ≤ 2  ) are all with the size of  ×  ( is the number of individuals and  is the number of individual attributes).
,  in   represents the population's state sequence number (in the order of the populations of the pros and cons from 1 to 2  ).So  is used to represent population's selection process.Each block matrix   is a selection of individuals.The details in   can be described as: there are some individuals to make   = 1 established in each row.Firstly, the first individual is compared with all other individuals,  1 = 1 if th individual is optimal (there may be several optima) or  11 = 1 if no one is better than it.Then, the second individual is compared with all other individuals except the first individual.The best individual, th individual, is chosen; set  2 = 1 if th individual is optimal or  22 = 1 if there is no one better than the second individual.The sorting process continues until all individuals are sorted.To simplify the difficulty of the problem, assume that the there is only one global optimal solution set.Then, only  11 is a unit matrix, whereas all matrices   with  ≥ 2 are not unit matrices.
In VNM, the populations go through Gauss mutation  + 1 , crossover  + , mutation  + 2 , selection  + , and EP upgrade matrix .It is worth of noticing that (+) selection mode is not used in the evolutionary process of VNM and the number of individuals remains unchanged.This means that  + = .The transition matrix  + for VNM is There is  11 > 0 in the transition matrix  + .The submatrices   which is with  ≥ 2 may be gathered in a rectangular matrix  ̸ = 0 so that Theorem 3 can be used to prove that the corresponding VNM converges to the global optimum [36].

Experimental Results and Analysis
Computational experiments are carried out to compare the approaches and to evaluate the efficiency of the proposed method.There are two objectives: to minimize the makespan and the mean workload of the instruments.In this section, the performance metric, coverage metric , is introduced first.There are two experimental instances adopted in this section.They are instances of 30 tasks with 12 instruments and 40 tasks with 12 instruments which are real-world examples taken from a missile system.The instance of 40 tasks with 12 instruments is displayed in Table 1.The instance of 30 tasks with 12 instruments is the first 30 tasks in Table 1.The experiment of selection of controlling curve for neighborhood size is shown in Section 5.2.The verification of the improvements of the algorithm is displayed in Section 5.3.In Section 5.3, VNM is compared with MOEA/D.In Section 5.4, the proposed algorithm (VNM) is compared with the variations of CNSGA using real-world TTSP problems.All of the algorithms are executed using 50 independent runs.In all of the experiments, the better performances are denoted in bold.The basic algorithm parameter settings are displayed in Table 2. CR,  1 , and  2 are the three control variables for the crossover. is the mutation probability.

Performance Metric.
For multiobjective optimization, the convergence to the Pareto-optimal set is the most important target to be considered.There are mainly two metrics to evaluate the convergence.One is convergence metric , and the other is convergence metric .The true set of Paretooptimal solutions is necessary for the calculation of .However, the solutions space of TTSP is so large that the true set of Pareto-optimal solutions cannot be obtained by enumeration.
The metric  can be used to compare the performances of the two solutions sets obtained by different algorithms.The calculation of  needs only the information of the two solutions sets.Therefore, in this paper the convergence metric  is used to evaluate the performance of the proposed algorithm.
Assume that  and  are two sets of nondominated solutions, and (, ) is the ratio of the solutions in  that are dominated by at least one solution in .Hence, (, ) = 1 means that all of the solutions in  are dominated by solutions in , and (, ) = 0 means that there is no solution in  dominated by a solution in .Generally speaking, if (, ) > (, ), then solution set  is better than solution set .

The Selection of Controlling
Curve.In this section, three curves are designed and tested to identify the best  controlling curve.1, 2, and 3, respectively, represent the straight line, monotonic parabolic and nonmonotonic parabolic curves shown in Figure 4.In curve 2, the curvature will be 0 at the end of the evolution period.Because of the influence of neighboring updating in MOEA/D, many duplicate solutions will be presented in the final evolution process of MOEA/D.Therefore, Starting Mutation is applied to the beginning of the next iteration to maintain the  population diversity.Tables 3 and 4 show the comparison of the influence of the three curves on the algorithm using two instances.The results show that the monotonic parabolic curve 2 has the best performance.This means that the monotonic curve with the fastest rate of change of curvature is the most useful for the algorithm.And the boxplots of three curves for 30 * 12 and 40 * 12 instances in Figures 5 and 6 also give the same conclusion.

Experiments for Comparisons of VNM and CNSGA.
In this section, the VNM is compared with the CNSGA for TTSP.CNSGA is based on NSGA-II.NSGA-II has been successfully applied to job shop scheduling problems [37], reactive power dispatch problems [38], and many other applications.CNSGA has successfully been adopted to solve TTSP [20].Therefore, a comparison of VNM and CNSGA is carried out to test the performance of the proposed algorithm VNM.
There are two chaotic sequences, logistic map and cat map, and the chaotic sequences can be applied in three positions, population initialization, crossover, and mutation.Therefore, there are six combinations for CNSGA.The nomenclatures for six variants of CNSGA are shown in Table 7. Tables 8 and 9 show the comparison of VNM and CNSGA for 30 * 12 and 40 * 12 instances.The VNM is represented by .All the comparisons between VNM and the variations of CNSGA are based on 50 independent experiments.The average of  metric and better computational times are used for the performance analysis.The results from Tables 8 and 9 show that VNM provides the best performance not only for the average metric  but also in terms of better computational times than CNSGA.
Figures 11 and 12 show the comparisons of VNM and the 6 variations of CNSGA for 30 * 12 instance.The figures show  The results of the comparison of VNM and CNSGA for the 40 * 12 instance are shown in Figures 13 and 14.The results also show that the solutions obtained by VNM have higher quality.
In addition, box plots are used to display the performances of the algorithms.The box plots of  metric for VNM and CNSGA with 30 * 12 and 40 * 12 instances are shown from Figures 15,16,17,and 18.From the box plots of  metric, it is clear that the median of VNM is larger than that of the variations of CNSGA in both the 30 * 12 and 40 * 12 instances, and the data distribution of VNM is more reasonable as well.Additionally, the average of VNM is also superior.The results show that VNM demonstrates better performance than CNSGA in solving the multiobjective TTSP.The performance of solutions obtained by VNM is better than that obtained by CNSGA because that the variable neighborhood is adopted in VNM.The span of information exchange in VNM changes following the evolutionary process, but that in CNSGA stays the same.The information from the process of evolution helps VNM get better performance.
The variable neighborhood provides a strategy to improve the performance of the algorithm.For different problems with different scales, the controlling curves for the neighborhood size will be different.The Starting Mutation can be also applied to solve other optimization problem in the evolution process.The strategies proposed in this paper can be investigated in other scheduling problem similar to TTSP.

Conclusion
How to improve the test efficiency is more and more important in modern industry.TTSP has important application   value in modern manufacturing process.TTSP is combinational optimization problem.The final best solutions only account for a rather small subset of the search space.In order to help the solutions avoid being trapped in local optima, this paper proposed a new genetic evolutionary multiobjective optimization algorithm (VNM) to solve the TTSP.The variable neighborhood and Starting Mutation strategies are adopted in VNM to make the crossover span more suitable and improve the diversity of population.Three controlling curves for neighborhood size are studied.The experimental results have shown that the monotonic   parabolic has the best performance.From the experiment conducted for comparison of VNM and MOEA/D, we see that the improved algorithm has made great progress in solving the TTSP problem.And the experiment conducted for comparison of VNM and CNSGA also shows that the improved algorithm is superior to CNSGA in solving TTSP.VNM can also be applied to solve other combinational optimization problems such as FJSP and TSP.Future work will focus on two objectives: the precedence constraint will be added to the TTSP, and information regarding bottleneck tasks will be considered.

Figure 3 :
Figure 3: The main procedure of the VNM.

Figure 4 :
Figure 4: Three controlling curves for the neighborhood size.

Figure 11 :
Figure 11: The comparison of VNM and three variations with logistic map for CNSGA for 30 * 12 instance.

Figure 12 :
Figure 12: The comparison of VNM and three variations with cat map for CNSGA for 30 * 12 instance.

Figure 13 :
Figure 13: The comparison of VNM and three variations with logistic map for CNSGA for 40 * 12 instance.

Figure 14 :
Figure 14: The comparison of VNM and three variations with cat map for CNSGA for 40 * 12 instance.

Table 1 :
The instance of 40 tasks with 12 instruments.

Table 3 :
Comparison of influence of three curves for 30 * 12 instance.

Table 4 :
Comparison of influence of three curves for 40 * 12 instance.

Table 7 :
Nomenclature for six variants of the CNSGA.
that the solutions obtained by the VNM dominate most of the solutions obtained by the 6 variations of CNSGA.Therefore, the VNM obtains the best performance.

Table 8 :
Comparison of VNM and six variations of CNSGA for 30 * 12 instance.

Table 9 :
Comparison of VNM and six variations of CNSGA for 40 * 12 instance.