An Ant Optimization Model for Unrelated Parallel Machine Scheduling with Energy Consumption and Total Tardiness

This research considers an unrelated parallel machine scheduling problem with energy consumption and total tardiness. This problem is compounded by two challenges: differences of unrelated parallel machines energy consumption and interaction between job assignments and machine state operations. To begin with, we establish a mathematical model for this problem. Then an ant optimization algorithm based on ATC heuristic rule (ATC-ACO) is presented. Furthermore, optimal parameters of proposed algorithm are defined via Taguchi methods for generating test data. Finally, comparative experiments indicate the proposed ATCACO algorithm has better performance on minimizing energy consumption as well as total tardiness and the modified ATC heuristic rule is more effectively on reducing energy consumption.


Introduction
In recent years, energy saving has been growing a great interest due to sequence of serious environmental impacts and rising energy cost [1][2][3].In manufacturing industry, machine energy consumption can be characterized by power, process time, and state of machines [4].In particular, a large amount of energy is wasted while keeping idle machine running (i.e., not processing jobs but still running machine) [5][6][7].Research on Wichita, an aircraft small-part supplier, shows that at least 13% of total energy consumption can be saved by simply turning off machines while they are not processing any jobs [8].Kordonowy [9] investigates the background runtime operations of machine and observes that more than 30% of input energy is consumed by background processes.What is more, Drake et al. [10] show that there is a significant amount of energy consumption while machine keeps on idling when no jobs are processed.
As a result, research on minimizing energy consumption with machine operation scheduling should be of benefit to energy saving and reducing carbon dioxide emissions.Only a few references consider the objective of energy consumption [4,11].Swaminathan and Chakrabarty [12] considered energy consumption in control systems to extend the life of batteries.Research on Tiwari et al. [13] proved that there is about 40% energy saving when proper power control software is used in microprocessor manufacturing.Mouzon and Yildirim [14] considered the problem of minimizing total energy consumption and total tardiness on signal machine.The total energy consumption is measured by summation of idle power and machine setup power.However, the key to save energy on single machine problem is to determine if the machine should be turned off or not during idle time.Yildirim and Mouzon [15] gave a math mathematical model for minimizing total energy consumption as well as max completion time on signal machine.A conventional genetic algorithm is adopted.
Actually, most of manufacturing systems are unrelated parallel machines.Furthermore, the manager should consider not only the energy consumption costs, but also the due dates of jobs.Ant colony optimization (ACO) algorithm has become more preferable to solve combinatorial optimization problems [16][17][18].Yagmahan and Yenisey proposed a multiobjective ant colony system algorithm to solve a flow shop scheduling problem with respect to both of makespan and total flowtime [19].Lin et al. [20] considered an ACO algorithm to solve the problem of scheduling unrelated parallel machines to minimize total weighted tardiness.Arnaout et al. [21] addressed the nonpreemptive unrelated parallel machine scheduling problem with machine dependent and sequence-dependent setup times via a modified ACO algorithm.The results showed that ACO outperformed the other algorithms.In this paper, we begin the research of minimizing energy consumption and total tardiness on unrelated parallel machines.The energy consumption of each machine is composed of power cost of machine setup (i.e., machine turning off and then turning on) and power wasted during machine idle period.The problem is formulated by a weighted summation of energy consumption and total tardiness.For solving this problem, we develop an ACO algorithm with ATC rules in which a machine reselection operation is applied.
After this introduction, we describe the problem in Section 2 and the mathematical model is presented in Section 3. The proposed ATC-ACO algorithm is set out in Section 4. Computation results and comparative analysis on 27 test problem configurations and 2187 experiments' results are shown in Section 5. Finally, the main conclusions are included in Section 6.

Problem Definition
In this section, a mathematical model is proposed for unrelated parallel machines with the objective of minimizing energy consumption and total tardiness, which is NP-hard, since minimizing energy consumption and total tardiness on single machine is proved to be NP-hard [14].There are  independent jobs that have to be processed on  parallel machines.Each job can be processed by only one machine and each machine is continuously available.Each job  arrives at time   and has a process time   on machine  and a due date   .The total tardiness is defined as ∑ max(  −   , 0), where   represent the completion time of job .The machine characteristics are defined as follows.Machine  consumes power   idle while machine stands idle.Furthermore, machine  consumes power   setup when it is turned off and then turned on (i.e., a setup occurs).To solve this problem, total tardiness and energy consumption must be considered together.If there is a long idle period between two jobs, it may choose to turn off machine to save energy.It means that when the idle energy consumption   idle *  idle is greater than machine setup energy consumption   setup , the machine  will be turned off to save energy.Finally, we conclude the breakeven duration    is the ratio of machine setup energy consumption   setup to machine idle energy consumption   idle : Unlike single machine scheduling framework proposed by Yildirim and Mouzon [15], unrelated parallel machines scheduling problem is much more complicated.Job assignment is affected not only by the processing time and tardiness cost, but also by the state of machine, which is As can be seen in Figure 1, a feasible solution is decided by making three decisions: machine assignment, job sequencing, and machine state (idling or from turning off to turning on).According to the definition of setup energy, tardiness, and idle power consumption, the breakeven durations  1  ,  2  are 5 sec and 4.5 sec, respectively.Whether keeping machine idle or performing a machine setup depends on the comprising breakeven duration    with waiting times between jobs.Furthermore, assigning jobs on machines relies not only on processing cost and machine available time, but also on setup energy and idle power consumption.Note that  6 arrived at time 17, the tardiness of  6 is 2 hp in solution 1, while idle power consumption between  1 and  6 is 3 hp in solution 2. In order to select an appropriate solution minimization of energy consumption and total tardiness on unrelated parallel machines, an ant colony optimization framework is proposed.

Mathematical Model
13 hp 2 hp 16 hp   idle : per unit time energy consumption of machine   .

Decision Variables. Consider
The definition of minimizing energy consumption and total tardiness on unrelated parallel machines is formulated as follows: If (  −   −   ) <    and job   immediately precedes job   on machine  then Our multiobjective function is started in (3) which aims at minimizing the weighted summation of energy consumption and total tardiness.Constraint (4) guarantees that a job cannot be processed before it is released.Constraint (5) ensures that only one job could be processed on each machine at the same time.Constraint (6) defines that if waiting time between job   and job   (job   precedes job   ) on machine   is longer than machine breakeven duration    , then   is equal to the corresponding machine setup energy consumption or otherwise equal to the corresponding machine idle power consumption.

Ant Colony Optimization Algorithm Based on ATC Heuristic Rule (ACO-ATC)
The ACO algorithm imitates the indirect communications within artificial ants to find the shortest path between food and their net.These communications are recorded by artificial pheromone trails.Naturally, pheromone in long paths will evaporate much quicker than short paths, and then short paths will attract more ants for denser pheromone.In this section, we propose an ACO-ATC algorithm to solve the problem of scheduling unrelated parallel machines to minimize energy consumption and total tardiness.Details of proposed algorithm are described in the following subsections.

Solution Construction.
The solution component for scheduling unrelated parallel machines to minimize energy consumption and total tardiness required two decisions: assignment and job sequence, which will result in a huge solution space.Consequently, the two decisions are often addressed independently to reduce the solution search space, such as selecting the first available machine and then distributing the minimization total tardiness job.Finally, after the solution is constructed, machine states are fixed according to the job sequence.Although this strategy could significantly reduce the search space, appealing solutions may be excluded due to the independent decision heuristic.As can be seen in Figure 1, the available machine ( 1 ) selected in the first scheduled strategy may not be the minimization energy consumption and total tardiness for selected job ( 6 ) in the second scheduled strategy.Inspired by ATC heuristic rule proposed by Lin et al. [20], we modify a new solution construction mechanism requiring three step: first, machine selection, then job selection, and finally machine reselection.Details of modified solution construction are shown as follows.

Machine Selection.
First, a machine will be selected.We generate a random number   from uniform distribution [0, 1].A user-specified number  0 = 0.9 represents the relative importance of exploitation versus exploration.If   <  0 an ant is apt to select the smallest makespan machine among all unrelated parallel machines according to (8); otherwise a machine  is chosen according to the probability distribution   defined in ( 9) 4.1.2.Job Selection.A job will be selected after a machine has been chosen.Job selection defined in (10) considers the heuristic information and pheromone trails together.We generate a random number   from uniform distribution [0, 1]. 0 = 0.9 is a user-specified number.If   <  0 an ant is apt to select the smallest tardiness job  processed on machine  * according to (10); otherwise a job  is chosen according to the probability distribution   *  defined in (11).Pheromone trails   *  () indicate the favorability of assigning job  to a machine  * and set to 0 initially.  *  () is heuristic information which suggests the greedy heuristic of processing the job  on machine  * that takes the least amount of tardiness, which is presented in (12).Parameters  and  are the relative importance of pheromone trails and heuristic information, respectively.Ψ represents a set of unscheduled jobs in ( 11) 4.1.3.Machine Reselection.Since the computation of energy consumption and total tardiness need to confirm machine and job sequence simultaneously, the independent selection strategy may not find the appealing solution.In order to solve this problem, a machine reselection will be executed after job  * has been selected.An ant will select machine  * * according to (13), which aims at minimizing the weighted sum of energy consumption and total tardiness when processing job  * on machine  * * : After three steps (machine selection, job selection, and machine reselection) are executed, a job  is assigned to a machine  * .Repeat the operations above until all jobs are distributed; then a solution construction is finished.[22] have proved that ACO algorithm may be further improved by incorporating an appropriate local search algorithm.Therefore, we include two local search strategies (LS1 and LS2) in our implementation of ACO-ATC algorithm.

Local Search. Dorigo and Stützle
The first procedure (LS1) searches for new solutions by swapping jobs on the same machine.The second procedure (LS2) searches for new solution by transferring jobs from the machine with the highest objective value to the machine with the lowest one.The computation of its implementation is ( *  2 ).The pseudocode for local search algorithm is summarized in Pseudocode 1.

Pheromone Update.
Once all ants have constructed their solutions, global pheromone updating rules are performed.Initially, there are no pheromone trails on all solutions.The global pheromone updating rules are defined as follows: Global updating is intended to provide more pheromone to the best performance solution.Pheromone evaporation rate  (0 <  < 1) is used to forget bad solutions and to explore new solutions.The pheromone amount of all solution components is updated by increasing the reciprocal of the best objective value  best .

Data Generation.
In this section, the data of computational experiments will be presented to evaluate the proposed ACO-ATC algorithm.The proposed algorithm is implemented in Matlab R2012b running on Windows 7 with Intel core i5 2.30 GHz and 4 Gigabytes RAM.The number of jobs and number of machines are divided into three different sizes, namely, small, medium, and large, which take the value of 20/5, 50/5, and 50/10, respectively.Processing times   are generated randomly from uniform distribution  (15), where  represents the relaxation coefficient and is set to 2, 4, and 8.As  increases, the difference between due dates and release times becomes larger, which means that the problem becomes less constrained and easily solved.The per unit time of job tardiness cost   tardiness is calculated by (16).We generate the unit time of machine idle power consumption   idle randomly from uniform distribution [1,3].The state (idle or from turning off to turning on) of machine only depends on the setting of unit time of machine idle energy consumption   idle and machine setup energy consumption   setup .We use   setup /  idle ratio to define this instance and set   setup /  idle ratios to 2, 4, and 8. Equal relative weightings chosen for total tardiness and energy consumption for total objective value are  1 =  2 = 0.5, respectively.All the parameter settings of each main factor are shown in Table 2. Consider When the data are generated, all the level combinations result in 3 * 3 * 3 = 27 test problem configurations.
In order to evaluate the performance of proposed ACO-ATC algorithm, we first compare the ACO-ATC algorithm with a comparative algorithm named GRASPTETT, which is a multiobjective algorithm to solve the minimization problem of energy consumption and total tardiness on single machine.For more details of GRASPTETT, see Mouzon and Yildirim [14].We extend the GRASPTETT algorithm on unrelated parallel machines in this paper by using a well-known earliest release time heuristic to assign machines.What is more, to validate our modified ATC heuristic rule (machine selection, job selection, and machine reselection), we also compare ACO-ATC with original ACO algorithm (OACO) which only adopts "machine first, schedule job second" solution construction strategy.We incorporate the same parameter setting of OACO and other important parameters (  setup /  idle and ) in this paper.

Performance Measure.
The relative percentage deviation (RPD) is used to evaluate the performance of multiobjective optimization algorithms.Given an obtained objective value by selected optimization algorithm, the RPD can be defined in (17) as follows: where Min sol is the best objective value obtained for each problem configuration.

Parameter Tuning.
Since the parameters of ACO algorithm significantly influence computation results, Taguchi method [23,24] is utilized to determine the appropriate values for ACO parameters that minimize the objective value for each problem configuration.The factors considered in parameter tuning experiment are as follows:  (0.01, 0.15, 0.3),   (5,20,40),  (0.01, 0.15, 0.3), and  (0.01, 0.15, 0.3).To reduce the number of runs but reach sound conclusions, the orthogonal array  9 described in Taguchi method is chosen according to the number of parameters and the number of factor levels.For each problem configuration, three instances are generated where each instance is run 3 times independently for each parameter combination, which means that we have to do 27 * 3 * 3 * 9 = 2187 experiments, and the average objective value (AOV) is obtained for each problem configuration.We implement the Taguchi method by using the small size configuration where  = 20,  = 5,  = 4, and   setup /  idle = 4.The orthogonal array and AOV results are listed in Table 3, where the second column of Table 3 represents  = 0.01,   = 20,  = 0.15, and  = 0.15.
According to the orthogonal array and AOV results, we can analyze the importance of each factor with its response value and significance rank, which is shown in Table 4.As can be seen in Table 4, heuristic information parameter  is the most significant one among all parameters.It means that heuristic information for machine selection and job sequence is crucial to the proposed ACO-ATC algorithm.An appropriate value of  could lead to better convergence stability.Since the parameter  ranks second, it implies that the amount of pheromone amplification is also important.A small value of  will lead to a faster convergence rate and a small value   is enough for searching the solution space.According to the analysis above, for problem configuration,  = 50,  = 10,  = 4, and   setup /  idle = 4, a good choice of parameter combination is suggested as  = 0.15,   = 5,  = 0.01, and  = 0.01.

Comparative Results
. In this section, our proposed ACO-ATC algorithm is tested on all 27 problem configurations.Each problem configuration generates 3 instances and each test is repeated with 5 runs for each instance.Parameter settings are the same as discussed in the last section (see Section 5.3).Performance of solutions to yield using test problem is compared with two multiobjective optimization algorithms: GRASPTETT and OACO.The computational results of average RPD for all problem configurations are shown in Table 5, respectively.
As can be seen in Table 5, the ACO-ATC algorithm performs better than the other two approaches in all problem configurations.The mean RPD values of all three algorithms are consistent when job number and machine number / are increasing.The mean RPD value for all tests of ACO-ATC algorithm is 0.96, when the mean RPD value of GRASPTETT algorithm is 4.85 which is 3.89 higher than ACO-ATC algorithm.The OACO algorithm shows the weakest performance with 5.95 mean RPD.The factor / has significant influence on GRASPTETT and OACO.Furthermore, machine reselection heuristic rule is crucial for solution construction since ACO-ATC algorithm outperforms OACO in all instances.When relaxation coefficient  is small ( = 2), the performances of GRASPTETT and OACO are acceptable, especially in small problem size where  = 20 and  = 5, for the reason that there is only little scheduling space when the due dates are not well spread and waiting time between release time and due date is small.With the increasing of relaxation coefficient , the differences between ACO-ATC and compared approaches become larger, for the reason that the bigger the margin between release time and due date, the less the probability of job tardiness occurrence.By increasing the ratio of   setup /  idle , which means to increase the length of breakeven duration, all approaches have a little fluctuation.It could be explained by machines trend to remain idle in short waiting time.

Conclusion
In this study we have successfully implemented the problem of minimizing energy consumption and total tardiness on unrelated parallel machines.Due dates and release times are distinct, and the breakeven duration of each machine is different.A compromised balance has to be found between machine energy consumption and total tardiness.We proposed a framework with an ant colony optimization algorithm (ACO) and ATC heuristic rule to solve this problem.Furthermore, it is a new kind of problem for minimization of machine energy consumption and total tardiness on unrelated parallel machines which need to be modeled and solved effectively.
In the computation evaluation, two approaches (GRASPTETT and OACO) for solving minimizing machine energy consumption and total tardiness on single machine are adapted and compared with proposed ACO-ATC algorithm.The ATC-ACO algorithm outperforms other approaches and GRASPTETT shows better than OACO in most of instances.
Although this work has dealt with several challenging issues, future work is still needed.Firstly, more machine states should be considered (e.g., machine has a warm-up time which depends on the length of setup time).In this situation, the breakeven duration is variable according to the setup time, which will make problem much more complicated.The second extension should obtain an approximate Pareto front via Pareto ACO algorithm, and then the decision maker can select a suitable choice among all solutions.
Notions : the number of machines; : the number of jobs;   : the job ,  = 1, 2, . . ., ;   : the machine ,  = 1, 2, . . ., ;   : the number of jobs allocated on machine   ;  1 : weight associated with total tardiness;  2 : weight associated with energy consumption;   : the completion time of job   ;   : the release time of job   ;   : the due date of job   ;   : the makespan of scheduled jobs on machine   ;   : the process time of job   on machine   ;   tardiness : per unit time cost of job   tardiness;

Figure 1 :
Figure 1: An illustration of a feasible solution for scheduling on two unrelated parallel machines with six jobs.

Table 1 :
Process time, release time, and due date of each job.,  2 , . . .,  6 } are scheduled on two machines denoted { 1 ,  2 }.The process time   , release time   , and due date   are listed in

Table 2 :
For each machine  For each job  1 in machine  For each job  2 ( 2 ̸ =  1 ) in machine  Construct new solution by exchanging two jobs If the new solution is better than current one, then exchange two jobs Find the machine  1 with the highest objective value Find the machine  2 with the lowest objective value For each  1 in machine  1 For each  2 in machine  2 Construct new solution by exchanging two jobs If the new solution is better than current one, then exchange two jobs Parameter setting of the main factors in experimental design.
[1,3].Release times   are generated randomly from uniform distribution[1, 30].Due dates of jobs   are generated by TWK (total work-content) method and calculated by

Table 3 :
Orthogonal array and AOV results.

Table 4 :
Response value and significance rank of each parameter.

Table 5 :
Comparative results of three multiobjective optimization algorithms.