A Genetic-Algorithms-Based Approach for Programming Linear and Quadratic Optimization Problems with Uncertainty

This paper proposes a genetic-algorithms-based approach as an all-purpose problem-solving method for operation programming problems under uncertainty. The proposed method was applied for management of a municipal solid waste treatment system. Compared to the traditional interactive binary analysis, this approach has fewer limitations and is able to reduce the complexity in solving the inexact linear programming problems and inexact quadratic programming problems. The implementation of this approach was performed using the Genetic Algorithm Solver of MATLAB (trademark of MathWorks). The paper explains the genetic-algorithms-based method and presents details on the computation procedures for each type of inexact operation programming problems. A comparison of the results generated by the proposed method based on genetic algorithms with those produced by the traditional interactive binary analysis method is also presented.


Introduction
Economic optimization in operation planning of municipal solid waste management was first proposed in the 1960s [1].Since then, different models of waste management planning have been proposed, which include linear programming [2][3][4][5], mixed integer linear programming, dynamic programming, multiobjective programming [6][7][8], and hybrids of these methods combined with probability, fuzzy, and inexact analyses [9][10][11][12].The objectives of these waste management models include reduction of total cost, protection of the environment, and reuse of waste material and energy.
In real-life engineering problems, the available information often cannot be represented as deterministic numbers or distribution functions.Instead, it is often possible to represent the available information as inexact numbers, which can be readily used in the inexact programming models.This may be due to the fact that decision makers often prefer to have an inexact representation of uncertainty than provide a specification for distributions of fuzzy sets [13][14][15][16][17].For operational planning, the inexact analysis approach typically treats the uncertain parameters as intervals with known upper and lower bounds but unclear distributions.A major advantage of inexact analysis in operation planning is that variation of system performance and decision variables can be investigated by solving relatively simple submodels.
This paper is organized as follows.Section 2 presents the background of this research, which includes an introduction of the Genetic Algorithm Solver of MATLAB used for implementing the proposed method and the concepts of ILP, IQP, and their interactive binary analysis solution method [18].Section 3 discusses the methodology of the proposed genetic-algorithms-based methods for solving inexact liner problems and inexact quadratic problems.Section 4 presents the solution of the IQP problem of solid waste disposal planning as a case study.

Background
Linear programming and nonlinear programming are considered powerful optimization tools suitable for modeling and solving complex optimization problems in engineering.To handle uncertainty in real world data, inexact parameters and constraints are combined with various kinds of optimization techniques.Huang et al. [18][19][20][21] proposed two inexact nonlinear programming methods by introducing internal and fuzzy numbers into the quadratic programming (QP) frameworks.The methods of inexact quadratic programming (IQP) and inexact-fuzzy quadratic programming are applicable for operation planning of solid waste management systems.Often a detailed solution of IQP involves a large number of direct comparisons to interactively identify the uncertain relationships among the objective function and decision variables, whether the problems are mediumsized or larger-scaled.When these methods are applied to complicated and nonlinear problems, the number of direct comparisons can become exponential.In such a situation, we suggest that GA are a feasible problem-solving method.
GA have been applied as the optimization techniques for solving complex and nonlinear problems in operations research, industrial engineering, and management science.The GA method is a suitable optimization tool especially for solving problems, which involve nonsmooth and multimodal search spaces.An engineering problem that has traditionally been solved as an IQP problem often involves a large and uneven search space, for which a global optimal solution is often not required.Instead, we suggest that the GA-based method is a more effective problem-solving approach than some traditional inexact programming methods.

Genetic Algorithm Solver for MATLAB.
For implementation of genetic algorithms, the Genetic Algorithm Solver of Global Optimization Toolbox (GASGOT), developed by MATLAB (Trademark of MathWorks), has been adopted.GASGOT implements simulated evolution in the MATLAB environment using both binary and floating point representations and ordered base representation.This enables flexible implementation of the genetic operators, selection functions, termination functions, and evaluation functions.GASGOT was developed by the Department of Industrial Engineering of North Carolina State University as a toolbox of MATLAB.Hence, it runs in a MATLAB workspace and can be easily invoked by other programs.GASGOT supports implementation of binary chromosomes, binary mutation, and simple crossover.For floating point representation, the operators of uniform mutation, nonuniform mutation, multinonuniform mutation, boundary mutation, simple crossover, arithmetic crossover, and heuristic crossover are defined.
The GASGOT is adopted as the problem-solving engine of both the GA linear program and GA nonlinear program; all the applications and numeric examples were calculated using this solver in MATLAB.

Inexact Linear Programming and Its Problem-Solving
Approach.To support decision making involving uncertainties, Huang et al. [20,22] proposed an interactive binary analysis to solve the inexact linear programming (ILP) problem.
A typical ILP problem can be expressed as follows: where  ±  ,  ±  , and  ±  are inexact parameters and  ±  is an inexact variable.It is assumed that an optimal solution exists.For an inexact number  ± ∈ [ − ,  + ],  + and  − are the upper and lower bounds, respectively.
The traditional binary solution procedure is specified as follows.
Step 2. Define the upper and lower bounds of the objective function as  + and − .
Step 3. Define absolute values and signs for the coefficients of the constraints  ±  .
Step 4. Define the relationships between the decision variables  ±  and the absolute value of the coefficients of the constraints | ±  |.
Step 5. Formulate constraints corresponding to the upper and lower bounds of the objective function  + and  − .
Step 6.When the right-hand side of the constraints   are also inexact numbers, define the relationships between  ± and  ±  .
Step 7. Specify the two submodels.
For a detailed description of the procedure, see Huang et al. [20,22,23].

Inexact Quadratic Programming and Its Problem-Solving
Approach.A typical IQP problem is formulated as follows: where  ±  ,  ±  ,  ±  , and  ±  are inexact parameters,  ±  is an inexact variable, and it is assumed that an optimal solution exists.
The solution procedure is similar to that of ILP but involves more complexity and computation; the main steps of the solution procedure are listed as follows; for a detailed description, see Huang et al. [18,24,25].
Step 1. Group symbols for inexact coefficients  ±  and  ±  ; when  ±  and  ±  have the same signs, similar to the ILP, let former  1 coefficients be positive and latter  2 be negative;  1 +  2 = .When  ±  and  ±  have different signs, 2  combinations of the upper and lower bounds of  ±  have to be formulated for the objective function, which will require a large number of computations.
Step 2. Define the upper and lower bounds of the objective function as  + and  − .
Step 3. Define the absolute values and signs for the coefficients of the constraints  ±  and the relationships between the decision variables  ±  and the absolute value of the coefficients of the constraints | ±  |.When some  −  corresponds to  + and some  +  corresponds to  − , the specification of the constraints  ±   ±  ≤  ±  requires a comparison of the contribution of  +  and  −  groups to the sum ∑  =1  ±   ±  , when  + is desired.When the problem is complex, a direct comparison of the dominance of  +  and  −  becomes impossible; then some simplification and assumption need to be considered, which will affect the quality of the result.
Step 4. Formulate the constraints corresponding to the upper and lower bounds of the objective function  + and  − .
Step 5. When the right-hand side of the constraints   are also inexact numbers, define the relationships between  ± and  ±  .
Step 6. Specify the two submodels.
The genetic-algorithms-based methods to solve the above inexact linear problem and inexact quadratic problem will be presented in the next section, and the results from the GAbased methods will be compared to those generated using the traditional approach in [18,20,[22][23][24][25].

Genetic-Algorithms-Based Method for Solution of ILP Problems (GAILP).
A GA, as a heuristic search algorithm, has been adopted for solving the aforementioned ILP problem.In the GA approach, the upper and lower bounds of the inexact numbers of coefficients  ±  ,  ±  , and  ±  can be determined by substituting the initial suboptimal decision variables into the objective function. + and  − can be calculated directly without any uncertainty in the coefficients.This approach is called the genetic-algorithms-based method for solving ILP problems or the GAILP method.
GAILP has been designed to include three stages, which are discussed as follows.
The objective of the first stage is to get an initial suboptimal    for the following problem, which is transformed from the ILP problem defined in (1): where    ,    , and    are random numbers that satisfy the continuous uniform distribution in the intervals of and [ −  ,  +  ], respectively.Then, the problem is solved by the GA linear program solving engine of GASGOT, which uses the objective function in (3) as the positive term of the fitness function and the constraints of (1) as the negative punishment terms.Thus, a suboptimal solution   can be identified and the corresponding decision variables of    are also obtained.
In the second stage, the inexact coefficients of  ±  ,  ±  , and  ±  will be determined.Let the determined coefficients corresponding to + be  ± .These two sets of coefficients can be obtained using the following method.Substituting    into (1) will convert (1) into the following equation: To identify the coefficients  ±  ,  ±  , and  ±  corresponding to  ± , a set of objective functions needs to be constructed and solved.Since    are suboptimal variables, which tend to make the objective function closer to  + , consider  ±  ,  ±  , and  ±  as variables; then the objective function of ( 5) can be constructed so as to find  ± +  : The coefficients  ± +  are considered as corresponding to  + .
At the same time, the objective function presented in ( 6) can be constructed so as to find  ± −  : There are two kinds of decision schemes for inexact programming problems, which are the conservative schemes and optimistic schemes [26].The former assumes less risk than the latter, so that, for a maximization objective function, planning for the lower bound of an objective value represents the conservative scheme, and planning for the upper bound of an objective value represents the optimistic scheme [26].In terms of constraints, the conservative scheme involves more rigorous or stringent constraints, and the optimistic scheme adopts more tolerant ones.Thus, the problem of searching for  ±  + and  ±  + of the optimistic scheme and corresponding to the upper bound of the objective value of  + can be represented as follows: The problem In the third stage, the problem represented in ( 1) is converted into the following two subproblems.
For  + , For  − , This step eliminates the inexact parameters in (1) and generates instead ( 9) and ( 10) as typical linear programming (LP) problems, which can be solved easily using the traditional methods.Generally speaking, the interactive binary algorithm of Huang et al. [20,22] can be used for solving inexact linear problems reliably and relatively quickly for many real-life decision-making scenarios in the engineering field.However, this binary algorithm has some limitations.One of them, for example, is the limitation that the upper and lower bounds of an inexact coefficient cannot have different signs.By contrast, the GAILP does not have this kind of limitation because the GA method does not depend on any assumed distribution of the inexact parameter.
The following inexact linear problem demonstrates how GAILP is able to handle this situation: In stage one, the suboptimal   and the corresponding   1 and   2 are calculated: In stage two, substituting   1 and   2 into (11), the two sets of problems for determining  ± By solving (13), ( 14), (15), and ( 16), the coefficients are calculated as follows: In stage three, the two submodels for the optimistic scheme and the conservative scheme are constructed, respectively, as follows.
For the optimistic scheme,  + , For the conservative scheme,  − , The final result can be found by solving the previous two submodels: From the previous calculation, it can be seen that the GAILP method can be used without any assumption of the upper and lower bounds of the inexact coefficients.In fact, this method effectively extends the scope of problems solvable using the methods of the inexact linear programming problem.Therefore, the GAILP method is more adaptable for real world applications of optimization problems with uncertainty.In the next section, this method will be extended to solve the inexact quadratic problems.
The GAILP method generates a solution, which is different from that obtained using the interactive binary analysis proposed in [22].A comparison of the results will be discussed as follows.
For the  + optimistic scheme, the GAILP method can generate a result that is guaranteed to be as close as possible to the upper bound of the constraints.Hence, the maximized value of the objective function is greater than that produced by the interactive binary analysis.For the  − conservative scheme, the GAILP method has a higher probability of satisfying the requirements of the constraints as close as possible to the lowest limit.Hence, the maximized objective value is smaller.
In Figures 1, 2, 3, and 4 the bold lines denote the boundaries of the constraints, which limit the possible values for  1 and  2 to the left lower area.The constraint  11  ± 1 + 12  ± 2 ≤  1 is shown in these figures as the grey bold solid lines, which is the same for both the interactive binary analysis and the GAILP method.The dark bold dotted lines represent the constraint of  21  ± 1 +  22  ± 2 ≤  2 given by the interactive

Objective function line given by interactive binary analysis
Objective function line given by GAILP binary analysis, and the dark bold solid lines represent the same constraint given by the proposed GAILP method.
The boundaries, together with the  1 and  2 axes, enclose the entire area defined by the constraints.The objective functions  + = 30 + 1 − 5.5 + 2 or  − = 26 − 1 − 6 − 2 are groups of parallel lines, as shown in the figures by the thin solid and dotted lines.According to different values of  1 and  2 , these objective function lines would have different intercepts on both axes.These constraints restrict the objective function lines to cross with the constraints area, so that, at some vertex, the objective function would reach its extreme (i.e., maximized or minimized) values.
In Figures 1, 2, 3, and 4, the thin dotted lines are given by the interactive binary analysis, and the thin solid lines represent the objective functions given by the proposed GAILP method.The legend for Figure 1 to Figure 4 is shown in Table 1.

Genetic-Algorithms-Based Method for Solving IQP Problems (GAIQP).
The GAILP method can be extended to solve the inexact quadratic programming (IQP) problems or other more complicated inexact nonlinear programming problems.The typical IQP problem was presented in Section 2 as (2).
In stage one, to obtain an initial suboptimal    from a problem transformed from the IQP problem we use the following: where  In the second stage, substituting    into the formula in (2) converts (2) into the following formula: To determine the coefficients  ±  ,  ±  ,  ±  , and  ±  corresponding to  ± we use the following: Min To determine  ±  + and  ±  + of the optimistic scheme corresponding to the upper limit of the objective value of  + , we have the following: To obtain  ±  − and  ±  − , we use the following: In the third stage, the problem expressed in (2) has been converted into the following two subproblems.For  + , For  − , The inexact information has been incorporated in these two subproblems.These two subproblems, as typical nonlinear programming problems, can be solved by the GA nonlinear program solver engine of GASGOT.This method is applied to an IQP problem that was originally proposed by [27].This IQP problem can be expressed as follows: In stage one, suboptimal variables can be calculated using the GA nonlinear program solver engine of GASGOT: In stage two,   1 and   2 are used to construct the objective functions expressed in ( 27), ( 28 In stage three, the problems of ( 31) and (32) are generated as follows: Solving the above two problems, the solution of this sample problem is  ± = [2.6371,5.4234],  ± 1 = [0.2441,0.2857], and  ± 2 = [0.20792,0.45239].As a comparison, the solution given by [27] is To enhance the solution, the GAIQP engine can be reconfigured in stage three.For example, the maximum genetics generations number can be increased.However, this may not be necessary as the above generated solution is sufficiently satisfactory for many practical engineering problems.

Case Study
To illustrate the proposed method, the problem of solid waste disposal planning presented in [25] has been recalculated using the GAIQP method.In this case study, the system involves three cities.As shown in Figure 5, the planning horizon is 15 years, which is divided equally into three periods.A landfill and an incinerator are available for the disposal of the municipal solid waste.The landfill has an existing capacity of [2.05, 2.30]×10 6 t, and the incinerator has a capacity of [500, 600] t/d.The incinerator generates residues of approximately 30% of the incoming waste streams, and its revenue from energy sale is $ [15,25] per ton combusted.The waste generation rate of each city, operating costs of the facilities, and the waste transportation costs are summarized and shown in Table 2.
The objective of the optimization problem in this case study is to minimize the total costs by allocating waste flow between cities and facilities.In [25], this IQP model was formulated as follows: where  is residue flow rate from incinerator to landfill (it is 0.3 in this case),  ±  is transportation cost for residue from incinerator to landfill during period  ($/t),  is type of waste management facility ( = 1, 2, where  = 1 for landfill, 2 for incinerator),  is city,  = 1, 2, 3,  is time period,  = 1, 2, 3,   is length of period ,  1 =  2 =  3 = 365 * 5 (day), is operating cost of facility  during period  ($/t),  ±  is revenue from incinerator during period  ($/t), This interval quadratic programming problem has 18 variables   and 13 constraints.The GAIQP method is applied to solve this problem according to the three stages presented in Section 3.2.].This is close to the result given by [25], which is, for comparison purposes,  ± = [2.39× 10 8 , 5.14 × 10 8 ].This case study indicates that the GAIQP method can be configured to deal with large-scaled and complex engineering problems and give a satisfactory solution.If the parameters of the genetic algorithms of the nonlinear program solver engine of GASGOT are further tuned, a better solution can be generated.

Conclusions
Two genetic-algorithms-based methods have been proposed and applied for identifying an all-purpose optimization solution for the inexact linear programming and Inexact quadratic programming problems.The two methods are called GAILP and GAIQP.The Genetic Algorithm Solver of MATLAB was the implementation environment of the proposed methods.Compared to the GAILP and GAIQP methods, the traditional problem-solving method has limitations due to the complexity involved in selecting the upper or lower bounds of variables and parameters when the subobjective functions are being constructed.The complexity arises due to the extensive computation and necessary assumptions and simplification.The solution procedures of the proposed GA-based optimization methods do not involve any such assumption or simplification, and the quality of the result is guaranteed.The GAIQP method has been applied to a case study that deals with municipal solid waste management taken from [25].A comparison of the results shows that the proposed GA-based heuristic optimization approach is able to handle more complicated quadratic relationships involving uncertainty and provide better results.
The GA-based heuristic optimization approach is a flexible approach, which can be extended to find solutions for various types of operation programming scenarios.It can also be used as an all-purpose algorithm for economic optimizations.In the future, the methods of GAILP and GAIOP will be further developed for handling more complex inexact nonlinear problems.
will give  ± −  and  ± −  of the conservative scheme, corresponding to the lower bound of the objective value of  − .Hence, the values of  ±  +

Figure 5 :
Figure 5: Diagram of municipalities and waste management facilities in the case study.
],  ± is capacity of incinerator (t/d),  ± is capacity of landfill (t),  ±  is transportation cost for waste from city  to facility  during period  ($/t),