Applications of generalized linear multiplicative programming problems (LMP) can be frequently found in various areas of engineering practice and management science. In this paper, we present a simple global optimization algorithm for solving linear multiplicative programming problem (LMP). The algorithm is developed by a fusion of a new convex relaxation method and the branch and bound scheme with some accelerating techniques. Global convergence and optimality of the algorithm are also presented and extensive computational results are reported on a wide range of problems from recent literature and GLOBALLib. Numerical experiments show that the proposed algorithm with a new convex relaxation method is more efficient than usual branch and bound algorithm that used linear relaxation for solving the LMP.
Education Department of Henan Province14A11002415A110023National Natural Science Foundation of Henan Province152300410097Science and Technology Projects of Henan Province182102310941Cultivation Plan of Young Key Teachers in Colleges and Universities of Henan Province2016GGJS-107Higher School Key Scientific Research Projects of Henan Province18A11001917A110021Henan Institute of Science and Technology2015ZD071. Introduction
This paper deals with finding global optimal solutions for generalized linear multiplicative programming problems of the form(1)LMP:minf0x=∑j=1p0ϕ0jxψ0jxs.t.fix=∑j=1piϕijxψijx≤0,i=1,2,…,M,fix=∑j=1piϕijxψijx≥0,i=M+1,M+2,…,N,x∈D=x∈Rn∣Ax≤b,x≥0,where ϕij(x),ψij(x) in objective and constraints are linear functions with general forms ϕij(x)=∑k=1naijkxk+bij, ψij(x)=∑k=1ncijkxk+dij, aijk, cijk, bij, and dij are all arbitrary real numbers, i=0,1,2,…,N, j=1,2,…,pi, k=1,2,…,n, A∈Rm×n is a matrix, b∈Rm is a vector, and set D⊂Rn is nonempty and bounded.
Generally, linear multiplicative programming problem (LMP) is a special case of nonconvex programming problem, known to be NP-hard. Linear multiplicative programming problem (LMP) has attracted considerable attention in the literature because of its large number of practical applications in various fields of study, including financial optimization in Konno et al. [1], VLSI chip design in Dorneich and Sahinidis [2], data mining and pattern recognition in Bennett and Mangasarian [3], plant layout design in Quesada and Grossmann [4], marketing and service planning in Samadi et al. [5], robust optimization in Mulvey et al. [6], multiple-objective decision in Benson [7], in Keeney and Raika [8], in Geoffrion [9], location-allocation problems in in Konno et al. [10], constrained bimatrix games in Mangasarian [11], three-dimensional assignment problems in Frieze [12], certain linear max-min problems in Falk [13], and many problems in engineering design, economic management, and operations research. Another reason why this problem attracts so much attention is that, by utilizing some techniques, many mathematical programs like general quadratic programming, bilinear programming, linear multiplicative programming, and quadratically constrained quadratic programming can be converted into the special form of LMP in Benson [14]; in Tuy [15], the important class of sum of ratios fractional problems can also be encapsulated by LMP; in fact, suppose that fi are convex and gi are concave and positive. Since each 1/gi(x) is convex and positive, then the sum of ratios fractional problem (with the objective function as ∑fi(x)/gi(x)) reduces to LMP when gi and fi are linear. When gi and fi are negative, one can add a large real member to make negative be positive because of the compactness of the constraint set in Dai et al. [16].
Moreover, from the algorithmic design point of view, sum of products of two affine functions need not be convex (even not be quasi-convex), and hence linear multiplicative programming problem (LMP) may have multiple local solutions, which fail to be global optimal. Due to the facts above, developing practical global optimization algorithms for the LMP has great theoretical and the algorithmic significance.
In the past 20 years, many solution methods have been proposed for globally solving linear multiplicative programming problem (LMP) and its special cases. The methods are mainly classified as parameterization-based methods, outer-approximation methods, kinds of branch-and-bound methods, decomposition method, and cutting plane methods in Konno et al. [17], in Thoai [18], in Shen and Jiao [19, 20], in Wang et al. [21], in Jiao et al. [22], and in Shen et al. [23]. Most of these methods for linear multiplicative programming are designed only for problems in which the constraint functions are all linear or under the assumption that all linear functions that appeared in the multiplicative terms are nonnegative. And most branch-and-bound algorithms for this problem are developed based on two-phase linear relaxation scheme, which will take more computational time in the approximation process. For example, in Zhao and Liu [24] and in Jiao et al. [22], both algorithms utilize two-phase relaxation methods, and a large amount of computational time is consumed in the relaxation process. Compared with these algorithms, the main features of our new algorithm are threefold. (1) The problem investigated in this paper is linear multiplicative constrained multiplicative programming; it has a more general form than those linear multiplicative programming problems with linear constraints. (2) The relaxation programming problem is a convex programming which can be obtained with one-step relaxation; this will greatly improve the efficiency of approximation process. (3) The condition ϕij(x)>0,ψij(x)>0,∀x∈X, is a nonnecessitating requirement in our algorithm. (4) Extensive computational numerical examples and comparison from recent literature and GLOBALLib are performed to test our algorithm for LMP.
The rest of this paper is arranged in the following way. In Section 2, the construction process of the convex relaxation problem is detailed, which will provide a reliable lower bound for the optimal value of LMP. In Section 3, some key operations for designing a branch-and-bound algorithm and the global optimization algorithm for LMP are described. Convergence property of the algorithm is also established in this section. Numerical results are reported to show the feasibility and efficiency of our algorithm in Section 4 and some concluding remarks are reported in the last section.
2. Convex Relaxation of LMP
As is known to all, constructing a well-performed relaxation problem can bring great convenience for designing branch-and-bound algorithm of global optimization problems. In this section, we will show how to construct the convex relaxation programming problem (CRP) for LMP. For this, we first compute the initial variable bounds by solving the following linear programming problems: (2)xil=minx∈Dxi,xiu=maxx∈Dxi,i=1,2,…,n;then an initial hyperrectangle X0=x∈Rn∣xil≤xi≤xiu,i=1,2,…,n can be obtained.
For convenience for introduction of relaxation convex programming problem for LMP over subrectangle X⊂X0, we further solve the following set of linear programming problems:(3)lij=minx∈D⋂Xϕijx,uij=maxx∈D⋂Xϕijx,Lij=minx∈D⋂Xψijx,Uij=maxx∈D⋂Xψijx.Based on the construction process of lij and Lij and uij and Uij, it is not hard to see that(4)ϕijx-uijψijx-Uij≥0,ϕijx-lijψijx-Lij≥0,(5)ϕijx-lijψijx-Uij≤0,ϕijx-uijψijx-Lij≤0;by combining (4) with (5) and performing some equivalent transformation, we can easily obtain a lower and an upper bound of each bilinear term; that is,(6)ϕijxψijx≤minuijψijx+Lijϕijx-uijLij,lijψijx+Uijϕijx-Uijlij,ϕijxψijx≥maxuijψijx+Uijϕijx-Uijuij,lijψijx+Lijϕijx-Lijlij.To facilitate the narrative, ∀i=0,1,2,…,N, by denoting (7)g_ij1x≜uijψijx+Uijϕijx-Uijuij,g_ij2x≜lijψijx+Lijϕijx-Lijlij,g¯ij1x≜uijψijx+Lijϕijx-uijLij,g¯ij2x≜lijψijx+Uijϕijx-Uijlij,we can reformulate conclusion (6) as(8)ϕijxψijx≤ming¯ij1x,g¯ij2x≜g¯ijx,ϕijxψijx≥maxg_ij1x,g_ij2x≜g_ijx,respectively. With this, we obtain a lower bound function g_i(x) and upper bound function g¯i(x) for fi(x), which satisfy g_i(x)≤fi(x)≤g¯i(x), i=0,1,2,…,N, where(9)g_ix=∑j=1pig_ijx,g¯ix=∑j=1pig¯ijx,i=0,1,2,…,N.
So far, based on the above discussion, it is not too hard to obtain the relaxation programming problem over X for the LMP which we formulated as follows: (10)CRP:ming_0x=∑j=1p0g_0jxs.t.g_ix=∑j=1pig_ijx≤0,i=1,2,…,M,g¯ix=∑j=1pig¯ijx≥0,i=M+1,M+2,…,N,x∈D⋂X=x∈X∣Ax≤b,x≥0.
Remark 1.
As one can easily confirm, program (CRP) is a convex program which can be effectively solved by some convex optimization tool-boxes such as CVX; that is, all functions that appeared in the objective and constraints of CRP are convex.
Remark 2.
Both the lower and upper bound functions g_i(x) and g¯i(x) will approximate function fi(x), as the diameter of rectangle converges to zero.
3. Branch-and-Bound Algorithm and Its Convergence
As we have known, branch-and-bound algorithms utilize tree search strategies to implicitly enumerate all possible solutions to a given problem, applying pruning techniques to eliminate regions of the search space that cannot yield a better solution. There are three algorithmic components in branch-and-bound scheme which can be specified to fine-tune the performance of the algorithm. These components are the search strategy, the branching strategy, and the pruning rules. This section presents a description of these components and the proposed algorithm for solving LMP.
3.1. Key Operation
There are two important phases of any branch-and-bound algorithm: search phase and verification phase.
The choice of search strategy primarily impacts the search phase and has potentially significant consequences for the amount of computational time required and memory used. In this paper, we will choose the depth-first search (DFS) strategy with node ranking techniques, which can reduce a lot of storage space.
The choice of branching strategy determines how children nodes are generated from a subproblem. It has significant impacts on both the search phase and the verification phase. By branching appropriately at subproblems, the strategy can guide the algorithm towards optimal solutions. In this paper, to develop the proposed algorithm for LMP, we adopt a standard range bisection approach, which is adequate to insure global convergence of the proposed algorithm. Detailed process is described as follows.
For any region X=[xl,xu]⊂X0, let r∈argmaxxiu-xil∣i=1,2,…,n and xmid=(xrl+xru)/2, and then the current region X can be divided into the two following subregions:(11)X¯=x∈Rn∣xil≤xi≤xiu,i≠r,xrl≤xr≤xmid,X̿=x∈Rn∣xil≤xi≤xiu,i≠r,xmid≤xr≤xru.
Another critical aspect of branch-and-bound algorithm is the choice of pruning rules used to exclude regions of the search space from exploration. The most common way to prune is to produce a lower and (or) upper bound on the objective function value at each subproblem and use this to prune subproblems whose bound is no better than the incumbents solution value. For each partition subset X generated by the above branching operation, the bounding operation is mainly concentrated on estimating a lower bound LB(X) and an upper bound UB(X) for the optimal value of linear multiplicative programming problem (LMP). LB(X) can be obtained by solving the following convex relaxation programming problems: (12)CRPX:ming_0x=∑j=1p0g_0jxs.t.g_ix=∑j=1pig_ijx≤0,i=1,2,…,M,g¯ix=∑j=1pig¯ijx≥0,i=M+1,M+2,…,N,x∈D⋂X=x∈X∣Ax≤b,x≥0.Moreover, since any feasible solution of linear multiplicative programming problem (LMP) will provide a valid upper bound of the optimal value, we can evaluate the initial objective value of the optimal solution of CRP to determine an upper bound (if possible) for the optimal value of linear multiplicative programming problem (LMP) over X.
3.2. Branch-and-Bound Algorithm
Based on the former discussion, the presented algorithm for globally solving the LMP can be summarized as follows.
Step 0 (initialization).
Step 0.1. Set iteration counter k≔0 and the initial partition set as Ω0=X0. The set of active nodes X~0=X0; the upper bound UB=∞; the set of feasible points F=ϕ; the convergence tolerance ϵ=1×10-8.
Step 0.2. Solve the initial convex relaxation problem (CRP) over region X0; if the CRP is not feasible, then there is no feasible solution for the initial problem. Otherwise, denote the optimal value and solution as fopt0 and xopt0, respectively. If xopt0 is feasible to the LMP, we can obtain an initial upper bound and lower bound of the optimal value for linear multiplicative programming problem (LMP); that is, UB≔f0(xopt0), and LB≔fopt0. And then, if UB-LB<ϵ, the algorithm can stop, and xopt0 is the optimal solution of the LMP; otherwise proceed to Step 1.
Step 1 (branching).
Partition Xk into two new subrectangles according to the partition rule described in Section 3.1. Delete Xk and add the new nodes into the active nodes set X~k; still denote the set of new partitioned sets as X~k.
Step 2 (bounding).
For each subregion still of interest Xkμ⊆X0,μ=1,2, obtain the optimal solution and value for convex relaxation problem (CRP) by solving the convex relaxation programming problem over Xkμ; if LB(Xk,μ)>UB, delete Xkμ from X~k. Otherwise, we can update the lower and upper bounds: LB=min{LB(Xk,μ)∣μ=1,2} and UB=min{UB,f(xk,μ)∣μ=1,2}.
Step 3 (termination).
If UB-LB≤ϵ, the algorithm can be stopped; UB is the global optimal value for LMP. Otherwise, set k≔k+1, and select the node with the smallest optimal value as the current active node, and return to Step 1.
3.3. Global Convergence of the Algorithm
The global convergence properties of the above algorithm for solving linear multiplicative programming problem (LMP) can be given in the sense of the following theorem.
Theorem 3.
The proposed algorithm will terminate within finite iterations or it will generate an infinite sequence {xk}, any accumulation point of which is a global optimal solution for the LMP.
Proof.
If the proposed algorithm terminates finitely, assume that it terminates at the kth iteration: k≥0. By the termination criteria, we know that (13)UB-LB≤ϵ.Based on the upper bounding technique described in Step 2, it is implied that (14)fxk-LB≤ϵ.Let vopt be the optimal value of linear multiplicative programming problem (LMP); then, by Section 3.1 and Step 2 above, we know that (15)UB=fxk≥vopt≥LB.Hence, taking (14) and (15) together, it is implied that (16)vopt+ϵ≥LB+ϵ≥fxk≥vopt,and thus the proof of the first part is completed.
If the algorithm is infinite, then it generates an infinite feasible solution sequence {xk} for the LMP via solving the CRP. Since the feasible region of LMP is compact, the sequence {xk} must have a convergent subsequence. For definiteness and without loss of generality, assume limk→∞xk=x∗, and then we have (17)limk→∞ϕijxk=ϕijx∗,limk→∞ψijxk=ψijx∗.By the definitions of lij and Lij and uij and Uij, we know that (18)limk→∞lijxk=ϕijx∗,limk→∞Lijxk=ψijx∗.Moreover, we have(19)UBk=limk→∞fxk=fx∗,LBk=limk→∞∑j=1p0g_0jx=fx∗.Therefore, we have limk→∞(UBk-LBk)=0. This implies that x∗ is a global optimal solution for linear multiplicative programming problem (LMP).
4. Numerical Experiments
To test the proposed algorithm in efficiency and solution quality, we performed some computational examples on a personal computer containing an Intel Core i5 processor of 2.40 GHz and 4 GB of RAM. The code base is written in Matlab 2014a and all subproblems are solved by using CVX.
We consider some instances of linear multiplicative programming problem (LMP) from some recent literature in Wang and Liang [25], in Jiao [26], in Shen et al. [23], in Shen and Jiao [19, 20], and in Jiao et al. [22] and GLOBALLib at http://www.gamsworld.org/global/globallib.htm. Among them, Examples 1–6 are taken from some recent literature. Examples 7–11 are taken from GLOBALLib, a collection of nonlinear programming models. The last example is a nonlinear nonconvex mathematical programming problem with randomized linear multiplicative objective and constraint functions.
Examples 1–6 are taken from some literature, where they are solved by branch-and-bound algorithm with linear relaxation techniques. Numerical experiment demonstrates that the above method is more efficient than other methods in the sense that our algorithm requires rather less iterations and CPU time for solving the same problems. Specific results of numerical Examples 1–6 are listed in Table 1, where the notations used in the headline have the following meanings: Exam.: serial number of numerical examples in this paper; Ref.: serial number of numerical examples in the references; Iter.: iterative times; Time: CPU time in seconds; Prec.: precision used in the algorithm; Opt. val. and Opt. sol. denote the optimal value and solution of the problem, respectively.
Results of the numerical contrast experiments 1–6.
These five examples are taken from GLOBALLib; all of them are generalized linear multiplicative programs with different types of constraints. Computational results and some known results are listed in Table 2, where the notations used in the headline have the following meanings: Exam. denotes the serial number of the example tested in this paper; Best sol. and Best val. represent the best optimal solution and optimal value currently known; Our sol. and Our val. are the optimal solution and optimal value obtained by our algorithm described in this paper. From the results summarised in the table, we can see that our algorithm can effectively solve the LMP.
One has (31)xglob=1026.9484,1000,5485,265.0597,280.58873,134.9403,284.47098,380.5887xour=1026.9484,1000,5485.282,265.06,280.589,134.94,284.471,380.589.
Results of numerical experiments 7–11.
Exam.
Best sol.
Our sol.
Best val.
Our val.
7
Unknown
(1,0)
Unknown
0
8
Unknown
(0.9,0,0.9)
Unknown
-1
9
xglob
xour
7512.2301449
7512.2301446
10
Unknown
(0,0,0,3.333,26.6667)
Unknown
-473.778
11
Unknown
(7.08,0)
Unknown
-185.779196
Example 12 (random test).
(32)minfx=∑i=1pa0iTx+b0ic0iTx+d0is.t.∑i=1pa1iTx+b1ic1iTx+d1i≤0,∑i=1pa2iTx+b2ic2iTx+d2i≥0,x∈D=x∈Rn∣Ax≤b,where the real numbers b0j and d0j are randomly generated in the range [-1,1], b1j is randomly generated in interval [-1,0], d1j,b2j,d2j are randomly generated in the range [0,1], and the real elements of aij, cij, A, and b are randomly generated in the range [0,1].
For this problem, we tested 8 groups of instances with different dimension. For each group, we performed 10 instances for a total of 80 instances. The computational results are listed in Table 3, where the notations used in the headline have the following meanings: Avr. iter.: average numbers of iterations in the algorithm; Std. dev.: standard deviation; Avr. time: average CPU time in seconds; m and n denote the numbers of linear constraints and variables, respectively.
Numerical results of Example 12.
p
m
n
Avr. iter.
Std. dev.
Avr. time (s)
5
10
10
5.7
28.2
0.5157
5
10
20
11.4
13.4
1.315
5
10
30
19.0
14.7
5.528
10
10
20
31.4
18.4
41.2140
10
20
40
35.7
17.7
43.541
20
30
40
49.6
19.5
75.208
20
30
50
56.1
22.3
88.233
30
50
80
117.0
14.8
168.213
50
80
100
327.0
24.5
216.209
50
100
150
530.0
58.5
436.139
5. Concluding Remarks
This paper presents a new relaxation method for designing branch-and-bound algorithm for generalized linear multiplicative programming problem with linear multiplicative constraints. The relaxation problem is a convex programming which can be easily obtained with one-step relaxation; it has better approximation effect than usual two-phase linear relaxation method. The presented algorithm can efficiently work without nonnegative restriction to linear function in multiplicative terms, while this restriction is a necessary condition to most branch and bound algorithms described in a lot of literatures. Extensive results of numerical experiments from recent literature show that our method is feasible and effective for this kind of problems.
Conflicts of Interest
The authors declare that there are no conflicts of interest.
Acknowledgments
This paper is supported by the Science and Technology Key Project of Education Department of Henan Province (14A110024 and 15A110023), the National Natural Science Foundation of Henan Province (152300410097), the Science and Technology Projects of Henan Province (182102310941), the Cultivation Plan of Young Key Teachers in Colleges and Universities of Henan Province (2016GGJS-107), the Higher School Key Scientific Research Projects of Henan Province (18A110019 and 17A110021), and the Major Scientific Research Projects of Henan Institute of Science and Technology (2015ZD07).
KonnoH.ShirakawaH.YamazakiH.A mean-absolute deviation-skewness portfolio optimization model1993451-420522010.1007/BF02282050MR1254511Zbl0785.900142-s2.0-21344487416DorneichM. C.SahinidisN. V.Global optimization algorithms for chip layout and compaction199525213115410.1080/03052159508941259BennettK. P.MangasarianO. L.Bilinear separation of two sets in nspace19932320722710.1007/BF01299449MR1258204QuesadaI.GrossmannI. E.GrossmannI. E.Alternative bounding approximations for the global optimization of various engineering design problems19969Norwell, MAKluwer Academic PublishersSamadiF.MirzazadehA.PedramM. .Fuzzy pricing, marketing and service planning in a fuzzy inventory model: a geometric programming approach20133710-116683669410.1016/j.apm.2012.12.020MR30699692-s2.0-84878166851MulveyJ. M.VanderbeiR. J.ZeniosS. A.Robust optimization of large-scale systems199543226428110.1287/opre.43.2.264MR1327415Zbl0832.90084BensonH. P.Vector maximization with two objective functions197928225325710.1007/BF00933245MR536724Zbl0372.901262-s2.0-0001665298KeeneyR. L.RaikaH.1993CambridgeCambridge University PressGeoffrionA. M.Solving bicriterion mathematical programs1967153954MR020739210.1287/opre.15.1.39KonnoH.ThachP. T.TuyH.199715Dordrecht, The NetherlandsKluwer Academic PublishersNonconvex Optimization and its Applications10.1007/978-1-4615-4098-4MR1480917MangasarianO. L.Equilibrium points of bimatrix games196412778780FriezeA. M.A bilinear programming formulation of the 3-dimensional assignment problem19797137637910.1007/BF01585532MR0354002FalkJ. E.A linear max-min problem1973516918810.1007/BF01580119MR0332174Zbl0276.900532-s2.0-34250434850BensonH. P.Global maximization of a generalized concave multiplicative function2008137110512010.1007/s10957-007-9323-9MR2386617Zbl1145.900712-s2.0-41549121581TuyH.20162ndSwitzerlandSpringer International Publishing AGDaiY.ShiJ.WangS.Conical partition algorithm for maximizing the sum of dc ratios200531225327010.1007/s10898-004-5699-3MR21405342-s2.0-17444430818KonnoH.YajimaY.MatsuiT.Parametric simplex algorithms for solving a special class of nonconvex minimization problems199111658110.1007/BF00120666MR12638392-s2.0-0002398911ThoaiN. V.A global optimization approach for solving the convex multiplicative programming problem19911434135710.1007/BF00130830MR1266210ShenP.JiaoH.A new rectangle branch-and-pruning approach for generalized geometric programming200618321027103810.1016/j.amc.2006.05.137MR2290857Zbl1112.650582-s2.0-33845788391ShenP.JiaoH.Linearization method for a class of multiplicative programming with exponent2006183132833610.1016/j.amc.2006.05.074MR2282815Zbl1110.650512-s2.0-33845389469WangC.-F.LiuS.-Y.ShenP.-P.Global minimization of a generalized linear multiplicative programming20123662446245110.1016/j.apm.2011.09.002MR2887215Zbl1246.901622-s2.0-84857029765JiaoH.-W.LiuS.-Y.ZhaoY.-F.Effective algorithm for solving the generalized linear multiplicative problem with generalized polynomial constraints20153923-247568758210.1016/j.apm.2015.03.025MR34283032-s2.0-84958876166ShenP.DuanY.MaY.A robust solution approach for nonconvex quadratic programs with additional multiplicative constraints20082011-251452610.1016/j.amc.2007.12.039MR24319482-s2.0-44649201508ZhaoY.LiuS.An efficient method for generalized linear multiplicative programming problem with multiplicative constraints201651, article no. 13022-s2.0-8498126364710.1186/s40064-016-2984-9WangY.LiangZ.A deterministic global optimization algorithm for generalized geometric programming2005168172273710.1016/j.amc.2005.01.142MR2170862Zbl1105.653352-s2.0-25644459852JiaoH.A branch and bound algorithm for globally solving a class of nonconvex programming problems20097021113112310.1016/j.na.2008.02.005MR2468390