MPE Mathematical Problems in Engineering 1563-5147 1024-123X Hindawi Publishing Corporation 909203 10.1155/2014/909203 909203 Research Article A New Hybrid Intelligent Algorithm for Fuzzy Multiobjective Programming Problem Based on Credibility Theory Wang Zu-Tong 1 Guo Jian-Sheng 1 Zheng Ming-Fa 2 Wang Ying 1 Proppe Carsten 1 Equipment Management and Safety Engineering College Air Force Engineering University Xi'an 710051 China 2 School of Mathematics and Statistics Xi'an Jiaotong University Xi’an 710048 China 2014 2532014 2014 17 06 2013 21 02 2014 25 3 2014 2014 Copyright © 2014 Zu-Tong Wang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Based on the credibility theory, this paper is devoted to the fuzzy multiobjective programming problem. Firstly, the expected-value model of fuzzy multiobjective programming problem is provided based on credibility theory; then two new approaches for obtaining efficient solutions are proposed on the basis of the expected-value model, whose validity has been proven. For solving the fuzzy MOP problem efficiently, Latin hypercube sampling, fuzzy simulation, support vector machine, and artificial bee colony algorithm are integrated to build a hybrid intelligent algorithm. An application case study on availability allocation optimization problem in repairable parallel-series system design is documented. The results suggest that the proposed method has excellent consistency and efficiency in solving fuzzy multiobjective programming problem and is particularly useful for expensive systems.

1. Introduction

Many real-life problems have mainly been studied from the multiobjective optimization point of view; these problems require considering and optimizing multiple and conflicting objectives at the same time. The multiobjective programming (MOP) problem with deterministic parameters has received much research interest . But the application of deterministic MOP methods to real-world problems often faces the difficulty that, for a particular problem considered, the parameters involved take unknown or incommensurable values at the moment of making the decision.

As pointed out by Zimmermann , various kinds of indeterminacy can be categorized as stochastic uncertainty and fuzziness. When the parameters involved in MOP problem are stochastic in nature, then the resulting problem is referred to as a stochastic MOP problem and can be solved through probability theory. The stochastic MOP methods have been widely used in many real-world decision making problems with the gradual perfection of probability theory, including power systems planning , distributed energy resources planning , and network design . When the sample size is too small to estimate a probability distribution in real-life systems, information about these problems is often available in the form of vague descriptions; such types of indeterminacy are called fuzziness. The parameters involved in such kind of MOP problem are fuzzy variables, and the resulting problem is called a fuzzy MOP problem (FMOP). Due to its close description and representation of real world situation, the FMOP problem has been widely studied by researchers in a variety of fields, including both theory  and application . These FMOP problem studies mentioned above are all based on the fuzzy set theory  and the concept of possibility measure  introduced by Zadeh.

However, as B. Liu and Y. K. Liu stated in , since the possibility measure has no self-duality, one event with possibility measure of 1 will not be necessary to happen, while one event with possibility measure of 0 will be possible to happen. Based on possibility measure, B. Liu and Y. K. Liu  proposed a self-dual set function, credibility measure, which can be considered as the improvement of possibility measure in the fuzzy decision system, and an axiomatic foundation based on credibility measure, called credibility theory, has been developed [11, 12]. From a measure-theoretic viewpoint, credibility theory provides a theoretical foundation for fuzzy programming as the role of probability theory in stochastic programming .

Unfortunately, although the credibility theory is much closer to the real-world FMOP problem, it has been overlooked so far. There has been only one research of FMOP problem considered based on credibility theory in previous work, that is, the primary objective function method proposed by Zheng et al. . In this paper, the linear weighted method and the ideal point method are proposed to obtain Pareto efficient solutions in FMOP problem based on credibility theory. Since the expected value is widely used in real-life problems, the expected-value model of FMOP problem is proposed to convert the FMOP problem into a deterministic MOP problem, and the expected-value Pareto efficient solution in FMOP problem is defined based on credibility theory. Then the linear weighted method and the ideal point method are adopted to convert the expected-value model of FMOP problem into a single objective programming (SOP) problem, which proved that the optimal solutions to this SOP problem are expected-value Pareto efficient solutions to the original FMOP problem.

Given that the FMOP problems are always complex optimization problems with complicated feasible set, it is difficult to be solved by traditional methods; some hybrid intelligent algorithms using fuzzy simulation, artificial neural network (ANN), and genetic algorithm (GA) have been adopted for solving fuzzy programming problems . However, since the traditional sampling method used in the fuzzy simulation needs to generate large-scale size of decision points through purely random sampling, the ANN requires large numbers of sample data to obtain the desired precision in model approximation, and the GA needs long time to obtain the optimal solution in model optimization; the computation cost of these hybrid intelligent algorithms is very time-expensive. A new powerful and efficient hybrid intelligent algorithm should be designed and applied to the FMOP problem to reduce the computation cost and improve the computation accuracy. For this purpose, a hybrid intelligent algorithm composed of Latin hypercube sampling (LHS), fuzzy simulation, support vector machine (SVM), and artificial bee colony (ABC) algorithm has been proposed to obtain the Pareto efficient solutions in FMOP problem based on credibility theory in this paper.

In the hybrid intelligent algorithm presented, it is broken into four phases, that is, sample phase, simulation phase, approximation phase, and optimization phase. In sample phase, the problem is addressed using Latin hypercube sampling introduced by McKay et al. , which is a very popular sampling method for use with computationally demanding models. It has been theoretically and experimentally proved that LHS is more precise and robust than traditional random sampling methods [17, 18]. In simulation phase, the problem is addressed using fuzzy simulation method based on credibility theory to calculate the expected value of functions on the sample generated in sample phase. In approximation phase, the problem is addressed using a new and very promising regression technique developed by Vapnik et al.  in 1996, called support vector regression (SVR). The excellent performances of SVR in approximation have been obtained in [20, 21]. In optimization phase, the problem is addressed using the artificial bee colony (ABC for short) algorithm proposed by Karaboga in 2005 , which is a metaheuristic bionic algorithm based on the intelligent foraging behavior of honey bees. It has been validated that its effectiveness and efficiency on algorithm performance are competitive to other optimization algorithms . Since every phase in the hybrid intelligent algorithm is implanted with advanced methods, using the LHS and fuzzy simulation for model data collection, SVR for model approximation, and ABC algorithm for model optimization, respectively, it can reduce the computation cost and improve the computation accuracy greatly. The comparison result with traditional hybrid intelligent algorithm in a numerical example shows that this new algorithm is more precise and efficient.

The paper is organized in the following manner. In Section 2, some useful definitions and properties about credibility theory with application to FMOP problem are introduced. In Section 3, the mathematical models for a general FMOP problem are described, and the expected-value principle of FMOP problem is presented. Then, two solution methods are proposed to generate Pareto efficient solution of FMOP problem based on credibility theory, and relative proofs about its validity are also presented. In Section 4, a new powerful hybrid intelligent algorithm is proposed for solving the FMOP problem more efficiently, and a numerical example is presented to test its performance. In Section 5, an application case study on system availability design is provided to illustrate that the developed method in this paper is successful and efficient. Finally, a brief summary is given and some open points are stated for future research work in Section 6.

2. Preliminaries

In this section, some foundational concepts and properties of credibility theory are introduced, which will be used throughout this paper.

Given a universe Θ , Wang  defined an ample field 𝒫 ( Θ ) on Θ as a class of subsets of Θ that is closed under arbitrary unions, intersections, and complement in Θ , and Klir  introduced the possibility measure Pos on 𝒫 ( Θ ) such that

(Pos 1) Pos ( Ø ) = 0 , and Pos ( Θ ) = 1 ;

(Pos 2) Pos ( i I A i ) = sup i I Pos A i , for any subclass { ( A i i I ) } of 𝒫 ( Θ ) , where I is an arbitrary index set.

Definition 1 (see [<xref ref-type="bibr" rid="B16">10</xref>]).

Let Pos be a possibility measure. The set function Cr defined by (1) Cr ( A ) = ( 1 + Pos ( A ) - Pos ( A C ) ) 2 , A 𝒫 ( Θ ) , is called a credibility measure on 𝒫 ( Θ ) , where A C = Θ A is the set complement of A .

It is easy to check that Cr is a self-dual set function in the sense that (2) Cr { A } + Cr { A C } = 1 , A 𝒫 ( Θ ) .

The triplet ( Θ , 𝒫 ( Θ ) , Cr ) is referred to as a credibility space , in which a fuzzy vector is formally defined as follows.

Definition 2 (see [<xref ref-type="bibr" rid="B16">10</xref>]).

An n -dimensional fuzzy vector is defined as a function from a credibility space ( Θ , 𝒫 ( Θ ) , Cr ) to the set of n -dimensional real number vectors. If n = 1 , then it is called a fuzzy variable.

Definition 3 (see [<xref ref-type="bibr" rid="B13">28</xref>]).

Let f be a real-valued measurable function from R n to R , and let ξ i be a fuzzy variable on ( Θ i , 𝒫 ( Θ i ) , Pos ) , i = 1,2 , , n ; then ξ = f ( ξ 1 , ξ 2 , , ξ n ) defined by (3) ξ ( θ 1 , θ 2 , , θ n ) = f ( ξ 1 ( θ 1 ) , ξ 2 ( θ 2 ) , , ξ n ( θ n ) ) , cccccccccccccccccccccccccc ( θ 1 , θ 2 , , θ n ) Θ , is called a fuzzy variable on ( Θ , 𝒫 ( Θ ) , Pos ) , which is a tensor product of the n credibility spaces ( Θ i , 𝒫 ( Θ i ) , Pos ) , i = 1,2 , , n .

Definition 4 (see [<xref ref-type="bibr" rid="B16">10</xref>]).

Let ξ be a fuzzy variable; the expected value of ξ is defined as (4) E [ ξ ] = 0 Cr { ξ r } d r - - 0 Cr { ξ r } d r , provided that at least one of the two integrals is finite.

3. Solution Approaches 3.1. Mathematical Formulation

Let us consider the FMOP problem as follows: (5) min x R n cccccccc f ( x , ξ ) cccccccccccccc = ( f 1 ( x , ξ 1 ) , f 2 ( x , ξ 2 ) , , f p ( x , ξ n ) ) subject to : c c c c c c i c c c c i g i ( x , ξ i ) 0 , i = 1,2 , , m c c c c c c c i c c c i h k ( x , ξ k ) = 0 , k = 1,2 , , l , where x R n is a vector of decision variables of the problem, the functions f , g , and h are real-valued measurable functions, and ξ = ( ξ 1 , ξ 2 , , ξ n ) are fuzzy vectors whose components are continuous fuzzy variables, defined on the credibility space ( Θ , 𝒫 ( Θ ) , Cr ) .

3.2. Expected-Value Model of FMOP Problem

As the expected value of fuzzy variable is widely used in real-life problems, the expected-value model of FMOP problem (5) is presented as follows: (6) min x R n cccccccc E [ f ( x , ξ ) ] ccccccccccccc = ( [ f p ( x , ξ n ) ] E [ f 1 ( x , ξ 1 ) ] , E [ f 2 ( x , ξ 2 ) ] , , cccccccccccccccccc E [ f p ( x , ξ n ) ] ) subject to : ccccccccccc E [ g i ( x , ξ i ) ] 0 , i = 1,2 , , m ccccccccccc E [ h k ( x , ξ k ) ] = 0 , k = 1,2 , , l , where E [ f j ( x , ξ j ) ] , E [ g i ( x , ξ i ) ] , and E [ h k ( x , ξ k ) ] are the expected value of the fuzzy objectives f j ( x , ξ j ) , g i ( x , ξ i ) , and h k ( x , ξ k ) , respectively.

Since the objectives in expected-value model of FMOP problem are usually in conflict, there is no optimal solution that simultaneously minimizes all objective functions. In this case, the concept of expected-value Pareto solution should be introduced, which is defined as follows.

Definition 5.

A Pareto efficient solution x * in problem (6) is said to be expected-value Pareto efficient to the FMOP problem (5), where the feasible solution x * is said to be a Pareto efficient solution of problem (6) if there is no feasible solution x such that (7) E [ f j ( x , ξ j ) ] E [ f j ( x * , ξ j ) ] , j = 1,2 , , p , and E [ f j ( x , ξ j ) ] < E [ f j ( x * , ξ j ) ] for at least one index j.

If we denote the constraint conditions as (8) D = { x R n E [ g i ( x , ξ i ) ] 0 , i = 1,2 , , m ; c c c E [ h k ( x , ξ k ) ] = 0 , k = 1,2 , , l } , then the expected-value model can be presented as the following equivalent model: (9) min x D E [ f ( x , ξ ) ] cccccccc = ( E [ f 1 ( x , ξ 1 ) ] , E [ f 2 ( x , ξ 2 ) ] , , E [ f p ( x , ξ n ) ] ) , where the set of feasible solutions D R n is nonempty and compact.

3.3. Linear Weighted Method

The first method we proposed is the linear weighted method, which converts the expected-value model in (9) into a deterministic single objective programming (SOP) problem by weighting the objective functions according to the importance of each objective; that is, (10) min x D E [ f ( x , ξ ) ] = j = 1 p λ j E [ f j ( x , ξ j ) ] , where λ Λ + + = { λ = ( λ 1 , , λ p ) T λ j > 0 , j = 1 p λ j = 1 } .

Theorem 6.

The optimal solution to the deterministic SOP problem in (10) using linear weighted method must be expected-value Pareto efficient to the original model of FMOP problem in (5).

Proof.

Suppose that x * is the optimal solution to the deterministic SOP problem in (10), but it is not expected-value Pareto efficient to the original model of FMOP problem (5). Following Definition 5, we can obtain that there must exist some x ¯ such that E [ f j ( x ¯ , ξ j ) ] E [ f j ( x * , ξ j ) ] and E [ f j ( x ¯ , ξ j ) ] < E [ f j ( x * , ξ j ) ] for at least one index j , j = 1,2 , , p .

Since λ Λ + + , we can get that (11) j = 1 p λ j E [ f j ( x ¯ , ξ j ) ] < j = 1 p λ j E [ f j ( x * , ξ j ) ] ; that is to say, E [ f ( x ¯ , ξ ) ] < E [ f ( x * , ξ ) ] . In other words, x * is not the optimal solution to the deterministic SOP problem in (10), which contradicts with the previous hypothesis that x * is expected-value Pareto efficient to the original model of FMOP problem (5). The theorem is proved.

3.4. Ideal Point Method

The second method we proposed is the ideal point method, which converts the expected-value model in (9) into a deterministic single objective programming (SOP) problem by minimizing the distance function from a solution (12) ( E [ f 1 ( x , ξ 1 ) ] , E [ f 2 ( x , ξ 2 ) ] , , E [ f p ( x , ξ p ) ] ) , to an ideal vector ( f 1 0 , f 2 0 , , f p 0 ) , where f j 0 denotes the optimal values of the j th objective functions on the set of feasible solution D without considering other objectives, j = 1,2 , , p , respectively. That is, (13) min x D E [ f ( x , ξ ) ] = j = 1 p ( E [ f j ( x , ξ j ) ] - f j 0 ) 2 .

Theorem 7.

The optimal solution to the deterministic SOP problem in (13) using ideal point method must be expected-value Pareto efficient to the original model of FMOP problem in (5).

Proof.

Suppose that x * is the optimal solution to the deterministic SOP problem in (13), but it is not expected-value Pareto efficient to the original model of FMOP problem (5). Following Definition 5, we can obtain that there must exist some x ¯ such that E [ f j ( x ¯ , ξ j ) ] E [ f j ( x * , ξ j ) ] and E [ f j ( x ¯ , ξ j ) ] < E [ f j ( x * , ξ j ) ] for at least one index j , j = 1,2 , , p .

Without any loss of generality, let us assume when j = j 0 , E [ f j 0 ( x ¯ , ξ j 0 ) ] < E [ f j 0 ( x * , ξ j 0 ) ] . As f j 0 0 is the optimal value of E [ f j 0 ( x , ξ j 0 ) ] , then (14) ( E [ f j 0 ( x ¯ , ξ j 0 ) ] - f j 0 0 ) 2 < ( E [ f j 0 ( x * , ξ j 0 ) ] - f j 0 0 ) 2 . When j j 0 , it is obvious that (15) E [ f j ( x ¯ , ξ j ) ] E [ f j ( x * , ξ j ) ] . Since f j 0 denotes the optimal value of single objective E [ f j ( x , ξ j ) ] ( for j = 1,2 , , p ) on feasible set, then we can get that (16) ( E [ f j ( x ¯ , ξ j ) ] - f j 0 ) 2 ( E [ f j ( x * , ξ j ) ] - f j 0 ) 2 , ( j j 0 ) . Then, it follows that (17) j = 1 p ( E [ f j ( x ¯ , ξ j ) ] - f j 0 ) 2 < j = 1 p ( E [ f j ( x * , ξ j ) ] - f j 0 ) 2 And it further gets that (18) j = 1 p ( E [ f j ( x ¯ , ξ j ) ] - f j 0 ) 2 < j = 1 p ( E [ f j ( x * , ξ j ) ] - f j 0 ) 2 ; that is to say, E [ f ( x ¯ , ξ ) ] < E [ f ( x * , ξ ) ] . In other words, x * is not the optimal solution to the deterministic SOP problem in (13), which contradicts with the previous hypothesis that x * is expected-value Pareto efficient to the original model of FMOP problem (5). The theorem is proved.

4. Hybrid Intelligent Algorithm for FMOP Problem

To perform multiobjective optimization under fuzziness, the most direct approach is to nest the iterative loops by performing complete fuzzy estimation (inner loop) for each optimization data request (outer loop). However, this can be prohibitively expensive; for this reason, the optimization techniques must be combined with hybrid intelligent algorithm. In this section, the Latin hypercube sampling (LHS), fuzzy simulation, support vector regression (SVR), and artificial bee colony (ABC) algorithm are integrated to design a powerful hybrid intelligent algorithm for solving FMOP problem.

4.1. Generating Sample Using LHS

The goal of sampling is to generate a matrix of experiments X n = ( x i j ) n × k , where n is the number of experiments and k is the number of variables. As an extension of stratified-random procedure, Latin hypercube sampling has a long history and has shown its robustness capabilities in sample generation. The LHS involves sampling n s values from the prescribed distribution of each of k decision variables X 1 , X 2 , , X k in FMOP problem. Unlike simple random sampling, LHS ensures a full coverage of the range of each variable by maximally stratifying each marginal distribution.

As the information of design variables in FMOP problem is always hard-available beforehand, we assume that all design variables follow uniform distribution. The main steps of LHS in FMOP problem can be summarized as follows.

Step 1: divide the cumulative distribution of each design variable into N equiprobable intervals.

Step 2: select a value from each interval randomly; once a point is selected in an interval, no other point could be selected in this interval. For the i th interval, the sampled cumulative probability can be written as Prob i = ( 1 / N ) r u + ( i - 1 ) / N , where r u is uniformly distributed random number ranging from 0 to 1.

Step 3: transform the probability values sampled into the value using the inverse of the distribution function F - 1 : x = F - 1 ( Prob ) .

Step 4: the N values obtained for each design variable x are paired randomly with the n s values of other design variables.

4.2. Computing the Objective Functions Using Fuzzy Simulation

Due to the complexity of fuzzy objective functions, we adopt the fuzzy simulation to calculate the expected value of objective functions on the sample generated by LHS. The main steps of fuzzy simulation in FMOP problem can be summarized as follows.

Step 1: choose one sampling point x 0 from the sample generated by LHS.

Step 2: set e = 0 .

Step 3: generate θ k from Θ according to the possibility measure Pos, and assure that Pos ( θ k ) ε , k = 1,2 , , n , where n is a sufficiently large number and ε is a sufficiently small number.

Step 4: set a = f ( x 0 , ξ ( θ 1 ) ) f ( x 0 , ξ ( θ n ) ) and b = f ( x 0 , ξ ( θ 1 ) ) f ( x 0 , ξ ( θ n ) ) .

Step 5: generate r from uniformly [ a , b ] .

Step 6: if r 0 , then e e + Cr { f ( x 0 , ξ ) r } .

Step 7: if r < 0 , then e e - Cr { f ( x 0 , ξ ) r } .

Step 8: repeat the fifth to seventh steps for N times, where N is a sufficiently large number.

Step 9: return E [ f ( x 0 , ξ ) ] = a 0 + b 0 + e · ( b - a ) / N .

Step 10: return to Step 1 until all the sample points have been chosen out.

In Steps 6 and 7, there involves the calculation of credibility measure; following Definition 1 of credibility measure, we can obtain that (19) Cr { f ( x 0 , ξ ) r } = ( 1 + Pos { f ( x 0 , ξ ) r } - Pos { f ( x 0 , ξ ) < r } ) 2 , Cr { f ( x 0 , ξ ) r } = ( 1 + Pos { f ( x 0 , ξ ) r } - Pos { f ( x 0 , ξ ) > r } ) 2 .

4.3. Approximating the Expected-Value Model Using SVR

After obtaining the sample in feasible set and the corresponding expected values of objective functions, it needs to build a surrogate model to map the relationships between them, which can be considered as a regression process. Support vector regression (SVR) is a new regression method different from traditional/statistical ones; it minimizes the generalized error bound instead of the observed training error, so as to achieve the generalized performance. In this paper, we start our study on the basis of the SVM toolbox—LIBSVM directly , rather than discussing the principle and algorithm of SVR. LIBSVM is a library for SVM, whose goal is to let users easily use SVM as a tool. Since the control parameters of SVR are very sensitive to its performance, a successful parameter selection is very important, especially the parameter γ in kernel function and the parameter C of cost. The artificial bee colony (ABC) algorithm is used to find the optimal control parameters aiming at the best regression accuracy, called ABC-SVR. The main steps of the ABC-SVR application in the FMOP problem can be summarized as follows.

Step 1: generate train data and test data based on the sample and its corresponding expected values of objective functions.

Step 2: normalize the train data and test data to improve the regression ability of SVR.

Step 3: denote the parameter γ in kernel function and the parameter C of cost as a food position ( c , γ ) and the regression accuracy as the nectar amount.

Step 4: adopt ABC algorithm to find the optimal control parameters of SVR (optimal food position) on the normalized data.

Step 5: use the optimal control parameters to build a SVR model and train it according to the train data.

Step 6: employ the test data to validate the accuracy of trained SVR model. If the regression accuracy does not meet, return to Step 3 to change the ABC options until the desired accuracy is met.

4.4. Optimization Using ABC Algorithm

Created by Karaboga , the artificial bee colony algorithm is a new population-based metaheuristic method that is motivated by the intelligent foraging behaviors of honeybee swarm. In the ABC algorithm, there are three essential components, that is, food source positions, nectar amount, and three kinds of foraging bees (employed bees, onlookers, and scouts). Each food source position represents a feasible solution to the optimization problem being considered and the nectar amount of a food source corresponds to the quality (fitness) of the solution being represented by that food source. Each kind of foraging bee performs one particular operation for generating new candidate food source positions. The ABC algorithm visualizes the employed and onlooker bees as performing the job of local search (exploitation) whereas the onlookers and scouts bees as performing the job of global search (exploration). Specifically, unlike real bee colonies, the ABC algorithm assumes that there is a one-to-one correspondence between the employed bees and the food sources; that is, the number of food sources (solution) is the same as the number of employed bees. The main steps of ABC algorithm in the FMOP problem can be summarized as follows.

Step 1: initialize the control parameters, including the number of food sources or the number of the employed bees, number of onlooker bees, number of scout bees, and number of cycles.

Step 2: initialize population of food source with random solutions.

Step 3: send the employed bees to the food sources and determine the nectar amounts f i using the SVR model built in Section 4.3.

Step 4: calculate the fitness values of each solution fi t i and its corresponding probability values as follows: (20) fi t i = { 1 ( 1 + f i ) if f i 0 , 1 + abs ( f i ) if f i < 0 , p i = fi t i i = 1 S N fi t i ,

where i = 1,2 , , S N and S N is the number of food sources.

Step 5: send the onlooker bees to their food sources according to the probability values.

Step 6: send the scouts to the search area if a food source could not be improved through “limit" trials and replace it with a new randomly produced solution if the new solution is better.

Step 7: memorize the best food source (solution) achieved so far.

Step 8: if a stopping criterion is met, then output the best food source; otherwise, go back to Step 3.

Straightforwardly, the framework of the proposed hybrid intelligent algorithm is illustrated in Figure 1. It can be seen that the hybrid intelligent algorithm not only applies classic sample method to generate sample data in feasible set but also adopts advanced regression procedure to build surrogate model and powerful optimization algorithm for solution improvement.

Framework of hybrid intelligent algorithm for FMOP problem.

4.5. Performance Comparison with the Traditional Hybrid Intelligent Algorithm

To test the performance of the proposed hybrid intelligent algorithm, it is compared with the traditional hybrid intelligent algorithm on a numerical example from , which is presented as follows: (21) max E [ x 1 - ξ 1 + x 2 - ξ 2 + x 3 - ξ 3 ] s . t . x 1 2 + x 2 2 + x 3 2 10 , where ξ 1 , ξ 2 , and ξ 3 are triangular fuzzy variables ( - 4 , - 2,0 ) , ( - 2,0 , - 2 ) , and ( 0,2 , 4 ) , respectively. In the traditional hybrid intelligent algorithm, it needs to produce 2000 sample data to train the ANN and 6000 generations in the evolution of GA. While in the new algorithm, it just needs to produce 500 sample data and go through 60 cycles. The results obtained using these two algorithms are shown in Table 1. It can be obtained that the proposed algorithm is more precise and efficient than the traditional hybrid intelligent algorithm.

Performance comparison.

Traditional algorithm Proposed algorithm
Optimal solution (−1.7809, −1.8632, −1.8322) (−1.1469, −2.3775, −1.7375)
Minimum objective 3.77 3.94
Time cost 1659 seconds 185 seconds
5. Application Case Study

The approach for solving FMOP problems proposed above is illustrated through an availability optimization problem in repairable parallel-series system design. A parallel-series system is a system made of parallel subsystems put in serial, which can be shown as in Figure 2. A parallel subsystem works when at least one of its components works and a series system fails when at least one of its components fails. The problem of availability optimization in system design can be formulated as a multiobjective optimization problem: minimize the cost and maximize the availability of the global system simultaneously. Uncertainty has always been an important consideration when designing and analyzing systems. It assumes that the failure rate and repair rate of components are fuzzy variables in this case, and its membership function can be available before system design using expert knowledge. In this example, we suppose that the subsystems are parallel, and that in each subsystem all components are identical. Here, the “identical” term means that the failure rate and repair rate of components have the same membership function in fuzzy environment. Then the decision variables of this problem are the number of components k i in each subsystem ( i = 1,2 , , s ) , and the availability optimization problem is to find the optimal values of k i to minimize the cost and maximize the system availability.

General structure of a parallel-series system.

5.1. Mathematical Model of the Problem

The formulation of the mathematical model taking into account all the influential factors is very important for the success of optimization. Let k i , A s , and C s denote the number of components in each subsystem, the availability of the system, and the system cost, respectively. Then the FMOP problem can be formulated as follows: (22) max k c c c c c c c A s ( λ , μ , k ) = i = 1 s ( 1 - ( λ i λ i + μ i ) k i ) , min k c c c c c c c C s ( λ , μ , k ) = i = 1 s k i ( a i λ i p i + b i μ i q i ) , subject to : c c c c c c c c c c c l k i k i u k i ( i = 1,2 , , s ) , k i N + . The variables in the FMOP model above are illustrated in Table 2.

Nomenclature used in the mathematical model (22).

Variable Signification
s Number of subsystems
i Index of a subsystem
λ i Fuzzy variable of the failure rate of components in subsystem i with known membership function
λ λ = ( λ 1 , λ 2 , , λ s )
μ i Fuzzy variable of the repair rate of components in subsystem i with known membership function
μ μ = ( μ 1 , μ 2 , , μ s )
k i Number of components in subsystem i
k k = ( k 1 , k 2 , , k s )
l k , u k Vector of minimum and maximum number of components allowable in each subsystem
a i , b i , p i , q i Coefficients of the cost function which can be obtained from maintenance database

Since maximizing the availability A s is equivalent to minimizing the unavailability ( 1 - A s ) , the mathematical model can be transformed as follows: (23) min k c c c c c c U s ( λ , μ , k ) = 1 - A s ( λ , μ , k ) min k c c c c c c C s ( λ , μ , k ) subject to : c c c c c c c c c c l k i k i u k i ( i = 1,2 , , s ) , k i N + .

5.2. Input Data of the Optimization Problem

After constructing the mathematical model, our next task is to determine the input data of the optimization problem. It is assumed that the system considered consists of six parallel subsystems in serial; that is to say, s = 6 . Since the trapezium fuzzy variables have been widely used in system reliability analysis, λ i , μ i are supposed to be trapezium fuzzy variables. The input data we assumed are shown in Table 3.

The input data of problem.

 Membership function of λ i 1 0 - 3 × ( 2 + 0.2 ( i - 1 ) , 2.5 + 0.2 ( i - 1 ) , 3 + 0.2 ( i - 1 ) , 3.5 + 0.2 ( i - 1 ) ) ,   i = 1,2 , … , 6 Membership function of μ i ( 0.1 + 0.05 ( i - 1 ) , 0.15 + 0.05 ( i - 1 ) , 0.2 + 0.05 ( i - 1 ) , 0.25 + 0.05 ( i - 1 ) ) ,   i = 1,2 , … , 6 l k 1 × ( 1,1 , 1,1 , 1,1 ) u k 6 × ( 1,1 , 1,1 , 1,1 ) a 0.01 × ( 4,2 , 8,5 , 12,8 ) b 0.1 × ( 0.4,0.2,0.8,1 , 1.2,0.8 ) p - 0.8 × ( 0.4,0.2,0.8,1 , 1.2,0.8 ) q 0.85 × ( 0.4,0.2,0.8,1 , 1.2,0.8 )
5.3. Problem Solution

In this subsection, we will try to solve the FMOP problem described above based on credibility theory using the approaches proposed in this paper.

5.3.1. Equivalent Transformation of FMOP Problem

Here, two approaches proposed in Section 3 are adopted to transform it into a deterministic SOP problem for generating Pareto efficient solutions. Using linear weighted method, it can obtain the equivalent SOP model as follows: (24) min k c c c c c c ω 1 E [ U s ( λ , μ , k ) ] + ω 2 E [ C s ( λ , μ , k ) ] subject to : c c c c c c c c c c l k i k i u k i ( i = 1,2 , , s ) , k i N + .

Using ideal point method, it can obtain the equivalent SOP model as follows: (25) min k E [ U s ( λ , μ , k ) ] - U s 0 2 + E [ C s ( λ , μ , k ) ] - C s 0 2 s . t . l k i k i u k i ( i = 1,2 , , s ) , k i N + , where U s 0 and C s 0 denote the optimal expected value of unavailability U s and C s without considering other objectives, respectively.

5.3.2. Sample Phase

As the information of the number of components in each subsystem is unknown beforehand, it is assumed that all design variables k i , ( i = 1,2 , , 6 ) follow uniform distribution U ( 1,6 ) . Because k i are discrete value, we use LHS to generate sample in the feasible set and take the integers nearest to the sample value generated by LHS. We set the sample size as 300, and the first ten sample points are shown in Table 4.

The first ten sample points generated by LHS.

Sample point (SP) Sample data
SP1 (2, 2, 5, 3, 5, 2)
SP2 (2, 4, 5, 2, 1, 3)
SP3 (5, 5, 5, 4, 2, 5)
SP4 (5, 2, 3, 2, 5, 2)
SP5 (5, 6, 2, 6, 4, 4)
SP6 (5, 5, 3, 4, 3, 5)
SP7 (2, 6, 5, 4, 5, 2)
SP8 (2, 4, 2, 5, 3, 2)
SP9 (2, 4, 1, 1, 4, 6)
SP10 (4, 3, 5, 2, 6, 2)
5.3.3. Simulation Phase

We adopt the fuzzy simulation to calculate the expected value of unavailability U s ( E [ U s ] ) and cost C s ( E [ C s ] ) on the 300 sample points generated by LHS. We set the number of expected-value calculation cycle (outer loop) as 500 and the number of credibility measure calculation cycle (inner loop) as 5000. The simulation results of the first ten sample points are shown in Table 5.

Fuzzy simulation results of the first ten sample points.

Sample point (SP) The expected value of unavailability U s The expected value of cost C s
SP1 8.7025 e - 04 135.7135 units
SP2 0.0169 57.1931 units
SP3 3.7900 e - 04 105.1304 units
SP4 0.0018 176.9077 units
SP5 8.9794 e - 04 187.3301 units
SP6 3.2716 e - 05 161.0648 units
SP7 0.0035 250.7263 units
SP8 0.0047 179.1654 units
SP9 0.0959 213.2756 units
SP10 0.0021 338.1837 units
5.3.4. Approximation Phase

After obtaining the sample in feasible set and the corresponding expected values of objective functions, we use ABC-SVR method to build the surrogate model. Since the precision required in the calculation of E [ U s ] and E [ C s ] is very high, it is very difficult to obtain an ideal surrogate model to predict E [ U s ] and E [ C s ] . However, we can use the ABC-SVR to build a surrogate model to map the order relationship between sample and objectives. In other words, even though we cannot predict the E [ U s ] and E [ C s ] of a sample point with high precision, we can predict the order of E [ U s ] and E [ C s ] in all sample objectives correctly. That is to say, the sample point with minimum objectives we predicted is also the corresponding sample point with minimum objectives in sample data; the optimal solution we get in the surrogate model is also the optimal solution in real problem. After getting the optimal solution, the fuzzy simulation is adopted to obtain the corresponding E [ U s ] and E [ C s ] with high precision. We take the 1–250 sample data as the train data and the 251–300 sample data as the test data to validate the surrogate model. Two surrogate models are built to predict E [ U s ] and E [ C s ] , respectively. The accuracy of order prediction is used to represent the regression performance and compare the regression performance of ABC-SVR with normal SVR using grid search method and BP artificial neural network. In the ABC algorithm, the maximum number of cycles was taken as 2500. The percentages of onlooker bees and employed bees were half of the colony and the number of scout bees was selected to be one. Parameters set for the ABC algorithm are given in Table 6, and the comparison result is shown in Tables 7 and 8.

Control parameters adopted in the ABC algorithm.

Control parameters in ABC algorithm
Colony size 40
Limit 100
Number of onlookers Half of the colony size
Number of employed bees Half of the colony size
Number of scouts 1

Comparison results of three methods (ABC-SVM/SVM/ANN) about E [ U s ] .

Method Parameters Regression performance
Train data Test data
ABC-SVM bestc = 1.5105 and bestg = 0.4064 245 / 250 (98%) 47 / 50 (94%)
SVM bestc = 0.7071 and bestg = 0.3536 216 / 250 (86.4%) 32 / 50 (64%)
ANN Hidden layer number = 10 187 / 250 (74.8%) 26 / 50 (52%)

Comparison results of three methods (ABC-SVM/SVM/ANN) about E [ C s ] .

Method Parameters Regression performance
Train data Test data
ABC-SVM bestc = 3.3354 and bestg = 0.0100 248 / 250 (99.2%) 48 / 50 (96%)
SVM bestc = 22.6274 and bestg = 0.0020 221 / 250 (88.4%) 34 / 50 (68%)
ANN Hidden layer number = 10 198 / 250 (79.2%) 26 / 50 (52%)

As shown in Tables 7 and 8, the regression performance of ABC-SVM is the best. Furthermore, it has achieved an ideal precision.

5.3.5. Optimization Phase

After obtaining the two surrogate models of E [ U s ] and E [ C s ] , the ABC algorithm is adopted to find the optimal solution of deterministic SOP problem (24) (25). In the ABC algorithm, control parameters set for the ABC algorithm are the same as shown in Table 6.

In the solution of model (24), three scenarios are considered here; they are ω 1 = 0.7 , ω 2 = 0.3 , ω 1 = 0.5 , ω 2 = 0.5 , ω 1 = 0.3 , and ω 2 = 0.7 , respectively. The results obtained are shown in Table 9.

Results obtained in model (24).

Scenarios Results
ω 1 = 0.7 , ω 2 = 0.3 E [ U s ] 2.7216 e - 06
E [ C s ] 103.6331 units
Optimal solution (5, 5, 4, 4, 3, 5)

ω 1 = 0.5 , ω 2 = 0.5 E [ U s ] 5.6275 e - 06
E [ C s ] 100.0452 units
Optimal solution (5, 5, 5, 3, 3, 4)

ω 1 = 0.3 , ω 2 = 0.7 E [ U s ] 0.0394
E [ C s ] 35.6331 units
Optimal solution (3, 3, 1, 1, 1, 3)

As shown in Table 9, the results obtained are different in three scenarios; this is due to the fact that different weights denote different importance of the objectives and higher weight implies higher importance. Therefore, the optimal solutions obtained are different.

Next, we consider the solution of model (25). Using ABC algorithm, we can obtain the minimum values of E [ U s ] and E [ C s ] on the feasible set without considering other objectives. They are 3.5894e-10 and 30.412316692, respectively. Then, we can solve the model (25) using the same way in the solution of model (24). The results obtained are shown in Table 10.

Results obtained in model (25).

Results
E [ U s ] 1.8425 e - 04
E [ C s ] 73.7527 units
Optimal solution (4, 5, 4, 3, 2, 3)
6. Conclusion

In this paper, two new solution approaches were proposed to generate Pareto efficient solutions for FMOP problem based on credibility theory, which are different from the traditional FMOP solution methods. To solve the FMOP problem efficiently based on credibility theory, Latin hypercube sampling (LHS), fuzzy simulation, support vector regression (SVR), and artificial bee colony (ABC) algorithm are integrated to design a powerful hybrid intelligent algorithm. An application case study on system availability optimization was provided to show the modeling of FMOP problem based on credibility theory and validate the performance of the hybrid intelligent algorithm. Specifically, given that the availability optimization problem requires a very high precision, we suggest finding the optimal solution according to the order of objectives, instead of the real values of objectives. And then the precise optimal values of objectives can be obtained using fuzzy simulation after we get the optimal solution.

In our view, the following problems in the FMOP field should be studied based on credibility theory in future, some of these problems are as follows.

Other deterministic models of FMOP problem should be proposed and considered based on credibility theory, such as the variance model, α -optimistic value model, α -pessimistic value model, and credibility measure model.

Since the FMOP problem is transformed into a deterministic MOP problem directly, it will neglect the fuzzy nature of original problem to some extent. A new method is needed for converting the FMOP problem into a fuzzy SOP problem first.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This work was supported by the National Natural Science Foundation under Grant no. 71171199 and the Natural Science Foundation of Shaanxi Province under Grant no. 2013JM1003.

Özlen M. Azizoğlu M. Multi-objective integer programming: a general approach for generating all non-dominated solutions European Journal of Operational Research 2009 199 1 25 35 10.1016/j.ejor.2008.10.023 MR2522641 ZBL1176.90554 Zimmermann H.-J. Fuzzy programming and linear programming with several objective functions Fuzzy Sets and Systems 1978 1 1 45 55 MR0496734 ZBL0364.90065 Teghem J. Jr. Kunsch P. L. Application of multi-objective stochastic linear programming to power systems planning Engineering Costs and Production Economics 1985 9 1-3 83 89 2-s2.0-0021409366 Alarcon-Rodriguez A. Ault G. Galloway S. Multi-objective planning of distributed energy resources: a review of the state-of-the-art Renewable and Sustainable Energy Reviews 2010 14 5 1353 1366 2-s2.0-77949485409 10.1016/j.rser.2010.01.006 Chen A. Kim J. Lee S. Kim Y. Stochastic multi-objective models for network design problem Expert Systems with Applications 2010 37 2 1608 1619 2-s2.0-72049106128 10.1016/j.eswa.2009.06.048 Arıkan F. Güngör Z. A two-phase approach for multi-objective programming problems with fuzzy coefficients Information Sciences 2007 177 23 5191 5202 10.1016/j.ins.2007.06.023 MR2357259 ZBL1121.90134 Peidro D. Mula J. Poler R. Verdegay J.-L. Fuzzy optimization for supply chain planning under supply, demand and process uncertainties Fuzzy Sets and Systems 2009 160 18 2640 2657 10.1016/j.fss.2009.02.021 MR2750313 ZBL1279.90206 Zadeh L. A. Fuzzy sets Information and Control 1965 8 3 338 353 2-s2.0-34248666540 Zadeh L. A. Fuzzy sets as a basis for a theory of possibility Fuzzy Sets and Systems 1999 100 1 9 34 2-s2.0-0005013141 Liu B. Liu Y.-K. Expected value of fuzzy variable and fuzzy expected value models IEEE Transactions on Fuzzy Systems 2002 10 4 445 450 2-s2.0-0036685786 10.1109/TFUZZ.2002.800692 Liu B. A survey of credibility theory Fuzzy Optimization and Decision Making 2006 5 4 387 408 10.1007/s10700-006-0016-x MR2265890 ZBL1133.90426 Liu Y.-K. Convergent results about the use of fuzzy simulation in fuzzy optimization problems IEEE Transactions on Fuzzy Systems 2006 14 2 295 304 2-s2.0-33645812547 10.1109/TFUZZ.2005.864077 Liu B. Toward fuzzy optimization without mathematical ambiguity Fuzzy Optimization and Decision Making 2002 1 1 43 63 10.1023/A:1013771608623 MR1922354 ZBL1068.90618 Zheng M. Li B. Kou G. The expected value model of multiobjective programming and its solution method based on bifuzzy environment Journal of Computers 2011 6 9 1942 1948 2-s2.0-80051811006 :10.4304/jcp.6.9.1942-1948 Liu B. Iwamura K. Topological optimization models for communication network with multiple reliability goals Computers & Mathematics with Applications 2000 39 7-8 59 69 10.1016/S0898-1221(00)00065-1 MR1746157 ZBL0997.90012 McKay M. D. Beckman R. J. Conover W. J. A comparison of three methods for selecting values of input variables in the analysis of output from a computer code Technometrics 1979 21 2 239 245 10.2307/1268522 MR533252 ZBL0415.62011 Stein M. Large sample properties of simulations using Latin hypercube sampling Technometrics 1987 29 2 143 151 10.2307/1269769 MR887702 ZBL0627.62010 Giunta A. A. McFarland J. M. Swiler L. P. Eldred M. S. The promise and peril of uncertainty quantification using response surface approximations Structures and Infrastructure Engineering 2006 2 3-4 175 189 Vapnik V. Golowich S. E. Smola A. Support vector method for function approximation, regression estimation, and signal processing Advances in Neural Information Processing Systems 1997 Cambridge, Mass, USA MIT Press 281 287 Drucker H. Burges C. J. C. Kaufman L. Smola A. Vapnik V. Support vector regression machines Advances in Neural Information Processing Systems 1997 Cambridge, Mass, USA MIT Press 155 161 Stitson M. Gammerman A. Vapnik V. Vovk V. Watkins C. Weston J. Support vector regression with anova decomposition kernels Advances in Kernel Methods—Support Vector Learning 1999 Cambridge, Mass, USA MIT Press 285 292 Karaboga D. An idea based on honey bee swarm for numerical optimization 2005 Karaboga D. Akay B. A comparative study of artificial Bee colony algorithm Applied Mathematics and Computation 2009 214 1 108 132 10.1016/j.amc.2009.03.090 MR2541051 ZBL1169.65053 Karaboga D. Basturk B. On the performance of artificial bee colony (ABC) algorithm Applied Soft Computing Journal 2008 8 1 687 697 2-s2.0-34548479029 10.1016/j.asoc.2007.05.007 Karaboga D. Basturk B. A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm Journal of Global Optimization 2007 39 3 459 471 10.1007/s10898-007-9149-x MR2346178 ZBL1149.90186 Wang P. Z. Fuzzy contactability and fuzzy variables Fuzzy Sets and Systems 1982 8 1 81 92 10.1016/0165-0114(82)90032-X MR665490 ZBL0493.28001 Klir G. J. On fuzzy-set interpretation of possibility theory Fuzzy Sets and Systems 1999 108 3 263 273 10.1016/S0165-0114(97)00371-0 MR1718322 ZBL0984.94045 Liu B. Uncertainty Theory: An Introduction to Its Axiomatic Foundations 2004 154 Berlin, Germany Springer xii+411 Studies in Fuzziness and Soft Computing MR2081092 Chang C.-C. Lin C.-J. LIBSVM: a Library for support vector machines ACM Transactions on Intelligent Systems and Technology 2011 2 3, article 27 2-s2.0-79955702502 10.1145/1961189.1961199 Liu B. Zhao R. Wang G. Uncertain Programming with Application 2012 5th Tsinghua University (Chinese)