A Sequential Optimization Sampling Method for Metamodels with Radial Basis Functions

Metamodels have been widely used in engineering design to facilitate analysis and optimization of complex systems that involve computationally expensive simulation programs. The accuracy of metamodels is strongly affected by the sampling methods. In this paper, a new sequential optimization sampling method is proposed. Based on the new sampling method, metamodels can be constructed repeatedly through the addition of sampling points, namely, extrema points of metamodels and minimum points of density function. Afterwards, the more accurate metamodels would be constructed by the procedure above. The validity and effectiveness of proposed sampling method are examined by studying typical numerical examples.


Introduction
In engineering, manufacturing companies strive to produce better and cheaper products more quickly. However, engineering systems are fairly large and complicated nowadays. In addition, design requirements are rigorous and stringent for such systems, especially multidiscipline design optimization systems such as aerospace. For example, in aircraft, the design is intrinsically a daunting optimization task often involving multiple disciplines, multiple objectives, and computationintensive processes for product simulation. Just taking the computation challenge as an example, it is reported that it takes Ford Motor Company about 36-160 h to run one crash simulation [1], which is unacceptable in practice. Despite the fact that the capacity of computer keeps increasing, the complexity of analysis software, for example, finite element analysis (FEA) and computational fluid dynamics (CFD), seems to keep pace with computing advances [2]. To meet the challenge of increasing model complexity, design engineers are seeking new methods. As a result, metamodel which is often called surrogate model or response surface as a widely used approximation model to replace the expensive simulation is proposed and improved by researchers. In fact, in everyday life we try to save time and make predictions based on assumptions. The literature [3] describes a vivid example to strengthen understanding of metamodel. When travelling on a road we will predict the rate of turn of a bend based on the entry and surrounding landscape. Without accurately evaluating it, in our mind we are constructing metamodels using the direction of the road, its derivatives with respect to distance along the road, and local elevation information. This information is coupled with assumptions based on our experience of going round many bends in the past. Then we will calculate a suitably safe speed based on our prediction of curvature and considering a safety error. In engineering design we are also faced with different problems, but we try to do with a surrogate model essentially what we do every day in our mind: make useful predictions based on limited information and assumptions. In the past two decades, the use of metamodel [4][5][6][7] has attracted intensive attention. It is found to be a valuable tool to support a wide scope of activities in modern engineering design, especially design optimization.
Metamodeling which means the process of constructing metamodels involves two important aspects: (a) choosing a sampling method to generate sampling points and (b) choosing an approximation method to represent the data, which influence the performance of metamodels. An important research issue associated with metamodeling is how to obtain good accuracy of metamodels with reasonable sampling 2 The Scientific World Journal methods and approximation methods. Accordingly, sampling methods and approximation methods are intensively studied in recent years. As one of the most effective approximation methods, radial basis functions (RBF) [8][9][10] interpolation has been gained popularity for model approximation because of their simplicity and accurate results for interpolation problems. RBF is becoming a better choice for constructing metamodels or finding the global optima of computationally expensive functions by using a limited number of sampling points. Other types of approximation methods including Kriging [11], multivariate adaptive regression splines (MARS) [12], response surface methodology (RSM) [13], and support vector machines (SVM) [14], and so forth, are discussed broadly as well. Mullur et al. proposed an improved form of the typical RBF approach, that is, extended radial basis functions (E-RBF) which offers more flexibility in the metamodel construction process and provides better smoothing properties. In general, it is expected to yield more accurate metamodels than the typical RBF. So this paper uses E-RBF to construct the metamodels.
The sampling method is another important factor of affecting accuracy for a given metamodel. The sampling method can be divided into the classical sampling method, "space-filling" sampling method, and sequential sampling method according to the type. Classic sampling methods are developed from design of experiments (DOE). These methods focus on planning experiments and tend to spread the sample points around boundaries of the design space for eliminating random error. The classical experiment designs contain alphabetical optimal design [15], factorial or fractional factorial design [16], Box-Behnken [17], central composite design (CCD) [18], and so forth. However, Sacks et al. [19] stated that classic experiment designs can be inefficient or even inappropriate for deterministic optimal problems. Jin et al. [20] confirmed that experiment designs for deterministic computer analyses should be spaced filling. The space-filling sampling methods which are correspondingly more often used in the literature are Latin hypercube design (LHD) [21], orthogonal arrays design [22], Hammersley sequences (HS) [23], and uniform designs [24]. The sampling methods above are generated all at once, or, in other words, at one stage. It is difficult for the one-stage sampling methods to forecast the number of sampling points. On the contrary, the sequential sampling approach generates sampling points one after another according to the particular criteria instead of generating all points at once. In sequential sampling technique, the new sampling points are added to the sample by taking the advantage of information gathered from the existing (earlier created) metamodel and then corresponding response surface is updated. Therefore, the sequential sampling recently has gained popularity for its advantages of flexibility and adaptability over other methods. Jin et al. [25] stated that sequential sampling allows engineers to control the sampling process and it is generally more efficient than one-stage sampling. Deng et al. [26] proposed a sequential sampling design method based on Kriging. Wei et al. [27] proposed a sequential sampling method adopting a criterion to determine the optimal sampling points, which maximized the value of the product of curvature and square of minimum distance to other design sites. Kitayama et al. [28] presented a sequential approximate optimization (SAO) algorithm using the RBF network with sequential sampling methods. A novel sequential sampling method based on the maximin distance criterion was proposed by Zhu et al. [29].
In this paper, a new sequential optimization sampling method with extended radial basis functions is proposed. In order to utilize the geometrical feature of metamodels, extrema points of the response surface, as new optimization sampling points, are added to the sample. Through using the metamodeling functions constructed by extended radial basis functions, the extrema points of metamodels can be achieved expediently. Moreover, an effective function [28,30] called the density function for determining the sparse region in the design variable space is considered. The density function constructed by using the RBF is to discover a sparse region in the design space. It is expected that the addition of sampling points in the sparse region will improve the accuracy of approximation model. Thus, a new metamodeling algorithm integrating a sequential optimization sampling method is presented. To illustrate the accuracy and efficiency of the proposed algorithm, the measure performance and several numerical examples will be tested.
The remainder of this paper is organized as follows. In next section, the RBF and E-RBF are described briefly. In Section 3, a new sequential optimization sampling method is proposed. In addition, the density function [28,30] is introduced. In Section 4, the numerical examples, assessment measures, test results and discussions, and so forth will be provided. The last section is the closure of the paper where we summarize the important observations made from our study.

Learning of Classical Radial Basis
Functions. The RBF metamodel was originally developed by Hardy [31] in 1971 to fit irregular topographic contours of geographical data. It has been known tested and verified for several decades and many positive properties have been identified. Mullur and Messac [32] made radial basis functions more flexible and effective by adding so-called nonradial basis functions. Krishnamurthy [33] added a polynomial to the definition of RBF for improving the performance. Wu [34] provided criteria for positive definiteness of radial functions with compact support which produced series of positive definite radial functions.
An RBF network is a three-layer feed-forward network shown in Figure 1. The output of the network̂( ), which corresponds to the response surface, is typically given bŷ where is the number of sampling points, x is a vector of design variables,

Name
Radial basis function. The approximation function̂is actually a linear combination of some RBF with weight coefficients . The most commonly used radial classical radial functions are listed in Table 1. The radial basis functions multiquadric and Gaussian are the best known and most often applied. The multiquadric is nonsingular and simple to use [35]. Hence, radial basis function multiquadric is used in this paper.

Learning of Extended Radial Basis Functions.
The extended radial basis functions approach is a combination of radial and nonradial basis functions which incorporate more flexibility in the metamodels by introducing additional degrees of freedom in the metamodels definition. It provides better smoothing properties, and, in general, it is expected to yield more accurate metamodels than the typical RBF. Mullur and Messac [32,36] found that the E-RBF approach results in highly accurate metamodels compared to the classical RBF and Kriging. Under the E-RBF approach, the approximation function takes the form: where is the number of design variables; , , are coefficients to be determined for given problems; , , are components of the so-called nonradial basis functions defined in Table 2. Nonradial basis functions are functions of  , which is the coordinate vector of a generic point in the design space relative to a data point , defined as = − . Thus, is the coordinate of any point relative to the data point along the th dimension. The difference between the Euclidean distance used in RBF and the relative coordinates used for N-RBF for a two-dimensional case is depicted in Figure 2. Four distinct regions (I-IV) are depicted in Figure 3, each corresponding to a row in Table 2.
In matrix notation, the metamodel defined in (2) can be written as Equation (3) can be compactly written in matrix form as where [ ] = [ ], { } = { ( ) ( ) } , and = ( ). The coefficients can be evaluated by using the pseudoinverse approach to solve the underdetermined system of (4) as follows: where [ ] + denotes the pseudoinverse of [ ].
After obtaining the coefficients using E-RBF, one can evaluate the metamodels to construct response surface using (2). The resulting metamodel is one that is guaranteed to be convex and highly accurate [32,36]. In the following section, a series of mathematical examples are approximated by E-RBF based on the sampling method proposed in next section.
In this section, we introduce the metamodel approach E-RBF briefly due to space limitations. A more complete description and discussion are presented in articles [32,36].

The Sequential Optimization Sampling Method
As it is known, the metamodels are approximation models of real models which are commonly complex and unknown. The accuracy of metamodels owes to the approximation methods and sampling methods primarily [37]. The sampling method proposed in this paper includes two parts. The first part is the procedure of adding optimization sampling points and the second part is the procedure of adding points of sparse regions [28,30].

The Optimization Sampling Points.
The optimization sampling points should have two important properties as follows: adaptive and sensitive. The focus on sampling should shift to how to generate a reasonable number of sampling points intelligently so that the metamodel can reflect the real "black-box functions" in areas of interest. General knowledge tells us that sampling points at the site of valley and peak of the response surface would improve the accuracy at the greatest extent. The valley and peak are extrema points of functions. In mathematics, the points which are the largest or smallest within a given neighborhood are defined extrema points. McDonald et al. [38] found the radial basis functions models created with (1) are twice continuously differentiable when employing multiquadric function as basis function for all ̸ = 0. The first approximation model is constructed with initial sampling points through using radial basis functions. Thus the function evaluations, analytic gradients, and the Hessian matrix of second partial derivatives can be obtained from the initial functions.
Considering the RBF model with dimensions in (1), the gradients of the equation arê where The Hessian matrix can be calculated from (6) as Similarly, ( ) = 2 / 2 . For multiquadric RBF model, Let (6) be equal to zero and solvê Then, the critical point x can be obtained. Upon substitution of the critical point x into Hessian matrix, we can judge the definition of the matrix (x ). The critical point is maximum or minimum when the matrix is definite positive or definite negative. Figures 4 and 5 separately show the extrema points in the case of 2D, 3D. The red square and blue pentagon indicate maxima points; meanwhile, the green dot and red asterisk indicate minima points. Once an approximation model has been created, we can obtain coordinates of extrema points.

Density Function with the RBF.
It is necessary to add new sampling points in the sparse region for global approximation. To achieve this, a new function called the density function which is proposed by Kitayama et al. [28,30] is constructed using the RBF network in this paper. The aim of the density function is to discover a sparse region in the design space. This density function generates local minima in the sparse region, so that the minimum of this function can be taken as a new sampling point. The addition of new sampling points in the sparse region will improve the accuracy of approximation model and help to find the global minimum of metamodels.
To explore the sparse region, every output of the RBF network is replaced with +1. Let be the number of sampling points. The procedure for constructing the density function is summarized as follows.
(1) The output vector is prepared at the sampling points: The Scientific World Journal (2) The weight vector of the density function ( ) is calculated as follows: where ( 3) The addition of sampling point in the sparse region is explored as the global minimum of density function with the RBF: 3.3. Summary of the Proposed Algorithm. The detailed algorithm for sequential optimization sampling method with RBF network is described below. Figure 6 shows the proposed algorithm. The proposed algorithm is roughly divided into two phases. The first phase is used to construct the response surface and add the extrema points of response surface as new sampling points. The second phase is used to construct the density function and add the minimum of the density function as a new sampling point. These two phases are described particularly as follows. First phase: initial sampling points are generated using the Latin hypercube sampling design. All functions are evaluated at the sampling points, and the response surfacê ( ) is constructed. The extrema points of response surface can then be found and directly taken as the new sampling points. The more accurate metamodel would be constructed by repeating the procedure of adding extrema points to the sample adaptively and sequentially.
Second phase: the density function is constructed to find the sparse region. The minimum point of the density function is taken as a new sampling point. This step is repeated while a terminal criterion (count ≤ ) is satisfied. Parameter controls the number of sampling points obtained by the density function. Kitayama et al. [28] advised = int( /2). In this paper, parameter = int( /2) + 1, where int( ) represents the rounding-off. The new sampling point would be gained if the parameter count is less than , and it is increased as count = count + 1.
The terminal criterion of the integrated algorithm is determined by the maximum number of sampling points max . If the number of sampling points is less than max , the algorithm proceeds. Otherwise, the algorithm is terminated. In the algorithm, the response surface is constructed repeatedly through the addition of the new sampling points, namely, extrema points and minimum point of density function. Afterwards, the more accurate metamodel would be constructed by repeating the procedure of adding points to the sample adaptively and sequentially.

Numerical Examples
In this section, we would test the validity of the proposed sampling method through some well-known numerical examples and one engineering optimization problem. All these functions are approximated with the E-RBF model. The response surfaces are constructed through one-stage sampling methods (i.e., LHD and RND) and sequential sampling methods (i.e., CV [25], Kitayama et al. [28], SLE [29], and SOSM proposed in this paper) with the same sampling size. In order to visualize the comparison between approximated model and actual model, two design variables of numerical examples listed in Table 3 are tested.

Sampling Strategies.
Two types of sampling methods used in this paper separately are one-stage sampling methods and sequential sampling methods. One-stage sampling methods include Latin hypercube sampling design (LHD) and Random sampling design (RND). Sequential sampling methods include cross-validation sampling method (CV) [25], sequential sampling method proposed by Kitayama et al. [28] termed KSSM in this paper, successive local enumeration sampling The Scientific World Journal 7

Selection of Parameters.
For the E-RBF approach, we set = 1, which is a prescribed parameter for the multiquadric basis functions, for all of the examples. The parameter is set equal to approximately 1/3 of the design domain size. Mullur and Messac [32] investigated that the results were not unduly sensitive to . Another parameter is set equal to 2 for all numerical examples.

Metamodel Accuracy Measures.
Generally speaking, an E-RBF response surface passes through all the sampling points exactly. Therefore it is impossible to estimate the accuracy of an E-RBF model with sampling points. To measure the accuracy of the resulting metamodels, we can use additional testing points to evaluate the accuracy of the model via standard error measure: root-mean-squared error (RMSE). The smaller the value of RMSE is, the more accurate the response surface will be. The error measure is defined as where is the number of additional testing points generated by grid sampling method (32 * 32 for all the examples). (x ) and̂(x ) are the true function value and predicted metamodel value at the th testing point x , respectively.
In addition to the preceding RMSE, we also calculate the normalized root-mean-squared error (NRMSE) as follows: RMSE only calculates the error of functions themselves. However, NRMSE allows comparison of the metamodel error values with regard to different functions.
In engineering problems, global minimum is required generally. So we employ the simulated annealing (SA) [39] to calculate the global minimum̂m in based on the ultimate metamodel. The actual global minimum min are listed in Table 3.

Results and Discussions.
In this section, we discuss the results obtained after constructing metamodels through six various sampling methods using the assessment measure described above. As mentioned in Section 4.1, 20 procedures are conducted for each sampling method and therefore there are twenty sets of accuracy results for each sampling method. The advantages and validity of sequential optimization sampling method (SOSM) are tested in comparison with onestage sampling methods and sequential sampling methods separately below. In addition, SOSM is used to solve a typical mechanical design optimization problem.

Comparison of the Performance between SOSM and
One-Stage Sampling Methods. In this part, two classical onestage sampling methods LHD, RND and SOSM are used to construct metamodels. The accuracy of metamodels and global minimum of functions are obtained and managed. The error measures RMSE and NRMSE and global minimum summarized in Table 4 are average values.
From the Table 4, the RMSE and NRMSE of metamodels using sampling method SOSM are smaller than the other two one-stage sampling methods for functions 1-5. For function 6, the values are close. The RND, as expected, performs poorly. That is, metamodels based on sampling method SOSM may provide a better fit to actual functions. As seen in Table 4, on exploring global minimum̂m in of metamodels, SOSM is superior to LHD and RDN through all numerical examples compared to the actual global minimum min . In particular, the SOSM can almost find the global minimum of all numerical examples at every turn. However, LHD and RND perform fairly poorly, particularly in the success rate which will be depicted in Figure 9.
The mean results from    box sizes of results are taken into account, the accuracy of metamodels with sampling method SOSM is better. Figure 9 depicts the boxplot of global minimum̂m in obtained for twenty numerical experiments. It is obvious from Figure 9 that the median value of SOSM is probably equal to the actual global minimum min . Meanwhile, the small sizes of boxes imply small standard deviation, which is also reflected by small differences between the mean and median values. The standard deviation of global minimum is one of the important factors for evaluating the robustness of algorithm. Therefore, smaller standard deviation of results The Scientific World Journal  implies the robustness of the algorithm. It is clear from Figure 9 that the SOSM is a more robust sampling method than the other two sampling techniques under the parameter settings employed in this paper. The success rate is bad comparing the actual global minimum from Table 4 with the distribution of global minimum of metamodels based on sampling methods LHD and RND from Figure 9. In other words, SOSM plays a perfect role in finding the global minimum of metamodels.
In order to indicate the effectiveness of SOSM in seeking global minimum points, the positions of global minimum points of metamodels for functions. 1-6 are shown in Figures  10(a)-10(f) separately. The red pentagon indicates the actual global minimum point. The black dots indicate the global minimum points of metamodels based on sampling method SOSM. The blue squares indicate the global minimum points of metamodels based on sampling method LHD. The magenta diamonds indicate the global minimum points of metamodels based on sampling method RND. Figure 10 shows that the black dots are distributed densely in the center of red pentagon. Meanwhile, the blue squares and magenta diamonds are decentralized around the red pentagon and the difference between actual global minimum points and global minimum points of metamodels based on LHD or RND is mostly quite large. The above demonstrate that SOSM is superior to LHD and RND on global optimization. (a)-(d) in Figures 11,12,13,14,15,and 16 show the graphs of actual functions and of the associated metamodels based on three sampling methods separately. It can be observed intuitionally that the metamodels surface adopting SOSM method is smoother than LHD and RND and, furthermore, the global minima of metamodels based on SOSM are consistent with the actual global minima. The conclusions reached above are identified further by comparing the actual function surfaces to metamodels surfaces.

Comparison of the Performance between SOSM and Previous Sequential Sampling
Methods. In this part, three different sequential sampling methods including cross-validation sampling method (CV) [25], sequential sampling method proposed by Kitayama et al. [28] termed KSSM, and successive local enumeration sampling method (SLE) [29] are used to construct metamodels in comparison with those constructed by SOSM. Similarly, the accuracy of metamodels and global minimum of functions are obtained and managed. The accuracy measures RMSE and NRMSE and global minimum summarized in Table 5 are mean values. Note that a value of zero for both accuracy measures RMSE and NRMSE would indicate a perfect fit. From Table 5, the RMSE and NRMSE of metamodels using sampling method SOSM are smaller than the sequential sampling methods CV and KSSM for functions 1-5. For function 6, the values are close. The SLE performs greatest. That is, metamodels based on sampling method SOSM may provide a better fit to actual functions than CV and KSSM. However, the sampling method SLE performs unsatisfactorily in terms of exploring global minimum. As seen in Table 5, on exploring global minimum̂m in of metamodels, SOSM is superior to the previous sequential sampling methods SLE through all numerical examples compared to the actual global minimum min . In addition, the sequential sampling methods CV and KSSM perform as great as SOSM on exploring the global minimum. In general, the sequential sampling method KSSM is the best, SOSM takes second place, and CV is the least. It can be concluded that the sequential sampling method SOSM proposed in this paper is the best choice considering the accuracy of metamodels and exploring global minimum.
In order to represent the advantages and disadvantages of different sequential sampling methods adequately, the twenty times of metamodels accuracy results (RMSE and NRMSE) and global minimum min with sequential sampling methods, that is, SOSM, CV, KSSM, and SLE, are illustrated in Figures  17-19 with the help of boxplot.
From the results shown in Figures 17 and 18, it is found that the median values of RMSE and NRMSE based on SOSM are smaller compared to CV and KSSM for functions 1-5. For function 6, the median values of RMSE and NRMSE are a little larger, but very close. Except for Function 5, the accuracy of metamodels constructed by SLE is the best. In addition, the box size of RMSE and NRMSE based on SOSM is shorter than  is superior to sampling methods CV and KSSM. Certainly, the sampling method SLE performs greatest in terms of the accuracy of metamodels. However, SLE is not good at exploring the global minimum of functions. Figure 19 depicts the boxplot of global minimum̂m in obtained for twenty numerical experiments. It is obvious from Figure 19 that the median value of SOSM, CV, and KSSM is probably equal to the actual global minimum min . Meanwhile, the small sizes of boxes imply small standard deviation, which is also reflected by small differences between the mean and median values. The standard deviation of global minimum is one of the important factors for evaluating the robustness of algorithm. Therefore, smaller standard deviation of results implies the robustness of the algorithm. It is clear from Figure 19 that the sequential sampling methods except SLE are robust sampling techniques under the parameter settings employed in this paper. The success rate is bad comparing the actual global minimum from Table 5 with the distribution of global minimum of metamodels based on sampling methods SLE from Figure 19. It is obvious that SOSM plays a perfect role in constructing the accurate metamodels and finding the global minimum of functions. Six various sampling methods have been used to construct metamodels for six typical functions in this paper. It can be demonstrated that sequential sampling methods perform better and more efficient than one-stage sampling methods. Furthermore, sequential sampling technique allows engineers to control the sampling process. In general, onestage sampling technique is not as good as sequential sampling methods for fitting the area where the global minimum locates. In a word, SOSM as a sequential sampling method proposed in this paper is the best choice considering the accuracy of metamodels and locating global minimum. In other words, SOSM is reliable in the whole fitting space and also good for fitting the area where the global minimum locates.

Engineering Problem.
The validity of sequential sampling method SOSM proposed in this paper is tested by a typical mechanical design optimization problem involving four design variables, that is, pressure vessel design. This problem has been studied by many researchers [40][41][42]. The schematic of the pressure vessel is shown in Figure 20. In this case, a cylindrical pressure vessel with two hemispherical heads is designed for minimum fabrication cost. Four variables are identified: thickness of the pressure vessel , thickness of the head ℎ , inner radius of the pressure vessel , and length of the vessel without heads . In this case, the variable vectors are given (in inches) by The objective function is the combined cost of materials, forming and welding of the pressure vessel.   [40].
The problem formulated above is a simple nonlinear constrained problem. Now assuming that the objective and constraint functions defined by (16) are computation-intensive functions, hence, metamodels of functions are constructed by RBF using the sequential sampling method SOSM.
This problem has been solved by many researchers, including Cao and Wu [42], applying an evolutionary programming model. Kannan and Kramer [43] solved the problem using an augmented Lagrangian multiplier approach and Deb [44] using a genetic adaptive search.
The average values of optimal results from 50 runs are listed in Table 6 compared with the three results reported in the literature [42][43][44]. It can be seen from the table that the optimal solution in this paper is still about 2.7% superior to the best solution previously reported in the literature [44].

Conclusions
In this paper, the sequential optimization sampling method (SOSM) for metamodels has been proposed. The recently developed extended radial basis functions (E-RBF) are introduced as an approximated method to construct the metamodels. Combining the new sampling strategy SOSM with the extended radial basis functions, the design algorithm for building metamodels is presented. In the SOSM, the optimal sampling points of response surface are taken as the new sampling points in order to improve the local accuracy.   In addition, new sampling points in the sparse region are required for better global approximation. To determine the sparse region, the density function constructed by the radial basis functions network has been applied. In the proposed 16 The Scientific World Journal Global minimum of functions   algorithm, the response surface is constructed repeatedly until the terminal criterion, that is, the maximum number of sampling points max , is satisfied.
For the sake of examining the validity of the proposed SOSM sampling method, six typical mathematical functions have been tested. The assessment measures for accuracy of metamodels, that is, RMSE and NRMSE, are employed. Meanwhile, global minimum is introduced to judge the performance of sampling methods for metamodels. The proposed sampling method SOSM is successfully implemented and the results are analyzed comprehensively and thoroughly. In contrast to the one-stage sampling methods (LHD and RND) and sequential sampling methods (CV, KSSM, and SLE), the SOSM results in more accurate metamodels. Furthermore, SOSM is superior in exploring the global minimum of metamodels compared to the other five sampling methods.
The new sequential optimization sampling method SOSM has been proposed, which provides another effective way for generating sampling points to construct metamodels. It is superior in seeking global minimum compared to the previous sampling methods, and, meanwhile, can improve the accuracy of metamodels. Therefore, the sequential optimization sampling method SOSM significantly outperforms the previous sampling methods.