Research Article Improved Hybrid Response Surface Method Based on Double Weighted Regression and Vector Projection

In order to increase the accuracy and stability of the classical response surface method and relevant method, a new improved response surface method based on the idea of double weighting factors and vector projection method is proposed. The response surface is fitted by the weighted regression technique, which allows the sampling points to be weighted by their distance from the true failure surface and that from the estimated design point. It uses the vector of the gradient projection method to get new sampling points in the process of iteration, in order to make the sampling points closer to the design point, and the value of deviation coefficient is constantly adjusted. To some extent, these strategies increase the accuracy and stability of the response surface method, while the calculation time is decreased. At last, the rationality and efficiency of the proposed method are demonstrated through five examples. Besides, as revealed from this investigation, compared with other conventional algorithms, this method has a few obvious advantages; this algorithm not only has high precision and efficiency, but also has solid stability.


Introduction
In the research of engineering structural reliability, common methods include rst-order reliability method, Monte Carlo method, and response surface method. e rst-order reliability method has many applications in engineering practice because it is easy to understand and put in use [1][2][3]. For the rst-order reliability method, the problem of robustness and e ciency has always been the core problem of the method. In order to improve its robustness and eciency, researchers have put forward their own ideas [4][5][6][7][8]. However, in general, the drawbacks of these methods have not been e ectively resolved. In other words, they are very suitable in some cases of high nonlinearity, but in other cases, they may not even converge. And Monte Carlo method is recognized as a general method for structural reliability, but its e ciency is very low. erefore, the research on Monte Carlo method is mainly on how to reduce its calculation amount [9,10].
In summary, the accuracy of the rst order reliability method is low, and the stability is poor; the Monte Carlo method is too computationally expensive. e response surface method can e ectively overcome the disadvantages of the above two methods. Because the response surface method is simple in principle, e cient in calculation, and easy to operate, scholars in the eld of reliability have paid extensive attention to the response surface method [11][12][13]. At present, many scholars have improved the response surface method in the two aspects of weighted regression and vector projection.
As early as 2005, Kaymaz [14] et al. proposed the idea of weighted regression and applied it to the response surface method, which triggered a large number of scholars to enable further exploration of their research results. Subsequently, Chen et al. [15] constructed an improved response surface method based on weighted regression. Xiong et al. [16] proposed a weighted stochastic response surface method that considered the sample probabilistic weights in regression. Dong et al. [17] proposed an improved weighted regression distributed collaborative surrogate model method. Lu et al. [18] proposed a weighted regression-based extremum response surface method. Recently, Li et al. [19] introduced the idea of weighted regression in the quasisparse response surface method, and the problem of overfitting in the process of atom selection was reduced. e above research results are all improvements to the weighted response surface method that contains only a single weighting factor.
Inspired by the idea of weights, Nguyen et al. [20] added a weighting factor (the distance from the fitting points to the design point) based on a single weighting factor to improve the single weighted response surface method proposed by Kaymaz and then proposed a double weighted response surface method. Xiong et al. [21] proposed a new double weighted stochastic response surface method. Guimarães et al. [22] used a cross-validation method and double weighted regression technique to improve the accuracy and efficiency of response surface method. ese studies can be regarded as an extension of the single weighted response surface method. And the single weighted response surface improvement method series and the double weighted response surface improvement method series belong to the use of weighted regression ideas to improve the response surface method.
In the field of vector projection, Kim [23] is one of the first scholars to apply the vector projection method to the response surface method, and the vector projection response surface method is applied to practical engineering applications by many scholars due to its high efficiency and accuracy [24,25]. e vector projection response surface method proposed by Basaga et al. [26] searches for points close to the true limit state function around the design point and then uses the Second-Order Reliability Method to obtain the reliability index and probability of failure. Li et al. [27] proposed a new class of hybrid perturbation-Galerkin method based on the combination of perturbation technique and Bubnov-Galerkin projection. e core of the above research is the improvement and application of the vector projection response surface method.
All the above research results are based on the weighted regression or the vector projection method to improve the accuracy and efficiency of the response surface method, but there are few researches that combine the two to study together. e most representative of these is the improved response surface method developed by Zhang [28]. However, in the weights setting of the sampling points, Zhang only considered the distance between the sampling points and the true failure surface and did not take into account that the distance between the sampling points, and the design point will also affect the model fitting accuracy of the final response surface. In addition, in its iterative process, although the linear interpolation method can achieve higher accuracy, it will increase the amount of calculation to a certain extent.
To address the above issues, on the basis of Zhang's research [28], this paper further applies vector projection method and weighted regression to the classical response surface method and then adds a weight factor considering the distance between the sampling points and the design point. e overall weight takes the average weight of the two weights. Besides, this paper no longer simply uses the small step size method of linear interpolation to search for the design point because this way will cause a lot of duplication of work. According to the characteristics of the design point, this paper makes multiple iterations. At the beginning, the first iteration was performed in the case of a linear response surface combined with the negative gradient direction. Starting from the second iteration, the quadratic polynomial function without cross terms is combined with the negative gradient direction. e effect of this is that it can quickly lean to the true failure surface. en, iterate alternately with the linear interpolation method of small step size and the negative gradient direction of large step size, so that the calculation efficiency and accuracy are improved. is method solves the problem that the response surface series method has always been affected by the deviation coefficient change, which makes low stability, and the method in this paper further improves the calculation accuracy of the response surface method while ensuring the efficiency. Finally, the rationality of the method in this paper is verified by the relatively accurate solution of the Monte Carlo method and five examples.

Improved Weighted Response
Surface Method

Choice of Function Form.
ere are many choices for the form of response surface functions, such as neural networks, splines, and polynomials. However, polynomials are the most commonly used, especially simple linear polynomials and quadratic polynomials without cross terms in the weighted response surface method. e expression of the linear response surface is as follows: Among them, a 0 and a i represent unknown coefficients, and x i represents random variables. e expression of the quadratic polynomial response surface function without cross terms is as follows: Among them, a 0 , a i and b i all represent unknown coefficients.

Determination of Function Coefficients.
e coefficients of the classical response surface method are obtained by the following formula: where B represents the design matrix at sampling points, and y represents the structural response obtained at sampling points. From the above formula, it can be found that all sampling points are equalized, and the weights are exactly the same, which directly leads to the low degree of the fitting of the response surface in our classical response surface method. And it further explains the reason for the lower accuracy of the classical response surface. In order to construct a response surface closer to the true failure surface, Kaymaz proposed a weighted regression idea. e coefficient matrix of the response surface function proposed by him is constructed as follows: where C is the weight matrix.

Weights of Sampling Points
According to Kaymaz's research [14], each sampling point has a different effect on the response surface function in fitting the true failure surface. e closer the point is to the true failure surface, the greater the effect on the fitting is. erefore, the value of the limit function at sampling point describes the distance from sampling point to the true failure surface in theory. It can be used as the first weight. And the smaller the absolute value of the limit function at sampling point, the greater the effect of this point. Based on this, Kaymaz [14] gives a form of weight function as follows: where j represents the j-th sampling point, and G min represents the response value of the sampling point closest to the true failure surface. Although this weighting form greatly improves the accuracy and efficiency of the classical response surface method, when the minimum value of G is close to 0, the illconditioned problem of the regression matrix often occurs, which limits its application.
In order to solve this problem, Wu [29] proposed a better form of weight function: where G(x 0 ) represents the response value of the limit state function at the origin, and θ is a non-zero constant used to adjust the smoothness of the fitted curve. is formula solves the ill-conditioned problem of the regression matrix very well, but the randomness of the value θ is its obvious shortcoming. Based on the ideas of the above two scholars, this paper constructs a more stable weight form that will not cause matrix ill-conditioned problems. When G(x j ) � 0, C j � 1.2 . is is because the closer the test point is to the limit state surface, the greater its weight is.
e weight of the test point at G min is 1. In theory, except for the sampling points on the true failure surface, it is the point closest to the true failure surface. erefore, the weight of the sampling points on the true failure surface should be greater than that at G min , and the weight value of the sampling points on the limit state surface is 1.2 here.
Considering that the closer the sampling point is to the design point, the more obvious its fitting effect will be. Following the functional form in [22], the expression for constructing the second weight is as follows: where x * represents the design point, and x j represents the sampling points.

Vector Projection Method
Assuming that the design point obtained last time is x * , the expression of the response surface function is (1). Calculate the unit vector α r of the response surface function at the design point: e i-th random variable is projected onto the response surface, and the expression of the projection vector is as follows: where e i represents the unit basis vector along the coordinate axis X i ; that is, the i-th component of e i is 1, and the others are 0. In order to project the sampling points as close to the response surface as possible and make the sampling points Mathematical Problems in Engineering 3 close to the true failure surface, the expression for the projection direction is shown as follows: where ε represents a small constant. e coordinates of the sampling points on the X i axis finally obtained become where f represents the deviation coefficient. Figure 1 shows a schematic diagram of sampling points for selection using vector projection technology in a twodimensional situation.

The Method Proposed of This Paper
Based on the classic response surface method, this paper proposes the following five improvement measures: ① A more reasonable weight form is proposed, so that the method of this paper will not cause the ill-conditioned problem of the matrix and is more stable. In particular, considering that the weight coefficient should be larger when the sampling point is on the failure surface, erefore, the weight of the sampling points on the true failure surface should be greater than that at G min , and their weight value on the limit state surface is 1.2 here. ② is paper proposes a strategy for searching design points in steps. e specific operation is as follows: according to the characteristics of the design point, the first iteration was performed in the case of a linear response surface combined with the negative gradient direction. Starting from the second iteration, the quadratic polynomial function without cross terms is combined with the negative gradient direction. e effect of this is that it can quickly lean to the true failure surface. en, iterate alternately with the linear interpolation method of small step size and the negative gradient direction of large step size, so that the calculation efficiency and accuracy are improved. ③ In this paper, the vector projection method is used to optimize the selection of sampling points, so that the sampling points are more likely to fall near the failure surface, so as to improve the accuracy of the classical response surface method; ④ Introduce a new weight factor, so that the sampling points close to the design point have greater weight, thereby achieving the effect of improving the fitting degree of the response surface; ⑤ In the iterative process, the value of the deviation coefficient can be adjusted adaptively, so that the distribution range of the sampling points is first large and then small, and finally, it can stably converge near the design point, enhancing the robustness of the classical response surface method. Finally, the algorithm steps and flowchart of this method are as follows.

Steps of Algorithm
(i) Step 1: Assuming that the initial design point is the mean point, construct the remaining 2n axial sampling points using the traditional experimental design method, and then use the traditional linear response surface method to obtain the next design point, where the form of the linear response surface function is shown in (1). (ii) Step 2: e design point obtained in the previous step is the center point, and the corresponding sampling points is obtained using the central composite design method with only the axis point, the corresponding coefficient matrix A is constructed, and then the finite element method or numerical calculation method is used to get estimated value of the performance function at sampling points. (iii) Step 3: According to the two weighting factors of the distance between the sampling point and the true failure surface and the distance between the sampling point and the design point, construct the corresponding double weighted matrix. e weight is the average weight of the two weights. en, use the response surface function without cross terms to perform a weighted regression analysis to determine the undetermined coefficients of the response surface function. (iv) Step 4: Use the First-Order Reliability Method to calculate the reliability index, and perform the iteration of the design point in the negative gradient direction of the large step size. e iteration form is as follows: (v) Step 5: Use the vector projection method to construct the sampling points for the next weighted least squares regression analysis, and, at the same time, raise the sixth power of the deviation coefficient f. (vi) Step 6: Repeat steps 2 to 5 until the distance between the two design points meets a certain accuracy, and then proceed to the next step after the iteration converges. (vii) Step 7: Perform linear interpolation between the starting point (x 1 , g(x 1 )) and the design point (x * i , g(x * i )) obtained in the previous iteration, and then get the next design point x * i+1 .
(viii) Step 8: Construct a weighting matrix according to the idea of double weighting factors, perform regression analysis, and then determine the unknown coefficients of the response surface. (ix) Step 9: Use the First Order Reliability Method to calculate the reliability index and get the next design point. (x) Step 10: Perform linear interpolation from the mean point (μ x , g(μ x )) and the design point (x * i , g(x * i )) obtained in the previous iteration.  Among them, the absolute value of the relative error difference between different interpolation coefficients is used as the stability index of the response surface function. e smaller the difference, the higher the stability of the corresponding method.

Example 1: Simple Low Nonlinear Function.
e performance function is shown below, where x and y both obey the standard normal distribution. e calculation results of the above methods are listed in Table 1, and the iterative process is shown in Figure 3.
It can be seen from Table 1 that the accurate result of the reliable index obtained by MCS is 2.3497. Compared with MCS, PM gives the most accurate results with an error of only 0.0170%. It is worth noting that WRSM and VPRSM not only have a larger relative error than PM, but also require longer iteration time. Although the iteration time of RSM is similar to that of PM, the relative error of its reliability index is the largest. When the deviation coefficient is equal to 5, the iterative process diagram of each method is shown in Figure 1. It can be seen from the figure that the convergence solution of PM is closest to the exact solution of MCS, and PM only needs 7 iterations to reach the convergence solution, with the least number of iterations. is phenomenon is mutually corroborated by the results of the reliability index and relative error shown in Table 1. According to Table 1, the stability index value of the method in this paper is 0, which shows that the reliability index obtained by the method in this paper is almost not affected by the change of the deviation coefficient. At the same time, it can be obtained that the order of the stability of each method from high to low is PM, VPRSM, WRSM, RSM.
In summary, in the case of low nonlinear functions, PM is not only superior in accuracy to other method, but also the iteration convergence speed of the method in this paper is faster and higher in efficiency. In addition, PM has high stability and strong robustness. e reason for the above phenomenon is that the PM method uses the strategy of searching the design point in steps. In the iterative process, according to the characteristics of the design point, it is first iterated in the negative gradient direction with a large step size, so that it can approach the design point faster, and then it is alternately iterated in the linear interpolation with a small step size and the negative gradient direction with a large step size afterwards, which makes the computational efficiency increase and the iteration time decrease.

Example 2: Functional Function with Cross terms.
Example 2 is to study the influence of the cross term on the algorithm. e calculation results are listed in Table 2, and the iteration process is shown in Figure 4.

(17)
It can be seen from Table 2 that although the iteration time of PM is the longest, the reliability index obtained by PM is closest to the solution of MCS, so the accuracy of PM is the highest. Secondly, as the deviation coefficient changes, the stability index of PM is always 0, indicating that the stability of PM is very high. It can be found intuitively from Mathematical Problems in Engineering   Figure 4 that the reliability index obtained by PM, WRSM, and RSM is all close to the exact solution, when the relative error of the reliability of VPRSM is the largest. erefore, it can be concluded that when the performance function contains cross terms, the efficiency of this method is slightly lower than other methods, but in terms of accuracy and stability, this method is still superior to other methods.

Example 3: Nonlinear Function of Concave toward Failure
Region.
e performance function of this example is shown below, and both x and y obey the standard normal distribution. e calculation results are shown in Table 3, and the iterative process and the fitting effect are shown in Figure 5 and Figure 6, respectively. e fitting effect of the response surface function obtained in the last iteration of each method to the true failure surface at the most probable point is shown in Figure 6. Among them, LSF represents the true failure surface, and MPP represents the most probable point, that is, the design point.
From the research of Nguyen, it can be known that the key of the response surface method is that the response surface function fits the sampling points well, especially near the design point. It can be seen from Figure 6 that, except for VPRSM, other methods have a relatively good fitting effect on the true failure surface at the design point, while the vector projection response surface is still a certain distance from the design point. e fitting effect at the design point is not very good, so it can be concluded that the accuracy of PM in this example is much higher than that of VPRSM. is conclusion is also verified in column relative error of Table 3. Figure 5 can also draw conclusions similar to Figure 6. In Figure 5, the reliability index of PM, RSM, and WRSM is slightly smaller than the exact solution, while the reliability of VPRSM is much larger than the exact solution, which also shows that the high accuracy of PM. Table 3 accurately shows the characteristics of each method from a quantitative perspective. e reliability index of PM, RSM, and WRSM has similar results, but according to the iteration time, PM and RSM are better than WRSM. Although the iteration time of VPRSM is also very small, the relative error of its reliability is very large, even as high as 10.0027%. Judging from the stability index, we can draw conclusions almost the same as those in the first and second examples. e method in this paper has high stability and strong robustness.

Example 4: Nonlinear Function of Convex toward Failure
Region.
e type of example 4 is just the opposite of that of example 3. It is a convex function, and its performance function is as follows. Both x and y obey the standard normal distribution. e calculation results are shown in Table 4, and the iteration path diagram of each method is shown in Figure 7.  It can be seen from Table 4 that the relative errors of the PM, RSM, and WRSM methods are very low, and the iteration time is similar. Although the iteration time of VPRSM is similar, its relative error is the largest. At the same time, it can be concluded that the stability of the method in this paper is still the best (0 stability).  It can be seen from the figure above that, except for the vector projection response surface method, other methods all converge to the true failure surface. is indicates that the PM is more accurate than the VPRSM. From the iterative path, it can be seen that the method in this paper can quickly approach the convergence point in only 4 steps, which is significantly faster than other methods in efficiency. is is because the method in this paper adopts a strategy of iterating in the negative gradient direction with a large step size first, and then iterating with a small step size.

Example 5:
Ten-Bar Truss Structure. In this example, a ten-bar truss structure (Figure 8)is selected. is structure is fixed with hinge support at node 1 and node 2, where E is the elastic modulus (E � 10 7 psi(1 psi � 6.895 kPa)), L is the    � 0.4536 kg)). And the section areas A1, A2, and A3 are all independent normal random variables (A 1 � N(13, 1.3)A 2 ∼ N(2, 0.2)A 3 � N(9, 0.9)). e failure state with respect to the serviceability of the structure is reached when the horizontal displacement d real of the node 5 exceeded a threshold value 3.5 in. Obviously, this is a case of an implicit performance function. And the results are shown in Table 5.
In this example, the calculation error obtained by VPRSM is too large and is no longer applicable to this example. Regardless of whether it is in the relative error of the failure probability or in the iteration time, the results displayed by the PM are satisfactory.

Conclusions
Aiming at the problem of the classic response surface method and its relevant method with low calculation accuracy in some cases, this paper proposes a new method based on double weighting factors idea and vector projection technology to improve the accuracy and stability.
Regarding accuracy and stability, the accuracy and stability of the method in this paper are better than the classical response surface method, linear weighted response surface, and vector projection response surface method in the case of low nonlinear performance function, performance function with cross term, concave function, or tenbar truss structure. In the case of concave functions, the accuracy of the method in this paper is slightly better than that of the vector projection response surface method, which is slightly inferior to other methods. But its stability and robustness are still higher than other methods.
Regarding efficiency, although the steps of the method in this paper are more complicated, the method in this paper reduces the iteration of invalid points, which makes the program running time less, and the calculation speed is improved. Compared with other methods, the method in this paper requires less calculation, and this method is more efficient.
In summary, the method in this paper improves the accuracy and stability of the response surface method while ensuring the calculation efficiency, and it has certain research significance and application value.

Data Availability
All data and models generated or used during the study appear in the submitted article. ey are available (providing full citations that include URLs or DOIs).

Conflicts of Interest
e authors declare that there are no conflicts of interests regarding the publication of this article.