MPE Mathematical Problems in Engineering 1563-5147 1024-123X Hindawi Publishing Corporation 10.1155/2016/4615903 4615903 Research Article A New Least Squares Support Vector Machines Ensemble Model for Aero Engine Performance Parameter Chaotic Prediction Du Dangdang 1 Jia Xiaoliang 1 Hao Chaobo 1 Franco Francesco School of Mechanical Engineering Northwestern Polytechnical University Xi’an 710072 China nwpu.edu.cn 2016 822016 2016 25 09 2015 26 01 2016 2016 Copyright © 2016 Dangdang Du et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Aiming at the nonlinearity, chaos, and small-sample of aero engine performance parameters data, a new ensemble model, named the least squares support vector machine (LSSVM) ensemble model with phase space reconstruction (PSR) and particle swarm optimization (PSO), is presented. First, to guarantee the diversity of individual members, different single kernel LSSVMs are selected as base predictors, and they also output the primary prediction results independently. Then, all the primary prediction results are integrated to produce the most appropriate prediction results by another particular LSSVM—a multiple kernel LSSVM, which reduces the dependence of modeling accuracy on kernel function and parameters. Phase space reconstruction theory is applied to extract the chaotic characteristic of input data source and reconstruct the data sample, and particle swarm optimization algorithm is used to obtain the best LSSVM individual members. A case study is employed to verify the effectiveness of presented model with real operation data of aero engine. The results show that prediction accuracy of the proposed model improves obviously compared with other three models.

1. Introduction

With increasing demands in the field of operation safety, asset availability, and economy, the health monitoring of aero engine has been widely considered as the key prerequisite for the competition of an airline company. One of the main tasks of health monitoring is to predict the performance parameter of aero engine. By predicting and analyzing the trend of performance parameters, one can obtain valuable information to avoid future risk and loss due to faults or accidents and reduce associated maintenance costs . Therefore, it is necessary to design a high accurate and robust prediction model for aero engine performance parameter (AEPP).

A variety of traditional time series prediction approaches have already been proposed for this problem, such as fuzzy rule , Kalman filter , grey prediction , ARMA , and multiple regression . These approaches are very mature in theory, but the accuracy is not always high and the robustness is not always satisfied in the application . With the development of artificial intelligence techniques, recent studies for AEPP prediction are mainly focused on artificial neural network (ANN) [8, 9] and support vector machine (SVM) [10, 11].

Compared with standard SVM, least squares support vector machine (LSSVM) adopts equality constraints and a linear Karush-Kuhn-Tucker system, which has a more powerful computational ability in solving the nonlinear and small-sample problem [12, 13]. In addition, LSSVM eliminates local minima and structure design complexity of ANN. Therefore, LSSVM is a good choice for AEPP prediction model designing. However, the modeling accuracy of a single LSSVM is not only influenced by the input data source, but also affected by its kernel function and regularization parameters . Thus, several main disadvantages are worth to be addressed. Firstly, using a data-driven technique to design an LSSVM model, data source should be considered as the first factor. AEPP data is different from the pure random system: that is, the chaotic characteristic of AEPP data should be extracted to reconstruct input data samples before modeling. Secondly, as two common parameter optimized methods for LSSVM, conventional cross-validation and grid search methods have several defects, such as high time consuming and a priori knowledge requirement.

In addition, although a single LSSVM with optimal parameters and reconstructed input data samples may have an excellent prediction performance under certain circumstances, because its kernel function is fixed, it perhaps has some kinds of inherent bias under other cases. In the literatures, due to the super robustness and generalization, ensemble model has been proved to be an effective way to reduce biases of single model. Ensemble model can make full use of diversity to compensate for disadvantages among the individual members, and the reasonable combination strategy is believed to be able to produce better prediction accuracy and generalization than single model . By using combining submodels, the multilayer networks of LS-SVMs ensemble have been discussed deeply, which is very encouraging and promising for further research , but up to now, the application of LSSVM ensemble model for AEPP prediction is relatively fresh and untouched in the open literature.

For ensemble model design, there are two points that should be considered. One is that the selected individual members need to exhibit much diversity (disagreement) and accuracy. The other is the effectiveness of the combination strategy . For the diversity of individual members, it is an easy and common way to build individual members by using data decomposition . However, this method is proved to be effective when the original data sample is sufficient, and it is not suitable for small-sample data. Compared with the existing combination strategies such as simple averaging weighting method, mean squared error weighting method, and least squares estimation weighting averaging method, intelligent method based combination strategies include ANN combiner and SVM combiner which have become the current trend ; however, ANN combiner cannot avoid falling into local optima, and for SVM combiner it is not easy to select appropriate kernel function, so it is necessary to further improve these ensemble strategies.

As previously mentioned, in this paper, a new PSR-PSO-(SK)LSSVM-(MK)LSSVM ensemble (PPLLE) model for AEPP prediction is proposed. Firstly, a set of diverse single kernel LSSVMs are created as base predictors. Subsequently these individual member LSSVMs output the primary prediction results independently. Finally, all the primary prediction results are combined to produce the most appropriate prediction results by another particular multiple kernel LSSVM. In the process of modeling, phase space reconstruction (PSR) theory is applied to extract the chaotic characteristic of input data source and reconstruct the data samples. Particle swarm optimization algorithm is used to search the best parameters for LSSVM members to ensure their prediction accuracies.

The rest of this paper is organized as follows. The next section provides a brief introduction to the related knowledge. Section 3 formulates the proposed PPLLE model. For illustration purpose, the detailed application on AEPP prediction and model comparisons is proposed in Section 4. Section 5 concludes this study.

2. An Overview of the Related Knowledge 2.1. Data Samples Reconstruction Based on PSR Theory

Although the nonlinear chaos behavior is the main challenge confronting the chaotic data series prediction, the underlying data generating mechanisms can still be explored by PSR theory . By means of the ability of revealing the nature of dynamic system state, the PSR theory is useful in system characterization, in nonlinear prediction, and in estimating bounds on the size of the system [20, 21].

According to Takens’ theorem, for the nonlinear time series xii=1n, the current state information can be represented by an m-dimensional vector:(1)xi+τ=fxi,xi-τ,,xi-m-1τ,where τ is the delay time, m is the embedded dimension, they are two important parameters for phase space construction, and f is the mapping relation between the inputs and outputs.

The autocorrelation function of time series at the first minimum value is taken as the delay time τ of the reconstructed phase space; we write(2)CR=i=1n-τxi-x-xi+τ-x-i=1n-τxi-x-2,where x- is the mean of xi.

To calculate the correlation dimension, the correlation integral C(r) needs to be computed:(3)Cr=1N2i=1Nj=1Nur-Xi-Xj,where r is the selected radius and r>0, u(x) is the Heaviside function.

The correlation dimension d(m) is calculated by the formula as below:(4)dm=lnCrlnr.

Suppose Yi=xi, Xi=(xi-τ,xi-2τ,,xi-mτ); then we can reconstruct n-m data samples Xi,Yim+1n.

2.2. Least Squares Support Vector Machine

LSSVM is the least squares form of a standard SVM; it was firstly proposed by Suykens and Vandewalle . LSSVM uses a set of linear equations during the training process and chooses all training data as support vectors, so it has excellent generalization and low computation complexity .

In LSSVM, the regression issue can be expressed as the following optimization problem:(5)min12W2+12γt=1Net2γ>0s.t.yt=W,φXt+b+et,where φ(Xt) is a nonlinear function which maps the input data into a higher dimensional space. et is the error at time t, b is the bias, and γ is the regulation constant.

According to the Lagrange function and Karush-Kuhn-Tucker theorem, the LSSVM for nonlinear functions can be given as below:(6)yt=t=1NαtKX,Xt+b,where αt is the Lagrange multiplier and KX,Xt is the kernel function which is applied to substitute the mapping process and avoid computing the function φ(Xt).

Typical kernel functions include linear kernel function, polynomial kernel function, radial basis kernel function, sigmoid kernel function, and multiple kernel function. Some of them are listed as follows:

linear kernel function (LKF):(7)KX,Xt=X,Xt,

polynomial kernel function (PKF):(8)KX,Xt=X,Xt+1q,

Gaussian radial basis kernel function (RBF):(9)KX,Xt=exp-X-Xt2σ2,

sigmoid kernel function (SKF):(10)KX,Xt=tanhνX,Xt+e,

multiple kernel function (MKF):(11)KX,Xt=ρ1K1X,Xt++ρnKnX,Xts.t.i=1nρi=10ρi1.

The nonlinear mapping ability of LSSVM is mainly determined by its kernel function form and relevant parameters setting: that is, various kernel functions or parameters have different influence on the prediction ability of LSSVM predictor (the parameters setting will be discussed in the next section). As to kernel function, the LKF is suited to expressing the linear component of the mapping relation, and the RBF possesses a wider convergence domain and an outstanding learning ability and high resolution power, while the PKF has a powerful approximation and generalization ability. Meanwhile, kernel functions can also be divided into local kernel function and global kernel function. For the global kernel function, it has the overall situation characteristic and is commonly good at fitting the sample points which are far away from the testing points, but the fitting effect is not perfect on the sample points which are near the testing points, and vice versa to the local kernel function . Each kind of kernel function has its own advantages and disadvantages; the prediction performances of LSSVM with different kernel functions are not identical.

Here, we define the LSSVM configured with a multiple kernel function as the multiple kernel LSSVM (MK-LSSVM); otherwise, we call it the single kernel LSSVM (SK-LSSVM).

2.3. Parameters Optimized Based on PSO

Particle swarm optimization (PSO) algorithm is a popular swarm intelligence evolutionary algorithm used for solving global optimization problem . It can search the global optimal solution in different regions of the solution space in parallel.

In PSO, the position of each particle represents a solution to the optimization problem. xk=xk1,xk2,,xkd is the position vector and vk=vk1,vk2,,vkd is the velocity vector of the kth particle. Similarly, Pk=pk1,pk2,,pkd represents the best position of the kth particle which has been achieved, and Pg=pg1,pg2,,pgd represents the best position among the whole particle group.

The values of position and velocity of the particle are updated as follows:(12)vidt+1=ωvidt+c1r1pidt-xidt+c2r2pgdt-xidt,xidt+1=xidt+vidt+1,where c1 and c2 are the acceleration constant, r1 and r2 are two random numbers in the range [0,1], and ω is inertia weight factor. To improve the convergence speed of PSO, c1, c2, and ω of PSO are adjusted by using the formulas as below:(13)ω=ωmax-ωmax-ωmintmaxt,c1=c1max-c1max-c1mintmaxt,c2=c2max-c2max-c2mintmaxt,where tmax expresses the maximum iteration number and t is the current iteration number.

3. Overall Process of Designing the PPLLE Model

The core idea of the ensemble model lies in that all the individual members are accurate as much as possible and diverse enough, and it adopts an appropriate ensemble strategy to combine these outputs of the selected members .

3.1. Selection of the Appropriate Individual Member Predictors

For LSSVM prediction model, several diverse strategies, such as data diversity, parameter diversity, and kernel diversity, have been proved effectively for the creation of ensemble members with much dissimilarity . Because kernel function has a crucial and direct effect on the learning and generalizing performance of LSSVM, various kernel functions can be used to create diverse LSSVMs. In this study, n independent SK-LSSVMs, such as LKF-LSSVM, PKF-LSSVM, and RBF-LSSVM, are selected as individual member LSSVM predictors.

3.2. Combination of the Selected Individual Member LSSVM Predictors

After the diverse individual member LSSVM predictors have been selected, the other key question is how to determine the weight coefficient of each individual predictor, that is, how to construct the combiner effectively. As depicted in previous section, the MKF integrates the advantages of global kernel function and local kernel function and offsets some shortages of both simultaneously. Hence, another special MK-LSSVM is chosen as the combiner. In this paper, the MKF is composed of a RBF and a PKF: the former is a typical local kernel function and the latter is a representative globe kernel function. A similar MK-LSSVM model has high prediction accuracy and generalization ability, which has been proved with chaotic time series by Tian et al. .

3.3. Overall Process of Designing the PPLLE Model

The basic framework of the proposed PPLLE model is given in Figure 1, where n is the number of the individual member LSSVM predictors.

Basic framework of the PPLLE model.

As shown in Figure 1, there are three main stages in the basic framework which can be summarized as follows.

Stage 1 (sample dataset reconstruction and partition).

The data source is reconstructed as data samples by using PSR; then the reconstructed data samples are divided into two indispensable subsets: training subset and testing subset.

Stage 2 (individual member creation and prediction).

Based on kernel function diversity principle, n independent SK-LSSVMs are created as the individual member. Each SK-LSSVM is trained by using the training subset. Accordingly, the computational results x^1,x^2,x^3,,x^n of the n SK-LSSVM predictors can be obtained, respectively. In the process of SK-LSSVM creating, PSO is used to optimize parameters of each member SK-LSSVM.

Stage 3 (combiner creation and prediction).

When the computational results of the individual member predictors in the second stage are acquired, they are aggregated into an ensemble result by another special MK-LSSVM. Similarly, to create the optimal MK-LSSVM, PSO is applied again.

Here, f(·) is the mapping function determined by the special combiner MK-LSSVM; thus, the final prediction output y^ of the PPLLE model can be given as below:(14)y^=fx^1,x^2,x^3,,x^n.

4. Case Study

Due to different gas path component degradations such as fouling, erosion, corrosion, and foreign object damage, the performance of an aero engine will decline over the service time . A lot of gas path performance parameters are often used in health monitoring of aero engine from different angles and levels, such as exhaust gas temperature (EGT), fuel flow (FF), and low pressure fan speed (N1). Among these performance parameters, EGT is considered as one of the most crucial working performance parameters of aero engine, which is measured to represent outlet temperature of combustor chamber in practice. When other conditions remain the same, the higher the EGT is, the more serious the performance degradation of aero engine is . EGT gradually rises when the working life of aero engine increases, if the EGT value reaches or exceeds the scheduled threshold provided by the original equipment manufacturer, then the aero engine needs to be arranged for maintenance timely.

In this study, we select EGT as the AEPP representative to predict by using the proposed PPLLE model, and it is worth mentioning that other similar parameters can also be predicted in the same way.

4.1. Data Description and Samples Reconstruction

In this study, the EGT data come from the real flight recorders of the cruise state of a certain type of aero engine, and the sampling interval is 5 flight cycles. The data series consists of 148 EGT datasets, covering the period from February 2013 to September 2014. To increase the quality of the prediction results, some abnormal samples have been discarded from the original data series. The observed EGT data is shown in Figure 2.

The observed EGT data.

For the observed EGT data series EGTii=1148, according to (2), (3), and (4), the delay time τ is set as 1 and embedding dimension m=5 is obtained by computing. Thus, (EGTi-5,EGTi-4,,EGTi-1) is taken as the input vector Xi, and Yi=EGTi (i=6,7,,148) is used as the corresponding expected value, so we can get the reconstructed data samples Xi,Yii=6148. The data samples Xi,Yii=6120 are used as training subset to train each individual LSSVM of the ensemble model, and the samples Xi,Yii=121148 are chosen as testing subset to validate the ensemble model. The one-step ahead prediction used in this paper is explained as in Figure 3. After the ensemble model has been trained, vector X121 is entered into 4 individual predictors (SK-LSSVM predictors) to compute their predicted values x^1211,x^1212,,x^1214, respectively. Then, these predicted values are aggregated into an ensemble result by using a combination predictor (MK-LSSVM predictor). Hence, the final predicted value y^121 is obtained. In this way, from i=121 to 148, all the final predicted values y^121 to y^148 can be got in turn.

One-step ahead prediction from i=121 to 148.

4.2. Evaluation Indices

Mean absolute percentage error (MAPE), mean absolute error (MAE), mean squared error (MSE), and Theil’s Inequality Coefficient (TIC) are used to evaluate the prediction ability of the prediction model:(15)MAPE=1ki=1kyi-y^iyi×100,MAE=1ki=1kyi-y^i,MSE=1ki=1kyi-y^i2,TIC=i=1kyi-y^i2i=1kyi2+i=1ky^i2,where yi and y^i are the observed values and corresponding prediction values, respectively.

4.3. Model Parameters Setting

In the modeling process of LSSVMs, the parameters of PSO are set as follows: c1min=c2min=2, c1max=c2max=3, ωmin=1, ωmax=3, p=50, and tmax=1000. By using the PSO, the corresponding optimal parameters of LSSVM2~LSSVM5 are obtained and listed in Table 1. An appropriate individual member number of the ensemble model is able to achieve a balance between the prediction efficiency and the prediction ability . In this study, the member number is set as 5.

Optimal parameters of LSSVM2∼LSSVM5.

LSSVM1(LKF-LSSVM) LSSVM2(PKF-LSSVM) LSSVM3(RBF-LSSVM) LSSVM4(SKF-LSSVM) LSSVM5(MK-LSSVM)
q = 3 γ=93.41 σ 2 = 0.32 γ=176.82 v = 1 , e=1γ=125.13 q = 2 , σ2=0.51ρ=0.27, γ=168.3
4.4. Results and Discussion

Figure 4 illustrates the prediction results for the EGT testing dataset by PPLLE model and corresponding observed EGT value. The black symbol represents the observed value, and the red symbol expresses the prediction value. From Figure 4, we can find that the rise and fall trends of the two curves are approximately the same, and only the individual points have some higher gaps of the size, which means EGT is predicted with good accuracy on the testing data samples as a whole. There are two causes that may explain the gaps between the observed values and prediction values. Firstly, it is difficult to give a thorough consideration to extract the EGT characteristics when determining the model input data. Secondly, due to the influence of subjective factors, it is impossible to eliminate all the outliers properly.

Prediction results of the PPLLE model on EGT testing dataset.

In contrast, the single LSSVM model proposed by Tian et al. , RBF-chaos model proposed by Zhang et al. , and PPLLE (PSR-PSO-LSSVM-LSSVM ensemble) model are built. The kernel function and parameters of the single LSSVM model are the same as those of the LSSVM5 model listed in Table 1. The RBF-chaos model aggregated chaos characteristics and RBF neural networks (here, the input layer, hidden layer, and output layer of RBF neural network are set as 5, 11, and 1, resp.). The difference between the PPLLE model and PPLLE model lies in that the latter uses an RBF-LSSVM (i.e., SK-LSSVM) as the combiner.

In Table 2, the MAPE, MAE, MSE, and TIC values of the PPLLE, PPLLE, RBF-chaos, and single LSSVM models on the testing dataset are listed. It shows that the PPLLE model performs the best among the four modes with MAPE of 0.51, compared with those of 0.62, 0.85, and 1.10 by the PPLLE, RBF-chaos, and single LSSVM models, respectively. The MAE of PPLLE, PPLLE, RBF-chaos, and single LSSVM models are 3.67, 4.48, 6.16, and 7.99, respectively, which demonstrates the prediction accuracy of the proposed model. PPLLE model predicts the EGT with MSE of 14.04, better than PPLLE, RBF-chaos, and single LSSVM models with those of 22.48, 49.70, and 75.66, respectively. Besides, it should be pointed out that the TIC of PPLLE is 0.00258, which is quite acceptable compared with those of the other 3 models. A strong support is also exhibited by Figure 5, where the curve of PPLLE model intuitively shows the good prediction accuracy and excellent ability in tracking the observed EGT compared to the other 3 models.

Comparison of different models on EGT testing dataset.

Model MAPE (%) MAE MSE TIC
PPLLE 0.51 3.67 14.04 0.00258
PPLLE 0.62 4.48 22.48 0.00327
RBF-chaos 0.85 6.16 49.70 0.00485
Single LSSVM 1.10 7.99 75.66 0.00598

Prediction results of different models on EGT testing dataset.

Figures 6(a)6(d) show a detailed profile of relative percentage error (RPE) between the observed values and prediction values of different models on the EGT testing data samples. It illustrates that the PPLLE model has an outstanding approximation ability with the RPE ranging from −0.7% to 0.9%; the RPE ranging around [−1.4%, 2.9%] in Figure 6(d) shows that the single LSSVM has the worst performance. RPE distribution range of PPLLE model is better than that of RBF-chaos model, which are exhibited by Figures 6(c) and 6(d). Comparison results of Figure 6 also prove the effectiveness of our proposed approach. Some of the main reasons why the PPLLE model is superior to others can be summarized as follows: (1) the PPLLE ensemble model based on kernel diverse principle eliminates the possible inherent biases of single LSSVM and makes full use of the advantages of individual member LSSVMs; (2) the PSR extracts the chaotic feature of the original data source and reconstructs data samples, which elucidates the input characteristic for the PPLLE model; (3) the PSO ensure that each individual LSSVM achieves the best performance; (4) the particular ensemble strategy of PPLLE employs an MK-LSSVM and further enhances the prediction ability of the ensemble model.

RPE comparison of different models on EGT testing dataset.

RPE of PPLLE

RPE of PPLLE

RPE of RBF-chaos

RPE of single LSSVM

5. Conclusions

Designing a high accuracy and robust model for AEPP prediction is quite challenging, since AEPP data is nonlinear, chaotic, and small-sample, and the traditional single prediction model may have some inherent biases. To solve this problem and to realize high prediction accuracy level, a new LSSVM ensemble model based on PSR and PSO is presented and applied to AEPP prediction in this paper.

For the presented PPLLE prediction model, individual member LSSVMs based on kernel diverse principle eliminate the inherent biases of single LSSVM and make full use of the advantages of them as much as possible. PSR is applied to reconstruct data samples, which alleviates the influence of the chaotic feature of the original data source to the PPLLE model. PSO is used to guarantee that each individual LSSVM achieves the best performance. The particular ensemble strategy employs an MK-LSSVM combiner, as the MKF integrates the advantages of global kernel function and local kernel function, and it offsets some shortages of both; this ensemble strategy further enhances the prediction ability of the ensemble model.

EGT is selected as the representative health monitoring parameter of aero engine for validating the effectiveness of the proposed PPLLE model. For comparison, the PPLLE, RBF-chaos, and single LSSVM models are also developed and evaluated. The PPLLE predicts EGT with MAPE of 0.51%, better than the PPLLE, RBF-chaos, and single LSSVM models with those of 0.62%, 0.85%, and 1.10%, respectively. Similarly, the PPLLE predicts EGT with TIC of 0.00258, better than the PPLLE, RBF-chaos, and single LSSVM models with those of 0.00327, 0.00485, and 0.00598, respectively. In addition, MAE and MSE indices also confirm that the presented model gives improved prediction accuracy. In a word, the above four evaluation indices consistently demonstrate that the PPLLE model is more suitable for AEPP prediction problem, and the PPLLE model can meet the actual demand of engineering application. Moreover, comparing results imply that this ensemble model has a promising application in other similar engineering areas where the data have complex nonlinear chaos relationships.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Yang L.-F. Ioachim I. Adaptive estimation of aircraft flight parameters for engine health monitoring system Journal of Aircraft 2002 39 3 404 408 10.2514/2.2965 2-s2.0-0036575674 Hong J. Han L. Miao X. Fuzzy logic inference for predicting aero-engine bearing grad-life 4 Proceedings of the 9th International Flins Conference on Computational Intelligence: Foundations and Applications August 2010 Chengdu, China 367 373 You G. Wang N. Aero-engine condition monitoring based on Kalman filter theory Advanced Materials Research 2012 490–495 4 176 181 Zhao N.-B. Yang J.-L. Li S.-Y. Sun Y.-W. A GM (1, 1) Markov chain-based aeroengine performance degradation forecast approach using exhaust gas temperature Mathematical Problems in Engineering 2014 2014 11 832851 10.1155/2014/832851 2-s2.0-84899944331 Liu Z. G. Cai Z. J. Tan X. M. Forecasting research of aero-engine rotate speed signal based on ARMA model Procedia Engineering 2011 15 115 121 10.1016/j.proeng.2011.08.024 Song Y.-X. Zhang K.-X. Shi Y.-S. Research on aeroengine performance parameters forecast based on multiple linear regression forecasting method Journal of Aerospace Power 2009 24 2 427 431 2-s2.0-62549145803 Chatfield C. The Analysis of Time Series: An Introduction 2003 6th Boca Raton, Fla, USA Chapman & Hall/CRC MR604358 Luan S. G. Zhong S. S. Li Y. Hybrid recurrent process neural network for aero engine condition monitoring Neural Network World 2008 18 2 133 145 2-s2.0-46749136077 Gang D. Zhong S. S. Aircraft engine lubricating oil monitoring by process neural network Neural Network World 2006 16 1 15 24 Zhang C. Wang N. Aero-engine condition monitoring based on support vector machine Physics Procedia 2012 24 1546 1552 10.1016/j.phpro.2012.02.228 Fu X.-Y. Zhong S.-S. Aeroengine turbine exhaust gas temperature prediction using process support vector machines Advances in Neural Networks—SNN 2013 2013 7951 Berlin, Germany Springer 300 310 Lecture Notes in Computer Science 10.1007/978-3-642-39065-4_37 Suykens J. A. K. Vandewalle J. Least squares support vector machine classifiers Neural Processing Letters 1999 9 3 293 300 10.1023/a:1018628609742 2-s2.0-0032638628 Suykens J. A. K. Van Gestel T. De Brabanter J. De Moor B. Vandewalle J. Least Squares Support Vector Machines 2002 Singapore World Scientific Yan X. Chowdhury N. A. Mid-term electricity market clearing price forecasting: a hybrid LSSVM and ARMAX approach International Journal of Electrical Power & Energy Systems 2013 53 1 20 26 10.1016/j.ijepes.2013.04.006 2-s2.0-84877745144 Tian Z.-D. Gao X.-W. Shi T. Combination kernel function least squares support vector machine for chaotic time series prediction Acta Physica Sinica 2014 63 16 160508 10.7498/aps.63.160508 2-s2.0-84907153260 Cagcag Yolcu O. A hybrid fuzzy time series approach based on fuzzy clustering and artificial neural network with single multiplicative neuron model Mathematical Problems in Engineering 2013 2013 9 560472 10.1155/2013/560472 2-s2.0-84893848994 Yu L. Yue W. Y. Wang S. Y. Lai K. K. Support vector machine based multiagent ensemble learning for credit risk evaluation Expert Systems with Applications 2010 37 2 1351 1360 10.1016/j.eswa.2009.06.083 2-s2.0-71749114830 Lv Y. Liu J. Yang T. Zeng D. A novel least squares support vector machine ensemble model for NOx emission prediction of a coal-fired boiler Energy 2013 55 319 329 10.1016/j.energy.2013.02.062 2-s2.0-84878657664 Zhang Q. Tse P. W.-T. Wan X. Xu G. Remaining useful life estimation for mechanical systems based on similarity of phase space trajectory Expert Systems with Applications 2015 42 5 2353 2360 10.1016/j.eswa.2014.10.041 2-s2.0-84912535377 Feeny B. F. Lin G. Fractional derivatives applied to phase-space reconstructions Nonlinear Dynamics 2004 38 1–4 85 99 10.1007/s11071-004-3748-6 MR2112169 2-s2.0-15544370418 Su L. Li C. Local prediction of chaotic time series based on polynomial coefficient autoregressive model Mathematical Problems in Engineering 2015 2015 14 901807 10.1155/2015/901807 Yuan Y. B. Yuan X. H. An improved PSO approach to short-term economic dispatch of cascaded hydropower plants Kybernetes 2010 39 8 1359 1365 10.1108/03684921011063664 2-s2.0-77956138748 Wang L. Li Y. G. Abdul Ghafir M. F. Swingler A. A Rough Set-based gas turbine fault classification approach using enhanced fault signatures Proceedings of the Institution of Mechanical Engineers 2011 225 8 1052 1065 10.1177/0957650911416913 2-s2.0-84863018278 Zhang Z. Y. Wang T. Liu X. G. Melt index prediction by aggregated RBF neural networks trained with chaotic theory Neurocomputing 2014 131 368 376 10.1016/j.neucom.2013.10.006 2-s2.0-84894043701