The Scientific World Journal

Volume 2013 (2013), Article ID 548370, 8 pages

http://dx.doi.org/10.1155/2013/548370

Research Article

A Hybrid Approach for Short-Term Forecasting of Wind Speed

Sivanagaraja Tatinati and Kalyana C. Veluvolu

School of Electronics Engineering, College of IT Engineering, Kyungpook National University, Daegu, Republic of Korea

Received 31 August 2013; Accepted 8 October 2013

Academic Editors: M. L. Ferrari and D. C. Rakopoulos

Copyright © 2013 Sivanagaraja Tatinati and Kalyana C. Veluvolu. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

We propose a hybrid method for forecasting the wind speed. The wind speed data is first decomposed into intrinsic mode functions (IMFs) with empirical mode decomposition. Based on the partial autocorrelation factor of the individual IMFs, adaptive methods are then employed for the prediction of IMFs. Least squares-support vector machines are employed for IMFs with weak correlation factor, and autoregressive model with Kalman filter is employed for IMFs with high correlation factor. Multistep prediction with the proposed hybrid method resulted in improved forecasting. Results with wind speed data show that the proposed method provides better forecasting compared to the existing methods.

1. Introduction

Exponential increase in energy consumption globally is leading to rapid depletion of existing fossil fuel resources [1]. This impending scarcity has led the power industry to explore renewable energy sources such as wind, solar, and tidal energies [2, 3]. Renewable energy resources attract more attention owing to their pollution free energy generation capabilities. Wind as a potential source for generation of electricity on a large scale has been receiving much attention recently. In China alone, the growth rate of wind farms was reported as in 2009 with the total wind generation capacity of 25805.3 MW [4]. However, stable production of electricity from wind power is a quite arduous task due to the uncertainty and intermittency of wind speed. The increasing importance of wind energy, affected by variations in wind speed, necessitates accurate forecasting of wind speed.

In recent past, significant amount of research has been focused on forecasting the wind speed. However, due to the properties of wind speed such as nonstationarity, high fluctuations, and irregularity, accurate forecasting becomes a challenge. Generally, forecasting of wind speed is classified into two types: short-term forecasting and long-term forecasting. Short-term forecasting of wind speed affects grid reliability and market-based ancillary service costs [5, 6], whereas long-term forecasting provides an idea about a particular site location [7]. The prediction models proposed in the recent past for wind speed prediction are categorized as physical models, time series statistical models, and knowledge-based methods. Each model has its own advantages and disadvantages. Physical models such as Markov models [8] require information regarding the temperature and climatic conditions to build the models. In time series statistical modeling, various techniques such as autoregressive moving average (ARMA) [9, 10], autoregressive integrated moving average (ARIMA) [11], Kalman filter [12], model-based approaches [13–15], and Particle swarm optimization [16] are employed for prediction. Knowledge-based methods have been the widely adapted techniques for wind speed forecasting especially artificial neural networks (ANN) [17, 18], radial bias function [19], fuzzy logic [20], and support vector machines [7].

Recently, hybrid methods based on divide and conquer principle are proposed for accurate forecasting of wind speed [21–23]. In these methods, wind speed data is decomposed into independent components. Later, each component is predicted with adaptive algorithms such as ARMA, SVM, or ANN. In [23], empirical mode of decomposition (EMD) was employed to decompose the signal into intrinsic mode functions (IMFs), and then ARMA model with fixed coefficients was employed to forecast the IMFs individually (EMD-ARMA). Further, SVM and ANN are employed to predict the IMFs in [22] and [21], respectively, to improve the forecasting performance. Different IMFs obtained from EMD posses different frequency bands and characteristics. For instance, IMF-n in the lowest frequency band represents the central tendency of data, and IMF-1 is the highest frequency band and it mainly contains a large quantity of noisy signals. Although regression models are effective for time series prediction, owing to the highly nonstationary characteristics of few IMFs (high frequency IMFs), the prediction with regression models is not effective. On the other hand, the performance of machine learning techniques (SVM, ANN) for low frequency components may hamper due to the over fitting of data.

To overcome the limitations, in this paper, we propose a new hybrid approach for multistep prediction of the IMFs. Instead of employing a single adaptive algorithm for predicting the IMFs, we employed the combination of LS-SVM and AR for prediction of IMFs. Based on the partial autocorrelation factor (PACF) and the frequency characteristics of IMFs, the adaptive prediction algorithm will be identified. In the proposed hybrid approach, for high frequency IMFs (weak correlation factor), LS-SVM is employed, and for low frequency IMFs (high correlation factor) AR model with Kalman filter is employed. Results show that the proposed hybrid approach provides better forecasting performance compared to the existing methods.

The paper is organized as follows. In Section 2, brief description of LS-SVM, AR model with Kalman filter, and the proposed hybrid approach is discussed. Section 3 provides wind speed data collection procedure, obtained results, and implications. Section 4 concludes the paper.

2. Methodology

In this section, we first discuss the formulation of all the methods (EMD, AR model with Kalman filter, and LS-SVM), followed by the proposed hybrid approach.

2.1. Empirical Mode Decomposition (EMD) [24]

EMD has been a widely accepted method for decomposition of nonlinear and nonstationary signals. The basic idea of EMD is to identify the steady-state intrinsic oscillatory modes by employing Hung-Hilbert transform. The detailed procedure for EMD decomposition technique is well documented; for details see [24, 25]. In Figure 1, the flowchart representation of EMD process is shown.

Figure 1: Flowchart of EMD.

The process of EMD to decompose the signal is as follows.

(i)Step 1: initially, all extrema of will be identified by a cubic spline.(ii)Step 2: the mean value () of upper envelope () and lower envelope () is calculated, , and subtracted from to obtain , .(iii) can be an IMF, if it obeys the following conditions.

(a)In the whole data series, the number of extrema and the number of zero crossings in a whole sampled data set must either be equal or differ at most by one.(b)At any point, the mean value of the envelope defined by the local maxima and the envelope defined by local minima is zero.

(iv)Step 3: if does not obey the above conditions, then will be considered as new signal and the same procedure from Step 1 will be followed.(v)Step 4: if is an IMF, then residue () for will be calculated, . Consider as new signal and same procedure from Step 1 will be employed.

2.2. Autoregressive Model (AR) with Kalman Filter [26]

AR model is a type of random process which is popular for prediction of various types of natural phenomena. It is also one of the linear prediction methods designed to predict an output of a system based on the previous outputs and the regression coefficients (weights). In this paper, Kalman filter is combined with the AR model to update the weights to enhance the prediction quality.

The state-space model of AR model of order can be given by

Measurement equation:

State equation:

where represents the weights (time-varying filter coefficients), represents delayed inputs, and and are independent white noise process with Gaussian distribution and variance ().

The Kalman filter update equations are given by [26]

where represents prediction error, represents Kalman gain vector, represents error covariance matrix, represents covariance of state noise, and represents covariance of measurement noise.

2.3. Least Squares-Support Vector Machines (LS-SVM) [27]

LS-SVM is the least squares version of support vector machine (SVM). In LS-SVM, the regression approximation addresses the problem of estimating a function based on given training data with as a -dimensional input vector and as the corresponding output. A brief formulation for LS-SVM is provided here; for more information see [27]. The regression model for LS-SVM can be given in the form:

where is the weight vector and is the bias.

The optimization problem for the function estimation with LS-SVM is defined as follows:

subject to the constraints , where is a regularization constant and is the estimation error.

The Lagrangian function for the optimization problem can be given as

where represents the Lagrangian multipliers.

The regression model with LS-SVM can be obtained as

where represents the Kernel function. RBF Kernel employed in this paper is .

2.4. The Hybrid EMD-LSSVM-AR Model

The procedure for forecasting the wind speed with the proposed hybrid method comprises three stages as shown in Figure 2. In the first stage, owing to the nonstationary and stochastic characteristics of wind speed time series, the signal will be decomposed into meaningful local time scales by employing EMD [28]. In the second stage, prediction of all the decomposed components will be performed individually with either LS-SVM or AR model. The selection of adaptive algorithm for an IMF is based on the obtained PACF factor and frequency components of the corresponding IMF. LS-SVM is employed for weakly correlated IMFs and AR model for the highly correlated IMFs. In the final stage, the predictions are aggregated to attain the final forecasting result.

Figure 2: The framework for hybrid EMD-LSSVM-AR model.

3. Results and Discussion

In this section, data employed for prediction is described. Following that, the indices were employed to evaluate the forecasting performance. Finally, performance analysis with the existing methods is discussed.

3.1. Wind Speed Data

Wind data collected from Beloit, Kansas, from a 20-meter anemometer as an integral part of the Western area power administration anemometer loan program is employed for analysis in this paper. This data contains average wind speed and the direction in Beloit for the period 2003-2004. The data was originally made available by Wind Powering America, a DOE Office of Energy Efficiency & Renewable Energy (EERE) program. For illustration, the wind speed profile (in hours) of Beloit is shown in Figure 3.

Figure 3: Hourly wind speed profile of Beloit.

Two data sets are used in this paper for analysis.

(i)Mins data: in this data set, wind speed is recorded for every 10 mins.(ii)Hours data: in this data set, wind speed is recorded for every one hour.

In this paper, single-step prediction and six-step ahead prediction were performed on the two data sets separately (six-step ahead prediction of mins data refers to the same duration of single-step prediction of hours data). Comparative analysis is performed with the existing methods for the same data sets to highlight the advantage of the proposed hybrid approach.

3.2. Evaluation of Forecast Performance

The indices employed to evaluate the wind forecasting performance are mean absolute error (MAE) and mean absolute percent error (MAPE). Smaller values of these indices imply better forecasting performance.

The indices are defined as follows:

where is the actual observation value for a time period and is the forecast value for the same time period. The MAE reveals the average variance between the true value and forecast value whereas MAPE has a good sensitivity to small changes in data.

3.3. Performance Analysis

In this subsection, forecasting of both mins data and hours data is performed with the proposed hybrid model. Further, a comparative analysis is also performed with EMD-AR and EMD-LSSVM.

In Stage 1 of the proposed hybrid approach, the wind speed data (mins data) is decomposed into nine IMFs with EMD. Further, PACF for each IMF is computed independently. IMFs and the corresponding PACF are shown in Figure 4. Based on the obtained PACF, LS-SVM is selected for prediction of first two IMFs (IMF-1 and IMF-2) and for the rest seven IMFs; AR model with Kalman filter is selected in Stage 2. Using trail-and-error method, the parameters of LS-SVM are initialized as , , and . Based on PACF, second order was identified for AR model. In Stage 3, aggregation of all the IMFs prediction is performed to obtain the final forecasting results.

(a)

(b)

Figure 4: (a) The decomposition of the wind speed profile for Beloit by EMD (b) PACF of respective IMF.

For hourly forecasting with mins data, six-step ahead prediction is performed. Results obtained for six-step prediction and single-step prediction with the proposed method along with the existing methods are tabulated in Table 1. The proposed method has an MAE of 0.42 for six-step ahead forecasting, whereas for the existing methods EMD-AR and EMD-LSSVM, MAE obtained was 0.48 and 0.52, respectively. Single-step prediction is performed with hours data for one hour ahead forecasting. The procedure employed for performing the prediction of IMFs is similar to six-step prediction procedure. With the proposed method for single-step prediction, MAE of 0.016 was obtained. With EMD-AR and EMD-LSSVM, MAE obtained was 5.8 and 4.8, respectively. For illustration, the forecasting results for all the three methods for six-step ahead prediction are shown in Figure 5.

Table 1: Hourly forecasting performance analysis.

Method
Model errors
Mins data
Hours data

1 step
6 steps
1 step
6 steps

EMD-AR [23]
MAE (m/s)
0.022
0.43
0.02
0.48

MAPE (%)
6.2
31.36
5.8
34.19

EMD-LSSVM [22]
MAE (m/s)
0.018
0.49
0.019
0.52

MAPE (%)
4.6
34.45
4.8
37.49

EMD-LSSVM-AR
MAE (m/s)
0.012
0.39
0.016
0.42

MAPE (%)
2.8
28.25
3.2
31.19

(a)

(b)

(c)

Figure 5: Performance analysis for 6-step ahead forecasting (one hour ahead forecasting) for mins data (a) EMD-AR; (b) EMD-LSSVM; (c) EMD-LSSVM-AR.

To highlight the robustness of the proposed method, six-step ahead prediction with the proposed method is performed. Results obtained are tabulated in Table 1. Results show that the proposed method provides better forecasting compared to the existing methods. For illustration, six-step ahead forecasting results with hours data for all three methods are shown in Figure 6.

(a)

(b)

(c)

Figure 6: Performance analysis for hourly forecasting (a) EMD-AR (b); EMD-LSSVM; (c) EMD-LSSVM-AR.

4. Conclusions

In this paper, a hybrid approach that is a combination of EMD, LS-SVM, and AR model-Kalman filter is developed for wind speed forecasting. The data was first decomposed into IMFs based on the PACF, and then multistep prediction was performed with LS-SVM for some IMFs and AR-Kalman filter for the rest of IMFs. With the proposed method, six-step ahead forecasting for both mins data and hours data was performed. A comparative analysis with existing methods EMD-AR and EMD-LSSVM highlights the advantages of the proposed method. Results show that the proposed hybrid approach provides better forecasting compared to the existing approaches.

Nomenclature

: | Signal
: | Lower envelope
: | AR coefficients at instant
: | Estimated AR coefficients
: | Prediction error
| Covariance of state noise
| Input vector in LS-SVM training set
: | LS-SVM weights vector
: | Bias
: | Lagrangian multipliers
: | Kernel function
: | Output of the corresponding s in LS-SVM
: | Upper envelope
: | Mean of the envelope
and : | State noise and measurement noise
: | Kalman gain vector
: | Error covariance matrix
: | Variance of measurement noise
: | Number of training samples
: | Nonlinear mapping
: | Regularization constant
: | Estimation error with LS-SVM
: | Predicted output with LS-SVM.

Acknowledgment

The research was supported by Kyungpook National University Research Fund, 2012.

References

J. Szarka, “Wind power, policy learning and paradigm change,” Energy Policy, vol. 34, no. 17, pp. 3041–3048, 2006.

S. Akpinar and E. K. Akpinar, “Estimation of wind energy potential using finite mixture distribution models,” Energy Conversion and Management, vol. 50, no. 4, pp. 877–884, 2009.

B. Kim, J. Lee, J. Jang, D. Han, and K.-H. Kim, “Prediction on the seasonal behavior of hydrogen sulfide using a neural network model,” The Scientific World Journal, vol. 11, pp. 992–1004, 2011.

A. Shiu and P.-L. Lam, “Electricity consumption and economic growth in China,” Energy Policy, vol. 32, no. 1, pp. 47–54, 2004.

R. G. Kavasseri and K. Seetharaman, “Day-ahead wind speed forecasting using f-ARIMA models,” Renewable Energy, vol. 34, no. 5, pp. 1388–1393, 2009.

L. Lizuma, Z. Avotniece, S. Rupainis, and A. Teilans, “Assessment of the present and future offshore wind power potential: a case study in a target territory of the Baltic Sea near the Latvian Coast,” The Scientific World Journal, vol. 2013, Article ID 126428, 10 pages, 2013.

M. A. Mohandes, T. O. Halawani, S. Rehman, and A. A. Hussain, “Support vector machines for wind speed prediction,” Renewable Energy, vol. 29, no. 6, pp. 939–947, 2004.

T. J. Parrore and R. G. Miller, “Generalized exponential Markov and model output statistics: a comparative verification,” Monthly Weather Review, vol. 113, pp. 1524–1541, 1985.

E. Erdem and J. Shi, “ARMA based approaches for forecasting the tuple of wind speed and direction,” Applied Energy, vol. 88, no. 4, pp. 1405–1414, 2011.

Y. Dong, Z. Guo, J. Wang, and H. Lu, “The forecasting procedure for long-term wind speed in the Zhangye area,” Mathematical Problems in Engineering, vol. 2010, Article ID 684742, 17 pages, 2010.

H. Liu, H.-Q. Tian, and Y.-F. Li, “Comparison of two new ARIMA-ANN and ARIMA-Kalman hybrid methods for wind speed prediction,” Applied Energy, vol. 98, pp. 415–424, 2012.

P. Louka, G. Galanis, N. Siebert et al., “Improvements in wind speed forecasts for wind power prediction purposes using Kalman filtering,” Journal of Wind Engineering and Industrial Aerodynamics, vol. 96, no. 12, pp. 2348–2362, 2008.

K. C. Veluvolu and W. T. Ang, “Estimation and filtering of physiological tremor for real-time compensation in surgical robotics applications,” International Journal of Medical Robotics and Computer Assisted Surgery, vol. 6, no. 3, pp. 334–342, 2010.

K. C. Veluvolu, W. T. Latt, and W. T. Ang, “Double adaptive bandlimited multiple Fourier linear combiner for real-time estimation/filtering of physiological tremor,” Biomedical Signal Processing and Control, vol. 5, no. 1, pp. 37–44, 2010.

W. T. Latt, K. C. Veluvolu, and W. T. Ang, “Drift-free position estimation of periodic or quasi-periodic motion using inertial sensors,” Sensors, vol. 11, no. 6, pp. 5931–5951, 2011.

W. Zhang, J. Wu, J. Wang, W. Zhao, and L. Shen, “Performance analysis of four modified approaches for wind speed prediction,” Applied Energy, vol. 99, pp. 324–333, 2012.

M. Bilgili, B. Sahin, and A. Yasar, “Application of artificial neural networks for the wind speed prediction of target station using reference stations data,” Renewable Energy, vol. 32, no. 14, pp. 2350–2360, 2007.

E. Cadenas and W. Rivera, “Short term wind speed forecasting in La Venta, Oaxaca, México, using artificial neural networks,” Renewable Energy, vol. 34, no. 1, pp. 274–278, 2009.

H. Beyer, T. Degener, J. Hausmann, M. Hoffmann, and P. Rujan, “Short term wind speed and power output of a wind turbine with neural networks,” in Proceedings of the 5th European Wind Energy Association Conference and Exhibition, pp. 349–352, 1994.

I. G. Damousis, M. C. Alexiadis, J. B. Theocharis, and P. S. Dokopoulos, “A fuzzy model for wind speed prediction and power generation in wind parks using spatial correlation,” IEEE Transactions on Energy Conversion, vol. 19, no. 2, pp. 352–361, 2004.

Z. Guo, W. Zhao, H. Lu, and J. Wang, “Multi-step forecasting for wind speed using a modified EMD-based artificial neural network model,” Renewable Energy, vol. 37, no. 1, pp. 241–249, 2012.

J. Hu, J. Wang, and G. Zeng, “A hybrid forecasting approach applied to wind speed time series,” Renewable Energy, vol. 60, pp. 185–194, 2013.

R. Li and Y. Wang, “Short-term wind speed forecasting for wind farm based on empirical mode decomposition,” in Proceedings of the 11th International Conference on Electrical Machines and Systems (ICEMS '08), pp. 2521–2525, October 2008.

N. E. Huang, Z. Shen, S. R. Long et al., “The empirical mode decomposition and the Hubert spectrum for nonlinear and non-stationary time series analysis,” Proceedings of the Royal Society A, vol. 454, no. 1971, pp. 903–995, 1998.

M. Dätig and T. Schlurmann, “Performance and limitations of the Hilbert-Huang transformation (HHT) with an application to irregular water waves,” Ocean Engineering, vol. 31, no. 14-15, pp. 1783–1834, 2004.

S. Haykin, Adaptive Filter Theory, Prentice-Hall, Englewood Cliffs, NJ, USA, 2001.

J. A. K. Suykens, J. Vandewalle, and B. De Moor, “Optimal control by least squares support vector machines,” Neural Networks, vol. 14, no. 1, pp. 23–35, 2001.

H. Bouzgou and N. Benoudjit, “Multiple architecture system for wind speed prediction,” Applied Energy, vol. 88, no. 7, pp. 2463–2471, 2011.