Advances in Electrical Engineering

Volume 2014 (2014), Article ID 424781, 7 pages

http://dx.doi.org/10.1155/2014/424781

Research Article

A Hybrid Short-Term Power Load Forecasting Model Based on the Singular Spectrum Analysis and Autoregressive Model

Hongze Li, Liuyang Cui, and Sen Guo

School of Economics and Management, North China Electric Power University, Beijing 102206, China

Received 15 February 2014; Revised 17 April 2014; Accepted 17 April 2014; Published 5 May 2014

Academic Editor: Mamun B. I. Reaz

Copyright © 2014 Hongze Li et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

Short-term power load forecasting is one of the most important issues in the economic and reliable operation of electricity power system. Taking the characteristics of randomness, tendency, and periodicity of short-term power load into account, a new method (SSA-AR model) which combines the univariate singular spectrum analysis and autoregressive model is proposed. Firstly, the singular spectrum analysis (SSA) is employed to decompose and reconstruct the original power load series. Secondly, the autoregressive (AR) model is used to forecast based on the reconstructed power load series. The employed data is the hourly power load series of the Mid-Atlantic region in PJM electricity market. Empirical analysis result shows that, compared with the single autoregressive model (AR), SSA-based linear recurrent method (SSA-LRF), and BPNN (backpropagation neural network) model, the proposed SSA-AR method has a better performance in terms of short-term power load forecasting.

1. Introduction

Short-term power load forecasting is one of the most important issues in economic and reliable operation of power system. Many operating decisions related to electricity power system such as unit commitment, dispatch scheduling of the generating capacity, reliability analysis, security assessment, and maintenance scheduling of the generators are based on the short-term power load forecasting.

In recent years, domestic and foreign scholars have done many studies in the field of short-term power load forecasting. Currently, the short-term power load forecasting method can be divided into two categories, that is, load-series-based forecasting method and affecting-factors-based forecasting method. Although the power load shows the random and uncertain characteristic, it also has an apparent tendency. Therefore, the load-series-based forecasting method is based upon the internal structure of the short-term power load series, which includes ARIMA, ARMAX [1, 2], neural networks [3, 4], gray prediction model [5, 6], wavelet analysis [7, 8], and other forecasting methods. However, these methods have some shortcomings: the load-series-based forecasting method can only be used for data fitting and is not suitable for the treatment of regularity; the neural network method has the problem that the relation between the input variables cannot be expressed explicitly; the grey prediction model is used for the case of the little sample data; the wavelet analysis forecasting method transforms the original sequence by the orthogonal wavelets to get the subsequences of different frequency-domain and then uses the subsequences to predict and reconstruct, which has a higher accuracy than using the original series directly. The affecting-factors-based method is from the perspective of the factors affecting the power load, which uses the regression analysis to perform the prediction on the base of determining the relation between different variables [9]. However, it is very difficult to find all the factors accurately and comprehensively, which are influenced by the geographical factors, economic situation, and climate and other factors that are often quite different in different periods to some extent. So, it is too hard to find an equation which can be suited to all the forecasting cases. Although the affecting-factors-based method is better than the load-series-based in theory, it has much less practical operability. Moreover, the affecting-factors-based method can be put into use for forecasting the medium- and long-term power load. To our knowledge and related work [10, 11], the key of short-term power load forecasting is to grasp the primary ingredients reflecting the variation tendency and it is quite necessary to find out a method that can depict the fluctuation characteristics of power load series.

The singular spectrum analysis (SSA) technology is a typical time-series-based analysis method which has been used for industrial production forecasting [12], signals detection [13], electricity price forecasting [14], murmur detection from heart sounds [15], and so on. The aim of SSA is to make a decomposition of the original time series into the sum of a small number of independent and interpretable components such as a slowly varying trend, oscillatory components, and a structureless noise. Then, some of these components are used for time series forecasting. At present, the SSA method has been widely applied to cope with the problem in many domains such as geography and sociology [16, 17].

From the perspective of the fluctuation characteristics the power load shows randomness, trend, and periodicity, which can be extracted by using the SSA method. That is to say, the stochastic noise components which influence the forecasting accuracy can be eliminated. And Afshar and Briceño have already applied this method to load forecasting with linear recurrent formulae (LRF) [18, 19], but, as we all know, the relation of power load in different time is not simply linear; usually complicated nonlinear relationship is presented. So the SSA-LRF is not so perfect if we take this into consideration. Meanwhile, using the time-series-based model to forecast power load can not only overcome the problem of invalid linear fitting, but also make up for the shortage of failing to handle the regularity of time series. Therefore, in this paper, the SSA approach and autoregressive (AR) model are combined to forecast the short-term power load, that is, SSA-AR forecasting model.

The rest of this paper is organized as follows. In Section 2, the SSA methodology and the AR model are described briefly, and the hybrid SSA-AR power load forecasting model is introduced; the empirical analysis is performed in Section 3, and the forecasting results of several different forecasting models are presented and discussed; Section 4 concludes this paper.

2. The Basic Principle of SSA-AR Model

2.1. A Brief Introduction to SSA Method

Singular spectrum analysis (SSA) method contains two phases named decomposition and reconstruction. The former phase arranges the original sequence in a form of time-delay matrix before decomposing the original time series. Then, the time series are reconstructed via grouping and diagonal averaging, which is called reconstruction. The reconstructed series is then used for forecasting the new data points.

2.1.1. Decomposition

Given a time series , . In the first step, the embedding procedure is applied to construct a sequence of with -dimension vectors from the time series :

where is a Hankel matrix with equal elements on the diagonals, , .

In the second step, the matrix is calculated and its Eigen triples (, , and ) are determined by singular value decomposition (SVD). Denote the Eigen values of by in descending order and let and be the th left and right Eigen vectors of , respectively. Set = rank(). Then, the trajectory matrix can be rewritten as

where is the th singular value of and () are the matrices of rank one.

2.1.2. Reconstruction

After decomposition, the time series is reconstructed via grouping and diagonal averaging. In grouping step, the indices are grouped into disjoint subsets corresponding to splitting the elementary matrices () into groups. Each group contains a set of indices as . Then, the resultant matrix is defined as , so

where the trajectory matrix is represented as a sum of resultant matrices. Next, the diagonal averaging transfers each matrix () into a time series.

Let be a () matrix with elements . Set , , and

where .

Diagonal averaging transfers the matrix to a series according to the following:

2.2. A Brief Introduction to AR Model

The principle of autoregressive (AR) model is to use the current interference and the limited past observations to predict the present value. Given a time series , the mathematical representation of the -order autoregressive model is as follows:

where is the undetermined coefficients of the model (also called autoregressive coefficient) and is a random disturbance whose mean value is zero but variance is not equal to zero.

If the lag operator is defined as , then . The -order autoregressive model can be presented as follows:

Only the reciprocal of all roots of lag operator’s polynomial is less than one (both fall within the unit circle); the AR () process is called covariance stationary process.

2.3. Introduction to SSA-AR Model

The application process of SSA-AR model for short-term power load forecasting is mainly divided into two steps: first, using the SSA method to decompose and reconstruct the original power load series and then using the AR model to forecast with the reconstructed sequences. The specific calculation procedure of SSA-AR model for short-term power load forecasting is shown in Figure 1.

Figure 1: The specific flow chart of the SSA-AR model.

3. Empirical Analysis

The hourly power load series of Mid-Atlantic region in the PJM electricity market from 18 June to 18 July 2013 containing 720 sample points is employed in the experimental data. The mentioned data versus time have been shown in Figure 2.

Figure 2: The hourly load curve of the Mid-Atlantic region from June 18 to July 18 in 2013.

3.1. Decomposing and Reconstructing the Original Power Load Series Based on SSA

As mentioned earlier, the window length is the only parameter in the decomposition stage. If the time series has a periodic component, the window length is taken proportional to that period to get better separability. Therefore,  h is assumed here, which corresponds to weekly variations of power load time series. This window length results in 168 Eigen triples. Then, the singular value decomposition (SVD) is applied to the time-delay matrix by MATLAB programming. Figure 3 illustrates the trend of the 168 singular point values.

Figure 3: Singular values curve (in descending order).

As shown in Figure 3, the convergence rate of the singular value is very fast. The first 30 singular values have a share of 99.6% of the power load series which can nearly be considered as the weekly trend. The singular values from the 30th one are basically close to zero, which comprise the random component of the original power load serials. Therefore, the original serials should be omitted when reconstructed. The first 30 singular values in descending order (taken to the base-10 logarithm) are listed in Table 1.

Table 1: The first 30 singular values in descending order (taken to the base-10 logarithm).

Order

Order

Order

1
16.31
11
12.06
21
11.13

2
14.15
12
11.87
22
11.07

3
14.15
13
11.87
23
11.07

4
13.39
14
11.73
24
10.80

5
13.03
15
11.67
25
10.76

6
12.49
16
11.48
26
10.68

7
12.23
17
11.43
27
10.61

8
12.16
18
11.36
28
10.61

9
12.11
19
11.26
29
10.60

10
12.08
20
11.13
30
10.60

The decomposition helps us to make the proper groups to extract the trend, the harmonic component, and random noise component. Based on the relevant mathematical theory about the singular value decomposition, there are three basic conclusions: the first Eigen triple almost represents the whole trend of the time series; every harmonic component with a different frequency produces two Eigen triples with close singular values; as a rule, a pure noise series produces a slowly decreasing sequence of singular values the explicit plateau in the Eigen value spectra is caused by two Eigen triples with close singular values. As shown in Table 1, it is obvious that the Eigen triples of , , , , and produce the main harmonics of power load series.

Based on the above analysis, this paper tries to reconstruct the power load series using the first 30 Eigen values. Figure 4 shows the gap between the original power load series (OS). Just as shown in Figure 4, the reconstruction has been done with a satisfactory error.

Figure 4: The gap between the reconstructed power load series (RS) and the original power load series.

Figure 4 reflects that the reconstructed power load series fit well with the original series, of which the correlation coefficient reaches 0.9988. Therefore, the decomposition and reconstruction of the original power load series not only greatly reduce the matrix dimension, but also extract the main ingredient of the original series. So, we can describe its dynamic change trend in a better way and also get a better predicting outcome.

3.2. Forecasting the Reconstructed Power Load Series Based on AR Model

Because the AR model is only applicable to the stationary time series, the first thing that needs to be done is to examine the stationarity of the reconstructed power load series with the ADF unit root test. By employing the software Eviews 6.0, we can get the value equal to , which means that the null hypothesis should not be rejected. That is to say, the reconstructed power load series is a nonstationary time series. Then, consider the stationarity of its first order difference series, and the calculation result is listed in Table 2. It can be seen that the first order difference series is stationary.

Table 2: The result of ADF test on first order difference power load series.

Item
ADF statistics
Prob.

Original series
−2.77525
0.0623

First order difference
−3.72147
0.0040

Observe the autocorrelation coefficient and partial correlation coefficient of the first order difference sequence which are shown in Figure 5; we can see the autocorrelation coefficient gradually decreases with fluctuation and the partial correlation coefficient tends to zero after the third order. Therefore, the AR model can be established, which is shown as follows:

Then, estimate (8) with the ordinary least squares (OLS) method, and the regression result is listed in Table 3.

Table 3: The regression result of AR () model of reconstructed power load series.

Variable
Coefficient
Std. error
-statistic
Prob.

AR ()
2.067776
0.035534
58.19094
0.0000

AR ()
−1.396917
0.066505
−21.00462
0.0000

AR ()
0.263791
0.035598
7.410290
0.0000

Parament
Value

Adjusted -squared
0.986002

Schwarz criterion
13.56932

Durbin-Watson stat
1.967281

Figure 5: The autocorrelation and partial correlation of the reconstructed series.

From Figure 6, we can see that the reciprocals of two roots of lag operator’s polynomial of AR both fall within the unit circle, which indicates that this process is covariance stationary.

Figure 6: Unit circle test of the covariance stationarity.

Then, expand the sample size to 745 from 744, and use the AR model to forecast its value. By calculation, the 745th first-order differential value equals −3620.273. Therefore, the 745th point value can be forecasted, which equals 42867.027. In the same way, the following value at any point of a certain period can also be forecasted.

3.3. Comparing the Forecasting Results of Different Models

The AR model, SSA-LRF model, and BPNN model are selected as the comparative models. The AR model is applied to the original power load series without any treatment that can extract the main trend. Although AR model can well represent the whole tendency of the original series, the predicted value is not perfect in a way. The SSA-LRF model is the combination of SSA method and linear recurrent formula (LRF), in which LRF is a simple linear combination of the known data and its coefficients are determined by SSA method. BPNN (backpropagation neural network) is made of neuron. Not only are sufficient neurons connected to net properly, but the BPNN model should be trained appropriately before it can simulate all types of nonlinear characteristics. BPNN model is applied most widespread among all artificial neural network models, which has been widely applied to many fields related to forecasting. The predicted hourly power load results in 24 hours of Mid-Atlantic region in PJM market on July 19 by employing the above four forecasting methods are depicted in Figure 7.

Figure 7: The comparison of prediction results of different models and the actual value.

In order to measure the performance of the three forecasting methods, two indices, that is, hourly mean error (HME) and the hourly peak error (HPE), have been employed in this paper. The HME and HPE are the well-known statistical indices for evaluating prediction methods defined as follows:

where and are the actual and predicted power load of hour , respectively.

The calculation results of absolute error rate, HME, and HPE are shown in Figure 8. It can be seen that the value of SSA-AR model in terms of HME and HPE is 0.58 and 2.57, respectively, and the absolute error rate of SSA-AR model is the smallest compared with the other three models. These indicate that the SSA-AR model shows better performance than SSA-LRF, AR, and BPNN model in terms of short-term power load forecasting.

(a)

(b)

Figure 8: The forecasting error comparison of four methods: (a) absolute error rate; (b) HME and HPE.

4. Conclusions

In this paper, a hybrid short-term power load forecasting model based on the singular spectrum analysis (SSA) and autoregressive (AR) model is proposed. As we all know, the short-term power load forecasting is vital in the fundamental operational functions of electricity market, such as unit commitment, economic dispatch, interchange evaluation, scheduled maintenance, and security assessment. In this paper, the SSA-AR model has been employed as a tool for short-term power load forecasting. Firstly, the power load series is analyzed with the SSA method to obtain the effective and predictable components of power load series. Then, the AR method is used to forecast the future values of the power load series. The hybrid SSA-AR power load forecasting method is examined by using the experimental data of Mid-Atlantic region in PJM electricity market. The obtained results show that the proposed method has a good ability in the prediction of the desired power load series. However, there is one point that needs emphasis: this method does not take the factors influencing the power load fluctuation into account. Once the outside situation, such as political, economic, and climate condition, has a sudden change, this method may not work. Therefore, this method is applicable to the short-term power load forecasting without the tremendous changes of outside situation.

Conflict of Interests

The authors declare that they have no conflict of interests.

Acknowledgment

This study is supported by the Beijing Philosophy and Social Science Planning Project (no. 11JGB070).

References

H. A. Amarawickrama and L. C. Hunt, “Electricity demand for Sri Lanka: a time series analysis,” Energy, vol. 33, no. 5, pp. 724–739, 2008.

S. S. Pappas, L. Ekonomou, D. C. Karamousantas, G. E. Chatzarakis, S. K. Katsikas, and P. Liatsis, “Electricity demand loads modeling using AutoRegressive Moving Average (ARMA) models,” Energy, vol. 33, no. 9, pp. 1353–1360, 2008.

D.-X. Niu, H.-F. Shi, and D. D. Wu, “Short-term load forecasting using bayesian neural networks learned by Hybrid Monte Carlo algorithm,” Applied Soft Computing Journal, vol. 12, no. 6, pp. 1822–1827, 2012.

D.-M. Zhou, X.-H. Guan, J. Sun, and Y. Huang, “A short-term load forecasting system based on BP artificial neural network,” Power System Technology, vol. 26, pp. 10–14, 2002.

G.-D. Li, C.-H. Wang, S. Masuda, and M. Nagai, “A research on short term load forecasting problem applying improved grey dynamic model,” International Journal of Electrical Power & Energy Systems, vol. 33, no. 4, pp. 809–816, 2011.

D.-M. Shi, L.-C. Li, and J.-W. Song, “Power system load forecasting based upon combination of gray forecast and artificial neural network,” Power System Technology, vol. 25, pp. 13–16, 2001.

G. Jie, “Application of wavelet analysis to short-term load forecasting of power system,” Proceedings of the EPSA, vol. 15, pp. 40–45, 2003.

H. M. Al-Hamadi and S. A. Soliman, “Long-term/mid-term electric load forecasting based on short-term correlation and annual growth,” Electric Power Systems Research, vol. 74, no. 3, pp. 353–361, 2005.

P. Peng and J.-H. Peng, “Research on the prediction of power load based on multiple linear regression model,” Journal of Safety Science and Technology, vol. 7, pp. 158–161, 2011.

H.-Z. Li, S. Guo, C.-J. Li, and J.-Q. Sun, “A hybrid annual power load forecasting model based on generalized regression neural network with fruit fly optimization algorithm,” Knowledge-Based Systems, vol. 37, pp. 378–387, 2013.

H. Li, S. Guo, H. Zhao, C. Su, and B. Wang, “Annual electric load forecasting by a least squares support vector machine with a fruit fly optimization algorithm,” Energies, vol. 5, no. 11, pp. 4430–4445, 2012.

H. Hassani, S. Heravi, and A. Zhigljavsky, “Forecasting UK industrial production with multivariate singular spectrum analysis,” Journal of Forecasting, vol. 32, no. 5, pp. 395–408, 2013.

M. Rui, C. Yushu, and S. Huagang, “Detection of weak signals based on empirical mode decomposition and singular spectrum analysis,” IET Signal Processing, vol. 7, no. 4, pp. 269–276, 2013.

A. Miranian, M. Abdollahzade, and H. Hassani, “Day-ahead electricity price analysis and forecasting by singular spectrum analysis,” IET Generation Transmission & Distribution, vol. 7, no. 4, pp. 337–346, 2013.

S. Sanei, M. Ghodsi, and H. Hassani, “An adaptive singular spectrum analysis approach to murmur detection from heart sounds,” Medical Engineering & Physics, vol. 33, no. 3, pp. 362–367, 2011.

L. Telesca, T. Matcharasvili, T. Chelidze, and N. Zhukova, “Relationship between seismicity and water level in the Enguri high dam area (Georgia) using the singular spectrum analysis,” Natural Hazards and Earth System Sciences, vol. 12, pp. 2479–2485, 2012.

H. Hassani, A. S. Soofi, and A. A. Zhigljavsky, “Predicting daily exchange rate with singular spectrum analysis,” Nonlinear Analysis: Real World Applications, vol. 11, no. 3, pp. 2023–2034, 2010.

K. Afshar and N. Bigdeli, “Data analysis and short term load forecasting in Iran electricity market using singular spectral analysis (SSA),” Energy, vol. 36, no. 5, pp. 2620–2627, 2011.

H. Briceño, C. M. Rocco, and E. Zio, “Singular spectrum analysis for forecasting of electric load demand,” Chemical Engineer Transactions, vol. 33, pp. 919–924, 2013.