Journal of Applied Mathematics

Volume 2013 (2013), Article ID 781856, 8 pages

http://dx.doi.org/10.1155/2013/781856

Research Article

Convergence Analysis of EFOP Estimate Based on Frequency Domain Smoothing

Yulai Zhang, Kueiming Lo, and Yang Su

School of Software, Tsinghua University, Tsinghua National Laboratory for Information Science and Technology, Beijing 100084, China

Received 8 March 2013; Revised 21 April 2013; Accepted 24 April 2013

Academic Editor: Graziano Chesi

Copyright © 2013 Yulai Zhang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

The classic methods for frequency domain transfer function estimation such as the Empirical Transfer Function Estimate (ETFE) and cross spectral method do not work well when the noise signal is complex. Combines the time domain and frequency domain methods the Empirical Frequency-domain Optimal Parameter (EFOP) Estimate was presented. It could improve the precision of system's transfer function estimation and identification efficiency. The convergence of the EFOP based on frequency domain smoothing is investigated in this paper. The transfer function is weighted by a frequency window and the GPE criterion is extended to the integral form. Convergence rate and consistent properties for the EFOP estimate are given. Finally, some simulation results are included to illustrate the advantage of the EFOP based smoothing method.

1. Introduction

Parametric and nonparametric estimations in system identification or signal processing are both of great importance. Most of these algorithms use input and output data to give a modeling of the target system. The modeling of linear system transfer function is a non-parameter method, and it is one of the most important basic problems in control theory. From the beginning of modern system identification and signal processing, many nonparametric methods in frequency domain have been proposed, such as ETFE [1], power spectrum estimation [2], and so on. Frequency domain window functions [3, 4] are used in power spectrum estimation. In the past few decades, algorithms for window function selection are developed, such as adaptive smoothing method in [5] and least square estimation for frequency function in [6]. Discussion of the relationship between time domain methods and frequency domain methods can be found in [7]. EFOP [8, 9] is an algorithm combines the time domain and frequency domain. A new criterion named General Prediction Error (GPE) is proposed and implemented in EFOP. This algorithm obtains the global optimal transfer function in frequency domain by minimizing the GPE criterion. The advantage of this kind of algorithm includes a faster rate of convergence as well as better identification qualities. The algorithms given in [8, 9] are parametric in time domain, so they cannot be directly used in the identification of transfer function in frequency domain. Since frequency domain methods have their own advantages such as robustness for outliers in data [10], it is necessary to develop frequency domain methods.

In this article we analysis the convergence of transfer function estimation based on EFOP and frequency domain window function smoothing technic. Firstly, the identification of transfer function is derived with GPE criterion in EFOP; secondly, the spectrum analysis is used to calculated the predict error and a window function to smoothing the transfer function in frequency domain. The consistence and convergence properties of this procedure are analyzed in this paper. It is proofed that this new smoothing method is asymptotically unbiased and the rate of convergence is fast. Simulations in the end show that the method proposed in this paper gives better results than the ETFE on identification accuracy under large noises.

For the rest of this article, preliminaries including EFOP and GPE are introduced in Section 2; the frequency domain smoothing procedure is derived in Section 3; its rate of convergence and estimator’s bias properties are analyzed in Section 4; simulation results are given in Section 5 and Section 6 is the conclusions.

The contributions of this article include the following.

(i)Extending the GPE criterion in EFOP to its integral form. (ii)Development of EFOP smoothing method for transfer function estimation.(iii)The rate of convergence for this new method is proved.

2. Preliminaries

Most input and output signals for system identification procedures are sampled from application systems in industry or laboratory. Denote as a data sequence, where is the total number of samples that is, the length of the data sequence. The Discrete Fourier Transformation (DFT) of is

where . The Inverse Discrete Fourier Transformation (IDFT) can also be denoted as:

Provided that and are signal sequence with same length, the convolution of then can be written as

Lemma 1 (Parse Val equation). Provided that , that is, and are DFT pairs. One can obtain

Lemma 2. For periodic signal , , , we can obtain:

where , .

Lemma 3. Provided that , is a constant, is stochastic i.d.d white noise and . Let , reaches its minimum value when the coefficient satisfies .

This lemma can be simply obtained by using Lagrange method.

Denote as an input data sequence, and as an output one. A black box linear model can be expressed as

where , , , and .

Rewrite this equation as

where , .

Denote as the predictor of output :

is the parameter of the black box model here, and is the predict error, which can also be written as

The predict error vector can be presented as

Define a criterion function

The estimation of the model under this criterion can be presented as

First we denote that the transfer function obtained by ETFE is , and the error of this estimation is calculated as

Lemma 4. Provided that the variance of in (7) is and it is a white noise, thus one obtains

where .

Corollary 5. Under the assumption of Lemma 4, one can obtain the following equation:

where

This can be derived from Lemma 3. We substitute the constant in Lemma 3 by

in an off-line procedure, so can be taken as a constant.

Theorem 6. Consider

where which is the weight matrix, and

Signal is introduced by

The proof can be completed by using Corollary 5 and Lemma 1 in this section, and it is similar to the proof in [11].

More details of EFOP and GPE can be can be found in [11]. EFOP gets the estimator by minimizing , which is the GPE criterion [8]

where and is composed of regression vectors

and .

3. New Method Based on EFOP and Frequency Domain Smoothing

3.1. Representing Criterion in Frequency Domain

Rewrite in frequency domain as

where . Since the frequency domain transfer function is actually a continuous function, the integrity form can be presented as

3.2. Algorithm with Frequency Domain Window

Denote as the window function. Window function can be seen as a way to perform weighting in frequency domain. If the width of the window function is relatively large, the variance of will be small. But a wider frequency window will make the bias of larger. So there is a tradeoff between the variance and bias of the estimated transfer function. A scalar is introduced to adjust this tradeoff. A smaller represents a wider window function. Some of the s properties are written as follows:

Theorem 7. If , the systems transfer function can be estimated as

where is the frequency domain window function and is the estimated ETFE transfer function.

Proof. Rewrite as

and are the real and imaginary parts of , respectively.

Since , so we have

The new algorithm is obtained by Theorem 7. Figure 1 is the explanation of algorithm procedure. In Figure 1, and are the numerator and denominator of the final result, respectively.

Figure 1: Algorithm procedure.

Elementary operations such as add and division are not explicitly shown in the chart.

4. Consistency and Convergence Analysis

The theoretical analysis of consistency and convergence for the proposed method are investigated in this section. It is proved that the estimation result is asymptotically unbiased and will converge to the true system transfer function.

4.1. Consistency and Bias

From the expression of , we can obtain:

where is defined as

and . Given the Taylor expansion:

Note that the window function should satisfy the following equations:

We can obtain the numerator of as:

And the denominator of as:

For sake of convenience, we denote as and as . So the equation can be rewritten as:

From the above equation, we can easily get that when and :

Based on the property of the window function, we can obtain the following inequality:

When the first-order and second-order derivatives of the transfer function are bounded, the estimator is asymptotically unbiased.

4.2. Variance Analysis and Rate of Convergence

From the results of previous sections, we have:

The nominator of (39) can be written as

where . Rewrite it in the integral form

And the denominator part can be written approximately as . Notice , so we have the variance of the estimator

5. Simulations

In this section, we use the target system

is a white Pseudo-Random Binary Sequence (PRBS) [12] noise with unit variance . And is a gaussian white noise with variance .

We compared EFOP smoothing with ETFE smoothing and cross-spectral method. In all simulations, a Hamming window of length 2 is used for all methods:

And the estimation errors are calculated by the following equation:

where is the sample sequence of true transfer function with . And is the estimation result with same length.

In Figures 2 to 5 we compared three methods for frequency domain transfer function estimation. In each figure, the top picture shows the amplitudes of the true and estimated frequency domain transfer function and the bottom picture shows the phase of them. Figures 2 and 3 are comparison between EFOP smoothing and ETFE smoothing under noise variance of 0.5 and 1.5. The estimation error for EFOP smoothing and ETFE smoothing in Figure 2 are 10.21 and 23.35, respectively. And the estimation error for EFOP smoothing and ETFE smoothing in Figure 3 are 29.07 and 42.80, respectively. Figures 4 and 5 are comparison between EFOP smoothing and cross-spectral method under noise variance of 0.5 and 1.5. The estimation error for EFOP smoothing and cross-spectral method in Figure 4 are 11.29 and 13.95, respectively. And the estimation error for EFOP smoothing and Cross Spectral Method in Figure 5 is 17.60 and 20.30, respectively.

(a)

(b)

Figure 2: Results of EFOP smoothing and ETFE smoothing for system in (43) under . .

(a)

(b)

Figure 3: Results of EFOP smoothing and ETFE smoothing for system in (43) under . .

(a)

(b)

Figure 4: Results of EFOP smoothing and cross-spectral method for system in (43) under . .

(a)

(b)

Figure 5: Results of EFOP smoothing and cross-spectral method for system in (43) under .

In all simulations, the variance of input signals are 1. And all results are obtained by smoothing with a same hamming window of length 2. It can be seen from the results that EFOP method gives better estimation of the transfer function than ETFE and cross-spectral method. Figure 6 is obtained by numerical simulations. The error values in Figure 6 are also represented in Table 1. The estimation error increases with noise signal ratio and EFOP smoothing gets estimations of transfer function with lowest error values.

Table 1: Estimation error for 3 methods under different noise variances.

Noise variance
0.1
0.4
0.7
1.0
1.3
1.6
1.9

Estimate error of ETFE smoothing
23.34
25.62
27.14
32.86
38.27
41.31
66.48

Estimate error of cross-spectral method
12.23
13.43
16.83
17.32
21.56
25.87
29.89

Estimate error of EFOP smoothing
9.88
10.68
13.14
13.96
16.67
20.86
24.79

Figure 6: Estimate error of EFOP smoothing, ETFE smoothing, and cross-spectral method for system in (43) under from 0.1 to 1.9.

6. Conclusion

In this paper, the convergence of transfer function estimation based on integrity form of the GPE criterion with frequency domain window function is analyzed. This smoothing technic gives better results on transfer functions of linear models than traditional ETFE method, especially for systems disturbed by large noises. The consistent property and convergence rate of this method are obtained. Simulations for identification of frequency domain transfer functions are given to illustrate the advantage of this technic derived.

Acknowledgment

This work is supported by the Funds 863 Project 2012AA040906, NSFC61171121, NSFC60973049, and the Science Foundation of Chinese Ministry of Education—China Mobile 2012.

References

L. Ljung, System Identification, Wiley Online Library, 1999.

C. Bingham, M. Godfrey, and J. Tukey, “Modern techniques of power spectrum estimation,” IEEE Transactions on Audio and Electroacoustics, vol. 15, no. 2, pp. 56–66, 1967.

P. C. W. Sommen, P. J. van Gerwen, H. J. Kotmans, and A. J. E. M. Janssen, “Convergence analysis of a frequency-domain adaptive filter with exponential power averaging and generalized window function,” IEEE Transactions on Circuits and Systems, vol. 34, no. 7, pp. 788–798, 1987.

R. Pintelon and J. Schoukens, System Identification: A Frequency Domain Approach, Wiley-IEEE Press, 2004.

A. Stenman, F. Gustafsson, D. E. Rivera, L. Ljung, and T. McKelvey, “On adaptive smoothing of empirical transfer function estimates,” Control Engineering Practice, vol. 8, no. 11, pp. 1309–1315, 2000.

H. Hjalmarsson and B. Ninness, “Least-squares estimation of a class of frequency functions: a finite sample variance expression,” Automatica, vol. 42, no. 4, pp. 589–600, 2006.

J. C. Agüero, J. I. Yuz, G. C. Goodwin, and R. A. Delgado, “On the equivalence of time and frequency domain maximum likelihood estimation,” Automatica, vol. 46, no. 2, pp. 260–270, 2010.

K. Lo and W. H. Kwon, “A new identification approach for FIR models,” IEEE Transactions on Circuits and Systems II, vol. 49, no. 6, pp. 439–446, 2002.

K. Lo and H. Kimura, “Recursive estimation methods for discrete systems,” IEEE Transactions on Automatic Control, vol. 48, no. 11, pp. 2019–2023, 2003.

J. C. Agüero, W. Tang, J. I. Yuz, R. Delgado, and G. C. Goodwin, “Dual time-frequency domain system identification,” Automatica, vol. 48, no. 12, pp. 3031–3041, 2012.

K. Lo, H. Kimura, W. H. Kwon, and X. Yang, “Empirical frequency-domain optimal parameter estimate for black-box processes,” IEEE Transactions on Circuits and Systems I, vol. 53, no. 2, pp. 419–430, 2006.

H. J. Vermeulen, J. M. Strauss, and V. Shikoana, “Online estimation of synchronous generator parameters using PRBS perturbations,” IEEE Transactions on Power Systems, vol. 17, no. 3, pp. 694–700, 2002.