Abstract and Applied Analysis

Volume 2012 (2012), Article ID 907286, 12 pages

doi:10.1155/2012/907286

Research Article

Complete Consistency of the Estimator of Nonparametric Regression Models Based on -Mixing Sequences

Xuejun Wang, Fengxi Xia, Meimei Ge, Shuhe Hu, and Wenzhi Yang

School of Mathematical Science, Anhui University, Hefei 230039, China

Received 26 August 2012; Accepted 24 October 2012

Academic Editor: Ciprian A. Tudor

Copyright © 2012 Xuejun Wang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

We study the complete consistency for estimator of nonparametric regression model based on -mixing sequences by using the classical Rosenthal-type inequality and the truncated method. As an application, the complete consistency for the nearest neighbor estimator is obtained.

1. Introduction

Consider the following fixed design nonparametric regression model:

where are known fixed design points from , where is a given compact set for some , is an unknown regression function defined on , and are random errors. Assume that for each , have the same distribution as . As an estimator of , the following weighted regression estimator will be considered:

where , are the weight function.

The above estimator was first proposed by Georgiev [1] and subsequently has been studied by many authors. For instance, when are assumed to be independent, consistency and asymptotic normality have been studied by Georgiev and Greblicki [2], Georgiev [3] and Müller [4] among others. Results for the case when are dependent have also been studied by various authors in recent years. Fan [5] extended the work of Georgiev [3] and Müller [4] in the estimation of the regression model to the case that forms an -mixingale sequence for some . Roussas [6] discussed strong consistency and quadratic mean consistency for under mixing conditions. Roussas et al. [7] established asymptotic normality of assuming that the errors are from a strictly stationary stochastic process and satisfying the strong mixing condition. Tran et al. [8] discussed again asymptotic normality of assuming that the errors form a linear time series, more precisely, a weakly stationary linear process based on a martingale difference sequence. Hu et al. [9] studied the asymptotic normality for double array sum of linear time series. Hu et al. [10] gave the mean consistency, complete consistency, and asymptotic normality of regression models with linear process errors. Liang and Jing [11] presented some asymptotic properties for estimates of nonparametric regression models based on negatively associated sequences, Yang et al. [12] generalized the results of Liang and Jing [11] for negatively associated sequences to the case of negatively orthant dependent sequences, and so forth. The main purpose of this section is to investigate the complete consistency for estimator of the nonparametric regression model based on -mixing random variables.

In the following, we will give the definition of sequence of -mixing random variables.

Let be a random variable sequence defined on a fixed probability space . Write . Given -algebras in , let

Define the -mixing coefficients by

Obviously, , and .

Definition 1.1. A sequence of random variables is said to be a -mixing sequence if there exists such that .

-mixing random variables were introduced by Bradley [13], and many applications have been found. Many authors have studied this concept providing interesting results and applications. See for example, Bradley [13] for the central limit theorem, Bryc and Smoleński [14], Peligrad [15], and Utev and Peligrad [16] for moment inequalities, Gan [17], Kuczmaszewska [18], Wu and Jiang [19], and Wang et al. [20] for almost sure convergence, Peligrad and Gut [21], Gan [17], Cai [22], Kuczmaszewska [23], Zhu [24], An and Yuan [25], Sung [26] and Wang et al. [27] for complete convergence, and Peligrad [15] for invariance principle, Zhou et al. [28] and Sung [29] for strong law of large numbers, and so forth. When these are compared with the corresponding results of independent random variable sequences, there still remains much to be desired.

This work is organized as follows: main result of the paper is provided in Section 2. Some preliminary lemmas are presented in Section 3, and the proof of the main result is given in Section 4.

Throughout the paper, denotes a positive constant not depending on , which may be different in various places. represents for all . Let denote the integer part of and let be the indicator function of the set . Denote and .

2. Main Result

Unless otherwise specified, we assume throughout the paper that is defined by (1.2). For any function , we use to denote all continuity points of the function on . The norm is the Euclidean norm. For any fixed design point , the following assumptions on weight function will be used:

) as ;() for all ;() as for all .

Based on the assumptions above, we can get the following complete consistency of the nonparametric regression estimator .

Theorem 2.1. Let be a sequence of -mixing random variables with mean zero, which is stochastically dominated by a random variable . Assume that conditions – hold true. If there exists some such that and

then

As an application of Theorem 2.1, we give the complete consistency for the nearest neighbor estimator of . Without loss of generality, put , taking , . For any , we rewrite as follows:

if , then is permuted before when .

Let , the nearest neighbor weight function estimator of in model (1.1) is defined as follows:

where

Based on the notations above, we can get the following result by using Theorem 2.1.

Corollary 2.2. Let be a sequence of -mixing random variables with mean zero, which is stochastically dominated by a random variable . Suppose that is continuous on the compact set . If there exists some such that and , then

3. Preliminaries

In this section, we will present some important lemmas which will be used to prove the main results of the paper. The first one is the Rosenthal-type inequality, which was proved by Utev and Peligrad [16].

Lemma 3.1. Let be a -mixing sequence of random variables, , for some and for every . Then there exists a positive constant C depending only on such that

The concept of stochastic domination will be used in this work.

Definition 3.2. A sequence of random variables is said to be stochastically dominated by a random variable if there exists a positive constant such that

for all and .

Lemma 3.3. Let be a sequence of random variables which is stochastically dominated by a random variable . For any and , the following two statements hold:

where and are positive constants.

4. Proofs of the Main Results

Proof of Theorem 2.1. For and , we have by (1.1) and (1.2) that

Since , hence for any , there exists a such that when . Thus, by setting in (4.1), we can get that

By conditions ()–() and the arbitrariness of , we can get that

For fixed design point , note that , so without loss of generality, we assume that in what follows.

From the condition (2.1), we assume that

By (4.3), we can see that in order to prove (2.2), we only need to show that

That is to say, it suffices to show that for all ,

For fixed , denote

It is easy to check that for any ,

which implies that

Hence, to prove (4.6), it suffices to show that and .

By condition () and , we can get that

which implies that .

Next, we will prove that . Firstly, we will show that

Actually, by the conditions , Lemma 3.3, (4.4) and , we can see that

which implies (4.11). Hence, to prove , we only need to show that for all ,

By Markov’s inequality, Lemma 3.1, ’s inequality, and Jensen’s inequality, we have for that

Take

which implies that and . By ’s inequality and Lemma 3.3, we can get

If , then we have by Markov’s inequality, and (4.4) that

If , then we have by Markov’s inequality, and (4.4) again that

From (4.14)–(4.18), we have proved that .

By ’s inequality and Lemma 3.3, we can see that

has been proved by (4.10). In the following, we will show that . Denote

It is easily seen that for and for all . Hence,

It is easily seen that for all ,

which implies that for all ,

Therefore,

Thus, the inequality (4.13) follows from (4.14)–(4.19), (4.21), and (4.24). This completes the proof of the theorem.

Proof of Corollary 2.2. It suffices to show that the conditions of Theorem 2.1 are satisfied. Since is continuous on the compact set , hence, is uniformly continuous on the compact set , which implies that is bounded on set .

For any , if follows from the definition of and that

Hence, conditions ()–() and (2.1) are satisfied. By Theorem 2.1, we can get (2.6) immediately. This completes the proof of the corollary.

Acknowledgments

This paper is supported by the National Natural Science Foundation of China (11201001, 11171001, and 11126176), Natural Science Foundation of Anhui Province (1208085QA03), Doctoral Research Start-up Funds Projects of Anhui University, Academic Innovation Team of Anhui University (KJTD001B), University Students Science Research Training Program of Anhui University (KYXL2012007), and Students’ Innovative Training Project of Anhui University (cxcy2012003). The authors are most grateful to the editor Ciprian A. Tudor and anonymous referee for careful reading of the paper and valuable suggestions which helped in significantly improving an earlier version of this paper.

References

A. A. Georgiev, “Local properties of function fitting estimates with application to system identification,” in Proceedings of the 4th Pannonian Symposium on Mathematical Statistics, W. Grossmann, Ed., Mathematical Statistics and Applications, pp. 141–151, Bad Tatzmannsdorf, Dordrecht, The Netherlands, 1983.

A. A. Georgiev and W. Greblicki, “Nonparametric function recovering from noisy observations,” Journal of Statistical Planning and Inference, vol. 13, no. 1, pp. 1–14, 1986.

A. A. Georgiev, “Consistent nonparametric multiple regression: the fixed design case,” Journal of Multivariate Analysis, vol. 25, no. 1, pp. 100–110, 1988.

H.-G. Müller, “Weak and universal consistency of moving weighted averages,” Periodica Mathematica Hungarica, vol. 18, no. 3, pp. 241–250, 1987.

Y. Fan, “Consistent nonparametric multiple regression for dependent heterogeneous processes: the fixed design case,” Journal of Multivariate Analysis, vol. 33, no. 1, pp. 72–88, 1990.

G. G. Roussas, “Consistent regression estimation with fixed design points under dependence conditions,” Statistics & Probability Letters, vol. 8, no. 1, pp. 41–50, 1989.

G. G. Roussas, L. T. Tran, and D. A. Ioannides, “Fixed design regression for time series: asymptotic normality,” Journal of Multivariate Analysis, vol. 40, no. 2, pp. 262–291, 1992.

L. Tran, G. Roussas, S. Yakowitz, and B. Truong Van, “Fixed-design regression for linear time series,” The Annals of Statistics, vol. 24, no. 3, pp. 975–991, 1996.

S. H. Hu, C. H. Zhu, Y. B. Chen, and L. C. Wang, “Fixed-design regression for linear time series,” Acta Mathematica Scientia, vol. 22, no. 1, pp. 9–18, 2002.

S. H. Hu, G. M. Pan, and Q. B. Gao, “Estimation problems for a regression model with linear process errors,” Applied Mathematics, vol. 18, no. 1, pp. 81–90, 2003.

H.-Y. Liang and B.-Y. Jing, “Asymptotic properties for estimates of nonparametric regression models based on negatively associated sequences,” Journal of Multivariate Analysis, vol. 95, no. 2, pp. 227–245, 2005.

W. Z. Yang, X. J. Wang, X. H. Wang, and S. H. Hu, “The consistency for estimator of nonparametricregression model based on NOD errors,” Journal of Inequalities and Applications, vol. 2012, 140, 2012.

R. C. Bradley, “On the spectral density and asymptotic normality of weakly dependent random fields,” Journal of Theoretical Probability, vol. 5, no. 2, pp. 355–373, 1992.

W. Bryc and W. Smoleński, “Moment conditions for almost sure convergence of weakly correlated random variables,” Proceedings of the American Mathematical Society, vol. 119, no. 2, pp. 629–635, 1993.

M. Peligrad, “Maximum of partial sums and an invariance principle for a class of weak dependent random variables,” Proceedings of the American Mathematical Society, vol. 126, no. 4, pp. 1181–1189, 1998.

S. Utev and M. Peligrad, “Maximal inequalities and an invariance principle for a class of weakly dependent random variables,” Journal of Theoretical Probability, vol. 16, no. 1, pp. 101–115, 2003.

S. X. Gan, “Almost sure convergence for -mixing random variable sequences,” Statistics & Probability Letters, vol. 67, no. 4, pp. 289–298, 2004.

A. Kuczmaszewska, “On Chung-Teicher type strong law of large numbers for -mixing random variables,” Discrete Dynamics in Nature and Society, vol. 2008, Article ID 140548, 10 pages, 2008.

Q. Y. Wu and Y. Y. Jiang, “Some strong limit theorems for -mixing sequences of random variables,” Statistics & Probability Letters, vol. 78, no. 8, pp. 1017–1023, 2008.

X. J. Wang, S. H. Hu, Y. Shen, and N. X. Ling, “Strong law of large numbers and growth rate for a class of random variable sequence,” Statistics & Probability Letters, vol. 78, no. 18, pp. 3330–3337, 2008.

M. Peligrad and A. Gut, “Almost-sure results for a class of dependent random variables,” Journal of Theoretical Probability, vol. 12, no. 1, pp. 87–104, 1999.

G.-H. Cai, “Strong law of large numbers for -mixing sequences with different distributions,” Discrete Dynamics in Nature and Society, vol. 2006, Article ID 27648, 7 pages, 2006.

A. Kuczmaszewska, “On complete convergence for arrays of rowwise dependent random variables,” Statistics & Probability Letters, vol. 77, no. 11, pp. 1050–1060, 2007.

M.-H. Zhu, “Strong laws of large numbers for arrays of rowwise -mixing random variables,” Discrete Dynamics in Nature and Society, vol. 2007, Article ID 74296, 6 pages, 2007.

J. An and D. M. Yuan, “Complete convergence of weighted sums for -mixing sequence of random variables,” Statistics & Probability Letters, vol. 78, no. 12, pp. 1466–1472, 2008.

S. H. Sung, “Complete convergence for weighted sums of -mixing random variables,” Discrete Dynamics in Nature and Society, vol. 2010, Article ID 630608, 13 pages, 2010.

X. J. Wang, X. Q. Li, W. Z. Yang, and S. H. Hu, “On complete convergence for arrays of rowwiseweakly dependent random variables,” Applied Mathematics Letters, vol. 25, no. 11, pp. 1916–1920, 2012.

X. C. Zhou, C. C. Tan, and J. G. Lin, “On the strong laws for weighted sums of -mixing random variables,” Journal of Inequalities and Applications, vol. 2011, Article ID 157816, 8 pages, 2011.

S. H. Sung, “On the strong convergence for weighted sums of -mixing random variables,” Statistical Papers. In press