The Scientific World Journal

Volume 2014 (2014), Article ID 341617, 6 pages

http://dx.doi.org/10.1155/2014/341617

Research Article

Inference for One-Way ANOVA with Equicorrelation Error Structure

Weiyan Mu and Xiaojing Wang

School of Sciences, Beijing University of Civil Engineering and Architecture, Beijing 100081, China

Received 27 February 2014; Revised 1 June 2014; Accepted 9 June 2014; Published 19 June 2014

Academic Editor: Nadia Minicuci

Copyright © 2014 Weiyan Mu and Xiaojing Wang. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

We consider inferences in a one-way ANOVA model with equicorrelation error structures. Hypotheses of the equality of the means are discussed. A generalized -test has been proposed by in the literature to compare the means of all populations. However, they did not discuss the performance of that test. We propose two methods, a generalized pivotal quantities-based method and a parametric bootstrap method, to test the hypotheses of equality of the means. We compare the empirical performance of the proposed tests with the generalized -test. It can be seen from the simulation results that the generalized -test does not perform well in terms of Type I error rate, and the proposed tests perform much better. We also provide corresponding simultaneous confidence intervals for all pair-wise differences of the means, whose coverage probabilities are close to the confidence level.

1. Introduction

The generalized value approach and the generalized pivotal quantities introduced by Tsui and Weerahandi [1] and Weerahandi [2], respectively, have proven to be useful tools to study repeated measures models when the error variances are unequal. Inferences for many important linear models with unequal error variances have been discussed by these approaches (see Weerahandi [3] and references therein). For the problem of comparing the means of several populations with unequal variances, Weerahandi [4] introduced a generalized -test using the notion of generalized values. Since then the generalized -test has been widely used to test the equality of the means or the fixed effects of ANOVA models (Ananda and Weerahandi [5], Gamage and Weerahandi [6], Bao and Ananda [7], and Mu et al. [8]) and other repeated measures models under heteroscedasticity (Chi and Weerahandi [9], Weerahandi and Berger [10], Lin and Lee [11], Ho and Weerahandi [12], and Mu and Xu [13]).

The ANOVA models are basic but important among linear models. Extensive studies have been done on the ANOVA models with usual independent error structure, even under heteroscedasticity (see, for example, Krishnamoorthy et al. [14] and references therein). However, it is often seen that the error variance varies over time in practical work. Therefore, it is required to assume more complicated error structures for investigating such situations. Lin and Lee [11] considered an ANOVA model with equicorrelation error structure under heteroscedasticity which is described as follows. Suppose a random sample of size is available from the th population, . Let , be the random vectors of order representing the observations taken from the populations. We assume that the random vectors are all mutually independent and that we have a complete data set from all subjects in each group. Then, the model can be formulated as

where the error term with , and the random effects .

Lin and Lee [11] provided the generalized -test to test the equality of the means of the populations. However, this generalized -test was not evaluated by simulation in their article. Note that the generalized -test for the model with independent error structure has poor size performance when the group number is large (Krishnamoorthy et al. [14]). Based on the generalized pivotal quantities derived from a general method provided by Hannig et al. [15], we provide a new standardization-based value for testing the equality of the means. A parametric bootstrap test following Krishnamoorthy et al. [14] is also presented. Furthermore, simultaneous confidence intervals of all pair-wise difference of the means are often important in practical work. We also present such simultaneous confidence intervals. Simulation results are reported in this paper and show that the Type I errors of the generalized -test exceed the nominal level in many cases (similar to the case of independent error structure shown in Krishnamoorthy et a.l [14]), while the proposed tests and simultaneous confidence intervals have good frequentist properties under various sample size and parameter combinations.

The rest of the paper is organized as follows. Section 2 discusses testing the equality of the means of the populations. The generalized -test, the standardization-based value test, and the parametric bootstrap test for the hypotheses of the equality of the means are described in this section. Section 3 provides the simultaneous confidence intervals for all pair-wise differences of the means. Simulation results for the Type I error probabilities of these three tests and the coverage probabilities of the simultaneous confidence intervals are provided in Section 4. Section 5 shows an illustrative example and some concluding remarks are presented in Section 6.

2. Tests of the Means in One-Way ANOVA

In this section, we consider the problem of testing the equality of means:

Lin and Lee [11] gave the generalized -test to deal with this problem. In the following, we describe the generalized -test and two new tests.

2.1. The Generalized -Test

We now describe the generalized -test. From (1), with

and . Consequently, it can be obtained that the residual sum of squares

is distributed as

where , and . Write and then

Denote the standardized between-group sum of squares by

The observed value of is denoted by .

The potential extreme region for is

The observed sample point of falls on the boundary of this set. The generalized value can be expressed as

where is the cdf of the distribution with degrees of freedom and . The expectation is taken with respect to the independent beta random variables:

2.2. The Standardization-Based Value Test

In this subsection, we provide new values based on Mahalanobis norm to test the hypotheses (2). Denote . Note that the hypotheses (2) can be rewritten in the matrix form

where

is an matrix.

Denote . We have

Thus, it is easy to obtain that

For , define

where , and is an independent copy of . By the structural method provided by Hannig et al. [15] (see Theorem 2 of their article), we can get the following fiducial generalized pivotal quantities of and :

Denote the Mahalanobis norm of a vector with respect to a positive definite matrix by ; that is, . Thus, the fiducial generalized pivotal quantity of , the parameter of interest, is , where . Thus, a reasonable ellipsoidal confidence region of can be given by

where and represent the expectation and covariance with respect to , respectively, and is the upper th quantile of given the observation . By the relationship between confidence regions and hypotheses testing, the corresponding value for the hypotheses (11) is

It is easy to show that and

This method for deriving generalized values concerning vector parameters has been adopted in Xiong et al. [16].

2.3. The Parametric Bootstrap Test

Following Krishnamoorthy et al. [14], we present the parametric bootstrap test for (2). Denote . The test statistic is

We use the bootstrap method (Efron [17]) to approximate its null distribution. Generate the bootstrap sample and , for . The bootstrap version of is

Given the level , we reject if is greater than the conditional upper th quantile of conditional on the observations. The quantile can be computed by the Monte Carlo method.

3. Simultaneous Confidence Intervals for the Means

For the case of independent error structure, Xiong and Mu [18] discussed simultaneous confidence intervals for all-pairwise differences of the means based on generalized pivotal quantities. Following their method, we now present such intervals under the model (1). Bootstrap simultaneous confidence intervals are also provided.

Denote

where

Let be the conditional upper th quantile of . The distribution of the studentized maximum modulus statistic

can be approximated by the conditional distribution of conditional on the observations. Then we have the following two-sided simultaneous confidence intervals for all-pairwise differences:

The bootstrap method approximates the distribution of by the conditional distribution of , the bootstrap version of obtained by replacing and in with and , where and , for . Then, the bootstrap two-sided simultaneous confidence intervals are

where is the conditional upper th quantile of .

4. Simulation Studies

This section is devoted to evaluating the performances of the procedures described in this paper. We first consider comparing the generalized -tests (denoted by GF), the standardization-based value test (denoted by SP), and the parametric bootstrap test (denoted by PB). We will present the Type error rates of the three tests through the Monte Carlo simulation. For a given sample size and parameter configuration shown in Table 1, the repetition is 5000 times. The Monte Carlo sample size for computing the values is 5000. The nominal level is given as 0.05. We take the dimension of as 4 in our simulation.

Table 1: Type I error rates of the tests.

(a)

GF
SP
PB
GF
SP
PB
GF
SP
PB
GF
SP
PB

(1.0, 1.0, 1.0, 1.0, 1.0, 1.0)
0.078
0.037
0.041
0.067
0.043
0.049
0.055
0.042
0.050
0.062
0.047
0.058

(1.0, 1.0, 1.0, 1.5, 1.5, 1.5)
0.075
0.034
0.055
0.068
0.046
0.042
0.056
0.041
0.048
0.065
0.045
0.059

(1.0, 1.0, 1.5, 1.5, 2.0, 2.0)
0.068
0.034
0.052
0.066
0.042
0.038
0.063
0.046
0.045
0.063
0.043
0.048

(1.0, 1.5, 2.0, 2.5, 3.0, 3.5)
0.073
0.033
0.040
0.070
0.046
0.040
0.060
0.044
0.046
0.064
0.046
0.042

.

(b)

GF
SP
PB
GF
SP
PB
GF
SP
PB
GF
SP
PB

(1.0, 1.0, 1.0, 1.0, 1.0, 1.0)
0.078
0.037
0.043
0.067
0.043
0.049
0.055
0.042
0.051
0.062
0.047
0.057

(1.0, 1.0, 1.0, 1.5, 1.5, 1.5)
0.075
0.034
0.054
0.070
0.045
0.044
0.057
0.041
0.048
0.064
0.044
0.058

(1.0, 1.0, 1.5, 1.5, 2.0, 2.0)
0.069
0.033
0.052
0.068
0.044
0.040
0.064
0.047
0.047
0.063
0.041
0.047

(1.0, 1.5, 2.0, 2.5, 3.0, 3.5)
0.070
0.032
0.042
0.069
0.047
0.041
0.062
0.043
0.045
0.065
0.048
0.043

(c)

GF
SP
PB
GF
SP
PB
GF
SP
PB

(1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0)
0.085
0.042
0.053
0.080
0.045
0.056
0.071
0.047
0.056

(1.0, 1.0, 1.0, 1.0, 1.5, 1.5, 1.5, 1.5)
0.090
0.039
0.045
0.093
0.044
0.051
0.074
0.045
0.052

(1.0, 1.0, 1.5, 1.5, 2.0, 2.0, 2.5, 2.5)
0.087
0.037
0.042
0.084
0.039
0.047
0.072
0.041
0.046

(1.0, 1.5, 2.0, 2.5, 3.0, 3.5, 4.0, 4.5)
0.092
0.036
0.048
0.085
0.038
0.053
0.077
0.048
0.047

.

(d)

GF
SP
PB
GF
SP
PB
GF
SP
PB

(1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0)
0.094
0.045
0.057
0.096
0.045
0.053
0.076
0.044
0.051

(1.0, 1.0, 1.0, 1.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0)
0.102
0.042
0.051
0.098
0.047
0.052
0.089
0.045
0.053

(1.0, 1.0, 1.0, 1.5, 1.5, 1.5, 2.0, 2.0, 3.0, 3.0)
0.094
0.040
0.043
0.083
0.041
0.047
0.077
0.045
0.047

(0.5, 1.0, 1.5, 2.0, 2.5, 3.0, 3.5, 4.0, 4.5, 5.0)
0.095
0.041
0.048
0.087
0.039
0.051
0.087
0.048
0.048

; .

The simulated Type error rates of the two tests are reported in Table 1. The results are described as follows.

(i)From the results of the two cases, and , when , we can see that does not have significant influence on the Type errors of the two tests.(ii)The Type error rates of the GF test exceed the nominal level in most cases, especially for relatively large . In the worst case of , the Type error rate of the GF test is as large as 0.102.(iii)The SP test appears to be some conservative when the sample sizes are relatively small. As the sample sizes increase, its Type error rates become quite close to the nominal level.(iv)The Type error rates of the PB test sometimes exceed the nominal level but they are the closest among the three tests in most cases.

We have an overall conclusion that the proposed SP and PB tests perform significantly better than the GF test.

The simulated coverage probabilities of the proposed simultaneous confidence intervals (25) and (26) are shown in Table 2. It can be seen that the simulated coverage probabilities of such intervals are larger than and/or close to the confidence level under all sample size and parameter combinations.

Table 2: Coverage probabilities of the simultaneous confidence intervals.

GP
PB
GP
PB
GP
PB

(1.0, 1.0, 1.0, 1.0)
0.958
0.943
0.957
0.948
0.956
0.954

(1.0, 1.0, 2.0, 2.0)
0.967
0.951
0.959
0.956
0.949
0.950

(1.0, 2.0, 1.5, 1.5)
0.972
0.943
0.955
0.948
0.959
0.946

(0.5, 1.0, 1.5, 2.0)
0.973
0.947
0.960
0.953
0.956
0.948

(1.0, 1.0, 1.0, 1.0)
0.967
0.942
0.958
0.948
0.955
0.952

(1.0, 1.0, 2.0, 2.0)
0.959
0.945
0.962
0.949
0.946
0.947

(1.0, 2.0, 1.5, 1.5)
0.973
0.952
0.966
0.952
0.953
0.953

(0.5, 1.0, 1.5, 2.0)
0.964
0.945
0.971
0.950
0.956
0.948

5. An Illustrative Example

We will illustrate our methods using an example. The data in this example are generated assuming model (1) with , and . We will compare the performances of the generalized -test and the proposed tests with respect to Type I error in the one-way ANOVA model with unequal error variances. The problem of comparing seven means is considered. The mean of each distribution is taken to be 1 so that the null hypotheses are all true. Table 3 shows the results of a simulated experiment in which data are generated from normal distributions with means 1 and the values of , and . The treatment means and residual sum of squares corresponding to each value of are also provided.

Table 3: Summary statistics in Section 5.

Treatments

A
5
1.0
5.60
1.806
12.835

B
5
1.5
7.60
2.053
40.928

C
5
2.0
10.40
0.179
10.731

D
5
2.5
14.00
1.492
32.809

E
10
3.0
18.40
0.369
111.134

F
10
3.5
23.60
1.995
430.336

G
10
4.0
29.60
−1.163
290.230

H
10
4.5
36.40
0.743
653.191

Seven treatments out of eight in Table 4 are compared at a time. The values of the generalized -test, the standardization-based test, and the parametric bootstrap test are denoted by , , and , respectively. We compute them using 500,000 Monte Carlo samples. The results are shown in Table 4. It is noted from the table that the generalized -test tends to reject the null hypothesis. Even in comparing the means , , , , , , and , the generalized -test suggests that we have strong evidence to reject the null hypothesis although the data are generated with the hypothesis being true. Nevertheless, ’s and are all larger than 0.05, which indicates that we cannot reject any null hypothesis. Thus, compared with the generalized -test, the proposed tests in this paper provide more credible conclusions in detecting the significance of mean differences.

Table 4: values in Section 5.

Treatments compared

A, B, C, D, E, F, and G
0.021
0.091
0.075

A, B, C, D, E, F, and H
0.111
0.234
0.186

A, B, C, D, E, H, and G
0.032
0.109
0.134

A, B, C, D, F, G, and H
0.036
0.105
0.115

A, B, C, E, F, G, and H
0.039
0.101
0.089

A, B, D, E, F, G, and H
0.159
0.151
0.152

A, C, D, E, F, G, and H
0.061
0.124
0.073

B, C, D, E, F, G, and H
0.106
0.212
0.182

6. Concluding Remarks

This paper discusses a one-way ANOVA model with equicorrelation error structures. Hypotheses testing of the equality of the means and simultaneous confidence intervals for all pair-wise differences of the means are discussed. Numerical evidences indicate that the proposed tests perform much better than the generalized -test provided by Lin and Lee [11], and the proposed simultaneous confidence intervals have good frequentist properties.

Although the generalized inference approach does not rely on any approximation, it often possesses frequentist properties only in the asymptotic sense (Hannig et al. [15], Xiong and Mu [19], and Xiong [20]). Krishnamoorthy et al. [14] and this paper show that the generalized -test has no satisfactory performances in some cases. It may be a valuable issue to construct better tests for linear models with complicatedly dependent structures in the future.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

The authors thank the referee for constructive comments and suggestions which led to significant improvements of this paper. This work was supported by Funding Project for Talents of Beijing Municipal Party Committee Organization Department (Grant no. 2013D005017000016) and Science and Technology Plan Project of Beijing Municipal Education Commission (Grant no. KM201410016003).

References

K. W. Tsui and S. Weerahandi, “Generalized p-values in significance testing of hypotheses in the presence of nuisance parameters,” Journal of the American Statistical Association, vol. 84, no. 406, pp. 602–607, 1989.

S. Weerahandi, “Generalized confidence intervals,” Journal of the American Statistical Association, vol. 88, no. 423, pp. 899–905, 1993.

S. Weerahandi, Generalized Inference in Repeated Measures, Springer, New York, NY, USA, 2004.

S. Weerahandi, “ANOVA under unequal error variances,” Biometrics, vol. 51, no. 2, pp. 589–599, 1995.

M. M. A. Ananda and S. Weerahandi, “Two-way ANOVA with unequal cell frequencies and unequal variances,” Statistica Sinica, vol. 7, no. 3, pp. 631–646, 1997.

J. Gamage and S. Weerahandi, “Size performance of some tests in one-way ANOVA,” Communications in Statistics B: Simulation and Computation, vol. 27, no. 3, pp. 625–640, 1998.

P. Bao and M. M. A. Ananda, “Performance of two-way anova procedures when cell frequencies and variances are unequal,” Communications in Statistics B: Simulation and Computation, vol. 30, no. 4, pp. 805–829, 2001.

W. Mu, S. Xiong, and X. Xu, “Generalized confidence regions of fixed effects in the two-way ANOVA,” Journal of Systems Science and Complexity, vol. 21, no. 2, pp. 276–282, 2008.

E. M. Chi and S. Weerahandi, “Comparing treatments under growth curve models: exact tests using generalized p-values,” Journal of Statistical Planning and Inference, vol. 71, no. 1-2, pp. 179–189, 1998.

S. Weerahandi and V. W. Berger, “Exact inference for growth curves with intraclass correlation structure,” Biometrics, vol. 55, no. 3, pp. 921–924, 1999.

S. Lin and J. Lee, “Exact tests in simple growth curve models and one-way ANOVA with equicorrelation error structure,” Journal of Multivariate Analysis, vol. 84, no. 2, pp. 351–368, 2003.

Y.-Y. Ho and S. Weerahandi, “Analysis of repeated measures under unequal variances,” Journal of Multivariate Analysis, vol. 98, no. 3, pp. 493–504, 2007.

W. Mu and X. Xu, “Inference for repeated measures models under heteroscedasticity,” Journal of Systems Science and Complexity, vol. 25, no. 6, pp. 1158–1170, 2012.

K. Krishnamoorthy, F. Lu, and T. Mathew, “A parametric bootstrap approach for ANOVA with unequal variances: fixed and random models,” Computational Statistics & Data Analysis, vol. 51, no. 12, pp. 5731–5742, 2007.

J. Hannig, H. Iyer, and P. Patterson, “Fiducial generalized confidence intervals,” Journal of the American Statistical Association, vol. 101, no. 473, pp. 254–269, 2006.

S. Xiong, W. Mu, and X. Xu, “Generalized inference for a class of linear models under heteroscedasticity,” Communications in Statistics: Theory and Methods, vol. 37, no. 8, pp. 1225–1236, 2008.

B. Efron, “Bootstrap methods: another look at the jackknife,” The Annals of Statistics, vol. 7, no. 1, pp. 1–26, 1979.

S. Xiong and W. Mu, “Simultaneous confidence intervals for one-way layout based on generalized pivotal quantities,” Journal of Statistical Computation and Simulation, vol. 79, no. 10, pp. 1235–1244, 2009.

S. Xiong and W. Mu, “On construction of asymptotically correct confidence intervals,” Journal of Statistical Planning and Inference, vol. 139, no. 4, pp. 1394–1404, 2009.

S. Xiong, “An asymptotics look at the generalized inference,” Journal of Multivariate Analysis, vol. 102, no. 2, pp. 336–348, 2011.