Robust variance estimators for generalized regression estimators in cluster samples
Section 4. Conclusion
Leverage adjustments to standard variance estimators
have been shown to reduce bias and improve confidence interval coverage based
on general regression estimators in single-stage samples. This paper extends
those results to two-stage samples by presenting new adjustments based on hat
matrices. Our theory provides the justification for the adjustments and
illustrates that some of the proposed estimators are related to the
delete-a-cluster jackknife that is a common procedure in survey estimation.
To test the theory, we conducted a series of simulation
studies on three populations designed to assess performance in a variety of
situations. In a school population a large sampling fraction of first-stage
units was used. In a second population, based on American Community Survey
data, the effects of small sample sizes were tested. In a third simulated
population, we examined large sample performance. Both simple random sampling
and probability proportional to size sampling of clusters were used.
The relationships of the variance estimators were
similar across all sample designs. The with-replacement variance estimator, which is the default
choice in survey software packages, the jackknife linearization estimator, and the design-based
variance estimator, that assumes Poisson
sampling at each stage as a computational convenience, are often negatively
biased leading to confidence intervals that cover at less than the desired
rate. Some of the jackknife-related estimators – and –which explicitly or implicitly include
hat-matrix adjustments, are prone to producing large, outlying values when the
first-stage sample is small. This is especially true when the first-stage is
selected by srs but is less so in pps sampling when an efficient
measure of size is used.
The variance estimators proposed here, particularly provide alternatives
to estimating the variance of GREG estimators in complex samples. At the
expense of somewhat inflating the variability of the variance estimator, the
hat-matrix adjusted sandwich estimators, denoted here by and give confidence
interval coverage that is closer to the nominal value in small to moderate
samples. Depending on the sample design and population characteristics,
hat-matrix adjusted estimators can produce less biased variance estimates and
better inferences when compared to the standard methods.
Acknowledgements
The authors thank the associate editor and two referees
whose comments substantially improved the presentation.
Appendix
Theoretical results
A.1 Assumptions
The assumptions used to obtain asymptotic results are
listed below. The number of population and sample clusters approach infinity;
however, the number of population clusters increases at a faster rate than the
number of sample clusters. Certain population quantities are assumed to be bounded.
A.1.1
as and
A.1.2
All and are bounded.
A.1.3
for all
A.1.4
All elements of
and are bounded.
A.1.5
The sample design is such that where is a positive definite matrix, i.e.,
Since elementwise and can be written as the
sum of terms and is bounded while By definition The second term in is consequently converges to a vector
of 1’s. Using along with assumptions A.1.3 and A.1.4, is elementwise.
A.2 Model variance of GREG
Let be the vector of all
sample elements in cluster and be the vector of all
elements in cluster The variance of the
GREG, with respect to the working model (2.1) is:
Since and elements in different clusters
are uncorrelated, we have,
Since and and are bounded, we have Because is bounded, and is the sum of terms. Since the are bounded, Thus, is the dominant term of the
prediction variance.
A.3 Proof that
In this section in order to simplify the notation, we
omit the subscript on and The residual can be
written in terms of a hat matrix as follows.
where is the identity matrix. The model variance of is then
As noted above, Thus,
To justify note that the second
term of (A.1) can be written as
The sum over the full cluster sample is
In the special case of and for some constant (i.e., the sample is
self-weighting), we have
along with and Using these simplifications, Substituting this result in (A.1)
and simplifying gives
This is the basis for the adjustment of to obtain
A.4 Proof that for cluster samples
In this section, we omit the subscript on and to simplify the
notation. The subscript denotes removal of the cluster from the full
sample matrix or vector. For example, is an estimate of based on all sample
clusters except cluster and is
where Using Lemma 9.5.1 in Valliant
et al. (2000), we have
Since and we have
That is,
A.5 Jackknife variance estimator of clustered GREG
in terms of leverages
We now simplify the delete-a-cluster Jackknife variance
estimator of the clustered GREG. As in Sections A.3 and A.4, we omit the subscript on various terms to
simplify the notation. The estimated total after removing the cluster is defined as
Adding and subtracting and doing a substantial amount of
simplification leads to
Taking the difference between the delete-one estimates and the average of
those estimates gives
Letting leads to the formula for in equation (2.12). Next, since and
Thus, and in (2.6) and (2.12) is asymptotically
equivalent to in (2.13).
Finally,
to justify in (2.14), we write in the
computational form
where Note that the model variance of is
Because and the sum in contains terms, the variance of is Next, scaling to be appropriate for a mean, the
first term in the brackets in (A.3) is Since the second term in brackets
has model expectation 0 and variance that is it converges in probability to 0,
and is asymptotically equivalent to
A.6 Asymptotic equivalence of variance estimators
In this appendix we sketch arguments for why several
variance estimators are asymptotically equivalent. Using design-based arguments,
Yung and Rao (1996, Appendix) showed that the jackknife linearization
estimator, , for the GREG is asymptotically equivalent to the
design-consistent estimator, in stratified
multistage designs with a large number of strata and a bounded number of sample
clusters selected from each stratum. Using regularity conditions in Rao and
Shao (1985), that result can be extended to cover designs in which either (i)
the number of strata is large and the number of clusters per stratum is bounded
or (ii) the number of strata is limited and the number of sample clusters per
stratum is large, as is the case in this article.
The
jackknife linearization estimator in Section 2 can be expanded as
The first term in (A.4) equals Because, under some reasonable assumptions, and are bounded, and by assumptions A.1.2 and A.1.3, the first term
in (A.4) is The second term is also but the model expectation of is zero as long as (2.1) holds. Since is a mean, its model-variance will approach 0
as Thus, the second term in (A.4) will converge
in probability to 0 and
In Section A.5
it was shown that and are asymptotically
equivalent. Under A.1.1-A.1.4, Consequently, and are approximately the
same as as Thus, by extension of Yung
and Rao (1996), both of which are design-consistent. Further, is asymptotically
equivalent to and As a result, the
alternative variance estimators considered here all have both model-based and
design-based justifications.
References
Kott, P.S. (1988).
Model-based finite population correction for the Horvitz-Thompson estimator. Biometrika,
75(4), 797-799.
Krewski, D., and Rao,
J.N.K. (1981). Inference from stratified samples: Properties of the
linearization, jackknife and balanced repeated replication methods. The
Annals of Statistics, 9(5), 1010-1019.
Li, J., and Valliant, R.
(2009). Survey weighted hat matrix and leverages. Survey Methodology, 35,
1, 15-24. Paper available at https://www150.statcan.gc.ca/n1/en/pub/12-001-x/2009001/article/10881-eng.pdf.
Long, J.S., and Ervin,
L.H. (2000). Using heteroscedasticity consistent standard errors in the linear
regression model. The American Statistician, 54(3), 217-224.
MacKinnon, J.G., and
White, H. (1985). Some heteroskedasticity consistent covariance matrix
estimators with improved finite sample properties. Journal of Econometrics,
29(3), 305-325.
Rao, J.N.K., and Shao, J.
(1985). Inference from stratified samples: Second-order analysis of three
methods for nonlinear statistics. Journal of the American Statistical
Association, 80(391), 620-630.
Royall, R.M., and
Cumberland, W.G. (1978). Variance estimation in finite population sampling. Journal
of the American Statistical Association, 73(362), 351-358.
Särndal, C.-E., Swensson,
B. and Wretman, J. (1989). The weighted residual technique for estimating the
variance of the general regression estimator of the finite population total.
Biometrika, 76(3), 527-537.
Särndal, C.-E., Swensson,
B. and Wretman, J. (1992). Model Assisted Survey Sampling. Springer
Series in Statistics. New York: Springer-Verlag.
Valliant, R. (2002).
Variance estimation for the general regression estimator. Survey Methodology,
28, 1, 103-114. Paper available at https://www150.statcan.gc.ca/n1/en/pub/12-001-x/2002001/article/6424-eng.pdf.
Valliant, R., Dorfman,
A.H. and Royall, R.M. (2000). Finite Population Sampling and Inference: A
Prediction Approach. Wiley Series in Probability and Statistics: Survey
Methodology Section. New York: John Wiley & Sons, Inc.
Yung, W., and Rao, J.N.K.
(1996). Jackknife linearization variance estimators under stratified
multi-stage sampling. Survey Methodology, 22, 1, 23-31. Paper available
at https://www150.statcan.gc.ca/n1/en/pub/12-001-x/1996001/article/14388-eng.pdf.