Bayesian spatial models for estimating means of sampled and non-sampled small areas
Section 6. Conclusions
In this paper, we followed a Bayesian approach to
investigate four spatial random-effects models as alternatives to the
independent Fay-Herriot model to estimate small area means. In particular, we
considered four spatial models with different autocorrelation structures. We
further extended the spatial models to allow multiple small areas without any
direct estimates in predicting small area means for all the areas. For a class
of noninformative priors, we established the propriety of posterior densities
of the proposed models for both setups.
A simulation study in Section 4 illustrates that
prediction accuracy can be greatly improved by considering spatial models when
effective covariates are unavailable. Datta, Hall and Mandal (2011) noted that the prediction
accuracy of small area estimation models largely depends on the availability of
good covariates. In other words, when suitable covariates are unavailable, the
independent Fay-Herriot model may not provide a significant advantage over
direct estimates. The simulation results indicated that, in such cases, the
spatial models considerably increase the prediction accuracy by exploiting
information from adjacent areas.
We applied the proposed spatial random-effects models to
estimate four-person family median incomes. Even when a good covariate exists,
the spatial models exhibited noticeable improvements in terms of mean squared
deviation and average posterior standard deviations. When a good covariate is
unavailable, spatial models provided significantly more accurate median income
predictions with much smaller variability, which agrees with the simulation
results. Furthermore, the SAR and LCAR models provide more precise small area
estimates when direct estimates of some states are excluded in model fitting.
In summary, the spatial models considered in this paper
outperform the independent Fay-Herriot model. A significant improvement can be
expected when effective covariates are unavailable. Since useful covariates are
not always available, the utility of the proposed models in small area
estimation can be substantial. Our simulation study and real data analysis
demonstrate no clear winner among the proposed models. Nonetheless, the SAR and
LCAR models show better performance compared with other spatial models. Also,
the LCAR model performs robustly well with simulated data from the SAR model
and real data with unknown spatial dependence. Thus, in the context of real
applications where true dependency is unknown, we recommend the LCAR model.
This work assumes
that all areas have at least one neighborhood. In real applications, however,
there are many situations that data contain small areas with no neighborhood
(stand-alone areas). Although the proposed models can accommodate stand-alone areas
by adjusting the diagonal entries of the precision matrices as in Brown, Datta
and Lazar (2017), we find that
this approach results in a counterintuitive prior, where stand-alone areas have
smaller prior random effect variances than areas with neighborhoods. Also, we
find that this prior can considerably deteriorate predictions of stand-alone
areas. This is a practically important problem as many countries have islands,
and this will possibly be our future research to pursue.
Disclaimer and acknowledgements
This report is released to inform interested parties of
ongoing research and to encourage discussion. The views expressed on
statistical, methodological, technical, or operational issues are those of the
authors and not those of the U.S. Census Bureau, or the University of Georgia.
The authors are grateful to Dr. William R. Bell for his
insightful comments on an earlier version of this work that led to an improved
manuscript.
Appendix
A. Proof of the propriety of the posterior pdf
Proof of Theorem 1. For
convenience of notation, we denote by and, for a given square matrix the determinant of is denoted by We use to denote a generic positive constant, not
depending on the variables we are integrating out.
Let be the number of small areas with no direct
estimates and let Also, let be the vector with direct estimates of the sampled
small areas. Without loss of generality, we assume that are arranged so that Let be the diagonal matrix with sampling variances
corresponding to the components of and
The joint pdf of and is given by
where is the normal pdf with mean and covariance matrix The posterior pdf will be proper if and only if the function is integrable with respect to and Since
we have from (A.1)
where By integrating both sides of (A.2) with
respect to we get
Partition as where is and is We assume that rank Let and
Then, we can write
where is is Hence, (A.3) can be written as
By integrating both sides of (A.4) with respect to we get
Since rank we immediately get that rank Thus has full column rank. We denote by For we now derive upper bounds for
which will be integrable with respect to and as follows.
A.1 Details for the SCAR Model
We first consider the CAR model where Let be an orthogonal matrix such that Then and hence,
where and Suppose the rows of corresponding to distinct indices are linearly independent. We denote these rows
by Let be the non-singular matrix and Note that
From this, we get that
where is a finite generic constant. Also, we know
that
By (A.6) and (A.7), we get
for any positive number Recall that We know is an eigenvalue of Thus, for for Also, These imply that Then from (A.8), we get
From (A.5) and (A.9), it follows under the
conditions of the theorem that the desired integral is finite.
A.2 Details for the SAR Model
We now consider for the SAR model. With we have
First, since and
Note that the eigenvalues of are all real (since is symmetric). Also, and have identical eigenvalues. Being a stochastic
matrix, has at least one eigenvalue which is one and
the remaining eigenvalues are bounded above by 1, that is and As and Thus, the eigenvalues of are positive and bounded above by Let and where Then and is bounded above. By writing
we have
Letting be the matrix of eigenvectors of such that we also have
where and is a subset of so that the matrix a submatrix of is non-singular. Note that is determined by Using (A.11) we get
Based on (A.10) and (A.12), we get that
where we use the fact that and to claim From (A.5) and (A.13), it follows by
proceeding along the lines we did for the CAR model that the desired integral is finite under the conditions of the theorem.
A.3 Details for the CAR Model
We now consider for the IAR model where
Let Then
where Proceeding along the same line as in (A.11),
we get that
Again, as we had for the two previous cases, we can
use (A.14) and (A.15) to establish that the desired integral is finite under
the conditions stated in the theorem.
A.4 Details for the LCAR Model
Finally, we consider where for the LCAR case we have
Suppose are the eigenvalues of and is an orthogonal matrix such that Since is a non-negative definite matrix, and implying that are all bounded between 0 and Then we can write
and claim that for the
eigenvalues of are all
positive and bounded above by Then,
with and we can
establish an inequality similar to (A.11). Note that the nonsingular matrix is a
submatrix of and is
free from Boundedness of the eigenvalues of will
lead to an inequality similar to (A.14). Finally, we get the desired integral
is finite under the conditions of the theorem.
References
Banerjee, S., Carlin,
B.P., and Gelfand, A.E. (2003). Hierarchical Modeling and Analysis for
Spatial Data, Chapman and Hall/CRC.
Berger, J.O. (1985). Statistical
Decision Theory and Bayesian Analysis, Springer Science & Business
Media.
Besag, J., and Kooperberg, C. (1995). On conditional and
intrinsic autoregressions. Biometrika, 82, 733-746.
Brown, D.A., Datta, G.S.
and Lazar, N.A. (2017). A Bayesian generalized CAR model for correlated signal
detection. Statistica Sinica, 27, 1125-1153.
Datta, G.S., and Lahiri,
P. (2000). A unified measure of uncertainty of estimated best linear unbiased
predictors in small area estimation problems. Statistica Sinica, 10,
613-627.
Datta, G.S., and Smith,
D.D. (2003). On propriety of posterior distributions of variance components in
small area estimation. Journal of Statistical Planning and Inference,
112, 175-183.
Datta, G.S., Hall, P. and
Mandal, A. (2011). Model selection by testing for the presence of small-area
effects, and application to area-level data. Journal of the American
Statistical Association, 106, 362-374.
Datta, G.S., Rao, J.N.K.
and Smith, D.D. (2005). On measuring the variability of small area estimators
under a basic area level model. Biometrika, 92, 183-196.
Datta, G.S., Lahiri, P.,
Maiti, T. and Lu, K.L. (1999). Hierarchical Bayes estimation of unemployment
rates for the states of the U.S. Journal of the American Statistical
Association, 94, 1074-1082.
Fay, R.E., and Herriot,
R.A. (1979). Estimates of income for small places: An application of
James-Stein procedures to census data. Journal of the American Statistical
Association, 74, 269-277.
Gelman, A., and Rubin, D.B. (1992). Inference from
iterative simulation using multiple sequences. Statistical Science, 7,
457-472.
Gelman, A., Carlin, J.B.,
Stern, H.S., Dunson, D.B., Vehtari, A. and Rubin, D.B. (2013). Bayesian Data
Analysis, CRC Press, 3rd ed.
Ghosh, M. (1992).
Hierarchical and empirical Bayes multivariate estimation. In Current Issues
in Statistical Inference: Essays in Honor of D. Basu, (Eds.,
M. Ghosh and P.K. Pathak), Institute of Mathematical Statistics,
151-177.
Hodges, J.S. (2019). Richly Parameterized Linear Models:
Additive, Time Series, and Spatial Models Using Random Effects, Chapman and
Hall/CRC.
Leroux, B.G., Lei, X. and
Breslow, N. (2000). Estimation of disease rates in small areas: A new mixed
model for spatial dependence. In Statistical Models in Epidemiology, the
Environment, and Clinical Trials, Springer, 179-191.
MacNab, Y.C. (2003). Hierarchical Bayesian spatial modelling of small-area rates of non-rare
disease. Statistics in Medicine, 22, 1761-1773.
Opsomer, J.D., Claeskens, G., Ranalli, M.G., Kauermann, G. and Breidt, F. (2008). Non-parametric small
area estimation using penalized spline regression. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 70, 265-286.
Porter, A.T., Wikle, C.K. and Holan, S.H. (2015). Small area estimation via multivariate Fay-Herriot
models with latent spatial dependence. Australian & New Zealand Journal of Statistics, 57, 15-29.
Porter, A.T., Holan, S.H., Wikle, C.K. and Cressie, N. (2014). Spatial Fay-Herriot models for small area estimation with functional covariates. Spatial Statistics, 10,
27-42.
Prasad, N.G.N., and Rao, J.N.K. (1990). The estimation of the mean squared error of small-area
estimators. Journal of the American Statistical Association, 85, 163-171.
Rao, J.N.K., and Molina, I. (2015). Small Area Estimation, New York: John Wiley & Sons, Inc.
Rao, J.N.K., Sinha, S.K. and Dumitrescu, L. (2014). Robust small area estimation under semi-parametric
mixed models. Canadian Journal of Statistics, 42, 126-141.
Speckman, P.L., and Sun, D. (2003). Fully Bayesian spline smoothing and intrinsic autoregressive priors.
Biometrika, 90, 289-302.
Stan Development Team (2018). RStan: The R interface to Stan. R package version 2.17.3.
Sun, D., Tsutakawa, R.K.
and Speckman, P.L. (1999). Posterior distribution of hierarchical models using CAR (1) distributions. Biometrika, 86, 341-350.
Torabi, M. (2012).
Hierarchical Bayes estimation of spatial statistics for rates. Journal of
Statistical Planning and Inference, 142, 358-365.
Trevisani, M., and Gelfand, A. (2013). Spatial misalignment models for small area estimation: A simulation study. In Advances in Theoretical and Applied Statistics,
Springer, 269-279.
Watanabe, S., and Opper, M. (2010). Asymptotic
equivalence of Bayes cross validation and widely applicable information criterion in singular learning theory. Journal of Machine Learning Research,
11.
Whittle, P. (1954). On stationary processes in the plane. Biometrika, 41, 434-449.
You, Y., and Zhou, Q.M.
(2011). Hierarchical
Bayes small area estimation under a spatial model with application to health survey data. Survey Methodology, 37, 1, 25-37. Paper available at https://www150.statcan.gc.ca/n1/en/pub/12-001-x/2011001/article/11445-eng.pdf.