Small area estimation methods under cut-off sampling
Section 10. Conclusions
Cut-off sampling is frequently used in business surveys, when drawing a representative sample from the whole population entails a cost that does not really compensate the subsequent gain in accuracy. On the other hand, in some surveys, part of the target population may not be actually available for sampling; that is, there may be population sectors that cannot be represented in the sample. These situations appear more often than desired, providing biased direct estimates as we have seen along this work.
We have studied the theoretical design properties of basic direct, calibration and model-based estimators under cut-off sampling in small areas. Our results show that EBLUP for a linear parameter, similarly as calibration estimators, reduce considerably the bias due to cut-off sampling if the models for the included and excluded individuals are reasonably similar. In terms of MSE, EBLUP performs significantly better than calibration estimators, specially for domains with small sample size.
In our simulation studies and in the application, we compared the proposed methods by assuming that the model is the same for all units in the population (included or excluded). The model assumption could be arguable because there is no way of checking the model for the excluded units. In the case that estimation for the overall domain (and not only for is required as is the case in this work, one will need to rely on subjective prior information concerning the validity of the assumed model for the excluded units. In any case, estimates can be considered just as indicatives of what could be the true values in the case that the same model holds for all the domain units. In fact, the case of different models for included and excluded units was also analyzed in simulations. In this case, model-based estimators remained to be the most efficient, with not much larger bias than that of calibration estimators.
MSEs of calibration and model-based estimators are obtained under the model. Design MSEs are preferred by National Statistical Institutes because they do not assume that a model is correct and therefore account for model failures. However, finding design-unbiased estimators for the design MSE under cut-off sampling encounters the same problems as finding design-unbiased estimators of the target domain indicators We plan to use the ideas of Strzalkowska-Kominiak and Molina (2019), based on borrowing strength from the other domains also for estimating the design MSE in a given domain, to find design MSE estimators with reduced cut-off sampling bias.
Finally, we have considered that the domains act as sampling strata and cut-off sampling is applied within each domain. Considering that the strata are different from the domains (typically cutting-across the domains) and applying cut-off sampling within each strata yields random domain sample sizes. Small area estimation is seldom studied under this case in the literature. Nevertheless, putting together the subsamples from the different strata corresponding to the same domain we get a sample from each domain. Inference could then be done conditionally on the observed domain sample sizes Rao (1985), which would reduce to the same problem considered here.
Acknowledgements
The work of M. Guadarrama and I. Molina is supported by the Spanish Ministerio de Economía y Competitividad, grants MTM2015-69638-R (MINECO/FEDER, UE) and MTM2015-72907-EXP.
Appendix
Estimates of total sales by provinces
| PROVINCE | |||||||
|---|---|---|---|---|---|---|---|
| SORIA | 3 | 293,020.0 | 187,824.9 | 213,325.0 | 50.0 | 17.1 | 6.2 |
| ZAMORA | 7 | 932,520.0 | 345,095.8 | 454,657.0 | 43.3 | 18.9 | 5.5 |
| ALAVA | 11 | 130,083.6 | 119,918.5 | 118,835.3 | 23.7 | 14.7 | 9.7 |
| ALMERIA | 13 | 1,870,104.6 | 2,407,333.1 | 2,272,051.4 | 30.4 | 5.8 | 3.4 |
| PALENCIA | 14 | 626,340.0 | 380,367.4 | 409,775.4 | 16.7 | 7.6 | 4.1 |
| SALAMANCA | 14 | 1,265,580.0 | 966,094.1 | 1,068,230.6 | 21.9 | 7.3 | 3.9 |
| AVILA | 15 | 708,696.0 | 392,474.1 | 418,917.2 | 19.5 | 9.2 | 5.0 |
| LERIDA | 17 | 817,817.6 | 1,011,032.3 | 1,014,770.2 | 22.5 | 7.1 | 4.1 |
| CIUDAD REAL | 18 | 1,764,000.0 | 841,228.2 | 939,994.9 | 21.4 | 8.6 | 4.6 |
| GUADALAJARA | 18 | 463,047.8 | 362,148.3 | 363,856.9 | 17.1 | 6.0 | 4.5 |
| RIOJA | 18 | 809,900.0 | 622,488.3 | 595,178.6 | 18.2 | 5.2 | 3.7 |
| SEGOVIA | 19 | 610,370.5 | 386,734.4 | 402,324.0 | 15.7 | 7.5 | 4.2 |
| CACERES | 20 | 4,391,826.0 | 2,081,619.7 | 2,286,462.0 | 20.4 | 5.6 | 2.7 |
| GUIPUZCOA | 20 | 181,634.0 | 136,700.0 | 156,311.8 | 18.6 | 16.7 | 11.6 |
| HUESCA | 22 | 377,954.5 | 372,101.3 | 371,246.5 | 24.5 | 7.7 | 5.2 |
| TERUEL | 22 | 534,417.3 | 446,565.7 | 465,643.3 | 19.9 | 6.0 | 4.3 |
| CUENCA | 23 | 588,464.3 | 587,005.5 | 586,347.5 | 19.0 | 5.8 | 4.2 |
| VALLADOLID | 24 | 1,609,875.0 | 1,210,132.8 | 1,188,336.1 | 13.3 | 4.5 | 3.4 |
| BURGOS | 28 | 961,645.7 | 708,510.0 | 666,698.1 | 18.5 | 4.9 | 3.4 |
| CORDOBA | 28 | 4,457,614.3 | 3,367,169.5 | 3,312,801.5 | 17.9 | 3.4 | 2.4 |
| ORENSE | 28 | 148,577.1 | 88,104.6 | 108,428.9 | 17.4 | 19.0 | 10.5 |
| LUGO | 30 | 107,213.3 | 92,938.7 | 104,233.7 | 16.9 | 13.8 | 10.7 |
| ALBACETE | 31 | 1,654,606.5 | 1,115,182.2 | 1,073,719.8 | 13.4 | 4.2 | 2.8 |
| LEON | 31 | 1,528,254.2 | 1,274,531.6 | 1,270,341.6 | 14.5 | 4.2 | 3.2 |
| PROVINCE | |||||||
| HUELVA | 32 | 3,031,328.1 | 2,838,874.0 | 2,816,281.3 | 10.5 | 2.6 | 2.0 |
| NAVARRA | 33 | 1,291,343.0 | 956,737.9 | 957,660.4 | 13.2 | 4.4 | 3.4 |
| PONTEVEDRA | 33 | 159,229.1 | 107,198.9 | 138,367.4 | 22.2 | 19.7 | 13.4 |
| VIZCAYA | 34 | 228,618.8 | 183,267.3 | 206,304.6 | 13.1 | 13.2 | 9.1 |
| TOLEDO | 35 | 1,619,939.4 | 1,529,104.8 | 1,539,799.3 | 13.1 | 4.2 | 3.2 |
| CADIZ | 38 | 1,851,521.1 | 1,585,755.9 | 1,620,844.2 | 14.9 | 4.0 | 3.4 |
| BADAJOZ | 39 | 4,571,743.6 | 3,439,625.5 | 3,457,692.5 | 13.5 | 2.7 | 2.2 |
| MALAGA | 39 | 2,499,392.3 | 3,188,031.1 | 3,237,081.8 | 10.9 | 4.2 | 2.5 |
| TARRAGONA | 41 | 2,872,882.0 | 2,690,969.7 | 2,656,117.8 | 11.6 | 2.6 | 2.2 |
| GRANADA | 42 | 2,123,693.3 | 2,221,155.1 | 2,241,916.2 | 12.5 | 3.8 | 2.9 |
| JAEN | 43 | 1,928,229.8 | 1,940,379.2 | 1,943,101.0 | 15.8 | 3.2 | 2.7 |
| ZARAGOZA | 43 | 3,750,210.7 | 2,564,909.0 | 2,578,011.3 | 13.5 | 3.0 | 2.3 |
| GERONA | 45 | 2,029,222.2 | 1,748,165.7 | 1,767,490.3 | 10.4 | 3.2 | 2.5 |
| MURCIA | 51 | 6,700,070.6 | 7,467,465.0 | 7,341,434.6 | 8.7 | 2.2 | 1.6 |
| BALEARES | 52 | 849,950.8 | 650,012.6 | 694,416.3 | 21.5 | 6.1 | 4.7 |
| CANTABRIA | 52 | 285,632.3 | 204,947.7 | 226,163.1 | 10.7 | 9.5 | 6.4 |
| ASTURIAS | 55 | 2,113,034.5 | 1,702,020.8 | 1,661,932.8 | 13.5 | 3.6 | 3.1 |
| CASTELLON | 55 | 1,605,604.4 | 1,526,618.1 | 1,530,394.2 | 8.9 | 2.5 | 2.2 |
| SEVILLA | 55 | 7,458,078.2 | 6,878,368.2 | 6,857,368.8 | 11.0 | 2.0 | 1.7 |
| CORUNA | 62 | 340,200.0 | 217,028.5 | 206,041.8 | 20.2 | 10.9 | 10.2 |
| ALICANTE | 66 | 8,324,589.1 | 8,390,895.3 | 8,240,996.9 | 9.2 | 1.8 | 1.6 |
| VALENCIA | 113 | 7,671,137.7 | 7,209,128.2 | 7,153,290.2 | 6.3 | 1.7 | 1.4 |
| MADRID | 123 | 11,483,342.8 | 12,892,853.8 | 12,892,305.0 | 6.2 | 1.7 | 1.5 |
| BARCELONA | 187 | 22,356,500.5 | 24,990,558.9 | 24,797,372.9 | 4.8 | 1.0 | 0.9 |
References
Battese, G.E., Harter, R.M. and Fuller, W.A. (1988). An error-components model for prediction of county crop areas using survey and satellite data. Journal of the American Statistical Association, 83, 28-36.
Benedetti, R., Bee, M. and Espa, G. (2010). A framework for cut-off sampling in business survey design. Journal of Official Statistics, 26, 651-671.
Foster, J., Greer, J. and Thorbecke, E. (1984). A class of decomposable poverty measures. Econometrica: Journal of the Econometric Society, 761-766.
González-Manteiga, W., Lombardia, M.J., Molina, I., Morales, D. and Santamaría, L. (2008). Bootstrap mean squared error of a small area EBLUP. Journal of Statistical Computation and Simulation, 78, 443-462.
Hájek, J. (1971). Discussion of an essay on the logical foundations of survey sampling, comment on a paper by D. Basu. In Foundations of Statistical Inference, (Eds., V.P. Godambe and D.A. Sprott), Toronto: Holt, Rinehart, Winston.
Haziza, D., Chauvet, G. and Deville, J.-C. (2010). Sampling estimation in presence of cut-off sampling. Australian & New Zealand Journal of Statistics, 52, 303-319.
Horvitz, D.G., and Thompson, D.J. (1952). A generalization of sampling without replacement from a finite universe. Journal of the American Statistical Association, 47, 663-685.
INE (2018). Índices de producción industrial (IPI) base 2015. Technical report, Instituto Nacional de Estadística, España.
Molina, I., and Marhuenda, Y. (2015). sae: An R package for small area estimation. R Journal, 1, 81-98.
Molina, I., and Rao, J.N.K. (2010). Small area estimation of poverty indicators. Canadian Journal of Statistics, 38, 369-385.
Pratesi, M. (2016). Analysis of Poverty Data by Small Area Estimation. Hoboken, New Jersey: John Wiley & Sons, Inc.
Rao, J.N.K. (1985). Conditional inference in survey sampling. Survey Methodology, 11, 1, 15-31. Paper available at https://www150.statcan.gc.ca/n1/pub/12-001-x/1985001/article/14364-eng.pdf.
Rao, J.N.K., and Molina, I. (2015). Small Area Estimation. Hoboken, New Jersey: John Wiley & Sons, Inc.
R Development Core Team (2016). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna.
Särndal, C.-E., Swensson, B. and Wretman, J. (1992). Model Assisted Survey Sampling. New York: Springer-Verlag.
Strzalkowska-Kominiak, E., and Molina, I. (2019). Estimation of proportions in small areas: Application to the labour force using the Swiss Census Structural Survey. Journal of the Royal Statistical Society: Series A (Statistics in Society).
Tillé, Y., and Matei, A. (2016). Sampling: Survey Sampling. R package version 2.8.
You, Y., and Rao, J.N.K. (2002). A pseudo-empirical best linear unbiased prediction approach to small area estimation using survey weights. Canadian Journal of Statistics, 30, 431-439.
- Date modified: