Small area estimation methods under cut-off sampling
Section 10. Conclusions

Cut-off sampling is frequently used in business surveys, when drawing a representative sample from the whole population entails a cost that does not really compensate the subsequent gain in accuracy. On the other hand, in some surveys, part of the target population may not be actually available for sampling; that is, there may be population sectors that cannot be represented in the sample. These situations appear more often than desired, providing biased direct estimates as we have seen along this work.

We have studied the theoretical design properties of basic direct, calibration and model-based estimators under cut-off sampling in small areas. Our results show that EBLUP for a linear parameter, similarly as calibration estimators, reduce considerably the bias due to cut-off sampling if the models for the included and excluded individuals are reasonably similar. In terms of MSE, EBLUP performs significantly better than calibration estimators, specially for domains with small sample size.

In our simulation studies and in the application, we compared the proposed methods by assuming that the model is the same for all units in the population (included or excluded). The model assumption could be arguable because there is no way of checking the model for the excluded units. In the case that estimation for the overall domain (and not only for U i I ) MathType@MTEF@5@5@+= feaagKart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLn hiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr 4rNCHbGeaGqiFu0Je9sqqrpepC0xbbL8F4rqqrpgpC0xe9GqFf0xc9 qqpeuf0xe9q8qiYRWFGCk9vi=dbbf9v8Gq0db9qqpm0dXdHqpq0=vr 0=vr0=edbaqaaeGaciGaaiaabeqaamaabaabaaGcbaGaamyvamaaBa aaleaacaWGPbGaamysaaqabaGccaGGPaaaaa@3922@ is required as is the case in this work, one will need to rely on subjective prior information concerning the validity of the assumed model for the excluded units. In any case, estimates can be considered just as indicatives of what could be the true values in the case that the same model holds for all the domain units. In fact, the case of different models for included and excluded units was also analyzed in simulations. In this case, model-based estimators remained to be the most efficient, with not much larger bias than that of calibration estimators.

MSEs of calibration and model-based estimators are obtained under the model. Design MSEs are preferred by National Statistical Institutes because they do not assume that a model is correct and therefore account for model failures. However, finding design-unbiased estimators for the design MSE under cut-off sampling encounters the same problems as finding design-unbiased estimators of the target domain indicators H i . MathType@MTEF@5@5@+= feaagKart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLn hiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr 4rNCHbGeaGqiFu0Je9sqqrpepC0xbbL8F4rqqrpgpC0xe9GqFf0xc9 qqpeuf0xe9q8qiYRWFGCk9vi=dbbf9v8Gq0db9qqpm0dXdHqpq0=vr 0=vr0=edbaqaaeGaciGaaiaabeqaamaabaabaaGcbaGaamisamaaBa aaleaacaWGPbaabeaakiaac6caaaa@384C@ We plan to use the ideas of Strzalkowska-Kominiak and Molina (2019), based on borrowing strength from the other domains also for estimating the design MSE in a given domain, to find design MSE estimators with reduced cut-off sampling bias.

Finally, we have considered that the domains act as sampling strata and cut-off sampling is applied within each domain. Considering that the strata are different from the domains (typically cutting-across the domains) and applying cut-off sampling within each strata yields random domain sample sizes. Small area estimation is seldom studied under this case in the literature. Nevertheless, putting together the subsamples from the different strata corresponding to the same domain we get a sample from each domain. Inference could then be done conditionally on the observed domain sample sizes Rao (1985), which would reduce to the same problem considered here.

Acknowledgements

The work of M. Guadarrama and I. Molina is supported by the Spanish Ministerio de Economía y Competitividad, grants MTM2015-69638-R (MINECO/FEDER, UE) and MTM2015-72907-EXP.

Appendix

Estimates of total sales by provinces


Table A.1
Basic direct, GREG and EBP estimates of total sales for the selected product and estimated coefficients of variation (%) for each Spanish province (by increasing sample size)
Table summary
This table displays the results of Basic direct. The information is grouped by PROVINCE (appearing as row headers), (équation) (appearing as column headers).
PROVINCE n i MathType@MTEF@5@5@+= feaagKart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLn hiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr 4rNCHbGeaGqk0Jf9crFfpeea0xh9v8qiW7rqqrpgpC0xe9GqFf0xc9 qqpeuf0xe9q8qiYRWFGCk9vi=dbbf9v8Gq0db9qqpm0dXdHqpq0=vr 0=vr0=edbeqabeWacmGabiqabeqabmqabeabbaGcbaGaamOBamaaBa aaleaacaWGPbaabeaaaaa@39E3@ V ^ i HA MathType@MTEF@5@5@+= feaagKart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLn hiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr 4rNCHbGeaGqk0Jf9crFfpeea0xh9v8qiW7rqqrpgpC0xe9GqFf0xc9 qqpeuf0xe9q8qiYRWFGCk9vi=dbbf9v8Gq0db9qqpm0dXdHqpq0=vr 0=vr0=edbeqabeWacmGabiqabeqabmqabeabbaGcbaGabmOvayaaja Waa0baaSqaaiaadMgaaeaacaqGibGaaeyqaaaaaaa@3B6B@ V ^ i GREG MathType@MTEF@5@5@+= feaagKart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLn hiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr 4rNCHbGeaGqk0Jf9crFfpeea0xh9v8qiW7rqqrpgpC0xe9GqFf0xc9 qqpeuf0xe9q8qiYRWFGCk9vi=dbbf9v8Gq0db9qqpm0dXdHqpq0=vr 0=vr0=edbeqabeWacmGabiqabeqabmqabeabbaGcbaGabmOvayaaja Waa0baaSqaaiaadMgaaeaacaqGhbGaaeOuaiaabweacaqGhbaaaaaa @3D0D@ V ^ i EBP MathType@MTEF@5@5@+= feaagKart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLn hiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr 4rNCHbGeaGqk0Jf9crFfpeea0xh9v8qiW7rqqrpgpC0xe9GqFf0xc9 qqpeuf0xe9q8qiYRWFGCk9vi=dbbf9v8Gq0db9qqpm0dXdHqpq0=vr 0=vr0=edbeqabeWacmGabiqabeqabmqabeabbaGcbaGabmOvayaaja Waa0baaSqaaiaadMgaaeaacaqGfbGaaeOqaiaabcfaaaaaaa@3C3C@ cv( V ^ i HA ) MathType@MTEF@5@5@+= feaagKart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLn hiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr 4rNCHbGeaGqk0Jf9crFfpeea0xh9v8qiW7rqqrpgpC0xe9GqFf0xc9 qqpeuf0xe9q8qiYRWFGCk9vi=dbbf9v8Gq0db9qqpm0dXdHqpq0=vr 0=vr0=edbeqabeWacmGabiqabeqabmqabeabbaGcbaGaae4yaiaabA hacaaIOaGabmOvayaajaWaa0baaSqaaiaadMgaaeaacaqGibGaaeyq aaaakiaaiMcaaaa@3EB9@ cv( V ^ i GREG ) MathType@MTEF@5@5@+= feaagKart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLn hiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr 4rNCHbGeaGqk0Jf9crFfpeea0xh9v8qiW7rqqrpgpC0xe9GqFf0xc9 qqpeuf0xe9q8qiYRWFGCk9vi=dbbf9v8Gq0db9qqpm0dXdHqpq0=vr 0=vr0=edbeqabeWacmGabiqabeqabmqabeabbaGcbaGaae4yaiaabA hacaaIOaGabmOvayaajaWaa0baaSqaaiaadMgaaeaacaqGhbGaaeOu aiaabweacaqGhbaaaOGaaGykaaaa@405B@ cv( V ^ i EBP ) MathType@MTEF@5@5@+= feaagKart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLn hiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr 4rNCHbGeaGqk0Jf9crFfpeea0xh9v8qiW7rqqrpgpC0xe9GqFf0xc9 qqpeuf0xe9q8qiYRWFGCk9vi=dbbf9v8Gq0db9qqpm0dXdHqpq0=vr 0=vr0=edbeqabeWacmGabiqabeqabmqabeabbaGcbaGaae4yaiaabA hacaaIOaGabmOvayaajaWaa0baaSqaaiaadMgaaeaacaqGfbGaaeOq aiaabcfaaaGccaaIPaaaaa@3F8A@
SORIA 3 293,020.0 187,824.9 213,325.0 50.0 17.1 6.2
ZAMORA 7 932,520.0 345,095.8 454,657.0 43.3 18.9 5.5
ALAVA 11 130,083.6 119,918.5 118,835.3 23.7 14.7 9.7
ALMERIA 13 1,870,104.6 2,407,333.1 2,272,051.4 30.4 5.8 3.4
PALENCIA 14 626,340.0 380,367.4 409,775.4 16.7 7.6 4.1
SALAMANCA 14 1,265,580.0 966,094.1 1,068,230.6 21.9 7.3 3.9
AVILA 15 708,696.0 392,474.1 418,917.2 19.5 9.2 5.0
LERIDA 17 817,817.6 1,011,032.3 1,014,770.2 22.5 7.1 4.1
CIUDAD REAL 18 1,764,000.0 841,228.2 939,994.9 21.4 8.6 4.6
GUADALAJARA 18 463,047.8 362,148.3 363,856.9 17.1 6.0 4.5
RIOJA 18 809,900.0 622,488.3 595,178.6 18.2 5.2 3.7
SEGOVIA 19 610,370.5 386,734.4 402,324.0 15.7 7.5 4.2
CACERES 20 4,391,826.0 2,081,619.7 2,286,462.0 20.4 5.6 2.7
GUIPUZCOA 20 181,634.0 136,700.0 156,311.8 18.6 16.7 11.6
HUESCA 22 377,954.5 372,101.3 371,246.5 24.5 7.7 5.2
TERUEL 22 534,417.3 446,565.7 465,643.3 19.9 6.0 4.3
CUENCA 23 588,464.3 587,005.5 586,347.5 19.0 5.8 4.2
VALLADOLID 24 1,609,875.0 1,210,132.8 1,188,336.1 13.3 4.5 3.4
BURGOS 28 961,645.7 708,510.0 666,698.1 18.5 4.9 3.4
CORDOBA 28 4,457,614.3 3,367,169.5 3,312,801.5 17.9 3.4 2.4
ORENSE 28 148,577.1 88,104.6 108,428.9 17.4 19.0 10.5
LUGO 30 107,213.3 92,938.7 104,233.7 16.9 13.8 10.7
ALBACETE 31 1,654,606.5 1,115,182.2 1,073,719.8 13.4 4.2 2.8
LEON 31 1,528,254.2 1,274,531.6 1,270,341.6 14.5 4.2 3.2
PROVINCE n i MathType@MTEF@5@5@+= feaagKart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLn hiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr 4rNCHbGeaGqk0Jf9crFfpeea0xh9v8qiW7rqqrpgpC0xe9GqFf0xc9 qqpeuf0xe9q8qiYRWFGCk9vi=dbbf9v8Gq0db9qqpm0dXdHqpq0=vr 0=vr0=edbeqabeWacmGabiqabeqabmqabeabbaGcbaGaamOBamaaBa aaleaacaWGPbaabeaaaaa@39E3@ Y ^ i DIR MathType@MTEF@5@5@+= feaagKart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLn hiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr 4rNCHbGeaGqk0Jf9crFfpeea0xh9v8qiW7rqqrpgpC0xe9GqFf0xc9 qqpeuf0xe9q8qiYRWFGCk9vi=dbbf9v8Gq0db9qqpm0dXdHqpq0=vr 0=vr0=edbeqabeWacmGabiqabeqabmqabeabbaGcbaGabmywayaaja Waa0baaSqaaiaadMgaaeaacaqGebGaaeysaiaabkfaaaaaaa@3C47@ Y ^ i GREG MathType@MTEF@5@5@+= feaagKart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLn hiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr 4rNCHbGeaGqk0Jf9crFfpeea0xh9v8qiW7rqqrpgpC0xe9GqFf0xc9 qqpeuf0xe9q8qiYRWFGCk9vi=dbbf9v8Gq0db9qqpm0dXdHqpq0=vr 0=vr0=edbeqabeWacmGabiqabeqabmqabeabbaGcbaGabmywayaaja Waa0baaSqaaiaadMgaaeaacaqGhbGaaeOuaiaabweacaqGhbaaaaaa @3D10@ Y ^ i EBP MathType@MTEF@5@5@+= feaagKart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLn hiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr 4rNCHbGeaGqk0Jf9crFfpeea0xh9v8qiW7rqqrpgpC0xe9GqFf0xc9 qqpeuf0xe9q8qiYRWFGCk9vi=dbbf9v8Gq0db9qqpm0dXdHqpq0=vr 0=vr0=edbeqabeWacmGabiqabeqabmqabeabbaGcbaGabmywayaaja Waa0baaSqaaiaadMgaaeaacaqGfbGaaeOqaiaabcfaaaaaaa@3C3F@ cv( Y ^ i DIR ) MathType@MTEF@5@5@+= feaagKart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLn hiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr 4rNCHbGeaGqk0Jf9crFfpeea0xh9v8qiW7rqqrpgpC0xe9GqFf0xc9 qqpeuf0xe9q8qiYRWFGCk9vi=dbbf9v8Gq0db9qqpm0dXdHqpq0=vr 0=vr0=edbeqabeWacmGabiqabeqabmqabeabbaGcbaGaae4yaiaabA hacaaIOaGabmywayaajaWaa0baaSqaaiaadMgaaeaacaqGebGaaeys aiaabkfaaaGccaaIPaaaaa@3F95@ cv( Y ^ i GREG ) MathType@MTEF@5@5@+= feaagKart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLn hiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr 4rNCHbGeaGqk0Jf9crFfpeea0xh9v8qiW7rqqrpgpC0xe9GqFf0xc9 qqpeuf0xe9q8qiYRWFGCk9vi=dbbf9v8Gq0db9qqpm0dXdHqpq0=vr 0=vr0=edbeqabeWacmGabiqabeqabmqabeabbaGcbaGaae4yaiaabA hacaaIOaGabmywayaajaWaa0baaSqaaiaadMgaaeaacaqGhbGaaeOu aiaabweacaqGhbaaaOGaaGykaaaa@405E@ cv( Y ^ i EBP ) MathType@MTEF@5@5@+= feaagKart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLn hiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr 4rNCHbGeaGqk0Jf9crFfpeea0xh9v8qiW7rqqrpgpC0xe9GqFf0xc9 qqpeuf0xe9q8qiYRWFGCk9vi=dbbf9v8Gq0db9qqpm0dXdHqpq0=vr 0=vr0=edbeqabeWacmGabiqabeqabmqabeabbaGcbaGaae4yaiaabA hacaaIOaGabmywayaajaWaa0baaSqaaiaadMgaaeaacaqGfbGaaeOq aiaabcfaaaGccaaIPaaaaa@3F8D@
HUELVA 32 3,031,328.1 2,838,874.0 2,816,281.3 10.5 2.6 2.0
NAVARRA 33 1,291,343.0 956,737.9 957,660.4 13.2 4.4 3.4
PONTEVEDRA 33 159,229.1 107,198.9 138,367.4 22.2 19.7 13.4
VIZCAYA 34 228,618.8 183,267.3 206,304.6 13.1 13.2 9.1
TOLEDO 35 1,619,939.4 1,529,104.8 1,539,799.3 13.1 4.2 3.2
CADIZ 38 1,851,521.1 1,585,755.9 1,620,844.2 14.9 4.0 3.4
BADAJOZ 39 4,571,743.6 3,439,625.5 3,457,692.5 13.5 2.7 2.2
MALAGA 39 2,499,392.3 3,188,031.1 3,237,081.8 10.9 4.2 2.5
TARRAGONA 41 2,872,882.0 2,690,969.7 2,656,117.8 11.6 2.6 2.2
GRANADA 42 2,123,693.3 2,221,155.1 2,241,916.2 12.5 3.8 2.9
JAEN 43 1,928,229.8 1,940,379.2 1,943,101.0 15.8 3.2 2.7
ZARAGOZA 43 3,750,210.7 2,564,909.0 2,578,011.3 13.5 3.0 2.3
GERONA 45 2,029,222.2 1,748,165.7 1,767,490.3 10.4 3.2 2.5
MURCIA 51 6,700,070.6 7,467,465.0 7,341,434.6 8.7 2.2 1.6
BALEARES 52 849,950.8 650,012.6 694,416.3 21.5 6.1 4.7
CANTABRIA 52 285,632.3 204,947.7 226,163.1 10.7 9.5 6.4
ASTURIAS 55 2,113,034.5 1,702,020.8 1,661,932.8 13.5 3.6 3.1
CASTELLON 55 1,605,604.4 1,526,618.1 1,530,394.2 8.9 2.5 2.2
SEVILLA 55 7,458,078.2 6,878,368.2 6,857,368.8 11.0 2.0 1.7
CORUNA 62 340,200.0 217,028.5 206,041.8 20.2 10.9 10.2
ALICANTE 66 8,324,589.1 8,390,895.3 8,240,996.9 9.2 1.8 1.6
VALENCIA 113 7,671,137.7 7,209,128.2 7,153,290.2 6.3 1.7 1.4
MADRID 123 11,483,342.8 12,892,853.8 12,892,305.0 6.2 1.7 1.5
BARCELONA 187 22,356,500.5 24,990,558.9 24,797,372.9 4.8 1.0 0.9

References

Battese, G.E., Harter, R.M. and Fuller, W.A. (1988). An error-components model for prediction of county crop areas using survey and satellite data. Journal of the American Statistical Association, 83, 28-36.

Benedetti, R., Bee, M. and Espa, G. (2010). A framework for cut-off sampling in business survey design. Journal of Official Statistics, 26, 651-671.

Foster, J., Greer, J. and Thorbecke, E. (1984). A class of decomposable poverty measures. Econometrica: Journal of the Econometric Society, 761-766.

González-Manteiga, W., Lombardia, M.J., Molina, I., Morales, D. and Santamaría, L. (2008). Bootstrap mean squared error of a small area EBLUP. Journal of Statistical Computation and Simulation, 78, 443-462.

Hájek, J. (1971). Discussion of an essay on the logical foundations of survey sampling, comment on a paper by D. Basu. In Foundations of Statistical Inference, (Eds., V.P. Godambe and D.A. Sprott), Toronto: Holt, Rinehart, Winston.

Haziza, D., Chauvet, G. and Deville, J.-C. (2010). Sampling estimation in presence of cut-off sampling. Australian & New Zealand Journal of Statistics, 52, 303-319.

Horvitz, D.G., and Thompson, D.J. (1952). A generalization of sampling without replacement from a finite universe. Journal of the American Statistical Association, 47, 663-685.

INE (2018). Índices de producción industrial (IPI) base 2015. Technical report, Instituto Nacional de Estadística, España.

Molina, I., and Marhuenda, Y. (2015). sae: An R package for small area estimation. R Journal, 1, 81-98.

Molina, I., and Rao, J.N.K. (2010). Small area estimation of poverty indicators. Canadian Journal of Statistics, 38, 369-385.

Pratesi, M. (2016). Analysis of Poverty Data by Small Area Estimation. Hoboken, New Jersey: John Wiley & Sons, Inc.

Rao, J.N.K. (1985). Conditional inference in survey sampling. Survey Methodology, 11, 1, 15-31. Paper available at https://www150.statcan.gc.ca/n1/pub/12-001-x/1985001/article/14364-eng.pdf.

Rao, J.N.K., and Molina, I. (2015). Small Area Estimation. Hoboken, New Jersey: John Wiley & Sons, Inc.

R Development Core Team (2016). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna.

Särndal, C.-E., Swensson, B. and Wretman, J. (1992). Model Assisted Survey Sampling. New York: Springer-Verlag.

Strzalkowska-Kominiak, E., and Molina, I. (2019). Estimation of proportions in small areas: Application to the labour force using the Swiss Census Structural Survey. Journal of the Royal Statistical Society: Series A (Statistics in Society).

Tillé, Y., and Matei, A. (2016). Sampling: Survey Sampling. R package version 2.8.

You, Y., and Rao, J.N.K. (2002). A pseudo-empirical best linear unbiased prediction approach to small area estimation using survey weights. Canadian Journal of Statistics, 30, 431-439.


Date modified: