Assessing the coverage of confidence intervals under nonresponse. A case study on income mean and quantiles in some municipalities from the 2015 Mexican Intercensal Survey
Section 4. Simulated populations
In order to control the asymmetry of the distribution of the correlation and the percentage of nonresponse, we simulated two symmetric and two asymmetric populations of size 50,000 with a variable of interest and six auxiliary variables as follows.
- 50,000 simple random samples for each of the variables were generated independently from a distribution.
- The response probabilities were obtained using a logistic regression with and chosen so that the average nonresponse was equal to 24.8%.
- Two
settings were considered for the distribution of
- i) Symmetric. was generated from a with 2.16 and 4.67 where
- ii) Asymmetric. where was generated from a with and where
4.1 Numerical results
The coverage rate of the CIs was computed as in Section 3.1, with and using a logistic regression without interactions to obtain
Table 4.1 reports the results for the populations with Table 4.2 shows the RB and RRMSE of the estimators. Numerical results for populations with are omitted since they were similar to those obtained for populations with We make the following observations:
- EL and Lin methods have a similar reasonable performance for though the upper tail error rates are larger than 5% in the asymmetric population.
- For quantiles, Lin method has the lowest and the highest coverage of 85.7 and 97.9% respectively. Unlike the distribution of shown in Figure 3.1, the distribution of for the simulated populations is symmetric and unimodal in all cases. EL and W methods perform well, reaching the nominal level in all cases with comparable tail error rates and CI average length.
- Weighting adjustment in the nonresponse scenario helps to get a RB similar to that of the full response.
- The coverage rate of the CI for each method is larger in the nonresponse scenario than in the full response, and in some cases it is also larger than the nominal level. This might be related to the impact of having treated the as fixed in the nonresponse case.
| Parameter | Method | Coverage % | Lower tail err. rates % | Upper tail err. rates % | CI average length | ||||
|---|---|---|---|---|---|---|---|---|---|
| NR | Full | NR | Full | NR | Full | NR | Full | ||
| Asymmetric | |||||||||
| EL | 90.9Note * | 88.6Note * | 2.2Note * | 5.1 | 6.9Note * | 6.3 | 0.50 | 0.32 | |
| Lin | 90.1 | 88.6Note * | 0.5Note * | 3.2Note * | 9.4Note * | 8.2Note * | 0.48 | 0.31 | |
| EL | 90.6 | 89.5 | 4.0Note * | 4.6 | 5.4 | 5.9 | 0.07 | 0.07 | |
| W | 90.3 | 89.5 | 3.6Note * | 4.1Note * | 6.2Note * | 6.4Note * | 0.07 | 0.07 | |
| Lin | 97.9Note * | 97.4Note * | 1.2Note * | 1.5Note * | 1.0Note * | 1.2Note * | 0.10 | 0.10 | |
| EL | 93.6Note * | 90.5 | 3.0Note * | 4.4Note * | 3.4Note * | 5.1 | 0.22 | 0.19 | |
| W | 93.5Note * | 90.4 | 2.9Note * | 4.4 | 3.6Note * | 5.1 | 0.22 | 0.19 | |
| Lin | 92.5Note * | 88.9Note * | 2.9Note * | 5.0 | 4.6 | 6.2Note * | 0.21 | 0.18 | |
| EL | 92.7Note * | 90.3 | 2.6Note * | 4.1Note * | 4.7 | 5.7Note * | 1.35 | 0.91 | |
| W | 93.0Note * | 90.4 | 2.7Note * | 4.6 | 4.3Note * | 5.0 | 1.36 | 0.92 | |
| Lin | 87.4Note * | 85.7Note * | 2.6Note * | 4.1Note * | 10.1Note * | 10.2Note * | 1.23 | 0.87 | |
| Symmetric | |||||||||
| EL | 93.6Note * | 90.2 | 3.3Note * | 5.0 | 3.1Note * | 4.8 | 0.40 | 0.32 | |
| Lin | 93.5Note * | 89.9 | 3.1Note * | 5.2 | 3.4Note * | 4.9 | 0.39 | 0.32 | |
| EL | 91.2Note * | 90.9Note * | 3.6Note * | 3.9Note * | 5.2 | 5.2 | 0.59 | 0.55 | |
| W | 91.0Note * | 90.6 | 3.2Note * | 3.6Note * | 5.8Note * | 5.8Note * | 0.59 | 0.56 | |
| Lin | 88.6Note * | 88.2Note * | 5.8Note * | 5.9Note * | 5.7Note * | 6.0Note * | 0.57 | 0.53 | |
| EL | 92.8Note * | 90.1 | 3.3Note * | 4.6 | 3.9Note * | 5.3 | 0.46 | 0.39 | |
| W | 92.9Note * | 90.1 | 3.1Note * | 4.6 | 4.0Note * | 5.3 | 0.46 | 0.39 | |
| Lin | 92.4Note * | 90.2 | 3.4Note * | 4.7 | 4.2Note * | 5.2 | 0.46 | 0.39 | |
| EL | 92.9Note * | 90.4 | 2.2Note * | 3.6Note * | 4.9 | 6.0Note * | 0.76 | 0.54 | |
| W | 93.3Note * | 90.3 | 2.2Note * | 4.2Note * | 4.5 | 5.4 | 0.77 | 0.54 | |
| Lin | 90.3 | 89.1Note * | 2.1Note * | 3.2Note * | 7.6Note * | 7.7Note * | 0.74 | 0.53 | |
|
|||||||||
| Population | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RB | RRMSE | RB | RRMSE | RB | RRMSE | RB | RRMSE | |||||||||
| NR | Full | NR | Full | NR | Full | NR | Full | NR | Full | NR | Full | NR | Full | NR | Full | |
| Asymmetric | 0.11 | 0.13 | 9.0 | 5.9 | 0.56 | 0.53 | 7.8 | 7.5 | 0.00 | 0.07 | 6.0 | 5.7 | 0.53 | 0.43 | 9.7 | 7.6 |
| Symmetric | 0.12 | 0.09 | 10.3 | 9.5 | 0.98 | 0.91 | 10.2 | 9.7 | 0.33 | 0.35 | 12.7 | 11.8 | 0.43 | 0.34 | 5.5 | 4.3 |
- Date modified: