Empirical likelihood inference for missing survey data under unequal probability sampling
Section 1. Introduction
Item
nonresponse is commonly seen in sample surveys. A popular method of handling
item nonresponse is hot-deck imputation because (i) it preserves the
distribution of item values as opposed to mean imputation which leads to a
“spike” at the mean of respondent values, (ii) it provides a complete data file
and allows the same survey weight to be used for all items, and (iii) results
from different analyses based on imputed data are consistent with each other
(Rao and Shao, 1992).
Our
focus is on fractional hot-deck imputation, where a few values are drawn
randomly from the set of respondent values (donors) and the average or weighted
average of the drawn values is used to fill in a missing value. For validity
and accuracy of inference based on imputation, the observed sample is usually
grouped into homogeneous classes, called imputation classes, according to
auxiliary variables that are observed for all the sample units (Brick and
Kalton, 1996). Haziza and Beaumont (2007) gave a comprehensive review on
different methods of constructing imputation classes. Missing values are
imputed using the donors within classes and independently across classes.
We
consider the case where imputation classes are formed according to a
categorical variable
with finite support
and whose value is observed on all the units
of a probability sample, denoted
of fixed size
selected from a finite population
of size
We shall focus on the probability proportional
to size (PPS) sampling with replacement or without replacement with negligible
sampling fractions in the paper, but our theory applies to any fixed-size
unequal probability sampling design with replacement. Let
be a variable (or item) of interest with value
observed only for some but not all
due to nonresponse. Let
be the response indicator for
taking the value 1 when the associated
is observed and 0 otherwise. The
are assumed to be independent random variables
across
We assume that
is missing at random (MAR) with uniform
response rate within each imputation class, that is, given the value of
the probability of response of unit
does not depend on the value of
More precisely, this means that, for
for all
such that
where
is a constant.
We
aim to construct reliable confidence intervals (CIs) for the population mean
of a given function
of
i.e.,
For example, taking
yields the population mean of
and taking
where
is the indicator function, gives the
finite-population distribution function of
at a given value
Note that
can be alternatively defined as the solution
to the population-level estimating equation
in
and similarly, our theory can be readily
extended to constructing CIs for a population parameter
defined by the solution to the equation
for a general smooth estimating function
in
The
empirical likelihood (EL) method, proposed by Owen (1988) for independent and
identically distributed (IID) complete data, has received much attention since
it provides a non-parametric approach to constructing likelihood-ratio-type
confidence intervals. The EL ratio intervals have several desirable properties:
shape and orientation of these intervals are determined entirely by the data
and the intervals are range preserving and transformation invariant (Owen,
2001). Qin and Lawless (1994) studied EL inference for parameters defined by
smooth estimating equations. Wang and Chen (2009) used EL and imputation to
handle IID data that are subject to a MAR assumption. Tang and Qin (2012)
proposed an efficient EL estimator based on an inverse-probability-weighted
imputation for IID MAR data. In the sample survey context, several variants of
EL have been proposed. Chen and Sitter (1999) developed a pseudo EL for complex
surveys with auxiliary information. Chen and Kim (2014) proposed a population
EL. However, neither papers handles the case of missing data. Cai, Qin, Rao and
Winiszewska (2019) proposed an EL method based on imputation for missing survey
data under stratified random sampling. Our paper adapts the method of Cai
et al. (2019) to accommodate unequal probability sampling designs.
We
define a fractionally imputed estimating function of the mean parameter
and propose an EL method based on this imputed
estimating function for PPS sampling with negligible sampling fractions or with
replacement. We derive the asymptotic distributions of the associated maximum
EL estimator (MELE) and EL ratio. Based on these limiting distributions, we
propose two asymptotically correct bootstrap methods for constructing CIs on
Additionally, we show that the usual bootstrap
procedures lead to asymptotically incorrect coverage probabilities when the
number of random draws in the fractional imputation is fixed. Simulation
studies show that the proposed EL-ratio-based bootstrap interval clearly
outperforms the proposed MELE-based bootstrap interval especially when the
inclusion probabilities vary considerably or when the sample size is not too
large.
Section 2 introduces the proposed fractional imputation on a function of the population
mean. Section 3 presents an EL under imputation and its asymptotic
properties. Section 4 gives the proposed bootstrap-EL procedures for
constructing CIs. Section 5 presents results from simulation studies.
Lengthy technical details and proofs are delegated to the Appendices.
ISSN : 1492-0921
Editorial policy
Survey Methodology publishes articles dealing with various aspects of statistical development relevant to a statistical agency, such as design issues in the context of practical constraints, use of different data sources and collection techniques, total survey error, survey evaluation, research in survey methodology, time series analysis, seasonal adjustment, demographic studies, data integration, estimation and data analysis methods, and general survey systems development. The emphasis is placed on the development and evaluation of specific methodologies as applied to data collection or the data themselves. All papers will be refereed. However, the authors retain full responsibility for the contents of their papers and opinions expressed are not necessarily those of the Editorial Board or of Statistics Canada.
Submission of Manuscripts
Survey Methodology is published twice a year in electronic format. Authors are invited to submit their articles in English or French in electronic form, preferably in Word to the Editor, (statcan.smj-rte.statcan@canada.ca, Statistics Canada, 150 Tunney’s Pasture Driveway, Ottawa, Ontario, Canada, K1A 0T6). For formatting instructions, please see the guidelines provided in the journal and on the web site (www.statcan.gc.ca/SurveyMethodology).
Note of appreciation
Canada owes the success of its statistical system to a long-standing partnership between Statistics Canada, the citizens of Canada, its businesses, governments and other institutions. Accurate and timely statistical information could not be produced without their continued co-operation and goodwill.
Standards of service to the public
Statistics Canada is committed to serving its clients in a prompt, reliable and courteous manner. To this end, the Agency has developed standards of service which its employees observe in serving its clients.
Copyright
Published by authority of the Minister responsible for Statistics Canada.
© Her Majesty the Queen in Right of Canada as represented by the Minister of Industry, 2019
Use of this publication is governed by the Statistics Canada Open Licence Agreement.
Catalogue No. 12-001-X
Frequency: Semi-annual
Ottawa