Bayesian predictive inference of small area proportions under selection bias
Section 3. Heterogeneous nonignorable selection model
In Section 3.1, we describe the heterogeneous nonignorable
selection (HeS) model. We also show how to perform the computations in Section 3.2.
We show how to fit this model and how to make inference about the small area
proportions. Inference about the small area proportions under the HeS model is
obtained using surrogate samples (Nandram, 2007).
3.1 Methodology
We assume that the sample selection probabilities
have the different supports over the set
for
That is,
have a histogram where the midpoints of the
categories are the
for
These
are assumed known and the
are assumed to be random quantities. For
notational convenience, let
(say),
and
The distribution of the selection
probabilities, given the binary response
is
and
Again, it is worth noting that the
are not selection probabilities.
To accommodate the sample selection scheme, we assume
that
and
for
are different. Note that we consider the
heterogeneity assumption for the sample selection probabilities. We replace the
homogeneity assumption with the heterogeneity assumption for the sample
selection probabilities of the HoS model, so that the sample selection
probabilities have different supports and the distributions of the selection
probabilities are different by areas.
Let
and
denote the selection indicator, the selection
probability and the binary response of the
unit in the
small area in the population respectively.
Essentially, NBBS postulated that the
within the
small area are independently distributed with
Thus, there is a joint probability mass function for the selection
indicator and the response indicator. Therefore, the model that NBBS specified
is a nonignorable selection model (i.e., NBBS assumed that the selection
mechanism is selection not at random (SNAR)). Since there are no data when
(i.e.,
and
are both unobserved), NBBS used the
conditional probability mass function
see the probability mass function in (4) of NBBS.
We have the data
Since the sampling units are independent, the
likelihood function is given by
where
are known. The likelihood function can be
rewritten as
where
is the cell count for category
at
and
is the cell count for category
at
under the area
Note that
and
This likelihood includes the selection bias.
Let
Differences between
and
for some
indicate that there is selection bias. The
likelihood function can be expressed as
We make a one-to-one transformation from
to
via
Note that if
does not depend on
and
are the same. In this case the likelihood
would be the same as the ignorable case. Let
Then the likelihood function can be expressed
as
We assume that
are independent, and we take
where
and
are to be specified. Recall that
has the density
where
and
Finally, a priori we assume
Of course one can use a half Cauchy density but these are very similar.
This latter prior is used to avoid the difficulties associated with improper
priors of the form
(e.g., see Gelman, 2006).
Hence, the joint prior density of
is
Using Bayes’ theorem, the joint posterior density of
given the data
is
To improve the computations, we use the more optimal
Rao-Blackwellization to get the posterior density of
(hence
Given the data, the joint posterior density
can be expressed as
3.2 Computations
By integrating out
from the joint posterior of
given
we get the marginal joint posterior density of
given
The conditional posterior density of
is given by
which we can sample directly.
We obtain a sample of
in the following manner: We draw each element
of
from the conditional posterior density of
using the Metropolis-Hastings algorithm and a
grid method, and then we draw
from the conditional posterior density of
We have monitored the convergence of the
Metropolis-Hastings sampler using trace plots, autocorrelation plots and Geweke
test of stationarity, which showed satisfactory performance.
The conditional posterior densities needed to execute
the Metropolis-Hastings sampler are
and transforming
and
to respectively
and
In above formula, the
and
are conditionally independent.
We use Metropolis steps to sample
and
from conditional distributions
and
respectively. Let
and
For notational convenience, let
and
We choose overdispersed Dirichlet
distributions as proposal densities for
and
In fact, the proposal densities are
and
where
and
for all
Note that as the
and
increase, the dispersion tends to increase in
the Dirichlet distribution.
Assuming that the Metropolis-Hastings sampler is at
then the probability of accepting
is
where
for all
Also, if we assume that the
Metropolis-Hastings sampler is at
then the probability of accepting
is
where
for all
The Metropolis step is obtained as follows: Assume the
Markov chain is at
a random vector
is drawn from the proposal density with
properly chosen
and
is computed. A random uniform deviate
in
is drawn, and if
then random vector
is accepted, otherwise the chain stays at
This algorithm is applied for all
The Metropolis step is utilized in a manner
similar to that for
for all
We generate
and
using the grid method; see CNK. Once we get
the sample from the posterior
by retransforming from
to
we can draw a sample from the posterior distribution of
Once
is estimated, we draw the entire finite
population values,
independently from
This is surrogate sampling (e.g., Nandram,
2007). So we have corrected the observed biased sample and replaced it by a
surrogate sample for
that we obtained from the heterogeneous
nonignorable selection model. We can obtain a sample of
by drawing
from
and by dividing the result by
for all
The selection mechanism is similar to the missing data
mechanism. So it is possible to incorporate missing data into our framework, or
independently (i.e., on its own) we can assume that the missing data are “missing
not at random” and a nonignorable nonresponse model can be used to adjust a
population model, see Nandram and Choi (2010).