Estimation and inference of domain means subject to qualitative constraints
Section 6. Conclusions
We
have proposed a general methodology to estimate domain means which makes it possible
incorporate natural restrictions between domains into design-based estimation.
It was shown to improve estimation and inference, especially on small domains.
As this new methodology covers a broad range of shape assumptions beyond
univariate monotonicity, it aims to jointly take advantage of several types of
qualitative information that arises naturally for survey data. Additional
shapes that may be imposed include convexity or log-concavity; the latter might
be imposed if the population domain means are believed to be increasing and
then decreasing over a set of domains. Future work by the authors will include
a “relaxed monotone” estimator to be used when the population domain means are “roughly”
monotone in some sequence of domains. For the relaxed monotone estimator, a
type of moving average over the domains is used to implement the constraints,
allowing the estimator to have some departures from monotonicity.
We
also proposed a design-based variance estimation method of the estimator, which
only requires knowledge of the sample-specific constraint set.
Replication-based methods are shown to behave similarly. From the computational
side, the estimator is based on the Cone Projection Algorithm which is
efficiently implemented in the package coneproj and freely available. In the
important practical case of partial ordering, the constrained estimator is
equivalent to a pooling of neighboring domains, so that once the constraint set
is identified by CPA, subsequent computations of estimators and variance estimators
can be done directly using traditional design-based estimation for the relevant
domains.
An
important practical issue, as illustrated in the NSCG analysis in Section 5, is
the determination of when the imposed constraint might not be valid for a
particular survey application. Recently, Oliva-Aviles, Meyer and Opsomer (2019) proposed the
sample-based Cone Information Criterion as a criterion to choose between the
constrained and unconstrained fits for the estimator of Wu et al. (2016).
That approach is generalizable to the setting considered here, and is currently
under development.
Appendix
The
first part of this appendix contains lemmas used to obtain the theoretical
results discussed in this paper. Proofs of the theorems are included at the end
of this appendix.
Lemma 1. If a
non-zero vector can be written as the positive linear combination of linearly
dependent non-zero vectors, then it can be expressed as the positive linear
combination of a linearly independent subset of these.
Proof. Let
be a
non-zero vector such that it can be written as
where
are
non-zero vectors and
for
If this
set of vectors is not linearly independent, then there exist constants
not all
zero, such that
and for
any
Let
then
for
but for
at least one
Then we
have written
as a
positive linear combination of a proper subset of the vectors. If this subset
is still linearly dependent, the process can be repeated.
Lemma 2. If
is a
irreducible matrix and
is a
nonsingular matrix, then
is also irreducible.
Proof. Suppose
for some
Then
implies
that
by the
non-singularity of
Because
is
irreducible, we must have
so the
origin is not a positive linear combination of rows of
Next,
suppose that one of the rows of
is a
positive linear combination of other rows of
This
means we can write
where
for some
and
But
implies
that
implies
that
by the
non-singularity of
We can’t
have
for this
so we
can’t have a row of
is a
positive linear combination of other rows of
Therefore,
is
irreducible.
Lemma 3. Let
be a
matrix. Also, let
and
be
diagonal matrices with nonzero elements on the
diagonal. For any set
denote
to be the set of vectors in rows
of
Then, for any
Proof. Let
where
denotes
the submatrix of
that
contains the rows in positions
First,
assume that
Since
it is
straightforward to see that
Now,
consider any
so that
for some
vector
Then, we
have
By
assumption, there exists a vector
such
that
Therefore,
Thus,
Analogously, it follows that
implies
Lemma 4. Under
Assumptions A1-A5, the following statements hold:
(i)
The
are uniformly
bounded.
(ii)
The
are uniformly
bounded above and uniformly bounded away from zero.
(iii)
var
and var
(iv)
and
Proof.
(i)
Note
that
which does not depend on
and is
bounded independently of
by
Assumption A2.
(ii)
From Assumptions A4 and A5, note that
where both lower and upper bounds do
not depend on
and are bounded for all
by Assumptions A1 and A4.
(iii)
Note that
which is bounded by Assumptions A2, A4 and A5. Setting
and
following an analogous argument, it can be shown that
(iv)
Since
Assumption A3 and (iii) lead to the
desired conclusion. Analogously, we find
Proof of
Theorem 1. First, suppose
that
In that
case, any subset
such
that
is
linearly independent will satisfy
Hence,
it is enough to choose
such
that
is
linearly independent and spans
Now,
suppose that
Since
can be
written as the positive linear combination of vectors
Moreover,
for
From
Lemma 1, there exists
such
that
is
linearly independent and
can be
written as a positive linear combination of the vectors in
which
implies that
In
addition, since
for
Thus,
If
then
satifies
all required conditions. Now, assume that
The fact
that
implies
that
for any
set
such
that
Further,
since
then
Thus, it
is enough to choose the set
such
that
and
is a
linearly independent set that spans
Proof of
Theorem 2. To prove this
theorem, we start with a set
and find
necessary conditions for such set to belong to
These
necessary conditions, expressed as inequalities in terms of smooth and
continuous functions of the
and the
are then
used to bound the probability of interest. Finally, we use Theorem 5.4.3
in Fuller (1996) to show that this probability converges to zero with a rate of
Let
and
be the analogous versions of
and
obtained by substituting
and
by
and
respectively. Lemma 2 ensures that both
and
are irreducible since
is.
First,
suppose
and let
Then, from conditions in (2.8),
if and only if
for
In contrast, suppose that
for
Hence,
which contradicts our choice of
Therefore, there exists
such that
Then, we have
where the
last inequality is obtained by an application of Markov’s inequality (see for
example Casella and Berger (2002), Section 3.6.1). We show now that the
expected value in the last term is
Note
that the expression inside of the expected value in the above inequality is a
function of vector
Let
be such a
function (which does not depend on
and
denote
To apply
Theorem 5.4.3 in Fuller (1996) with
and
first we
need to show that the following conditions are satisfied:
(a)
(b)
is uniformly
bounded in a closed and bounded sphere
(c)
is
continuous in
over
where
(d)
is an
interior point of
(e) There is a finite number
such that
Condition (a)
is directly met by Lemma 4 (iv). In addition, Lemma 4 (i)-(ii)
guarantees that there exist a constant
such
that
and
Hence,
there exists a closed and bounded sphere
that it
is contained within these constant bounds. Moreover, from Assumption A3, we can
conclude that
so
condition (d) is satisfied. To show that condition (b) is met, note that
is a
continuous function in
since
both
and
exist
for any
Therefore, the Extreme
Value Theorem (see Theorem 4.15 in Rudin (1976)) ensures that
is
uniformly bounded in
Conditions (c) and (e)
are satisfied since
is a
continuous rational function in
implying that
is infinitely
differentiable and its derivatives are bounded in
Finally, all conditions
(a)-(e) are fulfilled. Therefore, from Theorem 5.4.3 in Fuller (1996), we
can conclude that
since
and its
first derivative with respect to the
and
evaluate
to zero at
Now,
take any
such that
and assume that
Theorem 1 guarantees that we can always
choose a subset
such that
is linearly independent, and
Note that
Let
Hence, from conditions in (2.8), we have that
implies that
and
for any
Define
and assume that
and
for
These conditions would imply that
contradicting the original assumption that
since
from Lemma 3. Therefore, either there is
an element of
that is strictly negative or there exists
such that
Hence, proving that
in any of these two scenarios will conclude
the proof.
Suppose
the
element of
is strictly negative. That is,
where
denotes the indicator vector that is 1 for
entry
and 0 otherwise. Then, we have
Denote
to the
expression inside the above expected value. An analogous argument to the one
used for the function
can be
applied to the rational continuous function
over
to
conclude that
Note
that we also used the fact that
is an
invertible matrix for any
Lastly,
suppose there exists
such that
and denote
Then, we have
Denote
to the
expression inside the above expected value. An analogous argument to the one
used for the functions
is
applied to conclude that
Proof of
Theorem 3. Take any
and any
domain
Note
that the condition
implies
that
Then, we
can write
as
where we used
that
Now, an
unfeasible variance estimator
can be
written as
Hence,
where
is the
population version of
A first
order term Taylor expansion of
and
Assumption A6 allow to conclude that each term of the form
converges in
distribution to a standard normal distribution. Therefore,
also
converges to a standard normal distribution. Note that for each
while
by
Theorem 2 (since
Thus,
Now,
note that
when
by
Assumption A3. Hence, for any
which implies
that
(bias
term). Thus, by combining these properties of
and
we
conclude that
where
Now,
write the feasible variance estimator
as
By Assumption
A6, we have that
for any
which
implies that
Hence,
an application of Slutsky’s theorem allows to replace
by
To
prove the last part of this theorem, just note that
implies
Thus, the term
does not exist and the bias term vanishes.
References
Bickel, P.J.,
and Freedman, D.A. (1984). Asymptotic normality and the bootstrap in stratified
sampling. Annals of Statistics, 12,
470-482.
Breidt, F.J.,
Opsomer, J.D. and Sanchez-Borrego, I. (2016). Nonparametric variance estimation
under fine stratification: An alternative to collapsed strata. Journal of the American Statistical
Association, 111(514), 822-833.
Casella, G.,
and Berger, R.L. (2002). Statistical
Inference. Duxbury, 2nd Edition.
Fuller, W.
(1996). Introduction to Statistical Time
Series. 2nd Edition, New York: John Wiley & Sons, Inc.
Hájek, J.
(1960). Limiting distributions in simple random sampling from a finite
population. Publications of the
Mathematical Institute of the Hungarian Academy of Sciences, 5, 361-374.
Kott, P.S.
(2001). The delete-a-group jackknife. Journal
of Official Statistics, 17, 521-526.
Krewski, D.,
and Rao, J.N.K. (1981). Inference from stratified samples: Properties of the linearization,
jackknife and balanced repeated replication methods. Annals of Statistics, 9, 1010-1019.
Liao, X., and
Meyer, M.C. (2014). coneproj: an R package for the primal or dual cone projections
with routines for constrained regression. Journal
of Statistical Software, 61, 1-22.
Meyer, M.C.
(1999). An extension of the mixed primal-dual bases algorithm to the case of more
constraints than dimensions. Journal of
Statistical Planning and Inference, 81, 13-31.
Meyer, M.C.
(2013). A simple new algorithm for quadratic programming with applications in
statistics. Communications in Statistics,
42, 1126-1139.
Oliva-Aviles,
C., Meyer, M.C. and Opsomer, J.D. (2019). Checking validity of monotone domain
mean estimators. Canadian Journal of
Statistics, 47(2), 315-331.
Opsomer, J.D.,
Breidt, F.J., White, M. and Li, Y. (2016). Succesive difference replication variance
estimation in two-phase sampling. Journal
of Survey Statistical Methodology, 4(1), 43-70.
Robertson, T.,
Wright, F.T. and Dykstra, R.L. (1988). Order
Restricted Statistical Inference. New York: John Wiley & Sons, Inc.
Rockafellar,
R.T. (1970). Convex Analysis. New
Jersey: Princeton University Press.
Rudin, W.
(1976). Principles of Mathematical
Analysis. New York: McGraw Hill.
Rueda, C., and Lombardía,
M. (2012). Small area semiparametric additive monotone models. Statistical Modelling, 12(6), 527-549.
Särndal, C.-E.,
Swensson, B. and Wretman, J. (1992). Model
Assisted Survey Sampling. New York: Springer.
Wu, J., Meyer,
M.C. and Opsomer, J.D. (2016). Survey estimation of domain means that respect
natural orderings. Canadian Journal of
Statistics, 44(4), 431-444.