2. Successive difference replication
Stephen Ash
Previous | Next
2.1 Definition of successive
difference replication
F&T present a
method called successive difference replication (SDR) that estimates the
variance from a sample selected with
by mimicking
i.e., SDR is equivalent or nearly equivalent to
. We show how SDR can be used to produce replicate factors and weights
for a general replicate variance estimator that is equivalent to the SD2
estimator. Before we define the SDR estimator in the first theorem, we first
establish some terms and provide a lemma that is used by the theorem.
A row assignment
scheme, or more simply RA, is an assignment of two rows of a matrix to each
unit in the sample. We usually denote the pair of rows as
for unit
A connected loop is an RA that
does not repeat any of the rows, i.e.,
and
for all
and
in the connected loop, and is
circular, i.e.,
for all
and
For example, one possible
connected loop for three observations is (1,2), (2,3), (3,1).
A shift matrix
can be used to move either the rows
or columns of a matrix. We will explain how to move rows, which is similar to
columns. A shift matrix is a square matrix that has all 0s, except a single 1
in each column. If we wanted to move row
to row
we would put a 1 in the
row of the
column and 0s elsewhere. We
emphasize that order is important in applying a shift matrix to another matrix.
The application of
to another square matrix
as
shifts the columns of
and
shifts the rows of
Lemma: Let
be shift matrices, then
Proof. We first define a general block diagonal matrix
that is formed by the square
matrices
as
It can be
shown that if both
and
are block diagonal matrices and
the square matrices
have the same dimensions as
respectively, then
For a given shift matrix, we also
know that
since a one row down shift of a
shift matrix is
With the two previous items, the
lemma follows.
We also define a
one row shift matrix as a shift matrix that either shifts all the rows of
another matrix down one row and the last row moved to the first or shifts all
the rows of another matrix up one row and the last row moved to the last. If
is a one row shift matrix that
moves rows down then it has 1s along the upper superdiagonal and a 1 in the
bottom left entry of the matrix, for example
Similarly, if
is a one row shift matrix that
moves rows up, then it has 1s along the lower superdiagonal and a 1 in the top entry
of the matrix, for example the subsequently defined
Note the property that
and
therefore
We now present the main theorem
of the paper that establishes the conditions under which SDR is equivalent to
SD2.
Theorem 1: Let
be the sample size of a given
sample and
be defined as the
weighted observation vector,
where the order of the observations reflects the sort order of
- (a) Choose
a Hadamard matrix of order
where
- (b) Choose
a RA that assigns two rows
to each unit
in the sample. Let the RA define
connected loops of
units in each connected loop
- (c) Choose
the
rows of
corresponding to the RA to make
the
matrix
The order of the rows of
should correspond to the first
row of the RA. For example, the first row of
should be row
of
the second row should be row
of
etc. Next define the
shift matrix as
where the
one row shift matrices
are defined to identify the
position of the second row
of the RA in
In general, each shift matrix
will be a shift-up, shift-down,
or a
shift matrix (see the
subsequently defined
).
Define the
estimator for each replicate total
as
where the matrix of replicate
factors is
and individual values within the
matrix are defined for each unit
(rows of
) of replicate
(columns of
) as
is a
identity matrix and
is a
vector of 1s. Then the SDR
variance estimator
is equivalent to the sum of
different SD2 estimators.
Proof. The SDR estimator can be written in matrix notation
as
Because
, it can be shown that
With this result, the variance
becomes
The last line
follows from the lemma and has a constant value for any choice of
By noting the block diagonal
structure of
we can write the estimator as
where
corresponds to the vector of the
weighted observations in connected loop
which is a result of partitioning
the weighted observation vector as
The choice of the RA does not
change the result since we know that
is constant for either an up or
down one row shift matrix
Note 1: Theorem 1 defines the SDR estimator in terms of replicate factors, but
we can alternatively express the estimator in terms of replicate weights as
Here,
is the
matrix of replicate weights
defined as
where
is the vector of design weights
for the
units of the sample and the
operator
multiplies element-wise the
vector
by each of the columns of
i.e., if
and
are entries of
and
respectively, then the entries of
are defined as
Note 2: Huang and Bell (2009) similarly defined SDR as a quadratic form and
used it to establish some general properties of the estimator when
is
Our interest lies with the
interpretation of how and how well SDR works. Defining the quadratic form with
shift matrices and connected loops leads to insights into the row assignments
and the efficiency of the estimator.
For a large sample
size, it is not usually practical to use
where
The second theorem shows one way
that we can use
with
to produce a larger Hadamard
matrix
with
that will result in the SDR
estimator being equivalent to the SD2 estimator. The second theorem also builds
upon and clarifies the instructions F&T give for the case of
In F&T's instructions, they
use the term cycle to denote every
units of the sample. Theorem 2
does not make conditions on the RA, but otherwise it does follow the setup of
F&T.
Theorem 2: Let
be the sample size of a given
sample.
- (a) Choose a Hadamard matrix
of order
where
- (b) Choose a RA that assigns rows to
to the sample. Retaining their original order, split
the
sample units
into
cycles. Each
cycle
has
units. Within
each cycle, the RA defines one or more connected loops.
- (c) Choose a seminormal Hadamard matrix
of order
and use it to
define a larger Hadamard matrix
of order
generated from
the original
This can be
done by applying a Welsch construction to
i.e.,
- (d) Choose the
rows of
that correspond
to the RA to make the
matrix
The order of
the rows of
should
correspond to the first row of the RA. Next define the
shift matrix as
where the
shift matrices
identify the
position of the second row
of the RA in
With this
prescription, the SDR estimator is defined as
and is
equivalent to the sum of at least
SD2 estimators.
Proof. The result follows by applying Theorem 1. The specific value of
follows from the fact that each
of the
cycles can have one or more
connected loops, so there will be a total of at least
connected loops.
Example 1: Let
and
choose the nonnormal Hadamard
of
order
The
number of cycles will be
and
the RA within each cycle is given in the second column of Table 2.1 for each
unit. We define
of
16
using a Welsh construction of the original normal Hadamard matrix as
where
Using
we can calculate the replicate
factors for 16 replicates as Table 2.1. In matrix notation,
includes all the rows of
except rows 13 and 16. The rows
of
are ordered by
the first row assigned in the RA.
The shift matrix is defined as
where the shift matrices
corresponding to each cycle are
Table 2.1
Matrix of replicate factors
for example 1
Table summary
This table displays the Matrix of replicate factors . The information is grouped by Unit # 1 (appearing as row headers),
,
, Cycle, Replicate (appearing as column headers).
| Unit # |
RA
|
RA
|
Cycle |
Replicate |
| 1 |
2 |
3 |
4 |
5 |
6 |
7 |
8 |
9 |
10 |
11 |
12 |
13 |
14 |
15 |
16 |
| 1 |
(1,2) |
(1,2) |
1 |
1.7 |
1.0 |
1.7 |
1.0 |
1.7 |
1.0 |
1.7 |
1.0 |
1.7 |
1.0 |
1.7 |
1.0 |
1.7 |
1.0 |
1.7 |
1.0 |
| 2 |
(2,3) |
(2,3) |
0.3 |
1.0 |
1.0 |
1.7 |
0.3 |
1.0 |
1.0 |
1.7 |
0.3 |
1.0 |
1.0 |
1.7 |
0.3 |
1.0 |
1.0 |
1.7 |
| 3 |
(3,4) |
(3,4) |
1.0 |
0.3 |
1.0 |
0.3 |
1.0 |
0.3 |
1.0 |
0.3 |
1.0 |
0.3 |
1.0 |
0.3 |
1.0 |
0.3 |
1.0 |
0.3 |
| 4 |
(4,1) |
(4,1) |
1.0 |
1.7 |
0.3 |
1.0 |
1.0 |
1.7 |
0.3 |
1.0 |
1.0 |
1.7 |
0.3 |
1.0 |
1.0 |
1.7 |
0.3 |
1.0 |
| 5 |
(1,3) |
(5,7) |
1.0 |
1.0 |
1.7 |
1.7 |
1.0 |
1.0 |
0.3 |
0.3 |
1.0 |
1.0 |
1.7 |
1.7 |
1.0 |
1.0 |
0.3 |
0.3 |
| 6 |
(3,1) |
(7,5) |
2 |
1.0 |
1.0 |
0.3 |
0.3 |
1.0 |
1.0 |
1.7 |
1.7 |
1.0 |
1.0 |
0.3 |
0.3 |
1.0 |
1.0 |
1.7 |
1.7 |
| 7 |
(2,4) |
(6,8) |
0.3 |
0.3 |
1.0 |
1.0 |
1.7 |
1.7 |
1.0 |
1.0 |
0.3 |
0.3 |
1.0 |
1.0 |
1.7 |
1.7 |
1.0 |
1.0 |
| 8 |
(4,2) |
(8,6) |
1.7 |
1.7 |
1.0 |
1.0 |
0.3 |
0.3 |
1.0 |
1.0 |
1.7 |
1.7 |
1.0 |
1.0 |
0.3 |
0.3 |
1.0 |
1.0 |
| 9 |
(1,4) |
(9,12) |
1.0 |
0.3 |
1.7 |
1.0 |
1.0 |
0.3 |
1.7 |
1.0 |
1.0 |
1.7 |
0.3 |
1.0 |
1.0 |
1.7 |
0.3 |
1.0 |
| 10 |
(4,3) |
(12,11) |
3 |
1.0 |
1.7 |
1.0 |
1.7 |
1.0 |
1.7 |
1.0 |
1.7 |
1.0 |
0.3 |
1.0 |
0.3 |
1.0 |
0.3 |
1.0 |
0.3 |
| 11 |
(3,2) |
(11,10) |
1.7 |
1.0 |
1.0 |
0.3 |
1.7 |
1.0 |
1.0 |
0.3 |
0.3 |
1.0 |
1.0 |
1.7 |
0.3 |
1.0 |
1.0 |
1.7 |
| 12 |
(2,1) |
(10,9) |
0.3 |
1.0 |
0.3 |
1.0 |
0.3 |
1.0 |
0.3 |
1.0 |
1.7 |
1.0 |
1.7 |
1.0 |
1.7 |
1.0 |
1.7 |
1.0 |
| 13 |
(2,3) |
(14,15) |
4 |
0.3 |
1.0 |
1.0 |
1.7 |
1.7 |
1.0 |
1.0 |
0.3 |
1.7 |
1.0 |
1.0 |
0.3 |
0.3 |
1.0 |
1.0 |
1.7 |
| 14 |
(3,2) |
(15,14) |
1.7 |
1.0 |
1.0 |
0.3 |
0.3 |
1.0 |
1.0 |
1.7 |
0.3 |
1.0 |
1.0 |
1.7 |
1.7 |
1.0 |
1.0 |
0.3 |
Given the replicate factors in Table 2.1, the SDR estimator is equivalent to the sum of five different SD2 estimators, one for each connected loop of the RA, i.e.,
There are a
few items to note with Example 1. First, the number of replicates needed is
greater than the sample size. This happens when
is not constant across all
cycles. The fourth cycle had only two sample units, but we had to use four
replicates from each
because at least one of the
cycles used four rows.
To make the
example more interesting, we chose a nonnormal Hadamard matrix
for
This nonnormal Hadamard was
generated by starting with the normal Hadamard
and reversing the procedure for
finding a normal Hadamard as described by Hedayat and Wallis (1978).Here we simply changed the sign of all units in the second row and then changed all the signs for the second column.
If we would have
used the normal Hadamard matrix
for both
and
the replicate factors for
replicates 1, 5, 9, and 13 would have all been 1.0. We call a replicate a dead replicate when every unit gets a value
of 1.0 and thereby the replicate estimate is equal to the original estimate.In SDR, there is nothing wrong with
dead replicates, it is just the way the replicate factors are distributed by
the Hadamard matrix. With a dead replicate, many of the values of 1.0 are in the dead replicate, and the other replicates are more mixed with values of 1.7 and 0.3. However, all the replicates, even the dead replicates, are needed
in estimation.
The real value of Theorem 2 is in understanding
F&T's original prescription for SDR when
In
F&T, the RA is applied repeatedly to the
rows
of
(skipping the first row of
), where
is
chosen as a normal Hadamard matrix. Replicates are then formed using the
columns
of
If
we apply the larger framework of Theorem 2, we would say that they implicitly
used a normal
which results in
and only includes the first
replicates in the variance
estimator. Since a subset of the replicates needed for SDR to be equivalent to
SD2 is used, we say that the resultant estimator is an approximation of the SD2
estimator.
Example 1 (continued): If we only used the first four replicates of Table 2.1, the SDR estimator would
be equivalent to (2.1) plus the remainder term
that
is defined as
Note that
includes the same number of
positive and negative terms, which do not cancel exactly, but has the result
that
is usually close to zero.Similarly, using replicates 1 to
where
will result in a
that has an equal number of
positive and negative terms. Only
with all the replicates of
will the remainder term
equal 0.
Example 2: The Current Population Survey (CPS) has a monthly sample size of
72,000 households per month (U.S. Census Bureau 2006). CPS has a
two-stage sample design, where a first-stage sample of Primary Sample Units
(PSUs), which are generally counties or groups of counties, are selected and
then in the second-stage households are selected within the sample PSUs.Some PSUs, generally the metropolitan
areas, are selected with certainty, i.e.,
their first-stage probability of selection is 1.0. With the certainty PSUs, the
sample can be treated as the
first-stage sample design in variance estimation, i.e., SDR is applied to produce replicates. In the noncertainty PSUs, Balanced Repeated Replication (BRR)[McCarthy 1966] is applied to produce replicates. Roughly 75% of the sample or 54,000 units are in SR PSUs, where SDR is applied.
The CPS
application of SDR uses a Hadamard matrix with
160 and excludes two rows, i.e.,
158. Replicate weights are
produced for 160 replicates. Although
it may seem like a logical conclusion of the paper, we do not suggest that
CPS should use a Hadamard matrix of order
54,000 or produce 54,000 sets of
replicate weights.That would result
in an unreasonable number of replicates. Instead, we suggest that the subset of 160 replicates used by CPS is large
and therefore provides a reasonable approximation to SD2. Later in the empirical examples, we examine the impact of using a
reduced set of replicates.
2.2 Row assignment when
Until this point
we have assumed a given RA and have not discussed how to generate the RA for a
given sample, where
In this section, we review two
RAs and discuss some considerations about RAs in general. The first RA is similar to the RA described by Sukasih and Jang
(2003) and is intended for use with
and Theorem 2.
RA1: The RA assigns a pair of rows
and
to every
units of the sample, which we
call cycle
where
After
cycles, the RA is repeated until
all units of the sample have been assigned a pair of rows.
Step 1: Sort
the sample in the order in which it was sorted prior to sample selection.
Step 2:
Initialize the cycle number as
and the number of connected loops
as
Step 3: Start the RA at the beginning of a cycle or a connected loop as
Step 4:
Repeat the following RA:
and
until all
rows of the cycle have been used
or the RA becomes a connected loop. Here,
the modulo function or
is defined as the remainder of
the division of
by
If all
rows of the cycle have been used,
start a new cycle: let
and go back to step 3.Otherwise, (end of a connected loop,
but not the end of a cycle) start a new connected loop: let
and go back to step 3.
Step 5: At the end of
cycles, start over with the first
cycle
go back
to step 2.
RA1 has the following characteristics:
- - Each of
the cycles
of the RA, assigns
pairs of rows. This generates a total of
pairs of rows.
- - The RA
repeats itself after
cycles. F&T suggest that after 10 cycles,
the RA be restarted. We suggest that all
cycles be used before restarting the RA.
- - The
values of
and
are always
units apart.
- - Halfway
through the sequence, the pattern repeats itself in reverse order. If
is even, the cycles before and after the
cycle repeat themselves in reverse order.
RA1 differs
from the RA of Sukasih and Jang (2003) in that we do not suggest that row 1 be
skipped, nor that the RA be repeated after 10 cycles, or require that
be prime. First, a row of all 1s may seem odd, but it is not a problem. Similar to a column of all 1s in
which made a dead replicate, a
row of all 1s will only effect the distribution of the replicate factors.The replicate factors for a unit
that are assigned row 1 (either
or
) will have more replicate factors of 1.0 than otherwise. This
is not wrong; it is just how the replicate factors are distributed by
The second difference is that we suggest repeating the assignment after
cycles, which is when the pattern repeat, instead of a fixed number of 10 cycles. Lastly, we do not require that be prime but note that if
and
is prime, then every cycle is
guaranteed to have only one connected loop.
We also provide a second simpler-to-implement RA called RA2 that will be compared with RA1 in the empirical examples.
RA2: No mixing of row assignments. Repeat the same simple RA for every
units, i.e.,
Previous | Next