Survey Methodology
Robust adaptive survey design for time changes in
mixed-mode response propensities
by Shiya Wu, Harm-Jan Boonstra, Mirjam Moerbeek and Barry SchoutenNote 1
- Release date: December 20, 2024
Abstract
Adaptive survey designs (ASDs) tailor recruitment protocols to population subgroups that are relevant to a survey. In recent years, effective ASD optimization has been the topic of research and several applications. However, the performance of an optimized ASD over time is sensitive to time changes in response propensities. How adaptation strategies can adjust to such variation over time is not yet fully understood. In this paper, we propose a robust optimization approach in the context of sequential mixed-mode surveys employing Bayesian analysis. The approach is formulated as a mathematical programming problem that explicitly accounts for uncertainty due to time change. ASD decisions can then be made by considering time-dependent variation in conditional mode response propensities and between-mode correlations in response propensities. The approach is demonstrated using a case study: the 2014-2017 Dutch Health Survey. We evaluate the sensitivity of ASD performance to 1) the budget level and 2) the length of applicable historic time-series data. We find there is only a moderate dependence on the budget level and the dependence on historic data is moderated by the amount of seasonality during the year.
Key Words: Adaptive survey designs; Bayesian approach; Optimization; Response propensity model; Time series analysis.
Table of contents
- Section 1. Introduction
- Section 2. Methods
- Section 3. Optimizing mode allocation under the Bayesian multilevel time series model
- Section 4. The Dutch Health Survey case study
- Section 5. Discussion
- Appendix A
- Appendix B
- References
How to cite
Wu, S., Boonstra, H.-J., Moerbeek, M. and Schouten, B. (2024). Robust adaptive survey design for time changes in mixed-mode response propensities. Survey Methodology, 50(2), 435-463. Paper available at http://www.statcan.gc.ca/pub/12-001-x/2024002/article/00005-eng.pdf.
Note
- Date modified: