Survey Methodology
Is undesirable answer behaviour consistent across surveys? An investigation into respondent characteristics
by Frank Bais, Barry Schouten and Vera ToepoelNote 1
- Release date: June 21, 2022
Abstract
In this study, we investigate to what extent the respondent characteristics age and educational level may be associated with undesirable answer behaviour (UAB) consistently across surveys. We use data from panel respondents who participated in ten general population surveys of CentERdata and Statistics Netherlands. A new method to visually present UAB and an inventive adaptation of a non-parametric effect size measure are used. The occurrence of UAB of respondents with specific characteristics is summarized in density distributions that we refer to as respondent profiles. An adaptation of the robust effect size Cliff’s Delta is used to compare respondent profiles on the potentially consistent occurrence of UAB across surveys. Taking all surveys together, the degree of UAB varies by age and education. The results do not show consistent UAB across individual surveys: Age and educational level are associated with a relatively higher occurrence of UAB for some surveys, but a relatively lower occurrence for other surveys. We conclude that the occurrence of UAB across surveys may be more dependent on the survey and its items than on respondent’s cognitive ability.
Key Words: Respondent profiles; Answer behaviour consistency; Adapted Cliff’s Delta; Measurement error; Cognitive ability; Satisficing.
Table of contents
- Section 1. Introduction
- Section 2. Theoretical framework
- Section 3. Method
- Section 4. Results
- Section 5. Conclusion and discussion
- Acknowlegements
- Appendix A
- References
How to cite
Bais, F., Schouten, B. and Toepoel, V. (2022). Is undesirable answer behaviour consistent across surveys? An investigation into respondent characteristics. Survey Methodology, Statistics Canada, Catalogue No. 12-001-X, Vol. 48, No. 1. Paper available at http://www.statcan.gc.ca/pub/12-001-x/2022001/article/00001-eng.htm.
Note
- Date modified: