<abstract xmlns="http://www.w3.org/1999/xhtml">

Collecting life history data is highly demanding and therefore prone to error since respondents must retrieve and provide extensive complex information. Research has shown that response burden is an important factor influencing data quality. We examine whether increases in different measures of response burden in a (mixed-device) online survey lead to adverse effects on the data quality and whether these effects vary by the type of device used (mobile versus non-mobile).
We conducted an experimental study in an online mixed-device survey, for which we developed a questionnaire on the educational and occupational trajectories of secondary-school graduates, undergraduates, and university graduates. To address our research question, we randomly assigned different levels of response burden to the participants and compared different measures on the data quality and response.
We found mixed evidence for unfavourable effects of response burden on the examined outcomes. While some of our results were expected, they were not consistent across all subgroups. Most interestingly, the effects of response burden on outcomes seemed to differ based on the device used. Hence, we conclude that further research is needed to optimise the collection of complex data from different groups of participants.
</abstract>

Collecting life history data is highly demanding and therefore prone to error since respondents must retrieve and provide extensive complex information. Research has shown that response burden is an important factor influencing data quality. We examine whether increases in different measures of response burden in a (mixed-device) online survey lead to adverse effects on the data quality and whether these effects vary by the type of device used (mobile versus non-mobile).
We conducted an experimental study in an online mixed-device survey, for which we developed a questionnaire on the educational and occupational trajectories of secondary-school graduates, undergraduates, and university graduates. To address our research question, we randomly assigned different levels of response burden to the participants and compared different measures on the data quality and response.
We found mixed evidence for unfavourable effects of response burden on the examined outcomes. While some of our results were expected, they were not consistent across all subgroups. Most interestingly, the effects of response burden on outcomes seemed to differ based on the device used. Hence, we conclude that further research is needed to optimise the collection of complex data from different groups of participants.

The Effects of Response Burden – Collecting Life History Data in a Self-Administered Mixed-Device Survey

Journal of Official Statistics

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Collecting life history data is highly demanding and therefore prone to error since respondents must retrieve and provide extensive complex information....

The Effects of Response Burden – Collecting Life History Data in a Self-Administered Mixed-Device Survey

Published Online: Dec 03, 2022

Page range: 1069 - 1095

Received: Jan 01, 2021

Accepted: Dec 01, 2021

DOI: https://doi.org/10.2478/jos-2022-0046

Keywords
Respondent burden, data quality, response behavior, experiment, online survey

© 2022 Johann Carstensen et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

The Effects of Response Burden – Collecting Life History Data in a Self-Administered Mixed-Device Survey

Published Online: Dec 03, 2022

Page range: 1069 - 1095

Received: Jan 01, 2021

Accepted: Dec 01, 2021

DOI: https://doi.org/10.2478/jos-2022-0046

KeywordsRespondent burden, data quality, response behavior, experiment, online survey

© 2022 Johann Carstensen et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Keywords
Respondent burden, data quality, response behavior, experiment, online survey