<abstract xmlns="http://www.w3.org/1999/xhtml"><p>In double barreled questions (DBQs) respondents provide one answer to two questions. Assumptions how respondents treat DBQs and how DBQs impact measurement quality are tested in two randomized experiments. DBQs are compared with revisions in which one stimulus was retained while the other stimulus was skipped. The observed means and parameters when modeling latent variables differed among the versions. Metric and scalar measurement invariance was not given among the versions, and at least one single stimulus version was found to be associated with a higher validity. Response latencies did not differ among versions or respondents needed less time to respond to DBQs. The author concludes that respondents may understand the stimuli in a DBQ differently, and access one of them while disregarding the other, which can have an adverse effect on validity.</p></abstract>

In double barreled questions (DBQs) respondents provide one answer to two questions. Assumptions how respondents treat DBQs and how DBQs impact measurement quality are tested in two randomized experiments. DBQs are compared with revisions in which one stimulus was retained while the other stimulus was skipped. The observed means and parameters when modeling latent variables differed among the versions. Metric and scalar measurement invariance was not given among the versions, and at least one single stimulus version was found to be associated with a higher validity. Response latencies did not differ among versions or respondents needed less time to respond to DBQs. The author concludes that respondents may understand the stimuli in a DBQ differently, and access one of them while disregarding the other, which can have an adverse effect on validity.

Double Barreled Questions: An Analysis of the Similarity of Elements and Effects on Measurement Quality

Journal of Official Statistics

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

In double barreled questions (DBQs) respondents provide one answer to two questions. Assumptions how respondents treat DBQs and how DBQs impact measurement...

Double Barreled Questions: An Analysis of the Similarity of Elements and Effects on Measurement Quality

Published Online: Dec 10, 2020

Page range: 855 - 886

Received: Mar 01, 2019

Accepted: Aug 01, 2020

DOI: https://doi.org/10.2478/jos-2020-0041

Keywords
Question wording, double barreled questions, validity, comparability, measurement invariance

© 2020 Natalja Menold, published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Double Barreled Questions: An Analysis of the Similarity of Elements and Effects on Measurement Quality

Published Online: Dec 10, 2020

Page range: 855 - 886

Received: Mar 01, 2019

Accepted: Aug 01, 2020

DOI: https://doi.org/10.2478/jos-2020-0041

KeywordsQuestion wording, double barreled questions, validity, comparability, measurement invariance

© 2020 Natalja Menold, published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Keywords
Question wording, double barreled questions, validity, comparability, measurement invariance