<abstract xmlns="http://www.w3.org/1999/xhtml"><p>In double barreled questions (DBQs) respondents provide one answer to two questions. Assumptions how respondents treat DBQs and how DBQs impact measurement quality are tested in two randomized experiments. DBQs are compared with revisions in which one stimulus was retained while the other stimulus was skipped. The observed means and parameters when modeling latent variables differed among the versions. Metric and scalar measurement invariance was not given among the versions, and at least one single stimulus version was found to be associated with a higher validity. Response latencies did not differ among versions or respondents needed less time to respond to DBQs. The author concludes that respondents may understand the stimuli in a DBQ differently, and access one of them while disregarding the other, which can have an adverse effect on validity.</p></abstract>

In double barreled questions (DBQs) respondents provide one answer to two questions. Assumptions how respondents treat DBQs and how DBQs impact measurement quality are tested in two randomized experiments. DBQs are compared with revisions in which one stimulus was retained while the other stimulus was skipped. The observed means and parameters when modeling latent variables differed among the versions. Metric and scalar measurement invariance was not given among the versions, and at least one single stimulus version was found to be associated with a higher validity. Response latencies did not differ among versions or respondents needed less time to respond to DBQs. The author concludes that respondents may understand the stimuli in a DBQ differently, and access one of them while disregarding the other, which can have an adverse effect on validity.

Double Barreled Questions: An Analysis of the Similarity of Elements and Effects on Measurement Quality

Journal of Official Statistics

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

In double barreled questions (DBQs) respondents provide one answer to two questions. Assumptions how respondents treat DBQs and how DBQs impact measurement...

Double Barreled Questions: An Analysis of the Similarity of Elements and Effects on Measurement Quality

Publié en ligne: 10 déc. 2020

Pages: 855 - 886

Reçu: 01 mars 2019

Accepté: 01 août 2020

DOI: https://doi.org/10.2478/jos-2020-0041

Mots clés
Question wording, double barreled questions, validity, comparability, measurement invariance

© 2020 Natalja Menold, published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Double Barreled Questions: An Analysis of the Similarity of Elements and Effects on Measurement Quality

Publié en ligne: 10 déc. 2020

Pages: 855 - 886

Reçu: 01 mars 2019

Accepté: 01 août 2020

DOI: https://doi.org/10.2478/jos-2020-0041

Mots clésQuestion wording, double barreled questions, validity, comparability, measurement invariance

© 2020 Natalja Menold, published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Mots clés
Question wording, double barreled questions, validity, comparability, measurement invariance