<abstract xmlns="http://www.w3.org/1999/xhtml"><p>In double barreled questions (DBQs) respondents provide one answer to two questions. Assumptions how respondents treat DBQs and how DBQs impact measurement quality are tested in two randomized experiments. DBQs are compared with revisions in which one stimulus was retained while the other stimulus was skipped. The observed means and parameters when modeling latent variables differed among the versions. Metric and scalar measurement invariance was not given among the versions, and at least one single stimulus version was found to be associated with a higher validity. Response latencies did not differ among versions or respondents needed less time to respond to DBQs. The author concludes that respondents may understand the stimuli in a DBQ differently, and access one of them while disregarding the other, which can have an adverse effect on validity.</p></abstract>

In double barreled questions (DBQs) respondents provide one answer to two questions. Assumptions how respondents treat DBQs and how DBQs impact measurement quality are tested in two randomized experiments. DBQs are compared with revisions in which one stimulus was retained while the other stimulus was skipped. The observed means and parameters when modeling latent variables differed among the versions. Metric and scalar measurement invariance was not given among the versions, and at least one single stimulus version was found to be associated with a higher validity. Response latencies did not differ among versions or respondents needed less time to respond to DBQs. The author concludes that respondents may understand the stimuli in a DBQ differently, and access one of them while disregarding the other, which can have an adverse effect on validity.

Double Barreled Questions: An Analysis of the Similarity of Elements and Effects on Measurement Quality

Journal of Official Statistics

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

In double barreled questions (DBQs) respondents provide one answer to two questions. Assumptions how respondents treat DBQs and how DBQs impact measurement...

Double Barreled Questions: An Analysis of the Similarity of Elements and Effects on Measurement Quality

Data publikacji: 10 gru 2020

Zakres stron: 855 - 886

Otrzymano: 01 mar 2019

Przyjęty: 01 sie 2020

DOI: https://doi.org/10.2478/jos-2020-0041

Słowa kluczowe
Question wording, double barreled questions, validity, comparability, measurement invariance

© 2020 Natalja Menold, published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Double Barreled Questions: An Analysis of the Similarity of Elements and Effects on Measurement Quality

Data publikacji: 10 gru 2020

Zakres stron: 855 - 886

Otrzymano: 01 mar 2019

Przyjęty: 01 sie 2020

DOI: https://doi.org/10.2478/jos-2020-0041

Słowa kluczoweQuestion wording, double barreled questions, validity, comparability, measurement invariance

© 2020 Natalja Menold, published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Słowa kluczowe
Question wording, double barreled questions, validity, comparability, measurement invariance