If They Don’t Understand the Question, They Don’t answer. Language Mismatch in Face-to-Face Interviews

Ahlmark, N., M.H. Algren, T. Holmberg, M.L. Norredam, S.S. Nielsen, A.B. Blom, and K. Juel. 2015. “Survey nonresponse among ethnic minorities in a national health survey – a mixed-method study of participation, barriers, and potentials.” Ethnicity & Health 20(6): 611–632. DOI: https://doi.org/10.1080/13557858.2014.979768.10.1080/13557858.2014.97976825411892 Search in Google Scholar

Benstead, L J. 2013. “Effects of interviewer–respondent gender interaction on attitudes toward women and politics: Findings from Morocco.” International Journal of Public Opinion Research 26(3): 369–282. DOI: https://doi.org/10.1093/ijpor/edt024.10.1093/ijpor/edt024 Search in Google Scholar

Cenoz, J. 2013. Defining Multilingualism. Annual Review of Applied Linguistics 33: 3–18. DOI: https://doi.org/10.1017/S026719051300007X.10.1017/S026719051300007X Search in Google Scholar

Converse, J.M., and S. Presser. 1986. Survey questions: Handcrafting the standardized questionnnaire. Newbury Park: Sage.10.4135/9781412986045 Search in Google Scholar

Couper, M.P., P. Berglund, N. Kirgis, and S. Buageila. 2016. “Using text-to-speech (TTS) for audio computer-assisted self-interviewing (ACASI).” Field Methods 28(2): 95–111. DOI: https://doi.org/10.1177/1525822X14562350.10.1177/1525822X14562350 Search in Google Scholar

Couper, M.P., R. Tourangeau, and T. Marvin. 2009. “Taking the audio out of audio-CASI.” Public Opinion Quartely 73(2): 281–303. DOI: https://doi.org/10.1093/poq/nfp025.10.1093/poq/nfp025 Search in Google Scholar

Coutts, E., and B. Jann. 2011. “Sensitive questions in online surveys: Experimental results for the randomized response technique (RRT) and the unmatched count technique (UCT).” Sociological Methods & Research 40(1): 169–193. DOI: https://doi.org/10.1177/0049124110390768.10.1177/0049124110390768 Search in Google Scholar

Eckman, S., and F. Kreuter. 2018. “Misreporting to Looping Questions in Surveys: Recall, Motivation and Burden.” Survey Research Methods 12(1): 59–74. DOI: https://doi.org/10.18148/srm/2018.v12i1.7168. Search in Google Scholar

Elliott, M.N., W.S. Edwards, D.J. Klein, and A. Heller. 2012. “Differences by survey language and mode among chinese respondents to a CAHPS health plan survey.” Public Opinion Quartely 76(2): 238–264. DOI: https://doi.org/10.1093/poq/nfs020.10.1093/poq/nfs020 Search in Google Scholar

Glemser, A., S. Huber, and I. Leven. 2017. “Report 2016 from kantar public (Samples M1-4).” In SOEP Wave Report 2016, edited by J. Britzke and J. Schupp: 43–54. Berlin: SOEP–The German Socio-Economic Panel study at DIW Berlin. Available at: https://www.diw.de/documents/publikationen/73/diw_01.c.560446.de/wave_report_2016.pdf. Search in Google Scholar

Greenfield, M. 2009. “Reaching gypsies and travellers.” Primary Health Care 19(8): 26–27. DOI: https://doi.org/10.7748/phc2009.10.19.8.26.c7301.10.7748/phc2009.10.19.8.26.c7301 Search in Google Scholar

Harkness, J.A. 2003. “Questionnaire Translation.” In Cross-Cultural Survey Methods, edited by J.A. Harkness, F.J.R. van de Vijer and P.P. Mohler: 35–56. Hoboken: John Wiley & Sons. Search in Google Scholar

Harkness, J.A., F.J.R. van de Vijver, and P.P. Mohler. 2003. Cross-Cultural Survey Methods, Hoboken: John Wiley & Sons. Search in Google Scholar

Harkness, J.A. 2007. “Improving the comparability of translations.” In Measuring Attitudes Cross-Nationally: Lessons from the European Social Survey, edited by R. Jowell, C. Roberts, R. Fitzgerald, and G. Eva: 79–94. London: Sage. Search in Google Scholar

Harkness, J.A., B.-E. Pennell, and A. Schoua-Glusberg. 2004. “Survey questionnaire translation and assessment.” In Methods for Testing and Evaluating Survey Questionnaires, S. Presser, J.M. Rothgeb, M P. Couper, J.T. Lessler, E. Martin, J. Martin and E. Singer: 453–474. New Jersey: Wiley & Sons.10.1002/0471654728.ch22 Search in Google Scholar

Holbrook, A.L., Y.I. Cho, and T.P. Johnson. 2006. The Impact of Question and Respondent Characteristics and Mapping Difficulties. Public Opinion Quarterly 70 (4): 565–595. DOI: https://doi.org/10.1093/poq/nfl027.10.1093/poq/nfl027 Search in Google Scholar

Jacobsen, J. 2018. “Language barriers during the fieldwork of the IAB-BAMF-SOEP Survey of Refugees in Germany.” In Surveying the Migrant Population: Consideration of Linguistic and Cultural Issues, edited by D. Behr: 75–84. Köln: Gesis. Search in Google Scholar

Jacobsen, J., and L.M. Fuchs. 2020. “Can We Compare Conceptions of Democracy in Cross-Linguistic and Cross-National Research? Evidence from a Random Sample of Refugees in Germany.” Social Indicators Research 151: 669–690. DOI: https://doi.org/10.1007/s11205-020-02397-6.10.1007/s11205-020-02397-6 Search in Google Scholar

Jacobsen, J., J. Klikar, and J. Schupp. 2017. Scales manual IAB-BAMF-SOEP Survey of Refugees in Germany – revised version. Berlin: DIW/SOEP. (SOEP Survey Papers 475: Series C – Data Documentation). Available at: https://www.diw.de/documents/publikationen/73/diw_01.c.572342.de/diw_ssp0475.pdf. Search in Google Scholar

Jann, B., J. Jerke, and I. Krumpal. 2012. “Asking sensitive questions using the crosswise model: An experimental survey measuring plagiarism.” Public Opinion Quarterly 76(1): 32–49. DOI: https://doi.org/10.1093/poq/nfr036.10.1093/poq/nfr036 Search in Google Scholar

Jaworski, J., L. Pagel, and J. Schupp. 2017. “Zuordnung und Überführung erworbener Bildungsabschlüsse in das internationale Bildungs klassifikations system (ISCED).” Politikeratung kompakt 123: 21–28. DOI: http://hdl.handle.net/10419/176772. Search in Google Scholar

Jesske, B. 2018. “Surveying migrants in the context of the low-income panel PASS.” In Surveying the Migrant Population: Consideration of Linguistic and Cultural Issues, edited by D. Behr: 85–94. Köln: GESIS. Search in Google Scholar

Johnson, T.P, D.P. O’Rourke, N. Chavez, S. Sudman, R.B. Warnecke, and L. Lacey. 1997. “Social Cognition and Responses to Survey Questions among Culturally Diverse Populations,” in Survey Measurement and Process Quality, edited by L. Lyberg, P. Biemer, M. Collins, E.D. de Leeuw, C. Dippo, N. Schwarz, and D. Trewin: 87–113, New York: John Wiley & Sons.10.1002/9781118490013.ch4 Search in Google Scholar

Johnson T.P.,Y.I. Cho, A. Holbrook, D. O’Rourke, R.B. Warnecke, and N. Chávez. 2006. “Culturalvariability in the effects of question design featureson respondent comprehension of health surveys.” Annals of Epidemiology 16(9): 661–668. DOI: https://doi.10.1016/j.annepidem.2005.11.011.10.1016/j.annepidem.2005.11.011 Search in Google Scholar

Kieruj, N.D., J. Mulder, A. Wijnant, S. Douhou, and F. Conrad. 2013. Hearing voices: supporting online questionnaires with text-to-speech technology. Paper presented at the Priority Programme on Survey Methodology, Bremen. Search in Google Scholar

Kish, L. 1962. “Studies of interviewers variance for attitudinal variables.” Journal of the American Statistical Association 57(279): 91–115.10.1080/01621459.1962.10482153 Search in Google Scholar

Kleiner, B., O. Lipps, and E. Ferrez. 2015. “Language Ability and Motivation Among Foreigners inb Survey Responding.” Journal of Survey Statistics and Methodology 3(3): 339–360. DOI: https://doi.org/10.1093/jssam/smv015.10.1093/jssam/smv015 Search in Google Scholar

Kosyakova, Y., L. Olbrich, J.W. Sakshaug, and S. Schwanhäuser. 2019. “Identification of interviewer falsification in the IAB-BAMF-SOEP Survey of Refugees in Germany.” FDZ Methodenreport 2019(2). DOI: https://doi.org/10.5164/IAB.FDZM.1902.en.v1. Search in Google Scholar

Kosyakova, Y., J. Skopek, and S. Eckman. 2015. “Do interviewers manipulate responses to filter questions? evidence from a multilevel approach.” International Journal of Public Opinion Research 27(3): 417–431. DOI: https://doi.org/10.1093/ijpor/edu027.10.1093/ijpor/edu027 Search in Google Scholar

Kreuter, F., S. McCulloch, S. Presser, and R. Tourangeau. 2011. “The effect of asking filter questions in interleafed versus grouped format.” Sociological Methods & Research 40(1): 88–104. DOI: https://doi.org/10.1177/0049124110392342.10.1177/0049124110392342 Search in Google Scholar

Kroenke, K., R.L. Spitzer, J.B.W. Williams, and B. Löwe. 2009. “An ultra brief screening scale for anxiety and depression: The PHQ-4.” Psychosomatics 50(6): 613–621. DOI: https://doi.org/10.1016/S0033-3182(09)70864-3.10.1016/S0033-3182(09)70864-3 Search in Google Scholar

Kroh, M., S. Kühne, J. Goebel, and F. Preu. 2015. The 2013 IAB-SOEP Migration Sample (M1): Sampling design and weighting adjustment. Berlin: DIW/SOEP. (SOEP Survey Papers 271: Series C – Data Documentation). Available at: https://www.diw.de/documents/publikationen/73/diw_01.c.570750.de/diw_ssp0271.pdf. Search in Google Scholar

Kroh, M., S. Kühne, J. Jacobsen, M. Siegert, and R. Siegers. 2017. Sampling, nonresponse, and integrated weighting of the 2016 IAB-BAMF-SOEP Survey of Refugees (M3/M4). Berlin: DIW/SOEP. (SOEP Survey Papers 477: Series C – Data Documentation). Available at: https://www.diw.de/documents/publikationen/73/diw_01.c.572346.de/diw_ssp0477.pdf. Search in Google Scholar

Krosnick, J.A. 1991. “Response strategies for coping with the cognitive demands of aittude measures in surveys.” Applied Cognitive Psychology 5: 213–236. DOI: https://doi.org/10.1002/acp.2350050305.10.1002/acp.2350050305 Search in Google Scholar

Krosnick, J.A. 1999. “Survey research.” Annual Review of Psychology 50: 537–567. DOI: https://doi.org/10.1146/annurev.psych.50.1.537.10.1146/annurev.psych.50.1.53715012463 Search in Google Scholar

Krumpal, I. 2013. “Determinants of social desirability bias in sensitive surveys: a literature review.” Quality & Quantity 47(4): 2025–2047. DOI: https://doi.org/10.1007/s11135-011-9640-9.10.1007/s11135-011-9640-9 Search in Google Scholar

Kühne, S., J. Jacobsen, and M. Kroh. 2019. “Sampling in Times of High Immigration: The Survey Process of the IAB-BAMF-SOEP Survey of Refugees.” Survey Methods: Insights from the Field. DOI: https://doi.org/10.13094/SMIF-2019-00005. Search in Google Scholar

Kühne, S., and M. Kroh. 2017. The 2015 IAB-SOEP Migration Study M2: Sampling design, nonresponse, and weighting adjustment. Berlin: DIW/SOEP. (SOEP Survey Papers 473: Series C – Data Documentation). Available at: https://www.diw.de/documents/publikationen/73/diw_01.c.571195.de/diw_ssp0473.pdf. Search in Google Scholar

Lambert, D. 1992. “Zero-inflated pisson regression. With an application to defects in manufacturing.” Technometrics 34(1): 1–14. DOI: https://doi.org/10.2307/1269547.10.2307/1269547 Search in Google Scholar

Lenzner, T., L. Kaczmirek, and A. Lenzner. 2010. “Cognitive Burden of Survey Questions and Response Times: A Psycholinguistic Experiment.” Applied Cognitive Psychology 24(7). DOI: https://doi.org/10.1002/acp.1602.10.1002/acp.1602 Search in Google Scholar

Little, R.J., and D.B. Rubin. 2014. Statistical Analysis with Missing Data. 2nd Edition. Hoboken: John Wiley & Sons Search in Google Scholar

Lyberg, L., M. Stange, J. Harkness, P. Mohler, B.-E. Pennell, and L. Japec. 2014. “A review of quality issues associated with studying hard-to-survey populations.” In Hard-to-Survey Populations, edited by R. Tourangeau, B. Edwards, T.P. Johnson, K.M. Wolter and N. Bates: 82–107. Cambridge: Cambridge University Press.10.1017/CBO9781139381635.007 Search in Google Scholar

Massey, D.S. 2014. “Challenges to Surveying Immigrants.” In Hard-to-Survey Populations, edited by R. Tourangeau, B. Edwards, T.P. Johnson, K.M. Wolter and N. Bates: 270–292. Cambridge: Cambridge University Press.10.1017/CBO9781139381635.017 Search in Google Scholar

Mostafa, T., and R.D. Wiggins. 2015. “The impact of attrition and non-response in birth cohort studies: a need to incorporate missingness strategies.” Longitudinal and Life Course Studies 6(2): 131–146. DOI: https://doi.org/10.14301/llcs.v6i2.312.10.14301/llcs.v6i2.312 Search in Google Scholar

Park, H., M.M. Sha, and G. Willis. 2016. Influence of English-Language Proficiency on the Cognitive Processing of Survey Questions. Field Methods 28(4): 415–430. DOI: https://doi.org/10.1177/1525822X16630262.10.1177/1525822X16630262 Search in Google Scholar

Pennell, B.-E., Y. Deshmukh, J. Kelley, P. Maher, J. Wagner, and D. Tomlin. 2014. Disaster Research: Surveying Displaced Persons. In Hard-to-Survey Populations, edited by R. Tourangeau, B. Edwards, T.P. Johnson, K.M. Wolter, and N. Bates, 111–133. Cambridge: Cambridge University Press.10.1017/CBO9781139381635.009 Search in Google Scholar

Pennell, B.-E., K.C. Hibben, L.E. Lyberg, P.P. Mohler, and G. Worki. 2017. “A total survey error perspective on surveys in multinational, multiregional, and multicultural contexts.” In Total Survey Error in Practice, edited by P.P. Biemer, E. de Leeuw, S. Eckman, B. Edwards, F. Kreuter, L.E. Lyberg, N.C. Tucker and B.T. West. Hoboken: Wiley & Sons.10.1002/9781119041702.ch9 Search in Google Scholar

Perez, P., and B. Baffour. 2018. “Respondent mental health, mental disorders and survey interview outcomes.” Survey Research Methods 12(2): 161–176. DOI: https://doi.org/10.18148/srm/2018.v12i2.7225. Search in Google Scholar

Peytcheva, E. 2018. “Can the language of survey administration influence respondents’ answers?” In Advances in Comparative Survey Methods: Multinational, Multiregional, and Multicultural Contexts (3MC), edited by T.P. Johnson, B.-E. Pennell, I.A.L. Stoop and B. Dorer: 325-340. Hoboken, NJ: Wileys and Sons.10.1002/9781118884997.ch15 Search in Google Scholar

Rother, N., D. Schacht, and J.A. Scheible. 2017. “Sprachpotenziale: Sprachkenntnisse und Alphabetisierungsgrad von Geflüchteten.” Politikberatung kompakt 123: 29–42. DOI: http://hdl.handle.net/10419/176772. Search in Google Scholar

SOEp. 2016a. Erhebungsinstrumente der IAB-BAMF-SOEP-Befragung von Geflüchteten 2016: Haushaltsfragebogen, Stichproben M3-M4. Berlin: DIW/SOEP. (SOEP Survey Papers 361: Series A – Survey Instruments). Available at: https://www.econstor.eu/bitstream/10419/183117/1/1032414014.pdf. Search in Google Scholar

SOEp. 2016b. Erhebungsinstrumente der IAB-BAMF-SOEP-Befragung von Geflüchteten 2016: Integrierter Personen- und Biografiefragebogen, Stichproben M3-M4. Berlin: DIW/SOEP. (SOEP Survey Papers 362: Series A – Survey Instruments). Available at: https://www.econstor.eu/bitstream/10419/183118/1/1032416866.pdf. Search in Google Scholar

SOEp. 2018. SOEP-Core v33.1 – Documentation of Person-related Status and Generated Variables in PGEN. Berlin: DIW/SOEP. (SOEP Survey Papers 483: Series D – Varaible Descriptions and Coding). Available at: https://www.diw.de/documents/publikationen/73/diw_01.c.581299.de/diw_ssp0483.pdf. Search in Google Scholar

Survey Research Center. 2016. Guidelines for Best Practice in Cross-Cultural Surveys. Available at: http://ccsg.isr.umich.edu/. Search in Google Scholar

Tourangeau, R., F. Kreuter, and S. Eckmann. 2015. “Motivated misreporting: shaping answers to reduce survey burden.” In Survey Measurements: Techniques, Data Quality and Sources of Error, edited by U. Engel: 24–41. Frankfurt a. M.: Campus. Search in Google Scholar

Tourangeau, R., and T.W. Smith. 1996. “Asking sensitive questions: The impact of data collection mode, question format, and questions context.” Public Opinion Quartely 60(2): 275–304. DOI: https://doi.org/10.1086/297751.10.1086/297751 Search in Google Scholar

Tourangeau, R., L.J. Rips, and K. Rasinski. 2000. The Psychology of Survey Response. Cambridge: Cambridge University Press.10.1017/CBO9780511819322 Search in Google Scholar

Turner, C.F., L. Ku, S.M. Rogers, L.D. Lindberg, J.H. Pleck, and F. Sonenstein. 1998. “Adolescent sexual behavior, drug use and violence: Increased reporting with computer survey technology.” Science 280(8): 867–873. DOI: https://doi.org/10.1126/science.280.5365.867.10.1126/science.280.5365.867 Search in Google Scholar

Von Gostomski, C.B., and M. Pupeter. 2008. “Zufallsbefragung von Ausländern auf Basis des Ausländerzentralregisters: Erfahrungen bei der Repräsentativbefragung “Ausgewählte Migrantengruppen in Deutschland 2006/2007” (RAM).” Methoden, Daten, Analysen 2(2): 149–177. DOI: http://nbn-resolving.de/urn:nbn:de:0168-ssoar-126673. Search in Google Scholar

Warnecke, R.B., T.P. Johnson, N. Chavez, S. Sudman, D.P. O’Rourke, L. Lacey, and J. Horm. 1997. Improving Question Wording in Surveys of Culturally Diverse Populations. Annual Epidemiological Psychology 7: 334–342. DOI: https://doi.org/10.1016/s1047-2797(97)00030-6.10.1016/S1047-2797(97)00030-6 Search in Google Scholar

West, B.T., and A.G. Blom. 2017. “Explaining Interviewer Effects: A Research Synthesis.” Journal of Survey Statistics and Methodology 5(2): 175–211. DOI: https://doi.org/10.1093/jssam/smw024.10.1093/jssam/smw024 Search in Google Scholar

Wenz, A., T. Al Baghal, and A. Gaia. 2021. “Language Proficiency Among Respondents: Implications for Data Quality in a Longitudinal Face-to-Face Survey.” Journal of Survey Statistics and Methodology 9(1): 73–93. DOI: https://doi.org/10.1093/jssam/smz045.10.1093/jssam/smz045 Search in Google Scholar

Zavala-Rojas, D. 2018. “Exploring Language Effects in Crosscultural Survey Research: Does the Language of Administration Affect Answers About Politics?” Methods, data, analyses 12(1): 127–150. DOI: https://doi.org/10.12758/mda.2017.16. Search in Google Scholar