Reaching Hard-to-Survey Populations: Mode Choice and Mode Preference

Ament, P. (2008). Most People on Long-Term Low Incomes Live in Major Cities. Statistics Netherlands. Available at: http://www.cbs.nl (accessed August 2013).Search in Google Scholar

American Association for Public Opinion Research (2011). Standard Definitions: Final Dispositions of Case Codes and Outcome Rates for Surveys. Ann Arbor, MI: AAPOR.Search in Google Scholar

Bates, D. (2005). Fitting Linear Mixed Models in R. R News, 5, 27-30.Search in Google Scholar

Bethlehem, J., Cobben, F., and Schouten, B. (2011). Handbook of Nonresponse in Household Surveys. Hoboken, NJ: Wiley.10.1002/9780470891056Search in Google Scholar

Blohm, M. and Diehl, C. (2001). Wenn Migranten Migranten befragen Zum Teilnahmeverhalten von Einwanderern bei Bevo¨lkerungsbefragungen. Zeitschrift fu¨ r Soziologie, 30, 223-242.10.1515/zfsoz-2001-0304Search in Google Scholar

Blumberg, S.J. and Luke, J.V. (2007). Coverage Bias in Traditional Telephone Surveys of Low-Income and Young Adults. Public Opinion Quarterly, 71, 734-749. DOI: http://www.dx.doi.org/10.1093/poq/nfm04710.1093/poq/nfm047Search in Google Scholar

Brady, S.E., Stapleton, C.N., Bouffard, J.A., and Imel, J.D. (2003). Effect of Alternative Data Collection Modes on Cooperation Rates and Data Quality. Proceedings of the American Statistical Association, Joint Statistical Meetings, Section on Survey Research Methods, 693-700, San Francisco, August 3-7, 2003, http://www.amstat.org/ sections/srms/Proceedings/ (accessed November 2013).Search in Google Scholar

Brøgger, J., Nystad, W., Cappelen, I., and Bakke, P. (2007). No Increase in Response Rate by Adding a Web Response Option to a Postal Population Survey: A Randomized Trial. Journal of Medical Internet Research, 9(5), e40. DOI: http://www.dx.doi.org/10.2196/ jmir.9.5.e4010.2196/jmir.9.5.e40227041618174120Search in Google Scholar

Campanelli, P., Sturgis, P., and Purdon, S. (1997). Can you Hear Me Knocking: an Investigation into the Impact of Interviewers on Survey Response Rates. London: The Survey Methods Centre SCPR.Search in Google Scholar

Conrad, F.G., Schober, M.F., Zhang, C., Yan, H.G., Vickers, L., Johnston, M., Hupp, A., Hemingway, L., Fail, S., Ehlen, P., and Antoun, C. (2013). Mode Choice on an iPhone Increases Survey Data Quality. Paper presented at the Annual Conference of the American Association for Public Opinion Research, Boston., May 16-19, 2013.Search in Google Scholar

Couper, M.P. and Groves, R.M. (1996). Social Environmental Impacts on Survey Cooperation. Quality & Quantity, 30, 173-188. DOI: http://www.dx.doi.org/10.1007/ BF0015398610.1007/BF00153986Search in Google Scholar

Couper, M.P., Kapteyn, A., Schonlau, M., and Winter, J. (2007). Noncoverage and Nonresponse in an Internet Survey. Social Science Research, 36, 131-148. DOI: http://www.dx.doi.org/10.1016/j.ssresearch.2005.10.00210.1016/j.ssresearch.2005.10.002Search in Google Scholar

De Gregorio, J. and Lee, J.W. (2002). Education and Income Inequality: New Evidence from Cross-Country Data. Review of Income and Wealth, 48, 395-416. DOI: http://www.dx.doi.org/10.1111/1475-4991.0006010.1111/1475-4991.00060Search in Google Scholar

De Leeuw, E.D. (2005). To Mix or Not to Mix Data Collection Modes in Surveys.Journal of Official Statistics, 21, 233-255.Search in Google Scholar

De Leeuw, E.D. and Hox, J.J. (1998). Nonrespons in Surveys: Een Overzicht. Kwantitatieve Methoden, 19, 31-53.Search in Google Scholar

De Leeuw, E.D. and van der Zouwen, J. (1992). Data Quality and Mode of Data Collection: Methodology and Explanatory Model. La qualite´ de l’information dans les enquetes, L. Lebart (ed.). Paris: Dunod, 11-31.Search in Google Scholar

Deutskens, E., Ruyter, K., Wetzels, M., and Oosterveld, P. (2004). Response Rate and Response Quality of Internet-Based Surveys: An Experimental Study. Marketing Letters, 15, 21-36. DOI: http://www.dx.doi.org/10.1023/B:MARK.000002196886465.0010.1023/B:MARK.0000021968.86465.00Search in Google Scholar

Dhar, R. (1997). Consumer Preference for a No-Choice Option. Journal of Consumer Research, 24, 215-231.10.1086/209506Search in Google Scholar

Dillman, D.A. (2007). Mail and Internet Surveys: The Tailored Design Method. Hoboken, NJ: Wiley.Search in Google Scholar

Dillman, D.A., Phelps, G., Tortora, R., Swift, K., Kohrell, K., Berck, J., and Messer, B.L. (2009). Response Rate and Measurement Differences in Mixed-Mode Surveys Using Mail, Telephone, Interactive Voice Response (IVR) and the Internet. Social Science Research, 38, 1-18.10.1016/j.ssresearch.2008.03.007Search in Google Scholar

Dillman, D.A., West, K.K., and Clark, J.R. (1994). Influence of an Invitation to Answer by Telephone on Response to Census Questionnaires. Public Opinion Quarterly, 58, 557-568. DOI: http://www.dx.doi.org/10.1086/269447 10.1086/269447Search in Google Scholar

Diment, K. and Garrett-Jones, S. (2007). How Demographic Characteristics Affect Mode Preference in a Postal/Web Mixed Mode Survey of Australian Researchers. Social Science Computer Review, 25, 410-417. DOI: http://www.dx.doi.org/10.1177/089443930629539310.1177/0894439306295393Search in Google Scholar

Durrant, G.B. and Steele, F. (2009). Multilevel Modeling of Refusal and Non-Contact in Household Surveys: Evidence from Six UK Government Surveys. Journal of the Royal Statistical Society: Series A (Statistics in Society), 172, 361-381. DOI: http:// www.dx.doi.org/10.1111/j.1467-985X.2008.00565.x 10.1111/j.1467-985X.2008.00565.xSearch in Google Scholar

Feskens, R.C.W. (2009). Difficult Groups in Survey Research and the Development of Tailor-Made Approach Strategies. Utrecht: University of Utrecht.Search in Google Scholar

Feskens, R.C.W., Hox, J.J., Lensvelt-Mulders, G.J.L.M., and Schmeets, J.J.G. (2007). Non-Response Among Ethnic Minorities: a Multivariate Analysis. Journal of Official Statistics, 23, 387-408.Search in Google Scholar

Feskens, R.C.W., Hox, J.J., Lensvelt-Mulders, G.J.L.M., and Schmeets, J.J.G. (2006). Collecting Data Among Ethnic Minorities in an International Perspective. Field Methods, 18, 284-304. DOI: http://www.dx.doi.org/10.1177/1525822X0628875610.1177/1525822X06288756Search in Google Scholar

Friese, C.R., Lee, C.S., O’Brien, S., and Crawford, S.D. (2010). Multi-Mode and Method Experiment in a Study of Nurses. Survey Practice, 3. Available at: http://surveypractice.org/index.php/SurveyPractice/issue/view/32 (accessed August 2013).Search in Google Scholar

Gentry, R. and Good, C. (2008). Offering Respondents a Choice of Survey Mode: Use Patterns of an Internet Response Option in a Mail Survey. Paper presented at the Annual Conference of the American Association for Public Opinion Research, New Orleans., May 15-18, 2008.Search in Google Scholar

Gillian, E., Loosveldt, G., Lynn, P., Martin, P., Revilla, M., Saris, W., and Vannieuwenhuyze, J. (2010). ESS Prep6 - Mixed-Mode Experiment. Deliverable 21Search in Google Scholar

Final Mode Report. Available at: www.europensocialsurvey.org Griffin, D.H., Fischer, D.P., and Morgan, M.T. (2001). Testing an Internet Response Option for the American Community Survey. Paper presented at the Annual Meeting of the American Association for Public Opinion Research, Montreal., May 17-20, 2001.Search in Google Scholar

Groves, R.M. (1977). An Experimental Comparison of National Telephone and Personal.Interview Surveys. Proceedings of the Section on Social Statistics: American Statistical Association, 232-241.Search in Google Scholar

Groves, R.M., Cialdini, R.B., and Couper, M.P. (1992). Understanding the Decision to Participate in a Survey. Public Opinion Quarterly, 56, 475-495. DOI: http://www.dx.doi.org/10.1086/26933810.1086/269338Search in Google Scholar

Groves, R.M. and Couper, M.P. (1998). Nonresponse in Household Interview Surveys. New York: Wiley.10.1002/9781118490082Search in Google Scholar

Groves, R.M., Dillman, D.A., Eltinge, J.L., and Little, R.J.A. (2002). Survey Nonresponse. New York: Wiley.Search in Google Scholar

Groves, R.M. and Kahn, R.L. (1979). Surveys by Telephone: A National Comparison with Personal Interviews. New York: Academic Press.Search in Google Scholar

Goyder, J. (1987). The Silent Minority. Nonsample Members on Sample Surveys. Cambridge: Polity Press.Search in Google Scholar

Goyder, J., Lock, J., and McNair, T. (1992). Urbanization Effects on Survey Non- Response: A Test Within and Across Cities. Quality and Quantity, 26, 39-48. Haan, M. and Ongena, Y.P. (2014). Tailored and Targeted Designs for Hard-to-Survey Populations. In Hard to Survey Populations, R. Tourangeau et al. (eds). Cambridge: Cambridge University Press. (in press).Search in Google Scholar

Hardigan, P.C., Succar, C.T., and Fleischer, J.M. (2012). An Analysis of Response Rate and Economic Costs Between Mail and Web-Based Surveys Among Practicing Dentists: A Randomized Trial. Journal of Community Health, 37, 383-394. DOI: http:// www.dx.doi.org/10.1007/s10900-011-9455-610.1007/s10900-011-9455-621858591Search in Google Scholar

Hoffer, T., Grigorian, K., and Fesco, R. (2007). Effectiveness of Using Respondent Mode Preference Data. Paper presented at the Joint Statistical Meetings of the American Statistical Association, Salt Lake City., July 29-August 2, 2007.Search in Google Scholar

Holbrook, A.L., Green, M.C., and Krosnick, J.A. (2003). Telephone vs. Face-to-Face Interviewing of National Probability Samples with Long Questionnaires: Comparisons of Respondent Satisficing and Social Desirability Response Bias. Public Opinion Quarterly, 67, 79-125. DOI: http://www.dx.doi.org/10.1086/34601010.1086/346010Search in Google Scholar

Hox, J.J. and de Leeuw, E.D. (1994). A Comparison of Nonresponse in Mail, Telephone, and Face-to-Face Surveys. Quality and Quantity, 28, 329-344. DOI: http://www. dx.doi.org/10.1007/BF01097014 Israel, G.D. (2010). Using Web-Hosted Surveys to Obtain Responses from Extension Clients: A Cautionary Tale. Journal of Extension, 48, http://www.joe.org/joe/2010august/a8.php (accessed November 2013).Search in Google Scholar

Iyengar, S.S. and Lepper, M.R. (2000). When Choice Is Demotivating: Can One Desire Too Much of a Good Thing? Journal of Personality and Social Psychology, 79, 995-1006. DOI: http://www.dx.doi.org/10.1037/0022-3514.79.6.995Search in Google Scholar

Kaplowitz, M.D., Hadlock, T.D., and Levine, R. (2004). A Comparison of Web and Mail Survey Response Rates. Public Opinion Quarterly, 68, 94-101. DOI: http:// www.dx.doi.org/10.1093/poq/nfh00610.1093/poq/nfh006Search in Google Scholar

Lesser, V.M., Newton, L., and Yang, D. (2010). Does Providing a Choice of Survey Modes Influence Response? Paper presented at the Annual Meeting of the American Association for Public Opinion Research, Chicago., May 13-16, 2010.Search in Google Scholar

Li, B., Lingsma, H.F., Steverberg, E.W., and Lesaffre, E. (2011). Logistic Random Effects Regression Models: A Comparison of Statistical Packages for Binary and Ordinal Outcomes. BMC Medical Research, 11, Article 77. DOI: http://www.dx.doi.org10.1186/1471-228810.1186/1471-2288-11-77311219821605357Search in Google Scholar

Loges, W.E. and Jung, J. (2001). Exploring the Digital Divide: Internet Connectedness and Age. Communication Research, 28, 536-562. DOI: http://www.dx.doi.org/10.1177/00936500102800400710.1177/009365001028004007Search in Google Scholar

Lynn, P. (2013). Alternative Sequential Mixed-Mode Designs: Effects on Attrition Rates, Attrition Bias, and Costs. Journal of Survey Statistics and Methodology, 1, 183-205. DOI: http://www.dx.doi.org/10.1093/jssam/smt01510.1093/jssam/smt015Search in Google Scholar

Martin, P. (2011). What Makes a Good Mix? Chances and Challenges of Mixed Mode Data Collection in the ESS. Working Paper No. 02. Centre for Comparative Social Surveys, City University, London.Search in Google Scholar

Medway, R.L. and Fulton, J. (2012). When More Gets You Less: a Meta-Analysis of the Effect of Concurrent Web Options on Mail Survey Response Rates. Public Opinion Quarterly, 76, 733-746. DOI: http://www.dx.doi.org/10.1093/poq/nfs047 10.1093/poq/nfs047Search in Google Scholar

Millar, M.M. and Dillman, D.A. (2011). Improving Response to Web and Mixed-Mode Surveys. Public Opinion Quarterly, 75, 249-269. DOI: http://www.dx.doi.org10.1093/poq/nfr00310.1093/poq/nfr003Search in Google Scholar

Millar, M.M., O’Neill, A.C., and Dillman, D.A. (2009). Are Mode Preferences Real? Technical Report 09-003, Social and Economic Sciences Research Center. Pullman: Washington State University.Search in Google Scholar

Miller, T.I., Kobayashi, M.M., Caldwell, E., Thurston, S., and Collett, B. (2002). Citizen Surveys on the Web: General Population Surveys of Community Opinion. Social Science Computer Review, 20, 124-136. DOI: http://www.dx.doi.org/10.1177/08944393020200020310.1177/089443930202000203Search in Google Scholar

Nicolaas, H., Wobma, E., and Ooijevaar, J. (2010). Demografie van (Niet-Westerse) Allochtonen in Nederland. Statistics Netherlands. Available at: http://www.cbs.nl (accessed August 2013).Search in Google Scholar

Olson, K., Smyth, J.D., and Wood, H. (2012). Does Providing Sample Members with Their Preferred Survey Mode Really Increase Participation Rates? Public Opinion Quarterly, 76, 611-635.10.1093/poq/nfs024Search in Google Scholar

Porter, S.R. and Whitcomb, M.E. (2007). Mixed-Mode Contacts in Web Surveys: Paper Is Not Necessarily Better. Public Opinion Quarterly, 71, 635-648. DOI: http://www.dx.doi.org/10.1093/poq/nfm03810.1093/poq/nfm038Search in Google Scholar

Quene´, H. and van den Bergh, H. (2008). Examples of Mixed-Effects Modeling With Crossed Random Effects and With Binomial Data. Journal of Memory and Language, 59, 413-425. DOI: http://www.dx.doi.org/10.1016/j.jml.2008.02.00210.1016/j.jml.2008.02.002Search in Google Scholar

Radon, K., Goldberg, M., Becklake, M., Pindur, U., Hege, I., and Nowak, D. (2002).Low Acceptance of an Internet-Based Online Questionnaire by Young Adults. Epidemiology, 13, 748-749.10.1097/00001648-200211000-0002912410026Search in Google Scholar

Raets, B. (2008). Vinex-Bewoners zijn Geen Doorsnee Stedelingen. Statistics Netherlands. Available at: http://www.cbs.nl (accessed August 2013).Search in Google Scholar

Ryan, J.M., Corry, J.R., Attewell, R., and Smithson, M.J. (2002). A Comparison of an Electronic Version of the SF-36 General Health Questionnaire to the Standard Paper Version. Quality of Life Research, 11, 19-26. DOI: http://www.dx.doi.org10.1023/A:101441570999710.1023/A:1014415709997Search in Google Scholar

Scherpenzeel, A. and Toepoel, V. (2012). Recruiting a Probability Sample for an Online Panel. Effects of Contact Mode, Incentives and Information. Public Opinion Quarterly, 76, 470-490. DOI: http://www.dx.doi.org/10.1093/poq/nfs03710.1093/poq/nfs037Search in Google Scholar

Schmuhl, P., van Duker, H., Gurley, K.L., Webster, A., and Olson, L. (2010). Reaching Emergency Medical Services Providers: Is One Survey Mode Better Than Another? Prehospital Emergency Care, 14, 361-369.10.3109/1090312100376018420397864Search in Google Scholar

Schneider, S.J., Cantor, D., Malakhoff, L., Arieira, C., Segel, P., Nguyen, K., and Tancreto, J.G. (2005). Telephone, Internet and Paper Data Collection Modes for the Census 2000 Short Form. Journal of Official Statistics, 21, 89-101.Search in Google Scholar

Schwartz, B. (2004). The Paradox of Choice: Why More Is Less. New York: Harper Perennial.Search in Google Scholar

Shih, T. and Fan, X. (2007). Response Rates and Mode Preferences in Web-Mail Mixed- Mode Surveys: A Meta-Analysis. International Journal of Internet Science, 2, 59-82. Search in Google Scholar

Sinclair, M., O’Toole, J., and Malawaraarachchi, M. (2012). Comparison of Response Rates and Cost-Effectiveness for a Community-Based Survey: Postal, Internet and Telephone Modes with Generic or Personalized Recruitment Approaches. BMC Medical Research Methodology, 12, Article 132. DOI: http://www.dx.doi.org/10.1186/1471-2288-12-13210.1186/1471-2288-12-132350208222938205Search in Google Scholar

Smyth, J.D., Dillman, D.A., Christian, L.M., and O’Neill, A.C. (2010). Using the Internet to Survey Small Towns and Communities: Limitations and Possibilities in the Early 21st Century. American Behavioral Scientist, 53, 1423-1448. DOI: http://www.dx.doi.org/10.1177/000276421036169510.1177/0002764210361695Search in Google Scholar

Smyth, J.D., Olson, K., and Richards, A. (2009). Are Mode Preferences Real? Paper presented at the Annual Meeting of the American Association for Public Opinion Research. Hollywood, Florida., May 14-17, 2009.Search in Google Scholar

Statistics Netherlands. (2013a). Definitions. Available at: http://www.cbs.nl (accessed November 2013).Search in Google Scholar

Statistics Netherlands. (2013b). ICT Gebruik van Huishoudens naar Huishoudkenmerken Available at: http://statline.cbs.nl (accessed November 2013).Search in Google Scholar

Statistics Netherlands. (2010). Laag en Langdurig Laag Inkomen; Particuliere Huishoudens naar Kenmerken. Available at: http://statline.cbs.nl (accessed August 2013).Search in Google Scholar

Stoop, I. (2007). No time, Too Busy: Time Strain and Survey Cooperation. In Measuring Meaningful Data in Social Research, G. Loosveldt, M. Swyngedouw, and B. Cambre´ (eds). Leuven: Acco, 301-314.Search in Google Scholar

Stoop, I. (2005). The Hunt for the Last Respondent. Non-Response in Sample Surveys. The Hague: Social and Cultural Planning Agency.Search in Google Scholar

Sylvester, D.E. and McGlynn, A.J. (2010). The Digital Divide, Political Participation, and Place. Social Science Computer Review, 28, 64-74. DOI: http://www.dx.doi. org/10.1177/089443930933514810.1177/0894439309335148Search in Google Scholar

Tancreto, J.G., Zelenak, M.F., Davis, M., Ruiter, M., and Matthews, B. (2012). 2011 American Community Survey Internet Tests: Results from First Test in April 2011. Final Report. Washington, DC: US Census Bureau.Search in Google Scholar

Tarnai, J. and Paxson, M.C. (2004). Survey Mode Preferences of Business Respondents. Paper presented at the Annual Meeting of the American Association for Public Opinion Research, Phoenix., May 13-16, 2004.Search in Google Scholar

Toffler, A. (1971). Future Shock. United States: Bantam Books.Search in Google Scholar

Tse, A. (1998). Comparing the Response Rate, Response Speed, and Response Quality of Two Methods of Sending Questionnaires: Email vs. Mail. Journal of the Market Research Society, 40, 353-361.10.1177/147078539804000407Search in Google Scholar

Turner, S., Viera, L., and Marsh, S. (2010). Offering a Web Option in a Mail Survey of Young Adults: Impact on Survey Quality. Poster presented at the Annual Meeting of the American Association for Public Opinion Research, Chicago., May 13-16, 2010.Search in Google Scholar

Vannieuwenhuyze, J. (forthcoming 2014). On the Relative Advantage of Mixed-Mode Surveys. Survey Research Methods.Search in Google Scholar

Vehovar, V., Batagelj, Z., Lozar Manfreda, K., and Zalatel, M. (2002). Nonresponse in Web Surveys. In Survey Nonresponse, R.M. Groves, D.A. Dillman, J.L. Eltinge, and R.J.A. Little (eds). New York: John Wiley and Sons, 229-242. Search in Google Scholar

Vercruyssen, A., Roose, H., Carton, A., and van de Putte, B. (2013). The Effect of Busyness on Survey Participation: Being Too Busy or Feeling Too Busy to Cooperate? International Journal of Social Research Methodology. DOI: http://www.dx.doi.org/10.1080/13645579.2013.799255Search in Google Scholar

Weeks, M.F., Kulka, R.A., Lessler, J.T., and Whitmore, R.W. (1983). Personal versus Telephone Surveys for Collecting Household Health Data at the Local Level. American Journal of Public Health, 73, 1389-1394. DOI: http://www.dx.doi.org/10.2105/AJPH73.12.138910.2105/AJPH.73.12.138916512646638234Search in Google Scholar

Werner, P. and Forsman, G. (2005). Mixed Mode Data Collection Using Paper and Web Questionnaires. Proceedings of the American Statistical Association, Section on Survey Research Methods, 4015-4017.Search in Google Scholar

West, B.T. (2012). An Examination of the Quality and Utility of Interviewer Observations in the National Survey of Family Growth. Journal of the Royal Statistical Society: Series A (Statistics in Society), 176, 211-225. DOI: http://www.dx.doi.org/10.1111/ j.1467-985X.2012.01038.x Search in Google Scholar

Wilkins, J.R., Hueston, W.D., MacCrawford, J., Steele, L.L., and Gerken, D.F. (1997). Mixed-Mode Survey of Female Veterinarians Yields High Response Rate.Occupational Medicine, 47, 458-462. DOI: http://www.dx.doi.org/10.1093/occmed/47.8.45810.1093/occmed/47.8.4589604477Search in Google Scholar

Ziegenfuss, J.Y., Beebe, T.J., Rey, E., Schleck, C., Locke, III, G.R., and Talley, N.J. (2010). Internet Option in a Mail Survey: More Harm Than Good? Epidemiology, 21, 585-586. DOI: http://www.dx.doi.org/10.1097/EDE.0b013e3181e09657Search in Google Scholar

Zickuhr, K. and Smith, A. (2012). Digital Differences. Pew Internet Project Report.Washington, DC: Pew Research Center. Available at: http://www.pewInternet.org/Reports/2012/Digital-differences.aspx (accessed August 2013).Search in Google Scholar