1. bookVolume 35 (2019): Issue 4 (December 2019)
    Special Issue on Measuring LGBT Populations
Journal Details
License
Format
Journal
First Published
01 Oct 2013
Publication timeframe
4 times per year
Languages
English
access type Open Access

Comparing Self-Reported and Partnership-Inferred Sexual Orientation in Household Surveys

Published Online: 11 Dec 2019
Page range: 777 - 805
Received: 01 Nov 2019
Accepted: 01 Oct 2019
Journal Details
License
Format
Journal
First Published
01 Oct 2013
Publication timeframe
4 times per year
Languages
English

Research comparing heterosexuals with bisexuals and homosexuals in economics and the social sciences typically relies on two strategies to identify sexual orientation in existing survey data of general populations. Probing respondents to self-report their sexual orientation is generally considered the preferred option. Since self-reports are unavailable in most large multidisciplinary surveys, often researchers infer sexual orientation from the gender-constellation of a respondent’s partnership instead. Based on German Socio-Economic Panel (SOEP) data, this article reviews both strategies empirically in the context of a household panel survey. The analysis shows that self-reported and partnership-inferred sexual orientation are not mutual substitutes, instead leading to substantively different conclusions about differences between heterosexuals and LGBs (Lesbian, Gays, and Bisexuals). The article discusses problems of non-coverage in partnership-inferred sexual orientation and also investigates measurement error in self-reported sexual orientation, finding notable mode and interviewer effects.

Keywords

Aicken, C.R.H., C.H. Mercer, and J.A. Cassell. 2013. “Who reports absence of sexual attraction in Britain? Evidence from national probability surveys.” Psychology and Sexuality 4(2): 121–135. DOI: https://doi.org/10.1080/19419899.2013.774161.10.1080/19419899.2013.774161Open DOISearch in Google Scholar

Antecol, H., A. Jong, and M. Steinberger. 2008. “The Sexual Orientation Wage Gap: The Role of Occupational Sorting and Human Capital.” Industrial and Labor Relations Review 61(4): 518–543. DOI: https://doi.org/10.1177/001979390806100405.10.1177/001979390806100405Open DOISearch in Google Scholar

Australian Bureau of Statistics. 2016. Same-Sex Couples in Australia, 2016. Available at: http://www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/2071.0Main+Features852016?OpenDocument (accessed October 2019).Search in Google Scholar

Bates, N. and T.J. DeMaio. 2013. “Measuring same-sex relationships.” Contexts 12: 66–69. DOI: https://doi.org/10.1177/1536504213476251.10.1177/1536504213476251Open DOISearch in Google Scholar

Black, D.A. 2000. “Demographics of the Gay and Lesbian Population in the United States: Evidence from Available Systematic Data Sources.” Demography 37(2): 139–154. DOI: https://doi.org/10.2307/2648117.10.2307/2648117Open DOISearch in Google Scholar

Black, D.A., S.G. Sanders, and L.J. Taylor. 2007. “The Economics of Lesbian and Gay Families.” The Journal of Economic Perspectives 21(2): 53–70. DOI: https://doi.org/10.1257/jep.21.2.53.10.1257/jep.21.2.53Open DOISearch in Google Scholar

Booker, C.L., G. Riger, and J.B. Unger. 2017. “Sexual orientation health inequality: Evidence from Understanding Society, the UK Longitudinal Household Study.” Preventive Medicine 101: 126–132. DOI: https://doi.org/10.1016/j.ypmed.2017.06.010.10.1016/j.ypmed.2017.06.010Open DOISearch in Google Scholar

Campanelli, P. and C. O’Muricheartaigh. 1999. “Interviewers, Interviewer Continuity, and Panel Survey Nonresponse.” Quality & Quantity 33(1): 59–76. DOI: https://doi.org/10.1023/a:1004357711258.10.1023/a:1004357711258Open DOISearch in Google Scholar

Chandra, A., C.E. Copen, and W.D. Mosher. 2013. “Sexual Behavior, Sexual Attraction, and Sexual Identity in the United States: Data from the 2006–2010 National Survey of Family Growth.” In International Handbook on the Demography of Sexuality, vol 5, edited by A. Baumle, 45–66. Dordrecht: Springer. DOI: https://doi.org/10.1007/978-94-007-5512-3_4.10.1007/978-94-007-5512-3_4Open DOISearch in Google Scholar

Cortina, C., and P. Festy. 2014. Identification of same-sex couples and families in censuses, registers and surveys. Families and Societies Working Paper Series 8. Available at: http://www.familiesandsocieties.eu/wp-content/uploads/2014/12/WP8CortinaFesty2014.pdf (accessed October 2019).Search in Google Scholar

Dahlhamer, J.M., A.M. Galinksy, S.S. Joestl, and B.W. Ward. 2014. “Sexual orientation in the National Health Interview Survey: A quality assessment.” Vital Health Stat 2(169) Available at: https://www.researchgate.net/publication/269713986_Sexual_Orientation_in_the_2013_National_Health_Interview_Survey_A_Quality_Assessment (accessed November 2019).Search in Google Scholar

De Leeuw, E., J. Hox, and S. Kef. 2003. “Computer-Assisted Self-Interviewing Tailored for Special Populations and Topics.” Field Methods 15(3): 223–251. DOI: https://doi.org/10.1177/1525822x03254714.10.1177/1525822x03254714Open DOISearch in Google Scholar

DeMaio, T.J., N. Bates, and M. O’Connell. 2013. “Exploring Measurement Error Issues in Reporting of Same-Sex Couples.” Public Opinion Quarterly 77(1): 145–158. DOI: https://doi.org/10.1093/poq/nfs066.10.1093/poq/nfs066Open DOISearch in Google Scholar

Dillman, D.A., G. Phelps, R. Tortora, K. Swift, J. Kohrell, J. Berck, and B.L. Messer. 2009. “Response rate and measurement differences in mixed-mode surveys using mail, telephone, interactive voice response (IVR) and the Internet.” Social Science Research 38: 1–18. DOI: https://doi.org/10.1016/j.ssresearch.2008.03.007.10.1016/j.ssresearch.2008.03.007Open DOISearch in Google Scholar

Durrant, G.B. and J. D’Arrigo. 2014. “Doorstep Interactions and Interviewer Effects on the Process Leading to Cooperation or Refusal.” Sociological Methods & Research 43(3): 490–518. DOI: https://doi.org/10.1177/0049124114521148.10.1177/0049124114521148Open DOISearch in Google Scholar

Federal Statistical Office of Germany. 2019. Gleichgeschlechtlichen Paare (darunter: gleichgeschlechtliche Ehepaare und eingetragene Lebenspartnerschaften). Available at: https://www.destatis.de/DE/Themen/Gesellschaft-Umwelt/Bevoelkerung/Haushalte-Familien/Tabellen/3-4-gleichgeschlechtliche-lebensgemeinschaften.html?nn=209096 (accessed October 2019).Search in Google Scholar

Festy, P. 2007. “Enumerating same-sex couples in censuses and population registers.” Demographic Research 17: 339–368. DOI: https://doi.org/10.4054/demres.2007.17.12.10.4054/demres.2007.17.12Open DOISearch in Google Scholar

Frederiksen-Goldsen, K.I. and H.-J. Kim. 2014. “Count Me In: Response to Sexual Orientation Measures Among Older Adults.” Research on Aging 37(5): 464–480. DOI: https://doi.org/10.1177/0164027514542109.10.1177/0164027514542109Open DOISearch in Google Scholar

Galupo, M.P., E. Lomash, and R.C. Mitchell. 2016. “All of My Lovers Fit Into This Scale: Sexual Minority Individuals’ Responses to Two Novel Measures of Sexual Orientation.” Journal of Homosexuality 64: 145–165. DOI: https://doi.org/10.1080/00918369.2016.1174027.10.1080/00918369.2016.1174027Open DOISearch in Google Scholar

Gates, G.J. 2011. How many people are lesbian, gay, bisexual and transgender? Los Angeles: The Williams Institute. Available at: https://williamsinstitute.law.ucla.edu/wp-content/uploads/Gates-How-Many-People-LGBT-Apr-2011.pdf (accessed October 2019).Search in Google Scholar

Geary, R.S., C. Tanton, B. Erens, S. Clifton, P. Prah, K. Wellings, K.R. Mitchell, J. Datta, K. Gravningen, E. Fuller, A.M. Johnson, P. Sonnenberg, and C.H. Mercer. 2018. “Sexual identity, attraction and behaviour in Britain: The implications of using different dimensions of sexual orientation to estimate the size of sexual minority populations and inform public health interventions.” PLoS ONE 13(1). DOI: https://doi.org/10.1371/journal.pone.0189607.10.1371/journal.pone.0189607Open DOISearch in Google Scholar

Goebel, J., M. Grabka, S. Liebig, M. Kroh, D. Richter, C. Schröder, and J. Schupp. 2018. “The German Socio-Economic Panel (SOEP).” Journal of Economic and Statistics 239(2): 345–360. DOI: https://doi.org/10.1515/jbnst-2018-0022.10.1515/jbnst-2018-0022Open DOISearch in Google Scholar

Groves, R.M. 2004. Survey Error and Survey Costs. Hoboken, NJ: John Wiley & Sons. Hank, K. and M. Wetzel. 2018. “Same-sex relationship experiences and expectations regarding partnership and parenthood.” Demographic Research 39: 701–718. DOI: https://doi.org/10.4054/demres.2018.39.25.10.4054/demres.2018.39.25Open DOISearch in Google Scholar

Haseldon, L. and T. Joloza. 2009. “Measuring Sexual Identity: A Guide for Researchers.” Office for National Statistics, Newport UK. Available at: https://osservatoriogender.it/wp-content/uploads/2016/10/sexualidentityuserguidefinal_tcm77-181188.pdf (accessed October 2019).Search in Google Scholar

Heckman, J. 1976. “The common structure of statistical models of truncation, sample selection and limited dependent variables and a simple estimator for such models.” Annals of Economic and Social Measurement 5: 475–492. Available at: https://ideas.repec.org/h/nbr/nberch/10491.html (accessed November 2019).Search in Google Scholar

Heckman, J. 1979. “Sample selection bias as a specification error.” Econometrica 47(3): 153–161. DOI: https://doi.org/10.2307/1912352.10.2307/1912352Open DOISearch in Google Scholar

Hilgert, L. M. Kroh, and D. Richter 2016. “The effect of face-to-face interviewing on personality measurement.” Journal of Research in Personality 63: 133–136. DOI: https://doi.org/10.1016/j.jrp.2016.05.006.10.1016/j.jrp.2016.05.006Open DOISearch in Google Scholar

Jans, M., J. Viana, D. Grant, S.D. Cochran, A.C. Lee, and N.A. Ponce. 2015. “Trends in sexual orientation missing data over a decade of the California Health Interview Survey.” American Journal of Public Health 105(5): e43–e50. DOI: https://doi.org/10.2105/ajph.2014.302514.10.2105/ajph.2014.302514Open DOISearch in Google Scholar

Kish, Leslie. 1962. “Studies of Interviewer Variance for Attitudinal Variables.” Journal of the American Statistical Association 57(297): 92–115. DOI: https://doi.org/10.1080/01621459.1962.10482153.10.1080/01621459.1962.10482153Open DOISearch in Google Scholar

Klawitter, M. 2011. “Multilevel Analysis of the Effects of Antidiscrimination Policies on Earnings by Sexual Orientation.” Journal of Policy Analysis and Management 30(2): 334–358. DOI: https://doi.org/10.1002/pam.20563.10.1002/pam.20563Open DOISearch in Google Scholar

Klawitter, M. 2014. “Meta-Analysis of the Effects of Sexual Orientation on Earnings.” Industrial Relations: A Journal of Economy and Society 54(1): 4–32. DOI: https://doi.org/10.1111/irel.12075.10.1111/irel.12075Open DOISearch in Google Scholar

Kreider, R.M. and D.A. Lofquist. 2015. “Matching Survey Data with Administrative Records to Evaluate Reports of Same-Sex Married Couple Households.” SEHSD Working Paper, 2014-36. U.S. Census Bureau: Washington, DC.Search in Google Scholar

Kroh, M., S. Kühne, C. Kipp, and D. Richter. 2017. “Income, social support networks, life satisfaction: lesbians, gays, and bisexuals in Germany.” DIW Economic Bulletin 2017: 335–345. Available at: https://diw.de/documents/publikationen/73/diw_01.c.563931.de/diw_econ_bull_2017-33-2.pdf (accessed October 2019).Search in Google Scholar

Kroh, M., S. Kühne, R. Siegers, and V. Belcheva. 2018. “SOEP-Core: Documentation of Sample Sizes and Panel Attrition (1984 until 2016).” SOEP Survey Papers 480. Available at: https://www.diw.de/documents/publikationen/73/diw_01.c.579464.de/diw_ssp0480.pdf (accessed October 2019).Search in Google Scholar

Krosnick, J.A., S. Narayan, and W.R. Smith. 1996. “Satisficing in surveys: Initial evidence.” New Directions for Evaluation 1996(70): 29–44. DOI: https://doi.org/10.1002/ev.1033.10.1002/ev.1033Open DOISearch in Google Scholar

Kuha, J., C. Skinner, and S. Butt. 2014. The effect of interviewer probing on item nonresponse and measurement error in cross-national surveys. Presentation held at the 2014 American Association for Public Opinion Research Conference, May 15–18, 2014, Anaheim, California, U.S.A. Available at: https://www.aapor.org/AAPOR_Main/media/MainSiteFiles/Abstract_Book_FNL.pdf (accessed November 2019).Search in Google Scholar

Kühne, S. 2018. “From Strangers to Acquaintances? Interviewer Continuity and Socially Desirable Responses in Panel Surveys.” Survey Research Methods 12(2): 121–146. DOI: https://doi.org/10.18148/srm/2018.v12i2.7299.Search in Google Scholar

Leppel, K. 2009. “Labour Force Status and Sexual Orientation.” Economica 76(301): 197–207. DOI: https://doi.org/10.1111/j.1468-0335.2007.00676.x.10.1111/j.1468-0335.2007.00676.xOpen DOISearch in Google Scholar

Lewis, J.M., N. Bates, and M. Streeter. 2019. Measuring Same-Sex Couples: The What And Who of Misreporting on Relationship And Sex. U.S. Census Bureau. Available at: https://census.gov/content/dam/Census/library/working-papers/2015/demo/SEHSD-WP2015-12.pdf (accessed October 2019).Search in Google Scholar

Lengerer, A. 2017. Quality of Official Data on Cohabiting Same-Sex Couples in Germany. Presentation held at the 2017 European Survey Research Association Conference, July 17th–21st 2017, Lisbon, Portugal.Search in Google Scholar

Liu, H., C. Reczek, and D. Brown. 2013. “Same-sex Cohabitors and Health: the role of race-ethnicity, gender, and socioeconomic status.” Journal of Health and Social Behavior 54(1): 25–45. DOI: https://doi.org/10.1177/0022146512468280.10.1177/0022146512468280Open DOISearch in Google Scholar

Lofquist, D., T. Lugaila, M. O’Connell, and S. Feliz. 2012. “Households and Families: 2010.” Census Briefs. C2010BR-14. Available at: https://www.census.gov/prod/cen2010/briefs/c2010br-14.pdf (accessed November 2019).Search in Google Scholar

McCrae, R.R. and O.P. John. 1992. “An Introduction to the Five-Factor Model and Its Applications.” Journal of Personality 60(2): 175–215. DOI: https://doi.org/10.1111/j.1467-6494.1992.tb00970.x.10.1111/j.1467-6494.1992.tb00970.xOpen DOISearch in Google Scholar

Meyer, I.H. and P.A. Wilson. 2009. “Sampling lesbian, gay, and bisexual populations.” Journal of Counseling Psychology 56(1): 23–31. DOI: https://doi.org/10.1037/a0014587.10.1037/a0014587Open DOISearch in Google Scholar

Moleiro, C. and N. Pinto. 2015. “Sexual orientation and gender identity: review of concepts, controversies and their relation to psychopathology classification systems.” Frontiers in psychology 6: 1511. DOI: https://doi.org/10.3389/fpsyg.2015.01511.10.3389/fpsyg.2015.01511Open DOISearch in Google Scholar

Puhani, P. 2000. “The Heckman correction for sample selection and its critique.” Journal of economic surveys 14(1): 53–68. DOI: https://doi.org/10.1111/1467-6419.00104.10.1111/1467-6419.00104Open DOISearch in Google Scholar

Rasbash, J. and H. Goldstein. 1994. “Efficient Analysis of Mixed Hierarchical and Cross-Classified Random Structures Using a Multilevel Model.” Journal of Educational and Behavioral Statistics 19(4): 337–350. DOI: https://doi.org/10.3102/10769986019004337.10.3102/10769986019004337Open DOISearch in Google Scholar

Richter, D. and J. Schupp. 2015. “The SOEP Innovation Sample (SOEP IS).” Journal of Contextual Economics – Schmollers Jahrbuch 135(3): 389–399. DOI: https://doi.org/10.3790/schm.135.3.389.10.3790/schm.135.3.389Open DOISearch in Google Scholar

Schnell, R. and F. Kreuter. 2005. “Separating Interviewer and Sampling-Point Effects.” Journal of Official Statistics 21(3): 389–41020 Available at: https://www.scb.se/contentassets/ca21efb41fee47d293bbee5bf7be7fb3/separating-interviewer-and-sampling-point-effects.pdf (accessed November 2019).Search in Google Scholar

Schwarz, N., F. Strack, H.-J. Hippler, and G. Bishop. 1991. “The impact of administration mode on response effects in survey measurement.” Applied Cognitive Psychology 5(3): 193–212. DOI: https://doi.org/10.1002/acp.2350050304.10.1002/acp.2350050304Open DOISearch in Google Scholar

Sell, R.L. 2007. “Defining and Measuring Sexual Orientation for Research.” In: The Health of Sexual Minorites, edited by I.H. Meyer and M.E. Northridge. Boston, MA: Springer. DOI: https://doi.org/10.1007/978-0-387-31334-4_14.10.1007/978-0-387-31334-4_14Open DOISearch in Google Scholar

The European Parliament. 2014 “Resolution of 4 February 2014 on the EU roadmap against homophobia and discrimination on grounds of sexual orientation and gender identity”. Available at: http://www.europarl.europa.eu/sides/getDoc.do?pubRef=2//EP//TEXT+TA+P7-TA-2014-0062+0+DOC+XML+V0//EN (accessed October 2019)Search in Google Scholar

Tourangeau, R. and T. Yan. 2007. “Sensitive Questions in Surveys.” Psychological Bulletin 133(5): 859–883. DOI: https://doi.org/10.1037/0033-2909.10.1037/0033-2909Open DOISearch in Google Scholar

Uhrig, N. 2014. An Examination of Poverty and Sexual Orientation in the UK. Essex: Institute for Social and Economic Research. Available at: https://iser.essex.ac.uk/research/publications/working-papers/iser/2014-02.pdf (accessed October 2019).Search in Google Scholar

UK Office for National Statistics. 2019. Sexual Identity lesbian, gay and bisexual population by Occupation by Country. Available at: https://www.ons.gov.uk/peoplepopulationandcommunity/culturalidentity/sexuality/datasets/sexualidentitylesbiangayandbisexualpopulationbyoccupationbycountry (accessed October 2019).Search in Google Scholar

U.S. Census Bureau. 2019. Same-Sex Couples. Available at: https://www.census.gov/topics/families/same-sex-couples/data/tables.html (accessed October 2019).Search in Google Scholar

West, B.T. and K. Olson. 2010. “How Much Interviewer Variance Is Really Nonresponse Error Variance?” Public Opinion Quarterly 74(5): 1004–1026. DOI: https://doi.org/10.1093/poq/nfq061.10.1093/poq/nfq061Open DOISearch in Google Scholar

Williams Institute. 2009. Best Practices for Asking Questions about Sexual Orientation on Surveys? Los Angeles: The Williams Institute. Available at: https://www.williamsin-stitute.law.ucla.edu/wp-content/uploads/SMART-FINAL-Nov-2009.pdf (accessed October 2019).Search in Google Scholar

Wolff, M., B. Wells, C. Ventura-DiPersia, A. Renson, and C. Grov. 2016. “Measuring Sexual Orientation: A Review and Critique of U.S Data Collection Efforts and Implications for Health Policy.” The Journal of Sex Research 54: 507–531. DOI: https://doi.org/10.1080/00224499.2016.1255872.10.1080/00224499.2016.1255872Open DOISearch in Google Scholar

Wooden, M. 2014. The Measurement of Sexual Identity in Wave 12 of the HILDA Survey (and associations with mental health and earnings). Melbourne: Melbourne Institute for Applied Economic and Social Research. Available at: https://melbourneinstitute.uni-melb.edu.au/assets/documents/hilda-bibliography/hilda-discussion-papers/hdps114.pdf (accessed October 2019).Search in Google Scholar

Recommended articles from Trend MD

Plan your remote conference with Sciendo