1. bookVolume 33 (2017): Issue 2 (June 2017)
    Special Issue on Total Survey Error (TSE)
Journal Details
License
Format
Journal
eISSN
2001-7367
First Published
01 Oct 2013
Publication timeframe
4 times per year
Languages
English
access type Open Access

Adjusting for Measurement Error and Nonresponse in Physical Activity Surveys: A Simulation Study

Published Online: 12 Jun 2017
Volume & Issue: Volume 33 (2017) - Issue 2 (June 2017)<br/>Special Issue on Total Survey Error (TSE)
Page range: 533 - 550
Received: 01 Jan 2016
Accepted: 01 Apr 2017
Journal Details
License
Format
Journal
eISSN
2001-7367
First Published
01 Oct 2013
Publication timeframe
4 times per year
Languages
English
Abstract

Adult Americans are encouraged to engage in at least 150 minutes of moderate to vigorous physical activity (MVPA) each week. National surveys that collect physical activity data to assess whether or not adults adhere to this guideline use self-report questionnaires that are prone to measurement error and nonresponse. Studies have examined the individual effects of each of these error sources on estimators of physical activity, but little is known about the consequences of not adjusting for both error sources. We conducted a simulation study to determine how estimators of adherence to the guideline for adults to engage in 150 minutes of MVPA each week respond to different magnitudes of measurement and nonresponse errors in self-reported physical activity survey data. Estimators that adjust for both measurement and nonresponse errors provide the least amount of bias regardless of the magnitudes of measurement error and nonresponse. In some scenarios, the naïve estimator, which does not adjust for either error source, results in less bias than estimators that adjust for only one error source. To avoid biased physical activity estimates using data collected from self-report questionnaires, researchers should adjust for both measurement error and nonresponse.

Keywords

Adams, S.A., C.E. Matthews, C.B. Ebbeling, C.G. Moore, J.E. Cunningham, J. Fulton, and J.R. Hebert. 2005. “The Effect of Social Desirability and Social Approval on Self-Reports of Physical Activity.” American Journal of Epidemiology 161: 389–398. Doi: https://doi.org/10.1093/aje/kwi054.10.1093/aje/kwi054295851515692083Search in Google Scholar

Ainsworth, B.E., W.L. Haskell, M.C. Whitt, M.L. Irwin, A.M. Swartz, S.J. Strath, W.L. O’Brien, D.R. Bassett, K.H. Schmitz, P.O. Emplaincourt, and D.R. Jacobs. 2000. “Compendium of Physical Activities: An Update of Activity Codes and MET Intensities.” Medicine and Science in Sports and Exercise 32: S498–S504. Available at: https://pdfs.semanticscholar.org/314e/dc8553c9a5920a14eb799b67c2a11e07b8bf.pdf (accessed April 2017).Search in Google Scholar

Bassett, D.R., A.L. Cureton, and B.E. Ainsworth. 2000. “Measurement of Daily Walking Distance: Questionnaire versus Pedometer.” Medicine and Science in Sports and Exercise 32: 1018–1023. Available at: http://journals.lww.com/acsm-msse/pages/articleviewer.aspx?year=2000&issue=05000&article=00021&type=abstract (accessed April 2017).10.1097/00005768-200005000-0002110795795Search in Google Scholar

Beyler, N., S. James-Burdumy, M. Bleeker, J. Fortson, and M. Benjamin. 2015. “Estimated Distributions of Usual Physical Activity During Recess”. Medicine and Science in Sports and Exercise 46: 1197–1203. Doi: https://doi.org/10.1249/MSS.0000000000000535.10.1249/MSS.000000000000053525268539Search in Google Scholar

Carroll, R.J., D. Ruppert, and L.A. Stefanski. 2006. Measurement Error in Nonlinear Models. New York: CRC Press.10.1201/9781420010138Search in Google Scholar

Crouter, S.E., K.G. Clowers, and D.R. Bassett. 2006. “A Novel Method for Using Accelerometer Data to Predict Energy Expenditure.” Journal of Applied Physiology 100: 1324–1331. Doi: http://dx.doi.org/10.1152/japplphysiol.00818.2005.10.1152/japplphysiol.00818.200516322367Search in Google Scholar

Dodd, K.W., P.M. Guenther, L.S. Freedman, A.F. Subar, V. Kipnis, D. Midthune, J.A. Tooze, and S.M. Krebs-Smith. 2006. “Statistical Methods for Estimating Usual Intake of Nutrients and Foods: A Review of the Theory.” Journal of the American Dietetic Association 106: 1640–1650. Doi: http://doi.org/10.1016/j.jada.2006.07.011.10.1016/j.jada.2006.07.01117000197Search in Google Scholar

Ferrari, P., C. Friedenreich, and C.E. Matthews. 2007. “The Role of Measurement Error in Estimating Levels of Physical Activity.” American Journal of Epidemiology 166: 832–840. Doi: https://doi.org/10.1093/aje/kwm148.10.1093/aje/kwm14817670910Search in Google Scholar

Groves, R.M. and L. Lyberg. 2010. “Total Survey Error: Past: Present, and Future.” Public Opinion Quarterly 74: 849–879. Doi: https://doi.org/10.1093/poq/nfq065.10.1093/poq/nfq065Search in Google Scholar

Hill, A., J. Roberts, P. Ewings, and D. Gunnell. 1997. “Non-Response Bias in a Lifestyle Survey.” Journal of Public Health 19: 203–207. Doi: https://doi.org/10.1093/oxfordjournals.pubmed.a024610.10.1093/oxfordjournals.pubmed.a0246109243437Search in Google Scholar

Lessler, J.T. and W.D. Kalsbeek. 1992. Nonsampling Error in Surveys. New York: Wiley.Search in Google Scholar

Loustalot, F., S.A. Carlson, J.E. Fulton, J. Kruger, D.A. Galuska, and F. Lobelo. 2009. “Prevalence of Self-Reported Aerobic Physical Activity among US States and Territories–Behavioral Risk Factor Surveillance System, 2007.” Journal of Physical Activity and Health 6: S9–S17. Doi: http://dx.doi.org/10.1123/jpah.6.s1.s9.10.1123/jpah.6.s1.s919998845Search in Google Scholar

Matthews, C.E. 2002. “Use of Self-Report Instruments to Assess Physical Activity.” In Physical Activity Assessments for Health Related Research, edited by G.J. Welk, 107–123. Champaign: Human Kinetics.Search in Google Scholar

Matthews, C.E. 2005. “Calibration of Accelerometer Output for Adults.” Medicine and Science in Sports and Exercise 37: S512–S522. Doi: http://dx.doi.org/10.1249/01.mss.0000185659.11982.3d.10.1249/01.mss.0000185659.11982.3dSearch in Google Scholar

Nusser, S.M., N.K. Beyler, G.J. Welk, A.L. Carriquiry, W.A. Fuller, and B. King. 2012. “Modeling Errors in Physical Activity Recall Data.” Journal of Physical Activity and Health 9: S56–S67. Doi: http://dx.doi.org/10.1123/jpah.9.s1.s56.10.1123/jpah.9.s1.s56Search in Google Scholar

Sallis, J.F. and B.E. Saelens. 2000. “Assessment of Physical Activity by Self-Report: Status, Limitations and Future Directions.” Research Quarterly for Exercise and Sport 71: 1–14. Doi: http://dx.doi.org/10.1080/02701367.2000.11082780.10.1080/02701367.2000.11082780Search in Google Scholar

Schoenborn, C.A. and M. Stommel. 2011. “Adherence to the 2008 Adult Physical Activity Guidelines and Mortality Risk.” American Journal of Preventive Medicine 40: 514–521. Doi: http://doi.org/10.1016/j.amepre.2010.12.029.10.1016/j.amepre.2010.12.029Search in Google Scholar

Smith, C. and D. Nutbeam. 1990. “Assessing Non-Response Bias: A Case Study from the 1985 Welsh Heart Health Survey.” Health Education Research 5: 381–386. Doi: https://doi.org/10.1093/her/5.3.381.10.1093/her/5.3.381Search in Google Scholar

Tooze, J.A., R.P. Troiano, R.J. Carroll, A.J. Moshfegh, and L.S. Freedman. 2013. “A Measurement Error Model for Physical Activity Level as Measured by a Questionnaire with Application to the 1999–2006 NHANES Questionnaire.” American Journal of Epidemiology 177: 1199–1208. Doi: http://dx.doi.org/10.1093/aje/kws379.10.1093/aje/kws379Search in Google Scholar

Troiano, R.P., D. Berrigan, K.W. Dodd, L.C. Masse, T. Tilert, and M. McDowell. 2008. “Physical Activity in the United States Measured by Accelerometer.” Medicine and Science in Sports and Exercise 40: 181–188. Doi: http://dx.doi.org/10.1249/mss.0b013e31815a51b3.10.1249/mss.0b013e31815a51b3Search in Google Scholar

Tucker, J.M., G.J. Welk, and N.K. Beyler. 2011. “Physical Activity in U.S. Adults: Compliance with the Physical Activity Guidelines for Americans.” American Journal of Preventative Medicine 40: 454–461. Doi: http://dx.doi.org/10.1016/j.amepre.2010.12.016.10.1016/j.amepre.2010.12.016Search in Google Scholar

U.S. Department of Health and Human Services. 2008. 2008 Physical Activity Guidelines for Americans. Atlanta: HHS. Available at: http://health.gov/paguidelines (accessed November 2015).Search in Google Scholar

Van Loon, A.J.M., M. Tijhuis, H.S.J. Picavet, P.G. Surtees, and J. Ormel. 2003. “Survey Non-Response in the Netherlands: Effects on Prevalence Estimates and Associations.” Annals of Epidemiology 13: 105–110. Doi: http://doi.org/10.1016/S1047-2797(02)00257-0.10.1016/S1047-2797(02)00257-0Search in Google Scholar

Vink, J.M., G. Willemsen, J.H. Stubbe, C.M. Middeldorp, R.S. Ligthart, K.D. Baas, H.J. Dirkzwager, E.J. de Geus, and D.I. Boomsma. 2004. “Estimating Non-Response Bias in Family Studies: Application to Mental Health and Lifestyle.” European Journal of Epidemiology 19: 623–630. Doi: http://dx.doi.org/10.1023/B:EJEp.0000036814.56108.66.10.1023/B:EJEP.0000036814.56108.66Search in Google Scholar

Warnecke, R.B., T.P. Johnson, N. Chavez, S. Sudman, D.P. O’rourke, L. Lacey, and J. Horm. 1997. “Improving Question Wording in Surveys of Culturally Diverse Populations.” Annals of Epidemiology 7: 334–342. Doi: https://doi.org/10.1016/S1047-2797(97)00030-6.10.1016/S1047-2797(97)00030-6Search in Google Scholar

Welk, G.J. 2002. “Introduction to Physical Activity Research.” In Physical Activity Assessments for Health Related Research, edited by G.J. Welk, 3–18. Champaign: Human Kinetics.Search in Google Scholar

Recommended articles from Trend MD

Plan your remote conference with Sciendo