Public Opinion Quarterly Advance Access published online on January 21, 2008
Public Opinion Quarterly, doi:10.1093/poq/nfm055
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||
Effects and Costs of Tracing Strategies on Nonresponse Bias in a Survey of Workers with Low-Back Injury
Address correspondence to Elena M. Andresen; e-mail: andresen{at}phhp.ufl.edu
Declining rates of participation are an increasing challenge for studies that involve telephone surveys. This study examined the costs of a telephone survey methodology that used increasingly intensive tracing methods to track a pool of claimants who had sustained occupational back injuries. It also compared the respondent sample to people who refused the survey and/or were not located or contacted. 3,181 claimants were drawn from a database maintained by the Missouri Division of Workers Compensation (DWC) and 1,475 completed a telephone interview. The DWC database provided data reflecting monetary and disability outcomes for all potential participants; telephone interviews provided additional self-reported data. More intensive tracing strategies improved the representativeness of the sample, yielding more women and minority participants. Relative to less intensive techniques, advanced tracing efforts located people whose DWC records were more similar to claimants not located. While the hands-on tracing efforts reduced the apparent bias of the respondent sample, costs increased as tracing strategies intensified – over $98,000 was spent to trace 1,027 claimants who were never located or contacted. The results suggest some guidelines that may facilitate decision-making for researchers and funders who must balance the trade-off between costs and nonresponse bias when planning surveys.
ELENA M. ANDRESEN is with Department of Epidemiology and Biostatistics, College of Public Health and Health Professions, University of Florida Health Sciences Center, PO Box 100231, Gainesville, FL 32610-0231, USA. RENEA MACHUGA, MARY ELLEN VAN BOOVEN, AND JOHN EGEL are with Battelle Centers for Public Health Research and Evaluation, 10420 Old Olive St. Road Suite 300, St. Louis, MO 63141, USA. JOHN T. CHIBNALL AND RAYMOND C. TAIT are with Department of Psychiatry, School of Medicine, Saint Louis University, 1221 S. Grand Blvd., St. Louis, MO 63104, USA. This work was supported by a grant (R01 HS013087-01) from the Agency for Healthcare Research and Quality (AHRQ).