Public Opinion Quarterly 64:125-148 (2000)
© 2000 American Association for Public Opinion Research
Articles |
Consequences of Reducing Nonresponse in a National Telephone Survey*
Abstract
Critics of public opinion polls often claim that methodological shortcuts taken to collect timely data produce biased results. This study compares two random digit dial national telephone surveys that used identical questionnaires but very different levels of effort: a "Standard" survey conducted over a 5-day period that used a sample of adults who were home when the interviewer called, and a "Rigorous" survey conducted over an 8-week period that used random selection from among all adult household members. Response rates, computed according to AAPOR guidelines, were 60.6 percent for the Rigorous and 36.0 percent for the Standard study. Nonetheless, the two surveys produced similar results. Across 91 comparisons, no difference exceeded 9 percentage points, and the average difference was about 2 percentage points. Most of the statistically significant differences were among demographic items. Very few significant differences were found on attention to media and engagement in politics, social trust and connectedness, and most social and political attitudes, including even those toward surveys.
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  M. A. Morrisey and J. Cawley Health Economists' Views of Health Policy Journal of Health Politics Policy and Law, August 1, 2008; 33(4): 707 - 724. [Abstract] [PDF]
|
|
|
|
 |
|
 J. M. Mellor, R. B. Rapoport, and D. Maliniak The Impact of Child Obesity on Active Parental Consent in School-Based Survey Research on Healthy Eating and Physical Activity Eval Rev, June 1, 2008; 32(3): 298 - 312. [Abstract] [PDF]
|
|
|
|
 |
|
 R. M. Groves and E. Peytcheva The Impact of Nonresponse Rates on Nonresponse Bias: A Meta-Analysis Public Opin Q, June 1, 2008; 72(2): 167 - 189. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
E. M. Andresen, C. R. Machuga, M. E. Van Booven, J. Egel, J. T. Chibnall, and R. C. Tait Effects and Costs of Tracing Strategies on Nonresponse Bias in a Survey of Workers with Low-Back Injury Public Opin Q, March 1, 2008; 72(1): 40 - 54. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. Kennedy, S. Keeter, and M. Dimock A "Brute Force" Estimation of the Residency Rate for Undetermined Telephone Numbers in an RDD Survey Public Opin Q, March 1, 2008; 72(1): 28 - 39. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. Merkle and G. Langer How Too Little Can Give You a Little Too Much: Determining the Number of Household Phone Lines in RDD Surveys Public Opin Q, March 1, 2008; 72(1): 114 - 124. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 P. Jenkins, G. Earle-Richardson, P. Burdick, and J. May Handling Nonresponse in Surveys: Analytic Corrections Compared with Converting Nonresponders Am. J. Epidemiol., February 1, 2008; 167(3): 369 - 374. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. J. Blendon, D. E. Altman, C. Deane, J. M. Benson, M. Brodie, and T. Buhr Health Care in the 2008 Presidential Primaries N. Engl. J. Med., January 24, 2008; 358(4): 414 - 422. [Full Text] [PDF]
|
|
|
|
 |
|
 R. Bautista, M. Callegaro, J. A. Vera, and F. Abundis Studying Nonresponse in Mexican Exit Polls Int. J. Public Opin. Res., December 1, 2007; 19(4): 492 - 503. [Full Text] [PDF]
|
|
|
|
 |
|
 M. Thomas, M. Bloor, and J. Frankland The process of sample recruitment: an ethnostatistical perspective Qualitative Research, November 1, 2007; 7(4): 429 - 446. [Abstract] [PDF]
|
|
|
|
|
|
L. H. Hoffman, C. J. Glynn, M. E. Huge, R. B. Sietman, and T. Thomson The Role of Communication in Public Opinion Processes: Understanding the Impacts of Intrapersonal, Media, and Social Filters Int. J. Public Opin. Res., September 1, 2007; 19(3): 287 - 312. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 D. Sanders, H. D. Clarke, M. C. Stewart, and P. Whiteley Does Mode Matter For Modeling Political Choice? Evidence From the 2005 British Election Study Political Analysis, July 1, 2007; 15(3): 257 - 285. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. Chen, M.-j. Kresnow, T. R. Simon, and A. Dellinger Injury-Prevention Counseling and Behavior Among US Children: Results From the Second Injury Control and Risk Survey Pediatrics, April 1, 2007; 119(4): e958 - e965. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. A. Tiro, H. I. Meissner, S. Kobrin, and V. Chollette What Do Women in the U.S. Know about Human Papillomavirus and Cervical Cancer? Cancer Epidemiol. Biomarkers Prev., February 1, 2007; 16(2): 288 - 294. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 K. T. Call, M. Davern, and L. A. Blewett Estimates Of Health Insurance Coverage: Comparing State Surveys With The Current Population Survey Health Aff., January 1, 2007; 26(1): 269 - 278. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. L. Holbrook, I. C. Farrar, and S. J. Popkin Surveying a chicago public housing development: methodological challenges and lessons learned. Eval Rev, December 1, 2006; 30(6): 779 - 802. [Abstract] [PDF]
|
|
|
|
|
|
R. J. Blendon and D. E. Altman Voters and Health Care in the 2006 Election N. Engl. J. Med., November 2, 2006; 355(18): 1928 - 1933. [Full Text] [PDF]
|
|
|
|
 |
|
 S. J. Best and B. S. Krueger Online Interactions and Social Capital: Distinguishing Between New and Existing Ties Social Science Computer Review, November 1, 2006; 24(4): 395 - 410. [Abstract] [PDF]
|
|
|
|
 |
|
 M E Thompson, G T Fong, D Hammond, C Boudreau, P Driezen, A Hyland, R Borland, K M Cummings, G B Hastings, M Siahpush, et al. Methods of the International Tobacco Control (ITC) Four Country Survey Tob. Control, June 1, 2006; 15(suppl_3): iii12 - iii18. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 C. McCarty, M. House, J. Harman, and S. Richards Effort in Phone Survey Response Rates: The Effects of Vendor and Client-Controlled Factors Field Methods, May 1, 2006; 18(2): 172 - 188. [Abstract] [PDF]
|
|
|
|
 |
|
 S. Arlikatti, M. K. Lindell, C. S. Prater, and Y. Zhang Risk Area Accuracy and Hurricane Evacuation Expectations of Coastal Residents Environment and Behavior, March 1, 2006; 38(2): 226 - 247. [Abstract] [PDF]
|
|
|
|
|
|
E. Ryu, M. P. Couper, and R. W. Marans Survey Incentives: Cash vs. In-Kind; Face-to-Face vs. Mail; Response Rate vs. Nonresponse Error Int. J. Public Opin. Res., March 1, 2006; 18(1): 89 - 106. [Full Text] [PDF]
|
|
|
|
 |
|
 R. F. Hanson, S. Self-Brown, A. E. Fricker-Elhai, D. G. Kilpatrick, B. E. Saunders, and H. S. Resnick The relations between family environment and violence exposure among youth: findings from the national survey of adolescents. Child Maltreat, February 1, 2006; 11(1): 3 - 15. [Abstract] [PDF]
|
|
|
|
|
|
E. Singer Introduction: Nonresponse Bias in Household Surveys Public Opin Q, January 1, 2006; 70(5): 637 - 645. [Full Text] [PDF]
|
|
|
|
|
|
R. M. Groves Nonresponse Rates and Nonresponse Bias in Household Surveys Public Opin Q, January 1, 2006; 70(5): 646 - 675. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. G. Abraham, A. Maitland, and S. M. Bianchi Nonresponse in the American Time Use Survey: Who Is Missing from the Data and How Much Does It Matter? Public Opin Q, January 1, 2006; 70(5): 676 - 703. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. M. Groves, M. P. Couper, S. Presser, E. Singer, R. Tourangeau, G. P. Acosta, and L. Nelson Experiments in Producing Nonresponse Bias Public Opin Q, January 1, 2006; 70(5): 720 - 736. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. Olson Survey Participation, Nonresponse Bias, Measurement Error Bias, and Total Bias Public Opin Q, January 1, 2006; 70(5): 737 - 758. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. Keeter, C. Kennedy, M. Dimock, J. Best, and P. Craighill Gauging the Impact of Growing Nonresponse on Estimates from a National RDD Telephone Survey Public Opin Q, January 1, 2006; 70(5): 759 - 779. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 State-Specific Prevalence of Cigarette Smoking and Quitting Among Adults--United States, 2004 JAMA, December 21, 2005; 294(23): 2963 - 2966. [Full Text] [PDF]
|
|
|
|
|
|
C. B. Mann Do Advance Letters Improve Preelection Forecast Accuracy? Public Opin Q, December 1, 2005; 69(4): 561 - 571. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. P. Couper Technology Trends in Survey Data Collection Social Science Computer Review, November 1, 2005; 23(4): 486 - 501. [Abstract] [PDF]
|
|
|
|
 |
|
 S. J. Best, B. Chmielewski, and B. S. Krueger Selective Exposure to Online Foreign News during the Conflict with Iraq International Journal of Press/Politics, October 1, 2005; 10(4): 52 - 70. [Abstract] [PDF]
|
|
|
|
|
|
J. E. Oliver and T. Lee Public opinion and the politics of obesity in America. Journal of Health Politics Policy and Law, October 1, 2005; 30(5): 923 - 954. [Abstract] [PDF]
|
|
|
|
|
|
E. M. Shaeffer, J. A. Krosnick, G. E. Langer, and D. M. Merkle Comparing the Quality of Data Obtained by Minimally Balanced and Fully Balanced Attitude Questions Public Opin Q, September 1, 2005; 69(3): 417 - 428. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J P Pierce, M M White, and E A Gilpin Adolescent smoking decline during California's tobacco control programme Tob. Control, June 1, 2005; 14(3): 207 - 212. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. E Abell, J. M Hootman, M. M Zack, D. Moriarty, and C. G Helmick Physical activity and health related quality of life among people with arthritis J. Epidemiol. Community Health, May 1, 2005; 59(5): 380 - 385. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. M. DesRoches, R. J. Blendon, and J. M. Benson Americans' Responses To The 2004 Influenza Vaccine Shortage Health Aff., May 1, 2005; 24(3): 822 - 831. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. J. Reeves and A. P. Rafferty Healthy Lifestyle Characteristics Among Adults in the United States, 2000 Arch Intern Med, April 25, 2005; 165(8): 854 - 857. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. Kinne and T. D. Topolski Inclusion of People With Disabilities in Telephone Health Surveillance Surveys Am J Public Health, March 1, 2005; 95(3): 512 - 517. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. Curtin, S. Presser, and E. Singer Changes in Telephone Survey Nonresponse over the Past Quarter Century Public Opin Q, March 1, 2005; 69(1): 87 - 98. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. M. Moskowitz Assessment of Cigarette Smoking and Smoking Susceptibility among Youth: Telephone Computer-Assisted Self-Interviews versus Computer-Assisted Telephone Interviews Public Opin Q, December 1, 2004; 68(4): 565 - 587. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. J. Blendon, D. E. Altman, J. M. Benson, and M. Brodie Health Care in the 2004 Presidential Election N. Engl. J. Med., September 23, 2004; 351(13): 1314 - 1322. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
E. Martin Presidential Address: Unfinished Business Public Opin Q, September 1, 2004; 68(3): 439 - 450. [Full Text] [PDF]
|
|
|
|
|
|
H. Schuman and W. L. Rodgers Cohorts, Chronology, and Collective Memories Public Opin Q, June 1, 2004; 68(2): 217 - 254. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. R. Torabi and D.-C. Seo National Study of Behavioral and Life Changes Since September 11 Health Educ Behav, April 1, 2004; 31(2): 179 - 192. [Abstract] [PDF]
|
|
|
|
|
|
R. M. Groves, S. Presser, and S. Dipko The Role of Topic Interest in Survey Participation Decisions Public Opin Q, March 1, 2004; 68(1): 2 - 31. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. Peter Country Characteristics as Contingent Conditions of Agenda Setting: The Moderating Influence of Polarized Elite Opinion Communication Research, December 1, 2003; 30(6): 683 - 712. [Abstract] [PDF]
|
|
|
|
|
|
K. Donelan Use of the Internet for Health Information and Communication JAMA, November 5, 2003; 290(17): 2255 - 2255. [Full Text] [PDF]
|
|
|
|
|
|
D. C. Girasek and A. C. Gielen The Effectiveness of Injury Prevention Strategies: What Does the Public Believe? Health Educ Behav, June 1, 2003; 30(3): 287 - 304. [Abstract] [PDF]
|
|
|
|
|
|
G. King, R. K. Mallett, L. T. Kozlowski, and R. B. Bendel African Americans' Attitudes Toward Cigarette Excise Taxes Am J Public Health, May 1, 2003; 93(5): 828 - 834. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
B. G. Watts, S. W. Vernon, R. E. Myers, and B. C. Tilley Intention to be Screened Over Time for Colorectal Cancer in Male Automotive Workers Cancer Epidemiol. Biomarkers Prev., April 1, 2003; 12(4): 339 - 349. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. Gwyn, S. W. Vernon, and P. M. Conoley Intention to Pursue Genetic Testing for Breast Cancer among Women due for Screening Mammography Cancer Epidemiol. Biomarkers Prev., February 1, 2003; 12(2): 96 - 102. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S.-M. McKernan, J. M. Lacko, and M. Hastak Empirical Evidence on the Determinants of Rent-to-Own Use and Purchase Behavior Economic Development Quarterly, February 1, 2003; 17(1): 33 - 52. [Abstract] [PDF]
|
|
|
|
 |
|
 J. M. Kennedy and B. Vargus Challenges in Survey Research and Their Implications for Philanthropic Studies Research Nonprofit and Voluntary Sector Quarterly, September 1, 2001; 30(3): 483 - 494. [Abstract] [PDF]
|
|