| ||||||||||||||||||||||||||||||||||||||||||||||||||
Public Opinion Quarterly 57:62-79 (1993)
© 1993 American Association for Public Opinion Research
ESTIMATING THE EFFECT OF INCENTIVES ON MAIL SURVEY RESPONSE RATES: A META-ANALYSIS
Department of Social and Organizational Psychology, Teachers College, Columbia University
This article reports the results of a meta-analysis of 38 experimental and quasi-experimental studies that implemented some form of mail survey incentive in order to increase response rates. A total of 74 observations or cases were classified into one of four types of incentive groups: those using prepaid monetary or nonmonetary rewards included with the initial survey mailing and those using monetary or nonmonetary rewards as conditional upon the return of the survey. Results were generated using an analysis of variance approach. The overall effect size across the 74 observations was reported as low to moderate at d=.241. When compared across incentive types, only those surveys that included rewards (both monetary and nonmonetary) in the initial mailing yielded statistically significant estimates of effect size (d=.347, d=.136). The average increase in response rates over control conditions for these types of incentives was 19.1 percent and 7.9 percent, respectively. There was no evidence of any impact for those incentive types offering rewards contingent upon the return of the survey.
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  J. J. Blanchard, L. M. Collins, M. Aghevli, W. W. Leung, and A. S. Cohen Social Anhedonia and Schizotypy in a Community Sample: The Maryland Longitudinal Study of Schizotypy Schizophr Bull, October 22, 2009; (2009) sbp107v1. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 D. R. Petrolia and S. Bhattacharjee Revisiting Incentive Effects: Evidence from a Random-Sample Mail Survey on Consumer Preferences for Fuel Ethanol Public Opin Q, September 1, 2009; 73(3): 537 - 550. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 P. S. Van Horn, K. E. Green, and M. Martinussen Survey Response Rates and Survey Administration in Counseling and Clinical Psychology: A Meta-Analysis Educational and Psychological Measurement, June 1, 2009; 69(3): 389 - 403. [Abstract] [PDF]
|
|
|
|
|
|
M. Brennan and J. Charbonneau Improving Mail Survey Response Rates Using Chocolate and Replacement Questionnaires Public Opin Q, June 1, 2009; 73(2): 368 - 378. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 P. Gendall and B. Healey Alternatives to Prepaid Monetary Incentives in Mail Surveys Int. J. Public Opin. Res., December 1, 2008; 20(4): 517 - 527. [Full Text] [PDF]
|
|
|
|
|
|
W. Wetzels, H. Schmeets, J. v. d. Brakel, and R. Feskens Impact of Prepaid Incentives in Face-to-Face Surveys: A Large-Scale Experiment with Postage Stamps Int. J. Public Opin. Res., December 1, 2008; 20(4): 507 - 516. [Full Text] [PDF]
|
|
|
|
 |
|
 A. S. GORITZ, H.-G. WOLFF, and D. G. GOLDSTEIN Individual payments as a longer-term incentive in online panels Behav Res Methods, November 1, 2008; 40(4): 1144 - 1149. [Abstract] [PDF]
|
|
|
|
 |
|
 I. Grava-Gubins and S. Scott Effects of various methodologic strategies: Survey response rates among Canadian physicians and physicians-in-training Can Fam Physician, October 1, 2008; 54(10): 1424 - 1430. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. L. Mann, D. J. Lynn, and A. V. Peterson Jr The "Downstream" Effect of Token Prepaid Cash Incentives to Parents on Their Young Adult Children's Survey Participation Public Opin Q, September 1, 2008; 72(3): 487 - 501. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. L. Zagorsky and P. Rhoton The Effects of Promised Monetary Incentives on Attrition in a Long-Term Panel Survey Public Opin Q, September 1, 2008; 72(3): 502 - 513. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. S. Goritz The Long-Term Effect of Material Incentives on Participation in Online Panels Field Methods, August 1, 2008; 20(3): 211 - 225. [Abstract] [PDF]
|
|
|
|
|
|
T.-H. Shih and Xitao Fan Comparing Response Rates from Web and Mail Surveys: A Meta-Analysis Field Methods, August 1, 2008; 20(3): 249 - 271. [Abstract] [PDF]
|
|
|
|
 |
|
 P. Kemper, B. Heier, T. Barry, D. Brannon, J. Angelelli, J. Vasey, and M. Anderson-Knott What Do Direct Care Workers Say Would Improve Their Jobs? Differences Across Settings Gerontologist, July 1, 2008; 48(suppl_1): 17 - 25. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. Bosnjak, W. Neubarth, M. P. Couper, W. Bandilla, and L. Kaczmirek Prenotification in Web-Based Access Panel Surveys: The Influence of Mobile Text Messaging Versus E-Mail on Response Rates and Sample Composition Social Science Computer Review, May 1, 2008; 26(2): 213 - 223. [Abstract] [PDF]
|
|
|
|
 |
|
 J. B. VanGeest, T. P. Johnson, and V. L. Welch Methodologies for Improving Response Rates in Surveys of Physicians: A Systematic Review Eval Health Prof, December 1, 2007; 30(4): 303 - 321. [Abstract] [PDF]
|
|
|
|
|
|
S. R. Porter and M. E. Whitcomb Mixed-Mode Contacts In Web Surveys: Paper is Not Necessarily Better Public Opin Q, December 1, 2007; 71(4): 635 - 648. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
B. Marcus, M. Bosnjak, S. Lindner, S. Pilischenko, and A. Schutz Compensating for Low Topic Interest and Long Surveys: A Field Experiment on Nonresponse in Web Surveys Social Science Computer Review, August 1, 2007; 25(3): 372 - 383. [Abstract] [PDF]
|
|
|
|
 |
|
 D. S. Rose, S. D. Sidle, and K. H. Griffith A Penny for Your Thoughts: Monetary Incentives Improve Response Rates for Company-Sponsored Employee Surveys Organizational Research Methods, April 1, 2007; 10(2): 225 - 240. [Abstract] [PDF]
|
|
|
|
 |
|
 H. Roose, J. Lievens, and H. Waege The Joint Effect of Topic Interest and Follow-Up Procedures on the Response in a Mail Questionnaire: An Empirical Test of the Leverage-Saliency Theory in Audience Research Sociological Methods Research, February 1, 2007; 35(3): 410 - 428. [Abstract] [PDF]
|
|
|
|
|
|
A. S. Goritz Cash Lotteries as Incentives in Online Panels Social Science Computer Review, November 1, 2006; 24(4): 445 - 459. [Abstract] [PDF]
|
|
|
|
 |
|
 K. L. Fridkin, P. J. Kenney, and J. Crittenden On the Margins of Democratic Life: The Impact of Race and Ethnicity on the Political Engagement of Young People American Politics Research, September 1, 2006; 34(5): 605 - 626. [Abstract] [PDF]
|
|
|
|
|
|
M. F. Teisl, B. Roe, and M. E. Vayda Incentive Effects on Response Rates, Data Quality, and Survey Administration Costs Int. J. Public Opin. Res., September 1, 2006; 18(3): 364 - 373. [Full Text] [PDF]
|
|
|
|
|
|
D. Heerwegh An Investigation of the Effect of Lotteries on Web Survey Response Rates Field Methods, May 1, 2006; 18(2): 205 - 220. [Abstract] [PDF]
|
|
|
|
|
|
C. S. Cycyota and D. A. Harrison What (Not) to Expect When Surveying Executives: A Meta-Analysis of Top Manager Response Rates and Techniques Over Time Organizational Research Methods, April 1, 2006; 9(2): 133 - 160. [Abstract] [PDF]
|
|
|
|
|
|
E. Ryu, M. P. Couper, and R. W. Marans Survey Incentives: Cash vs. In-Kind; Face-to-Face vs. Mail; Response Rate vs. Nonresponse Error Int. J. Public Opin. Res., March 1, 2006; 18(1): 89 - 106. [Full Text] [PDF]
|
|
|
|
 |
|
 M. E. Kropf and J. Blair Eliciting Survey Cooperation: Incentives, Self-Interest, and Norms of Cooperation Eval Rev, December 1, 2005; 29(6): 559 - 575. [Abstract] [PDF]
|
|
|
|
 |
|
 P. Edwards, R. Cooper, I. Roberts, and C. Frost Meta-analysis of randomised trials of monetary incentives and response to mailed questionnaires J Epidemiol Community Health, November 1, 2005; 59(11): 987 - 999. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 E. White, P. A. Carney, and A. S. Kolar Increasing Response to Mailed Questionnaires by Including a Pencil/Pen Am. J. Epidemiol., August 1, 2005; 162(3): 261 - 266. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. Diekmann The Power of Reciprocity: Fairness, Reciprocity, and Stakes in Variants of the Dictator Game Journal of Conflict Resolution, August 1, 2004; 48(4): 487 - 505. [Abstract] [PDF]
|
|
|
|
|
|
J. P. Birnholtz, D. B. Horn, T. A. Finholt, and S. J. Bae The Effects of Cash, Electronic, and Paper Gift Certificates as Respondent Incentives for a Web-Based Survey of Technologically Sophisticated Respondents Social Science Computer Review, August 1, 2004; 22(3): 355 - 362. [Abstract] [PDF]
|
|
|
|
|
|
T. L. Tuten, M. Galesic, and M. Bosnjak Effects of Immediate Versus Delayed Notification of Prize Draw Results on Response Behavior in Web Surveys: An Experiment Social Science Computer Review, August 1, 2004; 22(3): 377 - 384. [Abstract] [PDF]
|
|
|
|
 |
|
 K. Ladin L'Engle, C. J. Pardun, and J. D. Brown Accessing Adolescents: A School-Recruited, Home-Based Approach to Conducting Media and Health Research The Journal of Early Adolescence, May 1, 2004; 24(2): 144 - 158. [Abstract] [PDF]
|
|
|
|
 |
|
 M. A. Hager, S. Wilson, T. H. Pollak, and P. M. Rooney Response Rates for Mail Surveys of Nonprofit Organizations: A Review and Empirical Test Nonprofit and Voluntary Sector Quarterly, June 1, 2003; 32(2): 252 - 267. [Abstract] [PDF]
|
|
|
|
|
|
M. Bosnjak and T. L. Tuten Prepaid and Promised Incentives in Web Surveys: An Experiment Social Science Computer Review, May 1, 2003; 21(2): 208 - 217. [Abstract] [PDF]
|
|
|
|
|
|
M. M. Doody, A. S. Sigurdson, D. Kampa, K. Chimes, B. H. Alexander, E. Ron, R. E. Tarone, and M. S. Linet Randomized Trial of Financial Incentives and Delivery Methods for Improving Response to a Mailed Questionnaire Am. J. Epidemiol., April 1, 2003; 157(7): 643 - 651. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J.-F. Etter, M. Cucherat, and T. V. Perneger Questionnaire Color and Response Rates to Mailed Surveys: A Randomizedtrial Anda Meta-Analysis Eval Health Prof, June 1, 2002; 25(2): 185 - 199. [Abstract] [PDF]
|
|
|
|
 |
|
 C. S. Cycyota and D. A. Harrison Enhancing Survey Response Rates at the Executive Level: Are Employee- or Consumer-Level Techniques Effective? Journal of Management, April 1, 2002; 28(2): 151 - 176. [Abstract] [PDF]
|
|
|
|
|
|
Z. Simsek and J. F. Veiga A Primer on Internet Organizational Surveys Organizational Research Methods, July 1, 2001; 4(3): 218 - 235. [Abstract] [PDF]
|
|
|
|
|
|
D. Kasprzyk, D. E. Montano, J. S. St. Lawrence, and W. R. Phillips The Effects of Variations in Mode of Delivery and Monetary Incentive on Physicians' Responses to a Mailed Survey Assessing STD Practice Patterns Eval Health Prof, March 1, 2001; 24(1): 3 - 17. [Abstract] [PDF]
|
|
|
|
|
|
G. Baron, P. De Wals, and F. Milord Cost-Effectiveness of a Lottery for Increasing Physicians' Responses to a Mail Survey Eval Health Prof, March 1, 2001; 24(1): 47 - 52. [Abstract] [PDF]
|
|
|
|
 |
|
 J. H. Price, J. A. Dake, and R. Islam Selected Ethical Issues in Research and Publication: Perceptions of Health Education Faculty Health Educ Behav, February 1, 2001; 28(1): 51 - 64. [Abstract] [PDF]
|
|
|
|
|
|
R. L. Collins, P. L. Ellickson, R. D. Hays, and D. F. Mccaffrey Effects of Incentive Size and Timing on Response Rates to a Follow-Up Wave of a Longitudinal Mailed Survey Eval Rev, August 1, 2000; 24(4): 347 - 363. [Abstract] [PDF]
|
|
|
|
|
|
Z. Simsek and J. F. Veiga The Electronic Survey Technique: An Integration and Assessment Organizational Research Methods, January 1, 2000; 3(1): 93 - 115. [Abstract] [PDF]
|
|
|
|
|
|
H. Cho and R. Larose Privacy Issues in Internet Surveys Social Science Computer Review, November 1, 1999; 17(4): 421 - 434. [Abstract] [PDF]
|
|
|
|
 |
|
 Bibliography Current Sociology, October 1, 1998; 46(4): 119 - 135.
|
|
|
|
|
|
P. L. Roth and C. A. BeVier Response Rates in HRM/OB Survey Research: Norms and Correlates, 1990-1994 Journal of Management, February 1, 1998; 24(1): 97 - 117. [Abstract] [PDF]
|
|
|
|
|
|
S. A. Everett, J. H. Price, A. W. Bedell, and S. K. Telljohann The Effect of a Monetary Incentive in Increasing the Return Rate of a Survey to Family Physicians Eval Health Prof, June 1, 1997; 20(2): 207 - 214. [Abstract] [PDF]
|
|