Public Opinion Quarterly 65:230-253 (2001)
© 2001 American Association for Public Opinion Research
Articles |
Web Survey Design and Administration*
Abstract
Many claims are being made about the advantages of conducting surveys on the Web. However, there has been little research on the effects of format or design on the levels of unit and item response or on data quality. In a study conducted at the University of Michigan, a number of experiments were added to a survey of the student population to assess the impact of design features on resulting data quality. A sample of 1,602 students was sent an e-mail invitation to participate in a Web survey on attitudes toward affirmative action. Three experiments on design approaches were added to the survey application. One experiment varied whether respondents were reminded of their progress through the instrument. In a second experiment, one version presented several related items on one screen, while the other version presented one question per screen. In a third experiment, for one series of questions a random half of the sample clicked radio buttons to indicate their answers, while the other half entered a numeric response in a box. This article discusses the overall implementation and outcome of the survey, and it describes the results of the imbedded design experiments.
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  J. D. Smyth, D. A. Dillman, L. M. Christian, and M. Mcbride Open-Ended Questions in Web Surveys: Can Increasing the Size of Answer Boxes and Providing Extra Verbal Instructions Improve Response Quality? Public Opin Q, June 1, 2009; 73(2): 325 - 337. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. L. Holland and L. M. Christian The Influence of Topic Interest and Interactive Probing on Responses to Open-Ended Questions in Web Surveys Social Science Computer Review, May 1, 2009; 27(2): 196 - 212. [Abstract] [PDF]
|
|
|
|
|
|
M. Fuchs Differences in the Visual Design Language of Paper-and-Pencil Surveys Versus Web Surveys: A Field Experimental Study on the Length of Response Fields in Open-Ended Frequency Questions Social Science Computer Review, May 1, 2009; 27(2): 213 - 227. [Abstract] [PDF]
|
|
|
|
 |
|
 V. Toepoel, M. Das, and A. Van Soest Design of Web Questionnaires: The Effects of the Number of Items per Screen Field Methods, May 1, 2009; 21(2): 200 - 213. [Abstract] [PDF]
|
|
|
|
 |
|
 M. Fuchs Asking for Numbers and Quantities: Visual Design Effects in Paper&Pencil Surveys Int. J. Public Opin. Res., March 1, 2009; 21(1): 65 - 84. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. Heerwegh Mode Differences Between Face-to-Face and Web Surveys: An Experimental Investigation of Data Quality and Social Desirability Effects Int. J. Public Opin. Res., March 1, 2009; 21(1): 111 - 121. [Full Text] [PDF]
|
|
|
|
 |
|
 K. O. Shropshire, J. E. Hawdon, and J. C. Witte Web Survey Design: Balancing Measurement, Response, and Topical Interest Sociological Methods Research, February 1, 2009; 37(3): 344 - 370. [Abstract] [PDF]
|
|
|
|
|
|
N. Malhotra Completion Time and Response Order Effects in Web Surveys Public Opin Q, December 23, 2008; (2008) nfn050v2. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
V. Toepoel, M. Das, and A. Van Soest Effects of Design in Web Surveys: Comparing Trained and Fresh Respondents Public Opin Q, December 1, 2008; 72(5): 985 - 1007. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. A. Klofstad, S. Boulianne, and D. Basson Matching the Message to the Medium: Results from an Experiment on Internet Survey Email Contacts Social Science Computer Review, November 1, 2008; 26(4): 498 - 509. [Abstract] [PDF]
|
|
|
|
 |
|
 I. Grava-Gubins and S. Scott Effects of various methodologic strategies: Survey response rates among Canadian physicians and physicians-in-training Can Fam Physician, October 1, 2008; 54(10): 1424 - 1430. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
T.-H. Shih and Xitao Fan Comparing Response Rates from Web and Mail Surveys: A Meta-Analysis Field Methods, August 1, 2008; 20(3): 249 - 271. [Abstract] [PDF]
|
|
|
|
 |
|
 K. E.A. Burns MD MSc, M. Duffett BScPharm, M. E. Kho PT MSc, M. O. Meade MD MSc, N. K.J. Adhikari MDCM MSc, T. Sinuff MD PhD, D. J. Cook MD MSc, and for the ACCADEMY Group A guide for the design and conduct of self-administered surveys of clinicians Can. Med. Assoc. J., July 29, 2008; 179(3): 245 - 252. [Full Text] [PDF]
|
|
|
|
|
|
L. M. Christian, D. A. Dillman, and J. D. Smyth Helping Respondents Get It Right the First Time: The Influence of Words, Symbols, and Graphics in Web Surveys Public Opin Q, March 1, 2007; 71(1): 113 - 125. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
B. Healey Drop Downs and Scroll Mice: The Effect of Response Option Format and Input Mechanism Employed on Data Quality in Web Surveys Social Science Computer Review, February 1, 2007; 25(1): 111 - 128. [Abstract] [PDF]
|
|
|
|
|
|
A. Peytchev, M. P. Couper, S. E. McCabe, and S. D. Crawford Web Survey Design: Paging versus Scrolling Public Opin Q, December 1, 2006; 70(4): 596 - 607. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 E. Deutskens, K. de Ruyter, and M. Wetzels An Assessment of Equivalence Between Online and Mail Surveys in Service Research Journal of Service Research, May 1, 2006; 8(4): 346 - 355. [Abstract] [PDF]
|
|
|
|
 |
|
 S. Hudson and J. R. B. Ritchie Promoting Destinations via Film Tourism: An Empirical Identification of Supporting Marketing Initiatives Journal of Travel Research, May 1, 2006; 44(4): 387 - 396. [Abstract] [PDF]
|
|
|
|
 |
|
 B. Franklin and T. Plum Successful Web Survey Methodologies for Measuring the Impact of Networked Electronic Services (MINES for Libraries) IFLA Journal, March 1, 2006; 32(1): 28 - 40. [Abstract] [PDF]
|
|
|
|
 |
|
 N. E. Kiernan, M. Kiernan, M. A. Oyler, and C. Gilles Is a Web Survey as Effective as a Mail Survey? A Field Experiment Among Computer Users American Journal of Evaluation, June 1, 2005; 26(2): 245 - 252. [Abstract] [PDF]
|
|
|
|
|
|
S. T. Cole Comparing Mail and Web-Based Survey Distribution Methods: Results of Surveys to Leisure Travel Retailers Journal of Travel Research, May 1, 2005; 43(4): 422 - 430. [Abstract] [PDF]
|
|
|
|
|
|
A. Peytchev and S. Crawford A Typology of Real-Time Validations in Web-Based Surveys Social Science Computer Review, May 1, 2005; 23(2): 235 - 249. [Abstract] [PDF]
|
|
|
|
|
|
R. Tourangeau, M. P. Couper, and F. Conrad Spacing, Position, and Order: Interpretive Heuristics for Visual Features of Survey Questions Public Opin Q, September 1, 2004; 68(3): 368 - 393. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. C. Witte, R. P. Pargas, C. Mobley, and J. Hawdon Instrument Effects of Images in Web Surveys: A Research Note Social Science Computer Review, August 1, 2004; 22(3): 363 - 369. [Abstract] [PDF]
|
|
|
|
|
|
M. D. Kaplowitz, T. D. Hadlock, and R. Levine A Comparison of Web and Mail Survey Response Rates Public Opin Q, March 1, 2004; 68(1): 94 - 101. [Full Text] [PDF]
|
|
|
|
|
|
M. P. Couper, R. Tourangeau, F. G. Conrad, and S. D. Crawford What They See Is What We Get: Response Options for Web Surveys Social Science Computer Review, February 1, 2004; 22(1): 111 - 127. [Abstract] [PDF]
|
|
|
|
 |
|
 S. R. McMahon, M. Iwamoto, M. S. Massoudi, H. R. Yusuf, J. M. Stevenson, F. David, S. Y. Chu, and L. K. Pickering Comparison of E-mail, Fax, and Postal Surveys of Pediatricians Pediatrics, April 1, 2003; 111(4): e299 - 303. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. D. Fricker and M. Schonlau Advantages and Disadvantages of Internet Research Surveys: Evidence from the Literature Field Methods, November 1, 2002; 14(4): 347 - 367. [Abstract] [PDF]
|
|
|
|
|
|
D. Heerwegh and G. Loosveldt An Evaluation of the Effect of Response Formats on Data Quality in Web Surveys Social Science Computer Review, November 1, 2002; 20(4): 471 - 484. [Abstract] [PDF]
|
|
|
|
|
|
S. Crawford Evaluation of Web Survey Data Collection Systems Field Methods, August 1, 2002; 14(3): 307 - 321. [Abstract] [PDF]
|
|