Skip Navigation

Public Opinion Quarterly 2006 70(1):66-77; doi:10.1093/poq/nfj007
This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (3)
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by Smyth, J. D.
Right arrow Articles by Stern, M. J.
Right arrow Search for Related Content
Social Bookmarking
Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

© The Author 2006. Published by Oxford University Press on behalf of the American Association for Public Opinion Research. All rights reserved. For permissions, please e-mail: journals.permissions@oxfordjournals.org.

Comparing Check-All and Forced-Choice Question Formats in Web Surveys

Jolene D. Smyth, Don A. Dillman, Leah Melani Christian and Michael J. Stern

Washington State University

Address correspondence to Jolene D. Smyth; e-mail: jsmyth{at}wsu.edu.

For survey researchers, it is common practice to use the check-all question format in Web and mail surveys but to convert to the forced-choice question format in telephone surveys. The assumption underlying this practice is that respondents will answer the two formats similarly. In this research note we report results from 16 experimental comparisons in two Web surveys and a paper survey conducted in 2002 and 2003 that test whether the check-all and forced-choice formats produce similar results. In all 16 comparisons, we find that the two question formats do not perform similarly; respondents endorse more options and take longer to answer in the forced-choice format than in the check-all format. These findings suggest that the forced-choice question format encourages deeper processing of response options and, as such, is preferable to the check-all format, which may encourage a weak satisficing response strategy. Additional analyses show that neither acquiescence bias nor item nonresponse seem to pose substantial problems for use of the forced-choice question format in Web surveys.


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?


This article has been cited by other articles:


Home page
 Measurement and Evaluation in Counseling and DevelopmentHome page
E. W. Wolfe, P. D. Converse, O. Airen, and N. Bodenhorn
Unit and Item Nonresponses and Ancillary Information in Web- and Paper-Based Questionnaires Administered to School Counselors
Measurement and Evaluation in Counseling and Development, July 1, 2009; 42(2): 92 - 103.
[Abstract] [PDF]

Home page
 Field MethodsHome page
V. Toepoel, M. Das, and A. Van Soest
Design of Web Questionnaires: The Effects of the Number of Items per Screen
Field Methods, May 1, 2009; 21(2): 200 - 213.
[Abstract] [PDF]

Home page
 Sociological Methods ResearchHome page
L. M. Christian, N. L. Parsons, and D. A. Dillman
Designing Scalar Questions for Web Surveys
Sociological Methods Research, February 1, 2009; 37(3): 393 - 425.
[Abstract] [PDF]

Home page
 Social Science Computer ReviewHome page
C. A. Klofstad, S. Boulianne, and D. Basson
Matching the Message to the Medium: Results from an Experiment on Internet Survey Email Contacts
Social Science Computer Review, November 1, 2008; 26(4): 498 - 509.
[Abstract] [PDF]

Home page
 Field MethodsHome page
M. J. Stern
The Use of Client-side Paradata in Analyzing the Effects of Visual Layout on Changing Responses in Web Surveys
Field Methods, November 1, 2008; 20(4): 377 - 398.
[Abstract] [PDF]

Home page
 Social Science Computer ReviewHome page
M. Denscombe
The Length of Responses to Open-Ended Questions: A Comparison of Online and Paper Questionnaires in Terms of a Mode Effect
Social Science Computer Review, August 1, 2008; 26(3): 359 - 368.
[Abstract] [PDF]

Home page
 Public Opin QHome page
J. D. Smyth, L. M. Christian, and D. A. Dillman
Does "Yes or No" on the Telephone Mean the Same as "Check-All-That-Apply" on the Web?
Public Opin Q, March 1, 2008; 72(1): 103 - 113.
[Abstract] [Full Text] [PDF]

Home page
 Am J EpidemiolHome page
T. Rosen and J. Olsen
Invited Commentary: The Art of Making Questionnaires Better
Am. J. Epidemiol., December 15, 2006; 164(12): 1145 - 1149.
[Abstract] [Full Text] [PDF]


Disclaimer: Please note that abstracts for content published before 1996 were created through digital scanning and may therefore not exactly replicate the text of the original print issues. All efforts have been made to ensure accuracy, but the Publisher will not be held responsible for any remaining inaccuracies. If you require any further clarification, please contact our Customer Services Department.