The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Web Survey Design and Administration
Abstract
Many claims are being made about the advantages of conducting surveys on the Web. However, there has been little research on the effects of format or design on the levels of unit and item response or on data quality. In a study conducted at the University of Michigan, a number of experiments were added to a survey of the student population to assess the impact of design features on resulting data quality. A sample of 1,602 students was sent an e-mail invitation to participate in a Web survey on attitudes toward affirmative action. Three experiments on design approaches were added to the survey application. One experiment varied whether respondents were reminded of their progress through the instrument. In a second experiment, one version presented several related items on one screen, while the other version presented one question per screen. In a third experiment, for one series of questions a random half of the sample clicked radio buttons to indicate their answers, while the other half entered a numeric response in a box. This article discusses the overall implementation and outcome of the survey, and it describes the results of the imbedded design experiments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mail and internet surveys : the tailored design method
Dillman, D. A. (2007) · Cited by 9,587
(2013) · Information Visualization · doi:10.1016/b978-0-12-381464-7.00018-1 · Cited by 3,742
Thinking About Answers: The Application of Cognitive Processes to Survey Methodology
Sudman, S., Bradburn, N. M., & Schwarz, N. (1995) · Cited by 1,586
Development of a Standard E-Mail Methodology: Results of an Experiment
Schaefer, D. R., & Dillman, D. A. (1998) · Public Opinion Quarterly · doi:10.1086/297851 · Cited by 830
Thinking about Answers: The Application of Cognitive Process to Survey Methodology
Aalbaum, G., Sudman, S., Bradburn, N. M., & Schwarz, N. (1996) · Journal of Marketing Research · doi:10.2307/3152133 · Cited by 783
Cognition and Communication: Judgmental Biases, Research Methods, and the Logic of Conversation
Schwarz, N. (2014) · Medical Entomology and Zoology · Cited by 537
Assimilation and Contrast Effects in Part-Whole Question Sequences: A Conversational Logic Analysis
Schwarz, N., Strack, F., & Mai, H.-P. (1991) · Public Opinion Quarterly · doi:10.1086/269239 · Cited by 400
The Formatting of Alphanumeric Displays: A Review and Analysis
Tullis, T. S. (1983) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872088302500604 · Cited by 232
Using E-mail To Survey Internet Users In The United States: Methodology And Assessment
Sheehan, K. B., & Hoy, M. G. (2006) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.1999.tb00101.x · Cited by 232
Usability Evaluation of Computer-Assisted Survey Instruments
Couper, M. P. (2000) · Social Science Computer Review · doi:10.1177/089443930001800402 · Cited by 177
Self-citation
Cited by
A Comparison of Web and Mail Survey Response Rates
Kaplowitz, M. D., Hadlock, T. D., & Levine, R. (2004) · Public Opinion Quarterly · doi:10.1093/poq/nfh006 · Cited by 1,661
Factors affecting response rates of the web survey: A systematic review
Fan, W., & Yan, Z. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2009.10.015 · Cited by 1,521
A guide for the design and conduct of self-administered surveys of clinicians
Burns, K. E. A., Duffett, M., Kho, M. E., Meade, M. O., Adhikari, N. K. J., Sinuff, T., Cook, D. J., & for the ACCADEMY Group (2008) · Canadian Medical Association Journal · doi:10.1503/cmaj.080372 · Cited by 1,354
Comparing Response Rates from Web and Mail Surveys: A Meta-Analysis
Shih, T.-H., & Fan, X. (2008) · Field Methods · doi:10.1177/1525822x08317085 · Cited by 1,159
Del Boca, F. K., & Darkes, J. (2003) · Addiction · doi:10.1046/j.1359-6357.2003.00586.x · Cited by 1,137
Kraut, R., Olson, J., Banaji, M., Bruckman, A., Cohen, J., & Couper, M. (2004) · American Psychologist · doi:10.1037/0003-066x.59.2.105 · Cited by 924
Self-citationVan Selm, M., & Jankowski, N. W. (2006) · Quality and Quantity · doi:10.1007/s11135-005-8081-8 · Cited by 905
Response Rate and Response Quality of Internet-Based Surveys: An Experimental Study
Deutskens, E., de Ruyter, K., Wetzels, M., & Oosterveld, P. (2004) · Marketing Letters · doi:10.1023/b:mark.0000021968.86465.00 · Cited by 835
Electronic Survey Methodology: A Case Study in Reaching Hard-to-Involve Internet Users
Andrews, D., Nonnecke, B., & Preece, J. (2003) · International Journal of Human-Computer Interaction · doi:10.1207/s15327590ijhc1602_04 · Cited by 747
Advantages and Disadvantages of Internet Research Surveys: Evidence from the Literature
Fricker, R. D., & Schonlau, M. (2002) · Field Methods · doi:10.1177/152582202237725 · Cited by 739
Web Surveys: Perceptions of Burden
Crawford, S. D., Couper, M. P., & Lamias, M. J. (2001) · Social Science Computer Review · doi:10.1177/089443930101900202 · Cited by 571
Self-citationHudson, S., & Ritchie, J. R. B. (2006) · Journal of Travel Research · doi:10.1177/0047287506286720 · Cited by 570
Designing Effective Web Surveys
Couper, M. P. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511499371 · Cited by 463
Self-citationRepTrak™ Pulse: Conceptualizing and Validating a Short-Form Measure of Corporate Reputation
Ponzi, L. J., Fombrun, C. J., & Gardberg, N. A. (2011) · Corporate Reputation Review · doi:10.1057/crr.2011.5 · Cited by 400
Spacing, Position, and Order: Interpretive Heuristics for Visual Features of Survey Questions
Tourangeau, R. (2004) · Public Opinion Quarterly · doi:10.1093/poq/nfh035 · Cited by 400
Holbrook, A. L., Krosnick, J. A., & Pfent, A. (2007) · Advances in Telephone Survey Methodology · doi:10.1002/9780470173404.ch23 · Cited by 380
Optimal experience of flow enhanced by telepresence: evidence from social media use
Pelet, J.-É., Ettis, S., & Cowart, K. (2017) · Information & Management · doi:10.1016/j.im.2016.05.001 · Cited by 354
Non-response in student surveys: The Role of Demographics, Engagement and Personality
Porter, S. R., & Whitcomb, M. E. (2005) · Research in Higher Education · doi:10.1007/s11162-004-1597-2 · Cited by 344
Strategies to improve response rates to web surveys: A literature review
Sammut, R., Griscti, O., & Norman, I. J. (2021) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2021.104058 · Cited by 343
Completion Time and Response Order Effects in Web Surveys
Malhotra, N. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn050 · Cited by 332
Heerwegh, D. (2009) · International Journal of Public Opinion Research · doi:10.1093/ijpor/edn054 · Cited by 298
The Impact of Contact Type on Web Survey Response Rates
Porter, S. R., & Whitcomb, M. E. (2003) · Public Opinion Quarterly · doi:10.1086/378964 · Cited by 287
Comparison of E-mail, Fax, and Postal Surveys of Pediatricians
McMahon, S. R., Iwamoto, M., Massoudi, M. S., Yusuf, H. R., Stevenson, J. M., David, F., Chu, S. Y., & Pickering, L. K. (2003) · Pediatrics · doi:10.1542/peds.111.4.e299 · Cited by 284
Pevec, D., Babic, J., Carvalho, A., Ghiassi-Farrokhfal, Y., Ketter, W., & Podobnik, V. (2020) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2020.122779 · Cited by 283
Nambisan, P. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2010-000058 · Cited by 282
Mixed method data collection strategies
(2007) · Choice Reviews Online · doi:10.5860/choice.44-6909 · Cited by 278
Improving response rates and evaluating nonresponse bias in surveys: AMEE Guide No. 102
Phillips, A. W., Reddy, S., & Durning, S. J. (2016) · Medical Teacher · doi:10.3109/0142159x.2015.1105945 · Cited by 269
A classification of response scale characteristics that affect data quality: a literature review
DeCastellarnau, A. (2018) · Quality & Quantity · doi:10.1007/s11135-017-0533-4 · Cited by 259
Kim, Y., Dykema, J., Stevenson, J., Black, P., & Moberg, D. P. (2019) · Social Science Computer Review · doi:10.1177/0894439317752406 · Cited by 258
A comparison of reliability between telephone and web-based surveys
Braunsberger, K., Wybenga, H., & Gates, R. (2007) · Journal of Business Research · doi:10.1016/j.jbusres.2007.02.015 · Cited by 222
Design Effects in the Transition to Web-Based Surveys
Dillman, D. A., & Smyth, J. D. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.03.008 · Cited by 194
The diffusion of human‐resource information‐technology innovations in US and non‐US firms
Florkowski, G. W., & Olivas‐Luján, M. R. (2006) · Personnel Review · doi:10.1108/00483480610702737 · Cited by 133
Prevalence and Profiling: Hazing Among College Students and Points of Intervention
Campo, S., Poulos, G., & Sipple, J. W. (2005) · American Journal of Health Behavior · doi:10.5993/ajhb.29.2.5 · Cited by 128
Web-based measurement: Effect of completing single or multiple items per webpage
Thorndike, F. P., Carlbring, P., Smyth, F. L., Magee, J. C., Gonder-Frederick, L., Ost, L.-G., & Ritterband, L. M. (2009) · Computers in Human Behavior · doi:10.1016/j.chb.2008.05.006 · Cited by 83
A Summary of Survey Methodology Best Practices for Security and Privacy Researchers
Redmiles, E. M., Acar, Y., Fahl, S., & Mazurek, M. L. (2017) · Digital Repository at the University of Maryland · doi:10.13016/m22k2w · Cited by 50
Intermittent Fasting Implementation and Association with Eating Disorder Symptomatology
Cuccolo, K., Kramer, R., Petros, T., & Thoennes, M. (2022) · Eating Disorders · doi:10.1080/10640266.2021.1922145 · Cited by 33
The use of internet-mediated cross-sectional studies in mental health research
Pitman, A., Osborn, D. P. J., & King, M. B. (2015) · BJPsych Advances · doi:10.1192/apt.bp.114.012948 · Cited by 22
Metadata
- Authors
- COUPER, M. P., TRAUGOTT, M. W., & LAMIAS, M. J.
- Venue
- Public Opinion Quarterly
- Publisher
- Oxford University Press (OUP)
- Published
- 2001-06-01
- Volume
- 65
- Issue
- 2
- Pages
- 230-253
- ISSN
- 0033-362X (ISSN-L)
- 1537-5331
- OpenAlex
- W2014542527
- Cited by
- 776
- References
- 11
- FWCI
- 82.97
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.