CoChat

Survey Mode Effects on Data Quality: Comparison of Web and Mail Modes in a U.S. National Panel Survey

Shin, Eunjung, Johnson, Timothy P., Rao, Kumar · 2012 · Social Science Computer Review
Cited by 85

The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.

Abstract

Web surveys are being increasingly incorporated into national survey data collection programs in the United States because of their cost/time-efficiencies. Yet, response rates and data quality issues in web surveys remain important challenges. As a basic study designed to better understand data quality in a mixed mode national survey, this article investigates the degree to which web versus mail survey modes affect unit and item responses. Findings indicate that the web survey mode produces a lower unit response rate compared to the mail mode. However, the web mode elicits higher data quality in terms of item responses to both closed- and open-ended questions. These mode effects on data quality remain after sociodemographic variables are held constant. Given the increasing integration of web survey questionnaires into mixed mode studies, additional research is necessary to understand and document the processes that underlie mode differences when responding to self-administered surveys.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1177/0894439311404508

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

  • A Comparison of Web and Mail Survey Response Rates

    Kaplowitz, M. D., Hadlock, T. D., & Levine, R. (2004) · Public Opinion Quarterly · doi:10.1093/poq/nfh006 · Cited by 1,661 · cited 4×

    “These findings confirm previous reports of the negative effects of the web survey mode on response rates (Bachmann, Elfrink, & Vazzana, 1996; Bech & Kristensen, 2009; Couper et al., 1999; Kaplowitz et al., 2004; Kwak & Radler, 2002; Link & Mokdad, 2006; Miller et al., 2002).”
    BackgroundResultInfluential
  • Comparing Response Rates from Web and Mail Surveys: A Meta-Analysis

    Shih, T.-H., & Fan, X. (2008) · Field Methods · doi:10.1177/1525822x08317085 · Cited by 1,159 · cited 2×

    “…Link & Mokdad, 2006; Lorenc, 2010; McCabe, 2004; McCabe, Boyd, Couper, Crawford, & d’Arcy, 2002; McCabe, Diez, Boyd, Nelson, & Weitzman, 2006; Miller, Kobayashi, Caldwell, Thurston, & Collett, 2002; Schaefer & Dillman, 1998; Schonlau et al., 2003; Shih & Fan, 2008; Wolfe, Converse, & Oswald, 2008).”
    Result

Show all 2 references

Cited by

See all 85

Metadata

Authors
Shin, E., Johnson, T. P., & Rao, K.
Venue
Social Science Computer Review
Published
2011-05-12
Volume
30
Issue
2
Pages
212-228
ISSN
  • 0894-4393 (ISSN-L)
  • 1552-8286
OpenAlex
W2057156173
Cited by
85
References
2
FWCI
20.36
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Survey Mode Effects on Data Quality: Comparison of Web and Mail Modes in a U.S. National Panel Survey. https://app.cochat.ai/papers/10.1177/0894439311404508
The paper
Shin, E., Johnson, T. P., & Rao, K. (2012). Survey Mode Effects on Data Quality: Comparison of Web and Mail Modes in a U.S. National Panel Survey. Social Science Computer Review. https://doi.org/10.1177/0894439311404508

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.