CoChat

Selection in Surveys: Using Randomized Incentives to Detect and Account for Nonresponse Bias

Open access
Dutz, Deniz, Huitfeldt, Ingrid, Lacouture, Santiago, Mogstad, Magne, Torgovitsky, Alexander, van Dijk, Winnie · 2021 · National Bureau of Economic Research
Cited by 34

The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.

Abstract

We show how to use randomized participation incentives to test and account for nonresponse bias in surveys.We first use data from a survey about labor market conditions, linked to fullpopulation administrative data, to provide evidence of large differences in labor market outcomes between participants and nonparticipants, differences which would not be observable to an analyst who only has access to the survey data.These differences persist even after correcting for observable characteristics, raising concerns about nonresponse bias in survey responses.We then use the randomized incentives in our survey to directly test for nonresponse bias, and find strong evidence that the bias is substantial.Next, we apply a range of existing methods that account for nonresponse bias and find they produce bounds (or point estimates) that are either wide or far from the ground truth.We investigate the failure of these methods by taking a closer look at the determinants of participation, finding that the composition of participants changes in opposite directions in response to incentives and reminder emails.We develop a model of participation that allows for two dimensions of unobserved heterogeneity in the participation decision.Applying the model to our data produces bounds (or point estimates) that are narrower and closer to the ground truth than the other methods.Our results highlight the benefits of including randomized participation incentives in surveys.Both the testing procedure and the methods for bias adjustment may be attractive tools for researchers who are able to embed randomized incentives into their survey.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3386/w29549

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 11 references

Cited by

See all 34

Metadata

Authors
Dutz, D., Huitfeldt, I., Lacouture, S., Mogstad, M., Torgovitsky, A., & van Dijk, W.
Venue
National Bureau of Economic Research
Published
2021-12
OpenAlex
W4200072060
Cited by
34
References
11
Type
report
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Selection in Surveys: Using Randomized Incentives to Detect and Account for Nonresponse Bias. https://app.cochat.ai/papers/10.3386/w29549
The paper
Dutz, D., Huitfeldt, I., Lacouture, S., Mogstad, M., Torgovitsky, A., & van Dijk, W. (2021). Selection in Surveys: Using Randomized Incentives to Detect and Account for Nonresponse Bias. National Bureau of Economic Research. https://doi.org/10.3386/w29549

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.