Treatment Spillover Effects across Survey Experiments
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Embedding experiments within surveys has reinvigorated survey research. Several survey experiments are generally embedded within a survey, and analysts treat each of these experiments as self-contained. We investigate whether experiments are self-contained or if earlier treatments affect later experiments, which we call “experimental spillover.” We consider two types of bias that might be introduced by spillover: mean and inference biases. Using a simple procedure, we test for experimental spillover in two data sets: the 1991 Race and Politics Survey and a survey containing several experiments pertaining to foreign policy attitudes. We find some evidence of spillover and suggest solutions to avoid bias.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
The Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734
Krosnick, J. A. (1999) · Annual Review of Psychology · doi:10.1146/annurev.psych.50.1.537 · Cited by 1,852
The Logic of the Survey Experiment Reexamined
Gaines, B. J., Kuklinski, J. H., & Quirk, P. J. (2007) · Political Analysis · doi:10.1093/pan/mpl008 · Cited by 553
With Malice toward Some: How People Make Civil Liberties Judgments
Marcus, G. E., Sullivan, J. L., Theiss-Morse, E., & Wood, S. L. (1995) · doi:10.1017/cbo9781139174046 · Cited by 387
Cited by
Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012) · Political Analysis · doi:10.1093/pan/mpr057 · Cited by 4,008
How Elite Partisan Polarization Affects Public Opinion Formation
DRUCKMAN, J. N., PETERSON, E., & SLOTHUUS, R. (2013) · American Political Science Review · doi:10.1017/s0003055412000500 · Cited by 1,569
How Conditioning on Posttreatment Variables Can Ruin Your Experiment and What to Do about It
Montgomery, J. M., Nyhan, B., & Torres, M. (2018) · American Journal of Political Science · doi:10.1111/ajps.12357 · Cited by 800
Cambridge Handbook of Experimental Political Science
(2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511921452 · Cited by 611
Students as Experimental Participants: A Defense of the “Narrow Data Base”
Druckman, J. N., & Kam, C. D. (2011) · Cambridge Handbook of Experimental Political Science · doi:10.1017/cbo9780511921452.004 · Cited by 454
Are Attention Check Questions a Threat to Scale Validity?
Kung, F. Y. H., Kwok, N., & Brown, D. J. (2018) · Applied Psychology · doi:10.1111/apps.12108 · Cited by 380
Students as Experimental Participants: A Defense of the 'Narrow Data Base'
Druckman, J. N., & Kam, C. D. (2009) · SSRN Electronic Journal · doi:10.2139/ssrn.1498843 · Cited by 350
Mapping the Boundaries of Elite Cues: How Elites Shape Mass Opinion across International Issues
Guisinger, A., & Saunders, E. N. (2017) · International Studies Quarterly · doi:10.1093/isq/sqx022 · Cited by 331
Comparing and Combining List and Endorsement Experiments: Evidence from Afghanistan
Blair, G., Imai, K., & Lyall, J. (2014) · American Journal of Political Science · doi:10.1111/ajps.12086 · Cited by 187
“Specifically, we assume that the latent support levels in both experiments have the identical distribution by imposing the restriction γ = λ/ω, which directly connects the two models.”
Background
Metadata
- Authors
- Transue, J. E., Lee, D. J., & Aldrich, J. H.
- Venue
- Political Analysis
- Publisher
- Cambridge University Press (CUP)
- Published
- 2009
- Volume
- 17
- Issue
- 2
- Pages
- 143-161
- ISSN
- 1047-1987 (ISSN-L)
- 1476-4989
- OpenAlex
- W2156795730
- Cited by
- 58
- References
- 5
- FWCI
- 14.11
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.