The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments
Open accessAbstract
The use of survey experiments has surged in political science. The most common design is the between-subjects design in which the outcome is only measured posttreatment. This design relies heavily on recruiting a large number of subjects to precisely estimate treatment effects. Alternative designs that involve repeated measurements of the dependent variable promise greater precision, but they are rarely used out of fears that these designs will yield different results than a standard design (e.g., due to consistency pressures). Across six studies, we assess this conventional wisdom by testing experimental designs against each other. Contrary to common fears, repeated measures designs tend to yield the same results as more common designs while substantially increasing precision. These designs also offer new insights into treatment effect size and heterogeneity. We conclude by encouraging researchers to adopt repeated measures designs and providing guidelines for when and how to use them.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1963) · Medical Entomology and Zoology · Cited by 15,085
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
The Nature and Origins of Mass Opinion
Zaller, J. R. (1992) · doi:10.1017/cbo9780511818691 · Cited by 7,785 · cited 1×
“…causal effects of the news media (Iyengar and Kinder 1987), campaign advertisements (Valentino, Hutchings, andWhite 2002), political information (Zaller 1992), emotions (Banks 2014), partisan identity (Huddy, Mason, and Aarøe 2015), candidate characteristics such as race (Krupnikov and Piston…”
BackgroundThe Nature and Origins of Mass Opinion.
Kenski, H. C., & Zaller, J. R. (1993) · Contemporary Sociology · doi:10.2307/2074664 · Cited by 5,169
Orne, M. T. (1962) · American Psychologist · doi:10.1037/h0043424 · Cited by 4,041
When Corrections Fail: The Persistence of Political Misperceptions
Nyhan, B., & Reifler, J. (2010) · Political Behavior · doi:10.1007/s11109-010-9112-2 · Cited by 3,173
Hainmueller, J., Hopkins, D. J., & Yamamoto, T. (2014) · Political Analysis · doi:10.1093/pan/mpt024 · Cited by 1,990
A Simple Theory of the Survey Response: Answering Questions versus Revealing Preferences
Zaller, J., & Feldman, S. (1992) · American Journal of Political Science · doi:10.2307/2111583 · Cited by 1,609
How Elite Partisan Polarization Affects Public Opinion Formation
DRUCKMAN, J. N., PETERSON, E., & SLOTHUUS, R. (2013) · American Political Science Review · doi:10.1017/s0003055412000500 · Cited by 1,569
Experimental methods: Between-subject and within-subject design
Charness, G., Gneezy, U., & Kuhn, M. A. (2012) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2011.08.009 · Cited by 1,469
Cited by
Designing Information Provision Experiments
Haaland, I., Roth, C., & Wohlfart, J. (2023) · Journal of Economic Literature · doi:10.1257/jel.20211658 · Cited by 541
How to Run Surveys: A Guide to Creating Your Own Identifying Variation and Revealing the Invisible
Stantcheva, S. (2023) · Annual Review of Economics · doi:10.1146/annurev-economics-091622-010157 · Cited by 354
LLM-generated messages can persuade humans on policy issues
Bai, H., Voelkel, J. G., Muldowney, S., Eichstaedt, J. C., & Willer, R. (2025) · Nature Communications · doi:10.1038/s41467-025-61345-5 · Cited by 110
Testing theories of political persuasion using AI
Argyle, L. P., Busby, E. C., Gubler, J. R., Lyman, A., Olcott, J., Pond, J., & Wingate, D. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2412815122 · Cited by 53
A randomized experiment evaluating survey mode effects for video interviewing
Endres, K., Hillygus, D. S., DeBell, M., & Iyengar, S. (2023) · Political Science Research and Methods · doi:10.1017/psrm.2022.30 · Cited by 22
Metadata
- Authors
- CLIFFORD, S., SHEAGLEY, G., & PISTON, S.
- Venue
- American Political Science Review
- Publisher
- Cambridge University Press (CUP)
- Published
- 2021-04-12
- Volume
- 115
- Issue
- 3
- Pages
- 1048-1065
- ISSN
- 0003-0554 (ISSN-L)
- 1537-5943
- OpenAlex
- W3156458201
- Cited by
- 254
- References
- 69
- FWCI
- 46.18
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments. https://app.cochat.ai/papers/10.1017/s0003055421000241
- The paper
- CLIFFORD, S., SHEAGLEY, G., & PISTON, S. (2021). Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments. American Political Science Review. https://doi.org/10.1017/s0003055421000241
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.