The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
The Number of Choice Tasks and Survey Satisficing in Conjoint Experiments
Open accessAbstract
In recent years, political and social scientists have made increasing use of conjoint survey designs to study decision-making. Here, we study a consequential question which researchers confront when implementing conjoint designs: How many choice tasks can respondents perform before survey satisficing degrades response quality? To answer the question, we run a set of experiments where respondents are asked to complete as many as 30 conjoint tasks. Experiments conducted through Amazon’s Mechanical Turk and Survey Sampling International demonstrate the surprising robustness of conjoint designs, as there are detectable but quite limited increases in survey satisficing as the number of tasks increases. Our evidence suggests that in similar study contexts researchers can assign dozens of tasks without substantial declines in response quality.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A perspective on judgment and choice: mapping bounded rationality.
Kahneman, D. (2003) · American Psychologist · doi:10.1037/0003-066x.58.9.697 · Cited by 5,540
Hainmueller, J., Hopkins, D. J., & Yamamoto, T. (2014) · Political Analysis · doi:10.1093/pan/mpt024 · Cited by 1,990 · cited 1×
“This research design has critical strengths: it allows researchers to make causal inferences about a variety of potentially relevant attributes simultaneously, and so to compare the treatment effects of various attributes (Hainmueller et al. 2014).”
Self-citationValidating vignette and conjoint survey experiments against real-world behavior
Hainmueller, J., Hangartner, D., & Yamamoto, T. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1416587112 · Cited by 1,344
Self-citationBerinsky, A. J., Margolis, M. F., & Sances, M. W. (2014) · American Journal of Political Science · doi:10.1111/ajps.12081 · Cited by 951 · cited 1×
“Satisficing respondents are more likely to rush through surveys, ignore or skip instructions, choose response options because of their placement, and use other effort-saving heuristics (Berinsky et al. 2014).”
How economic, humanitarian, and religious concerns shape European attitudes toward asylum seekers
Bansak, K., Hainmueller, J., & Hangartner, D. (2016) · Science · doi:10.1126/science.aag2147 · Cited by 811
Self-citationDe Vaus, D., & de Vaus, D. (2013) · doi:10.4324/9780203519196 · Cited by 491
The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers
Stewart, N., Ungemach, C., Harris, A. J. L., Bartels, D. M., Newell, B. R., Paolacci, G., & Chandler, J. (2015) · Judgment and Decision Making · doi:10.1017/s1930297500005611 · Cited by 304 · cited 1×
“While both use opt-in survey samples, MT draws from a small, highly experienced population (e.g. Stewart et al. 2015).”
Why Partisans Do Not Sort: The Constraints on Political Segregation
Mummolo, J., & Nall, C. (2017) · The Journal of Politics · doi:10.1086/687569 · Cited by 269
Cited by
Information equivalence in survey experiments
Dafoe, A., Zhang, B., & Caughey, D. (2018) · Political Analysis · doi:10.1017/pan.2018.9 · Cited by 356
How to Run Surveys: A Guide to Creating Your Own Identifying Variation and Revealing the Invisible
Stantcheva, S. (2023) · Annual Review of Economics · doi:10.1146/annurev-economics-091622-010157 · Cited by 354
Schwarz, S., & Coppock, A. (2022) · The Journal of Politics · doi:10.1086/716290 · Cited by 269
The partisan nature of support for democratic backsliding: A comparative perspective
Gidengil, E., Stolle, D., & Bergeron‐Boutin, O. (2022) · European Journal of Political Research · doi:10.1111/1475-6765.12502 · Cited by 162
Ancestry, Color, or Culture? How Whites Racially Classify Others in the U.S.
Schachter, A., Flores, R. D., & Maghbouleh, N. (2021) · American Journal of Sociology · doi:10.1086/714215 · Cited by 74
Metadata
- Authors
- Bansak, K., Hainmueller, J., Hopkins, D. J., & Yamamoto, T.
- Venue
- Political Analysis
- Publisher
- Cambridge University Press (CUP)
- Published
- 2018-01
- Volume
- 26
- Issue
- 1
- Pages
- 112-119
- ISSN
- 1047-1987 (ISSN-L)
- 1476-4989
- OpenAlex
- W2590583519
- Cited by
- 245
- References
- 8
- FWCI
- 32.15
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Number of Choice Tasks and Survey Satisficing in Conjoint Experiments. https://app.cochat.ai/papers/10.1017/pan.2017.40
- The paper
- Bansak, K., Hainmueller, J., Hopkins, D. J., & Yamamoto, T. (2018). The Number of Choice Tasks and Survey Satisficing in Conjoint Experiments. Political Analysis. https://doi.org/10.1017/pan.2017.40
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.