Causal Inference in Conjoint Analysis: Understanding Multidimensional Choices via Stated Preference Experiments
The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
Survey experiments are a core tool for causal inference. Yet, the design of classical survey experiments prevents them from identifying which components of a multidimensional treatment are influential. Here, we show how conjoint analysis , an experimental design yet to be widely applied in political science, enables researchers to estimate the causal effects of multiple treatment components and assess several causal hypotheses simultaneously. In conjoint analysis, respondents score a set of alternatives, where each has randomly varied attributes. Here, we undertake a formal identification analysis to integrate conjoint analysis with the potential outcomes framework for causal inference. We propose a new causal estimand and show that it can be nonparametrically identified and easily estimated from conjoint data using a fully randomized design. The analysis enables us to propose diagnostic checks for the identification assumptions. We then demonstrate the value of these techniques through empirical applications to voter decision making and attitudes toward immigrants.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Conditional logit analysis of qualitative choice behavior
McFadden, D. L. (1972) · eScholarship (California Digital Library) · Cited by 14,203
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
Cragg, J. G., & Zarembka, P. (1975) · The Canadian Journal of Economics · doi:10.2307/134075 · Cited by 8,342
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
Eulau, H. (1960) · American Political Science Review · doi:10.1017/s000305540012235x · Cited by 4,722
Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012) · Political Analysis · doi:10.1093/pan/mpr057 · Cited by 4,008
Constructive Consumer Choice Processes
Bettman, J. R., Luce, M. F., & Payne, J. W. (1998) · Journal of Consumer Research · doi:10.1086/209535 · Cited by 2,831
Simultaneous conjoint measurement: A new type of fundamental measurement
Luce, R. D., & Tukey, J. W. (1964) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(64)90015-x · Cited by 2,007
Contingent Valuation: Is Some Number Better than No Number?
Diamond, P. A., & Hausman, J. A. (1994) · Journal of Economic Perspectives · doi:10.1257/jep.8.4.45 · Cited by 1,894
Causal Mechanisms in the Social Sciences
Hedström, P., & Ylikoski, P. (2010) · Annual Review of Sociology · doi:10.1146/annurev.soc.012809.102632 · Cited by 1,630
On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9
Splawa-Neyman, J., Dabrowska, D. M., & Speed, T. P. (1990) · Statistical Science · doi:10.1214/ss/1177012031 · Cited by 1,627
IMAI, K., KEELE, L., TINGLEY, D., & YAMAMOTO, T. (2011) · American Political Science Review · doi:10.1017/s0003055411000414 · Cited by 1,537
Self-citationRandomization Analysis of Experimental Data: The Fisher Randomization Test Comment
Rubin, D. B. (1980) · Journal of the American Statistical Association · doi:10.2307/2287653 · Cited by 1,368
Labor Market Competition and Individual Preferences Over Immigration Policy
Scheve, K. F., & Slaughter, M. J. (2001) · Review of Economics and Statistics · doi:10.1162/003465301750160108 · Cited by 1,349
Conjoint Measurement- for Quantifying Judgmental Data
Green, P. E., & Rao, V. R. (1971) · Journal of Marketing Research · doi:10.1177/002224377100800312 · Cited by 1,346
Field Experiments: Design, Analysis, and Interpretation
Green, D. (2024) · doi:10.61700/sgeirzx0v0mjh1252 · Cited by 1,320
Public Opinion Toward Immigration Reform: The Role of Economic Motivations
Citrin, J., Green, D. P., Muste, C., & Wong, C. (1997) · The Journal of Politics · doi:10.2307/2998640 · Cited by 1,221
Attitudes toward Highly Skilled and Low-skilled Immigration: Evidence from a Survey Experiment
HAINMUELLER, J., & HISCOX, M. J. (2010) · American Political Science Review · doi:10.1017/s0003055409990372 · Cited by 1,191
Self-citationThe Use of Vignettes in Survey Research
Alexander, C. S., & Becker, H. J. (1978) · Public Opinion Quarterly · doi:10.1086/268432 · Cited by 1,169
The Race Card: Campaign Strategy, Implicit Messages, and the Norm of Equality
Mendelberg, T. (2001) · Princeton University Press eBooks · doi:10.1515/9781400889181 · Cited by 1,144
The Hidden American Immigration Consensus: A Conjoint Analysis of Attitudes toward Immigrants
Hainmueller, J., & Hopkins, D. J. (2015) · American Journal of Political Science · doi:10.1111/ajps.12138 · Cited by 952
Self-citationThe Race Card: Campaign Strategy, Implicit Messages, and the Norm of Equality
O'Reilly, K., & Mendelberg, T. (2002) · The Journal of Southern History · doi:10.2307/3069857 · Cited by 792
Information Load and Consumer Decision Making
Malhotra, N. K. (1982) · Journal of Consumer Research · doi:10.1086/208882 · Cited by 778
The Hidden American Immigration Consensus: A Conjoint Analysis of Attitudes Toward ImmigrantsPreprint
Hainmueller, J., & Hopkins, D. J. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2106116 · Cited by 753
Self-citation25 years of factorial surveys in sociology: A review
Wallander, L. (2009) · Social Science Research · doi:10.1016/j.ssresearch.2009.03.004 · Cited by 720
Conjoint Measurement for Quantifying Judgmental Data
Green, P. E., & Rao, V. R. (1971) · Journal of Marketing Research · doi:10.2307/3149575 · Cited by 659
Cambridge Handbook of Experimental Political Science
(2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511921452 · Cited by 611
Sniderman, P. M., & Carmines, E. G. (1997) · PS Political Science & Politics · doi:10.1017/s1049096500046667 · Cited by 568
The Logic of the Survey Experiment Reexamined
Gaines, B. J., Kuklinski, J. H., & Quirk, P. J. (2007) · Political Analysis · doi:10.1093/pan/mpl008 · Cited by 553
Partisan Hearts and Minds: Political Parties and the Social Identities of Voters
Green, D., Palmquist, B., & Schickler, E. (2017) · Yale University Press eBooks · doi:10.12987/9780300132007 · Cited by 484
Are Survey Experiments Externally Valid?
BARABAS, J., & JERIT, J. (2010) · American Political Science Review · doi:10.1017/s0003055410000092 · Cited by 481
Thirty Years of Conjoint Analysis: Reflections and Prospects
Green, P. E., Krieger, A. M., & Wind, Y. (2001) · Interfaces · doi:10.1287/inte.31.3s.56.9676 · Cited by 388
Distributive Justice and Earned Income
Jasso, G., & Rossi, P. H. (1977) · American Sociological Review · doi:10.2307/2094561 · Cited by 340
Who Should Get What? Fairness Judgments of the Distribution of Earnings
Alves, W. M., & Rossi, P. H. (1978) · American Journal of Sociology · doi:10.1086/226826 · Cited by 328
Innovations in Experimental Design in Attitude Surveys
Sniderman, P. M., & Grob, D. B. (1996) · Annual Review of Sociology · doi:10.1146/annurev.soc.22.1.377 · Cited by 260
Americanism in the Twenty-First Century: Public Opinion in the Age of Immigration
Schildkraut, D. J. (2010) · Cited by 237
The Simplest Shortcut of All: Sociodemographic Characteristics and Electoral Choice
Cutler, F. (2002) · The Journal of Politics · doi:10.1111/1468-2508.00135 · Cited by 224
Boundaries of Obligation in American Politics: Geographic, National, and Racial Communities
Wong, C. J. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511802874 · Cited by 206
Survey-Based Experiments on White Racial Attitudes Toward Residential Integration
Schuman, H., & Bobo, L. D. (1988) · American Journal of Sociology · doi:10.1086/228992 · Cited by 149
Qualitative and Quantitative Social Research: Papers in Honor of Paul F. Lazarsfeld
Burgess, R. L. (1980) · Sociology · doi:10.1177/003803858001400430 · Cited by 134
Choice-Based Conjoint Analysis: Models and Designs
Raghavarao, D., Wiley, J. B., & Chitturi, P. (2010) · Thammasat University Digital Collections · Cited by 133
Range and Number-of-Levels Effects in Derived and Stated Measures of Attribute Importance
Verlegh, P. W. J., Schifferstein, H. N. J., & Wittink, D. R. (2002) · Marketing Letters · doi:10.1023/a:1015063125062 · Cited by 130
The Logic and Design of the Survey Experiment: An Autobiography of a Methodological Innovation
Sniderman, P. M. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511921452.008 · Cited by 113
Boundaries of Obligation in American Politics: Geographic, National, and Racial Communities
Wong, C. J. (2010) · Cited by 113
Saved by the Stars and Stripes? Images of Protest, Salience of Threat, and Immigration Attitudes
Wright, M., & Citrin, J. (2010) · American Politics Research · doi:10.1177/1532673x10388140 · Cited by 88
The Vagaries of the Vignette World: A Comment on Alves and Rossi
Faia, M. A. (1980) · American Journal of Sociology · doi:10.1086/227096 · Cited by 58
Minimal sufficient causation and directed acyclic graphs
VanderWeele, T. J., & Robins, J. M. (2009) · The Annals of Statistics · doi:10.1214/08-aos613 · Cited by 56
MINIMAL SUFFICIENT CAUSATION AND DIRECTED ACYCLIC GRAPHSPreprint
VanderWeele, T. J., & Robins, J. M. (2009) · Cited by 51
Schulte, A. (2002) · Sociological Perspectives · doi:10.1525/sop.2002.45.1.81 · Cited by 48
Rossi, P. H., & Alves, W. M. (1980) · American Journal of Sociology · doi:10.1086/227097 · Cited by 19
Policy Design and Domestic Support for International BailoutsPreprint
Bechtel, M. M., Hainmueller, J., & Margalit, Y. M. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2163594 · Cited by 13
Self-citationStudying Public Opinion on Multidimensional Policies: The Case of the Eurozone Bailouts
Bechtel, M. M., Hainmueller, J., & Margalit, Y. M. (2012) · Alexandria (UniSG) (University of St.Gallen) · Cited by 11
Self-citationHainmueller, J., Hopkins, D. J., & Yamamoto, T. (2013) · Harvard Dataverse · doi:10.7910/dvn/thjyqr · Cited by 3
Self-citation
Research works printed but not linked: 7
- Green, 2002, Partisan hearts and minds
- Campbell, 1960, The American voter
- These journals are the American Journal of Political Science, the American Political Science Review, and the Journal of Politics.
- Hauser, 2007, MIT Sloan Courseware
- Brader, 2008, Is it immigration or the immigrants? The emotional influence of groups on public opinion and political action, American Journal of Political Science, 52
- 10.1287/inte.31.4.56.9676 · doi:10.1287/inte.31.4.56.9676 · Paper page
- Bechtel, 2013, Public support for global climate cooperation
Cited by
Awad, E., Dsouza, S., Kim, R., Schulz, J., Henrich, J., Shariff, A., Bonnefon, J.-F., & Rahwan, I. (2018) · Nature · doi:10.1038/s41586-018-0637-6 · Cited by 1,859
Public Attitudes Toward Immigration
Hainmueller, J., & Hopkins, D. J. (2014) · Annual Review of Political Science · doi:10.1146/annurev-polisci-102512-194818 · Cited by 1,668
“As Hainmueller & Hopkins (2012) and Hainmueller et al. (2014) detail, a technique in marketing known as conjoint analysis enables scholars to address these challenges.”
BackgroundSelf-citationValidating vignette and conjoint survey experiments against real-world behavior
Hainmueller, J., Hangartner, D., & Yamamoto, T. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1416587112 · Cited by 1,344
“S experiments, such as conjoint analysis (1, 2) and vignette factorial surveys (3, 4), are widely used in many areas”
Self-citationGRAHAM, M. H., & SVOLIK, M. W. (2020) · American Political Science Review · doi:10.1017/s0003055420000052 · Cited by 1,044
The Hidden American Immigration Consensus: A Conjoint Analysis of Attitudes toward Immigrants
Hainmueller, J., & Hopkins, D. J. (2015) · American Journal of Political Science · doi:10.1111/ajps.12138 · Cited by 952
Self-citation
Metadata
- Authors
- Hainmueller, J., Hopkins, D. J., & Yamamoto, T.
- Affiliations
- Harvard University (US)
- Corresponding author
- Yamamoto, Teppei
- Venue
- Political Analysis
- Publisher
- Cambridge University Press (CUP)
- Published
- 2014
- Volume
- 22
- Issue
- 1
- Pages
- 1-30
- ISSN
- 1047-1987 (ISSN-L)
- 1476-4989
- OpenAlex
- W2745098867
- Cited by
- 1,990
- References
- 51
- Citations by year
- 2026: 273 · 2025: 357 · 2024: 275 · 2023: 225 · 2022: 217 · 2021: 163 · 2020: 168 · 2019: 110 · 2018: 90 · 2017: 47 · 2016: 31 · 2015: 16 · 2014: 16
- FWCI
- 18.88
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Political Analysis (publishedVersion)
- Funders
- University of Cambridge
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Economic and Environmental Valuation
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Keywords
- conjoint analysis, causal inference, stated preference experiment, causal estimands, nonparametric identification, potential outcomes framework, randomized experiments, vote choice, attitudes toward immigrants
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.