Causal Inference in Conjoint Analysis: Understanding Multidimensional Choices via Stated Preference Experiments
The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
Survey experiments are a core tool for causal inference. Yet, the design of classical survey experiments prevents them from identifying which components of a multidimensional treatment are influential. Here, we show how conjoint analysis , an experimental design yet to be widely applied in political science, enables researchers to estimate the causal effects of multiple treatment components and assess several causal hypotheses simultaneously. In conjoint analysis, respondents score a set of alternatives, where each has randomly varied attributes. Here, we undertake a formal identification analysis to integrate conjoint analysis with the potential outcomes framework for causal inference. We propose a new causal estimand and show that it can be nonparametrically identified and easily estimated from conjoint data using a fully randomized design. The analysis enables us to propose diagnostic checks for the identification assumptions. We then demonstrate the value of these techniques through empirical applications to voter decision making and attitudes toward immigrants.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Conditional logit analysis of qualitative choice behavior
McFadden, D. L. (1972) · eScholarship (California Digital Library) · Cited by 14,203
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
Cragg, J. G., & Zarembka, P. (1975) · The Canadian Journal of Economics · doi:10.2307/134075 · Cited by 8,342
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
Eulau, H. (1960) · American Political Science Review · doi:10.1017/s000305540012235x · Cited by 4,722
Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012) · Political Analysis · doi:10.1093/pan/mpr057 · Cited by 4,008
Constructive Consumer Choice Processes
Bettman, J. R., Luce, M. F., & Payne, J. W. (1998) · Journal of Consumer Research · doi:10.1086/209535 · Cited by 2,831
Simultaneous conjoint measurement: A new type of fundamental measurement
Luce, R. D., & Tukey, J. W. (1964) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(64)90015-x · Cited by 2,007
Contingent Valuation: Is Some Number Better than No Number?
Diamond, P. A., & Hausman, J. A. (1994) · Journal of Economic Perspectives · doi:10.1257/jep.8.4.45 · Cited by 1,894
Causal Mechanisms in the Social Sciences
Hedström, P., & Ylikoski, P. (2010) · Annual Review of Sociology · doi:10.1146/annurev.soc.012809.102632 · Cited by 1,630
Research works printed but not linked: 7
- Green, 2002, Partisan hearts and minds
- Campbell, 1960, The American voter
- These journals are the American Journal of Political Science, the American Political Science Review, and the Journal of Politics.
- Hauser, 2007, MIT Sloan Courseware
- Brader, 2008, Is it immigration or the immigrants? The emotional influence of groups on public opinion and political action, American Journal of Political Science, 52
- 10.1287/inte.31.4.56.9676 · doi:10.1287/inte.31.4.56.9676 · Paper page
- Bechtel, 2013, Public support for global climate cooperation
Cited by
Awad, E., Dsouza, S., Kim, R., Schulz, J., Henrich, J., Shariff, A., Bonnefon, J.-F., & Rahwan, I. (2018) · Nature · doi:10.1038/s41586-018-0637-6 · Cited by 1,859
Public Attitudes Toward Immigration
Hainmueller, J., & Hopkins, D. J. (2014) · Annual Review of Political Science · doi:10.1146/annurev-polisci-102512-194818 · Cited by 1,668
“As Hainmueller & Hopkins (2012) and Hainmueller et al. (2014) detail, a technique in marketing known as conjoint analysis enables scholars to address these challenges.”
BackgroundSelf-citationValidating vignette and conjoint survey experiments against real-world behavior
Hainmueller, J., Hangartner, D., & Yamamoto, T. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1416587112 · Cited by 1,344
“S experiments, such as conjoint analysis (1, 2) and vignette factorial surveys (3, 4), are widely used in many areas”
Self-citationGRAHAM, M. H., & SVOLIK, M. W. (2020) · American Political Science Review · doi:10.1017/s0003055420000052 · Cited by 1,044
The Hidden American Immigration Consensus: A Conjoint Analysis of Attitudes toward Immigrants
Hainmueller, J., & Hopkins, D. J. (2015) · American Journal of Political Science · doi:10.1111/ajps.12138 · Cited by 952
Self-citationMeasuring Subgroup Preferences in Conjoint Experiments
Leeper, T. J., Hobolt, S. B., & Tilley, J. (2020) · Political Analysis · doi:10.1017/pan.2019.30 · Cited by 846
How economic, humanitarian, and religious concerns shape European attitudes toward asylum seekers
Bansak, K., Hainmueller, J., & Hangartner, D. (2016) · Science · doi:10.1126/science.aag2147 · Cited by 811
Self-citationFactors Associated With US Adults’ Likelihood of Accepting COVID-19 Vaccination
Kreps, S., Prasad, S., Brownstein, J. S., Hswen, Y., Garibaldi, B. T., Zhang, B., & Kriner, D. L. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.25594 · Cited by 732
“Educational attainment Less than high school 34 (2) High school/GED 410 (21) Some college 583 (30) 4-y College degree 469 (24) Graduate school 475 (24)”
BackgroundDivided by the vote: Affective polarization in the wake of the Brexit referendum
Hobolt, S. B., Leeper, T. J., & Tilley, J. (2021) · British Journal of Political Science · doi:10.1017/s0007123420000125 · Cited by 496
“2016; Hainmueller and Hopkins 2015), voting for candidates (Hainmueller et al. 2014) and preferences for labour market reform”
BackgroundDemand Effects in Survey Experiments: An Empirical Assessment
MUMMOLO, J., & PETERSON, E. (2019) · American Political Science Review · doi:10.1017/s0003055418000837 · Cited by 548
The Ties That Double Bind: Social Roles and Women's Underrepresentation in Politics
TEELE, D. L., KALLA, J., & ROSENBLUTH, F. (2018) · American Political Science Review · doi:10.1017/s0003055418000217 · Cited by 382
“Following Hainmueller, Hopkins, and Yamamoto (2014), we use cluster-robust standard errors at the respondent level to correct for potential withinrespondent clustering.”
InfluentialRenewable energy policy design and framing influence public support in the United States
Stokes, L. C., & Warshaw, C. (2017) · Nature Energy · doi:10.1038/nenergy.2017.107 · Cited by 355
“[26] The fully randomized design enables us to estimate the causal effects of multiple treatment components and assess several hypotheses simultaneously.”
BackgroundInformation equivalence in survey experiments
Dafoe, A., Zhang, B., & Caughey, D. (2018) · Political Analysis · doi:10.1017/pan.2018.9 · Cited by 356
“…(Sher and McKenzie 2006; Tomz and Weeks 2013, 853), “confounding” (Tomz and Weeks 2013, 849; Dafoe, Zhang, and Caughey 2015), “masking” and “aliasing” (Hainmueller, Hopkins, and Yamamoto 2014, 5, 25), violations of “excludability” (Butler and Homola 2017), and “bundled” or “compound”…”
BackgroundInfluentialHow to Run Surveys: A Guide to Creating Your Own Identifying Variation and Revealing the Invisible
Stantcheva, S. (2023) · Annual Review of Economics · doi:10.1146/annurev-economics-091622-010157 · Cited by 354
Who are the “illegals”? The social construction of illegality in the United States
Flores, R. D., & Schachter, A. (2018) · American Sociological Review · doi:10.1177/0003122418794635 · Cited by 303
“…are called Average Marginal Component Effects and can be efficiently estimated using an OLS model; however, the results are not modeldependent (see Hainmueller et al. 2014).4 We also estimate all treatment effects using logistic regression and conditional-logit models, which account for the fact…”
BackgroundMethodInfluentialWhich Clients are Deserving of Help? A Theoretical Model and Experimental Test
Jilke, S., & Tummers, L. (2018) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/muy002 · Cited by 336
“The order of student attributes was randomized across respondents to avoid order effects, but fixed within respondents to avoid confusion (see also Hainmueller et al. 2014).”
BackgroundInfluentialDoes Conjoint Analysis Mitigate Social Desirability Bias?
Horiuchi, Y., Markovich, Z., & Yamamoto, T. (2022) · Political Analysis · doi:10.1017/pan.2021.30 · Cited by 277
Self-citationSchwarz, S., & Coppock, A. (2022) · The Journal of Politics · doi:10.1086/716290 · Cited by 269
“When subjects rate multiple candidate pro fi les, we follow standard practice in the analysis of conjoint experiments and cluster our standard errors by re-spondent (Hainmueller et al. 2014).”
BackgroundMethodWhy Partisans Do Not Sort: The Constraints on Political Segregation
Mummolo, J., & Nall, C. (2017) · The Journal of Politics · doi:10.1086/687569 · Cited by 269
Ethnic Voting and Accountability in Africa: A Choice Experiment in Uganda
Carlson, E. (2015) · World Politics · doi:10.1017/s0043887115000015 · Cited by 266
Combining climate, economic, and social policy builds public support for climate action in the US
Bergquist, P., Mildenberger, M., & Stokes, L. C. (2020) · Environmental Research Letters · doi:10.1088/1748-9326/ab81c1 · Cited by 261
“The researcher can then calculate Average Marginal Component-Specific Effects (AMCEs) for each element of each policy bundle (Hainmueller et al 2014).”
BackgroundMethodInfluentialHow Clients Select Brokers: Competition and Choice in India's Slums
AUERBACH, A. M., & THACHIL, T. (2018) · American Political Science Review · doi:10.1017/s000305541800028x · Cited by 259
CLIFFORD, S., SHEAGLEY, G., & PISTON, S. (2021) · American Political Science Review · doi:10.1017/s0003055421000241 · Cited by 254
Perspective taking can promote short-term inclusionary behavior toward Syrian refugees
Adida, C. L., Lo, A., & Platas, M. R. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1804002115 · Cited by 249
“We also contribute to a rich literature on immigrant exclusion, which often treats individual attitudes and behaviors toward immigrants as static (24).”
BackgroundThe Number of Choice Tasks and Survey Satisficing in Conjoint Experiments
Bansak, K., Hainmueller, J., Hopkins, D. J., & Yamamoto, T. (2018) · Political Analysis · doi:10.1017/pan.2017.40 · Cited by 245
“This research design has critical strengths: it allows researchers to make causal inferences about a variety of potentially relevant attributes simultaneously, and so to compare the treatment effects of various attributes (Hainmueller et al. 2014).”
Self-citationWhen Do Renters Behave Like Homeowners? High Rent, Price Anxiety, and NIMBYism
HANKINSON, M. (2018) · American Political Science Review · doi:10.1017/s0003055418000035 · Cited by 225
CARNES, N., & LUPU, N. (2016) · American Political Science Review · doi:10.1017/s0003055416000551 · Cited by 223
“The other diagnostic checks described in Hainmueller et al. (2014) were not applicable to this research design: our study could not exhibit carryover effects (since our experiments presented each respondent with only one pair of candidates, not multiple back-to-back pairs as in Hainmueller et al.…”
BackgroundMethodInfluentialCandidate Choice Without Party Labels: New Insights from Conjoint Survey Experiments
Kirkland, P. A., & Coppock, A. (2018) · Political Behavior · doi:10.1007/s11109-017-9414-8 · Cited by 214
“Because the vote choice dependent variable is binary, some analysts would opt for a binary choice model such as logit or probit, but this is unnecessary in our setting because, as shown by Hainmueller et al. (2014), OLS is a consistent estimator of the AMCE.”
BackgroundMethodInfluentialCould revenue recycling make effective carbon taxation politically feasible?
Beiser-McGrath, L. F., & Bernauer, T. (2019) · Science Advances · doi:10.1126/sciadv.aax3323 · Cited by 208
Huber, R. A., Wicki, M. L., & Bernauer, T. (2020) · Environmental Politics · doi:10.1080/09644016.2019.1629171 · Cited by 200
“…policy instruments beforehand, and capturing policy preferences via a choice experiment where respondents are exposed to a wide range of policy instruments with different characteristics afterwards, is likely to mitigate problems of ad-hoc rationalization (Wallander 2009, Hainmueller et al. 2014).”
BackgroundMethodInfluentialYamane, T., & Kaneko, S. (2021) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2021.125932 · Cited by 199
Reeskens, T., & van der Meer, T. (2019) · Journal of European Social Policy · doi:10.1177/0958928718768335 · Cited by 188
“Methodological advances (Hainmueller et al., 2014) showed that experiments with few attributes might induce bias because deservingness perceptions would be based on omitted information; alternatively, offering many attributes might overwhelm respondents, making it possible that some are not even…”
BackgroundSexual Harassment and Gender Inequality in the Labor Market
Folke, O., & Rickne, J. (2022) · The Quarterly Journal of Economics · doi:10.1093/qje/qjac018 · Cited by 190
The Structure of American Income Tax Policy Preferences
Ballard-Rosa, C., Martin, L., & Scheve, K. (2017) · The Journal of Politics · doi:10.1086/687324 · Cited by 187
“Hainmueller et al. (2014) show that, under the conditional independent randomization of the attribute values, the AMCE can be estimated using linear regression.”
MethodCarey, J., Clayton, K., Helmke, G., Nyhan, B., Sanders, M., & Stokes, S. (2022) · Journal of Elections, Public Opinion and Parties · doi:10.1080/17457289.2020.1790577 · Cited by 177
“Based on respondents ’ pairwise choices, we calculate the Average Marginal Component E ff ect (AMCE) for each level on each attribute (Hainmueller, Hopkins, and Yamamoto 2014) and display the results in coe ffi cient plots that show the average e ff ect of changing each candidate attribute on the…”
How the Public Defines Terrorism
Huff, C., & Kertzer, J. D. (2018) · American Journal of Political Science · doi:10.1111/ajps.12329 · Cited by 173
Violence, Empathy and Altruism: Evidence from the Ivorian Refugee Crisis in Liberia
Hartman, A. C., & Morse, B. S. (2020) · British Journal of Political Science · doi:10.1017/s0007123417000655 · Cited by 167
The Politics of Trade-Offs: Studying the Dynamics of Welfare State Reform With Conjoint Experiments
Häusermann, S., Kurer, T., & Traber, D. (2019) · Comparative Political Studies · doi:10.1177/0010414018797943 · Cited by 166
“component, in our case the levels—or the changes from the status quo—independently of the configuration of the other components (Hainmueller et al., 2014).”
BackgroundMethodInfluentialBechtel, M. M., Genovese, F., & Scheve, K. F. (2019) · British Journal of Political Science · doi:10.1017/s0007123417000205 · Cited by 166
Improving the External Validity of Conjoint Analysis: The Essential Role of Profile Distribution
Cuesta, B. D. L., Egami, N., & Imai, K. (2021) · Political Analysis · doi:10.1017/pan.2020.40 · Cited by 157
“, 2001; Marshall and Bradlow, 2002), conjoint analysis has quickly gained popularity in political science due to its wide applicability and relative simplicity (Hainmueller et al., 2014).”
InfluentialAlrababa’h, A., Dillon, A., Williamson, S., Hainmueller, J., Hangartner, D., & Weinstein, J. M. (2020) · Comparative Political Studies · doi:10.1177/0010414020919910 · Cited by 158
“In addition to the exploratory observational design, we implemented a randomized conjoint experiment (Hainmueller et al., 2014) to identify the effects of refugees’ specific attributes on Jordanians’ willingness to host them.”
BackgroundMethodSelf-citationMotta, M. (2021) · Social Science & Medicine · doi:10.1016/j.socscimed.2020.113642 · Cited by 156
What Do We Learn about Voter Preferences from Conjoint Experiments?
Abramson, S. F., Koçak, K., & Magazinnik, A. (2022) · American Journal of Political Science · doi:10.1111/ajps.12714 · Cited by 148
Alrababa’h, A., Marble, W., Mousa, S., & Siegel, A. A. (2021) · American Political Science Review · doi:10.1017/s0003055421000423 · Cited by 159
Strebel, M. A., Kübler, D., & Marcinkowski, F. (2018) · European Journal of Political Research · doi:10.1111/1475-6765.12293 · Cited by 164
“More precisely, ‘the average marginal component effect (AMCE) represents the marginal effect of attribute l averaged over the joint distribution of the remaining attributes’ (Hainmueller et al. 2014: 10; emphasis in original).”
BackgroundMethodResultInfluentialAmericans’ perceptions of privacy and surveillance in the COVID-19 pandemic
Zhang, B., Kreps, S. E., McMurry, N., & McCain, R. M. (2020) · PLoS ONE · doi:10.1371/journal.pone.0242652 · Cited by 146
“questions, such as how voters evaluate characteristics of electoral candidates or how citizens evaluate immigrants applying for citizenship [18].”
BackgroundNews from the Other Side: How Topic Relevance Limits the Prevalence of Partisan Selective Exposure
Mummolo, J. (2016) · The Journal of Politics · doi:10.1086/685584 · Cited by 185
Horiuchi, Y., Smith, D. M., & Yamamoto, T. (2018) · Political Analysis · doi:10.1017/pan.2018.2 · Cited by 137
Self-citationResolving content moderation dilemmas between free speech and harmful misinformation
Kozyreva, A., Herzog, S. M., Lewandowsky, S., Hertwig, R., Lorenz-Spreen, P., Leiser, M., & Reifler, J. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2210666120 · Cited by 166
“A conjoint design is particularly suitable for such a multilevel problem, where a variety of factors can impact decisionmaking (41, 42).”
BackgroundThe Contingent Effects of Candidate Sex on Voter Choice
Ono, Y., & Burden, B. C. (2018) · Political Behavior · doi:10.1007/s11109-018-9464-6 · Cited by 132
“…vary all treatments simultaneously to allow for assessment of the impact of the independent and interactive effects of multiple variables on a common outcome metric without sacrificing much statistical power or imposing assumptions about functional form (Hainmueller, Hopkins, and Yamamoto 2014).”
BackgroundMethodInfluentialBeyond the Breaking Point? Survey Satisficing in Conjoint Experiments
Bansak, K. C., Hainmueller, J., Hopkins, D. J., & Yamamoto, T. (2017) · Political Science Research and Methods · doi:10.1017/psrm.2019.13 · Cited by 143
“Yet this AMCE is defined with respect to the other attributes that appeared alongside partisanship, and so can change as those attributes do (Hainmueller et al. 2014).”
InfluentialSelf-citationOliveros, V., & Schuster, C. (2017) · Comparative Political Studies · doi:10.1177/0010414017710268 · Cited by 151
“Respondents are provided with multiple reasons to justify any particular choice (Hainmueller et al., 2014).”
BackgroundMethodInfluentialGrimmer, J., Messing, S., & Westwood, S. J. (2017) · Political Analysis · doi:10.1017/pan.2017.15 · Cited by 157
Policy packaging can make food system transformation feasible
Fesenfeld, L., Wicki, M., Sun, Y., & Bernauer, T. (2020) · Nature Food · doi:10.1038/s43016-020-0047-4 · Cited by 132
Kreps, S. E., Dasgupta, N., Brownstein, J. S., Hswen, Y., & Kriner, D. L. (2021) · npj Vaccines · doi:10.1038/s41541-021-00335-2 · Cited by 130
Discriminatory attitudes against unvaccinated people during the pandemic
Bor, A., Jørgensen, F. J., & Petersen, M. B. (2022) · Nature · doi:10.1038/s41586-022-05607-y · Cited by 137
Bansak, K. C., Hainmueller, J., Hopkins, D. J., & Yamamoto, T. (2022) · Political Analysis · doi:10.1017/pan.2022.16 · Cited by 154
“…of Abramson et al. (2021) to the statistical analysis of randomized experiments and treatment effects, the latter of which has been the predominant framework for analyzing conjoint survey designs in the recent literature (e.g., De la Cuesta et al. 2021; Hainmueller et al. 2014; Leeper et al. 2020).”
InfluentialSelf-citationThe partisan nature of support for democratic backsliding: A comparative perspective
Gidengil, E., Stolle, D., & Bergeron‐Boutin, O. (2022) · European Journal of Political Research · doi:10.1111/1475-6765.12502 · Cited by 162
Doherty, D., Dowling, C. M., & Miller, M. G. (2019) · The Journal of Politics · doi:10.1086/704698 · Cited by 121
Bypassing the Enemy: Distributive Politics, Credit Claiming, and Non-State Organizations in Brazil
Bueno, N. (2016) · Comparative Political Studies · doi:10.1177/0010414017710255 · Cited by 133
“I test whether the causal effects of welfare and joint provision vary by mayor’s partisanship, which is the Average Component Interaction Effect (Hainmueller et al., 2014).”
BackgroundMethodFrom “Different” to “Similar”: An Experimental Approach to Understanding Assimilation
Schachter, A. (2016) · American Sociological Review · doi:10.1177/0003122416659248 · Cited by 160
“Reweighting allows me to assign differential weights to the four citizenship treatments (for more detailed explanation of reweighting in conjoint experiments, see Hainmueller et al. 2014).”
BackgroundMethodInfluentialFirms and Global Value Chains: Identifying Firms’ Multidimensional Trade Preferences
Kim, I., Milner, H. V., Bernauer, T., Osgood, I., Spilker, G., & Tingley, D. H. (2019) · International Studies Quarterly · doi:10.1093/isq/sqy055 · Cited by 139
How to make causal inferences using texts
Egami, N., Fong, C., Grimmer, J., Roberts, M. E., & Stewart, B. M. (2018) · Science Advances · doi:10.1126/sciadv.abg2652 · Cited by 205
Toral, G. (2023) · American Journal of Political Science · doi:10.1111/ajps.12758 · Cited by 133
“I estimate the average marginal component effect (AMCE) for each attribute’s value using the following linear regression (Hainmueller et al. 2014): Y ijk is the choice expressed by respondent i for profile j in the choice task k (i.e., whether that manager profile was chosen).”
BackgroundMethodIdeology, Not Affect: What Americans Want from Political Representation
Costa, M. (2021) · American Journal of Political Science · doi:10.1111/ajps.12571 · Cited by 118
Magni, G., & Reynolds, A. (2020) · The Journal of Politics · doi:10.1086/712142 · Cited by 117
“12 Studies based on conjoint experiments usually conduct subgroup analysis by comparing AMCEs between subgroups.”
BackgroundInfluentialExposure to Immigration and Admission Preferences: Evidence From France
Clayton, K., Ferwerda, J., & Horiuchi, Y. (2018) · Political Behavior · doi:10.1007/s11109-019-09550-z · Cited by 129
Gutiérrez‐Romero, R., & LeBas, A. (2016) · Journal of Peace Research · doi:10.1177/0022343319892677 · Cited by 123
Bremer, B., & Bürgisser, R. (2022) · Political Science Research and Methods · doi:10.1017/psrm.2021.78 · Cited by 123
Multi-dimensional preferences for labour market reforms: a conjoint experiment
Gallego, A., & Marx, P. (2016) · Journal of European Public Policy · doi:10.1080/13501763.2016.1170191 · Cited by 119
“As Hainmueller et al (2014) demonstrate, the average change in the probability of selecting an alternative caused by the inclusion of each attribute can be estimated using a simple ordinary least squares (OLS) linear regression.”
BackgroundMethodInfluentialWright, M., Levy, M., & Citrin, J. (2016) · Political Behavior · doi:10.1007/s11109-015-9311-y · Cited by 180
“Recent work (Hainmueller et al. 2014) proposes conjoint analysis as a way of overcoming this problem, and our design here builds on that approach.”
BackgroundMethodCorruption, Accountability, and Gender: Do Female Politicians Face Higher Standards in Public Life?
Eggers, A. C., Vivyan, N., & Wagner, M. (2017) · The Journal of Politics · doi:10.1086/694649 · Cited by 113
“This should also reduce social desirability bias, as respondents can justify their vote on the basis of a number of considerations (Hainmueller et al. 2014).”
BackgroundSobolewska, M., Galandini, S., & Lessard-Phillips, L. (2016) · Journal of Ethnic and Migration Studies · doi:10.1080/1369183x.2016.1248377 · Cited by 120
“…the ‘average change in the probability that a profile will win support when it includes the listed attribute values instead of the baseline’ (Hainmueller, Hopkins, and Yamamoto 2014, 19) and show which attributes of the profile lead respondents to choose who the most integrated immigrant…”
BackgroundMethodInfluentialPositive, global, and health or environment framing bolsters public support for climate policies
Dasandi, N., Graham, H. M., Hudson, D., Mikhaylov, S., Hudson, J. V.-H., & Watts, N. (2022) · Communications Earth & Environment · doi:10.1038/s43247-022-00571-x · Cited by 153
Catching the ‘Deliberative Wave’? How (Disaffected) Citizens Assess Deliberative Citizen Forums
Goldberg, S., & Bächtiger, A. (2022) · British Journal of Political Science · doi:10.1017/s0007123422000059 · Cited by 123
“Conjoint experiments are particularly attractive because they allow for estimating several effects simultaneously without having to observe all possible combinations of attributes (see, for example, Hainmueller et al. 2014).”
InfluentialHow Political Signals Affect Public Support for Judicial Nominations
Sen, M. (2017) · Political Research Quarterly · doi:10.1177/1065912917695229 · Cited by 109
“By evaluating which combinations lead to more support, the conjoint design enables the isolation of those characteristics that are more or less popular (Hainmueller, Hopkins, and Yamamoto 2014).”
BackgroundMethodInfluentialPolicy design and domestic support for international bailouts
Bechtel, M. M., Hainmueller, J., & Margalit, Y. M. (2017) · European Journal of Political Research · doi:10.1111/1475-6765.12210 · Cited by 107
“To assess the impact of each feature along those dimensions, we estimate the average marginal component-specific effects (AMCEs), which measure the average impact of a change in a policy feature on the probability of opposing the bailout package (Hainmueller et al., 2014).”
InfluentialSelf-citationWicki, M., Fesenfeld, L., & Bernauer, T. (2019) · Environmental Research Letters · doi:10.1088/1748-9326/ab30a2 · Cited by 109
“To assess our theoretical arguments, we use a conjoint experiment5, which is particularly useful in studying causal effects of multiple variables in complex preference formation or decision-making processes (Rienstra et al 1999, Hainmueller et al 2014).”
BackgroundMethodResultInfluentialOutsiders at Home: The Politics of American Islamophobia
Lajevardi, N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108782814 · Cited by 110
Conditionality & Coercion: Electoral clientelism in Eastern Europe
Mares, I., & Young, L. (2019) · doi:10.1093/oso/9780198832775.001.0001 · Cited by 108
Multiple Dimensions of Bureaucratic Discrimination: Evidence from German Welfare Offices
Hemker, J., & Hager, A. (2017) · American Journal of Political Science · doi:10.1111/ajps.12312 · Cited by 115
Causal Interaction in Factorial Experiments: Application to Conjoint Analysis
Egami, N., & Imai, K. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2018.1476246 · Cited by 114
“Although the uniform or empirical distribution would be a reasonable default choice for many experimentalists, researchers can improve the external validity of their exper-iment by using a treatment distribution based on the target population (Hainmueller, Hopkins, and Yamamoto 2014).”
InfluentialWicki, M., Huber, R. A., & Bernauer, T. (2019) · Journal of Public Policy · doi:10.1017/s0143814x19000205 · Cited by 117
“The data analysis was based on linear mixed effects regressions to estimate the AMCE (R Core Team 2015).10 We used individuals as tier 2 group, which was in line with a suggestion by Hainmueller et al. (2014) that allowed us to estimate the effects of the EV and the emission reduction frames and other covariates.”
BackgroundMethodInfluentialThe Populist Marketplace: Unpacking the Role of “Thin” and “Thick” Ideology
Neuner, F. G., & Wratil, C. (2020) · Political Behavior · doi:10.1007/s11109-020-09629-y · Cited by 120
“1 Conjoint experiments are an increasingly popular tool that allow researchers to simultaneously test the causal effects of a multitude of factors (Hainmueller et al. 2014).”
Identifying Voter Preferences for Politicians' Personal Attributes: A Conjoint Experiment in Japan
Horiuchi, Y., Smith, D. M., & Yamamoto, T. (2016) · Political Science Research and Methods · doi:10.1017/psrm.2018.26 · Cited by 104
Self-citationFranchino, F., & Zucchini, F. (2014) · Political Science Research and Methods · doi:10.1017/psrm.2014.24 · Cited by 102
Stadelmann‐Steffen, I., & Dermont, C. (2020) · Energy Research & Social Science · doi:10.1016/j.erss.2020.101818 · Cited by 108
“[49] and Stadelmann-Steffen & Dermont [38] in applying a fully randomized conjoint design (For more information on the survey, please refer to the online supplemental materials).”
BackgroundMethodInfluentialMarshall, J. (2022) · American Journal of Political Science · doi:10.1111/ajps.12741 · Cited by 137
Why Friends and Neighbors? Explaining the Electoral Appeal of Local Roots
Campbell, R., Cowley, P., Vivyan, N., & Wagner, M. (2019) · The Journal of Politics · doi:10.1086/703131 · Cited by 98
“chosen of a particular value of an attribute compared to a baseline value of that attribute, averaging over all possible values of all other attributes and all attributes of the other MP included in the choice task (Hainmueller et al. 2014).”
BackgroundHow Do Observers Assess Resolve?
Kertzer, J. D., Renshon, J., & Yarhi-Milo, K. (2019) · British Journal of Political Science · doi:10.1017/s0007123418000595 · Cited by 103
Public Attitudes toward Young Immigrant Men
Ward, D. G. (2018) · American Political Science Review · doi:10.1017/s0003055418000710 · Cited by 94
Adida, C. L., Lo, A., & Izama, M. P. (2019) · PLoS ONE · doi:10.1371/journal.pone.0222504 · Cited by 103
“Conjoint analysis is a common methodological approach in marketing, but it was first introduced to political science by Hainmueller, Hopkins and Yamamoto [22].”
Using Eye-Tracking to Understand Decision-Making in Conjoint Experiments
Jenke, L., Bansak, K. C., Hainmueller, J., & Hangartner, D. (2020) · Political Analysis · doi:10.1017/pan.2020.11 · Cited by 91
“Researchers have also begun to examine methodological issues in conjoint experimentation, both in terms of statistical methods (Hainmueller, Hopkins, and Yamamoto ; de la Cuesta et al. ; Egami and Imai ; Leeper, Hobolt, and Tilley ) as well as survey design (Hainmueller, Hangartner, and Yamamoto ;…”
Self-citationCorruption Information and Vote Share: A Meta-Analysis and Lessons for Experimental Design
Incerti, T. (2020) · American Political Science Review · doi:10.1017/s000305542000012x · Cited by 93
Reciprocity and Public Opposition to Foreign Direct Investment
Chilton, A. S., Milner, H. V., & Tingley, D. H. (2017) · British Journal of Political Science · doi:10.1017/s0007123417000552 · Cited by 99
Voting for women in nonpartisan and partisan elections
Badas, A., & Stauffer, K. E. (2018) · Electoral Studies · doi:10.1016/j.electstud.2018.10.004 · Cited by 90
“By evaluating which combinations lead to more support, the conjoint experiment isolates traits that are more or less influential in vote choice (Hainmueller et al., 2014).”
BackgroundYou’re Not From Here!: The Consequences of Urban and Rural Identities
Lyons, J., & Utych, S. (2021) · Political Behavior · doi:10.1007/s11109-021-09680-3 · Cited by 148
The Effects of Information Voids on Capital Flows in Emerging Markets
Kingsley, A. F., & Graham, B. A. T. (2016) · Journal of International Business Studies · doi:10.1057/s41267-016-0056-6 · Cited by 92
An Empirical Justification for the Use of Racially Distinctive Names to Signal Race in Experiments
Butler, D. M., & Homola, J. (2017) · Political Analysis · doi:10.1017/pan.2016.15 · Cited by 87
“If the experiment is a survey vignette, researchers can incorporate the relevant pieces of information into the vignette (e.g., Hainmueller, Hopkins and Yamamoto 2014).”
Heuristics and Political Elites’ Judgment and Decision-Making
Vis, B. (2018) · Political Studies Review · doi:10.1177/1478929917750311 · Cited by 106
“Another route is to conduct a conjoint experiment (Hainmueller et al., 2014).”
Background
Metadata
- Authors
- Hainmueller, J., Hopkins, D. J., & Yamamoto, T.
- Affiliations
- Harvard University (US)
- Corresponding author
- Yamamoto, Teppei
- Venue
- Political Analysis
- Publisher
- Cambridge University Press (CUP)
- Published
- 2014
- Volume
- 22
- Issue
- 1
- Pages
- 1-30
- ISSN
- 1047-1987 (ISSN-L)
- 1476-4989
- OpenAlex
- W2745098867
- Cited by
- 1,990
- References
- 51
- Citations by year
- 2026: 273 · 2025: 357 · 2024: 275 · 2023: 225 · 2022: 217 · 2021: 163 · 2020: 168 · 2019: 110 · 2018: 90 · 2017: 47 · 2016: 31 · 2015: 16 · 2014: 16
- FWCI
- 18.88
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Political Analysis (publishedVersion)
- Funders
- University of Cambridge
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Economic and Environmental Valuation
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Keywords
- conjoint analysis, causal inference, stated preference experiment, causal estimands, nonparametric identification, potential outcomes framework, randomized experiments, vote choice, attitudes toward immigrants
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.