Causal Inference in Conjoint Analysis: Understanding Multidimensional Choices via Stated Preference Experiments
The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
Survey experiments are a core tool for causal inference. Yet, the design of classical survey experiments prevents them from identifying which components of a multidimensional treatment are influential. Here, we show how conjoint analysis , an experimental design yet to be widely applied in political science, enables researchers to estimate the causal effects of multiple treatment components and assess several causal hypotheses simultaneously. In conjoint analysis, respondents score a set of alternatives, where each has randomly varied attributes. Here, we undertake a formal identification analysis to integrate conjoint analysis with the potential outcomes framework for causal inference. We propose a new causal estimand and show that it can be nonparametrically identified and easily estimated from conjoint data using a fully randomized design. The analysis enables us to propose diagnostic checks for the identification assumptions. We then demonstrate the value of these techniques through empirical applications to voter decision making and attitudes toward immigrants.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Conditional logit analysis of qualitative choice behavior
McFadden, D. L. (1972) · eScholarship (California Digital Library) · Cited by 14,203
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
Cragg, J. G., & Zarembka, P. (1975) · The Canadian Journal of Economics · doi:10.2307/134075 · Cited by 8,342
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
Eulau, H. (1960) · American Political Science Review · doi:10.1017/s000305540012235x · Cited by 4,722
Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012) · Political Analysis · doi:10.1093/pan/mpr057 · Cited by 4,008
Constructive Consumer Choice Processes
Bettman, J. R., Luce, M. F., & Payne, J. W. (1998) · Journal of Consumer Research · doi:10.1086/209535 · Cited by 2,831
Simultaneous conjoint measurement: A new type of fundamental measurement
Luce, R. D., & Tukey, J. W. (1964) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(64)90015-x · Cited by 2,007
Contingent Valuation: Is Some Number Better than No Number?
Diamond, P. A., & Hausman, J. A. (1994) · Journal of Economic Perspectives · doi:10.1257/jep.8.4.45 · Cited by 1,894
Causal Mechanisms in the Social Sciences
Hedström, P., & Ylikoski, P. (2010) · Annual Review of Sociology · doi:10.1146/annurev.soc.012809.102632 · Cited by 1,630
Research works printed but not linked: 7
- Green, 2002, Partisan hearts and minds
- Campbell, 1960, The American voter
- These journals are the American Journal of Political Science, the American Political Science Review, and the Journal of Politics.
- Hauser, 2007, MIT Sloan Courseware
- Brader, 2008, Is it immigration or the immigrants? The emotional influence of groups on public opinion and political action, American Journal of Political Science, 52
- 10.1287/inte.31.4.56.9676 · doi:10.1287/inte.31.4.56.9676 · Paper page
- Bechtel, 2013, Public support for global climate cooperation
Cited by
Items 101–200 of 1,000
Kreps, S., George, J., Lushenko, P., & Rao, A. (2023) · PLOS ONE · doi:10.1371/journal.pone.0288109 · Cited by 88
“In adopting this approach, we ensure to fulfill a key assumption for the orthogonality of attributes in expectation, which enables us to differentiate complex treatment effects into their constituent parts [39, 40].”
MethodRinscheid, A., Pianta, S., & Weber, E. U. (2020) · Behavioural Public Policy · doi:10.1017/bpp.2020.43 · Cited by 95
Does Competence Make Citizens Tolerate Undemocratic Behavior?
Frederiksen, K. V. S. (2022) · American Political Science Review · doi:10.1017/s0003055422000119 · Cited by 104
“These experiments allowme to examine the effects of undemocratic behavior and competence, provide scenarios resembling real-world decision-making situations for voters, and mitigate social desirability bias in candidate assessments (Hainmueller, Hopkins, and Yamamoto 2014).”
BackgroundMethodInfluentialSome Advances in the Design of Survey Experiments
Sniderman, P. M. (2018) · Annual Review of Political Science · doi:10.1146/annurev-polisci-042716-115726 · Cited by 85
Bertsou, E. (2021) · European Journal of Political Research · doi:10.1111/1475-6765.12448 · Cited by 104
“Conjoint experiments can help analyse citizen preferences to different attributes that vary simultaneously and entail a comparison between the available options (Hainmueller et al. 2014).”
BackgroundCross-National Yardstick Comparisons: A Choice Experiment on a Forgotten Voter Heuristic
Hansen, K. M., Olsen, A. L., & Bech, M. (2014) · Political Behavior · doi:10.1007/s11109-014-9288-y · Cited by 85
“Recently, this technique has been used in political science (Hainmueller et al. 2014; Bechtel et al. 2012; Hansen and Bech 2007, 2012).”
MethodWhat drives public support for policies to enhance electric vehicle adoption?
Brückmann, G., & Bernauer, T. (2020) · Environmental Research Letters · doi:10.1088/1748-9326/ab90a5 · Cited by 94
“In the conjoint choice experiment (Hainmueller et al 2014) study participants then had to express their preferenceswith regards to policy options consisting of specific sets of policy measures (attributes).”
BackgroundHorváth, L., James, O., BANDUCCI, S. A., & Beduschi, A. (2023) · Government Information Quarterly · doi:10.1016/j.giq.2023.101876 · Cited by 108
Arceneaux, K., & Truex, R. (2023) · Perspectives on Politics · doi:10.1017/s1537592722000901 · Cited by 97
“Because these attributes were randomly assigned, we can recover the average marginal component effect (AMCE) of the attribute on selection for political office using a simple linear regression, clustering the standard errors at the respondent level (Hainmueller, Hopkins and Yamamoto, 2014).”
How robust is public support for unilateral climate policy?
Bernauer, T., & Gampfer, R. (2015) · Environmental Science & Policy · doi:10.1016/j.envsci.2015.07.010 · Cited by 99
Choice sets, gender, and candidate choice in Brazil
Aguilar, R., Cunow, S., & DESPOSATO, S. W. (2015) · Electoral Studies · doi:10.1016/j.electstud.2015.03.011 · Cited by 95
The Populist Appeal: Personality and Antiestablishment Communication
Bakker, B. N., Schumacher, G., & Rooduijn, M. (2020) · The Journal of Politics · doi:10.1086/710014 · Cited by 99
Carbon Capture and Storage in the United States: Perceptions, preferences, and lessons for policy
Pianta, S., Rinscheid, A., & Weber, E. U. (2021) · Energy Policy · doi:10.1016/j.enpol.2021.112149 · Cited by 93
The Journey Home: Violence, Anchoring, and Refugee Decisions to Return
Ghosn, F., Chu, T. S., Simon, M., Braithwaite, A., Frith, M. J., & Jandali, J. (2021) · American Political Science Review · doi:10.1017/s0003055421000344 · Cited by 98
“In our analysis, we follow the statistical approach for conjoint analysis developed in Hainmueller, Hopkins, and Yamamoto (2014).”
MethodHuber, R. A., & Wicki, M. (2021) · Energy Research & Social Science · doi:10.1016/j.erss.2021.101973 · Cited by 86
Estimating the value of ecosystem services in a mixed-use watershed: A choice experiment approach
Chaikaew, P., Hodges, A. W., & Grunwald, S. (2017) · Ecosystem Services · doi:10.1016/j.ecoser.2016.12.015 · Cited by 79
“The CE approach, developed by Louviere and Hensher (1982) and Louviere and Woodworth (1983), has gained popularity in a variety of research fields (Boxall et al., 1996; Taylor and Longo, 2009; Álvarez-Farizo et al., 2009; Hoehn et al., 2010; Broadbent, 2013; Vollmer et al., 2013; Hainmueller et al., 2014).”
MethodBroockman, D. E., Kalla, J. L., & Sekhon, J. S. (2017) · Political Analysis · doi:10.1017/pan.2017.27 · Cited by 79
Military Alliances and Public Support for War
Tomz, M. R., & WEEKS, J. L. P. (2021) · International Studies Quarterly · doi:10.1093/isq/sqab015 · Cited by 91
“The public was also 12 points more willing to intervene 22 On using linear regression to estimate average marginal and conditional effects of all randomized treatments, see Hainmueller, Hopkins, and Yamamoto (2014).”
Battaglio, R. P., Bellè, N., & Cantarelli, P. (2021) · Public Management Review · doi:10.1080/14719037.2021.1900351 · Cited by 106
“…although ‘there are several reasons to believe that conjoint analysis fares better than traditional survey experiments in terms of external validity’ (Hainmueller, Hopkins, and Yamamoto 2014, 27), field experimentation would provide a definitive test about the generalizability of our findings…”
BackgroundInfluentialPeace agreement design and public support for peace: Evidence from Colombia
Tellez, J. (2019) · Journal of Peace Research · doi:10.1177/0022343319853603 · Cited by 86
Do citizens care about government debt? Evidence from survey experiments on budgetary priorities
Bremer, B., & Bürgisser, R. (2022) · European Journal of Political Research · doi:10.1111/1475-6765.12505 · Cited by 98
“Conjoint survey experiments are useful for this purpose because respondents have to evaluate policy packages rather than individual policies (Hainmueller et al., 2014).”
From the general to the specific: How social trust motivates relational trust
Robbins, B. G. (2015) · Social Science Research · doi:10.1016/j.ssresearch.2015.09.004 · Cited by 92
“In contrast, it is common fordand considered a strength ofdvignette experiments to investigate a large number of treatments in a single study (Hainmueller et al., 2014).”
BackgroundYamane, T., & Kaneko, S. (2020) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2020.125291 · Cited by 76
Legislator Dissent as a Valence Signal
Campbell, R., Cowley, P., Vivyan, N., & Wagner, M. (2016) · British Journal of Political Science · doi:10.1017/s0007123416000223 · Cited by 78
“63 Hainmueller, Hopkins, and Yamamoto 2014.”
BackgroundResultInfluentialThe Limits of Partisan Loyalty
Mummolo, J., Peterson, E., & Westwood, S. J. (2019) · Political Behavior · doi:10.1007/s11109-019-09576-3 · Cited by 96
Do Voters Prefer Gender Stereotypic Candidates?: Evidence from a Conjoint Survey Experiment in Japan
Ono, Y., & Yamada, M. (2016) · Political Science Research and Methods · doi:10.1017/psrm.2018.41 · Cited by 94
Ancestry, Color, or Culture? How Whites Racially Classify Others in the U.S.
Schachter, A., Flores, R. D., & Maghbouleh, N. (2021) · American Journal of Sociology · doi:10.1086/714215 · Cited by 74
Analyzing Causal Mechanisms in Survey Experiments
Acharya, A. R., Blackwell, M., & Sen, M. (2018) · Political Analysis · doi:10.1017/pan.2018.19 · Cited by 91
The Lesser Evil? Corruption Voting and the Importance of Clean Alternatives
Agerberg, M. (2019) · Comparative Political Studies · doi:10.1177/0010414019852697 · Cited by 77
“…design is that the respondent does not have to state directly how he or she views things like a corruption accusation (this is only one of several candidate attributes that are varied simultaneously), something that can be expected to reduce social desirability bias (see Hainmueller et al., 2014).”
BackgroundModeration and Competence: How a Party's Ideological Position Shapes Its Valence Reputation
Johns, R., & Kölln, A. (2019) · American Journal of Political Science · doi:10.1111/ajps.12481 · Cited by 85
“Meanwhile, the method of analysing conjoint experiments presented by Hainmueller, Hopkins and Yamamoto (2014) allows simultaneous estimation of the effects of multiple attributes of each party, even if any specific combination of attributes is seen by just a handful of respondents.”
Party Elites’ Preferences in Candidates: Evidence from a Conjoint Experiment
Rehmert, J. (2020) · Political Behavior · doi:10.1007/s11109-020-09651-0 · Cited by 82
The Dynamics of Refugee Return: Syrian Refugees and Their Migration Intentions
Alrababa’h, A., Masterson, D., Casalis, M., Hangartner, D., & Weinstein, J. M. (2023) · British Journal of Political Science · doi:10.1017/s0007123422000667 · Cited by 108
“We follow a standard approach for analyzing conjoint experiments, using ordinary least squares (OLS) regressions to estimate the average marginal component effect (AMCE) for each attribute (Hainmueller, Hopkins, and Yamamoto 2014).”
MethodThe Role of the Information Environment in Partisan Voting
Peterson, E. (2017) · The Journal of Politics · doi:10.1086/692740 · Cited by 85
“These types of information were drawn from earlier candidate conjoint experiments (Hainmueller et al. 2014, 17) and the types of candidate information commonly provided in voter guides.”
BackgroundMethodInfluentialPolitical considerations in nonpolitical decisions: A conjoint analysis of roommate choice
Shafranek, R. M. (2021) · Political Behavior · doi:10.1007/s11109-019-09554-9 · Cited by 73
Clayton, A. B., Robinson, A. L., Johnson, M. C., & Muriaas, R. L. (2019) · Comparative Political Studies · doi:10.1177/0010414019858960 · Cited by 89
“26 However, candidate gender was signaled indirectly by name and was only one of many characteristics we varied, a feature of conjoint-like designs that mitigates social desirability bias due to any single feature (Hainmueller et al., 2013).”
BackgroundBureaucrat or artificial intelligence: people’s preferences and perceptions of government service
Gaozhao, D., Wright, J. E., & Gainey, M. K. (2023) · Public Management Review · doi:10.1080/14719037.2022.2160488 · Cited by 85
“Conjoint experiments have been used as a powerful means to capture and estimate individuals’ multidimensional preferences (Hainmueller, Hopkins, and Yamamoto 2014; Jilke and Tummers 2018).”
BackgroundMethodInfluentialHow Do People Evaluate Foreign Aid To ‘Nasty’ Regimes?
Heinrich, T., & Kobayashi, Y. (2018) · British Journal of Political Science · doi:10.1017/s0007123417000503 · Cited by 84
“Our estimands correspond (relatively) closely to what Hainmueller, Hopkins, and Yamamoto (2014) call average component marginal effects (ACMEs) and average component interaction effects (ACIEs).”
Competing for Loyalists? How Party Positioning Affects Populist Radical Right Voting
Chou, W., Dancygier, R. M., Egami, N., & Jamal, A. (2021) · Comparative Political Studies · doi:10.1177/0010414021997166 · Cited by 90
“11 To test whether established parties can capture radical right voters by changing their policy positions, we designed a conjoint experiment (Hainmueller et al., 2014), which presented our respondents with hypothetical candidate profiles.”
InfluentialMeasuring Attitudes toward Public Spending Using a Multivariate Tax Summary Experiment
Barnes, L., Blumenau, J., & Lauderdale, B. E. (2021) · American Journal of Political Science · doi:10.1111/ajps.12643 · Cited by 78
Ganter, F. (2021) · Political Analysis · doi:10.1017/pan.2021.41 · Cited by 70
“…Illustration To illustrate the use and interpretation of ACPs, I calculate the ACPs for job experience, job plans, and occupations in Hainmueller and Hopkins’s (2015; Hainmueller, Hopkins, and Yamamoto 2013) immigrant experiment (Figure 2), using the R function available online (Ganter 2021).”
MethodEuropeans’ support for refugees of varying background is stable over time
Bansak, K. C., Hainmueller, J., & Hangartner, D. (2023) · Nature · doi:10.1038/s41586-023-06417-6 · Cited by 95
“Our research design is based on a conjoint experiment 24,25 that asks citizens to make choices over randomized profiles of asylum seekers that vary across multiple traits, including country of origin, religion, reasons for migrating and other attributes identified as important by asylum experts and…”
Self-citationGermany’s decision to phase out coal by 2038 lags behind citizens’ timing preferences
Rinscheid, A., & Wüstenhagen, R. (2019) · Nature Energy · doi:10.1038/s41560-019-0460-9 · Cited by 85
Migchelbrink, K., & de Walle, S. V. (2019) · Public Administration Review · doi:10.1111/puar.13138 · Cited by 90
Commitment failures are unlikely to undermine public support for the Paris agreement
Beiser-McGrath, L. F., & Bernauer, T. (2019) · Nature Climate Change · doi:10.1038/s41558-019-0414-z · Cited by 70
What Goes with Red and Blue? Mapping Partisan and Ideological Associations in the Minds of Voters
Goggin, S. N., Henderson, J. A., & Theodoridis, A. G. (2019) · Political Behavior · doi:10.1007/s11109-018-09525-6 · Cited by 86
Voting Can Be Hard, Information Helps
Crowder‐Meyer, M., Gadarian, S. K., & Trounstine, J. L. (2019) · Urban Affairs Review · doi:10.1177/1078087419831074 · Cited by 78
A Choice‐Based Measure of Issue Importance in the Electorate
Hanretty, C., Lauderdale, B. E., & Vivyan, N. (2020) · American Journal of Political Science · doi:10.1111/ajps.12470 · Cited by 70
Esaiasson, P., Arnesen, S., & Werner, H. (2023) · Comparative Political Studies · doi:10.1177/00104140221109433 · Cited by 70
“The advantage of conjoint designs, a method increasingly used in experimental political science research (Leeper et al., 2020), is the possibility to include a large number of experimental treatments and estimate their effects simultaneously (Hainmueller et al., 2014).”
BackgroundMethodInfluentialThe unpopularity of incentive-based instruments: what improves the cost–benefit ratio?
Stadelmann‐Steffen, I., & Dermont, C. (2018) · Public Choice · doi:10.1007/s11127-018-0513-9 · Cited by 76
“A forced-choice paired conjoint analysis (Hainmueller et al. 2014) enables us to evaluate how specific aspects of an incentive-based policy proposal influence individual support for or rejection of a whole proposal.”
MethodBorders of Compassion: Immigration Preferences and Parochial Altruism
Kustov, A. (2020) · Comparative Political Studies · doi:10.1177/0010414020938087 · Cited by 78
“…eliciting preferences underlying trade attitudes (Baron, 2012; Mutz & Kim, 2017), complement it with a multidimensional choice experiment technique (Hainmueller et al., 2014), and then apply it to the issue of immigration policy preferences as opposed to individual admission preferences explored…”
BackgroundMethodInfluentialBernauer, T., Mohrenberg, S., & Koubi, V. (2019) · The Review of International Organizations · doi:10.1007/s11558-019-09354-0 · Cited by 87
Attitudes of urban residents towards environmental migration in Kenya and Vietnam
Spilker, G., Nguyen, Q., Koubi, V., & Böhmelt, T. (2020) · Nature Climate Change · doi:10.1038/s41558-020-0805-1 · Cited by 78
Kreps, S. E., & Kriner, D. L. (2021) · Vaccine · doi:10.1016/j.vaccine.2021.04.044 · Cited by 74
“The estimated treatment effects are nonparametrically identified under a modest set of assumptions, many of which (such as randomization of attribute levels) are guaranteed by the experimental design [17].”
Labels vs. Pictures: Treatment-Mode Effects in Experiments About Discrimination
Abrajano, M., Elmendorf, C., & Quinn, K. M. (2018) · Political Analysis · doi:10.1017/pan.2017.36 · Cited by 70
“Consequently, we test the above hypotheses using linear regression with clustered standard errors in a manner consistent with Hainmueller, Hopkins, and Yamamoto (2014).”
BackgroundMethodArnesen, S., Duell, D., & Johannesson, M. P. (2018) · Electoral Studies · doi:10.1016/j.electstud.2018.10.005 · Cited by 90
“Previous work on candidate choice (Hainmueller et al., 2014; Franchino and Zucchini, 2015) has argued for the exclusion of party labels, referring to the fact that participants’ opinions of a given party may either be correlated with existing attributes or be proxies for attributes that are omitted.”
BackgroundLegitimacy beliefs towards global governance institutions: a research agenda
Dellmuth, L., & Schlipphak, B. (2019) · Journal of European Public Policy · doi:10.1080/13501763.2019.1604788 · Cited by 76
“Methodological insights from social psychology and comparative politics on survey experiments and conjoint analyses may be helpful in this endeavour (Chong and Druckman 2007, Hainmueller et al. 2014).”
BackgroundWhen Do Voters Sanction Corrupt Politicians?
Klašnja, M., Lupu, N., & Tucker, J. A. (2020) · Journal of Experimental Political Science · doi:10.1017/xps.2020.13 · Cited by 66
“With a larger set of treatments, conjoint designs lessen this concern by making it more difficult for respondents and interviewers to infer the key topics of interest (Hainmueller et al. 2014).”
BackgroundMethodInfluentialSympathy for the devil? Voter support for illiberal politicians
Lewandowsky, M., & Jankowski, M. (2022) · European Political Science Review · doi:10.1017/s175577392200042x · Cited by 75
“This also implies that we do not follow the standard approach in conjoint experiments and do not estimate Average Marginal Component Effects (AMCE; Hainmueller et al. , 2014) or Marginal Means (MMs; Leeper et al. , 2020).”
People’s understanding of inflation
Binetti, A., Nuzzi, F., & Stantcheva, S. (2024) · Journal of Monetary Economics · doi:10.1016/j.jmoneco.2024.103652 · Cited by 115
Why Are There So Many Lawyers in Congress?
Bonica, A. (2020) · Legislative Studies Quarterly · doi:10.1111/lsq.12265 · Cited by 69
“Hainmueller, Hopkins, and Yamamoto (2014) use a conjoint analysis design to investigate how the personal characteristics of candidates affect levels of support.”
BackgroundThe will for reason: voter demand for experts in office
Lavezzolo, S., Ramiro, L., & Fernández-Vázquez, P. (2020) · West European Politics · doi:10.1080/01402382.2020.1778917 · Cited by 75
“This figure shows AMCE coefficients (Hainmueller et al. 2014) from standard OLS regression.7 These coefficients can be interpreted as the marginal effect of a given attribute value (e.g. having a college degree) on the probability of choosing the candidate compared to the reference attribute value…”
BackgroundMethodInfluentialSaikkonen, I. A. L., & Christensen, H. S. (2022) · Political Research Quarterly · doi:10.1177/10659129211073592 · Cited by 83
“As recommended by Hainmueller et al. (2014), we report the results in coefficient plots.”
BackgroundMethodInfluentialSpilker, G., Bernauer, T., & Umaña, V. (2016) · International Studies Quarterly · doi:10.1093/isq/sqv024 · Cited by 66
“Following Hainmueller et al. (2014), we estimate the AMCEs by regressing either the choice or the ranking variable on the different values of the attributes (e.g. whether the potential partner country is a military ally), each of which is measured in binary form.”
BackgroundMethodInfluentialThink Twice before Jumping on the Bandwagon: Clarifying Concepts in Research on the Bandwagon Effect
Barnfield, M. (2019) · Political Studies Review · doi:10.1177/1478929919870691 · Cited by 65
“This has become increasingly simple to achieve with modern survey experimental approaches (Hainmueller et al., 2014).”
BackgroundStadelmann‐Steffen, I., & Dermont, C. (2019) · Journal of Social Policy · doi:10.1017/s0047279419000412 · Cited by 69
Citizens’ Attitudes to Contact Tracing Apps
Horváth, L., BANDUCCI, S. A., & James, O. (2020) · Journal of Experimental Political Science · doi:10.1017/xps.2020.30 · Cited by 80
“AMCE values calculated with the cjoint (Hainmueller et al. 2014) package in R.”
MethodAttitudes toward the Use of Force: Instrumental Imperatives, Moral Principles, and International Law
Dill, J., & Schubiger, L. I. (2021) · American Journal of Political Science · doi:10.1111/ajps.12635 · Cited by 73
“…of our design, we depart from prior experimental work on at- 22We estimate two distinct quantities: The “average component interaction effect,” ACIE (Hainmueller, Hopkins, and Yamamoto 2014), on p. 10–13 in the SI, and the “average marginal interaction effect,” AMIE (Egami and Imai 2019) on p.…”
BackgroundMethodInfluentialBoundaries of Solidarity: Immigrants, Economic Contributions, and Welfare Attitudes
Magni, G. (2022) · American Journal of Political Science · doi:10.1111/ajps.12707 · Cited by 79
“Since attribute levels are independently randomized from one another, OLS produces unbiased and consistent estimates of the average marginal component effects (AMCEs; Hainmueller, Hopkins, and Yamamoto 2014; Horiuchi, Smith, and Yamamoto 2018, 199).”
BackgroundWhy Public Employees Rebel: Guerrilla Government in the Public Sector
Hollibaugh, G. E., Miles, M. R., & Newswander, C. B. (2019) · Public Administration Review · doi:10.1111/puar.13118 · Cited by 65
“Rather than create several separate experiments manipulating each scenario that might motivate public servants to rebel in turn, we opted for a conjoint experimental design because it allows us to see how each treatment works in conjunction with each other (Hainmueller, Hopkins, and Yamamoto 2014).”
BackgroundMethodInfluentialBrexit Dilemmas: Shaping Postwithdrawal Relations with a Leaving State
Jurado, I., Léon, S., & Walter, S. (2021) · International Organization · doi:10.1017/s0020818321000412 · Cited by 70
Policy framing, design and feedback can increase public support for costly food waste regulation
Fesenfeld, L., Rudolph, L., & Bernauer, T. (2022) · Nature Food · doi:10.1038/s43016-022-00460-8 · Cited by 73
How to accelerate the uptake of electric cars? Insights from a choice experiment
Wicki, M., Brückmann, G., & Bernauer, T. (2022) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2022.131774 · Cited by 70
Aleksovska, M., Schillemans, T., & Grimmelikhuijsen, S. (2021) · Public Administration Review · doi:10.1111/puar.13357 · Cited by 69
Public Opinion on Institutional Designs for the United Nations: An International Survey Experiment
Ghassim, F., Koenig‐Archibugi, M., & Cabrera, L. C. (2022) · International Studies Quarterly · doi:10.1093/isq/sqac027 · Cited by 72
Schuster, C., Meyer‐Sahling, J., & Mikkelsen, K. S. (2020) · Governance · doi:10.1111/gove.12461 · Cited by 68
“Where public servants responded to two conjoint iterations, we clustered standard errors by respondent (cf. Hainmueller, Hopkins, and Yamamoto 2014).”
BackgroundMethodInfluentialAI on the street: Context-dependent responses to artificial intelligence
Dorotić, M., Stagno, E., & Warlop, L. (2023) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2023.08.010 · Cited by 79
House or home? Constituent preferences over legislator effort allocation
Vivyan, N., & Wagner, M. (2015) · European Journal of Political Research · doi:10.1111/1475-6765.12119 · Cited by 63
“…by the average British voter when the value of the attribute (component) of interest is changed from one level to another, averaging over all possible values of the MP’s remaining attributes and all possible values of the attributes of the other MP in the choice task (Hainmueller et al. 2014).”
BackgroundMethodInfluentialCross-cutting issues and electoral choice. EU issue voting in the aftermath of the Brexit referendum
HOBOLT, S. B., & Rodón, T. (2020) · Journal of European Public Policy · doi:10.1080/13501763.2019.1701535 · Cited by 64
Do Voters Prefer Just Any Descriptive Representative? The Case of Multiracial Candidates
Lemi, D. C. (2020) · Perspectives on Politics · doi:10.1017/s1537592720001280 · Cited by 62
“…and Yamamoto 2014).5 The conjoint allowed me to manipulate candidate race and numerous other candidate characteristics relevant to vote choice (Hainmueller, Hopkins, and Yamamoto 2014, 2).6 The design allows for comparisons between monoracial candidates and multiracial candidates of specific…”
BackgroundWhat Explains Low Female Political Representation? Evidence from Survey Experiments in Japan
Kage, R., Rosenbluth, F. M., & Tanaka, S. (2018) · Politics & Gender · doi:10.1017/s1743923x18000223 · Cited by 60
“Our primary substantive focus is to estimate the average marginal component effect (AMCE) of a change in values of the attributes on the probability that the person is chosen by the respondent (Hainmueller, Hopkins, and Yamamoto 2014).”
BackgroundInfluentialAuer, D., Bonoli, G., Fossati, F., & Liechti, F. (2018) · International Migration Review · doi:10.1177/0197918318764872 · Cited by 87
Causal Inference with Latent Treatments
Fong, C., & Grimmer, J. (2021) · American Journal of Political Science · doi:10.1111/ajps.12649 · Cited by 89
“Hainmueller, Hopkins, and Yamamoto (2013) show that linear regression estimates the AMCE under conditionally independent randomization.”
BackgroundNicoli, F., Kuhn, T., & Burgoon, B. M. (2019) · JCMS Journal of Common Market Studies · doi:10.1111/jcms.12977 · Cited by 64
An experimental analysis of consumer preferences towards public charging infrastructure
Brückmann, G., & Bernauer, T. (2023) · Transportation Research Part D Transport and Environment · doi:10.1016/j.trd.2023.103626 · Cited by 65
“We use Average Marginal Component effects (AMCEs) to study the effects of different attributes on the choice of charging stations (Barari et al., 2018; Hainmueller et al., 2014).”
MethodGampfer, R., Bernauer, T., & Kachi, A. (2014) · Global Environmental Change · doi:10.1016/j.gloenvcha.2014.08.006 · Cited by 85
Technocratic attitudes in COVID‐19 times: Change and preference over types of experts
Lavezzolo, S., Ramiro, L., & Fernández-Vázquez, P. (2021) · European Journal of Political Research · doi:10.1111/1475-6765.12491 · Cited by 69
“Conjoint designs are employed to reveal individuals’ preferences over objects with multiple traits in order to isolate the effect of each single trait on individuals’ choices (Hainmueller et al. 2014).”
BackgroundMethodIdeology and Vote Choice in U.S. Mayoral Elections: Evidence from Facebook Surveys
Sances, M. (2017) · Political Behavior · doi:10.1007/s11109-017-9420-x · Cited by 63
How citizens evaluate participatory processes: a conjoint analysis
Christensen, H. S. (2020) · European Political Science Review · doi:10.1017/s1755773920000107 · Cited by 86
Opening the Implicit Leadership Theories’ Black Box: An Experimental Approach with Conjoint Analysis
Tavares, G. M., Sobral, F. J. B. D. A., Goldszmidt, R. B., & Araújo, F. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00100 · Cited by 58
“Standard experimental designs tend to focus on a small set of factors and sometimes do not allow researchers to estimate which of the components’ manipulation produce the observed outcome (Hainmueller et al., 2014).”
BackgroundKnudsen, E., & Johannesson, M. P. (2018) · Political Communication · doi:10.1080/10584609.2018.1493009 · Cited by 78
Meyer‐Sahling, J., Mikkelsen, K. S., & Schuster, C. (2020) · Public Administration · doi:10.1111/padm.12708 · Cited by 77
The shot, the message, and the messenger: COVID-19 vaccine acceptance in Latin America
Argote, P., Barham, E., Daly, S. Z., Gerez, J. E., Marshall, J., & Pocasangre, O. (2021) · npj Vaccines · doi:10.1038/s41541-021-00380-x · Cited by 70
Berz, J., & Jankowski, M. (2022) · Party Politics · doi:10.1177/13540688211041770 · Cited by 62
“While Hainmueller et al. (2014) suggest estimating the “average marginal component effect” (AMCE)—which is the marginal effect of a certain attribute level averaged over the joint distribution of the remaining attribute levels—Leeper et al. (2020) advocate estimating “marginal means” (MM).”
BackgroundMethodInfluentialHostile Sexism, Benevolent Sexism, and American Elections
Winter, N. (2022) · Politics & Gender · doi:10.1017/s1743923x22000010 · Cited by 62
Researcher reasoning meets computational capacity: Machine learning for social science
Lundberg, I., Brand, J. E., & Jeon, N. (2022) · Social Science Research · doi:10.1016/j.ssresearch.2022.102807 · Cited by 69
Liebe, U., Meyerhoff, J., Kroesen, M., Chorus, C. G., & Glenk, K. (2018) · PLoS ONE · doi:10.1371/journal.pone.0199923 · Cited by 64
Taking cues on multidimensional issues: the case of attitudes toward immigration
Hellwig, T. T., & Kweon, Y. (2016) · West European Politics · doi:10.1080/01402382.2015.1136491 · Cited by 65
“Exceptions are Hainmueller and Hopkins (2015), Hainmueller et al. (2014), and, on related issues of Eurozone bailouts and globalisation, Bechtel et al. (2012) and Margalit (2012).”
BackgroundYamane, T., & Kaneko, S. (2021) · Ecological Economics · doi:10.1016/j.ecolecon.2021.107236 · Cited by 74
The Responsive Union: National Elections and European Governance
Schneider, C. J. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108589413 · Cited by 130
Power Analysis for Conjoint ExperimentsPreprint
Schuessler, J., & Freitag, M. (2020) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/9yuhp · Cited by 79
Metadata
- Authors
- Hainmueller, J., Hopkins, D. J., & Yamamoto, T.
- Affiliations
- Harvard University (US)
- Corresponding author
- Yamamoto, Teppei
- Venue
- Political Analysis
- Publisher
- Cambridge University Press (CUP)
- Published
- 2014
- Volume
- 22
- Issue
- 1
- Pages
- 1-30
- ISSN
- 1047-1987 (ISSN-L)
- 1476-4989
- OpenAlex
- W2745098867
- Cited by
- 1,990
- References
- 51
- Citations by year
- 2026: 273 · 2025: 357 · 2024: 275 · 2023: 225 · 2022: 217 · 2021: 163 · 2020: 168 · 2019: 110 · 2018: 90 · 2017: 47 · 2016: 31 · 2015: 16 · 2014: 16
- FWCI
- 18.88
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Political Analysis (publishedVersion)
- Funders
- University of Cambridge
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Economic and Environmental Valuation
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Keywords
- conjoint analysis, causal inference, stated preference experiment, causal estimands, nonparametric identification, potential outcomes framework, randomized experiments, vote choice, attitudes toward immigrants
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.