Cited by 37Electoral Systems and Political ParticipationPsychology of Moral and Emotional JudgmentRhetoric and Communication Studies

Personalizing Moral Reframing in Interpersonal Conversation: A Field Experiment

Open access
Kalla, Joshua L., Levine, Adam Seth, Broockman, David E.·2022·The Journal of Politics

Published version of a preprint

Abstract

Organizations in the contemporary United States face substantial challenges with persuading citizens and moving them to take action. Prior research finds that citizens’ views can be changed and strengthened using frames consistent with their moral values. However, it can be difficult for organizations to tailor their appeals to individuals’ moral values given the difficulty in predicting which moral values matter to which citizens. We present a preregistered field experiment in which canvassers for Planned Parenthood of Northern New England (n=52) sought to overcome this challenge by listening for individual voters’ (n=1,034) moral values and then tailoring their appeals to those moral values. In contrast to an earlier study finding no impact of long-form canvassing on abortion attitudes, we find these conversations had large effects on interest in taking action and some evidence of changes in policy attitudes. This experiment provides a template for practitioners and researchers to build on.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1086/716944

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Personalized moral reframing works to stimulate interest in taking action on abortion rights.

    “For instance, Kalla et al. (2022) find personalized moral reframing works to stimulate interest in taking action on abortion rights.”

    From How to study democratic backsliding (2024) · cites this paper as Kalla et al., 2022

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 24 · Cited by 37

Research works printed but not linked: 23

  1. Arceneaux, Kevin. 2002. "Direct democracy and the link between public opinion and state abortion policy." State Politics & Policy Quarterly 2(4):372-387.
  2. Arceneaux, Kevin and Robin Kolodny. 2009. "Educating the Least Informed: Group Endorsements in a Grassroots Campaign." American Journal of Political Science 53(4):755-70.
  3. Barker, David. 2002. Rushed to judgment. Columbia University Press.
  4. Barker, David C. 2005. "Values, Frames, and Persuasion in Presidential Nomination Contests." Political Behavior 27(4):375-394.
  5. Broockman, David E., Joshua L. Kalla and Jasjeet S. Sekhon. 2017. "The Design of Field Experiments With Survey Outcomes." Political Analysis 25(4):435-464.
  6. Carsey, Thomas M. and Geoffrey C. Layman. 2006. "Changing Sides or Changing Minds? Party Identification and Policy Preferences in the American Electorate." American Journal of Political Science 50(2):464-477.
  7. Feinberg, Matthew and Robb Willer. 2015. "From Gulf to Bridge: When Do Moral Arguments Facilitate Political Influence?" Personality and Social Psychology Bulletin 41:1665-1681.
  8. Graham, Jesse, Jonathan Haidt and Brian A Nosek. 2009. "Liberals and conservatives rely on different sets of moral foundations." Journal of personality and social psychology 96(5):1029.
  9. Han, Hahrie. 2014. How organizations develop activists. Oxford University Press.
  10. Hersh, Eitan D. 2015. Hacking the electorate: How campaigns perceive voters. Cambridge.
  11. Kalla, Joshua L and David E Broockman. 2020. "Reducing exclusionary attitudes through interpersonal conversation: evidence from three field experiments." American Political Science Review 114(2):410-425.
  12. Munson, Ziad. 2018. Abortion Politics. Medford, MA: Polity Press.
  13. Panagopoulos, Costas. 2016. "All about that base: Changing campaign strategies in US presidential elections." Party Politics 22(2):179-190.
  14. Rokeach, Milton. 1973. The nature of human values. Free press.
  15. Ryan, Timothy. 2014. "Reconsidering Moral Issues in Politics." Journal of Politics 76(2):380-397.
  16. Ryan, Timothy. 2019. "Actions versus consequences in political arguments: Insights from moral psychology." Journal of Politics 81(2):426-440.
  17. Strolovitch, Dara Z. 2006. "Do interest groups represent the disadvantaged? Advocacy at the intersections of race, class, and gender." Journal of Politics 68(4):894-910.
  18. David Broockman and Joshua Kalla. Durably reducing transphobia: A field experiment on door-to-door canvassing. Science, 352(6282):220-224, 2016.
  19. David E Broockman, Joshua L Kalla, and Jasjeet S Sekhon. The design of field experiments with survey outcomes: A framework for selecting more efficient, robust, and ethical designs. Political Analysis, 25(4):435-464, 2017.
  20. Alan S Gerber, Donald P Green, Edward H Kaplan, and Holger L Kern. Baseline, placebo, and treatment: Efficient estimation for three-group experiments. Political Analysis, 18(3):297-315, 2010.
  21. Jens Hainmueller. Entropy balancing for causal effects: A multivariate reweighting method to produce balanced samples in observational studies. Political Analysis, 20(1):25-46, 2012.
  22. Luke W. Miratrix, Jasjeet S. Sekhon, Alexander G. Theodoridis, and Luis F. Campos. Worth weighting? how to think about and use weights in survey experiments. Political Analysis, 26(3):275-291, 2018.
  23. David W Nickerson. Scalable protocols offer efficient design for field experiments. Political Analysis, 13(3):233-252, 2005.

Authors
Kalla, J. L., Levine, A. S., & Broockman, D. E.
Affiliations
  • Yale University (US)
  • Johns Hopkins University (US)
  • University of California, Berkeley (US)
Venue
The Journal of Politics
Published
2022-04-01
Volume
84
Issue
2
Pages
1239-1243
ISSN
  • 0022-3816 (ISSN-L)
  • 1468-2508
OpenAlex
W3195167555
Cited by
37
References
24
Citations by year
2026: 6 · 2025: 11 · 2024: 9 · 2023: 7 · 2022: 3 · 2019: 1
FWCI
15.79
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • The Journal of Politics (publishedVersion)
  • eScholarship (California Digital Library) (submittedVersion)
  • OSF Preprints (OSF Preprints) (submittedVersion, cc-by)
  • OSF Preprints (OSF Preprints) (submittedVersion)
Topics
  • Social Sciences › Political Science and International Relations › Electoral Systems and Political Participation
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Psychology of Moral and Emotional Judgment
  • Social Sciences › Arts and Humanities › Philosophy › Rhetoric and Communication Studies
Keywords
moral values, moral reframing, interpersonal persuasion, canvassing, abortion attitudes, Planned Parenthood, voter persuasion, policy attitudes

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review