Questionnaire Design Effects in Climate Change Surveys: Implications for the Partisan Divide
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Despite strong agreement among scientists, public opinion surveys reveal wide partisan disagreement on climate issues in the United States. We suggest that this divide may be exaggerated by questionnaire design variables. Following a brief literature review, we report on a national survey experiment involving U.S. Democrats and Republicans ( n = 2,041) (fielded August 25–September 5, 2012) that examined the effects of question wording and order on the belief that climate change exists, perceptions of scientific consensus, and support for limiting greenhouse gas emissions. Wording a questionnaire in terms of “global warming” (versus “climate change”) reduced Republicans’ (but not Democrats’) existence beliefs and weakened perceptions of the scientific consensus for both groups. Moreover, “global warming” reduced Republicans’ support for limiting greenhouse gases when this question immediately followed personal existence beliefs but not when the scientific consensus question intervened. We highlight the importance of attending to questionnaire design in the analysis of partisan differences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Framing: toward clarification of a fractured paradigm
Entman, R. M. (1993) · Journal of Communication · doi:10.1111/j.1460-2466.1993.tb01304.x · Cited by 16,203 · cited 1×
“…used more or less interchangeably in public discourse on climate issues, despite their different technical meanings.1 Such studies have a theoretical home in the literature on framing effects that spans political science, sociology, psychology, communication, and related disciplines (Entman 1993).”
Self-reports: How the questions shape the answers.
Schwarz, N. (1999) · American Psychologist · doi:10.1037/0003-066x.54.2.93 · Cited by 2,846 · cited 1×
“…at the intersection of cognitive psychology and survey methodology demonstrate that preceding questions can sway responses to subsequent questions by affecting the type of information that is brought to mind (e.g., McFarland 1981; for reviews, see Schwarz 1999; Sudman, bradburn, and Schwarz 1996).”
Self-citationMcCright, A. M., & Dunlap, R. E. (2011) · The Sociological Quarterly · doi:10.1111/j.1533-8525.2011.01198.x · Cited by 2,340
Communicating Climate Change: Why Frames Matter for Public Engagement
Nisbet, M. C. (2009) · Environment: Science and Policy for Sustainable Development · doi:10.3200/envt.51.2.12-23 · Cited by 1,562
A widening gap: republican and democratic views on climate change.
Dunlap, R. E., & McCright, A. M. (2008) · Environment: Science and Policy for Sustainable Development · doi:10.3200/envt.50.5.26-35 · Cited by 780
Sherman, D. A. K., Nelson, L. D., & Steele, C. M. (2000) · Personality and Social Psychology Bulletin · doi:10.1177/01461672002611003 · Cited by 660
A public health frame arouses hopeful emotions about climate change: A Letter
Myers, T. A., Nisbet, M. C., Maibach, E. W., & Leiserowitz, A. A. (2012) · Climatic Change · doi:10.1007/s10584-012-0513-6 · Cited by 632
Education, politics and opinions about climate change evidence for interaction effects
Hamilton, L. C. (2011) · Climatic Change · doi:10.1007/s10584-010-9957-8 · Cited by 628
The pivotal role of perceived scientific consensus in acceptance of science
Lewandowsky, S., Gignac, G. E., & Vaughan, S. (2013) · Nature Climate Change · doi:10.1038/nclimate1720 · Cited by 527
Whitmarsh, L. (2009) · Public Understanding of Science · doi:10.1177/0963662506073088 · Cited by 448 · cited 1×
“Various terms—including “global warming,” “climate change,” “global climate change,” and “the greenhouse effect”—are routinely used in climate surveys in a more or less interchangeable manner, yet scholars have only recently begun documenting the different ways that the general public reacts to these terms (e.g., Gree…”
Background
Cited by
The evidence for motivated reasoning in climate change preference formation
Druckman, J. N., & McGrath, M. C. (2019) · Nature Climate Change · doi:10.1038/s41558-018-0360-1 · Cited by 733
What shapes perceptions of climate change? New research since 2010
Weber, E. U. (2016) · WIREs Climate Change · doi:10.1002/wcc.377 · Cited by 312
The gateway belief model: a large-scale replication
van der Linden, S., Leiserowitz, A., & Maibach, E. (2019) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2019.01.009 · Cited by 262
Bolsen, T., & Druckman, J. N. (2018) · Group Processes & Intergroup Relations · doi:10.1177/1368430217737855 · Cited by 228
Psychological Barriers to Bipartisan Public Support for Climate Policy
Van Boven, L., Ehret, P. J., & Sherman, D. K. (2018) · Perspectives on Psychological Science · doi:10.1177/1745691617748966 · Cited by 228
Metadata
- Authors
- Schuldt, J. P., Roh, S., & Schwarz, N.
- Venue
- The ANNALS of the American Academy of Political and Social Science
- Publisher
- SAGE Publications
- Published
- 2015-02-08
- Volume
- 658
- Issue
- 1
- Pages
- 67-85
- ISSN
- 0002-7162 (ISSN-L)
- 1552-3349
- OpenAlex
- W2098788635
- Cited by
- 88
- References
- 14
- FWCI
- 35.44
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Questionnaire Design Effects in Climate Change Surveys: Implications for the Partisan Divide. https://app.cochat.ai/papers/10.1177/0002716214555066
- The paper
- Schuldt, J. P., Roh, S., & Schwarz, N. (2015). Questionnaire Design Effects in Climate Change Surveys: Implications for the Partisan Divide. The ANNALS of the American Academy of Political and Social Science. https://doi.org/10.1177/0002716214555066
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.