The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Unexpected Event during Survey Design: Promise and Pitfalls for Causal Inference
Abstract
An increasing number of studies exploit the occurrence of unexpected events during the fieldwork of public opinion surveys to estimate causal effects. In this paper, we discuss the use of this identification strategy based on unforeseen and salient events that split the sample of respondents into treatment and control groups: the Unexpected Event during Survey Design. In particular, we focus on the assumptions under which unexpected events can be exploited to estimate causal effects and we discuss potential threats to identification, paying especial attention to the observable and testable implications of these assumptions. We propose a series of best practices in the form of various estimation strategies and robustness checks that can be used to lend credibility to the causal estimates. Drawing on data from the European Social Survey, we illustrate the discussion of this method with an original study of the impact of the Charlie Hebdo terrorist attacks (Paris, 01/07/2015) on French citizens’ satisfaction with their national government.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hainmueller, J. (2012) · Political Analysis · doi:10.1093/pan/mpr025 · Cited by 6,026
(1997) · RePEc: Research Papers in Economics · Cited by 4,621
Regression discontinuity designs: A guide to practice
Imbens, G. W., & Lemieux, T. (2008) · Journal of Econometrics · doi:10.1016/j.jeconom.2007.05.001 · Cited by 3,694
How Conditioning on Posttreatment Variables Can Ruin Your Experiment and What to Do about It
Montgomery, J. M., Nyhan, B., & Torres, M. (2018) · American Journal of Political Science · doi:10.1111/ajps.12357 · Cited by 800 · cited 2×
“In the UESD, all covariates aremeasured posttreatment, so variables that can be potentially a ected by the event should not be included to avoid posttreatment bias (Montgomery, Nyhan, and Torres 2018).”
BackgroundHappiness in Everyday Life: The Uses of Experience Sampling
Csikszentmihalyi, M., & Hunter, J. (2003) · Journal of Happiness Studies · doi:10.1023/a:1024409732742 · Cited by 717
Euroscepticism and the Future of European Integration
De Vries, C. E. (2018) · Oxford Scholarship Online · doi:10.1093/oso/9780198793380.001.0001 · Cited by 627
The Logic of the Survey Experiment Reexamined
Gaines, B. J., Kuklinski, J. H., & Quirk, P. J. (2007) · Political Analysis · doi:10.1093/pan/mpl008 · Cited by 553
Are Survey Experiments Externally Valid?
BARABAS, J., & JERIT, J. (2010) · American Political Science Review · doi:10.1017/s0003055410000092 · Cited by 481
Anatomy of a Rally Effect: George W. Bush and the War on Terrorism
Hetherington, M. J., & Nelson, M. (2003) · Political Science and Politics · doi:10.1017/s1049096503001665 · Cited by 446
Terrorist Events and Attitudes toward Immigrants: A Natural Experiment
Legewie, J. (2013) · American Journal of Sociology · doi:10.1086/669605 · Cited by 322
The phantom respondents: opinion surveys and political representation
(1993) · Choice Reviews Online · doi:10.5860/choice.31-2316 · Cited by 274
Metcalfe, R., Powdthavee, N., & Dolan, P. (2011) · The Economic Journal · doi:10.1111/j.1468-0297.2010.02416.x · Cited by 194
The Effect of Terror on Institutional Trust: New Evidence from the 3/11 Madrid Terrorist Attack
Dinesen, P. T., & Jæger, M. M. (2013) · Political Psychology · doi:10.1111/pops.12025 · Cited by 163
The rolling cross-section design
Johnston, R., & Brady, H. E. (2002) · Electoral Studies · doi:10.1016/s0261-3794(01)00022-1 · Cited by 160
Regression Discontinuity Designs Based on Population Thresholds: Pitfalls and Solutions
Eggers, A. C., Freier, R., Grembi, V., & Nannicini, T. (2017) · American Journal of Political Science · doi:10.1111/ajps.12332 · Cited by 156
Flores, R. D. (2018) · Social Forces · doi:10.1093/sf/soy001 · Cited by 155
The (Non)Impact of the 2015 Paris Terrorist Attacks on Political Attitudes
Silva, B. C. (2018) · Personality and Social Psychology Bulletin · doi:10.1177/0146167217752118 · Cited by 138
Using a natural experiment to estimate the electoral consequences of terrorist attacks
Balcells, L., & Torrats‐Espinosa, G. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1800302115 · Cited by 136
Measuring Public Opinion with Surveys
Berinsky, A. J. (2017) · Annual Review of Political Science · doi:10.1146/annurev-polisci-101513-113724 · Cited by 130
Boomgaarden, H. G., & de Vreese, C. H. (2007) · International Journal of Public Opinion Research · doi:10.1093/ijpor/edm012 · Cited by 126
Losing Hurts: The Happiness Impact of Partisan Electoral Loss
Pierce, L., Rogers, T., & Snyder, J. A. (2015) · Journal of Experimental Political Science · doi:10.1017/xps.2015.8 · Cited by 126
Social Protest and Policy Attitudes: The Case of the 2006 Immigrant Rallies
Branton, R., Martinez-Ebers, V., Carey, T. E., & Matsubayashi, T. (2015) · American Journal of Political Science · doi:10.1111/ajps.12159 · Cited by 125
The Corrosive Effect of Corruption on Trust in Politicians: Evidence from a Natural Experiment
Ares, M., & Hernández, E. (2016) · Research & Politics · doi:10.1177/2053168017714185 · Cited by 125
Self-citationIt can happen here: the impact of the Mumbai terror attacks on public opinion in Western Europe
Finseraas, H., & Listhaug, O. (2011) · Public Choice · doi:10.1007/s11127-011-9895-7 · Cited by 118
In-Group Loyalty and the Punishment of Corruption
Solaz, H., Vries, C. E. D., & de Geus, R. A. (2018) · Comparative Political Studies · doi:10.1177/0010414018797951 · Cited by 114
Clair, T. S., Cook, T. D., & Hallberg, K. (2014) · American Journal of Evaluation · doi:10.1177/1098214014527337 · Cited by 103
Who trusts? Race, gender, and the September 11 rally effect among young adults
Perrin, A. J., & Smolek, S. J. (2008) · Social Science Research · doi:10.1016/j.ssresearch.2008.09.001 · Cited by 96
Natural Experiments Based on Geography
Keele, L. J., & Titiunik, R. (2015) · Political Science Research and Methods · doi:10.1017/psrm.2015.4 · Cited by 86
The Polarizing Effect of the March for Science on Attitudes toward Scientists
Motta, M. (2018) · PS Political Science & Politics · doi:10.1017/s1049096518000938 · Cited by 80
Racialization in times of contention: how social movements influence Latino racial identity
Zepeda‐Millán, C., & Wallace, S. J. (2013) · Politics Groups and Identities · doi:10.1080/21565503.2013.842492 · Cited by 68
Lines of Demarcation: Causation, Design-Based Inference, and Historical Research
Kocher, M. A., & Monteiro, N. P. (2016) · Perspectives on Politics · doi:10.1017/s1537592716002863 · Cited by 68
Did the 2011 Terror Attacks in Norway Change Citizens’ Attitudes Toward Immigrants?
Jakobsson, N., & Blom, S. (2014) · International Journal of Public Opinion Research · doi:10.1093/ijpor/edt036 · Cited by 63
Will you still trust me tomorrow? The causal effect of terrorism on social trust
Geys, B., & Qari, S. (2017) · Public Choice · doi:10.1007/s11127-017-0477-1 · Cited by 59
Stoop, I. A. L. (2004) · Field Methods · doi:10.1177/1525822x03259479 · Cited by 59
A Trump Effect on the EU’s Popularity? The U.S. Presidential Election as a Natural Experiment
Minkus, L., Deutschmann, E., & Delhey, J. (2018) · Perspectives on Politics · doi:10.1017/s1537592718003262 · Cited by 56
Identifying the Effect of Political Rumor Diffusion Using Variations in Survey Timing
Kim, J. W., & Kim, E. (2019) · Quarterly Journal of Political Science · doi:10.1561/100.00017138 · Cited by 54
Increasing pressures and support for public healthcare in Europe
Jensen, C., & Naumann, E. (2016) · Health Policy · doi:10.1016/j.healthpol.2016.04.015 · Cited by 48
Can Protests Make Latinos “American”? Identity, Immigration Politics, and the 2006 Marches
Mohamed, H. S. (2012) · American Politics Research · doi:10.1177/1532673x12456237 · Cited by 43
Coupé, T. (2016) · Applied Economics Letters · doi:10.1080/13504851.2016.1254335 · Cited by 32
Tiokhin, L., & Hruschka, D. J. (2017) · Psychological Science · doi:10.1177/0956797616680396 · Cited by 28
In the wake of a terrorist attack, do Americans’ attitudes toward Muslims decline?
Boydstun, A. E., Feezell, J. T., & Glazier, R. A. (2018) · Research & Politics · doi:10.1177/2053168018806391 · Cited by 24
Welfare Retrenchments and Government Support: Evidence from a Natural Experiment
Larsen, E. G. (2017) · European Sociological Review · doi:10.1093/esr/jcx081 · Cited by 23
Pollock, W. M., Barabas, J., Jerit, J., Schoonvelde, M., BANDUCCI, S. A., & Stevens, D. P. (2015) · European Political Science · doi:10.1057/eps.2015.67 · Cited by 8
Cited by
The effect of COVID‐19 lockdowns on political support: Some good news for democracy?
Bol, D., Giani, M., Blais, A., & Loewen, P. J. (2021) · European Journal of Political Research · doi:10.1111/1475-6765.12401 · Cited by 701
Political trust during the Covid‐19 pandemic: Rally around the flag or lockdown effects?
Schraff, D. (2021) · European Journal of Political Research · doi:10.1111/1475-6765.12425 · Cited by 369
Fixing the Past: The Effects of Human Rights Trials on Political Attitudes in Argentina
(2025) · doi:10.1017/s0007123424000206 · Cited by 19
Kikuta, K., & Uesugi, M. (2023) · International Organization · doi:10.1017/s0020818322000261 · Cited by 17
Motta, M., Hwang, J., & Stecula, D. (2024) · Health Communication · doi:10.1080/10410236.2023.2254583 · Cited by 11
Metadata
- Authors
- Muñoz, J., Falcó-Gimeno, A., & Hernández, E.
- Venue
- Political Analysis
- Publisher
- Cambridge University Press (CUP)
- Published
- 2019-07-15
- Volume
- 28
- Issue
- 2
- Pages
- 186-206
- ISSN
- 1047-1987 (ISSN-L)
- 1476-4989
- OpenAlex
- W2907499077
- Cited by
- 329
- References
- 43
- FWCI
- 23.24
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.