Counterfactuals and Hypothesis Testing in Political Science
Open accessThe DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
Abstract
Scholars in comparative politics and international relations routinely evaluate causal hypotheses by referring to counterfactual cases where a hypothesized causal factor is supposed to have been absent. The methodological status and the viability of this very common procedure are unclear and are worth examining. How does the strategy of counterfactual argument relate, if at all, to methods of hypothesis testing based on the comparison of actual cases, such as regression analysis or Mill's Method of Difference? Are counterfactual thought experiments a viable means of assessing hypotheses about national and international outcomes, or are they methodologically invalid in principle? The paper addresses the first question in some detail and begins discussion of the second. Examples from work on the causes of World War I, the nonoccurrence of World War III, social revolutions, the breakdown of democratic regimes in Latin America, and the origins of fascism and corporatism in Europe illustrate the use, problems and potential of counterfactual argument in small-N-oriented political science research.
Overview
CoChat Summary
TL;DR
Fearon argues that counterfactual conditionals play a necessary and fundamental, if often implicit, role in how political scientists assess causal hypotheses, and that analysts face a choice between two and only two strategies for empirically testing a causal claim: the "actual case" strategy and the "counterfactual case" strategy. The paper's primary concern is small-N research, where negative degrees of freedom make counterfactual argument logically necessary to establish the causal importance of any one variable.
Key findings
- When experimental control and replication are not possible, analysts can either (1) imagine that C had been absent and ask whether E would have occurred, or (2) search for other actual cases resembling the case in question except that C is absent or has a different value. Both strategies aim to solve the same statistical problem: the analyst begins with one case and at least one explanatory variable, meaning negative degrees of freedom, and legitimate causal imputations cannot be made on that basis.
- In large-N, non-experimental work, counterfactual assumptions enter via the "ceteris paribus" assumption (E(x'e)=0). Fearon argues this assumption is credible "if and only if" the counterfactual proposition (PI) is credible: "If the cases in the sample had assumed different values on the independent variables, the contents of the error term would not have differed systematically."
- The strategies differ in how they provide confirmation: the actual case strategy relies on frequency or magnitude of association across actual cases, while the counterfactual strategy cannot meaningfully assess frequencies and instead relies on general principles, theories, or laws distinct from the hypothesis being tested, plus historical facts relevant to the counterfactual scenario.
- Assessing relative causal weight in the counterfactual strategy requires a proliferation of counterfactual cases — to argue A was a more important cause than B, at least two scenarios are needed (A present/B absent versus B present/A absent).
Methods
- Conceptual and methodological argument developed in three sections: distinguishing the "actual case" and "counterfactual" strategies of hypothesis testing; illustrating the counterfactual strategy in practice through examples from international relations and comparative politics; and returning to theoretical issues about the link between causal arguments and counterfactual propositions.
- Illustrative examples include the "cult of the offensive" hypothesis about World War I (Van Evera 1984, Snyder 1984), structural versus domestic explanations of Soviet foreign policy (following Waltz 1979, 1981), and works such as Moore (1966), Skocpol (1979), and Luebbert (1987).
- No formal data collection or statistical analysis is reported; the paper is a methodological/theoretical essay.
Limitations
- The paper states that arguments about what would have happened in multiple counterfactual scenarios "will be very imprecise and uncertain," and that in the counterfactual strategy "there is no formal criterion for gauging the risk of error associated with some independent variable — all depends instead on the plausibility of arguments about 'what would have happened.'"
- The paper acknowledges that the counterfactual strategy for empirically checking a causal hypothesis "seems only indirectly empirical, since the confirmation it provides depends principally on other theories."
- Evident from the text: the provided full text is truncated mid-sentence in the second section ("Second, I will consider the role of counterfactuals in sever…"), so the paper's examples in practice and its third section on theoretical issues are only partially available here.
Model-written summary of a shortened version of the paper’s full text (it is longer than we read). Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 1 Not valid · 0 Not checked · 20 Own results and interpretations
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In addition, even in N-1 case studies analysts will often mix both strategies of confirmation.”
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“work”
- Also stated in: § 5 For example: "The might-have-beens of history are not a profitable subject · plain
“in case studies where the analyst is explicitly concerned with giving a causal explanation for some event or phenomenom”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 5 For example: "The might-have-beens of history are not a profitable subject · plain
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“causes”
- Also stated in: § 5 For example: "The might-have-beens of history are not a profitable subject · plain
“that selected the actual outcome from a range of possible counterfactual outcomes in that case, we see the source of the”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 5 For example: "The might-have-beens of history are not a profitable subject · plain
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Both strategies, if successful (from the analyst's point of view), tend to support the hypothesis that the proposed cause in fact produces (or produced) the effect.”
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If there are”
- Also stated in: § 2 Following Waltz (1979, 1981), "structural position" here would entail the · plain
“other causes”
- Also stated in: § 2 Following Waltz (1979, 1981), "structural position" here would entail the · plain
“of the phenomenom in question that are not considered ®*P^icitly in the analysis, and if any of these are systematically related to the causes explicitly considered, then effects of the”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 2 Following Waltz (1979, 1981), "structural position" here would entail the · plain
7 more claims
Create a free account to see all 21 claims and every source verdict.
- Probably not a substantial claim. 3
- It may state two separate claims as one. 6
- The quote only partly states this claim. 2
Citations
Cites
Theory of International Politics
Frankel, J., & Waltz, K. N. (1980) · International Journal · doi:10.2307/40201892 · Cited by 8,506
Theory of International Politics, by Kenneth N. Waltz
Randle, R. F. (1980) · Political Science Quarterly · doi:10.2307/2149594 · Cited by 6,358
States and Social Revolutions: A Comparative Analysis of France, Russia and China
Skocpol, T. (1979) · Cambridge University Press · doi:10.1017/cbo9780511815805 · Cited by 5,408
Nagel, E., & Hawkins, D. (1961) · American Journal of Physics · doi:10.1119/1.1937571 · Cited by 3,667
Comparative Politics and the Comparative Method
Lijphart, A. (1971) · American Political Science Review · doi:10.2307/1955513 · Cited by 3,151
On the Social Origins of Dictatorship and Democracy
Moore, B. (1984) · Critique and Anti-Critique · doi:10.1007/978-1-349-86027-2_4 · Cited by 2,694
Methodology of Social Sciences
Weber, M. (2017) · Routledge eBooks · doi:10.4324/9781315124445 · Cited by 2,527
Greenstein, F. I., & Polsby, N. W. (1975) · Addison-Wesley Longman Publishing Co., Inc. eBooks · Cited by 2,344
The Comparative Method: Moving Beyond Qualitative and Quantitative Strategies
Ragin, C. C. (2014) · doi:10.1525/9780520957350 · Cited by 2,130
Rationalizable Strategic Behavior
Bernheim, B. D. (1984) · Econometrica · doi:10.2307/1911196 · Cited by 1,291
Research works printed but not linked: 8
- Ragin, 1987, The Comparative Method, 39
- George, 1985, Advances in Information Processing in Organizations, 2
- Gaddis John Lewis , “Nuclear Weapons and International Systemic Stability,” American Academy of Arts and Sciences Occasional Paper No. 2 (Cambridge: AAAS, 1990).
- Polsby, 1982, What If?: Essays in Social Science Fiction
- Moore, 1966, Social Origins of Dictatorship and Democracy, 414
- Fischer, 1970, Historians' Fallacies, 15
- Lewis, 1973, Counterfactuals, 65
- Barry, 1980, Supertax, Political Studies, 28, 139
Cited by
Items 101–200 of 725
A “Garbage Can Model” of UN Peacekeeping
Lipson, M. J. (2007) · Global Governance A Review of Multilateralism and International Organizations · doi:10.1163/19426720-01301006 · Cited by 110
“On counterfactuals and hypothesis testing, see Fearon 1991.”
Background…And yet they persist: Explaining survival and transition in neopatrimonial regimes
Brownlee, J. M. (2002) · Studies in Comparative International Development · doi:10.1007/bf02686230 · Cited by 152
“But perhaps we can venture arguments that can be judged more credible or less credible, depending on our use of historical detail and theories about the way people behave” (Fearon 1991: 195).”
BackgroundDictatorial Institutions and their Impact on Economic Growth
Gandhi, J. (2008) · European Journal of Sociology · doi:10.1017/s0003975608000015 · Cited by 123
“The problem is one of generating correct counterfactuals (Fearon 1991; Jervis 1996) where ‘‘correct’’ is the subject of dispute.”
BackgroundProcess-Tracing Research Designs: A Practical Guide
Ricks, J. I., & Liu, A. H. (2018) · PS Political Science & Politics · doi:10.1017/s1049096518000975 · Cited by 113
“Counterfactuals are vital to process-tracing, especially when no alternative cases are considered (Fearon 1991).”
BackgroundRound Up the Usual Suspects!: Globalization, Domestic Politics, and Welfare State Change
Schwartz, H. (2001) · The New Politics of the Welfare State · doi:10.1093/0198297564.003.0002 · Cited by 103
Social psychology and world politics.
Tetlock, P. E. (1998) · Cited by 129
Beyond Anarchy: The Importance of Security Institutions
Lake, D. A. (2001) · International Security · doi:10.1162/016228801753212877 · Cited by 106
Nielsen, R. A. (2014) · Sociological Methods & Research · doi:10.1177/0049124114547054 · Cited by 121
Putin, Putinism, and the Domestic Determinants of Russian Foreign Policy
McFaul, M. (2020) · International Security · doi:10.1162/isec_a_00390 · Cited by 97
The securitisation of pandemic influenza: Framing, security and public policy
Kamradt‐Scott, A., & McInnes, C. J. (2012) · Global Public Health · doi:10.1080/17441692.2012.725752 · Cited by 102
“To what extent, however, was this range of actions the product of labelling pandemic influenza a security issue, as opposed to a public health policy response to an imminent emergency? Methodologically, of course, addressing a counter-factual – what would have been different if the securitising move had not been succe…”
BackgroundThe Role of Theory and Anomaly in Social-Scientific Inference
Rogowski, R. L. (1995) · American Political Science Review · doi:10.2307/2082443 · Cited by 106
EU normative power and regionalism: Ideational diffusion and its limits
Lenz, T. (2013) · Cooperation and Conflict · doi:10.1177/0010836713485539 · Cited by 93
International Nonregimes: A Research Agenda
Dimitrov, R. S., Sprinz, D. F., DiGiusto, G. M., & Kelle, A. (2007) · International Studies Review · doi:10.1111/j.1468-2486.2007.00672.x · Cited by 110
Remoulding the Critical Junctures Approach
Hogan, J. (2006) · Arrow - TU Dublin (Technological University Dublin) · doi:10.21427/d71f7n · Cited by 90
Defending democracy: Reactions to political extremism in inter–war Europe
Capoccia, G. (2001) · European Journal of Political Research · doi:10.1111/1475-6765.00584 · Cited by 125
“If they had acted differently, as they could have done, the democratic systems in those countries would very likely have come much closer to breakdown than they did (on this, see Fearon 1991 and Tetlock & Belkin 1996).”
BackgroundElectoral Institutions, Unemployment and Extreme Right Parties: A Correction
Golder, M. (2003) · British Journal of Political Science · doi:10.1017/s0007123403220226 · Cited by 86
Disciplining Political Science
Laitin, D. D. (1995) · American Political Science Review · doi:10.1017/s0003055400096453 · Cited by 116
How social movements die: repression and demobilization of the Republic of New Africa
Davenport, C. (2015) · Choice Reviews Online · doi:10.5860/choice.190991 · Cited by 86
The logic of counterfactual analysis in case‐study explanation
Mahoney, J., & Barrenechea, R. (2017) · British Journal of Sociology · doi:10.1111/1468-4446.12340 · Cited by 116
Neorealism and the myth of bipolar stability: Toward a new dynamic realist theory of major war
Copeland, D. C. (1996) · Security Studies · doi:10.1080/09636419608429276 · Cited by 82
Rethinking causal explanation in interpretive international studies
Norman, L. (2021) · European Journal of International Relations · doi:10.1177/13540661211006454 · Cited by 101
“This point parallels McKeown’s discussions on the statistical worldview (McKeown, 1999) but differs from that of Fearon (1991) who frames his discussion of comparative as well as single case studies explicitly in statistical terms.”
BackgroundToward a theory of public sector entrepreneurship
Shockley, G. E., Stough, R. R., Haynes, K. E., & Frank, P. M. (2006) · International Journal of Entrepreneurship and Innovation Management · doi:10.1504/ijeim.2006.009875 · Cited by 85
Democracy, the Market, and the Logic of Social Choice
DeCanio, S. (2013) · American Journal of Political Science · doi:10.1111/ajps.12072 · Cited by 91
“Yet these counterfactuals cannot be tested in empirical reality due to the singular and unrepeatable nature of political decisions (Fearon 1991, 173).”
BackgroundPreventable Catastrophe? The Hurricane Katrina Disaster Revisited
Parker, C. F., STERN, E. K., Paglia, E., & Brown, C. C. (2009) · Journal of Contingencies and Crisis Management · doi:10.1111/j.1468-5973.2009.00588.x · Cited by 103
2. The Problem of Scale in Human/Environment Relationships
Young, O. R. (1994) · Journal of Theoretical Politics · doi:10.1177/0951692894006004002 · Cited by 84
Manow, P. (2001) · Oxford University Press eBooks · doi:10.1093/0198297564.003.0006 · Cited by 98
Does the EUcausedomestic developments? improving case selection in Europeanisation research
Haverland, M. (2005) · West European Politics · doi:10.1080/01402380500389331 · Cited by 78
Single-Outcome Studies: A Methodological Primer
Gerring, J. (2006) · International Sociology · doi:10.1177/0268580906067837 · Cited by 86
“See Bunzl (2004), Cowley (2001), Einhorn and Hogarth (1986), Elster (1978), Fearon (1991), Hart and Honore (1959: 32–3; 1966: 225), Hawthorn (1991), Holland (1986), Mackie (1993: 39), Marini and Singer (1988: 353), Taylor (1970: 53), Tetlock and Belkin (1996: 23–5) and Weber (1949).”
Strategies for Studying Causation in Complex Ecological-Political Systems
Homer-Dixon, T. F. (1996) · The Journal of Environment & Development · doi:10.1177/107049659600500202 · Cited by 86
Shocking Intellectual Austerity: The Role of Ideas in the Demise of the Gold Standard in Britain
Morrison, J. A. (2015) · International Organization · doi:10.1017/s0020818315000314 · Cited by 78
Morrison, J. A. (2012) · International Organization · doi:10.1017/s0020818312000148 · Cited by 78
Kill a Leader, Murder a Movement? Leadership and Assassination in Social Movements
Bob, C., & Nepstad, S. E. (2007) · American Behavioral Scientist · doi:10.1177/0002764207300162 · Cited by 113
“Many studies oversimplify the division between leaders and followers, exclusively focusing on “formal leaders” (Etzioni, 1961) who hold titled positions in established movement organizations.”
BackgroundBlindsided? September 11 and the Origins of Strategic Surprise
Parker, C. F., & STERN, E. K. (2002) · Political Psychology · doi:10.1111/0162-895x.00300 · Cited by 94
The Importance of Ideas: An A Priori Critical Juncture Framework
Hogan, J., & Doyle, D. A. (2007) · Canadian Journal of Political Science · doi:10.1017/s0008423907071144 · Cited by 99
“In the past, critical junctures have been examined by means of unwieldy frameworks ~Collier and Collier, 1991!, or counterfactual analysis ~Fearon, 1991; 1996!.”
BackgroundAnalytic Eclecticism in Practice: A Method for Combining International Relations Theories
Cornut, J. (2014) · International Studies Perspectives · doi:10.1111/insp.12072 · Cited by 80
Explaining the Iraq War: counterfactual theory, logic, and evidence
(2012) · Choice Reviews Online · doi:10.5860/choice.49-7143 · Cited by 74
Durable by Design? Policy Feedback in a Changing Climate
Jordan, A., & Moore, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108779869 · Cited by 107
Remoulding the Critical Junctures Approach
Hogan, J. (2006) · Canadian Journal of Political Science · doi:10.1017/s0008423906060203 · Cited by 125
Savage Restraint: Israel, Palestine and the Dialectics of Legal Repression
Ron, J. (2000) · Social Problems · doi:10.2307/3097130 · Cited by 90
Winners’ Consent? Citizen Commitment to Democracy When Illiberal Candidates Win Elections
Cohen, M. J., Smith, A. E., Moseley, M. W., & Layton, M. L. (2022) · American Journal of Political Science · doi:10.1111/ajps.12690 · Cited by 94
Marfleet, B. G. (2000) · Political Psychology · doi:10.1111/0162-895x.00203 · Cited by 69
The Environment and International Relations
O’Neill, K. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511805974 · Cited by 190
Children’s causal reasoning: Counterfactual thinking occurs for ‘negative’ outcomes only
German, T. P. (1999) · Developmental Science · doi:10.1111/1467-7687.00088 · Cited by 66
“Mackie, 1974; Jackson, 1977; Roese & Olson, 1995a; Harris, German & Mills, 1996; Mandel & Lehman, 1996) but also to areas of enquiry as diverse as history, politics and the law (e.g. Hart & Honore , 1959=1985; Fearon, 1991).”
BackgroundA Quantitative Approach to Evaluating International Environmental Regimes
Mitchell, R. B. (2004) · Springer eBooks · doi:10.1007/978-1-4020-2208-1_6 · Cited by 65
Qualitative and Multimethod Research: Organizations, Publication, and Reflections on Integration
Collier, D., & Elman, C. (2009) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199286546.003.0034 · Cited by 71
Political Leadership and the Emergence of Radical Mass Movements in Democracy
Pappas, T. S. (2007) · Comparative Political Studies · doi:10.1177/0010414007302344 · Cited by 75
“Following a counterfactual logic (Fearon, 1991), I pit in this section each of the positive cases against pairs of countries belonging to same world region (see Goodwin, 2001) and sharing similar socioeconomic and political characteristics.”
Background‘Tough Love’: How the ECB’s Monetary Financing Prohibition Pushes Deeper Euro Area Integration
Yiangou, J., O’Keeffe, M., & Glöckler, G. (2013) · Journal of European Integration · doi:10.1080/07036337.2013.774786 · Cited by 76
“We use counterfactual analysis to analyse the empirical plausibility of our argument (Fearon 1991).”
MethodSet Diagrams and Qualitative Research
Mahoney, J., & Vanderpoel, R. S. (2015) · Comparative Political Studies · doi:10.1177/0010414013519410 · Cited by 63
“In the methodological literature, a well-known rule is the “minimal rewrite”: Counterfactuals should require as few changes to the real world as possible (Fearon, 1991; Tetlock & Belkin, 1996).”
BackgroundMethodMcCormack, D., & Pascoe, H. (2015) · Journal of Conflict Resolution · doi:10.1177/0022002715620471 · Cited by 73
Eidlin, B. (2016) · American Sociological Review · doi:10.1177/0003122416643758 · Cited by 66
Introduction: Causation, inferences, and solution types in configurational comparative methods
Haesebrouck, T., & Thomann, E. (2021) · Quality & Quantity · doi:10.1007/s11135-021-01209-4 · Cited by 79
“When introducing the intermediate solution, Ragin and Sonnett (2005, 184), for example, build on the literature on counterfactual thought experiments, which sometimes refers to Lewis’ counterfactual theory of causation (cf. inter alia Fearon 1991).”
MethodModernization in Historical Perspective: The Case of Imperial Germany
Berman, S. (2001) · World Politics · doi:10.1353/wp.2001.0007 · Cited by 61
The Effect of Global Environmental Regimes: A Measurement Concept
Sprinz, D. F., & Helm, C. (1999) · International Political Science Review · doi:10.1177/0192512199204003 · Cited by 61
“For counterfactual methods, see Fearon (1991) and Tetlock and Belkin (1996). 4. See Sprinz and Churkina (1998) for a method to generally derive environmental thresholds.”
MethodSeeing Double: Human Rights Impact Through Qualitative and Quantitative EyesPreprint
Hafner-Burton, E. M., & Ron, J. (2011) · SSRN Electronic Journal · doi:10.2139/ssrn.1287858 · Cited by 60
The Importance of Ideas: An A Priori Critical Juncture Framework
Hogan, J. (2007) · Dublin City University Open Access Institutional Repository (Dublin City University) · doi:10.21427/d7dn5c · Cited by 60
A Quantitative Approach to Evaluating International Environmental Regimes
Mitchell, R. B. (2002) · Global Environmental Politics · doi:10.1162/152638002320980623 · Cited by 60
Schafer, M., & Crichlow, S. (2002) · International Studies Quarterly · doi:10.1111/1468-2478.00222 · Cited by 59
Critical Event Analysis in Case Study Research
García-Montoya, L., & Mahoney, J. (2023) · Sociological Methods & Research · doi:10.1177/0049124120926201 · Cited by 62
“…been developing tools of counterfactual analysis for decades, and these tools continue to be developed today, including using set-theoretic analysis (Fearon 1991, 1996; Lebow 2007, 2010; Levy 2008b, 2015; Barrenechea and Mahoney 2019; Tetlock and Belkin 1996; Tetlock and Parker 2006; Weber 1949).”
MethodBlame avoidance in hard times: complex governance structures and the COVID-19 pandemic
Hinterleitner, M., Honegger, C., & Sager, F. (2022) · West European Politics · doi:10.1080/01402382.2022.2064634 · Cited by 61
“Taken together, these ‘counterfactual considerations’ (Fearon 1991) further strengthen our inference that the differences identified between the phases are primarily due to the changes in governance structures brought about by the enactment of the emergency law (and the associated relative…”
BackgroundThe Distinctiveness of Comparative Research
Ragin, C. C., & Rubinson, C. (2009) · SAGE Publications Ltd eBooks · doi:10.4135/9780857021083.n2 · Cited by 65
“In fact, all social research involves counterfactual analysis in some way (Lieberson, 1985) but caseoriented researchers tend to make their counterfactual theorizing explicit (Fearon, 1991).”
BackgroundPower in concert: the nineteenth-century origins of global governance
Carter, B. (2014) · Cambridge Review of International Affairs · doi:10.1080/09557571.2014.961816 · Cited by 59
How Did the Cold War Die? Principles for an Autopsy
Kegley, C. W. (1994) · Mershon International Studies Review · doi:10.2307/222609 · Cited by 58
Parties in chains: Do ethnic party bans in Africa promote peace?
Basedau, M., & Moroff, A. (2011) · Party Politics · doi:10.1177/1354068810391148 · Cited by 69
Anderson, J. J. (1995) · World Politics · doi:10.1017/s0043887100016452 · Cited by 57
Glenn, J. K. (1999) · Social Forces · doi:10.1093/sf/78.1.187 · Cited by 63
Empirical Research on International Environmental Policy: Designing Qualitative Case Studies
Mitchell, R. B., & Bernauer, T. (1998) · The Journal of Environment & Development · doi:10.1177/107049659800700102 · Cited by 56
“, ceteris paribus), B is absent when A is absent; and (c) that A preceded B in time (Fearon, 1991).”
BackgroundContrasts, counterfactuals,and causes
Grynaviski, E. (2012) · European Journal of International Relations · doi:10.1177/1354066111428971 · Cited by 83
“A contrastive, counterfactual account provides mechanisms for emphasizing distant elements of causal explanation that authors who want to focus on proximate causes would reject (e.g. Fearon, 1991).”
BackgroundCitizenship and Contemporary Direct Democracy
Altman, D. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108634397 · Cited by 118
Community history and rural development: why some farmers participate more readily than others
Walters, B. B., Cadelina, A., Cardano, A., & Visitacion, E. (1999) · Agricultural Systems · doi:10.1016/s0308-521x(99)00003-7 · Cited by 64
“Walters then synthesized these findings and applied counterfactual analysis to evaluate the relevance of specific historical events and factors as probable causes of project success or failure (see Fearon, 1990).”
MethodParker, C. F., & STERN, E. K. (2005) · Foreign Policy Analysis · doi:10.1111/j.1743-8594.2005.00014.x · Cited by 58
Koehler, S., & König, T. (2014) · Political Science Research and Methods · doi:10.1017/psrm.2014.26 · Cited by 63
“…distinguishes two research designs for empirical evaluations; it combines a case study (qualitative) design that applies counterfactual reasoning on an individual case with a regression-based design using other cases to identify the counterfactual in a quantitative manner (Fearon 1991).”
What is Analytical Sociology? Strengths and weaknesses of a new sociological research program
Opp, K. (2013) · Social Science Information · doi:10.1177/0539018413483939 · Cited by 60
“For the social sciences, see Fearon (1991), Morgan & Winship (2007), Winship & Morgan (1999).”
BackgroundA Careful Look at Modern Case Selection Methods
Herron, M. C., & Quinn, K. M. (2014) · Sociological Methods & Research · doi:10.1177/0049124114547053 · Cited by 48
Financial Incentives and Central Bank Authority in Industrializing Nations
Maxfield, S. (1994) · World Politics · doi:10.2307/2950718 · Cited by 64
Emergent Polarity: Analyzing State-Formation and Power Politics
Cederman, L. (1994) · International Studies Quarterly · doi:10.2307/2600863 · Cited by 56
Introduction: Investigating the Welfare State at Century's End
(2001) · Oxford University Press eBooks · doi:10.1093/0198297564.003.0001 · Cited by 49
Benefits of IT-Enabled Flexibilities for Foreign versus Local Firms in Emerging Economies
Khuntia, J., Kathuria, A., Saldanha, T. J. V., & Konsynski, B. R. (2019) · Journal of Management Information Systems · doi:10.1080/07421222.2019.1628906 · Cited by 54
“We can also examine counterfactual arguments to this hypothesis [23].”
BackgroundBamber, L. S., Christensen, T. E., & Gaver, K. M. (2000) · SSRN Electronic Journal · doi:10.2139/ssrn.208628 · Cited by 48
Rhevani, 2., & H. Popo Suryana, S. (2026) · Universitas Pasundan institutional repositories & scientific journals (Universitas Pasundan) · Cited by 47
Beach, D., & Kaas, J. G. (2020) · International Studies Review · doi:10.1093/isr/viaa016 · Cited by 73
Mayhew, D. R. (2005) · Perspectives on Politics · doi:10.1017/s1537592705050309 · Cited by 47
The Makeup and Breakup of Ethnofederal States: Why Russia Survives Where the USSR Fell
Hale, H. E. (2005) · Perspectives on Politics · doi:10.1017/s153759270505005x · Cited by 47
An Alternative Explanation for the Failure of the UNCED Forest Negotiations
Davenport, D. S. (2005) · Global Environmental Politics · doi:10.1162/1526380053243549 · Cited by 45
The false promise of the better argument
Hanrieder, T. (2011) · International Theory · doi:10.1017/s1752971911000182 · Cited by 57
Intra-EU Labour Migration and Support for the Norwegian Welfare State
Cappelen, C. W., & Midtbø, T. (2016) · European Sociological Review · doi:10.1093/esr/jcw025 · Cited by 57
Research Design, Falsification, and the Qualitative–Quantitative Divide
Caporaso, J. A. (1995) · American Political Science Review · doi:10.2307/2082441 · Cited by 54
Multi-Method Research in the Social Sciences: A Review of Recent Frameworks and a Way Forward
Beach, D. (2020) · Government and Opposition · doi:10.1017/gov.2018.53 · Cited by 43
“The logical argument is then made that if a particular cause had not occurred, the outcome would not have occurred (Fearon 1991; Goertz and Levy 2007; Lebow 2000; Levy 2015; Tetlock and Belkin 1996).”
BackgroundSpeed kills? Reassessing the role of speed, precision, and situation awareness in the Fall of Saddam
Biddle, S. D. (2007) · Journal of Strategic Studies · doi:10.1080/01402390701210749 · Cited by 43
Causation and Explanation in Social Science
Brady, H. E. (2013) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199604456.013.0049 · Cited by 39
Toward a Platinum Standard for Evidence‐Based Assessment by 2020
Khagram, S., & Thomas, C. W. (2010) · Public Administration Review · doi:10.1111/j.1540-6210.2010.02251.x · Cited by 47
Counterfactual Analysis of Sustainable Project Delivery Processes
Klotz, L. E., & Horman, M. J. (2009) · Journal of Construction Engineering and Management · doi:10.1061/(asce)co.1943-7862.0000148 · Cited by 42
Power and Political Theory: Domination, Normativity, Teleology
Parietti, G. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197607480.003.0005 · Cited by 42
‘Let's Talk Cash’: Cantons' Interests and the Reform of Swiss Federalism
Cappelletti, F., Fischer, M., & Sciarini, P. (2013) · Regional & Federal Studies · doi:10.1080/13597566.2013.808627 · Cited by 41
“…hypotheses if we are able to demonstrate that the three mechanisms presented in the previous section have played an important role in the success of the reform and—as in counterfactual reasoning (Fearon, 1991; Haverland, 2006)—that their absence would have led to the failure of the reform project.”
BackgroundResultMoya, I., Chica, M., Lozano, J. L. S., & Cordón, Ó. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.02.015 · Cited by 43
Using case studies to expand the theory of civil war
Sambanis, N. (2003) · Cited by 56
No Easy Choices: Estimating the Effects of United Nations Peacekeeping (Response to King and Zeng)
Sambanis, N., & Doyle, M. W. (2007) · International Studies Quarterly · doi:10.1111/j.1468-2478.2007.00447.x · Cited by 40
Taking Offense at Offense-Defense Theory
Davis, J. W., Finel, B. I., Goddard, S. E., Evera, S. V., Glaser, C. L., & Kaufmann, C. D. (1998) · International Security · doi:10.2307/2539342 · Cited by 39
A Realist Foreign Policy for the United States
Rosato, S., & Schuessler, J. M. (2011) · Perspectives on Politics · doi:10.1017/s1537592711003963 · Cited by 49
Coordination in Large Numbers: An Agent-Based Model of International Negotiations
Earnest, D. C. (2008) · International Studies Quarterly · doi:10.1111/j.1468-2478.2008.00505.x · Cited by 44
Metadata
- Authors
- Fearon, J. D.
- Affiliations
- University of California, Berkeley (US)
- Corresponding author
- Fearon, James D.
- Venue
- World Politics
- Publisher
- Project MUSE
- Published
- 1991-01
- Volume
- 43
- Issue
- 2
- Pages
- 169-195
- ISSN
- 0043-8871 (ISSN-L)
- 1086-3338
- OpenAlex
- W1972181371
- Semantic Scholar
- 17968a01ee432286912295946716661ac33e9b58
- Cited by
- 729
- References
- 74
- Citations by year
- 2026: 32 · 2025: 16 · 2024: 14 · 2023: 40 · 2022: 40 · 2021: 36 · 2020: 35 · 2019: 32 · 2018: 36 · 2017: 17 · 2016: 22 · 2015: 20 · 2014: 24 · 2013: 25 · 2012: 20
- FWCI
- 28.70
- Type
- journal article
- Language
- en
- Open access
- green
- escholarship.org
- Locations
- World Politics (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Virtual Defense Library (Ministerio de Defensa) (submittedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Qualitative Comparative Analysis Research
- Social Sciences › Political Science and International Relations › Political Science Research and Education
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Keywords
- hypothesis testing, causal inference, comparative case study, small-N research, origins of World War I, social revolution, Latin America, origins of fascism, corporatism, international relations theory
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


