Counterfactuals and Hypothesis Testing in Political Science
Open accessThe DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
Abstract
Scholars in comparative politics and international relations routinely evaluate causal hypotheses by referring to counterfactual cases where a hypothesized causal factor is supposed to have been absent. The methodological status and the viability of this very common procedure are unclear and are worth examining. How does the strategy of counterfactual argument relate, if at all, to methods of hypothesis testing based on the comparison of actual cases, such as regression analysis or Mill's Method of Difference? Are counterfactual thought experiments a viable means of assessing hypotheses about national and international outcomes, or are they methodologically invalid in principle? The paper addresses the first question in some detail and begins discussion of the second. Examples from work on the causes of World War I, the nonoccurrence of World War III, social revolutions, the breakdown of democratic regimes in Latin America, and the origins of fascism and corporatism in Europe illustrate the use, problems and potential of counterfactual argument in small-N-oriented political science research.
Overview
CoChat Summary
TL;DR
Fearon argues that counterfactual conditionals play a necessary and fundamental, if often implicit, role in how political scientists assess causal hypotheses, and that analysts face a choice between two and only two strategies for empirically testing a causal claim: the "actual case" strategy and the "counterfactual case" strategy. The paper's primary concern is small-N research, where negative degrees of freedom make counterfactual argument logically necessary to establish the causal importance of any one variable.
Key findings
- When experimental control and replication are not possible, analysts can either (1) imagine that C had been absent and ask whether E would have occurred, or (2) search for other actual cases resembling the case in question except that C is absent or has a different value. Both strategies aim to solve the same statistical problem: the analyst begins with one case and at least one explanatory variable, meaning negative degrees of freedom, and legitimate causal imputations cannot be made on that basis.
- In large-N, non-experimental work, counterfactual assumptions enter via the "ceteris paribus" assumption (E(x'e)=0). Fearon argues this assumption is credible "if and only if" the counterfactual proposition (PI) is credible: "If the cases in the sample had assumed different values on the independent variables, the contents of the error term would not have differed systematically."
- The strategies differ in how they provide confirmation: the actual case strategy relies on frequency or magnitude of association across actual cases, while the counterfactual strategy cannot meaningfully assess frequencies and instead relies on general principles, theories, or laws distinct from the hypothesis being tested, plus historical facts relevant to the counterfactual scenario.
- Assessing relative causal weight in the counterfactual strategy requires a proliferation of counterfactual cases — to argue A was a more important cause than B, at least two scenarios are needed (A present/B absent versus B present/A absent).
Methods
- Conceptual and methodological argument developed in three sections: distinguishing the "actual case" and "counterfactual" strategies of hypothesis testing; illustrating the counterfactual strategy in practice through examples from international relations and comparative politics; and returning to theoretical issues about the link between causal arguments and counterfactual propositions.
- Illustrative examples include the "cult of the offensive" hypothesis about World War I (Van Evera 1984, Snyder 1984), structural versus domestic explanations of Soviet foreign policy (following Waltz 1979, 1981), and works such as Moore (1966), Skocpol (1979), and Luebbert (1987).
- No formal data collection or statistical analysis is reported; the paper is a methodological/theoretical essay.
Limitations
- The paper states that arguments about what would have happened in multiple counterfactual scenarios "will be very imprecise and uncertain," and that in the counterfactual strategy "there is no formal criterion for gauging the risk of error associated with some independent variable — all depends instead on the plausibility of arguments about 'what would have happened.'"
- The paper acknowledges that the counterfactual strategy for empirically checking a causal hypothesis "seems only indirectly empirical, since the confirmation it provides depends principally on other theories."
- Evident from the text: the provided full text is truncated mid-sentence in the second section ("Second, I will consider the role of counterfactuals in sever…"), so the paper's examples in practice and its third section on theoretical issues are only partially available here.
Model-written summary of a shortened version of the paper’s full text (it is longer than we read). Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 1 Not valid · 0 Not checked · 20 Own results and interpretations
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In addition, even in N-1 case studies analysts will often mix both strategies of confirmation.”
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“work”
- Also stated in: § 5 For example: "The might-have-beens of history are not a profitable subject · plain
“in case studies where the analyst is explicitly concerned with giving a causal explanation for some event or phenomenom”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 5 For example: "The might-have-beens of history are not a profitable subject · plain
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“causes”
- Also stated in: § 5 For example: "The might-have-beens of history are not a profitable subject · plain
“that selected the actual outcome from a range of possible counterfactual outcomes in that case, we see the source of the”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 5 For example: "The might-have-beens of history are not a profitable subject · plain
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Both strategies, if successful (from the analyst's point of view), tend to support the hypothesis that the proposed cause in fact produces (or produced) the effect.”
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If there are”
- Also stated in: § 2 Following Waltz (1979, 1981), "structural position" here would entail the · plain
“other causes”
- Also stated in: § 2 Following Waltz (1979, 1981), "structural position" here would entail the · plain
“of the phenomenom in question that are not considered ®*P^icitly in the analysis, and if any of these are systematically related to the causes explicitly considered, then effects of the”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 2 Following Waltz (1979, 1981), "structural position" here would entail the · plain
7 more claims
Create a free account to see all 21 claims and every source verdict.
- Probably not a substantial claim. 3
- It may state two separate claims as one. 6
- The quote only partly states this claim. 2
Citations
Cites
Theory of International Politics
Frankel, J., & Waltz, K. N. (1980) · International Journal · doi:10.2307/40201892 · Cited by 8,506
Theory of International Politics, by Kenneth N. Waltz
Randle, R. F. (1980) · Political Science Quarterly · doi:10.2307/2149594 · Cited by 6,358
States and Social Revolutions: A Comparative Analysis of France, Russia and China
Skocpol, T. (1979) · Cambridge University Press · doi:10.1017/cbo9780511815805 · Cited by 5,408
Nagel, E., & Hawkins, D. (1961) · American Journal of Physics · doi:10.1119/1.1937571 · Cited by 3,667
Comparative Politics and the Comparative Method
Lijphart, A. (1971) · American Political Science Review · doi:10.2307/1955513 · Cited by 3,151
On the Social Origins of Dictatorship and Democracy
Moore, B. (1984) · Critique and Anti-Critique · doi:10.1007/978-1-349-86027-2_4 · Cited by 2,694
Methodology of Social Sciences
Weber, M. (2017) · Routledge eBooks · doi:10.4324/9781315124445 · Cited by 2,527
Greenstein, F. I., & Polsby, N. W. (1975) · Addison-Wesley Longman Publishing Co., Inc. eBooks · Cited by 2,344
The Comparative Method: Moving Beyond Qualitative and Quantitative Strategies
Ragin, C. C. (2014) · doi:10.1525/9780520957350 · Cited by 2,130
Rationalizable Strategic Behavior
Bernheim, B. D. (1984) · Econometrica · doi:10.2307/1911196 · Cited by 1,291
Research works printed but not linked: 8
- Ragin, 1987, The Comparative Method, 39
- George, 1985, Advances in Information Processing in Organizations, 2
- Gaddis John Lewis , “Nuclear Weapons and International Systemic Stability,” American Academy of Arts and Sciences Occasional Paper No. 2 (Cambridge: AAAS, 1990).
- Polsby, 1982, What If?: Essays in Social Science Fiction
- Moore, 1966, Social Origins of Dictatorship and Democracy, 414
- Fischer, 1970, Historians' Fallacies, 15
- Lewis, 1973, Counterfactuals, 65
- Barry, 1980, Supertax, Political Studies, 28, 139
Cited by
Items 201–300 of 725
How Perceptions Influence the Risk of War
Kim, W., & de Mesquita, B. B. (1995) · International Studies Quarterly · doi:10.2307/2600723 · Cited by 37
Ontologies, Problem Representation, and the Cuban Missile Crisis
Sylvan, D. A., & Thorson, S. J. (1992) · Journal of Conflict Resolution · doi:10.1177/0022002792036004005 · Cited by 37
Evidential Pluralism in the Social Sciences
Shan, Y., & Williamson, J. (2023) · Routledge eBooks · doi:10.4324/9781003143000 · Cited by 46
Emmenegger, P. (2011) · Journal of European Social Policy · doi:10.1177/0958928711412222 · Cited by 36
“The problem of logical consistency is strongly related to the problem of historical consistency (Fearon, 1991: 193; Lebow, 2000: 582–3; Levy, 2008: 635; Tetlock and Belkin, 1996: 23–5). According to Max Weber (1949), good counterfactual cases should require as few changes as possible compared with the real world (‘min…”
BackgroundKagan, K. (1997) · Security Studies · doi:10.1080/09636419708429341 · Cited by 52
Prehistoric Myths in Modern Political Philosophy
Widerquist, K., & Mccall, G. S. (2017) · Edinburgh University Press eBooks · doi:10.26530/oapen_625284 · Cited by 50
“Although counterfactuals are contrary-to-fact, they have empirical truth-value (Fearon 1991; Nolan 2013).”
BackgroundDisciplining Political Science
Laitin, D. D. (1995) · American Political Science Review · doi:10.2307/2082440 · Cited by 35
The role of ideas in defense planning: revisiting the revolution in military affairs
Jensen, B. (2018) · Defence Studies · doi:10.1080/14702436.2018.1497928 · Cited by 35
“On counterfactuals, see Fearon (1991).”
BackgroundHow Good Is Good Enough? A Multidimensional, Best-Possible Standard for Research Design
Gerring, J. (2010) · Political Research Quarterly · doi:10.1177/1065912910361221 · Cited by 63
“If we have no such variation, our analysis must take the form of a counterfactual thought experiment in which such variation is imagined—a much weaker research design in most settings (see Fearon 1991; Gerring 2007; Lebow 2007).”
MethodConditions of intergovernmental armaments cooperation in Western Europe, 1996–2006
Thiem, A. (2011) · European Political Science Review · doi:10.1017/s1755773910000251 · Cited by 41
“A useful strategy in such a situation is to allow for counterfactual cases (Fearon, 1991; Tetlock and Belkin, 1996; Ragin, 2008).”
BackgroundThe Comparative Method in Practice: Case Selection and the Social Science of Revolution
Beck, C. J. (2017) · Social Science History · doi:10.1017/ssh.2017.15 · Cited by 35
The Impact of the European Union on Environmental Policies
Haverland, M. (2003) · Oxford University Press eBooks · doi:10.1093/0199252092.003.0009 · Cited by 48
Islamic Politics, Muslim States, and Counterterrorism Tensions
Henne, P. S. (2017) · Cambridge University Press eBooks · doi:10.1017/9781316534328 · Cited by 42
From Agents to Outcomes: Simulation in International Relations
Pepinsky, T. B. (2005) · European Journal of International Relations · doi:10.1177/1354066105055484 · Cited by 32
“The epistemological critique of simulation advanced here focuses on what the simulation enterprise in abstract attempts to do — to create a would apply.”
BackgroundInternational Swaps And Derivatives Association
Encyclopedia, E. (2014) · Droit Francais | European Encyclopédie du Droit · Cited by 32
United We Stand?: Divide-and-Conquer Politics and the Logic of International Hostility
Belkin, A. (2005) · State University of New York Press eBooks · doi:10.1353/book4902 · Cited by 38
Bower, A. (2014) · Review of International Studies · doi:10.1017/s0260210514000217 · Cited by 31
Short-Term Forces and Partisanship
Cowden, J. A., & McDermott, R. (2000) · Political Behavior · doi:10.1023/a:1026610113325 · Cited by 40
The Americas’ More Perfect Unions: New Institutional Insights from Comparative Political Theory
Simon, J. (2014) · Perspectives on Politics · doi:10.1017/s153759271400214x · Cited by 31
Preventive Diplomacy and Ethnic Conflict: Possible, Difficult, Necessary
Jentleson, B. W. (1996) · Cited by 30
Opposing Power: Building Opposition Alliances in Electoral Autocracies
Ong, E. (2021) · University of Michigan Press eBooks · doi:10.3998/mpub.12001520 · Cited by 47
The Mixed Blessing of Israel's Nuclear Policy
Maoz, Z. (2003) · International Security · doi:10.1162/016228803322761964 · Cited by 30
Transitions from Authoritarian Rule and the Problem of Violence
Zielinski, J. (1999) · Journal of Conflict Resolution · doi:10.1177/0022002799043002006 · Cited by 30
Framing, Uncertainty, and Hostile Communications in a Crisis Experiment
McDermott, R., Cowden, J. A., & Koopman, C. (2002) · Political Psychology · doi:10.1111/0162-895x.00274 · Cited by 30
Centre-periphery conflicts and alienation in a resource-based economy
Vik, J., Fuglestad, E. M., & Øversveen, E. (2022) · Norsk Geografisk Tidsskrift - Norwegian Journal of Geography · doi:10.1080/00291951.2022.2111270 · Cited by 33
“Although counter-factual arguments are hard to validate with certainty (Fearon 1991), it is likely that the absence of an overall dominating political and/or economic elite was important for the institutional solutions that were chosen when Norway had to build a new institutional regime around new…”
BackgroundNugent, A., & Chan, H. F. (2023) · Technovation · doi:10.1016/j.technovation.2023.102762 · Cited by 33
Understanding the Past: Statistical Analysis of Causal Attribution
Yamamoto, T. (2011) · American Journal of Political Science · doi:10.1111/j.1540-5907.2011.00539.x · Cited by 43
“Imagine a World in Which”: Using Scenarios in Political Science
Barma, N. H., Durbin, B., Lorber, E., & Whitlark, R. E. (2015) · International Studies Perspectives · doi:10.1093/isp/ekv005 · Cited by 31
Bloom, J. (2015) · American Sociological Review · doi:10.1177/0003122415574329 · Cited by 63
Information, Bureaucracy, and Economic Reforms in China and the Soviet Union
Huang, Y. (1994) · World Politics · doi:10.2307/2950680 · Cited by 29
A Methodology for the Study of Historical Counterfactuals
Sylvan, D. J., & Majeski, S. J. (1998) · International Studies Quarterly · doi:10.1111/0020-8833.00070 · Cited by 43
Running to Lose?: John C. Breckinridge and the Presidential Election of 1860
Jenkins, J. A., & Morris, I. L. (2005) · Electoral Studies · doi:10.1016/j.electstud.2005.05.001 · Cited by 28
Correspondence: Taking Offense at Offense-Defense Theory
Davis, J. W., Finel, B. I., Goddard, S. E., Evera, S. V., Glaser, C. L., & Kaufmann, C. D. (1998) · International Security · doi:10.1162/isec.23.3.179 · Cited by 65
van der Heijden, J. (2009) · Research Repository (Delft University of Technology) · Cited by 47
Uluslararası İlişkilerde Nitel Yöntemlerle Makale Yazımı: Vaka Analizi ve İncelikleri
KÜRÜM, R. S. (2020) · Pamukkale University Journal of Social Sciences Institute · doi:10.30794/pausbed.801518 · Cited by 45
The Power of Deterrence: Emotions, Identity, and American and Israeli Wars of Resolve
Lupovici, A. (2016) · Cited by 26
Military Coalitions and the Politics of Information
Smith, B. C. (2020) · The Journal of Politics · doi:10.1086/711625 · Cited by 26
Kausalität als Gegenstand der Sozialwissenschaften und der multivariaten Statistik
Opp, K. (2010) · VS Verlag für Sozialwissenschaften eBooks · doi:10.1007/978-3-531-92038-2_2 · Cited by 46
Sobel, A. C. (1994) · International Interactions · doi:10.1080/03050629408434833 · Cited by 25
The institutional limitations of Catholic progressivism: an economic approach
Gill, A. (1995) · International Journal of Social Economics · doi:10.1108/eum0000000003956 · Cited by 24
Putting the Special Case in Its Place: Switzerland and Small‐N Comparison in Policy Research
Fontana, M., Afonso, A., & Papadopoulos, Y. (2008) · Swiss Political Science Review · doi:10.1002/j.1662-6370.2008.tb00111.x · Cited by 23
The Small N Methodological Challenges of Analyzing Regional Integration
Genna, G. M., & Lombaerde, P. A. A. D. (2010) · Journal of European Integration · doi:10.1080/07036337.2010.518717 · Cited by 29
“However this researcher could use Fearon’s (1991) technique in using counterfactual analysis to increase variance, if possible.”
From Ideals to Institutions: Institutional Entrepreneurship in Mexican Small Business FinancePreprint
Canales, R. (2011) · SSRN Electronic Journal · doi:10.2139/ssrn.1763385 · Cited by 24
Bringing the Welfare State Back In: The Promise (and Perils) of the New Social Welfare History
Hacker, J. S. (2005) · Journal of Policy History · doi:10.1353/jph.2005.0004 · Cited by 22
Williams, T., & Gemperle, S. M. (2016) · International Journal of Social Research Methodology · doi:10.1080/13645579.2016.1149316 · Cited by 41
“In making the case for causality, the use of counterfactual reasoning can be useful; however, this should be done ‘explicitly and carefully’ (Fearon, 1991, p. 195) for the invoked counterfactuals to underline the causal nature.”
MethodDoes the EU Cause Domestic Developments? The Problem of Case Selection in Europeanization ResearchPreprint
Haverland, M. (2005) · European integration online papers ( EIoP ) · Cited by 62
Understanding Resistance to Foreign Occupation
Collard-Wexler, S. (2013) · doi:10.7916/d8bz6d8m · Cited by 28
Why Political Economy Needs Historical Sociology
Seabrooke, L. (2007) · International Politics · doi:10.1057/palgrave.ip.8800197 · Cited by 32
Earnest, D. C., Yetiv, S. A., & Carmel, S. M. (2012) · International Interactions · doi:10.1080/03050629.2012.726151 · Cited by 22
Who Pays for Health Care Reform?
Giaimo, S. (2001) · Oxford University Press eBooks · doi:10.1093/0198297564.003.0012 · Cited by 22
Transnational Public-Private Partnerships as Learning Facilitators: Global Governance of Mercury
Sun, Y. (2017) · Global Environmental Politics · doi:10.1162/glep_a_00399 · Cited by 23
The Case Study: What it is and What it Does
Gerring, J. (2013) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199604456.013.0051 · Cited by 47
Western Policy and the Demise of the Soviet Union
Wallander, C. Α. (2003) · Journal of Cold War Studies · doi:10.1162/152039703322483774 · Cited by 22
Quantitative Cross-national Research Methods
Esping‐Andersen, G., & Przeworski, A. (2001) · Elsevier eBooks · doi:10.1016/b0-08-043076-7/00754-3 · Cited by 21
Rethinking Gore-War: Counterfactuals and the 2003 Iraq War
Stieb, J. (2023) · Journal of Strategic Studies · doi:10.1080/01402390.2023.2266577 · Cited by 20
Donoso, S., Pavlic, R. D., & Belén Cumsille, R. (2023) · World Development · doi:10.1016/j.worlddev.2023.106213 · Cited by 20
Bass, G. J. (2016) · International Security · doi:10.1162/isec_a_00258 · Cited by 24
Darfur: Strategic Victimhood Strikes Again?
Kuperman, A. J. (2009) · Genocide Studies and Prevention · doi:10.3138/gsp.4.3.281 · Cited by 20
An Assessment of the Partition of Cyprus
Kaufmann, C. D. (2007) · International Studies Perspectives · doi:10.1111/j.1528-3585.2007.00281.x · Cited by 21
El método comparativo y el análisis de configuraciones causales
Pérez‐Liñán, A. (2010) · D-Scholarship@Pitt (University of Pittsburgh) · Cited by 74
Naser, V., Rezaei, S., Ho, R. C., & Okumuş, F. (2018) · Perspectives on Asian tourism · doi:10.1007/978-981-13-2463-5_14 · Cited by 21
Gehring, T., & Oberthür, S. (2004) · Springer eBooks · doi:10.1007/978-1-4020-2208-1_10 · Cited by 28
PATTERNS, RULES AND LEARNING: COMPUTATIONAL MODELS OF INTERNATIONAL BEHAVIOR
Schrodt, P. A. (2004) · Cited by 21
Leadership and the End of the Cold War
Breslauer, G. W., & Lebow, R. N. (2004) · Palgrave Macmillan US eBooks · doi:10.1057/9781403982810_7 · Cited by 18
Introducing authoritarian diasporas: causes and consequences of authoritarian elite dispersion
Loxton, J., & Power, T. J. (2021) · Democratization · doi:10.1080/13510347.2020.1866553 · Cited by 20
Is Only Fair Lovely in Indian Politics? Consequences of Skin Color in a Survey Experiment in Delhi
Ahuja, A., Ostermann, S. L., & Mehta, A. S. (2016) · The Journal of Race Ethnicity and Politics · doi:10.1017/rep.2016.6 · Cited by 30
Evidence for development effectiveness
Khagram, S., Thomas, C. W., Lucero, C., & Mathes, S. (2009) · Journal of Development Effectiveness · doi:10.1080/19439340903141415 · Cited by 20
“Counterfactual thought experiments can correspondingly be utilised to increase the causal leverage from single case studies (Fearon 1991).”
MethodThe AKP between populism and neoliberalism: lessons from pharmaceutical policy
Dorlach, T. (2016) · New Perspectives on Turkey · doi:10.1017/npt.2016.23 · Cited by 18
Multiple Regression in Small-N Comparisons
Esping‐Andersen, G. (2007) · Comparative social research · doi:10.1016/s0195-6310(06)24009-2 · Cited by 18
“The standard approach is to sample the 20-odd OECD democracies and then regress the y ¼ f ðxjzÞ: As Fearon (1991) insists, the smaller the sample size, the greater is the need to make counterfactuals explicit.”
BackgroundQuantitative Cross-national Research Methods
Esping‐Andersen, G., & Przeworski, A. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-097086-8.44045-6 · Cited by 19
“The logic of the problem is similar whether we study large or small N’s (Fearon, 1991).”
BackgroundInfluentialThe Social Construction of the Acquis Communautaire: A Cornerstone of the European EdificePreprint
Jørgensen, K. E. (2002) · SSRN Electronic Journal · doi:10.2139/ssrn.302745 · Cited by 18
“Such a reading, the one chosen for this paper, is fairly similar to the use of counterfactuals in historical analysis (Fearon, 1991).”
MethodDebrand, T., & Sirven, N. (2008) · RePEc: Research Papers in Economics · Cited by 22
Morrison, J. A. (2012) · International Organization · doi:10.1017/s0020818312000331 · Cited by 17
Strengthening Democratic Quality: Reactive Deliberation in the Context of Direct Democracy
Altman, D. G. (2024) · Figshare · doi:10.7274/26125912 · Cited by 16
Legalising Abortion in Argentina: Social Movements and Multi-Party Coalitions
Anderson, C. F. (2022) · Journal of Politics in Latin America · doi:10.1177/1866802x221100274 · Cited by 22
“Counterfactuals have been used extensively in the field of history and social sciences (Fearon, 1991; Levy, 2015).”
MethodWhat if? Counterfactual (Hi)Stories of International Law
Venzke, I. (2017) · Asian Journal of International Law · doi:10.1017/s2044251317000091 · Cited by 16
Thinking about Russia: Plausible pasts and probable futures
Tetlock, P. E., & Visser, P. S. (2000) · British Journal of Social Psychology · doi:10.1348/014466600164417 · Cited by 17
“Counterfactual thought experiments are an issue of central methodological and epistemological concern to students of international relations and comparative politics (Fearon, 1991, 1996; Ferguson, 1997; Tetlock & Belkin, 1996).”
BackgroundRethinking Roles: Reflexive Role Ascription and Performativity in International Relations
Fazendeiro, B. T. (2016) · International Studies Review · doi:10.1093/isr/viv010 · Cited by 15
Living with observational data in biological anthropology
Smith, R. J. (2019) · American Journal of Physical Anthropology · doi:10.1002/ajpa.23862 · Cited by 16
Racism Is Not Enough: Minority Coalition Building in San Francisco, Seattle, and Vancouver
Kim, J. Y. (2020) · Studies in American Political Development · doi:10.1017/s0898588x20000115 · Cited by 15
Of Course International Institutions Matter: But When and How?
Mitchell, R. B. (2003) · VS Verlag für Sozialwissenschaften eBooks · doi:10.1007/978-3-322-80936-0_5 · Cited by 15
Cases, Numbers, Models: International Relations Research Methods
Sprinz, D. F., & Wolinsky-Nahmias, Y. (2002) · Cited by 20
Grigoryan, A. (2012) · International Political Science Review · doi:10.1177/0192512112456050 · Cited by 16
Differing Evaluations of Vietnamization
Gartner, S. S. (1998) · The Journal of Interdisciplinary History · doi:10.1162/002219598551698 · Cited by 14
Evaluating NATO enlargement: scholarly debates, policy implications, and roads not taken
Goldgeier, J. M., & Shifrinson, J. R. I. (2020) · International Politics · doi:10.1057/s41311-020-00243-7 · Cited by 12
Logics of action and models of capitalism: Explaining bottom‐up non‐liberal change
Étienne, J., & Schnyder, G. (2014) · Swiss Political Science Review · doi:10.1111/spsr.12082 · Cited by 14
Timpone, R. J. (2002) · Political Analysis · doi:10.1093/pan/10.2.154 · Cited by 13
Evaluating Gorbachev as Leader
Breslauer, G. W. (1989) · Soviet Economy · doi:10.1080/08826994.1989.10641312 · Cited by 14
Is Only Fair Lovely in Indian Politics? Consequences of Skin Color in a Survey Experiment in DelhiPreprint
Ahuja, A., Ostermann, S. L., & Mehta, A. S. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2730325 · Cited by 14
Hansel, M., & Oppermann, K. (2014) · Foreign Policy Analysis · doi:10.1111/fpa.12054 · Cited by 13
“Another criterion “requires that if the counterfactual assertion had been true […] nothing else would also have been different in a way that would have materially affected the outcome” (Fearon 1991:195; see also Goodman 1973:9–17).”
BackgroundIs there an empirical literature on rights?
Burke, T. F., & Barnes, J. (2009) · Studies in law, politics, and society · doi:10.1108/s1059-4337(2009)0000048006 · Cited by 13
Models, Methodologies, and Metaphors on the Move
Wimmer, A. (2006) · Palgrave Macmillan UK eBooks · doi:10.1057/9780230524644_1 · Cited by 17
The Perception of Indonesian Youths toward Islamophobia: An Exploratory Study
Shukri, S. F. M. (2019) · Islamophobia Studies Journal · doi:10.13169/islastudj.5.1.0061 · Cited by 13
“Counterfactual analysis is a framework of studying a case by extrapolating what could have happened in a different scenario (Fearon 1991).”
BackgroundLeadership in the European Convention
Kleine, M. O. (2007) · Journal of European Public Policy · doi:10.1080/13501760701656437 · Cited by 13
Márton, P. (2019) · Corvinus Journal of International Affairs · doi:10.14267/cojourn.2019v4n2a9 · Cited by 12
Procedural rights for nature – a pathway to sustainable decarbonisation?
Schapper, A., Hoffmann, C., & Lee, P. C. (2022) · Third World Quarterly · doi:10.1080/01436597.2022.2057293 · Cited by 18
“In addition, we use counterfactuals as a method (Fearon 1991; Gallo-Rivera, Mancha-Navarro, and Garrido-yserte 2013) to demonstrate how procedural rights of nature can prevent conflicts among state, society and ecosystems and lead to different, more sustainable, decisions in decarbonisation…”
MethodPracticing Peace: Conflict Management in Southeast Asia and South America
Glas, A. (2022) · doi:10.1093/oso/9780197633229.001.0001 · Cited by 16
Darfur: Strategic Victimhood Strikes Again?
Kuperman, A. J. (2009) · Genocide Studies and Prevention · doi:10.1353/gsp.0.0028 · Cited by 12
Regime complexes, critical actors and institutional layering
Rabitz, F. (2016) · Journal of International Relations and Development · doi:10.1057/jird.2016.16 · Cited by 17
Wolff, F., Schönherr, N., & Heyen, D. A. (2016) · Journal of Environmental Policy & Planning · doi:10.1080/1523908x.2016.1254035 · Cited by 16
“…when it can be plausibly argued either that the existence of the respective success factor contributed positively to the instrument’s effects; or that the absence of the factor led to a lower level of effects than could have otherwise been achieved (‘counterfactual reasoning’; cf. Fearon, 1991).”
Background
Metadata
- Authors
- Fearon, J. D.
- Affiliations
- University of California, Berkeley (US)
- Corresponding author
- Fearon, James D.
- Venue
- World Politics
- Publisher
- Project MUSE
- Published
- 1991-01
- Volume
- 43
- Issue
- 2
- Pages
- 169-195
- ISSN
- 0043-8871 (ISSN-L)
- 1086-3338
- OpenAlex
- W1972181371
- Semantic Scholar
- 17968a01ee432286912295946716661ac33e9b58
- Cited by
- 729
- References
- 74
- Citations by year
- 2026: 32 · 2025: 16 · 2024: 14 · 2023: 40 · 2022: 40 · 2021: 36 · 2020: 35 · 2019: 32 · 2018: 36 · 2017: 17 · 2016: 22 · 2015: 20 · 2014: 24 · 2013: 25 · 2012: 20
- FWCI
- 28.70
- Type
- journal article
- Language
- en
- Open access
- green
- escholarship.org
- Locations
- World Politics (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Virtual Defense Library (Ministerio de Defensa) (submittedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Qualitative Comparative Analysis Research
- Social Sciences › Political Science and International Relations › Political Science Research and Education
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Keywords
- hypothesis testing, causal inference, comparative case study, small-N research, origins of World War I, social revolution, Latin America, origins of fascism, corporatism, international relations theory
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


