Evidence and Inference in the Comparative Case Study
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Comparative case studies often rely on a practice known as selecting on the dependent variable. This technique involves choosing some phenomenon of political interest, gathering data on occurrences of the phenomenon, then determining what characteristics the occurrences have in common. A methodological strategy with a long history, selecting on the dependent variable has found numerous applications in political science, including the study of economic growth, social revolutions, and international conflict.' Selecting on the dependent variable has provided an important method for gathering information when there is relatively little data, though it is not limited to such situations. Its use has recently come under rather sharp attack. If observations are selected based on the value of the dependent variable, then estimates obtained by ordinary least squares will be biased. This bias can not be corrected by the introduction of control variables. Gathering more data will not solve the problem; the bias remains even if the number of observations goes to infinity. In short, inferences drawn from cases selected on the dependent variable are highly suspect.2 Impressive treatments of the problem from the position of comparative case study work have been presented by Barbara Geddes and by Gary King, Robert Keohane, and Sidney Verba.3 They have not only alerted the discipline to an important problem but have suggested concrete ways to deal with problems of selection bias.4 I would like to offer a qualified defense of analyses of a small number of cases selected on the dependent variable. As is well-known, selecting on the dependent variable is perfectly admissible if one is evaluating necessary (as opposed to sufficient) conditions.5 However, with a few exceptions, this argument has gone unnoticed in the debate on case selection.6 By concentrating on the logic of testing necessary conditions, this paper attempts to show that the methodological implications of selecting on the dependent variable are much less threatening to the validity of small-n comparative case study work than has often been claimed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These suggestions for explicitly (or implicitly) addressing measurement error made by Dion (1998), Braumoeller and Goertz (2000), and Clark, Gilligan, and Golder (2006) have, however, found little or any resonance among scholars employing QCA.”
From Qualitative Comparative Analysis: How Inductive Use and Measurement Error Lead to Problematic Inference (2013) · cites this paper as Dion (1998)
In the citing paper
“Dion (1998), in essence, adopts a Bayesian perspective where prior beliefs about necessary conditions are updated on the basis of new data according to Bayes's rule.”
From Qualitative Comparative Analysis: How Inductive Use and Measurement Error Lead to Problematic Inference (2013) · cites this paper as Dion (1998)
In the citing paper
“What remains unspecified, however, is where the uncertainty is coming from if some case(s) contradict(s) the necessary condition being tested.”
From Qualitative Comparative Analysis: How Inductive Use and Measurement Error Lead to Problematic Inference (2013) · cites this paper as Dion (1998)
In the citing paper
“This is also implied by Dion's (1998) finding that from a Bayesian perspective at least six cases are required to attain a sufficient level of certainty to maintain a necessary condition.”
From Qualitative Comparative Analysis: How Inductive Use and Measurement Error Lead to Problematic Inference (2013) · cites this paper as Dion (1998)
In the citing paper
“Dion (1998), in an award-winning article focusing in particular on necessary conditions, found using a Bayesian analysis that regularities can be established with con fi dence with as few as fi ve or six cases.”
From Large-N Qualitative Analysis (LNQA): Causal Generalization in Case Study and Multimethod Research (2023) · cites this paper as Dion (1998)
Citations
Cites
Capitalism and Social Democracy
Przeworski, A. (1987) · Labour / Le Travail · doi:10.2307/25142838 · Cited by 707
Without consent or contract: the rise and fall of American slavery
(1990) · Choice Reviews Online · doi:10.5860/choice.27-4712 · Cited by 533
Case Selection, Conceptualizations and Basic Logic in the Study of War
(1982) · doi:10.2307/2110974 · Cited by 25
Cited by
Items 201–263 of 263
Motivations Behind Donor Funding Refusal: Towards a Typology of Principled Refusal
Cochrane, L., & Wilson, A. (2024) · The Journal of Development Studies · doi:10.1080/00220388.2024.2401414 · Cited by 3
Coopetition Regimes and State-Led Creation of New High Technology IndustriesPreprint
Breznitz, D. (2007) · SSRN Electronic Journal · doi:10.2139/ssrn.1079395 · Cited by 2
Parties and Patronage: A Comparative Analysis of the Indian Case
Hankla, C. (2006) · Digital Archive @ GSU · Cited by 2
Recasting Reform: An Analysis of Electoral Reform Initiatives in Fourteen Parliamentary Democracies
Levick, L. (2017) · QSpace (Queen's University Library) · Cited by 4
The Secret to Boards in Reinventing Themselves
Dsouli, O., Khan, N., & KAKABADSE, N. K. (2013) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137275707_5 · Cited by 4
McSweeney, B., Brown, D., & Iliopoulou, S. (2010) · SSRN Electronic Journal · doi:10.2139/ssrn.1632340 · Cited by 3
Decentraliserade litenheter - en kartläggning och en förklaring
(2009) · Cited by 1
Fortin‐Rittberger, J. (2008) · eScholarship@McGill (McGill) · doi:10.82308/3183 · Cited by 1
Innovation in the Services Sector: Towards a New Typological Theory
Kallas-Zelek, K. (2014) · doi:10.13021/mars/8223 · Cited by 1
What's in voters' minds? Economic conditions and identity issues in Korean and Taiwanese elections
Choi, E. (2007) · Texas ScholarWorks (Texas Digital Library) · Cited by 1
Elinor Ostrom, Governing the Commons: The Evolution of Institutions for Collective Action
Poteete, A. R. (2016) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199646135.013.29 · Cited by 3
Context-Sensitive Policy Methods
Clarke, S. E. (2017) · Routledge eBooks · doi:10.4324/9781315093192-44 · Cited by 1
Small Polities: Tyrannized by Majorities?
(2009) · doi:10.2174/1874949600902010035 · Cited by 1
Rethinking Presidential Challenges and Falls: A Qualitative Comparative AnalysisPreprint
Boniface, D. S. (2010) · SSRN Electronic Journal · Cited by 1
Maverick Movies: New Line Cinema and the Transformation of American Film
Herbert, D. (2023) · University of California Press eBooks · doi:10.1525/luminos.170 · Cited by 2
CHAPTER 1 Introducing the causal attribution challenge and the QuIP
Copestake, J., Remnant, F., & Morsink, M. E. B. (2019) · doi:10.3362/9781780447469.001 · Cited by 1
The death penalty and U.S. foreign policy
Kendall, W. (2012) · doi:10.25439/rmt.27581742 · Cited by 1
Tang, S. (2026) · European Journal of International Relations · doi:10.1177/13540661261456163 · Cited by 1
The Renewal of Qualitative Methods
Waldner, D. (2014) · Oxford University Press eBooks · doi:10.1093/obo/9780199756223-0107
Ragin, C. C. (2023) · University of California Press eBooks · doi:10.1525/9780520393745-019
Harfiana, M., & Matzner, N. (2026) · IEEE Access · doi:10.1109/access.2026.3651471 · Cited by 2
Grandpierron, M. (2020) · theses.fr (ABES) · doi:10.70675/e32cc935z0b18z465bz8454z7019915a9cab
Goertz, G., Mahoney, J., & Levy, J. S. (2015)
Why Some Nations Remained Independent: A Thematic Framework for Resilient Nations
Cochrane, L., & Wilson, A. (2026) · Springer eBooks · doi:10.1007/978-981-92-0221-8_8
Higher Powers: Alcohol and After in Uganda’s Capital City
Scherz, C., Mpanga, G., & Namirembe, S. (2023) · University of California Press eBooks · doi:10.1525/luminos.176 · Cited by 6
Calidad y cantidad: estudios de caso, probabilidad condicional y contrafácticos
Sekhon, J. S. (2004) · Dialnet (Universidad de la Rioja)
Short-term Impact of Instagram on Livelihoods of Artisans at Accra Arts Centre
Ohene-Adu, A., Agyeman-Rawlings, Z., & Adomdza, G. N. (2023) · European Conference on Social Media · doi:10.34190/ecsm.10.1.1226
Why Can't We Be Friends? Informal Relations, Public Policy, and Federalism in Canada
Collins, E. (2016) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2016-11626 · Cited by 1
(2012) · Wiley eBooks · doi:10.1002/9781444355093.refs
Løvold, T. (2012) · NORA - Norwegian Open Research Archives
Case Studies in Comparative Political Research: Value, Versatility, and Methodological Integration
Dogan, O. (2026) · American Journal of Qualitative Research · doi:10.29333/ajqr/17874 · Cited by 2
“Who Do I Call...?” Or Why the EU’s Rise Has Gone UnchallengedPreprint
Imbrie, A., Bennett, A., Chickering, R. P., Edelstein, D. M., & Kupchan, C. A. (2010) · SSRN Electronic Journal
Excorsing Hidden Positovist Demons
Kincaid, H. (2006) · Methodological Innovations Online · doi:10.4256/mio.2006.0003
POLS 503: Political Science Research Methods
Ridout, T. N. (2010)
Mutawally, S. (2019) · Lu Zone Ul (Laurentian University)
Ovsiienko, I. (2011) · Sabanci University · Cited by 2
Fielder, J. D. (2022) · Simulation & Gaming · doi:10.1177/10468781221075659
(2001) · International Organization · doi:10.1162/002081801317193709
Interdépendances et aide publique au développement: Actes du séminaire DgCiD-IDDRI 2005-2006
Gabas, J., Claeys-Nivet, A.-S., Daviron, B., Clément, C., Duffield, M., Giordano, T., Kaldor, M. H., Leander, A., & Voituriez, T. (2006) · HAL
SYMBOLIC INTERACTIONISM: THE ROLE OF INTERACTION IN T HE
Baghdadi, L. (2009)
Corporate Scandals: In The Age of ‘Responsible Business’
Kjær, C. (2024) · OpenArchive@CBS (Copenhagen Business School) · doi:10.22439/phd.06.2024 · Cited by 2
Kuehn, D. (2018) · Springer Reference Sozialwissenschaften · doi:10.1007/978-3-658-16937-4_15-1
Cerwonka, A., Malkki, L. H., Charmaz, K. C., King, G., Keohane, R. O., & Verba, S. (2011)
Halimi, S. (2008) · PDXScholar (Portland State University) · doi:10.15760/etd.7833
Parties without brand names: the causes and consequences of party relabeling
Kim, M.-S., Osborn, T., Reisinger, W. M., Solt, F., Loewenberg, G., & Kim, J.-O. (2015) · doi:10.17077/etd.4frqh2fh · Cited by 3
Case studies and comparative history
Coppedge, M. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9781139016179.005
A Tale of Four Cities: Transnational Christian Activism in the Heartland
Wang, R. (2019) · Springer eBooks · doi:10.1007/978-3-030-14148-6_5
Author's Response: China's Water Warriors—Returning to the Scene of Battle
Mertha, A. C. (2009) · Asia policy · doi:10.1353/asp.2009.0028
Cardinale, R. (2019) · UCL Discovery (University College London)
Persiani, N., Landini, G., & José, H. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1953572
Simó, P., Enache, M., Fernández, V., & Sallan, J. M. (2010) · Dirección y Organización · doi:10.37610/dyo.v0i41.335 · Cited by 4
Metadata
- Authors
- Dion, D.
- Corresponding author
- Dion, Douglas
- Venue
- Comparative Politics
- Publisher
- JSTOR
- Published
- 1998-01
- Volume
- 30
- Issue
- 2
- Pages
- 127
- ISSN
- 0010-4159 (ISSN-L)
- OpenAlex
- W2017659746
- Cited by
- 261
- References
- 3
- Citations by year
- 2026: 5 · 2025: 4 · 2024: 2 · 2023: 10 · 2022: 2 · 2021: 1 · 2020: 7 · 2019: 9 · 2018: 7 · 2017: 11 · 2016: 7 · 2015: 12 · 2014: 10 · 2013: 12 · 2012: 13
- FWCI
- 20.37
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Comparative Politics (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Qualitative Comparative Analysis Research
- Social Sciences › Political Science and International Relations › Political Science Research and Education
- Social Sciences › Sociology and Political Science › Political Conflict and Governance
- Keywords
- selection bias, comparative case study, necessary conditions, sufficient conditions, small-N research, ordinary least squares bias, case selection, validity of inference
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.