Evidence and Inference in the Comparative Case Study
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Comparative case studies often rely on a practice known as selecting on the dependent variable. This technique involves choosing some phenomenon of political interest, gathering data on occurrences of the phenomenon, then determining what characteristics the occurrences have in common. A methodological strategy with a long history, selecting on the dependent variable has found numerous applications in political science, including the study of economic growth, social revolutions, and international conflict.' Selecting on the dependent variable has provided an important method for gathering information when there is relatively little data, though it is not limited to such situations. Its use has recently come under rather sharp attack. If observations are selected based on the value of the dependent variable, then estimates obtained by ordinary least squares will be biased. This bias can not be corrected by the introduction of control variables. Gathering more data will not solve the problem; the bias remains even if the number of observations goes to infinity. In short, inferences drawn from cases selected on the dependent variable are highly suspect.2 Impressive treatments of the problem from the position of comparative case study work have been presented by Barbara Geddes and by Gary King, Robert Keohane, and Sidney Verba.3 They have not only alerted the discipline to an important problem but have suggested concrete ways to deal with problems of selection bias.4 I would like to offer a qualified defense of analyses of a small number of cases selected on the dependent variable. As is well-known, selecting on the dependent variable is perfectly admissible if one is evaluating necessary (as opposed to sufficient) conditions.5 However, with a few exceptions, this argument has gone unnoticed in the debate on case selection.6 By concentrating on the logic of testing necessary conditions, this paper attempts to show that the methodological implications of selecting on the dependent variable are much less threatening to the validity of small-n comparative case study work than has often been claimed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These suggestions for explicitly (or implicitly) addressing measurement error made by Dion (1998), Braumoeller and Goertz (2000), and Clark, Gilligan, and Golder (2006) have, however, found little or any resonance among scholars employing QCA.”
From Qualitative Comparative Analysis: How Inductive Use and Measurement Error Lead to Problematic Inference (2013) · cites this paper as Dion (1998)
In the citing paper
“Dion (1998), in essence, adopts a Bayesian perspective where prior beliefs about necessary conditions are updated on the basis of new data according to Bayes's rule.”
From Qualitative Comparative Analysis: How Inductive Use and Measurement Error Lead to Problematic Inference (2013) · cites this paper as Dion (1998)
In the citing paper
“What remains unspecified, however, is where the uncertainty is coming from if some case(s) contradict(s) the necessary condition being tested.”
From Qualitative Comparative Analysis: How Inductive Use and Measurement Error Lead to Problematic Inference (2013) · cites this paper as Dion (1998)
In the citing paper
“This is also implied by Dion's (1998) finding that from a Bayesian perspective at least six cases are required to attain a sufficient level of certainty to maintain a necessary condition.”
From Qualitative Comparative Analysis: How Inductive Use and Measurement Error Lead to Problematic Inference (2013) · cites this paper as Dion (1998)
In the citing paper
“Dion (1998), in an award-winning article focusing in particular on necessary conditions, found using a Bayesian analysis that regularities can be established with con fi dence with as few as fi ve or six cases.”
From Large-N Qualitative Analysis (LNQA): Causal Generalization in Case Study and Multimethod Research (2023) · cites this paper as Dion (1998)
Citations
Cites
Capitalism and Social Democracy
Przeworski, A. (1987) · Labour / Le Travail · doi:10.2307/25142838 · Cited by 707
Without consent or contract: the rise and fall of American slavery
(1990) · Choice Reviews Online · doi:10.5860/choice.27-4712 · Cited by 533
Case Selection, Conceptualizations and Basic Logic in the Study of War
(1982) · doi:10.2307/2110974 · Cited by 25
Cited by
Items 101–200 of 263
Pipkin, S. (2011) · World Development · doi:10.1016/j.worlddev.2011.04.016 · Cited by 31
Dsouli, O., Khan, N., & KAKABADSE, N. K. (2012) · Journal of Management Development · doi:10.1108/02621711211281843 · Cited by 35
Mertha, A. C., & Pahre, R. (2005) · International Organization · doi:10.1017/s0020818305050241 · Cited by 27
Formal Theory and Case-Study Methods in EU Studies
Pahre, R. (2005) · European Union Politics · doi:10.1177/1465116505049610 · Cited by 38
Hierarchy and Judicial Institutions: Arbitration and Ideology in the Hellenistic World
Grynaviski, E., & Hsieh, A. (2015) · International Organization · doi:10.1017/s0020818315000090 · Cited by 28
A Meeting of Social Science and Football: Measuring the Effects of Three Points for a Win
Aylott, M., & Aylott, N. (2007) · Sport in Society · doi:10.1080/17430430601147047 · Cited by 29
Pahre, R. (2001) · European Union Politics · doi:10.1177/1465116501002002001 · Cited by 24
Freese, J., & Kevern, J. (2013) · Handbooks of sociology and social research · doi:10.1007/978-94-007-6094-3_3 · Cited by 31
The Impact of Living Lab Methodology on Open Innovation Contributions and Outcomes
Schuurman, D., Marez, L. D., & Ballon, P. (2016) · Technology Innovation Management Review · doi:10.22215/timreview956 · Cited by 25
Case Selection in Public Management Research: Problems and Solutions
Konisky, D. M., & Reenock, C. M. (2012) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/mus051 · Cited by 27
Didactic CME and practice change: don’t throw that baby out quite yet
Olson, C. A., & Tooman, T. (2011) · Advances in Health Sciences Education · doi:10.1007/s10459-011-9330-3 · Cited by 24
The Reverend and the Ravens: Comment on Seawright
Clarke, K. A. (2002) · Political Analysis · doi:10.1093/pan/10.2.194 · Cited by 23
Theory Building and Hypothesis Testing: Large- vs. Small-N Research on Democratization
Coppedge, M. (2002) · Cited by 21
Wailes, N. (1999) · The International Journal of Human Resource Management · doi:10.1080/095851999340099 · Cited by 23
Reason for Hope? The Spotted Owl Injunctions and Policy Change
Swedlow, B. (2009) · Law & Social Inquiry · doi:10.1111/j.1747-4469.2009.01167.x · Cited by 19
Large-N Qualitative Analysis (LNQA): Causal Generalization in Case Study and Multimethod Research
Goertz, G., & Haggard, S. (2023) · Perspectives on Politics · doi:10.1017/s1537592723002037 · Cited by 22
“Dion (1998), in an award-winning article focusing in particular on necessary conditions, found using a Bayesian analysis that regularities can be established with con fi dence with as few as fi ve or six cases.”
Collective Action Meets Prospect Theory: An Application to Coalition Building in Chile, 1973–75
Fanis, M. (2004) · Political Psychology · doi:10.1111/j.1467-9221.2004.00376.x · Cited by 23
Applied Social Science Methodology: An Introductory Guide
Gerring, J., & Christenson, D. P. (2017) · Cited by 38
Methodological Rorschach Tests: Contrasting Interpretations in Qualitative and Quantitative Research
Goertz, G., & Mahoney, J. (2012) · Comparative Political Studies · doi:10.1177/0010414012466376 · Cited by 51
El método comparativo y el análisis de configuraciones causales
Pérez‐Liñán, A. (2010) · D-Scholarship@Pitt (University of Pittsburgh) · Cited by 74
Substance and Methods in the Comparative Study of Policy Change
Peters, B. G., Fontaine, G., & Mendez, J.-L. (2018) · Journal of Comparative Policy Analysis Research and Practice · doi:10.1080/13876988.2017.1322764 · Cited by 28
Attributing Development Impact
Copestake, J., Morsink, M. E. B., & Remnant, F. (2019) · Practical Action Publishing eBooks · doi:10.3362/9781780447469 · Cited by 23
Harvey, F. P. (1999) · Journal of Conflict Resolution · doi:10.1177/0022002799043006008 · Cited by 18
Watching Your Posterior: Comment on Seawright
Braumoeller, B. F., & Goertz, G. (2002) · Political Analysis · doi:10.1093/pan/10.2.198 · Cited by 18
Chubb, J. (2017) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York) · Cited by 25
Boolean Analysis, Mechanisms, and the Study of Regime Effectiveness
Stokke, O. S. (2004) · Regime Consequences · doi:10.1007/978-1-4020-2208-1_5 · Cited by 17
Accounting for the Unaccounted: Weak-Actor Social Structure in Asymmetric Wars
Findley, M. G., & Edwards, S. (2007) · International Studies Quarterly · doi:10.1111/j.1468-2478.2007.00465.x · Cited by 17
Does Regime Robustness Require a Fair Distribution of the Gains from Cooperation?
Hasenclever, A., Mayer, P. B., & Rittberger, V. (2004) · Springer eBooks · doi:10.1007/978-1-4020-2208-1_8 · Cited by 17
Why Causal Mechanisms and Process Tracing Should Alter Case Selection Guidance
Saylor, R. (2018) · Sociological Methods & Research · doi:10.1177/0049124118769109 · Cited by 24
A Comparative Cyberconflict Analysis of Digital Activism Across Post-Soviet Countries
Karatzogianni, A., Miazhevich, G., & Denisova, A. (2017) · Comparative Sociology · doi:10.1163/15691330-12341415 · Cited by 29
Causation in the Social Sciences
Kincaid, H. (2010) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199279739.003.0037 · Cited by 31
Secure E-Examination Systems Compared: Case Studies from Two Countries
Fluck, A. E., Adebayo, O. S., & Abdulhamid, S. M. (2017) · Journal of Information Technology Education Innovations in Practice · doi:10.28945/3705 · Cited by 15
Deterrence and ethnic conflict: The case of Bosnia‐Herzegovina, 1993–94
Harvey, F. P. (1997) · Security Studies · doi:10.1080/09636419708429318 · Cited by 14
Mehr oder weniger? Quantitativer versus qualitativer Vergleich
Ebbinghaus, B. (2009) · VS Verlag für Sozialwissenschaften eBooks · doi:10.1007/978-3-531-91826-6_10 · Cited by 20
The Modernisation of Labour Law and Industrial Relations in a Comparative Perspective
Blanpain, R., Bromwich, W. J., Rymkevich, O., & Spattini, S. (2009) · Wolters Kluwer Law & Business eBooks · Cited by 16
Unifying the Study of Asymmetric Hypotheses
Rosenberg, A. S., Knuppe, A. J., & Braumoeller, B. F. (2017) · Political Analysis · doi:10.1017/pan.2017.16 · Cited by 11
Barahona, E. M. (2010) · Revista de ciencia política · doi:10.4067/s0718-090x2010000300007 · Cited by 13
Introduction to the Special Issue “Causal Complexity and Qualitative Methods”
Goertz, G. (2006) · Political Analysis · doi:10.1093/pan/mpj016 · Cited by 15
Ragin, C. C. (2001) · Elsevier eBooks · doi:10.1016/b0-08-043076-7/00762-2 · Cited by 17
Intermediate-N Comparison: Configurational Comparative Methods
Engeli, I., Rihoux, B., & Allison, C. R. (2014) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137314154_5 · Cited by 16
Rohlfing, I. (2009) · VS Verlag für Sozialwissenschaften eBooks · doi:10.1007/978-3-531-91826-6_7 · Cited by 35
Reducing Uncertainty: Information Analysis for Comparative Case Studies
Drozdova, K., & Gaubatz, K. T. (2013) · International Studies Quarterly · doi:10.1111/isqu.12101 · Cited by 13
Giusti, M., Remigis, S. D., Greco, S., Profeta, V. F., Bonaccorsi, G., Zanobini, P., Riccio, M. D., Lorini, C., Giosia, M. D., & Persiani, N. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1562564 · Cited by 11
Rasli, A. (2005) · RUCforsk (Roskilde University) · Cited by 10
Poteete, A. R., & Elinor Ostrom, B. (2005) · Digital Library Of The Commons Repository (Indiana University) · Cited by 10
Case Selection and Causal Inference in Qualitative ResearchPreprint
Plümper, T., Troeger, V. E., & Neumayer, E. (2010) · SSRN Electronic Journal · doi:10.2139/ssrn.1439868 · Cited by 8
How Large-Scale Land Protests Succeed in China: the Role of Domestic Media
Tang, Y., & Côté, I. (2020) · Journal of Chinese Political Science · doi:10.1007/s11366-020-09699-z · Cited by 11
Institutional Politics, Power Constellations, and Urban Social Sustainability
Laguna, J. M. (2014) · Cited by 10
Wang, R. (2017) · Journal for the Scientific Study of Religion · doi:10.1111/jssr.12366 · Cited by 8
Counterfactuals and the Study of the American Presidency
Chwieroth, J. M. (2002) · Presidential Studies Quarterly · doi:10.1111/j.0360-4918.2002.00222.x · Cited by 7
Pedersen, R. B., & Beach, D. (2010) · SSRN Electronic Journal · doi:10.2139/ssrn.1664660 · Cited by 8
Generalization, Case Studies, and Within-Case Causal Inference: Large-N Qualitative Analysis (LNQA)
Goertz, G., & Haggard, S. M. (2023) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197519806.013.14 · Cited by 9
Giusti, M., Cosma, C., Simoni, S., & Persiani, N. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192416632 · Cited by 9
Two-Level Theories and Fuzzy Sets
Goertz, G., & Mahoney, J. (2004) · Cited by 6
Causal Explanation and Multi-Method Research in the Social SciencesPreprint
Kuehn, D., & Rohlfing, I. (2009) · SSRN Electronic Journal · Cited by 10
Ragin, C. C. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-097086-8.44004-3 · Cited by 6
When More Is Less: Integrating Qualitative Information and Boolean Statistics
Braumoeller, B. F., & Kirpichevsky, Y. (2005) · Political Analysis · doi:10.1093/pan/mpi018 · Cited by 6
Fuzzy-Set Qualitative Comparative Analysis (fs/QCA): Ein Zwei-Stufen-Modul
Wagemann, C., & Schneider, C. Q. (2003) · VS Verlag für Sozialwissenschaften eBooks · doi:10.1007/978-3-663-12430-6_6 · Cited by 7
Regional cooperation and conflict management: Lessons from the Pacific Rim
Swanström, N. L. P. (2002) · Cited by 16
Linking democratic anchorage and regulatory authority: The case of internet regulators
Ewert, C., Kaufmann, C., & Maggetti, M. (2018) · Regulation & Governance · doi:10.1111/rego.12188 · Cited by 7
Private Institutions and Business Power in Global Governance
(2008) · doi:10.5555/ggov.2008.14.3.387 · Cited by 5
L'approccio del case study nella ricerca socio-economica
Sena, B. C. S. (2016) · SOCIOLOGIA E RICERCA SOCIALE · doi:10.3280/sr2016-111001 · Cited by 5
Case selection for robust generalisation: lessons from QuIP impact evaluation studies
Copestake, J. (2020) · Development in Practice · doi:10.1080/09614524.2020.1828829 · Cited by 5
Culture, context and East Asian high-performing education systems
Green, A., & Phan, H. (2025) · Research Papers in Education · doi:10.1080/02671522.2025.2567396 · Cited by 12
As conseqüências políticas e econômicas das crises entre Executivo e Legislativo
Pérez‐Liñán, A. (2004) · Opinião Pública · doi:10.1590/s0104-62762004000100005 · Cited by 9
2005, ‘A unified framework for the social sciences
Gerring, J. (2015) · Cited by 4
The challenge of empirically assessing the effects of constitutions
Tarko, V. (2015) · Journal of Economic Methodology · doi:10.1080/1350178x.2014.1003580 · Cited by 5
Kuehn, D. (2020) · Springer eBooks · doi:10.1007/978-3-658-16936-7_15 · Cited by 7
The effect of evidence in crisis learning: Based on a perspective integration framework
Bing, W., Li, D., & Wang, Y. (2023) · Journal of Contingencies and Crisis Management · doi:10.1111/1468-5973.12506 · Cited by 5
Recruitment and disengagement: two sides of the same coin or different phenomena?
Nascimento, J. S., Klandermans, B., & de Theije, M. (2021) · SN Social Sciences · doi:10.1007/s43545-021-00145-2 · Cited by 5
Urias, E. (2015) · Research Publications (Maastricht University) · doi:10.26481/dis.20151028eu · Cited by 10
Under the influence Of arms: the foreign policy causes and consequences of arms transfers
Willardson, S. L., Conybeare, J. A. C., Paik, A., Thies, C. G., Reisinger, W. M., & Lai, B. (2013) · doi:10.17077/etd.l20gvejw · Cited by 29
Bukve, O. (2019) · Springer eBooks · doi:10.1007/978-3-030-03979-0_9 · Cited by 3
Comparative Political Analysis: Six Case‐Oriented Strategies
Ragin, C. C., & Schneider, G. A. (2012) · Wiley eBooks · doi:10.1002/9781444355093.ch8 · Cited by 3
Debt overhang and natural resources: revisiting the resource curse hypothesis
Jones, Y. M. (2014) · BIROn (Birkbeck, University of London) · doi:10.18743/pub.00040095 · Cited by 8
Systematisch comparatief case onderzoek en evaluatieonderzoek
Marx, A. (2005) · Tijdschrift voor Sociologie · doi:10.21825/sociologos.86628 · Cited by 4
Design for society: Ageing communities as co-designers in processes of social innovation
Sarantou, M., & Pan, S. (2020) · Journal of Design Business & Society · doi:10.1386/dbs_00007_1 · Cited by 3
Schneider, C. Q., & Rohlfing, I. (2012) · SSRN Electronic Journal · doi:10.5281/zenodo.917753 · Cited by 2
Predicting the Results of School Finance Adequacy Lawsuits
Lynn, Z. (2011) · doi:10.7916/d8tt4xxj · Cited by 2
Posselt, J. R. (2013) · Deep Blue (University of Michigan) · Cited by 5
Li, Y. (2016) · RePub (Erasmus University Rotterdam) · Cited by 8
El método comparativo en América Latina
Pérez‐Liñán, A. (2023) · Revista Ecuatoriana de Ciencia Política · doi:10.59352/recp.v2i1.73 · Cited by 2
Context-Sensitive Policy Methods
Clarke, S. E. (2006) · Public administration and public policy · doi:10.1201/9781420017007.ch30 · Cited by 2
Pahre, R. (2009) · Perspectives on Politics · doi:10.1017/s1537592709991861 · Cited by 2
Metadata
- Authors
- Dion, D.
- Corresponding author
- Dion, Douglas
- Venue
- Comparative Politics
- Publisher
- JSTOR
- Published
- 1998-01
- Volume
- 30
- Issue
- 2
- Pages
- 127
- ISSN
- 0010-4159 (ISSN-L)
- OpenAlex
- W2017659746
- Cited by
- 261
- References
- 3
- Citations by year
- 2026: 5 · 2025: 4 · 2024: 2 · 2023: 10 · 2022: 2 · 2021: 1 · 2020: 7 · 2019: 9 · 2018: 7 · 2017: 11 · 2016: 7 · 2015: 12 · 2014: 10 · 2013: 12 · 2012: 13
- FWCI
- 20.37
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Comparative Politics (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Qualitative Comparative Analysis Research
- Social Sciences › Political Science and International Relations › Political Science Research and Education
- Social Sciences › Sociology and Political Science › Political Conflict and Governance
- Keywords
- selection bias, comparative case study, necessary conditions, sufficient conditions, small-N research, ordinary least squares bias, case selection, validity of inference
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.