Set-Theoretic Comparative Methods: Less Distinctive Than Claimed
The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Abstract
Proponents of set-theoretic comparative methods (STCM) sharply differentiate their approach from quantitative analysis—unlike many researchers who focus on integrating qualitative and quantitative methods. This article engages these opposing views by demonstrating shared foundations between STCM and quantitative techniques. First, it shows how the quantitative practice of analyzing cases that exhibit variation on both the explanatory conditions and the outcome—for example, all four cells of a 2 × 2 table—guards against misleading conclusions about necessary/sufficient conditions. Hence, conventional statistical ideas about association are relevant for STCM. Second, STCM’s tools for analyzing causal complexity share important features with regression interaction terms. Third, scrutinizing these shared foundations suggests how stronger theoretical and empirical standards for causal inference with deterministic hypotheses can be established. Focusing on shared foundations and recognizing that STCM does not genuinely break new inferential ground facilitate new opportunities for strengthening comparative research tools, rather than unproductively overemphasizing differences from mainstream methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“One cannot simply infer causal conclusions from associational relations (Paine 2016: 706).”
From A qualitative assessment of QCA: method stretching in large-N studies and temporality (2022) · doi:10.1007/s11135-021-01278-5 · cites this paper as Paine 2016: 706
Citations
Cites
Designing Social Inquiry: Scientific Inference in Qualitative Research
King, G., Keohane, R. O., & Verba, S. (1994) · Princeton University Press · doi:10.1515/9781400821211 · Cited by 7,225
Redesigning Social Inquiry: Fuzzy Sets and Beyond
Ragin, C. C. (2008) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226702797.001.0001 · Cited by 4,445
Redesigning Social Inquiry: Fuzzy Sets and Beyond
Ragin, C. C. (2008) · Cited by 3,990
Competitive Authoritarianism: Hybrid Regimes after the Cold War
Levitsky, S., & Way, L. A. (2010) · doi:10.1017/cbo9780511781353 · Cited by 3,459
Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis
Schneider, C. Q., & Wagemann, C. (2012) · doi:10.1017/cbo9781139004244 · Cited by 2,862 · cited 3×
“None of the models presented in Ragin (2008), Goertz and Mahoney (2012), or Schneider and Wagemann (2012) contain a stochastic component.”
BackgroundLieberson, S., & Ragin, C. C. (2001) · Contemporary Sociology · doi:10.2307/3089736 · Cited by 2,799
Rosenbaum, P. R. (2002) · Springer Series in Statistics · doi:10.1007/978-1-4757-3692-2 · Cited by 2,394
Competitive Authoritarianism: Hybrid Regimes after the Cold War
Levitsky, S., & Way, L. A. (2001) · Cited by 2,166
Jstor (1993) · Cited by 1,593
IMAI, K., KEELE, L., TINGLEY, D., & YAMAMOTO, T. (2011) · American Political Science Review · doi:10.1017/s0003055411000414 · Cited by 1,537
Nested Analysis as a Mixed-Method Strategy for Comparative Research
LIEBERMAN, E. S. (2005) · American Political Science Review · doi:10.1017/s0003055405051762 · Cited by 1,515 · cited 1×
“Brady and Collier (2010) advocate “shared standards” for different research traditions, Lieberman (2005) presents an iterative method for combining statistical and case study findings, Dunning (2012) demonstrates the crucial contribution of qualitative work to evaluating natural experimental…”
Method(2007) · Cited by 1,428
Competitive Authoritarianism: Acronyms and Abbreviations
Levitsky, S., & Way, L. A. (2010) · Cited by 1,379
Competitive Authoritarianism: Introduction and Theory
Levitsky, S., & Way, L. A. (2010) · Cited by 1,379
Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis
Schneider, C. Q., & Wagemann, C. (2012) · Cited by 1,345
Field Experiments: Design, Analysis, and Interpretation
Green, D. (2024) · doi:10.61700/sgeirzx0v0mjh1252 · Cited by 1,320
Counterfactuals and Causal Inference: Methods and Principles for Social Research
Morgan, S. L., & Winship, C. (2007) · doi:10.1017/cbo9780511804564 · Cited by 1,146
Rethinking Social Inquiry: Diverse Tools, Shared StandardsPreprint
Brady, H. E., & Collier, D. (2010) · SSRN Electronic Journal · Cited by 871
A Tale of Two Cultures: Qualitative and Quantitative Research in the Social Sciences
Goertz, G., & Mahoney, J. (2012) · Princeton University Press · doi:10.23943/princeton/9780691149707.001.0001 · Cited by 833
Natural Experiments in the Social Sciences: A Design-Based Approach
Dunning, T. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9781139084444 · Cited by 705
A Tale of Two Cultures: Qualitative and Quantitative Research in the Social Sciences
Goertz, G., & Mahoney, J. (2012) · Cited by 582
ALIGNING ONTOLOGY AND METHODOLOGY IN COMPARATIVE POLITICS
Hall, P. A. (2003) · Comparative Historical Analysis in the Social Sciences · doi:10.1017/cbo9780511803963.012 · Cited by 530
Hainmueller, J., & Hazlett, C. (2014) · Political Analysis · doi:10.1093/pan/mpt019 · Cited by 517
Social Science Methodology: A Unified Framework
Gerring, J. (2012) · Cited by 515
Natural Experiments in the Social Sciences: A Design-Based Approach
Dunning, T. (2012) · Thammasat University Digital Collections · Cited by 466
Rethinking Social Inquiry: Diverse Tools, Shared Standards
(2010) · doi:10.5040/9798216385530 · Cited by 405
Combining QCA and Process Tracing in Set-Theoretic Multi-Method Research
Schneider, C. Q., & Rohlfing, I. (2013) · Sociological Methods & Research · doi:10.1177/0049124113481341 · Cited by 385
Colonialism and Postcolonial Development: Spanish America in Comparative Perspective
Mahoney, J. (2010) · doi:10.1017/cbo9780511750328 · Cited by 364
Modeling and interpreting interactive hypotheses in regression analysis
(2008) · Choice Reviews Online · doi:10.5860/choice.45-3841 · Cited by 361
Toward a Unified Theory of Causality
Mahoney, J. (2008) · Comparative Political Studies · doi:10.1177/0010414007313115 · Cited by 343 · cited 2×
“Mahoney (2008) provides a useful discussion of INUS conditions (“insufficient but necessary part of a condition which is itself unnecessary but sufficient for the result,” p. 418) and SUIN conditions (“sufficient but unnecessary part of a factor that is insufficient but necessary for an outcome,”…”
BackgroundMethodSeawright, J. (2016) · Cambridge University Press · doi:10.1017/cbo9781316160831 · Cited by 338
Colonialism and postcolonial development: Spanish America in comparative perspective
(2010) · Choice Reviews Online · doi:10.5860/choice.47-7037 · Cited by 262
The Methodology of Necessary Conditions
Braumoeller, B. F., & Goertz, G. (2000) · American Journal of Political Science · doi:10.2307/2669285 · Cited by 255
Sources Of Leverage In Causal Inference: Toward An Alternative View Of Methodology
Collier, D., Brady, H. E., & Seawright, J. (2010) · Rethinking Social Inquiry · doi:10.5040/9798216385530.ch-009 · Cited by 249
Social science methodology: A unified framework
Dassen, A., & Gemenis, K. (2012) · Acta Politica · doi:10.1057/ap.2012.17 · Cited by 184
Qualitative Comparative Analysis in Critical Perspective
Lucas, S. R., & Szatrowski, A. (2014) · Sociological Methodology · doi:10.1177/0081175014532763 · Cited by 183
Hug, S. (2013) · Political Analysis · doi:10.1093/pan/mps061 · Cited by 137 · cited 2×
“Especially considering that many recent simulation studies demonstrate QCA algorithmic results are unreliable under various minor perturbations (Hug, 2013; Krogslund, Choi, & Poertner, 2014; Lucas & Szatrowski, 2014; Seawright, 2014), it will be valuable for STCM scholars to address how their…”
BackgroundFuzzy Sets on Shaky Ground: Parameter Sensitivity and Confirmation Bias in fsQCA
Krogslund, C., Choi, D. D., & Poertner, M. (2015) · Political Analysis · doi:10.1093/pan/mpu016 · Cited by 136 · cited 1×
“Thus, there exist conditions that could plausibly lead to development that do not require either Mahoney’s NC #1 or NC #2. Crucially, the argument that an exceptional source of revenue can engender high levels of overall wealth—regardless of other development impediments faced by the country—is plausible for the count…”
BackgroundA Simple Multivariate Test for Asymmetric Hypotheses
Clark, W. R., Gilligan, M. J., & Golder, M. (2006) · Political Analysis · doi:10.1093/pan/mpj018 · Cited by 120
Quality Meets Quantity: Case Studies, Conditional Probability, and Counterfactuals
Sekhon, J. S. (2004) · Perspectives on Politics · doi:10.1017/s1537592704040150 · Cited by 97
Statistical Models and Causal Inference: A Dialogue with the Social Sciences
Felson, J. (2011) · Contemporary Sociology A Journal of Reviews · doi:10.1177/0094306110391764k · Cited by 96
Testing for Necessary and/or Sufficient Causation: Which Cases Are Relevant?
Seawright, J. (2002) · Political Analysis · doi:10.1093/pan/10.2.178 · Cited by 85 · cited 1×
“Seawright (2002) advanced this argument using a Bayesian model.”
MethodDoing Justice to Logical Remainders in QCA: Moving beyond the Standard Analysis
Schneider, C. Q., & Wagemann, C. (2013) · Political Research Quarterly · Cited by 82
Compagnon, D. (2011) · University of Pennsylvania Press eBooks · doi:10.9783/9780812200041 · Cited by 81
Basedau, M., & Richter, T. O. (2013) · European Political Science Review · doi:10.1017/s1755773913000234 · Cited by 75
Settler Colonialism: Economic Development and Class Formation
Good, K. (1976) · The Journal of Modern African Studies · doi:10.1017/s0022278x00053726 · Cited by 70
Improving Research on Necessary Conditions: Formalized Case Selection for Process Tracing after QCA
Rohlfing, I., & Schneider, C. Q. (2021) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.4589399 · Cited by 61
The Product and Difference Fallacies for Indirect Effects
Glynn, A. N. (2012) · American Journal of Political Science · doi:10.1111/j.1540-5907.2011.00543.x · Cited by 54
Chapter 9. Venezuela’s Growth Implosion: A Neoclassical Story?
Hausmann, R. (2003) · Princeton University Press eBooks · doi:10.1515/9781400845897-011 · Cited by 48
Collier, D. (2014) · Sociological Methodology · doi:10.1177/0081175014542568 · Cited by 30
Seawright, J. (2014) · Sociological Methodology · doi:10.1177/0081175014542082 · Cited by 25
The Reverend and the Ravens: Comment on Seawright
Clarke, K. A. (2002) · Political Analysis · doi:10.1093/pan/10.2.194 · Cited by 23
Causal Models and Counterfactuals
Mahoney, J., Goertz, G., & Ragin, C. C. (2013) · Handbooks of sociology and social research · doi:10.1007/978-94-007-6094-3_5 · Cited by 21
Choosing Cases For Case Studies: A Qualitative Logic
Goertz, G. (2008) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.996354 · Cited by 19
Watching Your Posterior: Comment on Seawright
Braumoeller, B. F., & Goertz, G. (2002) · Political Analysis · doi:10.1093/pan/10.2.198 · Cited by 18
Book Review: Redesigning Social Inquiry: Fuzzy Sets and Beyond.
Brown, D. K. (2009) · Teaching Sociology · doi:10.1177/0092055x0903700410 · Cited by 13
Comment [From Howard S. Becker]
Becker, H. S. (2002) · Contemporary Sociology A Journal of Reviews · doi:10.2307/3089552 · Cited by 1
Research works printed but not linked: 10
- Braumoeller B., 2013, Presented at the 109th annual convention of the American Political Science Association
- Dunning T., 2013, Presented at the 109th annual convention of the American Political Science Association
- Freedman D. A., 2008, Newsletter of the American Political Science Association Organized Section on Qualitative Methods, 6, 14
- Goertz G., 2005, Newsletter of the American Political Science Association Organized Section on Qualitative Methods, 3, 22
- Goertz G., 2008, Newsletter of the American Political Science Association Organized Section on Qualitative Methods, 6, 11
- 10.1017/CBO9780511570902 · doi:10.1017/cbo9780511570902
- Schneider C. Q., 2013, Newsletter of the American Political Science Association Organized Section on Qualitative Methods, 11, 5
- Schneider C. Q., 2013, Political Research Quarterly, 66, 211
- Sekhon J. S., 2005, Newsletter of the American Political Science Association Organized Section on Qualitative Methods, 3, 29
- Waldner D., 2005, Newsletter of the American Political Science Association Organized Section on Qualitative Methods, 3, 27
Cited by
Designing Research With Qualitative Comparative Analysis (QCA): Approaches, Challenges, and Tools
(2017) · doi:10.1177/0049124117729700 · Cited by 380
QCA and business research: Work in progress or a consolidated agenda?
Wagemann, C., Buche, J., & Siewert, M. B. (2016) · Journal of Business Research · doi:10.1016/j.jbusres.2015.10.010 · Cited by 212
Often Trusted but Never (Properly) Tested: Evaluating Qualitative Comparative Analysis
Baumgartner, M., & Thiem, A. (2020) · Sociological Methods & Research · doi:10.1177/0049124117701487 · Cited by 193
de Block, D., & Vis, B. (2018) · Journal of Mixed Methods Research · doi:10.1177/1558689818770061 · Cited by 135
Opposition “overblown”? Community response to wind energy siting in the Western United States
Giordono, L. S., Boudet, H. S., Karmazina, A., Taylor, C. L., & Steel, B. S. (2018) · Energy Research & Social Science · doi:10.1016/j.erss.2018.05.016 · Cited by 92
Metadata
- Authors
- Paine, J.
- Affiliations
- University of California, Berkeley (US)
- Corresponding author
- Paine, Jack
- ORCID
- Paine, Jack
- Venue
- Comparative Political Studies
- Publisher
- SAGE Publications
- Published
- 2015-01-18
- Volume
- 49
- Issue
- 6
- Pages
- 703-741
- ISSN
- 0010-4140 (ISSN-L)
- 1552-3829
- OpenAlex
- W3121786445
- Semantic Scholar
- fdc2ac15665f6c8d9ca4e76b7fddc37fa55d2f19
- Cited by
- 28
- References
- 57
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 1 · 2023: 1 · 2022: 2 · 2021: 2 · 2020: 3 · 2019: 2 · 2018: 7 · 2017: 3 · 2016: 3 · 2015: 2
- FWCI
- 16.58
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Comparative Political Studies (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Qualitative Comparative Analysis Research
- Social Sciences › Political Science and International Relations › Political Science Research and Education
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- qualitative comparative analysis, quantitative analysis, causal inference, necessary and sufficient conditions, associations, interaction terms, causal complexity, qualitative-quantitative integration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.