Model Ambiguities in Configurational Comparative Research
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
For many years, sociologists, political scientists, and management scholars have readily relied on Qualitative Comparative Analysis (QCA) for the purpose of configurational causal modeling. However, this article reveals that a severe problem in the application of QCA has gone unnoticed so far: model ambiguities. These arise when multiple causal models fare equally well in accounting for configurational data. Mainly due to the uncritical import of an algorithm that is unsuitable for causal modeling, researchers have typically been unaware of the whole model space. As a result, there exists an indeterminable risk for practically all QCA studies published in the last quarter century to have presented findings that their data did not warrant. Using hypothetical data, we first identify the algorithmic source of ambiguities and discuss to what extent they affect different methodological aspects of QCA. By reanalyzing a published QCA study from rural sociology, we then show that model ambiguities are not a mere theoretical possibility but a reality in applied research, which can assume such extreme proportions that no causal conclusions whatsoever are possible. Finally, the prevalence of model ambiguities is examined by performing a comprehensive analysis of 192 truth tables across 28 QCA studies published in applied sociology. In conclusion, we urge that future QCA practice ensures full transparency with respect to model ambiguities, both by informing readers of QCA-based research about their extent and by employing algorithms capable of revealing them.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis
Schneider, C. Q., & Wagemann, C. (2012) · doi:10.1017/cbo9781139004244 · Cited by 2,862 · cited 4×
“…counterfactual introduction of sufficient configurations altogether, the intermediate strategy assumes that so-called easy (Ragin 2008) or tenable (Schneider and Wagemann 2012) counterfactuals can be introduced as sufficient configurations, and according to the parsimonious strategy, any…”
BackgroundMethodInfluentialA set-theoretic approach to organizational configurations
Fiss, P. C. (2007) · Academy of Management Review · doi:10.5465/amr.2007.26586092 · Cited by 2,225
Set Relations in Social Research: Evaluating Their Consistency and Coverage
Ragin, C. C. (2006) · Political Analysis · doi:10.1093/pan/mpj019 · Cited by 1,784
Standards of Good Practice in Qualitative Comparative Analysis (QCA) and Fuzzy-Sets
Schneider, C. Q., & Wagemann, C. (2010) · Comparative Sociology · doi:10.1163/156913210x12493538729793 · Cited by 1,473
Substitutes or Complements? A Configurational Examination of Corporate Governance Mechanisms
Misangyi, V. F., & Acharya, A. G. (2014) · Academy of Management Journal · doi:10.5465/amj.2012.0728 · Cited by 771
Cress, D. M., & Snow, D. A. (2000) · American Journal of Sociology · doi:10.1086/210399 · Cited by 722 · cited 1×
“…Avdagic 2010; Hicks, Misra, and Ng 1995; Misra 2003; Peillon 1996), social movements (e.g., Amenta, Caren, and Olasky 2005; Amenta et al. 2009; Cress and Snow 2000; Wright and Schaffer-Boudet 2012), labor markets (e.g., Brown and Boswell 1995; Brueggemann and Boswell 1998; Dixon, Roscigno,…”
BackgroundCorporate Governance and Investors' Perceptions of Foreign IPO Value: An Institutional Perspective
Bell, R. G., Filatotchev, I., & Aguilera, R. V. (2014) · Academy of Management Journal · doi:10.5465/amj.2011.0146 · Cited by 429
When Institutions Matter:Union Growth and Decline in Western Europe, 1950-1995
Ebbinghaus, B., & Visser, J. (1999) · European Sociological Review · doi:10.1093/oxfordjournals.esr.a018257 · Cited by 408
Amenta, E., Caren, N., Olasky, S. J., & Stobaugh, J. E. (2009) · American Sociological Review · doi:10.1177/000312240907400407 · Cited by 186 · cited 2×
“, Avdagic 2010; Hicks, Misra, and Ng 1995; Misra 2003; Peillon 1996), social movements (e.g., Amenta, Caren, and Olasky 2005; Amenta et al. 2009; Cress and Snow 2000; Wright and Schaffer-Boudet 2012), labor markets (e.”
BackgroundThe Programmatic Emergence of the Social Security State
Hicks, A., Misra, J., & Ng, T. N. (1995) · American Sociological Review · doi:10.2307/2096417 · Cited by 131
Cited by
Designing Research With Qualitative Comparative Analysis (QCA): Approaches, Challenges, and Tools
(2017) · doi:10.1177/0049124117729700 · Cited by 380
Qualitative Comparative Analysis Using R: A Beginner's Guide
Oana, I.-E., Schneider, C. Q., & Thomann, E. (2021) · doi:10.1017/9781009006781 · Cited by 224
Often Trusted but Never (Properly) Tested: Evaluating Qualitative Comparative Analysis
Baumgartner, M., & Thiem, A. (2020) · Sociological Methods & Research · doi:10.1177/0049124117701487 · Cited by 193
Self-citation
Metadata
- Authors
- Baumgartner, M., & Thiem, A.
- Venue
- Sociological Methods & Research
- Publisher
- SAGE Publications
- Published
- 2015-10-23
- Volume
- 46
- Issue
- 4
- Pages
- 954-987
- ISSN
- 0049-1241 (ISSN-L)
- 1552-8294
- OpenAlex
- W2356559998
- Cited by
- 149
- References
- 12
- FWCI
- 34.33
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Model Ambiguities in Configurational Comparative Research. https://app.cochat.ai/papers/10.1177/0049124115610351
- The paper
- Baumgartner, M., & Thiem, A. (2017). Model Ambiguities in Configurational Comparative Research. Sociological Methods & Research. https://doi.org/10.1177/0049124115610351
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.