The DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Assessing the Robustness of Crisp-set and Fuzzy-set QCA Results
Abstract
Configurational comparative methods constitute promising methodological tools that narrow the gap between variable-oriented and case-oriented research. Their infancy, however, means that the limits and advantages of these techniques are not clear. Tests on the sensitivity of qualitative comparative analysis (QCA) results have been sparse in previous empirical studies, and so has the provision of guidelines for doing this. Therefore this article uses data from a textbook example to discuss and illustrate various robustness checks of results based on the employment of crisp-set QCA and fuzzy-set QCA. In doing so, it focuses on three issues: the calibration of raw data into set-membership values, the frequency of cases linked to the configurations, and the choice of consistency thresholds. The study emphasizes that robustness tests, using systematic procedures, should be regarded as an important, and maybe even indispensable, analytical step in configurational comparative analysis.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“None of these recent contributions address directly, however, the issues raised in this article.”
From Qualitative Comparative Analysis: How Inductive Use and Measurement Error Lead to Problematic Inference (2013) · cites this paper as Skaaning 2011
In the citing paper
“The data used for the analyses that follow have been previously used by Ragin (2000, 292), Grofman and Schneider (2009), and Skaaning (2011).”
From Qualitative Comparative Analysis: How Inductive Use and Measurement Error Lead to Problematic Inference (2013) · cites this paper as Skaaning (2011)
In the citing paper
“These authors considered that four conditions should influence the presence of a strong welfare state, namely, a strong left party, strong unions, a corporatist industrial system, and sociocultural homogeneity.”
From Qualitative Comparative Analysis: How Inductive Use and Measurement Error Lead to Problematic Inference (2013) · cites this paper as Skaaning (2011)
Citations
Cites
Some Social Requisites of Democracy: Economic Development and Political Legitimacy
Lipset, S. M. (1959) · American Political Science Review · doi:10.2307/1951731 · Cited by 7,050
Redesigning Social Inquiry: Fuzzy Sets and Beyond
Ragin, C. C. (2008) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226702797.001.0001 · Cited by 4,445
Redesigning Social Inquiry: Fuzzy Sets and Beyond
Ragin, C. C. (2008) · Cited by 3,988
Configurational Comparative Methods: Qualitative Comparative Analysis (QCA) and Related Techniques
Rihoux, B., & Ragin, C. (2009) · SAGE Publications · doi:10.4135/9781452226569 · Cited by 3,089
Lieberson, S., & Ragin, C. C. (2001) · Contemporary Sociology · doi:10.2307/3089736 · Cited by 2,799
The Comparative Method: Moving Beyond Qualitative and Quantitative Strategies.
Smith, H. L., & Ragin, C. C. (1990) · Population and Development Review · doi:10.2307/1972971 · Cited by 2,779
The Comparative Method: Moving Beyond Qualitative and Quantitative Strategies
Ragin, C. C. (2014) · doi:10.1525/9780520957350 · Cited by 2,130
Pakulski, J., Best, H., Christmas-Best, & Horrman-Lange, U. (2012) · eCite Digital Repository (University of Tasmania) · Cited by 1,785
Nested Analysis as a Mixed-Method Strategy for Comparative Research
LIEBERMAN, E. S. (2005) · American Political Science Review · doi:10.1017/s0003055405051762 · Cited by 1,515
Standards of Good Practice in Qualitative Comparative Analysis (QCA) and Fuzzy-Sets
Schneider, C. Q., & Wagemann, C. (2010) · Comparative Sociology · doi:10.1163/156913210x12493538729793 · Cited by 1,473
Research works printed but not linked: 5
- Berg-Schlosser, Dirk, 2003, Conditions of Democracy in Europe, 1919-1939: Comparative Analyses
- Lieberson, Stanley., 2004, Qualitative Methods, 2, 13
- Marx, Axel., 2006, Towards More Robust Model Specification in QCA: Results From a Methodological Experiment
- Ragin, Charles, 2004, Qualitative Methods, 2, 3
- Skaaning, Svend-Erik., 2006, Democracy Besides Elections: An Inquiry Into the (Dis) Respect for Civil Liberty in Latin American and Post-communist Countries After the Third Wave
Cited by
Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis
Schneider, C. Q., & Wagemann, C. (2012) · Cited by 1,345
Green buying behavior and the theory of consumption values: A fuzzy-set approach
Gonçalves, H. M., Lourenço, T. F., & Silva, G. M. (2016) · Journal of Business Research · doi:10.1016/j.jbusres.2015.10.129 · Cited by 407
“However, the QCA literature recognizes that apparently small changes in the consistency and frequency thresholds can produce significant changes in the resulting solutions (Skaaning, 2011).”
BackgroundCombining QCA and Process Tracing in Set-Theoretic Multi-Method Research
Schneider, C. Q., & Rohlfing, I. (2013) · Sociological Methods & Research · doi:10.1177/0049124113481341 · Cited by 385
“2; Skaaning 2011) rather than diluting the principles of case selection.”
BackgroundDesigning Research With Qualitative Comparative Analysis (QCA): Approaches, Challenges, and Tools
(2017) · doi:10.1177/0049124117729700 · Cited by 380
“Different approaches offer several tools for addressing measurement error (Cooper and Glaesser 2016b; Emmenegger, Schraff, and Walter 2014; Greckhamer et al. 2013; Maggetti and Levi-Faur 2013; Ragin 2008a; Rohlfing and Schneider 2014; Skaaning 2011; Thiem 2014a; Thiem, Spöhel, et al. 2016).”
BackgroundMethodInfluentialPahl-Wostl, C., & Knieper, C. (2014) · Global Environmental Change · doi:10.1016/j.gloenvcha.2014.09.003 · Cited by 362
Metadata
- Authors
- Skaaning, S.-E.
- Affiliations
- Aarhus University (DK)
- Corresponding author
- Skaaning, Svend-Erik
- ORCID
- Skaaning, Svend-Erik
- Venue
- Sociological Methods & Research
- Publisher
- SAGE Publications
- Published
- 2011-04-06
- Volume
- 40
- Issue
- 2
- Pages
- 391-408
- ISSN
- 0049-1241 (ISSN-L)
- 1552-8294
- OpenAlex
- W2152395301
- Semantic Scholar
- af1d102cdc0fc6f582c6fd911040b2961c738798
- Cited by
- 407
- References
- 33
- Citations by year
- 2026: 49 · 2025: 39 · 2024: 27 · 2023: 37 · 2022: 35 · 2021: 42 · 2020: 29 · 2019: 24 · 2018: 23 · 2017: 32 · 2016: 20 · 2015: 17 · 2014: 12 · 2013: 15 · 2012: 5
- FWCI
- 35.23
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Sociological Methods & Research (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- Syddansk Universitet
- Topics
- Social Sciences › Sociology and Political Science › Qualitative Comparative Analysis Research
- Social Sciences › Education › Qualitative Research Methods and Applications
- Social Sciences › General Social Sciences › Q Methodology Applications
- Keywords
- qualitative comparative analysis, fuzzy-set QCA, robustness testing, sensitivity analysis, configurational comparative methods, configurational analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessing the Robustness of Crisp-set and Fuzzy-set QCA Results. https://app.cochat.ai/papers/10.1177/0049124111404818
- The paper
- Skaaning, S.-E. (2011). Assessing the Robustness of Crisp-set and Fuzzy-set QCA Results. Sociological Methods & Research. https://doi.org/10.1177/0049124111404818
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.