When Multi-Method Research Subverts Methodological Pluralism—or, Why We Still Need Single-Method Research
The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
While acknowledging the many forms and contributions of multi-method research (MMR), we examine the costs of treating it as best practice on the grounds that it reduces method-specific weaknesses and increases external validity for findings. Focusing on MMR that combines some type of qualitative analysis with statistical or formal approaches, we demonstrate that error-reduction and cross-validation are not feasible where methods are not sufficiently similar in their basic ontologies and their conceptions of causality. In such cases, MMR may still yield important benefits—such as uncovering related insights or improving the coding of variables—but these can be readily obtained through collaboration among scholars specializing in single-method research (SMR). Such scholars often set the standards for the application of particular methods and produce distinctive insights that can elude researchers concerned about competently deploying different methods and producing coherent findings. Thus, the unchecked proliferation of multi-method skill sets risks forefeiting the benefits of SMR and marginalizing idiographically-oriented qualitative research that fits less well with formal or quantitative approaches. This would effectively subvert the pluralism that once gave impetus to MMR unless disciplinary expectations and professional rewards are predicated on a more balanced and nuanced understanding of what various forms of SMR and MMR bring to the table.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Designing Social Inquiry: Scientific Inference in Qualitative Research
King, G., Keohane, R. O., & Verba, S. (1994) · Princeton University Press · doi:10.1515/9781400821211 · Cited by 7,225
Mixing Qualitative and Quantitative Methods: Triangulation in Action.
Jick, T. D. (1979) · Administrative Science Quarterly · doi:10.2307/2392366 · Cited by 7,103
Toward a definition of mixed methods research
Johnson, R. B., Onwuegbuzie, A. J., & Turner, L. A. (2007) · Journal of Mixed Methods Research · doi:10.1177/1558689806298224 · Cited by 6,464
Politics in Time: History, Institutions, and Social Analysis
Pierson, P. (2004) · doi:10.1515/9781400841080 · Cited by 4,957
Making Social Science Matter: Why Social Inquiry Fails and How it Can Succeed Again
Flyvbjerg, B. (2001) · doi:10.1017/cbo9780511810503 · Cited by 4,681
A set-theoretic approach to organizational configurations
Fiss, P. C. (2007) · Academy of Management Review · doi:10.5465/amr.2007.26586092 · Cited by 2,225
Nested Analysis as a Mixed-Method Strategy for Comparative Research
LIEBERMAN, E. S. (2005) · American Political Science Review · doi:10.1017/s0003055405051762 · Cited by 1,515 · cited 4×
“23 Lieberman 2005.”
BackgroundInfluentialContext and Causal Mechanisms in Political Analysis
Falleti, T. G., & Lynch, J. F. (2009) · Comparative Political Studies · doi:10.1177/0010414009331724 · Cited by 909
A Tale of Two Cultures: Contrasting Quantitative and Qualitative Research
Mahoney, J., & Goertz, G. (2006) · Political Analysis · doi:10.1093/pan/mpj017 · Cited by 904
A Tale of Two Cultures: Qualitative and Quantitative Research in the Social Sciences
Goertz, G., & Mahoney, J. (2012) · Princeton University Press · doi:10.23943/princeton/9780691149707.001.0001 · Cited by 833
Cited by
Technostress Research: A Nurturing Ground for Measurement Pluralism?
University of Applied Sciences Upper Austria, Fischer, T., Riedl, R., & University of Applied Sciences Upper Austria and University of Linz (2017) · Communications of the Association for Information Systems · doi:10.17705/1cais.04017 · Cited by 127
“Still, researchers such as Ahmed and Sil (2012) have contested this justification for multi-method research.”
A Unifying Framework for Causal Analysis in Set-Theoretic Multimethod Research
Rohlfing, I., & Schneider, C. Q. (2018) · Sociological Methods & Research · doi:10.1177/0049124115626170 · Cited by 98
Mahoney, J., & Owen, A. (2022) · Quality & Quantity · doi:10.1007/s11135-021-01188-6 · Cited by 4
Metadata
- Authors
- Ahmed, A., & Sil, R.
- Venue
- Perspectives on Politics
- Publisher
- Cambridge University Press (CUP)
- Published
- 2012-12
- Volume
- 10
- Issue
- 4
- Pages
- 935-953
- ISSN
- 1537-5927 (ISSN-L)
- 1541-0986
- OpenAlex
- W2116268797
- Cited by
- 85
- References
- 16
- FWCI
- 13.75
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: When Multi-Method Research Subverts Methodological Pluralism—or, Why We Still Need Single-Method Research. https://app.cochat.ai/papers/10.1017/s1537592712002836
- The paper
- Ahmed, A., & Sil, R. (2012). When Multi-Method Research Subverts Methodological Pluralism—or, Why We Still Need Single-Method Research. Perspectives on Politics. https://doi.org/10.1017/s1537592712002836
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.