The Integration of Bayesian Regression Analysis and Bayesian Process Tracing in Mixed-Methods Research
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
In this article, we develop a mixed-methods design that combines Bayesian regression with Bayesian process tracing. A fully Bayesian multimethod design allows one to include empirical knowledge at each stage of the analysis and to coherently transfer information from the quantitative to the qualitative analysis, and vice versa. We present a complete mixed-methods workflow explaining how this is accomplished and how to integrate both methods. It is demonstrated how to use the posterior highest density interval and the Bayes factor from the regression analysis to update the prior level of confidence about what mechanisms possibly connect the cause to the outcome. It is further shown how to choose cases for the qualitative analysis through posterior predictive sampling. We illustrate this approach with an empirical analysis of colonial development and compare it with alternative designs, including nested analysis and the Bayesian integration of qualitative and quantitative methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
The colonial origins of comparative development: An empirical investigation
Acemoglu, D., Johnson, S., & Robinson, J. A. (2001) · American Economic Review · doi:10.1257/aer.91.5.1369 · Cited by 8,517 · cited 1×
“29 The reviewed research further indicates that two control variables (see Lange, 2009), latitude (Acemoglu, Johnson, and Robinson, 2001) and ethnic fractionalization (Bernhard, Reenock, and Nordstrom, 2004), have a negative effect on development.”
Case Selection Techniques in Case Study Research: A Menu of Qualitative and Quantitative Options
Seawright, J., & Gerring, J. (2008) · Political Research Quarterly · doi:10.1177/1065912907313077 · Cited by 3,827 · cited 1×
“The fundamental idea is similar to the ideas that motivate the choice of diverse and extreme case (Seawright and Gerring, 2008) We develop this idea further and show how it can be used for single-case hypothesis-testing process tracing.”
Nested Analysis as a Mixed-Method Strategy for Comparative Research
LIEBERMAN, E. S. (2005) · American Political Science Review · doi:10.1017/s0003055405051762 · Cited by 1,515 · cited 9×
“This use of the BF has implications for the distinction between a con fi rma-tory, model-testing small-n analysis (mt-sna) and an exploratory, model-building analysis (mb-sna) that is salient in nested analysis (Lieberman, 2005).”
InfluentialKruschke, J. K., & Liddell, T. M. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1221-4 · Cited by 1,288 · cited 3×
“We show how to use the Bayes factor, representing an element of testing in Bayesian regression (Kruschke and Liddell, 2018), by inferring how much it changes con fi dence that a mechanism is present.”
InfluentialHow to Conduct a Mixed Methods Study: Recent Trends in a Rapidly Growing Literature
Small, M. L. (2011) · Annual Review of Sociology · doi:10.1146/annurev.soc.012809.102657 · Cited by 829 · cited 1×
“This type of mixed-methods design has its origins in political science, but is also relevant for sociology that has a longstanding and rich tradition of mixed-methods research (MMR) (Small, 2011).”
Is There a (Viable) Crucial-Case Method?
Gerring, J. (2007) · Comparative Political Studies · doi:10.1177/0010414006290784 · Cited by 763
Process-Tracing Methods: Foundations and Guidelines
Beach, D., & Pedersen, R. (2019) · University of Michigan Press eBooks · doi:10.3998/mpub.10072208 · Cited by 691
The Mechanismic Worldview: Thinking Inside the Box
GERRING, J. (2008) · British Journal of Political Science · doi:10.1017/s0007123408000082 · Cited by 360
Seawright, J. (2016) · Cambridge University Press · doi:10.1017/cbo9781316160831 · Cited by 338
Colonial legacies and economic growth
Grier, R. M. (1999) · Public Choice · doi:10.1023/a:1018322908007 · Cited by 266
The Legacy of Western Overseas Colonialism on Democratic Survival
Bernhard, M., Reenock, C., & Nordstrom, T. (2004) · International Studies Quarterly · doi:10.1111/j.0020-8833.2004.00298.x · Cited by 237 · cited 2×
“This is indicative of a positive marginal effect of indirect rule because British colonies are consistently described as having been more indirectly ruled (Bernhard, Reenock, and Nordstrom, 2004; Brown, 2000; Grier, 1999: section 2).”
The causal interpretation of estimated associations in regression models
Keele, L., Stevenson, R. T., & Elwert, F. (2020) · Political Science Research and Methods · doi:10.1017/psrm.2019.31 · Cited by 226
Mixing Methods: A Bayesian Approach
HUMPHREYS, M., & JACOBS, A. M. (2015) · American Political Science Review · doi:10.1017/s0003055415000453 · Cited by 198 · cited 1×
“The Bayesian integration of quantitative and qualitative evidence (BIQQ) is an alternative approach that uses cross-case and within-case data (Humphreys and Jacobs, 2015, 2023).”
Lineages of Despotism and Development: British Colonialism and State Power
Lange, M. (2009) · doi:10.7208/chicago/9780226470702.001.0001 · Cited by 197
Explicit Bayesian Analysis for Process Tracing: Guidelines, Opportunities, and Caveats
Fairfield, T., & Charman, A. E. (2017) · Political Analysis · doi:10.1017/pan.2017.14 · Cited by 193
The Case for Selecting Cases That Are Deviant or Extreme on the Independent Variable
Seawright, J. (2016) · Sociological Methods & Research · doi:10.1177/0049124116643556 · Cited by 163
Bayesian Methods: A Social and Behavioral Sciences Approach
Lee, H. K. H. (2008) · The American Statistician · doi:10.1198/000313008x370915 · Cited by 157
Go, J. (2020) · American Journal of Sociology · doi:10.1086/708464 · Cited by 136
Democracy, Colonization, and Human Capital in Sub-Saharan Africa
Brown, D. S. (2000) · Studies in Comparative International Development · doi:10.1007/bf02687449 · Cited by 113
What You See and What You Get: Pitfalls and Principles of Nested Analysis in Comparative Research
Rohlfing, I. (2008) · Comparative Political Studies · doi:10.1177/0010414007308019 · Cited by 112
Self-citationRelationships Among Rivals (RAR): A Framework for Analyzing Contending Hypotheses in Process Tracing
Zaks, S. (2017) · Political Analysis · doi:10.1017/pan.2017.12 · Cited by 91
A Case for Cases: Comparative Narratives in Sociological Explanation
Abell, P. (2009) · Sociological Methods & Research · doi:10.1177/0049124109339372 · Cited by 79
Pathway Analysis and the Search for Causal Mechanisms
Weller, N., & Barnes, J. (2014) · Sociological Methods & Research · doi:10.1177/0049124114544420 · Cited by 71
Social Inquiry and Bayesian Inference: Rethinking Qualitative Research
Fairfield, T., & Charman, A. E. (2022) · Cambridge University Press · doi:10.1017/9781108377522 · Cited by 62
Rohlfing, I., & Zuber, C. I. (2021) · Sociological Methods & Research · doi:10.1177/0049124119826156 · Cited by 53 · cited 1×
“Regardless of the formal-informal dimension, causal inference in process tracing can follow a difference-making perspective or a non-difference-making approach (Rohl fi ng and Zuber, 2021; Runhardt, 2022).”
Self-citationQuantitizing findings from qualitative studies for integration in mixed methods reviewing
van Grootel, L., Nair, L. B., Klugkist, I. G., & van Wesel, F. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1403 · Cited by 51
Concepts and Measurement in Multimethod Research
Ahram, A. I. (2011) · Political Research Quarterly · doi:10.1177/1065912911427453 · Cited by 35
Updating Bayesian(s): A Critical Evaluation of Bayesian Process Tracing
Zaks, S. (2021) · Political Analysis · doi:10.1017/pan.2020.10 · Cited by 24
Building on Solid Ground: Robust Case Selection in Multi‐Method Research
Rohlfing, I., & Starke, P. (2013) · Swiss Political Science Review · doi:10.1111/spsr.12052 · Cited by 21
Self-citationPolitical Inequality in 38 Countries: A Distributional Approach
Somma, N. M., & Bargsted, M. (2018) · Comparative Sociology · doi:10.1163/15691330-12341475 · Cited by 12
Integrated Inferences: Causal Models for Qualitative and Mixed-Method Research
Humphreys, M., & Jacobs, A. M. (2023) · Cambridge University Press · doi:10.1017/9781316718636 · Cited by 12 · cited 1×
“The Bayesian integration of quantitative and qualitative evidence (BIQQ) is an alternative approach that uses cross-case and within-case data (Humphreys and Jacobs, 2015, 2023).”
Hertog, S. (2021) · Sociological Methods & Research · doi:10.1177/0049124120986206 · Cited by 8
Surprising Causes: Propensity-adjusted Treatment Scores for Multimethod Case Selection
Galvin, D. J., & Seawright, J. (2021) · Sociological Methods & Research · doi:10.1177/00491241211004632 · Cited by 4
Cumulative science via Bayesian posterior passing, an introduction.Preprint
Brand, C. O., Ounsley, J., van der Post, D. J., et al. (2017) · doi:10.31235/osf.io/67jh7 · Cited by 3
Behrens, L., & Rohlfing, I. (2024) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.13745066 · Cited by 1
Self-citationBehrens, L., & Rohlfing, I. (2024) · Zenodo · doi:10.5281/zenodo.13745067
Self-citation
Research works printed but not linked: 2
- Jeffreys Harold. 1961. Theory of Probability. 3rd Ed. Oxford: Clarendon Press.
- Runhardt Rosa W. 2022. “Concrete Counterfactual Tests for Process Tracing: Defending an Interventionist Potential Outcomes Framework.” Sociological Methods & Research 53(4): 1592-1628.
Cited by
Methodology mayhem in urban planning research: a call for methodological triangulation
Ogunkan, D. V., & Akinpelu, O. P. (2025) · Quality & Quantity · doi:10.1007/s11135-025-02272-x · Cited by 14
Kerr, R. (2025) · International Journal of Qualitative Methods · doi:10.1177/16094069251394109 · Cited by 1
Metadata
- Authors
- Behrens, L., & Rohlfing, I.
- Affiliations
- Independent Researcher, Frankfurt, Hessen, Germany
- University of Passau (DE)
- Corresponding author
- Rohlfing, Ingo
- Venue
- Sociological Methods & Research
- Publisher
- SAGE Publications
- Published
- 2025-01-23
- Volume
- 55
- Issue
- 1
- Pages
- 186-218
- ISSN
- 0049-1241 (ISSN-L)
- 1552-8294
- OpenAlex
- W4406769145
- Cited by
- 3
- References
- 38
- Citations by year
- 2025: 3
- FWCI
- 5.23
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0/ (vor)
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Sociological Methods & Research (publishedVersion, cc-by)
- Funders
- Deutsche Forschungsgemeinschaft (Sonderforschungsbereich 884 "The Political Economy)
- H2020 European Research Council (ERC StG 638425)
- Topics
- Social Sciences › Sociology and Political Science › Qualitative Comparative Analysis Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Keywords
- Bayesian regression, mixed methods research design, Bayes factor, highest density interval, case selection, causal mechanisms, colonial development, qualitative-quantitative integration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.