Applying Qualitative Comparative Analysis (QCA) to evaluate a public health policy initiative in the North East of England
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
This paper presents a Qualitative Comparative Analysis (QCA) analysis of data produced as part of the evaluation a Nation Health Service commissioned intervention in the North East of England. QCA is a case-oriented method that allows systematic comparison of cases as configurations of set memberships based on their attributes and the relationship of these to particular outcomes. QCA provides an alternative to conventional quantitative approaches which are generally concerned with isolating the independent effect of one variable whilst controlling the influence of others. Instead, QCA allows for interactions between multiple attributes and recognises that the same outcomes may be generated by different configurations of attributes. The intervention evaluated provided case management for individuals who were out of work due to ill health, and had been for three years or more. It aimed to improve the health of individuals and move them closer to the labour market. The intervention and a comparison group were assessed at base line (T1), after 3 months — (T2) after 6 months (end of the intervention — T3) and after 9 months (three months post intervention — T4). The size of the respective populations at each time point were, Intervention group at T1, N = 131, T2, N = 44, T3, N = 79, T4, N = 95. Comparison group at T1, N = 229, T2, N = 188, T3, N = 166, T4, N = 154. General health was measured using EQ5-D (a standardised instrument for use as a measure of general health outcome) and SF-8. Two condition specific measures were included: the Hospital Anxiety and Depression Scale (HADS) and the Nordic Musculoskeletal questionnaire. Data was also collected on socio demographics (gender, age, housing tenure), social capital (contact with family and friends and participation with the wider community), and work history (previous jobs, time spent in the job, time spent on sickness absence). The aim of the QCA analysis was to identify whether individuals with certain characteristics or combinations of characteristics benefited from the intervention. In order to do this the cases were sorted according to whether their EQ-5D VAS (Visual Analogue Scale) scores (a self rated measure of general health) narrowed or did not narrow towards the population norm for the measure between baseline (T1) and (T4) 9 months (three months post intervention — T4). Cases which narrowed towards the UK population norm of 82.48 were judged to be experiencing a health improvement whilst those whose scores did not narrow towards the norm were judged to not have experienced a health improvement. A crisp set (cs) QCA analysis was then performed. The paper assesses the benefits of using QCA, and asks whether it can provide a viable and practical tool for social policy evaluations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Designing Social Inquiry: Scientific Inference in Qualitative Research
King, G., Keohane, R. O., & Verba, S. (1994) · Princeton University Press · doi:10.1515/9781400821211 · Cited by 7,225
Configurational Comparative Methods: Qualitative Comparative Analysis (QCA) and Related Techniques
Rihoux, B., & Ragin, C. (2009) · SAGE Publications · doi:10.4135/9781452226569 · Cited by 3,089
The Comparative Method: Moving Beyond Qualitative and Quantitative Strategies
Ragin, C. C. (2014) · doi:10.1525/9780520957350 · Cited by 2,130
Set Relations in Social Research: Evaluating Their Consistency and Coverage
Ragin, C. C. (2006) · Political Analysis · doi:10.1093/pan/mpj019 · Cited by 1,784 · cited 1×
“QCA has been developed by Ragin (1987, 2000, 2006a, 2006b) and applied by growing groups of methodologists and/ Box 1.”
MethodAn Introduction to Crisp Set QCA, with a Comparison to Binary Logistic Regression
Grofman, B., & Schneider, C. Q. (2009) · Political Research Quarterly · doi:10.1177/1065912909338464 · Cited by 192
The Limitations of Net-Effects Thinking
Ragin, C. C. (2006) · Innovative Comparative Methods for Policy Analysis · doi:10.1007/0-387-28829-5_2 · Cited by 103
Addressing the Critiques of QCA
Meur, G. D., Rihoux, B., & Yamasaki, S. (2009) · Configurational Comparative Methods: Qualitative Comparative Analysis (QCA) and Related Techniques · doi:10.4135/9781452226569.n7 · Cited by 89
Cited by
Craig, P., Katikireddi, S. V., Leyland, A., & Popham, F. (2017) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031816-044327 · Cited by 570
Hanckel, B., Petticrew, M., Thomas, J., & Green, J. (2021) · BMC Public Health · doi:10.1186/s12889-021-10926-2 · Cited by 147
“The two larger N (> 100 cases) studies in our sample were an individual level analysis of survey data [46, 47] and an analysis of intervention arms from a systematic review [50].”
QCA is of questionable value for policy research
Tanner, S. (2014) · Policy and Society · doi:10.1016/j.polsoc.2014.08.003 · Cited by 16
Hanckel, B., Petticrew, M., Thomas, J., & Green, J. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1159-5 · Cited by 10
Metadata
- Authors
- Warren, J., Wistow, J., & Bambra, C.
- Venue
- Policy and Society
- Publisher
- Oxford University Press (OUP)
- Published
- 2013-12-01
- Volume
- 32
- Issue
- 4
- Pages
- 289-301
- ISSN
- 1449-4035 (ISSN-L)
- 1839-3373
- OpenAlex
- W2020478223
- Cited by
- 38
- References
- 7
- FWCI
- 8.24
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Applying Qualitative Comparative Analysis (QCA) to evaluate a public health policy initiative in the North East of England. https://app.cochat.ai/papers/10.1016/j.polsoc.2013.10.002
- The paper
- Warren, J., Wistow, J., & Bambra, C. (2013). Applying Qualitative Comparative Analysis (QCA) to evaluate a public health policy initiative in the North East of England. Policy and Society. https://doi.org/10.1016/j.polsoc.2013.10.002
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.