Qualitative Comparative Analysis: A Mixed-Method Tool for Complex Implementation Questions
Abstract
The translation and scale-up of evidence-based programs require new methods to guide implementation decisions across varying contexts. As programs are translated to real-world settings, variability is introduced. Some program components may have minor roles to play in producing positive outcomes, and some may have major roles, but only if adapted to meet different contextual demands. While some sources of variability are likely to improve program outcomes, we currently lack methods that allow us to determine the critical components or combinations of components that serve as causal pathways to a desired outcome and then to advise practitioners accordingly. In this paper, we introduce a promising tool for this purpose and illustrate its use in a translational research context. Qualitative Comparative Analysis (QCA) is often used to examine causality in situations that have complex, multiply-determined outcomes. The basic premise of QCA is that different sets of causal conditions, or causal pathways, may lead to a single outcome (the principle of equifinality). We applied QCA to a selection of the highest- and lowest-performing programs from a multi-year two-state dissemination of The Strengthening Families Program for Parents and Adolescents 10-14 to determine which components or combinations of components at the implementation, program delivery, and participant levels produced desired participant outcomes. In particular, we examined which components were necessary (i.e., in the absence of these factors, the outcome didnot occur), and which were sufficient (i.e., in the presence of these factors, the outcome always occurred). Results demonstrated that certain conditions were necessary for program success. In addition, given those necessary conditions, there were two sets of conditions sufficient to produce success, regardless of the presence or absence of any of the others. QCA, not previously used in prevention science research, helps to illuminate causal pathways, leading to concrete, evidence-based implementation decisions that facilitate generalization and scale-up.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Crisp-set QCA can improve interpretation and provide clearer practice implications.
“as noted by several implementation researchers, crisp-set QCA can improve interpretation and provide clearer practice implications [33, 40].”
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · see citing works
Durlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304 · see citing works
Making sense of implementation theories, models and frameworks
Nilsen, P. (2015) · Implementation Science · doi:10.1186/s13012-015-0242-0 · Cited by 4,447 · see citing works
Configurational Comparative Methods: Qualitative Comparative Analysis (QCA) and Related Techniques
Rihoux, B., & Ragin, C. (2009) · SAGE Publications · doi:10.4135/9781452226569 · Cited by 3,089 · see citing works
Bridging Research and Practice
Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.05.024 · Cited by 1,386 · see citing works
Putting the Pieces Together: An Integrated Model of Program Implementation
Berkel, C., Mauricio, A. M., Schoenfelder, E. N., & Sandler, I. N. (2010) · Prevention Science · doi:10.1007/s11121-010-0186-1 · Cited by 532 · see citing works
Qualitative Comparative Analysis (QCA) as an Approach
Berg‐Schlosser, D., Meur, G. D., Rihoux, B., & Ragin, C. C. (2009) · Sage eBooks · doi:10.4135/9781452226569.n1 · Cited by 479 · see citing works
Rihoux, B. (2006) · International Sociology · doi:10.1177/0268580906067836 · Cited by 461 · see citing works
Longer‐term primary prevention for alcohol misuse in young people: a systematic review
Foxcroft, D. R., Ireland, D., Lister‐Sharp, D. J., Lowe, G., & Breen, R. (2003) · Addiction · doi:10.1046/j.1360-0443.2003.00355.x · Cited by 433 · see citing works
Spoth, R. L., Redmond, C. R., & Shin, C. (2001) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.69.4.627 · Cited by 377 · see citing works
Roberson, L. L., Aneni, E. C., Maziak, W., Agatston, A. S., Feldman, T., Rouseff, M., Tran, T. H., Blaha, M. J., Santos, R. D., Sposito, A. C., et al. (2014) · BMC Public Health · doi:10.1186/1471-2458-14-14 · Cited by 305 · see citing works
Spoth, R. L., Redmond, C. R., & Shin, C. (2001) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.69.4.627 · Cited by 290 · see citing works
Schneider, C. Q., & Wagemann, C. (2006) · European Journal of Political Research · doi:10.1111/j.1475-6765.2006.00635.x · Cited by 276 · see citing works
Examining Adaptations of Evidence-Based Programs in Natural Contexts
Moore, J. E., Bumbarger, B. K., & Cooper, B. R. (2013) · The Journal of Primary Prevention · doi:10.1007/s10935-013-0303-6 · Cited by 250 · see citing works
Self-citationOften Trusted but Never (Properly) Tested: Evaluating Qualitative Comparative Analysis
Baumgartner, M., & Thiem, A. (2020) · Sociological Methods & Research · doi:10.1177/0049124117701487 · Cited by 193 · see citing works
Hamre, B. K., Justice, L. M., Pianta, R. C., Kilday, C. R., Sweeney, B. D., Downer, J. T., & Leach, A. (2009) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2009.07.002 · Cited by 171 · see citing works
Spoth, R. L., Trudeau, L., Guyll, M., Shin, C., & Redmond, C. R. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0016029 · Cited by 139 · see citing works
Lillehoj, C. J., Griffin, K. W., & Spoth, R. L. (2004) · Health Education & Behavior · doi:10.1177/1090198103260514 · Cited by 128 · see citing works
Using qualitative comparative analysis to understand and quantify translation and implementation
Kane, H., Lewis, M. A., Williams, P. A., & Kahwati, L. C. (2014) · Translational Behavioral Medicine · doi:10.1007/s13142-014-0251-6 · Cited by 124 · see citing works
A Focused Approach to Assessing Program Fidelity
Hill, L. G., Maucione, K., & Hood, B. (2006) · Prevention Science · doi:10.1007/s11121-006-0051-4 · Cited by 120 · see citing works
Self-citationQualitative Comparative Analysis
Cragun, D. L., Pal, T., Vadaparampil, S. T., Baldwin, J. A., Hampel, H., & DeBate, R. D. (2015) · Journal of Mixed Methods Research · doi:10.1177/1558689815572023 · Cited by 118 · see citing works
Redmond, C. R., Spoth, R. L., Shin, C., & Lepper, H. S. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.67.6.975 · Cited by 110 · see citing works
Best Practices in the Veterans Health Administration's MOVE! Weight Management Program
Kahwati, L. C., Lewis, M. A., Kane, H., Williams-Piehota, P. A., Nerz, P., Jones, K. R., Lance, T., Vaisey, S., & Kinsinger, L. (2011) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2011.06.047 · Cited by 86 · see citing works
Redmond, C. R., Spoth, R. L., Shin, C., et al. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.67.6.975 · Cited by 74 · see citing works
Adaptations in a Community-Based Family Intervention: Replication of Two Coding Schemes
Cooper, B. R., Shrestha, G., Hyman, L., & Hill, L. (2016) · The Journal of Primary Prevention · doi:10.1007/s10935-015-0413-4 · Cited by 62 · see citing works
Self-citationEvaluation of a Swedish version of the Strengthening Families Programme
Skarstrand, E., Sundell, K., & Andreasson, S. (2014) · The European Journal of Public Health · doi:10.1093/eurpub/ckt146 · Cited by 61 · see citing works
Warren, J., Wistow, J., & Bambra, C. L. (2013) · Journal of Public Health · doi:10.1093/pubmed/fdt047 · Cited by 49 · see citing works
Zvoch, K. (2012) · American Journal of Evaluation · doi:10.1177/1098214012452715 · Cited by 48 · see citing works
Pettigrew, J., Miller-Day, M. A., Shin, Y., Hecht, M. L., Krieger, J. L. R., & Graham, J. A. (2012) · American Journal of Community Psychology · doi:10.1007/s10464-012-9539-1 · Cited by 46 · see citing works
Hansen, W. B., Pankratz, M. M., Dusenbury, L., Giles, S. M., Bishop, D. C., Albritton, J., Albritton, L. P., & Strack, J. (2013) · Health Education · doi:10.1108/09654281311329268 · Cited by 45 · see citing works
Interaction of Theory and Practice to Assess External Validity
Leviton, L. C., & Trujillo, M. D. (2017) · Evaluation Review · doi:10.1177/0193841x15625289 · Cited by 35 · see citing works
Cultural Adaptation of the Strengthening Families Program 10–14 to Italian Families
Ortega, E., Giannotta, F., Latina, D., & Ciairano, S. (2012) · Child & Youth Care Forum · doi:10.1007/s10566-011-9170-6 · Cited by 34 · see citing works
Goncy, E. A., Sutherland, K. S., Farrell, A. D., Sullivan, T. N., & Doyle, S. T. (2014) · Prevention Science · doi:10.1007/s11121-014-0508-9 · Cited by 30 · see citing works
Trudeau, L., Spoth, R. L., Mason, W. A., Randall, G. K., Redmond, C. R., & Schainker, L. M. (2015) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-015-9995-9 · Cited by 26 · see citing works
Selection Effects and Prevention Program Outcomes
Hill, L. G., Rosenman, R., Tennekoon, V., & Mandal, B. (2013) · Prevention Science · doi:10.1007/s11121-012-0342-x · Cited by 24 · see citing works
Self-citationCrowley, D. M., Coffman, D. L., Feinberg, M. E., Greenberg, M. T., & Spoth, R. L. (2013) · Prevention Science · doi:10.1007/s11121-012-0352-8 · Cited by 24 · see citing works
Component analysis of adherence in a family intervention
Hill, L. G., & Owens, R. W. (2013) · Health Education · doi:10.1108/09654281311329222 · Cited by 22 · see citing works
Self-citationThe Effects of Teacher Fidelity of Implementation of Pathways to Health on Student Outcomes
Little, M. A., Riggs, N. R., Shin, H.-S., Tate, E. B., & Pentz, M. A. (2013) · Evaluation & the Health Professions · doi:10.1177/0163278713489879 · Cited by 21 · see citing works
Understanding the art and science of implementation in the SAAF efficacy trial
Berkel, C., Murry, V. M., Roulston, K., & Brody, G. H. (2013) · Health Education · doi:10.1108/09654281311329240 · Cited by 19 · see citing works
Cantu, A., Hill, L., & Becker, L. (2010) · Journal of Children's Services · doi:10.5042/jcs.2010.0692 · Cited by 18 · see citing works
Self-citationSegrott, J., Gillespie, D., Holliday, J., Humphreys, I., Murphy, S., Phillips, C. J., Reed, H., Rothwell, H., FOXCROFT, D. R., Hood, K., et al. (2014) · BMC Public Health · doi:10.1186/1471-2458-14-49 · Cited by 17 · see citing works
Vaisey, S. (2014) · Sociological Methodology · doi:10.1177/0081175014542083 · Cited by 16 · see citing works
The realisation of a European health information system--time to get the politicians involved
Rosenkötter, N., Brand, H., McKee, M., Riley, N., Verma, A., & Verschuuren, M. (2014) · European Journal of Public Health · doi:10.1093/eurpub/cku012 · Cited by 8 · see citing works
Roulette, J. W., Hill, L. G., Diversi, M., & Overath, R. (2016) · Health Education Journal · doi:10.1177/0017896916654726 · Cited by 6 · see citing works
Self-citationConfigurational comparative methods : qualitative comparativeanalysis (QCA) and related techniques
Rihoux, B., & Ragin, C. C. (2009) · Cited by 5 · see citing works
Assessing the Scale-Up of a Weight Loss Program
Green, B. B., & Estabrooks, P. A. (2011) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2011.08.002 · Cited by 3 · see citing works
Segrott, J., Rothwell, H., Murphy, S., Morgan‐Trimmer, S., Scourfield, J., Holliday, J., Thomas, C., Gillespie, D., Roberts, Z., FOXCROFT, D. R., et al. (2014) · European Journal of Public Health · doi:10.1093/eurpub/cku163.072 · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Petrik, A. F., Green, B. B., Schneider, J. L., Miech, E. J., Coury, J., Retecki, S., & Coronado, G. D. (2020) · Journal of General Internal Medicine · doi:10.1007/s11606-020-06186-2 · Cited by 69 · see citing works
Tools for assessing the scalability of innovations in health: a systematic review
Charif, A. B., Zomahoun, H. T. V., Gogovor, A., Samri, M. A., Massougbodji, J., Wolfenden, L., Ploeg, J., Zwarenstein, M., Milat, A., Rhéault, N., et al. (2022) · Health Research Policy and Systems · doi:10.1186/s12961-022-00830-5 · Cited by 71 · see citing works
Chen, G., Chen, P., Wang, Y., & Zhu, N. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2023.2251038 · Cited by 41 · see citing works
Tuckey, A., Harmáčková, Z. V., Peterson, G., Norström, A. V., Moore, M., Olsson, P., Lam, D. P. M., & Jiménez-Aceituno, A. (2023) · Ecology and Society · doi:10.5751/es-14163-280227 · Cited by 33 · see citing works
Coumoundouros, C., Mårtensson, E., Ferraris, G., Zuidberg, J. M., von Essén, L., Sanderman, R., & Woodford, J. (2022) · JMIR Mental Health · doi:10.2196/41891 · Cited by 20 · see citing works
En Route to Implementation Science 3.0
Albers, B., Shlonsky, A., & Mildon, R. L. (2020) · Springer eBooks · doi:10.1007/978-3-030-03874-8_1 · Cited by 15 · see citing works
What complex factors influence sleep quality in college students? PLS-SEM vs. fsQCA
Ying, W., Dai, X., Zhu, J., Xu, Z., Lou, J.-Y., & Chen, K. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1185896 · Cited by 17 · see citing works
Beyond effectiveness of the Strengthening Families Program (10-14): a scoping RE-AIM-based review
Pinheiro-Carozzo, N. P., Murta, S. G., Vinha, L. G. D. A., da Silva, I. M., & Fontaine, A. M. (2021) · Psicologia Reflexão e Crítica · doi:10.1186/s41155-021-00182-z · Cited by 9 · see citing works
Coumoundouros, C., von Essén, L., Sanderman, R., & Woodford, J. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-035406 · Cited by 10 · see citing works
Cooper, B. R., Hill, L. G., Parker, L., Jenkins, G. J., Shrestha, G., & Funaiole, A. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00303-4 · Cited by 7 · see citing works
“We analyzed survey data collected from staff at SFP 10-14 implementation sites using crisp-set Qualitative Comparative Analysis (QCA), which assesses the quantitative associations between configurations of conditions and the presence or absence of an outcome [33].”
BackgroundMethodInfluentialSelf-citationHutto, B., Saunders, R. P., Wilcox, S., Jake‐Schoffman, D. E., Bernhart, J. A., Dunn, C. G., Kaczynski, A. T., & James, K. L. (2021) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2021.101941 · Cited by 8 · see citing works
Piotrowski, A., Coenen, J., Rupietta, C., Basten, J., Muth, C., Söling, S., Zimmer, V., Karbach, U., Kellermann-Mühlhoff, P., Köberlein–Neu, J., et al. (2023) · BMC Health Services Research · doi:10.1186/s12913-023-10156-9 · Cited by 8 · see citing works
Quan, L., Zhang, Y., Jiang, F., Liu, Y., Lan, Y., & Huang, L. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.929683 · Cited by 8 · see citing works
Media Review: Qualitative Comparative Analysis in Mixed Methods Research and Evaluation
Doering, E. L., & Cooper, B. R. (2022) · Journal of Mixed Methods Research · doi:10.1177/15586898221125636 · Cited by 6 · see citing works
Self-citationVelástegui, P. G. (2024) · Sociology Compass · doi:10.1111/soc4.70021 · Cited by 4 · see citing works
Jenkins, G. J., Cooper, B. R., Funaiole, A., & Hill, L. G. (2022) · Implementation Research and Practice · doi:10.1177/26334895221112694 · Cited by 5 · see citing works
Self-citationCooper, B. R., Skinner, M. L., Haggerty, K. P., Hill, C. M., Jenkins, G. J., Bumpus, M. F., & Hill, L. G. (2024) · Journal of Prevention and Health Promotion · doi:10.1177/26320770231209414 · Cited by 3 · see citing works
Self-citationMixed-Methods Evaluation in Dissemination and Implementation Science
Palinkas, L. A., Cooper, B. R., Leon, J. D., & Salinas, E. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197660690.003.0018 · Cited by 2 · see citing works
Self-citationWang, Y., Liu, Y., Chai, Y., Chen, K., Yang, S., Feng, X., Li, W., & Mi, Y. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1429006 · Cited by 2 · see citing works
Li, P., Deng, Z., Guo, Y., Gao, R., & Luo, P. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.120561 · Cited by 3 · see citing works
Weybright, E. H., Hampilos, K. E., Pascoe, K. M., Cooper, B. R., & Grinstead, C. (2025) · Global Implementation Research and Applications · doi:10.1007/s43477-025-00158-6 · Cited by 1 · see citing works
Self-citationfsQCA for discovering social emotional pathways to adult STEM engagement
Wasserman, D. L., Altman, J. T., Klein, C., Mohabir, P., & Tisdal, C. (2025) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2025.101767
Kim, J. J., & MacKinnon, D. P. (2025) · Prevention Science · doi:10.1007/s11121-025-01836-5
Piotrowski, A., Coenen, J., Rupietta, C., Basten, J., Muth, C., Söling, S., Zimmer, V., Karbach, U., Kellermann-Mühlhoff, P., & Köberlein-Neu, J. (2023) · Figshare · doi:10.6084/m9.figshare.24447556
Piotrowski, A., Coenen, J., Rupietta, C., Basten, J., Muth, C., Söling, S., Zimmer, V., Karbach, U., Kellermann-Mühlhoff, P., & Köberlein-Neu, J. (2024) · Figshare · doi:10.6084/m9.figshare.26632729
Piotrowski, A., Coenen, J., Rupietta, C., Basten, J., Muth, C., Söling, S., Zimmer, V., Karbach, U., Kellermann-Mühlhoff, P., & Köberlein-Neu, J. (2024) · Figshare · doi:10.6084/m9.figshare.26632732
Piotrowski, A., Coenen, J., Rupietta, C., Basten, J., Muth, C., Söling, S., Zimmer, V., Karbach, U., Kellermann-Mühlhoff, P., & Köberlein-Neu, J. (2024) · Figshare · doi:10.6084/m9.figshare.26632738
Piotrowski, A., Coenen, J., Rupietta, C., Basten, J., Muth, C., Söling, S., Zimmer, V., Karbach, U., Kellermann-Mühlhoff, P., & Köberlein-Neu, J. (2024) · Figshare · doi:10.6084/m9.figshare.24447652
Piotrowski, A., Coenen, J., Rupietta, C., Basten, J., Muth, C., Söling, S., Zimmer, V., Karbach, U., Kellermann-Mühlhoff, P., & Köberlein-Neu, J. (2024) · Figshare · doi:10.6084/m9.figshare.26632735
Michaelian, S., Williams, C. R., Bogdewic, S., Owen, M. D., Ashinyo, M. E., Srofenyoh, E., Deganus, S. A., Tetteh, C., Boamah, M. O., Brew, G., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-9441598/v1
Solomon, S. R., Abaya, R., Kaplan, K. C., & Davey-Rothwell, M. A. (2026) · Implementation Research and Practice · doi:10.1177/26334895261450993
Household structures and exposure networks among people with multidrug-resistant TB in Namibia
Iipumbu, E., Hoddinott, G., Seddon, J. A., Shavuka, O., de Boois, L., Shinedima, N., Haimbala, V., Absalom, L., Shiweva, L., Ekandjo, H., et al. (2026) · IJTLD OPEN · doi:10.5588/ijtldopen.26.0039
- Authors
- Hill, L. G., Cooper, B. R., & Parker, L. A.
- Affiliations
- Washington State University (US)
- Corresponding author
- Hill, Laura G.
- Venue
- The Journal of Primary Prevention
- Published
- 2019-01-22
- Volume
- 40
- Issue
- 1
- Pages
- 69-87
- ISSN
- 0278-095X (ISSN-L)
- 1573-6547
- OpenAlex
- W2913090087
- Cited by
- 33
- References
- 46
- Citations by year
- 2026: 3 · 2025: 4 · 2024: 8 · 2023: 7 · 2022: 6 · 2021: 2 · 2020: 3
- FWCI
- 5.52
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- The Journal of Primary Prevention (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Qualitative Comparative Analysis Research
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
- Keywords
- qualitative comparative analysis, program implementation, evidence-based programs, scale-up, causal pathways, equifinality, necessary and sufficient conditions, family-based prevention, program components, prevention science
- MeSH terms
- Implementation Science, Adolescent, Female, Humans, Male, Parent-Child Relations, Research Design, United States, Qualitative Research, Evidence-Based Practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review