Making contribution analysis work: A practical framework for handling influencing factors and alternative explanations
The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
This article examines the methodological strengths and weaknesses of contribution analysis. The authors contend that a salient characteristic of contribution analysis is its accounting for influencing factors and alternative explanations. We argue that contribution analysis in its current form needs further methodological and practical elaboration in this respect. Therefore, this article pays particular attention to how the methodology can identify and determine the extent of influencing factors and alternative explanations. The authors propose a corresponding framework – the Relevant Explanation Finder – which can help evaluators account for these elements and thereby create more credible contribution stories.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Certainty was assessed by the degree of alignment between evidence and programme theory (Lemire et al., 2012).”
From Promoting positive youth development with adolescent boys in UK schools: A theory-driven evaluation of the "Becoming a Man" programme (2026) · cites this paper as Lemire et al., 2012
Citations
Cites
(1984) · Cited by 81,983
Case Study Research: Design and Methods
Chaiklin, H. (1991) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199102000-00025 · Cited by 39,535
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · An Integrated Approach to Communication Theory and Research · doi:10.4324/9780203710753-35 · Cited by 37,322
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 13,723
Durlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304
(2005) · Cited by 3,748
Social Mechanisms: An Analytical Approach to Social Theory
(1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511663901 · Cited by 1,762
Dusenbury, L. (2003) · Health Education Research · doi:10.1093/her/18.2.237 · Cited by 1,671
Guide to Methods for Students of Political Science
Van Evera, S. (2016) · Cornell University Press eBooks · doi:10.7591/9780801454455 · Cited by 1,374
Realist synthesis - an introduction
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2004) · UCL Discovery (University College London) · Cited by 893
Research works printed but not linked: 4
- Coffman J, 2010, Evaluation Exchange, 2
- Lipsky M, 1980, Street-Level Bureaucrats: The Dilemmas of the Individual in Public Services
- Pawson R, 1997, Realistic Evaluation
- Winter S, 2003, Paper presented at the Annual Meeting of the Association for Policy Analysis and Management held in Washington, DC
Cited by
Progressing research impact assessment: A ‘contributions’ approach
Morton, S. (2015) · Research Evaluation · doi:10.1093/reseval/rvv016 · Cited by 265
Statistical matching for conservation science
Schleicher, J., Eklund, J., D. Barnes, M., Geldmann, J., Oldekop, J. A., & Jones, J. P. G. (2020) · Conservation Biology · doi:10.1111/cobi.13448 · Cited by 229
“Process tracing, realist evaluation, assessment of exceptional responders, and contribution analyses are all suited for exploring the mechanisms by which an intervention led to an outcome (Collier 2011; Lemire et al. 2012; Westhorp 2014; Meyfroidt 2016; Post & Geldmann 2018).”
BackgroundJoly, P.-B., Gaunand, A., Colinet, L., Larédo, P., Lemarié, S., & Matt, M. (2015) · Research Evaluation · doi:10.1093/reseval/rvv015 · Cited by 159
“Contribution analysis (Mayne 2001) is a liberating approach that raises original analytical and strategic questions related to the credibility of the contribution story (Lemire et al. 2012), typical productive configurations, and the mechanisms at stake.”
BackgroundShankardass, K., Renahy, É., Muntaner, C., & O'Campo, P. J. (2014) · Health Policy and Planning · doi:10.1093/heapol/czu021 · Cited by 125
“…has been the absence of suitable rigorous research methods for studying and synthesizing evidence about mechanisms-in-context for implementing macro-social health interventions at multiple levels of government (e.g. national, regional and municipal) (Kaufman and Hernan 2012; Lemire et al. 2012).”
BackgroundMethodApplying contribution analysis: Lessons from five years of practice
Delahais, T., & Toulemonde, J. (2012) · Evaluation · doi:10.1177/1356389012450810 · Cited by 125
Metadata
- Authors
- Lemire, S. T., Nielsen, S. B., & Dybdal, L.
- Affiliations
- Ramboll (Denmark) (DK)
- Venue
- Evaluation
- Publisher
- SAGE Publications
- Published
- 2012-07
- Volume
- 18
- Issue
- 3
- Pages
- 294-309
- ISSN
- 1356-3890 (ISSN-L)
- 1461-7153
- OpenAlex
- W2141370077
- Cited by
- 66
- References
- 28
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 7 · 2023: 4 · 2022: 6 · 2021: 4 · 2020: 1 · 2019: 5 · 2018: 3 · 2017: 5 · 2016: 5 · 2015: 8 · 2014: 9 · 2013: 2 · 2012: 1
- FWCI
- 8.48
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Evaluation (publishedVersion)
- Topics
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Sociology and Political Science › Qualitative Comparative Analysis Research
- Keywords
- contribution analysis, influencing factors, alternative explanations, evaluation methodology, evaluation credibility, program evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Making contribution analysis work: A practical framework for handling influencing factors and alternative explanations. https://app.cochat.ai/papers/10.1177/1356389012450654
- The paper
- Lemire, S. T., Nielsen, S. B., & Dybdal, L. (2012). Making contribution analysis work: A practical framework for handling influencing factors and alternative explanations. Evaluation. https://doi.org/10.1177/1356389012450654
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.