CoChat

Making contribution analysis work: A practical framework for handling influencing factors and alternative explanations

The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.

Abstract

This article examines the methodological strengths and weaknesses of contribution analysis. The authors contend that a salient characteristic of contribution analysis is its accounting for influencing factors and alternative explanations. We argue that contribution analysis in its current form needs further methodological and practical elaboration in this respect. Therefore, this article pays particular attention to how the methodology can identify and determine the extent of influencing factors and alternative explanations. The authors propose a corresponding framework – the Relevant Explanation Finder – which can help evaluators account for these elements and thereby create more credible contribution stories.

Overview

Integrity signals

Registry

Crossref · 10.1177/1356389012450654

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 28 references

Research works printed but not linked: 4

  1. Coffman J, 2010, Evaluation Exchange, 2
  2. Lipsky M, 1980, Street-Level Bureaucrats: The Dilemmas of the Individual in Public Services
  3. Pawson R, 1997, Realistic Evaluation
  4. Winter S, 2003, Paper presented at the Annual Meeting of the Association for Policy Analysis and Management held in Washington, DC

Cited by

See all 86

Metadata

Authors
Lemire, S. T., Nielsen, S. B., & Dybdal, L.
Affiliations
Ramboll (Denmark) (DK)
Venue
Evaluation
Published
2012-07
Volume
18
Issue
3
Pages
294-309
ISSN
  • 1356-3890 (ISSN-L)
  • 1461-7153
OpenAlex
W2141370077
Cited by
66
References
28
Citations by year
2026: 2 · 2025: 4 · 2024: 7 · 2023: 4 · 2022: 6 · 2021: 4 · 2020: 1 · 2019: 5 · 2018: 3 · 2017: 5 · 2016: 5 · 2015: 8 · 2014: 9 · 2013: 2 · 2012: 1
FWCI
8.48
Type
journal article
Language
en
Open access
closed
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
Evaluation (publishedVersion)
Topics
  • Social Sciences › Public Administration › Evaluation and Performance Assessment
  • Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
  • Social Sciences › Sociology and Political Science › Qualitative Comparative Analysis Research
Keywords
contribution analysis, influencing factors, alternative explanations, evaluation methodology, evaluation credibility, program evaluation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Making contribution analysis work: A practical framework for handling influencing factors and alternative explanations. https://app.cochat.ai/papers/10.1177/1356389012450654
The paper
Lemire, S. T., Nielsen, S. B., & Dybdal, L. (2012). Making contribution analysis work: A practical framework for handling influencing factors and alternative explanations. Evaluation. https://doi.org/10.1177/1356389012450654

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.