What are the barriers and facilitators for third sector organisations (non-profits) to evaluate their services? A systematic review
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The third sector is becoming a more common provider of social and health services, but little is known about how third sector organisations (TSOs) evaluate their activities. Past research has reported that the third sector is under increasing pressure to evaluate its impact and performance by government and other commissioning bodies. However, in responding to this increased pressure to undertake evaluation, research suggests that many TSOs struggle to evaluate their activities following the principles of evidence-based practice (EBP). Yet, there has been no systematic effort to investigate why the third sector is struggling to provide good quality evidence of its effects. METHODS: This systematic review is reported following the PRISMA guidelines. Ten interdisciplinary databases were searched using a search string developed following best practice and in consultation with an information systems expert. Included studies were primary research of any research design investigating barriers to and facilitators of the evaluation process of TSOs as identified by practitioners. All studies were quality appraised, and the results were synthesised as a thematic summary. RESULTS: Twenty-four studies were included, which mainly investigated TSOs working within health and social services. The thematic summary identified the main barriers for TSOs to undertake evaluation to be related to the (1) lack of financial resources, (2) lack of technical capability and evaluation literacy and (3) challenges around identifying relevant evaluation systems and outcome indicators. Key facilitating factors involved (1) getting the appropriate support, (2) having an organisational culture that supports evaluation and (3) the motivation to be accountable to stakeholders. These findings were robust to study quality. CONCLUSIONS: This review constitutes the first systematic effort to synthesise existing literature on factors supporting and preventing evaluation by TSOs. The prevalence of factors revolving around the lack of support, resources and clarity on appropriate outcome indicators suggests that many of the identified challenges may be met by applying evidence-based and stakeholder-inclusive strategies to develop shared evaluation requirements. Future efforts should address the application of EBP as part of the commissioning process of TSOs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evidence based medicine: what it is and what it isn't
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S. (1996) · BMJ · doi:10.1136/bmj.312.7023.71 · Cited by 15,769
Development of a critical appraisal tool to assess the quality of cross-sectional studies (AXIS)
Downes, M. J., Brennan, M. L., Williams, H. C., & Dean, R. S. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011458 · Cited by 2,376 · cited 1×
“To assess the quality of cross-sectional studies, the review employed the recently developed AXIS checklist [41] (see Appendix A in Additional file 3).”
MethodLégaré, F., Ratté, S., Gravel, K., & Graham, I. D. (2008) · Patient Education and Counseling · doi:10.1016/j.pec.2008.07.018 · Cited by 1,321
Psychological Treatments That Cause Harm
Lilienfeld, S. O. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00029.x · Cited by 959
CONSORT for reporting randomised trials in journal and conference abstracts
Hopewell, S., Clarke, M., Moher, D., Wager, E., Middleton, P., Altman, D. G., & Schulz, K. F. (2008) · The Lancet · doi:10.1016/s0140-6736(07)61835-2 · Cited by 458
Cures That Harm: Unanticipated Outcomes of Crime Prevention Programs
McCord, J. (2003) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716202250781 · Cited by 338
Rees, R., Oliver, K., Woodman, J., & Thomas, J. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-188 · Cited by 109
Cited by
Bach-Mortensen, A. M., Lange, B. C. L., & Montgomery, P. (2018) · Implementation Science · doi:10.1186/s13012-018-0789-7 · Cited by 253
Self-citationBach‐Mortensen, A. M., & Verboom, B. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1447 · Cited by 69
“Although there are no established guidelines on how to investigate the robustness of identified factors relating to barriers and facilitators, two reviews applied the method suggested by Rees et al,(30) in which the robustness of identified themes is tested by removing studies of poor quality or by investigating wheth…”
MethodSelf-citationAn Empirical Study on Public Sector versus Third Sector Circular Economy-Oriented Innovations
Clifton, N., Kyaw, K. S., Liu, Z., & Walpole, G. (2024) · Sustainability · doi:10.3390/su16041650 · Cited by 8
Metadata
- Authors
- Bach-Mortensen, A. M., & Montgomery, P.
- Venue
- Systematic Reviews
- Published
- 2018-01-22
- Volume
- 7
- Issue
- 1
- Pages
- 13-13
- ISSN
- 2046-4053 (ISSN-L)
- OpenAlex
- W2791775009
- Cited by
- 105
- References
- 7
- FWCI
- 2.03
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: What are the barriers and facilitators for third sector organisations (non-profits) to evaluate their services? A systematic review. https://app.cochat.ai/papers/10.1186/s13643-018-0681-1
- The paper
- Bach-Mortensen, A. M., & Montgomery, P. (2018). What are the barriers and facilitators for third sector organisations (non-profits) to evaluate their services? A systematic review. Systematic Reviews. https://doi.org/10.1186/s13643-018-0681-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.