CoChat

Online tools supporting the conduct and reporting of systematic reviews and systematic maps: a case study on CADIMA and review of existing tools

Open access

The DOI matches its Crossref record; 35 of the 36 references it cites were found in a registry or an index; 3 of the 18 sources its claims cite were checked for support.

Abstract

Systematic reviews and systematic maps represent powerful tools to identify, collect, evaluate and summarise primary research pertinent to a specific research question or topic in a highly standardised and reproducible manner. Even though they are seen as the “gold standard” when synthesising primary research, systematic reviews and maps are typically resource-intensive and complex activities. Thus, managing the conduct and reporting of such reviews can become a time consuming and challenging task. This paper introduces the open access online tool CADIMA, which was developed through a collaboration between the Julius Kühn-Institut and the Collaboration for Environmental Evidence, in order to increase the efficiency of the evidence synthesis process and facilitate reporting of all activities to maximise methodological rigour. Furthermore, we analyse how CADIMA compares with other available tools by providing a comprehensive summary of existing software designed for the purposes of systematic review management. We show that CADIMA is the only available open access tool that is designed to: (1) assist throughout the systematic review/map process; (2) be suited to reviews broader than medical sciences; (3) allow for offline data extraction; and, (4) support working as a review team.

Overview

CoChat Summary

TL;DR

CADIMA is an open access online tool developed by JKI and CEE to support the conduct and reporting of systematic reviews and systematic maps across disciplines, including offline data extraction and team workflows. A review of 22 existing software packages found CADIMA was the only open access tool designed to assist throughout the review/map process, suit non-medical fields, allow offline data extraction, and support review teams.

Key findings

  • The review identified 24 systematic review software packages; two were excluded (Slrtool discontinued; DRAGON ONLINE developers did not respond), leaving 22 packages analysed. Of these, nine were advertised for any field, nine for healthcare/medical science, three for software engineering, and one for experimental animal studies.
  • Among the 22 packages, 16 were freely available for non-commercial use, six were open source, 15 had web-based functions, seven involved downloadable applications, and 10 supported or planned to support machine learning/text mining features.
  • CADIMA supports protocol development, search-result management, duplicate identification, study selection including a kappa consistency check, on- and offline data extraction, critical appraisal, and documentation/outputs; it excludes built-in literature searching and quantitative synthesis.
  • The paper concludes CADIMA is the only available open access tool designed to assist throughout the systematic review/map process, be suited to reviews broader than medical sciences, allow offline data extraction, and support working as a review team.

Methods

  • Review of existing tools: four search approaches were used—online bibliographic database searches, snowballing via general web searches, screening targeted websites, and backwards/forwards citation searches. Twenty-four packages were identified; two were excluded, and the remaining 22 were researched and trialed by EJM where free access or free trials were available, then characterised by features including stages supported, team suitability, and cost.
  • CADIMA description: CADIMA is a client-server web application coded in PHP V5.5 using the Yii V1.1 framework with Bootstrap CSS, running on Apache 2.4/Linux Ubuntu Server V14.04 with a MySQL 5.5 database, SSL encryption, and daily backups stored for 6 months; it is hosted and maintained by JKI.
  • CADIMA’s menu structure mirrors systematic review/map steps, with two user roles: “review coordinator” and “review team members.”

Limitations

  • Stated: CADIMA does not provide built-in literature searching or quantitative synthesis; duplicates are detectable but cannot be automatically removed in the current version; the same reviewers must participate during title, abstract, and full-text selection stages; the linear structure has so far precluded adjustments to review team membership between screening stages; and selection criteria cannot be changed without de novo performance of the consistency check and loss of previously extracted information.
  • Stated in the review: two identified packages were excluded because one was discontinued and the other’s developers did not respond; where no further information was available, characteristics were marked “Unavailable”; and trialing occurred only where free access or free trials were available.
  • Evident from the text: the review may become outdated quickly, as the paper notes existing reviews of software become out of date and three new or upgraded packages were expected to become live in 2017; comparison also relies partly on advertised or developer-provided information, so feature coverage may be incomplete.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/s13750-018-0115-5

Cites

35 of 35 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

1 Valid · 17 Not valid · 12 Not checked · 94 Own results and interpretations

21 more claims

Create a free account to see all 124 claims and to verify the 15 references still open.

See all claims — free account
  • Probably not a substantial claim. 82
  • It may state two separate claims as one. 38
  • The quote only partly states this claim. 7

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 35 references

Research works printed but not linked: 5

  1. Practice CfRiEB. The systematic review accelerator. Centre for Research in Evidence Based Practice; 2017.
  2. Covidence systematic review software. Melbourne, Australia: Veritas Health Innovation.
  3. Thomas J, Brunton J, Graziosi S. EPPI-reviewer 4: software for research synthesis. EPPI-Centre Software. London: Social Science Research Unit, Institute of Education; 2010.
  4. Review Manager (RevMan) Version 5.3. Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration; 2014.
  5. Systematic Review and Meta-Analysis Facility (Syrf). Edinburgh, UK: CAMARADES-NC3Rs; 2017.

Cited by

See all 522

Metadata

Authors
Kohl, C., McIntosh, E. J., Unger, S., Haddaway, N. R., Kecke, S., Schiemann, J., & Wilhelm, R.
Affiliations
  • Julius Kühn-Institut (DE)
  • University of Oxford (GB)
  • Stockholm Environment Institute (SE)
Corresponding author
Kohl, Christian
Venue
Environmental Evidence
Published
2018-02-01
Volume
7
Issue
1
ISSN
2047-2382 (ISSN-L)
OpenAlex
W2794350945
Cited by
471
References
36
Citations by year
2026: 50 · 2025: 104 · 2024: 98 · 2023: 76 · 2022: 53 · 2021: 45 · 2020: 25 · 2019: 10 · 2018: 10
FWCI
4.78
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Environmental Evidence (publishedVersion, cc-by)
  • ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (acceptedVersion, cc-by-sa)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • OpenAgrar (submittedVersion, cc-by)
Funders
Seventh Framework Programme (Grant Agreement KBBE-2011-6-311957)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
  • Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
Keywords
systematic reviews, systematic map, web-based tool, evidence synthesis, open access software, methodological quality, software comparison

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Online tools supporting the conduct and reporting of systematic reviews and systematic maps: a case study on CADIMA and review of existing tools. https://app.cochat.ai/papers/10.1186/s13750-018-0115-5
The paper
Kohl, C., McIntosh, E. J., Unger, S., Haddaway, N. R., Kecke, S., Schiemann, J., & Wilhelm, R. (2018). Online tools supporting the conduct and reporting of systematic reviews and systematic maps: a case study on CADIMA and review of existing tools. Environmental Evidence. https://doi.org/10.1186/s13750-018-0115-5

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.