Future of evidence ecosystem series: 2. current opportunities and need for better tools and methods
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
To become user driven and more useful for decision-making, the current evidence synthesis ecosystem requires significant changes (Paper 1. Future of evidence ecosystem series). Reviewers have access to new sources of data (clinical trial registries, protocols, and clinical study reports from regulatory agencies or pharmaceutical companies) for more information on randomized control trials. With all these newly available data, the management of multiple and scattered trial reports is even more challenging. New types of data are also becoming available: individual patient data and routinely collected data. With the increasing number of diverse sources to be searched and the amount of data to be extracted, the process needs to be rethought. New approaches and tools, such as automation technologies and crowdsourcing, should help accelerate the process. The implementation of these new approaches and methods requires a substantial rethinking and redesign of the current evidence synthesis ecosystem. The concept of a "living" evidence synthesis enterprise, with living systematic review and living network meta-analysis, has recently emerged. Such an evidence synthesis ecosystem implies conceptualizing evidence synthesis as a continuous process built around a clinical question of interest and no longer as a small team independently answering a specific clinical question at a single point in time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions
Sterne, J. A., Hernán, M. A., Reeves, B. C., Savović, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., et al. (2016) · BMJ · doi:10.1136/bmj.i4919 · Cited by 20,329
Self-citationBenchimol, E. I., Smeeth, L., Guttmann, A., Harron, K., Moher, D., Petersen, I., Sørensen, H. T., von Elm, E., Langan, S. M., & RECORD Working Committee (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001885 · Cited by 5,749 · cited 2×
“Specific reporting guidelines for reporting these studies using routinely collected data are now available [46], and a specific tool for assessing risk of bias of non-randomized studies of”
BackgroundMethodScalable and accurate deep learning with electronic health records
Rajkomar, A., Oren, E., Chen, K., Dai, A. M., Hajaj, N., Hardt, M., Liu, P. J., Liu, X., Marcus, J., Sun, M., et al. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0029-1 · Cited by 2,648 · cited 1×
“18 these records can be used to create accurate and scalable predictions for a variety of clinical scenarios, including focusing on specific sub-populations [77].”
BackgroundMurad, M. H., Asi, N., Alsawas, M., & Alahdab, F. (2016) · Evidence Based Medicine · doi:10.1136/ebmed-2016-110401 · Cited by 1,388
A scoping review of rapid review methods
Tricco, A. C., Antony, J., Zarin, W., Strifler, L., Ghassemi, M., Ivory, J., Perrier, L., Hutton, B., Moher, D., & Straus, S. E. (2015) · BMC Medicine · doi:10.1186/s12916-015-0465-6 · Cited by 1,146 · cited 1×
“, a form of knowledge synthesis in which components of the systematic review process are simplified or omitted to produce information in a timely manner [45] ─ seems appropriate, whereas an IPD meta-analysis seems preferable for a clinical question for which we want to identify the characteristics of patients respondi…”
BackgroundBoutron, I. (2010) · JAMA · doi:10.1001/jama.2010.651 · Cited by 842
Self-citationThe ClinicalTrials.gov Results Database — Update and Key Issues
Zarin, D. A., Tse, T., Williams, R. J., Califf, R. M., & Ide, N. C. (2011) · New England Journal of Medicine · doi:10.1056/nejmsa1012065 · Cited by 838
O’Mara-Eves, A., Thomas, J., McNaught, J., Miwa, M., & Ananiadou, S. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-5 · Cited by 681 · cited 2×
“Such methods could save 30% to 78% of the workload but miss 4% to 5% of relevant studies [82,86].”
BackgroundLiving systematic review: 1. Introduction-the why, what, when, and how
Elliott, J. H., Synnot, A., Turner, T., Simmonds, M., Akl, E. A., McDonald, S., Salanti, G., Meerpohl, J., MacLehose, H., Hilton, J., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.08.010 · Cited by 655 · cited 1×
“14 RCTs as soon as they are available [60,61].”
BackgroundSelf-citationLiving Systematic Reviews: An Emerging Opportunity to Narrow the Evidence-Practice Gap
Elliott, J. H., Turner, T., Clavisi, O., Thomas, J., Higgins, J. P. T., Mavergames, C., & Gruen, R. L. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001603 · Cited by 596 · cited 2×
“some researchers proposed new methods — living systematic reviews [60] — representing high-quality, up-to-date evidence synthesis, updated several times per year to add all new”
BackgroundMethod
Cited by
Future of Evidence Ecosystem Series: Evidence ecosystems and learning health systems: why bother?
Vandvik, P. O., & Brandt, L. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.02.008 · Cited by 48
Iannizzi, C., Akl, E. A., Anslinger, E., Weibel, S., Kahale, L. A., Aminat, A. M., Piechotta, V., & Skoetz, N. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02396-x · Cited by 31
“…existing structured data sources (e.g., clinical trials registries) [25] How ( N = 6/17) • AI, machine learning, and automated structured data [3, 13, • Crowd-sourcing [13, 26, 27] Quality & bias assessment Frequency ( N = 2/17) • Regular updating, at a defined time interval [3] • Once new…”
BackgroundInfluentialLindsley, K., Fusco, N., Teeuw, H., Mooij, E., Scholten, R., & Hooft, L. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.12.016 · Cited by 14
Metadata
- Authors
- Créquit, P., Boutron, I., Meerpohl, J., Williams, H. C., Craig, J., & Ravaud, P.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2020-07
- Volume
- 123
- Pages
- 143-152
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W3010563038
- Cited by
- 36
- References
- 28
- FWCI
- 3.83
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Future of evidence ecosystem series: 2. current opportunities and need for better tools and methods. https://app.cochat.ai/papers/10.1016/j.jclinepi.2020.01.023
- The paper
- Créquit, P., Boutron, I., Meerpohl, J., Williams, H. C., Craig, J., & Ravaud, P. (2020). Future of evidence ecosystem series: 2. current opportunities and need for better tools and methods. Journal of Clinical Epidemiology. https://doi.org/10.1016/j.jclinepi.2020.01.023
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.