SYNERGY - Open machine learning dataset on study selection in systematic reviews
Open accessThe DOI matches its DataCite record.
Abstract
SYNERGY is a free and open dataset on study selection in systematic reviews, comprising 169,288 academic works from 26 systematic reviews. Only 2,834 (1.67%) of the academic works in the binary classified dataset are included in the systematic reviews. This makes the SYNERGY dataset a unique dataset for the development of information retrieval algorithms, especially for sparse labels. Due to the many available variables available per record (i.e. titles, abstracts, authors, references, topics), this dataset is useful for researchers in NLP, machine learning, network analysis, and more. In total, the dataset contains 82,668,134 trainable data points. The easiest way to get the SYNERGY dataset is via the synergy-dataset Python package. See https://github.com/asreview/synergy-dataset for all information.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cited by
Evaluating the effectiveness of large language models in abstract screening: a comparative analysis
Li, M., Sun, J., & Tan, X. (2024) · Systematic Reviews · doi:10.1186/s13643-024-02609-x · Cited by 125
Ferdinands, G., Schram, R., de Bruin, J., Bagheri, A., Oberski, D. L., Tummers, L., Teijema, J. J., & van de Schoot, R. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02257-7 · Cited by 96
Self-citationLarge-scale simulation study of active learning models for systematic reviews
Teijema, J. J., de Bruin, J., Bagheri, A., & van de Schoot, R. (2025) · International Journal of Data Science and Analytics · doi:10.1007/s41060-025-00777-0 · Cited by 13
Self-citationChan, G. C. K., He, E., Leung, J., & Verspoor, K. (2025) · Research Synthesis Methods · doi:10.1017/rsm.2025.1 · Cited by 10
Large-Scale Simulation Study of Active Learning Models for Systematic Reviews
Teijema, J. J., de Bruin, J., Bagheri, A., & van de Schoot, R. (2023) · doi:10.31234/osf.io/2w3rm · Cited by 8
Self-citationUsing Chao’s Estimator as a Stopping Criterion for Technology-Assisted Review
Bron, M., van der Heijden, P. G. M., Feelders, A., & Siebes, A. (2025) · ACM Transactions on Information Systems · doi:10.1145/3724116 · Cited by 7
The hunt for the last relevant paper: blending the best of humans and AI
van de Schoot, R., Messina Coimbra, B., Evenhuis, T., Lombaers, P., Weijdema, F., de Bruin, L., Neeleman, R., Grandfield, E., Sijbrandij, M., Teijema, J. J., et al. (2025) · European Journal of Psychotraumatology · doi:10.1080/20008066.2025.2546214 · Cited by 6
Self-citationByrne, F., Hofstee, L., Teijema, J., De Bruin, J., & van de Schoot, R. (2024) · Systematic Reviews · doi:10.1186/s13643-024-02587-0 · Cited by 9
Self-citationWhen to stop reviewing: validation of stop criteria in ASReview
Kempny, C., Annac, K., Wahidie, D., Yilmaz-Aslan, Y., & Brzoska, P. (2026) · BMC Medical Research Methodology · doi:10.1186/s12874-026-02866-5 · Cited by 5
Romanov, S., Siqueira, A. S., Bruin, J. D., Teijema, J. J., Hofstee, L., & van de Schoot, R. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/mh4vt · Cited by 2
Self-citationRomanov, S., Siqueira, A. S., Bruin, J. D., Teijema, J. J., Hofstee, L., & van de Schoot, R. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/9h5ju · Cited by 2
Self-citationSimulation-based active learning for systematic reviews: A scoping review of literature
Teijema, J. J., Ribeiro, G., Seuren, S., Anadria, D., Bagheri, A., & van de Schoot, R. (2025) · Journal of Information Science · doi:10.1177/01655515251379058 · Cited by 1
Self-citationData management in literature reviews: The C5-DM Framework
Wagner, G., Prester, J., Lukyanenko, R., & Paré, G. (2026) · Research Synthesis Methods · doi:10.1017/rsm.2026.10091 · Cited by 1
Byrne, F., Hofstee, L., Teijema, J. J., Bruin, J. D., & van de Schoot, R. (2023) · doi:10.31234/osf.io/qhg9k · Cited by 1
Self-citationM-PreSS: A Model Pre-training Approach for Study Screening in Systematic ReviewsPreprint
Xu, Z., Davies, P., Millard, L. A. C., Teng, L., Markozannes, G., Erola, P., Seleiro, E. A. P., Higgins, J. P. T., Martin, R. M., Sobczyk-Barad, M., et al. (2025) · medRxiv · doi:10.1101/2025.04.08.25325463 · Cited by 1
AIM review tool: artificial intelligence for smarter systematic review screening
Mena, S., Rituerto-González, E., Coutts, F., von Trott, J., Jacobs, G. R., Bryant, L., Moles, L., Sirbu, N., Promet, L., Oliver, D., et al. (2026) · npj Artificial Intelligence · doi:10.1038/s44387-026-00080-8
Enhancing Title and Abstract Priority Screening Through EdRoSi AI PipelinePreprint
Lecot, P., Tonoli-Catez, H., Noseda, A., Buisse, T., Chanut, S., & Chanel, I. (2026) · medRxiv · doi:10.64898/2026.06.26.26356718
Automated Study Selection Using Representation Learning and Clustering
Owolabi, F. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-20897-2_53
PASHA, M., & Shaikᵇ, M. A. (2026) · Research Square · doi:10.21203/rs.3.rs-10938971/v1
Validation of an LLM-assisted title and abstract screener on two published systematic reviews
Parmar, D. (2026) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.22929149
Screen: browser-only title–abstract screening with active learning — reproducible benchmark
Ahmad, M. (2026) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.23132679
Metadata
- Authors
- De Bruin, J., Ma, Y., Ferdinands, G., Teijema, J., & Van de Schoot, R.
- Affiliations
- Utrecht University
- University of Michigan (US)
- Utrecht University (NL)
- Venue
- DataverseNL
- Publisher
- DataverseNL
- Published
- 2023
- OpenAlex
- W6927811720
- Cited by
- 20
- References
- 0
- Citations by year
- 2026: 7 · 2025: 6 · 2024: 2 · 2023: 5
- Type
- dataset
- Language
- en
- Open access
- green
- doi.org
- Licence
- public-domain
- creativecommons.org/publicdomain/zero/1.0/legalcode
- Locations
- DataverseNL (public-domain)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- study selection, systematic reviews, information retrieval, sparse labels, binary classification, academic papers, bibliographic metadata, network analysis, ASReview
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.