Guidance for using artificial intelligence for title and abstract screening while conducting knowledge syntheses
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Background: Systematic reviews are the cornerstone of evidence-based medicine. However, systematic reviews are time consuming and there is growing demand to produce evidence more quickly, while maintaining robust methods. In recent years, artificial intelligence and active-machine learning (AML) have been implemented into several SR software applications. As some of the barriers to adoption of new technologies are the challenges in set-up and how best to use these technologies, we have provided different situations and considerations for knowledge synthesis teams to consider when using artificial intelligence and AML for title and abstract screening. Methods: We retrospectively evaluated the implementation and performance of AML across a set of ten historically completed systematic reviews. Based upon the findings from this work and in consideration of the barriers we have encountered and navigated during the past 24 months in using these tools prospectively in our research, we discussed and developed a series of practical recommendations for research teams to consider in seeking to implement AML tools for citation screening into their workflow. Results: We developed a seven-step framework and provide guidance for when and how to integrate artificial intelligence and AML into the title and abstract screening process. Steps include: (1) Consulting with Knowledge user/Expert Panel; (2) Developing the search strategy; (3) Preparing your review team; (4) Preparing your database; (5) Building the initial training set; (6) Ongoing screening; and (7) Truncating screening. During Step 6 and/or 7, you may also choose to optimize your team, by shifting some members to other review stages (e.g., full-text screening, data extraction). Conclusion: Artificial intelligence and, more specifically, AML are well-developed tools for title and abstract screening and can be integrated into the screening process in several ways. Regardless of the method chosen, transparent reporting of these methods is critical for future studies evaluating artificial intelligence and AML.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“as their development depends on knowledge of the true relevant records (Callaghan & Müller-Hansen, 2020; Hamel et al., 2021).”
From Screening Smarter, Not Harder: A Comparative Analysis of Machine Learning Screening Algorithms and Heuristic Stopping Criteria for Systematic Reviews in Educational Research (2024) · cites this paper as Hamel et al., 2021
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Overall, the performance of heuristic stopping rules should not be generalized to databases where the number of relevant records is unknown, as their development depends on knowledge of the true relevant records (Callaghan & Müller-Hansen, 2020; Hamel et al., 2021).”
From Screening Smarter, Not Harder: A Comparative Analysis of Machine Learning Screening Algorithms and Heuristic Stopping Criteria for Systematic Reviews in Educational Research (2024) · cites this paper as Hamel et al., 2021
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Nonetheless, forthcoming advances in automation (eg, active machine learning) 49 50 and crowdsourcing 8 51 have the potential to reduce screening time when conducting rapid reviews.”
From Updated recommendations for the Cochrane rapid review methods guidance for rapid reviews of effectiveness (2024) · cites this paper as [49]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
Self-citationRayyan-a web and mobile app for systematic reviews.
Ouzzani, M., Hammady, H., Fedorowicz, Z., & Elmagarmid, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0384-4 · Cited by 26,092 · cited 1×
“…been introduced in several SR software applications, such as Abstrackr [18], DistillerSR ® [19], EPPI-Reviewer [20], Pico Portal [21], Rayyan [22], RobotAnalyst [23], and SWIFTActive-Screener [24], with a comprehensive list available at SR Toolbox (http:// syste matic revie wtools. com/…”
MethodThe PRISMA 2020 statement: an updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01626-4 · Cited by 13,874 · cited 1×
“…around the use of automation tools with a list of ‘essential elements for systematic reviews using automation tools in the selection process’ [46]; we feel this to be a sign of growing acceptance of the use of AI in the field of knowledge synthesis that should encourage those interested to…”
MethodSelf-citationA typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817 · cited 1×
“Other examples include overview of reviews, rapid reviews, and scoping reviews [5].”
BackgroundThe PRISMA 2020 statement: an updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/v7gm2 · Cited by 5,177
Self-citationEvidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232 · cited 2×
“This requires one reviewer to include a record and two reviewers to exclude a record [9].”
BackgroundMethodO’Mara-Eves, A., Thomas, J., McNaught, J., Miwa, M., & Ananiadou, S. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-5 · Cited by 681 · cited 1×
“Active machine-learning: An iterative process whereby the accuracy of the predictions made by the algorithm is improved through interaction with reviewers as they screen additional records [1].”
BackgroundMarshall, I. J., & Wallace, B. C. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1074-9 · Cited by 638 · cited 1×
“Artificial intelligence (AI) and more specifically, active machine-learning (AML) have emerged during the past decade as an area of focus to expedite the performance of knowledge syntheses, and may offer potential value both in terms of time saved and costs averted [17].”
BackgroundLiving systematic reviews: 2. Combining human and machine effort
Thomas, J., Noel-Storr, A., Marshall, I., Wallace, B., McDonald, S., Mavergames, C., Glasziou, P., Shemilt, I., Synnot, A., Turner, T., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.08.011 · Cited by 355 · cited 1×
“…users for shorter timelines and lower cost reviews; (3) increased demand for updating reviews and producing living reviews, which require efficiencies in the review process [38]; and (4) the push for evidence-informed decision-making, especially during emergencies (e.g., COVID-19 COVID-19 ).”
BackgroundSelf-citationO’Mara-Eves, A., Thomas, J., McNaught, J., Miwa, M., & Ananiadou, S. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0031-5 · Cited by 353
Edwards, P., Clarke, M., DiGuiseppi, C., Pratap, S., Roberts, I., & Wentz, R. (2002) · Statistics in Medicine · doi:10.1002/sim.1190 · Cited by 340 · cited 2×
“Single-reviewer screening can also be used, although when empirically evaluated, this approach may miss many relevant studies [10–13].”
BackgroundMethodUsing systematic reviews in guideline development: The GRADE approach
Zhang, Y., Akl, E. A., & Schünemann, H. J. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1313 · Cited by 260 · cited 1×
“SRs are the cornerstone of evidencebased medicine [6], supporting clinical decision-making such as through use in guidelines, and informing policy decisions [7].”
BackgroundThomas, J., McDonald, S., Noel-Storr, A., Shemilt, I., Elliott, J., Mavergames, C., & Marshall, I. J. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.11.003 · Cited by 253
Bougioukas, K. I., Liakos, A., Tsapas, A., Ntzani, E., & Haidich, A.-B. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.002 · Cited by 251 · cited 1×
“Implications for future research Study design of inclusion may impact performance of AML, as RCTs may have better reported abstracts than observational studies, as there is guidance on what should be reported in RCT abstracts [48].”
BackgroundPrinciples of and Procedures for Systematic Reviews
Egger, M., & Smith, G. D. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch2 · Cited by 234
Gartlehner, G., Affengruber, L., Titscher, V., Noel-Storr, A., Dooley, G., Ballarini, N., & König, F. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.01.005 · Cited by 206 · cited 1×
“In one study, single reviewer screening missed an average of 13% of relevant studies among 24,942 screening decisions [11].”
BackgroundTitles versus titles and abstracts for initial screening of articles for systematic reviews
Mateen, F., Oh, Tergas, Bhayani, & Kamdar (2013) · Clinical Epidemiology · doi:10.2147/clep.s43118 · Cited by 202 · cited 1×
“Other alternatives include first performing title-only screening [14, 15], and using more experienced (or expert) reviewers [16].”
BackgroundSWIFT-Review: a text-mining workbench for systematic review
Howard, B. E., Phillips, J., Miller, K., Tandon, A., Mav, D., Shah, M. R., Holmgren, S., Pelch, K. E., Walker, V., Rooney, A. A., et al. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0263-z · Cited by 196 · cited 1×
“With no current consensus on how to best use AI for study selection, and several studies published in the area performance of AI and AML [26, 27, 30–32, 34],”
BackgroundRathbone, J., Hoffmann, T., & Glasziou, P. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0067-6 · Cited by 184 · cited 1×
“Several studies have been published since 2015 using and evaluating the use of AI and prioritized screening, many with encouraging results [10, 25–37].”
BackgroundO’Connor, A. M., Tsafnat, G., Thomas, J., Glasziou, P., Gilbert, S. B., & Hutton, B. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1062-0 · Cited by 167 · cited 1×
“These tools use active machine-learning (AML) to re-order (or prioritize) citations to be displayed in order from most likely to be relevant to least likely, a level 2 automation for human-computer interactions [3].”
MethodSelf-citationHoward, B. E., Phillips, J., Tandon, A., Maharana, A., Elmore, R., Mav, D., Sedykh, A., Thayer, K., Merrick, B. A., Walker, V., et al. (2020) · Environment International · doi:10.1016/j.envint.2020.105623 · Cited by 157 · cited 3×
“With no current consensus on how to best use AI for study selection, and several studies published in the area performance of AI and AML [26, 27, 30–32, 34],”
BackgroundInfluentialGates, A., Johnson, C., & Hartling, L. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0707-8 · Cited by 148 · cited 1×
“With no current consensus on how to best use AI for study selection, and several studies published in the area performance of AI and AML [26, 27, 30–32, 34],”
BackgroundPrioritising references for systematic reviews with RobotAnalyst: A user study
Przybyła, P., Brockmeier, A. J., Kontonatsios, G., Le Pogam, M., McNaught, J., von Elm, E., Nolan, K., & Ananiadou, S. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1311 · Cited by 148
Hamel, C., Kelly, S. E., Thavorn, K., Rice, D. B., Wells, G. A., & Hutton, B. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01129-1 · Cited by 140 · cited 5×
“…a software tool for systematic review management, to measure its performance in terms of accuracy (to identify potentially relevant citations) and potential for time savings, and also to develop empirical experience in its use to further guide our work flow for future systematic reviews [34].”
BackgroundMethodInfluentialSelf-citationGates, A., Guitard, S., Pillay, J., Elliott, S. A., Dyson, M. P., Newton, A. S., & Hartling, L. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1222-2 · Cited by 133 · cited 3×
“As most research in this area is based on a small number of case studies [30] or small datasets [33], it is important for knowledge synthesis teams to test prioritization tools in their own projects, and we encourage replication to build to the repository of information.”
BackgroundTsou, A. Y., Treadwell, J. R., Erinoff, E., & Schoelles, K. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01324-7 · Cited by 122 · cited 2×
“As most research in this area is based on a small number of case studies [30] or small data-sets [33], it is important for knowledge synthesis teams to test prioritization tools in their own projects, and we encourage replication to build to the repository of information.”
BackgroundStatistical stopping criteria for automated screening in systematic reviews
Callaghan, M. W., & Müller-Hansen, F. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01521-4 · Cited by 121 · cited 1×
“There have also been some more complex evaluations to implement a stopping decision [44].”
BackgroundXiong, Z., Liu, T., Tse, G., Gong, M., Gladding, P. A., Smaill, B. H., Stiles, M. K., Gillis, A. M., & Zhao, J. (2018) · Frontiers in Physiology · doi:10.3389/fphys.2018.00835 · Cited by 117
Robson, R. C., Pham, B., Hwee, J., Thomas, S. M., Rios, P., Page, M. J., & Tricco, A. C. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.10.003 · Cited by 86
Self-citationGates, A., Gates, M., Sebastianski, M., Guitard, S., Elliott, S. A., & Hartling, L. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01031-w · Cited by 80
Assessing the accuracy of machine-assisted abstract screening with DistillerAI: a user study
Gartlehner, G., Wagner, G., Lux, L., Affengruber, L., Dobrescu, A., Kaminski-Hartenthaler, A., & Viswanathan, M. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1221-3 · Cited by 73 · cited 4×
“Single-reviewer screening can also be used, although when empirically evaluated, this approach may miss many relevant studies [10–13].”
BackgroundMethodInfluentialRathbone, J., Albarqouni, L., Bakhit, M., Beller, E., Byambasuren, O., Hoffmann, T., Scott, A. M., & Glasziou, P. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0629-x · Cited by 64 · cited 1×
“Other alternatives include first performing title-only screening [14, 15], and using more experienced (or expert) reviewers [16].”
BackgroundPham, M. T., Waddell, L., Rajić, A., Sargeant, J. M., Papadopoulos, A., & McEwen, S. A. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1215 · Cited by 40 · cited 1×
“…these records is not currently known, but several options can be implemented: (1) As title-only screening has been shown to have high recall [12, 13], screen these records in the order they appear (based on the re-ranking algorithm), with the knowledge that they may be incorrectly informing…”
BackgroundThe views of health guideline developers on the use of automation in health evidence synthesis
Arno, A., Elliott, J., Wallace, B., Turner, T., & Thomas, J. (2021) · Systematic Reviews · doi:10.1186/s13643-020-01569-2 · Cited by 40 · cited 1×
“Transparent and consistent reporting will help determine which title and abstract screening methods were applied when conducting the review, which will allow for replicability, and ultimately allow for conclusions to be made on best approaches and to address concerns of stakeholders [47].”
BackgroundEvaluation of text mining to reduce screening workload for injury-focused systematic reviews
Giummarra, M. J., Lau, G., & Gabbe, B. J. (2020) · Injury Prevention · doi:10.1136/injuryprev-2019-043247 · Cited by 39
Reddy, S. M., Patel, S., Weyrich, M., Fenton, J., & Viswanathan, M. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01450-2 · Cited by 38
Models of provider care in long-term care: A rapid scoping review
Hamel, C., Garritty, C., Hersi, M., Butler, C., Esmaeilisaraji, L., Rice, D. B., Straus, S. E., Skidmore, B., & Hutton, B. (2021) · PLoS ONE · doi:10.1371/journal.pone.0254527 · Cited by 24 · cited 1×
“…and challenges in the context of recent knowledge syntheses related to the benefits of different primary care models for long-term care homes [39, 40], interventions to manage chronic pain in those with comorbid mental health conditions [41], interventions to reduce the risk of acute pain…”
BackgroundSelf-citationHamel, C., Corace, K., Hersi, M., Rice, D., Willows, M., Macpherson, P., Sproule, B., Flores-Aranda, J., Garber, G., Esmaeilisaraji, L., et al. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01499-z · Cited by 17 · cited 1×
“…the risk of acute pain transitioning to chronic pain [41], the health effects of cannabis consumed by older adults [42], and interventions for management of methamphetamine disorder [43]; we provide additional information regarding these reviews in Additional file 1 to provide context for readers.”
BackgroundSelf-citationEffects of medical and non-medical cannabis use in older adults: protocol for a scoping review
Wolfe, D. M., Corace, K. M., Rice, D. B., Smith, A., Kanji, S., Conn, D. K., Willows, M., Garber, G. E., Puxty, J., Moghadam, E., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-034301 · Cited by 14 · cited 1×
“…[41], interventions to reduce the risk of acute pain transitioning to chronic pain [41], the health effects of cannabis consumed by older adults [42], and interventions for management of methamphetamine disorder [43]; we provide additional information regarding these reviews in Additional file…”
BackgroundSelf-citationEffective models of provider care in long-term care homes: a rapid scoping reviewPreprint
Garritty, C., Hamel, C., Hutton, B., & Skidmore, B. (2020) · doi:10.17605/osf.io/u3an4 · Cited by 1 · cited 1×
“Prospective implementation of ALM In addition to the above retrospective investigation, since adoption of DistillerSR®‘s AML features as part of the workflow within the research unit of team members CH and BH, the strategies described in this guidance were assessed in terms of their benefits and challenges in the cont…”
MethodSelf-citationEffective models of provider care in long-term care homes: a rapid scoping reviewPreprint
Hamel, C., Hutton, B., Skidmore, B., & Garritty, C. (2020) · OSF Preprints (OSF Preprints) · Cited by 1
Self-citation
Research works printed but not linked: 3
- Cottrell E Whitlock E Kato E Uhl S Belinson S Chang C Defining the Benefits of Stakeholders Engagement in Systematic Reviews 2014 Rockville Agency for Healthcare Research and Quality (US) 24783309
- Thomas J Graziosi S Brunton J Ghouze Z O’Driscoll P Bond M EPPI-Reviewer: advanced software for systematic reviews, maps and evidence synthesis 2020 London UCL Social Research Institute: EPPI-Centre Software
- Rice D Wolfe D Garritty C Hersi M Esmaeilisaraji L Butler C Best Practice in Pain Management: Rapid Reviews of Guidelines and Knowledge Syntheses 2020 Ottawa Ottawa Hospital Research Insitute
Cited by
Garritty, C., Hamel, C., Trivella, M., Gartlehner, G., Nussbaumer-Streit, B., Devane, D., Kamel, C., Griebler, U., & King, V. J. (2024) · BMJ · doi:10.1136/bmj-2023-076335 · Cited by 260
Self-citationDennstädt, F., Zink, J., Putora, P. M., Hastings, J., & Cihoric, N. (2024) · Systematic Reviews · doi:10.1186/s13643-024-02575-4 · Cited by 145
“Several approaches have been developed that use machine learning (ML) to automate or semi-automate screening [1, 6].”
MethodGalli, C., Donos, N., & Calciolari, E. (2024) · Information · doi:10.3390/info15020068 · Cited by 100
Hasan, B., Saadi, S., Rajjoub, N. S., Hegazi, M., Al-Kordi, M., Fleti, F., Farah, M., Riaz, I. B., Banerjee, I., Wang, Z., et al. (2024) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2023-112597 · Cited by 67
Campos, D. G., Fütterer, T., Gfrörer, T., Lavelle-Hill, R., Murayama, K., König, L., Hecht, M., Zitzmann, S., & Scherer, R. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09862-5 · Cited by 75
“In a mixed-based strategy, researchers decide to stop reviewing after a certain number of abstracts have been reviewed and a certain threshold of consecutive irrelevant records have been found (Hamel et al., 2021; Yu & Menzies, 2019).”
Metadata
- Authors
- Hamel, C., Hersi, M., Kelly, S. E., Tricco, A. C., Straus, S., Wells, G., Pham, B., & Hutton, B.
- Affiliations
- Ottawa Hospital Research Institute (CA)
- University of Ottawa (CA)
- St. Michael's Hospital (CA)
- Corresponding author
- Hamel, Candyce
- ORCID
- Venue
- BMC Medical Research Methodology
- Published
- 2021-12
- Volume
- 21
- Issue
- 1
- Pages
- 285-285
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC8686081
- OpenAlex
- W4200362342
- Semantic Scholar
- 23a6f783190957fee7ec26f72a84738f64bac71a
- Cited by
- 104
- References
- 40
- Citations by year
- 2026: 21 · 2025: 24 · 2024: 29 · 2023: 20 · 2022: 10
- FWCI
- 8.55
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor, 19 d)
- Locations
- BMC Medical Research Methodology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- uO Research (University of Ottawa) (submittedVersion, public-domain)
- TSpace (University of Toronto) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Canadian Institutes of Health Research (Tier 2)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- artificial intelligence, active learning (machine learning), title and abstract screening, systematic reviews, knowledge synthesis, citation screening, screening workflow, search strategies, reporting transparency
- MeSH terms
- Artificial Intelligence, Humans, Mass Screening, Research Design, Retrospective Studies, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

