Artificial intelligence for literature reviews: opportunities and challenges
Open accessThe DOI matches its Crossref record; 217 of the 218 references it cites were found in a registry or an index; 62 of the 115 sources its claims cite were checked for support.
Abstract
This paper presents a comprehensive review of the use of Artificial Intelligence (AI) in Systematic Literature Reviews (SLRs). A SLR is a rigorous and organised methodology that assesses and integrates prior research on a given topic. Numerous tools have been developed to assist and partially automate the SLR process. The increasing role of AI in this field shows great potential in providing more effective support for researchers, moving towards the semi-automatic creation of literature reviews. Our study focuses on how AI techniques are applied in the semi-automation of SLRs, specifically in the screening and extraction phases. We examine 21 leading SLR tools using a framework that combines 23 traditional features with 11 AI features. We also analyse 11 recent tools that leverage large language models for searching the literature and assisting academic writing. Finally, the paper discusses current trends in the field, outlines key research challenges, and suggests directions for future research. We highlight three primary research challenges: integrating advanced AI solutions, such as large language models and knowledge graphs, improving usability, and developing a standardised evaluation framework. We also propose best practices to ensure more robust evaluations in terms of performance, usability, and transparency. Overall, this review offers a detailed overview of AI-enhanced SLR tools for researchers and practitioners, providing a foundation for the development of next-generation AI solutions in this field.
Overview
CoChat Summary
TL;DR
This paper reviews AI use in systematic literature reviews, analyzing 21 SLR tools with 23 general and 11 AI-specific features plus 11 recent LLM-based tools. It finds most SLR tools rely on older AI methods and have usability/evaluation gaps, and identifies three main challenges: advanced AI integration, usability, and standardised evaluation.
Key findings
- Of the 21 SLR tools, 19 support screening and 4 support extraction; 19 are web applications and 2 are desktop (SWIFT-Review, ASReview); only 4 release code under an open license (Colandr, ASReview, FAST2, RobotReviewer/RobotSearch). Most use basic classifiers and bag-of-words; SVM is the most adopted approach, with Abstrackr, FAST2, Rayyan, and RobotAnalyst relying exclusively on SVM. Minimum seed requirements vary: ASReview, SWIFT-Active Screener, and SWIFT-Review require 1 relevant and 1 irrelevant paper; Covidence 2; Rayyan 5; Colandr 10; SysRev 30.
- Only 8 of 21 tools implement at least 70% of the 23 general features. DistillerSR, Nested Knowledge, Dextr, and ExaCT lead at 82%; PICOPortal and Rayyan at 78%; EPPI-Reviewer at 74%; SWIFT-Active Screener at 70%. 13 of 21 are free to use; only LitSuggest supports living reviews; only 4 tools provide PRISMA diagram or protocol templates.
- The paper identifies 11 recent LLM-based tools: 7 search engines, 3 writing assistants, and Textero.ai fitting both categories. Most use the OpenAI API, often with RAG; output quality varies and may be more useful for master’s students than researchers.
- Usability and evaluation remain weak: a survey of 81 researchers found discontinuation reasons were poor usability (43%), insufficient functionality (37%), and workflow incompatibility (37%); SUS scores ranged from 66 to 77 (C–B). No standard evaluation framework exists; F2, WSS, and nWSS are proposed metrics, and only 4 of 21 tools operate under open licenses.
Methods
- PRISMA systematic review. The authors searched Scopus for prior surveys, the Systematic Literature Review Toolbox, CRAN, and performed snowballing via Semantic Scholar; after inclusion/exclusion criteria, they selected 21 SLR tools. They analyzed 34 features (11 AI-specific, 23 general) using literature, official websites, tutorials, and developer interviews.
- An additional exploratory search on TopAI Tools for LLM-based literature review and writing tools returned 164 tools; 18 candidates were examined, yielding 11 included tools.
Limitations
- Stated: internal validity threats from subjective inclusion/exclusion decisions and the SLR Toolbox being offline since March 2024; external validity threats from search engines/search strings possibly missing tools and from excluding tools without user interfaces, under maintenance, or not updated in 10 years; construct validity threat that the 34 features may not cover all AI dimensions; conclusion validity threat from dynamic software and rapid AI evolution, making findings a snapshot.
- Evident from the text: the LLM-tool analysis is described as an initial exploratory study rather than a systematic review, and the proposed best practices/evaluation framework are not empirically validated in the paper.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
39 Valid · 20 Not valid · 40 Not checked · 177 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“(Cowie's et al. 2022) conducted the most restricted analysis, considering only one feature ( approach ).”
What the sources say
- Disputedcites Cowie's et al. 2022 sourceExperimental — accuracy not yet measured
The Introduction’s “Feature Analysis of Systematic Review Tools” says the analysis covered the full systematic-review life cycle across six feature classes. The Results’ “Feature Assessment: Breakout by Feature Class” reports multiple features within those classes, contrary to the claim that Cowie et al. considered only one feature. The paper does not establish the comparative label “most restricted.” (LLM, conf=0.92)
Checked by a reasoning model — may be wrong.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“(Burgard and Bittermann 2023) employed only three features: text representation , approach , and output .”
What the sources say
- Disputedcites Burgard and Bittermann 2023 sourceExperimental — accuracy not yet measured
Table 2 in “Applications and Performance of Screening Automation Tools” describes tools across more than three characteristics, including type of screening automation, web availability, fees, open-source status, machine-learning method, and active learning. The paper therefore does not restrict its analysis to the three features named in the claim. (LLM, conf=0.86)
Checked by a reasoning model — may be wrong.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In the context of SLR, these methodologies are predominantly utilised to semi-automate tasks like screening and data extraction (Cowie et al. 2022; Burgard and Bittermann 2023).”
What the sources say
- Partly supportedcites Cowie et al. 2022 sourceExperimental — accuracy not yet measured
The Discussion, under “Automation and Machine Learning,” reports automation for screening in 13 of 24 tools. But under “Data Extraction,” it says automated extraction is underdeveloped and has not achieved partial extraction at sufficient accuracy for adoption. The source therefore supports screening, but not the claim that AI is predominantly used to semi-automate data extraction. (LLM, conf=0.90)
- Partly supportedcites Burgard and Bittermann 2023 sourceExperimental — accuracy not yet measured
In “Need for Automation in Systematic Reviews” (page not available), the paper says tools have been developed to automate review steps including data extraction and reference screening, and it describes semiautomated screening. It does not establish that AI methodologies are predominantly used for those tasks, or that data extraction is predominantly semiautomated. (LLM, conf=0.82)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“We selected Scopus over other alternatives because it is widely recognised as the preferred source for conducting systematic literature reviews due to its high-quality metadata, reliable citation tracking, and extensive coverage of scientific documents, including journals, conference proceedings, and books (Baas et al. 2020; Visser et al. 2021).”
What the sources say
- Partly supportedcites Baas et al. 2020 sourceExperimental — accuracy not yet measured
Section 1, “Scopus as a Bibliometric Data Source” (page not provided), supports the stated reasons for choosing Scopus: it describes extensive journal, conference, and book coverage, quality controls for metadata, and high citation-linking accuracy. It does not establish that Scopus is widely recognised as the preferred source for systematic literature reviews over alternatives. (LLM, conf=0.88)
- Partly supportedcites Visser et al. 2021 sourceExperimental — accuracy not yet measured
The Introduction describes Scopus as a major bibliographic source, and the Conclusions report high precision and recall for its citation links and substantial coverage of journal articles and proceedings papers. The paper does not establish that Scopus is the preferred source for systematic literature reviews or assess its metadata quality as claimed; its conclusions also note strengths of other databases. Page numbers are unavailable in our copy. (LLM, conf=0.88)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Many of these tools have adopted Artificial Intelligence (AI) solutions (van den Bulk et al. 2022; Kebede et al. 2023), particularly for the screening and data extraction phases.”
What the sources say
- Partly supportedcites van den Bulk et al. 2022 sourceExperimental — accuracy not yet measured
The Introduction and Discussion (page numbers unavailable) describe machine-learning tools used to screen literature for systematic reviews. The Discussion describes automatically collecting information from relevant articles only as possible future work, so this paper does not support the claim that tools have already adopted AI for the data-extraction phase. (LLM, conf=0.88)
- Supportedcites Kebede et al. 2023 source
The Introduction says that systematic-review steps including screening and data extraction can be semi-automated with machine-learning algorithms or web-based tools. It also reports a review finding that a majority of studies used AI methods for screening, risk-of-bias assessment, and data extraction. This supports the citing sentence as a broad background statement. (LLM, conf=0.88)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
91 more claims · 13 with their cited sources checked
Create a free account to see all 276 claims and every source verdict.
- Probably not a substantial claim. 142
- It may state two separate claims as one. 64
- The quote only partly states this claim. 4
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The ability of LLMs to document the rationale behind each screening and data extraction decision is a major advantage over earlier AI approaches, improving transparency and aiding in the interpretation of the models’ outputs, as well as informing the future development of models and prompts for better performance (Bolaños et al., 2024; de la Torre-López et al., 2023).”
From Analysis of article screening and data extraction performance by an AI systematic literature review platform (2025) · cites this paper as Bolaños et al., 2024
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Researchers’ current lack of trust in the accuracy and quality of SLR automation tools has been identified as a major barrier to uptake, and transparency from the developers and users of these tools has been suggested as a means to overcome this challenge (Bolaños et al., 2024; de la Torre-López et al., 2023; Gates et al., 2019; O’Connor et al., 2019; van Altena et al., 2019).”
From Analysis of article screening and data extraction performance by an AI systematic literature review platform (2025) · cites this paper as Bolaños et al., 2024
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Until recently, most work in this field used natural language processing (NLP) and similar text mining approaches (Blaizot et al., 2022; Bolaños et al., 2024; Cowie et al., 2022; de la Torre-López et al., 2023; van Dinter et al., 2021).”
From Analysis of article screening and data extraction performance by an AI systematic literature review platform (2025) · cites this paper as Bolaños et al., 2024
The cited source says what the claim attributes to it.
In the citing paper
“Many of the tasks involved in SLRs are amenable to automation using artificial intelligence (AI) (Beller et al., 2018; Bolaños et al., 2024; Michelson and Reuter, 2019; Shemilt et al., 2016; Tsertsvadze et al., 2015).”
From Analysis of article screening and data extraction performance by an AI systematic literature review platform (2025) · cites this paper as Bolaños et al., 2024
The cited source says what the claim attributes to it.
In the citing paper
“Although we have demonstrated the potential utility of ISLaR in rapidly performing SLR tasks to ease researcher workload, there are many challenges and barriers that must be addressed before AI tools can be routinely used in practice (Bolaños et al., 2024; de la Torre-López et al., 2023; Doyal et al., 2023; O’Connor et al., 2019; van Altena et al., 2019).”
From Analysis of article screening and data extraction performance by an AI systematic literature review platform (2025) · cites this paper as Bolaños et al., 2024
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 5.3 Outstanding SLR tools
“| | Multiple user support | 21 (100%) | 0 (0%) |”
§ 8 Conclusion
“| Mul- tiple user sup- port | 2 | 2 | >1 | >1 | No | >1”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 5.3 Outstanding SLR tools
“| | Multiple user roles | 21 (100%) | 0 (0%) |”
§ 8 Conclusion
“| Mul- tiple user roles | | | | | | | | Mult. | Sing. | | | Sing. | Sing.”
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071 · cited 3×
“Finally, Section 4.2.3 describes the full set of 21 SLR tools according to the general features.”
Influential(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Rayyan-a web and mobile app for systematic reviews.
Ouzzani, M., Hammady, H., Fedorowicz, Z., & Elmagarmid, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0384-4 · Cited by 26,092
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · The Lancet · doi:10.1016/s0140-6736(07)61602-x · Cited by 21,320
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
Evidence based medicine: what it is and what it isn't
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S. (1996) · BMJ · doi:10.1136/bmj.312.7023.71 · Cited by 15,769 · cited 1×
“This methodology originally emerged within the realm of Evidence-Based Medicine [3], and it was subsequently adapted and employed in diverse research disciplines including social sciences [4], engineering and technology [5], education [6], environmental sciences [7], and business and management [8].”
Tranfield, D., Denyer, D., & Smart, P. (2003) · British Journal of Management · doi:10.1111/1467-8551.00375 · Cited by 15,386 · cited 1×
“This is due to several factors, such as the duration of the whole process, which can extend beyond a year [9]; the necessity for a multidisciplinary team of experts, often accompanied by specific training [10]; significant financial implications arising from database subscriptions, specialised…”
Research works printed but not linked: 12
- Iansiti M, Lakhani KR (2020) Competing in the age of AI: strategy and leadership when algorithms and networks run the world. Harvard Business Press, Boston
- Kusa W, Knoth P, Hanbury A (2022) Evaluation of automated citation screening in systematic literature reviews with work saved over sampling: an analysis. In: 1st workshop on augmented intelligence for technology-assisted reviews systems: evaluation metrics and protocols for ediscovery and systematic review systems, pp 1–7
- Le Q, Mikolov T (2014) Distributed representations of sentences and documents. In: International Conference on Machine Learning. PMLR, pp 1188–1196
- Lewis P, Perez E, Piktus A, Petroni F, Karpukhin V, Goyal N, Küttler H, Lewis M, Yih W-T, Rocktäschel T et al (2020) Retrieval-augmented generation for knowledge-intensive NLP tasks. Adv Neural Inf Process Syst 33:9459–9474
- Li Q, Li J, Sheng J, Cui S, Wu J, Hei Y, Peng H, Guo S, Wang L, Beheshti A et al (2022) A survey on deep learning event extraction: approaches and applications. IEEE Trans Neural Netw Learn Syst
- Lipscomb CE (2000) Medical subject headings (mesh). Bull Med Libr Assoc 88(3):265
- Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. Adv Neural Inf Process Syst 26
- Minion JT, Egunsola O, Mastikhina L, Farkas B, Hofmeister M, Flanagan J, Salmon C, Clement F (2021) Pico portal. J Can Health Libraries Assoc 42(3):181
- Ng A, Jordan M, Weiss Y (2001) On spectral clustering: analysis and an algorithm. Adv Neural Inf Process Syst 14
- National Academies of Sciences, Engineering, and Medicine; Policy and Global Affairs; Board on Research Data and Information; Committee on Toward an Open Science Enterprise (2018) Open science by design: realizing a vision for 21st century research. National Academies Press, Washington
- Quesenbery W (2014) The five dimensions of usability. Content and complexity. Routledge, New York, pp 93–114
- Wang LL, DeYoung J, Wallace B (2022) Overview of mslr2022: a shared task on multi-document summarization for literature reviews. In: Proceedings of the third workshop on scholarly document processing
Cited by
Resnik, D. B., & Hosseini, M. (2025) · AI and Ethics · doi:10.1007/s43681-024-00493-8 · Cited by 228
“• Searching and reviewing the scientific literature [30, 72].”
Bandi, A., Kongari, B., Naguru, R., Pasnoor, S., & Vilipala, S. V. (2025) · Future Internet · doi:10.3390/fi17090404 · Cited by 207
Suchikova, Y., Tsybuliak, N., Teixeira da Silva, J. A., & Nazarovets, S. (2026) · Accountability in Research · doi:10.1080/08989621.2025.2544331 · Cited by 70
Automating Research Synthesis with Domain-Specific Large Language Model Fine-Tuning
Sušnjak, T., Hwang, P., Reyes, N. H., Barczak, A. L. C., McIntosh, T. R., & Ranathunga, S. (2025) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3715964 · Cited by 143
“In their most recent review, Bolanos et al. [28] found that LLM usage for SLRs is hampered by limitations such as reduced efficacy in domain-specific and narrower subject areas, their propensity for hallucinating and generating misleading information, alongside their opaque decision processes which…”
BackgroundEconomic impacts of AI-augmented R&D
Besiroglu, T., Emery-Xu, N., & Thompson, N. (2024) · Research Policy · doi:10.1016/j.respol.2024.105037 · Cited by 118
Intelligent Systems for Inorganic Nanomaterial Synthesis
Han, C., Dong, X., Zhang, W., Huang, X., Gong, L., & Su, C. (2025) · Nanomaterials · doi:10.3390/nano15080631 · Cited by 46
Use of artificial intelligence for liver diseases: A survey from the EASL congress 2024
Žigutytė, L., Sorz-Nechay, T., Clusmann, J., & Kather, J. N. (2024) · JHEP Reports · doi:10.1016/j.jhepr.2024.101209 · Cited by 33
Barman, K. G., Caron, S., Sullivan, E., de Regt, H. W., de Austri, R. R., Boon, M., Färber, M., Fröse, S., Golling, T., Lopez, L. G., et al. (2025) · The European Physical Journal C · doi:10.1140/epjc/s10052-025-14707-8 · Cited by 46
“In selecting relevant research topics, they can efficiently summarise and highlight key findings from vast scientific literature, and enhance understanding [33, 34].”
García-Torres, D., Vicente Ripoll, M. A., Fernández Peris, C., & Mira Solves, J. J. (2024) · Healthcare · doi:10.3390/healthcare12222241 · Cited by 29
A hybrid framework for creating artificial intelligence-augmented systematic literature reviews
Malik, F. S., & Terzidis, O. (2026) · Management Review Quarterly · doi:10.1007/s11301-025-00522-8 · Cited by 28
“…for researchers, such as tailoring AI models, curating domain-specific knowledge bases, and employing iterative prompt engineering, thereby aligning AI outputs with schol - arly standards (Alvesson and Sandberg 2020; Bolaños et al. 2024; Benbya et al. 2024 ; Grimes et al. 2023; Lorenz et al. 2024).”
InfluentialEmon, M. M. H. (2025) · Telematics and Informatics Reports · doi:10.1016/j.teler.2025.100267 · Cited by 55
Toward Automated Simulation Research Workflow through LLM Prompt Engineering Design
Liu, Z., Chai, Y., & Li, J. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.4c01653 · Cited by 24
Enhancing Intuitive Decision-Making and Reliance Through Human–AI Collaboration: A Review
Xu, G., Murthy, S. V., & Jia, B. (2025) · Informatics · doi:10.3390/informatics12040135 · Cited by 44
“While AI-assisted systematic reviews represent an emerging methodological approach [52–54], we acknowledge this represents a methodological innovation that requires careful validation and transparency.”
The Rise of Agentic AI: Synthesis of Current Knowledge and Future Research Agenda
Islam, M. A., Somu, S., & Aldaihani, F. M. F. (2025) · Global Business and Organizational Excellence · doi:10.1002/joe.70019 · Cited by 58
Resnik, D. B., & Hosseini, M. (2023) · doi:10.31235/osf.io/rbg9z · Cited by 20
From E-Government to AI E-Government: A Systematic Review of Citizen Attitudes
Savveli, I., Rigou, M., & Balaskas, S. (2025) · Informatics · doi:10.3390/informatics12030098 · Cited by 61
From insight to innovation: Harnessing artificial intelligence for dynamic literature reviews
Buetow, S., & Lovatt, J. (2024) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2024.102901 · Cited by 28
A systematic review of multi-modal large language models on domain-specific applications
Li, S., Wong, K. W., Wang, G., & Duong, T.-T. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11398-1 · Cited by 27
“– Recall : Measures the ability to identify true positives.”
InfluentialAggarwal, T., Salatino, A. A., Osborne, F., & Motta, E. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104262 · Cited by 41
“In conclusion, LLMs are increasingly being used for ontology generation, as well as a range of research-related tasks such as identifying relevant papers [50, 51], assisting with or even automating the creation of literature reviews [52], and enhancing academic writing and referencing [53, 54].”
Self-citationPanke, S. (2025) · Journal of Teacher Education · doi:10.1177/00224871251325065 · Cited by 34
“Generative AI is transforming research design (Si et al., 2024), systematic literature reviews (Bolanos et al., 2024; Castillo-Segura et al., 2023; Schryen et al., 2024) and data analysis by accelerating processes, enhancing efficiency, and, potentially, increasing creativity and scope.”
Artificial intelligence in writing and research: ethical implications and best practices
AlSamhori, A. F., & Alnaimat, F. (2024) · Central Asian Journal of Medical Hypotheses and Ethics · doi:10.47316/cajmhe.2024.5.4.02 · Cited by 15
“Enhancement vs. Diminishment AI enhances productivity through the automation of redundant tasks, support in literature reviews, and the production of drafts of articles [37,38].”
Responsible use of AI in social science research
Ivanov, S. H. (2025) · Service Industries Journal · doi:10.1080/02642069.2025.2537115 · Cited by 19
Tosi, D. (2025) · IEEE Access · doi:10.1109/access.2025.3554504 · Cited by 23
“Similarly, Bolanos et al. analyze existing SLR automation tools, identifying trends and key challenges in AI-based literature reviews [5].”
Papa, D., Ingenito, A., von Gal, A., Pandis, M. F. D., & Piccardi, L. (2025) · Biomedicines · doi:10.3390/biomedicines13051023 · Cited by 17
“The adoption of AI tools for scientific research is increasingly supported by studies such as [123,124], which highlight how AI-based tools can simplify the process of identifying and synthesizing scientific evidence, improving both accuracy and efficiency to the point of achieving levels…”
Silva, N., & Wickramaarachchi, D. (2025) · International Conference on Advanced Research in Computing (ICARC) · doi:10.1109/icarc64760.2025.10963273 · Cited by 21
“For example, tools like SciS-pace and ResearchRabbit facilitate rapid literature discovery and trend visualization, significantly reducing the manual effort required for comprehensive reviews [4] [5].”
Synergizing blockchain and AI to fortify IoT security: a comprehensive review
Kaushik, D., Gulia, P., Gill, N. S., Yahya, M., Shukla, P. K., & Shreyas, J. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-025-11434-0 · Cited by 25
“Bolanos et al. (2024), look into AI integration in SLRs, assessing tools and setting up issues such as usability and LLM hallucination.”
Spillias, S., Ollerhead, K. M., Andreotta, M., Annand-Jones, R., Boschetti, F., Duggan, J., Karcher, D. B., Paris, C. L., Shellock, R., & Trebilco, R. (2025) · Environmental Evidence · doi:10.1186/s13750-025-00362-9 · Cited by 28
A survey of knowledge organization systems of research fields: Resources and challenges
Salatino, A. A., Aggarwal, T., Mannocci, A., Osborne, F., & Motta, E. (2025) · Quantitative Science Studies · doi:10.1162/qss_a_00363 · Cited by 35
“In the literature, we can find different types of KOSs, such as: taxonomies, glossaries, dictionaries, synonym rings, gazetteers, authority files, subject headings, thesauri, classification schemes, semantic networks, and ontologies (Hodge, 2000; Zeng, 2008).”
Self-citationCS-KG 2.0: A Large-scale Knowledge Graph of Computer Science
Dessí, D., Osborne, F., Buscaldi, D., Reforgiato Recupero, D., & Motta, E. (2025) · Scientific Data · doi:10.1038/s41597-025-05200-8 · Cited by 17
“…of effectively interpreting and answering natural language questions about a single 15-page paper, a task currently undertaken by several LLM-based services 4 , does not extend to understanding the key entities, narratives, and concepts of a research field represented by millions of such papers.”
Self-citationEvolving Pedagogy in Digital Signal Processing Education: AI-Assisted Review and Analysis
López, M. B. (2025) · IEEE Access · doi:10.1109/access.2025.3549477 · Cited by 11
“…emerging AI fields highlights the increasing need for innovative pedagogical approaches to equip students with relevant skills. intelligence to enhance the efficiency and comprehensiveness of academic literature reviews, representing a significant shift from traditional manual review methods [10].”
Appliances of Generative AI-Powered Language Tools in Academic Writing: A Scoping Review
Raitskaya, L., & Тихонова, Е. В. (2024) · Journal of language and Education · doi:10.17323/jle.2024.24181 · Cited by 29
“According to the reviewed documents, we are “moving towards semi-automatic creation of literature reviews” ( Bolaños et al., 2024).”
Cadeddu, A., Chessa, A., Leo, V. D., Fenu, G., Motta, E., Osborne, F., Recupero, D. R., Salatino, A. A., & Secchi, L. (2024) · Information · doi:10.3390/info15070398 · Cited by 20
“A wide range of systems now rely on these technologies, including modern conversational agents [7,8], medical applications [9], translation systems [10], and even tools for literature reviews [11].”
BackgroundSelf-citationFütterer, T., Campos, D., Gfrörer, T., Lavelle-Hill, R. E., Murayama, K., & Scherer, R. (2025) · Learning and Individual Differences · doi:10.1016/j.lindif.2025.102849 · Cited by 18
Dellafiore, F., Saba, A., Collaro, C., & Artioli, G. (2025) · Qualitative Health Research · doi:10.1177/10497323251389800 · Cited by 25
“Advanced AI solutions have demonstrated the potential to support semi-automated review processes (Bolaños et al., 2024; Liu et al., 2025).”
Hosayny, O. E., Razkane, H., & Yeou, M. (2025) · Discover Artificial Intelligence · doi:10.1007/s44163-025-00390-x · Cited by 16
“In accordance with adopted framework, recent research highlighted the pivotal role of AI in ameliorating CT skills through automation [23–26].”
An Evaluation of Large Language Models for Supplementing a Food Extrusion Dataset
Bölücü, N., Pennells, J., Yang, H., Rybinski, M., & Wan, S. (2025) · Foods · doi:10.3390/foods14081355 · Cited by 17
“This mechanism significantly enhances the utility of LLMs in scientific information extraction (IE), demonstrating their capability to transform unstructured data from sources like scientific articles, reports, and reviews into structured formats [17–19].”
AI and Data Science for Public Policy
Benoit, K. R. (2024) · LSE Public Policy Review · doi:10.31389/lseppr.115 · Cited by 16
Empowering business research with ChatGPT: academic and student insights through the UTAUT lens
Al‐Hattami, H. M. (2025) · Discover Computing · doi:10.1007/s10791-025-09692-1 · Cited by 17
Bhargava, H. K., Brown, S. A., Ghose, A., Gupta, A., Leidner, D. E., & Wu, D. J. (2025) · ACM Transactions on Management Information Systems · doi:10.1145/3721846 · Cited by 9
“As Generative AI is reshaping how research is conducted across disciplines (Wang et al., 2023), from automating literature reviews (Bolaños et al., 2024) to enabling fully automated discovery through frameworks like "The AI Scientist" (Callaway, 2024; Kudiabor, 2024), how do we ensure that…”
Research hypothesis generation over scientific knowledge graphs
Borrego, A., Dessì, D., Ayala, D., Hernández, I., Osborne, F., Recupero, D. R., Buscaldi, D., Ruiz, D., & Motta, E. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113280 · Cited by 29
Self-citationMtotywa, M. M., Mowers, J.-L., Ndou, W., Moleko, T. V. Q., & Ledwaba, M. (2026) · Informatics · doi:10.3390/informatics13030043 · Cited by 16
Optimizing Large Language Models for ESG Activity Detection in Financial Texts
Birti, M., Maurino, A., & Osborne, F. (2025) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3768292.3770371 · Cited by 28
Self-citationAutomate the ‘boring bits’: An assessment of AI-assisted systematic review (AIASR)
Hampson, T., Cargos, K., & McKinley, J. (2025) · Research Methods in Applied Linguistics · doi:10.1016/j.rmal.2025.100258 · Cited by 10
Towards Intelligent Universities Enhanced with Artificial Intelligence (AI)
Adel, . A. A., Abouelnour, M. M., Alhourani, M. I., & Awad, A. (2025) · Journal of Infrastructure Policy and Development · doi:10.24294/jipd10412 · Cited by 9
Lehmann, J., Meloni, A., Motta, E., Osborne, F., Recupero, D. R., Salatino, A. A., & Vahdati, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-60626-7_11 · Cited by 9
Self-citationNshakira‐Rukundo, E., Tabe‐Ojong, M. P. J., Gebrekidan, B. H., Agaba, M., Padmaja, S. S., & Dhehibi, B. (2026) · Communications Earth & Environment · doi:10.1038/s43247-025-03171-7 · Cited by 11
A comprehensive introspection on AI risks: taxonomy, challenges, and future directions
Ray, P. P. (2026) · Iran Journal of Computer Science · doi:10.1007/s42044-025-00370-5 · Cited by 16
Harnessing language models for computational literature review of emerging AI topics
Chung, J., Jeong, B., Park, Y.-J., Jeong, H., Lee, J., Yoon, J., & Choi, J. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104245 · Cited by 7
Torres, J. P. F., Mulligan, C. E. A., Jorge, J. A., & Moreira, C. (2025) · Information · doi:10.3390/info16050420 · Cited by 21
“Bolanos et al. [10] conducted a comprehensive review of AI-integrated SLR tools, highlighting the efficiency improvements AI brings while emphasizing usability-related challenges.”
Mirvis, M., Weingard, B., Goodman, S. N., & Marshall, W. F. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.02.03.636363 · Cited by 6
Systems Thinking on Artificial Intelligence Integration into Higher Education: Causal Loops
Liew, Y. Z., Tan, A. H. P., Yap, E. H., Lim, C. S., Majeed, A. P. P. A., Zhu, Y., Chen, W., Chen, S.-H., & Lo, J. Y. T. (2024) · IntechOpen eBooks · doi:10.5772/intechopen.1008246 · Cited by 17
Cassell, K., Ologunowa, A., Rastegar-Mojarad, M., Chun, B., Huang, Y.-L., Wang, D., & Cossrow, N. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1662202 · Cited by 15
Daraio, C. C., Leo, S. D., & Ferazzoli, F. (2025) · International Transactions in Operational Research · doi:10.1111/itor.70054 · Cited by 9
Modelling big data platforms as knowledge graphs: the data platform shaper
Greco, D., Osborne, F., Pusceddu, S., & Recupero, D. R. (2025) · Journal Of Big Data · doi:10.1186/s40537-025-01094-w · Cited by 8
“…used to complement large language models [19], as they have proven effective in reducing hallucinations [20], enabling evidence-informed conversational agents [21, 22], and producing verifiable text in complex domains, such as scientific reviews [23] and clinical decision support systems [24].”
Self-citationLeveraging LLMs for semi-automatic corpus filtration in systematic literature reviews
Joos, L., Keim, D. A., & Fischer, M. T. (2026) · Computers & Graphics · doi:10.1016/j.cag.2026.104537 · Cited by 14
“Therefore include papers that deal with ASPECT_1, ASPECT_2, . broadly, how machine learning [8, 4, 6] and LLM-based meth-ods [18, 19, 20, 21, 22, 23] can enhance di ff erent steps of the overall review process.”
Dutta, A., BANDUCCI, S. A., & Camargo, C. Q. (2025) · Scientometrics · doi:10.1007/s11192-025-05410-2 · Cited by 14
“…uses Latent Dirichlet Allocation (LDA) that assigns a topic to a paper based on the most recurrent terms shared by other papers using a generative probabilistic model, while Iris.ai 11 clusters the papers according to a two-level taxonomy of global topics and specific topics (Bolanos et al., 2024).”
The rise of the research automaton: science as process or product in the era of generative AI?
Sætra, H. S. (2025) · AI & Society · doi:10.1007/s00146-025-02557-7 · Cited by 17
From data extraction to analysis: a comparative study of ELISE capabilities in scientific literature
Gobin, M., Gosnat, M., Touré, S., Faik, L., Belafa, J., de Torcy, A. V., & Armstrong, F. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1587244 · Cited by 6
“A significant issue is the variability in AI-generated responses, which stems from the diverse methodologies and algorithms employed by different tools (Bolaños et al., 2024).”
Rich, A. J., McGorray, E. L., Baldwin-SoRelle, C., Cawley, M. A., Grigg, K., Beach, L. B., Phillips, G., & Poteat, T. (2025) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2025.1860 · Cited by 5
“The application of machine learning to systematic literature reviews is most often for the literature screening step [25].”
The power of generative AI for CRIS systems: a new paradigm for scientific information management
Guillaumet, A. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.11.057 · Cited by 5
Eastaugh, C., Still, M., Beyer, F. R., Wallace, S. A., & O’Keefe, H. (2025) · Cochrane Evidence Synthesis and Methods · doi:10.1002/cesm.70049 · Cited by 7
“These tools predict language patterns from vast, unstructured datasets and are increasingly synthesizing rather than retrieving which raises concerns about the reliability, transparency, and veracity, often referred to as “ black box ” [23, 24].”
Meloni, A., Recupero, D. R., Osborne, F., Salatino, A. A., Motta, E., Vahdati, S., & Lehmann, J. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3757923 · Cited by 10
Self-citationMoradi, M., & Kheiri, B. (2025) · Quality & Quantity · doi:10.1007/s11135-025-02185-9 · Cited by 8
“Furthermore, the advent of artificial intelligence and its integration into the research process prompted us to incorporate AI search engines alongside traditional information sources (Bolaños et al. 2024), in alignment with the PRISMA framework.”
Fok, R., Siu, A. F., & Weld, D. S. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714047 · Cited by 10
How to Conduct a Multi‐Domain Systematic (Literature) Review? Guidelines Using The Lotus Protocol
van Bueren, B. J. A., Lim, W. M., Donthu, N., Argus, K., Waters-Lynch, J., Sabani, A., & Leenders, M. A. A. M. (2026) · Psychology and Marketing · doi:10.1002/mar.70112 · Cited by 5
Anwar, A., & Akeel, M. O. (2026) · Accounting and Auditing · doi:10.3390/accountaudit2010004 · Cited by 26
“Multilingual scenarios, sarcasm, and implicit meanings [56,65] are further challenges.”
AI4Research: a survey of artificial intelligence for scientific research
Chen, Q., Yang, M., Qin, L., Liu, J., Yan, Z., Guan, J., Peng, D., Ji, Y., Li, H., Hu, M., et al. (2026) · Science China Information Sciences · doi:10.1007/s11432-025-5000-y · Cited by 4
Artificial intelligence in doctoral training: Bridging gaps, easing burdens
Rodríguez, G. A., Chiappe, A., & Durand, J. C. (2026) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2026.102744 · Cited by 5
Urban flood disaster risk management using multi-criteria decision-making methods: A scoping review
Piaseckienė, G., & Antuchevičienė, J. (2025) · International Journal of Strategic Property Management · doi:10.3846/ijspm.2025.25478 · Cited by 5
“The Systematic Literature Review (SLR) is a structured and rigorous methodology used for a thorough evaluation of previous research in a specific field (Bolaños et al., 2024).”
Santos, C. P., Pegado, M. R., Santos, C. F., & Rosa, R. (2025) · Reviews in Fish Biology and Fisheries · doi:10.1007/s11160-025-09968-1 · Cited by 3
“Fortunately, advances and increasing access to artificial intelligence tools should allow researchers to more swiftly scout the increasing volume of studies (Blaizot et al. 2022; Bolanos et al. 2024).”
Case Studies on the Use of AI in Literary Research and Academic Studies
Rani, J., Guru, R., & Santhanam, S. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-6330-1.ch001 · Cited by 4
Sujau, M., Wada, M., Vallée, É., Hillis, N., & Sušnjak, T. (2025) · Machine Learning and Knowledge Extraction · doi:10.3390/make7020028 · Cited by 9
“CSMed is an initiative to create a standardised dataset to evaluate the performance of automated SLR screening models [56], a gap highlighted in recent research [24].”
Oprea, S., & Bârã, A. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04633-1 · Cited by 4
“The use of AI in Systematic Literature Reviews (SLRs) was further investigated in (Bolaños et al., 2024), focusing on semi-automating screening and extraction processes.”
Wätzold, F., Popiela, B., & Mayer, J. (2024) · Publications · doi:10.3390/publications12040049 · Cited by 5
Restructuring the Landscape of Generative AI Research
Edam, S. M. I. (2024) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-0884-4.ch012 · Cited by 3
Guidelines and open-source toolbox for systematic literature reviews in the field of urbanismPreprint
Cottineau, C., Forgaci, C., Janssen, K. M. J., Li, B., Zhang, S., & Zhang, X. (2024) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/w5b8v · Cited by 3
Dai, D., 曹莎丽, & Zhao, M. (2026) · Systems · doi:10.3390/systems14060669 · Cited by 3
Kelley, C., Kelley, S., Rivas‐Koehl, M., Wilson, A., Rosinsky, K., Briggs, S., & Scott, M. E. (2026) · Prevention Science · doi:10.1007/s11121-026-01885-4 · Cited by 3
“Therefore, researchers are increasingly using generative artificial intelligence (AI) tools to support literature reviews and meta-analyses (Bolanos et al., 2024).”
Kniffert, S., Katthöfer, B., Emprechtinger, R., Pellegrini, P., Funk, E. M., Dhamrait, I. S., Zang, Y., Bornmüller, A., & Toelch, U. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.01.23.701317 · Cited by 1
Scoping Reviews in Health Professions Education
Church, H., & Sandars, J. E. (2026) · The Clinical Teacher · doi:10.1111/tct.70350 · Cited by 3
de Araújo, P. R., de Rezende, J. A. M., Faria, D. R. M., & Gomes, O. D. S. M. (2026) · Sensors · doi:10.3390/s26020747 · Cited by 7
“12.3 script integrated with the OpenAI API with the GPT-4o-mini model for the semantic screening stage assisted by artificial intelligence (AI) [30–34].”
InfluentialAI Voice Methodology: Using Generative AI in Qualitative Social Research
Hughes, J., Homan, L., O’Reilly, M., & Hughes, K. (2025) · Qualitative Inquiry · doi:10.1177/10778004251401842 · Cited by 2
Yang, M., Luo, Y., He, T., Diao, S., Li, H., Zou, K., Hazlewood, G. S., Vandvik, P. O., Kawano-Dourado, L. B., Dourado, D. D. A., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02156-2 · Cited by 7
Human versus machine: Can generative AI anticipate insect biological control outcomes?
Wyckhuys, K. A. G., Akutse, K. S., Amalin, D. M., Araj, S.-E., Beltran, M. J. B., Fekih, I. B., Calatayud, P., Cicero, L., Cokola, M. C., Colmenárez, Y. C., et al. (2025) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2025.111317 · Cited by 2
Márquez, R., Tardy, B. L., Aguado, R. J., Signori-Iamin, G., Argelagós, E., & Delgado‐Aguilar, M. (2025) · Journal of Chemical Education · doi:10.1021/acs.jchemed.5c00931 · Cited by 6
Using Role-Specialized LLM Agents for Workflow Execution in a Product Development Setting
Kretzschmar, M., Gundermann, A., Mehlstäubl, J., Gómez, A. P., Saske, B., & Paetzold-Byhain, K. (2025) · International Conference on Inventive Systems and Control (ICISC) · doi:10.1109/icisc65841.2025.11188152 · Cited by 4
“Recent research highlights the opportunities AI-assisted tools offer for literature review processes, enabling researchers to explore broader and more complex bodies of research with greater efficiency [11].”
Open Schooling in Science Education: A Systematic Literature Review
Cruz-Lorite, I. M., Nikolaou, M., Nisiforou, E. A., & Evagorou, M. (2025) · European Journal of Educational Research · doi:10.12973/eu-jer.14.4.1063 · Cited by 3
Invited Response to “Artificial Intelligence in Rhinoplasty: Precision or Over-Reliance?”
Genovese, A., Prabha, S., & Forte, A. J. (2025) · Aesthetic Plastic Surgery · doi:10.1007/s00266-025-05058-6 · Cited by 2
Autonomous Mobile Station for Artificial Intelligence Monitoring of Mining Equipment and Risks
Cerna, G. P., Vidal, G. H., & Coronado-Hernández, J. R. (2025) · Applied Sciences · doi:10.3390/app15084197 · Cited by 5
The Rise of the Research Automaton: Science as process or product in the era of generative AI?Preprint
Sætra, H. S. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5219722 · Cited by 2
Anthuvan, T., Nagendra, L., Lakhani, O., Prabhuram, S., Rizvi, A. H., Maheshwari, K., & Kalra, S. (2025) · doi:10.2139/ssrn.5394918 · Cited by 2
Inteligencia Artificial en salud
Cabra‐Bautista, G. (2024) · Revista de la Facultad de Ciencias de la Salud Universidad del Cauca · doi:10.47373/rfcs.2024.v26.2580 · Cited by 2
“Su uso en decisiones críticas exige supervisión constante para prevenir errores que puedan afectar negativamente los resultados clínicos o de investigación (3,5,11).”
InfluentialHighlighting Case Studies in LLM Literature Review of Interdisciplinary System Science
McGinness, L. P., Baumgartner, P., Onyango, E., & Lema, Z. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0348-0_3 · Cited by 8
Ethical Considerations in Artificial Intelligence Development
Gowtham raj, R., & Logeshwari, P. (2024) · International Journal of Research Publication and Reviews · doi:10.55248/gengpi.5.0624.1453 · Cited by 3
Oelen, A., Jaradeh, M. Y., & Auer, S. (2026) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-97207-2_2 · Cited by 2
Integrating Large Language Models and knowledge graphs to capture political viewpoints in news media
Fadda, M., Motta, E., Osborne, F., Recupero, D. R., & Salatino, A. A. (2026) · EPJ Data Science · doi:10.1140/epjds/s13688-026-00678-7 · Cited by 2
Self-citationNúñez-Gómez, D., Bini, L., Nin, S., Legua, P., Martínez-Nicolás, J. J., & Giordani, E. (2026) · Scientia Horticulturae · doi:10.1016/j.scienta.2026.114978 · Cited by 2
Trubbach, S., Johannesen, E., & Platjouw, F. M. (2026) · Frontiers in Ocean Sustainability · doi:10.3389/focsu.2026.1768173 · Cited by 2
ChatGPT and higher education in Latin America: measuring perceived academic skills
George-Reyes, C. E., Romero, C. A., Mérida-Córdova, E. J., & Yeguas-Bolívar, E. (2026) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2026.1816902 · Cited by 2
Metadata
- Authors
- Bolaños, F., Salatino, A., Osborne, F., & Motta, E.
- Affiliations
- The Open University (GB)
- Corresponding author
- Bolaños, Francisco
- Venue
- Artificial Intelligence Review
- Published
- 2024-08-17
- Volume
- 57
- Issue
- 10
- ISSN
- 0269-2821 (ISSN-L)
- 1573-7462
- OpenAlex
- W4401667275
- Cited by
- 246
- References
- 170
- Citations by year
- 2026: 124 · 2025: 103 · 2024: 19
- FWCI
- 69.13
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Artificial Intelligence Review (publishedVersion, cc-by)
- Open Research Online (The Open University) (acceptedVersion, cc-by)
- BOA (University of Milano-Bicocca) (submittedVersion, cc-by)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- artificial intelligence, systematic reviews, large language models, literature screening, data extraction, knowledge graphs, academic writing support, usability, transparency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.