Natural language processing in the era of large language models
Open accessThe DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Abstract
SPECIALTY GRAND CHALLENGE article Front. Artif. Intell., 12 January 2024Sec. Natural Language Processing Volume 6 - 2023 | https://doi.org/10.3389/frai.2023.1350306
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, when applied to patient-specific data retrieval, LLMs face significant limitations, most notably lacking necessary context grounding, leading to hallucinations (plausible sounding but factually incorrect information) (7, 8).”
From Unlocking electronic health records: a hybrid graph RAG approach to safe clinical AI for patient QA (2026) · cites this paper as [7]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 1×
“…et al., 2014) for compact representation of words in the form of embeddings, the first major wave came with the emergence of LLMs built on top of the Transformer architecture (Vaswani et al., 2017), including BERT (Devlin et al., 2019), RoBERTa (Liu et al., 2019) and T5 (Raffel et al., 2020).”
MethodBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515 · cited 2×
“…et al., 2014) for compact representation of words in the form of embeddings, the first major wave came with the emergence of LLMs built on top of the Transformer architecture (Vaswani et al., 2017), including BERT (Devlin et al., 2019), RoBERTa (Liu et al., 2019) and T5 (Raffel et al., 2020).”
MethodAdvances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361
Cited by
Synthetic Data Generation Using Large Language Models: Advances in Text and Code
Nadas, M. D., Dioşan, L. S., & Tomescu, A. (2025) · IEEE Access · doi:10.1109/access.2025.3589503 · Cited by 225
“Focus on models with at least several hundred million parameters (to ensure relevance to the LLM paradigm), including both proprietary (e.g., GPT-3/4, Claude, Gemini) and open-source (e.g., Llama, CodeLlama, StarCoder) models.”
Ai-Based Chatbot Interactions and Critical Thinking Skills: An Exploratory Study
Fabio, R. A., Plebe, A., & Suriano, R. (2025) · Current Psychology · doi:10.1007/s12144-024-06795-8 · Cited by 49
Policies on artificial intelligence chatbots among academic publishers: a cross-sectional audit
Bhavsar, D., Duffy, L., Jo, H., Lokker, C., Haynes, R. B., Iorio, A., Marušić, A., & Ng, J. Y. (2025) · Research Integrity and Peer Review · doi:10.1186/s41073-025-00158-y · Cited by 46
Can large language models detect drug–drug interactions leading to adverse drug reactions?
Sicard, J., Montastruc, F., Achalme, C., Jonville-Bera, A. P., Songue, P., Babin, M., Soeiro, T., Schiro, P., de Canecaude, C., & Barus, R. (2025) · Therapeutic Advances in Drug Safety · doi:10.1177/20420986251339358 · Cited by 29
Rancati, S., Bosoni, P., Schiaffini, R., Deodati, A., Mongini, P. A., Sacchi, L., Toffanin, C., & Bellazzi, R. (2024) · Diabetology · doi:10.3390/diabetology5060042 · Cited by 31
“In recent years, the development and proliferation of large language models (LLMs) and transformer-based generative models, along with the attention mechanism, have rev-olutionized the state of the art in Natural Language Processing (NLP) tasks [1].”
Metadata
- Authors
- Zubiaga, A.
- Affiliations
- Queen Mary University of London (GB)
- Corresponding author
- Zubiaga, Arkaitz
- ORCID
- Zubiaga, Arkaitz
- Venue
- Frontiers in Artificial Intelligence
- Publisher
- Frontiers Media SA
- Published
- 2024-01-12
- Volume
- 6
- Pages
- 1350306-1350306
- ISSN
- 2624-8212 (ISSN-L)
- PMC
- PMC10820986
- OpenAlex
- W4390790246
- Cited by
- 81
- References
- 59
- Citations by year
- 2026: 33 · 2025: 36 · 2024: 12
- FWCI
- 11.88
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Artificial Intelligence (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- natural language processing, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Natural language processing in the era of large language models. https://app.cochat.ai/papers/10.3389/frai.2023.1350306
- The paper
- Zubiaga, A. (2024). Natural language processing in the era of large language models. Frontiers in Artificial Intelligence. https://doi.org/10.3389/frai.2023.1350306
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.