Cited by 19Biomedical Text Mining and OntologiesTopic ModelingAdvanced Text Analysis Techniques

LLM Based Biological Named Entity Recognition from Scientific Literature

Jung, Sung Jae, Kim, Hajung, Jang, Kyoung Sang·2024·2024 IEEE International Conference on Big Data and Smart Computing (BigComp)

Abstract

Recently, the application of Large Language Models (LLMs) in the field of natural language processing has witnessed remarkable growth, revolutionizing the field of bioinformatics by automating the extraction of biological entities from scientific literature. This study presents the development and evaluation of a Biological Named Entity Recognizer (BNER) using a pre-trained Large Language Model (LLM) refined through prompt engineering. The BNER was tailored to identify proteins, genes, and small molecules within scientific texts, specifically targeting the context of p53 protein-related research. To assess the BNER's efficacy, we curated a dataset comprising ten paragraphs extracted from the abstracts and significant sections of five high-relevance scientific papers. The system's performance was quantified through an entity recognition task, resulting in 51 true positives (TP), 10 false positives (FP), and 3 false negatives (FN). The BNER achieved an F1 score of 0.887, demonstrating a high degree of precision and recall. These results validate the utility of LLMs in bioinformatics and highlight the BNER's potential to support and accelerate scientific discovery by providing accurate, structured data outputs suitable for comprehensive analysis.

Integrity signals

Registry

Crossref · 10.1109/bigcomp60711.2024.00095

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Jung, S. J., Kim, H., & Jang, K. S.
Affiliations
  • En-Core Inc.,Division of DG and AI Business,Seoul,South Korea
  • En-Core Inc.,Division of DT Business,Seoul,South Korea
Venue
2024 IEEE International Conference on Big Data and Smart Computing (BigComp)
Publisher
IEEE
Published
2024-02-18
Pages
433-435
OpenAlex
W4394713233
Cited by
19
References
8
Citations by year
2026: 8 · 2025: 10 · 2024: 1
FWCI
34.34
Type
conference paper
Language
en
Open access
closed
Locations
IEEE International Conference on Big Data and Smart Computing (BigComp) (publishedVersion)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Biomedical Text Mining and Ontologies
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
Keywords
large language models, prompt engineering, p53, protein extraction, gene extraction, scientific publications, bioinformatics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review