Automatic Related Work Section in Scientific Article: Research Trends and Future Directions
The DOI matches its Crossref record; 39 of the 40 references it cites were found in a registry or an index.
Abstract
Related work plays an important role in the scientific article to track the history of topic evolution and demonstrate the improvement of the proposed method. Writing related work tasks could be arduous for young researchers and scholars. Some studies have attempted to design systems to ease this work besides improving the quality of related work produced. Initially, the research focused on extractive approaches by exploiting the heuristic method, machine learning, or graph-based methods. Recently, deep learning and its variants have become more popular because they can handle abstractive approaches. We propose five research questions that direct discussion and analysis of research in related work summarization. We look for answers to this research question in scientific articles on ScienceDirect, Web of Science, or the Google Scholar Database. This research presents a widespread survey about the trends in related work tasks: related work structure, important aspects, scientific corpora standards, prior proposed methods, baseline systems comparison, evaluation metrics, and challenges in the future. The results of this study provide an overview of research trends in related work summarization, as well as describe research gaps and future research that can still be developed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Historically, this stage did not benefit from the use of artificial intelligence techniques (Justitia and Wang 2022; Li and Ouyang 2022).”
From Artificial intelligence for literature reviews: opportunities and challenges (2024) · cites this paper as Justitia and Wang 2022
Citations
Cites
Bleu: a method for automatic evaluation of machine translation
Papineni, K. (2024) · doi:10.57702/ljteqmrb · Cited by 3,672
BERTScore: Evaluating Text Generation with BERT
Zhang, T., Kishore, V., Wu, F., Weinberger, K. Q., & Artzi, Y. (2019) · arXiv · doi:10.48550/arxiv.1904.09675 · Cited by 2,865 · cited 1×
“More recently, BERTScore computes semantic similarities using contextual embeddings [39].”
MethodMeteor Universal: Language Specific Translation Evaluation for Any Target Language
Denkowski, M., & Lavie, A. (2014) · Proceedings of the Ninth Workshop on Statistical Machine Translation · doi:10.3115/v1/w14-3348 · Cited by 1,952 · cited 1×
“Meteor [35] and BLEU [36] are two well-known machine translation assessment measures that also work well in text summarization.”
BackgroundLexRank: Graph-based Lexical Centrality as Salience in Text Summarization
Erkan, G., & Radev, D. R. (2004) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1523 · Cited by 1,700 · cited 1×
“LextRank, introduced by [32], uses the random walk approach to rank sentences in a graph-based summarization.”
MethodAutomatic text summarization: A comprehensive survey
El-Kassas, W. S., Salama, C. R., Rafea, A. A., & Mohamed, H. K. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113679 · Cited by 809 · cited 3×
“In the extractive approach, the summarizer combines the most important sentences from the original article [4].”
BackgroundMethodTextRank: Bringing Order into Texts
Mihalcea, R., & Tarau, P. (2004) · University of North Texas Digital Library (University of North Texas) · Cited by 632
MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance
Zhao, W., Peyrard, M., Liu, F., Gao, Y., Meyer, C. M., & Eger, S. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1053 · Cited by 490 · cited 1×
“MoverScore [38] also combines contextualized embeddings with Earth Mover's Distance, which calculates the semantic distance between texts.”
BackgroundWikipedia-based Semantic Interpretation for Natural Language Processing
Gabrilovich, E., & Markovitch, S. (2009) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2669 · Cited by 377 · cited 1×
“Unfortunately, the lexical character in the thesaurus is powerful where the individual words are used to find the high similarity values of other similar words [22].”
BackgroundMEAD - A Platform for Multidocument Multilingual Text Summarization
Radev, D., Allison, T., Blair-Goldensohn, S., Blitzer, J. C., Çelebi, A., Dimitrov, S., Drábek, E. F., Hakim, A., Lam, W. P., Liu, D., et al. (2004) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2nevc4eu3swt · Cited by 335
Yasunaga, M., Kasai, J., Zhang, R., Fabbri, A. R., Li, I., Friedman, D., & Radev, D. R. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33017386 · Cited by 192 · cited 2×
“[23] - - X X - X X - - ScisummNet [40] corpus 1000 set papers 8 set target papers from computer science field INPUT SYSTEM Papers with their citation sentences Abstractive Approach”
Background
Research works printed but not linked: 5
- lin, 2004, ROUGE: A Package for Automatic Evaluation of Summaries Chin-Yew, Text Summa-rization Branches out, 74
- team, 2021, Example of Methodology in a Research Paper (With Definition)
- 2022, Learn how to write a review of literature, The Writing Center University of Wisconsin - Madison
- steinberger, 2004, Using Latent Semantic Analysis in text summarization and summary evaluation, Proc ISIMVSP, 93
- chen, 2016, Summarizing Related Work through Citations, International Conference on Semantics Knowledge and Grid, 54
Cited by
Artificial intelligence for literature reviews: opportunities and challenges
Bolaños, F., Salatino, A., Osborne, F., & Motta, E. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10902-3 · Cited by 246
“This section will discuss some of the key research challenges identified from our analysis that the academic community will need to address in future work.”
InfluentialRashidov, A. (2024) · International Congress on Human-Computer Interaction, Optimization and Robotic Applications (ICHORA) · doi:10.1109/hora61326.2024.10550536 · Cited by 3
“Also, research teams are faced with the need to make sound and effective decisions when analyzing multiple options, while at the same time considering their own interests and expertise in the field [4].”
Background
Metadata
- Authors
- Justitia, A., & Wang, H.-C.
- Affiliations
- Universitas Airlangga (ID)
- National Cheng Kung University (TW)
- Venue
- 2022 International Seminar on Intelligent Technology and Its Applications (ISITIA)
- Publisher
- IEEE
- Published
- 2022-07-20
- Pages
- 108-114
- OpenAlex
- W4292388001
- Cited by
- 2
- References
- 40
- Citations by year
- 2024: 2
- FWCI
- 0.28
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Seminar on Intelligent Technology and Its Applications (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- research paper writing, literature review automation, extractive summarization, abstractive summarization, research trends, evaluation metrics, research gaps
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Automatic Related Work Section in Scientific Article: Research Trends and Future Directions. https://app.cochat.ai/papers/10.1109/isitia56226.2022.9855331
- The paper
- Justitia, A., & Wang, H.-C. (2022). Automatic Related Work Section in Scientific Article: Research Trends and Future Directions. 2022 International Seminar on Intelligent Technology and Its Applications (ISITIA). https://doi.org/10.1109/isitia56226.2022.9855331
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.