The DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index; none of the 58 sources its claims cite is checked for support yet.
A Critical Review on Citation Recommendation Systems Through a Graph-Centric Approach
Open accessAbstract
The rapid growth of digital scholarly content has made citation recommendation central to literature discovery. This survey organizes the field through a graph-centric lens, unifying unipartite, bipartite, and k -partite formulations and the typed relations that connect papers, authors, venues, concepts, and time. Despite growing research, several critical gaps remain in citation recommendation: (i) heterogeneous relations are underutilized, limiting the ability to model complex interactions; (ii) temporal dynamics and real-time updates are rarely incorporated, restricting adaptivity; (iii) social and serendipity signals (e.g., co-reading, communities, novelty/diversity) are largely neglected, reducing user-centric utility; (iv) cross-lingual and cross-domain transfer is underexplored, limiting global applicability; and (v) evaluation practices remain fragmented, emphasizing accuracy over transparency, diversity, and robustness. We consolidate datasets, tasks, and metrics, and outline a roadmap emphasizing relation-weighted heterogeneous graphs, temporally adaptive learners, cross-lingual alignment, explanation-aware objectives, and deployable pipelines with open artifacts. This graph-centric perspective surfaces actionable gaps and opportunities for building citation recommenders that are accurate, transparent, and production-ready.
Overview
CoChat Summary
TL;DR
This survey reframes citation recommendation through a graph-centric lens, synthesizing uni-, bi-, and k-partite formulations, typed relations, and temporal dynamics across 56 included studies. It identifies five key gaps—relation-aware modeling, temporal/streaming updates, social/serendipity signals, cross-lingual/cross-domain generalization, and fragmented evaluation—and offers a roadmap toward reproducible, deployable systems.
Key findings
- The survey’s synthesis highlights five key findings: heterogeneous relations benefit from relation-aware weighting; temporal evolution and streaming updates are underutilized; social and serendipity signals are often neglected; cross-lingual and cross-domain generalization remains limited; and evaluation practices are fragmented, focusing mainly on accuracy over diversity, fairness, robustness, and deployability.
- The PRISMA-guided search retrieved 236 records; after removing 78 duplicates, 158 unique studies were screened, 102 were excluded at title/abstract, and 56 underwent full-text assessment and were included.
- Data sparsity remains severe: systems routinely face interaction matrices/tensors with >99% missing entries; for a 3D tensor with n=1000 users, m=2000 papers, k=300 time periods, and r=1000 interactions, density ≈ 0.000167% and sparsity ≈ 99.999833%.
- Reproducibility and deployment gaps persist: only 5 out of 47 studies made their code publicly accessible, and real-world platforms such as Mendeley, PubMed, and ResearchGate continue to rely on traditional information filtering rather than state-of-the-art citation recommendation methods.
Methods
- PRISMA-guided literature survey searching DBLP, IEEE Xplore, ACM Digital Library, Scopus, Web of Science, arXiv, and OpenAlex for works published between January 2010 and October 2025, with queries targeting citation recommendation, graph/GNN/HIN/meta-path, transformer/LLM/SciBERT/SPECTER, RAG, and cross-lingual/multilingual alignment.
- After deduplication, 158 unique records were screened by title/abstract, followed by full-text assessment; two reviewers applied inclusion/exclusion criteria, resolving disagreements by discussion, yielding 56 included studies.
- For each included paper, the authors extracted task type (global vs. local), input modalities, graph construction, modeling approach, datasets, and evaluation; the analysis uses a graph-centric taxonomy unifying uni/bi/k-partite formulations and typed edges, plus a diagnostic synthesis of five problem axes. The paper states it is a survey and does not present new experimental results or case studies.
Limitations
- The paper states it is a survey and does not present new experimental results or case studies; it also states that it does not provide empirical benchmarks.
- The paper states that evaluation and reproducibility are fragmented in the field, with accuracy favored over transparency, diversity, and robustness, and that only 5 out of 47 studies made code publicly accessible.
- Evident from the text: the review is restricted to works published between January 2010 and October 2025 and excludes non-English/abstract-only items and generic paper recommendation without a citation objective, so its synthesis depends on prior literature and reported metrics.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures








Verification
Claims the paper makes
0 Valid · 8 Not valid · 38 Not checked · 68 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Among these works, the predominant topic (about 88%) revolves around models for citation and article recommendation.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“(iv) cross-lingual and cross-domain generalization remains limited”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
- Rests on 4 assumptions not shown here.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This overlap complicates the task of identifying relevant literature using keyword-based search alone, especially on platforms such as Google Scholar, 3 Semantic Scholar, 4 and the ACM Digital Library, 5 where semantically adjacent topics often surface jointly due to their similar linguistic patterns.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A statement the paper makes itself — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Unlike other recommendation domains where user interactions or attendance data are readily accessible, citation datasets often lack comprehensive records of users' past interactions with the scholarly literature.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The absence of user interaction data presents a significant hurdle in personalizing citation recommendations based on individual preferences and behaviors.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
15 more claims
Create a free account to see all 114 claims and to verify the 55 references still open.
- Probably not a substantial claim. 82
- It may state two separate claims as one. 45
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Sparsity Versus Cold Start
“MAAE by Galke et al. [23] combines a generative adversarial network with an auto-encoder”
§ References
“23. Liao W, Zhang Q, Yuan B, Zhang G, Lu J. Heterogeneous multi- domain recommender system through adversarial learning.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Included studies and data extraction
“Models like dual attention for citation recommendation [81]”
§ References
“81. Tian Y, Zheng B, Wang Y, Zhang Y, Wu Q. College library per- sonalized recommendation system based on hybrid recommenda- tion algorithm.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Pavlos Kefalas 1,2 • Zafar Ali 3 • Yannis Manolopoulos 4,5 (2026) 7:267
“We followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) protocol to guide our literature selection [53].”
§ References
“53. Järvelin K, Kekäläinen J. Cumulated gain-based evaluation of IR techniques. ACM Trans Inf Syst. 2002;20(4):422-46.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Justification versus Personalization
“Uchiyama et al. [67] conducted a rigorous experiment to evaluate the efficacy of two distinct methodologies in cross-lingual citation recommendation systems.”
§ References
“67. Zhang Y, Chen X. Explainable recommendation: a survey and new perspectives.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Cross-Lingual Context
“Jiang, Zhuoren, et al. [30] have proposed a sophisticated framework termed crosslanguage citation recommendation via hierarchical representation learning on heterogeneous graph (HRLHG).”
§ References
“30. Mhirsi N, Boukhris I. Exploring location and ranking for aca- demic venue recommendation.”
5 more findings
Create a free account to see every finding of this check.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Introduction to Information Retrieval
Manning, C. D., Raghavan, P., & Schütze, H. (2008) · doi:10.1017/cbo9780511809071 · Cited by 11,288
Adomavicius, G., & Tuzhilin, A. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.99 · Cited by 10,310
Cumulated gain-based evaluation of IR techniques
Järvelin, K., & Kekäläinen, J. (2002) · ACM Transactions on Information Systems · doi:10.1145/582415.582418 · Cited by 4,841
The ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 4,567
Deep Learning Based Recommender System: A Survey and New Perspectives
Zhang, S., Yao, L., Sun, A., & Tay, Y. (2020) · ACM Computing Surveys · doi:10.1145/3285029 · Cited by 3,485
The probabilistic relevance framework: BM25 and beyond
Robertson, S., & Zaragoza, H. (2009) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000019 · Cited by 3,374
Content-based Recommender Systems: State of the Art and Trends
Lops, P., de Gemmis, M., & Semeraro, G. (2011) · Recommender Systems Handbook · doi:10.1007/978-0-387-85820-3_3 · Cited by 1,898
Performance of recommender algorithms on top-n recommendation tasks
Cremonesi, P., Koren, Y., & Turrin, R. (2010) · Proceedings of the fourth ACM conference on Recommender systems · doi:10.1145/1864708.1864721 · Cited by 1,410
Research works printed but not linked: 5
- Buckley C, Voorhees EM. Evaluation of retrieval systems. In Proceedings of the 27th ACM annual international conference on research & development in information retrieval (SIGIR). 2004;1–12.
- Hidasi B, Karatzoglou A, Baltrunas L, Tikk D. Session-based recommendations with recurrent neural networks. In Proceedings of the 4th international conference on learning representations (ICLR). 2016.
- Liu T-Y. Learning to rank for information retrieval. Berlin: Springer; 2009.
- Rohatgi S. Design and data mining techniques for large-scale scholarly digital libraries and search engines. University Park: The Pennsylvania State University; 2023.
- Salton G, McGill MJ. Introduction to modern information retrieval. Columbus: McGraw-Hill; 1988.
Cited by
Experimental Evaluation of Related Papers Finding Techniques
Idrees, M. A., Qadir, M. A., & Nageen, M. (2026) · International Journal of Innovations in Science and Technology · doi:10.33411/ijist/1790
Nurjahan, V. A., & Jancy, S. (2026) · International Research Journal of Multidisciplinary Technovation · doi:10.54392/irjmt2654
Lei, M., & Sui, J. (2026) · International Conference on Artificial Intelligence, Internet of Things and Cloud Computing Technology (AIoTC) · doi:10.1109/aiotc71250.2026.11688544
Zhang, J., Li, H., & Liu, D. (2026) · Scientometrics · doi:10.1007/s11192-026-05875-9
Metadata
- Authors
- Kefalas, P., Ali, Z., & Manolopoulos, Y.
- Affiliations
- Aristotle University of Thessaloniki (GR)
- Southeast University (CN)
- University of Nicosia (CY)
- Corresponding author
- Manolopoulos, Yannis
- Venue
- SN Computer Science
- Published
- 2026-03-09
- Volume
- 7
- Issue
- 3
- ISSN
- 2661-8907 (ISSN-L)
- OpenAlex
- W7134273351
- Semantic Scholar
- d9a613b561e1eefc3cd448f6ba60d486e96d8d0a
- Cited by
- 4
- References
- 78
- Citations by year
- 2026: 4
- FWCI
- 10.52
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- SN Computer Science (publishedVersion, cc-by)
- Funders
- University of Nicosia
- Topics
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Complex Network Analysis Techniques
- Keywords
- citation recommendation, graph neural networks, heterogeneous graphs, bipartite graphs, k-partite graphs, temporal dynamics, shared reading, serendipity, cross-lingual transfer, cross-domain transfer, recommendation evaluation, literature discovery, scientific information retrieval
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-18, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-18 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.