The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
Evaluation of Sentiment Analysis in Finance: From Lexicons to Transformers
Open accessAbstract
Financial and economic news is continuously monitored by financial market participants. According to the efficient market hypothesis, all past information is reflected in stock prices and new information is instantaneously absorbed in determining future stock prices. Hence, prompt extraction of positive or negative sentiments from news is very important for investment decision-making by traders, portfolio managers and investors. Sentiment analysis models can provide an efficient method for extracting actionable signals from the news. However, financial sentiment analysis is challenging due to domain-specific language and unavailability of large labeled datasets. General sentiment analysis models are ineffective when applied to specific domains such as finance. To overcome these challenges, we design an evaluation platform which we use to assess the effectiveness and performance of various sentiment analysis approaches, based on combinations of text representation methods and machine-learning classifiers. We perform more than one hundred experiments using publicly available datasets, labeled by financial experts. We start the evaluation with specific lexicons for sentiment analysis in finance and gradually build the study to include word and sentence encoders, up to the latest available NLP transformers. The results show improved efficiency of contextual embeddings in sentiment analysis compared to lexicons and fixed word and sentence encoders, even when large datasets are not available. Furthermore, distilled versions of NLP transformers produce comparable results to their larger teacher models, which makes them suitable for use in production environments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
(2014) · Cited by 33,419
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Enriching Word Vectors with Subword Information
Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00051 · Cited by 9,645
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2019) · arXiv · doi:10.48550/arxiv.1910.13461 · Cited by 8,816
Landauer, T. K., & Dumais, S. T. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.211 · Cited by 6,282
When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks
LOUGHRAN, T., & MCDONALD, B. (2011) · The Journal of Finance · doi:10.1111/j.1540-6261.2010.01625.x · Cited by 6,015
Unsupervised Cross-lingual Representation Learning at Scale
Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzmán, F., Grave, E., Ott, M., Zettlemoyer, L., & Stoyanov, V. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.747 · Cited by 5,637
Distributed Representations of Sentences and Documents
Le, Q. V., & Mikolov, T. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1405.4053 · Cited by 4,934
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
Hierarchical Attention Networks for Document Classification
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., & Hovy, E. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1174 · Cited by 4,712
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Sanh, V., Debut, L., Chaumond, J., & Wolf, T. (2019) · arXiv · doi:10.48550/arxiv.1910.01108 · Cited by 4,653
Bag of Tricks for Efficient Text Classification
Joulin, A., Grave, E., Bojanowski, P., & Mikolov, T. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers · doi:10.18653/v1/e17-2068 · Cited by 4,545
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2019) · arXiv · doi:10.48550/arxiv.1909.11942 · Cited by 4,308
Universal Language Model Fine-tuning for Text Classification
Howard, J., & Ruder, S. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1031 · Cited by 4,100
Deep Learning: Methods and Applications
Deng, L., & Yu, D. (2014) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000039 · Cited by 3,480
Deep learning for computer vision: A brief review
Voulodimos, A., Doulamis, N., Doulamis, A., & Protopapadakis, E. (2018) · Computational Intelligence and Neuroscience · doi:10.1155/2018/7068349 · Cited by 3,403
Character-level Convolutional Networks for Text Classification
Zhang, X., Zhao, J., & LeCun, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.01626 · Cited by 3,205
Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks
Tai, K. S., Socher, R., & Manning, C. D. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1150 · Cited by 3,081
From Frequency to Meaning: Vector Space Models of Semantics
Turney, P. D., & Pantel, P. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2934 · Cited by 2,866
Natural TTS Synthesis by Conditioning Wavenet on MEL Spectrogram Predictions
Shen, J., Pang, R., Weiss, R. J., Schuster, M., Jaitly, N., Yang, Z., Chen, Z., Zhang, Y., Wang, Y., Skerrv-Ryan, R., et al. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461368 · Cited by 2,791
Zhu, Y., Kiros, R., Zemel, R., Salakhutdinov, R., Urtasun, R., Torralba, A., & Fidler, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.11 · Cited by 2,264
The Efficient Market Hypothesis and Its Critics
Malkiel, B. G. (2003) · Journal of Economic Perspectives · doi:10.1257/089533003321164958 · Cited by 2,161
Supervised Learning of Universal Sentence Representations from Natural Language Inference Data
Conneau, A., Kiela, D., Schwenk, H., Barrault, L., & Bordes, A. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1070 · Cited by 2,049
Deep learning for sentiment analysis: A survey
Zhang, L., Wang, S., & Liu, B. (2018) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1253 · Cited by 1,928
Cross-lingual Language Model Pretraining
Lample, G., & Conneau, A. (2019) · arXiv · doi:10.48550/arxiv.1901.07291 · Cited by 1,586
Document Modeling with Gated Recurrent Neural Network for Sentiment Classification
Tang, D., Qin, B., & Liu, T. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1167 · Cited by 1,519
Kiros, R., Zhu, Y., Salakhutdinov, R., Zemel, R. S., Torralba, A., Urtasun, R., & Fidler, S. (2015) · arXiv · doi:10.48550/arxiv.1506.06726 · Cited by 1,293
Cer, D., Yang, Y., Kong, S.-Y., Hua, N., Limtiaco, N., John, R. S., Constant, N., Guajardo-Cespedes, M., Yuan, S., Tar, C., et al. (2018) · arXiv · doi:10.48550/arxiv.1803.11175 · Cited by 1,267 · cited 9×
“The results obtained from the evaluation of sentence encoders are presented in fully connected dense layers which averages FastText word embeddings, thus outperforming Doc2Vec, Universal Sentence Encoder (USE), Skip-Thought-Vectors, and LASER.”
BackgroundInfluentialDeng, L., Hinton, G., & Kingsbury, B. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639344 · Cited by 1,178
Bidirectional LSTM with attention mechanism and convolutional layer for text classification
Liu, G., & Guo, J. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.01.078 · Cited by 1,127
Contextual String Embeddings for Sequence Labeling
Akbik, A., Blythe, D. A. J., & Vollgraf, R. (2018) · International Conference on Computational Linguistics · Cited by 1,086
The General Inquirer: A Computer Approach to Content Analysis
Green, B. F., Stone, P. J., Dunphy, D. C., Smith, M. S., & Ogilvie, D. M. (1967) · American Educational Research Journal · doi:10.2307/1161774 · Cited by 1,013
Recurrent Neural Network for Text Classification with Multi-Task Learning
Liu, P., Qiu, X., & Huang, X. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.05101 · Cited by 972
Deep Pyramid Convolutional Neural Networks for Text Categorization
Johnson, R., & Zhang, T. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1052 · Cited by 823
Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond
Artetxe, M., & Schwenk, H. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00288 · Cited by 791
The effect of manager-specific optimism on the tone of earnings conference calls
Davis, A. K., Ge, W., Matsumoto, D., & Zhang, J. L. (2015) · Review of Accounting Studies · doi:10.1007/s11142-014-9309-4 · Cited by 592
Disclosure Tone and Shareholder Litigation
Rogers, J. L., Van Buskirk, A., & Zechman, S. L. C. (2011) · SSRN Electronic Journal · doi:10.2139/ssrn.1331608 · Cited by 592
Sahlgren, M. (2006) · Diva portal (Dalarna University Library) · Cited by 527
Good debt or bad debt: Detecting semantic orientations in economic texts
Malo, P., Sinha, A., Korhonen, P., Wallenius, J., & Takala, P. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23062 · Cited by 513 · cited 1×
“The Financial Phrase-Bank dataset [69] consists of 4845 English sentences selected randomly from financial news found on the LexisNexis database.”
MethodNews impact on stock price return via sentiment analysis
Li, X., Xie, H., Chen, L., Wang, J., & Deng, X. (2014) · Knowledge-Based Systems · doi:10.1016/j.knosys.2014.04.022 · Cited by 503
Ghiassi, M., Skinner, J., & Zimbra, D. (2013) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.05.057 · Cited by 485
Deep Learning and Its Applications to Signal and Information Processing [Exploratory DSP
Yu, D., & Deng, L. (2011) · IEEE Signal Processing Magazine · doi:10.1109/msp.2010.939038 · Cited by 455
An efficient framework for learning sentence representations
Logeswaran, L., & Lee, H. (2018) · arXiv · doi:10.48550/arxiv.1803.02893 · Cited by 427
Big Data: Deep Learning for financial sentiment analysis
Sohangir, S., Wang, D., Pomeranets, A., & Khoshgoftaar, T. M. (2018) · Journal of Big Data · doi:10.1186/s40537-017-0111-6 · Cited by 390
Sentiment analysis based on improved pre-trained word embeddings
Rezaeinia, S. M., Rahmani, R., Ghodsi, A., & Veisi, H. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.08.044 · Cited by 325
Deep voice 3: scaling text-to-speech with convolutional sequence learning
Ping, W., Peng, K., Gibiansky, A., Arik, S. O., Kannan, A., Narang, S., Raiman, J., & Miller, J. (2017) · arXiv · doi:10.48550/arxiv.1710.07654 · Cited by 313
Trading Strategies to Exploit Blog and News Sentiment
Zhang, W., & Skiena, S. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14075 · Cited by 252
SemEval-2017 Task 5: Fine-Grained Sentiment Analysis on Financial Microblogs and News
Cortis, K., Freitas, A., Daudert, T., Huerlimann, M., Zarrouk, M., Handschuh, S., & Davis, B. (2017) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s17-2089 · Cited by 231
Deep learning for financial sentiment analysis on finance news providers
Day, M.-Y., & Lee, C.-C. (2016) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1109/asonam.2016.7752381 · Cited by 199
Deep CNN-LSTM with combined kernels from multiple branches for IMDb review sentiment analysis
Yenter, A., & Verma, A. (2017) · 2017 IEEE 8th Annual Ubiquitous Computing, Electronics and Mobile Communication Conference (UEMCON) · doi:10.1109/uemcon.2017.8249013 · Cited by 170
Predictive Sentiment Analysis of Tweets: A Stock Market Application
Smailović, J., Grćar, M., Lavrač, N., & Žnidaršič, M. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39146-0_8 · Cited by 161
Enhanced news sentiment analysis using deep learning methods
Souma, W., Vodenska, I., & Aoyama, H. (2019) · Journal of Computational Social Science · doi:10.1007/s42001-019-00035-x · Cited by 153
Self-citationAnalyzing Stock Market Movements Using Twitter Sentiment Analysis
Rao, T., & Srivastava, S. (2012) · Lincoln Repository (University of Lincoln) · doi:10.1109/asonam.2012.30 · Cited by 151
Financial Sentiment Lexicon Analysis
Sohangir, S., Petty, N., & Wang, D. (2018) · IEEE International Conference on Semantic Computing (ICSC) · doi:10.1109/icsc.2018.00052 · Cited by 123
Al-Garadi, M. A., Yang, Y., Cai, H., Ruan, Y., O’Connor, K., Gonzalez‐Hernandez, G., Perrone, J., & Sarker, A. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01394-0 · Cited by 122
A BERT based Sentiment Analysis and Key Entity Detection Approach for Online Financial Texts
Zhao, L., Li, L., Zheng, X., & Zhang, J. (2021) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd49262.2021.9437616 · Cited by 104
Crowds on Wall Street: Extracting Value from Collaborative Investing Platforms
Wang, G., Wang, T., Wang, B., Sambasivan, D., Zhang, Z., Zheng, H., & Zhao, B. Y. (2015) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2675133.2675144 · Cited by 93
Financial Sentiment Analysis(FSA): A Survey
Man, X., Tong, L., & Lin, J. (2019) · IEEE International Conference on Industrial Cyber-Physical Systems (ICPS) · doi:10.1109/icphys.2019.8780312 · Cited by 72
Lauren, P., Qu, G., Yang, J., Watta, P. B., Huang, G.-B., & Lendasse, A. (2018) · Cognitive Computation · doi:10.1007/s12559-018-9548-y · Cited by 57
Vector representation of words for sentiment analysis using GloVe
Sharma, Y., Agrawal, G., Jain, P., & Kumar, T. (2017) · International Conference on Intelligent Communication and Computational Techniques (ICCT) · doi:10.1109/intelcct.2017.8324059 · Cited by 56
Improving Arabic sentiment analysis with sentiment-specific embeddings
Altowayan, A. A., & Elnagar, A. (2017) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2017.8258460 · Cited by 38
Crone, S. F., & Koeppel, C. (2014) · IEEE Conference on Computational Intelligence for Financial Engineering & Economics · doi:10.1109/cifer.2014.6924062 · Cited by 35
COUPLED NETWORK APPROACH TO PREDICTABILITY OF FINANCIAL MARKET RETURNS AND NEWS SENTIMENTS
Curme, C., Stanley, E., & Vodenska, I. (2015) · International Journal of Theoretical and Applied Finance · doi:10.1142/s0219024915500430 · Cited by 32
Self-citationFine-Grained Sentiment Analysis on Financial Microblogs and News Headlines
Atzeni, M., Dridi, A., & Recupero, D. R. (2017) · Communications in computer and information science · doi:10.1007/978-3-319-69146-6_11 · Cited by 30
Sentiment Analysis Using Learning Approaches Over Emojis for Turkish Tweets
Velioğlu, R., Yıldız, T., & Yıldırım, S. (2018) · International Conference on Computer Science and Engineering (UBMK) · doi:10.1109/ubmk.2018.8566260 · Cited by 27
Financial Aspect-Based Sentiment Analysis using Deep RepresentationsPreprint
Yang, S. Y., Rosenfeld, J., & Makutonin, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.07931 · Cited by 24
Performance Evaluation of Word and Sentence Embeddings for Finance Headlines Sentiment Analysis
Mishev, K., Gjorgjevikj, A., Stojanov, R., Mishkovski, I., Vodenska, I., Chitkushev, L. T., & Trajanov, D. (2019) · Communications in computer and information science · doi:10.1007/978-3-030-33110-8_14 · Cited by 16
Self-citationBeyond Word-level to Sentence-level Sentiment Analysis for Financial Reports
Du, C.-H., Tsai, M.-F., & Wang, C. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683085 · Cited by 15
Forecasting Corporate Revenue by Using Deep-Learning Methodologies
Mishev, K., Gjorgjevikj, A., Vodenska, I., Chitkushev, L. T., Souma, W., & Trajanov, D. (2019) · International Conference on Control, Artificial Intelligence, Robotics & Optimization (ICCAIRO) · doi:10.1109/iccairo47923.2019.00026 · Cited by 12
Self-citation
Cited by
Recent advancements and challenges of NLP-based sentiment analysis: A state-of-the-art review
Jim, J. R., Talukder, M. A. R., Malakar, P., Kabir, M. M., Nur, K., & Mridha, M. F. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2024.100059 · Cited by 297
Anbaee Farimani, S., Vafaei Jahan, M., Milani Fard, A., & Tabbakh, S. R. K. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108742 · Cited by 93
A heterogeneous stacking ensemble based sentiment analysis framework using multiple word embeddings
Subba, B., & Kumari, S. (2022) · Computational Intelligence · doi:10.1111/coin.12478 · Cited by 41
On Assessing the Performance of LLMs for Target-Level Sentiment Analysis in Financial News Headlines
Muhammad, I., & Rospocher, M. (2025) · Algorithms · doi:10.3390/a18010046 · Cited by 14
On the impact of publicly available news and information transfer to financial markets
Jazbec, M., Pàsztor, B., Faltings, F., Antulov-Fantulin, N., & Kolm, P. N. (2021) · Royal Society Open Science · doi:10.1098/rsos.202321 · Cited by 3
Metadata
- Authors
- Mishev, K., Gjorgjevikj, A., Vodenska, I., Chitkushev, L. T., & Trajanov, D.
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 131662-131682
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3043424630
- Cited by
- 345
- References
- 83
- FWCI
- 11.46
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.