Emo2Vec: Learning Generalized Emotion Representation by Multi-task Training
Open accessThe DOI matches its Crossref record; 43 of the 45 references it cites were found in a registry or an index.
Abstract
In this paper, we propose Emo2Vec which encodes emotional semantics into vectors.We train Emo2Vec by multi-task learning six different emotion-related tasks, including emotion/sentiment analysis, sarcasm classification, stress detection, abusive language classification, insult detection, and personality recognition.Our evaluation of Emo2Vec shows that it outperforms existing affect-related representations, such as Sentiment-Specific Word Embedding and DeepMoji embeddings with much smaller training corpora.When concatenated with GloVe, Emo2Vec achieves competitive performances to state-of-the-art results on several tasks using a simple logistic regression classifier.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Experiments revealed that Emo2Vec surpasses conventional word embedding techniques in numerous emotion-driven tasks.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [65]
The cited source says what the claim attributes to it.
In the citing paper
“Xu et al. [65] unveiled Emo2Vec, embedding emotional semantics into fixed-size vector representations at the word level.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [65]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 8×
“Compared with CNN embedding : Emo2Vec works better than CNN embedding on 14/18 datasets, giving 2.6% absolute accuracy improvement for the sentiment task and 1.6% absolute f1-score improvement on the other tasks.”
MethodInfluentialGlove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071 · cited 1×
“Recent work on word representation has been focusing on embedding syntactic and semantic information into fixed-sized vectors (Mikolov et al., 2013; Pennington et al., 2014) based on the distributional hypothesis, and have proven to be useful in many natural language tasks (Collobert et al., 2011).”
BackgroundDistributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · cited 1×
“Recent work on word representation has been focusing on embedding syntactic and semantic information into fixed-sized vectors (Mikolov et al., 2013; Pennington et al., 2014) based on the distributional hypothesis, and have proven to be useful in many natural language tasks (Collobert et al., 2011).”
Background(2010) · International Conference on Machine Learning · Cited by 13,995
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878 · cited 2×
“(1,2) SST-fine and SST-binary (Socher et al., 2013) (3) OpeNER (Agerri et al., 2013) (Staiano and Guerini, 2014).”
BackgroundNatural Language Processing (almost) from Scratch
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. P. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.0398 · Cited by 4,962 · cited 1×
“Recent work on word representation has been focusing on embedding syntactic and semantic information into fixed-sized vectors (Mikolov et al., 2013; Pennington et al., 2014) based on the distributional hypothesis, and have proven to be useful in many natural language tasks (Collobert et al., 2011).”
BackgroundA Convolutional Neural Network for Modelling Sentences
Kalchbrenner, N., Grefenstette, E., & Blunsom, P. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1062 · Cited by 3,601
NLTK: the Natural Language Toolkit
Loper, E., & Bird, S. (2002) · Proceedings of the ACL-02 Workshop on Effective tools and methodologies for teaching natural language processing and computational linguistics - · doi:10.3115/1118108.1118117 · Cited by 3,218
Emotion knowledge: further exploration of a prototype approach
Shaver, P., Schwartz, J., Kirson, D., & O'Connor, C. (1987) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.52.6.1061 · Cited by 3,072 · cited 1×
“More tweets between January and October 2017 are additionally added using the Twitter Firehose API by us-ing the hashtags based on the hierarchy mentioned in Shaver et al. (1987).”
MethodAttention-based LSTM for Aspect-level Sentiment Classification
Wang, Y., Huang, M., zhu, X., & Zhao, L. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1058 · Cited by 2,450 · cited 1×
“Aspect-based sentiment (Chen et al., 2017; Wang et al., 2016) is also a hot topic where researchers care more about the sentiment towards a certain target.”
BackgroundTensor Fusion Network for Multimodal Sentiment Analysis
Zadeh, A., Chen, M., Poria, S., Cambria, E., & Morency, L.-P. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1115 · Cited by 2,102 · cited 1×
“Multi-modal sentiment analysis (Zadeh et al., 2017; Poria et al., 2017) extends text-based model to the combination of visual, acoustic and language, which achieves better results than the single modality.”
BackgroundLinguistic styles: language use as an individual difference
Pennebaker, J. W., & King, L. A. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.6.1296 · Cited by 1,961 · cited 1×
“(5) Personality (Pennebaker and King, 1999) (6) Insult.”
NLTK: The Natural Language Toolkit
Loper, E., & Bird, S. (2002) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0205028 · Cited by 1,844
Hateful Symbols or Hateful People? Predictive Features for Hate Speech Detection on Twitter
Waseem, Z., & Hovy, D. (2016) · Proceedings of the NAACL Student Research Workshop · doi:10.18653/v1/n16-2013 · Cited by 1,655 · cited 1×
“(1,2) SCv1-GEN and SCv2-GEN for sarcasm detection, (3) Stress (Winata et al., 2018), (4) Abu-sive (Waseem, 2016; Waseem and Hovy, 2016).”
A review of affective computing: From unimodal analysis to multimodal fusion
Poria, S., Cambria, E., Bajpai, R., & Hussain, A. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.003 · Cited by 1,644 · cited 1×
“Multi-modal sentiment analysis (Zadeh et al., 2017; Poria et al., 2017) extends text-based model to the combination of visual, acoustic and language, which achieves better results than the single modality.”
BackgroundSentiment strength detection in short informal text
Thelwall, M., Buckley, K., Paltoglou, G., Cai, D., & Kappas, A. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21416 · Cited by 1,449
Recurrent Attention Network on Memory for Aspect Sentiment Analysis
Chen, P., Sun, Z., Bing, L., & Yang, W. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1047 · Cited by 995 · cited 3×
“Multi-task training has achieved great success in various natural language tasks, such as machine translation (Dong et al., 2015; Malaviya et al., 2017), multilingual tasks (Duong et al., 2015; Gillick et al., 2016), semantic parsing (Peng et al., 2017).”
BackgroundSemEval-2016 Task 4: Sentiment Analysis in Twitter
Nakov, P., Ritter, A., Rosenthal, S., Sebastiani, F., & Stoyanov, V. (2016) · Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016) · doi:10.18653/v1/s16-1001 · Cited by 966
Deep Unordered Composition Rivals Syntactic Methods for Text Classification
Iyyer, M., Manjunatha, V., Boyd-Graber, J., & Daumé III, H. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1162 · Cited by 714 · cited 2×
“models (Kalchbrenner et al.; Iyyer et al., 2015; Dou, 2017) have been explored.”
MethodFelbo, B., Mislove, A. E., Søgaard, A., Rahwan, I., & Lehmann, S. (2017) · Research at the University of Copenhagen (University of Copenhagen) · Cited by 712
SemEval-2014 Task 9: Sentiment Analysis in Twitter
Rosenthal, S., Ritter, A., Nakov, P., & Stoyanov, V. (2014) · Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014) · doi:10.3115/v1/s14-2009 · Cited by 617
Are You a Racist or Am I Seeing Things? Annotator Influence on Hate Speech Detection on Twitter
Waseem, Z. (2016) · Proceedings of the First Workshop on NLP and Computational Social Science · doi:10.18653/v1/w16-5618 · Cited by 569 · cited 2×
“(1,2) SCv1-GEN and SCv2-GEN for sarcasm detection, (3) Stress (Winata et al., 2018), (4) Abu-sive (Waseem, 2016; Waseem and Hovy, 2016).”
Multi-Task Learning for Multiple Language Translation
Dong, D., Wu, H., He, W., Yu, D., & Wang, H. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1166 · Cited by 565 · cited 2×
“Multi-task training has achieved great success in various natural language tasks, such as machine translation (Dong et al., 2015; Malaviya et al., 2017), multilingual tasks (Duong et al., 2015; Gillick et al., 2016), semantic parsing (Peng et al., 2017).”
BackgroundA Joint Many-Task Model: Growing a Neural Network for Multiple NLP Tasks
Hashimoto, K., xiong, C., Tsuruoka, Y., & Socher, R. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1206 · Cited by 535 · cited 1×
“Hashimoto et al. (2017) jointly learns POS tagging, chunking, dependency parsing, semantic relatedness, and textual entailment by considering linguistic hierarchy and achieves state-of-the-results on five datasets.”
BackgroundLow Resource Dependency Parsing: Cross-lingual Parameter Sharing in a Neural Network Parser
Duong, L., Cohn, T., Bird, S., & Cook, P. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · doi:10.3115/v1/p15-2139 · Cited by 402 · cited 2×
“Multi-task training has achieved great success in various natural language tasks, such as machine translation (Dong et al., 2015; Malaviya et al., 2017), multilingual tasks (Duong et al., 2015; Gillick et al., 2016), semantic parsing (Peng et al., 2017).”
BackgroundSentiment Embeddings with Applications to Sentiment Analysis
Tang, D., Wei, F., Qin, B., Yang, N., Liu, T., & Zhou, M. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2015.2489653 · Cited by 335 · cited 7×
“Compared with SSWE : Emo2Vec works much better on all datasets except SS-T datasets, which gives 3.3% accuracy improvement and 4.7% f1 score improvement respectively on sentiment and other tasks.”
MethodInfluentialHarnessing Twitter "Big Data" for Automatic Emotion Identification
Wang, W., Chen, L., Thirunarayan, K., & Sheth, A. P. (2012) · 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Confernece on Social Computing · doi:10.1109/socialcom-passat.2012.119 · Cited by 303 · cited 4×
“Such distant supervision method using hashtags has already been proved to provide reasonably relevant emotion labels by previous works (Wang et al., 2012).”
MethodInfluentialWASSA-2017 Shared Task on Emotion Intensity
Mohammad, S., & Bravo-Marquez, F. (2017) · Proceedings of the 8th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis · doi:10.18653/v1/w17-5205 · Cited by 270 · cited 1×
“For emotion tasks, we include 4 datasets, (1) ISEAR (Wallbott and Scherer, 1986) (2) WASSA (Mohammad and Bravo-Marquez, 2017) (3) Olympic Sintsova et al.”
MethodDepeche Mood: a Lexicon for Emotion Analysis from Crowd Annotated News
Staiano, J., & Guerini, M. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.3115/v1/p14-2070 · Cited by 210 · cited 1×
“(1,2) SST-fine and SST-binary (Socher et al., 2013) (3) OpeNER (Agerri et al., 2013) (Staiano and Guerini, 2014).”
Multilingual Language Processing From Bytes
Gillick, D., Brunk, C., Vinyals, O., & Subramanya, A. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1155 · Cited by 208 · cited 1×
“Multi-task training has achieved great success in various natural language tasks, such as machine translation (Dong et al., 2015; Malaviya et al., 2017), multilingual tasks (Duong et al., 2015; Gillick et al., 2016), semantic parsing (Peng et al., 2017).”
BackgroundRefining Word Embeddings for Sentiment Analysis
Yu, L.-C., Wang, J., Lai, K. R., & Zhang, X. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1056 · Cited by 188 · cited 3×
“SS-fine bi-LSTM (Yu et al., 2017) 0.”
BackgroundInfluentialDeep Multitask Learning for Semantic Dependency Parsing
Peng, H., Thomson, S., & Smith, N. A. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1186 · Cited by 179 · cited 2×
“Multi-task training has achieved great success in various natural language tasks, such as machine translation (Dong et al., 2015; Malaviya et al., 2017), multilingual tasks (Duong et al., 2015; Gillick et al., 2016), semantic parsing (Peng et al., 2017).”
BackgroundHow universal and specific is emotional experience? Evidence from 27 countries on five continents
Wallbott, H. G., & Scherer, K. R. (1986) · Social Science Information · doi:10.1177/053901886025004001 · Cited by 168 · cited 1×
“For emotion tasks, we include 4 datasets, (1) ISEAR (Wallbott and Scherer, 1986) (2) WASSA (Mohammad and Bravo-Marquez, 2017) (3) Olympic Sintsova et al. (2013) (4) SE0714 (Staiano and Guerini, 2014).”
Dou, Z.-Y. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1054 · Cited by 132 · cited 1×
“For sentiment analysis, numerous classification models (Kalchbrenner et al.; Iyyer et al., 2015; Dou, 2017) have been explored.”
MethodLearning Language Representations for Typology Prediction
Malaviya, C., Neubig, G., & Littell, P. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1268 · Cited by 120 · cited 1×
“Multi-task training has achieved great success in various natural language tasks, such as machine translation (Dong et al., 2015; Malaviya et al., 2017), multilingual tasks (Duong et al., 2015; Gillick et al., 2016), semantic parsing (Peng et al., 2017).”
BackgroundMultitask Learning for Fine-Grained Twitter Sentiment Analysis
Balikas, G., Moura, S., & Amini, M.-R. (2017) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3077136.3080702 · Cited by 101 · cited 2×
“For sentiment analysis, Balikas et al. (2017) jointly trains ternary and fine-grained classification with a recurrent neural network and achieves new stateof-the-art results.”
BackgroundMethodWinata, G. I., Kampman, O. P., & Fung, P. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461990 · Cited by 84 · cited 3×
“(1,2) SCv1-GEN and SCv2-GEN for sarcasm detection, (3) Stress (Winata et al., 2018), (4) Abusive (Waseem, 2016; Waseem and Hovy, 2016).”
Self-citationOpeNER: Open Polarity Enhanced Named Entity Recognition
Agerri, R., Cuadros, M., Gaines, S., & Rigau, G. (2013) · Procesamiento del lenguaje natural · Cited by 74
Wang, L. Y., & Xia, R. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1052 · Cited by 74 · cited 1×
“Various methods are developed for automatic constructions of sentiment lexicons using both supervised and unsupervised way (Wang and Xia, 2017).”
MethodAssessing State-of-the-Art Sentiment Models on State-of-the-Art Sentiment Datasets
Barnes, J., Klinger, R., & Schulte im Walde, S. (2017) · Proceedings of the 8th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis · doi:10.18653/v1/w17-5202 · Cited by 70 · cited 4×
“436 OpeNER bi-LSTM (Barnes et al., 2017) 0.”
InfluentialSenTube: A Corpus for Sentiment Analysis on YouTube Social Media
Uryupina, O., Plank, B., Severyn, A., Rotondi, A., & Moschitti, A. (2014) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/26zovkicj2th · Cited by 60 · cited 1×
“ch/sharing-emotion-lexicons-anddata#emo-hash-data and tube tablet (Uryupina et al., 2014) (6) Se-”
Fine-Grained Emotion Recognition in Olympic Tweets Based on Human Computation
Sintsova, V., Musat, C., & Pu, P. (2013) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 36
Modeling the Impact of Modifiers on Emotional Statements
Sintsova, V., Jiménez, M. B., & Pu, P. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-77116-8_6 · Cited by 3 · cited 2×
“(2012), and Sintsova et al. (2017) 2.”
Method
Research works printed but not linked: 4
- [14]14. Mohit Iyyer, Varun Manjunatha, Jordan Boyd-Graber, and Hal Daumé III. 2015. Deep unordered com- position rivals syntactic methods for text classifica- tion. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), vol- ume 1, pages 1681-1691.
- [18]18. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S. Cor- rado, and Jeff Dean. 2013. Distributed representa- tions of words and phrases and their compositional- ity. In Advances in neural information processing systems, pages 3111-3119.
- [22]22. James W Pennebaker and Laura A King. 1999. Lin- guistic styles: Language use as an individual differ- ence. Journal of personality and social psychology, 77(6):1296.
- [41]41. Amir Zadeh, Minghai Chen, Soujanya Poria, Erik Cambria, and Louis-Philippe Morency. 2017. Ten- sor fusion network for multimodal sentiment analy- sis. In Proceedings of the 2017 Conference on Em- pirical Methods in Natural Language Processing, pages 1103-1114.
Cited by
Towards Empathetic Open-domain Conversation Models: A New Benchmark and Dataset
Rashkin, H., Smith, E. M., Li, M., & Boureau, Y.-L. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1534 · Cited by 771
“…wide breadth of research in distributional representation approaches for many emotion classification tasks (Duppada et al., 2018; Park et al., 2018; Xu et al., 2018; Mohammad et al., 2018) that build on deep networks pretrained on large-scale weakly-labelled data such as emo-jis (Felbo et al.,…”
BackgroundZhang, S., Yang, Y., Chen, C., Zhang, X., Leng, Q., & Zhao, X. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121692 · Cited by 251
Semantic-Emotion Neural Network for Emotion Recognition From Text
Batbaatar, E., Li, M., & Ryu, K. H. (2019) · IEEE Access · doi:10.1109/access.2019.2934529 · Cited by 246
“Recently, some emotion embeddings are proposed for solving this issue and achieved better performance in emotion-related tasks [16]–[19].”
BackgroundMoEL: Mixture of Empathetic Listeners
Lin, Z., Madotto, A., Shin, J., Xu, P., & Fung, P. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1012 · Cited by 213
“However, only fewer works focus on emotion (Winata et al., 2017, 2019; Xu et al., 2018; Fan et al., 2018a,c,b; Lee et al., 2019) and empathy in the context of dialogues systems (Bertero et al., 2016; Chatterjee et al., 2019a,b; Shin et al., 2019).”
BackgroundSelf-citationA Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face
Lian, H., Lu, C., Li, S., Zhao, Y., Tang, C., & Zong, Y. (2023) · Entropy · doi:10.3390/e25101440 · Cited by 224
“Following this, Xu et al. [65] unveiled Emo2Vec, embedding emotional semantics into fixed-size vector representations at the word level.”
Method
Metadata
- Authors
- Xu, P., Madotto, A., Wu, C.-S., Park, J. H., & Fung, P.
- Affiliations
- Hong Kong University of Science and Technology (HK)
- Venue
- Proceedings of the 9th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis
- Published
- 2018
- Pages
- 292-298
- OpenAlex
- W2891424355
- Cited by
- 83
- References
- 45
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 8 · 2023: 6 · 2022: 6 · 2021: 15 · 2020: 9 · 2019: 23
- FWCI
- 4.78
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (WASSA) (publishedVersion, cc-by)
- Funders
- Hong Kong University of Science and Technology
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- emotion representation, multi-task learning, emotion analysis, sentiment analysis, sarcasm detection, stress detection, offensive language detection, personality recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
