The DOI matches its Crossref record; 93 of the 93 references it cites were found in a registry or an index.
A transformer-based approach to irony and sarcasm detection
Open accessAbstract
Figurative language (FL) seems ubiquitous in all social media discussion forums and chats, posing extra challenges to sentiment analysis endeavors. Identification of FL schemas in short texts remains largely an unresolved issue in the broader field of natural language processing, mainly due to their contradictory and metaphorical meaning content. The main FL expression forms are sarcasm, irony and metaphor. In the present paper, we employ advanced deep learning methodologies to tackle the problem of identifying the aforementioned FL forms. Significantly extending our previous work (Potamias et al., in: International conference on engineering applications of neural networks, Springer, Berlin, pp 164–175, 2019), we propose a neural network methodology that builds on a recently proposed pre-trained transformer-based network architecture which is further enhanced with the employment and devise of a recurrent convolutional neural network. With this setup, data preprocessing is kept in minimum. The performance of the devised hybrid neural architecture is tested on four benchmark datasets, and contrasted with other relevant state-of-the-art methodologies and systems. Results demonstrate that the proposed methodology achieves state-of-the-art performance under all benchmark datasets, outperforming, even by a large margin, all other methodologies and published studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
(2016) · Cited by 11,679
Domain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319
Universal Language Model Fine-tuning for Text Classification
Howard, J., & Ruder, S. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1031 · Cited by 4,100
Lazer, D., Pentland, A., Adamic, L., Aral, S., Barabási, A.-L., Brewer, D., Christakis, N., Contractor, N., Fowler, J., Gutmann, M., et al. (2009) · Science · doi:10.1126/science.1167742 · Cited by 3,365
Transformer-XL: Attentive language models beyond a fixed-length context
Dai, Z., Yang, Z., Yang, Y., Carbonell, J., Le, Q., & Salakhutdinov, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1285 · Cited by 3,169
Design and Analysis of Experiments
Dean, A., Voss, D., & Draguljić, D. (2017) · Springer Texts in Statistics · doi:10.1007/978-3-319-52250-0 · Cited by 2,891
Recurrent Convolutional Neural Networks for Text Classification
Lai, S., Xu, L., Liu, K., & Zhao, J. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9513 · Cited by 2,280
Zhu, Y., Kiros, R., Zemel, R., Salakhutdinov, R., Urtasun, R., Torralba, A., & Fidler, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.11 · Cited by 2,264 · cited 1×
“html data from Wikipedia, BookCorpus [103] and WordPiece [97] embeddings.”
MethodSpanBERT: Improving Pre-training by Representing and Predicting Spans
Joshi, M., Chen, D., Liu, Y., Weld, D. S., Zettlemoyer, L., & Levy, O. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00300 · Cited by 1,827 · cited 1×
“studies that question the NSP loss term [44, 55, 101].”
BackgroundSpanBERT: Improving Pre-training by Representing and Predicting Spans
Joshi, M., Chen, D., Liu, Y., Weld, D. S., Zettlemoyer, L., & Levy, O. (2019) · arXiv · doi:10.48550/arxiv.1907.10529 · Cited by 1,827
Cross-lingual Language Model Pretraining
Lample, G., & Conneau, A. (2019) · arXiv · doi:10.48550/arxiv.1901.07291 · Cited by 1,586 · cited 1×
“moves the next sentence prediction objective used in BERT, following advises by several other studies that question the NSP loss term [54,97,43].”
MethodUniversal Sentence Encoder for English
Cer, D., Yang, Y., Kong, S.-Y., Hua, N., Limtiaco, N., St. John, R., Constant, N., Guajardo-Cespedes, M., Yuan, S., Tar, C., et al. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/d18-2029 · Cited by 1,277
Cer, D., Yang, Y., Kong, S.-Y., Hua, N., Limtiaco, N., John, R. S., Constant, N., Guajardo-Cespedes, M., Yuan, S., Tar, C., et al. (2018) · arXiv · doi:10.48550/arxiv.1803.11175 · Cited by 1,267 · cited 9×
“SemEval-2015 Task 11 [24] System COS MSE ELMo 0.710 3.610 USE 0.71 3.17 Appendix In our experiments we compared our model with several seven different classifiers under different settings.”
BackgroundMethodInfluentialMachine learning on big data: Opportunities and challenges
Zhou, L., Pan, S., Wang, J., & Vasilakos, A. V. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.01.026 · Cited by 1,228
Irony and the Use-Mention Distinction
Sperber, D., & Wilson, D. (1981) · UCL Discovery (University College London) · Cited by 1,110
One Billion Word Benchmark for Measuring Progress in Statistical Language Modeling
Chelba, C., Mikolov, T., Schuster, M., Ge, Q., Brants, T., Koehn, P., & Robinson, T. (2013) · arXiv · doi:10.48550/arxiv.1312.3005 · Cited by 1,051
Baselines and Bigrams: Simple, Good Sentiment and Topic Classification
Wang, S. I., & Manning, C. D. (2012) · Cited by 1,006
Semi-supervised Sequence Learning
Dai, A. M., & Le, Q. V. (2015) · arXiv · doi:10.48550/arxiv.1511.01432 · Cited by 994
FastText.zip: Compressing text classification models
Joulin, A., Grave, E., Bojanowski, P., Douze, M., Jégou, H., & Mikolov, T. (2016) · arXiv · doi:10.48550/arxiv.1612.03651 · Cited by 887
Sentiment Analysis: Mining Opinions, Sentiments, and Emotions
Liu, B. (2015) · Cambridge University Press eBooks · doi:10.1017/cbo9781139084789 · Cited by 796
Deep Unordered Composition Rivals Syntactic Methods for Text Classification
Iyyer, M., Manjunatha, V., Boyd-Graber, J., & Daumé III, H. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1162 · Cited by 714
Further Notes on Logic and Conversation
Grice, H. P. (2008) · Reasoning · doi:10.1017/cbo9780511814273.039 · Cited by 661
Sentiment Analysis: Mining Opinions, Sentiments, and Emotions
Liu, B. (2015) · Cited by 656
Semi-supervised sequence tagging with bidirectional language models
Peters, M., Ammar, W., Bhagavatula, C., & Power, R. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1161 · Cited by 655
On the psycholinguistics of sarcasm.
Gibbs, R. W. (1986) · Journal of Experimental Psychology: General · doi:10.1037//0096-3445.115.1.3 · Cited by 635
Identifying Sarcasm in Twitter: A Closer Look
González‐Ibáñez, R., Muresan, S., & Wacholder, N. (2011) · Cited by 627
SemEval-2014 Task 9: Sentiment Analysis in Twitter
Rosenthal, S., Ritter, A., Nakov, P., & Stoyanov, V. (2014) · Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014) · doi:10.3115/v1/s14-2009 · Cited by 617
Sarcasm as Contrast between a Positive Sentiment and Negative Situation
Riloff, E., Qadir, A., Surve, P., De Silva, L., Gilbert, N., & Huang, R. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1066 · Cited by 587
Learned in Translation: Contextualized Word Vectors
McCann, B., Bradbury, J., Xiong, C., & Socher, R. (2017) · arXiv · doi:10.48550/arxiv.1708.00107 · Cited by 572 · cited 1×
“, [70,71,60]) it is argued that the”
Relation Extraction: Perspective from Convolutional Neural Networks
Nguyen, T. H., & Grishman, R. (2015) · Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing · doi:10.3115/v1/w15-1506 · Cited by 486
Deep Convolution Neural Networks for Twitter Sentiment Analysis
Jianqiang, Z., Xiaolin, G., & Xuejun, Z. (2018) · IEEE Access · doi:10.1109/access.2017.2776930 · Cited by 482
A multidimensional approach for detecting irony in Twitter
Reyes, A., Rosso, P., & Veale, T. (2013) · Language Resources and Evaluation · doi:10.1007/s10579-012-9196-x · Cited by 454
Semi-supervised recognition of sarcastic sentences in Twitter and Amazon
Davidov, D., Tsur, O., & Rappoport, A. (2010) · Cited by 424
On the pretense theory of irony.
Clark, H. H., & Gerrig, R. J. (1984) · PubMed · Cited by 413
From humor recognition to irony detection: The figurative language of social media
Reyes, A., Rosso, P., & Buscaldi, D. (2012) · Data & Knowledge Engineering · doi:10.1016/j.datak.2012.02.005 · Cited by 377
Sarcasm Detection on Twitter: A Behavioral Modeling Approach
Rajadesingan, A., Zafarani, R., & Liu, H. (2015) · Proceedings of the Eighth ACM International Conference on Web Search and Data Mining · doi:10.1145/2684822.2685316 · Cited by 363
Fine-tuned Language Models for Text Classification.Preprint
Howard, J., & Ruder, S. (2018) · arXiv (Cornell University) · Cited by 357
Creating metaphors: the neural basis of figurative language production
Benedek, M., Beaty, R., Jauk, E., Koschutnig, K., Fink, A., Silvia, P. J., Dunst, B., & Neubauer, A. C. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.12.046 · Cited by 328
SemEval-2018 Task 3: Irony Detection in English Tweets
Van Hee, C., Lefever, E., & Hoste, V. (2018) · Proceedings of The 12th International Workshop on Semantic Evaluation · doi:10.18653/v1/s18-1005 · Cited by 292
Fracking Sarcasm using Neural Network
Ghosh, A., & Veale, D. T. (2016) · Proceedings of the 7th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis · doi:10.18653/v1/w16-0425 · Cited by 290
Modelling Context with User Embeddings for Sarcasm Detection in Social Media
Amir, S., Wallace, B. C., Lyu, H., Carvalho, P., & Silva, M. J. (2016) · Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1017 · Cited by 272
CASCADE: Contextual Sarcasm Detection in Online Discussion Forums
Hazarika, D., Poria, S., Gorantla, S., Cambria, E., Zimmermann, R., & Mihalcea, R. F. (2018) · NOT FOUND REPOSITORY (Indian Institute of Science Bangalore) · doi:10.48550/arxiv.1805.06413 · Cited by 252
Clues for detecting irony in user-generated contents: oh...!! it's "so easy" ;-)
Carvalho, P., Sarmento, L., Silva, M. J., & de Oliveira, E. (2009) · Proceedings of the 1st international CIKM workshop on Topic-sentiment analysis for mass opinion · doi:10.1145/1651461.1651471 · Cited by 240
The role of literal meaning in figurative language comprehension: evidence from masked priming ERP
Weiland, H., Bambini, V., & Schumacher, P. B. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00583 · Cited by 226
Son, L. H., Kumar, A., Sangwan, S. R., Arora, A., Nayyar, A., & Abdel-Basset, M. (2019) · IEEE Access · doi:10.1109/access.2019.2899260 · Cited by 206
Reasoning with Sarcasm by Reading In-Between
Tay, Y., Luu, A. T., Hui, S. C., & Su, J. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1093 · Cited by 192
Sentiment analysis: a review and comparative analysis over social media
Singh, N. K., Tomar, D. S., & Sangaiah, A. K. (2018) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-018-0862-8 · Cited by 172
A Large Self-Annotated Corpus for Sarcasm
Khodak, M., Saunshi, N., & Vodrahalli, K. (2018) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2ifwj74dgdbw · Cited by 171
Figurative messages and affect in Twitter: Differences between #irony, #sarcasm and #not
Sulis, E., Irazú Hernández Farías, D., Rosso, P., Patti, V., & Ruffo, G. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.05.035 · Cited by 170
Irony Detection in Twitter: The Role of Affective Content
Farías, D. I. H., Patti, V., & Rosso, P. (2016) · ACM Transactions on Internet Technology · doi:10.1145/2930663 · Cited by 154
Deep contextualized word representations for detecting sarcasm and irony
Ilić, S., Marrese-Taylor, E., Balazs, J., & Matsuo, Y. (2018) · Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (WASSA) · doi:10.18653/v1/w18-6202 · Cited by 146
Irony detection via sentiment-based transfer learning
Zhang, S., Zhang, X., Chan, J., & Rosso, P. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.04.006 · Cited by 139
An Impact Analysis of Features in a Classification Approach to Irony Detection in Product Reviews
Buschmeier, K., Cimiano, P., & Klinger, R. (2014) · Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (WASSA) · doi:10.3115/v1/w14-2608 · Cited by 135
A Sentiment-and-Semantics-Based Approach for Emotion Detection in Textual ConversationsPreprint
Gupta, U., Chatterjee, A., Srikanth, R., & Agrawal, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.06996 · Cited by 118
Sarcastic or Not: Word Embeddings to Predict the Literal or Sarcastic Meaning of Words
Ghosh, D., Guo, W., & Muresan, S. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1116 · Cited by 117
Barbieri, F., & Saggion, H. (2014) · Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop (EACL SRW) · doi:10.3115/v1/e14-3007 · Cited by 112
Wu, C., Wu, F., Wu, S., Liu, J., Yuan, Z., & Huang, Y. (2018) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s18-1006 · Cited by 112
Wallace, B., Choe, D. K., & Charniak, E. (2015) · doi:10.3115/v1/p15-1100 · Cited by 93
The danger of big data: Social media as computational social science
Oboler, A., Welsh, K., & Cruz, L. P. (2012) · First Monday · doi:10.5210/fm.v17i7.3993 · Cited by 89
A novel automatic satire and irony detection using ensembled feature selection and data mining
Ravi, K., & Ravi, V. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.12.018 · Cited by 76
Charalampakis, B., Spathis, D., Kouslis, E., & Kermanidis, K. L. (2016) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2016.01.007 · Cited by 72
Kumar, A., & Garg, G. (2019) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-019-01419-7 · Cited by 70
Baziotis, C., Nikolaos, A., Papalampidi, P., Kolovou, A., Paraskevopoulos, G., Ellinas, N., & Potamianos, A. (2018) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s18-1100 · Cited by 68
Reducing BERT Pre-Training Time from 3 Days to 76 MinutesPreprint
You, Y., Li, J., Hseu, J., Song, X., Demmel, J. W., & Hsieh, C. (2019) · arXiv (Cornell University) · Cited by 64
Leveraging semantics for sentiment polarity detection in social media
Dridi, A., & Recupero, D. R. (2017) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-017-0727-z · Cited by 55
Annotating Sentiment and Irony in the Online Italian Political Debate on #labuonascuola
Stranisci, M. A., Bosco, C., Farías, D. I. H., & Patti, V. (2016) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/4abqh39vt3ni · Cited by 53
Zhou, T., Souzeau, E., Sharma, S., Landers, J. A., Mills, R. A., Goldberg, I., Healey, P. R., Graham, S. L., Hewitt, A. W., Mackey, D. A., et al. (2017) · PLoS ONE · doi:10.1371/journal.pone.0172427 · Cited by 51
Social media analysis during political turbulence
Antonakaki, D., Spiliotopoulos, D., Samaras, C. V., Pratikakis, P., Ioannidis, S., & Fragopoulou, P. (2017) · PLoS ONE · doi:10.1371/journal.pone.0186836 · Cited by 51
Overview of the Task on Irony Detection in Spanish Variants.
Bueno, R. O., Pardo, F. M. R., Farías, D. I. H., Rosso, P., Montes-y-Gómez, M., & Medina-Pagola, J. E. (2019) · IberLEF@SEPLN · Cited by 43
How the Context Matters. Literal and Figurative Meaning in the Embodied Language Paradigm
Cuccio, V., Ambrosecchia, M., Ferri, F., Carapezza, M., Piparo, F. L., Fogassi, L., & Gallese, V. (2014) · PLoS ONE · doi:10.1371/journal.pone.0115381 · Cited by 41
Big Data Analytics and Social Media in Disaster Management
Joseph, J. K., Dev, K. A., Pradeepkumar, A. P., et al. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-812056-9.00016-6 · Cited by 38
A comparative empirical study on social media sentiment analysis over various genres and languages
Hangya, V., & Farkas, R. (2016) · Artificial Intelligence Review · doi:10.1007/s10462-016-9489-3 · Cited by 33
Exploring the fine-grained analysis and automatic detection of irony on Twitter
Hee, C. V., Lefever, E., & Hoste, V. (2018) · Language Resources and Evaluation · doi:10.1007/s10579-018-9414-2 · Cited by 33
Irony Detection with Attentive Recurrent Neural Networks
Huang, Y.-H., Huang, H., & Chen, H. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-56608-5_45 · Cited by 30
A Robust Deep Ensemble Classifier for Figurative Language Detection
Potamias, R.-A., Siolas, G., & Stafylopatis, A. (2019) · Communications in computer and information science · doi:10.1007/978-3-030-20257-6_14 · Cited by 26
Self-citation“When Numbers Matter!”: Detecting Sarcasm in Numerical Portions of Text
Dubey, A., Kumar, L., Somani, A., Joshi, A., & Bhattacharyya, P. (2019) · Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (WASSA) · doi:10.18653/v1/w19-1309 · Cited by 23
Women prefer men who use metaphorical language when paying compliments in a romantic context
Gao, Z., Gao, S., Xu, L., Zheng, X., Ma, X., Luo, L., & Kendrick, K. M. (2017) · Scientific Reports · doi:10.1038/srep40871 · Cited by 22
"Having 2 hours to write a paper is fun!": Detecting Sarcasm in Numerical Portions of TextPreprint
Kumar, L., Somani, A., & Bhattacharyya, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.01950 · Cited by 13
NTUA-ISLab at SemEval-2019 Task 9: Mining Suggestions in the wild
Potamias, R. A., Neofytou, A., & Siolas, G. (2019) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s19-2215 · Cited by 13
Self-citationELiRF: A SVM Approach for SA tasks in Twitter at SemEval-2015
Giménez, M., Plà, F., & Hurtado, L.-F. (2015) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s15-2096 · Cited by 7
Potamias, R. A., & Siolas, G. (2019) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s19-2047 · Cited by 3
Self-citationTransformer-XL: Attentive Language Models Beyond a Fixed-Length Context
Dai, Z., Yang, Z., Yang, Y., Carbonell, J., Le, Q. V., & Salakhutdinov, R. (2019) · arXiv · doi:10.48550/arxiv.1901.02860
Cited by
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.04615 · Cited by 569
A heterogeneous stacking ensemble based sentiment analysis framework using multiple word embeddings
Subba, B., & Kumari, S. (2022) · Computational Intelligence · doi:10.1111/coin.12478 · Cited by 41
Building towards Automated Cyberbullying Detection: A Comparative Analysis
Al-Harigy, L. M., Al-Nuaim, H. A., Moradpoor, N., & Tan, Z. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/4794227 · Cited by 32
Distributional Semantics: Meaning Through Culture and Interaction
Contreras Kallens, P., & Christiansen, M. H. (2025) · Topics in Cognitive Science · doi:10.1111/tops.12771 · Cited by 17
“…language modeling , the weights of the model, and thus the semantic space in which meanings are represented, have implicit knowledge of dimensions that determine usage such as syntax (Linzen & Baroni, 2021), morphology (Edmiston, 2020), and even some aspects of pragmatics (Potamias et al., 2020).”
Metadata
- Authors
- Potamias, R. A., Siolas, G., & Stafylopatis, A. G.
- Venue
- Neural Computing and Applications
- Published
- 2020-06-22
- Volume
- 32
- Issue
- 23
- Pages
- 17309-17320
- ISSN
- 0941-0643 (ISSN-L)
- 1433-3058
- OpenAlex
- W2991568321
- Cited by
- 278
- References
- 93
- FWCI
- 13.92
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.