The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Enriching Word Vectors with Subword Information
Open accessAbstract
Continuous word representations, trained on large unlabeled corpora are useful for many natural language processing tasks. Popular models that learn such representations ignore the morphology of words, by assigning a distinct vector to each word. This is a limitation, especially for languages with large vocabularies and many rare words. In this paper, we propose a new approach based on the skipgram model, where each word is represented as a bag of character n-grams. A vector representation is associated to each character n-gram; words being represented as the sum of these representations. Our method is fast, allowing to train models on large corpora quickly and allows us to compute word representations for words that did not appear in the training data. We evaluate our word representations on nine different languages, both on word similarity and analogy tasks. By comparing to recently proposed morphological word representations, we show that our vectors achieve state-of-the-art performance on these tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Contrary to string similarity-based approaches, continuous word representations capture not only lexical but also semantic properties of tokens.”
From A Method for the Calculation of Parallel Passages for Buddhist Chinese Sources Based on Million-scale Nearest Neighbor Search (2020) · cites this paper as Bojanowski et al. (2017)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“We screened 4 different word embeddings following a similar procedure reported in our previous study [46] and found that the Common Crawl embeddings—released by Facebook and trained using the fastText on the Common Crawl data set [47]—achieved better performance compared to other embeddings on a validation data set.”
From Extracting Family History of Patients From Clinical Narratives: Exploring an End-to-End Solution With Deep Learning Models (2020) · cites this paper as [47]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“I use Fasttext (Bojanowski et al. 2017) as a word representation model because of its capacity to collect sub-word information, which can be helpful in the case of compound words.”
From A Method for the Calculation of Parallel Passages for Buddhist Chinese Sources Based on Million-scale Nearest Neighbor Search (2020) · cites this paper as Bojanowski et al. 2017
The cited source says what the claim attributes to it.
In the citing paper
“This technique involves learning large-scale word embeddings (Bojanowski et al. 2017; Joulin et al. 2016), representing an advancement from Word2Vec.”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Bojanowski et al. 2017
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Self-citationDistributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Self-citationThe proof and measurement of association between two things
Spearman, C. (1904) · The American Journal of Psychology · doi:10.2307/1412159 · Cited by 8,039
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
Character-level Convolutional Networks for Text ClassificationPreprint
Zhang, X., Zhao, J., & LeCun, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.01626 · Cited by 4,481
From Frequency to Meaning: Vector Space Models of Semantics
Turney, P. D., & Pantel, P. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2934 · Cited by 2,949
Generating Sequences With Recurrent Neural Networks
Graves, A. (2013) · arXiv · doi:10.48550/arxiv.1308.0850 · Cited by 2,894
Producing high-dimensional semantic spaces from lexical co-occurrence
Lund, K., & Burgess, C. (1996) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03204766 · Cited by 1,875
Character-Aware Neural Language Models
Kim, Y., Jernite, Y., Sontag, D. A., & Rush, A. M. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10362 · Cited by 1,590
Flagged first, then by citations
Research works printed but not linked: 1
- Cui Qing, 2015, ACM Transactions on Information Systems, 34, 1
Cited by
Sorted by citations
Items 201–300 of 1,029
Who do we invent for? Patents by women focus more on women’s health, but few women get to invent
Koning, R. M., Samila, S., & Ferguson, J. (2021) · Science · doi:10.1126/science.aba6990 · Cited by 184
Survey of Low-Resource Machine Translation
Haddow, B., Bawden, R., Barone, A. V. M., Helcl, J., & Birch, A. (2022) · Computational Linguistics · doi:10.1162/coli_a_00446 · Cited by 219
Zeng, D., Cao, Z., & Neill, D. B. (2021) · Artificial Intelligence in Medicine · doi:10.1016/b978-0-12-821259-2.00022-3 · Cited by 183
Deep CNN-LSTM with combined kernels from multiple branches for IMDb review sentiment analysis
Yenter, A., & Verma, A. (2017) · IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON) · doi:10.1109/uemcon.2017.8249013 · Cited by 185
Opportunities and challenges of text mining in materials research
Kononova, O., He, T., Huo, H., Trewartha, A., Olivetti, E. A., & Ceder, G. (2021) · iScience · doi:10.1016/j.isci.2021.102155 · Cited by 182
Chinese named entity recognition: The state of the art
Liu, P., Guo, Y., Wang, F., & Li, G. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.10.101 · Cited by 183
A Complete Process of Text Classification System Using State-of-the-Art NLP Models
Dogra, V., Verma, S., Kavita, K., Chatterjee, P., Shafi, J., Choi, J., & Ijaz, M. F. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/1883698 · Cited by 199
SBERT-WK: A Sentence Embedding Method by Dissecting BERT-Based Word Models
Wang, B., & Kuo, C. ‐. J. (2020) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2020.3008390 · Cited by 192
Learning Graph Embeddings for Compositional Zero-shot Learning
Naeem, M. F., Xian, Y., Tombari, F., & Akata, Z. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00101 · Cited by 179
Automated Concatenation of Embeddings for Structured Prediction
Wang, X., Jiang, Y., Bách, N., Wang, T., Huang, Z., Huang, F., & Tu, K. (2021) · doi:10.18653/v1/2021.acl-long.206 · Cited by 206
Survey on reinforcement learning for language processing
Uc-Cetina, V., Navarro-Guerrero, N., Martin-Gonzalez, A., Weber, C., & Wermter, S. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10205-5 · Cited by 177
Mimicking Word Embeddings using Subword RNNs
Pinter, Y., Guthrie, R., & Eisenstein, J. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1010 · Cited by 177
Refining Word Embeddings Using Intensity Scores for Sentiment Analysis
Yu, L.-C., Wang, J., Lai, K.-H. R., & Zhang, X. (2017) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2017.2788182 · Cited by 177
Schuster, T., Ram, O., Barzilay, R., & Globerson, A. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1162 · Cited by 185
AI-based language models powering drug discovery and development
Liu, Z., Roberts, R. A., Lal‐Nag, M., Chen, X., Huang, R., & Tong, W. (2021) · Drug Discovery Today · doi:10.1016/j.drudis.2021.06.009 · Cited by 183
Khoo, L. S., McNaney, R., Lim, M. K., & McNaney, R. (2024) · Sensors · doi:10.3390/s24020348 · Cited by 194
Neural Cross-Lingual Named Entity Recognition with Minimal Resources
Xie, J., Yang, Z., Neubig, G., Smith, N. A., & Carbonell, J. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1034 · Cited by 184
Probabilistic FastText for Multi-Sense Word Embeddings
Athiwaratkun, B., Wilson, A. G., & Anandkumar, A. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1001 · Cited by 176
Jin, Q., Kim, W., Chen, Q., Comeau, D. C., Yeganova, L., Wilbur, W. J., & Lu, Z. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad651 · Cited by 175
Lewis, P., Ott, M., Du, J., & Stoyanov, V. (2020) · Clinical Natural Language Processing Workshop (ClinicalNLP) · doi:10.18653/v1/2020.clinicalnlp-1.17 · Cited by 196
Deep Learning for Source Code Modeling and Generation
Le, T. H. M., Chen, H., & Babar, M. A. (2020) · ACM Computing Surveys · doi:10.1145/3383458 · Cited by 192
Retrieval on source code: a neural code search
Sachdev, S., Li, H., Luan, S., Kim, S., Sen, K., & Chandra, S. (2018) · ACM SIGPLAN International Workshop on Machine Learning and Programming Languages (MAPL) · doi:10.1145/3211346.3211353 · Cited by 174
Glavaš, G., Litschko, R., Ruder, S., & Vulić, I. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1070 · Cited by 185
Massively Multilingual Transfer for NER
Rahimi, A., Yuan, L. Y., & Cohn, T. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1015 · Cited by 187
Creating Embeddings of Heterogeneous Relational Datasets for Data Integration Tasks
Cappuzzo, R., Papotti, P., & Thirumuruganathan, S. (2020) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3318464.3389742 · Cited by 194
End-to-End Referring Video Object Segmentation with Multimodal Transformers
Botach, A., Zheltonozhskii, E., & Baskin, C. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00493 · Cited by 188
AlBERTo: Italian BERT Language Understanding Model for NLP Challenging Tasks Based on Tweets.
Polignano, M., Basile, P., de Gemmis, M., Semeraro, G. M., & Basile, V. (2019) · Institutional Research Information System University of Turin (University of Turin) · Cited by 173
Information-Theoretic Probing for Linguistic Structure
Pimentel, T., Valvoda, J., Hall Maudslay, R., Zmigrod, R., Williams, A., & Cotterell, R. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.420 · Cited by 41
A Multilingual Evaluation for Online Hate Speech Detection
Corazza, M., Menini, S., Cabrio, E., Tonelli, S., & Villata, S. (2020) · ACM Transactions on Internet Technology · doi:10.1145/3377323 · Cited by 182
Jha, A., & Mamidi, R. (2017) · Workshop on Natural Language Processing and Computational Social Science (NLP+CSS) · doi:10.18653/v1/w17-2902 · Cited by 178
Khan, L., Amjad, A., Afaq, K. M., & Chang, H.-T. (2022) · Applied Sciences · doi:10.3390/app12052694 · Cited by 171
Neural entity linking: A survey of models based on deep learning
Sevgili, Ö., Shelmanov, A., Arkhipov, M., Panchenko, A., & Biemann, C. (2022) · Semantic Web · doi:10.3233/sw-222986 · Cited by 202
Islam, M. S., Kabir, M. N., Ghani, N. A., Zamli, K. Z., Zulkifli, N. S. A., Rahman, M. M., & Moni, M. A. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-023-10651-9 · Cited by 194
Towards Sub-Word Level Compositions for Sentiment Analysis of Hindi-English Code Mixed TextPreprint
Prabhu, A., Joshi, A., Shrivastava, M., & Varma, V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.00472 · Cited by 170
Weng, W., Wagholikar, K. B., McCray, A. T., Szolovits, P., & Chueh, H. C. (2017) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-017-0556-8 · Cited by 175
A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages
Ortiz Suárez, P. J., Romary, L., & Sagot, B. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.156 · Cited by 166
Yamada, I., Asai, A., Sakuma, J., Shindo, H., Takeda, H., Takefuji, Y., & Matsumoto, Y. (2020) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2020.emnlp-demos.4 · Cited by 179
Li, Y., Kong, D., Zhang, Y., Tan, Y., & Chen, L. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.08.001 · Cited by 168
An intelligent knowledge-based chatbot for customer service
Ngai, E. W. T., Lee, M. C. M., Luo, M., Chan, P. S. L., & Liang, T. (2021) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2021.101098 · Cited by 165
Unsupervised Multilingual Word Embeddings
Chen, X., & Cardie, C. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1024 · Cited by 164
Monitoring the public opinion about the vaccination topic from tweets analysis
D’Andrea, E., Ducange, P., Bechini, A., Renda, A., & Marcelloni, F. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.09.009 · Cited by 169
BEAT: A Large-Scale Semantic and Emotional Multi-modal Dataset for Conversational Gestures Synthesis
Liu, H., Zhu, Z., Iwamoto, N., Peng, Y., Li, Z., Zhou, Y., Bozkurt, E., & Zheng, B. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20071-7_36 · Cited by 164
Text-Adaptive Generative Adversarial Networks: Manipulating Images with Natural LanguagePreprint
Nam, S., Kim, Y., & Kim, S. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.11919 · Cited by 170
Speech2Vec: A Sequence-to-Sequence Framework for Learning Word Embeddings from Speech
Chung, Y.-A., & Glass, J. R. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-2341 · Cited by 182
Towards Debiasing Sentence Representations
Liang, P. P., Li, I., Zheng, E., Lim, Y. C., Salakhutdinov, R., & Morency, L. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.488 · Cited by 188
Mutinda, J., Mwangi, W. R., & Okeyo, G. O. (2023) · Applied Sciences · doi:10.3390/app13031445 · Cited by 170
The Multilingual Amazon Reviews Corpus
Keung, P., Lu, Y., Szarvas, G., & Smith, N. A. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.369 · Cited by 197
Challenges of Hate Speech Detection in Social Media
Kovács, G., Alonso, P., & Saini, R. (2021) · SN Computer Science · doi:10.1007/s42979-021-00457-3 · Cited by 162
Koto, F., Lau, J., & Baldwin, T. (2021) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.833 · Cited by 192
A Survey of Automatic Text Summarization: Progress, Process and Challenges
Mridha, M. F., Lima, A. A., Nur, K. M., Das, S. C., Hasan, M., & Kabir, M. M. (2021) · IEEE Access · doi:10.1109/access.2021.3129786 · Cited by 173
Learning from Dialogue after Deployment: Feed Yourself, Chatbot!
Hancock, B., Bordes, A., Mazare, P.-E., & Weston, J. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1358 · Cited by 161
A deep neural network based multi-task learning approach to hate speech detection
Kapil, P., & Ekbal, A. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106458 · Cited by 166
Canine : Pre-training an Efficient Tokenization-Free Encoder for Language Representation
Clark, J. H., Garrette, D., Turc, I., & Wieting, J. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00448 · Cited by 205
Engaging Image Captioning via Personality
Shuster, K., Humeau, S., Hu, H., Bordes, A., & Weston, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01280 · Cited by 160
Deep neural network for hierarchical extreme multi-label text classification
Gargiulo, F., Silvestri, S., Ciampi, M., & Pietro, G. D. (2019) · Applied Soft Computing · doi:10.1016/j.asoc.2019.03.041 · Cited by 164
Dealing with Data Imbalance in Text Classification
Padurariu, C., & Breaban, M. E. (2019) · Procedia Computer Science · doi:10.1016/j.procs.2019.09.229 · Cited by 169
SemEval-2020 Task 9: Overview of Sentiment Analysis of Code-Mixed Tweets
Patwa, P., Aguilar, G., Kar, S., Pandey, S., Pykl, S., Gambäck, B., Chakraborty, T., Solorio, T., & Das, A. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.100 · Cited by 165
BERT for Stock Market Sentiment Analysis
Sousa, M. G., Sakiyama, K. M., Rodrigues, L. D. S., Moraes, P. H., Fernandes, E. R., & Matsubara, E. T. (2019) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2019.00231 · Cited by 165
Using a stacked residual LSTM model for sentiment intensity prediction
Wang, J., Peng, B., & Zhang, X. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.09.049 · Cited by 158
Charting the Attack Surface of Trigger-Action IoT Platforms
Wang, Q., Datta, P., Yang, W. M., Liu, S., Bates, A., & Gunter, C. A. (2019) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3319535.3345662 · Cited by 157
Tired of Topic Models? Clusters of Pretrained Word Embeddings Make for Fast and Good Topics too!
Sia, S., Dalmia, A., & Mielke, S. J. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.135 · Cited by 186
Open World Compositional Zero-Shot Learning
Mancini, M., Naeem, M. F., Xian, Y., & Akata, Z. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00518 · Cited by 162
Deep Graph Matching ConsensusPreprint
Fey, M., Lenssen, J. E., Morris, C., Masci, J., & Kriege, N. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.09621 · Cited by 171
Linguistik Aktuell/Linguistics Today
(2013) · Linguistik aktuell · doi:10.1075/la · Cited by 157
Automatic Detection of Machine Generated Text: A Critical Survey
Jawahar, G., Abdul-Mageed, M., & Lakshmanan, V. S. (2020) · Proceedings of the 28th International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.208 · Cited by 156
CASCADE: Contextual Sarcasm Detection in Online Discussion Forums
Hazarika, D., Poria, S., Gorantla, S., Cambria, E., Zimmermann, R., & Mihalcea, R. F. (2018) · NOT FOUND REPOSITORY (Indian Institute of Science Bangalore) · doi:10.48550/arxiv.1805.06413 · Cited by 156
Twitter Sentiment Analysis via Bi-sense Emoji Embedding and Attention-based LSTM
Chen, Y., Yuan, J., You, Q., & Luo, J. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240533 · Cited by 166
Multi-channel Transformers for Multi-articulatory Sign Language Translation
Camgöz, N. C., Koller, O., Hadfield, S., & Bowden, R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-66823-5_18 · Cited by 156
Arabic Offensive Language on Twitter: Analysis and ExperimentsPreprint
Mubarak, H., Rashed, A. A.-A., Darwish, K. M., Samih, Y., & Abdelalí, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.02192 · Cited by 170
A Neural Network-Based Ensemble Approach for Spam Detection in Twitter
Madisetty, S., & Desarkar, M. S. (2018) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2018.2878852 · Cited by 157
Conversational AI: Dialogue Systems, Conversational Agents, and Chatbots
McTear, M. (2021) · Synthesis Lectures on Human Language Technologies · doi:10.1007/978-3-031-02176-3 · Cited by 155
Evaluation of sentence embeddings in downstream and linguistic probing tasksPreprint
Perone, C. S., Silveira, R. P., & Paula, T. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.06259 · Cited by 154
Gongane, V. U., Munot, M. V., & Anuse, A. D. (2022) · Social Network Analysis and Mining · doi:10.1007/s13278-022-00951-3 · Cited by 153
Xia, L., Liang, Y., Leng, J., & Zheng, P. (2022) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2022.109068 · Cited by 160
Detection of Hate Speech Text in Hindi-English Code-mixed Data
Sreelakshmi, K., Premjith, B., & Soman, K. P. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.04.080 · Cited by 152
Enhanced news sentiment analysis using deep learning methods
Souma, W., Vodenska, I., & Aoyama, H. (2019) · Journal of Computational Social Science · doi:10.1007/s42001-019-00035-x · Cited by 153
Le, N. Q. K., Yapp, E. K. Y., Ho, Q., Nagasundaram, N., Ou, Y., & Yeh, H. (2019) · Analytical Biochemistry · doi:10.1016/j.ab.2019.02.017 · Cited by 152
Towards automatically filtering fake news in Portuguese
Silva, R. M., Santos, R. L. D. S., Almeida, T. A., & Pardo, T. A. S. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113199 · Cited by 157
Crossmod: A Cross-Community Learning-based System to Assist Reddit Moderators
Chandrasekharan, E., Gandhi, C., Mustelier, M. W., & Gilbert, E. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359276 · Cited by 151
Uncovering new families and folds in the natural protein universe
Durairaj, J., Waterhouse, A. M., Mets, T., Brodiazhenko, T., Abdullah, M., Studer, G., Tauriello, G., Akdel, M., Andreeva, A. E., Bateman, A. G., et al. (2023) · Nature · doi:10.1038/s41586-023-06622-3 · Cited by 159
Visual Pivoting for (Unsupervised) Entity Alignment
Liu, F., Chen, M., Roth, D., & Collier, N. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i5.16550 · Cited by 156
Using word embeddings in Twitter election classification
Yang, X., Macdonald, C., & Ounis, I. (2017) · Information Retrieval · doi:10.1007/s10791-017-9319-5 · Cited by 154
Automatically learning construction injury precursors from text
Baker, H., Hallowell, M. R., & Tixier, A. J. ‐. (2020) · Automation in Construction · doi:10.1016/j.autcon.2020.103145 · Cited by 155
Checking Smart Contracts With Structural Code Embedding
Gao, Z., Jiang, L., Xia, X., Lo, D., & Grundy, J. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.2971482 · Cited by 149
Comparing pre-trained language models for Spanish hate speech detection
Plaza-del-Arco, F. M., Molina-González, M. D., López, L. A. U., & Valdivia, M. T. M. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114120 · Cited by 162
An automatic method for constructing machining process knowledge base from knowledge graph
Guo, L., Yan, F., Li, T., Tao, Y., & Lu, Y. (2021) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2021.102222 · Cited by 155
Making Better Mistakes: Leveraging Class Hierarchies With Deep Networks
Bertinetto, L., Mueller, R., Τερτίκας, Κ., Samangooei, S., & Lord, N. A. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01252 · Cited by 166
See-Through-Text Grouping for Referring Image Segmentation
Chen, D.-J., Jia, S., Lo, Y.-C., Chen, H.-T., & Liu, T.-L. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00755 · Cited by 153
Interpreting Pretrained Contextualized Representations via Reductions to Static Embeddings
Bommasani, R., Davis, K., & Cardie, C. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.431 · Cited by 163
Unsupervised Question Answering by Cloze Translation
Lewis, P., Denoyer, L., & Riedel, S. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1484 · Cited by 156
Inorganic Materials Synthesis Planning with Literature-Trained Neural Networks
Kim, E., Jensen, Z., van Grootel, A., Huang, K., Staib, M., Mysore, S., Chang, H.-S., Strubell, E., McCallum, A., Jegelka, S., et al. (2020) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.9b00995 · Cited by 151
An In-Depth Benchmarking and Evaluation of Phishing Detection Research for Security Needs
Aassal, A. E., Baki, S., Das, A., & Verma, R. M. (2020) · IEEE Access · doi:10.1109/access.2020.2969780 · Cited by 159
Applications of natural language processing and large language models in materials discovery
Jiang, X., Wang, W., Tian, S., Wang, H., Lookman, T., & Su, Y. (2025) · npj Computational Materials · doi:10.1038/s41524-025-01554-0 · Cited by 145
Gender stereotypes are reflected in the distributional structure of 25 languages
Lewis, M. L., & Lupyan, G. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0918-6 · Cited by 145
Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Virtual Agents
Bhattacharya, U., Rewkowski, N., Banerjee, A., Guhan, P., Bera, A., & Manocha, D. (2021) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr50410.2021.00037 · Cited by 144
URLTran: Improving Phishing URL Detection Using Transformers
Maneriker, P., Stokes, J. W., Lazo, E. G., Carutasu, D., Tajaddodianfar, F., & Gururajan, A. (2021) · IEEE Military Communications Conference (MILCOM) · doi:10.1109/milcom52596.2021.9653028 · Cited by 154
Multilingual Alignment of Contextual Word RepresentationsPreprint
Cao, S., Kitaev, N., & Klein, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.03518 · Cited by 156
Low-resource Deep Entity Resolution with Transfer and Active Learning
Kasai, J., Qian, K., Gurajada, S., Li, Y., & Popa, L. C. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1586 · Cited by 157
DAGA: Data Augmentation with a Generation Approach for Low-resource Tagging Tasks
Ding, B., Liu, L., Bing, L., Kruengkrai, C., Nguyen, T. H., Joty, S., Si, L., & Miao, C. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.488 · Cited by 156
Detection of fake news using deep learning CNN–RNN based methods
Sastrawan, I. K., Bayupati, I. P. A., & Arsa, D. M. S. (2021) · ICT Express · doi:10.1016/j.icte.2021.10.003 · Cited by 151
Metadata
- Authors
- Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T.
- Affiliations
- Meta (United States) (US)
- Facebook AI Research,
- Corresponding author
- Bojanowski, Piotr
- Joulin, Armand
- ORCID
- Bojanowski, Piotr
- Venue
- Transactions of the Association for Computational Linguistics
- Publisher
- MIT Press
- Published
- 2017-12
- Volume
- 5
- Pages
- 135-146
- ISSN
- 2307-387X (ISSN-L)
- OpenAlex
- W2493916176
- Cited by
- 9,645
- References
- 47
- Citations by year
- 2026: 389 · 2025: 677 · 2024: 790 · 2023: 1188 · 2022: 1253 · 2021: 1691 · 2020: 1561 · 2019: 1288 · 2018: 648 · 2017: 142
- FWCI
- 593.75
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- Transactions of the Association for Computational Linguistics (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
- Keywords
- word embeddings, character n-grams, skip-gram model, out-of-vocabulary words, word similarity, word analogy, multilingual word representation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review