The DOI matches its DataCite record; 21 of the 23 references it cites were found in a registry or an index.
Efficient Estimation of Word Representations in Vector Space
Open accessAbstract
We propose two novel model architectures for computing continuous vector representations of words from very large data sets. The quality of these representations is measured in a word similarity task, and the results are compared to the previously best performing techniques based on different types of neural networks. We observe large improvements in accuracy at much lower computational cost, i.e. it takes less than a day to learn high quality word vectors from a 1.6 billion words data set. Furthermore, we show that these vectors provide state-of-the-art performance on our test set for measuring syntactic and semantic word similarities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even during this stage, there was some use of pre-trained LMs exemplified by word2vec[85,86] and GloVe[95], but they were used for only a limited portion of the final model parameters.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [85]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Word embeddings are created using a model proposed by Mikolov et al. (2013), developed by Google.”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
The cited source says what the claim attributes to it.
In the citing paper
“According to Mikolov et al. (2013), if 'closeness' is measured by cosine similarity, the vector V ( w 3 ) is most similar to the vector V ( w 0 ) -V ( w 1 ) + V ( w 2 ) .”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
The cited source says what the claim attributes to it.
In the citing paper
“Models can undergo training on extensive textual datasets, subsequently utilizing the acquired knowledge for subsequent tasks through transfer learning (Mikolov et al. 2013).”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
The cited source says what the claim attributes to it.
In the citing paper
“Distributed word representations can be created quickly using shallow networks, such as the Continuous Bag-of-Words (CBOW) model [19].”
From Automatic Speech Recognition With Very Large Conversational Finnish and Estonian Vocabularies (2017) · cites this paper as [19]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“This form of Test-Time Training (TTT), similar to an old idea known as dynamic evaluation [72, 60], still has a missing piece: At training time, we were optimizing the model for its loss out of the box, not for its loss after TTT.”
From End-to-End Test-Time Training for Long Context (2025) · cites this paper as [72]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Word2Vec has experienced significant growth in NLP in recent years (Mikolov et al. 2013).”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
(2010) · Cited by 8,261
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390
Self-citationA unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Learning Word Vectors for Sentiment Analysis
Maas, A. L., Daly, R. E., Pham, P. T., Huang, D., Ng, A. Y., & Potts, C. (2011) · Cited by 3,710
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · Cited by 3,202
Self-citationLinguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · Cited by 2,913
Self-citation(2010) · Cited by 1,906
Extensions of recurrent neural network language model
Mikolov, T., Kombrink, S., Burget, L., Černocký, J., & Khudanpur, S. P. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5947611 · Cited by 1,622
Self-citation(2007) · Cited by 937
Research works printed but not linked: 10
- [1][1] Y. Bengio, R. Ducharme, P. Vincent. A neural probabilistic language model. Journal of Machine Learning Research, 3:1137-1155, 2003. -
- [5][5] R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu and P. Kuksa. Natural Language Processing (Almost) from Scratch. Journal of Machine Learning Research, 12:24932537, 2011. -
- [9][9] Eric H. Huang, R. Socher, C. D. Manning and Andrew Y. Ng. Improving Word Representations via Global Context and Multiple Word Prototypes. In: Proc. Association for Computational Linguistics, 2012. -
- [10][10] G.E. Hinton, J.L. McClelland, D.E. Rumelhart. Distributed representations. In: Parallel distributed processing: Explorations in the microstructure of cognition. Volume 1: Foundations, MIT Press, 1986. -
- [13][13] T. Mikolov. Language Modeling for Speech Recognition in Czech, Masters thesis, Brno University of Technology, 2007. -
- [14][14] T. Mikolov, J. Kopeck´ y, L. Burget, O. Glembek and J. ˇ Cernock´ y. Neural network based language models for higly inflective languages, In: Proc. ICASSP 2009. -
- [18][18] T. Mikolov, A. Deoras, D. Povey, L. Burget, J. ˇ Cernock´ y. Strategies for Training Large Scale Neural Network Language Models, In: Proc. Automatic Speech Recognition and Understanding, 2011. -
- [19][19] T. Mikolov. Statistical Language Models based on Neural Networks. PhD thesis, Brno University of Technology, 2012. -
- [21][21] T. Mikolov, I. Sutskever, K. Chen, G. Corrado, and J. Dean. Distributed Representations of Words and Phrases and their Compositionality. Accepted to NIPS 2013. -
- [25][25] F. Morin, Y. Bengio. Hierarchical Probabilistic Neural Network Language Model. AISTATS, 2005. -
Cited by
Sorted by citations
Items 401–500 of 1,189
Learning Semantic Concepts and Order for Image and Sentence Matching
Huang, Y., Wu, Q., Song, C., & Wang, L. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00645 · Cited by 356
DeepBugs: a learning approach to name-based bug detection
Pradel, M., & Sen, K. (2018) · Proceedings of the ACM on Programming Languages · doi:10.1145/3276517 · Cited by 379
Do Not Have Enough Data? Deep Learning to the Rescue!
Anaby-Tavor, A., Carmeli, B., Goldbraich, E., Kantor, A., Kour, G., Shlomov, S., Tepper, N., & Zwerdling, N. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6233 · Cited by 371
Knowledge Graph Completion: A Review
Chen, Z., Wang, Y., Zhao, B., Cheng, J., Zhao, X., & Duan, Z. (2020) · IEEE Access · doi:10.1109/access.2020.3030076 · Cited by 382
Document Embedding with Paragraph VectorsPreprint
Dai, A. M., Olah, C., & Le, Q. V. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.07998 · Cited by 352
Recipe1M+: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food Images
Marín, J., Biswas, A., Ofli, F., Hynes, N., Salvador, A., Aytar, Y., Weber, I. G., & Torralba, A. B. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2927476 · Cited by 350
A deep learning algorithm to predict risk of pancreatic cancer from disease trajectories
Placido, D., Yuan, B., Hjaltelin, J. X., Zheng, C., Haue, A. D., Chmura, P. J., Yuan, C., Kim, J., Umeton, R., Antell, G., et al. (2023) · Nature Medicine · doi:10.1038/s41591-023-02332-5 · Cited by 349
Neural Sentiment Classification with User and Product Attention
Chen, H., Sun, M., Tu, C., Lin, Y., & Liu, Z. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1171 · Cited by 349
Deep Learning for Depression Detection of Twitter Users
Orabi, A. H., Buddhitha, P., Orabi, M. H., & Inkpen, D. Z. (2018) · Workshop on Computational Linguistics and Clinical Psychology (CLPsych) · doi:10.18653/v1/w18-0609 · Cited by 367
A Comprehensive Survey of Scene Graphs: Generation and Application
Chang, X., Ren, P., Xu, P., Li, Z., Chen, X., & Hauptmann, A. G. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3137605 · Cited by 375
Successor Features for Transfer in Reinforcement LearningPreprint
Barreto, A. D. M. S., Dabney, W., Munos, R., Hunt, J. J., Schaul, T., Silver, D., & van Hasselt, H. P. (2016) · arXiv (Cornell University) · doi:10.13140/rg.2.2.35439.18085 · Cited by 349
AI Benchmark: Running Deep Neural Networks on Android Smartphones
Ignatov, A., Timofte, R., Chou, W., Wang, K., Wu, M., Hartley, T., & Van Gool, L. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11021-5_19 · Cited by 347
Hate speech detection: A solved problem? The challenging case of long tail on Twitter
Zhang, Z., & Luo, L. (2018) · Semantic Web · doi:10.3233/sw-180338 · Cited by 372
How to Train good Word Embeddings for Biomedical NLP
Chiu, B., Crichton, G., Korhonen, A., & Pyysalo, S. (2016) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/w16-2922 · Cited by 350
Zhou, H.-Y., Yu, Y., Wang, C., Zhang, S., Gao, Y., Pan, J., Shao, J., Lu, G., Zhang, K., & Li, W. (2023) · Nature Biomedical Engineering · doi:10.1038/s41551-023-01045-x · Cited by 343
Recent trends in deep learning based personality detection
Mehta, Y., Majumder, N., Gelbukh, A. F., & Cambria, E. (2019) · Artificial Intelligence Review · doi:10.1007/s10462-019-09770-z · Cited by 352
How to Generate a Good Word Embedding
Lai, S., Liu, K., He, S., & Zhao, J. (2016) · IEEE Intelligent Systems · doi:10.1109/mis.2016.45 · Cited by 347
Adaptation of Deep Bidirectional Multilingual Transformers for Russian LanguagePreprint
Kuratov, Y., & Arkhipov, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.07213 · Cited by 389
Optimizing the Latent Space of Generative NetworksPreprint
Bojanowski, P., Joulin, A., López-Paz, D., & Szlam, A. D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.05776 · Cited by 382
Sentiment Analysis Using Deep Learning Techniques: A Review
Tul, Q., Ali, M., Riaz, A., Noureen, A., Kamranz, M., Hayat, B., & Rehman, A. U. (2017) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2017.080657 · Cited by 351
Multi-Turn Response Selection for Chatbots with Deep Attention Matching Network
Zhou, X., Lü, L., Dong, D., Liu, Y., Chen, Y., Zhao, W. X., Yu, D., & Wu, H. R. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1103 · Cited by 341
Loss in Translation: Learning Bilingual Word Mapping with a Retrieval Criterion
Joulin, A., Bojanowski, P., Mikolov, T., Jeǵou, H., & Grave, É. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1330 · Cited by 352
Self-citationLearning to Respond with Deep Neural Networks for Retrieval-Based Human-Computer Conversation System
Yan, R., Song, Y., & Wu, H. R. (2016) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2911451.2911542 · Cited by 347
CARER: Contextualized Affect Representations for Emotion Recognition
Saravia, E., Liu, H.-C. T., Huang, Y.-H., Wu, J., & Chen, Y.-S. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1404 · Cited by 337
Joint Learning of the Embedding of Words and Entities for Named Entity Disambiguation
Yamada, I., Shindo, H., Takeda, H., & Takefuji, Y. (2016) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1025 · Cited by 363
Günther, F., Rinaldi, L., & Marelli, M. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691619861372 · Cited by 354
The citation advantage of linking publications to research data
Colavizza, G., Hrynaszkiewicz, I., Staden, I., Whitaker, K., & McGillivray, B. (2020) · PLOS ONE · doi:10.1371/journal.pone.0230416 · Cited by 335
A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4
Kalyan, K. S. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2023.100048 · Cited by 335
Sentiment Embeddings with Applications to Sentiment Analysis
Tang, D., Wei, F., Qin, B., Yang, N., Liu, T., & Zhou, M. (2015) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2015.2489653 · Cited by 344
Multimodal Convolutional Neural Networks for Matching Image and Sentence
Ma, L., Lu, Z., Shang, L., & Li, H. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.301 · Cited by 334
Semi-supervised Convolutional Neural Networks for Text Categorization via Region Embedding
Johnson, R., & Zhang, T. (2015) · PubMed · doi:10.48550/arxiv.1504.01255 · Cited by 334
Evaluating word embedding models: methods and experimental results
Wang, B., Wang, A. Y., Chen, F., Wang, Y.-C., & Kuo, C. ‐. J. (2019) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2019.12 · Cited by 369
Transformers in Time-Series Analysis: A Tutorial
Ahmed, S., Nielsen, I. E., Tripathi, A. G., Siddiqui, S., Ramachandran, R. P., & Rasool, G. (2023) · Circuits Systems and Signal Processing · doi:10.1007/s00034-023-02454-8 · Cited by 370
Cyber Threat Intelligence Mining for Proactive Cybersecurity Defense: A Survey and New Perspectives
Sun, N., Ding, M., Jiang, J., Xu, W., Mo, X., Tai, Y., & Zhang, J. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3273282 · Cited by 367
Sentiment analysis based on improved pre-trained word embeddings
Rezaeinia, S. M., Rahmani, R., Ghodsi, A., & Veisi, H. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.08.044 · Cited by 338
Data-Driven Cybersecurity Incident Prediction: A Survey
Sun, N., Zhang, J., Rimba, P., Gao, S., Zhang, L. Y., & Xiang, Y. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2885561 · Cited by 343
FinBERT: A Pre-trained Financial Language Representation Model for Financial Text Mining
Liu, Z., Huang, D., Huang, K., Li, Z., & Zhao, J. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/622 · Cited by 350
Topic modeling algorithms and applications: A survey
Abdelrazek, A., Eid, Y., Gawish, E. K., Medhat, W., & Hassan, A. (2022) · Information Systems · doi:10.1016/j.is.2022.102131 · Cited by 358
Generative Adversarial Networks for face generation: A survey
Kammoun, A., Slama, R., Tabia, H., Ouni, T., & Abid, M. (2022) · ACM Computing Surveys · doi:10.1145/1122445.1122456 · Cited by 370
Chen, S., Lin, T., Basu, R., Ritchey, J., Wang, S., Luo, Y., Li, X., Pei, D., Kara, L. B., & Cheng, X. (2024) · Nature Communications · doi:10.1038/s41467-024-45766-2 · Cited by 324
LSTM with sentence representations for document-level sentiment classification
Rao, G., Huang, W., Feng, Z., & Cong, Q. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.04.045 · Cited by 326
A Deep-Learned Embedding Technique for Categorical Features Encoding
Dahouda, M. K., & Joe, I. (2021) · IEEE Access · doi:10.1109/access.2021.3104357 · Cited by 354
Wang, W. Y., & Yang, D. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1306 · Cited by 334
Visual Relationship Detection with Internal and External Linguistic Knowledge Distillation
Yu, R., Li, A., Morariu, V. I., & Davis, L. S. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.121 · Cited by 329
A Survey on Differential Privacy for Unstructured Data Content
Zhao, Y., & Chen, J. (2022) · ACM Computing Surveys · doi:10.1145/3490237 · Cited by 336
Deep learning for detecting financial statement fraud
Craja, P., Kim, A., & Lessmann, S. (2020) · Decision Support Systems · doi:10.1016/j.dss.2020.113421 · Cited by 352
Natural Language Processing Advancements By Deep Learning: A SurveyPreprint
Torfi, A., Shirvani, R. A., Keneshloo, Y., Tavaf, N., & Fox, E. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.01200 · Cited by 411
C3D: Generic Features for Video Analysis.
Tran, D., Bourdev, L. D., Fergus, R., Torresani, L., & Paluri, M. (2014) · Cited by 321
Word Sense Disambiguation: A Unified Evaluation Framework and Empirical Comparison
Raganato, A., Camacho-Collados, J., & Roberto Navigli, A. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1010 · Cited by 320
Improving zero-shot learning by mitigating the hubness problem
Dinu, G., Lazaridou, A., & Baroni, M. (2015) · Figshare · doi:10.5281/zenodo.2654863 · Cited by 320
Optimal Hyperparameters for Deep LSTM-Networks for Sequence Labeling Tasks
Reimers, N., & Gurevych, I. (2017) · arXiv · doi:10.48550/arxiv.1707.06799
Koehn, P. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108608480 · Cited by 375
Zhang, P., Xu, W., Gao, H., Niu, K., Xu, X., Qin, X., Yuan, C., Qin, Z., Zhao, H., Wei, J., et al. (2021) · Engineering · doi:10.1016/j.eng.2021.11.003 · Cited by 335
A Survey of Controllable Text Generation Using Transformer-based Pre-trained Language Models
Zhang, H., Song, H., Li, S., Zhou, M., & Song, D. (2024) · ACM Computing Surveys · doi:10.1145/3617680 · Cited by 317
TENER: Adapting Transformer Encoder for Named Entity RecognitionPreprint
Yan, H. R., Deng, B., Li, X., & Qiu, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.04474 · Cited by 349
Bilingual Word Representations with Monolingual Quality in Mind
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing · doi:10.3115/v1/w15-1521 · Cited by 315
Learning Visual Features from Large Weakly Supervised Data
Joulin, A., van der Maaten, L. J. P., Jabri, A., & Vasilache, N. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46478-7_5 · Cited by 316
A Review of Current Trends, Techniques, and Challenges in Large Language Models (LLMs)
Patil, R., & Gudivada, V. N. (2024) · Applied Sciences · doi:10.3390/app14052074 · Cited by 355
Efficient Natural Language Response Suggestion for Smart ReplyPreprint
Henderson, M., Al‐Rfou, R., Strope, B. P., Sung, Y.-H., Lukacs, L., Guo, R., Kumar, S., Miklos, B., & Kurzweil, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.00652 · Cited by 449
What you can cram into a single vector: Probing sentence embeddings for linguistic propertiesPreprint
Conneau, A., Kruszewski, G., Lample, G., Barrault, L., & Baroni, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.01070 · Cited by 426
From Group to Individual Labels Using Deep Features
Kotzias, D., Denil, M., de Freitas, N., & Smyth, P. (2015) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2783258.2783380 · Cited by 324
Utilizing graph machine learning within drug discovery and development
Gaudelet, T., Day, B., Jamasb, A. R., Soman, J., Regep, C., Liu, G., Hayter, J. B. R., Vickers, R., Roberts, C., Tang, J., et al. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab159 · Cited by 313
Boosting Named Entity Recognition with Neural Character Embeddings
dos Santos, C. N., & Guimarães, V. (2015) · Named Entities Workshop (NEWS) · doi:10.18653/v1/w15-3904 · Cited by 317
Semantic memory: A review of methods, models, and current challenges
Kumar, A. A. (2020) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01792-x · Cited by 350
Query expansion techniques for information retrieval: a survey
Azad, H. K., & Deepak, A. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.05.009 · Cited by 313
Gated Neural Networks for Targeted Sentiment Analysis
Zhang, M., Zhang, Y., & Vo, D.-T. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10380 · Cited by 310
A transformer-based approach to irony and sarcasm detection
Potamias, R. A., Siolas, G., & Stafylopatis, A. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-05102-3 · Cited by 328
A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios
Hedderich, M. A., Lange, L., Adel, H., Strötgen, J., & Klakow, D. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.201 · Cited by 310
Use What You Have: Video Retrieval Using Representations From Collaborative ExpertsPreprint
Liu, Y., Albanie, S., Nagrani, A., & Zisserman, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.13487 · Cited by 351
Entity Embeddings of Categorical Variables
Guo, C., & Berkhahn, F. (2016) · arXiv · doi:10.48550/arxiv.1604.06737 · Cited by 308
A Neural Network for Factoid Question Answering over Paragraphs
Iyyer, M., Boyd-Graber, J. L., Claudino, L., Socher, R., & Daumé, H. (2014) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1070 · Cited by 308
TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech
Liu, A. T., Li, S.-W. D., & Lee, H.-Y. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3095662 · Cited by 333
Wang, P., Xu, B., Xu, J., Tian, G., Liu, C., & Hao, H. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.09.096 · Cited by 315
Semantically Enhanced Software Traceability Using Deep Learning Techniques
Guo, J., Cheng, J., & Cleland‐Huang, J. (2017) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2017.9 · Cited by 334
Curiskis, S. A., Drake, B., Osborn, T. R., & Kennedy, P. J. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.04.002 · Cited by 307
Weston, L., Tshitoyan, V., Dagdelen, J. M., Kononova, O., Trewartha, A., Persson, K. A., Ceder, G., & Jain, A. (2019) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.9b00470 · Cited by 324
Contrastive Embedding for Generalized Zero-Shot Learning
Han, Z., Fu, Z., Chen, S., & Yang, J. J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00240 · Cited by 312
Temporal Analysis of Language through Neural Language Models
Kim, Y., Chiu, Y.-I., Hanaki, K., Hegde, D., & Petrov, S. (2014) · Proceedings of the ACL 2014 Workshop on Language Technologies and Computational Social Science · doi:10.3115/v1/w14-2517 · Cited by 305
Augmenting End-to-End Dialogue Systems With Commonsense Knowledge
Young, T., Cambria, E., Chaturvedi, I., Zhou, H., Biswas, S., & Huang, M. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11923 · Cited by 308
Multimodal Large Language Models: A Survey
Wu, J., Gan, W., Chen, Z., Wan, S., & Yu, P. S. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386743 · Cited by 369
Language Understanding for Text-based Games using Deep Reinforcement Learning
Narasimhan, K., Kulkarni, T. D., & Barzilay, R. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1001 · Cited by 341
Constructing knowledge graphs and their biomedical applications
Nicholson, D. N., & Greene, C. S. (2020) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2020.05.017 · Cited by 326
BERT applications in natural language processing: a review
Gardazi, N. M., Daud, A. Y., Malik, M. K., Bukhari, A. A., Alsahfi, T., & Alshemaimri, B. K. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11162-5 · Cited by 354
Deep Representation Learning for Trajectory Similarity Computation
Li, X., Zhao, K., Cong, G., Jensen, C. S., & Wei, W. (2018) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2018.00062 · Cited by 316
Polymer informatics: Current status and critical next steps
Chen, L., Pilania, G., Batra, R., Huan, T. D., Kim, C., Kuenneth, C., & Ramprasad, R. (2020) · Materials Science and Engineering R Reports · doi:10.1016/j.mser.2020.100595 · Cited by 313
Convolutional Neural Network Architectures for Signals Supported on Graphs
Gama, F., Marques, A. G., Leus, G. J. T., & Ribeiro, A. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2887403 · Cited by 310
Generating Sentences by Editing Prototypes
Guu, K., Hashimoto, T. B., Oren, Y., & Liang, P. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00030 · Cited by 300
“Our use of lexical similarity neighborhoods is comparable to context windows used in word vector training (Mikolov et al., 2013a).”
BackgroundMethodLi, C., Ma, J., Guo, X., & Mei, Q. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3038912.3052643 · Cited by 308
Virtual, Digital and Hybrid Twins: A New Paradigm in Data-Based Engineering and Engineered Data
Chinesta, F., Cueto, E., Abisset‐Chavanne, E., Duval, J. L., & Khaldi, F. E. (2018) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-018-9301-4 · Cited by 327
User Preference-aware Fake News Detection
Dou, Y., Shu, K., Xia, C., Yu, P. S., & Sun, L. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462990 · Cited by 317
Multilingual is not enough: BERT for FinnishPreprint
Virtanen, A., Kanerva, J., Ilo, R., Luoma, J., Luotolahti, J., Salakoski, T., Ginter, F., & Pyysalo, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.07076 · Cited by 441
Trotzek, M., Koitka, S., & Friedrich, C. M. (2018) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2885515 · Cited by 312
Topic Modeling for Short Texts with Auxiliary Word Embeddings
Li, C., Wang, H., Zhang, Z., Sun, A., & Ma, Z. (2016) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2911451.2911499 · Cited by 305
Analyzing the Behavior of Visual Question Answering Models
Agrawal, A., Batra, D., & Parikh, D. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1203 · Cited by 297
Character-Based LSTM-CRF with Radical-Level Features for Chinese Named Entity Recognition
Dong, C., Zhang, J., Zong, C., Hattori, M., & Di, H. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-50496-4_20 · Cited by 297
Onan, A. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2022.02.025 · Cited by 302
Random Walks: A Review of Algorithms and Applications
Xia, F., Liu, J., Nie, H., Fu, Y., Wan, L., & Kong, X. (2020) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2019.2952908 · Cited by 295
Shakeri, R., Al-Garadi, M. A., Badawy, A., Mohamed, A., Khattab, T., Al-Ali, A. K., Harras, K. A., & Guizani, M. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2924143 · Cited by 295
WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representations
Pilehvar, M. T., & Camacho-Collados, J. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1128 · Cited by 406
Progress in Neural NLP: Modeling, Learning, and Reasoning
Zhou, M., Duan, N., Liu, S., & Shum, H. (2020) · Engineering · doi:10.1016/j.eng.2019.12.014 · Cited by 325
Metadata
- Authors
- Mikolov, T., Chen, K., Corrado, G., & Dean, J.
- Affiliations
- Beijing University of Posts and Telecommunications (CN)
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2013
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1301.3781
- OpenAlex
- W1614298861
- Cited by
- 26,568
- References
- 23
- Citations by year
- 2026: 160 · 2025: 1031 · 2024: 1852 · 2023: 2491 · 2022: 2436 · 2021: 3947 · 2020: 3679 · 2019: 3494 · 2018: 2934 · 2017: 1991 · 2016: 1405 · 2015: 853 · 2014: 254 · 2013: 32
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
- Keywords
- word embeddings, word representation learning, word similarity, computational efficiency, syntactic similarity, semantic similarity, neural network architecture
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
