The DOI matches its DataCite record; 21 of the 23 references it cites were found in a registry or an index.
Efficient Estimation of Word Representations in Vector Space
Open accessAbstract
We propose two novel model architectures for computing continuous vector representations of words from very large data sets. The quality of these representations is measured in a word similarity task, and the results are compared to the previously best performing techniques based on different types of neural networks. We observe large improvements in accuracy at much lower computational cost, i.e. it takes less than a day to learn high quality word vectors from a 1.6 billion words data set. Furthermore, we show that these vectors provide state-of-the-art performance on our test set for measuring syntactic and semantic word similarities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even during this stage, there was some use of pre-trained LMs exemplified by word2vec[85,86] and GloVe[95], but they were used for only a limited portion of the final model parameters.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [85]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Word embeddings are created using a model proposed by Mikolov et al. (2013), developed by Google.”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
The cited source says what the claim attributes to it.
In the citing paper
“According to Mikolov et al. (2013), if 'closeness' is measured by cosine similarity, the vector V ( w 3 ) is most similar to the vector V ( w 0 ) -V ( w 1 ) + V ( w 2 ) .”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
The cited source says what the claim attributes to it.
In the citing paper
“Models can undergo training on extensive textual datasets, subsequently utilizing the acquired knowledge for subsequent tasks through transfer learning (Mikolov et al. 2013).”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
The cited source says what the claim attributes to it.
In the citing paper
“Distributed word representations can be created quickly using shallow networks, such as the Continuous Bag-of-Words (CBOW) model [19].”
From Automatic Speech Recognition With Very Large Conversational Finnish and Estonian Vocabularies (2017) · cites this paper as [19]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“This form of Test-Time Training (TTT), similar to an old idea known as dynamic evaluation [72, 60], still has a missing piece: At training time, we were optimizing the model for its loss out of the box, not for its loss after TTT.”
From End-to-End Test-Time Training for Long Context (2025) · cites this paper as [72]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Word2Vec has experienced significant growth in NLP in recent years (Mikolov et al. 2013).”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
(2010) · Cited by 8,261
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390
Self-citationA unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Learning Word Vectors for Sentiment Analysis
Maas, A. L., Daly, R. E., Pham, P. T., Huang, D., Ng, A. Y., & Potts, C. (2011) · Cited by 3,710
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · Cited by 3,202
Self-citationLinguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · Cited by 2,913
Self-citation(2010) · Cited by 1,906
Extensions of recurrent neural network language model
Mikolov, T., Kombrink, S., Burget, L., Černocký, J., & Khudanpur, S. P. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5947611 · Cited by 1,622
Self-citation(2007) · Cited by 937
Research works printed but not linked: 10
- [1][1] Y. Bengio, R. Ducharme, P. Vincent. A neural probabilistic language model. Journal of Machine Learning Research, 3:1137-1155, 2003. -
- [5][5] R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu and P. Kuksa. Natural Language Processing (Almost) from Scratch. Journal of Machine Learning Research, 12:24932537, 2011. -
- [9][9] Eric H. Huang, R. Socher, C. D. Manning and Andrew Y. Ng. Improving Word Representations via Global Context and Multiple Word Prototypes. In: Proc. Association for Computational Linguistics, 2012. -
- [10][10] G.E. Hinton, J.L. McClelland, D.E. Rumelhart. Distributed representations. In: Parallel distributed processing: Explorations in the microstructure of cognition. Volume 1: Foundations, MIT Press, 1986. -
- [13][13] T. Mikolov. Language Modeling for Speech Recognition in Czech, Masters thesis, Brno University of Technology, 2007. -
- [14][14] T. Mikolov, J. Kopeck´ y, L. Burget, O. Glembek and J. ˇ Cernock´ y. Neural network based language models for higly inflective languages, In: Proc. ICASSP 2009. -
- [18][18] T. Mikolov, A. Deoras, D. Povey, L. Burget, J. ˇ Cernock´ y. Strategies for Training Large Scale Neural Network Language Models, In: Proc. Automatic Speech Recognition and Understanding, 2011. -
- [19][19] T. Mikolov. Statistical Language Models based on Neural Networks. PhD thesis, Brno University of Technology, 2012. -
- [21][21] T. Mikolov, I. Sutskever, K. Chen, G. Corrado, and J. Dean. Distributed Representations of Words and Phrases and their Compositionality. Accepted to NIPS 2013. -
- [25][25] F. Morin, Y. Bengio. Hierarchical Probabilistic Neural Network Language Model. AISTATS, 2005. -
Cited by
Sorted by citations
Items 601–700 of 1,189
Unsupervised Point Cloud Pre-training via Occlusion Completion
Wang, H., Liu, Q., Yue, X., Lasenby, J., & Kusner, M. J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00964 · Cited by 275
Word Embeddings: What Works, What Doesn’t, and How to Tell the Difference for Applied Research
Rodriguez, P. L., & Spirling, A. (2022) · The Journal of Politics · doi:10.1086/715162 · Cited by 254
Toward Optimal Feature Selection in Naive Bayes for Text Categorization
Tang, B., Kay, S., & He, H. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2563436 · Cited by 253
Toward Large-Scale Vulnerability Discovery using Machine Learning
Grieco, G., Grinblat, G. L., Uzal, L. C., Rawat, S., Feist, J., & Mounier, L. (2016) · ACM Conference on Data and Application Security and Privacy (CODASPY) · doi:10.1145/2857705.2857720 · Cited by 253
Fuzzy bag-of-words model for document representation
Zhao, R., & Mao, K. (2018) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2017.2690222 · Cited by 252
What to talk about and how? Selective Generation using LSTMs with Coarse-to-Fine Alignment
Mei, H., Bansal, M., & Walter, M. R. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1086 · Cited by 261
Li, C. (2019) · Chapman & Hall/CRC eBooks · doi:10.1201/9781351006620-6 · Cited by 257
Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval
Gao, L., & Callan, J. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.203 · Cited by 251
Exploiting Argument Information to Improve Event Detection via Supervised Attention Mechanisms
Liu, S., Chen, Y., Liu, K., & Zhao, J. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1164 · Cited by 250
Max-margin deepwalk: discriminative learning of network representation
Tu, C., Zhang, W., Liu, Z., & Sun, M. (2016) · International Joint Conference on Artificial Intelligence · Cited by 250
Learning Joint Embedding with Multimodal Cues for Cross-Modal Video-Text Retrieval
Mithun, N. C., Li, J., Metze, F., & Roy–Chowdhury, A. K. (2018) · International Conference on Multimedia Retrieval · doi:10.1145/3206025.3206064 · Cited by 250
Improving text classification with weighted word embeddings via a multi-channel TextCNN model
Guo, B., Zhang, C., Liu, J., & Ma, X. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.07.052 · Cited by 259
From Zero to Hero: On the Limitations of Zero-Shot Language Transfer with Multilingual Transformers
Lauscher, A., Ravishankar, V., Vulić, I., & Glavaš, G. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.363 · Cited by 283
Sentiment Analysis Using Convolutional Neural Network
Ouyang, X., Zhou, P., Li, C. H., & Liu, L. (2015) · IEEE International Conference on Computer and Information Technology (CIT) · doi:10.1109/cit/iucc/dasc/picom.2015.349 · Cited by 259
BB_twtr at SemEval-2017 Task 4: Twitter Sentiment Analysis with CNNs and LSTMs
Cliche, M. (2017) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s17-2094 · Cited by 268
A comparative study of automated legal text classification using random forests and deep learning
Chen, H., Wu, L., Chen, J., Lu, W. P., & Ding, J. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102798 · Cited by 259
PyTorch-BigGraph: A Large-scale Graph Embedding System
Lerer, A., Wu, L., Shen, J., Lacroix, T., Wehrstedt, L., Bose, A., & Peysakhovich, A. (2019) · arXiv · doi:10.48550/arxiv.1903.12287 · Cited by 247
An analysis of hierarchical text classification using word embeddings
Stein, R. A., Jaques, P. A., & Valiati, J. F. (2018) · Information Sciences · doi:10.1016/j.ins.2018.09.001 · Cited by 253
Impacts of digital transformation on firms' competitive advantages: A systematic literature review
Leão, P. H. P., & da Silva, M. M. (2021) · Strategic Change · doi:10.1002/jsc.2459 · Cited by 247
Hybrid Transformer with Multi-level Fusion for Multimodal Knowledge Graph Completion
Chen, X., Zhang, N., Li, L., Deng, S., Tan, C., Xu, C., Huang, F., Si, L., & Chen, H. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531992 · Cited by 276
Diachronic word embeddings and semantic shifts: a surveyPreprint
Kutuzov, A., Øvrelid, L., Szymanski, T., & Velldal, E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.03537 · Cited by 267
Self-Supervised MultiModal Versatile NetworksPreprint
Alayrac, J.-B., Recasens, A., Schneider, R. G., Arandjelović, R., Ramapuram, J., Fauw, J. D., Smaira, L., Dieleman, S., & Zisserman, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.16228 · Cited by 258
Continuous Online Sequence Learning with an Unsupervised Neural Network Model
Cui, Y., Ahmad, S., & Hawkins, J. (2016) · Neural Computation · doi:10.1162/neco_a_00893 · Cited by 261
CAPTION-ing the situation: A lexically-derived taxonomy of psychological situation characteristics.
Parrigon, S., Woo, S. E., Tay, L., & Wang, T. (2016) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000111 · Cited by 265
CANE: Context-Aware Network Embedding for Relation Modeling
Tu, C., Liu, H., Liu, Z., & Sun, M. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1158 · Cited by 253
Simple Unsupervised Keyphrase Extraction using Sentence Embeddings
Bennani-Smires, K., Musat, C., Hossmann, A., Baeriswyl, M., & Jaggi, M. (2018) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k18-1022 · Cited by 255
Flow-based network traffic generation using Generative Adversarial Networks
Ring, M., Schlör, D., Landes, D., & Andreas Hotho, A. (2018) · Computers & Security · doi:10.1016/j.cose.2018.12.012 · Cited by 261
AI Benchmark: All About Deep Learning on Smartphones in 2019
Ignatov, A., Timofte, R., Kulik, A., Yang, S., Wang, K., Baum, F., Wu, M., Xu, L., & Gool, L. V. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00447 · Cited by 264
Phishing Scams Detection in Ethereum Transaction Network
Chen, L., Peng, J., Liu, Y., Li, J., Xie, F., & Zheng, Z. (2020) · ACM Transactions on Internet Technology · doi:10.1145/3398071 · Cited by 246
A Survey on Graph Representation Learning Methods
Khoshraftar, S., & An, A. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3633518 · Cited by 278
Long-tail Relation Extraction via Knowledge Graph Embeddings and Graph Convolution Networks
Zhang, N., Deng, S., Sun, Z., Wang, G., Chen, X., Zhang, W., & Chen, H. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1306 · Cited by 249
Hierarchical Multi-View Graph Pooling with Structure Learning
Zhang, Z., Bu, J., Ester, M., Zhang, J., Li, Z., Yao, C., Huifen, D., Yu, Z., & Wang, C. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3090664 · Cited by 287
Artificial intelligence in science: An emerging general method of invention
Bianchini, S., Müller, M., & Pelletier, P. (2022) · Research Policy · doi:10.1016/j.respol.2022.104604 · Cited by 287
Automatic detection of cyberbullying on social networks based on bullying features
Zhao, R., Zhou, A., & Mao, K. (2016) · International Conference on Distributed Computing and Networking (ICDCN) · doi:10.1145/2833312.2849567 · Cited by 243
Self-Taught convolutional neural networks for short text clustering
Xu, J., Xu, B., Wang, P., Zheng, S., Tian, G., Zhao, J., & Xu, B. (2017) · Neural Networks · doi:10.1016/j.neunet.2016.12.008 · Cited by 246
A survey on automatic image caption generation
Bai, S., & An, S. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.05.080 · Cited by 253
A Survey of Text Representation and Embedding Techniques in NLP
Patil, R., Boit, S., Gudivada, V. N., & Nandigam, J. (2023) · IEEE Access · doi:10.1109/access.2023.3266377 · Cited by 276
Deep learning for anomaly detection in log data: A survey
Landauer, M., Onder, S., Skopik, F., & Wurzenberger, M. (2023) · Machine Learning with Applications · doi:10.1016/j.mlwa.2023.100470 · Cited by 286
Coooolll: A Deep Learning System for Twitter Sentiment Classification
Tang, D., Wei, F., Qin, B., Liu, T., & Zhou, M. Q. (2014) · International Workshop on Semantic Evaluation (SemEval) · doi:10.3115/v1/s14-2033 · Cited by 241
Transductive Unbiased Embedding for Zero-Shot Learning
Song, J., Shen, C., Yang, Y., Liu, Y., & Song, M. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00113 · Cited by 245
The survey: Text generation models in deep learning
Iqbal, T., & Qureshi, S. (2020) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2020.04.001 · Cited by 258
Predictive biases in natural language processing models: A conceptual framework and overview
Shah, D. S., Schwartz, H. A., & Hovy, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.468 · Cited by 241
Word Embedding for Understanding Natural Language: A Survey
Li, Y., & Yang, T. (2017) · Studies in big data · doi:10.1007/978-3-319-53817-4_4 · Cited by 240
Deep learning for stock market prediction from financial news articles
Vargas, M. R., de Lima, B. S. L. P., & Evsukoff, A. G. (2017) · IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA) · doi:10.1109/civemsa.2017.7995302 · Cited by 243
CLAUDETTE: an automated detector of potentially unfair clauses in online terms of service
Lippi, M., Pałka, P., Contissa, G., Lagioia, F., Micklitz, H., Giovanni Sartor, B., & Torroni, P. (2019) · Artificial Intelligence and Law · doi:10.1007/s10506-019-09243-2 · Cited by 268
Community Detection in Attributed Graphs: An Embedding Approach
Li, Y., Sha, C., Huang, X. S., & Zhang, Y. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11274 · Cited by 239
Nelson, L. K., Burk, D., Knudsen, M. L., & McCall, L. (2018) · Sociological Methods & Research · doi:10.1177/0049124118769114 · Cited by 194
Behind the cues: A benchmarking study for fake news detection
Gravanis, G., Vakali, A. I., Diamantaras, K., & Karadais, P. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.03.036 · Cited by 248
Learning Combinatorial Embedding Networks for Deep Graph Matching
Wang, R., Yan, J., & Yang, X. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00315 · Cited by 244
AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language ProcessingPreprint
Kalyan, K. S., Rajasekharan, A., & Sangeetha, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.05542 · Cited by 357
Adversarial Learning on Heterogeneous Information Networks
Hu, B., Fang, Y., & Shi, C. (2019) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3292500.3330970 · Cited by 238
Named Entity Extraction for Knowledge Graphs: A Literature Overview
Al-Moslmi, T., Ocaña, M. G., Opdahl, A. L., & Veres, C. (2020) · IEEE Access · doi:10.1109/access.2020.2973928 · Cited by 258
Learning and Evaluating Contextual Embedding of Source CodePreprint
Kanade, A., Maniatis, P., Balakrishnan, G., & Shi, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.00059 · Cited by 258
Mai, S., Hu, H., & Xing, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5347 · Cited by 237
Instance-Aware Image and Sentence Matching with Selective Multimodal LSTM
Huang, Y., Wang, W., & Wang, L. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.767 · Cited by 237
Contrastive Learning of General-Purpose Audio Representations
Saeed, A., Grangier, D., & Zeghidour, N. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413528 · Cited by 261
Mohammad, S. M., & Bravo-Márquez, F. (2017) · Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/s17-1007 · Cited by 236
A Survey of Evaluation Metrics Used for NLG Systems
Sai, A. B., Mohankumar, A. K., & Khapra, M. M. (2023) · ACM Computing Surveys · doi:10.1145/3485766 · Cited by 235
Si, Y., Du, J., Li, Z., Jiang, X., Miller, T., Wang, F., Jim Zheng, W., & Roberts, K. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103671 · Cited by 235
Do Multi-Sense Embeddings Improve Natural Language Understanding?
Li, J., & Jurafsky, D. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1200 · Cited by 249
Revisiting Visual Question Answering Baselines
Jabri, A., Joulin, A., & van der Maaten, L. J. P. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46484-8_44 · Cited by 238
Learning Type-Aware Embeddings for Fashion Compatibility
Vasileva, M. I., Plummer, B. A., Dusad, K., Rajpal, S., Kumar, R., & Forsyth, D. A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01270-0_24 · Cited by 238
Using Word2Vec to process big text data
Ma, L., & Zhang, Y. (2015) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2015.7364114 · Cited by 242
A systematic review of natural language processing applied to radiology reports
Casey, A., Davidson, E., Poon, M., Dong, H., Duma, D., Grivas, A., Grover, C., Suárez-Paniagua, V., Tobin, R., Whiteley, W., et al. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01533-7 · Cited by 244
Recent Advances in Natural Language Inference: A Survey of Benchmarks, Resources, and ApproachesPreprint
Storks, S., Gao, Q., & Chai, J. Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.01172 · Cited by 289
ViP-CNN: Visual Phrase Guided Convolutional Neural Network
Li, Y., Ouyang, W., Wang, X., & Tang, X. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.766 · Cited by 237
SimVerb-3500: A Large-Scale Evaluation Set of Verb Similarity
Gerz, D., Vulić, I., Hill, F., Reichart, R., & Korhonen, A. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1235 · Cited by 262
Multimodal Named Entity Recognition for Short Social Media Posts
Moon, S., Neves, L., & Carvalho, V. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1078 · Cited by 248
On the use of deep learning in software defect prediction
Giray, G., Bennin, K. E., Köksal, Ö., Babur, Ö., & Teki̇nerdoğan, B. (2022) · Journal of Systems and Software · doi:10.1016/j.jss.2022.111537 · Cited by 244
Computational Sociolinguistics: A Survey
Nguyen, D., Doğruöz, A. S., Rosé, C. P., & de Jong, F. M. G. (2016) · Computational Linguistics · doi:10.1162/coli_a_00258 · Cited by 259
Improving Entity Linking by Modeling Latent Relations between Mentions
Le, P., & Titov, I. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1148 · Cited by 231
A survey of word embeddings for clinical text
Khattak, F. K., Jeblee, S., Pou-Prom, C., Abdalla, M., Meaney, C. A., & Rudzicz, F. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.yjbinx.2019.100057 · Cited by 241
MARTA GANs: unsupervised representation learning for remote sensing image classification
Lin, D., Fu, K., Wang, Y., Xu, G., & Sun, X. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2752750 · Cited by 230
A Knowledge-Enhanced Pretraining Model for Commonsense Story Generation
Guan, J., Huang, F., Zhao, Z., Zhu, X., & Huang, M. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00302 · Cited by 243
The emergence of social media data and sentiment analysis in election prediction
Chauhan, P., Sharma, N., & Sikka, G. (2020) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-020-02423-y · Cited by 242
A neural network multi-task learning approach to biomedical named entity recognition
Crichton, G., Pyysalo, S., Chiu, B., & Korhonen, A. (2017) · BMC Bioinformatics · doi:10.1186/s12859-017-1776-8 · Cited by 229
Toward better drug discovery with knowledge graph
Zeng, X., Tu, X., Liu, Y., Fu, X., & Su, Y. (2022) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2021.09.003 · Cited by 229
Black Holes and White Rabbits: Metaphor Identification with Visual Features
Shutova, E., Kiela, D., & Maillard, J. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1020 · Cited by 229
ANRL: Attributed Network Representation Learning via Deep Neural Networks
Zhang, Z., Yang, H., Bu, J., Zhou, S., Yu, P., Zhang, J., Ester, M., & Wang, C. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/438 · Cited by 232
Learning the molecular grammar of protein condensates from sequence determinants and embeddings
Saar, K. L., Morgunov, A. S., Qi, R., Arter, W. E., Krainer, G., Lee, A. A., & Knowles, T. P. J. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2019053118 · Cited by 232
Post-hoc Interpretability for Neural NLP: A Survey
Madsen, A., Reddy, S., & Chandar, S. (2022) · ACM Computing Surveys · doi:10.1145/3546577 · Cited by 283
Unsupervised Learning by Predicting Noise
Bojanowski, P., & Joulin, A. (2017) · arXiv · doi:10.48550/arxiv.1704.05310 · Cited by 228
Automatic Spatially-Aware Fashion Concept Discovery
Han, X., Wu, Z., Huang, P. X., Zhang, X., Zhu, M., Li, Y., Zhao, Y. S., & Davis, L. S. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.163 · Cited by 228
The EPIC-KITCHENS Dataset: Collection, Challenges and Baselines
Damen, D., Doughty, H., Farinella, G. M., Fidler, S., Furnari, A., Kazakos, E., Moltisanti, D., Munro, J., Perrett, T., Price, W., et al. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2991965 · Cited by 267
Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP
Schick, T., Udupa, S., & Schütze, H. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00434 · Cited by 227
Deep Learning in Protein Structural Modeling and Design
Gao, W., Mahajan, S. P., Sulam, J., & Gray, J. J. (2020) · Patterns · doi:10.1016/j.patter.2020.100142 · Cited by 227
Learning Image Embeddings using Convolutional Neural Networks for Improved Multi-Modal Semantics
Kiela, D., & Bottou, L. (2014) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1005 · Cited by 230
Exploring the Political Agenda of the European Parliament Using a Dynamic Topic Modeling Approach
Greene, D., & Cross, J. (2017) · Political Analysis · doi:10.1017/pan.2016.7 · Cited by 227
Robust Classification of Crisis-Related Data on Social Networks Using Convolutional Neural Networks
Nguyen, D. T., Mannai, K. A. A., Joty, S., Sajjad, H., Imran, M., & Mitra, P. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14950 · Cited by 235
Keyword extraction: Issues and methods
Firoozeh, N., Nazarenko, A., Alizon, F., & Daille, B. (2019) · Natural Language Engineering · doi:10.1017/s1351324919000457 · Cited by 227
Large Language Models for Information Retrieval: A Survey
Zhu, Y., Yuan, H., Wang, S., Liu, J., Liu, W., Deng, C., Chen, H., Liu, Z., Dou, Z., & Wen, J.-R. (2026) · ACM Transactions on Information Systems · doi:10.1145/3748304 · Cited by 225
Preserving Semantic Relations for Zero-Shot Learning
Biswas, S., & Annadani, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00793 · Cited by 225
Network-based Fake News Detection
Zhou, X., & Zafarani, R. (2019) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3373464.3373473 · Cited by 225
Translation between Molecules and Natural Language
Edwards, C., Lai, T., Ros, K., Honke, G., Cho, K., & Ji, H. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.26 · Cited by 341
Ammar, W., Mulcaire, G., Ballesteros, M., Dyer, C., & Smith, N. A. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00109 · Cited by 224
POI2Vec: Geographical Latent Representation for Predicting Future Visitors
Feng, S., Cong, G., An, B., & Chee, Y. M. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10500 · Cited by 228
Select-additive learning: Improving generalization in multimodal sentiment analysis
Wang, H., Meghawat, A., Morency, L., & Xing, E. P. (2017) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2017.8019301 · Cited by 232
BiG-SLiCE: A highly scalable tool maps the diversity of 1.2 million biosynthetic gene clusters
Kautsar, S. A., van der Hooft, J. J. J., de Ridder, D., & Medema, M. H. (2021) · GigaScience · doi:10.1093/gigascience/giaa154 · Cited by 235
Query Expansion with Locally-Trained Word Embeddings
Díaz, F., Mitra, B., & Craswell, N. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1035 · Cited by 230
SemEval-2019 Task 7: RumourEval, Determining Rumour Veracity and Support for Rumours
Gorrell, G., Kochkina, E., Liakata, M., Aker, A., Zubiaga, A., Bontcheva, K., & Derczynski, L. (2019) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s19-2147 · Cited by 236
Metadata
- Authors
- Mikolov, T., Chen, K., Corrado, G., & Dean, J.
- Affiliations
- Beijing University of Posts and Telecommunications (CN)
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2013
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1301.3781
- OpenAlex
- W1614298861
- Cited by
- 26,568
- References
- 23
- Citations by year
- 2026: 160 · 2025: 1031 · 2024: 1852 · 2023: 2491 · 2022: 2436 · 2021: 3947 · 2020: 3679 · 2019: 3494 · 2018: 2934 · 2017: 1991 · 2016: 1405 · 2015: 853 · 2014: 254 · 2013: 32
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
- Keywords
- word embeddings, word representation learning, word similarity, computational efficiency, syntactic similarity, semantic similarity, neural network architecture
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
