The DOI matches its DataCite record; 21 of the 23 references it cites were found in a registry or an index.
Efficient Estimation of Word Representations in Vector Space
Open accessAbstract
We propose two novel model architectures for computing continuous vector representations of words from very large data sets. The quality of these representations is measured in a word similarity task, and the results are compared to the previously best performing techniques based on different types of neural networks. We observe large improvements in accuracy at much lower computational cost, i.e. it takes less than a day to learn high quality word vectors from a 1.6 billion words data set. Furthermore, we show that these vectors provide state-of-the-art performance on our test set for measuring syntactic and semantic word similarities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even during this stage, there was some use of pre-trained LMs exemplified by word2vec[85,86] and GloVe[95], but they were used for only a limited portion of the final model parameters.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [85]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Word embeddings are created using a model proposed by Mikolov et al. (2013), developed by Google.”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
The cited source says what the claim attributes to it.
In the citing paper
“According to Mikolov et al. (2013), if 'closeness' is measured by cosine similarity, the vector V ( w 3 ) is most similar to the vector V ( w 0 ) -V ( w 1 ) + V ( w 2 ) .”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
The cited source says what the claim attributes to it.
In the citing paper
“Models can undergo training on extensive textual datasets, subsequently utilizing the acquired knowledge for subsequent tasks through transfer learning (Mikolov et al. 2013).”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
The cited source says what the claim attributes to it.
In the citing paper
“Distributed word representations can be created quickly using shallow networks, such as the Continuous Bag-of-Words (CBOW) model [19].”
From Automatic Speech Recognition With Very Large Conversational Finnish and Estonian Vocabularies (2017) · cites this paper as [19]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“This form of Test-Time Training (TTT), similar to an old idea known as dynamic evaluation [72, 60], still has a missing piece: At training time, we were optimizing the model for its loss out of the box, not for its loss after TTT.”
From End-to-End Test-Time Training for Long Context (2025) · cites this paper as [72]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Word2Vec has experienced significant growth in NLP in recent years (Mikolov et al. 2013).”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
(2010) · Cited by 8,261
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390
Self-citationA unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Learning Word Vectors for Sentiment Analysis
Maas, A. L., Daly, R. E., Pham, P. T., Huang, D., Ng, A. Y., & Potts, C. (2011) · Cited by 3,710
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · Cited by 3,202
Self-citationLinguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · Cited by 2,913
Self-citation(2010) · Cited by 1,906
Extensions of recurrent neural network language model
Mikolov, T., Kombrink, S., Burget, L., Černocký, J., & Khudanpur, S. P. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5947611 · Cited by 1,622
Self-citation(2007) · Cited by 937
Research works printed but not linked: 10
- [1][1] Y. Bengio, R. Ducharme, P. Vincent. A neural probabilistic language model. Journal of Machine Learning Research, 3:1137-1155, 2003. -
- [5][5] R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu and P. Kuksa. Natural Language Processing (Almost) from Scratch. Journal of Machine Learning Research, 12:24932537, 2011. -
- [9][9] Eric H. Huang, R. Socher, C. D. Manning and Andrew Y. Ng. Improving Word Representations via Global Context and Multiple Word Prototypes. In: Proc. Association for Computational Linguistics, 2012. -
- [10][10] G.E. Hinton, J.L. McClelland, D.E. Rumelhart. Distributed representations. In: Parallel distributed processing: Explorations in the microstructure of cognition. Volume 1: Foundations, MIT Press, 1986. -
- [13][13] T. Mikolov. Language Modeling for Speech Recognition in Czech, Masters thesis, Brno University of Technology, 2007. -
- [14][14] T. Mikolov, J. Kopeck´ y, L. Burget, O. Glembek and J. ˇ Cernock´ y. Neural network based language models for higly inflective languages, In: Proc. ICASSP 2009. -
- [18][18] T. Mikolov, A. Deoras, D. Povey, L. Burget, J. ˇ Cernock´ y. Strategies for Training Large Scale Neural Network Language Models, In: Proc. Automatic Speech Recognition and Understanding, 2011. -
- [19][19] T. Mikolov. Statistical Language Models based on Neural Networks. PhD thesis, Brno University of Technology, 2012. -
- [21][21] T. Mikolov, I. Sutskever, K. Chen, G. Corrado, and J. Dean. Distributed Representations of Words and Phrases and their Compositionality. Accepted to NIPS 2013. -
- [25][25] F. Morin, Y. Bengio. Hierarchical Probabilistic Neural Network Language Model. AISTATS, 2005. -
Cited by
Sorted by citations
Items 901–1,000 of 1,189
Kowsari, K., Heidarysafa, M., Brown, D. E., Meimandi, K. J., & Barnes, L. E. (2018) · International Conference on Information System and Data Mining (ICISDM) · doi:10.1145/3206098.3206111 · Cited by 186
Probabilistic FastText for Multi-Sense Word Embeddings
Athiwaratkun, B., Wilson, A. G., & Anandkumar, A. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1001 · Cited by 176
DataShot: Automatic Generation of Fact Sheets from Tabular Data
Wang, Y., Sun, Z., Zhang, H., Cui, W., Xu, K., Ma, X., & Zhang, D. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2934398 · Cited by 176
Kim, S., Park, H., & Lee, J. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113401 · Cited by 181
Intelligent Health Care: Applications of Deep Learning in Computational Medicine
Yang, S., Zhu, F., Ling, X., Liu, Q., & Zhao, P. (2021) · Frontiers in Genetics · doi:10.3389/fgene.2021.607471 · Cited by 186
Semantic Clustering and Convolutional Neural Network for Short Text Categorization
Wang, P., Xu, J., Xu, B., Liu, C., Zhang, H., Wang, F., & Hao, H. (2015) · doi:10.3115/v1/p15-2058 · Cited by 178
Semantic Search on Text and Knowledge Bases
Bast, H., Buchhold, B., & Haußmann, E. (2016) · now publishers, Inc. eBooks · doi:10.1561/1500000032 · Cited by 187
Kim, H. K., Kim, H., & Cho, S. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.05.046 · Cited by 175
Reinforcement Learning with Tree-LSTM for Join Order Selection
Yu, X., Li, G., Chai, C., & Tang, N. (2020) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde48307.2020.00116 · Cited by 189
SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detection
Schlechtweg, D., McGillivray, B. C., Hengchen, S., Dubossarsky, H., & Tahmasebi, N. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.1 · Cited by 184
Deep Learning for Source Code Modeling and Generation
Le, T. H. M., Chen, H., & Babar, M. A. (2020) · ACM Computing Surveys · doi:10.1145/3383458 · Cited by 192
sense2vec - A Fast and Accurate Method for Word Sense Disambiguation In Neural Word EmbeddingsPreprint
Trask, A., Michalak, P., & Liu, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06388 · Cited by 175
NeuroNER: an easy-to-use program for named-entity recognition based on neural networks
Dernoncourt, F., Lee, J. Y., & Szolovits, P. (2017) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/d17-2017 · Cited by 191
Stance Classification with Target-specific Neural Attention
Du, J., Xu, R., He, Y., & Gui, L. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/557 · Cited by 174
Predicting Visual Exemplars of Unseen Classes for Zero-Shot Learning
Changpinyo, S., Chao, W., & Sha, F. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.376 · Cited by 175
Perozzi, B., Kulkarni, V., Chen, H., & Skiena, S. (2017) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1145/3110025.3110086 · Cited by 174
Peng, H. M., Li, J., Wang, S., Wang, L., Gong, Q., Yang, R., Li, B. H., Yu, P. S., & He, L. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2959991 · Cited by 179
Phan, H. T., Tran, C., Nguyên, N. T., & Hwang, D. (2020) · IEEE Access · doi:10.1109/access.2019.2963702 · Cited by 174
S_I_LSTM: stock price prediction based on multiple data sources and sentiment analysis
Wu, S., Liu, Y., Zou, Z., & Weng, T. (2021) · Connection Science · doi:10.1080/09540091.2021.1940101 · Cited by 184
BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language ModelPreprint
Wang, A., & Cho, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.04094 · Cited by 234
Deep learning for Arabic NLP: A survey
Al‐Ayyoub, M., Nuseir, A., Alsmearat, K., Jararweh, Y., & Gupta, B. B. (2017) · Journal of Computational Science · doi:10.1016/j.jocs.2017.11.011 · Cited by 174
A Survey of Word Embeddings Evaluation MethodsPreprint
Bakarov, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.09536 · Cited by 208
A Survey of Deep Learning for Scientific DiscoveryPreprint
Raghu, M., & Schmidt, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.11755 · Cited by 221
Cross-lingual Dependency Parsing Based on Distributed Representations
Guo, J., Che, W., Yarowsky, D., Wang, H., & Liu, T. (2015) · doi:10.3115/v1/p15-1119 · Cited by 172
Convolutional Neural Networks for Authorship Attribution of Short Texts
Shrestha, P., Sierra, S., Gonzalez, F. A., Montes, M., Rosso, P., & Solorio, T. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-2106 · Cited by 172
User reviews: Sentiment analysis using lexicon integrated two-channel CNN–LSTM family models
Li, W., Zhu, L., Shi, Y., Guo, K., & Cambria, E. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106435 · Cited by 172
Enriching contextualized language model from knowledge graph for biomedical information extraction
Fei, H., Ren, Y., Zhang, Y., Ji, D., & Liang, X. (2020) · Briefings in Bioinformatics · doi:10.1093/bib/bbaa110 · Cited by 174
MovieNet: A Holistic Dataset for Movie Understanding
Huang, Q., Xiong, Y., Rao, A., Wang, J., & Lin, D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58548-8_41 · Cited by 196
Sub-Graph Contrast for Scalable Self-Supervised Graph Representation Learning
Jiao, Y., Xiong, Y., Zhang, J., Zhang, Y., Zhang, T., & Zhu, Y. (2020) · Proceedings · doi:10.1109/icdm50108.2020.00031 · Cited by 174
Fast and Space-Efficient Entity Linking for Queries
Blanco, R., Ottaviano, G., & Meij, E. (2015) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/2684822.2685317 · Cited by 171
BanditSum: Extractive Summarization as a Contextual Bandit
Dong, Y., Shen, Y., Crawford, E., van Hoof, H., & Cheung, J. C. K. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1409 · Cited by 173
Predicting outcomes in crowdfunding campaigns with textual, visual, and linguistic signals
Kaminski, J., & Hopp, C. (2019) · Small Business Economics · doi:10.1007/s11187-019-00218-w · Cited by 174
Large-Scale Representation Learning on Graphs via BootstrappingPreprint
Thakoor, S., Tallec, C., Azar, M. G., Azabou, M., Dyer, E. L., Munos, R., Veličković, P., & Valko, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.06514 · Cited by 243
Min, X., Yu, B., & Wang, F. (2019) · Scientific Reports · doi:10.1038/s41598-019-39071-y · Cited by 170
Unsupervised representation learning for time series with temporal neighborhood coding
Tonekaboni, S., Eytan, D., & Goldenberg, A. (2021) · arXiv · doi:10.48550/arxiv.2106.00750 · Cited by 170
Korkontzelos, I., Nikfarjam, A., Shardlow, M., Sarker, A., Ananiadou, S., & Gonzalez‐Hernandez, G. (2016) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2016.06.007 · Cited by 170
Network embedding in biomedical data science
Su, C., Tong, J., Zhu, Y., Cui, P., & Wang, F. (2018) · Briefings in Bioinformatics · doi:10.1093/bib/bby117 · Cited by 176
Adversarial Multi-Criteria Learning for Chinese Word Segmentation
Chen, X., Shi, Z., Qiu, X., & Huang, X. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1110 · Cited by 170
Neural entity linking: A survey of models based on deep learning
Sevgili, Ö., Shelmanov, A., Arkhipov, M., Panchenko, A., & Biemann, C. (2022) · Semantic Web · doi:10.3233/sw-222986 · Cited by 202
Learning a Recurrent Visual Representation for Image Caption GenerationPreprint
Chen, X., & Zitnick, C. L. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.5654 · Cited by 187
Research of Text Classification Based on Improved TF-IDF Algorithm
Liu, C.-Z., Sheng, Y., Wei, Z., & Yang, Y. (2018) · International Conference on Intelligent Robotics and Control Engineering (IRCE) · doi:10.1109/irce.2018.8492945 · Cited by 169
Kullback–Leibler Divergence Metric Learning
Ji, S., Zhang, Z., Ying, S., Wang, L., Zhao, X., & Gao, Y. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.3008248 · Cited by 169
A Hybrid CNN-LSTM Model for SMS Spam Detection in Arabic and English Messages
Ghourabi, A., Mahmood, M. A., & Alzubi, Q. M. (2020) · Future Internet · doi:10.3390/fi12090156 · Cited by 169
Embeddings from deep learning transfer GO annotations beyond homology
Littmann, M., Heinzinger, M., Dallago, C., Olenyi, T., & Rost, B. (2021) · Scientific Reports · doi:10.1038/s41598-020-80786-0 · Cited by 176
TITAN: T-cell receptor specificity prediction with bimodal attention networks
Weber, A., Born, J., & Martínez, M. R. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btab294 · Cited by 180
An effective ensemble deep learning framework for text classification
Mohammed, A., & Kora, R. (2021) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2021.11.001 · Cited by 179
A detailed review on word embedding techniques with emphasis on word2vec
Johnson, S. J., Murty, M. R., & Navakanth, I. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17007-z · Cited by 169
Metadata Embeddings for User and Item Cold-start RecommendationsPreprint
Kula, M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.08439 · Cited by 169
Aligning Knowledge and Text Embeddings by Entity Descriptions
Zhong, H., Zhang, J., Wang, Z., Wan, H., & Chen, Z. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1031 · Cited by 163
A comprehensive survey on relation extraction: recent advances and new frontiers
Zhao, X., Deng, Y., Yang, M., Wang, L., Zhang, R., Cheng, H., Lam, W., Shen, Y., & Xu, R. (2024) · ACM Computing Surveys · doi:10.1145/3674501 · Cited by 168
“Yuan et al. [218] encoded the position information in sentences, which can be formulated as follows: first, for a sentence, transform the word at position 𝑖 into a pre-trained word vector 𝑣 𝑖 [104].”
DNA Sequence Classification by Convolutional Neural Network
Nguyen, N. G., Vu, T. A., Ngo, D. L., Phan, D., Lumbanraja, F. R., Faisal, M. R., Abapihi, B., Kubo, M., & Satou, K. (2016) · Journal of Biomedical Science and Engineering · doi:10.4236/jbise.2016.95021 · Cited by 171
Learning Word Representations for Sentiment Analysis
Li, Y., Pan, Q., Yang, T., Wang, S., Tang, J., & Cambria, E. (2017) · Cognitive Computation · doi:10.1007/s12559-017-9492-2 · Cited by 168
Martin, C. B., Douglas, D., Newsome, R. N., Man, L. L., & Barense, M. D. (2018) · eLife · doi:10.7554/elife.31873 · Cited by 182
Salminen, J. O., Almerekhi, H., Milenković, M., Jung, S., An, J., Kwak, H., & Jansen, B. J. J. (2018) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v12i1.15028 · Cited by 173
Nasiri, E., Berahmand, K., Rostami, M., & Dabiri, M. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104772 · Cited by 168
Convolutional Neural Networks Analyzed via Convolutional Sparse CodingPreprint
PapyanVardan, RomanoYaniv, & EladMichael (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.08194 · Cited by 171
Emerging technologies and analytics for a new era of value-centered marketing in healthcare
Agarwal, R., Dugas, M., Gao, G. (., & Kannan, P. K. (2020) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-019-00692-4 · Cited by 175
A Survey on an Emerging Area: Deep Learning for Smart City Data
Chen, Q., Wang, W., Wu, F., De, S., Wang, R., Zhang, B., & Huang, X. (2019) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2019.2907718 · Cited by 167
#TagSpace: Semantic Embeddings from Hashtags
Weston, J., Chopra, S., & Adams, K. (2014) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1194 · Cited by 167
Udell, M. R., Horn, C., Zadeh, R. B., & Boyd, S. (2016) · now publishers, Inc. eBooks · doi:10.1561/9781680831412 · Cited by 169
Sorting and Transforming Program Repair Ingredients via Deep Learning Code Similarities
White, M., Tufano, M., Martínez, M., Monperrus, M., & Poshyvanyk, D. (2019) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2019.8668043 · Cited by 173
Phrase Localization and Visual Relationship Detection with Comprehensive Image-Language Cues
Plummer, B. A., Mallya, A., Cervantes, C. M., Hockenmaier, J., & Lazebnik, S. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.213 · Cited by 168
Deep learning for effective Android malware detection using API call graph embeddings
Pektaş, A., & Acarman, T. (2019) · Soft Computing · doi:10.1007/s00500-019-03940-5 · Cited by 167
Fairwalk: Towards Fair Graph Embedding
Rahman, T., Surma, B., Michael Backes, A., & Zhang, Y. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/456 · Cited by 167
Dynamic Interpretation of Emerging Risks in the Financial Sector
Hanley, K. W., & Hoberg, G. (2016) · Review of Financial Studies · doi:10.1093/rfs/hhz023 · Cited by 168
Can language models be used for real-world urban-delivery route optimization?
Liu, Y., Wu, F., Liu, Z., Wang, K., Wang, F., & Qu, X. (2023) · The Innovation · doi:10.1016/j.xinn.2023.100520 · Cited by 167
Space-Time Correspondence as a Contrastive Random WalkPreprint
Jabri, A., Owens, A., & Efros, A. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.14613 · Cited by 176
Self-supervised learning for human activity recognition using 700,000 person-days of wearable data
Yuan, H., Chan, S., Creagh, A. P., Tong, C., Acquah, A., Clifton, D. A., & Doherty, A. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01062-3 · Cited by 166
Multichannel Variable-Size Convolution for Sentence Classification
Yin, W., & Schütze, H. (2015) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k15-1021 · Cited by 166
Ethical Challenges in Data-Driven Dialogue Systems
Henderson, P., Sinha, K., Gontier, N., Ke, N. R., Fried, G., Lowe, R., & Pineau, J. (2018) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3278721.3278777 · Cited by 166
Smaili, F. Z., Gao, X., & Hoehndorf, R. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty933 · Cited by 178
Zero-Shot Sketch-Image Hashing
Shen, Y., Liu, L., Shen, F., & Shao, L. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00379 · Cited by 168
Searching for Effective Neural Extractive Summarization: What Works and What’s Next
Zhong, M., Liu, P., Wang, D., Qiu, X., & Huang, X. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1100 · Cited by 177
A novel molecular representation with BiGRU neural networks for learning atom
Lin, X., Quan, Z., Wang, Z.-J., Huang, H., & Zeng, X. (2019) · Briefings in Bioinformatics · doi:10.1093/bib/bbz125 · Cited by 169
SoliAudit: Smart Contract Vulnerability Assessment Based on Machine Learning and Fuzz Testing
Liao, J., Tsai, T.-T., He, C.-K., & Tien, C. (2019) · International Conference on Internet of Things: Systems, Management and Security (IOTSMS) · doi:10.1109/iotsms48152.2019.8939256 · Cited by 166
Image Representations Learned With Unsupervised Pre-Training Contain Human-like Biases
Steed, R., & Caliskan, A. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445932 · Cited by 189
Yamada, I., Asai, A., Sakuma, J., Shindo, H., Takeda, H., Takefuji, Y., & Matsumoto, Y. (2020) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2020.emnlp-demos.4 · Cited by 179
Li, Y., Kong, D., Zhang, Y., Tan, Y., & Chen, L. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.08.001 · Cited by 168
ZeroCap: Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic
Tewel, Y., Shalev, Y., Schwartz, I., & Wolf, L. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01739 · Cited by 194
Deep Learning for Genomics: From Early Neural Nets to Modern Large Language Models
Yue, T., Wang, Y., Zhang, L., Gu, C., Xue, H., Wang, W., Lyu, Q., & Dun, Y. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms242115858 · Cited by 192
Knowledge-Powered Deep Learning for Word Embedding
Bian, J., Gao, B., & Liu, T. (2014) · Lecture notes in computer science · doi:10.1007/978-3-662-44848-9_9 · Cited by 166
A survey on aspect-based sentiment classification
Brauwers, G., & Frasincar, F. (2023) · ACM Computing Surveys · doi:10.1145/3503044 · Cited by 165
Max-Margin Tensor Neural Network for Chinese Word Segmentation
Pei, W., Ge, T., & Chang, B. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-1028 · Cited by 165
Deep learning-based personality recognition from text posts of online social networks
Xue, D., Wu, L., Zheng, H., Guo, S., Gao, L., Wu, Z., Zhong, X., & Sun, J. (2018) · Applied Intelligence · doi:10.1007/s10489-018-1212-4 · Cited by 169
An image-text consistency driven multimodal sentiment analysis approach for social media
Zhao, Z., Huiying, Z., Xue, Z., Liu, Z., Tian, J., Chua, M. C. H., & Liu, M. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.102097 · Cited by 167
Machine-learned and codified synthesis parameters of oxide materials
Kim, E., Huang, K., Tomala, A., Matthews, S., Strubell, E., Saunders, A. M., McCallum, A., & Olivetti, E. (2017) · Scientific Data · doi:10.1038/sdata.2017.127 · Cited by 174
Ensemble Distribution DistillationPreprint
Gales, M., Malinin, A., & Mlodozeniec, B. (2019) · arXiv (Cornell University) · doi:10.17863/cam.49348 · Cited by 165
Future applications of generative large language models: a data-driven case study on ChatGPT
Chiarello, F., Giordano, V., Spada, I., Barandoni, S., & Fantoni, G. (2024) · Technovation · doi:10.1016/j.technovation.2024.103002 · Cited by 164
A Novel Neural Topic Model and Its Supervised Extension
Cao, Z., Li, S., Liu, Y., Li, W., & Ji, H. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9499 · Cited by 164
A Multi-task Approach for Named Entity Recognition in Social Media Data
Aguilar, G., Maharjan, S., López-Monroy, A. P., & Solorio, T. (2017) · Workshop on Noisy User-generated Text (W-NUT) · doi:10.18653/v1/w17-4419 · Cited by 172
Node Embedding over Temporal Graphs
Singer, U., Guy, I., & Radinsky, K. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/640 · Cited by 164
Word Embeddings for the Analysis of Ideological Placement in Parliamentary Corpora
Rheault, L., & Cochrane, C. (2019) · Political Analysis · doi:10.1017/pan.2019.26 · Cited by 177
Attribute Recognition by Joint Recurrent Learning of Context and Correlation
Wang, J., Zhu, X., Gong, S., & Li, W. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.65 · Cited by 164
Outlier Resistant Unsupervised Deep Architectures for Attributed Network Embedding
Bandyopadhyay, S., Lokesh, N., Vivek, S. V., & Murty, M. N. (2020) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3336191.3371788 · Cited by 165
Navigating the landscape of enzyme design: from molecular simulations to machine learning
Zhou, J., & Huang, M. (2024) · Chemical Society Reviews · doi:10.1039/d4cs00196f · Cited by 168
CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentation
Cho, S., Shin, H., Hong, S., Arnab, A., Seo, P. H., & Kim, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00394 · Cited by 205
A Multimodal Translation-Based Approach for Knowledge Graph Representation Learning
Mousselly-Sergieh, H., Botschen, T., Gurevych, I., & Roth, S. (2018) · Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/s18-2027 · Cited by 170
NetSMF: Large-Scale Network Embedding as Sparse Matrix Factorization
Qiu, J., Dong, Y., Ma, H., Li, J., Wang, C., Wang, K., & Tang, J. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313446 · Cited by 166
Amin, M. M., Cambria, E., & Schuller, B. W. (2023) · IEEE Intelligent Systems · doi:10.1109/mis.2023.3254179 · Cited by 162
Applications of natural language processing in construction
Ding, Y., Ma, J., & Luo, X. (2022) · Automation in Construction · doi:10.1016/j.autcon.2022.104169 · Cited by 161
Metadata
- Authors
- Mikolov, T., Chen, K., Corrado, G., & Dean, J.
- Affiliations
- Beijing University of Posts and Telecommunications (CN)
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2013
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1301.3781
- OpenAlex
- W1614298861
- Cited by
- 26,568
- References
- 23
- Citations by year
- 2026: 160 · 2025: 1031 · 2024: 1852 · 2023: 2491 · 2022: 2436 · 2021: 3947 · 2020: 3679 · 2019: 3494 · 2018: 2934 · 2017: 1991 · 2016: 1405 · 2015: 853 · 2014: 254 · 2013: 32
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
- Keywords
- word embeddings, word representation learning, word similarity, computational efficiency, syntactic similarity, semantic similarity, neural network architecture
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review