The DOI matches its DataCite record; 21 of the 23 references it cites were found in a registry or an index.
Efficient Estimation of Word Representations in Vector Space
Open accessAbstract
We propose two novel model architectures for computing continuous vector representations of words from very large data sets. The quality of these representations is measured in a word similarity task, and the results are compared to the previously best performing techniques based on different types of neural networks. We observe large improvements in accuracy at much lower computational cost, i.e. it takes less than a day to learn high quality word vectors from a 1.6 billion words data set. Furthermore, we show that these vectors provide state-of-the-art performance on our test set for measuring syntactic and semantic word similarities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even during this stage, there was some use of pre-trained LMs exemplified by word2vec[85,86] and GloVe[95], but they were used for only a limited portion of the final model parameters.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [85]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Word embeddings are created using a model proposed by Mikolov et al. (2013), developed by Google.”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
The cited source says what the claim attributes to it.
In the citing paper
“According to Mikolov et al. (2013), if 'closeness' is measured by cosine similarity, the vector V ( w 3 ) is most similar to the vector V ( w 0 ) -V ( w 1 ) + V ( w 2 ) .”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
The cited source says what the claim attributes to it.
In the citing paper
“Models can undergo training on extensive textual datasets, subsequently utilizing the acquired knowledge for subsequent tasks through transfer learning (Mikolov et al. 2013).”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
The cited source says what the claim attributes to it.
In the citing paper
“Distributed word representations can be created quickly using shallow networks, such as the Continuous Bag-of-Words (CBOW) model [19].”
From Automatic Speech Recognition With Very Large Conversational Finnish and Estonian Vocabularies (2017) · cites this paper as [19]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“This form of Test-Time Training (TTT), similar to an old idea known as dynamic evaluation [72, 60], still has a missing piece: At training time, we were optimizing the model for its loss out of the box, not for its loss after TTT.”
From End-to-End Test-Time Training for Long Context (2025) · cites this paper as [72]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Word2Vec has experienced significant growth in NLP in recent years (Mikolov et al. 2013).”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
(2010) · Cited by 8,261
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390
Self-citationA unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Learning Word Vectors for Sentiment Analysis
Maas, A. L., Daly, R. E., Pham, P. T., Huang, D., Ng, A. Y., & Potts, C. (2011) · Cited by 3,710
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · Cited by 3,202
Self-citationLinguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · Cited by 2,913
Self-citation(2010) · Cited by 1,906
Extensions of recurrent neural network language model
Mikolov, T., Kombrink, S., Burget, L., Černocký, J., & Khudanpur, S. P. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5947611 · Cited by 1,622
Self-citation(2007) · Cited by 937
Research works printed but not linked: 10
- [1][1] Y. Bengio, R. Ducharme, P. Vincent. A neural probabilistic language model. Journal of Machine Learning Research, 3:1137-1155, 2003. -
- [5][5] R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu and P. Kuksa. Natural Language Processing (Almost) from Scratch. Journal of Machine Learning Research, 12:24932537, 2011. -
- [9][9] Eric H. Huang, R. Socher, C. D. Manning and Andrew Y. Ng. Improving Word Representations via Global Context and Multiple Word Prototypes. In: Proc. Association for Computational Linguistics, 2012. -
- [10][10] G.E. Hinton, J.L. McClelland, D.E. Rumelhart. Distributed representations. In: Parallel distributed processing: Explorations in the microstructure of cognition. Volume 1: Foundations, MIT Press, 1986. -
- [13][13] T. Mikolov. Language Modeling for Speech Recognition in Czech, Masters thesis, Brno University of Technology, 2007. -
- [14][14] T. Mikolov, J. Kopeck´ y, L. Burget, O. Glembek and J. ˇ Cernock´ y. Neural network based language models for higly inflective languages, In: Proc. ICASSP 2009. -
- [18][18] T. Mikolov, A. Deoras, D. Povey, L. Burget, J. ˇ Cernock´ y. Strategies for Training Large Scale Neural Network Language Models, In: Proc. Automatic Speech Recognition and Understanding, 2011. -
- [19][19] T. Mikolov. Statistical Language Models based on Neural Networks. PhD thesis, Brno University of Technology, 2012. -
- [21][21] T. Mikolov, I. Sutskever, K. Chen, G. Corrado, and J. Dean. Distributed Representations of Words and Phrases and their Compositionality. Accepted to NIPS 2013. -
- [25][25] F. Morin, Y. Bengio. Hierarchical Probabilistic Neural Network Language Model. AISTATS, 2005. -
Cited by
Sorted by citations
Items 1,001–1,100 of 1,189
Mutual Attention Inception Network for Remote Sensing Visual Question Answering
Zheng, X., Wang, B., Du, X., & Lu, X. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3079918 · Cited by 159
Classification and Clustering of Arguments with Contextualized Word Embeddings
Reimers, N., Schiller, B., Beck, T., Daxenberger, J., Stab, C., & Gurevych, I. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1054 · Cited by 157
Symbol emergence in robotics: a survey
Taniguchi, T., Nagai, T., Nakamura, T., Iwahashi, N., Ogata, T., & Asoh, H. (2016) · Advanced Robotics · doi:10.1080/01691864.2016.1164622 · Cited by 150
A Survey on Contrastive Self-Supervised Learning
Jaiswal, A., Babu, A. R., Zadeh, M. Z., Banerjee, D., & Makedon, F. (2020) · Technologies · doi:10.3390/technologies9010002 · Cited by 154
Self-supervised learning for videos: A survey
Schiappa, M. C., Rawat, Y. S., & Shah, M. (2023) · ACM Computing Surveys · doi:10.1145/3577925 · Cited by 155
Mai, S., Hu, H., & Xing, S. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1046 · Cited by 153
Tracing the evolution of AI in the past decade and forecasting the emerging trends
Shao, Z., Zhao, R., Yuan, S., Ding, M., & Wang, Y. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118221 · Cited by 153
(2021) · doi:10.1145/3462757.3466088 · Cited by 151
A Survey of Machine Learning for Big Code and Naturalness
Allamanis, M., Barr, E. T., Devanbu, P., & Sutton, C. (2019) · ACM Computing Surveys · doi:10.1145/3212695 · Cited by 150
Automatic Multiple Choice Question Generation From Text: A Survey
CH, D. R., & Saha, S. K. (2020) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2018.2889100 · Cited by 144
Demographic Factors Improve Classification Performance
Hovy, D. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1073 · Cited by 148
ChatGPT and Bard exhibit spontaneous citation fabrication during psychiatry literature search
McGowan, A., Gui, Y., Dobbs, M., Shuster, S., Cotter, M., Selloni, A., Goodman, M., Srivastava, A., Cecchi, G. A., & Corcoran, C. M. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2023.115334 · Cited by 140
E-BERT: Efficient-Yet-Effective Entity Embeddings for BERT
Poerner, N., Waltinger, U., & Schütze, H. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.71 · Cited by 146
Predicting dementia from spontaneous speech using large language models
Agbavor, F., & Liang, H. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000168 · Cited by 147
Artificial intelligence moving serious gaming: Presenting reusable game AI components
Westera, W., Prada, R., Mascarenhas, S., Santos, P. A., Dias, J., Guimarães, M., Georgiadis, K., Nyamsuren, E., Bahreini, K., Yumak, Z., et al. (2020) · Education and Information Technologies · doi:10.1007/s10639-019-09968-2 · Cited by 136
A Design Space for Intelligent and Interactive Writing Assistants
Lee, M., Gero, K. I., Chung, J. J. Y., Shum, S. B., Raheja, V., Shen, H., Venugopalan, S., Wambsganss, T., Zhou, D., Alghamdi, E. A., et al. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642697 · Cited by 136
“To highlight a few notable trends, we see audience is under-represented compared to the other task dimensions, suggesting future work may want to more explicitly consider who is the audience of a piece of writing. overall, as well as relative to other technology dimensions, suggesting that there…”
Query2box: Reasoning over Knowledge Graphs in Vector Space using Box Embeddings
Ren, H., Hu, W., & Leskovec, J. (2020) · arXiv · doi:10.48550/arxiv.2002.05969 · Cited by 135
TorusE: Knowledge Graph Embedding on a Lie Group
Ebisu, T., & Ichise, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11538 · Cited by 212
Word meaning in minds and machines.
Lake, B. M., & Murphy, G. L. (2023) · Psychological Review · doi:10.1037/rev0000297 · Cited by 131
Modeling Stress with Social Media Around Incidents of Gun Violence on College Campuses
Saha, K., & De Choudhury, M. (2017) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3134727 · Cited by 124
Applications of natural language processing and large language models in materials discovery
Jiang, X., Wang, W., Tian, S., Wang, H., Lookman, T., & Su, Y. (2025) · npj Computational Materials · doi:10.1038/s41524-025-01554-0 · Cited by 145
Moon, S., Chi, S., & Im, S.-B. (2022) · Automation in Construction · doi:10.1016/j.autcon.2022.104465 · Cited by 134
Xiao, C., Xu, S. X., Zhang, K., Wang, Y., & Xia, L. (2023) · Proceedings of the 18th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2023) · doi:10.18653/v1/2023.bea-1.52 · Cited by 138
Altszyler, E., Ribeiro, S., Sigman, M., & Fernández Slezak, D. (2017) · Consciousness and Cognition · doi:10.1016/j.concog.2017.09.004 · Cited by 128
Objects2action: Classifying and Localizing Actions without Any Video Example
Jain, M., Gemert, J. C. V., Mensink, T., & Snoek, C. G. M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.521 · Cited by 142
Cyberthreat Detection from Twitter using Deep Neural Networks
Dionisio, N., Alves, F., Ferreira, P. M., & Bessani, A. (2019) · 2019 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852475 · Cited by 126
Raj, C., Agarwal, A., Bharathy, G., Narayan, B., & Prasad, M. (2021) · Electronics · doi:10.3390/electronics10222810 · Cited by 128
Samant, R. M., Bachute, M. R., Gite, S., & Kotecha, K. (2022) · IEEE Access · doi:10.1109/access.2022.3149798 · Cited by 123
Yan, M. Y., Gustad, L. T., & Nytrø, Ø. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab236 · Cited by 119
Generating Datasets with Pretrained Language Models
Schick, T., & Schütze, H. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.555 · Cited by 122
Gonen, H., & Goldberg, Y. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1061 · Cited by 454
End-to-end generation of multiple-choice questions using text-to-text transfer transformer models
Rodriguez-Torrealba, R., Garcia-Lopez, E., & Garcia-Cabot, A. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118258 · Cited by 118
Garrido-Muñoz, I., Montejo-Ráez, A., Martínez-Santiago, F., & Ureña-López, L. A. (2021) · Applied Sciences · doi:10.3390/app11073184 · Cited by 123
Rethinking search: making domain experts out of dilettantes
Metzler, D., Tay, Y., Bahri, D., & Najork, M. (2021) · ACM SIGIR Forum · doi:10.1145/3476415.3476428 · Cited by 112
TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment
Yang, J., Bisk, Y., & Gao, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01136 · Cited by 115
Volkova, S., Ayton, E., Porterfield, K., & Corley, C. D. (2017) · PLOS ONE · doi:10.1371/journal.pone.0188941 · Cited by 100
rawMSA: End-to-end Deep Learning using raw Multiple Sequence Alignments
Mirabello, C., & Wallner, B. (2019) · PLOS ONE · doi:10.1371/journal.pone.0220182 · Cited by 105
Bonner, M. F., & Epstein, R. A. (2021) · Nature Communications · doi:10.1038/s41467-021-24368-2 · Cited by 96
A survey on clinical natural language processing in the United Kingdom from 2007 to 2022
Wu, H., Wang, M., Wu, J., Francis, F., Chang, Y.-H., Shavick, A., Dong, H., Poon, M. T. C., Fitzpatrick, N., Levine, A. P., et al. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00730-6 · Cited by 101
A Review on Deep-Learning-Based Cyberbullying Detection
Hasan, M. T., Hossain, M. A. E., Mukta, M. S. H., Akter, A., Ahmed, M., & Islam, S. (2023) · Future Internet · doi:10.3390/fi15050179 · Cited by 103
A Review of Automated Speech and Language Features for Assessment of Cognitive and Thought Disorders
Voleti, R., Liss, J. M., & Berisha, V. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2019.2952087 · Cited by 96
Zuo, Y., Wu, Y., Min, G., Huang, C., & Pei, K. (2020) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2020.2966615 · Cited by 94
Task-Oriented Query Reformulation with Reinforcement Learning
Nogueira, R., & Cho, K. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1061 · Cited by 120
“We use pretrained embed-dings from Mikolov et al. (2013), and it contains 374,000 words.”
MethodInfluentialUnderstanding the creation of trust in cryptocurrencies: the case of Bitcoin
Marella, V., Upreti, B., Merikivi, J., & Tuunainen, V. K. (2020) · Electronic Markets · doi:10.1007/s12525-019-00392-5 · Cited by 96
Multi-Modal Attention for Speech Emotion Recognition
Pan, Z., Luo, Z., Yang, J., & Li, H. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-1653 · Cited by 95
Reddy, S., Raghu, D., Khapra, M. M., & Joshi, S. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers · doi:10.18653/v1/e17-1036 · Cited by 93
DeepCPI: A Deep Learning-Based Framework for Large-Scale in Silico Drug Screening
Wan, F., Zhu, Y., Hu, H., Dai, A., Cai, X., Chen, L., Gong, H., Xia, T., Yang, D., Wang, M.-W., et al. (2019) · Genomics, Proteomics & Bioinformatics · doi:10.1016/j.gpb.2019.04.003 · Cited by 92
HyperLex: A Large-Scale Evaluation of Graded Lexical Entailment
Vulić, I., Gerz, D., Kiela, D., Hill, F., & Korhonen, A. (2016) · arXiv · doi:10.48550/arxiv.1608.02117 · Cited by 90
Word Representations in Vector Space and their Applications for Arabic
Zahran, M. A., Magooda, A., Mahgoub, A. Y., Raafat, H., Rashwan, M., & Atyia, A. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-18111-0_32 · Cited by 90
Joint feature synthesis and embedding: Adversarial cross-modal retrieval revisited
Xu, X., Lin, K., Yang, Y., Hanjalic, A., & Shen, H. T. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3045530 · Cited by 88
Barbieri, S., Kemp, J., Perez-Concha, O., Kotwal, S., Gallagher, M., Ritchie, A., & Jorm, L. (2020) · Scientific Reports · doi:10.1038/s41598-020-58053-z · Cited by 86
The LAMBADA dataset: Word prediction requiring a broad discourse context
Paperno, D., Kruszewski, G., Lazaridou, A., Pham, N. Q., Bernardi, R., Pezzelle, S., Baroni, M., Boleda, G., & Fernandez, R. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1144 · Cited by 87
SECTOR: A Neural Model for Coherent Topic Segmentation and Classification
Arnold, S., Schneider, R., Cudré-Mauroux, P., Gers, F. A., & Löser, A. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00261 · Cited by 85
Inferring Mood Instability on Social Media by Leveraging Ecological Momentary Assessments
Saha, K., Chan, L., De Barbaro, K., Abowd, G. D., & De Choudhury, M. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3130960 · Cited by 77
Does ChatGPT have semantic understanding? A problem with the statistics-of-occurrence strategy
Titus, L. M. (2024) · Cognitive Systems Research · doi:10.1016/j.cogsys.2023.101174 · Cited by 82
Natural language processing in the era of large language models
Zubiaga, A. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1350306 · Cited by 81
Dark personalities on Facebook: Harmful online behaviors and language
Bogolyubova, O., Panicheva, P., Tikhonov, R., Ivanov, V., & Ledovaya, Y. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2017.09.032 · Cited by 78
Introduction to Neural Network Verification
Albarghouthi, A. (2021) · Foundations and Trends® in Programming Languages · doi:10.1561/2500000051 · Cited by 78
ContIG: Self-supervised Multimodal Contrastive Learning for Medical Imaging with Genetics
Taleb, A., Kirchler, M., Monti, R., & Lippert, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.02024 · Cited by 83
Silvestri, S., Islam, S., Papastergiou, S., Tzagkarakis, C., & Ciampi, M. (2023) · Sensors · doi:10.3390/s23020651 · Cited by 76
Deep Learning-Based Applications for Safety Management in the AEC Industry: A Review
Hou, L., Chen, H., Zhang, G. (., & Wang, X. (2021) · Applied Sciences · doi:10.3390/app11020821 · Cited by 76
Yang, X., Bian, J., Fang, R., Bjarnadottir, R. I., Hogan, W. R., & Wu, Y. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz144 · Cited by 74
Campos, D. G., Fütterer, T., Gfrörer, T., Lavelle-Hill, R., Murayama, K., König, L., Hecht, M., Zitzmann, S., & Scherer, R. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09862-5 · Cited by 75
What's up with Privacy?: User Preferences and Privacy Concerns in Intelligent Personal Assistants
Manikonda, L., Deotale, A., & Kambhampati, S. (2018) · Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3278721.3278773 · Cited by 71
Anderson, A. J., Kiela, D., Binder, J. R., Fernandino, L., Humphries, C. J., Conant, L. L., Raizada, R. D. S., Grimm, S., & Lalor, E. C. (2021) · The Journal of Neuroscience · doi:10.1523/jneurosci.1152-20.2021 · Cited by 70
Adikari, A., de Silva, D., Moraliyage, H., Alahakoon, D., Wong, J., Gancarz, M., Chackochan, S., Park, B., Heo, R., & Leung, Y. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2021.08.015 · Cited by 71
Generative Artificial Intelligence for Software Engineering - a Research Agenda
NguyenDuc, A., Cabrero-Daniel, B., Arora, C., Przybylek, A., Khanna, D., Herda, T., Rafiq, U., Melegati, J., Guerra, E., Kemell, K.-K., et al. (2023) · doi:10.2139/ssrn.4622517 · Cited by 71
Protein design via deep learning
Ding, W., Nakai, K., & Gong, H. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac102 · Cited by 66
Amer, F., Jung, Y., & Golparvar-Fard, M. (2021) · Automation in Construction · doi:10.1016/j.autcon.2021.103929 · Cited by 68
Bang, F. (2023) · Proceedings of the 3rd Workshop for Natural Language Processing Open Source Software (NLP-OSS 2023) · doi:10.18653/v1/2023.nlposs-1.24 · Cited by 72
“Common text embedding models include BERT (Devlin et al., 2019), GloVe (Pen-nington et al., 2014), and Word2Vec (Goldberg and Levy, 2014; Mikolov et al., 2013).”
Tuomi, I. (2022) · European Journal of Education · doi:10.1111/ejed.12531 · Cited by 66
Radar Camera Fusion via Representation Learning in Autonomous Driving
Dong, X., Zhuang, B., Mao, Y., & Liu, L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00183 · Cited by 62
Generative Artificial Intelligence for Software Engineering—A Research Agenda
Nguyen‐Duc, A., Cabrero‐Daniel, B., Przybylek, A., Arora, C., Khanna, D., Herda, T., Rafiq, U., Melegati, J., Guerra, E., Kemell, K., et al. (2025) · Software: Practice and Experience · doi:10.1002/spe.70005 · Cited by 60
Simple, Interpretable and Stable Method for Detecting Words with Usage Change across Corpora
Gonen, H., Jawahar, G., Seddah, D., & Goldberg, Y. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.51 · Cited by 59
DNN-based Emotion Recognition Based on Bottleneck Acoustic Features and Lexical Features
Kim, E., & Shin, J. W. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683077 · Cited by 54
Compressive Sequential Learning for Action Similarity Labeling
Qin, J., Liu, L., Zhang, Z., Wang, Y., & Shao, L. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2508600 · Cited by 55
Graph representation learning for single-cell biology
Hetzel, L., Fischer, D. S., Günnemann, S., & Theis, F. J. (2021) · Current Opinion in Systems Biology · doi:10.1016/j.coisb.2021.05.008 · Cited by 55
Cyberbullying Identification System Based Deep Learning Algorithms
Aldhyani, T. H. H., Al-Adhaileh, M. H., & Alsubari, S. N. (2022) · Electronics · doi:10.3390/electronics11203273 · Cited by 55
Bardak, B., & Tan, M. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102112 · Cited by 48
DeleSmell: Code smell detection based on deep learning and latent semantic analysis
Zhang, Y., Ge, C., Hong, S., Tian, R., Dong, C., & Liu, J. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.109737 · Cited by 54
Background selection schema on deep learning-based classification of dermatological disease
Zhou, J., Wu, Z., Jiang, Z., Huang, K., Guo, K., & Zhao, S. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105966 · Cited by 53
Curto, G., Jojoa Acosta, M. F., Comim, F., & Garcia-Zapirain, B. (2024) · AI & SOCIETY · doi:10.1007/s00146-022-01494-z · Cited by 53
Contrastive Learning Models for Sentence Representations
Xu, L., Xie, H., Li, Z., Wang, F. L., Wang, W., & Li, Q. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3593590 · Cited by 50
On the Binding Problem in Artificial Neural Networks
Greff, K., van Steenkiste, S., & Schmidhuber, J. (2020) · arXiv · doi:10.48550/arxiv.2012.05208 · Cited by 102
Distributed learning from multiple EHR databases: Contextual embedding models for medical events
Li, Z., Roberts, K., Jiang, X., & Long, Q. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103138 · Cited by 44
Shen, J., Yang, B., Dudley, J. J., & Kristensson, P. O. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511145 · Cited by 48
A Review of Current Trends, Techniques, and Challenges in Large Language Models (LLMs)
Patil, R., & Gudivada, A. V. (2024) · doi:10.20944/preprints202402.0357.v1 · Cited by 296
Measuring text similarity based on structure and word embedding
Farouk, M. (2020) · Cognitive Systems Research · doi:10.1016/j.cogsys.2020.04.002 · Cited by 47
HeteroMed: Heterogeneous Information Network for Medical Diagnosis
Hosseini, A., Chen, T., Wu, W., Sun, Y., & Sarrafzadeh, M. (2018) · Proceedings of the 27th ACM International Conference on Information and Knowledge Management · doi:10.1145/3269206.3271805 · Cited by 47
Impact of log parsing on deep learning-based anomaly detection
Khan, Z. A., Shin, D., Bianculli, D., & Briand, L. C. (2024) · Empirical Software Engineering · doi:10.1007/s10664-024-10533-w · Cited by 49
Pretraining to Recognize PICO Elements from Randomized Controlled Trial Literature.
Tian, K., Shirui, Z., & Chunhua, W. (2019) · Studies in Health Technology and Informatics · doi:10.3233/shti190209 · Cited by 45
Silva, A., Tambwekar, P., & Gombolay, M. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.189 · Cited by 46
Obeid, J. S., Dahne, J., Christensen, S., Howard, S., Crawford, T., Frey, L. J., Stecker, T., & Bunnell, B. E. (2020) · JMIR Medical Informatics · doi:10.2196/17784 · Cited by 44
Exploring Numeracy in Word Embeddings
Naik, A., Ravichander, A., Rose, C., & Hovy, E. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1329 · Cited by 49
Zhao, C., Jiang, J., Guan, Y., Guo, X., & He, B. (2018) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2018.03.005 · Cited by 41
Knowledge graphs: Introduction, history, and perspectives
Chaudhri, V. K., Baru, C., Chittar, N., Dong, X. L., Genesereth, M., Hendler, J., Kalyanpur, A., Lenat, D. B., Sequeda, J., Vrandečić, D., et al. (2022) · AI Magazine · doi:10.1002/aaai.12033 · Cited by 71
On the Evolution of Knowledge Graphs: A Survey and Perspective
Jiang, X., Xu, C., Shen, Y., Sun, X., Tang, L., Wang, S., Chen, Z., Wang, Y., & Guo, J. (2023) · arXiv · doi:10.48550/arxiv.2310.04835 · Cited by 42
Generating Product Descriptions from User Reviews
Novgorodov, S., Guy, I., Elad, G., & Radinsky, K. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313532 · Cited by 41
Kreutzer, J., Uyheng, J., & Riezler, S. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1165 · Cited by 38
CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoning
Johnson, J., Hariharan, B., van der Maaten, L., Fei-Fei, L., Zitnick, C. L., & Girshick, R. (2016) · arXiv · doi:10.48550/arxiv.1612.06890 · Cited by 40
Metadata
- Authors
- Mikolov, T., Chen, K., Corrado, G., & Dean, J.
- Affiliations
- Beijing University of Posts and Telecommunications (CN)
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2013
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1301.3781
- OpenAlex
- W1614298861
- Cited by
- 26,568
- References
- 23
- Citations by year
- 2026: 160 · 2025: 1031 · 2024: 1852 · 2023: 2491 · 2022: 2436 · 2021: 3947 · 2020: 3679 · 2019: 3494 · 2018: 2934 · 2017: 1991 · 2016: 1405 · 2015: 853 · 2014: 254 · 2013: 32
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
- Keywords
- word embeddings, word representation learning, word similarity, computational efficiency, syntactic similarity, semantic similarity, neural network architecture
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
