The DOI matches its DataCite record; 21 of the 23 references it cites were found in a registry or an index.
Efficient Estimation of Word Representations in Vector Space
Open accessAbstract
We propose two novel model architectures for computing continuous vector representations of words from very large data sets. The quality of these representations is measured in a word similarity task, and the results are compared to the previously best performing techniques based on different types of neural networks. We observe large improvements in accuracy at much lower computational cost, i.e. it takes less than a day to learn high quality word vectors from a 1.6 billion words data set. Furthermore, we show that these vectors provide state-of-the-art performance on our test set for measuring syntactic and semantic word similarities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even during this stage, there was some use of pre-trained LMs exemplified by word2vec[85,86] and GloVe[95], but they were used for only a limited portion of the final model parameters.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [85]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Word embeddings are created using a model proposed by Mikolov et al. (2013), developed by Google.”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
The cited source says what the claim attributes to it.
In the citing paper
“According to Mikolov et al. (2013), if 'closeness' is measured by cosine similarity, the vector V ( w 3 ) is most similar to the vector V ( w 0 ) -V ( w 1 ) + V ( w 2 ) .”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
The cited source says what the claim attributes to it.
In the citing paper
“Models can undergo training on extensive textual datasets, subsequently utilizing the acquired knowledge for subsequent tasks through transfer learning (Mikolov et al. 2013).”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
The cited source says what the claim attributes to it.
In the citing paper
“Distributed word representations can be created quickly using shallow networks, such as the Continuous Bag-of-Words (CBOW) model [19].”
From Automatic Speech Recognition With Very Large Conversational Finnish and Estonian Vocabularies (2017) · cites this paper as [19]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“This form of Test-Time Training (TTT), similar to an old idea known as dynamic evaluation [72, 60], still has a missing piece: At training time, we were optimizing the model for its loss out of the box, not for its loss after TTT.”
From End-to-End Test-Time Training for Long Context (2025) · cites this paper as [72]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Word2Vec has experienced significant growth in NLP in recent years (Mikolov et al. 2013).”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Mikolov et al. 2013
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
(2010) · Cited by 8,261
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390
Self-citationA unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Learning Word Vectors for Sentiment Analysis
Maas, A. L., Daly, R. E., Pham, P. T., Huang, D., Ng, A. Y., & Potts, C. (2011) · Cited by 3,710
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · Cited by 3,202
Self-citationLinguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · Cited by 2,913
Self-citation(2010) · Cited by 1,906
Extensions of recurrent neural network language model
Mikolov, T., Kombrink, S., Burget, L., Černocký, J., & Khudanpur, S. P. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5947611 · Cited by 1,622
Self-citation(2007) · Cited by 937
Research works printed but not linked: 10
- [1][1] Y. Bengio, R. Ducharme, P. Vincent. A neural probabilistic language model. Journal of Machine Learning Research, 3:1137-1155, 2003. -
- [5][5] R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu and P. Kuksa. Natural Language Processing (Almost) from Scratch. Journal of Machine Learning Research, 12:24932537, 2011. -
- [9][9] Eric H. Huang, R. Socher, C. D. Manning and Andrew Y. Ng. Improving Word Representations via Global Context and Multiple Word Prototypes. In: Proc. Association for Computational Linguistics, 2012. -
- [10][10] G.E. Hinton, J.L. McClelland, D.E. Rumelhart. Distributed representations. In: Parallel distributed processing: Explorations in the microstructure of cognition. Volume 1: Foundations, MIT Press, 1986. -
- [13][13] T. Mikolov. Language Modeling for Speech Recognition in Czech, Masters thesis, Brno University of Technology, 2007. -
- [14][14] T. Mikolov, J. Kopeck´ y, L. Burget, O. Glembek and J. ˇ Cernock´ y. Neural network based language models for higly inflective languages, In: Proc. ICASSP 2009. -
- [18][18] T. Mikolov, A. Deoras, D. Povey, L. Burget, J. ˇ Cernock´ y. Strategies for Training Large Scale Neural Network Language Models, In: Proc. Automatic Speech Recognition and Understanding, 2011. -
- [19][19] T. Mikolov. Statistical Language Models based on Neural Networks. PhD thesis, Brno University of Technology, 2012. -
- [21][21] T. Mikolov, I. Sutskever, K. Chen, G. Corrado, and J. Dean. Distributed Representations of Words and Phrases and their Compositionality. Accepted to NIPS 2013. -
- [25][25] F. Morin, Y. Bengio. Hierarchical Probabilistic Neural Network Language Model. AISTATS, 2005. -
Cited by
Sorted by citations
Items 1,101–1,189 of 1,189
Winners and losers of generative AI: Early Evidence of Shifts in Freelancer Demand
Teutloff, O., Einsiedler, J., Kässi, O., Braesemann, F., Mishkin, P., & del Rio-Chanona, R. M. (2025) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2024.106845 · Cited by 39
Natural Language Processing in Marketing
Hartmann, J., & Netzer, O. (2023) · Artificial Intelligence in Marketing · doi:10.1108/s1548-643520230000020011 · Cited by 38
Human-centered neural reasoning for subjective content processing: Hate speech, emotions, and humor
Kazienko, P., Bielaniewicz, J., Gruza, M., Kanclerz, K., Karanowski, K., Miłkowski, P., & Kocoń, J. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.01.010 · Cited by 38
Visual Semantic Information Pursuit: A Survey
Liu, D., Bober, M., & Kittler, J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2950025 · Cited by 39
IntroBot: Exploring the Use of Chatbot-assisted Familiarization in Online Collaborative Groups
Shin, D., Kim, S., Shang, R., Lee, J., & Hsieh, G. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580930 · Cited by 37
Analogy Generation by Prompting Large Language Models: A Case Study of InstructGPT
Bhavya, B., Xiong, J., & Zhai, C. (2022) · Proceedings of the 15th International Conference on Natural Language Generation · doi:10.18653/v1/2022.inlg-main.25 · Cited by 40
A Deep Dive into Multilingual Hate Speech Classification
Aluru, S. S., Mathew, B., Saha, P., & Mukherjee, A. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-67670-4_26 · Cited by 37
Deep learning for online harassment detection in tweets
Marwa, T., Salima, O., & Souham, M. (2018) · 2018 3rd International Conference on Pattern Analysis and Intelligent Systems (PAIS) · doi:10.1109/pais.2018.8598530 · Cited by 35
How Large Language Models are Transforming Machine-Paraphrase Plagiarism
Wahle, J. P., Ruas, T., Kirstein, F., & Gipp, B. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.62 · Cited by 35
Feature Learning in Infinite-Width Neural Networks
Yang, G., & Hu, E. J. (2020) · arXiv · doi:10.48550/arxiv.2011.14522 · Cited by 35
An Investigation of Transfer Learning-Based Sentiment Analysis in Japanese
Bataa, E., & Wu, J. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1458 · Cited by 35
Text-To-Text Generative Adversarial Networks
Li, C., Su, Y., & Liu, W. (2018) · 2018 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489624 · Cited by 33
Automatic Speech Recognition With Very Large Conversational Finnish and Estonian Vocabularies
Enarvi, S., Smit, P., Virpioja, S., & Kurimo, M. (2017) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2017.2743344 · Cited by 33
“Distributed word representations can be created quickly using shallow networks, such as the Continuous Bag-of-Words (CBOW) model [19].”
BackgroundIntrinsic bias metrics do not correlate with application bias
Goldfarb-Tarrant, S., Marchant, R., Muñoz Sánchez, R., Pandya, M., & Lopez, A. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.150 · Cited by 33
“A theme-rewriting approach for generating algebra word problems,”
Koncel-Kedziorski, R., Konstas, I., Zettlemoyer, L., & Hajishirzi, H. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1168 · Cited by 30
Testing of Detection Tools for AI-Generated Text
Weber-Wulff, D., Anohina-Naumeca, A., Bjelobaba, S., Foltýnek, T., Guerrero-Dib, J., Popoola, O., Šigut, P., & Waddington, L. (2023) · arXiv · doi:10.48550/arxiv.2306.15666 · Cited by 32
Representing high throughput expression profiles via perturbation barcodes reveals compound targets
Filzen, T. M., Kutchukian, P. S., Hermes, J. D., Li, J., & Tudor, M. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005335 · Cited by 31
Emergent Linear Representations in World Models of Self-Supervised Sequence Models
Nanda, N., Lee, A., & Wattenberg, M. (2023) · Proceedings of the 6th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/2023.blackboxnlp-1.2 · Cited by 55
Language models for materials discovery and sustainability: Progress, challenges, and opportunities
Pei, Z., Yin, J., & Zhang, J. (2025) · Progress in Materials Science · doi:10.1016/j.pmatsci.2025.101495 · Cited by 30
A Hybrid Deep Learning System of CNN and LRCN to Detect Cyberbullying from SNS Comments
Bu, S.-J., & Cho, S.-B. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-92639-1_47 · Cited by 30
Detecting Insider Threat from Behavioral Logs Based on Ensemble and Self-Supervised Learning
Zhang, C., Wang, S., Zhan, D., Yu, T., Wang, T., & Yin, M. (2021) · Security and Communication Networks · doi:10.1155/2021/4148441 · Cited by 30
PICO entity extraction for preclinical animal literature.
Wang, Q., Liao, J., Lapata, M., & Macleod, M. (2022) · Systematic Reviews · doi:10.1186/s13643-022-02074-4 · Cited by 29
Automatic Speech Assessment for People with Aphasia Using TDNN-BLSTM with Multi-Task Learning
Qin, Y., Lee, T., Feng, S., & Kong, A. P. H. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1630 · Cited by 30
Artificial intelligence—friend or foe in fake news campaigns
Węcel, K., Sawiński, M., Stróżyna, M., Lewoniewski, W., Księżniak, E., Stolarski, P., & Abramowicz, W. (2023) · Economics and Business Review · doi:10.18559/ebr.2023.2.736 · Cited by 28
Mai, S., Hu, H., & Xing, S. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3082398 · Cited by 26
Aceso: PICO-Guided Evidence Summarization on Medical Literature.
Zhang, X., Geng, P., Zhang, T., Lu, Q., Gao, P., & Mei, J. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2984704 · Cited by 25
Minot, J. R., Cheney, N., Maier, M., Elbers, D. C., Danforth, C. M., & Dodds, P. S. (2022) · ACM Transactions on Computing for Healthcare · doi:10.1145/3524887 · Cited by 23
Investigating Enhancements to Contrastive Predictive Coding for Human Activity Recognition
Haresamudram, H., Essa, I., & Plötz, T. (2023) · 2023 IEEE International Conference on Pervasive Computing and Communications (PerCom) · doi:10.1109/percom56429.2023.10099197 · Cited by 27
“This training paradigm of ‘pretrain-then-finetune’ has resulted in significant performance improvements across domains such as computer vision [11], speech processing [12]–[15], natural language processing [16]–[18], and human activity recognition from wearables [19]–[21].”
BackgroundAlsharid, M., Cai, Y., Sharma, H., Drukker, L., Papageorghiou, A. T., & Noble, J. A. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102630 · Cited by 25
Sequence to Sequence Modeling for User Simulation in Dialog Systems
Crook, P., & Marin, A. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-161 · Cited by 25
JustCorrect: Intelligent Post Hoc Text Correction Techniques on Smartphones
Cui, W., Zhu, S., Zhang, M. R., Schwartz, H. A., Wobbrock, J. O., & Bi, X. (2020) · Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3379337.3415857 · Cited by 24
Enriched music representations with multiple cross-modal contrastive learning
Ferraro, A., Favory, X., Drossos, K., Kim, Y., & Bogdanov, D. (2021) · IEEE Signal Processing Letters · doi:10.1109/lsp.2021.3071082 · Cited by 23
Question answering systems with deep learning-based symbolic processing
Honda, H., & Hagiwara, M. (2019) · IEEE Access · doi:10.1109/access.2019.2948081 · Cited by 23
An explainable machine learning model of cognitive decline derived from speech
Chandler, C., Diaz‐Asper, C., Turner, R. S., Reynolds, B., & Elvevåg, B. (2023) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1002/dad2.12516 · Cited by 24
Irreflexive and Hierarchical Relations as Translations
Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., & Yakhnenko, O. (2013) · arXiv · doi:10.48550/arxiv.1304.7158 · Cited by 23
The use of bibliography enriched features for automatic citation screening
Olorisade, B. K., Brereton, P., & Andras, P. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103202 · Cited by 21
Lotfollahi, M., Wolf, F. A., & Theis, F. J. (2018) · doi:10.1101/478503 · Cited by 21
Reducing annotation burden through multimodal learning
Lopez, K., Fodeh, S. J., Allam, A., Brandt, C. A., & Krauthammer, M. (2020) · Frontiers in Big Data · doi:10.3389/fdata.2020.00019 · Cited by 21
Research progress of zero-shot learning beyond computer vision
Cao, W., Zhou, C., Wu, Y., Ming, Z., Xu, Z., & Zhang, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-60239-0_36 · Cited by 21
Analysis of sentence embedding models using prediction tasks in natural language processing
Adi, Y., Kermany, E., Belinkov, Y., Lavi, O., & Goldberg, Y. (2017) · IBM Journal of Research and Development · doi:10.1147/jrd.2017.2702858 · Cited by 21
Using Natural Language Processing to Predict Item Response Times and Improve Test Construction
Baldwin, P., Yaneva, V., Mee, J., Clauser, B. E., & Ha, L. A. (2021) · Journal of Educational Measurement · doi:10.1111/jedm.12264 · Cited by 20
Adaptive e-Learning AI-Powered Chatbot based on Multimedia Indexing
Janati, S. E., Maach, A., & El, D. (2020) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2020.0111238 · Cited by 20
Parameter-Efficient Transfer Learning with Diff Pruning
Guo, D., Rush, A. M., & Kim, Y. (2020) · arXiv · doi:10.48550/arxiv.2012.07463 · Cited by 20
DeepCADRME: a deep neural model for complex adverse drug reaction mentions extraction
El-allaly, E.-D., Sarrouti, M., En-Nahnahi, N., & Ouatik El Alaoui, S. (2021) · Pattern Recognition Letters · doi:10.1016/j.patrec.2020.12.013 · Cited by 19
Hacking, C., Verbeek, H., Hamers, J. P. H., Sion, K., & Aarts, S. (2022) · PLoS ONE · doi:10.1371/journal.pone.0268281 · Cited by 19
Text Transformations in Contrastive Self-Supervised Learning: A Review
Bhattacharjee, A., Karami, M., & Liu, H. (2022) · Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/757 · Cited by 20
SemGloVe: Semantic Co-Occurrences for GloVe From BERT
Gan, L., Teng, Z., Zhang, Y., Zhu, L., Wu, F., & Yang, Y. (2022) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2022.3197316 · Cited by 22
Investigating the Effects of Word Substitution Errors on Sentence Embeddings
Voleti, R., Liss, J. M., & Berisha, V. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683367 · Cited by 17
Log2Intent: Towards Interpretable User Modeling via Recurrent Semantics Memory Unit
Tao, Z., Li, S., Wang, Z., Fang, C., Yang, L., Zhao, H., & Fu, Y. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330889 · Cited by 16
Measuring and Mitigating Gender Bias in Legal Contextualized Language Models
Bozdag, M., Sevim, N., & Koç, A. (2024) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3628602 · Cited by 15
Facebook Use of Sensitive Data for Advertising in Europe
Cabañas, J. G., Cuevas, Á., & Cuevas, R. (2018) · arXiv · doi:10.48550/arxiv.1802.05030 · Cited by 16
Multimodal fusion network for ICU patient outcome prediction
Wang, C., Yang, X., Sun, M., Gu, Y., Niu, J., & Zhang, W. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106672 · Cited by 16
A Large-Scale Deep Architecture for Personalized Grocery Basket Recommendations
Mantha, A., Arora, Y., Gupta, S., Kanumala, P., Liu, Z., Guo, S., & Achan, K. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053091 · Cited by 15
Learning Patient Representations from Text
Dligach, D., & Miller, T. (2018) · Proceedings of the Seventh Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/s18-2014 · Cited by 13
Lou, S. S., Liu, H., Harford, D., Lu, C., & Kannampallil, T. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac239 · Cited by 13
Investigating Educational and Noneducational Answer Selection for Educational Question Generation
Steuer, T., Filighera, A., & Tregel, T. (2022) · IEEE Access · doi:10.1109/access.2022.3180838 · Cited by 13
“Each sentence embedding vector is a Continuous Bag of Words [11] averaging over all word embeddings of the sentence 3 .”
BackgroundDomain-specific sentiment analysis: An optimized deep learning approach for the financial markets
Yekrangi, M., & Nikolov, N. S. (2023) · IEEE Access · doi:10.1109/access.2023.3293733 · Cited by 14
Zhao, Z., Gao, M., Luo, F., Zhang, Y., & Xiong, Q. (2020) · 2020 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207640 · Cited by 13
Towards a computational framework for automating substance use counseling with virtual agents
Olafsson, S., Wallace, B., & Bickmore, T. (2020) · International Joint Conference on Autonomous Agents and Multiagent Systems · doi:10.65109/ykkp3988 · Cited by 13
Rationales for Sequential Predictions
Vafa, K., Deng, Y., Blei, D., & Rush, A. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.807 · Cited by 14
TwitchChat: A Dataset for Exploring Livestream Chat
Ringer, C., Nicolaou, M., & Walker, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v16i1.7439 · Cited by 11
Universality of representation in biological and artificial neural networks
Hosseini, E., Casto, C., Zaslavsky, N., Conwell, C., Richardson, M., & Fedorenko, E. (2024) · doi:10.1101/2024.12.26.629294 · Cited by 10
Towards Recognizing Unseen Categories in Unseen Domains
Mancini, M., Akata, Z., Ricci, E., & Caputo, B. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58592-1_28 · Cited by 9
New Methods for Confusion Detection in Course Forums: Student, Teacher, and Machine
Geller, S. A., Gal, K., Segal, A., Sripathi, K., Kim, H. G., Facciotti, M. T., Igo, M., Hoernle, N., & Karger, D. (2021) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2021.3123266 · Cited by 9
Automatic Generation of Multiple-choice Cloze-test Questions for Lao Language Learning
Qiu, X., Xue, H., Liang, L., Xie, Z., Liao, S., & Shi, G. (2021) · 2021 International Conference on Asian Language Processing (IALP) · doi:10.1109/ialp54817.2021.9675153 · Cited by 7
Kariyawasam, H., Niwarthana, A., Palmer, A., Kay, J., & Withana, A. (2024) · Proceedings of the 29th International Conference on Intelligent User Interfaces · doi:10.1145/3640543.3645161 · Cited by 9
Multimodal Generative Models for Compositional Representation Learning
Wu, M., & Goodman, N. (2019) · arXiv · doi:10.48550/arxiv.1912.05075 · Cited by 8
Scoring alignments by embedding vector similarity
Ashrafzadeh, S., Golding, G. B., Ilie, S., & Ilie, L. (2023) · doi:10.1101/2023.08.30.555602 · Cited by 8
“Embeddings such as word2vec [21] or GloVe [24] are contextual independent as the embedding vector for a given word is the same regardless of context.”
BackgroundMethodEmbedding Learning with Heterogeneous Event Sequence for Insider Threat Detection
Wang, J., Cai, L., Yu, A., & Meng, D. (2019) · 2019 IEEE 31st International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2019.00134 · Cited by 7
Xie, Y., Peng, J., & Zhou, Y. (2019) · doi:10.21203/rs.2.18936/v1 · Cited by 5
Exploring the Knowledge of an Outstanding Protein to Protein Interaction Transformer
Yang, S., Cheng, P., Liu, Y., Feng, D., & Wang, S. (2024) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2024.3381825 · Cited by 6
SAED: Edge-Based Intelligence for Privacy-Preserving Enterprise Search on the Cloud
Zobaed, S. M., Salehi, M. A., & Buyya, R. (2021) · 2021 IEEE/ACM 21st International Symposium on Cluster, Cloud and Internet Computing (CCGrid) · doi:10.1109/ccgrid51090.2021.00046 · Cited by 6
de la Fuente Garcia, S., Ritchie, C. W., & Luz, S. (2020) · Journal of Alzheimer's Disease · doi:10.3233/jad-200888 · Cited by 5
Multimodal social media video classification with deep neural networks
Trzcinski, T. (2018) · Photonics Applications in Astronomy, Communications, Industry, and High-Energy Physics Experiments 2018 · doi:10.1117/12.2501679 · Cited by 6
Vacareanu, R., Valenzuela-Escárcega, M. A., Sharp, R., & Surdeanu, M. (2020) · Proceedings of the 28th International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.297 · Cited by 5
Taxonomy of academic plagiarism methods
Vrbanec, T., & Meštrović, A. (2021) · Zbornik Veleučilišta u Rijeci · doi:10.31784/zvr.9.1.17 · Cited by 9
Fine-Grained Fault Sensitivity Analysis of Vision Transformers Under Soft Errors
He, J., Liu, Y., Xu, C., Liao, X., & Yang, Y. (2025) · Electronics · doi:10.3390/electronics14122418 · Cited by 4
Liu, L., Mendoza, R. A., Martin, T. R., & Miori, V. M. (2024) · Proceedings of the 2024 9th International Conference on Distance Education and Learning · doi:10.1145/3675812.3675874 · Cited by 4
BDCN: Semantic Embedding Self-explanatory Breast Diagnostic Capsules Network
Chen, D., Zhong, K., & He, J. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-84186-7_28 · Cited by 3
Improving Text Simplification with Factuality Error Detection
Ma, Y., Seneviratne, S., & Daskalaki, E. (2022) · Proceedings of the Workshop on Text Simplification, Accessibility, and Readability (TSAR-2022) · doi:10.18653/v1/2022.tsar-1.16 · Cited by 3
Boundary-aware Dual Biaffine Model for Sequential Sentence Classification in Biomedical Documents.
Duan, J., Guo, H., Jiang, H., Guo, F., & Wang, J. (2024) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2024.3376566 · Cited by 2
End-to-End Test-Time Training for Long Context
Tandon, A., Dalal, K., Li, X., Koceja, D., Rød, M., Buchanan, S., Wang, X., Leskovec, J., Koyejo, S., Hashimoto, T., et al. (2025) · arXiv
“Moreover, our outer loop directly optimizes the final loss after TTT, in contrast to dynamic evaluation [72, 60], as discussed.”
InfluentialHistorical Ink: Semantic Shift Detection for 19th Century Spanish
Montes, T., Manrique-Gómez, L., & Manrique, R. (2024) · arXiv · doi:10.48550/arxiv.2407.12852
“In 2013, static word embeddings, also known as word vector representations, were first introduced by Mikolov et al. (2013) using the bag-of-words and skip-gram architectures.”
MethodInvestigating Enhancements to Contrastive Predictive Coding for Human Activity Recognition
Haresamudram, H., Essa, I., & Ploetz, T. (2022) · arXiv · Cited by 27
“This training paradigm of ‘pretrain-then-finetune’ has resulted in significant performance improvements across domains such as computer vision [11], speech processing [12]–[15], natural language processing [16]–[18], and human activity recognition from wearables [19]–[21].”
BackgroundEvoFlow: Evolving Diverse Agentic Workflows On The Fly
Zhang, G., Chen, K., Wan, G., Chang, H., Cheng, H., Wang, K., Hu, S., & Bai, L. (2025) · arXiv · doi:10.48550/arxiv.2502.07373
“For natural language processing (NLP), this is exemplified by the replacement of hand-designed representations like Bag-of-Words (Mikolov et al., 2013) with learned embeddings like GloVe (Pennington et al., 2014) and BERT (Devlin, 2018).”
Self-citationA Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., Dong, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.18223 · Cited by 2,090
Self-supervised Learning for Human Activity Recognition Using 700,000 Person-days of Wearable Data
Yuan, H., Chan, S., Creagh, A. P., Tong, C., Acquah, A., Clifton, D. A., & Doherty, A. (2022) · arXiv · doi:10.48550/arxiv.2206.02909
Grattafiori, A., Dubey, A., Jauhri, A., Pandey, A., Kadian, A., Al-Dahle, A., Letman, A., Mathur, A., Schelten, A., Vaughan, A., et al. (2024) · arXiv · doi:10.48550/arxiv.2407.21783 · Cited by 505
In ChatGPT We Trust? Measuring and Characterizing the Reliability of ChatGPT
Shen, X., Chen, Z., Backes, M., & Zhang, Y. (2023) · arXiv · doi:10.48550/arxiv.2304.08979 · Cited by 76
“Language models need to identify question tenses to provide correct answers [52, 55].”
Metadata
- Authors
- Mikolov, T., Chen, K., Corrado, G., & Dean, J.
- Affiliations
- Beijing University of Posts and Telecommunications (CN)
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2013
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1301.3781
- OpenAlex
- W1614298861
- Cited by
- 26,568
- References
- 23
- Citations by year
- 2026: 160 · 2025: 1031 · 2024: 1852 · 2023: 2491 · 2022: 2436 · 2021: 3947 · 2020: 3679 · 2019: 3494 · 2018: 2934 · 2017: 1991 · 2016: 1405 · 2015: 853 · 2014: 254 · 2013: 32
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
- Keywords
- word embeddings, word representation learning, word similarity, computational efficiency, syntactic similarity, semantic similarity, neural network architecture
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
