The DOI matches its DataCite record; 18 of the 19 references it cites were found in a registry or an index.
Distributed Representations of Words and Phrases and their Compositionality
Open accessAbstract
The recently introduced continuous Skip-gram model is an efficient method for learning high-quality distributed vector representations that capture a large number of precise syntactic and semantic word relationships. In this paper we present several extensions that improve both the quality of the vectors and the training speed. By subsampling of the frequent words we obtain significant speedup and also learn more regular word representations. We also describe a simple alternative to the hierarchical softmax called negative sampling. An inherent limitation of word representations is their indifference to word order and their inability to represent idiomatic phrases. For example, the meanings of "Canada" and "Air" cannot be easily combined to obtain "Air Canada". Motivated by this example, we present a simple method for finding phrases in text, and show that learning good vector representations for millions of phrases is possible.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Earlier word embedding models, e.g., word2vec [60] and GloVe [61], predominantly relied on syntactic contexts for training.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [60]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Contrary to string similarity-based approaches, continuous word representations capture not only lexical but also semantic properties of tokens.”
From A Method for the Calculation of Parallel Passages for Buddhist Chinese Sources Based on Million-scale Nearest Neighbor Search (2020) · cites this paper as Mikolov et al. (2013)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Mikolov et al. (2013) demonstrated that unweighted averaging of word embeddings performs well for the representation of short phrases.”
From A Method for the Calculation of Parallel Passages for Buddhist Chinese Sources Based on Million-scale Nearest Neighbor Search (2020) · cites this paper as Mikolov et al. (2013)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even during this stage, there was some use of pre-trained LMs exemplified by word2vec[85,86] and GloVe[95], but they were used for only a limited portion of the final model parameters.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [86]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These models were trained on vast amounts of unlabeled data, aiming to capture intricate grammatical and semantic rules.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [60]
The cited source says what the claim attributes to it.
In the citing paper
“In the next steps we filter out stopwords (e. g. 'a' , 'and' , 'the') and build a Word2Vec model (Mikolov et al., 2013) from these queries to get a model of the occurrence and co-occurrence of terms in these queries.”
From AI art in architecture (2023) · cites this paper as Mikolov et al., 2013
The cited source says what the claim attributes to it.
In the citing paper
“Negative sampling has been proved quite effective for both learning knowledge graph embedding (Trouillon et al., 2016) and word embedding (Mikolov et al., 2013).”
From RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space (2019) · cites this paper as Mikolov et al., 2013
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Self-citationA unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
From Frequency to Meaning: Vector Space Models of Semantics
Turney, P. D., & Pantel, P. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2934 · Cited by 2,949
Linguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · Cited by 2,913
Self-citation(2010) · Cited by 1,906
Extensions of recurrent neural network language model
Mikolov, T., Kombrink, S., Burget, L., Černocký, J., & Khudanpur, S. P. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5947611 · Cited by 1,622
Self-citationDomain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach
Glorot, X., Bordes, A., & Bengio, Y. (2011) · Cited by 1,569
Semantic Compositionality through Recursive Matrix-Vector Spaces
Socher, R., Huval, B., Manning, C. D., & Ng, A. Y. (2012) · Cited by 1,262
(2011) · Cited by 1,192
Research works printed but not linked: 3
- [1][1] Yoshua Bengio, R´ ejean Ducharme, Pascal Vincent, and Christian Janvin. A neural probabilistic language model. The Journal of Machine Learning Research , 3:1137-1155, 2003. -
- [7][7] Tomas Mikolov. Statistical Language Models Based on Neural Networks. PhD thesis, PhD Thesis, Brno University of Technology , 2012. -
- [13][13] David E Rumelhart, Geoffrey E Hintont, and Ronald J Williams. Learning representations by backpropagating errors. Nature , 323(6088):533-536, 1986. -
Cited by
Sorted by citations
Items 1,101–1,187 of 1,187
Learner experience in artificial intelligence-scaffolded argumentation
Kim, M. K., Kim, N. J., & Heidari, A. (2022) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2022.2042792 · Cited by 51
Generalizing Word Embeddings using Bag of Subwords
Zhao, J., Mudgal, S., & Liang, Y. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1059 · Cited by 53
Lyu, L., He, X., & Li, Y. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.213 · Cited by 51
Distributed learning from multiple EHR databases: Contextual embedding models for medical events
Li, Z., Roberts, K., Jiang, X., & Long, Q. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103138 · Cited by 44
Robust Anomaly-Based Insider Threat Detection Using Graph Neural Network
Xiao, J., Yang, L., Zhong, F., Wang, X., Chen, H., & Li, D. (2023) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2022.3222635 · Cited by 48
Koloveas, P., Chantzios, T., Tryfonopoulos, C., & Skiadopoulos, S. (2019) · 2019 IEEE World Congress on Services (SERVICES) · doi:10.1109/services.2019.00016 · Cited by 48
Kaur, R., Ginige, J. A., & Obst, O. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118997 · Cited by 48
Lee, K., Famiglietti, M. L., McMahon, A., Wei, C.-H., MacArthur, J. A. L., Poux, S., Breuza, L., Bridge, A., Cunningham, F., Xenarios, I., et al. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006390 · Cited by 47
Controlling hallucinations at word level in data-to-text generation
Rebuffel, C., Roberti, M., Soulier, L., Scoutheeten, G., Cancelliere, R., & Gallinari, P. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-021-00801-4 · Cited by 50
HeteroMed: Heterogeneous Information Network for Medical Diagnosis
Hosseini, A., Chen, T., Wu, W., Sun, Y., & Sarrafzadeh, M. (2018) · Proceedings of the 27th ACM International Conference on Information and Knowledge Management · doi:10.1145/3269206.3271805 · Cited by 47
Language Models Represent Space and Time
Gurnee, W., & Tegmark, M. (2023) · arXiv · doi:10.48550/arxiv.2310.02207 · Cited by 46
Enhancing Reliability of Analog Neural Network Processors
Moon, S., Shin, K., & Jeon, D. (2019) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2019.2893256 · Cited by 45
Exploring Numeracy in Word Embeddings
Naik, A., Ravichander, A., Rose, C., & Hovy, E. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1329 · Cited by 49
Zhao, C., Jiang, J., Guan, Y., Guo, X., & He, B. (2018) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2018.03.005 · Cited by 41
Machine Learning Explanations to Prevent Overtrust in Fake News Detection
Mohseni, S., Yang, F., Pentyala, S., Du, M., Liu, Y., Lupfer, N., Hu, X., Ji, S., & Ragan, E. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v15i1.18072 · Cited by 44
Multimodal Continuous Emotion Recognition with Data Augmentation Using Recurrent Neural Networks
Huang, J., Li, Y., Tao, J., Lian, Z., Niu, M., & Yang, M. (2018) · Proceedings of the 2018 on Audio/Visual Emotion Challenge and Workshop · doi:10.1145/3266302.3266304 · Cited by 40
Modeling temporal patterns of cyberbullying detection with hierarchical attention networks
Cheng, L., Guo, R., Silva, Y. N., Hall, D., & Liu, H. (2021) · ACM/IMS Transactions on Data Science · doi:10.1145/3441141 · Cited by 43
Yang, J., Wang, L., Phadke, N. A., Wickner, P. G., Mancini, C. M., Blumenthal, K. G., & Zhou, L. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.22836 · Cited by 42
Sense and Learn: Self-supervision for omnipresent sensors
Saeed, A., Ungureanu, V., & Gfeller, B. (2021) · Machine Learning with Applications · doi:10.1016/j.mlwa.2021.100152 · Cited by 34
Natural Language Processing in Marketing
Hartmann, J., & Netzer, O. (2023) · Artificial Intelligence in Marketing · doi:10.1108/s1548-643520230000020011 · Cited by 38
Moon, K., Green, A. E., & Kushlev, K. (2025) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2025.100207 · Cited by 38
Visual Semantic Information Pursuit: A Survey
Liu, D., Bober, M., & Kittler, J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2950025 · Cited by 39
Machine learning techniques for the automation of literature reviews and systematic reviews in EFSA
Jaspers, S., De Troyer, E., & Aerts, M. (2018) · EFSA Supporting Publications · doi:10.2903/sp.efsa.2018.en-1427 · Cited by 36
Hurtful Words: Quantifying Biases in Clinical Contextual Word Embeddings
Zhang, H., Lu, A. X., Abdalla, M., McDermott, M., & Ghassemi, M. (2020) · arXiv · doi:10.48550/arxiv.2003.11515 · Cited by 37
The design of reciprocal learning between human and artificial intelligence
Zagalsky, A., Te'eni, D., Yahav, I., Schwartz, D. G., Silverman, G., Cohen, D., Mann, Y., & Lewinsky, D. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479587 · Cited by 35
Harmonized representation learning on dynamic EHR graphs
Lee, D., Jiang, X., & Yu, H. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103426 · Cited by 34
Kwak, H., Lee, M., Yoon, S., Chang, J., Park, S., & Jung, K. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-47436-2_48 · Cited by 41
GraphCPI: Graph Neural Representation Learning for Compound-Protein Interaction
Quan, Z., Guo, Y., Lin, X., Wang, Z.-J., & Zeng, X. (2019) · 2019 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm47256.2019.8983267 · Cited by 35
Feature Learning in Infinite-Width Neural Networks
Yang, G., & Hu, E. J. (2020) · arXiv · doi:10.48550/arxiv.2011.14522 · Cited by 35
Voice Deepfake Detection Using the Self-Supervised Pre-Training Model HuBERT
Li, L., Lu, T., Ma, X., Yuan, M., & Wan, D. (2023) · Applied Sciences · doi:10.3390/app13148488 · Cited by 33
Automatic Speech Recognition With Very Large Conversational Finnish and Estonian Vocabularies
Enarvi, S., Smit, P., Virpioja, S., & Kurimo, M. (2017) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2017.2743344 · Cited by 33
“[47] use the unigram distribution raised to the power of β.”
MethodExtracting and Ranking Travel Tips from User-Generated Reviews
Guy, I., Mejer, A., Nus, A., & Raiber, F. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052632 · Cited by 32
A Deep Multi-Modal Explanation Model for Zero-Shot Learning
Liu, Y., & Tuytelaars, T. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2975980 · Cited by 31
A Hybrid Deep Learning System of CNN and LRCN to Detect Cyberbullying from SNS Comments
Bu, S.-J., & Cho, S.-B. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-92639-1_47 · Cited by 30
Milon-Flores, D. F., & Cordeiro, R. L. F. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.108017 · Cited by 29
Language models for materials discovery and sustainability: Progress, challenges, and opportunities
Pei, Z., Yin, J., & Zhang, J. (2025) · Progress in Materials Science · doi:10.1016/j.pmatsci.2025.101495 · Cited by 30
Modeling generalization in machine learning: a methodological and computational study
Barbiero, P., Squillero, G., & Tonda, A. (2020) · arXiv · doi:10.48550/arxiv.2006.15680 · Cited by 39
Artificial intelligence—friend or foe in fake news campaigns
Węcel, K., Sawiński, M., Stróżyna, M., Lewoniewski, W., Księżniak, E., Stolarski, P., & Abramowicz, W. (2023) · Economics and Business Review · doi:10.18559/ebr.2023.2.736 · Cited by 28
Trait Associations for Hillary Clinton and Donald Trump in News Media: A Computational Analysis
Bhatia, S., Goodwin, G. P., & Walasek, L. (2018) · Social Psychological and Personality Science · doi:10.1177/1948550617751584 · Cited by 26
Minot, J. R., Cheney, N., Maier, M., Elbers, D. C., Danforth, C. M., & Dodds, P. S. (2022) · ACM Transactions on Computing for Healthcare · doi:10.1145/3524887 · Cited by 23
Convolutional neural networks for multi-topic dialog state tracking,
Shi, H., Ushio, T., Endo, M., Yamagami, K., & Horii, N. (2017) · Lecture Notes in Electrical Engineering · doi:10.1007/978-981-10-2585-3_37 · Cited by 24
A Multi-task Approach to Learning Multilingual Representations
Singla, K., Can, D., & Narayanan, S. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2035 · Cited by 22
Stylianou, N., Razis, G., Goulis, D. G., & Vlahavas, I. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101949 · Cited by 22
Do Language Embeddings capture Scales?
Zhang, X., Ramachandran, D., Tenney, I., Elazar, Y., & Roth, D. (2020) · Proceedings of the Third BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/2020.blackboxnlp-1.27 · Cited by 22
A Unified Sequence-to-Sequence Front-End Model for Mandarin Text-to-Speech Synthesis
Pan, J., Yin, X., Zhang, Z., Liu, S., Zhang, Y., Ma, Z., & Wang, Y. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053390 · Cited by 21
Analysis of sentence embedding models using prediction tasks in natural language processing
Adi, Y., Kermany, E., Belinkov, Y., Lavi, O., & Goldberg, Y. (2017) · IBM Journal of Research and Development · doi:10.1147/jrd.2017.2702858 · Cited by 21
A language framework for modeling social media account behavior
Nwala, A. C., Flammini, A., & Menczer, F. (2023) · EPJ Data Science · doi:10.1140/epjds/s13688-023-00410-9 · Cited by 31
Teacher-student neural coupling during teaching and learning
Nguyen, M., Chang, A., Micciche, E., Meshulam, M., Nastase, S. A., & Hasson, U. (2020) · doi:10.1101/2020.05.07.082958 · Cited by 67
Wu, L., Fang, H., Qu, Y., Xu, J., & Tong, W. (2025) · Drug Safety · doi:10.1007/s40264-025-01520-1 · Cited by 20
GAN-MVAE: a discriminative latent feature generation framework for generalized zero-shot learning
Ma, P., Lu, H., Yang, B., & Ran, W. (2022) · Pattern Recognition Letters · doi:10.1016/j.patrec.2022.02.002 · Cited by 18
A structured distributional model of sentence meaning and processing
Chersoni, E., Santus, E., Pannitto, L., Lenci, A., Blache, P., & Huang, C.-R. (2019) · Natural Language Engineering · doi:10.1017/s1351324919000214 · Cited by 19
SemGloVe: Semantic Co-Occurrences for GloVe From BERT
Gan, L., Teng, Z., Zhang, Y., Zhu, L., Wu, F., & Yang, Y. (2022) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2022.3197316 · Cited by 22
Partially Generative Neural Networks for Gang Crime Classification with Partial Information
Seo, S., Chan, H., Brantingham, P. J., Leap, J., Vayanos, P., Tambe, M., & Liu, Y. (2018) · Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3278721.3278758 · Cited by 17
Xiao, F., Chen, S., Yang, J., He, H., Jiang, X., Tan, X., & Jin, D. (2025) · Computers & Security · doi:10.1016/j.cose.2024.104180 · Cited by 17
Generative Question Refinement with Deep Reinforcement Learning in Retrieval-based QA System
Liu, Y., Zhang, C., Yan, X., Chang, Y., & Yu, P. S. (2019) · Proceedings of the 28th ACM International Conference on Information and Knowledge Management · doi:10.1145/3357384.3358046 · Cited by 15
Facebook Use of Sensitive Data for Advertising in Europe
Cabañas, J. G., Cuevas, Á., & Cuevas, R. (2018) · arXiv · doi:10.48550/arxiv.1802.05030 · Cited by 16
Wait, But Why?: Assessing Behavior Explanation Strategies for Real-Time Strategy Games
Robertson, J., Kokkinakis, A. V., Hook, J., Kirman, B., Block, F., Ursu, M. F., Patra, S., Demediuk, S., Drachen, A., & Olarewaju, O. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397481.3450699 · Cited by 18
A Large-Scale Deep Architecture for Personalized Grocery Basket Recommendations
Mantha, A., Arora, Y., Gupta, S., Kanumala, P., Liu, Z., Guo, S., & Achan, K. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053091 · Cited by 15
Chen, X., Zhou, X., Sun, M., & Wang, H. (2025) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3491933 · Cited by 13
“Automated prediction of item difficulty in reading comprehension using long short-term memory,”
Lin, L.-H., Chang, T.-H., & Hsu, F.-Y. (2019) · 2019 International Conference on Asian Language Processing (IALP) · doi:10.1109/ialp48816.2019.9037716 · Cited by 13
A Neural Candidate-Selector Architecture for Automatic Structured Clinical Text Annotation.
Singh, G., Marshall, I. J., Thomas, J., Shawe-Taylor, J., & Wallace, B. C. (2017) · Proceedings of the 2017 ACM on Conference on Information and Knowledge Management · doi:10.1145/3132847.3132989 · Cited by 11
Thinking Fast and Slow: Efficient Text-to-Visual Retrieval with Transformers
Miech, A., Alayrac, J.-B., Laptev, I., Sivic, J., & Zisserman, A. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00970 · Cited by 149
Limisiewicz, T., & Mareček, D. (2022) · Proceedings of the 4th Workshop on Gender Bias in Natural Language Processing (GeBNLP) · doi:10.18653/v1/2022.gebnlp-1.3 · Cited by 11
TwitchChat: A Dataset for Exploring Livestream Chat
Ringer, C., Nicolaou, M., & Walker, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v16i1.7439 · Cited by 11
The Linear Representation Hypothesis and the Geometry of Large Language Models
Park, K., Choe, Y. J., & Veitch, V. (2023) · arXiv · doi:10.48550/arxiv.2311.03658 · Cited by 11
Universality of representation in biological and artificial neural networks
Hosseini, E., Casto, C., Zaslavsky, N., Conwell, C., Richardson, M., & Fedorenko, E. (2024) · doi:10.1101/2024.12.26.629294 · Cited by 10
Multimodal Fusion with Co-attention Mechanism
Li, P., & Li, X. (2020) · 2020 IEEE 23rd International Conference on Information Fusion (FUSION) · doi:10.23919/fusion45008.2020.9190483 · Cited by 14
OLMo: Accelerating the Science of Language Models
Groeneveld, D., Beltagy, I., Walsh, P., Bhagia, A., Kinney, R., Tafjord, O., Jha, A. H., Ivison, H., Magnusson, I., Wang, Y., et al. (2024) · arXiv · doi:10.48550/arxiv.2402.00838 · Cited by 10
“Language models have been at the center of NLP technologies for many years (Rosenfeld, 2000; Ben-gio et al., 2003; Mikolov et al., 2013; Peters et al., 2018; Brown et al., 2020).”
BackgroundSemantic embeddings of generic objects for zero-shot learning
Hascoet, T., Ariki, Y., & Takiguchi, T. (2019) · EURASIP Journal on Image and Video Processing · doi:10.1186/s13640-018-0371-x · Cited by 9
Doc2vec-Based Insider Threat Detection through Behaviour Analysis of Multi-source Security Logs
Liu, L., Chen, C., Zhang, J., De Vel, O., & Xiang, Y. (2020) · 2020 IEEE 19th International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom50675.2020.00050 · Cited by 9
Kazi, S., Khoja, S., & Daud, A. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100756 · Cited by 9
Identification, Interpretability, and
Lauretig, A. (2019) · Proceedings of the Third Workshop on Natural Language Processing and Computational Social Science · doi:10.18653/v1/w19-2102 · Cited by 9
Kariyawasam, H., Niwarthana, A., Palmer, A., Kay, J., & Withana, A. (2024) · Proceedings of the 29th International Conference on Intelligent User Interfaces · doi:10.1145/3640543.3645161 · Cited by 9
Embedding Learning with Heterogeneous Event Sequence for Insider Threat Detection
Wang, J., Cai, L., Yu, A., & Meng, D. (2019) · 2019 IEEE 31st International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2019.00134 · Cited by 7
Irie, K., Csordás, R., & Schmidhuber, J. (2022) · arXiv · doi:10.48550/arxiv.2202.05798 · Cited by 6
“A desirable NLP experiment would be to train a big Transformer language model (LM) on a vast amount of data, and analyse the attention of linear layers over the training datapoints while sampling from the model.”
InfluentialVacareanu, R., Valenzuela-Escárcega, M. A., Sharp, R., & Surdeanu, M. (2020) · Proceedings of the 28th International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.297 · Cited by 5
From Yes-Men to Truth-Tellers: Addressing Sycophancy in Large Language Models with Pinpoint Tuning
Chen, W., Huang, Z., Xie, L., Lin, B., Li, H., Lu, L., Tian, X., Cai, D., Zhang, Y., Wang, W., et al. (2024) · arXiv · doi:10.48550/arxiv.2409.01658 · Cited by 5
Towards AI-Generated Essay Classification Using Numerical Text Representation
Krawczyk, N., Probierz, B., & Kozak, J. (2024) · Applied Sciences · doi:10.3390/app14219795 · Cited by 4
Nehrdich, S. (2020) · Journal of the Japanese Association for Digital Humanities · doi:10.17928/jjadh.5.2_132 · Cited by 3
“Mikolov et al. (2013) demonstrated that unweighted averaging of word embeddings performs well for the representation of short phrases.”
BackgroundMethodFeng, N. (2025) · Scientific Reports · doi:10.1038/s41598-025-22272-z · Cited by 3
Keep a Human in the Machine and Other Lessons Learned from Deploying and Maintaining Colandr
Cheng, S., & Augustin, C. (2021) · CHANCE · doi:10.1080/09332480.2021.1979818 · Cited by 2
Quillivic, R., Auxéméry, Y., Gayraud, F., Dayan, J., & Mesmoudi, S. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf075 · Cited by 3
Ivanova, A. A., Sathe, A., Lipkin, B., Kumar, U., Radkani, S., Clark, T. H., Kauf, C., Hu, J., Pramod, R. T., Grand, G., et al. (2024) · arXiv · doi:10.48550/arxiv.2405.09605 · Cited by 2
“We additionally tested a baseline bag-of-words model based on word2vec embeddings (Mikolov et al., 2013).”
The Data-Wink Ratio: Emoji Encoder for Generating Semantically-Resonant Unit Charts
Brehmer, M., Setlur, V., Zoe, & Correll, M. (2024) · 2024 IEEE VIS Workshop on Data Storytelling in an Era of Generative AI (GEN4DS) · doi:10.1109/gen4ds63889.2024.00005 · Cited by 1
AxBench: Steering LLMs? Even Simple Baselines Outperform Sparse Autoencoders
Wu, Z., Arora, A., Geiger, A., Wang, Z., Huang, J., Jurafsky, D., Manning, C. D., & Potts, C. (2025) · arXiv · doi:10.48550/arxiv.2501.17148
Adversarial Unsupervised Representation Learning for Activity Time-Series
Aggarwal, K., Joty, S., Fernandez-Luque, L., & Srivastava, J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.3301834
Metadata
- Authors
- Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2013
- Volume
- 26
- Pages
- 3111-3119
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1310.4546
- OpenAlex
- W2153579005
- Cited by
- 24,533
- References
- 19
- Citations by year
- 2026: 114 · 2025: 872 · 2024: 1388 · 2023: 1965 · 2022: 2239 · 2021: 3514 · 2020: 3787 · 2019: 3870 · 2018: 2785 · 2017: 1949 · 2016: 1194 · 2015: 658 · 2014: 176 · 2013: 7
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- TIB Data Manager
- neural information processing systems
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- distributed word representations, skip-gram model, phrase representation, negative sampling, frequent terms, idioms, word order, training speed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
