The DOI matches its DataCite record; 18 of the 19 references it cites were found in a registry or an index.
Distributed Representations of Words and Phrases and their Compositionality
Open accessAbstract
The recently introduced continuous Skip-gram model is an efficient method for learning high-quality distributed vector representations that capture a large number of precise syntactic and semantic word relationships. In this paper we present several extensions that improve both the quality of the vectors and the training speed. By subsampling of the frequent words we obtain significant speedup and also learn more regular word representations. We also describe a simple alternative to the hierarchical softmax called negative sampling. An inherent limitation of word representations is their indifference to word order and their inability to represent idiomatic phrases. For example, the meanings of "Canada" and "Air" cannot be easily combined to obtain "Air Canada". Motivated by this example, we present a simple method for finding phrases in text, and show that learning good vector representations for millions of phrases is possible.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Earlier word embedding models, e.g., word2vec [60] and GloVe [61], predominantly relied on syntactic contexts for training.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [60]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Contrary to string similarity-based approaches, continuous word representations capture not only lexical but also semantic properties of tokens.”
From A Method for the Calculation of Parallel Passages for Buddhist Chinese Sources Based on Million-scale Nearest Neighbor Search (2020) · cites this paper as Mikolov et al. (2013)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Mikolov et al. (2013) demonstrated that unweighted averaging of word embeddings performs well for the representation of short phrases.”
From A Method for the Calculation of Parallel Passages for Buddhist Chinese Sources Based on Million-scale Nearest Neighbor Search (2020) · cites this paper as Mikolov et al. (2013)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even during this stage, there was some use of pre-trained LMs exemplified by word2vec[85,86] and GloVe[95], but they were used for only a limited portion of the final model parameters.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [86]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These models were trained on vast amounts of unlabeled data, aiming to capture intricate grammatical and semantic rules.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [60]
The cited source says what the claim attributes to it.
In the citing paper
“In the next steps we filter out stopwords (e. g. 'a' , 'and' , 'the') and build a Word2Vec model (Mikolov et al., 2013) from these queries to get a model of the occurrence and co-occurrence of terms in these queries.”
From AI art in architecture (2023) · cites this paper as Mikolov et al., 2013
The cited source says what the claim attributes to it.
In the citing paper
“Negative sampling has been proved quite effective for both learning knowledge graph embedding (Trouillon et al., 2016) and word embedding (Mikolov et al., 2013).”
From RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space (2019) · cites this paper as Mikolov et al., 2013
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Self-citationA unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
From Frequency to Meaning: Vector Space Models of Semantics
Turney, P. D., & Pantel, P. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2934 · Cited by 2,949
Linguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · Cited by 2,913
Self-citation(2010) · Cited by 1,906
Extensions of recurrent neural network language model
Mikolov, T., Kombrink, S., Burget, L., Černocký, J., & Khudanpur, S. P. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5947611 · Cited by 1,622
Self-citationDomain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach
Glorot, X., Bordes, A., & Bengio, Y. (2011) · Cited by 1,569
Semantic Compositionality through Recursive Matrix-Vector Spaces
Socher, R., Huval, B., Manning, C. D., & Ng, A. Y. (2012) · Cited by 1,262
(2011) · Cited by 1,192
Research works printed but not linked: 3
- [1][1] Yoshua Bengio, R´ ejean Ducharme, Pascal Vincent, and Christian Janvin. A neural probabilistic language model. The Journal of Machine Learning Research , 3:1137-1155, 2003. -
- [7][7] Tomas Mikolov. Statistical Language Models Based on Neural Networks. PhD thesis, PhD Thesis, Brno University of Technology , 2012. -
- [13][13] David E Rumelhart, Geoffrey E Hintont, and Ronald J Williams. Learning representations by backpropagating errors. Nature , 323(6088):533-536, 1986. -
Cited by
Sorted by citations
Items 701–800 of 1,187
From Zero to Hero: On the Limitations of Zero-Shot Language Transfer with Multilingual Transformers
Lauscher, A., Ravishankar, V., Vulić, I., & Glavaš, G. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.363 · Cited by 283
Journal of Intelligent Information Systems
(2013) · Journal of Intelligent Information Systems · doi:10.1007/10844.1573-7675 · Cited by 281
Generating Factoid Questions With Recurrent Neural Networks: The 30M Factoid Question-Answer Corpus
Serban, I. V., García-Durán, A., Gulcehre, C., Ahn, S., Chandar, S., Courville, A., & Bengio, Y. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1056 · Cited by 280
Biological network analysis with deep learning
Muzio, G., O’Bray, L., & Borgwardt, K. M. (2020) · Briefings in Bioinformatics · doi:10.1093/bib/bbaa257 · Cited by 280
AutoExtend: Extending Word Embeddings to Embeddings for Synsets and Lexemes
Rothe, S., & Schütze, H. (2015) · doi:10.3115/v1/p15-1173 · Cited by 279
A content-based recommendation algorithm for learning resources
Shu, J., Shen, X., Liu, H., Yi, B., & Zhang, Z. (2017) · Multimedia Systems · doi:10.1007/s00530-017-0539-8 · Cited by 279
Tree-to-Sequence Attentional Neural Machine Translation
Eriguchi, A., Hashimoto, K., & Tsuruoka, Y. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1078 · Cited by 279
RESIDE: Improving Distantly-Supervised Neural Relation Extraction using Side Information
Vashishth, S., Joshi, R., Prayaga, S. S., Bhattacharyya, C., & Talukdar, P. P. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1157 · Cited by 278
Lexicon Infused Phrase Embeddings for Named Entity Resolution
Passos, A., Kumar, V., & McCallum, A. (2015) · Cited by 277
Graph representation learning: a survey
Chen, F., Wang, Y.-C., Wang, B., & Kuo, C.-C. J. (2020) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2020.13 · Cited by 277
FlowTransformer: A transformer framework for flow-based network intrusion detection systems
Manocchio, L. D., Layeghy, S., Lo, W. W., Kulatilleke, G. K., Sarhan, M., & Portmann, M. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122564 · Cited by 277
A Survey of Reinforcement Learning Informed by Natural Language
Luketina, J., Nardelli, N., Farquhar, G., Foerster, J., Andreas, J., Grefenstette, E., Whiteson, S., & Rocktäschel, T. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/880 · Cited by 279
Li, Z., Cui, Z., Wu, S., Zhang, X., & Wang, L. (2019) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3357384.3357951 · Cited by 276
Yang, X., Yumer, E., Asente, P., Kraley, M., Kifer, D., & Giles, C. L. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.462 · Cited by 275
A Survey of Text Representation and Embedding Techniques in NLP
Patil, R., Boit, S., Gudivada, V. N., & Nandigam, J. (2023) · IEEE Access · doi:10.1109/access.2023.3266377 · Cited by 276
Impact of word embedding models on text analytics in deep learning environment: a review
Asudani, D. S., Nagwani, N. K., & Singh, P. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10419-1 · Cited by 274
Exercise-Enhanced Sequential Modeling for Student Performance Prediction
Su, Y., Liu, Q., Liu, Q., Huang, Z., Yin, Y., Chen, E., Ding, C. H. Q., Wei, S., & Hu, G. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11864 · Cited by 274
Neural Natural Language Processing for unstructured data in electronic health records: A review
Li, I., Pan, J. N., Goldwasser, J., Verma, N., Wong, W. P., Nuzumlalı, M. Y., Rosand, B., Li, Y., Zhang, M. M., Chang, D., et al. (2022) · Computer Science Review · doi:10.1016/j.cosrev.2022.100511 · Cited by 280
Spam Review Detection with Graph Convolutional Networks
Li, A., Qin, Z., Liu, R., Yang, Y., & Li, D. (2019) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3357384.3357820 · Cited by 273
Argumentation Mining in User-Generated Web Discourse
Habernal, I., & Gurevych, I. (2016) · Computational Linguistics · doi:10.1162/coli_a_00276 · Cited by 272
A survey of visual analytics techniques for machine learning
Yuan, J., Chen, C., Yang, W., Liu, M., Xia, J., & Liu, S. (2020) · Computational Visual Media · doi:10.1007/s41095-020-0191-7 · Cited by 272
Generating Natural Questions About an Image
Mostafazadeh, N., Misra, I., Devlin, J., Mitchell, M., He, X., & Vanderwende, L. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1170 · Cited by 270
Jamal, M. A., Brown, M., Yang, M., Wang, L., & Gong, B. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00763 · Cited by 270
Liu, S., Liu, S., Liu, Z., Peng, X., & Yang, Z. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104461 · Cited by 269
Deep learning-based sentiment classification of evaluative text based on Multi-feature fusion
Abdi, A., Shamsuddin, S. M., Hasan, S., & Piran, M. J. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.02.018 · Cited by 269
Rethinking Positional Encoding in Language Pre-trainingPreprint
Ke, G., He, D., & Liu, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.15595 · Cited by 269
PhraseRNN: Phrase Recursive Neural Network for Aspect-based Sentiment Analysis
Nguyen, T. H., & Shirai, K. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1298 · Cited by 268
BB_twtr at SemEval-2017 Task 4: Twitter Sentiment Analysis with CNNs and LSTMs
Cliche, M. (2017) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s17-2094 · Cited by 268
How Neural Networks Extrapolate: From Feedforward to Graph Neural NetworksPreprint
Xu, K., Zhang, M., Li, J., Du, S. S., Kawarabayashi, K., & Jegelka, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.11848 · Cited by 268
From Paraphrase Database to Compositional Paraphrase Model and Back
Wieting, J., Bansal, M., Gimpel, K., & Livescu, K. (2015) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00143 · Cited by 267
Pretraining-Based Natural Language Generation for Text Summarization
Zhang, H., Cai, J., Xu, J., & Wang, J. (2019) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k19-1074 · Cited by 267
Sampling-bias-corrected neural modeling for large corpus item recommendations
Yi, X., Yang, J. H., Hong, L., Cheng, D. Z., Heldt, L., Kumthekar, A., Zhao, Z., Li, W., & Ed, H. (2019) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3298689.3346996 · Cited by 267
Diachronic word embeddings and semantic shifts: a surveyPreprint
Kutuzov, A., Øvrelid, L., Szymanski, T., & Velldal, E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.03537 · Cited by 267
Detecting Sarcasm in Multimodal Social Platforms
Schifanella, R., de Juan, P., Tetreault, J., & Cao, L. (2016) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2964284.2964321 · Cited by 266
Latent Dirichlet allocation (LDA) for topic modeling of the CFPB consumer complaints
Bastani, K., Namavari, H., & Shaffer, J. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.03.001 · Cited by 266
Ren, X., Wu, Z., He, W., Qu, M., Voss, C. R., Ji, H., Abdelzaher, T., & Han, J. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3038912.3052708 · Cited by 265
Detecting breaking news rumors of emerging topics in social media
Alkhodair, S. A., Ding, S. H. H., Fung, B. C. M., & Liu, J. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.02.016 · Cited by 265
Semantic-Emotion Neural Network for Emotion Recognition From Text
Batbaatar, E., Li, M., & Ryu, K. H. (2019) · IEEE Access · doi:10.1109/access.2019.2934529 · Cited by 265
Open Sesame: Getting inside BERT’s Linguistic Knowledge
Lin, Y., Tan, Y. C., & Frank, R. (2019) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/w19-4825 · Cited by 266
Detection of Suicide Ideation in Social Media Forums Using Deep Learning
Tadesse, M. M., Lin, H., Xu, B., & Yang, L. (2019) · Algorithms · doi:10.3390/a13010007 · Cited by 268
You Are What You Do: Hunting Stealthy Malware via Data Provenance Analysis
Wang, Q., Hassan, W. U., Li, D., Jee, K., Yu, X., Zou, K., Rhee, J., Chen, Z., Cheng, W. X., Gunter, C. A., et al. (2020) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2020.24167 · Cited by 265
COIL: Revisit Exact Lexical Match in Information Retrieval with Contextualized Inverted List
Gao, L., Dai, Z., & Callan, J. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.241 · Cited by 265
NeuroQuery, comprehensive meta-analysis of human brain mapping
Dockès, J., Poldrack, R. A., Primet, R., Gözükan, H., Yarkoni, T., Suchanek, F. M., Thirion, B., & Varoquaux, G. P. (2020) · eLife · doi:10.7554/elife.53385 · Cited by 264
Speaker-Independent Speech Separation With Deep Attractor Network
Luo, Y., Chen, Z., & Mesgarani, N. (2018) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2018.2795749 · Cited by 263
Adversarial Training for Unsupervised Bilingual Lexicon Induction
Zhang, M., Liu, Y., Luan, H., & Sun, M. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1179 · Cited by 263
Pang, L., Lan, Y., Guo, J., Xu, J., Xu, J., & Cheng, X. (2017) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3132847.3132914 · Cited by 263
Convolutional Recurrent Deep Learning Model for Sentence Classification
Hassan, A., & Mahmood, A. (2018) · IEEE Access · doi:10.1109/access.2018.2814818 · Cited by 263
Graphical Contrastive Losses for Scene Graph Parsing
Zhang, J., Shih, K. J., Elgammal, A., Tao, A., & Catanzaro, B. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01180 · Cited by 263
Smit, A., Jain, S., Rajpurkar, P., Pareek, A., Ng, A., & Lungren, M. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.117 · Cited by 262
Layer-Wise Analysis of a Self-Supervised Speech Representation Model
Pasad, A., Chou, J.-C., & Livescu, K. (2021) · 2021 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) · doi:10.1109/asru51503.2021.9688093 · Cited by 262
SimVerb-3500: A Large-Scale Evaluation Set of Verb Similarity
Gerz, D., Vulić, I., Hill, F., Reichart, R., & Korhonen, A. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1235 · Cited by 262
On the Limitations of Unsupervised Bilingual Dictionary Induction
Søgaard, A., Ruder, S., & Vulić, I. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1072 · Cited by 262
SMR: Medical Knowledge Graph Embedding for Safe Medicine Recommendation
Gong, F., Wang, M., Wang, H., Wang, S., & Liu, M. (2020) · Big Data Research · doi:10.1016/j.bdr.2020.100174 · Cited by 262
Spec2Vec: Improved mass spectral similarity scoring through learning of structural relationships
Huber, F., Ridder, L., Verhoeven, S., Spaaks, J. H., Diblen, F., Rogers, S., & van der Hooft, J. J. J. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008724 · Cited by 262
Multi-task deep visual-semantic embedding for video thumbnail selection
Liu, W., Mei, T., Zhang, Y., Che, C., & Luo, J. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298994 · Cited by 261
Improved Representation Learning for Question Answer Matching
Tan, M., dos Santos, C., Xiang, B., & Zhou, B. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1044 · Cited by 261
Convolutional Neural Networks for Toxic Comment Classification
Georgakopoulos, S. V., Tasoulis, S. K., Vrahatis, A. G., & Plagianakos, V. P. (2018) · Hellenic Conference on Artificial Intelligence · doi:10.1145/3200947.3208069 · Cited by 261
Flow-based network traffic generation using Generative Adversarial Networks
Ring, M., Schlör, D., Landes, D., & Andreas Hotho, A. (2018) · Computers & Security · doi:10.1016/j.cose.2018.12.012 · Cited by 261
Zhai, W., Bai, X., Shi, Y., Han, Y., Peng, Z., & Gu, C. (2018) · Computers Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2018.11.008 · Cited by 261
Adversarial Representation Learning for Text-to-Image Matching
Sarafianos, N., Xu, X., & Kakadiaris, I. A. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00591 · Cited by 261
Song, C., Ning, N., Zhang, Y., & Wu, B. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2020.102437 · Cited by 261
Attention-Emotion-Enhanced Convolutional LSTM for Sentiment Analysis
Huang, F., Li, X., Yuan, C., Zhang, S., Zhang, J., & Qiao, S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3056664 · Cited by 261
Sinha, K., Jia, R., Hupkes, D., Pineau, J., Williams, A., & Kiela, D. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.230 · Cited by 264
Taming Pretrained Transformers for Extreme Multi-label Text Classification
Chang, W.-C., Yu, H., Zhong, K., Yang, Y., & Dhillon, I. S. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403368 · Cited by 260
Sentiment Analysis Using Convolutional Neural Network
Ouyang, X., Zhou, P., Li, C. H., & Liu, L. (2015) · IEEE International Conference on Computer and Information Technology (CIT) · doi:10.1109/cit/iucc/dasc/picom.2015.349 · Cited by 259
Visual question answering: Datasets, algorithms, and future challenges
Kafle, K., & Kanan, C. (2017) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2017.06.005 · Cited by 259
Graph Learning based Recommender Systems: A Review
Wang, S., Hu, L., Wang, Y., He, X., Sheng, Q. Z., Orgun, M. A., Cao, L., Ricci⋆, F., & Yu, P. S. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/630 · Cited by 259
A comparative study of automated legal text classification using random forests and deep learning
Chen, H., Wu, L., Chen, J., Lu, W. P., & Ding, J. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102798 · Cited by 259
Evaluating Bayesian Deep Learning Methods for Semantic SegmentationPreprint
Mukhoti, J., & Gal, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.12709 · Cited by 259
Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models
Serban, I. V., Sordoni, A., Bengio, Y., Courville, A. C., & Pineau, J. (2016) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v30i1.9883 · Cited by 1,645
AL-Smadi, M., Talafha, B., Al‐Ayyoub, M., & Jararweh, Y. (2018) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-018-0799-4 · Cited by 259
Khan, W., Daud, A. Y., Khan, K., Muhammad, S., & Haq, R. (2023) · Natural Language Processing Journal · doi:10.1016/j.nlp.2023.100026 · Cited by 260
Machine Learning on Graphs: A Model and Comprehensive TaxonomyPreprint
Chami, I., Abu-El-Haija, S., Perozzi, B., Ré, C., & Murphy, K. P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.03675 · Cited by 258
The survey: Text generation models in deep learning
Iqbal, T., & Qureshi, S. (2020) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2020.04.001 · Cited by 258
Machine Learning for Clinical Outcome Prediction
Shamout, F. E., Zhu, T., & Clifton, D. A. (2020) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2020.3007816 · Cited by 257
Learning Low-Dimensional Representations of Medical Concepts.
Choi, Y., Chiu, C. Y.-I., & Sontag, D. A. (2016) · PubMed Central · Cited by 256
Gehrmann, S., Dernoncourt, F., Li, Y., Carlson, E. T., Wu, J. T.-Y., Welt, J. A., Foote, J., Moseley, E. T., Grant, D. W., Tyler, P. D., et al. (2018) · PLoS ONE · doi:10.1371/journal.pone.0192360 · Cited by 256
End-to-End Neural Entity Linking
Kolitsas, N., Ganea, O.-E., & Hofmann, T. (2018) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k18-1050 · Cited by 258
Improving text classification with weighted word embeddings via a multi-channel TextCNN model
Guo, B., Zhang, C., Liu, J., & Ma, X. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.07.052 · Cited by 259
Order Matters: Semantic-Aware Neural Networks for Binary Code Similarity Detection
Yu, Z., Cao, R., Tang, Q., Nie, S., Huang, J., & Wu, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5466 · Cited by 255
Word Embeddings: What Works, What Doesn’t, and How to Tell the Difference for Applied Research
Rodriguez, P. L., & Spirling, A. (2022) · The Journal of Politics · doi:10.1086/715162 · Cited by 254
Computing Semantic Similarity of Concepts in Knowledge Graphs
Zhu, G., & Iglesias, C. Á. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2610428 · Cited by 254
Semantic Relation Reasoning for Shot-Stable Few-Shot Object Detection
Zhu, C., Chen, F., Ahmed, U., Shen, Z., & Savvides, M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00867 · Cited by 254
A survey on automatic image caption generation
Bai, S., & An, S. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.05.080 · Cited by 253
An analysis of hierarchical text classification using word embeddings
Stein, R. A., Jaques, P. A., & Valiati, J. F. (2018) · Information Sciences · doi:10.1016/j.ins.2018.09.001 · Cited by 253
A Lexicon-Based Graph Neural Network for Chinese NER
Gui, T., Zou, Y., Zhang, Q., Peng, M., Fu, J., Wei, Z., & Huang, X. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1096 · Cited by 253
Interpretable and Efficient Heterogeneous Graph Convolutional Network
Yang, Y., Guan, Z., Li, J., Zhao, W., Cui, J., & Wang, Q. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3101356 · Cited by 253
Asynchronous Stochastic Gradient Descent with Delay CompensationPreprint
Zheng, S., Meng, Q., Wang, T., Chen, W., Yu, N., Ma, Z.-M., & Liu, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.08326 · Cited by 253
Fuzzy bag-of-words model for document representation
Zhao, R., & Mao, K. (2018) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2017.2690222 · Cited by 252
Rumor Detection with Hierarchical Social Attention Network
Guo, H., Cao, J., Zhang, Y., Guo, J., & Li, J. (2018) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3269206.3271709 · Cited by 253
Detecting Anomaly in Big Data System Logs Using Convolutional Neural Network
Lu, S., Wei, X., Li, Y., & Wang, L. (2018) · IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech) · doi:10.1109/dasc/picom/datacom/cyberscitec.2018.00037 · Cited by 252
A Novel Hybrid Deep Learning Model for Sentiment Classification
Salur, M. U., & Aydın, İ. (2020) · IEEE Access · doi:10.1109/access.2020.2982538 · Cited by 252
Unsupervised Semantic Segmentation by Distilling Feature CorrespondencesPreprint
Hamilton, M., Zhang, Z., Hariharan, B., Snavely, N., & Freeman, W. T. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.08414 · Cited by 252
Unsupervised Pretraining for Sequence to Sequence Learning
Ramachandran, P., Liu, P., & Le, Q. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1039 · Cited by 251
CANE: Context-Aware Network Embedding for Relation Modeling
Tu, C., Liu, H., Liu, Z., & Sun, M. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1158 · Cited by 253
Effective Modeling of Encoder-Decoder Architecture for Joint Entity and Relation Extraction
Nayak, T. K., & Ng, H. T. (2020) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v34i05.6374 · Cited by 251
Deep Recursive Neural Networks for Compositionality in Language
İrsoy, O., & Cardie, C. (2014) · neural information processing systems · Cited by 250
Nested Named Entity Recognition Revisited
Katiyar, A., & Cardie, C. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1079 · Cited by 251
Joint Extraction of Events and Entities within a Document Context
Yang, B., & Mitchell, T. M. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1033 · Cited by 250
Metadata
- Authors
- Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2013
- Volume
- 26
- Pages
- 3111-3119
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1310.4546
- OpenAlex
- W2153579005
- Cited by
- 24,533
- References
- 19
- Citations by year
- 2026: 114 · 2025: 872 · 2024: 1388 · 2023: 1965 · 2022: 2239 · 2021: 3514 · 2020: 3787 · 2019: 3870 · 2018: 2785 · 2017: 1949 · 2016: 1194 · 2015: 658 · 2014: 176 · 2013: 7
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- TIB Data Manager
- neural information processing systems
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- distributed word representations, skip-gram model, phrase representation, negative sampling, frequent terms, idioms, word order, training speed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
