The DOI matches its DataCite record; 18 of the 19 references it cites were found in a registry or an index.
Distributed Representations of Words and Phrases and their Compositionality
Open accessAbstract
The recently introduced continuous Skip-gram model is an efficient method for learning high-quality distributed vector representations that capture a large number of precise syntactic and semantic word relationships. In this paper we present several extensions that improve both the quality of the vectors and the training speed. By subsampling of the frequent words we obtain significant speedup and also learn more regular word representations. We also describe a simple alternative to the hierarchical softmax called negative sampling. An inherent limitation of word representations is their indifference to word order and their inability to represent idiomatic phrases. For example, the meanings of "Canada" and "Air" cannot be easily combined to obtain "Air Canada". Motivated by this example, we present a simple method for finding phrases in text, and show that learning good vector representations for millions of phrases is possible.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Earlier word embedding models, e.g., word2vec [60] and GloVe [61], predominantly relied on syntactic contexts for training.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [60]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Contrary to string similarity-based approaches, continuous word representations capture not only lexical but also semantic properties of tokens.”
From A Method for the Calculation of Parallel Passages for Buddhist Chinese Sources Based on Million-scale Nearest Neighbor Search (2020) · cites this paper as Mikolov et al. (2013)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Mikolov et al. (2013) demonstrated that unweighted averaging of word embeddings performs well for the representation of short phrases.”
From A Method for the Calculation of Parallel Passages for Buddhist Chinese Sources Based on Million-scale Nearest Neighbor Search (2020) · cites this paper as Mikolov et al. (2013)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even during this stage, there was some use of pre-trained LMs exemplified by word2vec[85,86] and GloVe[95], but they were used for only a limited portion of the final model parameters.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [86]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These models were trained on vast amounts of unlabeled data, aiming to capture intricate grammatical and semantic rules.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [60]
The cited source says what the claim attributes to it.
In the citing paper
“In the next steps we filter out stopwords (e. g. 'a' , 'and' , 'the') and build a Word2Vec model (Mikolov et al., 2013) from these queries to get a model of the occurrence and co-occurrence of terms in these queries.”
From AI art in architecture (2023) · cites this paper as Mikolov et al., 2013
The cited source says what the claim attributes to it.
In the citing paper
“Negative sampling has been proved quite effective for both learning knowledge graph embedding (Trouillon et al., 2016) and word embedding (Mikolov et al., 2013).”
From RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space (2019) · cites this paper as Mikolov et al., 2013
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Self-citationA unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
From Frequency to Meaning: Vector Space Models of Semantics
Turney, P. D., & Pantel, P. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2934 · Cited by 2,949
Linguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · Cited by 2,913
Self-citation(2010) · Cited by 1,906
Extensions of recurrent neural network language model
Mikolov, T., Kombrink, S., Burget, L., Černocký, J., & Khudanpur, S. P. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5947611 · Cited by 1,622
Self-citationDomain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach
Glorot, X., Bordes, A., & Bengio, Y. (2011) · Cited by 1,569
Semantic Compositionality through Recursive Matrix-Vector Spaces
Socher, R., Huval, B., Manning, C. D., & Ng, A. Y. (2012) · Cited by 1,262
(2011) · Cited by 1,192
Research works printed but not linked: 3
- [1][1] Yoshua Bengio, R´ ejean Ducharme, Pascal Vincent, and Christian Janvin. A neural probabilistic language model. The Journal of Machine Learning Research , 3:1137-1155, 2003. -
- [7][7] Tomas Mikolov. Statistical Language Models Based on Neural Networks. PhD thesis, PhD Thesis, Brno University of Technology , 2012. -
- [13][13] David E Rumelhart, Geoffrey E Hintont, and Ronald J Williams. Learning representations by backpropagating errors. Nature , 323(6088):533-536, 1986. -
Cited by
Sorted by citations
Items 401–500 of 1,187
Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Models
Plummer, B. A., Wang, L., Cervantes, C. M., Caicedo, J. C., Hockenmaier, J., & Lazebnik, S. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-016-0965-7 · Cited by 429
Zhang, X., Wei, F., & Zhou, M. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1499 · Cited by 428
An Unsupervised Neural Attention Model for Aspect Extraction
He, R., Lee, W. S., Ng, H. T., & Dahlmeier, D. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1036 · Cited by 427
Learning Gender-Neutral Word Embeddings
Zhao, J., Zhou, Y., Li, Z., Wang, W. W., & Chang, K.-W. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1521 · Cited by 426
Counter-fitting Word Vectors to Linguistic Constraints
Mrkšić, N., Séaghdha, D. Ó., Thomson, B., Gašić, M., Rojas-Barahona, L. M., Su, P.-H., Vandyke, D., Wen, T.-H., & Young, S. J. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1018 · Cited by 425
An attention-based BiLSTM-CRF approach to document-level chemical named entity recognition
Luo, L., Yang, Z., Yang, P., Zhang, Y., Wang, L., Lin, H., & Wang, J. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx761 · Cited by 425
Debiased Contrastive LearningPreprint
Chuang, C.-Y., Robinson, J., Lin, Y.-C., Torralba, A. B., & Jegelka, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.00224 · Cited by 425
Event Detection and Domain Adaptation with Convolutional Neural Networks
Nguyen, T. H., & Grishman, R. (2015) · doi:10.3115/v1/p15-2060 · Cited by 424
Dual Graph Convolutional Networks for Graph-Based Semi-Supervised Classification
Zhuang, C., & Ma, Q. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186116 · Cited by 423
Lynott, D., Connell, L., Brysbaert, M., Brand, J., & Carney, J. (2019) · Behavior Research Methods · doi:10.3758/s13428-019-01316-z · Cited by 423
Learning Hierarchical Representation Model for NextBasket Recommendation
Wang, P., Guo, J., Lan, Y., Xu, J., Wan, S., & Cheng, X. (2015) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2766462.2767694 · Cited by 422
LSTMVis: A Tool for Visual Analysis of Hidden State Dynamics in Recurrent Neural Networks
Strobelt, H., Gehrmann, S., Pfister, H., & Rush, A. M. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2744158 · Cited by 422
Learning with a Wasserstein LossPreprint
Frogner, C., Zhang, C., Mobahi, H., Araya‐Polo, M., & Poggio, T. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.05439 · Cited by 422
The science of science: From the perspective of complex systems
Zeng, A., Shen, Z., Zhou, J., Wu, J., Fan, Y., Wang, Y., & Stanley, E. (2017) · Physics Reports · doi:10.1016/j.physrep.2017.10.001 · Cited by 420
Who Are the Phishers? Phishing Scam Detection on Ethereum via Network Embedding
Wu, J., Yuan, Q., Lin, D., You, W., Chen, W., Chen, C., & Zheng, Z. (2020) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2020.3016821 · Cited by 422
Protection Against Reconstruction and Its Applications in Private Federated LearningPreprint
Bhowmick, A., Duchi, J. C., Freudiger, J., Kapoor, G., & Rogers, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.00984 · Cited by 420
Natural language based financial forecasting: a survey
Xing, F., Cambria, E., & Welsch, R. E. (2017) · Artificial Intelligence Review · doi:10.1007/s10462-017-9588-9 · Cited by 419
Learning Fashion Compatibility with Bidirectional LSTMs
Han, X., Wu, Z., Jiang, Y.-G., & Davis, L. S. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123394 · Cited by 418
Investigating Capsule Networks with Dynamic Routing for Text Classification
Yang, M., Zhao, W., Ye, J., Lei, Z., Zhao, Z., & Zhang, S. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1350 · Cited by 422
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286 · Cited by 422
SenticNet 5: Discovering Conceptual Primitives for Sentiment Analysis by Means of Context Embeddings
Cambria, E., Poria, S., Hazarika, D., & Kwok, K. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11559 · Cited by 417
Bisk, Y., Holtzman, A., Thomason, J., Andreas, J., Bengio, Y., Chai, J. Y., Lapata, M., Lazaridou, A., May, J., Nisnevich, A., et al. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.703 · Cited by 421
De-identification of patient notes with recurrent neural networks
Dernoncourt, F., Lee, J. Y., Uzuner, Ö., & Szolovits, P. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw156 · Cited by 418
Probabilistic forecasting with temporal convolutional neural network
Chen, Y., Kang, Y., Chen, Y., & Wang, Z. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.03.011 · Cited by 416
Empath: Understanding Topic Signals in Large-Scale Text
Fast, E., Chen, B., & Bernstein, M. S. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858535 · Cited by 413
Look, Imagine and Match: Improving Textual-Visual Cross-Modal Retrieval with Generative Models
Gu, J., Cai, J., Joty, S., Niu, L., & Wang, G. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00750 · Cited by 413
Graph Neural Networks for Natural Language Processing: A Survey
Wu, L., Chen, Y., Shen, K., Guo, X., Gao, H., Li, S., Pei, J., & Long, B. (2023) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000096 · Cited by 417
Exploiting BERT for End-to-End Aspect-based Sentiment Analysis
Li, X., Bing, L., Zhang, W., & Lam, W. P. (2019) · Workshop on Noisy User-generated Text (W-NUT) · doi:10.18653/v1/d19-5505 · Cited by 414
Where to Go Next: A Spatio-Temporal Gated Network for Next POI Recommendation
Zhao, P., Luo, A., Liu, Y., Xu, J., Li, Z., Zhuang, F., Sheng, V. S., & Zhou, X. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3007194 · Cited by 412
One-step and Two-step Classification for Abusive Language Detection on Twitter
Park, J. H., & Fung, P. (2017) · Workshop on Abusive Language Online (ALW) · doi:10.18653/v1/w17-3006 · Cited by 409
A Deep Look into neural ranking models for information retrieval
Guo, J., Fan, Y., Pang, L., Yang, L., Ai, Q., Zamani, H., Wu, C. H., Croft, W. B., & Cheng, X. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.102067 · Cited by 411
Stock market movement forecast: A Systematic review
Bustos, O., & Pomares, A. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113464 · Cited by 409
Deep Collaborative Embedding for Social Image Understanding
Li, Z., Tang, J., & Mei, T. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2852750 · Cited by 408
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2019) · doi:10.1101/622803 · Cited by 3,280
“A.1 B ACKGROUND ON LANGUAGE MODELS AND EMBEDDINGS Deep language models are parametric functions that map sequences into distributed word representations in a learned vector space (Bengio et al., 2003; Mikolov et al., 2013a;b; Pennington et al., 2014; Lample et al., 2017).”
BackgroundKnowledge Graph and Text Jointly Embedding
Wang, Z., Zhang, J., Feng, J., & Chen, Z. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1167 · Cited by 406
WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representations
Pilehvar, M. T., & Camacho-Collados, J. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1128 · Cited by 406
Pretrained Transformers Improve Out-of-Distribution Robustness
Hendrycks, D., Liu, X., Wallace, E., Dziedzic, A., Krishnan, R., & Song, D. X. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.244 · Cited by 406
Understanding Emotions in Text Using Deep Learning and Big Data
Chatterjee, A., Gupta, U., Chinnakotla, M. K., Srikanth, R., Galley, M., & Agrawal, P. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.12.029 · Cited by 406
Visualizing Large-scale and High-dimensional Data
Tang, J., Liu, J., Zhang, M., & Mei, Q. (2016) · International World Wide Web Conference (WWW) · doi:10.1145/2872427.2883041 · Cited by 404
Predicting Deep Zero-Shot Convolutional Neural Networks Using Textual Descriptions
Ba, J. L., Swersky, K., Fidler, S., & Salakhutdinov, R. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.483 · Cited by 404
A hybrid model integrating deep learning with investor sentiment analysis for stock price prediction
Jing, N., Wu, Z., & Wang, H. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115019 · Cited by 404
Low Resource Dependency Parsing: Cross-lingual Parameter Sharing in a Neural Network Parser
Duong, L., Cohn, T., Bird, S., & Cook, P. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · doi:10.3115/v1/p15-2139 · Cited by 402
Learning to Represent Knowledge Graphs with Gaussian Embedding
He, S., Liu, K., Ji, G., & Zhao, J. (2015) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2806416.2806502 · Cited by 402
Named Entity Recognition for Chinese Social Media with Jointly Trained Embeddings
Peng, N., & Dredze, M. H. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1064 · Cited by 402
FLAIR: An Easy-to-Use Framework for State-of-the-Art NLP
Akbik, A., Bergmann, T., Blythe, D. A. J., Rasul, K., Schweter, S., & Vollgraf, R. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-4010 · Cited by 417
Stanford neural machine translation systems for spoken language domains.
Luong, M.-T., & Manning, C. D. (2015) · Cited by 402
Data augmentation approaches in natural language processing: A survey
Li, B., Hou, Y., & Che, W. (2022) · AI Open · doi:10.1016/j.aiopen.2022.03.001 · Cited by 401
Zampieri, M., Nakov, P., Rosenthal, S., Atanasova, P., Karadzhov, G., Mubarak, H., Derczynski, L., Pitenis, Z., & Çöltekin, Ç. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.188 · Cited by 400
A Hierarchical Latent Vector Model for Learning Long-Term Structure in MusicPreprint
Roberts, A., Engel, J., Raffel, C., Hawthorne, C., & Eck, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.05428 · Cited by 400
Chinese comments sentiment classification based on word2vec and SVMperf
Zhang, D., Xu, H., Su, Z., & Xu, Y. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.09.011 · Cited by 399
Normalized Word Embedding and Orthogonal Transform for Bilingual Word Translation
Xing, C., Wang, D., Liu, C., & Lin, Y. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1104 · Cited by 397
CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies
Zeman, D., Popel, M., Straka, M., Hajič, J., Nivre, J., Ginter, F., Luotolahti, J., Pyysalo, S., Petrov, S., Potthast, M., et al. (2017) · CoNLL Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies · doi:10.18653/v1/k17-3001 · Cited by 397
Liu, X., Gao, J., He, X., Deng, L., Duh, K., & Wang, Y.-Y. (2015) · Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.3115/v1/n15-1092 · Cited by 395
Boosting docking-based virtual screening with deep learning.
Pereira, J. C., Caffarena, E. R., & dos Santos, C. N. (2016) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6b00355 · Cited by 395
Two/Too Simple Adaptations of Word2Vec for Syntax Problems
Ling, W., Dyer, C., Black, A. W., & Trancoso, I. M. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1142 · Cited by 395
Multi-modal Cycle-Consistent Generalized Zero-Shot Learning
Felix, R., Kumar, B. G. V., Reid, I. D., & Carneiro, G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01231-1_2 · Cited by 395
The Application of Deep Learning in Cancer Prognosis Prediction
Zhu, W., Xie, L., Han, J., & Guo, X. (2020) · Cancers · doi:10.3390/cancers12030603 · Cited by 398
Graph Convolutional Networks With Argument-Aware Pooling for Event Detection
Nguyen, T. H., & Grishman, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12039 · Cited by 394
Designing and Interpreting Probes with Control Tasks
Hewitt, J., & Liang, P. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1275 · Cited by 393
Liu, Y., Liu, Z., Chua, T., & Sun, M. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9522 · Cited by 393
Video Representation Learning by Dense Predictive Coding
Han, T., Xie, W., & Zisserman, A. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00186 · Cited by 393
CLUE: A Chinese Language Understanding Evaluation Benchmark
Xu, L. J., Hu, H., Zhang, X., Lü, L., Cao, C., Li, Y., Xu, Y., Sun, K., Yu, D., Yu, C., et al. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.419 · Cited by 393
Natural Language Processing Advancements By Deep Learning: A SurveyPreprint
Torfi, A., Shirvani, R. A., Keneshloo, Y., Tavaf, N., & Fox, E. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.01200 · Cited by 411
Mohammad, S. M. (2016) · Emotion Measurement · doi:10.1016/b978-0-08-100508-8.00009-6 · Cited by 391
Big Data: Deep Learning for financial sentiment analysis
Sohangir, S., Wang, D., Pomeranets, A., & Khoshgoftaar, T. M. (2018) · Journal of Big Data · doi:10.1186/s40537-017-0111-6 · Cited by 390
Statistically Significant Detection of Linguistic Change
Kulkarni, V., Al-Rfou, R., Perozzi, B., & Skiena, S. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2736277.2741627 · Cited by 390
From Word To Sense Embeddings: A Survey on Vector Representations of Meaning
Camacho-Collados, J., & Pilehvar, M. T. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11259 · Cited by 393
Bansal, A., Sikka, K., Sharma, G., Chellappa, R., & Divakaran, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01246-5_24 · Cited by 389
Directional Skip-Gram: Explicitly Distinguishing Left and Right Context for Word Embeddings
Song, Y., Shi, S., Li, J., & Zhang, H. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-2028 · Cited by 393
A Survey of Available Corpora For Building Data-Driven Dialogue Systems: The Journal Version
Serban, I. V., Lowe, R., Henderson, P., Charlin, L., & Pineau, J. (2018) · Dialogue & Discourse · doi:10.5087/dad.2018.101 · Cited by 388
Graph embedding on biomedical networks: methods, applications and evaluations
Yue, X., Wang, Z., Huang, J., Parthasarathy, S., Moosavinasab, S., Huang, Y., Lin, S. M., Zhang, W., Zhang, P., & Sun, H. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz718 · Cited by 389
An analysis of the coherence of descriptors in topic modeling
O’Callaghan, D., Greene, D., Carthy, J., & Cunningham, P. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.02.055 · Cited by 385
A Comprehensive Survey on Deep Graph Representation Learning
Ju, W., Fang, Z., Gu, Y., Liu, Z., Long, Q., Qiao, Z., Qin, Y., Shen, J., Sun, F., Xiao, Z., et al. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106207 · Cited by 395
Opinion Mining with Deep Recurrent Neural Networks
Irsoy, O., & Cardie, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1080 · Cited by 384
Optimized Graph Convolution Recurrent Neural Network for Traffic Prediction
Guo, K., Hu, Y., Qian, S., Liu, H., Zhang, K., Sun, Y., Gao, J., & Yin, B. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2963722 · Cited by 384
HARP: Hierarchical Representation Learning for Networks
Chen, H., Perozzi, B., Hu, Y., & Skiena, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11849 · Cited by 382
Wan, F., Hong, L., Xiao, A., Jiang, T., & Zeng, J. (2019) · Bioinformatics · doi:10.1093/bioinformatics/bty543 · Cited by 381
Modeling User Exposure in Recommendation
Liang, D., Charlin, L., McInerney, J., & Blei, D. M. (2016) · International World Wide Web Conference (WWW) · doi:10.1145/2872427.2883090 · Cited by 381
Multifaceted protein–protein interaction prediction based on Siamese residual RCNN
Chen, M., Ju, C. J. ‐., Zhou, G., Chen, X., Zhang, T., Chang, K.-W., Zaniolo, C., & Wang, W. W. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz328 · Cited by 388
DeepBugs: a learning approach to name-based bug detection
Pradel, M., & Sen, K. (2018) · Proceedings of the ACM on Programming Languages · doi:10.1145/3276517 · Cited by 379
Inducing Domain-Specific Sentiment Lexicons from Unlabeled Corpora
Hamilton, W. L., Clark, K., Leskovec, J., & Jurafsky, D. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1057 · Cited by 379
Heterogeneous Network Representation Learning: A Unified Framework With Survey and Benchmark
Yang, C., Xiao, Y., Zhang, Y., Sun, Y., & Han, J. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3045924 · Cited by 379
Attentive Pooling NetworksPreprint
dos Santos, C. N., Tan, M., Xiang, B., & Zhou, B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.03609 · Cited by 379
Effective LSTMs for Target-Dependent Sentiment Classification
Tang, D., Qin, B., Feng, X., & Liu, T. (2016) · International Conference on Computational Linguistics · Cited by 378
Emergent linguistic structure in artificial neural networks trained by self-supervision
Manning, C. D., Clark, K., Hewitt, J., Khandelwal, U., & Levy, O. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1907367117 · Cited by 378
Evaluation of Sentiment Analysis in Finance: From Lexicons to Transformers
Mishev, K., Gjorgjevikj, A., Vodenska, I., Chitkushev, L. T., & Trajanov, D. (2020) · IEEE Access · doi:10.1109/access.2020.3009626 · Cited by 380
Learning Semantic Representations of Users and Products for Document Level Sentiment Classification
Tang, D., Qin, B., & Liu, T. (2015) · doi:10.3115/v1/p15-1098 · Cited by 376
Legal Judgment Prediction via Topological Learning
Zhong, H., Guo, Z., Tu, C., Xiao, C., Liu, Z., & Sun, M. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1390 · Cited by 377
Applying deep learning to answer selection: A study and an open task
Feng, M., Xiang, B., Glass, M. R., Wang, L., & Zhou, B. (2015) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2015.7404872 · Cited by 376
Chakraborty, K., Bhatia, S., Bhattacharyya, S., Platos, J., Bag, R., & Hassanien, A. E. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106754 · Cited by 375
Koehn, P. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108608480 · Cited by 375
Community Interaction and Conflict on the Web
Kumar, S., Hamilton, W. L., Leskovec, J., & Jurafsky, D. (2018) · International World Wide Web Conference (WWW) · doi:10.1145/3178876.3186141 · Cited by 375
Deep Feature Consistent Variational Autoencoder
Hou, X., Shen, L., Sun, K., & Qiu, G. (2017) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2017.131 · Cited by 374
Pre-training is a Hot Topic: Contextualized Document Embeddings Improve Topic Coherence
Bianchi, F., Terragni, S., & Hovy, D. (2021) · doi:10.18653/v1/2021.acl-short.96 · Cited by 384
Learning a Neural Semantic Parser from User Feedback
Iyer, S. V., Konstas, I., Cheung, A., Krishnamurthy, J., & Zettlemoyer, L. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1089 · Cited by 375
Webly Supervised Learning of Convolutional Networks
Chen, X., & Gupta, A. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.168 · Cited by 370
Yu, W., Cheng, W. D., Aggarwal, C. C., Zhang, K., Chen, H., & Wang, W. W. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3220024 · Cited by 370
Graph-Based Semi-Supervised Learning: A Comprehensive Review
Song, Z., Yang, X., Xu, Z., & King, I. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3155478 · Cited by 369
Semi-Supervised Sequence Modeling with Cross-View Training
Clark, K., Luong, M.-T., Manning, C. D., & Le, Q. V. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1217 · Cited by 368
Cheng, X. Y., Wang, H., Hua, J., Xu, G., & Sui, Y. (2021) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3436877 · Cited by 368
Metadata
- Authors
- Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2013
- Volume
- 26
- Pages
- 3111-3119
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1310.4546
- OpenAlex
- W2153579005
- Cited by
- 24,533
- References
- 19
- Citations by year
- 2026: 114 · 2025: 872 · 2024: 1388 · 2023: 1965 · 2022: 2239 · 2021: 3514 · 2020: 3787 · 2019: 3870 · 2018: 2785 · 2017: 1949 · 2016: 1194 · 2015: 658 · 2014: 176 · 2013: 7
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- TIB Data Manager
- neural information processing systems
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- distributed word representations, skip-gram model, phrase representation, negative sampling, frequent terms, idioms, word order, training speed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
