The DOI matches its DataCite record; 18 of the 19 references it cites were found in a registry or an index.
Distributed Representations of Words and Phrases and their Compositionality
Open accessAbstract
The recently introduced continuous Skip-gram model is an efficient method for learning high-quality distributed vector representations that capture a large number of precise syntactic and semantic word relationships. In this paper we present several extensions that improve both the quality of the vectors and the training speed. By subsampling of the frequent words we obtain significant speedup and also learn more regular word representations. We also describe a simple alternative to the hierarchical softmax called negative sampling. An inherent limitation of word representations is their indifference to word order and their inability to represent idiomatic phrases. For example, the meanings of "Canada" and "Air" cannot be easily combined to obtain "Air Canada". Motivated by this example, we present a simple method for finding phrases in text, and show that learning good vector representations for millions of phrases is possible.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Earlier word embedding models, e.g., word2vec [60] and GloVe [61], predominantly relied on syntactic contexts for training.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [60]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Contrary to string similarity-based approaches, continuous word representations capture not only lexical but also semantic properties of tokens.”
From A Method for the Calculation of Parallel Passages for Buddhist Chinese Sources Based on Million-scale Nearest Neighbor Search (2020) · cites this paper as Mikolov et al. (2013)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Mikolov et al. (2013) demonstrated that unweighted averaging of word embeddings performs well for the representation of short phrases.”
From A Method for the Calculation of Parallel Passages for Buddhist Chinese Sources Based on Million-scale Nearest Neighbor Search (2020) · cites this paper as Mikolov et al. (2013)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even during this stage, there was some use of pre-trained LMs exemplified by word2vec[85,86] and GloVe[95], but they were used for only a limited portion of the final model parameters.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [86]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These models were trained on vast amounts of unlabeled data, aiming to capture intricate grammatical and semantic rules.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [60]
The cited source says what the claim attributes to it.
In the citing paper
“In the next steps we filter out stopwords (e. g. 'a' , 'and' , 'the') and build a Word2Vec model (Mikolov et al., 2013) from these queries to get a model of the occurrence and co-occurrence of terms in these queries.”
From AI art in architecture (2023) · cites this paper as Mikolov et al., 2013
The cited source says what the claim attributes to it.
In the citing paper
“Negative sampling has been proved quite effective for both learning knowledge graph embedding (Trouillon et al., 2016) and word embedding (Mikolov et al., 2013).”
From RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space (2019) · cites this paper as Mikolov et al., 2013
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Self-citationA unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
From Frequency to Meaning: Vector Space Models of Semantics
Turney, P. D., & Pantel, P. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2934 · Cited by 2,949
Linguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · Cited by 2,913
Self-citation(2010) · Cited by 1,906
Extensions of recurrent neural network language model
Mikolov, T., Kombrink, S., Burget, L., Černocký, J., & Khudanpur, S. P. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5947611 · Cited by 1,622
Self-citationDomain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach
Glorot, X., Bordes, A., & Bengio, Y. (2011) · Cited by 1,569
Semantic Compositionality through Recursive Matrix-Vector Spaces
Socher, R., Huval, B., Manning, C. D., & Ng, A. Y. (2012) · Cited by 1,262
(2011) · Cited by 1,192
Research works printed but not linked: 3
- [1][1] Yoshua Bengio, R´ ejean Ducharme, Pascal Vincent, and Christian Janvin. A neural probabilistic language model. The Journal of Machine Learning Research , 3:1137-1155, 2003. -
- [7][7] Tomas Mikolov. Statistical Language Models Based on Neural Networks. PhD thesis, PhD Thesis, Brno University of Technology , 2012. -
- [13][13] David E Rumelhart, Geoffrey E Hintont, and Ronald J Williams. Learning representations by backpropagating errors. Nature , 323(6088):533-536, 1986. -
Cited by
Sorted by citations
Items 501–600 of 1,187
Distant Supervision for Relation Extraction with Sentence-Level Attention and Entity Descriptions
Ji, G., Liu, K., He, S., & Zhao, J. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10953 · Cited by 369
Gender Bias in Contextualized Word Embeddings
Zhao, J., Wang, T., Yatskar, M., Cotterell, R., Ordóñez, V., & Chang, K.-W. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1064 · Cited by 367
Self-Supervised Learning in Remote Sensing: A review
Wang, Y., Albrecht, C. M., Braham, N. A. A., Mou, L., & Zhu, X. X. (2022) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2022.3198244 · Cited by 364
Semantics-Aware BERT for Language Understanding
Zhang, Z., Wu, Y., Zhao, H., Li, Z., Zhang, S., Zhou, X., & Zhou, X. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6510 · Cited by 364
SemEval 2017 Task 10: ScienceIE - Extracting Keyphrases and Relations from Scientific Publications
Augenstein, I., Das, M., Riedel, S., Vikraman, L., & McCallum, A. (2017) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s17-2091 · Cited by 364
Compute Trends Across Three Eras of Machine Learning
Sevilla, J., Heim, L., Ho, A., Besiroglu, T., Hobbhahn, M., & Villalobos, P. (2022) · 2022 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9891914 · Cited by 363
Evaluating word embedding models: methods and experimental results
Wang, B., Wang, A. Y., Chen, F., Wang, Y.-C., & Kuo, C. ‐. J. (2019) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2019.12 · Cited by 369
Joint Learning of the Embedding of Words and Entities for Named Entity Disambiguation
Yamada, I., Shindo, H., Takeda, H., & Takefuji, Y. (2016) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1025 · Cited by 363
Learning the language of viral evolution and escape
Hie, B., Zhong, E. D., Berger, B., & Bryson, B. (2021) · Science · doi:10.1126/science.abd7331 · Cited by 361
The language of proteins: NLP, machine learning & protein sequences
Ofer, D., Brandes, N., & Linial, M. (2021) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2021.03.022 · Cited by 365
Emergent: a novel data-set for stance classification
Ferreira, W., & Vlachos, A. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1138 · Cited by 360
Short Text Topic Modeling Techniques, Applications, and Performance: A Survey
Qiang, J., Qian, Z., Li, Y., Yuan, Y., & Wu, X. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2992485 · Cited by 360
Speech gesture generation from the trimodal context of text, audio, and speaker identity
Yoon, Y., Cha, B., Lee, J.-H., Jang, M., Lee, J., Kim, J., & Lee, G. (2020) · ACM Transactions on Graphics · doi:10.1145/3414685.3417838 · Cited by 360
Generative Adversarial Networks for face generation: A survey
Kammoun, A., Slama, R., Tabia, H., Ouni, T., & Abid, M. (2022) · ACM Computing Surveys · doi:10.1145/1122445.1122456 · Cited by 370
Distributed representations of tuples for entity resolution
Ebraheem, M., Thirumuruganathan, S., Joty, S., Ouzzani, M., & Tang, N. (2018) · Proceedings of the VLDB Endowment · doi:10.14778/3236187.3236198 · Cited by 361
Large language models are few-shot clinical information extractors
Agrawal, M., Hegselmann, S., Lang, H., Kim, Y., & Sontag, D. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.130 · Cited by 358
A Long Short-Term Memory Model for Answer Sentence Selection in Question Answering
Wang, D., & Nyberg, E. (2015) · doi:10.3115/v1/p15-2116 · Cited by 358
More than a Feeling: Accuracy and Application of Sentiment Analysis
Hartmann, J., Heitmann, M., Siebert, C., & Schamp, C. (2023) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2022.05.005 · Cited by 356
Wieting, J., & Gimpel, K. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1042 · Cited by 356
Empower Sequence Labeling with Task-Aware Neural Language Model
Liu, L., Shang, J., Ren, X., Xu, F. F., Gui, H., Peng, J., & Han, J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12006 · Cited by 356
Scene Text Visual Question Answering
Biten, A. F., Tito, R., Mafla, A., Gómez, L., Rusiñol, M., Jawahar, C. V., Valveny, E., & Karatzas, D. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00439 · Cited by 357
Günther, F., Rinaldi, L., & Marelli, M. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691619861372 · Cited by 354
The unreasonable effectiveness of deep learning in artificial intelligence
Sejnowski, T. J. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1907373117 · Cited by 352
Holzinger, A., Malle, B., Saranti, A., & Pfeifer, B. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.01.008 · Cited by 352
Sentiment Analysis Using Deep Learning Techniques: A Review
Tul, Q., Ali, M., Riaz, A., Noureen, A., Kamranz, M., Hayat, B., & Rehman, A. U. (2017) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2017.080657 · Cited by 351
AL-Smadi, M., Qawasmeh, O., Al‐Ayyoub, M., Jararweh, Y., & Gupta, B. B. (2017) · Journal of Computational Science · doi:10.1016/j.jocs.2017.11.006 · Cited by 351
A Deep-Learned Embedding Technique for Categorical Features Encoding
Dahouda, M. K., & Joe, I. (2021) · IEEE Access · doi:10.1109/access.2021.3104357 · Cited by 354
Deep Learning applications for COVID-19
Shorten, C., Khoshgoftaar, T. M., & Furht, B. (2021) · Journal of Big Data · doi:10.1186/s40537-020-00392-9 · Cited by 350
(2019) · neural information processing systems · Cited by 350
Exploiting Context for Rumour Detection in Social Media
Zubiaga, A., Liakata, M., & Procter, R. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-67217-5_8 · Cited by 350
How to Train good Word Embeddings for Biomedical NLP
Chiu, B., Crichton, G., Korhonen, A., & Pyysalo, S. (2016) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/w16-2922 · Cited by 350
A Review of Current Trends, Techniques, and Challenges in Large Language Models (LLMs)
Patil, R., & Gudivada, V. N. (2024) · Applied Sciences · doi:10.3390/app14052074 · Cited by 355
Automatic Text Scoring Using Neural Networks
Alikaniotis, D., Yannakoudakis, H., & Rei, M. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1068 · Cited by 349
How to Train Your Energy-Based ModelsPreprint
Song, Y., & Kingma, D. P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.03288 · Cited by 376
Measuring Bias in Contextualized Word Representations
Kurita, K., Vyas, N., Pareek, A., Black, A. W., & Tsvetkov, Y. (2019) · Proceedings of the First Workshop on Gender Bias in Natural Language Processing · doi:10.18653/v1/w19-3823 · Cited by 348
Learning to Predict Charges for Criminal Cases with Legal Basis
Luo, B., Feng, Y., Xu, J., Zhang, X., & Zhao, D. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1289 · Cited by 348
Elnaggar, A., Heinzinger, M., Dallago, C., Rihawi, G., Wang, Y., Jones, L., Gibbs, T., Fehér, T., Angerer, C. M., Steinegger, M., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.06225 · Cited by 364
Semantic memory: A review of methods, models, and current challenges
Kumar, A. A. (2020) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01792-x · Cited by 350
How to Generate a Good Word Embedding
Lai, S., Liu, K., He, S., & Zhao, J. (2016) · IEEE Intelligent Systems · doi:10.1109/mis.2016.45 · Cited by 347
Sentiment Embeddings with Applications to Sentiment Analysis
Tang, D., Wei, F., Qin, B., Yang, N., Liu, T., & Zhou, M. (2015) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2015.2489653 · Cited by 344
Can large language models reason about medical questions?
Liévin, V., Hother, C. E., Motzfeldt, A. G., & Winther, O. (2024) · Patterns · doi:10.1016/j.patter.2024.100943 · Cited by 343
“Language representations have transformed the field of natural language processing, from simple word vectors (Mikolov et al., 2013; Pennington et al., 2014) to deep contextualized representations (Peters et al., 2018; Vaswani et al., 2017; Devlin et al., 2018; Radford et al., 2018), language models…”
BackgroundDetecting formal thought disorder by deep contextualized word representations
Sarzyńska‐Wawer, J., Wawer, A., Pawlak, A., Szymanowska, J., Stefaniak, I., Jarkiewicz, M., & Okruszek, Ł. (2021) · Psychiatry Research · doi:10.1016/j.psychres.2021.114135 · Cited by 343
Adapting Feature Selection Algorithms for the Classification of Chinese Texts
Liu, X., Wang, S., Lu, S., Yin, Z., Li, X., Yin, L., Tian, J., & Zheng, W. (2023) · Systems · doi:10.3390/systems11090483 · Cited by 343
A Survey of Knowledge Tracing: Models, Variants, and Applications
Shen, S., Liu, Q., Huang, Z., Zheng, Y., Yin, M., Wang, M., & Chen, E. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3383325 · Cited by 358
Williams, J. D., Asadi, K., & Zweig, G. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1062 · Cited by 342
Deep Joint Entity Disambiguation with Local Neural Attention
Ganea, O.-E., & Hofmann, T. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1277 · Cited by 342
Unsupervised Statistical Machine Translation
Artetxe, M., Labaka, G., & Agirre, E. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1399 · Cited by 342
Improved Neural Relation Detection for Knowledge Base Question Answering
Yu, M., Yin, W., Hasan, K. S., dos Santos, C., Xiang, B., & Zhou, B. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1053 · Cited by 342
Automating creativity assessment with SemDis: An open platform for computing semantic distance
Beaty, R. E., & Johnson, D. R. (2021) · Behavior Research Methods · doi:10.3758/s13428-020-01453-w · Cited by 341
Learning Text Similarity with Siamese Recurrent Networks
Neculoiu, P., Versteegh, M., & Rotaru, M. (2016) · Proceedings of the 1st Workshop on Representation Learning for NLP · doi:10.18653/v1/w16-1617 · Cited by 341
“For example, word similarity models based on dense embeddings (Mikolov et al., 2013) have recently been applied in diverse settings, such as sentiment analysis (dos Santos and Gatti, 2014) and recommender systems (Barkan and Koenig-stein, 2016).”
BackgroundMethodNatural Language Inference by Tree-Based Convolution and Heuristic Matching
Mou, L., Men, R., Li, G., Xu, Y., Zhang, L., Yan, R., & Jin, Z. G. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-2022 · Cited by 340
Decoupling Zero-Shot Semantic Segmentation
Ding, J., Xue, N., Xia, G.-S., & Dai, D. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01129 · Cited by 339
BERTology Meets Biology: Interpreting Attention in Protein Language Models
Vig, J., Madani, A., Varshney, L. R., Xiong, C., Socher, R., & Rajani, N. F. (2020) · doi:10.1101/2020.06.26.174417 · Cited by 338
Representation learning for dynamic graphs: A survey
Kazemi, S. M., Goel, R., Jain, K., Kobyzev, I., Sethi, A., Forsyth, P., & Poupart, P. (2019) · arXiv · doi:10.48550/arxiv.1905.11485 · Cited by 338
Decision support from financial disclosures with deep neural networks and transfer learning
Kraus, M., & Feuerriegel, S. (2017) · Decision Support Systems · doi:10.1016/j.dss.2017.10.001 · Cited by 338
Sentiment analysis based on improved pre-trained word embeddings
Rezaeinia, S. M., Rahmani, R., Ghodsi, A., & Veisi, H. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.08.044 · Cited by 338
A Generative Model for Zero Shot Learning Using Conditional Variational Autoencoders
Mishra, A., Reddy, M. S. K., Mittal, A., & Murthy, H. A. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00294 · Cited by 337
emoji2vec: Learning Emoji Representations from their Description
Eisner, B., Rocktäschel, T., Augenstein, I., Bošnjak, M., & Riedel, S. (2016) · International Workshop on Natural Language Processing for Social Media (SocialNLP) · doi:10.18653/v1/w16-6208 · Cited by 337
How Transferable are Neural Networks in NLP Applications?
Mou, L., Zhao, M., Yan, R., Li, G., Xu, Y., Zhang, L., & Jin, Z. G. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1046 · Cited by 337
Supervised Multimodal Bitransformers for Classifying Images and TextPreprint
Kiela, D., Bhooshan, S., Firooz, H., Perez, E., & Testuggine, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.02950 · Cited by 345
Improving Coreference Resolution by Learning Entity-Level Distributed Representations
Clark, K., & Manning, C. D. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1061 · Cited by 335
A Survey on Automated Log Analysis for Reliability Engineering
He, S., He, P., Chen, Z., Yang, T., Su, Y., & Lyu, M. R. (2022) · ACM Computing Surveys · doi:10.1145/3460345 · Cited by 334
Semi-supervised Convolutional Neural Networks for Text Categorization via Region Embedding
Johnson, R., & Zhang, T. (2015) · PubMed · doi:10.48550/arxiv.1504.01255 · Cited by 334
Wang, W. Y., & Yang, D. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1306 · Cited by 334
A Deep Architecture for Semantic Matching with Multiple Positional Sentence Representations
Wan, S., Lan, Y., Guo, J., Xu, J., Pang, L., & Cheng, X. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10342 · Cited by 335
Semantically Enhanced Software Traceability Using Deep Learning Techniques
Guo, J., Cheng, J., & Cleland‐Huang, J. (2017) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2017.9 · Cited by 334
Flow Prediction in Spatio-Temporal Networks Based on Multitask Deep Learning
Zhang, J., Zheng, Y., Sun, J., & Qi, D. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2891537 · Cited by 334
FlauBERT: Unsupervised Language Model Pre-training for FrenchPreprint
Le, H., Vial, L., Frej, J., Segonne, V., Coavoux, M., Lecouteux, B., Allauzen, A., Crabbé, B., Besacier, L., & Schwab, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.05372 · Cited by 342
Optimized CRISPR guide RNA design for two high-fidelity Cas9 variants by deep learning
Wang, D., Zhang, C., Wang, B., Li, B., Wang, Q., Liu, D., Wang, H., Zhou, Y., Shi, L., Lan, F., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-12281-8 · Cited by 331
Improving Topic Models with Latent Feature Word Representations
Nguyen, D. Q., Billingsley, R., Du, L., & Johnson, M. (2015) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00140 · Cited by 330
ATRank: An Attention-Based User Behavior Modeling Framework for Recommendation
Zhou, C., Bai, J., Song, J., Liu, X., Zhao, Z., Chen, X., & Gao, J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11618 · Cited by 330
Baseline Needs More Love: On Simple Word-Embedding-Based Models and Associated Pooling Mechanisms
Shen, D., Wang, G., Wang, W., Min, M. R., Su, Q., Zhang, Y., Li, C., Henao, R., & Carin, L. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1041 · Cited by 328
Semantic Pooling for Complex Event Analysis in Untrimmed Videos
Chang, X., Yu, Y., Yang, Y., & Xing, E. P. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2608901 · Cited by 328
Distributional Semantics and Linguistic Theory
Boleda, G. (2019) · Annual Review of Linguistics · doi:10.1146/annurev-linguistics-011619-030303 · Cited by 328
Combining Graph-Based Learning With Automated Data Collection for Code Vulnerability Detection
Wang, H., Ye, G., Tang, Z., Tan, S. H., Huang, S., Fang, D., Feng, Y., Bian, L., & Wang, Z. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.3044773 · Cited by 328
LSTM with sentence representations for document-level sentiment classification
Rao, G., Huang, W., Feng, Z., & Cong, Q. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.04.045 · Cited by 326
Constructing knowledge graphs and their biomedical applications
Nicholson, D. N., & Greene, C. S. (2020) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2020.05.017 · Cited by 326
A comprehensive survey on deep learning based malware detection techniques
Gopinath, M. A., & Sethuraman, S. C. (2022) · Computer Science Review · doi:10.1016/j.cosrev.2022.100529 · Cited by 326
Toward a universal decoder of linguistic meaning from brain activation
Pereira, F., Lou, B., Pritchett, B., Ritter, S., Gershman, S. J., Kanwisher, N., Botvinick, M., & Fedorenko, E. (2018) · Nature Communications · doi:10.1038/s41467-018-03068-4 · Cited by 324
From Group to Individual Labels Using Deep Features
Kotzias, D., Denil, M., de Freitas, N., & Smyth, P. (2015) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2783258.2783380 · Cited by 324
Modelling Context with User Embeddings for Sarcasm Detection in Social Media
Amir, S., Wallace, B., Lyu, H., Carvalho, P. C. Q. D. F., & Silva, M. J. (2016) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1017 · Cited by 324
Multilevel Language and Vision Integration for Text-to-Clip Retrieval
Xu, H., He, K., Plummer, B. A., Sigal, L., Sclaroff, S., & Saenko, K. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019062 · Cited by 324
Translation between Molecules and Natural Language
Edwards, C., Lai, T., Ros, K., Honke, G., Cho, K., & Ji, H. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.26 · Cited by 341
Reducing Gender Bias in Abusive Language Detection
Park, J. H., Shin, J., & Fung, P. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1302 · Cited by 323
Enhancing clinical concept extraction with contextual embeddings
Si, Y., Wang, J., Xu, H., & Roberts, K. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz096 · Cited by 322
Althoff, T., Clark, K., & Leskovec, J. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00111 · Cited by 322
A CNN-BiLSTM Model for Document-Level Sentiment Analysis
Rhanoui, M., Mikram, M., Yousfi, S., & Barzali, S. (2019) · Machine Learning and Knowledge Extraction · doi:10.3390/make1030048 · Cited by 322
Bansal, T., Belanger, D., & McCallum, A. (2016) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/2959100.2959180 · Cited by 326
BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis
Xu, H., Liu, B., Shu, L., & Yu, P. S. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1242 · Cited by 324
Zero-Shot Visual Recognition Using Semantics-Preserving Adversarial Embedding Networks
Chen, L., Zhang, H., Xiao, J., Liu, W., & Chang, S. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00115 · Cited by 321
Detecting fake news by exploring the consistency of multimodal data
Xue, J., Wang, Y., Tian, Y., Li, Y., Shi, L., & Wei, L. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102610 · Cited by 320
Visualizing and Measuring the Geometry of BERTPreprint
Coenen, A., Reif, E., Yuan, A., Kim, B., Pearce, A., Viegas, F., & Wattenberg, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.02715 · Cited by 320
Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLPPreprint
Mielke, S. J., Alyafeai, Z., Salesky, E., Raffel, C., Dey, M., Gallé, M., Raja, A., Si, C., Lee, W. Y., Sagot, B., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.10508 · Cited by 328
Boyd, R. L., & Schwartz, H. A. (2021) · Journal of Language and Social Psychology · doi:10.1177/0261927x20967028 · Cited by 317
Neural Ranking Models with Weak Supervision
Dehghani, M., Zamani, H., Severyn, A., Kamps, J., & Croft, W. B. (2017) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3077136.3080832 · Cited by 317
Joint Representation Learning for Top-N Recommendation with Heterogeneous Information Sources
Zhang, Y., Ai, Q., Chen, X., & Croft, W. B. (2017) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3132847.3132892 · Cited by 317
When and Why Are Pre-Trained Word Embeddings Useful for Neural Machine Translation?
Ye, Q., Sachan, D. S., Felix, M., Padmanabhan, S. J., & Neubig, G. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-2084 · Cited by 319
Developing an online hate classifier for multiple social media platforms
Salminen, J. O., Hopf, M., Chowdhury, S. A., Jung, S., Almerekhi, H., & Jansen, B. J. J. (2020) · Human-centric Computing and Information Sciences · doi:10.1186/s13673-019-0205-6 · Cited by 317
A Comprehensive Review on Fake News Detection With Deep Learning
Mridha, M. F., Keya, A. J., Hamid, M. A., Monowar, M. M., & Rahman, M. S. (2021) · IEEE Access · doi:10.1109/access.2021.3129329 · Cited by 317
Multi-label Zero-Shot Learning with Structured Knowledge Graphs
Lee, C., Fang, W., Yeh, C., & Wang, Y.-C. F. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00170 · Cited by 317
Metadata
- Authors
- Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2013
- Volume
- 26
- Pages
- 3111-3119
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1310.4546
- OpenAlex
- W2153579005
- Cited by
- 24,533
- References
- 19
- Citations by year
- 2026: 114 · 2025: 872 · 2024: 1388 · 2023: 1965 · 2022: 2239 · 2021: 3514 · 2020: 3787 · 2019: 3870 · 2018: 2785 · 2017: 1949 · 2016: 1194 · 2015: 658 · 2014: 176 · 2013: 7
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- TIB Data Manager
- neural information processing systems
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- distributed word representations, skip-gram model, phrase representation, negative sampling, frequent terms, idioms, word order, training speed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
