The DOI matches its DataCite record; 18 of the 19 references it cites were found in a registry or an index.
Distributed Representations of Words and Phrases and their Compositionality
Open accessAbstract
The recently introduced continuous Skip-gram model is an efficient method for learning high-quality distributed vector representations that capture a large number of precise syntactic and semantic word relationships. In this paper we present several extensions that improve both the quality of the vectors and the training speed. By subsampling of the frequent words we obtain significant speedup and also learn more regular word representations. We also describe a simple alternative to the hierarchical softmax called negative sampling. An inherent limitation of word representations is their indifference to word order and their inability to represent idiomatic phrases. For example, the meanings of "Canada" and "Air" cannot be easily combined to obtain "Air Canada". Motivated by this example, we present a simple method for finding phrases in text, and show that learning good vector representations for millions of phrases is possible.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Earlier word embedding models, e.g., word2vec [60] and GloVe [61], predominantly relied on syntactic contexts for training.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [60]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Contrary to string similarity-based approaches, continuous word representations capture not only lexical but also semantic properties of tokens.”
From A Method for the Calculation of Parallel Passages for Buddhist Chinese Sources Based on Million-scale Nearest Neighbor Search (2020) · cites this paper as Mikolov et al. (2013)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Mikolov et al. (2013) demonstrated that unweighted averaging of word embeddings performs well for the representation of short phrases.”
From A Method for the Calculation of Parallel Passages for Buddhist Chinese Sources Based on Million-scale Nearest Neighbor Search (2020) · cites this paper as Mikolov et al. (2013)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even during this stage, there was some use of pre-trained LMs exemplified by word2vec[85,86] and GloVe[95], but they were used for only a limited portion of the final model parameters.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [86]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These models were trained on vast amounts of unlabeled data, aiming to capture intricate grammatical and semantic rules.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [60]
The cited source says what the claim attributes to it.
In the citing paper
“In the next steps we filter out stopwords (e. g. 'a' , 'and' , 'the') and build a Word2Vec model (Mikolov et al., 2013) from these queries to get a model of the occurrence and co-occurrence of terms in these queries.”
From AI art in architecture (2023) · cites this paper as Mikolov et al., 2013
The cited source says what the claim attributes to it.
In the citing paper
“Negative sampling has been proved quite effective for both learning knowledge graph embedding (Trouillon et al., 2016) and word embedding (Mikolov et al., 2013).”
From RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space (2019) · cites this paper as Mikolov et al., 2013
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Self-citationA unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
From Frequency to Meaning: Vector Space Models of Semantics
Turney, P. D., & Pantel, P. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2934 · Cited by 2,949
Linguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · Cited by 2,913
Self-citation(2010) · Cited by 1,906
Extensions of recurrent neural network language model
Mikolov, T., Kombrink, S., Burget, L., Černocký, J., & Khudanpur, S. P. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5947611 · Cited by 1,622
Self-citationDomain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach
Glorot, X., Bordes, A., & Bengio, Y. (2011) · Cited by 1,569
Semantic Compositionality through Recursive Matrix-Vector Spaces
Socher, R., Huval, B., Manning, C. D., & Ng, A. Y. (2012) · Cited by 1,262
(2011) · Cited by 1,192
Research works printed but not linked: 3
- [1][1] Yoshua Bengio, R´ ejean Ducharme, Pascal Vincent, and Christian Janvin. A neural probabilistic language model. The Journal of Machine Learning Research , 3:1137-1155, 2003. -
- [7][7] Tomas Mikolov. Statistical Language Models Based on Neural Networks. PhD thesis, PhD Thesis, Brno University of Technology , 2012. -
- [13][13] David E Rumelhart, Geoffrey E Hintont, and Ronald J Williams. Learning representations by backpropagating errors. Nature , 323(6088):533-536, 1986. -
Cited by
Sorted by citations
Items 601–700 of 1,187
Deep Representation Learning for Trajectory Similarity Computation
Li, X., Zhao, K., Cong, G., Jensen, C. S., & Wei, W. (2018) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2018.00062 · Cited by 316
Bilingual Word Representations with Monolingual Quality in Mind
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing · doi:10.3115/v1/w15-1521 · Cited by 315
Wang, P., Xu, B., Xu, J., Tian, G., Liu, C., & Hao, H. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.09.096 · Cited by 315
Yin and Yang: Balancing and Answering Binary Visual Questions
Zhang, P., Goyal, Y., Summers-Stay, D. A., Batra, D., & Parikh, D. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.542 · Cited by 315
Bidirectional RNN for Medical Event Detection in Electronic Health Records
Jagannatha, A. N., & Yu, H. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1056 · Cited by 314
Disentangled Representation Learning for Non-Parallel Text Style Transfer
John, V., Mou, L., Bahuleyan, H., & Vechtomova, O. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1041 · Cited by 314
Multi-Level Semantic Feature Augmentation for One-Shot Learning
Chen, Z., Fu, Y., Zhang, Y., Jiang, Y.-G., Xue, X., & Sigal, L. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2910052 · Cited by 314
The Role of Corporate Culture in Bad Times: Evidence from the COVID-19 Pandemic
Li, K., Liu, X., Mai, F., & Zhang, T. (2020) · Journal of Financial and Quantitative Analysis · doi:10.1017/s0022109021000326 · Cited by 314
Neural Rating Regression with Abstractive Tips Generation for Recommendation
Li, P., Wang, Z., Ren, Z., Bing, L., & Lam, W. (2017) · Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3077136.3080822 · Cited by 313
Sentic LSTM: a Hybrid Network for Targeted Aspect-Based Sentiment Analysis
Ma, Y., Peng, H., Khan, T. A., Cambria, E., & Hussain, A. (2018) · Cognitive Computation · doi:10.1007/s12559-018-9549-x · Cited by 313
Community detection in node-attributed social networks: A survey
Chunaev, P. (2020) · Computer Science Review · doi:10.1016/j.cosrev.2020.100286 · Cited by 316
Multi-modal Knowledge Graphs for Recommender Systems
Sun, R. F., Cao, X., Zhao, Y. L., Wan, J., Zhou, K., Zhang, F., Wang, Z., & Zheng, K. (2020) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3340531.3411947 · Cited by 313
BilBOWA: Fast Bilingual Distributed Representations without Word AlignmentsPreprint
Gouws, S., Bengio, Y., & Corrado, G. S. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.2455 · Cited by 313
Self-citationContrastive Embedding for Generalized Zero-Shot Learning
Han, Z., Fu, Z., Chen, S., & Yang, J. J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00240 · Cited by 312
Learning Tree-based Deep Model for Recommender Systems
Han, Z., Li, X., Zhang, P., Li, G., He, J., Li, H., & Gai, K. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3219826 · Cited by 311
Trotzek, M., Koitka, S., & Friedrich, C. M. (2018) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2885515 · Cited by 312
Xu, R., Xiong, C., Chen, W. R., & Corso, J. J. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9512 · Cited by 311
A Deep Reinforcement Learning ChatbotPreprint
Serban, I. V., Sankar, C., Germain, M., Zhang, S., Lin, Z., Subramanian, S., Kim, T., Pieper, M., Chandar, S., Ke, N. R., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.02349 · Cited by 311
Transformer based Deep Intelligent Contextual Embedding for Twitter sentiment analysis
Naseem, U., Razzak, I., Musiał, K., & Imran, M. A. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.06.050 · Cited by 311
Mansouri, S., & Momtaz, P. P. (2021) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2022.106258 · Cited by 309
Entity Embeddings of Categorical Variables
Guo, C., & Berkhahn, F. (2016) · arXiv · doi:10.48550/arxiv.1604.06737 · Cited by 308
Beyond Binary Labels: Political Ideology Prediction of Twitter Users
Preoțiuc-Pietro, D., Liu, Y., Hopkins, D. J., & Ungar, L. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1068 · Cited by 310
Predicting cellular responses to complex perturbations in high‐throughput screens
Lotfollahi, M., Klimovskaia Susmelj, A., De Donno, C., Hetzel, L., Ji, Y., Ibarra, I. L., Srivatsan, S. R., Naghipourfar, M., Daza, R. M., Martin, B., et al. (2023) · Molecular Systems Biology · doi:10.15252/msb.202211517 · Cited by 307
Automatic cyberbullying detection: A systematic review
Rosa, H., Pereira, N., Ribeiro, R., Ferreira, P. C., Carvalho, J. P., Oliveira, S., Coheur, L., Paulino, P., Veiga Simão, A. M., & Trancoso, I. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.12.021 · Cited by 307
Adversarial Removal of Demographic Attributes from Text Data
Elazar, Y., & Goldberg, Y. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1002 · Cited by 307
Addressing Class Imbalance in Federated Learning
Wang, L., Xu, S., Wang, X., & Zhu, Q. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i11.17219 · Cited by 306
Unsupervised Scalable Representation Learning for Multivariate Time Series
Franceschi, J.-Y., Dieuleveut, A., & Jaggi, M. (2019) · arXiv · doi:10.48550/arxiv.1901.10738 · Cited by 305
A Survey on Text Classification Algorithms: From Text to Predictions
Gasparetto, A., Marcuzzo, M., Zangari, A., & Albarelli, A. (2022) · Information · doi:10.3390/info13020083 · Cited by 305
Embedding Temporal Network via Neighborhood Formation
Zuo, Y., Liu, G., Lin, H., Guo, J., Hu, X., & Wu, J. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3220054 · Cited by 304
KnowEdu: A System to Construct Knowledge Graph for Education
Chen, P., Lu, Y., Zheng, V. W., Chen, X., & Yang, B. (2018) · IEEE Access · doi:10.1109/access.2018.2839607 · Cited by 303
Data-driven materials research enabled by natural language processing and information extraction
Olivetti, E. A., Cole, J. M., Kim, E., Kononova, O., Ceder, G., Han, T. Y.-J., & Hiszpanski, A. M. (2020) · Applied Physics Reviews · doi:10.1063/5.0021106 · Cited by 302
Ye, X., Shen, H., Ma, X., Bunescu, R., & Liu, C. (2016) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2884781.2884862 · Cited by 302
Co-Occurrent Features in Semantic Segmentation
Zhang, H., Zhang, H., Wang, C., & Xie, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00064 · Cited by 302
Onan, A. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2022.02.025 · Cited by 302
Explicit Semantic Ranking for Academic Search via Knowledge Graph Embedding
Xiong, C., Power, R., & Callan, J. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052558 · Cited by 301
Mehrotra, R., McInerney, J., Bouchard, H., Lalmas, M., & Díaz, F. (2018) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3269206.3272027 · Cited by 301
Emotion-Cause Pair Extraction: A New Task to Emotion Analysis in Texts
Xia, R., & Ding, Z. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1096 · Cited by 301
FireCaffe: Near-Linear Acceleration of Deep Neural Network Training on Compute Clusters
Iandola, F., Moskewicz, M. W., Ashraf, K. M., & Keutzer, K. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.284 · Cited by 299
Tsitsulin, A., Mottin, D., Karras, P., & Müller, E. (2018) · International World Wide Web Conference (WWW) · doi:10.1145/3178876.3186120 · Cited by 299
Self-supervised learning methods and applications in medical imaging analysis: a survey
Shurrab, S., & Duwairi, R. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.1045 · Cited by 299
Chinese Poetry Generation with Recurrent Neural Networks
Zhang, X., & Lapata, M. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1074 · Cited by 298
Five sources of bias in natural language processing
Hovy, D., & Prabhumoye, S. (2021) · Language and Linguistics Compass · doi:10.1111/lnc3.12432 · Cited by 298
Machine learning in materials science: From explainable predictions to autonomous design
Pilania, G. (2021) · Computational Materials Science · doi:10.1016/j.commatsci.2021.110360 · Cited by 298
A Gentle Introduction to Graph Neural Networks
Sánchez-Lengeling, B., Reif, E., Pearce, A., & Wiltschko, A. B. (2021) · Distill · doi:10.23915/distill.00033 · Cited by 298
Recurrent Neural Networks for Short-Term Load Forecasting
Bianchi, F. M., Maiorino, E., Kampffmeyer, M., Rizzi, A., & Jenssen, R. (2017) · SpringerBriefs in computer science · doi:10.1007/978-3-319-70338-1 · Cited by 304
Transformer-based deep learning models for the sentiment analysis of social media data
Kokab, S. T., Asghar, S., & Naz, S. (2022) · Array · doi:10.1016/j.array.2022.100157 · Cited by 297
Combining Language and Vision with a Multimodal Skip-gram Model
Lazaridou, A., Pham, N. T., & Baroni, M. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1016 · Cited by 296
Latent Relational Metric Learning via Memory-based Attention for Collaborative Ranking
Tay, Y., Tuan, L. A., & Hui, S. C. (2018) · International World Wide Web Conference (WWW) · doi:10.1145/3178876.3186154 · Cited by 296
An Introductory Survey on Attention Mechanisms in NLP Problems
Hu, D. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-29513-4_31 · Cited by 296
Entezari, N., Al-Sayouri, S. A., Darvishzadeh, A., & Papalexakis, E. E. (2020) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3336191.3371789 · Cited by 297
Structure-Augmented Text Representation Learning for Efficient Knowledge Graph Completion
Wang, B., Shen, T., Long, G., Zhou, T., Wang, Y., & Chang, Y. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450043 · Cited by 297
A Survey on Knowledge Graph Embedding: Approaches, Applications and Benchmarks
Dai, Y., Wang, S., Xiong, N. N., & Guo, W. (2020) · Electronics · doi:10.3390/electronics9050750 · Cited by 294
A Simple Method for Commonsense Reasoning
Trinh, T. H., & Le, Q. V. (2018) · arXiv · doi:10.48550/arxiv.1806.02847 · Cited by 293
Tailoring Continuous Word Representations for Dependency Parsing
Bansal, M., Gimpel, K., & Livescu, K. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-2131 · Cited by 293
Going out on a limb: Joint Extraction of Entity Mentions and Relations without Dependency Trees
Katiyar, A., & Cardie, C. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1085 · Cited by 293
Survey on Multi-Output Learning
Xu, D., Shi, Y., Tsang, I. W.-H., Ong, Y.-S., Gong, C., & Shen, X. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2945133 · Cited by 293
Associating neural word embeddings with deep image representations using Fisher Vectors
Klein, B., Lev, G., Sadeh, G., & Wolf, L. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299073 · Cited by 292
Improving Lexical Embeddings with Semantic Knowledge
Yu, M., & Dredze, M. H. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-2089 · Cited by 292
Deep Sketch Hashing: Fast Free-Hand Sketch-Based Image Retrieval
Liu, L., Shen, F., Shen, Y., Liu, X., & Shao, L. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.247 · Cited by 292
Pooled Contextualized Embeddings for Named Entity Recognition
Akbik, A., Bergmann, T., & Vollgraf, R. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1078 · Cited by 292
Udell, M. R., Horn, C., Zadeh, R. B., & Boyd, S. (2016) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000055 · Cited by 294
MasakhaNER: Named Entity Recognition for African Languages
Adelani, D. I., Abbott, J., Neubig, G., D’souza, D., Kreutzer, J., Lignos, C., Palen-Michel, C., Buzaaba, H., Rijhwani, S., Ruder, S., et al. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00416 · Cited by 294
Are Transformers universal approximators of sequence-to-sequence functions?Preprint
Yun, C., Bhojanapalli, S., Rawat, A. S., Reddi, S. J., & Kumar, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.10077 · Cited by 292
Wang, T., Huang, J., Zhang, H., & Sun, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01077 · Cited by 291
Large pre-trained language models contain human-like biases of what is right and wrong to do
Schramowski, P., Turan, C., Andersen, N., Rothkopf, C. A., & Kersting, K. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00458-8 · Cited by 291
Large-Scale Weakly-Supervised Pre-Training for Video Action Recognition
Ghadiyaram, D., Tran, D., & Mahajan, D. K. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01232 · Cited by 291
Language2Pose: Natural Language Grounded Pose Forecasting
Ahuja, C., & Morency, L. (2019) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2019.00084 · Cited by 291
Identity-Aware Textual-Visual Matching with Latent Co-attention
Li, S., Xiao, T., Li, H., Yang, W. P., & Wang, X. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.209 · Cited by 291
Blocking and Filtering Techniques for Entity Resolution
Papadakis, G., Skoutas, D., Thanos, E., & Palpanas, T. (2020) · ACM Computing Surveys · doi:10.1145/3377455 · Cited by 291
Bridging Collaborative Filtering and Semi-Supervised Learning
Yang, C., Bai, L., Zhang, C., Yuan, Q., & Han, J. (2017) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3097983.3098094 · Cited by 290
Multi-view Knowledge Graph Embedding for Entity Alignment
Zhang, Q., Sun, Z., Hu, W. P., Chen, M., Guo, L., & Qu, Y. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/754 · Cited by 290
Zhang, S., Yang, Y., Chen, C., Zhang, X., Leng, Q., & Zhao, X. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121692 · Cited by 290
CNN-Based Chinese NER with Lexicon Rethinking
Gui, T., Ma, R., Zhang, Q., Zhao, L., Jiang, Y., & Huang, X. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/692 · Cited by 289
Distribution-Balanced Loss for Multi-label Classification in Long-Tailed Datasets
Wu, T., Huang, Q., Liu, Z., Wang, Y., & Lin, D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58548-8_10 · Cited by 289
Zoom In: An Introduction to Circuits
Olah, C., Cammarata, N., Schubert, L., Goh, G., Petrov, M., & Carter, S. (2020) · Distill · doi:10.23915/distill.00024.001 · Cited by 288
Spatial-Aware Hierarchical Collaborative Deep Learning for POI Recommendation
Yin, H., Wang, W., Wang, H., Chen, L., & Zhou, X. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2741484 · Cited by 288
Graph-based Neural Multi-Document Summarization
Yasunaga, M., Zhang, R., Meelu, K., Pareek, A., Srinivasan, K., & Radev, D. (2017) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k17-1045 · Cited by 288
Latent Embedding Feedback and Discriminative Features for Zero-Shot Classification
Narayan, S., Gupta, A., Khan, F. S., Snoek, C. G. M., & Shao, L. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58542-6_29 · Cited by 288
Vision-language models for medical report generation and visual question answering: a review
Hartsock, I., & Rasool, G. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1430984 · Cited by 298
Siamese CBOW: Optimizing Word Embeddings for Sentence Representations
Kenter, T., Borisov, A., & de Rijke, M. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1089 · Cited by 287
μVulDeePecker: A Deep Learning-Based System for Multiclass Vulnerability Detection
Zou, D., Wang, S., Xu, S., Li, Z., & Jin, H. (2019) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2019.2942930 · Cited by 287
Hierarchical Multi-View Graph Pooling with Structure Learning
Zhang, Z., Bu, J., Ester, M., Zhang, J., Li, Z., Yao, C., Huifen, D., Yu, Z., & Wang, C. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3090664 · Cited by 287
Artificial intelligence in science: An emerging general method of invention
Bianchini, S., Müller, M., & Pelletier, P. (2022) · Research Policy · doi:10.1016/j.respol.2022.104604 · Cited by 287
Graph Neural Networks for Intrusion Detection: A Survey
Bilot, T., Madhoun, N. E., Agha, K. A., & Zouaoui, A. (2023) · IEEE Access · doi:10.1109/access.2023.3275789 · Cited by 294
A Latent Variable Model Approach to PMI-based Word Embeddings
Arora, S., Li, Y., Liang, Y., Ma, T., & Risteski, A. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00106 · Cited by 286
"What is relevant in a text document?": An interpretable machine learning approach
Arras, L., Horn, F., Montavon, G., Müller, K., & Samek, W. (2017) · PLoS ONE · doi:10.1371/journal.pone.0181142 · Cited by 286
Universal Dependency Parsing from Scratch
Qi, P., Dozat, T., Zhang, Y., & Manning, C. D. (2018) · Proceedings of the · doi:10.18653/v1/k18-2016 · Cited by 290
Multi-label Hate Speech and Abusive Language Detection in Indonesian Twitter
Ibrohim, M. O., & Budi, I. D. (2019) · Workshop on Abusive Language Online (ALW) · doi:10.18653/v1/w19-3506 · Cited by 286
Jwa, H.-J., Oh, D., Park, K., Kang, J., & Lim, H. (2019) · Applied Sciences · doi:10.3390/app9194062 · Cited by 286
Toward Transformer-Based Object DetectionPreprint
Beal, J., Kim, E. S., Tzeng, E., Park, D. H., Zhai, A., & Kislyuk, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.09958 · Cited by 286
Proceedings of the 19th Python in Science Conference
(2020) · Proceedings of the Python in Science Conferences · doi:10.25080/majora-342d178e-02b · Cited by 285
Information Leakage in Embedding Models
Song, C., & Raghunathan, A. (2020) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3372297.3417270 · Cited by 287
Long Short-Term Memory Neural Networks for Chinese Word Segmentation
Chen, X., Qiu, X., Zhu, C., Liu, P., & Huang, X. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1141 · Cited by 283
Neural Machine Translation Inspired Binary Code Similarity Comparison beyond Function Pairs
Zuo, F., Li, X., Young, P., Luo, L., Zeng, Q., & Zhang, Z. (2019) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2019.23492 · Cited by 283
Sentiment Analysis of Arabic Tweets using Deep Learning
Heikal, M., Torki, M., & El-Makky, N. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.10.466 · Cited by 283
Cross-type biomedical named entity recognition with deep multi-task learning
Wang, X., Zhang, Y., Ren, X., Zhang, Y., Žitnik, M., Shang, J., Langlotz, C. P., & Han, J. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty869 · Cited by 282
Should ChatGPT be biased? Challenges and risks of bias in large language models
Ferrara, E. (2023) · First Monday · doi:10.5210/fm.v28i11.13346 · Cited by 282
Asynchronous pipelines for processing huge corpora on medium to low resource infrastructures
Suárez, P. O., Sagot, B., & Romary, L. (2019) · Publication Server of the Institute for German Language (Institute for German Language) · doi:10.14618/ids-pub-9021 · Cited by 282
A brief survey of machine learning methods and their sensor and IoT applications
Shanthamallu, U. S., Spanias, A., Tepedelenlioğlu, C., & Stanley, M. (2017) · International Conference on Information, Intelligence, Systems & Applications (IISA) · doi:10.1109/iisa.2017.8316459 · Cited by 281
Stopwords in technical language processing
Sarica, S., & Luo, J. (2021) · PLoS ONE · doi:10.1371/journal.pone.0254937 · Cited by 281
Metadata
- Authors
- Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2013
- Volume
- 26
- Pages
- 3111-3119
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1310.4546
- OpenAlex
- W2153579005
- Cited by
- 24,533
- References
- 19
- Citations by year
- 2026: 114 · 2025: 872 · 2024: 1388 · 2023: 1965 · 2022: 2239 · 2021: 3514 · 2020: 3787 · 2019: 3870 · 2018: 2785 · 2017: 1949 · 2016: 1194 · 2015: 658 · 2014: 176 · 2013: 7
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- TIB Data Manager
- neural information processing systems
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- distributed word representations, skip-gram model, phrase representation, negative sampling, frequent terms, idioms, word order, training speed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review