The DOI matches its DataCite record; 18 of the 19 references it cites were found in a registry or an index.
Distributed Representations of Words and Phrases and their Compositionality
Open accessAbstract
The recently introduced continuous Skip-gram model is an efficient method for learning high-quality distributed vector representations that capture a large number of precise syntactic and semantic word relationships. In this paper we present several extensions that improve both the quality of the vectors and the training speed. By subsampling of the frequent words we obtain significant speedup and also learn more regular word representations. We also describe a simple alternative to the hierarchical softmax called negative sampling. An inherent limitation of word representations is their indifference to word order and their inability to represent idiomatic phrases. For example, the meanings of "Canada" and "Air" cannot be easily combined to obtain "Air Canada". Motivated by this example, we present a simple method for finding phrases in text, and show that learning good vector representations for millions of phrases is possible.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Earlier word embedding models, e.g., word2vec [60] and GloVe [61], predominantly relied on syntactic contexts for training.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [60]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Contrary to string similarity-based approaches, continuous word representations capture not only lexical but also semantic properties of tokens.”
From A Method for the Calculation of Parallel Passages for Buddhist Chinese Sources Based on Million-scale Nearest Neighbor Search (2020) · cites this paper as Mikolov et al. (2013)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Mikolov et al. (2013) demonstrated that unweighted averaging of word embeddings performs well for the representation of short phrases.”
From A Method for the Calculation of Parallel Passages for Buddhist Chinese Sources Based on Million-scale Nearest Neighbor Search (2020) · cites this paper as Mikolov et al. (2013)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even during this stage, there was some use of pre-trained LMs exemplified by word2vec[85,86] and GloVe[95], but they were used for only a limited portion of the final model parameters.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [86]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These models were trained on vast amounts of unlabeled data, aiming to capture intricate grammatical and semantic rules.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [60]
The cited source says what the claim attributes to it.
In the citing paper
“In the next steps we filter out stopwords (e. g. 'a' , 'and' , 'the') and build a Word2Vec model (Mikolov et al., 2013) from these queries to get a model of the occurrence and co-occurrence of terms in these queries.”
From AI art in architecture (2023) · cites this paper as Mikolov et al., 2013
The cited source says what the claim attributes to it.
In the citing paper
“Negative sampling has been proved quite effective for both learning knowledge graph embedding (Trouillon et al., 2016) and word embedding (Mikolov et al., 2013).”
From RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space (2019) · cites this paper as Mikolov et al., 2013
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Self-citationA unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
From Frequency to Meaning: Vector Space Models of Semantics
Turney, P. D., & Pantel, P. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2934 · Cited by 2,949
Linguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · Cited by 2,913
Self-citation(2010) · Cited by 1,906
Extensions of recurrent neural network language model
Mikolov, T., Kombrink, S., Burget, L., Černocký, J., & Khudanpur, S. P. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5947611 · Cited by 1,622
Self-citationDomain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach
Glorot, X., Bordes, A., & Bengio, Y. (2011) · Cited by 1,569
Semantic Compositionality through Recursive Matrix-Vector Spaces
Socher, R., Huval, B., Manning, C. D., & Ng, A. Y. (2012) · Cited by 1,262
(2011) · Cited by 1,192
Research works printed but not linked: 3
- [1][1] Yoshua Bengio, R´ ejean Ducharme, Pascal Vincent, and Christian Janvin. A neural probabilistic language model. The Journal of Machine Learning Research , 3:1137-1155, 2003. -
- [7][7] Tomas Mikolov. Statistical Language Models Based on Neural Networks. PhD thesis, PhD Thesis, Brno University of Technology , 2012. -
- [13][13] David E Rumelhart, Geoffrey E Hintont, and Ronald J Williams. Learning representations by backpropagating errors. Nature , 323(6088):533-536, 1986. -
Cited by
Sorted by citations
Items 901–1,000 of 1,187
VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text UnderstandingPreprint
Xu, H., Ghosh, G., Huang, P.-Y., Okhonko, D., Aghajanyan, A., Metze, F., Zettlemoyer, L., & Feichtenhofer, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.14084 · Cited by 221
Gao, M. Z., Chen, L., He, X., & Zhou, A. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3209987 · Cited by 220
A Survey of Event Extraction From Text
Xiang, W., & Wang, B. (2019) · IEEE Access · doi:10.1109/access.2019.2956831 · Cited by 222
Jointly Embedding the Local and Global Relations of Heterogeneous Graph for Rumor Detection
Yuan, C., Ma, Q., Zhou, W. J., Han, J., & Hu, S. (2019) · Proceedings · doi:10.1109/icdm.2019.00090 · Cited by 220
Studying user income through language, behaviour and affect in social media
Preoţiuc-Pietro, D., Volkova, S., Lampos, V., Bachrach, Y., & Aletras, N. (2015) · PLOS ONE · doi:10.1371/journal.pone.0138717 · Cited by 219
Identifying and Reducing Gender Bias in Word-Level Language Models
Bordia, S., & Bowman, S. R. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Student Research Workshop · doi:10.18653/v1/n19-3002 · Cited by 219
Diverse Beam Search for Improved Description of Complex Scenes
Vijayakumar, A., Cogswell, M., Selvaraju, R., Sun, Q., Lee, S., Crandall, D., & Batra, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12340 · Cited by 219
Do Supervised Distributional Methods Really Learn Lexical Inference Relations?
Levy, O., Remus, S., Biemann, C., & Dagan, I. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1098 · Cited by 219
Zhao, W. X., Li, S., He, Y., Chang, E. Y., Wen, J.-R., & Li, X. (2015) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2015.2508816 · Cited by 219
RAVEN: A Dataset for Relational and Analogical Visual REasoNing
Zhang, C., Gao, F., Jia, B., Zhu, Y., & Zhu, S. C. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00546 · Cited by 219
Kumar, A., Srinivasan, K., Cheng, W.-H., & Zomaya, A. Y. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.102141 · Cited by 219
Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge Bases
Gu, Y., Kase, S., Vanni, M., Sadler, B. M., Liang, P., Yan, X., & Su, Y. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3449992 · Cited by 227
Sledzieski, S., Singh, R., Cowen, L., & Berger, B. (2021) · Cell Systems · doi:10.1016/j.cels.2021.08.010 · Cited by 235
ProjE: Embedding Projection for Knowledge Graph Completion
Shi, B., & Weninger, T. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10677 · Cited by 218
Zero-shot object recognition by semantic manifold distance
Fu, Z., Xiang, T., Kodirov, E., & Gong, S. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298879 · Cited by 218
Artetxe, M., Labaka, G., & Agirre, E. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11992 · Cited by 218
A Combined CNN and LSTM Model for Arabic Sentiment Analysis
Alayba, A. M., Palade, V., England, M., & Iqbal, R. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-99740-7_12 · Cited by 219
LCF: A Local Context Focus Mechanism for Aspect-Based Sentiment Classification
Zeng, B., Yang, H., Xu, R., Zhou, W., & Han, X. (2019) · Applied Sciences · doi:10.3390/app9163389 · Cited by 218
Ahmed, N. K., Rossi, R. A., Lee, J. B., Willke, T. L., Zhou, R., Kong, X., & Eldardiry, H. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3006475 · Cited by 222
BABEL: Bodies, Action and Behavior with English Labels
Punnakkal, A. R., Chandrasekaran, A., Athanasiou, N., Quirós-Ramírez, M. A., & Black, M. J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00078 · Cited by 218
Towards Open Vocabulary Learning: A Survey
Wu, J., Li, X., Xu, S., Yuan, H., Ding, H., Yang, Y., Li, X., Zhang, J., Tong, Y., Jiang, X., et al. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3361862 · Cited by 218
Toward the third generation artificial intelligence
Zhang, B., Zhu, J., & Su, H. (2023) · Science China Information Sciences · doi:10.1007/s11432-021-3449-x · Cited by 217
Uncovering the Temporal Context for Video Question Answering
Zhu, L., Xu, Z., Yang, Y., & Hauptmann, A. G. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-017-1033-7 · Cited by 217
Semantic Sentence Matching with Densely-Connected Recurrent and Co-Attentive Information
Kim, S., Kang, I.-H., & Kwak, N. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016586 · Cited by 217
Zhao, C., Li, C., Xiao, R., Deng, H., & Sun, A. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401169 · Cited by 217
ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information
Sun, Z., Li, X., Sun, X., Meng, Y., Ao, X., He, Q., Wu, F. Q., & Li, J. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.161 · Cited by 220
Prediction of Liquid-Liquid Phase Separation Proteins Using Machine Learning
Chu, X., Sun, T., Li, Q., Xu, Y., Zhang, Z., Lai, L., & Pei, J. (2020) · BMC Bioinformatics · doi:10.1186/s12859-022-04599-w · Cited by 217
Dalianis, H. (2018) · Springer eBooks · doi:10.1007/978-3-319-78503-5 · Cited by 217
Recurrent Dropout Without Memory LossPreprint
Semeniuta, S., Severyn, A., & Barth, E. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.05118 · Cited by 217
Exploring Neural Text Simplification Models
Nisioi, S., Štajner, S., Ponzetto, S. P., & Dinu, L. P. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-2014 · Cited by 216
Machine Learning for Quantitative Finance Applications: A Survey
Rundo, F., Trenta, F., di Stallo, A. L., & Battiato, S. (2019) · Applied Sciences · doi:10.3390/app9245574 · Cited by 216
Structured prediction models for RNN based sequence labeling in clinical text
Jagannatha, A., & yu, H. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1082 · Cited by 215
UNITN: Training Deep Convolutional Neural Network for Twitter Sentiment Classification
Severyn, A., & Moschitti, A. (2015) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s15-2079 · Cited by 215
Learning to Predict Severity of Software Vulnerability Using Only Vulnerability Description
Han, Z., Li, X., Xing, Z., Liu, H., & Feng, Z. (2017) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2017.52 · Cited by 215
Wang, L., Wang, X., Peng, J., & Wang, J. (2019) · Tourism Management · doi:10.1016/j.tourman.2019.103961 · Cited by 220
GDroid: Android malware detection and classification with graph convolutional network
Gao, H., Cheng, S., & Zhang, W. (2021) · Computers & Security · doi:10.1016/j.cose.2021.102264 · Cited by 215
Rahate, A., Walambe, R., Ramanna, S., & Kotecha, K. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.12.003 · Cited by 214
A comprehensive survey of arabic sentiment analysis
Al‐Ayyoub, M., Khamaiseh, A. A., Jararweh, Y., & Al-Kabi, M. N. (2018) · Information Processing & Management · doi:10.1016/j.ipm.2018.07.006 · Cited by 214
Recurrent Neural Network for Predicting Transcription Factor Binding Sites
Shen, Z., Bao, W., & Huang, D.-S. (2018) · Scientific Reports · doi:10.1038/s41598-018-33321-1 · Cited by 214
BottleNet: A Deep Learning Architecture for Intelligent Mobile Cloud Computing Services
Eshratifar, A. E., Esmaili, A., & Pedram, M. (2019) · International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1109/islped.2019.8824955 · Cited by 214
Chung, Y.-A., Wu, C.-C., Shen, C.-H., Lee, H.-Y., & Lee, L.-S. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-82 · Cited by 215
A Survey of Textual Emotion Recognition and Its Challenges
Deng, J., & Ren, F. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2021.3053275 · Cited by 214
Love, P. E. D., Fang, W., Matthews, J., Porter, S. R., Luo, H., & Ding, L. (2023) · Advanced Engineering Informatics · doi:10.1016/j.aei.2023.102024 · Cited by 214
Financial Sentiment Analysis: Techniques and Applications
Du, K., Xing, F., Mao, R., & Cambria, E. (2024) · ACM Computing Surveys · doi:10.1145/3649451 · Cited by 215
Character-level neural network for biomedical named entity recognition
Gridach, M. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.05.002 · Cited by 213
Rezaii, N., Walker, E. F., & Wolff, P. (2019) · Schizophrenia · doi:10.1038/s41537-019-0077-9 · Cited by 213
A Survey on Knowledge Graph Embeddings for Link Prediction
Wang, M., Qiu, L., & Wang, X. (2021) · Symmetry · doi:10.3390/sym13030485 · Cited by 212
TorusE: Knowledge Graph Embedding on a Lie Group
Ebisu, T., & Ichise, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11538 · Cited by 212
SemEval-2014 Task 7: Analysis of Clinical Text
Pradhan, S., Elhadad, N., Chapman, W. W., Manandhar, S., & Savova, G. (2014) · International Workshop on Semantic Evaluation (SemEval) · doi:10.3115/v1/s14-2007 · Cited by 212
Tahmasbi, F., Schild, L., Ling, C., Blackburn, J., Stringhini, G., Zhang, Y., & Zannettou, S. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450024 · Cited by 212
Recipe recognition with large multimodal food dataset
Wang, X., Kumar, D., Thome, N., Cord, M., & Precioso, F. (2015) · IEEE International Conference on Multimedia & Expo Workshops (ICMEW) · doi:10.1109/icmew.2015.7169757 · Cited by 211
Sentiment Polarity Detection for Software Development
Calefato, F., Lanubile, F., Maiorano, F., & Novielli, N. (2017) · Empirical Software Engineering · doi:10.1007/s10664-017-9546-9 · Cited by 211
Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddings
Chen, K., Choy, C., Savva, M., Chang, A. X., Funkhouser, T. A., & Savarese, S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20893-6_7 · Cited by 211
Self-citationPalmTree: Learning an Assembly Language Model for Instruction Embedding
Li, X., Qu, Y., & Yin, H. (2021) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3460120.3484587 · Cited by 211
Active Learning by Acquiring Contrastive Examples
Margatina, K., Vernikos, G., Barrault, L., & Αλέτρας, Ν. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.51 · Cited by 211
Improved Relation Classification by Deep Recurrent Neural Networks with Data AugmentationPreprint
Xu, Y., Jia, R., Mou, L., Li, G., Chen, Y., Lu, Y., & Jin, Z. G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.03651 · Cited by 211
Zero-Shot Semantic SegmentationPreprint
Bucher, M., Vu, T.-H., Cord, M., & Pérez, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.00817 · Cited by 211
Attention Correctness in Neural Image Captioning
Liu, C., Mao, J., Sha, F., & Yuille, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11197 · Cited by 210
Improving stock market prediction via heterogeneous information fusion
Zhang, X., Zhang, Y., Wang, S., Yao, Y., Fang, B., & Yu, P. S. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.12.025 · Cited by 210
Affective Neural Response Generation
Asghar, N., Poupart, P., Hoey, J., Jiang, X., & Mou, L. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-76941-7_12 · Cited by 210
Eichstaedt, J. C., Kern, M. L., Yaden, D. B., Schwartz, H. A., Giorgi, S., Park, G., Hagan, C. A., Tobolsky, V. A., Smith, L. K., Buffone, A. E. K., et al. (2021) · Psychological Methods · doi:10.1037/met0000349 · Cited by 210
A Survey of Deep Learning for Scientific DiscoveryPreprint
Raghu, M., & Schmidt, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.11755 · Cited by 221
Scalable Graph Embedding for Asymmetric Proximity
Zhou, C., Liu, Y., Liu, X., Liu, Z., & Gao, J. Y. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10878 · Cited by 209
Good-Enough Compositional Data Augmentation
Andreas, J. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.676 · Cited by 209
A Survey on Canonical Correlation Analysis
Yang, X., Liu, W., Liu, W., & Tao, D. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2958342 · Cited by 209
word2vec, node2vec, graph2vec, X2vec: Towards a Theory of Vector Embeddings of Structured Data
Grohe, M. (2020) · ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems (PODS) · doi:10.1145/3375395.3387641 · Cited by 209
Composite Backdoor Attack for Deep Neural Network by Mixing Existing Benign Features
Lin, J., Xu, L., Liu, Y., & Zhang, X. (2020) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3372297.3423362 · Cited by 209
Crossley, S. A., Kyle, K. D., & Dascălu, M. (2018) · Behavior Research Methods · doi:10.3758/s13428-018-1142-4 · Cited by 208
Word2vec convolutional neural networks for classification of news articles and tweets
Jang, B., Kim, I., & Kim, J. W. (2019) · PLoS ONE · doi:10.1371/journal.pone.0220976 · Cited by 208
Zero-VAE-GAN: Generating Unseen Features for Generalized and Transductive Zero-Shot Learning
Gao, R., Hou, X., Qin, J., Chen, J., Liu, L., Zhu, F., Zhang, Z., & Shao, L. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2964429 · Cited by 208
Evaluation of Text Generation: A Survey
Celikyilmaz, A., Clark, E., & Gao, J. (2020) · arXiv · doi:10.48550/arxiv.2006.14799 · Cited by 207
Learning from History and Present
Li, Z., Zhao, H., Liu, Q., Huang, Z., Mei, T., & Chen, E. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3220014 · Cited by 209
Distinguish Confusing Law Articles for Legal Judgment Prediction
Xu, N., Wang, P., Chen, L. F., Pan, L., Wang, X., & Zhao, J. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.280 · Cited by 207
SumGNN: multi-typed drug interaction prediction via efficient knowledge graph summarization
Yu, Y., Huang, K., Zhang, C., Glass, L. M., Sun, J., & Xiao, C. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btab207 · Cited by 207
Unsupervised Speech RecognitionPreprint
Baevski, A., Hsu, W.-N., Conneau, A., & Auli, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.11084 · Cited by 207
Time2Vec: Learning a Vector Representation of Time
Kazemi, S. M., Goel, R., Eghbali, S., Ramanan, J., Sahota, J., Thakur, S., Wu, S., Smyth, C., Poupart, P., & Brubaker, M. (2019) · arXiv · doi:10.48550/arxiv.1907.05321 · Cited by 206
ANN-Benchmarks: A Benchmarking Tool for Approximate Nearest Neighbor Algorithms
Aumüller, M., Bernhardsson, E., & Faithfull, A. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68474-1_3 · Cited by 206
Semantic text classification: A survey of past and recent advances
Altınel, B., & Ganiz, M. C. (2018) · Information Processing & Management · doi:10.1016/j.ipm.2018.08.001 · Cited by 206
A Label Attention Model for ICD Coding from Clinical Text
Vu, T., Nguyen, D. Q., & Nguyen, A. N. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/461 · Cited by 211
Automated Concatenation of Embeddings for Structured Prediction
Wang, X., Jiang, Y., Bách, N., Wang, T., Huang, Z., Huang, F., & Tu, K. (2021) · doi:10.18653/v1/2021.acl-long.206 · Cited by 206
Nodes and networks in Diachronic Construction Grammar
Sommerer, L., & Smirnova, E. (2020) · Constructional approaches to language · doi:10.1075/cal.27 · Cited by 206
Salehi, A., & Davulcu, H. (2020) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai50040.2020.00154 · Cited by 205
DeepBinDiff: Learning Program-Wide Code Representations for Binary Diffing
Duan, Y., Li, X., Wang, J., & Yin, H. (2020) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2020.24311 · Cited by 205
Ombabi, A. H., Ouarda, W., & Alimi, A. M. (2020) · Social Network Analysis and Mining · doi:10.1007/s13278-020-00668-1 · Cited by 205
Organisciak, P., Acar, S., Dumas, D., & Berthiaume, K. (2023) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2023.101356 · Cited by 202
Semantic-aware Knowledge Distillation for Few-Shot Class-Incremental Learning
Cheraghian, A., Rahman, S., Fang, P., Roy, S. K., Petersson, L., & Harandi, M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00256 · Cited by 201
Ash, E., & Hansen, S. (2023) · Annual Review of Economics · doi:10.1146/annurev-economics-082222-074352 · Cited by 197
A survey of word embeddings based on deep learning
Wang, S., Zhou, W., & Jiang, C. (2020) · Computing · doi:10.1007/s00607-019-00768-7 · Cited by 193
Learning Deep Network Representations with Adversarially Regularized Autoencoders
Yu, W., Zheng, C., Cheng, W., Aggarwal, C. C., Song, D., Zong, B., Chen, H., & Wang, W. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220000 · Cited by 188
Measuring and Reducing Gendered Correlations in Pre-trained Models
Webster, K., Wang, X., Tenney, I., Beutel, A., Pitler, E., Pavlick, E., Chen, J., Chi, E., & Petrov, S. (2020) · arXiv · doi:10.48550/arxiv.2010.06032 · Cited by 195
Naseem, U., Razzak, I., Khan, S. K., & Prasad, M. (2021) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3434237 · Cited by 194
Readmission prediction using deep learning on electronic health records
Ashfaq, A., Sant’Anna, A., Lingman, M., & Nowaczyk, S. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103256 · Cited by 194
Wu, Y., & Wang, G. (2018) · International Journal of Molecular Sciences · doi:10.3390/ijms19082358 · Cited by 193
Virtual screening of inorganic materials synthesis parameters with deep learning
Kim, E., Huang, K., Jegelka, S., & Olivetti, E. (2017) · npj Computational Materials · doi:10.1038/s41524-017-0055-6 · Cited by 190
Evaluating the Underlying Gender Bias in Contextualized Word Embeddings
Basta, C., Costa-jussà, M. R., & Casas, N. (2019) · Proceedings of the First Workshop on Gender Bias in Natural Language Processing · doi:10.18653/v1/w19-3805 · Cited by 189
Privacy Risks of General-Purpose Language Models
Pan, X., Zhang, M., Ji, S., & Yang, M. (2020) · 2020 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp40000.2020.00095 · Cited by 188
Hajek, P., Barushka, A., & Munk, M. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-04757-2 · Cited by 186
Unsupervised Pretraining Transfers Well Across Languages
Riviere, M., Joulin, A., Mazare, P.-E., & Dupoux, E. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9054548 · Cited by 186
Linear Algebraic Structure of Word Senses, with Applications to Polysemy
Arora, S., Li, Y., Liang, Y., Ma, T., & Risteski, A. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00034 · Cited by 186
CoLAKE: Contextualized Language and Knowledge Embedding
Sun, T., Shao, Y., Qiu, X., Guo, Q., Hu, Y., Huang, X., & Zhang, Z. (2020) · Proceedings of the 28th International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.327 · Cited by 185
Metadata
- Authors
- Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2013
- Volume
- 26
- Pages
- 3111-3119
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1310.4546
- OpenAlex
- W2153579005
- Cited by
- 24,533
- References
- 19
- Citations by year
- 2026: 114 · 2025: 872 · 2024: 1388 · 2023: 1965 · 2022: 2239 · 2021: 3514 · 2020: 3787 · 2019: 3870 · 2018: 2785 · 2017: 1949 · 2016: 1194 · 2015: 658 · 2014: 176 · 2013: 7
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- TIB Data Manager
- neural information processing systems
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- distributed word representations, skip-gram model, phrase representation, negative sampling, frequent terms, idioms, word order, training speed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
