The DOI matches its DataCite record; 18 of the 19 references it cites were found in a registry or an index.
Distributed Representations of Words and Phrases and their Compositionality
Open accessAbstract
The recently introduced continuous Skip-gram model is an efficient method for learning high-quality distributed vector representations that capture a large number of precise syntactic and semantic word relationships. In this paper we present several extensions that improve both the quality of the vectors and the training speed. By subsampling of the frequent words we obtain significant speedup and also learn more regular word representations. We also describe a simple alternative to the hierarchical softmax called negative sampling. An inherent limitation of word representations is their indifference to word order and their inability to represent idiomatic phrases. For example, the meanings of "Canada" and "Air" cannot be easily combined to obtain "Air Canada". Motivated by this example, we present a simple method for finding phrases in text, and show that learning good vector representations for millions of phrases is possible.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Earlier word embedding models, e.g., word2vec [60] and GloVe [61], predominantly relied on syntactic contexts for training.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [60]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Contrary to string similarity-based approaches, continuous word representations capture not only lexical but also semantic properties of tokens.”
From A Method for the Calculation of Parallel Passages for Buddhist Chinese Sources Based on Million-scale Nearest Neighbor Search (2020) · cites this paper as Mikolov et al. (2013)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Mikolov et al. (2013) demonstrated that unweighted averaging of word embeddings performs well for the representation of short phrases.”
From A Method for the Calculation of Parallel Passages for Buddhist Chinese Sources Based on Million-scale Nearest Neighbor Search (2020) · cites this paper as Mikolov et al. (2013)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even during this stage, there was some use of pre-trained LMs exemplified by word2vec[85,86] and GloVe[95], but they were used for only a limited portion of the final model parameters.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [86]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These models were trained on vast amounts of unlabeled data, aiming to capture intricate grammatical and semantic rules.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [60]
The cited source says what the claim attributes to it.
In the citing paper
“In the next steps we filter out stopwords (e. g. 'a' , 'and' , 'the') and build a Word2Vec model (Mikolov et al., 2013) from these queries to get a model of the occurrence and co-occurrence of terms in these queries.”
From AI art in architecture (2023) · cites this paper as Mikolov et al., 2013
The cited source says what the claim attributes to it.
In the citing paper
“Negative sampling has been proved quite effective for both learning knowledge graph embedding (Trouillon et al., 2016) and word embedding (Mikolov et al., 2013).”
From RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space (2019) · cites this paper as Mikolov et al., 2013
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Self-citationA unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
From Frequency to Meaning: Vector Space Models of Semantics
Turney, P. D., & Pantel, P. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2934 · Cited by 2,949
Linguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · Cited by 2,913
Self-citation(2010) · Cited by 1,906
Extensions of recurrent neural network language model
Mikolov, T., Kombrink, S., Burget, L., Černocký, J., & Khudanpur, S. P. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5947611 · Cited by 1,622
Self-citationDomain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach
Glorot, X., Bordes, A., & Bengio, Y. (2011) · Cited by 1,569
Semantic Compositionality through Recursive Matrix-Vector Spaces
Socher, R., Huval, B., Manning, C. D., & Ng, A. Y. (2012) · Cited by 1,262
(2011) · Cited by 1,192
Research works printed but not linked: 3
- [1][1] Yoshua Bengio, R´ ejean Ducharme, Pascal Vincent, and Christian Janvin. A neural probabilistic language model. The Journal of Machine Learning Research , 3:1137-1155, 2003. -
- [7][7] Tomas Mikolov. Statistical Language Models Based on Neural Networks. PhD thesis, PhD Thesis, Brno University of Technology , 2012. -
- [13][13] David E Rumelhart, Geoffrey E Hintont, and Ronald J Williams. Learning representations by backpropagating errors. Nature , 323(6088):533-536, 1986. -
Cited by
Sorted by citations
Items 801–900 of 1,187
Kraljević, Ž., Searle, T., Shek, A., Roguski, Ł., Noor, K., Bean, D. M., Mascio, A., Zhu, L., Folarin, A., Roberts, A., et al. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102083 · Cited by 255
Deep Multi-Task Learning for Aspect Term Extraction with Memory Interaction
Li, X., & Lam, W. P. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1310 · Cited by 249
Lessons from Natural Language Inference in the Clinical Domain
Romanov, A., & Shivade, C. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1187 · Cited by 249
SAFE: Self-Attentive Function Embeddings for Binary Similarity
Massarelli, L., Luna, G. A. D., Petroni, F., Baldoni, R., & Querzoni, L. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-22038-9_15 · Cited by 249
Neural networks for deceptive opinion spam detection: An empirical study
Ren, Y., & Ji, D. (2017) · Information Sciences · doi:10.1016/j.ins.2017.01.015 · Cited by 248
From Red Wine to Red Tomato: Composition with Context
Misra, I., Gupta, A., & Hebert, M. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.129 · Cited by 248
Semantic Projection Network for Zero- and Few-Label Semantic Segmentation
Xian, Y., Choudhury, S., He, Y., Schiele, B., & Akata, Z. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00845 · Cited by 248
Behind the cues: A benchmarking study for fake news detection
Gravanis, G., Vakali, A. I., Diamantaras, K., & Karadais, P. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.03.036 · Cited by 248
Supervised and Semi-Supervised Text Categorization using LSTM for Region EmbeddingsPreprint
Johnson, R., & Zhang, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.02373 · Cited by 248
Akhtar, M. S., Ekbal, A., & Cambria, E. (2020) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2019.2954667 · Cited by 246
Sentence Compression by Deletion with LSTMs
Filippova, K., Alfonseca, E., Colmenares, C. A., Kaiser, Ł., & Vinyals, O. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1042 · Cited by 246
Self-Taught convolutional neural networks for short text clustering
Xu, J., Xu, B., Wang, P., Zheng, S., Tian, G., Zhao, J., & Xu, B. (2017) · Neural Networks · doi:10.1016/j.neunet.2016.12.008 · Cited by 246
Cardon, D., Cointet, J., Mazières, A., & Carey-Libbrecht, L. (2018) · Réseaux · doi:10.3917/res.211.0173 · Cited by 246
Factorization Meets the Item Embedding
Liang, D., Altosaar, J., Charlin, L., & Blei, D. M. (2016) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/2959100.2959182 · Cited by 245
Transductive Unbiased Embedding for Zero-Shot Learning
Song, J., Shen, C., Yang, Y., Liu, Y., & Song, M. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00113 · Cited by 245
A Novel Deep Learning-Based Collaborative Filtering Model for Recommendation System
Fu, M., Qu, H., Zhang, Y., Lu, L., & Liu, Y. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2795041 · Cited by 244
Chen, M., Tian, Y., Chang, K.-W., Skiena, S., & Zaniolo, C. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/556 · Cited by 244
Representation Degeneration Problem in Training Natural Language Generation ModelsPreprint
Gao, J. Y., He, D., Tan, X., Qin, T., Wang, L., & Liu, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.12009 · Cited by 244
Deep learning for stock market prediction from financial news articles
Vargas, M. R., de Lima, B. S. L. P., & Evsukoff, A. G. (2017) · IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA) · doi:10.1109/civemsa.2017.7995302 · Cited by 243
Cultural Shift or Linguistic Drift? Comparing Two Computational Measures of Semantic Change
Hamilton, W. L., Leskovec, J., & Jurafsky, D. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1229 · Cited by 243
 3: Accelerating attention mechanisms in neural networks with approximation
Ham, T. J., Jung, S. J., Kim, S., Oh, Y. H., Park, Y., Song, Y., Park, J.-H., Lee, S., Park, K., Lee, J. W., et al. (2020) · 2020 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca47549.2020.00035 · Cited by 242
Using Word2Vec to process big text data
Ma, L., & Zhang, Y. (2015) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2015.7364114 · Cited by 242
Enhancing Social Media Analysis with Visual Data Analytics: A Deep Learning Approach
Shin, D., He, S., Lee, G. M., Whinston, A. B., Cetintas, S., & Lee, K.-C. (2020) · MIS Quarterly · doi:10.25300/misq/2020/14870 · Cited by 243
PhaTYP: predicting the lifestyle for bacteriophages using BERT
Shang, J., Tang, X., & Sun, Y. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac487 · Cited by 242
Compact integration of multi-network topology for functional analysis of genes
Cho, H., Berger, B., & Peng, J. (2016) · Cell Systems · doi:10.1016/j.cels.2016.10.017 · Cited by 241
Hybrid Recommender System based on Autoencoders
Strub, F., Gaudel, R., & Mary, J. (2016) · Workshop on Deep Learning for Recommender Systems (DLRS) · doi:10.1145/2988450.2988456 · Cited by 241
A stacking model using URL and HTML features for phishing webpage detection
Li, Y., Yang, Z., Chen, X., Yuan, H., & Liu, W. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2018.11.004 · Cited by 241
A survey of word embeddings for clinical text
Khattak, F. K., Jeblee, S., Pou-Prom, C., Abdalla, M., Meaney, C. A., & Rudzicz, F. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.yjbinx.2019.100057 · Cited by 241
Towards Automated Reentrancy Detection for Smart Contracts Based on Sequential Models
Qian, P., Liu, Z., He, Q., Zimmermann, R., & Wang, X. (2020) · IEEE Access · doi:10.1109/access.2020.2969429 · Cited by 241
Sparse Graph Attention Networks
Ye, Y., & Ji, S. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3072345 · Cited by 240
More than Bags of Words: Sentiment Analysis with Word Embeddings
Rudkowsky, E., Haselmayer, M., Wastian, M., Jenny, M., Emrich, Š., & Sedlmair, M. (2018) · Communication Methods and Measures · doi:10.1080/19312458.2018.1455817 · Cited by 239
Li, Y., Wang, S., & Nguyen, T. N. (2020) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3377811.3380345 · Cited by 239
Graph representation learning in bioinformatics: trends, methods and applications
Yi, H.-C., You, Z., Huang, D.-S., & Kwoh, C. K. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab340 · Cited by 239
Fake Reviews Detection: A Survey
Mohawesh, R., Xu, S., Tran, S. N., Ollington, R., Springer, M., Jararweh, Y., & Maqsood, S. (2021) · IEEE Access · doi:10.1109/access.2021.3075573 · Cited by 238
Towards generalisable hate speech detection: a review on obstacles and solutions
Yin, W., & Zubiaga, A. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.598 · Cited by 238
pix2code: Generating Code from a Graphical User Interface Screenshot
Beltramelli, T. (2018) · Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems · doi:10.1145/3220134.3220135 · Cited by 237
Neural User Response Generator: Fake News Detection with Collective User Intelligence
Qian, F., Gong, C., Sharma, K., & Liu, Y. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/533 · Cited by 237
A novel time series forecasting model with deep learning
Shen, Z., Zhang, Y., Lu, J., Xu, J., & Xiao, G. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.12.084 · Cited by 237
Detecting Depression using Vocal, Facial and Semantic Communication Cues
Williamson, J. R., Godoy, E., Cha, M., Schwarzentruber, A., Khorrami, P., Gwon, Y., Kung, H.-T., Dagli, C. K., & Quatieri, T. F. (2016) · International Workshop on Audio/Visual Emotion Challenge (AVEC) · doi:10.1145/2988257.2988263 · Cited by 236
Peng, N., & Dredze, M. H. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-2025 · Cited by 237
Zhao, W., Wang, L., Shen, K., Jia, R., & Liu, J. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1014 · Cited by 240
Adversarial Robustness as a Prior for Learned RepresentationsPreprint
Engstrom, L., Ilyas, A., Santurkar, S., Tsipras, D., Tran, B., & Mądry, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.00945 · Cited by 236
Si, Y., Du, J., Li, Z., Jiang, X., Miller, T., Wang, F., Jim Zheng, W., & Roberts, K. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103671 · Cited by 235
Robust Classification of Crisis-Related Data on Social Networks Using Convolutional Neural Networks
Nguyen, D. T., Mannai, K. A. A., Joty, S., Sajjad, H., Imran, M., & Mitra, P. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14950 · Cited by 235
Exploiting Document Knowledge for Aspect-level Sentiment Classification
He, R., Lee, W. S., Ng, H. T., & Dahlmeier, D. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-2092 · Cited by 235
Supporting Clustering with Contrastive Learning
Zhang, D., Nan, F., Wei, X., Li, S.-W. D., Zhu, H., McKeown, K. R., Nallapati, R. M., Arnold, A. O., & Xiang, B. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.427 · Cited by 236
Wang, S., Wang, Y., Tang, J., Shu, K., Ranganath, S., & Liu, H. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3038912.3052638 · Cited by 234
DeepSol: a deep learning framework for sequence-based protein solubility prediction
Khurana, S., Rawi, R., Kunji, K. B., Chuang, G., Bensmail, H., & Mall, R. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty166 · Cited by 234
Lai, V., Ngo, N., Pouran Ben Veyseh, A., Man, H., Dernoncourt, F., Bui, T., & Nguyen, T. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.878 · Cited by 233
Improving Pairwise Ranking for Multi-label Image Classification
Li, Y., Song, Y., & Luo, J. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.199 · Cited by 233
Vasile, F., Smirnova, E., & Conneau, A. (2016) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/2959100.2959160 · Cited by 233
Structural Deep Embedding for Hyper-Networks
Tu, K., Cui, P., Wang, X., Wang, F., & Zhu, W. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11266 · Cited by 232
ANRL: Attributed Network Representation Learning via Deep Neural Networks
Zhang, Z., Yang, H., Bu, J., Zhou, S., Yu, P., Zhang, J., Ester, M., & Wang, C. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/438 · Cited by 232
Arabic natural language processing: An overview
Guellil, I., Saâdane, H., Azouaou, F., Gueni, B., & Nouvel, D. (2019) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2019.02.006 · Cited by 232
Daniely, A., Frostig, R., & Singer, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.05897 · Cited by 232
Table union search on open data
Nargesian, F., Zhu, E., Pu, K. Q., & Miller, R. J. (2018) · Proceedings of the VLDB Endowment · doi:10.14778/3192965.3192973 · Cited by 231
ParsBERT: Transformer-based Model for Persian Language Understanding
Farahani, M., Gharachorloo, M., Farahani, M., & Manthouri, M. (2021) · Neural Processing Letters · doi:10.1007/s11063-021-10528-4 · Cited by 232
Learning Image and User Features for Recommendation in Social Networks
Geng, X., Zhang, H., Bian, J., & Chua, T. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.486 · Cited by 230
Query Expansion with Locally-Trained Word Embeddings
Díaz, F., Mitra, B., & Craswell, N. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1035 · Cited by 230
End-to-End Adversarial Memory Network for Cross-domain Sentiment Classification
Li, Z., Zhang, Y., Wei, Y., Wu, Y., & Yang, Q. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/311 · Cited by 230
Net2Vec: Quantifying and Explaining How Concepts are Encoded by Filters in Deep Neural Networks
Fong, R., & Vedaldi, A. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00910 · Cited by 230
Anaphora and coreference resolution: A review
Sukthanker, R. S., Poria, S., Cambria, E., & Thirunavukarasu, R. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.01.010 · Cited by 230
Deep Matrix Factorization With Implicit Feedback Embedding for Recommendation System
Yi, B., Shen, X., Liu, H., Zhang, Z., Zhang, W., Liu, S., & Xiong, N. N. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2893714 · Cited by 230
Constructing Narrative Event Evolutionary Graph for Script Event Prediction
Li, Z., Ding, X., & Liu, T. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/584 · Cited by 230
Park, S., Hong, Y., Heo, B., Yun, S., & Choi, J. Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00676 · Cited by 230
Scalable Multiplex Network Embedding
Zhang, H., Qiu, L., Yi, L., & Song, Y. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/428 · Cited by 229
Cross-Task Weakly Supervised Learning From Instructional Videos
Zhukov, D., Alayrac, J.-B., Cinbiş, R. G., Fouhey, D. F., Laptev, I., & Šivic, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00365 · Cited by 229
Geometric deep learning for computational mechanics Part I: anisotropic hyperelasticity
Vlassis, N. N., Ma, R., & Sun, W. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113299 · Cited by 229
Semantic projection recovers rich human knowledge of multiple object features from word embeddings
Grand, G., Blank, I., Pereira, F., & Fedorenko, E. G. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01316-8 · Cited by 229
Pre-trained Language Models in Biomedical Domain: A Systematic Survey
Wang, B., Xie, Q., Pei, J., Chen, Z., Tiwari, P., Li, Z., & Fu, J. (2023) · ACM Computing Surveys · doi:10.1145/3611651 · Cited by 238
Incorporating BERT into Neural Machine Translation
Zhu, J., Xia, Y., Wu, L., He, D., Qin, T., Zhou, W., Li, H., & Liu, T.-Y. (2020) · arXiv · doi:10.48550/arxiv.2002.06823 · Cited by 228
Convolutional neural tensor network architecture for community-based question answering
Qiu, X., & Huang, X. (2015) · International Conference on Artificial Intelligence · Cited by 228
Emmanuel Dupoux, A. (2018) · Cognition · doi:10.1016/j.cognition.2017.11.008 · Cited by 228
End-to-End Concept Word Detection for Video Captioning, Retrieval, and Question Answering
Yu, Y., Ko, H., Choi, J., & Kim, G. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.347 · Cited by 231
POI2Vec: Geographical Latent Representation for Predicting Future Visitors
Feng, S., Cong, G., An, B., & Chee, Y. M. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10500 · Cited by 228
A Unified Approach for Conventional Zero-Shot, Generalized Zero-Shot, and Few-Shot Learning
Rahman, S., Khan, S., & Porikli, F. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2861573 · Cited by 228
Dynamic Word Embeddings for Evolving Semantic Discovery
Yao, Z., Sun, Y., Ding, W., Rao, N., & Xiong, H. (2018) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3159652.3159703 · Cited by 228
Social Influence-Based Group Representation Learning for Group Recommendation
Yin, H., Wang, Q., Zheng, K., Li, Z., Yang, J., & Zhou, X. (2019) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2019.00057 · Cited by 228
Transformers for modeling physical systems
Geneva, N., & Zabaras, N. J. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.11.022 · Cited by 228
A Multilayer Convolutional Encoder-Decoder Neural Network for Grammatical Error Correction
Chollampatt, S., & Ng, H. T. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12069 · Cited by 227
When deep learning met code search
Cambronero, J., Li, H., Kim, S., Sen, K., & Chandra, S. (2019) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3338906.3340458 · Cited by 227
Adversarial text-to-image synthesis: A review
Frolov, S., Hinz, T., Raue, F., Hees, J., & Dengel, A. R. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.07.019 · Cited by 228
Bidirectional Recurrent Convolutional Neural Network for Relation Classification
Cai, R., Zhang, X., & Wang, H. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1072 · Cited by 226
Camacho-Collados, J., & Pilehvar, M. T. (2018) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/w18-5406 · Cited by 226
Dynamic Network Embedding : An Extended Approach for Skip-gram based Network Embedding
Du, L., Wang, Y., Song, G., Lu, Z., & Wang, J. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/288 · Cited by 226
Preserving Semantic Relations for Zero-Shot Learning
Biswas, S., & Annadani, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00793 · Cited by 225
Transferable Contrastive Network for Generalized Zero-Shot Learning
Jiang, H., Wang, R., Shan, S., & Chen, X. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00986 · Cited by 225
Transductive Multi-view Embedding for Zero-Shot Recognition and Annotation
Fu, Y., Hospedales, T. M., Xiang, T., Fu, Z., & Gong, S. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10605-2_38 · Cited by 225
A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face
Lian, H., Lu, C., Li, S., Zhao, Y., Tang, C., & Zong, Y. (2023) · Entropy · doi:10.3390/e25101440 · Cited by 224
When Are Tree Structures Necessary for Deep Learning of Representations?
Li, J., Luong, M.-T., Jurafsky, D., & Hovy, E. H. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1278 · Cited by 224
An analysis of the user occupational class through Twitter content
Preoțiuc-Pietro, D., Lampos, V., & Αλέτρας, Ν. (2015) · doi:10.3115/v1/p15-1169 · Cited by 224
An Attention-Based Spatiotemporal LSTM Network for Next POI Recommendation
Huang, L., Ma, Y., Wang, S., & Liu, Y. (2019) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2019.2918310 · Cited by 224
Improving Hypernymy Detection with an Integrated Path-based and Distributional Method
Shwartz, V., Goldberg, Y., & Dagan, I. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1226 · Cited by 224
Lu, G., Ju, X., Chen, X., Pei, W., & Cai, Z. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2024.112031 · Cited by 224
Vision-language navigation with self-supervised auxiliary reasoning tasks
Zhu, F., Zhu, Y., Chang, X., & Liang, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01003 · Cited by 223
SemEval-2015 Task 13: Multilingual All-Words Sense Disambiguation and Entity Linking
Moro, A., & Roberto Navigli, A. (2015) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s15-2049 · Cited by 222
Context-Aware Sentence/Passage Term Importance Estimation For First Stage RetrievalPreprint
Dai, Z., & Callan, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.10687 · Cited by 222
Ranking Sentences for Extractive Summarization with Reinforcement Learning
Narayan, S., Cohen, S. B., & Lapata, M. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1158 · Cited by 221
Dai, Q., Li, Q., Tang, J., & Wang, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11865 · Cited by 222
CLUB: A Contrastive Log-ratio Upper Bound of Mutual InformationPreprint
Cheng, P., Hao, W., Dai, S., Liu, J., Gan, Z., & Carin, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.12013 · Cited by 221
Metadata
- Authors
- Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2013
- Volume
- 26
- Pages
- 3111-3119
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1310.4546
- OpenAlex
- W2153579005
- Cited by
- 24,533
- References
- 19
- Citations by year
- 2026: 114 · 2025: 872 · 2024: 1388 · 2023: 1965 · 2022: 2239 · 2021: 3514 · 2020: 3787 · 2019: 3870 · 2018: 2785 · 2017: 1949 · 2016: 1194 · 2015: 658 · 2014: 176 · 2013: 7
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- TIB Data Manager
- neural information processing systems
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- distributed word representations, skip-gram model, phrase representation, negative sampling, frequent terms, idioms, word order, training speed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
