The DOI matches its DataCite record; 63 of the 72 references it cites were found in a registry or an index.
Learned in Translation: Contextualized Word Vectors
Open accessAbstract
Computer vision has benefited from initializing multiple deep layers with weights pretrained on large supervised training sets like ImageNet. Natural language processing (NLP) typically sees initialization of only the lowest layer of deep models with pretrained word vectors. In this paper, we use a deep LSTM encoder from an attentional sequence-to-sequence model trained for machine translation (MT) to contextualize word vectors. We show that adding these context vectors (CoVe) improves performance over using only unsupervised word and character vectors on a wide variety of common NLP tasks: sentiment analysis (SST, IMDb), question classification (TREC), entailment (SNLI), and question answering (SQuAD). For fine-grained sentiment analysis and entailment, CoVe improves performance of our baseline models to the state of the art.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The increase of 4.7% with ELMo is also significantly larger then the 1.8% improvement from adding CoVe to a baseline model (McCann et al., 2017).”
From Deep Contextualized Word Representations (2018) · cites this paper as McCann et al., 2017
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“For tasks where direct comparisons are possible, ELMo outperforms CoVe (McCann et al., 2017), which computes contextualized representations using a neural machine translation encoder.”
From Deep Contextualized Word Representations (2018) · cites this paper as McCann et al., 2017
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 2×
“[2016] propose to combine text representations with visual representations extracted by a pretrained residual network [He et al., 2016].”
BackgroundMethodVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148 · cited 1×
“Qi et al. [2016] propose a CNN-based object tracking framework, which uses hierarchical features from a pretrained CNN (VGG-19 by Simonyan and Zisserman [2014]).”
MethodImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 1×
“In computer vision, convolutional neural networks (CNNs) pretrained on ImageNet [Krizhevsky et al., 2012, Deng et al., 2009] have become the de facto initialization for more complex and deeper models.”
MethodSelf-citationGlove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071 · cited 14×
“The MT-LSTM is used to compute a sequence of hidden states h = MT-LSTM ( GloVe ( w x )) .”
BackgroundMethodInfluentialSelf-citationRich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684 · cited 1×
“Girshick et al. [2014] show that using a pretrained CNN to extract features from region proposals improves object detection and semantic segmentation models.”
MethodBatch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818 · cited 1×
“…representation for all inputs. x pool = max( X | y ); mean( X | y ); min( X | y ); x self (15) We feed this joined representation through a three-layer, batch-normalized [Ioffe and Szegedy, 2015] maxout network [Goodfellow et al., 2013] to produce a probability distribution over possible classes.”
MethodEfficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766 · cited 1×
“Sutskever et al. [2014] investigate sequence-to-sequence models that consist of a neural network encoder and decoder for machine translation.”
BackgroundNeural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213 · cited 1×
“Bahdanau et al. [2015] propose the augmenting sequence to sequence models with an attention mechanism that gives the decoder access to the encoder representations of the input sequence at each step of sequence generation.”
Background
Research works printed but not linked: 6
- Q. Chen, X.-D. Zhu, Z.-H. Ling, S. Wei, and H. Jiang. Enhancing and combining sequential and tree LSTM for natural language inference. CoRR , abs/1609.06038, 2016. · arXiv
- A. L. Maas, R. E. Daly, P. T. Pham, D. Huang, A. Y. Ng, and C. Potts. Learning word vectors for sentiment analysis. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies , pages 142-150, Portland, Oregon, USA, June 2011. Association for Computational Linguistics. URL http://www.aclweb.org/anthology/P11-1015 .
- H. T. Madabushi and M. Lee. High accuracy rule-based question classification using question syntax and semantics. In COLING , 2016.
- V. Nair and G. E. Hinton. Rectified linear units improve restricted Boltzmann machines. In ICML , 2010.
- L. Sha, B. Chang, Z. Sui, and S. Li. Reading and thinking: Re-read LSTM unit for textual entailment recognition. In COLING , 2016.
- Y. Yu, W. Zhang, K. Hasan, M. Yu, B. Xiang, and B. Zhou. End-to-end reading comprehension with dynamic answer chunk ranking. ICLR , 2017.
Cited by
Sorted by citations
Items 401–500 of 571
Overview of Deep Learning Methods for Sentiment Analysis
Zhao, Y. (2023) · Advances in Engineering Technology Research · doi:10.56028/aetr.5.1.367.2023 · Cited by 4
Text Representation for Sentiment Analysis: From Static to Dynamic
Gavali, P. M., & Shiragave, S. K. (2023) · International Conference on Smart Data Intelligence (ICSMDI) · doi:10.1109/icsmdi57622.2023.00025 · Cited by 6
Jùnior, G. H. K., & Duque, C. G. (2022) · RDBCI Revista Digital de Biblioteconomia e Ciência da Informação · doi:10.20396/rdbci.v21i00.8671396 · Cited by 8
Automatic Noise Generation and Reduction for Text Classification
Chen, H., Sun, Y., Zhang, M., & Zhang, M. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3325135 · Cited by 5
Effective Tool Augmented Multi-Agent Framework for Data Analysis
Zhang, X., Mao, Z., Chen, Z., & Gao, S. (2024) · Data Intelligence · doi:10.3724/2096-7004.di.2024.0013 · Cited by 7
Kingsoft’s Neural Machine Translation System for WMT19
Guo, X., Liu, C., Li, X., Wang, Y., Li, G., Wang, F., Xu, Z., Yang, L., Ma, L., & Li, C. (2019) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w19-5317 · Cited by 4
Unsupervised Compositional Translation of Multiword Expressions
Gamallo, P., & García, M. (2019) · doi:10.18653/v1/w19-5106 · Cited by 4
MIHNet: Combining N-gram, Sequential and Global Information for Text Classification
Song, Y. (2020) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1453/1/012156 · Cited by 4
The Rediscovery Hypothesis: Language Models Need to Meet Linguistics
Nikoulina, V., Tezekbayev, M., Kozhakhmet, N., Babazhanova, M., Gallé, M., & Assylbekov, Z. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12788 · Cited by 4
Auxiliary Loss for BERT-Based Paragraph Segmentation
Binggang, Z. H. U. O., Murata, M., & Ma, Q. (2022) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2022edp7083 · Cited by 5
Multi-passage extraction-based machine reading comprehension based on verification sorting
Dong, R., Wang, X., Dong, L., & Zhang, Z. (2023) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2023.108576 · Cited by 4
Learning sentiment analysis with word embeddings
Marreddy, M., & Mamidi, R. (2023) · Elsevier eBooks · doi:10.1016/b978-0-32-390535-0.00011-2 · Cited by 4
Lau, E. (2024) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2024.61039 · Cited by 4
Cyclegen: Cyclic consistency based product review generator from attributes
Sharma, V., Sharma, H., Bishnu, A., & Patel, L. (2018) · International Conference on Natural Language Generation · doi:10.18653/v1/w18-6552 · Cited by 5
Fully Contextualized Biomedical NER
Gupta, A., Goyal, P., Sarkar, S., et al. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-15719-7_15 · Cited by 4
CoKE : Word Sense Induction Using Contextualized Knowledge Embeddings.
Ramprasad, S., & Maddox, J. (2019) · AAAI Spring Symposium Combining Machine Learning with Knowledge Engineering · Cited by 4
Chakraborty, R., Elhence, A., & Arora, K. (2019) · International conference Recent advances in natural language processing · doi:10.26615/978-954-452-056-4_022 · Cited by 4
Sentiment Analysis with Contextual Embeddings and Self-attention
Biesialska, K., Biesialska, M., & Rybiński, H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59491-6_4 · Cited by 5
Xu, C., Wang, H., Wu, S., & Lin, Z. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115182 · Cited by 5
Basirat, A., Allassonnière‐Tang, M., & Berdičevskis, A. (2021) · Linguistics Vanguard · doi:10.1515/lingvan-2020-0048 · Cited by 5
Multi-Level Head-Wise Match and Aggregation in Transformer for Textual Sequence Matching
Wang, S., Lan, Y., Tay, Y., Jiang, J., & Liu, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6458 · Cited by 5
Suffix Bidirectional Long Short-Term Memory.Preprint
Brahma, S. (2018) · arXiv (Cornell University) · Cited by 4
Making Presentation Math Computable
Greiner-Petter, A. (2022) · Springer eBooks · doi:10.1007/978-3-658-40473-4 · Cited by 5
Intent detection and slot filling for Persian: Cross-lingual training for low-resource languages
Zadkamali, R., Momtazi, S., & Zeinali, H. (2024) · Natural language processing. · doi:10.1017/nlp.2024.17 · Cited by 3
A context-enhanced neural network model for biomedical event trigger detection
Wang, Z., Ren, Y., Peng, Q., & Ji, D. (2024) · Information Sciences · doi:10.1016/j.ins.2024.121625 · Cited by 3
Universally domain adaptive algorithm for sentiment classification using transfer learning approach
Krishna, B. V., Pandey, A. K., & Kumar, A. P. S. (2021) · International Journal of Systems Assurance Engineering and Management · doi:10.1007/s13198-021-01113-y · Cited by 3
Explaining Errors in Machine Translation with Absolute Gradient Ensembles
Eksi, M., Gelbing, E., Stieber, J., & Vu, C. V. (2021) · Workshop on Evaluation and Comparison of NLP Systems (Eval4NLP) · doi:10.18653/v1/2021.eval4nlp-1.23 · Cited by 4
Medication Error Detection Using Contextual Language Models
Jiang, Y., & Poellabauer, C. (2022) · Studies in computational intelligence · doi:10.1007/978-3-031-14771-5_7 · Cited by 4
Jùnior, G. H. K., & Duque, C. G. (2024) · SAGE Open · doi:10.1177/21582440231177042 · Cited by 4
Encouraging Paragraph Embeddings to Remember Sentence Identity Improves Classification
Vu, T., & Iyyer, M. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1638 · Cited by 3
Comparing Knowledge-Intensive and Data-Intensive Models for English Resource Semantic Parsing
Cao, J., Lin, Z. J., Sun, W., & Wan, X. (2021) · Computational Linguistics · doi:10.1162/coli_a_00395 · Cited by 5
Unsupervised Learning of Explainable Parse Trees for Improved Generalisation
Sahay, A., Maheshwari, A., Kumar, R., Ramakrishnan, G., Hanawal, M. K., & Arya, K. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533448 · Cited by 3
Cross-lingual Transfer for Text Classification with Dictionary-based Heterogeneous Graph
Chairatanakul, N., Sriwatanasakdi, N., Charoenphakdee, N., Liu, X., & Murata, T. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.130 · Cited by 3
Duan, R., Yang, X., Wang, Q., & Zhao, Y. (2021) · 2021 2nd International Conference on Electronics, Communications and Information Technology (CECIT) · doi:10.1109/cecit53797.2021.00028 · Cited by 3
Sliding-Bert: Striding Towards Conversational Machine Comprehension in Long Contex
Zhang, L., Wang, W., Yu, K., Huang, J., Lyu, Q., Xue, H., & Hetang, C. (2023) · Advances in Artificial Intelligence and Machine Learning · doi:10.54364/aaiml.2023.1178 · Cited by 4
Learning to Embed Sentences Using Attentive Recursive Trees
Shi, J., Hou, L., Li, J., Liu, Z., & Zhang, H. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016991 · Cited by 3
Using Pre-trained Deeply Contextual Model BERT for Russian Named Entity Recognition
Mukhin, E. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-39575-9_17 · Cited by 3
Adaptable Conversational Machines
Lubis, N., Heck, M. C., van Niekerk, C., & Gašić, M. (2020) · AI Magazine · doi:10.1609/aimag.v41i3.5322 · Cited by 3
Basic Methodologies Used in NLP Area
Wang, Y. (2020) · IEEE International Conference on Automation, Electronics and Electrical Engineering (AUTEEE) · doi:10.1109/auteee50969.2020.9315550 · Cited by 3
Incorporating Concreteness in Multi-Modal Language Models with Curriculum Learning
Sezerer, E., & Tekır, S. (2021) · Applied Sciences · doi:10.3390/app11178241 · Cited by 5
BioHanBERT: A Hanzi-aware Pre-trained Language Model for Chinese Biomedical Text Mining
Wang, X., Xiong, Y., Niu, H., Yue, J., Zhu, Y., & Yu, P. S. (2021) · Proceedings · doi:10.1109/icdm51629.2021.00181 · Cited by 3
Robust Word Vectors: Context-Informed Embeddings for Noisy Texts
Malykh, V., Khakhulin, T., & Logacheva, V. (2023) · Journal of Mathematical Sciences · doi:10.1007/s10958-023-06523-w · Cited by 3
Chao, W., Hu, H., & Sha, F. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.07121 · Cited by 3
Multi-view Sentence Representation LearningPreprint
Tang, S., & de Sa, V. R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.07443 · Cited by 3
Learning Robust, Transferable Sentence Representations for Text ClassificationPreprint
Ahmad, W. U., Bai, X., Peng, N., & Chang, K.-W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.00681 · Cited by 3
Semi-supervised Thai sentence segmentation using local and distant word representations
Saetia, C. (2020) · Chula Digiverse · doi:10.58837/chula.the.2020.136 · Cited by 3
Xu, L., Yang, B., Lv, X., Bi, T., Liu, D., & Zhang, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.01992 · Cited by 6
Learning Sequence Representations by Non-local Recurrent Neural Memory
Pei, W., Feng, X., Fu, C., Cao, Q., Lu, G., & Tai, Y. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01648-y · Cited by 2
Contextualized Word Representations for Self-Attention Network
Essam, M., Eldawlatly, S., & Abbas, H. M. (2018) · International Conference on Computer Engineering and Systems · doi:10.1109/icces.2018.8639446 · Cited by 2
Exploiting Invertible Decoders for Unsupervised Sentence Representation Learning
Tang, S., & de Sa, V. R. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1397 · Cited by 2
Cañas, A. R. (2023) · Cuaderno activa · doi:10.53995/20278101.987 · Cited by 2
Improving Scientific Literature Classification: A Parameter-Efficient Transformer-Based Approach
Ahanger, M. M., & Wani, M. A. (2023) · International journal of electrical and computer engineering systems · doi:10.32985/ijeces.14.10.4 · Cited by 2
Large Language Models for Transforming Categorical Data to Interpretable Feature Vectors
Huesmann, K., & Linsen, L. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3460652 · Cited by 3
Tahery, S., & Farzi, S. (2025) · IEEE Access · doi:10.1109/access.2025.3574115 · Cited by 3
Connecting Supervised and Unsupervised Sentence Embeddings
Levi, G. (2018) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/w18-3010 · Cited by 1
Natural Language Inference with Definition Embedding Considering Context On the Fly
Nishida, K., Nishida, K., Asano, H., et al. (2018) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/w18-3007 · Cited by 2
Robust Text Classifier on Test-Time Budgets
Parvez, M. R., Bolukbasi, T., Chang, K.-W., & Saligrama, V. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1108 · Cited by 2
InFoBERT: Zero-Shot Approach to Natural Language Understanding Using ContextualizedWord Embedding
Huawei Noah’s Ark lab, M., Burnyshev, P., Bout, A., Huawei Noah’s Ark lab, M., Malykh, V., Huawei Noah’s Ark lab, M., Piontkovskaya, I., & Huawei Noah’s Ark lab, M. (2021) · International conference Recent advances in natural language processing · doi:10.26615/978-954-452-072-4_025 · Cited by 2
He, M., & Garner, P. N. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.291 · Cited by 2
Aligning Word Embeddings from BERT to Vocabulary-Free Representations
Rodríguez, A., Sooksatra, K., Rivas, P., Quevedo, E., Turek, J. S., Bichler, G., Cerny, T., Giddens, L., & Petter, S. (2023) · Congress in Computer Science, Computer Engineering, and Applied Computing (CSCE) · doi:10.1109/csce60160.2023.00023 · Cited by 2
Factoid Question Answering with Distant Supervision
Zhang, H., Liang, X., Xu, G.-L., Fu, K., Li, F., & Huang, T.-L. (2018) · Entropy · doi:10.3390/e20060439 · Cited by 1
Semantic Gated Network for Efficient News Representation
Bu, X., Li, B., Wang, Y., Zhu, J., Qian, X., & Zhao, M. (2020) · International Conference on Multimedia Retrieval · doi:10.1145/3372278.3390719 · Cited by 2
Towards syntax-aware token embeddings
Popa, D. N., Pérez, J., Henderson, J., & Gaussier, É. (2020) · Natural Language Engineering · doi:10.1017/s1351324920000297 · Cited by 2
Language modeling and bidirectional coders representations: an overview of key technologies
Kachkou, D. I. (2021) · Informatics · doi:10.37661/1816-0301-2020-17-4-61-72 · Cited by 2
Network embeddings from distributional thesauri for improving static word representations
Jana, A., Haldar, S., & Goyal, P. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115868 · Cited by 3
SSIN: Sentence Semantic Interaction Network for Multi-Choice Reading Comprehension
Xu, X., Tohti, T., & Hamdulla, A. (2022) · IEEE Access · doi:10.1109/access.2022.3217479 · Cited by 2
Liao, J., Shi, Y., & Xu, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3219838 · Cited by 5
Gessler, L., & Schneider, N. (2023) · Conference on Computational Natural Language Learning · doi:10.18653/v1/2023.conll-1.17 · Cited by 5
Unsupervised question-retrieval approach based on topic keywords filtering and multi-task learning
Aiguo, S., Zhu, X., Danner, M., & Rätsch, M. (2024) · Computer Speech & Language · doi:10.1016/j.csl.2024.101644 · Cited by 4
Shahriar, M. H., Kamal, A. H., & Kayem, A. V. D. M. (2024) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-031-57916-5_13 · Cited by 2
Towards Language Agnostic Universal Representations
Aghajanyan, A., Song, X., & Tiwary, S. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1395 · Cited by 2
Label Distribution Augmented Maximum Likelihood Estimation for Reading Comprehension
Su, L., Guo, J., Fan, Y., Lan, Y., & Cheng, X. (2020) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3336191.3371835 · Cited by 2
Han, Y., Qiao, L., Zheng, J., Wu, H., Li, D., & Liao, X. (2021) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.2000347 · Cited by 3
On the differences between BERT and MT encoder spaces and how to address them in translation tasks
Vázquez, R., Çelikkanat, H., Creutz, M., & Tiedemann, J. (2021) · doi:10.18653/v1/2021.acl-srw.35 · Cited by 2
Guo, Y., Shou, L., Pei, J., Gong, M., Xu, M., Wu, Z., & Jiang, D. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.259 · Cited by 2
AWE: Asymmetric Word Embedding for Textual EntailmentPreprint
Ma, T., Wu, C.-M., Xiao, C., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.04047 · Cited by 2
Improving Sentence Representations with Consensus MaximisationPreprint
Tang, S., & de Sa, V. R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.01064 · Cited by 2
Cost Estimation for Configurable Model-Driven SoC Designs Using Machine Learning
Servadei, L., Mosca, E., Devarajegowda, K., et al. (2020) · doi:10.1145/3386263.3406950 · Cited by 1
Reference Free Domain Adaptation for Translation of Noisy Questions with Question Specific Rewards
Gain, B., Appicharla, R., Chennabasavaraj, S., Garera, N., Ekbal, A., & Chelliah, M. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.16 · Cited by 1
Yousif, S. (2022) · Association of Collegiate Schools of Architecture Annual Meeting (ACSA) · doi:10.35483/acsa.am.110.32 · Cited by 1
Riza Ayisha, P., & Mathew, G. (2024) · doi:10.1109/ictest60614.2024.10576168 · Cited by 1
Wang, L., & Law, K. L. E. (2025) · Computer · doi:10.1109/mc.2024.3423378 · Cited by 1
Zhang, Y., & Shen, B. (2025) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2025.110567 · Cited by 1
Prichard, C., & Atkins, A. (2025) · System · doi:10.1016/j.system.2025.103822 · Cited by 3
Xia, J. (2018) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s18-1178 · Cited by 1
Context and Embeddings in Language Modelling - an Exploration.
Nitsche, M., & Tropmann-Frick, M. (2018) · DAMDID/RCDL · Cited by 1
Improving Universal Language Model Fine-Tuning using Attention Mechanism
Santos, F., Ponce-Guevara, K. L., Macêdo, D., & Zanchettin, C. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852398 · Cited by 1
Embeddings and Convolution, Is That the Best You can Do with Sentiment Features?
Feng, A., Chen, Z., Zhou, S., & Wu, X. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852160 · Cited by 1
From Monolingual to Multilingual FAQ Assistant using Multilingual Co-training
Patidar, M., Kumari, S., Patwardhan, M. S., Karande, S. S., Agarwal, P., Vig, L., & Shroff, G. M. (2019) · Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo) · doi:10.18653/v1/d19-6113 · Cited by 1
Multi-Task Deep Neural Networks for Multi-Document Reading Comprehension
Liu, C., Liu, Z., Lin, W., & Zhao, J. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533940 · Cited by 1
AdaptText: A Novel Framework for Domain-Independent Automated Sinhala Text Classification
Kodithuwakku, Y., & Hettiarachchi, S. (2021) · International Conference on Information and Automation for Sustainability (ICIAfS) · doi:10.1109/iciafs52090.2021.9605861 · Cited by 1
Spell Check Programme to Fix Mistakes in a Language
Mathur, A., & Vanitha, K. (2022) · International Conference on System Modeling & Advancement in Research Trends (SMART) · doi:10.1109/smart55829.2022.10047325 · Cited by 1
Morphologically-Aware Vocabulary Reduction of Word Embeddings
Chia, C. C., Tkachenko, M., & Lauw, H. W. (2022) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wi-iat55865.2022.00018 · Cited by 1
Comparing Methods for Mitigating Gender Bias in Word Embedding
Ronchieri, E., & Biagi, C. (2023) · Proceedings of the ... Annual Hawaii International Conference on System Sciences/Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.24251/hicss.2023.091 · Cited by 1
A Fast Algorithm to Find Computer-aided Translation Tools View in Native XML Corpus Semantic Cache
Xing, H., & Xu, L. (2023) · International Conference on Advances in Electrical Engineering and Computer Applications (AEECA) · doi:10.1109/aeeca59734.2023.00076 · Cited by 1
Future of Natural Language Processing (Human Like Conversation)
Jayakumar, A., John, H., Nair, A. R., Varghese, T., & Thomas, R. (2024) · International Research Journal on Advanced Engineering and Management (IRJAEM) · doi:10.47392/irjaem.2024.0538 · Cited by 1
Rivera-Zavala, R. M., & Martı́nez, P. (2020) · IberLEF@SEPLN · Cited by 1
Squashed Shifted PMI Matrix: Bridging Word Embeddings and Hyperbolic Spaces
Assylbekov, Z., & Jangeldin, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-64984-5_26
Gupta, P., & Raman, S. (2021) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-981-16-6285-0_60 · Cited by 1
Beyond the Polarities: Sentiment Analysis of French Restaurant Reviews Using BERT-based Models
Kang, H. J., & Eshkol-Taravella, I. (2021) · International Conference on Behavioral, Economic, and Socio-Cultural Computing · doi:10.1109/besc53957.2021.9635309 · Cited by 1
Metadata
- Authors
- McCann, B., Bradbury, J., Xiong, C., & Socher, R.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2017
- Volume
- 30
- Pages
- 6297-6308
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1708.00107
- OpenAlex
- W2740711318
- Semantic Scholar
- bc8fa64625d9189f5801837e7b133e7fe3c581f7
- Cited by
- 572
- References
- 72
- Citations by year
- 2025: 14 · 2024: 39 · 2023: 65 · 2022: 57 · 2021: 98 · 2020: 94 · 2019: 122 · 2018: 80 · 2017: 3
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- coves, pre-trained word embeddings, machine translation, LSTM encoder, sentiment analysis, logical consequence, question answering, question classification, transfer learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
