The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Meteor: an automatic metric for MT evaluation with high levels of correlation with human judgments
Abstract
Meteor is an automatic metric for Machine Translation evaluation which has been demonstrated to have high levels of correlation with human judgments of translation quality, significantly outperforming the more commonly used Bleu metric. It is one of several automatic metrics used in this year's shared task within the ACL WMT-07 workshop. This paper recaps the technical details underlying the metric and describes recent improvements in the metric. The latest release includes improved metric parameters and extends the metric to support evaluation of MT output in Spanish, French and German, in addition to English.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Popular evaluation methods for natural language generation such as BLEU-460, ROUGE-L61, and METEOR62 primarily compare n-grams between two documents and may not effectively capture semantic similarities.”
From Generating dermatopathology reports from gigapixel whole slide images with HistoGPT (2025) · cites this paper as [62]
In the citing paper
“BLEU computes n-gram overlap and is representative for the family of text overlap-based natural language generation metrics such as CIDEr,31 METEOR,30 and ROUGE.32”
From Evaluating progress in automatic chest X-ray radiology report generation (2023) · cites this paper as [30]
Citations
Cites
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
(2005) · Cited by 4,152
Self-citationMinimum error rate training in statistical machine translation
Och, F. J. (2003) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1075096.1075117 · Cited by 2,728
A Study of Translation Edit Rate with Targeted Human Annotation
Snover, M., Dorr, B. J., Schwartz, R. M., Micciulla, L., & Makhoul, J. I. (2006) · Cited by 2,380
Confidence estimation for machine translation
Blatz, J., Fitzgerald, E., Foster, G. F., Gandrabur, S., Goutte, C., Kulesza, A., Sanchís, A., & Ueffing, N. (2004) · International Conference on Computational Linguistics · doi:10.3115/1220355.1220401 · Cited by 368
Lattice-based minimum error rate training for statistical machine translation
Macherey, W., Och, F. J., Thayer, I., & Uszkoreit, J. (2008) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1613715.1613807 · Cited by 347
Precision and recall of machine translation
Melamed, I. D., Green, R., & Turian, J. P. (2003) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/1073483.1073504 · Cited by 228
The Significance of Recall in Automatic Metrics for MT Evaluation
Lavie, A., Sagae, K., & Jayaraman, S. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30194-3_16 · Cited by 123
Self-citationCDER: Efficient MT Evaluation Using Block Movements.
Leusch, G., Ueffing, N., & Ney, H. (2006) · RWTH Publications (RWTH Aachen) · Cited by 109
(2024) · ACM eBooks · doi:10.1145/3674127 · Cited by 86
Flagged first, then by citations
Cited by
Sorted by citations
Items 201–300 of 1,003
Concept-Aware Video Captioning: Describing Videos With Effective Prior Information
Yang, B., Cao, M., & Zou, Y. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3307969 · Cited by 39
Pre-training on high-resource speech recognition improves low-resource speech-to-text translation
Bansal, S., Kamper, H., Livescu, K., Lopez, A., & Goldwater, S. J. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1006 · Cited by 58
Zeng, X., Wen, L., Yang, X., & Ji, C. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105700 · Cited by 41
Entity Slot Filling for Visual Captioning
Bin, Y., Ding, Y., Peng, B., Peng, L., Yang, Y., & Chua, T. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3063297 · Cited by 39
Evaluating MT Adequacy without Reference Translations
Mehdad, Y., Negri, M., & Federico, M. (2012) · Cited by 39
Herbig, N., Pal, S., Vela, M., Krüger, A., & van Genabith, J. (2019) · Machine Translation · doi:10.1007/s10590-019-09227-8 · Cited by 38
Divergent-convergent attention for image captioning
Ji, J., Du, Z., & Zhang, X. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.107928 · Cited by 38
The IWSLT 2011 Evaluation Campaign on Automatic Talk Translation
Federico, M., Stüker, S., Bentivogli, L., Paul, M. D., Cettolo, M., Herrmann, T., Niehues, J., & Moretti, G. (2012) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/5ms6auiwwnq2 · Cited by 37
Show and Tell More: Topic-Oriented Multi-Sentence Image Captioning
Mao, Y., Zhou, C., Wang, X., & Li, R. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/592 · Cited by 37
LIUM-CVC Submissions for WMT18 Multimodal Translation Task
Çağlayan, O., Bardet, A., Bougares, F., Barrault, L., Wang, K., Masana, M., Herranz, L., & van de Weijer, J. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6438 · Cited by 37
Answer-driven Deep Question Generation based on Reinforcement Learning
Wang, L., Xu, Z., Lin, Z., Zheng, H.-T., & Shen, Y. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.452 · Cited by 38
Generating dermatopathology reports from gigapixel whole slide images with HistoGPT
Tran, M., Schmidle, P., Guo, R. R., Wagner, S. J., Koch, V., Lupperger, V., Novotny, B., Murphree, D. H., Hardway, H. D., D’Amato, M., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-60014-x · Cited by 36
GVA: guided visual attention approach for automatic image caption generation
Hossen, M. B., Ye, Z., Abdussalam, A., & Hossain, M. I. (2024) · Multimedia Systems · doi:10.1007/s00530-023-01249-w · Cited by 36
CNX-B2: A Novel CNN-Transformer Approach For Chest X-Ray Medical Report Generation
Alqahtani, F. F., Mohsan, M. M., Alshamrani, K. A., Zeb, J., Alhamami, S. A., & Alqarni, D. (2024) · IEEE Access · doi:10.1109/access.2024.3367360 · Cited by 36
Hypertagging: Supertagging for Surface Realization with CCG
Espinosa, D., White, M., & Mehay, D. N. (2008) · Cited by 36
Video Description Generation using Audio and Visual Cues
Jin, Q., & Liang, J. (2016) · International Conference on Multimedia Retrieval · doi:10.1145/2911996.2912043 · Cited by 36
Evaluation of Arabic Machine Translation System Based on the Universal Networking Language
Adly, N., & Alansary, S. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-12550-8_20 · Cited by 36
HTLM: Hyper-Text Pre-Training and Prompting of Language Models
Aghajanyan, A., Okhonko, D., Lewis, M., Joshi, M., Xu, H., Ghosh, G., & Zettlemoyer, L. (2021) · arXiv · doi:10.48550/arxiv.2107.06955 · Cited by 35
Prior Knowledge-Guided Transformer for Remote Sensing Image Captioning
Meng, L., Wang, J., Yang, Y., & Xiao, L. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3328181 · Cited by 38
Better Evaluation Metrics Lead to Better Machine Translation
Liu, C., Dahlmeier, D., & Ng, H. T. (2011) · Cited by 35
ViGGO: A Video Game Corpus for Data-To-Text Generation in Open-Domain Conversation
Juraska, J., Bowden, K. K., & Walker, M. A. (2019) · International Conference on Natural Language Generation · doi:10.18653/v1/w19-8623 · Cited by 35
Exploration and exploitation of multilingual data for statistical machine translation
Carter, S. (2012) · UvA-DARE (University of Amsterdam) · Cited by 35
Dialog System Technology Challenge 7Preprint
Yoshino, K., Hori, C., Pérez, J., D’Haro, L. F., Polymenakos, L., Gunasekara, C., Lasecki, W. S., Kummerfeld, J. K., Galley, M., Brockett, C., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.03461 · Cited by 35
Intent-Based Infrastructure and Service Orchestration Using Agentic-AI
Brodimas, D., Birbas, A. N., Kapolos, D., & Denazis, S. (2025) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2025.3600706 · Cited by 34
German Compounds in Factored Statistical Machine Translation
Stymne, S. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-85287-2_44 · Cited by 34
TESLA: Translation Evaluation of Sentences with Linear-Programming-Based Analysis
Liu, C., Dahlmeier, D., & Ng, H. T. (2010) · Cited by 34
Performance of an online translation tool when applied to patient educational material
Khanna, R. R., Karliner, L., Eck, M., Vittinghoff, E., Koenig, C. J., & Fang, M. C. (2011) · Journal of Hospital Medicine · doi:10.1002/jhm.898 · Cited by 34
SoccerNet 2023 challenges results
Cioppa, A., Giancola, S., Somers, V., Magera, F., Zhou, X., Mkhallati, H., Deliège, A., Held, J., Hinojosa, C. A., Mansourian, A. M., et al. (2024) · Sports Engineering · doi:10.1007/s12283-024-00466-4 · Cited by 33
CyberRAG: An agentic RAG cyber attack classification and reporting tool
Blefari, F., Cosentino, C., Pironti, F. A., Furfaro, A., & Marozzo, F. (2025) · Future Generation Computer Systems · doi:10.1016/j.future.2025.108186 · Cited by 42
Appraise: An Open-Source Toolkit for Manual Phrase-Based Evaluation of Translations
Federmann, C. (2010) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/5aj2568ubi3f · Cited by 33
Ferreira, T. C., Calixto, I., Wubben, S., & Krahmer, E. (2017) · International Conference on Natural Language Generation · doi:10.18653/v1/w17-3501 · Cited by 33
Deep Learning Image Captioning in Construction Management: A Feasibility Study
Xiao, B., Wang, Y., & Kang, S.-C. (2022) · Journal of Construction Engineering and Management · doi:10.1061/(asce)co.1943-7862.0002297 · Cited by 36
Multimodality information fusion for automated machine translation
Li, L., Tayir, T., Han, Y., Tao, X., & Velásquez, J. D. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.10.018 · Cited by 35
Language Independent Connectivity Strength Features for Phrase Pivot Statistical Machine Translation
Kholy, A. E., Habash, N. Y., Leusch, G., Matusov, E., & Sawaf, H. (2013) · Cited by 32
Aspect and Sentiment Aware Abstractive Review Summarization
Yang, M., Qu, Q., Shen, Y., Liu, Q., Zhao, W., & Zhu, J. (2018) · International Conference on Computational Linguistics · Cited by 32
Memory-Augmented Image Captioning
Fei, Z. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16220 · Cited by 32
Hybrid Reinforced Medical Report Generation With M-Linear Attention and Repetition Penalty
Xu, Z., Xu, W., Wang, R., Chen, J., Chang, Q., & Lukasiewicz, T. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3343391 · Cited by 34
Learning performance of a machine translation system
Turchi, M., Bie, T. D., & Cristianini, N. (2008) · Conference on Machine Translation (WMT) · doi:10.3115/1626394.1626399 · Cited by 32
An Encoder-Decoder Based Audio Captioning System With Transfer and Reinforcement LearningPreprint
Mei, X., Huang, Q., Liu, X., Chen, G., Wu, J., Wu, Y., Zhao, J., Li, S., Ko, T., Tang, H., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.02752 · Cited by 32
A Dual-Feature-Based Adaptive Shared Transformer Network for Image Captioning
Shi, Y., Xia, J., Zhou, M., & Cao, Z. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3353830 · Cited by 31
An End-to-End Generative Architecture for Paraphrase Generation
Yang, Q., Huo, Z., Shen, D., Cheng, Y., Wang, W., Wang, G., & Carin, L. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1309 · Cited by 30
Cross-Lingual Image Caption Generation Based on Visual Attention Model
Wang, B., Wang, C., Zhang, Q., Su, Y. M., Wang, Y., & Xu, Y. (2020) · IEEE Access · doi:10.1109/access.2020.2999568 · Cited by 32
Reference-based model using multimodal gated recurrent units for image captioning
Nogueira, T. D. C., Vinhal, C. D. N., da Cruz, G., & Ullmann, M. R. D. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09539-5 · Cited by 30
Assemble Foundation Models for Automatic Code Summarization
Gu, J., Salza, P., & Gall, H. C. (2022) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner53432.2022.00112 · Cited by 34
EduQG: A Multi-Format Multiple-Choice Dataset for the Educational Domain
Hadifar, A., Bitew, S. K., Deleu, J., Develder, C., & Demeester, T. (2023) · IEEE Access · doi:10.1109/access.2023.3248790 · Cited by 35
Statistical Machine Translation into a Morphologically Complex Language
Oflazer, K. (2008) · Springer eBooks · doi:10.1007/978-3-540-78135-6_32 · Cited by 30
Saers, M., & Wu, D. (2009) · Workshop on Syntax and Structure in Statistical Translation (SSST) · doi:10.3115/1626344.1626348 · Cited by 30
The RWTH Aachen Machine Translation System for WMT 2010
Huck, M., Wuebker, J., Schmidt, C., Freitag, M., Peitz, S., Stein, D. J., Dagnelies, A., Mansour, S., Leusch, G., & Ney, H. (2010) · Cited by 30
Fast Image Caption Generation with Position AlignmentPreprint
Fei, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.06365 · Cited by 30
Evaluation and Analysis of Large Language Models for Clinical Text Augmentation and Generation
Latif, A., & Kim, J. (2024) · IEEE Access · doi:10.1109/access.2024.3384496 · Cited by 32
A Dataset for Assessing Machine Translation Evaluation Metrics
Specia, L., Cancedda, N., & Dymetman, M. (2010) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2iotwi4xhg3p · Cited by 29
Understanding and Generating Ultrasound Image Description
Zeng, X., Liu, B., & Zhou, M. (2018) · Journal of Computer Science and Technology · doi:10.1007/s11390-018-1874-8 · Cited by 29
Ordinal and Attribute Aware Response Generation in a Multimodal Dialogue System
Chauhan, H., Firdaus, M., Ekbal, A., & Bhattacharyya, P. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1540 · Cited by 29
Towards Unique and Informative Captioning of Images
Wang, Z., Feng, B. T., Narasimhan, K., & Russakovsky, O. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58571-6_37 · Cited by 29
Boot-Strapping a WordNet Using Multiple Existing WordNets
Bond, F., Isahara, H., Kanzaki, K., & Uchimoto, K. (2008) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/4ejh98hk6235 · Cited by 29
Natural Language Generation in Dialogue using Lexicalized and Delexicalized DataPreprint
Sharma, S., He, J., Suleman, K., Schulz, H., & Bachman, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.03632 · Cited by 31
Chest X-Ray Report Generation Using Abnormality Guided Vision Language Model
Edirisinghe, D., Nimalsiri, W., Hennayake, M., Meedeniya, D., & Lim, G. (2025) · IEEE Access · doi:10.1109/access.2025.3606961 · Cited by 28
Evaluating LLM-based Agents for Multi-turn Conversations: A Survey
Guan, S., Wang, J., 渡辺, 将., Zhu, B., Lou, J., & Xiong, H. (2026) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3793671 · Cited by 71
Using a Grammar Checker for Evaluation and Postprocessing of Statistical Machine Translation
Stymne, S., & Ahrenberg, L. (2010) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/27f7h5poasoc · Cited by 28
Target Inference in Argument Conclusion Generation
Alshomary, M., Syed, S., Potthast, M., & Wachsmuth, H. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.399 · Cited by 31
INSET: Sentence Infilling with INter-SEntential Transformer
Huang, Y., Zhang, Y., Elachqar, O., & Cheng, Y. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.226 · Cited by 28
Partially Non-Autoregressive Image Captioning
Fei, Z. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16219 · Cited by 28
Farrús, M., Costa‐jussà, M. R., & Popović, M. (2011) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21674 · Cited by 28
AMBER: A Modified BLEU, Enhanced Ranking Metric
Chen, B., & Kühn, R. (2011) · NPARC · Cited by 28
Machine translation errors and the translation process: a study across different languages
Carl, M., & Báez, M. C. T. (2019) · The Journal of Specialised Translation · doi:10.26034/cm.jostrans.2019.179 · Cited by 28
On the Role of Scene Graphs in Image Captioning
Wang, D., Beck, D., & Cohn, T. (2019) · doi:10.18653/v1/d19-6405 · Cited by 28
BERT-hLSTMs: BERT and hierarchical LSTMs for visual storytelling
Su, J., Dai, Q., Guérin, F., & Zhou, M. (2020) · Computer Speech & Language · doi:10.1016/j.csl.2020.101169 · Cited by 28
Partially-Supervised Image CaptioningPreprint
Anderson, P., Gould, S. J., & Johnson, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.06004 · Cited by 29
MusCaps: Generating Captions for Music Audio
Manco, I., Benetos, E., Quinton, E., & Fazekas, G. (2021) · 2021 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533461 · Cited by 36
Statistical machine translation enhancements through linguistic levels
Costa‐jussà, M. R., & Farrús, M. (2014) · ACM Computing Surveys · doi:10.1145/2518130 · Cited by 27
Stack-VS: Stacked Visual-Semantic Attention for Image Caption Generation
Cheng, L., Wei, W., Mao, X.-L., Liu, Y., & Miao, C. (2020) · IEEE Access · doi:10.1109/access.2020.3018752 · Cited by 28
Exploring Question-Specific Rewards for Generating Deep Questions
Xie, Y., Pan, L., Wang, D., Kan, M., & Feng, Y. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.228 · Cited by 30
A Knowledge-Grounded Multimodal Search-Based Conversational Agent
Agarwal, S., Dušek, O., Konstas, I., & Rieser, V. (2018) · doi:10.18653/v1/w18-5709 · Cited by 27
Image captioning via semantic element embedding
Zhang, X., He, S., Song, X., Lau, R. W. H., Jiao, J., & Ye, Q. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.02.112 · Cited by 28
Machine translation system combination with flexible word ordering
Heafield, K., Hanneman, G., & Lavie, A. (2009) · Conference on Machine Translation (WMT) · doi:10.3115/1626431.1626442 · Cited by 27
Self-citationActive learning and crowdsourcing for machine translation in low resource scenarios
Carbonell, J., & Ambati, V. (2012) · Cited by 27
Attention-guided image captioning with adaptive global and local feature fusion
Zhong, X., Nie, G., Huang, W., Liu, W., Ma, B., & Lin, C. (2021) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2021.103138 · Cited by 26
Automatic Detection of Machine Translated Text and Translation Quality Estimation
Aharoni, R., Koppel, M., & Goldberg, Y. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-2048 · Cited by 26
Content Aware Source Code Change Description Generation
Loyola, P., Marrese-Taylor, E., Balazs, J., Matsuo, Y., & Satoh, F. (2018) · International Conference on Natural Language Generation · doi:10.18653/v1/w18-6513 · Cited by 26
Iterative Back Modification for Faster Image Captioning
Fei, Z. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413901 · Cited by 26
Engineering LLM Powered Multi-Agent Framework for Autonomous CloudOps
Parthasarathy, K., Vaidhyanathan, K., Dhar, R., Krishnamachari, V., Kakran, A., Akshathala, S., Arun, S., Karan, A., Muhammed, B., Dubey, S., et al. (2025) · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · doi:10.1109/cain66642.2025.00031 · Cited by 28
Dognin, P., Padhi, I., Melnyk, I., & Das, P. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.83 · Cited by 25
Chinivar, S., Roopa, M. S., Arunalatha, J. S., & Venugopal, K. R. (2022) · Entertainment Computing · doi:10.1016/j.entcom.2022.100544 · Cited by 25
REX: Reasoning-aware and Grounded Explanation
Chen, S., & Zhao, Q. G. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01514 · Cited by 27
Bundled Object Context for Referring Expressions
Li, X., & Jiang, S. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2811621 · Cited by 25
Pretrained Language Models for Dialogue Generation with Multiple Input Sources
Cao, Y. H., Bi, W., Fang, M., & Tao, D. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.81 · Cited by 27
PORT: a Precision-Order-Recall MT Evaluation Metric for Tuning
Chen, B., Kühn, R., & Larkin, S. (2012) · NPARC · Cited by 24
It’s not a Non-Issue: Negation as a Source of Error in Machine Translation
Hossain, M., Anastasopoulos, A., Blanco, E., & Palmer, A. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.345 · Cited by 24
CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenarios
Ye, Q., Yu, Z., Shao, R., Xie, X., Torr, P. H. S., & Cao, X. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72684-2_9 · Cited by 37
CASICT-DCU Participation in WMT2015 Metrics Task
Yu, H., Ma, Q., Wu, X., & Liu, Q. (2015) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w15-3053 · Cited by 24
Discourse Structure in Machine Translation Evaluation
Joty, S., Guzmán, F., Màrquez, L., & Nakov, P. (2017) · Computational Linguistics · doi:10.1162/coli_a_00298 · Cited by 24
Neural Clinical Paraphrase Generation with Attention
Hasan, S. A., Liu, B., Liu, J., Qadir, A., Lee, K., Datla, V. V., Prakash, A., & Farri, O. (2016) · International Conference on Computational Linguistics · Cited by 24
Yang, M., Qu, Q., Shen, Y., Lei, K., & Zhu, J. (2018) · Neural Computing and Applications · doi:10.1007/s00521-018-3825-2 · Cited by 25
Phrase based statistical machine translation : models, search, training
Zens, R., & Ney, H. (2008) · RWTH Publications (RWTH Aachen) · Cited by 24
Sun, Y., & Platoš, J. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123356 · Cited by 25
Results of the Multi-Domain Task-Completion Dialog Challenge
Li, J., Peng, B., Lee, S., Gao, J., Takanobu, R., Zhu, Q., Huang, M., Schulz, H., Atkinson, A., & Adada, M. (2020) · National Conference on Artificial Intelligence · Cited by 23
Chai, Z., & Wan, X. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.21 · Cited by 25
PASS: Perturb-and-Select Summarizer for Product Reviews
Oved, N., & Levy, R. (2021) · doi:10.18653/v1/2021.acl-long.30 · Cited by 24
A visual persistence model for image captioning
Wang, Y., Xu, J., & Sun, Y. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.10.014 · Cited by 23
Where did I leave my keys? — Episodic-Memory-Based Question Answering on Egocentric Videos
Bärmann, L., & Waibel, A. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00162 · Cited by 29
Metadata
- Authors
- Lavie, A., & Agarwal, A.
- Affiliations
- Carnegie Mellon University (US)
- ORCID
- Lavie, Alon
- Venue
- Proceedings of the Second Workshop on Statistical Machine Translation - StatMT '07
- Published
- 2007
- Pages
- 228-231
- OpenAlex
- W2133512280
- Cited by
- 1,047
- References
- 10
- Citations by year
- 2026: 50 · 2025: 104 · 2024: 91 · 2023: 80 · 2022: 78 · 2021: 124 · 2020: 98 · 2019: 84 · 2018: 43 · 2017: 24 · 2016: 29 · 2015: 32 · 2014: 23 · 2013: 23 · 2012: 30
- FWCI
- 21.44
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Conference on Machine Translation (WMT) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Social Sciences › Arts and Humanities › Language and Linguistics › Translation Studies and Practices
- Keywords
- meteors, machine translation evaluation, automatic evaluation metrics, translation quality, BLEU, human judgment correlation, multilingual evaluation, Spanish language, French language, German
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review