The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Meteor: an automatic metric for MT evaluation with high levels of correlation with human judgments
Abstract
Meteor is an automatic metric for Machine Translation evaluation which has been demonstrated to have high levels of correlation with human judgments of translation quality, significantly outperforming the more commonly used Bleu metric. It is one of several automatic metrics used in this year's shared task within the ACL WMT-07 workshop. This paper recaps the technical details underlying the metric and describes recent improvements in the metric. The latest release includes improved metric parameters and extends the metric to support evaluation of MT output in Spanish, French and German, in addition to English.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Popular evaluation methods for natural language generation such as BLEU-460, ROUGE-L61, and METEOR62 primarily compare n-grams between two documents and may not effectively capture semantic similarities.”
From Generating dermatopathology reports from gigapixel whole slide images with HistoGPT (2025) · cites this paper as [62]
In the citing paper
“BLEU computes n-gram overlap and is representative for the family of text overlap-based natural language generation metrics such as CIDEr,31 METEOR,30 and ROUGE.32”
From Evaluating progress in automatic chest X-ray radiology report generation (2023) · cites this paper as [30]
Citations
Cites
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
(2005) · Cited by 4,152
Self-citationMinimum error rate training in statistical machine translation
Och, F. J. (2003) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1075096.1075117 · Cited by 2,728
A Study of Translation Edit Rate with Targeted Human Annotation
Snover, M., Dorr, B. J., Schwartz, R. M., Micciulla, L., & Makhoul, J. I. (2006) · Cited by 2,380
Confidence estimation for machine translation
Blatz, J., Fitzgerald, E., Foster, G. F., Gandrabur, S., Goutte, C., Kulesza, A., Sanchís, A., & Ueffing, N. (2004) · International Conference on Computational Linguistics · doi:10.3115/1220355.1220401 · Cited by 368
Lattice-based minimum error rate training for statistical machine translation
Macherey, W., Och, F. J., Thayer, I., & Uszkoreit, J. (2008) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1613715.1613807 · Cited by 347
Precision and recall of machine translation
Melamed, I. D., Green, R., & Turian, J. P. (2003) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/1073483.1073504 · Cited by 228
The Significance of Recall in Automatic Metrics for MT Evaluation
Lavie, A., Sagae, K., & Jayaraman, S. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30194-3_16 · Cited by 123
Self-citationCDER: Efficient MT Evaluation Using Block Movements.
Leusch, G., Ueffing, N., & Ney, H. (2006) · RWTH Publications (RWTH Aachen) · Cited by 109
(2024) · ACM eBooks · doi:10.1145/3674127 · Cited by 86
Flagged first, then by citations
Cited by
Sorted by citations
Items 101–200 of 1,003
A Deep Ensemble Model with Slot Alignment for Sequence-to-Sequence Natural Language Generation
Juraska, J., Karagiannis, P., Bowden, K., & Walker, M. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1014 · Cited by 75
Comparison of crowdsourcing translation with Machine Translation
Anastasiou, D., & Gupta, R. K. (2011) · Journal of Information Science · doi:10.1177/0165551511418760 · Cited by 75
Expressing an image stream with a sequence of natural sentences
Park, C. C., & Kim, G. (2015) · Seoul National University Open Repository (Seoul National University) · Cited by 75
Adaptive Path Selection for Dynamic Image Captioning
Xian, T., Li, Z., Tang, Z., & Ma, H. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3155795 · Cited by 76
Does Multimodality Help Human and Machine for Translation and Image Captioning?
Çağlayan, O., Aransa, W., Wang, Y., Masana, M., García-Martínez, M., Bougares, F., Barrault, L., & van de Weijer, J. (2016) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w16-2358 · Cited by 74
DIFNet: Boosting Visual Information Flow for Image Captioning
Wu, M., Zhang, X., Sun, X., Zhou, Y., Chen, C., Gu, J., Sun, X., & Ji, R. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01749 · Cited by 77
Video Captioning With Object-Aware Spatio-Temporal Correlation and Aggregation
Zhang, J., & Peng, Y. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2988435 · Cited by 73
Investigating Evaluation of Open-Domain Dialogue Systems With Human Generated Multiple References
Gupta, P., Mehri, S., Zhao, T., Pavel, A., Eskénazi, M., & Bigham, J. P. (2019) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/w19-5944 · Cited by 78
LIUM-CVC Submissions for WMT17 Multimodal Translation Task
Çağlayan, O., Aransa, W., Bardet, A., García-Martínez, M., Bougares, F., Barrault, L., Masana, M., Herranz, L., & van de Weijer, J. (2017) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w17-4746 · Cited by 72
Cui, F., Cui, Q., & Song, Y. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2985588 · Cited by 74
Radial Graph Convolutional Network for Visual Question Generation
Xu, X., Wang, T., Yang, Y., Hanjalić, A., & Shen, H. T. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2986029 · Cited by 72
METEOR-NEXT and the METEOR Paraphrase Tables: Improved Evaluation Support for Five Target Languages
Denkowski, M., & Lavie, A. (2010) · Cited by 72
Self-citationBhooshan, R. S., Kumaraswamy, S., & Sasidharan, S. (2023) · Journal Of Big Data · doi:10.1186/s40537-023-00693-9 · Cited by 72
Wang, Z., Lan, A., Nie, W., Waters, A. E., Grimaldi, P. J., & Baraniuk, R. G. (2018) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3231644.3231654 · Cited by 77
MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover DistancePreprint
Zhao, W., Peyrard, M., Liu, F., Gao, Y., Meyer, C. M., & Eger, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.02622 · Cited by 159
Neural Fuzzy Repair: Integrating Fuzzy Matches into Neural Machine Translation
Bulté, B., & Tezcan, A. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1175 · Cited by 69
Have Your Text and Use It Too! End-to-End Neural Data-to-Text Generation with Semantic Fidelity
Harkous, H., Groves, I., & Saffari, A. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.218 · Cited by 78
The NIST 2008 Metrics for machine translation challenge—overview, methodology, metrics, and results
Przybocki, M. A., Peterson, K., Bronsart, S., & Sanders, G. (2009) · Machine Translation · doi:10.1007/s10590-009-9065-6 · Cited by 68
Yang, M., Liu, J., Shen, Y., Zhao, Z., Chen, X., Wu, Q., & Li, C. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3028651 · Cited by 67
Textual Context-Aware Dense Captioning With Diverse Words
Shao, Z., Han, J., Debattista, K., & Pang, Y. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3241517 · Cited by 69
He, Z., Bhasuran, B., Jin, Q., Tian, S., Hanna, K., Shavor, C., Arguello, L. G., Murray, P. R., & Lu, Z. (2024) · Journal of Medical Internet Research · doi:10.2196/56655 · Cited by 76
CoCon: A Self-Supervised Approach for Controlled Text GenerationPreprint
Chan, A., Ong, Y.-S., Pung, B. T. W., Zhang, A., & Fu, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.03535 · Cited by 73
Cui, W. H., Wang, F., He, X. J., Zhang, D., Xu, X., Meng, Y., Wang, Z., & Huang, J. (2019) · Remote Sensing · doi:10.3390/rs11091044 · Cited by 67
CoreGen: Contextualized Code Representation Learning for Commit Message Generation
Nie, L. Y., Gao, C., Zhong, Z., Lam, W. P., Liu, Y., & Xu, Z. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.05.039 · Cited by 62
Can LLMs Generate Architectural Design Decisions? - An Exploratory Empirical Study
Dhar, R., Vaidhyanathan, K., & Varma, V. (2024) · IEEE International Conference on Software Architecture (ICSA) · doi:10.1109/icsa59870.2024.00016 · Cited by 78
Extending the METEOR Machine Translation Evaluation Metric to the Phrase Level
Denkowski, M., & Lavie, A. (2010) · Cited by 61
Self-citationCommon Subspace for Model and Similarity: Phrase Learning for Caption Generation from Images
Ushiku, Y., Yamaguchi, M., Mukuta, Y., & Harada, T. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.306 · Cited by 61
NMTPY: A Flexible Toolkit for Advanced Neural Machine Translation Systems
Caglayan, O., García-Martínez, M., Bardet, A., Aransa, W., Bougares, F., & Barrault, L. (2017) · The Prague Bulletin of Mathematical Linguistics · doi:10.1515/pralin-2017-0035 · Cited by 61
SoccerNet-Caption: Dense Video Captioning for Soccer Broadcasts Commentaries
Mkhallati, H., Cioppa, A., Giancola, S., Ghanem, B., & Droogenbroeck, M. V. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00536 · Cited by 62
Source-language entailment modeling for translating unknown terms
Mirkin, S., Specia, L., Cancedda, N., Dagan, I., Dymetman, M., & Szpektor, I. (2009) · doi:10.3115/1690219.1690257 · Cited by 59
Attention-based LSTM with Semantic Consistency for Videos Captioning
Guo, Z. Z., Gao, L., Song, J., Xu, X., Shao, J., & Shen, H. T. (2016) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2964284.2967242 · Cited by 59
Overview of the IWSLT 2011 Evaluation Campaign
Federico, M., Bentivogli, L., Paul, M. D., & Stüker, S. (2011) · KITopen · doi:10.5445/ir/1000030223 · Cited by 58
Template Guided Text Generation for Task-Oriented Dialogue
Kale, M., & Rastogi, A. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.527 · Cited by 64
Automated Whole Sentence Grammar Correction Using a Noisy Channel Model
Park, Y. A., & Lévy, R. (2011) · Cited by 57
Can Crowds Build parallel corpora for Machine Translation Systems
Ambati, V., & Vogel, S. (2010) · Cited by 57
Improving the Confidence of Machine Translation Quality Estimates
Specia, L., Turchi, M., Wang, Z., Shawe-Taylor, J. S., & Saunders, C. J. (2009) · Cited by 57
Sun, M., Suo, W., Wang, P., Zhang, Y., & Wu, Q. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3147385 · Cited by 57
Making Sense of Meaning: A Survey on Metrics for Semantic and Goal-Oriented Communication
Getu, T. M., Kaddoum, G., & Bennis, M. (2023) · IEEE Access · doi:10.1109/access.2023.3269848 · Cited by 69
Revisiting pivot language approach for machine translation
Wu, H. R., & Wang, H. (2009) · doi:10.3115/1687878.1687902 · Cited by 56
Unsupervised Paraphrase Generation using Pre-trained Language ModelsPreprint
Hegde, C. V., & Patil, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.05477 · Cited by 66
English–Mizo Machine Translation using neural and statistical approaches
Pathak, A., Pakray, P., & Bentham, J. (2018) · Neural Computing and Applications · doi:10.1007/s00521-018-3601-3 · Cited by 55
Evaluating Semantic Accuracy of Data-to-Text Generation with Natural Language Inference
Dušek, O., & Kasner, Z. (2020) · International Conference on Natural Language Generation · doi:10.18653/v1/2020.inlg-1.19 · Cited by 66
Learning Program Semantics with Code Representations: An Empirical Study
Siow, J. K., Liu, S., Xie, X., Meng, G., & Liu, Y. (2022) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner53432.2022.00073 · Cited by 57
Metrics for MT evaluation: evaluating reordering
Birch, A., Osborne, M., & Blunsom, P. (2010) · Machine Translation · doi:10.1007/s10590-009-9066-5 · Cited by 55
Aspect-Controlled Neural Argument Generation
Schiller, B., Daxenberger, J., & Gurevych, I. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.34 · Cited by 55
Vision Transformer and Language Model Based Radiology Report Generation
Mohsan, M. M., Akram, M. U., Rasool, G., Alghamdi, N. S., Baqai, M. A. A., & Abbas, M. (2022) · IEEE Access · doi:10.1109/access.2022.3232719 · Cited by 54
Design, development and field evaluation of a Spanish into sign language translation system
San-Segundo, R., Montero, J. M., de Córdoba, R., Sama, V., Fernández-Martínez, F., D’Haro, L. F., López-Ludeña, V., Sánchez, D. F. D. G., & Garcia, A. (2011) · Pattern Analysis and Applications · doi:10.1007/s10044-011-0243-9 · Cited by 54
Boosted Attention: Leveraging Human Attention for Image Captioning
Chen, S., & Zhao, Q. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01252-6_5 · Cited by 53
Pragmatically Informative Text Generation
Shen, S., Fried, D., Andreas, J., & Klein, D. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1410 · Cited by 56
Enhancing Context Modeling with a Query-Guided Capsule Network for Document-level Translation
Yang, Z., Zhang, J., Meng, F., Gu, S., Feng, Y., & Zhou, J. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1164 · Cited by 53
Zhao, W., Glavaš, G., Peyrard, M., Gao, Y., West, R., & Eger, S. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.151 · Cited by 59
Automatic image caption generation using deep learning
Verma, A., Yadav, A. K., Kumar, M., & Yadav, D. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-15555-y · Cited by 54
Evaluating the Output of Machine Translation Systems
Lavie, A. (2010) · Conference of the Association for Machine Translation in the Americas · Cited by 52
Self-citationExploring Multi-Level Attention and Semantic Relationship for Remote Sensing Image Captioning
Yuan, Z., Li, X., & Wang, Q. (2019) · IEEE Access · doi:10.1109/access.2019.2962195 · Cited by 52
Multiscale Methods for Optical Remote-Sensing Image Captioning
Ma, X., Zhao, R., & Shi, Z. (2020) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2020.3009243 · Cited by 52
Towards Knowledge-Aware Video Captioning via Transitive Visual Relationship Detection
Wu, B., Niu, G., Yu, J., Xiao, X., Zhang, J., & Wu, H. R. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3169894 · Cited by 51
Video description: A comprehensive survey of deep learning approaches
Rafiq, G., Rafiq, M. T., & Choi, G. S. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10414-6 · Cited by 55
Unsupervised Multimodal Machine Translation for Low-resource Distant Language Pairs
Tayir, T., & Li, L. (2024) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3652161 · Cited by 54
Rosti, A.-V. I., Zhang, B., Matsoukas, S., & Schwartz, R. M. (2008) · Conference on Machine Translation (WMT) · doi:10.3115/1626394.1626423 · Cited by 51
Knowing What to Learn: A Metric-Oriented Focal Mechanism for Image Captioning
Ji, J., Ma, Y., Sun, X., Zhou, Y., Wu, Y., & Ji, R. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3183434 · Cited by 50
Decomposability of translation metrics for improved evaluation and efficient algorithms
Chiang, D., DeNeefe, S., Chan, Y. S., & Ng, H. T. (2008) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1613715.1613791 · Cited by 50
LEPOR: A Robust Evaluation Metric for Machine Translation with Augmented Factors
Han, A. L.-F., Wong, D. F., & Chao, L. S. (2012) · Research Explorer (The University of Manchester) · Cited by 50
Deep Learning for Video Captioning: A Review
Chen, S., Yao, T., & Jiang, Y. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/877 · Cited by 50
Exploring Diverse Expressions for Paraphrase Generation
Qian, L., Qiu, L., Zhang, W., Jiang, X., & Yu, Y. H. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1313 · Cited by 51
Unsupervised Multi-hop Question Answering by Question Generation
Pan, L., Chen, W., Xiong, W., Kan, M., & Wang, W. Y. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.469 · Cited by 55
Hu, X., Gu, L., An, Q., Zhang, M., Liu, L., Kobayashi, K., Harada, T., Summers, R. M., & Zhu, Y. (2023) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3580305.3599819 · Cited by 49
CLIP-Guided Vision-Language Pre-training for Question Answering in 3D Scenes
Parelli, M., Delitzas, A., Hars, N., Vlassis, G., Anagnostidis, S., Bachmann, G., & Hofmann, T. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00593 · Cited by 48
Ji, J., Hou, Y., Chen, X., Pan, Y., & Xiang, Y. (2024) · JMIR Formative Research · doi:10.2196/32690 · Cited by 48
Boosted Transformer for Image Captioning
Li, J., Yao, P., Guo, L., & Zhang, W. (2019) · Applied Sciences · doi:10.3390/app9163260 · Cited by 51
The First Conversational Intelligence Challenge
Burtsev, M., Logacheva, V., Malykh, V. A., Serban, I. V., Lowe, R., Prabhumoye, S., Black, A. W., Rudnicky, A. I., & Bengio, Y. (2018) · The Springer series on challenges in machine learning · doi:10.1007/978-3-319-94042-7_2 · Cited by 46
Leaf: Multiple-Choice Question Generation
Vachev, K., Hardalov, M., Karadzhov, G., Georgiev, G., Koychev, I., & Nakov, P. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-99739-7_41 · Cited by 45
Switching Text-Based Image Encoders for Captioning Images With Text
Ueda, A., Yang, W., & Sugiura, K. (2023) · IEEE Access · doi:10.1109/access.2023.3282444 · Cited by 49
Fritzinger, F., & Fraser, A. (2010) · Cited by 45
PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generation
Hua, X., & Wang, L. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.57 · Cited by 45
Conversations Are Not Flat: Modeling the Dynamic Information Flow across Dialogue Utterances
Li, Z., Zhang, J., Fei, Z., Feng, Y., & Zhou, J. (2021) · doi:10.18653/v1/2021.acl-long.11 · Cited by 51
Factual Consistency Evaluation for Text Summarization via Counterfactual Estimation
Xie, Y., Sun, F., Deng, Y., Li, Y., & Ding, B. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.10 · Cited by 49
Retrieval-Augmented Response Generation for Knowledge-Grounded Conversation in the Wild
Ahn, Y., Lee, S., Shim, J., & Park, J. (2022) · IEEE Access · doi:10.1109/access.2022.3228964 · Cited by 45
Data-driven semantic analysis for multilingual WSD and lexical selection in translation
Apidianaki, M. (2009) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/1609067.1609075 · Cited by 44
English Machine Reading Comprehension Datasets: A Survey
Dzendzik, D., Foster, J., & Vogel, C. M. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.693 · Cited by 47
Zero-shot Fact Verification by Claim Generation
Pan, L., Chen, W., Xiong, W., Kan, M., & Wang, W. Y. (2021) · doi:10.18653/v1/2021.acl-short.61 · Cited by 43
Learning Object Context for Dense Captioning
Li, X., Jiang, S., & Han, J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018650 · Cited by 43
Guiding the Growth: Difficulty-Controllable Question Generation through Step-by-Step Rewriting
Cheng, Y. D., Li, S., Liu, B., Zhao, R., Li, S., Lin, C., & Zheng, Y. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.465 · Cited by 55
Denkowski, M., & Lavie, A. (2018) · Figshare · doi:10.1184/r1/6473108 · Cited by 43
Self-citationLarge Language Models in Mental Health Care: A Systematic Scoping Review (Preprint)
hua, Y., Liu, F., Yang, K., Li, Z., Sheu, Y.-H., Zhou, P., Moran, L. V., Ananiadou, S., Clifton, D. A., & Beam, A. (2024) · doi:10.2196/preprints.64088 · Cited by 46
Token-Mixer: Bind Image and Text in One Embedding Space for Medical Image Reporting
Yang, Y. Q., Yu, J., Fu, Z., Zhang, K., Yu, T., Wang, X., Jiang, H., Lv, J., Huang, Q., & Han, W. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3412402 · Cited by 45
Fast consensus decoding over translation forests
DeNero, J., Chiang, D., & Knight, K. K. (2009) · doi:10.3115/1690219.1690226 · Cited by 42
DeeCap: Dynamic Early Exiting for Efficient Image Captioning
Fei, Z., Yan, X., Wang, S., & Tian, Q. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01190 · Cited by 41
Linguistic measures for automatic machine translation evaluation
Giménez, J., & Màrquez, L. (2010) · Machine Translation · doi:10.1007/s10590-011-9088-7 · Cited by 41
Summarization-based Video Caption via Deep Neural Networks
Li, G., Ma, S., & Han, Y. (2015) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2733373.2806314 · Cited by 42
Key Phrase Extraction for Generating Educational Question-Answer Pairs
Willis, A., Davis, G. M., Ruan, S., Manoharan, L., Landay, J. A., & Brunskill, E. (2019) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3330430.3333636 · Cited by 41
Neural aesthetic image reviewer
Wang, W., Yang, S., Zhang, W., & Zhang, J. (2019) · IET Computer Vision · doi:10.1049/iet-cvi.2019.0361 · Cited by 44
Automatic Report Generation for Chest X-Ray Images via Adversarial Reinforcement Learning
Hou, D., Zhao, Z., Liu, Y., Chang, F., & Hu, S. (2021) · IEEE Access · doi:10.1109/access.2021.3056175 · Cited by 42
SPT: Spatial Pyramid Transformer for Image Captioning
Zhang, H., Zeng, P., Gao, L., Lyu, X., Song, J., & Shen, H. T. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3336371 · Cited by 44
Hu, D., Zhang, S., Liu, Q., Xiaofeng, Z., & Liu, B. (2025) · Journal of Medical Internet Research · doi:10.2196/65547 · Cited by 43
Remote Sensing Spatiotemporal Vision–Language Models: A comprehensive survey
Liu, C., Zhang, J. Q., Chen, K., Wang, M., Zou, Z., & Shi, Z. (2025) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2025.3598283 · Cited by 54
E2E NLG Challenge: Neural Models vs. Templates
Puzikov, Y., & Gurevych, I. (2018) · International Conference on Natural Language Generation · doi:10.18653/v1/w18-6557 · Cited by 45
Cascaded Revision Network for Novel Object Captioning
Feng, Q., Wu, Y., Fan, H., Yan, C. C., Xu, M., & Yang, Y. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2965966 · Cited by 40
Machine Translation and the Evaluation of Its Quality
Maučec, M. S., & Donaj, G. (2019) · IntechOpen eBooks · doi:10.5772/intechopen.89063 · Cited by 40
“Math word problem generation with mathematical consistency and problem context constraints,”
Wang, Z., Lan, A., & Baraniuk, R. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.484 · Cited by 39
DiscoTK: Using Discourse Structure for Machine Translation Evaluation
Joty, S., Guzmán, F., Màrquez, L., & Nakov, P. (2014) · Conference on Machine Translation (WMT) · doi:10.3115/v1/w14-3352 · Cited by 39
Metadata
- Authors
- Lavie, A., & Agarwal, A.
- Affiliations
- Carnegie Mellon University (US)
- ORCID
- Lavie, Alon
- Venue
- Proceedings of the Second Workshop on Statistical Machine Translation - StatMT '07
- Published
- 2007
- Pages
- 228-231
- OpenAlex
- W2133512280
- Cited by
- 1,047
- References
- 10
- Citations by year
- 2026: 50 · 2025: 104 · 2024: 91 · 2023: 80 · 2022: 78 · 2021: 124 · 2020: 98 · 2019: 84 · 2018: 43 · 2017: 24 · 2016: 29 · 2015: 32 · 2014: 23 · 2013: 23 · 2012: 30
- FWCI
- 21.44
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Conference on Machine Translation (WMT) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Social Sciences › Arts and Humanities › Language and Linguistics › Translation Studies and Practices
- Keywords
- meteors, machine translation evaluation, automatic evaluation metrics, translation quality, BLEU, human judgment correlation, multilingual evaluation, Spanish language, French language, German
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review