CoChat
Sign Up
PreprintCited by 1Multimodal Machine Learning ApplicationsGenerative Adversarial Networks and Image SynthesisAdversarial Robustness in Machine Learning

T2I-Eval-R1: Reinforcement Learning-Driven Reasoning for Interpretable Text-to-Image Evaluation

Open access
Ma, Zi-Ao, Lan, Tian, Tu, Rong-Cheng, Liu, Shu-Hang, Huang, Heyan, Wu, Zhijing, Xu, Chen, Mao, Xian-Ling·2025·arXiv
DOI 10.48550/arxiv.2505.17897arXiv 2505.17897
Open this paper in CoChat — free accountOpen PDF

Abstract

The rapid progress in diffusion-based text-to-image (T2I) generation has created an urgent need for interpretable automatic evaluation methods that can assess the quality of generated images, therefore reducing the human annotation burden. To reduce the prohibitive cost of relying on commercial models for large-scale evaluation, and to improve the reasoning capabilities of open-source models, recent research has explored supervised fine-tuning (SFT) of multimodal large language models (MLLMs) as dedicated T2I evaluators. However, SFT approaches typically rely on high-quality critique datasets, which are either generated by proprietary LLMs-with potential issues of bias and inconsistency-or annotated by humans at high cost, limiting their scalability and generalization. To address these limitations, we propose T2I-Eval-R1, a novel reinforcement learning framework that trains open-source MLLMs using only coarse-grained quality scores, thereby avoiding the need for annotating high-quality interpretable evaluation rationale. Our approach integrates Group Relative Policy Optimization (GRPO) into the instruction-tuning process, enabling models to generate both scalar scores and interpretable reasoning chains with only easy accessible annotated judgment scores or preferences. Furthermore, we introduce a continuous reward formulation that encourages score diversity and provides stable optimization signals, leading to more robust and discriminative evaluation behavior. Experimental results on three established T2I meta-evaluation benchmarks demonstrate that T2I-Eval-R1 achieves significantly higher alignment with human assessments and offers more accurate interpretable score rationales compared to strong baseline methods.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2505.17897

Cites

33 of 33 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • A particularly promising evaluation approach is fine-tuning MLLM 'judges' on context-aware or community-sensitive data.

    “A particularly promising evaluation approach is fine-tuning MLLM 'judges' on context-aware or community-sensitive data [75, 111].”

    From Engaging Communities Meaningfully in Defining Disability Representation for AI Image Generation (2026) · cites this paper as [75]

    The Introduction describes fine-tuning MLLMs as text-to-image evaluators, and Section 3.3 describes training them on image-quality scores and human preferences. Neither section identifies the training data as context-aware or community-sensitive, so that qualification is not supported by this source. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 6

  1. Heusel , M., Ramsauer , H., Unterthiner , T., Nessler , B., & Hochreiter , S. (2017) Gans trained by a two time-scale update rule converge to a local nash equilibrium. Advances in neural information processing systems 30.
  2. Hu , E. J., Shen , Y., Wallis , P., Allen-Zhu , Z., Li , Y., Wang , S., Wang , L., Chen , W., & others (2022) Lora: Low-rank adaptation of large language models. ICLR 1(2):3.
  3. Li , J., Li , D., Savarese , S., & Hoi , S. (2023) Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models. In International conference on machine learning pages 19730-19742. PMLR.
  4. Podell , D., English , Z., Lacey , K., Blattmann , A., Dockhorn , T., Müller , J., Penna , J., & Rombach , R. (2023) Sdxl: Improving latent diffusion models for high-resolution image synthesis. In The Twelfth International Conference on Learning Representations
  5. Salimans , T., Goodfellow , I., Zaremba , W., Cheung , V., Radford , A., & Chen , X. (2016) Improved techniques for training gans. Advances in neural information processing systems 29.
  6. Welleck , S., Kulikov , I., Roller , S., Dinan , E., Cho , K., & Weston , J. (2020) Neural text degeneration with unlikelihood training. In 8th International Conference on Learning Representations, ICLR 2020

Cited by

Sorted by citations

Authors
Ma, Z.-A., Lan, T., Tu, R.-C., Liu, S.-H., Huang, H., Wu, Z., Xu, C., & Mao, X.-L.
Affiliations
Beijing Institute of Technology (CN)
Venue
arXiv
Publisher
arXiv
Published
2025
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2505.17897
arXiv
2505.17897
OpenAlex
W6891943096
Cited by
0
References
33
Type
posted content
Language
en
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
Keywords
text-to-image generation, interpretable evaluation, reinforcement learning, Group Relative Policy Optimization, multimodal large language models, instruction tuning, diffusion models

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review