Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Sign Up
Cited by 9

The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.

AToMiC: An Image/Text Retrieval Test Collection to Support Multimedia Content Creation

Yang, Jheng-Hong, Lassance, Carlos, Sampaio De Rezende, Rafael, Srinivasan, Krishna, Redi, Miriam, Clinchant, Stéphane, Lin, Jimmy·2023·Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval
DOI 10.1145/3539618.3591903
Open this paper in CoChat — free account

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3539618.3591903

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Our two retrieval tasks: image suggestion and image promotion. We use existing image-text associations in Wikipedia as proxy relevance labels.
Figure 1 Our two retrieval tasks: image suggestion and image promotion. We use existing image-text associations in Wikipedia as proxy relevance labels.CC-BY · From the PDF
Figure 2 Wikipedia page category composition.
Figure 2 Wikipedia page category composition.CC-BY · From the PDF
Figure 3 CLIP zero-shot image style analysis
Figure 3 CLIP zero-shot image style analysisCC-BY · From the PDF
Figure 4 DETR zero-shot objection detection analysis
Figure 4 DETR zero-shot objection detection analysisCC-BY · From the PDF
Image 5
CC-BY · From the PDF
Image 6
CC-BY · From the PDF
(a) Original attached image.
(a) Original attached image.CC-BY · From the PDF
(c) Top-10 and Bottom-10 (out of 1K) candidates retrieved by OpenCLIP ViT-L-14
(c) Top-10 and Bottom-10 (out of 1K) candidates retrieved by OpenCLIP ViT-L-14CC-BY · From the PDF
Figure 7 Effectiveness comparison. We report R@10 for AToMiC and S@10 for COCO using transformer-based baselines and the OpenCLIP models fine-tuned on AToMiC.
Figure 7 Effectiveness comparison. We report R@10 for AToMiC and S@10 for COCO using transformer-based baselines and the OpenCLIP models fine-tuned on AToMiC.CC-BY · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 46

  1. 10.1007/s11042-008-0246-8 · DOI
  2. 10.1145/2699668 · DOI
  3. 10.1007/978-3-030-99739-7_30 · DOI
  4. 10.15294/elt.v9i1.34614 · DOI
  5. 10.1007/978-3-030-99736-6_36 · DOI
  6. Sanghyuk Chun, Wonjae Kim, Song Park, Minsuk Chang Chang, and Seong Joon Oh. 2022. ECCV Caption: Correcting False Negatives by Collecting Machine-and-Human-verified Image-Caption Associations for MS-COCO. In Proc. of ECCV. 1--19.
  7. 10.1109/CVPR46437.2021.00831 · DOI
  8. Fartash Faghri, David J. Fleet, Jamie Ryan Kiros, and Sanja Fidler. 2018. VSE++: Improving Visual-Semantic Embeddings with Hard Negatives. In Proc. of BMVC.
  9. Norbert Fuhr, Jaap Kamps, Mounia Lalmas, Saadia Malik, and Andrew Trotman. 2007. Overview of the INEX 2007 ad hoc track. In Proc. of INEX. 1--23.
  10. 10.1007/978-3-319-28231-2_12 · DOI
  11. Debasis Ganguly, Iacer Calixto, and Gareth J.F. Jones. 2015. Overview of the Automated Story Illustration Task at FIRE 2015.. In FIRE Workshops. 63--66.
  12. Gregor Geigle, Jonas Pfeiffer, Nils Reimers, Ivan Vulić, and Iryna Gurevych. 2022. Retrieve Fast, Rerank Smart: Cooperative and Joint Approaches for Improved Cross-Modal Retrieval. Trans. of ACL 10 (2022), 503--521.
  13. Xintong Han, Zuxuan Wu, Phoenix X. Huang, Xiao Zhang, Menglong Zhu, Yuan Li, Yang Zhao, and Larry S. Davis. 2017. Automatic Spatially-aware Fashion Concept Discovery. In Proc. of ICCV. 1463--1471.
  14. 10.1613/jair.3994 · DOI
  15. Bogdan Ionescu Henning Müller Renaud Péteri Johannes Rückert Asma Ben Abacha Alba G. Seco de Herrera Christoph M. Friedrich Louise Bloch Raphael Brüngel Ahmad Idrissi-Yaghir Henning Schäfer Serge Kozlovski Yashin Dicente Cid Vassili Kovalev Liviu-Daniel Ştefan Mihai Gabriel Constantin Mihai Dogariu Adrian Popescu Jérôme Deshayes-Chossart Hugo Schindler Jon Chamberlain Antonio Campello and Adrian Clark. 2022. Overview of the ImageCLEF 2022: Multimedia Retrieval in Medical Social Media and Nature Applications. In Proc. of CLEF. 541--564. · DOI
  16. 10.1109/CVPR.2015.7298932 · DOI · Paper page
  17. 10.18653/v1/2022.emnlp-main.308 · DOI
  18. 10.18653/v1/D19-1469 · DOI
  19. 10.1007/BF02766607 · DOI
  20. Junnan Li, Dongxu Li, Caiming Xiong, and Steven Hoi. 2022. BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation. In Proc. of ICML.
  21. Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick. 2014. Microsoft COCO: Common Objects in Context. In Proc. of ECCV. 740--755.
  22. 10.18653/v1/2021.emnlp-main.542 · DOI
  23. 10.1145/3524273.3532891 · DOI
  24. 10.1109/CVPR.2019.00331 · DOI
  25. 10.1108/00220410310506303 · DOI
  26. Henning Müller Paul D. Clough Thomas Deselaers and Barbara Caputo (Eds.). 2010. ImageCLEF Experimental Evaluation in Visual Information Retrieval. Springer. · DOI
  27. Vivien Petras and Paul D. Clough. 2011. Introduction to the CLEF 2011 Labs. In Proc. of CLEF.
  28. Adrian Popescu, Theodora Tsikrika, and Jana Kludas. 2010. Overview of the Wikipedia Retrieval Task at ImageCLEF 2010. In Proc. of CLEF.
  29. Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. 2021. Learning Transferable Visual Models from Natural Language Supervision. In Proc. of ICML. 8748--8763.
  30. 10.1140/epjds/s13688-021-00312-8 · DOI
  31. Jun Rao, Fei Wang, Liang Ding, Shuhan Qi, Yibing Zhan, Weifeng Liu, and Dacheng Tao. 2022. Where Does the Performance Improvement Come From? A Reproducibility Concern about Image-Text Retrieval. In Proc. of SIGIR. 2727--2737.
  32. Christoph Schuhmann, Romain Beaumont, Richard Vencu, Cade W. Gordon, Ross Wightman, Mehdi Cherti, Theo Coombes, Aarush Katta, Clayton Mullis, Mitchell Wortsman, Patrick Schramowski, Srivatsa R. Kundurthy, Katherine Crowson, Ludwig Schmidt, Robert Kaczmarczyk, and Jenia Jitsev. 2022. LAION-5B: An Open Large-scale Dataset for Training Next Generation Image-text Models. In Proc. of NeurIPS: Datasets and Benchmarks Track.
  33. Christoph Schuhmann, Richard Vencu, Romain Beaumont, Robert Kaczmarczyk, Clayton Mullis, Aarush Katta, Theo Coombes, Jenia Jitsev, and Aran Komatsuzaki. 2021. LAION-400m: Open Dataset of CLIP-filtered 400 Million Image-text Pairs. arXiv:2111.02114 (2021). · arXiv
  34. Dustin Schwenk, Apoorv Khandelwal, Christopher Clark, Kenneth Marino, and Roozbeh Mottaghi. 2022. A-OKVQA: A Benchmark for Visual Question Answering using World Knowledge. arXiv:2206.01718 (2022). · arXiv
  35. 10.1109/CVPR52688.2022.01519 · DOI
  36. 10.1145/3404835.3463257 · DOI · Paper page
  37. Besiki Stvilia, Michael B. Twidale, Les Gasser, and Linda C. Smith. 2005. Information Quality in a Community-based Encyclopedia. In Knowledge Management: Nurturing Culture, Innovation, and Technology. 101--113.
  38. 10.1007/978-3-642-15181-1_9 · DOI
  39. 10.18653/v1/P19-1272 · DOI
  40. Peter Welinder, Steve Branson, Takeshi Mita, Catherine Wah, Florian Schroff, Serge Belongie, and Pietro Perona. 2010. Caltech-UCSD Birds 200. Technical Report CNS-TR-2010-001. California Institute of Technology.
  41. 10.1177/0093650212439062 · DOI
  42. Lewei Yao, Runhui Huang, Lu Hou, Guansong Lu, Minzhe Niu, Hang Xu, Xiaodan Liang, Zhenguo Li, Xin Jiang, and Chunjing Xu. 2022. FILIP: Fine-grained Interactive Language-Image Pre-Training. In Proc. of ICLR.
  43. Peter Young, Alice Lai, Micah Hodosh, and Julia Hockenmaier. 2014. From Image Descriptions to Visual Denotations: New Similarity Metrics for Semantic Inference over Event Descriptions. Trans. of ACL 2 (2014), 67--78.
  44. 10.1109/CVPR52688.2022.01759 · DOI · Paper page
  45. Xinyu Zhang, Nandan Thakur, Odunayo Ogundepo, Ehsan Kamalloo, David Alfonso-Hermelo, Xiaoguang Li, Qun Liu, Mehdi Rezagholizadeh, and Jimmy Lin. 2022. Making a MIRACL: Multilingual Information Retrieval Across a Continuum of Languages. arXiv:2210.09984 (2022). · arXiv
  46. Yuhao Zhang, Hang Jiang, Yasuhide Miura, Christopher D. Manning, and Curtis P. Langlotz. 2022. Contrastive Learning of Medical Visual Representations from Paired Images and Text. In Proc. of MLHC. 2--25.

Cited by

See all 9

Metadata

Authors
Yang, J.-H., Lassance, C., Sampaio De Rezende, R., Srinivasan, K., Redi, M., Clinchant, S., & Lin, J.
Venue
Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval
Publisher
ACM
Published
2023-07-18
Pages
2975-2984
DOI
10.1145/3539618.3591903
Cited by
9
References
2
Licence
creativecommons.org/licenses/by/4.0/ (vor)
Funders
NSERC

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.