The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions
Open accessAbstract
We propose to use the visual denotations of linguistic expressions (i.e. the set of images they describe) to define novel denotational similarity metrics, which we show to be at least as beneficial as distributional similarities for two tasks that require semantic inference. To compute these denotational similarities, we construct a denotation graph, i.e. a subsumption hierarchy over constituents and their denotations, based on a large corpus of 30K images and 150K descriptive captions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
An Information-Theoretic Definition of Similarity
Lin, D. (1998) · International Conference on Machine Learning · Cited by 3,790
Word association norms, mutual information, and lexicography
Church, K., & Hanks, P. (1990) · doi:10.5555/89086.89095 · Cited by 3,590
Using Information Content to Evaluate Semantic Similarity in a Taxonomy
Resnik, P. (1995) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9511007 · Cited by 3,193
Barwise, J., & Perry, J. (1981) · The Journal of Philosophy · doi:10.2307/2026578 · Cited by 2,352
Computing semantic relatedness using Wikipedia-based explicit semantic analysis
Gabrilovich, E., & Markovitch, S. (2007) · Cited by 1,981
The PASCAL Recognising Textual Entailment Challenge
Dagan, I., Glickman, O., & Magnini, B. (2006) · Lecture Notes in Computer Science · doi:10.1007/11736790_9 · Cited by 1,628
Framing Image Description as a Ranking Task: Data, Models and Evaluation Metrics
Hodosh, M., Young, P., & Hockenmaier, J. (2013) · Journal of Artificial Intelligence Research · doi:10.1613/jair.3994 · Cited by 1,314
Self-citationComputational linguistics in 1990
Karlgren, H. (1990) · Proceedings of the 13th conference on Computational linguistics - · doi:10.3115/992507.992531 · Cited by 1,243
Every Picture Tells a Story: Generating Sentences from Images
Farhadi, A., Hejrati, M., Sadeghi, M. A., Young, P., Rashtchian, C., Hockenmaier, J., & Forsyth, D. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_2 · Cited by 1,204
Self-citationIntroduction to Montague Semantics
Dowty, D. R., Wall, R. E., & Peters, S. (1980) · Studies in Linguistics and Philosophy · doi:10.1007/978-94-009-9065-4 · Cited by 1,097
Composition in Distributional Models of Semantics
Mitchell, J., & Lapata, M. (2010) · Cognitive Science · doi:10.1111/j.1551-6709.2010.01106.x · Cited by 960
Collecting Highly Parallel Data for Paraphrase Evaluation
Chen, D. J., & Dolan, W. B. (2011) · Cited by 904
Im2Text: Describing Images Using 1 Million Captioned Photographs
Ordóñez, V., Kulkarni, G. A., & Berg, T. L. (2011) · neural information processing systems · Cited by 874
SemEval-2012 Task 6: A Pilot on Semantic Textual Similarity
Agirre, E., Cer, D. M., Diab, M., & González-Agirre, A. (2012) · Joint Conference on Lexical and Computational Semantics · Cited by 649
Baby talk: Understanding and generating simple image descriptions
Kulkarni, G., Premraj, V., Dhar, S., Li, S., Choi, Y., Berg, A. C., & Berg, T. L. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995466 · Cited by 521
MaltParser: A Data-Driven Parser-Generator for Dependency Parsing
Nivre, J., Hall, J., & Nilsson, J. (2006) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2c4iw9v6wxqe · Cited by 467
Midge: Generating Image Descriptions From Computer Vision Detections
Mitchell, M., Dodge, J., Goyal, A., Yamaguchi, K., Stratos, K., Han, X., Mensch, A., Berg, A., Berg, T. L., & Daumé, H. (2012) · Conference of the European Chapter of the Association for Computational Linguistics · Cited by 416
VerbOcean: Mining the Web for Fine-Grained Semantic Verb Relations
Chklovski, T. A., & Pantel, P. (2004) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · Cited by 391
Corpus-Guided Sentence Generation of Natural Images
Yang, Y., Teo, C. L., Daumé, H., & Aloimonos, Y. (2011) · Cited by 356
Composing Simple Image Descriptions using Web-scale N-grams
Li, S., Kulkarni, G. A., Berg, T. L., Berg, A. C., & Choi, Y. (2011) · Cited by 353
Collective Generation of Natural Image Descriptions
Кузнецова, П., Ordóñez, V., Berg, A., Berg, T. L., & Choi, Y. (2012) · Cited by 319
The IAPR Benchmark : A New Evaluation Resource for Visual Information Systems
Grubinger, M. (2006) · RWTH Publications (RWTH Aachen) · Cited by 285
Directional distributional similarity for lexical inference
KOTLERMAN, L., DAGAN, I., SZPEKTOR, I., & ZHITOMIRSKY-GEFFET, M. (2010) · Natural Language Engineering · doi:10.1017/s1351324910000124 · Cited by 207
TakeLab: Systems for Measuring Semantic Text Similarity
Šarić, F., Glavaš, G., Karan, M., Šnajder, J., & Bašić, B. D. (2012) · MADOC (University of Mannheim) · Cited by 198
Modeling semantic containment and exclusion in natural language inference
MacCartney, B., & Manning, C. D. (2008) · Proceedings of the 22nd International Conference on Computational Linguistics - COLING '08 · doi:10.3115/1599081.1599147 · Cited by 161
A general framework for distributional similarity
Weeds, J., & Weir, D. J. (2003) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1119355.1119366 · Cited by 127
Choosing Linguistics over Vision to Describe Images
Gupta, A., Verma, Y., & Jawahar, C. V. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v26i1.8205 · Cited by 120
Learning entailment rules for unary templates
Szpektor, I., & Dagan, I. (2008) · International Conference on Computational Linguistics · doi:10.3115/1599081.1599188 · Cited by 107
DKPro Similarity: An Open Source Framework for Text Similarity
Bär, D., Zesch, T., & Gurevych, I. (2013) · TUbilio (Technical University of Darmstadt) · doi:10.17185/duepublico/72181 · Cited by 79
Context-theoretic semantics for natural language
Clarke, D. (2009) · doi:10.3115/1705415.1705430 · Cited by 62
Learning Entailment Relations by Global Graph Structure Optimization
Berant, J., Dagan, I., & Goldberger, J. (2011) · Computational Linguistics · doi:10.1162/coli_a_00085 · Cited by 38
Evaluating the inferential utility of lexical-semantic resources
Mirkin, S., Dagan, I., & Shnarch, E. (2009) · doi:10.3115/1609067.1609129 · Cited by 24
Cross-Caption Coreference Resolution for Automatic Image Understanding
Hodosh, M., Young, P., Rashtchian, C., & Hockenmaier, J. (2010) · Conference on Computational Natural Language Learning · Cited by 16
Self-citation
Cited by
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations
Krishna, R., Zhu, Y., Groth, O., Johnson, J., Hata, K., Kravitz, J., Chen, S., Kalantidis, Y., Li, L.-J., Shamma, D. A., et al. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0981-7 · Cited by 5,107
Long-term recurrent convolutional networks for visual recognition and description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228
Metadata
- Authors
- Young, P., Lai, A., Hodosh, M., & Hockenmaier, J.
- Venue
- Transactions of the Association for Computational Linguistics
- Publisher
- MIT Press - Journals
- Published
- 2014-12
- Volume
- 2
- Pages
- 67-78
- ISSN
- 2307-387X (ISSN-L)
- OpenAlex
- W2185175083
- Cited by
- 2,426
- References
- 34
- FWCI
- 93.47
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.