The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Baby talk: Understanding and generating simple image descriptions
Abstract
We posit that visually descriptive language offers computer vision researchers both information about the world, and information about how people describe the world. The potential benefit from this source is made more significant due to the enormous amount of language data easily available today. We present a system to automatically generate natural language descriptions from images that exploits both statistics gleaned from parsing large quantities of text data and recognition algorithms from computer vision. The system is very effective at producing relevant sentences for images. It also generates descriptions that are notably more true to the specific image content than previous work.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
ImageNet: A large-scale hierarchical image database
Deng, J. H., Dong, W. F., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206848 · Cited by 2,714
80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition
Torralba, A., Fergus, R., & Freeman, W. T. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.128 · Cited by 1,921
Describing objects by their attributes
Farhadi, A., Endres, I., Hoiem, D., & Forsyth, D. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206772 · Cited by 1,917
Learning to detect unseen object classes by between-class attribute transfer
Lampert, C. H., Nickisch, H., & Harmeling, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206594 · Cited by 1,849
Automatic evaluation of summaries using N-gram co-occurrence statistics
Lin, C.-Y., & Hovy, E. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073465 · Cited by 1,578
Learning to detect unseen object classes by between-class attribute transfer
Lampert, C. H., Nickisch, H., & Harmeling, S. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206594 · Cited by 1,528
Attribute and simile classifiers for face verification
Kumar, N., Berg, A. C., Belhumeur, P. N., & Nayar, S. K. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459250 · Cited by 1,361
Self-citationLogothetis, N. K., & Sheinberg, D. L. (1996) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.19.030196.003045 · Cited by 1,351
Every Picture Tells a Story: Generating Sentences from Images
Farhadi, A., Hejrati, M., Sadeghi, M. A., Young, P., Rashtchian, C., Hockenmaier, J., & Forsyth, D. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_2 · Cited by 1,204
Convergent Tree-Reweighted Message Passing for Energy Minimization
Kolmogorov, V. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.200 · Cited by 1,095
Shotton, J., Winn, J., Rother, C., & Criminisi, A. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-007-0109-1 · Cited by 1,026
Im2Text: Describing Images Using 1 Million Captioned Photographs
Ordóñez, V., Kulkarni, G. A., & Berg, T. L. (2011) · Cited by 874
Self-citationStanford typed dependencies manual
de Marnee, M.-C., & Manning, C. D. (2010) · Cited by 717
MAP Estimation Via Agreement on Trees: Message-Passing and Linear Programming
Wainwright, M. J., Jaakkola, T. S., & Willsky, A. S. (2005) · IEEE Transactions on Information Theory · doi:10.1109/tit.2005.856938 · Cited by 654
Perceiving, remembering, and communicating structure in events.
Zacks, J. M., Tversky, B., & Iyer, G. (2001) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.130.1.29 · Cited by 640
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/153244303322533214 · Cited by 615
Large Language Models in Machine Translation
Brants, T., Popat, A. C., Xu, P., Och, F. J., & Dean, J. B. (2007) · Cited by 574
Hello! My name is... Buffy'' -- Automatic Naming of Characters in TV Video
Everingham, M. R., Sivic, J., & Zisserman, A. (2006) · Procedings of the British Machine Vision Conference 2006 · doi:10.5244/c.20.92 · Cited by 552
Collecting Image Annotations Using Amazon's Mechanical Turk
Rashtchian, C., Young, P., Hodosh, M., & Hockenmaier, J. (2010) · Cited by 541
Object categorization using co-occurrence, location and appearance
Galleguillos, C., Rabinovich, A., & Belongie, S. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587799 · Cited by 457
Automatic Attribute Discovery and Characterization from Noisy Web Data
Berg, T. L., Berg, A. C., & Shih, J. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15549-9_48 · Cited by 411
Self-citationFerrari, V., & Zisserman, A. (2007) · Cited by 387
Corpus-Guided Sentence Generation of Natural Images
Yang, Y., Teo, C. L., Daumé, H., & Aloimonos, Y. (2011) · Cited by 356
Composing Simple Image Descriptions using Web-scale N-grams
Li, S., Kulkarni, G. A., Berg, T. L., Berg, A. C., & Choi, Y. (2011) · Cited by 353
Self-citationKojima, A., Tamura, T., & Fukunaga, K. (2002) · International Journal of Computer Vision · doi:10.1023/a:1020346032608 · Cited by 338
Collective Generation of Natural Image Descriptions
Кузнецова, П., Ordóñez, V., Berg, A., Berg, T. L., & Choi, Y. (2012) · Cited by 319
Self-citationI2T: Image Parsing to Text Description
Yao, B. Z., Yang, X., Lin, L., Lee, M. W., & Zhu, S.-C. (2010) · Proceedings of the IEEE · doi:10.1109/jproc.2010.2050411 · Cited by 310
Discriminative models for multi-class object layout
Desai, C., Ramanan, D., & Fowlkes, C. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459256 · Cited by 274
Gupta, A., Srinivasan, P., Shi, J., & Davis, L. S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206492 · Cited by 231
“Who are you?” - Learning person specific classifiers from video
Sivic, J., Everingham, M., & Zisserman, A. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206513 · Cited by 223
Learning Models for Object Recognition from Natural Language Descriptions
Wang, J., Markert, K., & Everingham, M. (2009) · Procedings of the British Machine Vision Conference 2009 · doi:10.5244/c.23.2 · Cited by 201
Harvesting Image Databases from the Web
Schroff, F., Criminisi, A., & Zisserman, A. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4409099 · Cited by 192
OPTIMOL: Automatic Online Picture Collection via Incremental Model Learning
Li, L.-J., & Fei-Fei, L. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0265-6 · Cited by 187
Berg, T. L., & Forsyth, D. A. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.57 · Cited by 181
Self-citationBeyond Nouns: Exploiting Prepositions and Comparative Adjectives for Learning Visual Classifiers
Gupta, A., & Davis, L. S. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88682-2_3 · Cited by 167
Using the forest to see the trees
Torralba, A. B., Murphy, K. P., & Freeman, W. T. (2010) · Communications of the ACM · doi:10.1145/1666420.1666446 · Cited by 123
Generating Image Descriptions Using Dependency Relational Patterns
Aker, A., & Gaizauskas, R. (2010) · Cited by 85
Yanai, ., & Barnard, K. (2005) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1101149.1101241 · Cited by 75
How Many Words Is a Picture Worth? Automatic Caption Generation for News Images
Feng, Y., & Lapata, M. (2010) · Cited by 74
Unsupervised Learning of Visual Sense Models for Polysemous Words
Saenko, K., & Darrell, T. (2008) · Cited by 47
Template-Filtered Headline Summarization
Zhou, L., & Hovy, E. H. (2004) · Cited by 25
Using Closed Captions as Supervision for Video Activity Recognition
Gupta, S., & Mooney, R. J. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7738 · Cited by 24
Berg, T. L., Berg, A. C., Edwards, J., Maire, M., White, R. M., Teh, Y., & Miller, E. G. (2004) · Cited by 22
Self-citationWhat do we see when we glance at a scene?
Fei-Fei, L., Koch, C., Iyer, A., & Perona, P. (2004) · Journal of Vision · doi:10.1167/4.8.863 · Cited by 18
Using closed captions to train activity recognizers that improve video retrieval
Gupta, S., & Mooney, R. J. (2009) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2009.5204202 · Cited by 14
Cited by
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
Deep visual-semantic alignments for generating image descriptions
Karpathy, A., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298932 · Cited by 4,902
CIDEr: Consensus-based image description evaluation
Vedantam, R., Zitnick, C. L., & Parikh, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299087 · Cited by 4,845
VQA: Visual Question Answering
Antol, S., Agrawal, A., Lu, J., Mitchell, M., Batra, D., Zitnick, C. L., & Parikh, D. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.279 · Cited by 4,487
Zhu, Y., Kiros, R., Zemel, R., Salakhutdinov, R., Urtasun, R., Torralba, A., & Fidler, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.11 · Cited by 2,264
Metadata
- Authors
- Kulkarni, G., Premraj, V., Dhar, S., Li, S., Choi, Y., Berg, A. C., & Berg, T. L.
- Venue
- CVPR 2011
- Publisher
- IEEE
- Published
- 2011-06
- Pages
- 1601-1608
- OpenAlex
- W2066134726
- Cited by
- 521
- References
- 47
- FWCI
- 30.13
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.