AutoCaption: Automatic caption generation for personal photos
The DOI matches its Crossref record.
Abstract
AutoCaption is a system that helps a smartphone user generate a caption for their photos. It operates by uploading the photo to a cloud service where a number of parallel modules are applied to recognize a variety of entities and relations. The outputs of the modules are combined to generate a large set of candidate captions, which are returned to the phone. The phone client includes a convenient user interface that allows users to select their favorite caption, reorder, add, or delete words to obtain the grammatical style they prefer. The user can also select from multiple candidates returned by the recognition modules.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 26
- ordonez, 2011, Im2Text: Describing images using 1 million captioned photographs, NIPS
- 0, Microsoft Windows Azure
- mitchell, 2012, Midge: Generating image descriptions from computer vision detections, Proc of the 13th Conf of the European Chapter of the Assoc for Comp Linguistics
- langkilde, 1998, Generation that exploits corpusbased statistical knowledge, Proceedings of the association for Computational Linguistics
- li, 2009, Landmark classification in large-scale image collections, ICCV
- 10.1109/CVPR.2011.5995466 · DOI · Paper page
- kuznetzova, 2012, Collective generation of natural image descriptions, Proc of the Association for Computational Linguistics
- 10.1525/aa.1963.65.5.02a00020 · DOI · Paper page
- 10.1109/CVPR.2010.5540039 · DOI · Paper page
- 10.1109/CVPR.2009.5206839 · DOI · Paper page
- 10.1109/CVPR.2001.990517 · DOI · Paper page
- 10.1145/355598.362773 · DOI · Paper page
- 10.1109/CVPR.2010.5539970 · DOI · Paper page
- yang, 2010, Recognizing proxemics in personal photos, CVPR
- yang, 2011, Corpusguided sentence generation in natural images, Empirical Methods in Natural Language Processing
- zhang, 2007, Multiple-instance pruning for learning efficient cascade detectors, NIPS
- 0, Bing Bing Maps Locations REST Service
- 10.1109/CVPR.2013.104 · DOI
- 10.1007/978-3-642-34500-5_24 · DOI
- 0, Project page
- farhadi, 2010, Every picture tells a story: Generating sentences from images, ECCV
- csurka, 2004, Visual categorization with bags of keypoints, Statistical Learning in Computer Vision
- 10.1007/978-3-642-48354-7_7 · DOI · Paper page
- 10.1109/CVPR.2010.5539992 · DOI · Paper page
- 0, Google Places Api
- 10.1023/B:VISI.0000042934.15159.49 · DOI · Paper page
Cited by
Microsoft COCO Captions: Data Collection and Evaluation Server
Chen, X., Fang, H., Lin, T.-Y., Vedantam, R., Gupta, S., Dollar, P., & Zitnick, C. L. (2015) · arXiv · doi:10.48550/arxiv.1504.00325 · Cited by 1,614
“The automatic generation of captions for images is a long standing and challenging problem in artificial intelligence [1], [2], [3], [4], [5], [6], [7], [8], [9], [10], [11], [12], [13], [14], [15], [16], [17], [18], [19].”
Background(2017) · doi:10.1145/2998181.2998364 · Cited by 258
Understanding Blind People's Experiences with Computer-Generated Captions of Social Media Images
MacLeod, H., Bennett, C. L., Morris, M. R., & Cutrell, E. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025814 · Cited by 200
“Sometimes this is done through user studies where sighted people are asked to rate the quality of a caption for a given image [25,27] or choose the best from a series of captions [9].”
BackgroundCaption Crawler: Enabling Reusable Alternative Text Descriptions using Reverse Image Search
Guinness, D., Cutrell, E., & Morris, M. R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174092 · Cited by 108
FuseCap: Leveraging Large Language Models for Enriched Fused Image Captions
Rotstein, N., Bensaïd, D., Brody, S., Ganz, R., & Kimmel, R. (2024) · 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv57701.2024.00559 · Cited by 66
Metadata
- Authors
- Ramnath, K., Baker, S., Vanderwende, L., El-Saban, M., Sinha, S. N., Kannan, A., Hassan, N., Galley, M., Yang, Y., Ramanan, D., Bergamo, A., & Torresani, L.
- Venue
- IEEE Winter Conference on Applications of Computer Vision
- Publisher
- IEEE
- Published
- 2014-03
- Pages
- 1050-1057
- ISSN
- 2472-6737 (ISSN-L)
- OpenAlex
- W2095759914
- Cited by
- 27
- References
- 0
- FWCI
- 0.90
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: AutoCaption: Automatic caption generation for personal photos. https://app.cochat.ai/papers/10.1109/wacv.2014.6835988
- The paper
- Ramnath, K., Baker, S., Vanderwende, L., El-Saban, M., Sinha, S. N., Kannan, A., Hassan, N., Galley, M., Yang, Y., Ramanan, D., Bergamo, A., & Torresani, L. (2014). AutoCaption: Automatic caption generation for personal photos. IEEE Winter Conference on Applications of Computer Vision. https://doi.org/10.1109/wacv.2014.6835988
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.