The DOI matches its Crossref record; 89 of the 89 references it cites were found in a registry or an index.
LabelMe: Online Image Annotation and Applications
Open accessAbstract
Central to the development of computer vision systems is the collection and use of annotated images spanning our visual world. Annotations may include information about the identity, spatial extent, and viewpoint of the objects present in a depicted scene. Such a database is useful for the training and evaluation of computer vision systems. Motivated by the availability of images on the Internet, we introduced a web-based annotation tool that allows online users to label objects and their spatial extent in images. To date, we have collected over 400 000 annotations that span a variety of different scene and object classes. In this paper, we show the contents of the database, its growth over time, and statistics of its usage. In addition, we explore and survey applications of the database in the areas of computer vision and computer graphics. Particularly, we show how to extract the real-world 3-D coordinates of images in a variety of scenes using only the user-provided object annotations. The output 3-D information is comparable to the quality produced by a laser range scanner. We also characterize the space of the images in the database by analyzing 1) statistics of the co-occurrence of large objects in the images and 2) the spatial layout of the labeled images.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Turk, M., & Pentland, A. (1991) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1991.3.1.71 · Cited by 13,733
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope
Oliva, A., & Torralba, A. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011139631724 · Cited by 6,319
Self-citationBallard, D. H., & Brown, C. M. (1982) · Cited by 5,303
LabelMe: A Database and Web-Based Tool for Image Annotation
Russell, B. C., Torralba, A., Murphy, K. P., & Freeman, W. T. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0090-8 · Cited by 4,210
Self-citationLearning realistic human actions from movies
Laptev, I., Marszalek, M., Schmid, C., & Rozenfeld, B. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587756 · Cited by 3,444
Recognizing human actions: a local SVM approach
Schuldt, C., Laptev, I., & Caputo, B. (2004) · Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004. · doi:10.1109/icpr.2004.1334462 · Cited by 3,010
Recognizing human actions: A local SVM approach
Schüldt, C., Laptev, I., & Barbara Caputo, B. (2004) · Cited by 2,908
Photo tourism: exploring photo collections in 3D
Snavely, N., Seitz, S. M., & Szeliski, R. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141964 · Cited by 2,866
ON A CLASS OF SKEW DISTRIBUTION FUNCTIONS
SIMON, H. A. (1955) · Biometrika · doi:10.1093/biomet/42.3-4.425 · Cited by 2,771
Fei-Fei, L., Fergus, R., & Perona, P. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2005.09.012 · Cited by 2,359
Labeling images with a computer game
von Ahn, L., & Dabbish, L. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985733 · Cited by 2,204
Object class recognition by unsupervised scale-invariant learning
Fergus, R., Perona, P., & Zisserman, A. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211479 · Cited by 2,023
Advances in Neural Information Processing Systems 18
Murray, I., Mackay, D., Zoubin Ghahramani, A., & Skilling, J. (2006) · Cited by 1,927
80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition
Torralba, A., Fergus, R., & Freeman, W. T. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.128 · Cited by 1,921
Self-citationDescribing objects by their attributes
Farhadi, A., Endres, I., Hoiem, D., & Forsyth, D. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206772 · Cited by 1,917
Learning to detect unseen object classes by between-class attribute transfer
Lampert, C. H., Nickisch, H., & Harmeling, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206594 · Cited by 1,849
Make3D: Learning 3D Scene Structure from a Single Still Image
Saxena, A., Sun, M., & Ng, A. Y. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.132 · Cited by 1,736
Learning to detect unseen object classes by between-class attribute transfer
Lampert, C. H., Nickisch, H., & Harmeling, S. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206594 · Cited by 1,528
Self-taught learning: transfer learning from unlabeled data
Raina, R., Battle, A., Lee, H., Packer, B., & Ng, A. Y. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273592 · Cited by 1,510
Quattoni, A., & Torralba, A. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206537 · Cited by 1,463
Self-citationRecognizing action at a distance
Efros, Berg, Mori, & Malik (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238420 · Cited by 1,241
Evaluation campaigns and TRECVid
Smeaton, A. F., Over, P., & Kraaij, W. (2006) · Proceedings of the 8th ACM international workshop on Multimedia information retrieval · doi:10.1145/1178677.1178722 · Cited by 1,224
Early processing of visual information
Marr, D. (1976) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1976.0090 · Cited by 1,034
(2005) · Cited by 981
Discovering objects and their location in images
Sivic, J., Russell, B. C., Efros, A. A., Zisserman, A., & Freeman, W. T. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.77 · Cited by 975
Self-citationIM2GPS: estimating geographic information from a single image
Hays, J., & Efros, A. A. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587784 · Cited by 877
The 2005 PASCAL Visual Object Classes Challenge
Everingham, M., Zisserman, A., Williams, C. K. I., Van Gool, L., Allan, M., Bishop, C. M., Chapelle, O., Dalal, N., Deselaers, T., Dorkó, G., et al. (2006) · Lecture Notes in Computer Science · doi:10.1007/11736790_8 · Cited by 765
Small codes and large image databases for recognition
Torralba, A., Fergus, R., & Weiss, Y. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587633 · Cited by 727
Self-citationJoos, M. (1936) · Language · doi:10.1017/408930 · Cited by 726
RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES
Barrow, H. G., & Tenenbaum, J. M. (1978) · Cited by 725
Sharing Visual Features for Multiclass and Multiview Object Detection
Torralba, A., Murphy, K. P., & Freeman, W. T. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1055 · Cited by 700
Self-citationScene completion using millions of photographs
Hays, J., & Efros, A. A. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276382 · Cited by 687
Clowes, M. B. (1971) · Artificial Intelligence · doi:10.1016/0004-3702(71)90005-1 · Cited by 675
Geometric context from a single image
Hoiem, D., Efros, A. A., & Hebert, M. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.107 · Cited by 662
Criminisi, A., Reid, I., & Zisserman, A. (2000) · International Journal of Computer Vision · doi:10.1023/a:1026598000963 · Cited by 618
Using Multiple Segmentations to Discover Objects and their Extent in Image Collections
Russell, B. C., Freeman, W. T., Efros, A. A., Sivic, J., & Zisserman, A. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.326 · Cited by 617
Self-citationHoiem, D., Efros, A. A., & Hebert, M. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073232 · Cited by 616
Utility data annotation with Amazon Mechanical Turk
Sorokin, A., & Forsyth, D. (2008) · 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2008.4562953 · Cited by 616
SIFT Flow: Dense Correspondence across Different Scenes
Liu, C., Yuen, J., Torralba, A., Sivic, J., & Freeman, W. T. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88690-7_3 · Cited by 540
Self-citationScene completion using millions of photographs
Hays, J., & Efros, A. A. (2007) · ACM Transactions on Graphics · doi:10.1145/1276377.1276382 · Cited by 534
LOCUS: learning object classes with unsupervised segmentation
Winn, J., & Jojic, N. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.148 · Cited by 520
Peekaboom: a game for locating objects in images
von Ahn, L., Liu, R., & Blum, M. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124782 · Cited by 509
The Psycho-Biology of Language
(1936) · Notes and Queries · doi:10.1093/nq/clxx.mar28.234b · Cited by 507
A Bayesian Approach to Unsupervised One-Shot Learning of Object Categories
Fei-Fei, L., Fergus, R., & Perona, P. (2003) · Cited by 423
Laptev, I., & Perez, P. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4409105 · Cited by 416
A Bayesian approach to unsupervised one-shot learning of object categories
Fe-Fei, L., Fergus, & Perona (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238476 · Cited by 403
Tour into the picture: using a spidery mesh interface to make animation from a single image
Horry, Y., Anjyo, K.-I., & Arai, K. (1997) · Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97 · doi:10.1145/258734.258854 · Cited by 390
(1995) · Cited by 359
HumanEva: Synchronized video and Motion Capture Dataset for Evaluation of Articulated Human Motion
Sigal, L., Bălan, A. O., & Black, M. J. (2006) · Cited by 356
Image-based modeling and photo editing
Oh, B. M., Chen, M., Dorsey, J., & Durand, F. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383310 · Cited by 348
Nonparametric scene parsing: Label transfer via dense scene alignment
Liu, C., Yuen, J., & Torralba, A. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206536 · Cited by 315
Self-citationDynamic 3D Scene Analysis from a Moving Vehicle
Leibe, B., Cornelis, N., Cornelis, K., & Van Gool, L. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383146 · Cited by 300
Learning hierarchical models of scenes, objects, and parts
Sudderth, E. B., Torralba, A., Freeman, W. T., & Willsky, A. S. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.137 · Cited by 297
Self-citationTransfer learning for image classification with sparse prototype representations
Quattoni, A., Collins, M., & Darrell, T. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587637 · Cited by 252
A statistical approach to 3d object detection applied to faces and cars
Schneiderman, H., & Takeo Kanade, A. (2000) · Cited by 243
Lalonde, J.-F., Hoiem, D., Efros, A. A., Rother, C., Winn, J., & Criminisi, A. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276381 · Cited by 242
Learning 3-D Scene Structure from a Single Still Image
Saxena, A., Sun, M., & Ng, A. Y. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408828 · Cited by 223
Towards automatic discovery of object categories
Weber, M., Welling, M., & Perona, P. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.854754 · Cited by 218
Recovering Occlusion Boundaries from a Single Image
Hoiem, D., Stein, A. N., Efros, A. A., & Hebert, M. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408985 · Cited by 206
Dataset Issues in Object Recognition
Ponce, J., Berg, T. L., Everingham, M., Forsyth, D. A., Hebert, M., Lazebnik, S., Marszalek, M., Schmid, C., Russell, B. C., Torralba, A., et al. (2006) · Lecture Notes in Computer Science · doi:10.1007/11957959_2 · Cited by 204
Self-citationCross-Generalization: Learning Novel Classes from a Single Example by Feature Replacement
Bart, E., & Ullman, S. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.117 · Cited by 196
Yao, B., Yang, X., & Zhu, S.-C. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74198-5_14 · Cited by 188
Human-assisted motion annotation
Liu, C., Freeman, W. T., Adelson, E. H., & Weiss, Y. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587845 · Cited by 186
Hoiem, D., Efros, A. A., & Hebert, M. (2005) · ACM SIGGRAPH 2005 Papers · doi:10.1145/1186822.1073232 · Cited by 180
Beyond Nouns: Exploiting Prepositions and Comparative Adjectives for Learning Visual Classifiers
Gupta, A., & Davis, L. S. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88682-2_3 · Cited by 167
Unsupervised Learning of Categories from Sets of Partially Matching Image Features
Grauman, K., & Darrell, T. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.322 · Cited by 159
How many pixels make an image?
Torralba, A. B. (2009) · Visual Neuroscience · doi:10.1017/s0952523808080930 · Cited by 143
Self-citationRecognition by association via learning per-exemplar distances
Malisiewicz, T., & Efros, A. A. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587462 · Cited by 135
Single view modeling of free-form scenes
Zhang, L., Dugas‐Phocion, G., Samson, J., & Seitzt, S. M. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2001.990638 · Cited by 125
A bootstrapping algorithm for learning linear models of object classes
Vetter, T. R., Jones, M., & Poggio, T. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1997.609295 · Cited by 121
Figure/Ground Assignment in Natural Images
Ren, X., Fowlkes, C. C., & Malik, J. (2006) · Lecture notes in computer science · doi:10.1007/11744047_47 · Cited by 118
Object Recognition by Scene Alignment
Russell, B. C., Torralba, A. B., Liu, C., Fergus, R., & Freeman, W. T. (2007) · Cited by 104
Self-citationSingle‐view modelling of free‐form scenes
Zhang, L., Dugas‐Phocion, G., Samson, J., & Seitz, S. M. (2002) · The Journal of Visualization and Computer Animation · doi:10.1002/vis.291 · Cited by 93
An algebraic approach to shape-from-image problems
Sugihara, K. (1984) · Artificial Intelligence · doi:10.1016/0004-3702(84)90005-5 · Cited by 89
Extracting Subimages of an Unknown Category from a Set of Images
Todorović, S., & Ahuja, N. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.116 · Cited by 84
Building a database of 3D scenes from user annotations
Russell, B. C., & Torralba, A. B. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206643 · Cited by 76
Self-citationMulti-Level Active Prediction of Useful Image Annotations for Recognition
Vijayanarasimhan, S., & Grauman, K. L. (2008) · Cited by 70
Building intelligent systems one e-citizen at a time
Hearst, M. A., Hunson, R. D., & Stork, D. G. (1999) · IEEE Intelligent Systems and their Applications · doi:10.1109/5254.769877 · Cited by 69
Pyramid Match Hashing: Sub-Linear Time Indexing Over Partial Correspondences
Grauman, K. L., & Darrell, T. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383225 · Cited by 65
Detecting faces in impoverished images
Sinha, P., & Torralba, A. B. (2010) · Journal of Vision · doi:10.1167/2.7.601 · Cited by 42
Self-citationDepth Information by Stage Classification
Nedović, V., Smeulders, A. W. M., Redert, A., & Geusebroek, J. (2007) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2007.4409056 · Cited by 39
Detecting Faces in Impoverished Images
Torralba, A. B., & Sinha, P. (2001) · Defense Technical Information Center (DTIC) · doi:10.21236/ada636815 · Cited by 29
Self-citationActive learning for visual object recognition
Abramson, Y., Freund, Y., & Laxton, B. (2005) · Cited by 23
Depth-From-Recognition: Inferring Meta-data by Cognitive Feedback
Thomas, A., Ferrari, V., Leibe, B., Tuytelaars, T., & Gool, L. V. (2007) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2007.4408831 · Cited by 21
Measuring and Predicting Importance of Objects in Our Visual World
Spain, M., & Perona, P. (2007) · CaltechAUTHORS (California Institute of Technology) · Cited by 13
Cited by
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
Hmdb: a large video database for human motion recognition
Kuehne, H., Jhuang, H., Garrote, E., Poggio, T., & Serre, T. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126543 · Cited by 3,965
ShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T. A., Guibas, L. J., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2023) · doi:10.5281/zenodo.10089705 · Cited by 1,623
HMDB51: A Large Video Database for Human Motion Recognition
Kuehne, H., Jhuang, H., Stiefelhagen, R., & Serre, T. (2013) · High Performance Computing in Science and Engineering ‘12 · doi:10.1007/978-3-642-33374-3_41 · Cited by 377
Intelligent detection of fastener defects in ballastless tracks based on deep learning
Ye, W., Ren, J., Lu, C., Zhang, A. A., Zhan, Y., & Liu, J. (2024) · Automation in Construction · doi:10.1016/j.autcon.2024.105280 · Cited by 42
Metadata
- Authors
- Torralba, A., Russell, B. C., & Yuen, J.
- Venue
- Proceedings of the IEEE
- Published
- 2010-08
- Volume
- 98
- Issue
- 8
- Pages
- 1467-1484
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W2064985253
- Cited by
- 431
- References
- 89
- FWCI
- 10.69
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.