The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Context-based vision system for place and object recognition
Open accessAbstract
While navigating in an environment, a vision system has to be able to recognize where it is and what the main objects in the scene are. We present a context-based vision system for place and object recognition. The goal is to identify familiar locations (e.g., office 610, conference room 941, main street), to categorize new environments (office, corridor, street) and to use that information to provide contextual priors for object recognition (e.g., tables are more likely in an office than a street). We present a low-dimensional global image representation that provides relevant information for place recognition and categorization, and show how such contextual information introduces strong priors that simplify object recognition. We have trained the system to recognize over 60 locations (indoors and outdoors) and to suggest the presence and locations of more than 20 different object types. The algorithm has been integrated into a mobile system that provides realtime feedback to the user.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope
Oliva, A., & Torralba, A. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011139631724 · Cited by 6,319
Robust real-time object detection.
Viola, P. A. (2001) · IEEE/CVF International Conference on Computer Vision (ICCV) · Cited by 2,874
Visual learning and recognition of 3-d objects from appearance
Murase, H., & Nayar, S. K. (1995) · International Journal of Computer Vision · doi:10.1007/bf01421486 · Cited by 1,881
A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients
Portilla, J., & Simoncelli, E. P. (2000) · International Journal of Computer Vision · doi:10.1023/a:1026553619983 · Cited by 1,806 · cited 1×
“The textured images are generated by coercing noise to have the same features as the original image, while matching the statistics of natural images [8].”
BackgroundQuattoni, A., & Torralba, A. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206537 · Cited by 1,463
Probabilistic visual learning for object representation
Moghaddam, B., & Pentland, A. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598227 · Cited by 1,441
A Trainable System for Object Detection
Papageorgiou, C., & Poggio, T. (2000) · International Journal of Computer Vision · doi:10.1023/a:1008162616689 · Cited by 1,289
The steerable pyramid: a flexible architecture for multi-scale derivative computation
Simoncelli, E. P., & Freeman, W. T. (2002) · Proceedings., International Conference on Image Processing · doi:10.1109/icip.1995.537667 · Cited by 1,070
Appearance-based place recognition for topological localization
Ulrich, I., & Nourbakhsh, I. (2002) · Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065) · doi:10.1109/robot.2000.844734 · Cited by 512
Cited by
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
SUN database: Large-scale scene recognition from abbey to zoo
Xiao, J., Hays, J., Ehinger, K. A., Oliva, A., & Torralba, A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539970 · Cited by 3,283
80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition
Torralba, A., Fergus, R., & Freeman, W. T. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.128 · Cited by 1,921
Relation Networks for Object Detection
Hu, H., Gu, J., Zhang, Z., Dai, J., & Wei, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00378 · Cited by 1,524
FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance
Cummins, M., & Newman, P. (2008) · The International Journal of Robotics Research · doi:10.1177/0278364908090961 · Cited by 1,472
“More recently Torralba et al. (2003) represent places by a set of texture features, and describe a system where localization is cast as estimating the state of a hidden Markov model.”
BackgroundQuattoni, A., & Torralba, A. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206537 · Cited by 1,463
The Role of Context for Object Detection and Semantic Segmentation in the Wild
Mottaghi, R., Chen, X., Liu, X., Cho, N.-G., Lee, S.-W., Fidler, S., Urtasun, R., & Yuille, A. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.119 · Cited by 1,438
“[37] penalize the presence of objects in irrelevant scenes.”
BackgroundVisual Place Recognition: A Survey
Lowry, S., Sünderhauf, N., Newman, P., Leonard, J. J., Cox, D., Corke, P., & Milford, M. J. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2496823 · Cited by 1,079
Multiscale conditional random fields for image labeling
He, X., Zemel, R. S., & Carreira-Perpinan, M. A. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315232 · Cited by 828
Hu, P., & Ramanan, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.166 · Cited by 705
Scene completion using millions of photographs
Hays, J., & Efros, A. A. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276382 · Cited by 687
A survey and performance evaluation of deep learning methods for small object detection
Liu, Y., Sun, P., Wergeles, N., & Shang, Y. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114602 · Cited by 665
Chen, D., Cao, X., Wen, F., & Sun, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.389 · Cited by 615
Human Reidentification with Transferred Metric Learning
Li, W., Zhao, R., & Wang, X. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-37331-2_3 · Cited by 591
On the performance of ConvNet features for place recognition
Sunderhauf, N., Shirazi, S., Dayoub, F., Upcroft, B., & Milford, M. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353986 · Cited by 544
Scene completion using millions of photographs
Hays, J., & Efros, A. A. (2007) · ACM Transactions on Graphics · doi:10.1145/1276377.1276382 · Cited by 534
Rapid Biologically-Inspired Scene Classification Using Features Shared with Visual Attention
Siagian, C., & Itti, L. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.40 · Cited by 526
Recovering human body con .gurations:combining segmentation and recognition
Mori, G., Ren, X., Efros, A. A., & Malik, J. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315182 · Cited by 507
Gather-Excite: Exploiting Feature Context in Convolutional Neural Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Vedaldi, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.12348 · Cited by 462
Object categorization using co-occurrence, location and appearance
Galleguillos, C., Rabinovich, A., & Belongie, S. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587799 · Cited by 457
InLoc: Indoor Visual Localization with Dense Matching and View Synthesis
Taira, H., Okutomi, M., Sattler, T., Cimpoi, M., Pollefeys, M., Sivic, J., Pajdla, T., & Torii, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00752 · Cited by 449
Malware Classification with Deep Convolutional Neural Networks
Kalash, M., Rochan, M., Mohammed, N., Bruce, N. D. B., Wang, Y., & Iqbal, F. (2018) · 2018 9th IFIP International Conference on New Technologies, Mobility and Security (NTMS) · doi:10.1109/ntms.2018.8328749 · Cited by 408
City-scale landmark identification on mobile devices
Chen, D. M., Baatz, G., Koser, K., Tsai, S. S., Vedantham, R., Pylvanainen, T., Roimela, K., Chen, X., Bach, J., Pollefeys, M., et al. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995610 · Cited by 400
R-CNN for Small Object Detection
Chen, C., Liu, M.-Y., Tuzel, O., & Xiao, J. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-54193-8_14 · Cited by 392
Learning Spatial Context: Using Stuff to Find Things
Heitz, G., & Koller, D. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88682-2_4 · Cited by 372
Hierarchical spatio-temporal context modeling for action recognition
Sun, J., Wu, X., Yan, S., Cheong, L.-F., Chua, T.-S., & Li, J. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206721 · Cited by 358
Spatial Pyramid-Enhanced NetVLAD With Weighted Triplet Loss for Place Recognition
Yu, J., Zhu, C., Zhang, J., Huang, Q., & Tao, D. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2908982 · Cited by 352
Context based object categorization: A critical survey
Galleguillos, C., & Belongie, S. (2010) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2010.02.004 · Cited by 351
“Many object categorization frameworks have incorporated this prior information for their localization tasks [20,27,34, 36 ,37].”
50 Years of object recognition: Directions forward
Andreopoulos, A., & Tsotsos, J. K. (2013) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2013.04.005 · Cited by 347
“Various knowledge representation schemes were implemented over the years in order to improve the performance of vision systems, through the integration of task-specific knowledge [116], [117], [118],[119], [120], [121], [122], [123].”
BackgroundKhosla, A., Das Sarma, A., & Hamid, R. (2014) · Proceedings of the 23rd international conference on World wide web · doi:10.1145/2566486.2567996 · Cited by 343
Modeling scenes with local descriptors and latent aspects
Quelhas, P., Monay, F., Odobez, J.-M., Gatica-Perez, D., Tuytelaars, T., & Van Gool, L. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.152 · Cited by 343
SUN Database: Exploring a Large Collection of Scene Categories
Xiao, J., Ehinger, K. A., Hays, J., Torralba, A., & Oliva, A. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-014-0748-y · Cited by 331
Graph Cut Based Inference with Co-occurrence Statistics
Ladicky, L., Russell, C., Kohli, P., & Torr, P. H. S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15555-0_18 · Cited by 308
ContextLocNet: Context-Aware Deep Network Models for Weakly Supervised Localization
Kantorov, V., Oquab, M., Cho, M., & Laptev, I. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_22 · Cited by 266
ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers
Laput, G., Xiao, R., & Harrison, C. (2016) · Proceedings of the 29th Annual Symposium on User Interface Software and Technology · doi:10.1145/2984511.2984582 · Cited by 265
Content-Based Photo Quality Assessment
Tang, X., Luo, W., & Wang, X. (2013) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2013.2269899 · Cited by 253
Deng, Z., Vahdat, A., Hu, H., & Mori, G. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.516 · Cited by 253
Large-scale semantic mapping and reasoning with heterogeneous modalities
Pronobis, A., & Jensfelt, P. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6224637 · Cited by 248
Iterative Visual Reasoning Beyond Convolutions
Chen, X., Li, L.-J., Fei-Fei, L., & Gupta, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00756 · Cited by 236
Tsintotas, K. A., Bampis, L., & Gasteratos, A. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3175656 · Cited by 175
Contextual Priming and Feedback for Faster R-CNN
Shrivastava, A., & Gupta, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_20 · Cited by 153
Contextual recognition of head gestures,
Morency, L.-P., Sidner, C., Lee, C., & Darrell, T. (2005) · Proceedings of the 7th international conference on Multimodal interfaces · doi:10.1145/1088463.1088470 · Cited by 130
Grauman, K., & Leibe, B. (2011) · Synthesis Lectures on Artificial Intelligence and Machine Learning · doi:10.2200/s00332ed1v01y201103aim011 · Cited by 126
Efficient levels of spatial pyramid representation for local binary patterns
Akoushideh, A., & Mazloom‐Nezhad Maybodi, B. (2015) · IET Computer Vision · doi:10.1049/iet-cvi.2015.0028 · Cited by 7
Metadata
- Authors
- Torralba, Murphy, Freeman, & Rubin
- Venue
- Proceedings Ninth IEEE International Conference on Computer Vision
- Publisher
- IEEE
- Published
- 2003
- Pages
- 273-280 vol.1
- OpenAlex
- W2128554449
- Cited by
- 867
- References
- 20
- FWCI
- 22.21
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.