Finding any Waldo with zero-shot invariant and efficient visual search
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Searching for a target object in a cluttered scene constitutes a fundamental challenge in daily vision. Visual search must be selective enough to discriminate the target from distractors, invariant to changes in the appearance of the target, efficient to avoid exhaustive exploration of the image, and must generalize to locate novel target objects with zero-shot training. Previous work on visual search has focused on searching for perfect matches of a target after extensive category-specific training. Here, we show for the first time that humans can efficiently and invariantly search for natural objects in complex scenes. To gain insight into the mechanisms that guide visual search, we propose a biologically inspired computational model that can locate targets without exhaustive sampling and which can generalize to novel objects. The model provides an approximation to the mechanisms integrating bottom-up and top-down signals during search in natural scenes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Hierarchical models of object recognition in cortex
Riesenhuber, M., & Poggio, T. (1999) · Nature Neuroscience · doi:10.1038/14819 · Cited by 3,309
Klein, R. M. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01452-2 · Cited by 2,017
(2011) · doi:10.5591/978-1-57735-516-8/ijcai11-210 · Cited by 1,229
A source for feature-based attention in the prefrontal cortex
Bichot, N. P., Heard, M. T., DeGennaro, E. M., & Desimone, R. (2015) · Neuron · doi:10.1016/j.neuron.2015.10.001 · Cited by 283
Hamker, F. H. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhh146 · Cited by 217
Cited by
V*: Guided Visual Search as a Core Mechanism in Multimodal LLMs
Wu, P., & Xie, S. (2023) · arXiv · doi:10.48550/arxiv.2312.14135 · Cited by 74
V*: Guided Visual Search as a Core Mechanism in Multimodal LLMs
Wu, P., & Xie, S. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01243 · Cited by 74
“IVSN [59] uses convolutional networks to compute the similarity map between the search image and the target template and perform the search greedily.”
MethodUnder-exploration of three-dimensional images leads to search errors for small salient targets
Lago, M. A., Jonnalagadda, A., Abbey, C. K., Barufaldi, B. B., Bakic, P. R., Maidment, A. D. A., Leung, W. K., Weinstein, S. P., Englander, B. S., & Eckstein, M. P. (2021) · Current Biology · doi:10.1016/j.cub.2020.12.029 · Cited by 22
Li, G., Xu, J., Zhao, Y., & Peng, Y. (2025) · 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52734.2025.00850 · Cited by 12
“Inspired by human visual search and its connection to eye movements, early methods simulated this process using Bayesian frameworks with saliency maps [38, 42], deep networks for similarity mapping [60], or inverse reinforcement learning (IRL) to learn search strategies [53].”
Metadata
- Authors
- Zhang, M., Feng, J., Ma, K. T., Lim, J. H., Zhao, Q., & Kreiman, G.
- Venue
- Nature Communications
- Published
- 2018-09-13
- Volume
- 9
- Issue
- 1
- Pages
- 3730-3730
- ISSN
- 2041-1723 (ISSN-L)
- OpenAlex
- W2801144650
- Cited by
- 55
- References
- 8
- FWCI
- 2.12
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Finding any Waldo with zero-shot invariant and efficient visual search. https://app.cochat.ai/papers/10.1038/s41467-018-06217-x
- The paper
- Zhang, M., Feng, J., Ma, K. T., Lim, J. H., Zhao, Q., & Kreiman, G. (2018). Finding any Waldo with zero-shot invariant and efficient visual search. Nature Communications. https://doi.org/10.1038/s41467-018-06217-x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.