SALICON: Saliency in Context
The DOI matches its Crossref record; 38 of the 40 references it cites were found in a registry or an index.
Abstract
Saliency in Context (SALICON) is an ongoing effort that aims at understanding and predicting visual attention. This paper presents a new method to collect large-scale human data during natural explorations on images. While current datasets present a rich set of images and task-specific annotations such as category labels and object segments, this work focuses on recording and logging how humans shift their attention during visual exploration. The goal is to offer new possibilities to (1) complement task-specific annotations to advance the ultimate goal in visual understanding, and (2) understand visual attention and learn saliency models, all with human attentional data at a much larger scale. We designed a mouse-contingent multi-resolutional paradigm based on neurophysiological and psychophysical studies of peripheral vision, to simulate the natural viewing behavior of humans. The new paradigm allowed using a general-purpose mouse instead of an eye tracker to record viewing behaviors, thus enabling large-scale data collection. The paradigm was validated with controlled laboratory as well as large-scale online data. We report in this paper a proof-of-concept SALICON dataset of human “free-viewing” data on 10,000 images from the Microsoft COCO (MS COCO) dataset with rich contextual information. We evaluated the use of the collected data in the context of saliency prediction, and demonstrated them a good source as ground truth for the evaluation of saliency algorithms.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“To solve this problem, supervised attention methods tried to use additional loss functions to learn to predict gold attention on a manually labeled corpus [31,49,102].”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [49]
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Brainard, D. H. (1997) · Spatial Vision · doi:10.1163/156856897x00357 · Cited by 19,702
A model of saliency-based visual attention for rapid scene analysis
Itti, L., Koch, C., & Niebur, E. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730558 · Cited by 11,271
The VideoToolbox software for visual psychophysics: transforming numbers into movies
Pelli, D. G. (1997) · Spatial Vision · doi:10.1163/156856897x00366 · Cited by 11,098
Harel, J., Koch, C., & Perona, P. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0073 · Cited by 3,439
SUN database: Large-scale scene recognition from abbey to zoo
Xiao, J., Hays, J., Ehinger, K. A., Oliva, A., & Torralba, A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539970 · Cited by 3,283
ImageNet: A large-scale hierarchical image database
Deng, J. H., Dong, W. F., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206848 · Cited by 2,714
Learning to predict where humans look
Judd, T., Ehinger, K., Durand, F., & Torralba, A. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459462 · Cited by 2,016
80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition
Torralba, A., Fergus, R., & Freeman, W. T. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.128 · Cited by 1,921
Research works printed but not linked: 3
- 10.1097/00006324-199806000-00024 · doi:10.1097/00006324-199806000-00024
- hunziker, 2006, Im Auge des Lesers: foveale und periphere Wahrnehmung - vom Buchstabieren zur Lesefreude, Trans-media Verlag
- shen, 2014, Webpage saliency, ECCV, 33
Cited by
Items 101–200 of 736
Saliency for fine-grained object recognition in domains with scarce training data
Figueroa-Flores, C., González-García, A., van de Weijer, J., & Raducanu, B. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.05.002 · Cited by 59
Personal Fixations-Based Object Segmentation With Object Localization and Boundary Preservation
Li, G., Liu, Z., Shi, R., Hu, Z., Wei, W., Wu, Y., Huang, M., & Ling, H. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3044440 · Cited by 60
Tidying Deep Saliency Prediction Architectures
Reddy, N., Jain, S., Yarlagadda, P., & Gandhi, V. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341574 · Cited by 58
A Deeper Look at Saliency: Feature Contrast, Semantics, and Beyond
Bruce, N. D. B., Catton, C., & Janjić, S. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.62 · Cited by 58
Chen, X.-W., Zheng, A.-L., Li, J., & Lu, F. (2017) · IEEE International Conference on Computer Vision · doi:10.1109/iccv.2017.119 · Cited by 57
Human attention guided explainable artificial intelligence for computer vision models
Liu, G., Zhang, J., Chan, A. B., & Hsiao, J. H. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106392 · Cited by 69
Personalized Saliency and Its Prediction
Xu, Y., Gao, S., Wu, J., Li, N., & Yu, J. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2866563 · Cited by 61
Visual Attention Analysis and Prediction on Human Faces for Children with Autism Spectrum Disorder
Duan, H., Min, X., Fang, Y., Fan, L., Yang, X., & Zhai, G. (2019) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3337066 · Cited by 62
Decision Weights for Experimental Asset Prices Based on Visual Salience
Bose, D., Cordes, H., Nolte, S., Schneider, J. C., & Camerer, C. F. (2022) · Review of Financial Studies · doi:10.1093/rfs/hhac027 · Cited by 65
“Looking at the Right Stuff” – Guided Semantic-Gaze for Autonomous Driving
Pal, A., Mondal, S., & Christensen, H. I. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01190 · Cited by 66
Boosted Attention: Leveraging Human Attention for Image Captioning
Chen, S., & Zhao, Q. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01252-6_5 · Cited by 59
Self-citationImage Cropping with Composition and Saliency Aware Aesthetic Score Map
Tu, Y., Niu, L., Zhao, W., Cheng, D., & Zhang, L. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6889 · Cited by 53
COCO-Search18 fixation dataset for predicting goal-directed attention control
Chen, Y., Yang, Z., Ahn, S., Samaras, D., Hoai, M., & Zelinsky, G. J. (2021) · Scientific Reports · doi:10.1038/s41598-021-87715-9 · Cited by 78
ECANet: Explicit cyclic attention-based network for video saliency prediction
Xue, H., Sun, M., & Liang, Y. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.10.024 · Cited by 52
GOO: A Dataset for Gaze Object Prediction in Retail Environments
Tomas, H., Reyes, M., Dionido, R., Ty, M. V., Mirando, J., Casimiro, J., Atienza, R., & Guinto, R. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00349 · Cited by 51
Learning where to search using visual attention
Kloss, A., Kappler, D., Lensch, H. P. A., Butz, M. V., Schaal, S., & Bohg, J. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759770 · Cited by 51
Visual explanation of black-box model: Similarity Difference and Uniqueness (SIDU) method
Muddamsetty, S. M., Jahromi, M. N. S., Ciontos, A. E., Fenoy, L. M., & Moeslund, T. B. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.108604 · Cited by 55
Anwyl-Irvine, A. L., Armstrong, T., & Dalmaijer, E. S. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01703-5 · Cited by 59
Duan, H., Shen, W., Min, X., Tu, D., Li, J., & Zhai, G. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3547955 · Cited by 55
Attentive Deep Stitching and Quality Assessment for 360$^{\circ }$ Omnidirectional Images
Li, J., Zhao, Y., Ye, W., Yu, K., & Ge, S. (2019) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2019.2953950 · Cited by 56
Composing Photos Like a Photographer
Hong, C., Du, S., Xian, K., Lü, H., Cao, Z., & Zhong, W. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00698 · Cited by 51
Understanding and Visualizing Deep Visual Saliency Models
He, S., Tavakoli, H. R., Borji, A., Mi, Y., & Pugeault, N. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01045 · Cited by 49
Human Attention in Image Captioning: Dataset and Analysis
He, S., Tavakoli, H. R., Borji, A., & Pugeault, N. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00862 · Cited by 59
Human Gaze Assisted Artificial Intelligence: A Review
Zhang, R., Saran, A., Liu, B., Zhu, Y., Guo, S., Niekum, S., Ballard, D., & Hayhoe, M. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/689 · Cited by 48
“Hence researchers have often used alternative meth-ods as surrogates for gaze data, such as mouse tracking [Jiang et al. , 2015].”
MethodSpatio-Temporal Modeling and Prediction of Visual Attention in Graphical User Interfaces
Xu, P., Sugano, Y., & Bulling, A. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858479 · Cited by 48
Look Both Ways: Self-supervising Driver Gaze Estimation and Road Scene Saliency
Kasahara, I., Stent, S., & Park, H. S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19778-9_8 · Cited by 63
TempSAL - Uncovering Temporal Information for Deep Saliency Prediction
Aydemir, B., Hoffstetter, L., Zhang, T., Salzmann, M., & Süsstrunk, S. (2023) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52729.2023.00625 · Cited by 42
Velasco, C., Escobar, F. B., Spence, C. J., & Olier, J. S. (2023) · Food Quality and Preference · doi:10.1016/j.foodqual.2023.105009 · Cited by 47
A Unified Framework for Salient Structure Detection by Contour-Guided Visual Search
Yang, K.-F., Li, H., Li, C.-Y., & Li, Y.-J. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2572600 · Cited by 45
SaliencyRank: Two-stage manifold ranking for salient object detection
Qi, W., Cheng, M., Borji, A., Lu, H., & Bai, L. (2015) · Computational Visual Media · doi:10.1007/s41095-015-0028-y · Cited by 45
How Much Time Do You Have? Modeling Multi-Duration Saliency
Fosco, C. L., Newman, A., Sukhum, P., Zhang, Y. B., Zhao, N., Oliva, A., & Bylinskii, Z. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00453 · Cited by 44
Learning Where to Look While Tracking Instruments in Robot-Assisted Surgery
Islam, M., Li, Y., & Ren, H. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32254-0_46 · Cited by 43
Scanpath Prediction on Information Visualisations
Wang, Y., Bâce, M., & Bulling, A. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3242293 · Cited by 42
Top-down saliency detection driven by visual classification
Murabito, F., Spampinato, C., Palazzo, S., Giordano, D., Pogorelov, K., & Riegler, M. A. (2018) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.03.005 · Cited by 47
SBAS: Salient Bundle Adjustment for Visual SLAM
Wang, K., Ma, S., Ren, F., & Lǚ, J. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3105243 · Cited by 46
Con-Text: Text Detection for Fine-Grained Object Classification
Karaoğlu, S., Ran, T., van Gemert, J. C., & Gevers, T. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2707805 · Cited by 46
Inferring Attention Shift Ranks of Objects for Image Saliency
Siris, A., Jiao, J.-B., Tam, G., Xie, X.-H., & Lau, R. W. H. (2020) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr42600.2020.01215 · Cited by 44
Saliency Revisited: Analysis of Mouse Movements Versus Fixations
Tavakoli, H. R., Ahmed, F., Borji, A., & Laaksonen, J. T. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.673 · Cited by 49
What are the Visual Features Underlying Human Versus Machine Vision?
Linsley, D. A., Eberhardt, S., Sharma, T., Gupta, P., & Serre, T. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.331 · Cited by 55
Identifying Children with Autism Spectrum Disorder Based on Gaze-Following
Fang, Y., Duan, H., Shi, F., Min, X., & Zhai, G. (2020) · Proceedings - International Conference on Image Processing · doi:10.1109/icip40778.2020.9190831 · Cited by 39
Islam, M., Vibashan, V. S., Lim, C. M., & Ren, H. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101837 · Cited by 50
A Spatial-Temporal Recurrent Neural Network for Video Saliency Prediction
Zhang, K., Chen, Z., & Liu, S. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3036749 · Cited by 42
Understanding and Predicting the Memorability of Outdoor Natural Scenes
Lu, J., Xu, M., Yang, R., & Wang, Z. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2975957 · Cited by 41
Kümmerer, M., & Bethge, M. (2023) · Annual Review of Vision Science · doi:10.1146/annurev-vision-120822-072528 · Cited by 46
Saliency Weighted Convolutional Features for Instance Search
Mohedano, E., McGuinness, K., Giró-i-Nieto, X., & O'Connor, N. E. (2018) · International Workshop on Content-Based Multimedia Indexing (CBMI) · doi:10.1109/cbmi.2018.8516500 · Cited by 45
Zheng, Q., Jiao, J., Cao, Y. S., & Lau, R. W. H. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01264-9_18 · Cited by 37
Tian, H., Deng, T., & Yan, H. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.105716 · Cited by 42
Toward Visual Behavior and Attention Understanding for Augmented 360 Degree Videos
Zhu, Y., Min, X., Zhu, D., Zhai, G., Yang, X., Zhang, W., Gu, K., & Zhou, J. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3565024 · Cited by 51
SMGEA: A New Ensemble Adversarial Attack Powered by Long-Term Gradient Memories
Che, Z., Borji, A., Zhai, G., Ling, S., Li, J., Min, X., Guo, G., & Callet, P. L. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3039295 · Cited by 38
A Comparison Study of Saliency Models for Fixation Prediction on Infants and Adults
Mahdi, A., Su, M., Schlesinger, M., & Qin, J. (2018) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2017.2696439 · Cited by 32
SalFBNet: Learning pseudo-saliency distribution via feedback convolutional networks
Ding, G., İmamoğlu, N., Çağlayan, A., Murakawa, M., & Nakamura, R. (2022) · Image and Vision Computing · doi:10.1016/j.imavis.2022.104395 · Cited by 35
Tracking the gaze on objects in 3D: how do people really look at the bunny?
Wang, X., Koch, S., Holmqvist, K., & Alexa, M. (2018) · ACM Transactions on Graphics · doi:10.1145/3272127.3275094 · Cited by 40
Rethinking 360° Image Visual Attention Modelling with Unsupervised Learning
Djilali, Y. A. D., Krishna, T., McGuinness, K., & O'Connor, N. E. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01513 · Cited by 39
Zhao, H., Lu, M., Yao, A., Chen, Y., & Zhang, L. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01263-4 · Cited by 42
Saliency-Guided Image Translation
Jiang, L. W., Xu, M., Wang, X., & Sigal, L. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01624 · Cited by 34
Egner, S., Reimann, S., Höger, R., & Zangemeister, W. H. (2018) · Journal of Eye Movement Research · doi:10.16910/jemr.11.6.4 · Cited by 33
ViTOR: Learning to Rank Webpages Based on Visual Features
van den Akker, B., Markov, I., & de Rijke, M. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313419 · Cited by 31
Yang, Z., Mondal, S., Ahn, S., Zelinsky, G. J., Hoai, M., & Samaras, D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19772-7_4 · Cited by 39
A New Ensemble Adversarial Attack Powered by Long-Term Gradient Memories
Che, Z., Borji, A., Zhai, G., Ling, S., Li, J., & Callet, P. L. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5743 · Cited by 42
Instance-Level Relative Saliency Ranking with Graph Reasoning
Liu, N., Li, L., Zhao, W., Han, J., & Shao, L. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3107872 · Cited by 38
Salient Object Ranking with Position-Preserved Attention
Fang, H., Zhang, D., Zhang, Y., Chen, M., Li, J., Hu, Y. G., Cai, D., & He, X. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01602 · Cited by 30
Scanpath and saliency prediction on 360 degree images
Assens, M., Giró-i-Nieto, X., McGuinness, K., & O'Connor, N. E. (2018) · Signal Processing Image Communication · doi:10.1016/j.image.2018.06.006 · Cited by 30
Uncertainty-Aware Visual Perception System for Outdoor Navigation of the Visually Challenged
Dimas, G., Diamantis, D. E., Kalozoumis, P. G., & Iakovidis, D. K. (2020) · Sensors · doi:10.3390/s20082385 · Cited by 30
Das, A., Wu, Z., Škrjanec, I., & Feit, A. M. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3655610 · Cited by 34
A review of machine learning in scanpath analysis for passive gaze-based interaction
Selim, A. M., Barz, M., Bhatti, O. S., Alam, H., & Sonntag, D. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1391745 · Cited by 34
Gorji, S., & Clark, J. J. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.370 · Cited by 29
Learning Coupled Convolutional Networks Fusion for Video Saliency Prediction
Wu, Z., Su, L., & Huang, Q. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2870954 · Cited by 29
Bio-Inspired Representation Learning for Visual Attention Prediction
Yuan, Y., Ning, H., & Lu, X. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2931735 · Cited by 29
A Novel Heterogeneous Network for Modeling Driver Attention With Multi-Level Visual Content
Hu, Z., Zhang, Y., Li, Q., & Lv, C. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3208004 · Cited by 29
G-VOILA: Gaze-Facilitated Information Querying in Daily Scenarios
Wang, Z. S., Shi, Y., Wang, Y., Yao, Y. X., Yan, K., Wang, Y., Ji, L., Xu, X., & Yu, C. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3659623 · Cited by 42
EyeFormer: Predicting Personalized Scanpaths with Transformer-Guided Reinforcement Learning
Jiang, Y., Guo, Z., Tavakoli, H. R., Leiva, L. A., & Oulasvirta, A. (2024) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3654777.3676436 · Cited by 37
Chao, F.-Y., Zhang, L., Hamidouche, W., & Olivier Déforges, A. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3003642 · Cited by 28
Deep saliency models learn low-, mid-, and high-level features to predict scene attention
Hayes, T. R., & Henderson, J. M. (2021) · Scientific Reports · doi:10.1038/s41598-021-97879-z · Cited by 28
Thinking Like a Developer? Comparing the Attention of Humans with Neural Models of Code
Paltenghi, M., & Pradel, M. (2021) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase51524.2021.9678712 · Cited by 39
A Scanner Deeply: Predicting Gaze Heatmaps on Visualizations Using Crowdsourced Eye Movement Data
Shin, S., Chung, S., Hong, S., & Elmqvist, N. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3209472 · Cited by 36
Gurnani, A., Shah, K., Gajjar, V., Mavani, V., & Khandhediya, Y. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00094 · Cited by 31
Adversarial Attack Against Deep Saliency Models Powered by Non-Redundant Priors
Che, Z., Borji, A., Zhai, G., Ling, S., Li, J., Tian, Y., Guo, G., & Callet, P. L. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3050303 · Cited by 33
Emotion-Aware Human Attention Prediction
Cordel, M. O., Fan, S., Shen, Z., & Kankanhalli, M. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00415 · Cited by 27
Sensing Accident-Prone Features in Urban Scenes for Proactive Driving and Accident Prevention
Mishra, S., Rajendran, P. K., Vecchietti, L. F., & Har, D. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3271395 · Cited by 30
Rethinking Object Saliency Ranking: A Novel Whole-Flow Processing Paradigm
Song, M., Li, L., Wu, D., Song, W., & Chen, C. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3341332 · Cited by 28
SAM: Pushing the Limits of Saliency Prediction Models
Cornia, M., Baraldi, L., Serra, G., & Cucchiara, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00250 · Cited by 27
Wang, Z., Liu, Z., Wei, W., & Duan, H. (2021) · Image and Vision Computing · doi:10.1016/j.imavis.2021.104149 · Cited by 27
TransView: Inside, Outside, and Across the Cropping View Boundaries
Pan, Z., Cao, Z., Wang, K., Lü, H., & Zhong, W. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00418 · Cited by 27
Direction Concentration Learning: Enhancing Congruency in Machine Learning
Luo, Y., Wong, Y., Kankanhalli, M., & Zhao, Q. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2963387 · Cited by 30
Self-citationCross-Domain Multi-task Learning for Object Detection and Saliency Estimation
Khattar, A., Hegde, S., & Hebbalaguppe, R. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00403 · Cited by 33
Harmonious Textual Layout Generation Over Natural Images via Deep Aesthetics Learning
Li, C., Zhang, P., & Wang, C. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3097900 · Cited by 26
Weakly Supervised Visual Saliency Prediction
Zhou, L., Zhou, T., Khan, S. H., Sun, H., Shen, J., & Shao, L. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3158064 · Cited by 26
Beyond Average: Individualized Visual Scanpath Prediction
Chen, X., Jiang, M., & Zhao, Q. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02402 · Cited by 33
Self-citationMulti-level Net: A Visual Saliency Prediction Model
Cornia, M., Baraldi, L., Serra, G., & Cucchiara, R. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-48881-3_21 · Cited by 26
Visual saliency for image captioning in new multimedia services
Cornia, M., Baraldi, L., Serra, G., & Cucchiara, R. (2017) · IEEE International Conference on Multimedia & Expo Workshops (ICMEW) · doi:10.1109/icmew.2017.8026277 · Cited by 30
Influence of image classification accuracy on saliency map estimation
Oyama, T., & Yamanaka, T. (2018) · CAAI Transactions on Intelligence Technology · doi:10.1049/trit.2018.1012 · Cited by 25
Deep Saliency Prior for Reducing Visual Distraction
Aberman, K., He, J., Gandelsman, Y., Mosseri, I., Jacobs, D. E., Kohlhoff, K., Pritch, Y., & Rubinstein, M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01923 · Cited by 25
Deng, T., Jiang, L., Shi, Y., Wu, J., Wu, Z., Yan, S., Zhang, X.-S., & Yan, H. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3323468 · Cited by 25
Neves, J., Hsieh, C., Nobre, I. B., Sousa, S. C., Ouyang, C., Maciel, A., Duchowski, A. T., Jorge, J. A., & Moreira, C. (2024) · European Journal of Radiology · doi:10.1016/j.ejrad.2024.111341 · Cited by 28
Hosseini, A., Hooshanfar, K., Omrani, P., Toosi, R., Toosi, R., Ebrahimian, Z., & Akhaee, M. A. (2025) · Discover Applied Sciences · doi:10.1007/s42452-025-07043-9 · Cited by 25
Beyond Universal Saliency: Personalized Saliency Prediction with Multi-task CNN
Xu, Y., Li, N., Wu, J., Jingyi Yu, A., & Gao, S. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/543 · Cited by 25
Human scanpath prediction based on deep convolutional saccadic model
Bao, W., & Chen, Z. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.03.060 · Cited by 25
Deep saliency models : The quest for the loss function
Bruckert, A., Tavakoli, H. R., Liu, Z., Christie, M., & Meur, O. L. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.06.131 · Cited by 25
Two-Stream Convolutional Networks for Dynamic Saliency Prediction.Preprint
Bak, Ç., Erdem, A., & Erdem, E. (2016) · arXiv (Cornell University) · Cited by 25
Auditing saliency cropping algorithms
Birhane, A., Prabhu, V. U., & Whaley, J. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00158 · Cited by 32
Metadata
- Authors
- Jiang, M., Huang, S., Duan, J., & Zhao, Q.
- Affiliations
- National University of Singapore (SG)
- ORCID
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 1072-1080
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W1934890906
- Cited by
- 729
- References
- 40
- Citations by year
- 2026: 30 · 2025: 58 · 2024: 75 · 2023: 76 · 2022: 75 · 2021: 100 · 2020: 93 · 2019: 84 · 2018: 60 · 2017: 44 · 2016: 27 · 2015: 7
- FWCI
- 18.87
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- visual attention, saliency prediction, peripheral vision
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.