SALICON: Saliency in Context
The DOI matches its Crossref record; 38 of the 40 references it cites were found in a registry or an index.
Abstract
Saliency in Context (SALICON) is an ongoing effort that aims at understanding and predicting visual attention. This paper presents a new method to collect large-scale human data during natural explorations on images. While current datasets present a rich set of images and task-specific annotations such as category labels and object segments, this work focuses on recording and logging how humans shift their attention during visual exploration. The goal is to offer new possibilities to (1) complement task-specific annotations to advance the ultimate goal in visual understanding, and (2) understand visual attention and learn saliency models, all with human attentional data at a much larger scale. We designed a mouse-contingent multi-resolutional paradigm based on neurophysiological and psychophysical studies of peripheral vision, to simulate the natural viewing behavior of humans. The new paradigm allowed using a general-purpose mouse instead of an eye tracker to record viewing behaviors, thus enabling large-scale data collection. The paradigm was validated with controlled laboratory as well as large-scale online data. We report in this paper a proof-of-concept SALICON dataset of human “free-viewing” data on 10,000 images from the Microsoft COCO (MS COCO) dataset with rich contextual information. We evaluated the use of the collected data in the context of saliency prediction, and demonstrated them a good source as ground truth for the evaluation of saliency algorithms.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“To solve this problem, supervised attention methods tried to use additional loss functions to learn to predict gold attention on a manually labeled corpus [31,49,102].”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [49]
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Brainard, D. H. (1997) · Spatial Vision · doi:10.1163/156856897x00357 · Cited by 19,702
A model of saliency-based visual attention for rapid scene analysis
Itti, L., Koch, C., & Niebur, E. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730558 · Cited by 11,271
The VideoToolbox software for visual psychophysics: transforming numbers into movies
Pelli, D. G. (1997) · Spatial Vision · doi:10.1163/156856897x00366 · Cited by 11,098
Harel, J., Koch, C., & Perona, P. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0073 · Cited by 3,439
SUN database: Large-scale scene recognition from abbey to zoo
Xiao, J., Hays, J., Ehinger, K. A., Oliva, A., & Torralba, A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539970 · Cited by 3,283
ImageNet: A large-scale hierarchical image database
Deng, J. H., Dong, W. F., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206848 · Cited by 2,714
Learning to predict where humans look
Judd, T., Ehinger, K., Durand, F., & Torralba, A. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459462 · Cited by 2,016
80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition
Torralba, A., Fergus, R., & Freeman, W. T. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.128 · Cited by 1,921
Research works printed but not linked: 3
- 10.1097/00006324-199806000-00024 · doi:10.1097/00006324-199806000-00024
- hunziker, 2006, Im Auge des Lesers: foveale und periphere Wahrnehmung - vom Buchstabieren zur Lesefreude, Trans-media Verlag
- shen, 2014, Webpage saliency, ECCV, 33
Cited by
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361
A Comprehensive Survey of Deep Learning for Image Captioning
Hossain, M. Z., Sohel, F., Shiratuddin, M. F., & Laga, H. (2019) · ACM Computing Surveys · doi:10.1145/3295748 · Cited by 879
“For experiments, it uses SALICON dataset [60] and achieves good results.”
MethodSalient Object Detection in the Deep Learning Era: An In-Depth Survey
Wang, W., Lai, Q., Fu, H., Shen, J., Ling, H., & Yang, R. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3051099 · Cited by 811
What Do Different Evaluation Metrics Tell Us About Saliency Models?
Bylinskii, Z., Judd, T., Oliva, A., Torralba, A., & Durand, F. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2815601 · Cited by 802
Deep Visual Attention Prediction
Wang, W., & Shen, J. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2787612 · Cited by 585
Simultaneously Localize, Segment and Rank the Camouflaged Objects
Lv, Y., Zhang, J., Dai, Y., Li, A., Liu, B., Barnes, N., & Fan, D.-P. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01142 · Cited by 584
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021) · arXiv · doi:10.48550/arxiv.2107.13586 · Cited by 4,352
Shallow and Deep Convolutional Networks for Saliency Prediction
Pan, J., Sayrol, E., Giro-I-Nieto, X., McGuinness, K., & OConnor, N. E. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.71 · Cited by 471
Learning Uncertain Convolutional Features for Accurate Saliency Detection
Zhang, P., Wang, D., Lu, H., Wang, H., & Yin, B. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.32 · Cited by 481
DeepFix: A Fully Convolutional Neural Network for Predicting Human Eye Fixations
Kruthiventi, S. S. S., Ayush, K., & Babu, R. V. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2710620 · Cited by 478
Predicting Human Eye Fixations via an LSTM-Based Saliency Attentive Model
Cornia, M., Baraldi, L., Serra, G., & Cucchiara, R. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2851672 · Cited by 474
Saliency in VR: How Do People Explore Virtual Environments?
Sitzmann, V., Serrano, A., Pavel, A., Agrawala, M., Gutierrez, D., Masia, B., & Wetzstein, G. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2793599 · Cited by 459
SalGAN: Visual Saliency Prediction with Generative Adversarial Networks
Pan, J., Canton-Ferrer, C., McGuinness, K., O'Connor, N. E., Torres, J., Sayrol, E., & Giró-i-Nieto, X. (2017) · Dublin City University Open Access Institutional Repository (Dublin City University) · doi:10.48550/arxiv.1701.01081 · Cited by 315
Human Attention in Visual Question Answering: Do Humans and Deep Networks look at the same regions?
Das, A., Agrawal, H., Zitnick, L., Parikh, D., & Batra, D. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1092 · Cited by 427
TurkerGaze: Crowdsourcing Saliency with Webcam based Eye Tracking
Xu, P., Ehinger, K. A., Zhang, Y., Finkelstein, A., Kulkarni, S. R., & Xiao, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.06755 · Cited by 234
A deep multi-level network for saliency prediction
Cornia, M., Baraldi, L., Serra, G., & Cucchiara, R. (2016) · 2016 23rd International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.2016.7900174 · Cited by 360
Revisiting Video Saliency Prediction in the Deep Learning Era
Wang, W., Shen, J., Xie, J., Cheng, M.-M., Ling, H., & Borji, A. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2924417 · Cited by 330
A Deep Network Solution for Attention and Aesthetics Aware Photo Cropping
Wang, W., Shen, J., & Ling, H. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2840724 · Cited by 348
DeepGaze II: Reading fixations from deep features trained on object recognition
Kümmerer, M., Wallis, T. S. A., & Bethge, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.01563 · Cited by 236
Predicting the Driver's Focus of Attention: The DR(eye)VE Project
Palazzi, A., Abati, D., Calderara, S., Solera, F., & Cucchiara, R. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2845370 · Cited by 313
A Survey on Deep Learning Technique for Video Segmentation
Zhou, T., Porikli, F., Crandall, D. J., Van Gool, L., & Wang, W. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3225573 · Cited by 255
Understanding Low- and High-Level Contributions to Fixation Prediction
Kummerer, M., Wallis, T. S. A., Gatys, L. A., & Bethge, M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.513 · Cited by 282
Revisiting Video Saliency: A Large-Scale Benchmark and a New Model
Wang, W., Shen, J., Guo, F., Cheng, M.-M., & Borji, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00514 · Cited by 268
Saliency Prediction in the Deep Learning Era: Successes and Limitations
Borji, A. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2935715 · Cited by 180
Contextual encoder–decoder network for visual saliency prediction
Kroner, A., Senden, M., Driessens, K., & Goebel, R. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.05.004 · Cited by 220
A Deep Spatial Contextual Long-Term Recurrent Convolutional Network for Saliency Detection
Liu, N., & Han, J. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2817047 · Cited by 207
Inferring Salient Objects from Human Fixations
Wang, W., Shen, J., Dong, X., Borji, A., & Yang, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2905607 · Cited by 216
Salient Object Detection Driven by Fixation Prediction
Wang, W., Shen, J., Dong, X., & Borji, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00184 · Cited by 205
Cube Padding for Weakly-Supervised Saliency Prediction in 360° Videos
Cheng, H.-T., Chao, C.-H., Dong, J.-D., Wen, H.-K., Liu, T.-L., & Sun, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00154 · Cited by 206
TASED-Net: Temporally-Aggregating Spatial Encoder-Decoder Network for Video Saliency Detection
Min, K., & Corso, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00248 · Cited by 194
Unified Image and Video Saliency Modeling
Droste, R., Jiao, J., & Noble, J. A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58558-7_25 · Cited by 205
Transparency by Design: Closing the Gap Between Performance and Interpretability in Visual Reasoning
Mascharka, D., Tran, P., Soklaski, R., & Majumdar, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00519 · Cited by 203
Kang, J., Du, H., Li, Z., Xiong, Z., Ma, S., Niyato, D., & Li, Y. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3221990 · Cited by 186
EML-NET: An Expandable Multi-Layer NETwork for saliency prediction
Jia, S., & Bruce, N. D. B. (2020) · Image and Vision Computing · doi:10.1016/j.imavis.2020.103887 · Cited by 167
Goal-Oriented Gaze Estimation for Zero-Shot Learning
Liu, Y., Zhou, L., Bai, X., Huang, Y., Gu, L., Zhou, J., & Harada, T. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00379 · Cited by 171
Multimodal Emotion Recognition on RAVDESS Dataset Using Transfer Learning
Luna-Jiménez, C., Griol, D., Callejas, Z., Kleinlein, R., Montero, J. M., & Fernández-Martínez, F. (2021) · Sensors · doi:10.3390/s21227665 · Cited by 161
Emotional Attention: A Study of Image Sentiment and Visual Attention
Fan, S., Shen, Z., Jiang, M., Koenig, B. L., Xu, J., Kankanhalli, M. S., & Zhao, Q. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00785 · Cited by 160
Self-citationLearning Visual Importance for Graphic Designs and Data Visualizations
Bylinskii, Z., Kim, N. W., O'Donovan, P., Alsheikh, S., Madan, S., Pfister, H., Durand, F., Russell, B., & Hertzmann, A. (2017) · Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3126594.3126653 · Cited by 156
FoV-NeRF: Foveated Neural Radiance Fields for Virtual Reality
Deng, N., He, Z., Ye, J., Duinkharjav, B., Chakravarthula, P., Yang, X., & Sun, Q. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3203102 · Cited by 209
SalNet360: Saliency maps for omni-directional images with CNN
Monroy, R., Lutz, S., Chalasani, T., & Smolic, A. (2018) · Signal Processing: Image Communication · doi:10.1016/j.image.2018.05.005 · Cited by 167
A Dilated Inception Network for Visual Saliency Prediction
Yang, S., Lin, G., Jiang, Q., & Lin, W. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2947352 · Cited by 158
Lightweight Salient Object Detection via Hierarchical Visual Perception Learning
Liu, Y., Gu, Y.-C., Zhang, X., Wang, W.-W., & Cheng, M. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.3035613 · Cited by 172
TranSalNet: Towards perceptually relevant visual saliency prediction
Lou, J., Lin, H., Marshall, D., Saupe, D., & Liu, H. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.04.080 · Cited by 184
Kruthiventi, S. S. S., Gudisa, V., Dholakiya, J. H., & Babu, R. V. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.623 · Cited by 159
Global and Local-Contrast Guides Content-Aware Fusion for RGB-D Saliency Prediction
Zhou, W., Lv, Y., Lei, J., & Yu, L. (2021) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2019.2957386 · Cited by 142
End-to-End Saliency Mapping via Probability Distribution Prediction
Jetley, S., Murray, N., & Vig, E. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.620 · Cited by 140
Where Should Saliency Models Look Next?
Bylinskii, Z., Recasens, A., Borji, A., Oliva, A., Torralba, A. B., & Durand, F. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46454-1_49 · Cited by 138
DR(eye)VE: A Dataset for Attention-Based Tasks with Applications to Autonomous and Assisted Driving
Alletto, S., Palazzi, A., Solera, F., Calderara, S., & Cucchiara, R. (2016) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.14 · Cited by 137
Deng, T., Yan, H., Qin, L., Ngo, T., & Manjunath, B. S. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2915540 · Cited by 148
Obeso, A. M., Benois‐Pineau, J., Vázquez, M. S. G., & Acosta, A. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108411 · Cited by 141
Toward Deeper Understanding of Camouflaged Object Detection
Lv, Y., Zhang, J., Dai, Y., Li, A., Barnes, N. M., & Fan, D.-P. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3234578 · Cited by 145
DeepGaze III: Modeling free-viewing human scanpaths with deep learning
Kümmerer, M., Bethge, M., & Wallis, T. S. A. (2022) · Journal of Vision · doi:10.1167/jov.22.5.7 · Cited by 176
CapSal: Leveraging Captioning to Boost Semantics for Salient Object Detection
Zhang, L., Zhang, J., Lin, Z., Lu, H., & He, Y. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00618 · Cited by 138
DeepGaze IIE: Calibrated prediction in and out-of-domain for state-of-the-art saliency modeling
Linardos, A., Kümmerer, M., Press, O., & Bethge, M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01268 · Cited by 128
Deep Cropping via Attention Box Prediction and Aesthetics Assessment
Wang, W., & Shen, J. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.240 · Cited by 131
SaltiNet: Scan-Path Prediction on 360 Degree Images Using Saliency Volumes
Assens, M., Giró-i-Nieto, X., McGuinness, K., & O'Connor, N. E. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.275 · Cited by 152
Saliency Benchmarking Made Easy: Separating Models, Maps and Metrics
Kümmerer, M., Wallis, T. S. A., & Bethge, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01270-0_47 · Cited by 122
Learning what and where to attendPreprint
Linsley, D. A., Shiebler, D., Eberhardt, S., & Serre, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.08819 · Cited by 140
Viewing Behavior Supported Visual Saliency Predictor for 360 Degree Videos
Zhu, Y., Zhai, G., Yang, Y., Duan, H., Min, X., & Yang, X. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3126590 · Cited by 122
UEyes: Understanding Visual Saliency across User Interface Types
Jiang, Y., Leiva, L. A., Tavakoli, H. R., Houssel, P. R. B., Kylmälä, J., & Oulasvirta, A. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581096 · Cited by 130
Paying More Attention to Saliency: Image Captioning with Saliency and Context Attention
Cornia, M., Baraldi, L., Serra, G., & Cucchiara, R. (2018) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3177745 · Cited by 124
ViNet: Pushing the limits of Visual Modality for Audio-Visual Saliency Prediction
Jain, S., Yarlagadda, P., Jyoti, S., Karthik, S., Subramanian, R., & Gandhi, V. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9635989 · Cited by 139
The Prediction of Saliency Map for Head and Eye Movements in 360 Degree Images
Zhu, Y., Zhai, G., Min, X., & Zhou, J. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2957986 · Cited by 115
Predicting Goal-Directed Human Attention Using Inverse Reinforcement Learning
Yang, Z., Huang, L., Chen, Y., Wei, Z., Ahn, S., Zelinsky, G., Samaras, D., & Hoai, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00027 · Cited by 101
How is Gaze Influenced by Image Transformations? Dataset and Model
Che, Z., Borji, A., Zhai, G., Min, X., Guo, G., & Callet, P. L. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2945857 · Cited by 107
BubbleView: An Interface for Crowdsourcing Image Importance Maps and Tracking Visual Attention
Kim, N. W., Bylinskii, Z., Borkin, M. A., Gajos, K. Z., Oliva, A., Durand, F., & Pfister, H. (2017) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3131275 · Cited by 124
Understanding More About Human and Machine Attention in Deep Neural Networks
Lai, Q., Khan, S. H., Nie, Y., Sun, H., Shen, J., & Shao, L. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3007321 · Cited by 113
Saliency Detection on Light Field
Zhang, J., Wang, M., Lin, L., Yang, X., Gao, J., & Rui, Y. (2017) · ACM Trans. Multim. Comput. Commun. Appl. · doi:10.1145/3107956 · Cited by 54
Exploring Human-Like Attention Supervision in Visual Question Answering
Qiao, T., Dong, J., & Xu, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12272 · Cited by 100
Simple vs complex temporal recurrences for video saliency predictionPreprint
Linardos, P., Mohedano, E., Nieto, J. J., O'Connor, N. E., Giró-i-Nieto, X., & McGuinness, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.01869 · Cited by 97
PathGAN: Visual Scanpath Prediction with Generative Adversarial Networks
Assens, M., Giró-i-Nieto, X., McGuinness, K., & O'Connor, N. E. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11021-5_25 · Cited by 110
Video Saliency Prediction Based on Spatial-Temporal Two-Stream Network
Zhang, K., & Chen, Z. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2883305 · Cited by 98
SP-ASDNet: CNN-LSTM Based ASD Classification Model using Observer ScanPaths
Tao, Y., & Shyu, M. (2019) · IEEE International Conference on Multimedia & Expo Workshops (ICMEW) · doi:10.1109/icmew.2019.00124 · Cited by 90
Understanding Visual Saliency in Mobile User Interfaces
Leiva, L. A., Xue, Y., Bansal, A., Tavakoli, H. R., Köroðlu, T., Du, J., Dayama, N. R., & Oulasvirta, A. (2020) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3379503.3403557 · Cited by 90
Hierarchical Domain-Adapted Feature Learning for Video Saliency Prediction
Bellitto, G., Salanitri, F. P., Palazzo, S., Rundo, F., Giordano, D., & Spampinato, C. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01519-y · Cited by 96
Semantic Perceptual Image Compression Using Deep Convolution Networks
Prakash, A., Moran, N., Garber, S., DiLillo, A., & Storer, J. A. (2017) · DCC · doi:10.1109/dcc.2017.56 · Cited by 88
Eye Fixation Metrics for Large Scale Evaluation and Comparison of Information Visualizations
Bylinskii, Z., Borkin, M. A., Kim, N. W., Pfister, H., & Oliva, A. (2017) · Mathematics and visualization · doi:10.1007/978-3-319-47024-5_14 · Cited by 99
Visual Scanpath Prediction Using IOR-ROI Recurrent Mixture Density Network
Sun, W., Chen, Z., & Wu, F. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2956930 · Cited by 86
Cazzato, D., Leo, M., Distante, C., & Voos, H. (2020) · Sensors · doi:10.3390/s20133739 · Cited by 93
Re-Caption: Saliency-Enhanced Image Captioning Through Two-Phase Learning
Zhou, L., Zhang, Y., Jiang, Y., Zhang, T., & Fan, W. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2928144 · Cited by 88
Facial Expression Recognition Using Visual Saliency and Deep Learning
Mavani, V., Raman, S., & Miyapuram, K. P. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.327 · Cited by 87
Paying Attention to Descriptions Generated by Image Captioning Models
Tavakoliy, H. R., Shetty, R., Borji, A., & Laaksonen, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.272 · Cited by 81
Spatio-Temporal Self-Attention Network for Video Saliency Prediction
Wang, Z., Liu, Z., Li, G., Wang, Y., Zhang, T., Xu, L., & Wang, J. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3139743 · Cited by 96
Scene Context-Aware Salient Object Detection
Siris, A., Jiao, J., Tam, G. K. L., Xie, X., & Lau, R. W. H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00412 · Cited by 89
ID-YOLO: Real-Time Salient Object Detection Based on the Driver’s Fixation Region
Qin, L., Shi, Y., He, Y., Zhang, J., Zhang, X.-S., Li, Y., Deng, T., & Yan, H. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3146271 · Cited by 84
Jin, S., Wang, X., & Meng, Q. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111358 · Cited by 80
AGIL: Learning Attention from Human for Visuomotor Tasks
Zhang, R., Liu, Z., Zhang, L., Whritner, J. A., Muller, K., Hayhoe, M., & Ballard, D. H. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01252-6_41 · Cited by 84
Fan, D.-P., Zhang, J., Xu, G., Cheng, M., & Shao, L. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3166451 · Cited by 83
Supervising Neural Attention Models for Video Captioning by Human Gaze Data
Yu, Y., Choi, J., Kim, Y., Yoo, K., Lee, S.-H., & Kim, G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.648 · Cited by 70
Lateef, F., Kas, M., & Ruichek, Y. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3053178 · Cited by 72
TENet: Triple Excitation Network for Video Salient Object Detection
Ren, S., Han, C., Yang, X., Han, G., & He, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58558-7_13 · Cited by 81
SalientDSO: Bringing Attention to Direct Sparse Odometry
Liang, H.-J., Sanket, N. J., Fermuller, C. M., & Aloimonos, Y. (2019) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2019.2900980 · Cited by 75
SalSAC: A Video Saliency Prediction Model with Shuffled Attentions and Correlation-Based ConvLSTM
Wu, X., Wu, Z., Zhang, J., Ju, L., & Wang, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6927 · Cited by 71
Predicting Visual Importance Across Graphic Design Types
Fosco, C. L., Casser, V., Bedi, A. K., O'Donovan, P., Hertzmann, A., & Bylinskii, Z. (2020) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3379337.3415825 · Cited by 82
Atari-HEAD: Atari Human Eye-Tracking and Demonstration Dataset
Zhang, R., Walshe, C., Liu, Z., Guan, L., Muller, K., Whritner, J. A., Zhang, L., Hayhoe, M., & Ballard, D. H. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6161 · Cited by 88
Nguyen, T., Zhao, Q., & Yan, S. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-017-1042-6 · Cited by 70
Self-citationVisual Saliency Prediction Using a Mixture of Deep Neural Networks
Dodge, S., & Karam, L. J. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2834826 · Cited by 66
Salient object detection based on multi-scale contrast
Wang, H., Dai, L., Cai, Y., Sun, X., & Chen, L. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.02.005 · Cited by 62
Going from Image to Video Saliency: Augmenting Image Salience with Dynamic Attentional Push
Gorji, S., & Clark, J. J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00783 · Cited by 61
Yee, K., Tantipongpipat, U., & Mishra, S. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479594 · Cited by 59
Metadata
- Authors
- Jiang, M., Huang, S., Duan, J., & Zhao, Q.
- Affiliations
- National University of Singapore (SG)
- ORCID
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 1072-1080
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W1934890906
- Cited by
- 729
- References
- 40
- Citations by year
- 2026: 30 · 2025: 58 · 2024: 75 · 2023: 76 · 2022: 75 · 2021: 100 · 2020: 93 · 2019: 84 · 2018: 60 · 2017: 44 · 2016: 27 · 2015: 7
- FWCI
- 18.87
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- visual attention, saliency prediction, peripheral vision
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.