The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Automatic Shadow Detection and Removal from a Single Image
Open accessAbstract
We present a framework to automatically detect and remove shadows in real world scenes from a single image. Previous works on shadow detection put a lot of effort in designing shadow variant and invariant hand-crafted features. In contrast, our framework automatically learns the most relevant features in a supervised manner using multiple convolutional deep neural networks (ConvNets). The features are learned at the super-pixel level and along the dominant boundaries in the image. The predicted posteriors based on the learned features are fed to a conditional random field model to generate smooth shadow masks. Using the detected shadow masks, we propose a Bayesian formulation to accurately extract shadow matte and subsequently remove shadows. The Bayesian formulation is based on a novel model which accurately models the shadow generation process in the umbra and penumbra regions. The model parameters are efficiently estimated using an iterative optimization procedure. Our proposed framework consistently performed better than the state-of-the-art on all major shadow databases collected under a variety of conditions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680
SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., & Süsstrunk, S. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.120 · Cited by 9,201
Efficient Graph-Based Image Segmentation
Felzenszwalb, P. F., & Huttenlocher, D. P. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000022288.19776.77 · Cited by 6,176
Contour Detection and Hierarchical Image Segmentation
Arbeláez, P., Maire, M., Fowlkes, C., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.161 · Cited by 5,454
Multi-column deep neural networks for image classification
Ciresan, D., Meier, U., & Schmidhuber, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248110 · Cited by 3,720
Region Filling and Object Removal by Exemplar-Based Image Inpainting
Criminisi, A., Perez, P., & Toyama, K. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.833105 · Cited by 3,258 · cited 1×
“[47].”
Reinhard, E., Adhikhmin, M., Gooch, B., & Shirley, P. (2001) · IEEE Computer Graphics and Applications · doi:10.1109/38.946629 · Cited by 2,937
Pérez, P., Gangnet, M., & Blake, A. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882269 · Cited by 2,020
Graph Cuts and Efficient N-D Image Segmentation
Boykov, Y., & Funka-Lea, G. (2006) · International Journal of Computer Vision · doi:10.1007/s11263-006-7934-5 · Cited by 1,910
Pérez, P., Gangnet, M., & Blake, A. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882269 · Cited by 1,773
A Closed-Form Solution to Natural Image Matting
Levin, A., Lischinski, D., & Weiss, Y. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1177 · Cited by 1,616
LeCun, Y., Bottou, L., Orr, G., & Müller, K. (1998) · neural information processing systems · Cited by 1,333
LeCun, Y. A., Bottou, L., Orr, G. B., & Müller, K.-R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_3 · Cited by 1,264
Structured Forests for Fast Edge Detection
Dollar, P., & Zitnick, C. L. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.231 · Cited by 899
A Bayesian approach to digital matting
Chuang, Y.-Y., Curless, B., Salesin, D. H., & Szeliski, R. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990970 · Cited by 796
Detecting moving shadows: algorithms and evaluation
Prati, A., Mikic, I., Trivedi, M. M., & Cucchiara, R. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1206520 · Cited by 760
On the removal of shadows from images
Finlayson, G. D., Hordley, S. D., Lu, C., & Drew, M. S. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.18 · Cited by 657
Finlayson, G. D., Hordley, S. D., & Drew, M. S. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47979-1_55 · Cited by 420
User Assisted Separation of Reflections from a Single Image Using a Sparsity Prior
Levin, A., & Weiss, Y. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1106 · Cited by 389
Entropy Minimization for Shadow Removal
Finlayson, G. D., Drew, M. S., & Lu, C. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-009-0243-z · Cited by 349
Paired Regions for Shadow Detection and Removal
Guo, R., Dai, Q., & Hoiem, D. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.214 · Cited by 339
Learning CRFs Using Graph Cuts
Szummer, M., Kohli, P., & Hoiem, D. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88688-4_43 · Cited by 243
Detecting Ground Shadows in Outdoor Consumer Photographs
Lalonde, J.-F., Efros, A. A., & Narasimhan, S. G. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15552-9_24 · Cited by 214
Deep Reconstruction Models for Image Set Classification
Hayat, M., Bennamoun, M., & An, S. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2353635 · Cited by 172
Self-citationKersten, D., Knill, D. C., Mamassian, P., & Bülthoff, I. (1996) · Nature · doi:10.1038/379031a0 · Cited by 162
Shadow Removal Using Intensity Surfaces and Texture Anchor Points
Arbel, E., & Hel-Or, H. Z. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.157 · Cited by 162
Shadow Removal Using Bilateral Filtering
Yang, Q., Tan, K.-H., & Ahuja, N. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2208976 · Cited by 151
Automatic Feature Learning for Robust Shadow Detection
Khan, S. H., Bennamoun, M., Sohel, F. A., & Togneri, R. B. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.249 · Cited by 151
Self-citationIllumination normalization with time-dependent intrinsic images for video surveillance
Matsushita, Y., Nishino, K., Ikeuchi, K., & Sakauchi, M. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.86 · Cited by 119
Fast Shadow Removal Using Adaptive Multi‐Scale Illumination Transfer
Xiao, C., She, R., Xiao, D., & Ma, K. (2013) · Computer Graphics Forum · doi:10.1111/cgf.12198 · Cited by 92
Learning to Detect Moving Shadows in Dynamic Environments
Joshi, A. J., & Papanikolopoulos, N. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.150 · Cited by 87
Illumination estimation and cast shadow detection through a higher-order graphical model
Panagopoulos, A., Wang, C., Samaras, D., & Nikos Paragios, A. (2011) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2011.5995585 · Cited by 83
Geometry Driven Semantic Labeling of Indoor Scenes
Khan, S. H., Bennamoun, M., Sohel, F. A., & Togneri, R. B. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10590-1_44 · Cited by 67
Self-citationHamiltonian path based shadow removal
Fredembach, C., & Finlayson, G. D. (2005) · British Machine Vision Conference (BMVC) · doi:10.5244/c.19.51 · Cited by 66
Describing Reflectances for Color Segmentation Robust to Shadows, Highlights, and Textures
Vazquez, E., Baldrich, R., van de Weijer, J., & Vanrell, M. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.146 · Cited by 41
Estimating Shadows with the Bright Channel Cue
Panagopoulos, A., Wang, C., Samaras, D., & Nikos Paragios, A. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-35740-4_1 · Cited by 27
A Three-Stage Approach to Shadow Field Estimation From Partial Boundary Information
Su, Y.-F., & Chen, H. H. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2050626 · Cited by 24
Cited by
Cost-Sensitive Learning of Deep Feature Representations From Imbalanced Data
Khan, S. H., Hayat, M., Bennamoun, M., Sohel, F. A., & Togneri, R. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2732482 · Cited by 967
Self-citationWang, J., Li, X., & Yang, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00192 · Cited by 465
A Guide to Convolutional Neural Networks for Computer Vision
Khan, S. H., Rahmani, H., Shah, S. A. A., & Bennamoun, M. (2018) · Synthesis lectures on computer vision · doi:10.2200/s00822ed1v01y201712cov015 · Cited by 443
Self-citationA Generic Deep Architecture for Single Image Reflection Removal and Image Smoothing
Fan, Q., Yang, J., Hua, G., Chen, B., & Wipf, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.351 · Cited by 324
DeshadowNet: A Multi-context Embedding Deep Network for Shadow Removal
Qu, L., Tian, J., He, S., Tang, Y., & Lau, R. W. H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.248 · Cited by 310
Metadata
- Authors
- Khan, S. H., Bennamoun, M., Sohel, F., & Togneri, R.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2016-03-01
- Volume
- 38
- Issue
- 3
- Pages
- 431-446
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2252574053
- Cited by
- 283
- References
- 38
- FWCI
- 20.80
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.