The DOI matches its DataCite record; 1 of the 1 references it cites were found in a registry or an index.
Multi-Scale Context Aggregation by Dilated Convolutions
Open accessAbstract
State-of-the-art models for semantic segmentation are based on adaptations of convolutional networks that had originally been designed for image classification. However, dense prediction and image classification are structurally different. In this work, we develop a new convolutional network module that is specifically designed for dense prediction. The presented module uses dilated convolutions to systematically aggregate multi-scale contextual information without losing resolution. The architecture is based on the fact that dilated convolutions support exponential expansion of the receptive field without loss of resolution or coverage. We show that the presented context module increases the accuracy of state-of-the-art semantic segmentation systems. In addition, we examine the adaptation of image classification networks to dense prediction and show that simplifying the adapted network can increase accuracy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The dilated network has become the de facto paradigm for semantic segmentation.”
From Unified Perceptual Parsing for Scene Understanding (2018) · cites this paper as [14]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Moreover, dilated convolution [36, 37] is proposed to capture the multi-scale context with the same amount of parameters as standard convolutions.”
From DilatedFormer: dilated granularity transformer network for placental maturity grading in ultrasound (2023) · cites this paper as [36]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Based upon ResNet, many studies have managed to improve the performance of the original ResNet, such as pre-activation ResNet [38], wide ResNet [39], stochastic depth ResNets (SDR) [40], and ResNet in ResNet (RiR) [41].”
From A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects (2022) · cites this paper as [40]
Experimental — accuracy not yet measuredIn the citing paper
“To overcome the drawbacks of successive max-pooling and downsampling that lead to a loss of feature map resolution, dilated convolution [22], [23] was proposed to preserve the resolution of feature maps and enlarge the receptive field to incorporate larger contextual information.”
From DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentation (2019) · cites this paper as [23]
In the citing paper
“Multi-scale features extracted from CNNs have been shown to be effective for improving segmentation accuracy [11], [22], [23].”
From DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentation (2019) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning Hierarchical Features for Scene Labeling
Farabet, C., Couprie, C., Najman, L., & LeCun, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.231 · Cited by 2,620
Research works printed but not linked: 33
- Badrinarayanan, Vijay, Handa, Ankur, and Cipolla, Roberto. SegNet: A deep convolutional encoder-decoder architecture for robust semantic pixel-wise labelling. arXiv:1505.07293 , 2015. · arXiv
- Brostow, Gabriel J., Fauqueur, Julien, and Cipolla, Roberto. Semantic object classes in video: A high-definition ground truth database. Pattern Recognition Letters , 30(2), 2009.
- Chen, Liang-Chieh, Papandreou, George, Kokkinos, Iasonas, Murphy, Kevin, and Yuille, Alan L. Semantic image segmentation with deep convolutional nets and fully connected CRFs. In ICLR , 2015a.
- Chen, Liang-Chieh, Yang, Yi, Wang, Jiang, Xu, Wei, and Yuille, Alan L. Attention to scale: Scale-aware semantic image segmentation. arXiv:1511.03339 , 2015b. · arXiv
- Cordts, Marius, Omran, Mohamed, Ramos, Sebastian, Rehfeld, Timo, Enzweiler, Markus, Benenson, Rodrigo, Franke, Uwe, Roth, Stefan, and Schiele, Bernt. The Cityscapes dataset for semantic urban scene understanding. In CVPR , 2016.
- Everingham, Mark, Gool, Luc J. Van, Williams, Christopher K. I., Winn, John M., and Zisserman, Andrew. The Pascal visual object classes (VOC) challenge. IJCV , 88(2), 2010.
- Fischer, Philipp, Dosovitskiy, Alexey, Ilg, Eddy, H¨ ausser, Philip, Hazrba, Caner, Golkov, Vladimir, van der Smagt, Patrick, Cremers, Daniel, and Brox, Thomas. Learning optical flow with convolutional neural networks. In ICCV , 2015.
- Galleguillos, Carolina and Belongie, Serge J. Context based object categorization: A critical survey. Computer Vision and Image Understanding , 114(6), 2010.
- Geiger, Andreas, Lenz, Philip, Stiller, Christoph, and Urtasun, Raquel. Vision meets robotics: The KITTI dataset. International Journal of Robotics Research , 32(11), 2013.
- Glorot, Xavier and Bengio, Yoshua. Understanding the difficulty of training deep feedforward neural networks. In AISTATS , 2010.
- Hariharan, Bharath, Arbelaez, Pablo, Bourdev, Lubomir D., Maji, Subhransu, and Malik, Jitendra. Semantic contours from inverse detectors. In ICCV , 2011.
- He, Xuming, Zemel, Richard S., and Carreira-Perpi˜ n´ an, Miguel ´ A. Multiscale conditional random fields for image labeling. In CVPR , 2004.
- Holschneider, M., Kronland-Martinet, R., Morlet, J., and Tchamitchian, Ph. A real-time algorithm for signal analysis with the help of the wavelet transform. In Wavelets: Time-Frequency Methods and Phase Space. Proceedings of the International Conference , 1987.
- Jia, Yangqing, Shelhamer, Evan, Donahue, Jeff, Karayev, Sergey, Long, Jonathan, Girshick, Ross B., Guadarrama, Sergio, and Darrell, Trevor. Caffe: Convolutional architecture for fast feature embedding. In Proc. ACM Multimedia , 2014.
- Kohli, Pushmeet, Ladicky, Lubor, and Torr, Philip H. S. Robust higher order potentials for enforcing label consistency. IJCV , 82(3), 2009.
- Kr¨ ahenb¨ uhl, Philipp and Koltun, Vladlen. Efficient inference in fully connected CRFs with Gaussian edge potentials. In NIPS , 2011.
- Krizhevsky, Alex, Sutskever, Ilya, and Hinton, Geoffrey E. ImageNet classification with deep convolutional neural networks. In NIPS , 2012.
- Kundu, Abhijit, Vineet, Vibhav, and Koltun, Vladlen. Feature space optimization for semantic video segmentation. In CVPR , 2016.
- Ladicky, Lubor, Russell, Christopher, Kohli, Pushmeet, and Torr, Philip H. S. Associative hierarchical CRFs for object class image segmentation. In ICCV , 2009.
- Le, Quoc V., Jaitly, Navdeep, and Hinton, Geoffrey E. A simple way to initialize recurrent networks of rectified linear units. arXiv:1504.00941 , 2015. · arXiv
- LeCun, Yann, Boser, Bernhard, Denker, John S., Henderson, Donnie, Howard, Richard E., Hubbard, Wayne, and Jackel, Lawrence D. Backpropagation applied to handwritten zip code recognition. Neural Computation , 1(4), 1989.
- Lin, Guosheng, Shen, Chunhua, Reid, Ian, and van dan Hengel, Anton. Efficient piecewise training of deep structured models for semantic segmentation. arXiv:1504.01013 , 2015. · arXiv
- Lin, Tsung-Yi, Maire, Michael, Belongie, Serge, Hays, James, Perona, Pietro, Ramanan, Deva, Doll´ ar, Piotr, and Zitnick, C. Lawrence. Microsoft COCO: Common objects in context. In ECCV , 2014.
- Liu, Buyu and He, Xuming. Multiclass semantic video segmentation with object-level active inference. In CVPR , 2015.
- Long, Jonathan, Shelhamer, Evan, and Darrell, Trevor. Fully convolutional networks for semantic segmentation. In CVPR , 2015.
- Noh, Hyeonwoo, Hong, Seunghoon, and Han, Bohyung. Learning deconvolution network for semantic segmentation. In ICCV , 2015.
- Ros, Germ´ an, Ramos, Sebastian, Granados, Manuel, Bakhtiary, Amir, V´ azquez, David, and L´ opez, Antonio Manuel. Vision-based offline-online perception paradigm for autonomous driving. In WACV , 2015.
- Shensa, Mark J. The discrete wavelet transform: wedding the ` a trous and Mallat algorithms. IEEE Transactions on Signal Processing , 40(10), 1992.
- Shotton, Jamie, Winn, John M., Rother, Carsten, and Criminisi, Antonio. TextonBoost for image understanding: Multi-class object recognition and segmentation by jointly modeling texture, layout, and context. IJCV , 81 (1), 2009.
- Simonyan, Karen and Zisserman, Andrew. Very deep convolutional networks for large-scale image recognition. In ICLR , 2015.
- Sturgess, Paul, Alahari, Karteek, Ladicky, Lubor, and Torr, Philip H. S. Combining appearance and structure from motion features for road scene understanding. In BMVC , 2009.
- Tighe, Joseph and Lazebnik, Svetlana. Superparsing - scalable nonparametric image parsing with superpixels. IJCV , 101(2), 2013.
- Zheng, Shuai, Jayasumana, Sadeep, Romera-Paredes, Bernardino, Vineet, Vibhav, Su, Zhizhong, Du, Dalong, Huang, Chang, and Torr, Philip. Conditional random fields as recurrent neural networks. In ICCV , 2015.
Cited by
Sorted by citations
Items 101–122 of 122
Protein sequence‐to‐structure learning: Is this the end(‐to‐end revolution)?
Laine, E., Eismann, S., Elofsson, A., & Grudinin, S. (2021) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26235 · Cited by 44
“[110] Yu F, Koltun V, Multi-Scale Context Aggregation by Dilated Convolutions; 2016.”
BackgroundIncorporating biological structure into machine learning models in biomedicine
Crawford, J., & Greene, C. S. (2020) · Current Opinion in Biotechnology · doi:10.1016/j.copbio.2019.12.021 · Cited by 41
Intelligent detection of fastener defects in ballastless tracks based on deep learning
Ye, W., Ren, J., Lu, C., Zhang, A. A., Zhan, Y., & Liu, J. (2024) · Automation in Construction · doi:10.1016/j.autcon.2024.105280 · Cited by 42
Global extreme heat forecasting using neural weather models
Lopez-Gomez, I., McGovern, A., Agrawal, S., & Hickey, J. (2023) · Artificial Intelligence for the Earth Systems · doi:10.1175/aies-d-22-0035.1 · Cited by 41
High-throughput design of fiber reinforced cement-based composites using deep learning
Tong, Z., Huo, J., & Wang, Z. (2020) · Cement and Concrete Composites · doi:10.1016/j.cemconcomp.2020.103716 · Cited by 39
Self-Supervised Contrastive Video-Speech Representation Learning for Ultrasound
Jiao, J., Cai, Y., Alsharid, M., Drukker, L., Papageorghiou, A. T., & Noble, J. A. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-59716-0_51 · Cited by 38
Degradation-Resistant Unfolding Network for Heterogeneous Image Fusion
He, C., Li, K., Xu, G., Zhang, Y., Hu, R., Guo, Z., & Li, X. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01159 · Cited by 37
ISDNet: AI-enabled Instance Segmentation of Aerial Scenes for Smart Cities
Garg, P., Chakravarthy, A. S., Mandal, M., Narang, P., Chamola, V., & Guizani, M. (2021) · ACM Transactions on Internet Technology · doi:10.1145/3418205 · Cited by 32
MTLDesc: Looking Wider to Describe Better
Wang, C., Xu, R., Zhang, Y., Xu, S., Meng, W., Fan, B., & Zhang, X. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20138 · Cited by 33
High-throughput deep learning variant effect prediction with Sequence UNET
Dunham, A. S., Beltrao, P., & AlQuraishi, M. (2023) · Genome Biology · doi:10.1186/s13059-023-02948-3 · Cited by 31
Weakly Supervised Multi-Task Representation Learning for Human Activity Analysis Using Wearables
Sheng, T., & Huber, M. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3397330 · Cited by 28
Perspective-Adaptive Convolutions for Scene Parsing
Zhang, R., Tang, S., Zhang, Y., Li, J., & Yan, S. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2890637 · Cited by 25
Vision Transformers: From Semantic Segmentation to Dense Prediction
Zhang, L., Lu, J., Zheng, S., Zhao, X., Zhu, X., Fu, Y., Xiang, T., Feng, J., & Torr, P. H. S. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02173-w · Cited by 23
“STTR [46] and LSTR [47] adopt Transformer for disparity estimation and lane shape prediction respectively.”
Siamese Networks for Weakly Supervised Human Activity Recognition
Sheng, T., & Huber, M. (2019) · 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC) · doi:10.1109/smc.2019.8914045 · Cited by 21
Transferable multi-modal fusion in knee angles and gait phases for their continuous prediction
Guo, Z., Zheng, H., Wu, H., Zhang, J., Zhou, G., & Long, J. (2023) · Journal of Neural Engineering · doi:10.1088/1741-2552/accd22 · Cited by 18
Yang, M., Liu, S., Hao, T., Ma, C., Chen, H., Li, Y., Wu, C., Xie, J., Qiu, H., Li, J., et al. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102785 · Cited by 10
Leveraging Temporal Information for 3D Trajectory Estimation of Space Objects
Musallam, M. A., Del Castillo, M. O., Al Ismaeil, K., Perez, M. D., & Aouada, D. (2021) · 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00425 · Cited by 9
“Architectures with dilated convolutions have been successfully used for audio generation in Wavnet [21], semantic segmentation [25], machine translation [11], and 3D pose estimation [22].”
MethodA central multimodal fusion framework for outdoor scene image segmentation
Zhang, Y., Morel, O., Seulin, R., Mériaudeau, F., & Sidibé, D. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10357-y · Cited by 5
An Efficient Object Detection Algorithm Based on Compressed Networks
Li, J., Peng, K., & Chang, C.-C. (2018) · Symmetry · doi:10.3390/sym10070235 · Cited by 6
A Slice and Dice Approach to Accelerate Compound Sparse Attention on GPU
Li, H., Choi, J., & Ahn, J. H. (2022) · 2022 IEEE International Symposium on Workload Characterization (IISWC) · doi:10.1109/iiswc55918.2022.00019 · Cited by 3
DilatedFormer: dilated granularity transformer network for placental maturity grading in ultrasound
Wu, Y., Yang, Y., Zhu, L., Han, Z., Luo, H., Xue, X., & Wang, W. (2023) · Frontiers in Physics · doi:10.3389/fphy.2023.1239400 · Cited by 2
Baz, M. (2024) · Mathematics · doi:10.3390/math12213320 · Cited by 1
Metadata
- Authors
- Yu, F., & Koltun, V.
- Affiliations
- Princeton University (US)
- Intel (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1511.07122
- OpenAlex
- W2286929393
- Cited by
- 7,738
- References
- 1
- Citations by year
- 2026: 55 · 2025: 446 · 2024: 752 · 2023: 862 · 2022: 863 · 2021: 1415 · 2020: 1148 · 2019: 1141 · 2018: 667 · 2017: 319 · 2016: 68 · 2015: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Remote-Sensing Image Classification
- Keywords
- semantic segmentation, dilated convolution, multi-scale context aggregation, dense prediction, receptive field expansion, network simplification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
