The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
RS-Mamba for Large Remote Sensing Image Dense Prediction
Open accessAbstract
Context modeling is critical for remote sensing image dense prediction tasks. Nowadays, the growing size of very-high-resolution (VHR) remote sensing images poses challenges in effectively modeling context. While transformer-based models possess global modeling capabilities, they encounter computational challenges when applied to large VHR images due to their quadratic complexity. The conventional practice of cropping large images into smaller patches results in a notable loss of contextual information. To address these issues, we propose the remote sensing Mamba (RSM) for dense prediction tasks in large VHR remote sensing images. RSM is specifically designed to capture the global context of remote sensing images with linear complexity, facilitating the effective processing of large VHR images. Considering that the land covers in remote sensing images are distributed in arbitrary spatial directions due to characteristics of remote sensing over-head imaging, the RSM incorporates an omnidirectional selective scan module (OSSM) to globally model the context of images in multiple directions, capturing large spatial features from various directions. We designed simple yet effective models based on RSM, achieving state-of-the-art performance on dense prediction tasks in VHR remote sensing images without fancy training strategies. Extensive experiments on semantic segmentation (SS) and change detection (CD) tasks across various land covers demonstrate the effectiveness of the proposed RSM. Leveraging the linear complexity and global modeling capabilities, RSM achieves better efficiency and accuracy than transformer-based models on large remote sensing images. Interestingly, we also demonstrated that our model generally performs better with a larger image size on dense prediction tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Self-citationU-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · arXiv · doi:10.48550/arxiv.1802.02611 · Cited by 20,063
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_49 · Cited by 20,054
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
Zhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.660 · Cited by 16,438
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., & Woo, W.-C. (2015) · arXiv · doi:10.48550/arxiv.1506.04214 · Cited by 7,709
Deep High-Resolution Representation Learning for Human Pose Estimation
Sun, K., Xiao, B., Liu, D., & Wang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00584 · Cited by 5,984
TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation
Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A. L., & Zhou, Y. (2021) · arXiv · doi:10.48550/arxiv.2102.04306 · Cited by 4,206
ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data
Diakogiannis, F. I., Waldner, F., Caccetta, P., & Wu, C. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.01.013 · Cited by 2,153
Ji, S., Wei, S., & Lu, M. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2858817 · Cited by 1,973
Chen, H., & Shi, Z. (2020) · Remote Sensing · doi:10.3390/rs12101662 · Cited by 1,903
Self-citationRemote sensing for agricultural applications: A meta-review
Weiss, M., Jacob, F., & Duveiller, G. (2020) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.111402 · Cited by 1,877
Fully Convolutional Siamese Networks for Change Detection
Caye Daudt, R., Le Saux, B., & Boulch, A. (2018) · 2018 25th IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2018.8451652 · Cited by 1,743
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Gu, A., & Dao, T. (2023) · arXiv · doi:10.48550/arxiv.2312.00752 · Cited by 1,579 · cited 5×
“The recent work Mamba [12] integrated time-varying parameters into the state space model (SSM) and proposed a hardware-aware algorithm that facilitates highly efficient training and inference processes.”
BackgroundMethodInfluentialVMamba: Visual State Space Model
Jiao, J., Liu, Y., Liu, Y., Tian, Y., Wang, Y., Xie, L., Ye, Q., Yu, H., & Zhao, Y. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-3273 · Cited by 1,295
Zhang, C., Yue, P., Tapete, D., Jiang, L., Shangguan, B., Huang, L., & Liu, G. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.06.003 · Cited by 1,215
Machine learning for aerial image labeling
Hinton, G. E., & Mnih, V. (2013) · TSpace (University of Toronto) · Cited by 1,203
Remote Sensing Image Change Detection With Transformers
Chen, H., Qi, Z., & Shi, Z. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3095166 · Cited by 1,189
Self-citationSNUNet-CD: A Densely Connected Siamese Network for Change Detection of VHR Images
Fang, S., Li, K., Shao, J., & Li, Z. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2021.3056416 · Cited by 1,182
A Transformer-Based Siamese Network for Change Detection
Bandara, W. G. C., & Patel, V. M. (2022) · IGARSS 2022 - 2022 IEEE International Geoscience and Remote Sensing Symposium · doi:10.1109/igarss46834.2022.9883686 · Cited by 1,095
Zhou, L., Zhang, C., & Wu, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00034 · Cited by 945
ChangeMamba: Remote Sensing Change Detection With Spatiotemporal State Space Model
Chen, H., Song, J. H., Han, C., Xia, J., & Yokoya, N. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3417253 · Cited by 861
Self-citationEfficiently Modeling Long Sequences with Structured State Spaces
Gu, A., Goel, K., & Ré, C. (2021) · arXiv · doi:10.48550/arxiv.2111.00396 · Cited by 805
Chen, J., Yuan, Z., Peng, J., Chen, L., Huang, H., Zhu, J., Liu, Y., & Li, H. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3037893 · Cited by 679
Liu, Y., Pang, C., Zhan, Z., Zhang, X., & Yang, X. (2021) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2020.2988032 · Cited by 654
Self-citationZheng, Z., Zhong, Y., Wang, J., Ma, A., & Zhang, L. (2021) · Remote Sensing of Environment · doi:10.1016/j.rse.2021.112636 · Cited by 521
SwinSUNet: Pure Transformer Network for Remote Sensing Image Change Detection
Zhang, C., Wang, L., Cheng, S., & Li, Y. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3160007 · Cited by 483
Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model
Zhu, L., Liao, B., Zhang, Q., Wang, X., Liu, W., & Wang, X. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.09417 · Cited by 414
Liu, M., Chai, Z., Deng, H., & Liu, R. (2022) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2022.3177235 · Cited by 409
Optical Remote Sensing Image Change Detection Based on Attention Mechanism and Image Difference
Peng, X., Zhong, R., Li, Z., & Li, Q. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3033009 · Cited by 379
Wu, H., Huang, P., Zhang, M., Tang, W., & Yu, X. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3314641 · Cited by 360
TransUNetCD: A Hybrid Transformer Network for Change Detection in Optical Remote-Sensing Images
Li, Q., Zhong, R., Du, X., & Du, Y. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3169479 · Cited by 347
Zhang, C., Jiang, W., Zhang, Y., Wang, W., Zhao, Q., & Wang, C. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3144894 · Cited by 325
Remote sensing in urban planning: Contributions towards ecologically sound policies?
Wellmann, T., Lausch, A., Andersson, E., Knapp, S., Cortinovis, C., Jache, J., Scheuer, S., Kremer, P., Mascarenhas, A., Kraemer, R., et al. (2020) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2020.103921 · Cited by 276
Zhu, Q., Liao, C., Hu, H., Mei, X., & Li, H. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3026051 · Cited by 264
Han, C., Wu, C., Guo, H., Hu, M., & Chen, H. (2023) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3264802 · Cited by 259
Self-citationToward Automatic Building Footprint Delineation From Aerial Images Using CNN and Regularization
Wei, S., Ji, S., & Lu, M. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2954461 · Cited by 242
Transformer-Based Multistage Enhancement for Remote Sensing Image Super-Resolution
Lei, S., Shi, Z., & Mo, W. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3136190 · Cited by 236
FCCDN: Feature constraint network for VHR image change detection
Chen, P., Zhang, B., Hong, D., Chen, Z., Yang, X., & Li, B. (2022) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2022.02.021 · Cited by 231
A CBAM Based Multiscale Transformer Fusion Approach for Remote Sensing Image Change Detection
Wang, W., Tan, X., Zhang, P., & Wang, X. (2022) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2022.3198517 · Cited by 208
TreeUNet: Adaptive Tree convolutional neural networks for subdecimeter aerial image segmentation
Yue, K., Yang, L., Li, R., Hu, W., Zhang, F., & Li, W. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.07.007 · Cited by 189
An attention-fused network for semantic segmentation of very-high-resolution remote sensing imagery
Yang, X., Li, S., Chen, Z., Chanussot, J., Jia, X., Zhang, B., Li, B., & Chen, P. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.05.004 · Cited by 189
An attention-based multiscale transformer network for remote sensing image change detection
Liu, W., Lin, Y., Liu, W., Yu, Y., & Li, J. (2023) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2023.07.001 · Cited by 183
Liquid Structural State-Space ModelsPreprint
Hasani, R., Lechner, M., Wang, T.-H. J., Chahine, M., Amini, A., & Rus, D. L. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.12951 · Cited by 180
Han, C., Wu, C., Guo, H., Hu, M., Li, J., & Chen, H. (2023) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3310208 · Cited by 169
Self-citationAdversarial Instance Augmentation for Building Change Detection in Remote Sensing Images
Chen, H., Li, W., & Shi, Z. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3066802 · Cited by 166
Self-citationSimplified State Space Layers for Sequence Modeling
Smith, J. T. H., Warrington, A., & Linderman, S. W. (2022) · arXiv · doi:10.48550/arxiv.2208.04933 · Cited by 162
Detecting Urban Changes with Recurrent Neural Networks from Multitemporal Sentinel-2 Data
Papadomanolaki, M., Verma, S., Vakalopoulou, M., Gupta, S., & Karantzalos, K. (2019) · IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium · doi:10.1109/igarss.2019.8900330 · Cited by 159
Coupled Adversarial Training for Remote Sensing Image Super-Resolution
Lei, S., Shi, Z., & Zou, Z. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2959020 · Cited by 159
Zhao, S., Zhang, X., Xiao, P., & He, G. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3327780 · Cited by 144
Self-citationSpatial information inference net: Road extraction using road-specific contextual information
Tao, C., Qi, J., Li, Y., Wang, H., & Li, H. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.10.001 · Cited by 136
Jiang, X., Li, Y., Jiang, T., Xie, J., Wu, Y., Cai, Q., Jiang, J., Xu, J., & Zhang, H. (2022) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2022.102987 · Cited by 84
Serrano, T., Chevrier, C., Multigner, L., Cordier, S., & Jégou, B. (2013) · Human Reproduction · doi:10.1093/humrep/det111 · Cited by 72
BDTNet: Road Extraction by Bi-Direction Transformer From Remote Sensing Images
Luo, L., Wang, J., Chen, S.-B., Tang, J., & Luo, B. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2022.3183828 · Cited by 50
Cited by
Change Detection Methods for Remote Sensing in the Last Decade: A Comprehensive Review
Cheng, G., Huang, Y., Li, X., Lyu, S., Xu, Z., Zhao, H., Zhao, Q., & Xiang, S. (2024) · Remote Sensing · doi:10.3390/rs16132355 · Cited by 263
Metadata
- Authors
- Zhao, S., Chen, H., Zhang, X., Xiao, P., Bai, L., & Ouyang, W.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2024
- Volume
- 62
- Pages
- 1-14
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W4400448280
- Cited by
- 323
- References
- 61
- FWCI
- 54.43
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.