The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
Challenges and Opportunities of Multimodality and Data Fusion in Remote Sensing
Open accessAbstract
Remote sensing is one of the most common ways to extract relevant information about Earth and our environment. Remote sensing acquisitions can be done by both active (synthetic aperture radar, LiDAR) and passive (optical and thermal range, multispectral and hyperspectral) devices. According to the sensor, a variety of information about the Earth's surface can be obtained. The data acquired by these sensors can provide information about the structure (optical, synthetic aperture radar), elevation (LiDAR), and material content (multispectral and hyperspectral) of the objects in the image. Once considered together their complementarity can be helpful for characterizing land use (urban analysis, precision agriculture), damage detection (e.g., in natural disasters such as floods, hurricanes, earthquakes, oil spills in seas), and give insights to potential exploitation of resources (oil fields, minerals). In addition, repeated acquisitions of a scene at different times allows one to monitor natural resources and environmental variables (vegetation phenology, snow cover), anthropological effects (urban sprawl, deforestation), climate changes (desertification, coastal erosion), among others. In this paper, we sketch the current opportunities and challenges related to the exploitation of multimodal data for Earth observation. This is done by leveraging the outcomes of the data fusion contests, organized by the IEEE Geoscience and Remote Sensing Society since 2006. We will report on the outcomes of these contests, presenting the multimodal sets of data made available to the community each year, the targeted applications, and an analysis of the submitted methods and results: How was multimodality considered and integrated in the processing chain? What were the improvements/new opportunities offered by the fusion? What were the objectives to be addressed and the reported solutions? And from this, what will be the next challenges?
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Pattern Recognition and Machine Learning
(2007) · Kybernetes · doi:10.1108/03684920710743466 · Cited by 8,265
The Laplacian pyramid as a compact image code
Burt, P., & Adelson, E. (1983) · IEEE Transactions on Communications · doi:10.1109/tcom.1983.1095851 · Cited by 6,077
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841 · cited 1×
“The emerging paradigms of deep learning provide an approach to systematically and hierarchically learn the underlying structure in datasets via deep neural networks [76], [77].”
BackgroundReview Article Digital change detection techniques using remotely-sensed data
SINGH, A. (1989) · International Journal of Remote Sensing · doi:10.1080/01431168908903939 · Cited by 3,849
Lu, D., Mausel, P., Brondízio, E., & Moran, E. (2004) · International Journal of Remote Sensing · doi:10.1080/0143116031000139863 · Cited by 3,226
An introduction to multisensor data fusion
Hall, D. L., & Llinas, J. (1997) · Proceedings of the IEEE · doi:10.1109/5.554205 · Cited by 2,629
Hyperspectral remote sensing data analysis and future challenges
Bioucas-Dias, J. M., Plaza, A., Camps-Valls, G., Scheunders, P., Nasrabadi, N., & Chanussot, J. (2013) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2013.2244672 · Cited by 2,223
Self-citationReview article Multisensor image fusion in remote sensing: Concepts, methods and applications
Pohl, C., & Van Genderen, J. L. (1998) · International Journal of Remote Sensing · doi:10.1080/014311698215748 · Cited by 2,211
Remote sensing, models, and methods for image processing
Schowengerdt, R. A. (1997) · Cited by 2,122
Cited by
Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data
Kussul, N., Lavreniuk, M., Skakun, S., & Shelestov, A. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2681128 · Cited by 1,786
Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects
Lahat, D., Adali, T., & Jutten, C. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2460697 · Cited by 1,296
“contest of the IEEE Geoscience and Remote Sensing Society (GRSS) (see dedicated paper in this issue [44]).”
BackgroundDeep learning in multimodal remote sensing data fusion: A comprehensive review
Li, J., Hong, D., Gao, L., Yao, J., Zheng, K., Zhang, B., & Chanussot, J. (2022) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2022.102926 · Cited by 630
Self-citationHong, D., Zhang, B., Li, H., Li, Y., Yao, J., Li, C., Werner, M., Chanussot, J., Zipf, A., & Zhu, X. X. (2023) · Remote Sensing of Environment · doi:10.1016/j.rse.2023.113856 · Cited by 545
Self-citationMultimodal Classification of Remote Sensing Images: A Review and Future Directions
Gomez-Chova, L., Tuia, D., Moser, G., & Camps-Valls, G. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2449668 · Cited by 508
Fan, C., Zhang, C., Yahja, A., & Mostafavi, A. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.102049 · Cited by 434
Deep Learning-Based Change Detection in Remote Sensing Images: A Review
Shafique, A., Cao, G., Khan, Z., Asad, M., & Aslam, M. (2022) · Remote Sensing · doi:10.3390/rs14040871 · Cited by 419
Convolutional Neural Networks for Multimodal Remote Sensing Data Classification
Wu, X., Hong, D., & Chanussot, J. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3124913 · Cited by 412
Self-citationDetail Injection-Based Deep Convolutional Neural Networks for Pansharpening
Deng, L.-J., Vivone, G., Jin, C., & Chanussot, J. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3031366 · Cited by 332
Self-citationHong, D., Hu, J., Yao, J., Chanussot, J., & Zhu, X. X. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.05.011 · Cited by 326
Self-citationMeng, X., Shen, H., Li, H., Zhang, L., & Fu, R. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.05.006 · Cited by 324
Hong, D., He, W., Yokoya, N., Yao, J., Gao, L., Zhang, L., Chanussot, J., & Zhu, X. (2021) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2021.3064051 · Cited by 275
Self-citationSun, W., Zhou, J., Meng, X., Yang, G., Ren, K., & Peng, J. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3335418 · Cited by 267
Crop type classification using a combination of optical and radar remote sensing data: a review
Orynbaikyzy, A., Gessner, U., & Conrad, C. (2019) · International Journal of Remote Sensing · doi:10.1080/01431161.2019.1569791 · Cited by 256
A Review on Explainability in Multimodal Deep Neural Nets
Joshi, G., Walambe, R., & Kotecha, K. (2021) · IEEE Access · doi:10.1109/access.2021.3070212 · Cited by 204
Metadata
- Authors
- Dalla Mura, M., Prasad, S., Pacifici, F., Gamba, P., Chanussot, J., & Benediktsson, J. A.
- Venue
- Proceedings of the IEEE
- Published
- 2015-09
- Volume
- 103
- Issue
- 9
- Pages
- 1585-1601
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W1583106483
- Cited by
- 286
- References
- 65
- FWCI
- 29.44
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.