The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
Challenges and Opportunities of Multimodality and Data Fusion in Remote Sensing
Open accessAbstract
Remote sensing is one of the most common ways to extract relevant information about Earth and our environment. Remote sensing acquisitions can be done by both active (synthetic aperture radar, LiDAR) and passive (optical and thermal range, multispectral and hyperspectral) devices. According to the sensor, a variety of information about the Earth's surface can be obtained. The data acquired by these sensors can provide information about the structure (optical, synthetic aperture radar), elevation (LiDAR), and material content (multispectral and hyperspectral) of the objects in the image. Once considered together their complementarity can be helpful for characterizing land use (urban analysis, precision agriculture), damage detection (e.g., in natural disasters such as floods, hurricanes, earthquakes, oil spills in seas), and give insights to potential exploitation of resources (oil fields, minerals). In addition, repeated acquisitions of a scene at different times allows one to monitor natural resources and environmental variables (vegetation phenology, snow cover), anthropological effects (urban sprawl, deforestation), climate changes (desertification, coastal erosion), among others. In this paper, we sketch the current opportunities and challenges related to the exploitation of multimodal data for Earth observation. This is done by leveraging the outcomes of the data fusion contests, organized by the IEEE Geoscience and Remote Sensing Society since 2006. We will report on the outcomes of these contests, presenting the multimodal sets of data made available to the community each year, the targeted applications, and an analysis of the submitted methods and results: How was multimodality considered and integrated in the processing chain? What were the improvements/new opportunities offered by the fusion? What were the objectives to be addressed and the reported solutions? And from this, what will be the next challenges?
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Pattern Recognition and Machine Learning
(2007) · Kybernetes · doi:10.1108/03684920710743466 · Cited by 8,265
The Laplacian pyramid as a compact image code
Burt, P., & Adelson, E. (1983) · IEEE Transactions on Communications · doi:10.1109/tcom.1983.1095851 · Cited by 6,077
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841
Review Article Digital change detection techniques using remotely-sensed data
SINGH, A. (1989) · International Journal of Remote Sensing · doi:10.1080/01431168908903939 · Cited by 3,849
Lu, D., Mausel, P., Brondízio, E., & Moran, E. (2004) · International Journal of Remote Sensing · doi:10.1080/0143116031000139863 · Cited by 3,226
An introduction to multisensor data fusion
Hall, D. L., & Llinas, J. (1997) · Proceedings of the IEEE · doi:10.1109/5.554205 · Cited by 2,629
Hyperspectral remote sensing data analysis and future challenges
Bioucas-Dias, J. M., Plaza, A., Camps-Valls, G., Scheunders, P., Nasrabadi, N., & Chanussot, J. (2013) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2013.2244672 · Cited by 2,223
Self-citationReview article Multisensor image fusion in remote sensing: Concepts, methods and applications
Pohl, C., & Van Genderen, J. L. (1998) · International Journal of Remote Sensing · doi:10.1080/014311698215748 · Cited by 2,211
Remote sensing, models, and methods for image processing
Schowengerdt, R. A. (1997) · Cited by 2,122
Review ArticleDigital change detection methods in ecosystem monitoring: a review
Coppin, P., Jonckheere, I., Nackaerts, K., Muys, B., & Lambin, E. (2004) · International Journal of Remote Sensing · doi:10.1080/0143116031000101675 · Cited by 2,100
Multisensor data fusion: A review of the state-of-the-art
Khaleghi, B., Khamis, A., Karray, F. O., & Razavi, S. N. (2013) · Information Fusion · doi:10.1016/j.inffus.2011.08.001 · Cited by 2,074
Image change detection algorithms: a systematic survey
Radke, R. J., Andra, S., Al-Kofahi, O., & Roysam, B. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.838698 · Cited by 1,869
Lucien Wald, A., Ranchin, T., & Mangolini, M. (1997) · HAL · Cited by 1,362
Mathematical Techniques in Multisensor Data Fusion
Hall, D. L. (1992) · Cited by 1,356
A Critical Comparison Among Pansharpening Algorithms
Vivone, G., Alparone, L., Chanussot, J., Dalla Mura, M., Garzelli, A., Licciardi, G. A., Restaino, R., & Wald, L. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2361734 · Cited by 1,303
Self-citationHyperspectral Image Classification Using Dictionary-Based Sparse Representation
Chen, Y., Nasrabadi, N. M., & Tran, T. D. (2011) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2129595 · Cited by 1,155
Oil spill detection by satellite remote sensing
Brekke, C., & Solberg, A. H. S. (2005) · Remote Sensing of Environment · doi:10.1016/j.rse.2004.11.015 · Cited by 1,095
Composite Kernels for Hyperspectral Image Classification
Camps-Valls, G., Gomez-Chova, L., Munoz-Mari, J., Vila-Frances, J., & Calpe-Maravilla, J. (2006) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2005.857031 · Cited by 1,068
Image‐based 3D Modelling: A Review
Remondino, F., & El‐Hakim, S. (2006) · The Photogrammetric Record · doi:10.1111/j.1477-9730.2006.00383.x · Cited by 1,019
An empirical evaluation of deep architectures on problems with many factors of variation
Larochelle, H., Erhan, D., Courville, A., Bergstra, J., & Bengio, Y. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273556 · Cited by 992
Multispectral and Panchromatic Data Fusion Assessment Without Reference
Alparone, L., Aiazzi, B., Baronti, S., Garzelli, A., Nencini, F., & Selva, M. (2008) · Photogrammetric Engineering & Remote Sensing · doi:10.14358/pers.74.2.193 · Cited by 892
Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest
Alparone, L., Wald, L., Chanussot, J., Thomas, C., Gamba, P., & Bruce, L. M. (2007) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2007.904923 · Cited by 886
Self-citationCarper, W. J. (1990) · Photogrammetric Engineering & Remote Sensing · Cited by 873
A new quality metric for image fusion
Piella, G., & Heijmans, H. (2004) · Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429) · doi:10.1109/icip.2003.1247209 · Cited by 838
Advances in Hyperspectral Image Classification: Earth Monitoring with Statistical Learning Methods
Camps-Valls, G., Tuia, D., Bruzzone, L., & Benediktsson, J. A. (2014) · IEEE Signal Processing Magazine · doi:10.1109/msp.2013.2279179 · Cited by 781
Self-citationMulti-source remote sensing data fusion: status and trends
Zhang, J. (2010) · International Journal of Image and Data Fusion · doi:10.1080/19479830903561035 · Cited by 764
Nielsen, A. A. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.888195 · Cited by 746
Review of oil spill remote sensing
Fingas, M., & Brown, C. (2014) · Marine Pollution Bulletin · doi:10.1016/j.marpolbul.2014.03.059 · Cited by 723
Hyperspectral and LiDAR Data Fusion: Outcome of the 2013 GRSS Data Fusion Contest
Debes, C., Merentitis, A., Heremans, R., Hahn, J., Frangiadakis, N., van Kasteren, T., Liao, W., Bellens, R., Pizurica, A., Gautama, S., et al. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2305441 · Cited by 653
Self-citationThomas, C., Ranchin, T., Wald, L., & Chanussot, J. (2008) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2007.912448 · Cited by 632
Self-citationFusion of Hyperspectral and LIDAR Remote Sensing Data for Classification of Complex Forest Areas
Dalponte, M., Bruzzone, L., & Gianelle, D. (2008) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2008.916480 · Cited by 564
Locality-Preserving Dimensionality Reduction and Classification for Hyperspectral Image Analysis
Li, W., Prasad, S., Fowler, J. E., & Bruce, L. M. (2012) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2165957 · Cited by 472
Self-citationCanty, M. J., & Nielsen, A. A. (2008) · Remote Sensing of Environment · doi:10.1016/j.rse.2007.07.013 · Cited by 363
Limitations of Principal Components Analysis for Hyperspectral Target Recognition
Prasad, S., & Bruce, L. M. (2008) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2008.2001282 · Cited by 340
Self-citationBruzzone, L., & Bovolo, F. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2197169 · Cited by 330
A Framework for Automatic and Unsupervised Detection of Multiple Changes in Multitemporal Images
Bovolo, F., Marchesi, S., & Bruzzone, L. (2012) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2171493 · Cited by 328
Mapping forest degradation in the Eastern Amazon from SPOT 4 through spectral mixture models
Souza, C. (2003) · Remote Sensing of Environment · doi:10.1016/j.rse.2002.08.002 · Cited by 294
Lunga, D., Prasad, S., Crawford, M. M., & Ersoy, O. (2014) · IEEE Signal Processing Magazine · doi:10.1109/msp.2013.2279894 · Cited by 293
Self-citationA survey of classical methods and new trends in pansharpening of multispectral images
Amro, I., Mateos, J., Vega, M., Molina, R., & Katsaggelos, A. K. (2011) · EURASIP Journal on Advances in Signal Processing · doi:10.1186/1687-6180-2011-79 · Cited by 275
Remote Sensing and Earthquake Damage Assessment: Experiences, Limits, and Perspectives
Dell'Acqua, F., & Gamba, P. (2012) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2196404 · Cited by 228
Self-citationA Review of data fusion models and architectures: towards engineering guidelines
Esteban, J., Starr, A., Willetts, R., Hannah, P., & Bryanston-Cross, P. (2005) · Neural Computing and Applications · doi:10.1007/s00521-004-0463-7 · Cited by 226
(2013) · Choice Reviews Online · doi:10.5860/choice.50-6201 · Cited by 224
Classification of Remote Sensing Optical and LiDAR Data Using Extended Attribute Profiles
Pedergnana, M., Marpu, P., Mura, M. D., Benediktsson, J. A., & Bruzzone, L. (2012) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2012.2208177 · Cited by 192
Self-citationLongbotham, N., Pacifici, F., Glenn, T., Zare, A., Volpi, M., Tuia, D., Christophe, E., Michel, J., Inglada, J., Chanussot, J., et al. (2012) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2011.2179638 · Cited by 182
Self-citationLicciardi, G., Pacifici, F., Tuia, D., Prasad, S., West, T., Giacco, F., Thiel, C., Inglada, J., Christophe, E., Chanussot, J., et al. (2009) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2009.2029340 · Cited by 182
Self-citationAnalysis of Hyperion data with the FLAASH atmospheric correction algorithm
Felde, G. W., Anderson, G. P., Cooley, T. W., Matthew, M. W., adler-Golden, S. M., Berk, A., & Lee, J. (2004) · IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477) · doi:10.1109/igarss.2003.1293688 · Cited by 162
Urban Mapping Using Coarse SAR and Optical Data: Outcome of the 2007 GRSS Data Fusion Contest
Pacifici, F., Frate, F. D., Emery, W. J., et al. (2008) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2008.915939 · Cited by 126
Self-citationRoad extraction based on fuzzy logic and mathematical morphology from pan‐sharpened ikonos images
Mohammadzadeh, A., Tavakoli, A., & Zoej, M. J. V. (2006) · The Photogrammetric Record · doi:10.1111/j.1477-9730.2006.00353.x · Cited by 121
Very High-Resolution Remote Sensing: Challenges and Opportunities [Point of View]
Benediktsson, J. A., Chanussot, J., & Moon, W. M. (2012) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2190811 · Cited by 105
Self-citationDemir, B., Bovolo, F., & Bruzzone, L. (2011) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2168534 · Cited by 104
Ensemble Multiple Kernel Active Learning For Classification of Multisource Remote Sensing Data
Zhang, Y., Yang, H. L., Prasad, S., Pasolli, E., Jung, J., & Crawford, M. M. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2359136 · Cited by 93
Self-citationMulti-Modal and Multi-Temporal Data Fusion: Outcome of the 2012 GRSS Data Fusion Contest
Berger, C. R., Voltersen, M., Eckardt, R., Eberle, J., Heyer, T., Salepci, N., Hese, S., Schmullius, C., Tao, J., Auer, S., et al. (2013) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2013.2245860 · Cited by 93
Self-citationHuman Settlements: A Global Challenge for EO Data Processing and Interpretation
Gamba, P. E. (2012) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2189089 · Cited by 65
Self-citationDelalieux, S., Zarco‐Tejada, P. J., Tits, L., Jiménez-Bello, M. A., Intrigliolo, D. S., & Somers, B. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2330352 · Cited by 56
Design of Tokyo Tech nano-satellite Cute-1.7+APD II and its operation
Ashida, H., Fujihashi, K., Inagawa, S., Miura, Y., Omagari, K., Miyashita, N., Matunaga, S., Toizumi, T., Kataoka, J., & Kawai, N. (2009) · Acta Astronautica · doi:10.1016/j.actaastro.2009.10.035 · Cited by 56
A novel approach to quantitative evaluation of hyperspectral image fusion techniques
Kotwal, K., & Chaudhuri, S. (2011) · Information Fusion · doi:10.1016/j.inffus.2011.03.008 · Cited by 51
Automatic Moving Vehicles Information Extraction From Single-Pass WorldView-2 Imagery
Salehi, B., Zhang, Y., & Zhong, M. (2012) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2012.2183117 · Cited by 48
Ghulam, A. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2319314 · Cited by 33
Image interpretation using multiple sensing modalities
Chu, C.-C., & Aggarwal, J. K. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.149595 · Cited by 31
Pacifici, F., Du, Q., & Prasad, S. (2013) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2013.2277532 · Cited by 23
Self-citationFusion of Hyperspectral and LiDAR Data for Landscape Visual Quality Assessment
Yokoya, N., Nakazawa, S., Matsuki, T., et al. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2313356 · Cited by 22
Foreword to the Special Issue on Data Fusion
Gamba, P. E., & Chanussot, J. (2008) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2008.919761 · Cited by 22
Self-citationMoving Car Detection and Spectral Restoration in a Single Satellite WorldView-2 Imagery
Bar, D. E., & Raboy, S. (2013) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2013.2253088 · Cited by 22
2011 GRSS Data Fusion Contest: Exploiting WorldView-2 multi-angular acquisitions
Pacifici, F., Chanussot, J., & Du, Q. (2011) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2011.6049404 · Cited by 11
Self-citation
Cited by
Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data
Kussul, N., Lavreniuk, M., Skakun, S., & Shelestov, A. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2681128 · Cited by 1,786
Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects
Lahat, D., Adali, T., & Jutten, C. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2460697 · Cited by 1,296
“contest of the IEEE Geoscience and Remote Sensing Society (GRSS) (see dedicated paper in this issue [44]).”
BackgroundDeep learning in multimodal remote sensing data fusion: A comprehensive review
Li, J., Hong, D., Gao, L., Yao, J., Zheng, K., Zhang, B., & Chanussot, J. (2022) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2022.102926 · Cited by 630
Self-citationHong, D., Zhang, B., Li, H., Li, Y., Yao, J., Li, C., Werner, M., Chanussot, J., Zipf, A., & Zhu, X. X. (2023) · Remote Sensing of Environment · doi:10.1016/j.rse.2023.113856 · Cited by 545
Self-citationMultimodal Classification of Remote Sensing Images: A Review and Future Directions
Gomez-Chova, L., Tuia, D., Moser, G., & Camps-Valls, G. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2449668 · Cited by 508
Metadata
- Authors
- Dalla Mura, M., Prasad, S., Pacifici, F., Gamba, P., Chanussot, J., & Benediktsson, J. A.
- Venue
- Proceedings of the IEEE
- Published
- 2015-09
- Volume
- 103
- Issue
- 9
- Pages
- 1585-1601
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W1583106483
- Cited by
- 286
- References
- 65
- FWCI
- 29.44
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.