The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Panoptic Segmentation of Satellite Image Time Series with Convolutional Temporal Attention Networks
Open accessAbstract
Unprecedented access to multi-temporal satellite imagery has opened new perspectives for a variety of Earth observation tasks. Among them, pixel-precise panoptic segmentation of agricultural parcels has major economic and environmental implications. While researchers have explored this problem for single images, we argue that the complex temporal patterns of crop phenology are better addressed with temporal sequences of images. In this paper, we present the first end-to-end, single-stage method for panoptic segmentation of Satellite Image Time Series (SITS). This module can be combined with our novel image sequence encoding network which relies on temporal self-attention to extract rich and adaptive multi-scale spatiotemporal features. We also introduce PASTIS, the first open-access SITS dataset with panoptic annotations. We demonstrate the superiority of our encoder for semantic segmentation against multiple competing architectures, and set up the first state-of-the-art of panoptic segmentation of SITS. Our implementation and PASTIS are publicly available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“We also outperform UTAE [48], a SITS state-of-the-art, by 18%.”
From SatMAE: Pre-Training Transformers for Temporal and Multi-Spectral Satellite Imagery (2022) · cites this paper as [48]
The cited source says what the claim attributes to it.
In the citing paper
“The dataset followed the original split [37]: folds 1-3 for training, 4 for validation, and 5 for testing.”
From Prithvi-EO-2.0: A Versatile Multitemporal Foundation Model for Earth Observation Applications (2026) · cites this paper as [37]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., & Woo, W.-C. (2015) · arXiv · doi:10.48550/arxiv.1506.04214 · Cited by 7,709
Deep learning in agriculture: A survey
Kamilaris, A., & Prenafeta-Boldú, F. X. (2018) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2018.02.016 · Cited by 5,886
Stacked Hourglass Networks for Human Pose Estimation
Newell, A., Yang, K., & Deng, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_29 · Cited by 5,634
Sentinel-2: ESA's Optical High-Resolution Mission for GMES Operational Services
Drusch, M., Bello, U. D., Carlier, S., Colin, O., Fernandez, V., Gascon, F., Hoersch, B., Isola, C., Laberinti, P., Martimort, P., et al. (2012) · Remote Sensing of Environment · doi:10.1016/j.rse.2011.11.026 · Cited by 4,906
CornerNet: Detecting Objects as Paired Keypoints
Law, H., & Deng, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_45 · Cited by 3,852
Wu, Y., & He, K. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01198-w · Cited by 3,601
Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data
Kussul, N., Лавренюк, М. С., Skakun, S. V., & Шелестов, А. Ю. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2681128 · Cited by 1,886
Yu, F., Wang, D., Shelhamer, E., & Darrell, T. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00255 · Cited by 1,623
Panoptic Feature Pyramid Networks
Kirillov, A., Girshick, R., He, K., & Dollár, P. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00656 · Cited by 1,460
Ye, L., & Keogh, E. (2009) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1557019.1557122 · Cited by 992
Delving Deeper into Convolutional Networks for Learning Video RepresentationsPreprint
Ballas, N., Yao, L., Pal, C., & Courville, A. C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06432 · Cited by 767
Yang, L., Fan, Y., & Xu, N. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00529 · Cited by 537
3D Convolutional Neural Networks for Crop Classification with Multi-Temporal Remote Sensing Images
Ji, S., Zhang, C., Xu, A., Shi, Y. B., & Duan, Y. (2018) · Remote Sensing · doi:10.3390/rs10010075 · Cited by 417
Inglada, J., Arias, M., Tardy, B., Hagolle, O., Valero, S., Morin, D., Dedieu, G., Sepulcre, G., Bontemps, S., Defourny, P., et al. (2015) · Remote Sensing · doi:10.3390/rs70912356 · Cited by 411
Self-attention for raw optical Satellite Time Series Classification
Rußwurm, M., & Körner, M. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.06.006 · Cited by 405
Semantic Segmentation of Earth Observation Data Using Multimodal and Multi-scale Deep Networks
Audebert, N., Saux, B. L., & Lefèvre, S. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-54181-5_12 · Cited by 386
Waldner, F., & Diakogiannis, F. I. (2020) · Remote Sensing of Environment · doi:10.1016/j.rse.2020.111741 · Cited by 338
How much does multi-temporal Sentinel-2 data improve crop type classification?
Vuolo, F., Neuwirth, M., Immitzer, M., Atzberger, C., & Ng, W. (2018) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2018.06.007 · Cited by 311
Zhou, X., Wang, D., & Krähenbühl, P. (2019) · arXiv · doi:10.48550/arxiv.1904.07850 · Cited by 288
Land Cover Classification via Multitemporal Spatial Data by Deep Recurrent Neural Networks
Ienco, D., Gaetano, R., Dupaquier, C., & Maurel, P. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2728698 · Cited by 285
EfficientPS: Efficient Panoptic Segmentation
Mohan, R., & Valada, A. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01445-z · Cited by 268
Self-Supervised Pretraining of Transformers for Satellite Image Time Series Classification
Yuan, Y., & Lin, L. (2020) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3036602 · Cited by 224
Papadomanolaki, M., Vakalopoulou, M., & Karantzalos, K. G. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3055584 · Cited by 205
Satellite Image Time Series Classification With Pixel-Set Encoders and Temporal Self-Attention
Garnot, V. S. F., Landrieu, L., Giordano, S., & Chehata, N. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01234 · Cited by 200
Self-citationCrop mapping from image time series: Deep learning with multi-scale label hierarchies
Türkoglu, M. Ö., D’Aronco, S., Perich, G., Liebisch, F., Streit, C., Konrad Schindler, B., & Wegner, J. D. (2021) · Remote Sensing of Environment · doi:10.1016/j.rse.2021.112603 · Cited by 194
Stoian, A., Poulain, V., Inglada, J., Poughon, V., & Derksen, D. (2019) · Remote Sensing · doi:10.3390/rs11171986 · Cited by 175
Kim, D., Woo, S., Lee, J., & Kweon, I. S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00988 · Cited by 166
Satellite Image Time Series Classification with Pixel-Set Encoders and Temporal Self-Attention
Garnot, V. S. F., Landrieu, L., Giordano, S., & Chehata, N. (2020) · HAL · Cited by 158
Self-citationLearning to Segment Moving Objects
Tokmakov, P., Schmid, C., & Alahari, K. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-018-1122-2 · Cited by 126
Semantic Segmentation of Crop Type in Africa: A Novel Dataset and Analysis of Deep Learning Methods
Rustowicz, R., Cheong, R., Wang, L., Ermon, S., Burke, M., & Lobell, D. B. (2019) · Cited by 125
Temporal Convolutional Neural Network for the Classification of Satellite Image Time Series
Pelletier, C., Webb, G. I., & Petitjean, F. (2019) · Remote Sensing · doi:10.3390/rs11050523 · Cited by 122
Masoud, K. M., Persello, C., & Tolpekin, V. A. (2019) · Remote Sensing · doi:10.3390/rs12010059 · Cited by 120
Results from the Planet Labs Flock Constellation
Boshuizen, C. R., Mason, J., Klupar, P., & Spanhake, S. (2014) · Digital Commons - USU (Utah State University) · Cited by 116
A machine learning approach for agricultural parcel delineation through agglomerative segmentation
García‐Pedrero, Á., Gonzalo‐Martín, C., & Lillo‐Saavedra, M. (2017) · International Journal of Remote Sensing · doi:10.1080/01431161.2016.1278312 · Cited by 113
Martinez, J. A. C., Rosa, L. E. C. L., Feitosa, R. Q., Sanches, I. D., & Happ, P. N. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.11.007 · Cited by 111
Lightweight Temporal Self-attention for Classifying Satellite Images Time Series
Garnot, V. S. F., & Landrieu, L. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-65742-0_12 · Cited by 102
Self-citationSpatio-temporal reasoning for the classification of satellite image time series
Petitjean, F., Kurtz, C., Passat, N., & Gançarski, P. (2012) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.06.009 · Cited by 92
CenterMask: Single Shot Instance Segmentation With Point Representation
Wang, Y., Xu, Z., Shen, H., Cheng, B., & Yang, L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00933 · Cited by 86
Garnot, V. S. F., Landrieu, L., Giordano, S., & Chehata, N. (2019) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2019.8900517 · Cited by 73
Self-citationWagner, F. H., Dalagnol, R., Tarabalka, Y., Segantine, T. Y. F., Thomé, R., & Hirye, M. C. M. (2020) · Remote Sensing · doi:10.3390/rs12101544 · Cited by 72
Panoptic Feature Pyramid NetworksPreprint
Kirillov, A., Girshick, R., He, K., & Dollár, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.02446 · Cited by 66
Convolutional LSTMs for Cloud-Robust Segmentation of Remote Sensing ImageryPreprint
Rußwurm, M., & Körner, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.02471 · Cited by 47
Crop Classification Under Varying Cloud Cover With Neural Ordinary Differential Equations
Metzger, N., Türkoglu, M. Ö., D’Aronco, S., Wegner, J. D., & Konrad Schindler, B. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3101965 · Cited by 46
Dense Bag-of-Temporal-SIFT-Words for Time Series Classification
Bailly, A., Malinowski, S., Tavenard, R., Chapel, L., & Guyet, T. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-44412-3_2 · Cited by 34
Attentive Spatial Temporal Graph CNN for Land Cover Mapping From Multi Temporal Remote Sensing Data
Censi, A. M., Ienco, D., Gbodjo, Y. J. E., Pensa, R. G., Interdonato, R., & Gaetano, R. (2021) · IEEE Access · doi:10.1109/access.2021.3055554 · Cited by 31
Bailly, S., Giordano, S., Landrieu, L., & Chehata, N. (2018) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2018.8518427 · Cited by 24
Self-citationQin, Y., Ferraz, A., Mallet, C., & Iovan, C. (2014) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2014.6946545 · Cited by 21
Efficient Temporal Kernels Between Feature Sets for Time Series Classification
Tavenard, R., Malinowski, S., Chapel, L., Bailly, A., Sanchez, H., & Bustos, B. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-71246-8_32 · Cited by 11
Derksen, D., Inglada, J., & Michel, J. (2018) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2018.8518961 · Cited by 9
Crop Classification under Varying Cloud Cover with Neural Ordinary Differential Equations
Metzger, N., Turkoglu, M. O., D'Aronco, S., Wegner, J. D., & Schindler, K. (2020) · arXiv · doi:10.48550/arxiv.2012.02542
Crop mapping from image time series: deep learning with multi-scale label hierarchies
Turkoglu, M. O., D'Aronco, S., Perich, G., Liebisch, F., Streit, C., Schindler, K., & Wegner, J. D. (2021) · arXiv · doi:10.48550/arxiv.2102.08820
Research works printed but not linked: 1
- zhao, 2018, Tree canopy differentiation using instance-aware semantic segmentation, ASABE Annual International Meeting
Cited by
Sorted by citations
Transfer learning in environmental remote sensing
Ma, Y., Chen, S., Ermon, S., & Lobell, D. B. (2023) · Remote Sensing of Environment · doi:10.1016/j.rse.2023.113924 · Cited by 486
Remote Sensing Object Detection in the Deep Learning Era—A Review
Gui, S., Song, S., Qin, R., & Tang, Y. (2024) · Remote Sensing · doi:10.3390/rs16020327 · Cited by 367
SatMAE: Pre-Training Transformers for Temporal and Multi-Spectral Satellite Imagery
Cong, Y., Khanna, S., Meng, C., Liu, P., Rozi, E., He, Y., Burke, M., Lobell, D., & Ermon, S. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-0015 · Cited by 303
SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understanding
Bastani, F., Wolters, P., Gupta, R., Ferdinando, J., & Kembhavi, A. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01538 · Cited by 223
Multi-modal temporal attention models for crop mapping from satellite time series
Garnot, V. S. F., Landrieu, L., & Chehata, N. (2022) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2022.03.012 · Cited by 156
Self-citation
Metadata
- Authors
- Fare Garnot, V. S., & Landrieu, L.
- Affiliations
- Univ. Gustave Eiffel, ENSG, IGN,LASTIG,Saint-Mande,France,F-94160
- Venue
- 2021 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2021-10
- Pages
- 4852-4861
- OpenAlex
- W3185151088
- Cited by
- 242
- References
- 56
- Citations by year
- 2026: 49 · 2025: 67 · 2024: 60 · 2023: 43 · 2022: 20 · 2021: 3
- FWCI
- 54.60
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- HAL (submittedVersion, other-oa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Remote-Sensing Image Classification
- Physical Sciences › Environmental Science › Ecology › Remote Sensing in Agriculture
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- panoptic segmentation, satellite image time series, crop phenology, agricultural parcels, temporal self-attention, spatio-temporal features, semantic segmentation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
