Cloud Detection Autonomous System Based on Machine Learning and COTS Components On-Board Small Satellites
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
One of the main applications of small satellites is Earth observation. CubeSats and different kinds of nanosatellites usually form constellations that obtain images mainly using an optical payload. There is a massive amount of data generated by these satellites and a limited capacity of download due to volume and mass constraints that make it difficult to use high-speed communication systems and high-power systems. For this reason, it is important to develop satellites with the autonomy to process data on board. In this way, the limited communication channel can be used efficiently to download relevant images containing the required information. In this paper, a system for the satellite on-board processing of RGB images is proposed, which automatically detects the cloud coverage level to prioritize the images and effectively uses the download time and the mission operation center. The system implements a Convolutional Neural Network (CNN) on a Commercial off-the-Shelf (COTS) microcontroller that receives the image and returns the cloud level (priority). After training, the system was tested on a dataset of 100 images with an accuracy of 0.9 and it was also evaluated with CubeSat images to evaluate the performance of a different image sensor. This implementation contributes to the development of autonomous satellites with processing on board.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
CubeSat evolution: Analyzing CubeSat capabilities for conducting science missions
Poghosyan, A., & Golkar, A. (2017) · Progress in Aerospace Sciences · doi:10.1016/j.paerosci.2016.11.002 · Cited by 537
A survey and assessment of the capabilities of Cubesats for Earth observation
Selva, D., & Krejci, D. (2012) · Acta Astronautica · doi:10.1016/j.actaastro.2011.12.014 · Cited by 430
A cloud detection algorithm for satellite imagery based on deep learning
Jeppesen, J. H., Jacobsen, R. H., Inceoglu, F., & Toftegaard, T. S. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.03.039 · Cited by 402
Modern Small Satellites-Changing the Economics of Space
Sweeting, M. N. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2806218 · Cited by 382
Towards the Thousandth CubeSat: A Statistical Overview
Villela, T., Costa, C. A., Brandão, A. M., Bueno, F. T., & Leonardi, R. (2019) · International Journal of Aerospace Engineering · doi:10.1155/2019/5063145 · Cited by 269
Furano, G., Meoni, G., Dunne, A., Moloney, D., Ferlet-Cavrois, V., Tavoularis, A., Byrne, J., Buckley, L., Psarakis, M., Voss, K.-O., et al. (2020) · IEEE Aerospace and Electronic Systems Magazine · doi:10.1109/maes.2020.3008468 · Cited by 259
Cloudscout: a deep neural network for on-board cloud detection on hyperspectral images
Giuffrida, G., Diana, L., de Gioia, F., Benelli, G., Meoni, G., Donati, M., & Fanucci, L. (2020) · Remote Sensing · doi:10.3390/rs12142205 · Cited by 176
An Overview of Machine Learning within Embedded and Mobile Devices–Optimizations and Applications
Ajani, T. S., Imoize, A. L., & Atayero, A. A. (2021) · Sensors · doi:10.3390/s21134412 · Cited by 176
Small Satellite Missions for Earth Observation
Sandau, R., Röser, H.-P., & Valenzuela, A. (2010) · Springer eBooks · doi:10.1007/978-3-642-03501-2 · Cited by 121
Fast Cloud Segmentation Using Convolutional Neural Networks
Drönner, J., Korfhage, N., Egli, S., Mühling, M., Thies, B., Bendix, J., Freisleben, B., & Seeger, B. (2018) · Remote Sensing · doi:10.3390/rs10111782 · Cited by 119
Bäuerle, A., van Onzenoodt, C., & Ropinski, T. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3057483 · Cited by 97
Azami, M. H. B., Örger, N. C., Schulz, V. H., Oshiro, T., & Cho, M. (2022) · Remote Sensing · doi:10.3390/rs14081874 · Cited by 57
NASA's CubeSat Launch Initiative: Enabling broad access to space
Crusan, J. C., & Galica, C. (2018) · Acta Astronautica · doi:10.1016/j.actaastro.2018.08.048 · Cited by 56
Nanosatellites applied to optical Earth observation: a review
Nagel, G. W., Novo, E. M. L. D. M., & Kampel, M. (2020) · Ambiente e Agua - An Interdisciplinary Journal of Applied Science · doi:10.4136/ambi-agua.2513 · Cited by 56
On-Board Ship Detection in Micro-Nano Satellite Based on Deep Learning and COTS Component
Yao, Y., Jiang, Z., Zhang, H., & Zhou, Y. (2019) · Remote Sensing · doi:10.3390/rs11070762 · Cited by 51
Maskey, A., & Cho, M. (2020) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2020.103952 · Cited by 47
Cloud detection on small satellites based on lightweight U-net and image compression
Zhang, Z., Iwasaki, A., Xu, G., & Song, J. (2019) · Journal of Applied Remote Sensing · doi:10.1117/1.jrs.13.026502 · Cited by 39
Spence, H. E., Caspi, A., Bahcivan, H., Nieves-Chinchilla, J., Crowley, G., Cutler, J., Fish, C. S., Jackson, D. R., Moretto, T., Klumpar, D. M., et al. (2022) · Space Weather · doi:10.1029/2021sw003031 · Cited by 31
In-orbit feasibility demonstration of supercapacitors for space applications
González-Llorente, J., Lidtke, A., Hatanaka, K., Limam, L., Tapia, I. F., & Okuyama, K. (2020) · Acta Astronautica · doi:10.1016/j.actaastro.2020.05.007 · Cited by 30
Routers in space: Kepler communications' CubeSats will create an Internet for other satellites
Mitry, M. (2020) · IEEE Spectrum · doi:10.1109/mspec.2020.8976900 · Cited by 24
RGB Image Prioritization Using Convolutional Neural Network on a Microprocessor for Nanosatellites
Park, J. H., Inamori, T., Hamaguchi, R., Otsuki, K., Kim, J. E., & Yamaoka, K. (2020) · Remote Sensing · doi:10.3390/rs12233941 · Cited by 23
POTENTIAL AND LIMITATIONS OF PHOTOMETRIC RECONSTRUCTION THROUGH A FLOCK OF DOVE CUBESATS
Altena, B., Mousivand, A., Mascaro, J., & Kääb, A. (2017) · The international archives of the photogrammetry, remote sensing and spatial information sciences/International archives of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-archives-xlii-3-w3-7-2017 · Cited by 5
Research works printed but not linked: 1
- Giovanni, C., and Eliot, B. (2019, January 21–25). Technology transfer and capability building for Colombia’s space program by means of small satellites. Proceedings of the International Astronautical Congress, IAC, Washington, DC, USA.
Cited by
Diana, L., & Dini, P. (2024) · Remote Sensing · doi:10.3390/rs16213957 · Cited by 57
Wright, N., Duncan, J., Callow, N., Thompson, S., & George, R. J. (2024) · Remote Sensing of Environment · doi:10.1016/j.rse.2024.114122 · Cited by 64
Acero, I. F., Diaz, J., Hurtado-Velasco, R., Bautista, S. R. G., Rincón, S., Hernández, F. L., Rodriguez-Ferreira, J., & Gonzalez-Llorente, J. (2023) · IEEE Access · doi:10.1109/access.2023.3271596 · Cited by 24
“for CubeSats developed in Colombia) [20], [21], which will be analyzed by trained professionals in the institutions to which they are delivered.”
BackgroundSelf-citationLu, S., Jones, E., Zhao, L., Yu, S. Y., Qin, A. K., Liu, J., Li, J., Abeysekara, P., Mueller, N., Oliver, S., et al. (2024) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2024.3394574 · Cited by 22
“Salazar et al. [24] proposed a CNN to autonomously prioritize RGB images based on cloud coverage levels, thereby optimizing the limited bandwidth of small satellites.”
BackgroundSemantic Segmentation in Satellite Hyperspectral Imagery by Deep Learning
Justo, J. A., Ghiţă, A., Kováč, D., Garrett, J. L., Georgescu, M.-I., González-Llorente, J., Ionescu, R. T., & Johansen, T. A. (2024) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2024.3487360 · Cited by 16
“This enables the satellite to downlink, for instance, only valuable noncloudy data, thus optimizing the usage of the often limited communication channel [13].”
Influential
Metadata
- Authors
- Salazar, C., Gonzalez-Llorente, J., Cardenas, L., Mendez, J., Rincon, S., Rodriguez-Ferreira, J., & Acero, I. F.
- Affiliations
- Centro de Investigación en Tecnologías Aeroespaciales (CITAE), Cra 8 # 58-67, Cali 760011, Colombia
- Universidad Industrial de Santander (CO)
- Universidad Sergio Arboleda (CO)
- ORCID
- Venue
- Remote Sensing
- Publisher
- MDPI AG
- Published
- 2022-11-06
- Volume
- 14
- Issue
- 21
- Pages
- 5597
- ISSN
- 2072-4292 (ISSN-L)
- OpenAlex
- W4308475446
- Cited by
- 27
- References
- 24
- Citations by year
- 2026: 4 · 2025: 10 · 2024: 11 · 2023: 2
- FWCI
- 2.56
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Remote Sensing (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Espace ÉTS (ETS) (submittedVersion)
- Funders
- Ministerio de Ciencia
- Tecnología e Innovación de Colombia (MINCIENCIAS)
- Colombian Air Force (COLAF)
- Topics
- Physical Sciences › Engineering › Aerospace Engineering › Spacecraft Design and Technology
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Satellite Image Processing and Photogrammetry
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Space Technology and Applications
- Keywords
- cloud detection, onboard image processing, CubeSat, nanosatellites, autonomous satellites, convolutional neural networks, RGB images, Earth observation, small satellite constellations
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.