The DOI matches its Crossref record; the references it cites are not checked yet.
Hybrid deep learning-based multimodal framework for plant leaf disease classification using RGB, Excess Green (ExG), and pseudo-thermal representations with MobileNetV2
Abstract
Plant diseases are a serious danger to the world’s food security, because they lower agricultural output and increase economic losses. Due to subjectivity, fluctuating lighting, and environmental unpredictability, traditional visual examination techniques are frequently incorrect. The Excess Green (ExG) vegetation index and pseudo-thermal representations produced from RGB pictures are two synthetically developed complementary representations that are integrated with RGB imagery in this study’s lightweight multimodal deep learning system to address these issues. Histogram shifting and pseudo-infrared color mapping are used in a reproducible picture alteration pipeline to create the pseudo-thermal modality, which allows for extra visual signals without the need for specific thermal sensors. In order to classify plant diseases while preserving computational efficiency, the suggested framework uses MobileNetV3-Small backbones to extract modality-specific characteristics. This is followed by feature-level fusion. The publicly accessible Ginger Leaf Dataset, which includes RGB pictures of ginger leaves in four different conditions—Damage-Pest, Dehydrated, Healthy, and Leaf-blight—was used for the experiments. For training, validation, and testing, the dataset was split using a stratified 70:15:15 split. Python-based preprocessing procedures were used to create the extra modalities (ExG and pseudo-thermal representations) from the original RGB images. The experimental results show that the combination of the representations with RGB images can enhance the classification performance compared with the unimodal RGB-based models. Ablation experiments are also conducted to examine the contributions of different modalities to the overall categorization accuracy. The experimental results show that plant disease recognition can be improved with the help of efficient computing by combining lightweight convolutional neural networks with computationally generated visual representations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
The citation lists haven’t been fetched yet
Cited by 1
Research works printed but not linked: 65
- Wang, Y. et al. A hybrid approach for rice crop disease detection in agricultural IoT system. Discov. Sustain. 5, 99. https://doi.org/10.1007/s43621-024-00285-4 (2024). · doi:10.1007/s43621-024-00285-4
- Rajpoot, V., Tiwari, A. & Jalal, A. Automatic early detection of rice leaf diseases using hybrid deep learning and machine learning methods. Multimed. Tools Appl. 82(1), 1–27. https://doi.org/10.1007/s11042-023-14969-y (2023a). · DOI
- Sharma, R. et al. Detection of plant leaf disease using advanced deep learning architectures. Int. j. inf. tecnol. 16, 3475–3492. https://doi.org/10.1007/s41870-024-01937-4 (2024). · DOI
- Theerthagiri, P. et al. Deep SqueezeNet learning model for diagnosis and prediction of maize leaf diseases. J. Big Data 11, 112. https://doi.org/10.1186/s40537-024-00972-z (2024). · doi:10.1186/s40537-024-00972-z
- Naralasetti, V. & Bodapati, J. D. Enhancing plant leaf disease prediction through advanced deep feature representations: A transfer learning approach. J. Inst. Eng. India Ser. B 105, 469–482. https://doi.org/10.1007/s40031-023-00966-0 (2024). · DOI
- Zhang, Y. et al. Deep learning-based classification and application test of multiple crop leaf diseases using transfer learning and the attention mechanism. Computing 106, 3063–3084. https://doi.org/10.1007/s00607-024-01308-8 (2024). · DOI
- Jayashree, S. & Sumalatha, V. Deep learning-based plant leaf disease detection using scaled immutable feature selection using adaptive deep convolutional recurrent neural network. SN Comput. Sci. 4, 592. https://doi.org/10.1007/s42979-023-01908-9 (2023). · DOI
- Fan, X., Ge, C., Yang, X. & Wang, W. Cross-modal feature fusion for field weed mapping using RGB and near-infrared imagery. Agriculture 14(12), 2331. https://doi.org/10.3390/agriculture14122331 (2024). · DOI
- Ulku, I., Tanriover, O. O. & Akagündüz, E. Cross-band correlation-aware interactive fusion for multispectral images. IEEE Geosci. Remote Sens. Lett. https://doi.org/10.1109/LGRS.2025.XXXXXXX (2025). · doi:10.1109/lgrs.2025.xxxxxxx
- Bhakta, I. et al. A novel plant disease prediction model based on thermal images using modified deep convolutional neural network. Precis. Agric. 24, 23–39. https://doi.org/10.1007/s11119-022-09927-x (2023). · DOI
- Attaluri, S. & Dharavath, R. Novel plant disease detection techniques—A brief review. Mol. Biol. Rep. 50, 9677–9690. https://doi.org/10.1007/s11033-023-08838-y (2023). · doi:10.1007/s11033-023-08838-y
- Liu, J. & Wang, X. Plant diseases and pests detection based on deep learning: A review. Plant Methods 17, 22. https://doi.org/10.1186/s13007-021-00722-9 (2021). · DOI · Paper page
- Nagpal, J., Goel, L. & Shekhawat, P. S. A hybrid deep learning neural network for early plant disease diagnosis using a real-world Wheat-Barley vision dataset: Challenges and solutions. Int. J. Data Sci. Anal. https://doi.org/10.1007/s41060-024-00578-x (2024). · DOI
- Rajpoot, V., Tiwari, A. & Jalal, A. S. Automatic early detection of rice leaf diseases using hybrid deep learning and machine learning methods. Multimed. Tools Appl. 82, 36091–36117. https://doi.org/10.1007/s11042-023-14969-y (2023b). · DOI
- R, K. & T, S. Development of plant disease detection for smart agriculture. Multimed. Tools Appl. 83, 54391–54410. https://doi.org/10.1007/s11042-023-17687-7 (2024). · doi:10.1007/s11042-023-17687-7
- ZKhan, S. D., Basalamah, S. & Naseer, A. Classification of plant diseases in images using dense-Inception architecture with attention modules. Multimed. Tools Appl. https://doi.org/10.1007/s11042-024-19860-y (2024). · DOI
- Vijayan, S. & Chowdhary, C. L. Hybrid feature optimized CNN for rice crop disease prediction. Sci. Rep. 15, 7904. https://doi.org/10.1038/s41598-025-92646-w (2025). · DOI
- Jha, P., Dembla, D. & Dubey, W. Deep learning models for enhancing potato leaf disease prediction: Implementation of transfer learning based stacking ensemble model. Multimed. Tools Appl. 83, 37839–37858. https://doi.org/10.1007/s11042-023-16993-4 (2024). · DOI
- Patel, V. K., Abhishek, K. & Selvarajan, S. Optimized recurrent neural network-based early diagnosis of crop pest and diseases in agriculture. Discover Computing 27, 43. https://doi.org/10.1007/s10791-024-09481-2 (2024). · doi:10.1007/s10791-024-09481-2
- Pfordt, A. & Paulus, S. A review on detection and differentiation of maize diseases and pests by imaging sensors. J. Plant Dis. Prot. https://doi.org/10.1007/s41348-024-01019-4 (2024). · DOI
- Pacal, I. et al. A systematic review of deep learning techniques for plant diseases. Artif. Intell. Rev. 57, 304. https://doi.org/10.1007/s10462-024-10944-7 (2024). · DOI · Paper page
- Gangadevi, E. et al. Spot-out fruit fly algorithm with simulated annealing optimized SVM for detecting tomato plant diseases. Neural Comput. Appl. 36, 4349–4375. https://doi.org/10.1007/s00521-023-09295-1 (2024). · DOI
- Sharma, A. et al. A stacked deep learning approach for multiclass classification of plant diseases. Plant Soil 506, 621–638. https://doi.org/10.1007/s11104-024-06719-2 (2025). · DOI
- Kumar, I., Bhattacharya, J. & Das, B. K. Efficacy of silver nanoparticles-based foliar spray application to control plant diseases, its effect on productivity, and risk assessment. Arab. J. Geosci. 15, 390. https://doi.org/10.1007/s12517-022-09652-9 (2022). · doi:10.1007/s12517-022-09652-9
- Dubey, R. K. & Choubey, D. K. Adaptive feature selection with deep learning MBi-LSTM model based paddy plant leaf disease classification. Multimed. Tools Appl. 83, 25543–25571. https://doi.org/10.1007/s11042-023-16475-7 (2024a). · doi:10.1007/s11042-023-16475-7
- Dubey, R. K. & Choubey, D. K. An efficient adaptive feature selection with deep learning model-based paddy plant leaf disease classification. Multimed. Tools Appl. 83, 22639–22661. https://doi.org/10.1007/s11042-023-16247-3 (2024b). · doi:10.1007/s11042-023-16247-3
- Girmaw, D. W. et al. A novel deep learning model for cabbage leaf disease detection and classification. Discov. Appl. Sci. 6, 521. https://doi.org/10.1007/s42452-024-06233-1 (2024). · doi:10.1007/s42452-024-06233-1
- Kini, A. S., Prema, K. V. & Pai, S. N. Early stage black pepper leaf disease prediction based on transfer learning using ConvNets. Sci. Rep. 14, 1404. https://doi.org/10.1038/s41598-024-51884-0 (2024). · DOI
- Muhammad, M. et al. A review on endophytic fungi: A potent reservoir of bioactive metabolites with special emphasis on blight disease management. Arch. Microbiol. 206129. https://doi.org/10.1007/s00203-023-03828-x (2024). · DOI
- Khanna, M. et al. PlaNet: A robust deep convolutional neural network model for plant leaves disease recognition. Multimed. Tools Appl. 83, 4465–4517. https://doi.org/10.1007/s11042-023-15809-9 (2024a). · DOI
- Singla, P., Kalavakonda, V. & Senthil, R. Detection of plant leaf diseases using deep convolutional neural network models. Multimed. Tools Appl. 83, 64533–64549. https://doi.org/10.1007/s11042-023-18099-3 (2024). · DOI
- Annrose, J. et al. A Cloud-Based Platform for Soybean Plant Disease Classification Using Archimedes Optimization Based Hybrid Deep Learning Model. Wireless Pers Commun 122, 2995–3017. https://doi.org/10.1007/s11277-021-09038-2 (2022). · DOI
- Nishiguchi, M. & Kobayashi, K. Attenuated plant viruses: Preventing virus diseases and understanding the molecular mechanism. J. Gen. Plant Pathol. 77, 221–229. https://doi.org/10.1007/s10327-011-0318-x (2011). · doi:10.1007/s10327-011-0318-x
- Ferrari, R. C. et al. Transcriptional profiling of Fraxinus excelsior leaves during the early infection phase of ash dieback. J. Plant Dis. Prot. 132, 48. https://doi.org/10.1007/s41348-024-01028-3 (2025). · doi:10.1007/s41348-024-01028-3
- Zhang, H. & Ren, G. Intelligent leaf disease diagnosis: Image algorithms using Swin Transformer and federated learning. Vis. Comput. 41, 4815–4838. https://doi.org/10.1007/s00371-024-03692-w (2025). · DOI
- Wang, X. & Jannesari, V. Towards a crop pest control system based on the Internet of Things and fuzzy logic. Telecommun. Syst. 85, 665–677. https://doi.org/10.1007/s11235-024-01106-9 (2024). · doi:10.1007/s11235-024-01106-9
- Pandiyaraju, V. et al. Spatial attention-based hybrid VGG-SVM and VGG-RF frameworks for improved cotton leaf disease detection. Neural Comput. Appl. 37, 8309–8329. https://doi.org/10.1007/s00521-025-11012-z (2025). · DOI
- Kashyap, A. S., Manzar, N., Vishwakarma, S. K., Mahajan, C. & Dey, U. Tiny but mighty: Metal nanoparticles as effective antimicrobial agents for plant pathogen control. World J. Microbiol. Biotechnol. 40(3), 104. https://doi.org/10.1007/s11274-024-03911-5 (2024). · doi:10.1007/s11274-024-03911-5
- Greer, S. F., Rabiey, M., Studholme, D. J. & Grant, M. The potential of bacteriocins and bacteriophages to control bacterial disease of crops with a focus on Xanthomonas spp.. J. R. Soc. N. Z. 55(2), 302–326. https://doi.org/10.1080/03036758.2024.2345315 (2024). · DOI
- Shin, J. et al. A deep learning approach for RGB image-based powdery mildew disease detection on strawberry leaves. Comput. Electron. Agric. 183, 106042. https://doi.org/10.1016/j.compag.2021.106042 (2021). · DOI · Paper page
- Thakur, P. S., Chaturvedi, S., Khanna, P. & Sheorey, T. Vision transformer meets convolutional neural network for plant disease classification. Comput. Electron. Agric. https://doi.org/10.1016/j.compag.2023.108072 (2023). · DOI
- Lin, Y., Wang, L., Chen, T., Liu, Y. & Zhang, L. Monitoring system for peanut leaf disease based on a lightweight deep learning model. Comput. Electron. Agric. 222, 109055. https://doi.org/10.1016/j.compag.2024.109055 (2024). · DOI
- Chen, Y. Plant image recognition with deep learning: A review. Comput. Electron. Agric. 212, 108072. https://doi.org/10.1016/j.compag.2023.108072 (2023). · DOI
- Elshewey, A. M. et al. Optimized Deep Learning for Potato Blight Detection Using the Waterwheel Plant Algorithm and Sine Cosine Algorithm. Potato Res. 68, 1–25. https://doi.org/10.1007/s11540-024-09735-y (2025). · doi:10.1007/s11540-024-09735-y
- Ahmed, I. & Yadav, P. K. Predicting apple plant diseases in orchards using machine learning and deep learning algorithms. SN Comput. Sci. 5, 700. https://doi.org/10.1007/s42979-024-02959-2 (2024). · doi:10.1007/s42979-024-02959-2
- Aboelenin, S. et al. A hybrid framework for plant leaf disease detection and classification using convolutional neural networks and vision transformer. Complex Intell. Syst. 11, 142. https://doi.org/10.1007/s40747-024-01764-x (2025). · DOI
- Saraswathi, E. & Faritha Banu, J. A novel probabilistic intermittent neural network (PINN) and artificial jelly fish optimization (AJFO)-based plant leaf disease detection system. J. Plant Dis. Prot. 131, 587–600. https://doi.org/10.1007/s41348-024-00876-3 (2024). · doi:10.1007/s41348-024-00876-3
- Khan, B. et al. Bayesian optimized multimodal deep hybrid learning approach for tomato leaf disease classification. Sci. Rep. 14, 21525. https://doi.org/10.1038/s41598-024-72237-x (2024). · DOI
- Haridasan, A., Thomas, J. & Raj, E. D. Deep learning system for paddy plant disease detection and classification. Environ. Monit. Assess. 195, 120. https://doi.org/10.1007/s10661-022-10656-x (2023). · DOI · Paper page
- Mathew, M. P. et al. Development of a handheld GPU-assisted DSC-TransNet model for the real-time classification of plant leaf disease using deep learning approach. Sci. Rep. 15, 3579. https://doi.org/10.1038/s41598-024-82629-8 (2025). · doi:10.1038/s41598-024-82629-8
- Arya, A. & Mishra, P. K. MobileNetV2-Incep-M: A hybrid lightweight model for the classification of rice plant diseases. Multimed. Tools Appl. 83, 79117–79144. https://doi.org/10.1007/s11042-024-18723-w (2024). · DOI
- Kaur, P. et al. Performance analysis of segmentation models to detect leaf diseases in tomato plant. Multimed Tools Appl 83, 16019–16043. https://doi.org/10.1007/s11042-023-16238-4 (2024). · DOI
- Shetty, S. & Mahesh, T. R. SKGDC: Effective segmentation based deep learning methodology for banana leaf, fruit, and stem disease prediction. SN Comput. Sci. 5698. https://doi.org/10.1007/s42979-024-03031-9 (2024). · doi:10.1007/s42979-024-03031-9
- Virk, V., Deepak, H., Taneja, K., Srivastava, R. & Giri, S. Amelioration in nanobiosensors for the control of plant diseases: Current status and future challenges. Front. Nanotechnol. 6, 1310165. https://doi.org/10.3389/fnano.2024.1310165 (2024). · DOI
- Amna. Bio-Fabricated Silver Nanoparticles: A Sustainable Approach for Augmentation of Plant Growth and Pathogen Control. In: Faizan, M., Hayat, S., Yu, F. (eds) Sustainable Agriculture Reviews 53. Springer, Cham, (2021). https://doi.org/10.1007/978-3-030-86876-5_14 · DOI
- Kapoor, D., Sharma, P., Sharma, M. M. M., Yadav, S. & Husen, A. Exploring soil microbiota and their role in plant growth, stress tolerance, disease control and nutrient immobilizer. Biocatal. Agric. Biotechnol. 61, 103358. https://doi.org/10.1016/j.bcab.2024.103358 (2024). · DOI
- Chen, R. et al. Joint application of plant immunity-inducing elicitors and fungicides to control Phytophthora diseases. Phytopathol. Res. 6(1), 233. https://doi.org/10.1186/s42483-024-00233-0 (2024). · DOI
- Saberi Riseh, R., Fathi, F., Lagzian, A., Vatankhah, M. & Kennedy, J. F. Modifying lignin: A promising strategy for plant disease control. Int. J. Biol. Macromol. 271, 132696. https://doi.org/10.1016/j.ijbiomac.2024.132696 (2024). · DOI
- Mitsugi, F. Practical ozone disinfection of soil via surface barrier discharge to control scab diseases on radishes. IEEE Trans. Plasma Sci. 47(1), 52–56. https://doi.org/10.1109/TPS.2018.2872408 (2019). · doi:10.1109/tps.2018.2872408
- Zhou, J. et al. Progress in research on prevention and control of crop fungal diseases in the context of climate change. Agriculture 14, 1108. https://doi.org/10.3390/agriculture14071108 (2024). · DOI
- Rigobelo, E., Nicodemo, D., Babalola, O. & Desoignies, N. Purpureocillium lilacinum as an agent of nematode control and plant growth-promoting fungi. Agronomy 14(6), 1225. https://doi.org/10.3390/agronomy14061225 (2024). · DOI
- Ramamoorthy, R. et al. Reliable and accurate plant leaf disease detection with treatment suggestions using enhanced deep learning techniques. SN Comput. Sci. 4, 158. https://doi.org/10.1007/s42979-022-01589-w (2023). · doi:10.1007/s42979-022-01589-w
- Patil, R. R. & Kumar, S. Rice Transformer: A novel integrated management system for controlling rice diseases. IEEE Access 10, 87698–87714. https://doi.org/10.1109/ACCESS.2022.3202393 (2022). · doi:10.1109/access.2022.3202393
- paauw, M. et al. ScAnalyzer: An image processing tool to monitor plant disease symptoms and pathogen spread in Arabidopsis thaliana leaves. Plant Methods 20(1), 80. https://doi.org/10.1186/s13007-024-01213-3 (2024). · doi:10.1186/s13007-024-01213-3
- Suwanchaikasem, P. et al. The impacts of Chitosan on plant root systems and its potential to be used for controlling fungal diseases in agriculture. J. Plant Growth Regul. 43, 3424–3445. https://doi.org/10.1007/s00344-024-11356-1 (2024). · DOI
Metadata
- Authors
- Begum, S., Naresh, E., & Srinidhi, N. N.
- Venue
- Scientific Reports
- Published
- 2026-05-21
- Volume
- 16
- Issue
- 1
- ISSN
- 2045-2322
- Cited by
- 1
- Language
- en
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor, 102 d)
- Funders
- Manipal Academy of Higher Education, Manipal
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Hybrid deep learning-based multimodal framework for plant leaf disease classification using RGB, Excess Green (ExG), and pseudo-thermal representations with MobileNetV2. https://app.cochat.ai/papers/10.1038/s41598-026-52115-4
- The paper
- Begum, S., Naresh, E., & Srinidhi, N. N. (2026). Hybrid deep learning-based multimodal framework for plant leaf disease classification using RGB, Excess Green (ExG), and pseudo-thermal representations with MobileNetV2. Scientific Reports. https://doi.org/10.1038/s41598-026-52115-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.