The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index; 24 of the 92 sources its claims cite were checked for support.
A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding
Open accessAbstract
Deep learning methods have been applied when working to enhance the prediction accuracy of traditional statistical methods in the field of plant breeding. Although deep learning seems to be a promising approach for genomic prediction, it has proven to have some limitations, since its conventional methods fail to leverage all available information. Multimodal deep learning methods aim to improve the predictive power of their unimodal counterparts by introducing several modalities (sources) of input information. In this review, we introduce some theoretical basic concepts of multimodal deep learning and provide a list of the most widely used neural network architectures in deep learning, as well as the available strategies to fuse data from different modalities. We mention some of the available computational resources for the practical implementation of multimodal deep learning problems. We finally performed a review of applications of multimodal deep learning to genomic selection in plant breeding and other related fields. We present a meta-picture of the practical performance of multimodal deep learning methods to highlight how these tools can help address complex problems in the field of plant breeding. We discussed some relevant considerations that researchers should keep in mind when applying multimodal deep learning methods. Multimodal deep learning holds significant potential for various fields, including genomic selection. While multimodal deep learning displays enhanced prediction capabilities over unimodal deep learning and other machine learning methods, it demands more computational resources. Multimodal deep learning effectively captures intermodal interactions, especially when integrating data from different sources. To apply multimodal deep learning in genomic selection, suitable architectures and fusion strategies must be chosen. It is relevant to keep in mind that multimodal deep learning, like unimodal deep learning, is a powerful tool but should be carefully applied. Given its predictive edge over traditional methods, multimodal deep learning is valuable in addressing challenges in plant breeding and food security amid a growing global population.
Overview
CoChat Summary
TL;DR
This review introduces multimodal deep learning (MMDL) concepts, architectures, and fusion strategies for genomic-enabled prediction in plant breeding, then surveys applications integrating genomic, environmental, phenotypic, and other omics data. It concludes MMDL often improves prediction over unimodal DL and traditional ML, but requires more computational resources and careful choices of architecture, fusion strategy, and hyperparameters.
Key findings
- MMDL can integrate genomic, phenotypic, environmental, pedigree, transcriptomic, epigenomic, proteomic, and image modalities; early, intermediate, and late fusion each have tradeoffs in computational cost, robustness, and ability to capture cross-modality interactions.
- Reviewed applications often show MMDL advantages: Shook et al. (2021) LSTM models surpassed SVR–RBF and Lasso on RMSE, MAE, and R²; Måløy et al. (2021) performer-based models significantly outperformed traditional DL and BGLR-RKHS; Togninalli et al. (2023) PheGeMIL achieved PCC 0.754 ± 0.024 versus RF 0.707 ± 0.027 and Lasso 0.708 ± 0.029, and 0.767 ± 0.019 with all data channels.
- MMDL is not always superior: Kick et al. (2023) reported MMDL RMSE 0.948 and NRMSE 14.554%, closely matching BLUP RMSE 0.937 and NRMSE 14.388%; Montesinos-López et al. (2023) found GBLUP nRMSE 0.0663 ± 0.0089 for thousand-grain weight versus MMDL 0.0744 ± 0.0081.
- MMDL demands more computational resources, data acquisition/preprocessing, tuning, and storage; transfer learning and interpretability are highlighted as future directions.
Methods
- Design: narrative review covering neural network basics, activation functions, advanced architectures (MLP, CNN, RNN/LSTM, ResNet, Transformers, GNN, Autoencoders), and data fusion strategies (early, intermediate, late).
- Data/sample: review of publications in Table 3 with actual or potential applications to genomic prediction, focusing on molecular marker (SNP) data and comparisons of MMDL with unimodal DL; includes crops/species, models, modalities, responses, and comparators.
- Main analysis: qualitative synthesis of reported prediction performance, plus a simple MMDL example using 4,464 wheat lines across 4 environments in 2021/2022 at Ciudad Obregón, Mexico, with 18,239 SNPs and 5 traits; no formal meta-analysis is reported.
Limitations
- Stated: MMDL application in GS/PB is relatively nascent with limited literature; selecting an optimal fusion strategy is challenging; computational costs are high for high-dimensional genomic data; additional modalities may not justify computational expense; data from each modality must be available in training and testing; caution is needed with small training-testing datasets and hyperparameter selection.
- Stated: some studies, such as Kick et al. (2023) and Togninalli et al. (2023), show no clear superiority of MMDL over unimodal DL in prediction accuracy.
- Evident from the text: the review is narrative/qualitative rather than a systematic meta-analysis, and performance comparisons rely on heterogeneous studies, metrics, and datasets, so no pooled effect sizes are reported.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
21 Valid · 10 Not valid · 60 Not checked · 55 Own results and interpretations
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“In some instances, studies such as Kick et al. (2023) and Togninalli et al. (2023) have shown no clear superiority of MMDL over unimodal DL in terms of prediction accuracy.”
§ A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding > For consideration regarding MMDL methods
What the sources say
- Partly supportedcites Kick et al. (2023) sourceExperimental — accuracy not yet measured
In “Model performance generally improves through incorporating multimodal data and interactions” (page unavailable), the paper reports that one multimodal DNN had slightly higher prediction error than the weather/management DNN. That supports a limited instance of no superiority, but the section says adding data sources generally improved DNN accuracy, and the other multimodal DNN performed better. This verdict concerns Kick et al. only; our copy cannot establish what Togninalli et al. found. (LLM, conf=0.84)
- Disputedcites Togninalli et al. (2023) sourceExperimental — accuracy not yet measured
The Results (page unavailable in our copy) report that the multimodal PheGeMIL model outperformed a genotype-only deep-learning baseline, with Pearson correlations of 0.381 ± 0.016 versus 0.336 ± 0.011. The authors explicitly attribute the accuracy gain to using phenomic information alongside genotypes, contrary to the claim that this study showed no clear superiority over unimodal deep learning. (LLM, conf=0.89)
Checked by a reasoning model — may be wrong.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Overall, DNNGP performed equally well or better than commonly used linear models (GBLUP), ML-based methods (LightGBM and SVR), and DL-based methods (DLGWAS and DeepGS) across a wide range of prediction tasks.”
§ A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding > Introduction
What the sources say
- Supportedcites Wang et al. (2023) source
The paper explicitly says DNNGP performed as well as or better than GBLUP, LightGBM, SVR, DLGWAS, and DeepGS across a broad range of prediction tasks (Molecular Plant passage [8]). Its comparison section describes evaluations on wheat, maize, and tomato datasets ([1]). (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“A study by Zingaretti et al. (2020) analyzing blueberry and strawberry experimental data found that DL methods did not offer advantages over linear models, except when the epistasis component played a significant role.”
§ A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding > Introduction
What the sources say
- Supportedcites Zingaretti et al. (2020) source
In Results (Comparing Deep Learning With Bayesian Penalized Linear Models; page not supplied), the paper reports no important differences among methods for strawberry except percentage of culled fruit, where CNN performed about 20% better than the linear models and the epistatic component was largest. It reports that CNNs somewhat underperformed the linear models in blueberry. The Discussion likewise suggests that deep learning can perform better when epistasis is important. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“They found that both DL methods outperformed RR-BLUP, achieving a 0 to 5% better prediction accuracy.”
§ A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding > Introduction
What the sources say
- Supportedcites Sandhu et al. (2021) source
The Results section 'Comparison of Model Performances for Cross-Validations' states MLP improved prediction accuracy by 3 to 5% over rrBLUP for all five traits and CNN by 0 to 3%, so the citing sentence's aggregated '0 to 5%' range is the union of the two model-specific gains the paper reports. The Abstract and Conclusion attribute the same overall result to both DL models ('DL approaches obtained better prediction accuracy for each trait'; 'DL based models are superior for predicting all five traits'), in spring wheat, matching the claim's population and comparator. Minor nuance: the paper's Discussion notes rrBLUP was 'competitive' and CNN tied rrBLUP for grain yield and grain protein content (Table 4, 0.39/0.48), i.e. the 0% end of the range is equality rather than improvement, but this is the paper's own framing. (LLM, conf=0.87)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Transformers can also be used to exploit the sequential structure of DNA, as demonstrated by Jubair et al. (2021) and Måløy et al. (2021).”
§ A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding > Some considerations on selecting an appropriate DL architecture
What the sources say
- Partly supportedcites Jubair et al. (2021) sourceExperimental — accuracy not yet measured
The Introduction and Methods §2.4 describe a Transformer that uses self-attention to identify relationships among barley genetic markers, supporting its use with genomic data. They do not show that the model exploits the sequential order of DNA; its inputs are encoded SNP markers, and the described attention mechanism relates markers to one another rather than modeling DNA sequence order. Page numbers are unavailable in our copy. (LLM, conf=0.84)
- Not checked yetcites Måløy et al. (2021)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
58 more claims · 9 with their cited sources checked
Create a free account to see all 146 claims and to verify the 68 references still open.
- It may state two separate claims as one. 39
- Probably not a substantial claim. 63
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Early fusion excels with synchronized, coregistered data by capturing fine-grained interactions, though it lacks flexibility and is less robust to noisy or incomplete data due to its direct combination of inputs”
From Multimodal neuroimaging and AI integration in cognitive disorders: advances, challenges, and future directions for precision medicine (2026) · cites this paper as Montesinos-Lopez et al., 2024
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding > Introduction
“All studies mentioned so far focus solely on using genotypic information to predict traits of interest in different species.”
§ A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding > Introduction
“Wang et al. (2023) used neural network genomic prediction (DNNGP) to integrate multi-omics data in plants.”
Citations
Cites
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Prediction of Total Genetic Value Using Genome-Wide Dense Marker Maps
Meuwissen, T. H. E., Hayes, B. J., & Goddard, M. E. (2001) · Genetics · doi:10.1093/genetics/157.4.1819 · Cited by 7,917
Practical Recommendations for Gradient-Based Training of Deep Architectures
Bengio, Y. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_26 · Cited by 2,259 · cited 1×
“Regarding the number of neurons in every hidden layer, in the study by Bengio 2012, 2012 it is suggested to include several nodes large enough in every layer, and it is remarked that using the same number of neurons in every layer, rather than a sequential decrease or increase of them, seems to be…”
Activation functions in deep learning: a comprehensive survey and benchmark
Dubey, S. R., Singh, S. K., & Chaudhuri, B. B. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.06.111 · Cited by 1,259 · cited 1×
“For example, it is well known that the output of the derivative of the sigmoid function tends to be zero for higher and lower inputs, which can lead to the GV problem (Dubey et al .”
Dive into Deep LearningPreprint
Zhang, A., Lipton, Z. C., Mu, L., & Smola, A. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.11342 · Cited by 993 · cited 6×
“(2021) and Zhang et al .”
InfluentialFastai: A Layered API for Deep Learning
Howard, J., & Gugger, S. (2020) · Information · doi:10.3390/info11020108 · Cited by 971
Random forests for genomic data analysis
Chen, X., & Ishwaran, H. (2012) · Genomics · doi:10.1016/j.ygeno.2012.04.003 · Cited by 953 · cited 1×
“…this model is that it is only able to capture linear relationships between genotypes and phenotypic traits and because GS is a predictive methodology, other ML models have been applied to handle this limitation, such as random forests (Chen and Ishwaran 2012), support vector machines (Zhao et al .”
Huang, S.-C., Pareek, A., Seyyedi, S., Banerjee, I., & Lungren, M. P. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00341-z · Cited by 934 · cited 3×
“A meticulous description of this topic can be found in the studies by Huang et al (2020), Boulahia et al .”
InfluentialMultimodal deep learning for biomedical data fusion: a review
Stahlschmidt, S. R., Ulfenborg, B., & Synnergren, J. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbab569 · Cited by 766
Rethinking Attention with Performers
Choromanski, K., Likhosherstov, V., Dohan, D., Song, X., Gane, A., Sarlos, T., Hawkins, P., Davis, J., Mohiuddin, A., Kaiser, L., et al. (2020) · arXiv · doi:10.48550/arxiv.2009.14794 · Cited by 695
Research works printed but not linked: 4
- Chen, 2021, A review of multi-view deep learning methods for multimodal data fusion, Neural Comput, 33, 67
- Chollet, 2017, Deep Learning with R
- Goodfellow, 2016, Deep Learning
- Henderson, 1984, Applications of Linear Models in Animal Breeding Models
Cited by
Amin, A., Zaman, W., & Park, S. (2025) · Genes · doi:10.3390/genes16070809 · Cited by 97
“Recent advances integrate multi-modal deep learning architectures that jointly process heterogeneous omics and imaging data, exemplified by maize yield prediction models integrating genomics, metabolomics, and multispectral images [103].”
Integrating multi-omics and machine learning for disease resistance prediction in legumes
Mohamedikbal, S., Al-Mamun, H. A., Bestry, M., Batley, J., & Edwards, D. (2025) · Theoretical and Applied Genetics · doi:10.1007/s00122-025-04948-2 · Cited by 39
“This approach has the potential to integrate multi-omics data with environmental factors to provide robust prediction accuracy for implementing GS in breeding programmes (Montesinos-López et al. 2024).”
Kassem, M. A. (2025) · Plants · doi:10.3390/plants14111727 · Cited by 29
Pourmadadi, M., Shabestari, S. M., Abdouss, H., Rahdar, A., Fathi‐karkan, S., & Pandey, S. (2025) · Seminars in Oncology · doi:10.1016/j.seminoncol.2025.152429 · Cited by 33
Multi-omics approaches in plant biology: decoding agronomic traits for sustainable agriculture
Younas, M. U., Zuo, S., Qasim, M., Ahmad, I., Feng, Z., Korai, S. K., Zulfiqar, U., Tukhtaboeva, F., Ibrokhim, I., & Malik, T. (2025) · Plant Stress · doi:10.1016/j.stress.2025.101118 · Cited by 30
Metadata
- Authors
- Montesinos-López, O. A., Chavira-Flores, M., Kiasmiantini, Crespo-Herrera, L., Saint Piere, C., Li, H., Fritsche-Neto, R., Al-Nowibet, K., Montesinos-López, A., & Crossa, J.
- Affiliations
- Universidad de Colima (MX)
- Instituto de Investigaciones en Matemáticas Aplicadas y Sistemas (IIMAS), Universidad Nacional Autónoma de México (UNAM) , Ciudad de México 04510 ,
- Yogyakarta State University (ID)
- International Maize and Wheat Improvement Center (CIMMYT) , Km 45, Carretera Mexico-Veracruz, Texcoco, CP 52640 Edo. de México ,
- Chinese Academy of Agricultural Sciences (CN)
- Louisiana State University , Baton Rouge, LA 70803 ,
- Department of Statistics and Operations Research, King Saud University , Riyah 11451 ,
- Departamento de Matematicas, Centro Universitario de Ciencias Exactas e Ingenierías (CUCEI), Universidad de Guadalajara , 44430, Guadalajara, Jalisco ,
- Louisiana State University (US)
- Corresponding author
- Crossa, José
- Venue
- GENETICS
- Publisher
- Oxford University Press (OUP)
- Published
- 2024-11-05
- ISSN
- 0016-6731 (ISSN-L)
- 1943-2631
- PMC
- PMC11631469
- OpenAlex
- W4404061905
- Cited by
- 47
- References
- 67
- Citations by year
- 2026: 32 · 2025: 14 · 2024: 1
- FWCI
- 12.43
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Genetics (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- CGSPace A Repository of Agricultural Research Outputs (Consultative Group for International Agricultural Research) (submittedVersion, other-oa)
- Funders
- Bill & Melinda Gates Foundation (INV-003439 BMGF/FCDO)
- Accelerating Genetic Gains in Maize and Wheat for Improved Livelihoods
- USAID projects
- Foundation for Research Levy on Agricultural Products
- Agricultural Agreement Research Fund
- Research Council of Norway (301835, 320090)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic and phenotypic traits in livestock
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Mapping and Diversity in Plants and Animals
- Life Sciences › Agricultural and Biological Sciences › Plant Science › Smart Agriculture and AI
- Keywords
- multimodal deep learning, genomic selection, plant breeding, genomic prediction, neural network architecture, computational resources, food security
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding. https://app.cochat.ai/papers/10.1093/genetics/iyae161
- The paper
- Montesinos-López, O. A., Chavira-Flores, M., Kiasmiantini, Crespo-Herrera, L., Saint Piere, C., Li, H., Fritsche-Neto, R., Al-Nowibet, K., Montesinos-López, A., & Crossa, J. (2024). A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding. GENETICS. https://doi.org/10.1093/genetics/iyae161
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.