A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding
Open accessThe DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index; 24 of the 92 sources its claims cite were checked for support.
Abstract
Deep learning methods have been applied when working to enhance the prediction accuracy of traditional statistical methods in the field of plant breeding. Although deep learning seems to be a promising approach for genomic prediction, it has proven to have some limitations, since its conventional methods fail to leverage all available information. Multimodal deep learning methods aim to improve the predictive power of their unimodal counterparts by introducing several modalities (sources) of input information. In this review, we introduce some theoretical basic concepts of multimodal deep learning and provide a list of the most widely used neural network architectures in deep learning, as well as the available strategies to fuse data from different modalities. We mention some of the available computational resources for the practical implementation of multimodal deep learning problems. We finally performed a review of applications of multimodal deep learning to genomic selection in plant breeding and other related fields. We present a meta-picture of the practical performance of multimodal deep learning methods to highlight how these tools can help address complex problems in the field of plant breeding. We discussed some relevant considerations that researchers should keep in mind when applying multimodal deep learning methods. Multimodal deep learning holds significant potential for various fields, including genomic selection. While multimodal deep learning displays enhanced prediction capabilities over unimodal deep learning and other machine learning methods, it demands more computational resources. Multimodal deep learning effectively captures intermodal interactions, especially when integrating data from different sources. To apply multimodal deep learning in genomic selection, suitable architectures and fusion strategies must be chosen. It is relevant to keep in mind that multimodal deep learning, like unimodal deep learning, is a powerful tool but should be carefully applied. Given its predictive edge over traditional methods, multimodal deep learning is valuable in addressing challenges in plant breeding and food security amid a growing global population.
Overview
CoChat Summary
TL;DR
This review introduces multimodal deep learning (MMDL) concepts, architectures, and fusion strategies for genomic-enabled prediction in plant breeding, then surveys applications integrating genomic, environmental, phenotypic, and other omics data. It concludes MMDL often improves prediction over unimodal DL and traditional ML, but requires more computational resources and careful choices of architecture, fusion strategy, and hyperparameters.
Key findings
- MMDL can integrate genomic, phenotypic, environmental, pedigree, transcriptomic, epigenomic, proteomic, and image modalities; early, intermediate, and late fusion each have tradeoffs in computational cost, robustness, and ability to capture cross-modality interactions.
- Reviewed applications often show MMDL advantages: Shook et al. (2021) LSTM models surpassed SVR–RBF and Lasso on RMSE, MAE, and R²; Måløy et al. (2021) performer-based models significantly outperformed traditional DL and BGLR-RKHS; Togninalli et al. (2023) PheGeMIL achieved PCC 0.754 ± 0.024 versus RF 0.707 ± 0.027 and Lasso 0.708 ± 0.029, and 0.767 ± 0.019 with all data channels.
- MMDL is not always superior: Kick et al. (2023) reported MMDL RMSE 0.948 and NRMSE 14.554%, closely matching BLUP RMSE 0.937 and NRMSE 14.388%; Montesinos-López et al. (2023) found GBLUP nRMSE 0.0663 ± 0.0089 for thousand-grain weight versus MMDL 0.0744 ± 0.0081.
- MMDL demands more computational resources, data acquisition/preprocessing, tuning, and storage; transfer learning and interpretability are highlighted as future directions.
Methods
- Design: narrative review covering neural network basics, activation functions, advanced architectures (MLP, CNN, RNN/LSTM, ResNet, Transformers, GNN, Autoencoders), and data fusion strategies (early, intermediate, late).
- Data/sample: review of publications in Table 3 with actual or potential applications to genomic prediction, focusing on molecular marker (SNP) data and comparisons of MMDL with unimodal DL; includes crops/species, models, modalities, responses, and comparators.
- Main analysis: qualitative synthesis of reported prediction performance, plus a simple MMDL example using 4,464 wheat lines across 4 environments in 2021/2022 at Ciudad Obregón, Mexico, with 18,239 SNPs and 5 traits; no formal meta-analysis is reported.
Limitations
- Stated: MMDL application in GS/PB is relatively nascent with limited literature; selecting an optimal fusion strategy is challenging; computational costs are high for high-dimensional genomic data; additional modalities may not justify computational expense; data from each modality must be available in training and testing; caution is needed with small training-testing datasets and hyperparameter selection.
- Stated: some studies, such as Kick et al. (2023) and Togninalli et al. (2023), show no clear superiority of MMDL over unimodal DL in prediction accuracy.
- Evident from the text: the review is narrative/qualitative rather than a systematic meta-analysis, and performance comparisons rely on heterogeneous studies, metrics, and datasets, so no pooled effect sizes are reported.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
21 Valid · 10 Not valid · 60 Not checked · 55 Own results and interpretations
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“In some instances, studies such as Kick et al. (2023) and Togninalli et al. (2023) have shown no clear superiority of MMDL over unimodal DL in terms of prediction accuracy.”
§ A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding > For consideration regarding MMDL methods
What the sources say
- Partly supportedcites Kick et al. (2023) sourceExperimental — accuracy not yet measured
In “Model performance generally improves through incorporating multimodal data and interactions” (page unavailable), the paper reports that one multimodal DNN had slightly higher prediction error than the weather/management DNN. That supports a limited instance of no superiority, but the section says adding data sources generally improved DNN accuracy, and the other multimodal DNN performed better. This verdict concerns Kick et al. only; our copy cannot establish what Togninalli et al. found. (LLM, conf=0.84)
- Disputedcites Togninalli et al. (2023) sourceExperimental — accuracy not yet measured
The Results (page unavailable in our copy) report that the multimodal PheGeMIL model outperformed a genotype-only deep-learning baseline, with Pearson correlations of 0.381 ± 0.016 versus 0.336 ± 0.011. The authors explicitly attribute the accuracy gain to using phenomic information alongside genotypes, contrary to the claim that this study showed no clear superiority over unimodal deep learning. (LLM, conf=0.89)
Checked by a reasoning model — may be wrong.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Overall, DNNGP performed equally well or better than commonly used linear models (GBLUP), ML-based methods (LightGBM and SVR), and DL-based methods (DLGWAS and DeepGS) across a wide range of prediction tasks.”
§ A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding > Introduction
What the sources say
- Supportedcites Wang et al. (2023) source
The paper explicitly says DNNGP performed as well as or better than GBLUP, LightGBM, SVR, DLGWAS, and DeepGS across a broad range of prediction tasks (Molecular Plant passage [8]). Its comparison section describes evaluations on wheat, maize, and tomato datasets ([1]). (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“A study by Zingaretti et al. (2020) analyzing blueberry and strawberry experimental data found that DL methods did not offer advantages over linear models, except when the epistasis component played a significant role.”
§ A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding > Introduction
What the sources say
- Supportedcites Zingaretti et al. (2020) source
In Results (Comparing Deep Learning With Bayesian Penalized Linear Models; page not supplied), the paper reports no important differences among methods for strawberry except percentage of culled fruit, where CNN performed about 20% better than the linear models and the epistatic component was largest. It reports that CNNs somewhat underperformed the linear models in blueberry. The Discussion likewise suggests that deep learning can perform better when epistasis is important. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“They found that both DL methods outperformed RR-BLUP, achieving a 0 to 5% better prediction accuracy.”
§ A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding > Introduction
What the sources say
- Supportedcites Sandhu et al. (2021) source
The Results section 'Comparison of Model Performances for Cross-Validations' states MLP improved prediction accuracy by 3 to 5% over rrBLUP for all five traits and CNN by 0 to 3%, so the citing sentence's aggregated '0 to 5%' range is the union of the two model-specific gains the paper reports. The Abstract and Conclusion attribute the same overall result to both DL models ('DL approaches obtained better prediction accuracy for each trait'; 'DL based models are superior for predicting all five traits'), in spring wheat, matching the claim's population and comparator. Minor nuance: the paper's Discussion notes rrBLUP was 'competitive' and CNN tied rrBLUP for grain yield and grain protein content (Table 4, 0.39/0.48), i.e. the 0% end of the range is equality rather than improvement, but this is the paper's own framing. (LLM, conf=0.87)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Transformers can also be used to exploit the sequential structure of DNA, as demonstrated by Jubair et al. (2021) and Måløy et al. (2021).”
§ A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding > Some considerations on selecting an appropriate DL architecture
What the sources say
- Partly supportedcites Jubair et al. (2021) sourceExperimental — accuracy not yet measured
The Introduction and Methods §2.4 describe a Transformer that uses self-attention to identify relationships among barley genetic markers, supporting its use with genomic data. They do not show that the model exploits the sequential order of DNA; its inputs are encoded SNP markers, and the described attention mechanism relates markers to one another rather than modeling DNA sequence order. Page numbers are unavailable in our copy. (LLM, conf=0.84)
- Not checked yetcites Måløy et al. (2021)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
58 more claims · 9 with their cited sources checked
Create a free account to see all 146 claims and to verify the 68 references still open.
- It may state two separate claims as one. 39
- Probably not a substantial claim. 63
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Early fusion excels with synchronized, coregistered data by capturing fine-grained interactions, though it lacks flexibility and is less robust to noisy or incomplete data due to its direct combination of inputs”
From Multimodal neuroimaging and AI integration in cognitive disorders: advances, challenges, and future directions for precision medicine (2026) · cites this paper as Montesinos-Lopez et al., 2024
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding > Introduction
“All studies mentioned so far focus solely on using genotypic information to predict traits of interest in different species.”
§ A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding > Introduction
“Wang et al. (2023) used neural network genomic prediction (DNNGP) to integrate multi-omics data in plants.”
Citations
Cites
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Prediction of Total Genetic Value Using Genome-Wide Dense Marker Maps
Meuwissen, T. H. E., Hayes, B. J., & Goddard, M. E. (2001) · Genetics · doi:10.1093/genetics/157.4.1819 · Cited by 7,917
Practical Recommendations for Gradient-Based Training of Deep Architectures
Bengio, Y. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_26 · Cited by 2,259 · cited 1×
“Regarding the number of neurons in every hidden layer, in the study by Bengio 2012, 2012 it is suggested to include several nodes large enough in every layer, and it is remarked that using the same number of neurons in every layer, rather than a sequential decrease or increase of them, seems to be…”
Activation functions in deep learning: a comprehensive survey and benchmark
Dubey, S. R., Singh, S. K., & Chaudhuri, B. B. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.06.111 · Cited by 1,259 · cited 1×
“For example, it is well known that the output of the derivative of the sigmoid function tends to be zero for higher and lower inputs, which can lead to the GV problem (Dubey et al .”
Fastai: A Layered API for Deep Learning
Howard, J., & Gugger, S. (2020) · Information · doi:10.3390/info11020108 · Cited by 971
Random forests for genomic data analysis
Chen, X., & Ishwaran, H. (2012) · Genomics · doi:10.1016/j.ygeno.2012.04.003 · Cited by 953 · cited 1×
“…this model is that it is only able to capture linear relationships between genotypes and phenotypic traits and because GS is a predictive methodology, other ML models have been applied to handle this limitation, such as random forests (Chen and Ishwaran 2012), support vector machines (Zhao et al .”
Huang, S.-C., Pareek, A., Seyyedi, S., Banerjee, I., & Lungren, M. P. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00341-z · Cited by 934 · cited 3×
“A meticulous description of this topic can be found in the studies by Huang et al (2020), Boulahia et al .”
InfluentialMultimodal deep learning for biomedical data fusion: a review
Stahlschmidt, S. R., Ulfenborg, B., & Synnergren, J. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbab569 · Cited by 766
Rethinking Attention with Performers
Choromanski, K., Likhosherstov, V., Dohan, D., Song, X., Gane, A., Sarlos, T., Hawkins, P., Davis, J., Mohiuddin, A., Kaiser, L., et al. (2020) · arXiv · doi:10.48550/arxiv.2009.14794 · Cited by 695
Robust Face Recognition via Multimodal Deep Face Representation
Ding, C., & Tao, D. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2477042 · Cited by 449 · cited 1×
“MMDL has been applied in various research and industry areas, including face authentication (Ding and Tao 2015), biometric recognition (Alay and Al-Baity 2020; Aung et al .”
ModDrop: Adaptive Multi-Modal Gesture Recognition
Neverova, N., Wolf, C., Taylor, G., & Nebout, F. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2461544 · Cited by 420
Neural Networks and Deep Learning: A Textbook
Aggarwal, C. C. (2018) · doi:10.1007/978-3-319-94463-0 · Cited by 417 · cited 2×
“The reader interested in this subject in greater detail can find more by Aggarwal (2018), Zhang, Lipton, et al .”
A roadmap for multi-omics data integration using deep learning
Kang, M., Ko, E., & Mersha, T. B. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbab454 · Cited by 389
A review of deep learning applications for genomic selection
Montesinos-López, O. A., Montesinos-López, A., Pérez-Rodríguez, P., Barrón-López, J. A., Martini, J. W. R., Fajardo-Flores, S. B., Gaytan-Lugo, L. S., Santana-Mancilla, P. C., & Crossa, J. (2021) · BMC Genomics · doi:10.1186/s12864-020-07319-x · Cited by 361
Self-citationA deep convolutional neural network approach for predicting phenotypes from genotypes
Ma, W., Qiu, Z., Song, J., Li, J., Cheng, Q., Zhai, J., & Ma, C. (2018) · Planta · doi:10.1007/s00425-018-2976-9 · Cited by 341 · cited 3×
“The RR-BLUP model as presented by Ma et al .”
InfluentialMachine learning in plant science and plant breeding
van Dijk, A. D. J., Kootstra, G., Kruijer, W., & de Ridder, D. (2021) · iScience · doi:10.1016/j.isci.2020.101890 · Cited by 320
DNNGP, a deep neural network-based method for genomic prediction using multi-omics data in plants
Wang, K., Abid, M. A., Rasheed, A., Crossa, J., Hearne, S., & Li, H. (2023) · Molecular Plant · doi:10.1016/j.molp.2022.11.004 · Cited by 278
Self-citationSALMON: survival analysis learning with multi-omics neural networks on breast cancer
Huang, Z., Zhan, X., Xiang, S., Johnson, T. S., Helm, B., Yu, C. Y., Zhang, J., Salama, P., Rizkalla, M., Han, Z., et al. (2019) · Frontiers in Genetics · doi:10.3389/fgene.2019.00166 · Cited by 262 · cited 1×
“Another example, in the field of survival analysis, is provided by Huang et al .”
Boulahia, S. Y., Amamra, A., Madi, M. R., & Daikh, S. (2021) · Machine Vision and Applications · doi:10.1007/s00138-021-01249-8 · Cited by 236
Machine Learning for Plant Breeding and Biotechnology
Niazian, M., & Niedbała, G. (2020) · Agriculture · doi:10.3390/agriculture10100436 · Cited by 235 · cited 1×
“These methods are used to analyze and evaluate the transmission of information from DNA sequences to observable phenotypic traits in plants (Niazian and Niedbała 2020).”
Deep learning versus parametric and ensemble methods for genomic prediction of complex phenotypes
Abdollahi-Arpanahi, R., Gianola, D., & Peñagaricano, F. (2020) · Genetics Selection Evolution · doi:10.1186/s12711-020-00531-z · Cited by 228
Can deep learning improve genomic prediction of complex human traits?
Bellot, P., de los Campos, G., & Pérez-Enciso, M. (2018) · Genetics · doi:10.1534/genetics.118.301298 · Cited by 225
Crop yield prediction integrating genotype and weather variables using deep learning
Shook, J., Gangopadhyay, T., Wu, L., Ganapathysubramanian, B., Sarkar, S., & Singh, A. K. (2021) · PLOS ONE · doi:10.1371/journal.pone.0252402 · Cited by 222 · cited 2×
“In cases involving temporal experimental data, RNNs like LSTMs, as demonstrated by Shook et al .”
A Guide on Deep Learning for Complex Trait Genomic Prediction
Pérez-Enciso, M., & Zingaretti, L. M. (2019) · Genes · doi:10.3390/genes10070553 · Cited by 197
Alay, N., & Al-Baity, H. H. (2020) · Sensors · doi:10.3390/s20195523 · Cited by 195
Multi-trait, Multi-environment Deep Learning Modeling for Genomic-Enabled Prediction of Plant Traits
Montesinos-López, O. A., Montesinos-López, A., Crossa, J., Gianola, D., Hernández-Suárez, C. M., & Martín-Vallejo, J. (2018) · G3 Genes|Genomes|Genetics · doi:10.1534/g3.118.200728 · Cited by 184
Self-citationMulti-environment Genomic Prediction of Plant Traits Using Deep Learners With Dense Architecture
Montesinos-López, A., Montesinos-López, O. A., Gianola, D., Crossa, J., & Hernández-Suárez, C. M. (2018) · G3 Genes|Genomes|Genetics · doi:10.1534/g3.118.200740 · Cited by 180
Self-citationElallid, B. B., Benamar, N., Hafid, A. S., Rachidi, T., & Mrani, N. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2022.03.013 · Cited by 179
To feed the world in 2050 will require a global revolution
Ehrlich, P. R., & Harte, J. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1519841112 · Cited by 179 · cited 1×
“…a similarly critical situation where advances in this field are poised to play a leading role, given the current climate crisis and the increasing demand for land, water, and energy to produce high-quality food for a global population projected to reach 9 billion by 2,050 (Ehrlich and Harte 2015).”
A Genomic Bayesian Multi-trait and Multi-environment Model
Montesinos-López, O. A., Montesinos-López, A., Crossa, J., Toledo, F. H., Pérez-Hernández, O., Eskridge, K. M., & Rutkoski, J. (2016) · G3 Genes|Genomes|Genetics · doi:10.1534/g3.116.032359 · Cited by 159
Self-citationExploring deep learning for complex trait genomic prediction in polyploid outcrossing species
Zingaretti, L. M., Gezan, S. A., Ferrão, L. F. V., Osorio, L. F., Monfort, A., Muñoz, P. R., Whitaker, V. M., & Pérez-Enciso, M. (2020) · Frontiers in Plant Science · doi:10.3389/fpls.2020.00025 · Cited by 159
Machine learning: a powerful tool for gene function prediction in plants
Mahood, E. H., Kruse, L. H., & Moghe, G. D. (2020) · Applications in Plant Sciences · doi:10.1002/aps3.11376 · Cited by 153 · cited 1×
“However, as pointed out by Mahood et al .”
Plant Genotype to Phenotype Prediction Using Machine Learning
Danilevicz, M. F., Gill, M., Anderson, R., Batley, J., Bennamoun, M., Bayer, P. E., & Edwards, D. (2022) · Frontiers in Genetics · doi:10.3389/fgene.2022.822173 · Cited by 150
On the depth of deep neural networks: a theoretical view
Sun, S., Chen, W., Wang, L., Liu, X., & Liu, T.-Y. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10243 · Cited by 147 · cited 1×
“Sun et al .”
Deep learning for predicting complex traits in spring wheat breeding program
Sandhu, K. S., Lozada, D. N., Zhang, Z., Pumphrey, M. O., & Carter, A. H. (2021) · Frontiers in Plant Science · doi:10.3389/fpls.2020.613325 · Cited by 147 · cited 1×
“Sandhu et al .”
Multi-omics revolution to promote plant breeding efficiency
Mahmood, U., Li, X., Fan, Y., Chang, W., Niu, Y., Li, J., Qu, C., & Lu, K. (2022) · Frontiers in Plant Science · doi:10.3389/fpls.2022.1062952 · Cited by 145
Learn to combine modalities in multimodal deep learning
Liu, K., Li, Y., Xu, N., & Natarajan, P. (2018) · arXiv · doi:10.48550/arxiv.1805.11730 · Cited by 136 · cited 2×
“However, because late fusion operates on inferences and not the raw inputs, it is not effective when modeling signal-level interactions between modalities (Liu et al .”
He, T., & Li, C. (2020) · The Crop Journal · doi:10.1016/j.cj.2020.04.005 · Cited by 99 · cited 1×
“The development of plant breeding (PB) strategies has significantly contributed to meeting the needs of the human population, which reached 3 billion by 1960, prior to the well-known Green Revolution ( He and Li, 2020).”
Multimodal Deep LearningPreprint
Akkus, C., Chu, L., Djakovic, V., Jauch-Walser, S., Koch, P., Loss, G., Marquardt, C., Moldovan, M., Sauter, N., Schneider, M., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2301.04856 · Cited by 87
Genetic evaluation including intermediate omics features
Christensen, O. F., Börner, V., Varona, L., & Legarra, A. (2021) · Genetics · doi:10.1093/genetics/iyab130 · Cited by 81 · cited 1×
“Compared to the single-step mixed effects model by Christensen et al .”
Zhang, A., Lipton, Z. C., Mu, L., & Smola, A. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.11342 · Cited by 76 · cited 6×
“(2021) and Zhang et al .”
InfluentialDanilevicz, M. F., Bayer, P. E., Boussaid, F., Bennamoun, M., & Edwards, D. (2021) · Remote Sensing · doi:10.3390/rs13193976 · Cited by 75 · cited 1×
“Danilevicz et al .”
Multi-Modal Fusion Emotion Recognition Method of Speech Expression Based on Deep Learning
Liu, D., Wang, Z., Wang, L., & Chen, L. (2021) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2021.697634 · Cited by 70 · cited 1×
“2022), emotion recognition (Liu et al .”
Applications of Support Vector Machine in Genomic Prediction in Pig and Maize Populations
Zhao, W., Lai, X., Liu, D., Zhang, Z., Ma, P., Wang, Q., Zhang, Z., & Pan, Y. (2020) · Frontiers in Genetics · doi:10.3389/fgene.2020.598318 · Cited by 68 · cited 1×
“…this model is that it is only able to capture linear relationships between genotypes and phenotypic traits and because GS is a predictive methodology, other ML models have been applied to handle this limitation, such as random forests (Chen and Ishwaran 2012), support vector machines (Zhao et al .”
Thung, K.-H., Yap, P.-T., & Shen, D. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-67558-9_19 · Cited by 63 · cited 1×
“To tackle this problem, Thung et al .”
Machine learning for predicting phenotype from genotype and environment
Guo, T., & Li, X. (2023) · Current Opinion in Biotechnology · doi:10.1016/j.copbio.2022.102853 · Cited by 61
End-to-end 3D CNN for plot-scale soybean yield prediction using multitemporal UAV-based RGB images
Bhadra, S., Sagan, V., Skobalski, J., Grignola, F., Sarkar, S., & Vilbig, J. M. (2023) · Precision Agriculture · doi:10.1007/s11119-023-10096-8 · Cited by 56
Kick, D. R., Wallace, J. G., Schnable, J. C., Kolkman, J. M., Alaca, B., Beissinger, T. M., Edwards, J., Ertl, D., Flint-Garcia, S., Gage, J. L., et al. (2023) · G3: Genes|Genomes|Genetics · doi:10.1093/g3journal/jkad006 · Cited by 53
Hierarchical Cross-Modality Semantic Correlation Learning Model for Multimodal Summarization
Zhang, L., Zhang, X., & Pan, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21422 · Cited by 53
Zhao, T., Zeng, J., & Cheng, H. (2022) · Genetics · doi:10.1093/genetics/iyac034 · Cited by 52
Deep learning methods improve genomic prediction of wheat breeding
Montesinos‐López, A., Crespo‐Herrera, L., Dreisigacker, S., Gerard, G., Vitale, P., Pierre, C. S., Govindan, V., Tadesse, Z., Flores, M. C., Pérez‐Rodríguez, P., et al. (2024) · Frontiers in Plant Science · doi:10.3389/fpls.2024.1324090 · Cited by 52
Self-citationTogninalli, M., Wang, X., Kucera, T., Shrestha, S., Juliana, P., Mondal, S., Pinto, F., Govindan, V., Crespo-Herrera, L., Huerta-Espino, J., et al. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad336 · Cited by 49
Self-citationJubair, S., Tucker, J. R., Henderson, N., Hiebert, C. W., Badea, A., Domaratzki, M., & Fernando, W. G. D. (2021) · Frontiers in Plant Science · doi:10.3389/fpls.2021.761402 · Cited by 46 · cited 2×
“Transformers can also be used to exploit the sequential structure of DNA, as demonstrated by Jubair et al .”
Multimodal deep learning methods enhance genomic prediction of wheat breeding
Montesinos-López, A., Rivera, C., Pinto, F., Piñera, F., Gonzalez, D., Reynolds, M., Pérez-Rodríguez, P., Li, H., Montesinos-López, O. A., & Crossa, J. (2023) · G3: Genes, Genomes, Genetics · doi:10.1093/g3journal/jkad045 · Cited by 41
Self-citationChandrashekar, P. B., Alatkar, S., Wang, J., Hoffman, G. E., He, C., Jin, T., Khullar, S., Bendl, J., Fullard, J. F., Roussos, P., et al. (2023) · Genome Medicine · doi:10.1186/s13073-023-01248-6 · Cited by 37
Neural Network Principles and Applications
Zayegh, A., & Bassam, N. A. (2018) · IntechOpen eBooks · doi:10.5772/intechopen.80416 · Cited by 37 · cited 1×
“(Zayegh, 2018).”
Multimodal performers for genomic selection and crop yield prediction
Måløy, H., Windju, S. S., Bergersen, S., Alsheikh, M. K., & Downing, K. L. (2021) · Smart Agricultural Technology · doi:10.1016/j.atech.2021.100017 · Cited by 35 · cited 2×
“(2021) and Måløy et al .”
Aung, H. M. L., Pluempitiwiriyawej, C., Hamamoto, K., & Wangsiripitak, S. (2022) · Computation · doi:10.3390/computation10070127 · Cited by 35
Genome-based prediction of Bayesian linear and non-linear regression models for ordinal data
Pérez‐Rodríguez, P., Flores‐Galarza, S., Vaquera‐Huerta, H., del Valle‐Paniagua, D. H., Montesinos‐López, O. A., & Crossa, J. (2020) · The Plant Genome · doi:10.1002/tpg2.20021 · Cited by 24
Self-citationMultiZoo & MultiBench: A Standardized Toolkit for Multimodal Deep LearningPreprint
Liang, P. P., Lyu, Y., Fan, X., Agarwal, A., Cheng, Y., Morency, L., & Salakhutdinov, R. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.16413 · Cited by 20
Wang, Y., & Chen, L. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac696 · Cited by 19
Multimodal Deep Learning for Advanced Driving Systems
Aranjuelo, N., Unzueta, L., Arganda‐Carreras, I., & Otaegui, O. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-94544-6_10 · Cited by 15 · cited 1×
“2021), and autonomous driving systems (Aranjuelo et al .”
MSXFGP: combining improved sparrow search algorithm with XGBoost for enhanced genomic prediction
Zhou, G., Gao, J., Zuo, D., Li, J., & Li, R. (2023) · BMC Bioinformatics · doi:10.1186/s12859-023-05514-7 · Cited by 15
Deep Multi-modal Object Detection for Autonomous Driving
Ennajar, A., Khouja, N., Boutteau, R., & Tlili, F. (2021) · International Multi-Conference on Systems, Signals & Devices (SSD) · doi:10.1109/ssd52085.2021.9429355 · Cited by 14 · cited 1×
“2018; Ennajar et al .”
A Generalized Multimodal Deep Learning Model for Early Crop Yield Prediction
Kaur, A., Goyal, P., Sharma, K., Sharma, L., & Goyal, N. (2022) · 2022 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata55660.2022.10020917 · Cited by 12
DeepG2P: fusing multi-modal data to improve crop production
Sharma, S., Partap, A., Balaguer, M. A. D. L., Malvar, S., & Chandra, R. (2022) · arXiv · doi:10.48550/arxiv.2211.05986 · Cited by 11
Multimodal Deep Learning for Crop Yield Prediction
Jácome-Galarza, L.-R. (2022) · Communications in Computer and Information Science · doi:10.1007/978-3-031-18347-8_9 · Cited by 9
Hierarchical Cross-Modality Semantic Correlation Learning Model for Multimodal SummarizationPreprint
Zhang, L., Zhang, X., Pan, J., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.12072 · Cited by 1
Research works printed but not linked: 4
- Chen, 2021, A review of multi-view deep learning methods for multimodal data fusion, Neural Comput, 33, 67
- Chollet, 2017, Deep Learning with R
- Goodfellow, 2016, Deep Learning
- Henderson, 1984, Applications of Linear Models in Animal Breeding Models
Cited by
Amin, A., Zaman, W., & Park, S. (2025) · Genes · doi:10.3390/genes16070809 · Cited by 98
“Recent advances integrate multi-modal deep learning architectures that jointly process heterogeneous omics and imaging data, exemplified by maize yield prediction models integrating genomics, metabolomics, and multispectral images [103].”
Integrating multi-omics and machine learning for disease resistance prediction in legumes
Mohamedikbal, S., Al-Mamun, H. A., Bestry, M., Batley, J., & Edwards, D. (2025) · Theoretical and Applied Genetics · doi:10.1007/s00122-025-04948-2 · Cited by 39
“This approach has the potential to integrate multi-omics data with environmental factors to provide robust prediction accuracy for implementing GS in breeding programmes (Montesinos-López et al. 2024).”
Kassem, M. A. (2025) · Plants · doi:10.3390/plants14111727 · Cited by 29
Pourmadadi, M., Shabestari, S. M., Abdouss, H., Rahdar, A., Fathi‐karkan, S., & Pandey, S. (2025) · Seminars in Oncology · doi:10.1016/j.seminoncol.2025.152429 · Cited by 33
Multi-omics approaches in plant biology: decoding agronomic traits for sustainable agriculture
Younas, M. U., Zuo, S., Qasim, M., Ahmad, I., Feng, Z., Korai, S. K., Zulfiqar, U., Tukhtaboeva, F., Ibrokhim, I., & Malik, T. (2025) · Plant Stress · doi:10.1016/j.stress.2025.101118 · Cited by 30
Metadata
- Authors
- Montesinos-López, O. A., Chavira-Flores, M., Kiasmiantini, Crespo-Herrera, L., Saint Piere, C., Li, H., Fritsche-Neto, R., Al-Nowibet, K., Montesinos-López, A., & Crossa, J.
- Affiliations
- Universidad de Colima (MX)
- Instituto de Investigaciones en Matemáticas Aplicadas y Sistemas (IIMAS), Universidad Nacional Autónoma de México (UNAM) , Ciudad de México 04510 ,
- Yogyakarta State University (ID)
- International Maize and Wheat Improvement Center (CIMMYT) , Km 45, Carretera Mexico-Veracruz, Texcoco, CP 52640 Edo. de México ,
- Chinese Academy of Agricultural Sciences (CN)
- Louisiana State University , Baton Rouge, LA 70803 ,
- Department of Statistics and Operations Research, King Saud University , Riyah 11451 ,
- Departamento de Matematicas, Centro Universitario de Ciencias Exactas e Ingenierías (CUCEI), Universidad de Guadalajara , 44430, Guadalajara, Jalisco ,
- Louisiana State University (US)
- Corresponding author
- Crossa, José
- Venue
- GENETICS
- Publisher
- Oxford University Press (OUP)
- Published
- 2024-11-05
- ISSN
- 0016-6731 (ISSN-L)
- 1943-2631
- PMC
- PMC11631469
- OpenAlex
- W4404061905
- Cited by
- 47
- References
- 67
- Citations by year
- 2026: 32 · 2025: 14 · 2024: 1
- FWCI
- 12.43
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Genetics (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- CGSPace A Repository of Agricultural Research Outputs (Consultative Group for International Agricultural Research) (submittedVersion, other-oa)
- Funders
- Bill & Melinda Gates Foundation (INV-003439 BMGF/FCDO)
- Accelerating Genetic Gains in Maize and Wheat for Improved Livelihoods
- USAID projects
- Foundation for Research Levy on Agricultural Products
- Agricultural Agreement Research Fund
- Research Council of Norway (301835, 320090)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic and phenotypic traits in livestock
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Mapping and Diversity in Plants and Animals
- Life Sciences › Agricultural and Biological Sciences › Plant Science › Smart Agriculture and AI
- Keywords
- multimodal deep learning, genomic selection, plant breeding, genomic prediction, neural network architecture, computational resources, food security
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.