Combining macula clinical signs and patient characteristics for age-related macular degeneration diagnosis: a machine learning approach
Open accessAbstract
BACKGROUND: To investigate machine learning methods, ranging from simpler interpretable techniques to complex (non-linear) "black-box" approaches, for automated diagnosis of Age-related Macular Degeneration (AMD). METHODS: Data from healthy subjects and patients diagnosed with AMD or other retinal diseases were collected during routine visits via an Electronic Health Record (EHR) system. Patients' attributes included demographics and, for each eye, presence/absence of major AMD-related clinical signs (soft drusen, retinal pigment epitelium, defects/pigment mottling, depigmentation area, subretinal haemorrhage, subretinal fluid, macula thickness, macular scar, subretinal fibrosis). Interpretable techniques known as white box methods including logistic regression and decision trees as well as less interpreitable techniques known as black box methods, such as support vector machines (SVM), random forests and AdaBoost, were used to develop models (trained and validated on unseen data) to diagnose AMD. The gold standard was confirmed diagnosis of AMD by physicians. Sensitivity, specificity and area under the receiver operating characteristic (AUC) were used to assess performance. RESULTS: Study population included 487 patients (912 eyes). In terms of AUC, random forests, logistic regression and adaboost showed a mean performance of (0.92), followed by SVM and decision trees (0.90). All machine learning models identified soft drusen and age as the most discriminating variables in clinicians' decision pathways to diagnose AMD. CONCLUSIONS: Both black-box and white box methods performed well in identifying diagnoses of AMD and their decision pathways. Machine learning models developed through the proposed approach, relying on clinical signs identified by retinal specialists, could be embedded into EHR to provide physicians with real time (interpretable) support.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Missing data were usually ignored by dropping data or imputing, and if not dealt with appropriately can skew the results.
“Missing data were usually ignored by dropping data or imputing, if not dealt with appropriately can skew the results68,106,173.”
From Multimodal machine learning in precision health: A scoping review (2022) · cites this paper as [68]
The Methods and Results describe this study's use of complete-case analysis and several imputation approaches. The Discussion says model performance did not change significantly across imputation methods. The paper does not establish that missing data are usually handled this way or that inappropriate handling skewed its results. (LLM, conf=0.82)
Experimental — accuracy not yet measuredFraccaro et al.'s study of macular degeneration noted their white box performed as well as black box methods.
“Contrast this with the work of Fraccaro et al. whose study of macular degeneration noted their white box performed as well as black box methods implementions68.”
From Multimodal machine learning in precision health: A scoping review (2022) · cites this paper as [68]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538 · see citing works
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305 · see citing works
Cortes, C., & Vapnik, V. N. (1995) · Machine Learning · doi:10.1023/a:1022627411411 · Cited by 34,565 · see citing works
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,834 · see citing works
An introduction to ROC analysis
Fawcett, T. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.10.010 · Cited by 21,879 · see citing works
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 21,028 · see citing works
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466 · see citing works
Hosmer, D. W., & Lemeshow, S. (2000) · doi:10.1002/0471722146 · Cited by 20,302 · see citing works
Classification and Regression by randomForest
Liaw, A. I., & Wiener, M. C. (2007) · Cited by 18,594 · see citing works
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325 · see citing works
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824 · see citing works
Friedman, J., Hastie, T., & Tibshirani, R. (2000) · The Annals of Statistics · doi:10.1214/aos/1016218223 · Cited by 6,884 · see citing works
MissForest—Non-parametric missing value imputation for mixed-type data
Stekhoven, D. J., & Bühlmann, P. (2012) · Bioinformatics · doi:10.1093/bioinformatics/btr597 · Cited by 6,156 · see citing works
Clinical Classification of Age-related Macular Degeneration
Ferris, F. L., Wilkinson, C. P., Bird, A. C., Chakravarthy, U., Chew, E. Y., Csaky, K. G., & Sadda, S. R. (2013) · Ophthalmology · doi:10.1016/j.ophtha.2012.10.036 · Cited by 1,868 · see citing works
Inference for the Generalization Error
Nadeau, C., & Bengio, Y. (2003) · Machine Learning · doi:10.1023/a:1024068626366 · Cited by 1,165 · see citing works
Foundations of Machine Learning
Mohri, M., Rostamizadeh, A., & Talwalkar, A. (2018) · doi:10.7551/mitpress/10290.001.0001 · Cited by 1,122 · see citing works
Foundations of Machine Learning
(2012) · The MIT Press eBooks · doi:10.7551/mitpress/8291.003.0006 · Cited by 1,102 · see citing works
Age-Related Macular Degeneration Is the Leading Cause of Blindness . . .
Bressler, N. M. (2004) · JAMA · doi:10.1001/jama.291.15.1900 · Cited by 686 · see citing works
Topography of diabetic macular edema with optical coherence tomography
Hee, M. R., Puliafito, C. A., Duker, J. S., et al. (1998) · Ophthalmology · doi:10.1016/s0161-6420(98)93601-6 · Cited by 637 · see citing works
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 636 · see citing works
Optical Coherence Tomography of Age-related Macular Degeneration and Choroidal Neovascularization
Hee, M. R., Baumal, C. R., Puliafito, C. A., Duker, J. S., Reichel, E., Wilkins, J. R., Coker, J. G., Schuman, J. S., Swanson, E. A., & Fujimoto, J. G. (1996) · Ophthalmology · doi:10.1016/s0161-6420(96)30512-5 · Cited by 413 · see citing works
Open-source machine learning: R meets Weka
Hornik, K., Buchta, C., & Zeileis, A. (2008) · Computational Statistics · doi:10.1007/s00180-008-0119-7 · Cited by 388 · see citing works
Forecasting Age-Related Macular Degeneration Through the Year 2050
Rein, D. B. (2009) · Archives of Ophthalmology · doi:10.1001/archophthalmol.2009.58 · Cited by 345 · see citing works
People and eyes: statistical approaches in ophthalmology
Murdoch, I., Morris, S. S., & Cousens, S. (1998) · British Journal of Ophthalmology · doi:10.1136/bjo.82.8.971 · Cited by 322 · see citing works
Improving Outcomes with Clinical Decision Support : An Implementer's Guide
Osheroff, J. A., Teich, J. M., Levick, D., Saldana, L., Velasco, F. T., Sittig, D. F., Rogers, K. M., & Jenders, R. A. (2012) · Cited by 297 · see citing works
Drusen as Risk Factors in Age-Related Macular Disease
Pauleikhoff, D., Barondes, M. J., Minassian, D. C., Chisholm, I. H., & Bird, A. C. (1990) · American Journal of Ophthalmology · doi:10.1016/s0002-9394(14)75576-x · Cited by 192 · see citing works
Progress on retinal image analysis for age related macular degeneration
Kanagasingam, Y., Bhuiyan, A., Abràmoff, M. D., Smith, R. T., Goldschmidt, L. P., & Wong, T. Y. (2013) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2013.10.002 · Cited by 172 · see citing works
Zheng, Y., Hijazi, M. H. A., & Coenen, F. (2012) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.12-9576 · Cited by 91 · see citing works
Optical Coherence Tomography of age-related macular degeneration and choroidal neovascularization
Puliafito, C. A., Hee, M. R., Baumal, C. R., Duker, J. S., Reichel, E., Wilkins, J. R., Coker, J. G., Schuman, J. S., Swanson, E. A., & Fujimoto, J. G. (1996) · Investigative Ophthalmology & Visual Science · Cited by 70 · see citing works
Performance of Automated Drusen Detection by Polarization-Sensitive Optical Coherence Tomography
Schlanitz, F. G., Baumann, B., Spalek, T., Schütze, C., Ahlers, C., Pircher, M., Götzinger, E., Hitzenberger, C. K. F., & Schmidt-Erfurth, U. M. (2011) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.10-6846 · Cited by 63 · see citing works
Liu, Y.-Y., Ishikawa, H., Chen, M., et al. (2011) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.10-7012 · Cited by 52 · see citing works
Automated Classification of Severity of Age-Related Macular Degeneration from Fundus Photographs
Kankanahalli, S., Burlina, P., Wolfson, Y., et al. (2013) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.12-10928 · Cited by 47 · see citing works
Impact of early and late age-related macular degeneration on vision-specific functioning
Lamoureux, E. L., Mitchell, P., Rees, G., et al. (2010) · British Journal of Ophthalmology · doi:10.1136/bjo.2010.185207 · Cited by 44 · see citing works
A Laboratory for Recursive Partytioning
Hothorn, T., Hornik, K., Strobl, C., et al. (2015) · Cited by 44 · see citing works
Data mining techniques for the screening of age-related macular degeneration
Hijazi, M. H. A., Coenen, F., & Zheng, Y. (2011) · Knowledge-Based Systems · doi:10.1016/j.knosys.2011.07.002 · Cited by 41 · see citing works
Fraccaro, P., Dentone, C., Fenoglio, D., et al. (2013) · Informatics for Health and Social Care · doi:10.3109/17538157.2013.812648 · Cited by 22 · see citing works
Self-citationQuellec, G., Russell, S. R., Scheetz, T. E., Stone, E. M., & Abràmoff, M. D. (2011) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.10-6232 · Cited by 15 · see citing works
Serrano-Aguilar, P. G., González, R. A., Antón-Canalís, L., Guerra-Artal, C., Ramallo‐Fariña, Y., Gómez-Ulla, F., & Nadal, J. (2011) · British Journal of Ophthalmology · doi:10.1136/bjophthalmol-2011-300660 · Cited by 9 · see citing works
A web-tool to manage ophthalmologic electronic health records
Bonetto, M., Fraccaro, P., Nicolò, M., et al. (2014) · IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI ...) · doi:10.1109/bhi.2014.6864374 · Cited by 3 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 1
- The pre-publication history for this paper can be accessed here: http://www.biomedcentral.com/1471-2415/15/10/prepub
Cited by
Sorted by citations
Multimodal machine learning in precision health: A scoping review
Kline, A., Wang, H., Li, Y., Dennis, S., Hutch, M., Xu, Z., Wang, F., Cheng, F., & Luo, Y. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00712-8 · Cited by 528 · see citing works
Big data hurdles in precision medicine and precision public health
Prosperi, M., Min, J. S., Bian, J., & Modave, F. (2018) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-018-0719-2 · Cited by 200 · see citing works
Self-citation
- Authors
- Fraccaro, P., Nicolo, M., Bonetto, M., Giacomini, M., Weller, P., Traverso, C. E., Prosperi, M., & OSullivan, D.
- Affiliations
- City, University of London (GB)
- University of Genoa (IT)
- University of Manchester (GB)
- Venue
- BMC Ophthalmology
- Published
- 2015-01-27
- Volume
- 15
- Issue
- 1
- Pages
- 10-10
- ISSN
- 1471-2415 (ISSN-L)
- PMC
- PMC4417241
- OpenAlex
- W2136493825
- Cited by
- 48
- References
- 39
- Citations by year
- 2025: 3 · 2024: 7 · 2023: 3 · 2022: 6 · 2021: 4 · 2020: 8 · 2019: 3 · 2018: 6 · 2017: 4 · 2016: 3 · 2015: 1
- FWCI
- 3.78
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Ophthalmology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (publishedVersion)
- NORMA (acceptedVersion)
- TRAP@NCI (National College of Ireland) (acceptedVersion)
- City Research Online (City University London) (acceptedVersion)
- CINECA IRIS Institutial Research Information System (University of Genoa) (submittedVersion)
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Retinal Imaging and Analysis
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Health Sciences › Medicine › Ophthalmology › Retinal Diseases and Treatments
- Keywords
- age-related macular degeneration, automated diagnosis, machine learning, interpretable models, black-box models, soft drusen, electronic health records, random forest, support vector machine, logistic regression, decision tree, AdaBoost, clinical decision support
- MeSH terms
- Machine Learning, Aged, Decision Trees, Female, Humans, Image Processing, Computer-Assisted, Macula Lutea, Macular Degeneration, Male, Retinal Hemorrhage, ROC Curve, Sensitivity and Specificity, Retinal Drusen, Area Under Curve, Retinal Pigment Epithelium, Subretinal Fluid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review