Logistic regression was as good as machine learning for predicting major chronic diseases
The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
OBJECTIVE To evaluate the performance of machine learning (ML) algorithms and to compare them to logistic regression for the prediction of risk of cardiovascular diseases (CVD), chronic kidney disease (CKD), diabetes (DM), and hypertension (HTN) and in a prospective cohort study using simple clinical predictors. STUDY DESIGN AND SETTING We conducted analyses in a population-based cohort study in Asian adults (n=6,762). Five different ML models were considered: single-hidden-layer neural network, support vector machine, random forest, gradient boosting machine and k-nearest neighbour, and were compared to standard logistic regression. RESULTS The incidences at 6-year of CVD, CKD, DM, and HTN cases were 4.0%, 7.0%, 9.2%, and 34.6%, respectively. Logistic regression reached the highest AUC for CKD (0.905 [0.88, 0.93]) and DM (0.768 [0.73, 0.81]) predictions. For CVD and HTN, the best models were neural network (0.753 [0.70, 0.81]) and support vector machine (0.780 [0.747, 0.812]), respectively. However, the differences with logistic regression were small (less than 1%) and non-significant. Logistic regression, gradient boosting machine and neural network were systematically ranked among the best models. CONCLUSION Logistic regression yields as good performance as ML models to predict the risk of major chronic diseases with low incidence and simple clinical predictors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
A New Equation to Estimate Glomerular Filtration Rate
Levey, A. S., Stevens, L. A., Schmid, C. H., Zhang, Y. (., Castro, A. F., Feldman, H. I., Kusek, J. W., Eggers, P., Van Lente, F., Greene, T., et al. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-150-9-200905050-00006 · Cited by 25,603
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Building Predictive Models in R Using the caret Package
Kuhn, M. (2008) · Journal of Statistical Software · doi:10.18637/jss.v028.i05 · Cited by 8,863
MissForest—Non-parametric missing value imputation for mixed-type data
Stekhoven, D. J., & Bühlmann, P. (2012) · Bioinformatics · doi:10.1093/bioinformatics/btr597 · Cited by 6,156
Multi-Ethnic Study of Atherosclerosis: Objectives and Design
Bild, D. E. (2002) · American Journal of Epidemiology · doi:10.1093/aje/kwf113 · Cited by 3,942
Webster, A. C., Nagler, E. V., Morton, R. L., & Masson, P. (2017) · The Lancet · doi:10.1016/s0140-6736(16)32064-5 · Cited by 3,842
Christodoulou, E., Ma, J., Collins, G. S., Steyerberg, E. W., Verbakel, J. Y., & Van Calster, B. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.02.004 · Cited by 2,119
The Rotterdam Study: objectives and design update
Hofman, A., Breteler, M. M. B., van Duijn, C. M., Krestin, G. P., Pols, H. A., Stricker, B. H. C., Tiemeier, H., Uitterlinden, A. G., Vingerling, J. R., & Witteman, J. C. M. (2007) · European Journal of Epidemiology · doi:10.1007/s10654-007-9199-x · Cited by 1,395
Can machine-learning improve cardiovascular risk prediction using routine clinical data?
Weng, S. F., Reps, J., Kai, J., Garibaldi, J. M., & Qureshi, N. (2017) · PLOS ONE · doi:10.1371/journal.pone.0174944 · Cited by 1,346
Chronic kidney disease: the global challenge
El Nahas, A. M., & Bello, A. K. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17789-7 · Cited by 1,195
Lim, T.-S., Loh, W.-Y., & Shih, Y.-S. (2000) · Machine Learning · doi:10.1023/a:1007608224229 · Cited by 1,133
Prediction models for cardiovascular disease risk in the general population: systematic review
Damen, J. A. A. G., Hooft, L., Schuit, E., Debray, T. P. A., Collins, G. S., Tzoulaki, I., Lassale, C. M., Siontis, G. C. M., Chiocchia, V., Roberts, C., et al. (2016) · BMJ · doi:10.1136/bmj.i2416 · Cited by 935
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Surgery · doi:10.1002/bjs.9736 · Cited by 889
Modern modelling techniques are data hungry: a simulation study for predicting dichotomous endpoints
van der Ploeg, T., Austin, P. C., & Steyerberg, E. W. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-137 · Cited by 809
Classifier Technology and the Illusion of Progress
Hand, D. J. (2006) · Statistical Science · doi:10.1214/088342306000000060 · Cited by 723
Churpek, M. M., Yuen, T. C., Winslow, C., Meltzer, D. O., Kattan, M. W., & Edelson, D. P. (2016) · Critical Care Medicine · doi:10.1097/ccm.0000000000001571 · Cited by 638
Reporting and Methods in Clinical Prediction Research: A Systematic Review
Bouwmeester, W., Zuithoff, N. P. A., Mallett, S., Geerlings, M. I., Vergouwe, Y., Steyerberg, E. W., Altman, D. G., & Moons, K. G. M. (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001221 · Cited by 600
Risk models and scores for type 2 diabetes: systematic review
Noble, D., Mathur, R., Dent, T., Meads, C., & Greenhalgh, T. (2011) · BMJ · doi:10.1136/bmj.d7163 · Cited by 551
Goldstein, B. A., Navar, A. M., & Carter, R. E. (2016) · European Heart Journal · doi:10.1093/eurheartj/ehw302 · Cited by 543
Yu, W., Liu, T., Valdez, R., Gwinn, M., & Khoury, M. J. (2010) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-10-16 · Cited by 508
Comparison of imputation methods for missing laboratory data in medicine
Waljee, A. K., Mukherjee, A., Singal, A. G., Zhang, Y., Warren, J., Balis, U., Marrero, J., Zhu, J., & Higgins, P. D. (2013) · BMJ Open · doi:10.1136/bmjopen-2013-002847 · Cited by 498
Taylor, R. A., Pare, J. R., Venkatesh, A. K., Mowafi, H., Melnick, E. R., Fleischman, W., & Hall, M. K. (2016) · Academic Emergency Medicine · doi:10.1111/acem.12876 · Cited by 491
Machine learning and neurosurgical outcome prediction: a systematic review
Senders, J. T., Staples, P. C., Karhade, A. V., Zaki, M. M., Gormley, W. B., Broekman, M. L. D., Smith, T. R., & Arnaout, O. (2018) · World Neurosurgery · doi:10.1016/j.wneu.2017.09.149 · Cited by 486
Foong, A. W. P., Saw, S.-M., Loo, J.-L., Shen, S., Loon, S.-C., Rosman, M., Aung, T., Tan, D. T. H., Tai, E. S., & Wong, T. Y. (2007) · Ophthalmic Epidemiology · doi:10.1080/09286580600878844 · Cited by 432
Self-citationAustin, P. C., Tu, J. V., Ho, J. E., Levy, D., & Lee, D. S. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.11.008 · Cited by 338
Cardiovascular Disease Risk Assessment: Insights from Framingham
D’Agostino Sr., R. B., Pencina, M. J., Massaro, J. M., & Coady, S. (2013) · Global Heart · doi:10.1016/j.gheart.2013.01.001 · Cited by 329
Lavanya, R., Jeganathan, V. S. E., Zheng, Y., Raju, P., Cheung, N., Tai, E. S., Wang, J. J., Lamoureux, E., Mitchell, P., Young, T. L., et al. (2009) · Ophthalmic Epidemiology · doi:10.3109/09286580903144738 · Cited by 322
Self-citationSingal, A. G., Mukherjee, A., Elmunzer, J. B., Higgins, P. D. R., Lok, A. S., Zhu, J., Marrero, J. A., & Waljee, A. K. (2013) · American Journal of Gastroenterology · doi:10.1038/ajg.2013.332 · Cited by 305
The Rotterdam Study: 2010 objectives and design update
Hofman, A., Breteler, M. M. B., van Duijn, C. M., Janssen, H. L. A., Krestin, G. P., Kuipers, E. J., Stricker, B. H. C., Tiemeier, H., Uitterlinden, A. G., Vingerling, J. R., et al. (2009) · European Journal of Epidemiology · doi:10.1007/s10654-009-9386-z · Cited by 244
Class Imbalance Learning Methods for Support Vector Machines
Batuwita, R., & Palade, V. (2013) · Imbalanced Learning · doi:10.1002/9781118646106.ch5 · Cited by 227
Predicting urinary tract infections in the emergency department with machine learning
Taylor, R. A., Moore, C. L., Cheung, K.-H., & Brandt, C. (2018) · PLOS ONE · doi:10.1371/journal.pone.0194085 · Cited by 224
Risk Models to Predict Hypertension: A Systematic Review
Echouffo-Tcheugui, J. B., Batty, G. D., Kivimäki, M., & Kengne, A. P. (2013) · PLoS ONE · doi:10.1371/journal.pone.0067370 · Cited by 152
Practical experiences on the necessity of external validation
König, I. R., Malley, J. D., Weimar, C., Diener, H. ‐., & Ziegler, A. (2007) · Statistics in Medicine · doi:10.1002/sim.3069 · Cited by 138
Predicting Active Pulmonary Tuberculosis Using an Artificial Neural Network
El-Solh, A., Hsiao, C.-B., Goodnough, S., et al. (1999) · CHEST Journal · doi:10.1378/chest.116.4.968 · Cited by 126
Screening for Prediabetes Using Machine Learning Models
Choi, S. B., Kim, W. J., Yoo, T. K., Park, J. S., Chung, J. W., Lee, Y.-H., Kang, E. S., & Kim, D. W. (2014) · Computational and Mathematical Methods in Medicine · doi:10.1155/2014/618976 · Cited by 108
Ward, M. M., Pajevic, S., Dreyfuss, J., & Malley, J. D. (2006) · Arthritis Care & Research · doi:10.1002/art.21695 · Cited by 108
Selker, H. P., Griffith, J. L., Patil, S., Long, W. J., & D’Agostino, R. B. (1995) · PubMed · Cited by 101
Singapore Malay Eye Study: rationale and methodology of 6‐year follow‐up study (SiMES‐2)
Rosman, M., Zheng, Y., Wong, W., Lamoureux, E. L., Saw, S., Tay, W.-T., Wang, J. J., Mitchell, P. L. R., Tai, E. S., & Wong, T. Y. (2012) · Clinical and Experimental Ophthalmology · doi:10.1111/j.1442-9071.2012.02763.x · Cited by 93
Self-citationRisk prediction with machine learning and regression methods
Steyerberg, E. W., van der Ploeg, T., & Van Calster, B. (2014) · Biometrical Journal · doi:10.1002/bimj.201300297 · Cited by 90
Singapore Indian Eye Study‐2: methodology and impact of migration on systemic and eye outcomes
Sabanayagam, C., Yip, W., Gupta, P., Abdul, R. B. B. M., Lamoureux, E. L., Neelam, K., Cheung, C. M. G., Cheung, C. Y.-L., Wang, J. J., Cheng, C., et al. (2017) · Clinical and Experimental Ophthalmology · doi:10.1111/ceo.12974 · Cited by 75
Self-citationKruppa, J., Liu, Y., Diener, H., Holste, T., Weimar, C., König, I. R., & Ziegler, A. (2014) · Biometrical Journal · doi:10.1002/bimj.201300077 · Cited by 61
CALSTER, B. V., Valentin, L., Holsbeke, C. V., Testa, A. C., Bourne, T. H., Huffel, S. V., & Timmerman, D. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-96 · Cited by 40
Patient-centered yes/no prognosis using learning machines
König, I. R., Malley, J. D., Pajevic, S., Weimar, C., Diener, H., & Ziegler, A. (2008) · International Journal of Data Mining and Bioinformatics · doi:10.1504/ijdmb.2008.022149 · Cited by 37
Is Corneal Arcus Independently Associated With Incident Cardiovascular Disease in Asians?
Wong, M. Y. Z., Man, R. E. K., Gupta, P., Lim, S. H., Lim, B., Tham, Y. C., Sabanayagam, C., Wong, T. Y., Cheng, C., & Lamoureux, E. L. (2017) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2017.09.002 · Cited by 21
Self-citationPrediction of intracranial findings on CT-scans by alternative modelling techniques
van der Ploeg, T., Smits, M., Dippel, D. W. J., Hunink, M. G. M., & Steyerberg, E. W. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-143 · Cited by 17
Gupta, P., Gan, A. T. L., Man, R. E. K., Fenwick, E., Tham, Y. C., Sabanayagam, C., Wong, T. Y., Cheng, C., & Lamoureux, E. L. (2018) · Scientific Reports · doi:10.1038/s41598-018-32833-0 · Cited by 16
Self-citation(1950) · doi:10.1002/1097-0142(1950)3:1<32::aid-cncr2820030106>3.0.co;2-3
Cited by
The promise of machine learning in predicting treatment outcomes in psychiatry
Chekroud, A. M., Bondar, J., Delgadillo, J., Doherty, G., Wasil, A., Fokkema, M., Cohen, Z., Belgrave, D., DeRubeis, R., Iniesta, R., et al. (2021) · World Psychiatry · doi:10.1002/wps.20882 · Cited by 531
“Several studies found no benefit of machine learning over tra ditional logistic regression, for example in predicting treatment resistance in major depression 11 , brain injury outcomes 12 , or ma jor chronic diseases 13 .”
BackgroundSong, X., Liu, X., Liu, F., & Wang, C. (2021) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2021.104484 · Cited by 299
Stroke Risk Prediction with Machine Learning Techniques
Dritsas, E., & Trigka, M. (2022) · Sensors · doi:10.3390/s22134670 · Cited by 286
Predicting Type 2 Diabetes Using Logistic Regression and Machine Learning Approaches
Joshi, R. D., & Dhakal, C. K. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18147346 · Cited by 260
A scoping review of artificial intelligence-based methods for diabetes risk prediction
Mohsen, F., Al-Absi, H. R. H., Yousri, N. A., El Hajj, N., & Shah, Z. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00933-5 · Cited by 125
Metadata
- Authors
- Nusinovici, S., Tham, Y. C., Chak Yan, M. Y., Wei Ting, D. S., Li, J., Sabanayagam, C., Wong, T. Y., & Cheng, C.-Y.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2020-06
- Volume
- 122
- Pages
- 56-69
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W3011484826
- Cited by
- 541
- References
- 49
- FWCI
- 51.24
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.