The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Computational Phenotype Discovery Using Unsupervised Feature Learning over Noisy, Sparse, and Irregular Clinical Data
Open accessAbstract
Inferring precise phenotypic patterns from population-scale clinical data is a core computational task in the development of precision, personalized medicine. The traditional approach uses supervised learning, in which an expert designates which patterns to look for (by specifying the learning task and the class labels), and where to look for them (by specifying the input variables). While appropriate for individual tasks, this approach scales poorly and misses the patterns that we don't think to look for. Unsupervised feature learning overcomes these limitations by identifying patterns (or features) that collectively form a compact and expressive representation of the source data, with no need for expert input or labeled examples. Its rising popularity is driven by new deep learning methods, which have produced high-profile successes on difficult standardized problems of object recognition in images. Here we introduce its use for phenotype discovery in clinical data. This use is challenging because the largest source of clinical data - Electronic Medical Records - typically contains noisy, sparse, and irregularly timed observations, rendering them poor substrates for deep learning methods. Our approach couples dirty clinical data to deep learning architecture via longitudinal probability densities inferred using Gaussian process regression. From episodic, longitudinal sequences of serum uric acid measurements in 4368 individuals we produced continuous phenotypic features that suggest multiple population subtypes, and that accurately distinguished (0.97 AUC) the uric-acid signatures of gout vs. acute leukemia despite not being optimized for the task. The unsupervised features were as accurate as gold-standard features engineered by an expert with complete knowledge of the domain, the classification task, and the class labels. Our findings demonstrate the potential for achieving computational phenotype discovery at population scale. We expect such data-driven phenotypes to expose unknown disease variants and subtypes and to provide rich targets for genetic association studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
(2008) · Journal of Machine Learning Research · Cited by 33,051
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Hosmer, D. W., & Lemeshow, S. (2000) · doi:10.1002/0471722146 · Cited by 20,302
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
On the limited memory BFGS method for large scale optimization
Liu, D. C., & Nocedal, J. (1989) · Mathematical Programming · doi:10.1007/bf01589116 · Cited by 8,560
Solutions of Ill-Posed Problems.
Bell, J. B., Tikhonov, A. N., & Arsenin, V. Y. (1978) · Mathematics of Computation · doi:10.2307/2006360 · Cited by 8,101
An introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,715
An Introduction to Variable and Feature Selection.
Guyon, I., & Elisseeff, A. (2003) · Cited by 6,576
Information theory, inference, and learning algorithms
(2004) · Choice Reviews Online · doi:10.5860/choice.41-5949 · Cited by 6,362
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Some Studies in Machine Learning Using the Game of Checkers
Samuel, A. L. (1959) · IBM Journal of Research and Development · doi:10.1147/rd.33.0210 · Cited by 4,443
(2011) · Cited by 2,752
Asthma phenotypes: the evolution from clinical to molecular approaches
Wenzel, S. E. (2012) · Nature Medicine · doi:10.1038/nm.2678 · Cited by 2,412
Multiple Kernel Learning Algorithms
Gönen, M., & Alpaydın, E. (2011) · Journal of Machine Learning Research · doi:10.5555/1953048.2021071 · Cited by 2,173
Deep Learning of Representations for Unsupervised and Transfer Learning.
Bengio, Y. (2011) · Cited by 1,702
Building high-level features using large scale unsupervised learning
Le, Q. V. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639343 · Cited by 1,695 · cited 3×
“Recent results using the largest deep architecture to date achieved a 70% improvement over the previous best performance on an extremely difficult object recognition task, where each object belonged to one of 22,000 different categories [6].”
BackgroundMethodResultInfluentialSelf-taught learning: transfer learning from unlabeled data
Raina, R., Battle, A., Lee, H., Packer, B., & Ng, A. Y. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273592 · Cited by 1,510
Some studies in machine learning using the game of checkers
Samuel, A. L. (2000) · IBM Journal of Research and Development · doi:10.1147/rd.441.0206 · Cited by 1,439
Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier]
Arel, I., Rose, D. C., & Karnowski, T. P. (2010) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2010.938364 · Cited by 1,121
On optimization methods for deep learning
Ngiam, J., Coates, A., Lahiri, A., Prochnow, B., Le, Q. V., & Ng, A. Y. (2011) · International Conference on Machine Learning · Cited by 1,076
Howard, S. C., Jones, D. P., & Pui, C.-H. (2011) · New England Journal of Medicine · doi:10.1056/nejmra0904569 · Cited by 1,044
Development of a Large-Scale De-Identified DNA Biobank to Enable Personalized Medicine
Roden, D., Pulley, J., Basford, M., Bernard, G., Clayton, E., Balser, Jr., & Masys, D. (2008) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2008.89 · Cited by 983
(2009) · neural information processing systems · Cited by 962
(2007) · Cited by 937
(2007) · Cited by 849
The use of receiver operating characteristic curves in biomedical informatics
Lasko, T. A., Bhagwat, J. G., Zou, K. H., & Ohno-Machado, L. (2005) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2005.02.008 · Cited by 823
Self-citationBuilding high-level features using large scale unsupervised learning
Ranzato, M., Monga, R., Devin, M., Chen, K., Corrado, G. S., Dean, J., Le, Q. V., & Ng, A. Y. (2012) · International Conference on Machine Learning · Cited by 823
A Statistical Perspective on Ill-Posed Inverse Problems
O'Sullivan, F. (1986) · Statistical Science · doi:10.1214/ss/1177013525 · Cited by 670
Bayesian Treed Gaussian Process Models With an Application to Computer Modeling
Gramacy, R. B., & Lee, H. K. H. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000689 · Cited by 650
Neogi, T. (2011) · New England Journal of Medicine · doi:10.1056/nejmcp1001124 · Cited by 490
Scaling Learning Algorithms toward AI
Bengio, Y., & LeCun, Y. (2007) · Large-Scale Kernel Machines · doi:10.7551/mitpress/7496.003.0016 · Cited by 455
The Mathematics of Learning: Dealing With Data
Smale, S. (2005) · 2005 International Conference on Neural Networks and Brain · doi:10.1109/icnnb.2005.1614860 · Cited by 398
Unsupervised learning of hierarchical representations with convolutional deep belief networks
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2011) · Communications of the ACM · doi:10.1145/2001269.2001295 · Cited by 388
Electronic Medical Records for Genetic Research: Results of the eMERGE Consortium
Kho, A. N., Pacheco, J. A., Peissig, P. L., Rasmussen, L., Newton, K. M., Weston, N., Crane, P. K., Pathak, J., Chute, C. G., Bielinski, S. J., et al. (2011) · Science Translational Medicine · doi:10.1126/scitranslmed.3001807 · Cited by 336
Self-citationElectronic medical records for discovery research in rheumatoid arthritis
Liao, K. P., Cai, T., Gainer, V., Goryachev, S., Zeng‐treitler, Q., Raychaudhuri, S., Szolovits, P., Churchill, S., Murphy, S., Kohane, I., et al. (2010) · Arthritis Care & Research · doi:10.1002/acr.20184 · Cited by 325
Using electronic health records to drive discovery in disease genomics
Kohane, I. S. (2011) · Nature Reviews Genetics · doi:10.1038/nrg2999 · Cited by 325
Ritchie, M. D., Denny, J. C., Crawford, D. C., Ramirez, A. H., Weiner, J. B., Pulley, J. M., Basford, M. A., Brown-Gentry, K., Balser, J. R., Masys, D. R., et al. (2010) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2010.03.003 · Cited by 323
Self-citationBayesian Inference for Non-Stationary Spatial Covariance Structure via Spatial Deformations
Schmidt, A. M., & O'Hagan, A. (2003) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00413 · Cited by 292
Nonstationary Covariance Functions for Gaussian Process Regression
Paciorek, C. J., & Schervish, M. J. (2003) · Cited by 284
Using Electronic Patient Records to Discover Disease Correlations and Stratify Patient Cohorts
Roque, F. S., Jensen, P. B., Schmock, H., Dalgaard, M., Andreatta, M., Hansen, T., Søeby, K., Bredkjær, S., Juul, A., Werge, T., et al. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002141 · Cited by 282
Inductive learning of structural descriptions
Dietterich, T. G., & Michalski, R. S. (1981) · Artificial Intelligence · doi:10.1016/0004-3702(81)90002-3 · Cited by 186
Integration of Early Physiological Responses Predicts Later Illness Severity in Preterm Infants
Saria, S., Rajani, A. K., Gould, J., Koller, D., & Penn, A. A. (2010) · Science Translational Medicine · doi:10.1126/scitranslmed.3001304 · Cited by 176
Review: Use of Electronic Medical Records for Health Outcomes Research: A Literature Review
Dean, B. B., Lam, J., Natoli, J. L., Butler, Q., Aguilar, D., & Nordyke, R. J. (2009) · Medical Care Research and Review · doi:10.1177/1077558709332440 · Cited by 176
Temporal pattern discovery in longitudinal electronic patient records
Norén, G. N., Hopstadius, J., Bate, A., Star, K., & Edwards, I. R. (2010) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-009-0152-3 · Cited by 170
Systolic and Diastolic Heart Failure Are Overlapping Phenotypes Within the Heart Failure Spectrum
Keulenaer, G. W. D., & Brutsaert, D. L. (2011) · Circulation · doi:10.1161/circulationaha.110.981431 · Cited by 168
Temporal abstraction in intelligent clinical data analysis: A survey
Stacey, M., & McGregor, C. (2007) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2006.08.002 · Cited by 146
Feature Generation Using General Constructor Functions
Markovitch, S., & Rosenstein, D. (2002) · Machine Learning · doi:10.1023/a:1014046307775 · Cited by 143
Is there anything good in uric acid?
Alvarez‐Lario, B., & Macarrón‐Vicente, J. (2011) · QJM · doi:10.1093/qjmed/hcr159 · Cited by 137
Evaluation of a Method to Identify and Categorize Section Headers in Clinical Documents
Denny, J. C., Spickard, A., Johnson, K. B., Peterson, N. B., Peterson, J. F., & Miller, R. A. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m3037 · Cited by 125
Self-citationMedical temporal-knowledge discovery via temporal abstraction.
Moskovitch, R., & D, Y. S. M. (2009) · PubMed · Cited by 113
Naïve Electronic Health Record phenotype identification for Rheumatoid arthritis.
Carroll, R. J., Eyler, A. E., & Denny, J. C. (2011) · PubMed Central · Cited by 111
Self-citationAbnormal serum uric acid levels in children
Wilcox, W. D. (1996) · The Journal of Pediatrics · doi:10.1016/s0022-3476(96)70322-0 · Cited by 106
Matheny, M. E., Miller, R. A., Ikizler, T. A., Waitman, L. R., Denny, J. C., Schildcrout, J. S., Dittus, R. S., & Peterson, J. F. (2010) · Medical Decision Making · doi:10.1177/0272989x10364246 · Cited by 104
Self-citationConway, M., Berg, R. L., Carrell, D., Denny, J. C., Kho, A., Kullo, I. J., Linneman, J. G., Pacheco, J. A., Peissig, P. L., Rasmussen, L. V., et al. (2011) · PubMed Central · Cited by 95
Self-citationA Pattern Mining Approach for Classifying Multivariate Temporal Data
Batal, I., Valizadegan, H., Cooper, G. F., & Hauskrecht, M. (2011) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2011.39 · Cited by 80
Towards heterogeneous temporal clinical event pattern discovery
Wang, F., Lee, N., Hu, J., Sun, J., & Ebadollahi, S. (2012) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2339530.2339605 · Cited by 76
Klompas, M., Haney, G. A., Church, D., Lazarus, R. M., Hou, X., & Platt, R. G. (2008) · PLoS ONE · doi:10.1371/journal.pone.0002626 · Cited by 72
The Mathematics of Learning: Dealing with Data
Poggio, T., & Smale, S. (2006) · International Conference on Neural Networks and Brain · doi:10.1109/icnnb.2005.1614546 · Cited by 59
The Heart Failure Spectrum: Time for a Phenotype-Oriented Approach
Keulenaer, G. W. D., & Brutsaert, D. L. (2009) · Circulation · doi:10.1161/circulationaha.109.870006 · Cited by 54
Automatic Feature Generation for Problem Solving Systems
Fawcett, T. E., & Utgoff, P. E. (1992) · Elsevier eBooks · doi:10.1016/b978-1-55860-247-2.50024-3 · Cited by 51
Cited by
Deep learning for healthcare: review, opportunities and challenges
Miotto, R., Wang, F., Wang, S., Jiang, X., & Dudley, J. T. (2018) · Briefings in Bioinformatics · doi:10.1093/bib/bbx044 · Cited by 3,076
“[64] used a two-layer stacked AE (without regularization) to model longitudinal sequences of serum uric acid measurements to distinguish the uric-acid signatures of gout and acute leukemia.”
Opportunities and obstacles for deep learning in biology and medicine
Ching, T., Himmelstein, D. S., Beaulieu-Jones, B. K., Kalinin, A. A., Do, B. T., Way, G. P., Ferrero, E., Agapow, P.-M., Zietz, M., Hoffman, M. M., et al. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0387 · Cited by 2,310
Artificial intelligence in healthcare: transforming the practice of medicine
Bajwa, J., Munir, U., Nori, A., & Williams, B. (2021) · Future Healthcare Journal · doi:10.7861/fhj.2021-0095 · Cited by 1,856
Miotto, R., Li, L., Kidd, B. A., & Dudley, J. T. (2016) · Scientific Reports · doi:10.1038/srep26094 · Cited by 1,710
Shickel, B., Tighe, P. J., Bihorac, A., & Rashidi, P. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2767063 · Cited by 1,688
Metadata
- Authors
- Lasko, T. A., Denny, J. C., & Levy, M. A.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-06-24
- Volume
- 8
- Issue
- 6
- Pages
- e66341
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W1973825638
- Cited by
- 313
- References
- 67
- FWCI
- 25.77
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.