The absence of longitudinal data limits the accuracy of high-throughput clinical phenotyping for identifying type 2 diabetes mellitus subjects
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Purpose To evaluate the impact of insufficient longitudinal data on the accuracy of a high-throughput clinical phenotyping (HTCP) algorithm for identifying 1) patients with type 2 diabetes mellitus (T2DM) and 2) patients with no diabetes. Methods Retrospective study conducted at Mayo Clinic in Rochester, Minnesota. Eligible subjects were Olmsted County residents with ≥1 Mayo Clinic encounter in each of three time periods : 1) 2007, 2) from 1997 through 2006, and 3) before 1997 (N= 54,283). Diabetes relevant electronic medical record (EMR) data about diagnoses, laboratories, and medications were used. We employed the HTCP algorithm to categorize individuals as T2DM cases and non-diabetes controls. Considering the full 11 years (1997–2007) as the gold standard, we compared gold-standard categorizations with those using data for 10 subsequent intervals, ranging from 1998–2007 (10-year data) to 2007 (1-year data). Positive predictive values (PPVs) and false-negative rates (FNRs) were calculated. McNemar tests were used to determine whether categorizations using shorter time periods differed from the gold standard. Statistical significance was defined as P<.05. Results We identified 2,770 T2DM cases and 21,005 controls when the algorithm was applied using 11-year data. Using 2007 data alone, PPVs and FNRs respectively were 70% and 25% for case identification and 59% and 67% for control identification. All time frames differed significantly from the gold standard, except for the 10-year period. Conclusions The accuracy of the algorithm reduced remarkably as data were limited to shorter observation periods. This impact should be considered carefully when designing/executing HTCP algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Note on the Sampling Error of the Difference Between Correlated Proportions or Percentages
McNemar, Q. (1947) · Psychometrika · doi:10.1007/bf02295996 · Cited by 4,754
History of the Rochester Epidemiology Project
Melton, L. J. (1996) · Mayo Clinic Proceedings · doi:10.4065/71.3.266 · Cited by 1,443 · cited 4×
“The lack of these data may bring about subject selection errors, lead to sampling bias, and, more importantly, risk misleading results of following studies[8].”
BackgroundMethodInfluentialGenomics, type 2 diabetes, and obesity
McCarthy, M. I. (2010) · New England Journal of Medicine · doi:10.1056/nejmra0906948 · Cited by 938
Identifying Persons with Diabetes Using Medicare Claims Data
Hebert, P. L., Geiss, L. S., Tierney, E. F., Engelgau, M. M., Yawn, B. P., & McBean, A. M. (1999) · American Journal of Medical Quality · doi:10.1177/106286069901400607 · Cited by 403 · cited 1×
“Previous evidence suggests that using ICD-9-CM (International Classification of Diseases, Ninth Revision, Clinical Modification) codes alone is problematic for identifying diabetes subjects generally [15, 16].”
MethodWannamethee, S. G., Shaper, A. G., Whincup, P. H., Lennon, L., & Sattar, N. (2011) · Archives of Internal Medicine · doi:10.1001/archinternmed.2011.2 · Cited by 281
The Threat to Medical-Records Research
Melton, L. J. (1997) · New England Journal of Medicine · doi:10.1056/nejm199711133372012 · Cited by 245
Wei, W.-Q., Leibson, C. L., Ransom, J. E., Kho, A. N., Caraballo, P. J., Chai, H. S., Yawn, B. P., Pacheco, J. A., & Chute, C. G. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000597 · Cited by 112 · cited 4×
“, spatial data fragmentation, which has been addressed by other studies [14].”
BackgroundMethodInfluentialSelf-citation
Cited by
Hersh, W. R., Weiner, M. G., Embi, P. J., Logan, J. R., Payne, P. R. O., Bernstam, E. V., Lehmann, H. P., Hripcsak, G., Hartzog, T. H., Cimino, J. J., et al. (2013) · Medical Care · doi:10.1097/mlr.0b013e31829b1dbd · Cited by 567
A machine learning-based framework to identify type 2 diabetes through electronic health records
Zheng, T., Xie, W., Xu, L., He, X., Zhang, Y., You, M., Yang, G., & Chen, Y. (2017) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2016.09.014 · Cited by 380
Wei, W.-Q., Bastarache, L. A., Carroll, R. J., Marlo, J. E., Osterman, T. J., Gamazon, E. R., Cox, N. J., Roden, D. M., & Denny, J. C. (2017) · PLOS ONE · doi:10.1371/journal.pone.0175508 · Cited by 379
Self-citationWei, W.-Q., Teixeira, P. L., Mo, H., Cronin, R. M., Warner, J. L., & Denny, J. C. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv130 · Cited by 230
“We have also shown that patients with a longer history of interaction in the EHR have more accurate phenotyping results.(12) This incompleteness increases for patients who are seen at multiple healthcare centers that do not share patient data.”
BackgroundSelf-citationDevelopment and evaluation of an ensemble resource linking medications to their indications
Wei, W.-Q., Cronin, R. M., Xu, H., Lasko, T. A., Bastarache, L., & Denny, J. C. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001431 · Cited by 106
Self-citation
Metadata
- Authors
- Wei, W.-Q., Leibson, C. L., Ransom, J. E., Kho, A. N., & Chute, C. G.
- Venue
- International Journal of Medical Informatics
- Publisher
- Elsevier BV
- Published
- 2013-04
- Volume
- 82
- Issue
- 4
- Pages
- 239-247
- ISSN
- 1386-5056 (ISSN-L)
- OpenAlex
- W1963579426
- Cited by
- 38
- References
- 7
- FWCI
- 5.07
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The absence of longitudinal data limits the accuracy of high-throughput clinical phenotyping for identifying type 2 diabetes mellitus subjects. https://app.cochat.ai/papers/10.1016/j.ijmedinf.2012.05.015
- The paper
- Wei, W.-Q., Leibson, C. L., Ransom, J. E., Kho, A. N., & Chute, C. G. (2013). The absence of longitudinal data limits the accuracy of high-throughput clinical phenotyping for identifying type 2 diabetes mellitus subjects. International Journal of Medical Informatics. https://doi.org/10.1016/j.ijmedinf.2012.05.015
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.