Validity of Cardiovascular Data From Electronic Sources: The Multi-Ethnic Study of Atherosclerosis and HealthLNK
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Background: Understanding the validity of data from electronic data research networks is critical to national research initiatives and learning healthcare systems for cardiovascular care. Our goal was to evaluate the degree of agreement of electronic data research networks in comparison with data collected by standardized research approaches in a cohort study. Methods: We linked individual-level data from MESA (Multi-Ethnic Study of Atherosclerosis), a community-based cohort, with HealthLNK, a 2006 to 2012 database of electronic health records from 6 Chicago health systems. To evaluate the correlation and agreement of blood pressure in HealthLNK in comparison with in-person MESA examinations, and body mass index in HealthLNK in comparison with MESA, we used Pearson correlation coefficients and Bland-Altman plots. Using diagnoses in MESA as the criterion standard, we calculated the performance of HealthLNK for hypertension, obesity, and diabetes mellitus diagnosis by using International Classification of Diseases, Ninth Revision codes and clinical data. We also identified potential myocardial infarctions, strokes, and heart failure events in HealthLNK and compared them with adjudicated events in MESA. Results: Of the 1164 MESA participants enrolled at the Chicago Field Center, 802 (68.9%) participants had data in HealthLNK. The correlation was low for systolic blood pressure (0.39; P <0.0001). In comparison with MESA, HealthLNK overestimated systolic blood pressure by 6.5 mm Hg (95% confidence interval, 4.2–7.8). There was a high correlation between body mass index in MESA and HealthLNK (0.94; P <0.0001). HealthLNK underestimated body mass index by 0.3 kg/m 2 (95% confidence interval, –0.4 to –0.1). With the use of International Classification of Diseases, Ninth Revision codes and clinical data, the sensitivity and specificity of HealthLNK queries for hypertension were 82.4% and 59.4%, for obesity were 73.0% and 89.8%, and for diabetes mellitus were 79.8% and 93.3%. In comparison with adjudicated cardiovascular events in MESA, the concordance rates for myocardial infarction, stroke, and heart failure were, respectively, 41.7% (5/12), 61.5% (8/13), and 62.5% (10/16). Conclusions: These findings illustrate the limitations and strengths of electronic data repositories in comparison with information collected by traditional standardized epidemiological approaches for the ascertainment of cardiovascular risk factors and events.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
A New Initiative on Precision Medicine
Collins, F. S., & Varmus, H. (2015) · New England Journal of Medicine · doi:10.1056/nejmp1500523 · Cited by 5,202
Multi-Ethnic Study of Atherosclerosis: Objectives and Design
Bild, D. E. (2002) · American Journal of Epidemiology · doi:10.1093/aje/kwf113 · Cited by 3,942
Third Universal Definition of Myocardial Infarction
Thygesen, K., Alpert, J. S., Jaffe, A. S., Simoons, M. L., Chaitman, B. R., & White, H. D. (2012) · Circulation · doi:10.1161/cir.0b013e31826e1058 · Cited by 2,985
Weiskopf, N. G., & Weng, C. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000681 · Cited by 1,216
Hersh, W. R., Weiner, M. G., Embi, P. J., Logan, J. R., Payne, P. R. O., Bernstam, E. V., Lehmann, H. P., Hripcsak, G., Hartzog, T. H., Cimino, J. J., et al. (2013) · Medical Care · doi:10.1097/mlr.0b013e31829b1dbd · Cited by 567
Defining and measuring completeness of electronic health records for secondary use
Weiskopf, N. G., Hripcsak, G., Swaminathan, S., & Weng, C. (2013) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2013.06.010 · Cited by 367
Wei, W.-Q., Teixeira, P. L., Mo, H., Cronin, R. M., Warner, J. L., & Denny, J. C. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv130 · Cited by 230
Agarwal, R. (2017) · Journal of the American Heart Association · doi:10.1161/jaha.116.004536 · Cited by 144
Cited by
Cheung, A. K., Chang, T. I., Cushman, W. C., Furth, S. L., Hou, F. F., Ix, J. H., Knoll, G. A., Muntner, P., Pecoits-Filho, R., Sarnak, M. J., et al. (2021) · Kidney International · doi:10.1016/j.kint.2020.11.003 · Cited by 1,452
Wang, Q. Q., Kaelber, D. C., Xu, R., & Volkow, N. D. (2021) · Molecular Psychiatry · doi:10.1038/s41380-020-00880-7 · Cited by 634
Wang, Q., Xu, R., & Volkow, N. D. (2021) · World Psychiatry · doi:10.1002/wps.20806 · Cited by 617
Wang, Q., Berger, N. A., & Xu, R. (2021) · JAMA Oncology · doi:10.1001/jamaoncol.2020.6178 · Cited by 390
Wang, Q., Davis, P. B., Gurney, M. E., & Xu, R. (2021) · Alzheimer's & Dementia · doi:10.1002/alz.12296 · Cited by 257
Blood Pressure Assessment in Adults in Clinical Practice and Clinic-Based Research
Muntner, P., Einhorn, P. T., Cushman, W. C., Whelton, P. K., Bello, N. A., Drawz, P. E., Green, B. B., Jones, D. W., Juraschek, S. P., Margolis, K. L., et al. (2019) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2018.10.069 · Cited by 199
“All BPs should be recorded in the EMR in structured data fields as individual measurements rather than the average in order to facilitate monitoring of adherence to protocols that call for 2 or more BP measurements at each visit and for the purpose of using the data for ongoing clinical care and research.”
BackgroundInfluential(2022) · PubMed Central · doi:10.6515/acs.202205_38(3).20220321a · Cited by 117
Strom, J. B., Faridi, K. F., Butala, N. M., Zhao, Y., Tamez, H., Valsdottir, L. R., Brennan, J. M., Shen, C., Popma, J. J., Kazi, D. S., et al. (2020) · Circulation · doi:10.1161/circulationaha.120.046159 · Cited by 37
Tang, O., Foti, K., Miller, E. R., Appel, L. J., & Juraschek, S. P. (2020) · American Journal of Hypertension · doi:10.1093/ajh/hpaa093 · Cited by 30
Sakhuja, S., Jaeger, B. C., Akinyelure, O. P., Bress, A. P., Shimbo, D., Schwartz, J. E., Hardy, S. T., Howard, G., Drawz, P., & Muntner, P. (2022) · The Journal of Clinical Hypertension · doi:10.1111/jch.14418 · Cited by 28
Metadata
- Authors
- Ahmad, F. S., Chan, C., Rosenman, M. B., Post, W. S., Fort, D. G., Greenland, P., Liu, K. J., Kho, A. N., & Allen, N. B.
- Venue
- Circulation
- Published
- 2017-09-26
- Volume
- 136
- Issue
- 13
- Pages
- 1207-1216
- ISSN
- 0009-7322 (ISSN-L)
- 1524-4539
- OpenAlex
- W2725924843
- Cited by
- 60
- References
- 9
- FWCI
- 9.96
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.