Missing clinical and behavioral health data in a large electronic health record (EHR) system
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Objective Recent massive investment in electronic health records (EHRs) was predicated on the assumption of improved patient safety, research capacity, and cost savings. However, most US health systems and health records are fragmented and do not share patient information. Our study compared information available in a typical EHR with more complete data from insurance claims, focusing on diagnoses, visits, and hospital care for depression and bipolar disorder. Methods We included insurance plan members aged 12 and over, assigned throughout 2009 to a large multispecialty medical practice in Massachusetts, with diagnoses of depression ( N = 5140) or bipolar disorder ( N = 462). We extracted insurance claims and EHR data from the primary care site and compared diagnoses of interest, outpatient visits, and acute hospital events (overall and behavioral) between the 2 sources. Results Patients with depression and bipolar disorder, respectively, averaged 8.4 and 14.0 days of outpatient behavioral care per year; 60% and 54% of these, respectively, were missing from the EHR because they occurred offsite. Total outpatient care days were 20.5 for those with depression and 25.0 for those with bipolar disorder, with 45% and 46% missing, respectively, from the EHR. The EHR missed 89% of acute psychiatric services. Study diagnoses were missing from the EHR’s structured event data for 27.3% and 27.7% of patients. Conclusion EHRs inadequately capture mental health diagnoses, visits, specialty care, hospitalizations, and medications. Missing clinical information raises concerns about medical errors and research integrity. Given the fragmentation of health care and poor EHR interoperability, information exchange, and usability, priorities for further investment in health IT will need thoughtful reconsideration.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kessler, R. C., Chiu, W. T., Demler, O., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.617 · Cited by 12,052
Gulliver, A., Griffiths, K. M., & Christensen, H. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-113 · Cited by 3,292
Chaudhry, B., Wang, J., Wu, S., Maglione, M., Mojica, W., Roth, E., Morton, S. C., & Shekelle, P. G. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-10-200605160-00125 · Cited by 3,159
The “Meaningful Use” Regulation for Electronic Health Records
Blumenthal, D., & Tavenner, M. (2010) · New England Journal of Medicine · doi:10.1056/nejmp1006114 · Cited by 2,059
Antenatal risk factors for postpartum depression: a synthesis of recent literature
Robertson, E., Grace, S., Wallington, T., & Stewart, D. E. (2004) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2004.02.006 · Cited by 1,886
Consensus development conference on antipsychotic drugs and obesity and diabetes
American Diabetes Association, American Psychiatric Association, American Association of Clinical Endocrinologists, & North American Association for the Study of Obesity (2004) · Diabetes Care · doi:10.2337/diacare.27.2.596 · Cited by 1,554
Improving Safety with Information Technology
Bates, D. W., & Gawande, A. A. (2003) · New England Journal of Medicine · doi:10.1056/nejmsa020847 · Cited by 1,544 · cited 1×
“EHRs are often credited with improvements in safety when compared with earlier paper and manual systems.(44,45) However, to the extent that medical decision-making grows increasingly automated and reliant on new information technologies, care will suffer if there is overreliance on data that are in fact incomplete.”
BackgroundBuntin, M. B., Burke, M. F., Hoaglin, M. C., & Blumenthal, D. (2011) · Health Affairs · doi:10.1377/hlthaff.2011.0178 · Cited by 1,311
The Economic Burden of Depression in the United States: How Did It Change Between 1990 and 2000?
Greenberg, P. E., Kessler, R. C., Birnbaum, H. G., Leong, S. A., Lowe, S. W., Berglund, P. A., & Corey-Lisle, P. K. (2003) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v64n1211 · Cited by 1,280
Kessler, R. C. (2012) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2011.11.005 · Cited by 871
The Co-Morbidity Burden of Children and Young Adults with Autism Spectrum Disorders
Kohane, I. S., McMurry, A., Weber, G., MacFadden, D., Rappaport, L., Kunkel, L., Bickel, J., Wattanasin, N., Spence, S., Murphy, S., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0033224 · Cited by 562
Internet use and stigmatized illness
Berger, M., Wagner, T. H., & Baker, L. C. (2005) · Social Science & Medicine · doi:10.1016/j.socscimed.2005.03.025 · Cited by 547
Health Information Technology: An Updated Systematic Review With a Focus on Meaningful Use
Jones, S. S., Rudin, R. S., Perry, T., & Shekelle, P. G. (2014) · Annals of Internal Medicine · doi:10.7326/m13-1531 · Cited by 475
Melfi, C. A., Chawla, A. J., Croghan, T. W., Hanna, M. P., Kennedy, S., & Sredl, K. (1998) · Archives of General Psychiatry · doi:10.1001/archpsyc.55.12.1128 · Cited by 409
The economic burden of depression and the cost-effectiveness of treatment
Wang, P. S., Simon, G., & Kessler, R. C. (2003) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.139 · Cited by 403
Health and disability costs of depressive illness in a major U.S. corporation
Druss, B. G., Rosenheck, R. A., & Sledge, W. H. (2000) · American Journal of Psychiatry · doi:10.1176/appi.ajp.157.8.1274 · Cited by 395
Systematic Review of Health Information Exchange in Primary Care Practices
Fontaine, P., Ross, S. E., Zink, T., & Schilling, L. M. (2010) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2010.05.090192 · Cited by 214 · cited 1×
“Future progress may be possible through more accountable insurer-provider arrangements which include the sharing of data from claims with EHRs and clinicians, patient-driven data-sharing mechanisms, and regulations requiring more complete, timely, and usable data flows where access already exists.(4,5,63,64) EHRs have…”
BackgroundDrug interaction alert override rates in the Meaningful Use era: No evidence of progress
Bryant, A. D., Fletcher, G. S., & Payne, T. H. (2014) · Applied Clinical Informatics · doi:10.4338/aci-2013-12-ra-0103 · Cited by 172
Implications of an emerging EHR monoculture for hospitals and healthcare systems
Koppel, R., & Lehmann, C. U. (2015) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2014-003023 · Cited by 140
Cited by
Inside the nation’s largest mental health institution: a prevalence study in a state prison system
Al-Rousan, T., Rubenstein, L., Sieleni, B., Deol, H., & Wallace, R. B. (2017) · BMC Public Health · doi:10.1186/s12889-017-4257-0 · Cited by 175
“However, even if prior records are acquired, there may be variation in completeness as it has recently been shown that community electronic health records may have missing behavioral health and other data [36].”
BackgroundA Survey of Generative Adversarial Networks for Synthesizing Structured Electronic Health Records
Ghosheh, G. O., Li, J., & Zhu, T. (2024) · ACM Computing Surveys · doi:10.1145/3636424 · Cited by 95
The Pathway to Patient Data Ownership and Better Health
Mikk, K. A., Sleeper, H. A., & Topol, E. J. (2017) · JAMA · doi:10.1001/jama.2017.12145 · Cited by 56
Automation to optimise physician treatment of individual patients: examples in psychiatry
Bauer, M., Monteith, S., Geddes, J., Gitlin, M. J., Grof, P., Whybrow, P. C., & Glenn, T. (2019) · The Lancet Psychiatry · doi:10.1016/s2215-0366(19)30041-0 · Cited by 44
The qualculative dimension of healthcare data interoperability
Pine, K. H. (2019) · Health Informatics Journal · doi:10.1177/1460458219833095 · Cited by 37
Metadata
- Authors
- Madden, J. M., Lakoma, M. D., Rusinak, D., Lu, C. Y., & Soumerai, S. B.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-04-14
- Volume
- 23
- Issue
- 6
- Pages
- 1143-1149
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W2336383680
- Cited by
- 172
- References
- 19
- FWCI
- 22.24
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.