Caveats for the Use of Operational Electronic Health Record Data in Comparative Effectiveness Research
Open accessAbstract
The growing amount of data in operational electronic health record systems provides unprecedented opportunity for its reuse for many tasks, including comparative effectiveness research. However, there are many caveats to the use of such data. Electronic health record data from clinical settings may be inaccurate, incomplete, transformed in ways that undermine their meaning, unrecoverable for research, of unknown provenance, of insufficient granularity, and incompatible with research protocols. However, the quantity and real-world nature of these data provide impetus for their use, and we develop a list of caveats to inform would-be users of such data as well as provide an informatics roadmap that aims to insure this opportunity to augment comparative effectiveness research can be best leveraged.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Data not collected systematically for research will be poorer quality, which could have negative impacts on findings generated from these data.
“However, a major concern is that data not collected systematically for research will be poorer quality, which could have negative impacts on findings generated from these data.24–27”
From A harmonized data quality assessment terminology and framework for the secondary use of electronic health record data (2016) · cites this paper as [27]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The “Meaningful Use” Regulation for Electronic Health Records
Blumenthal, D., & Tavenner, M. (2010) · New England Journal of Medicine · doi:10.1056/nejmp1006114 · Cited by 2,059 · see citing works
Natural language processing: an introduction
Nadkarni, P. M., Lucila Ohno-machado, A., & Chapman, W. W. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000464 · Cited by 1,984 · see citing works
A review of uses of health care utilization databases for epidemiologic research on therapeutics
Schneeweiß, S., & Avorn, J. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.10.012 · Cited by 1,290 · see citing works
Weiskopf, N. G., & Weng, C. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000681 · Cited by 1,216 · cited 1× · see citing works
“A review of the literature of studies evaluating the data quality of EHRs for clinical research identified 5 dimensions of data quality assessed: completeness, correctness, concordance, plausibility, and currency.(26) The authors identified many studies with a wide variety of techniques to assess these dimensions and,…”
Measuring Diagnoses: ICD Code Accuracy
O’Malley, K. J., Cook, K. F., Price, M. D., Wildes, K. R., Hurdle, J. F., & Ashton, C. M. (2005) · Health Services Research · doi:10.1111/j.1475-6773.2005.00444.x · Cited by 1,121 · see citing works
Assessing Quality Using Administrative Data
Iezzoni, L. I. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-8_part_2-199710151-00048 · Cited by 981 · see citing works
Next-generation phenotyping of electronic health records
Hripcsak, G., & Albers, D. J. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001145 · Cited by 795 · see citing works
Self-citationSafran, C., Bloomrosen, M., Hammond, W. E., Labkoff, S., Markel-Fox, S., Tang, P. C., & Detmer, D. E. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2273 · Cited by 707 · see citing works
the eMERGE Team, McCarty, C. A., Chisholm, R. L., Chute, C. G., Kullo, I. J., Jarvik, G. P., Larson, E. B., Li, R., Masys, D. R., Ritchie, M. D., et al. (2011) · BMC Medical Genomics · doi:10.1186/1755-8794-4-13 · Cited by 692 · see citing works
Desiderata for Controlled Medical Vocabularies in the Twenty-First Century
Cimino, J. J. (1998) · Methods of Information in Medicine · doi:10.1055/s-0038-1634558 · Cited by 656 · see citing works
Self-citationChildhood Obesity and Metabolic Imprinting
Hillier, T. A., Pedula, K. L., Schmidt, M. M., Mullen, J. A., Charles, M.-A., & Pettitt, D. J. (2007) · Diabetes Care · doi:10.2337/dc06-2361 · Cited by 656 · see citing works
Jollis, J. G., Ancukiewicz, M., DeLong, E. R., Pryor, D. B., Muhlbaier, L. H., & Mark, D. B. (1993) · Annals of Internal Medicine · doi:10.7326/0003-4819-119-8-199310150-00011 · Cited by 626 · see citing works
Achieving a Nationwide Learning Health System
Friedman, C. P., Wong, A. K., & Blumenthal, D. (2010) · Science Translational Medicine · doi:10.1126/scitranslmed.3001456 · Cited by 539 · see citing works
Reengineering Translational Science: The Time Is Right
Collins, F. S. (2011) · Science Translational Medicine · doi:10.1126/scitranslmed.3002747 · Cited by 481 · see citing works
Chan, K. S., Fowles, J. B., & Weiner, J. P. (2010) · Medical Care Research and Review · doi:10.1177/1077558709359007 · Cited by 365 · see citing works
Lawson, E. H., Louie, R., Zingmond, D. S., Brook, R. H., Hall, B. L., Han, L. F., Rapp, M. T., & Ko, C. Y. (2012) · Annals of Surgery · doi:10.1097/sla.0b013e31826b4c4f · Cited by 343 · see citing works
Systematic review of scope and quality of electronic patient record data in primary care
Thiru, K., Hassey, A., & Sullivan, F. (2003) · BMJ · doi:10.1136/bmj.326.7398.1070 · Cited by 342 · see citing works
Unlocking Clinical Data from Narrative Reports: A Study of Natural Language Processing
Hripcsak, G. M., Friedman, C., Alderson, P. O., DuMouchel, W., Johnson, S. B., & Clayton, P. D. (1995) · Annals of Internal Medicine · doi:10.7326/0003-4819-122-9-199505010-00007 · Cited by 340 · see citing works
Self-citationSecondary Use of EHR: Data Quality Issues and Informatics Opportunities.
(2010) · PubMed Central · Cited by 332 · see citing works
de Lusignan, S., & van Weel, C. (2005) · Family Practice · doi:10.1093/fampra/cmi106 · Cited by 327 · see citing works
Lindenauer, P. K., Lagu, T. C., Shieh, M., Pekow, P. S., & Rothberg, M. B. (2012) · JAMA · doi:10.1001/jama.2012.384 · Cited by 295 · see citing works
Denny, J. C., Crawford, D. C., Ritchie, M. D., Bielinski, S. J., Basford, M., Bradford, Y., Chai, H. S., Bastarache, L. A., Zuvich, R. L., Peissig, P. L., et al. (2011) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2011.09.008 · Cited by 249 · see citing works
A systematic literature review of automated clinical coding and classification systems
Stanfill, M. H., Williams, M., Fenton, S. H., Jenders, R. A., & Hersh, W. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.001024 · Cited by 224 · see citing works
Self-citationRea, S., Pathak, J., Savova, G., Oniki, T. A., Westberg, L., Beebe, C. E., Tao, C., Parker, C. G., Haug, P. J., Huff, S. M., et al. (2012) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2012.01.009 · Cited by 206 · see citing works
Zhang, Z., & Sun, J. (2009) · Statistical Methods in Medical Research · doi:10.1177/0962280209105023 · Cited by 190 · see citing works
Review: Use of Electronic Medical Records for Health Outcomes Research
Dean, B. B., Lam, J. W. K., Natoli, J. L., Butler, Q. R., Aguilar, D., & Nordyke, R. J. (2009) · Medical Care Research and Review · doi:10.1177/1077558709332440 · Cited by 177 · see citing works
Ryan, P. B., Madigan, D., Stang, P., Overhage, J. M., Racoosin, J. A., & Hartzema, A. G. (2012) · Statistics in Medicine · doi:10.1002/sim.5620 · Cited by 177 · see citing works
The Methods of Comparative Effectiveness Research
Sox, H. C., & Goodman, S. N. (2012) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031811-124610 · Cited by 174 · see citing works
Wahl, P. M., Rodgers, K., Schneeweiß, S., Gage, B. F., Butler, J., Wilmer, C. I., Nash, M., Esper, G. J., Gitlin, N., Osborn, N. K., et al. (2010) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1924 · Cited by 174 · see citing works
Chapter 13: Mining Electronic Health Records in the Genomics Era
Denny, J. C. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002823 · Cited by 165 · see citing works
Building a Virtual Cancer Research Organization
Hornbrook, M. C. (2005) · JNCI Monographs · doi:10.1093/jncimonographs/lgi033 · Cited by 154 · see citing works
Tannen, R. L., Weiner, M. G., & Xie, D. (2009) · BMJ · doi:10.1136/bmj.b81 · Cited by 145 · see citing works
Self-citationPatients Treated at Multiple Acute Health Care Facilities: Quantifying Information Fragmentation
Bourgeois, F. C. (2010) · Archives of Internal Medicine · doi:10.1001/archinternmed.2010.439 · Cited by 140 · see citing works
Validity of electronic health record-derived quality measurement for performance monitoring
Parsons, A., McCullough, C., Wang, J., & Shih, S. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000557 · Cited by 137 · see citing works
Toward Reuse of Clinical Data for Research and Quality Improvement: The End of the Beginning?
Weiner, M. G., & Embi, P. J. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-5-200909010-00141 · Cited by 129 · see citing works
Self-citationIdentification of Genomic Predictors of Atrioventricular Conduction
Denny, J. C., Ritchie, M. D., Crawford, D. C., Schildcrout, J. S., Ramirez, A. H., Pulley, J. M., Basford, M., Masys, D. R., Haines, J. L., & Roden, D. M. (2010) · Circulation · doi:10.1161/circulationaha.110.948828 · Cited by 122 · see citing works
Challenges in Using Electronic Health Record Data for CER
Bayley, K. B., Belnap, T., Savitz, L. A., Masica, A. L., Shah, N. D., & Fleming, N. S. (2013) · Medical Care · doi:10.1097/mlr.0b013e31829b1d48 · Cited by 120 · see citing works
A Genome-Wide Association Study of Red Blood Cell Traits Using the Electronic Medical Record
Kullo, I. J., Ding, K., Jouni, H., Smith, C. Y., & Chute, C. G. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013011 · Cited by 118 · see citing works
Wei, W.-Q., Leibson, C. L., Ransom, J. E., Kho, A. N., Caraballo, P. J., Chai, H. S., Yawn, B. P., Pacheco, J. A., & Chute, C. G. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000597 · Cited by 112 · see citing works
Genetic variants associated with the white blood cell count in 13,923 subjects in the eMERGE Network
Crosslin, D. R., McDavid, A., Weston, N., Nelson, S. C., Zheng, X., Hart, E., de Andrade, M., Kullo, I. J., McCarty, C. A., Doheny, K. F., et al. (2011) · Human Genetics · doi:10.1007/s00439-011-1103-9 · Cited by 108 · see citing works
DeVoe, J. E., Gold, R. B., McIntire, P., Puro, J. E., Chauvie, S., & Gallia, C. A. (2011) · The Annals of Family Medicine · doi:10.1370/afm.1279 · Cited by 104 · see citing works
Association of Patient-Centered Outcomes With Patient-Reported and ICD-9-Based Morbidity Measures
Bayliss, E. A., Ellis, J. L., Shoup, J. A., Zeng, C. X., McQuillan, D. B., & Steiner, J. F. (2012) · The Annals of Family Medicine · doi:10.1370/afm.1364 · Cited by 92 · see citing works
Identification of metastatic cancer in claims data
Nordstrom, B. L., Whyte, J. L., Stolar, M. J., Mercaldi, C. J., & Kallich, J. D. (2012) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.3247 · Cited by 84 · see citing works
Bias Associated with Mining Electronic Health Records
Hripcsak, G., Knirsch, C., Zhou, L., Wilcox, A., & Melton, G. (2011) · Journal of Biomedical Discovery and Collaboration · doi:10.5210/disco.v6i0.3581 · Cited by 83 · see citing works
Self-citationMowat, F. S., Lau, Whyte, Kelsh, Legg, Engel-Nitz, Watson, Collins, & Nordyke, R. J. (2011) · Clinical Epidemiology · doi:10.2147/clep.s23690 · Cited by 75 · see citing works
Effect of Nonpayment for Hospital-Acquired, Catheter-Associated Urinary Tract Infection
Meddings, J. A., Reichert, H., Rogers, M. A. M., Saint, S. K., Stephansky, J., & McMahon, L. F. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-5-201209040-00003 · Cited by 70 · see citing works
Finnell, J. T., Overhage, J. M., & Grannis, S. J. (2011) · PubMed · Cited by 69 · see citing works
Gorelick, M. H., Knight, S., Alessandrini, E. A., Stanley, R. M., Chamberlain, J. M., Kuppermann, N., & Alpern, E. R. (2007) · Academic Emergency Medicine · doi:10.1197/j.aem.2007.03.1357 · Cited by 68 · see citing works
Practices and perspectives on building integrated data repositories: results from a 2010 CTSA survey
MacKenzie, S. L., Wyatt, M., Schuff, R. A., Tenenbaum, J. D., & Anderson, N. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000508 · Cited by 62 · see citing works
Green, S. M. (2012) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2012.09.010 · Cited by 60 · see citing works
Evaluation of biomedical text-mining systems: Lessons learned from information retrieval
Hersh, W. (2005) · Briefings in Bioinformatics · doi:10.1093/bib/6.4.344 · Cited by 58 · see citing works
Self-citationThe importance of knowing context of hospital episode statistics when reconfiguring the NHS
Brennan, L., Watson, M., Klaber, R. E., & Charles, T. (2012) · BMJ · doi:10.1136/bmj.e2432 · Cited by 57 · see citing works
Harris, S. B., Glazier, R. H., Tompkins, J. W., Wilton, A. S., Chevendra, V., Stewart, M., & Thind, A. (2010) · BMC Health Services Research · doi:10.1186/1472-6963-10-347 · Cited by 54 · see citing works
Benin, A. L., Vitkauskas, G., Thornquist, E., Shapiro, E. D., Concato, J., Aslan, M., & Krumholz, H. M. (2005) · Medical Care · doi:10.1097/01.mlr.0000167185.26058.8e · Cited by 52 · see citing works
Hu, G., & Baker, S. P. (2012) · Public Health Reports · doi:10.1177/003335491212700307 · Cited by 50 · see citing works
Edinger, T., Cohen, A. M., Bedrick, S. D., Ambert, K. H., & Hersh, W. (2012) · PubMed Central · Cited by 50 · see citing works
Self-citationTannen, R. L., Weiner, M. G., Xie, D., & Barnhart, K. T. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.10.012 · Cited by 49 · see citing works
Self-citationde Lusignan, S., Liaw, S., Krause, P., Ćurčin, V., Vicente, M., Michalakidis, G., Agréus, L., Leysen, P., Shaw, N. T., & Mendis, K. (2011) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638748 · Cited by 47 · see citing works
How the Continuity of Care Document Can Advance Medical Research and Public Health
D'Amore, J. D., Sittig, D. F., & Ness, R. B. (2012) · American Journal of Public Health · doi:10.2105/ajph.2011.300640 · Cited by 44 · see citing works
Sensible use of observational clinical data
Overhage, J. M., & Overhage, L. M. (2011) · Statistical Methods in Medical Research · doi:10.1177/0962280211403598 · Cited by 43 · see citing works
Tannen, R. L., Weiner, M. G., & Xie, D. (2008) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1584 · Cited by 41 · see citing works
Self-citationWei, W.-Q., Leibson, C. L., Ransom, J. E., Kho, A. N., & Chute, C. G. (2012) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2012.05.015 · Cited by 38 · see citing works
The impact of electronic medical records data sources on an adverse drug event quality measure
Kahn, M. G., & Ranade, D. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.002451 · Cited by 31 · see citing works
Benin, A. L., Fenick, A. M., Herrin, J. S., Vitkauskas, G., Chen, J., & Brandt, C. (2011) · American Journal of Medical Quality · doi:10.1177/1062860611403136 · Cited by 31 · see citing works
Hormone therapy and coronary heart disease in young women
Weiner, M. G., Barnhart, K. T., Xie, D., & Tannen, R. L. (2007) · Menopause The Journal of The North American Menopause Society · doi:10.1097/gme.0b013e3180413e45 · Cited by 28 · see citing works
Self-citationYu, A. C., & Cimino, J. J. (2011) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2011.01.005 · Cited by 13 · see citing works
Self-citationMaster Data Management: Getting your House in Order
Seiler, K. P., Bodycombe, N. E., Hawkins, T., Shell, R., Lemon, A., Souza, A. G. D., & Clemons, P. A. (2011) · Combinatorial Chemistry & High Throughput Screening · doi:10.2174/138620711796957189 · Cited by 3 · see citing works
Yu, A. C., & Cimino, J. J. (2007) · PubMed · Cited by 3 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 3
- [6]Smith M Saunders R Stuckhardt L McGinnis JM Best Care at Lower Cost: The Path to Continuously Learning Health Care in America 2012 Washington, DC National Academies Press 24901184
- [30]Roebuck C The importance of knowing context of hospital episode statistics when reconfiguring the NHS British Medical Journal 2012 Rapid Response. http://www.bmj.com/content/344/bmj.e2432/rr/578977 22491714
- [55]Bernstam EV Herskovic JR Reeder P Meric-Bernstam F Oncology research using electronic medical record data Journal of Clinical Oncology 2010 28 suppl e16501 abstr http://www.asco.org/ascov2/Meetings/Abstracts?&vmview=abst_detail_view&confID=74&abstractID=42963
Cited by
Sorted by citations
Rajkomar, A., Dean, J., & Kohane, I. (2019) · New England Journal of Medicine · doi:10.1056/nejmra1814259 · Cited by 4,579 · see citing works
Key challenges for delivering clinical impact with artificial intelligence
Kelly, C. J., Karthikesalingam, A., Suleyman, M., Corrado, G., & King, D. (2019) · BMC Medicine · doi:10.1186/s12916-019-1426-2 · Cited by 3,136 · see citing works
Ahmed, Z., Mohamed, K., Zeeshan, S., & Dong, X. (2020) · Database · doi:10.1093/database/baaa010 · Cited by 1,035 · see citing works
Goldstein, B. A., Navar, A. M., Pencina, M. J., & Ioannidis, J. P. A. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw042 · Cited by 936 · see citing works
Automated machine learning: Review of the state-of-the-art and opportunities for healthcare
Waring, J., Lindvall, C., & Umeton, R. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101822 · Cited by 834 · see citing works
Electronic health records to facilitate clinical research
Cowie, M. R., Blomster, J. I., Curtis, L. H., Duclaux, S., Ford, I., Fritz, F., Goldman, S., Janmohamed, S., Kreuzer, J., Leenay, M., et al. (2017) · Clinical Research in Cardiology · doi:10.1007/s00392-016-1025-6 · Cited by 651 · see citing works
Harnessing multimodal data integration to advance precision oncology
Boehm, K. M., Khosravi, P., Vanguri, R., Gao, J., & Shah, S. P. (2022) · Nature Reviews Cancer · doi:10.1038/s41568-021-00408-3 · Cited by 662 · see citing works
Launching PCORnet, a national patient-centered clinical research network
Fleurence, R., Curtis, L. H., Califf, R. M., Platt, R., Selby, J. V., & Brown, J. S. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2014-002747 · Cited by 637 · see citing works
Kahn, M. G., Callahan, T. J., Barnard, J., Bauck, A. E., Brown, J., Davidson, B. N., Estiri, H., Goerg, C., Holve, E., Johnson, S. G., et al. (2016) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.13063/2327-9214.1244 · Cited by 636 · see citing works
The National COVID Cohort Collaborative (N3C): Rationale, design, infrastructure, and deployment
Haendel, M. A., Chute, C. G., Bennett, T. D., Eichmann, D. A., Guinney, J., Kibbe, W. A., Payne, P. R. O., Pfaff, E. R., Robinson, P. N., Saltz, J. H., et al. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa196 · Cited by 553 · see citing works
Self-citationBig Data and Large Sample Size: A Cautionary Note on the Potential for Bias
Kaplan, R. M., Chambers, D., & Glasgow, R. E. (2014) · Clinical and Translational Science · doi:10.1111/cts.12178 · Cited by 416 · see citing works
Personalized Medicine and the Power of Electronic Health Records
Abul-Husn, N. S., & Kenny, E. E. (2019) · Cell · doi:10.1016/j.cell.2019.02.039 · Cited by 355 · see citing works
Wei, W., Bastarache, L. A., Carroll, R. J., Marlo, J. E., Osterman, T. J., Gamazon, E. R., Cox, N. J., Roden, D. M., & Denny, J. C. (2017) · PLoS ONE · doi:10.1371/journal.pone.0175508 · Cited by 380 · see citing works
Real-world Data for Clinical Evidence Generation in Oncology
Khozin, S., Blumenthal, G. M., & Pazdur, R. (2017) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djx187 · Cited by 346 · see citing works
Natural Language Processing in Oncology: A Review
Yim, W.-W., Yetisgen, M., Harris, W. P., & Kwan, S. W. (2016) · JAMA Oncology · doi:10.1001/jamaoncol.2016.0213 · Cited by 298 · see citing works
Possible Sources of Bias in Primary Care Electronic Health Record Data Use and Reuse
Verheij, R. A., Ćurčin, V., Delaney, B. C., & McGilchrist, M. M. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9134 · Cited by 293 · see citing works
Chakraborty, C., Bhattacharya, M., Pal, S., & Lee, S. (2023) · Current Research in Biotechnology · doi:10.1016/j.crbiot.2023.100164 · Cited by 295 · see citing works
Beckmann, J. S., & Lew, D. (2016) · Genome Medicine · doi:10.1186/s13073-016-0388-7 · Cited by 260 · see citing works
Extracting research-quality phenotypes from electronic health records to support precision medicine
Wei, W., & Denny, J. C. (2015) · Genome Medicine · doi:10.1186/s13073-015-0166-y · Cited by 243 · see citing works
Steele, A. J., Cakiroglu, S. A., Shah, A. D., Denaxas, S., Hemingway, H., & Luscombe, N. M. (2018) · PLoS ONE · doi:10.1371/journal.pone.0202344 · Cited by 241 · see citing works
Fundamentals of Clinical Data Science
Kubben, P., Dumontier, M., & Dekker, A. L. A. J. (2018) · Springer eBooks · doi:10.1007/978-3-319-99713-1 · Cited by 240 · see citing works
Bernert, R. A., Hilberg, A. M., Melia, R., Kim, J. P., Shah, N. H., & Abnousi, F. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17165929 · Cited by 225 · see citing works
Corey, K. M., Kashyap, S., Lorenzi, E., Lagoo-Deenadayalan, S. A., Heller, K., Whalen, K., Balu, S., Heflin, M. T., McDonald, S. R., Swaminathan, M., et al. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002701 · Cited by 204 · see citing works
Clinical Data Reuse or Secondary Use: Current Status and Potential Future Progress
Meystre, S. M., Lovis, C., Bürkle, T., Tognola, G., Budrionis, A., & Lehmann, C. U. (2017) · Yearbook of Medical Informatics · doi:10.15265/iy-2017-007 · Cited by 204 · see citing works
Will Generative Artificial Intelligence Deliver on Its Promise in Health Care?
Wachter, R. M., & Brynjolfsson, E. (2023) · JAMA · doi:10.1001/jama.2023.25054 · Cited by 190 · see citing works
Goldstein, B. A., Bhavsar, N. A., Phelan, M., & Pencina, M. J. (2016) · American Journal of Epidemiology · doi:10.1093/aje/kww112 · Cited by 176 · see citing works
Machine Learning in Healthcare
Callahan, A., & Shah, N. H. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809523-2.00019-4 · Cited by 178 · see citing works
Use of Latent Class Analysis and k-Means Clustering to Identify Complex Patient Profiles
Grant, R. W., McCloskey, J. K., Hatfield, M. K., Uratsu, C. S., Ralston, J. D., Bayliss, E. A., & Kennedy, C. J. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.29068 · Cited by 173 · see citing works
Bias in pharmacoepidemiologic studies using secondary health care databases: a scoping review
Prada-Ramallal, G., Takkouche, B., & Figueiras, A. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0695-y · Cited by 161 · see citing works
A Data Quality Assessment Guideline for Electronic Health Record Data Reuse
Weiskopf, N. G., Bakken, S., Hripcsak, G., & Weng, C. (2017) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.5334/egems.218 · Cited by 152 · see citing works
Self-citationvan de Sande, D., Van Genderen, M. E., Smit, J. M., Huiskens, J., Visser, J. J., Veen, R. E. R., van Unen, E., BA, O. H., Gommers, D., & Bommel, J. V. (2022) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2021-100495 · Cited by 135 · see citing works
Rusanov, A., Weiskopf, N. G., Wang, S., & Weng, C. (2014) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-14-51 · Cited by 137 · see citing works
Challenges in and Opportunities for Electronic Health Record-Based Data Analysis and Interpretation
Kim, M. K., Rouphael, C., McMichael, J. P., Welch, N., & Dasarathy, S. (2023) · Gut and Liver · doi:10.5009/gnl230272 · Cited by 133 · see citing works
Transparent Reporting of Data Quality in Distributed Data Networks
Kahn, M. G., Brown, J. S., Chun, A. T., Davidson, B. N., Meeker, D., Ryan, P. B., Schilling, L. M., Weiskopf, N. G., Williams, A. E., & Zozus, M. N. (2015) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.13063/2327-9214.1052 · Cited by 126 · see citing works
Haneuse, S., & Daniels, M. J. (2016) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.13063/2327-9214.1203 · Cited by 118 · see citing works
Using Electronic Health Records To Generate Phenotypes For Research
Pendergrass, S. A., & Crawford, D. C. (2019) · Current Protocols in Human Genetics · doi:10.1002/cphg.80 · Cited by 120 · see citing works
Kohane, I. S., Aronow, B. J., Avillach, P., Beaulieu-Jones, B. K., Bellazzi, R., Bradford, R. L., Brat, G. A., Cannataro, M., Cimino, J. J., García-Barrio, N., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/22219 · Cited by 113 · see citing works
Self-citationRodríguez, F., Chung, S., Blum, M. R., Coulet, A., Basu, S., & Palaniappan, L. P. (2019) · Journal of the American Heart Association · doi:10.1161/jaha.118.011874 · Cited by 107 · see citing works
Population segmentation based on healthcare needs: a systematic review
Chong, J. L., Lim, K. K., & Matchar, D. B. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1105-6 · Cited by 106 · see citing works
Employing Computers for the Recruitment into Clinical Trials: A Comprehensive Systematic Review
Köpcke, F., & Prokosch, H. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3446 · Cited by 104 · see citing works
Sick patients have more data: the non-random completeness of electronic health records.
Weiskopf, N. G., Rusanov, A., & Weng, C. (2013) · Europe PMC (PubMed Central) · Cited by 99 · see citing works
Giannoula, A., Gutiérrez‐Sacristán, A., Bravo, Á., Sanz, F., & Furlong, L. I. (2018) · Scientific Reports · doi:10.1038/s41598-018-22578-1 · Cited by 98 · see citing works
Biases introduced by filtering electronic health records for patients with “complete data.”
Weber, G. M., Adams, W. G., Bernstam, E. V., Bickel, J. P., Fox, K. P., Marsolo, K., Raghavan, V. A., Turchin, A., Zhou, X., Murphy, S. N., et al. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx071 · Cited by 93 · see citing works
Self-citationAnderson, A., Kerr, W. T., Thames, A. D., Li, T., Xiao, J., & Cohen, M. S. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.12.006 · Cited by 94 · see citing works
Phelan, M., Bhavsar, N. A., & Goldstein, B. A. (2017) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.5334/egems.243 · Cited by 95 · see citing works
Tackling COVID-19 Through Responsible AI Innovation: Five Steps in the Right Direction
Leslie, D. (2020) · Harvard Data Science Review · doi:10.1162/99608f92.4bb9d7a7 · Cited by 95 · see citing works
Development and validation of early warning score system: A systematic literature review
Fu, L.-H., Schwartz, J., Moy, A., Knaplund, C., Kang, M.-J., Schnock, K. O., Garcia, J. P., Jia, H., Dykes, P. C., Cato, K., et al. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103410 · Cited by 102 · see citing works
Hersh, W., Gorman, P., Biagioli, F. E., Mohan, V., Gold, J. A., & Mejicano, G. C. (2014) · Advances in Medical Education and Practice · doi:10.2147/amep.s63903 · Cited by 92 · see citing works
Self-citationIdentifying and mitigating biases in EHR laboratory tests
Pivovarov, R., Albers, D. J., Sepulveda, J. L., & Elhadad, N. (2014) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.03.016 · Cited by 91 · see citing works
Using electronic health records for clinical trials: Where do we stand and where can we go?
Cord, K. A. M., & Hemkens, L. G. (2019) · Canadian Medical Association Journal · doi:10.1503/cmaj.180841 · Cited by 88 · see citing works
Harnessing EHR data for health research
Tang, A. S., Woldemariam, S. R., Miramontes, S., Norgeot, B., Oskotsky, T. T., & Sirota, M. (2024) · Nature Medicine · doi:10.1038/s41591-024-03074-8 · Cited by 87 · see citing works
Big data are coming to psychiatry: a general introduction
Monteith, S., Glenn, T., Geddes, J. R., & Bauer, M. (2015) · International Journal of Bipolar Disorders · doi:10.1186/s40345-015-0038-9 · Cited by 93 · see citing works
Madhavan, S., Bastarache, L. A., Brown, J. S., Butte, A. J., Dorr, D. A., Embí, P. J., Friedman, C. P., Johnson, K. B., Moore, J. H., Kohane, I. S., et al. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa287 · Cited by 87 · see citing works
Self-citationData quality assessment framework to assess electronic medical record data for use in research
Reimer, A. P., Milinovich, A., & Madigan, E. A. (2016) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2016.03.006 · Cited by 86 · see citing works
Big Healthcare Data Analytics: Challenges and Applications
Lee, C., Luo, Z., Ngiam, K. Y., Zhang, M., Zheng, K., Chen, G., Ooi, B. C., & Yip, W. L. J. (2017) · Scalable computing and communications · doi:10.1007/978-3-319-58280-1_2 · Cited by 83 · see citing works
Schulz, S., Stegwee, R., & Chronaki, C. (2019) · Fundamentals of Clinical Data Science · doi:10.1007/978-3-319-99713-1_3 · Cited by 86 · see citing works
Harrison, C. M., Henderson, J., Miller, G. C., & Britt, H. C. (2017) · PLoS ONE · doi:10.1371/journal.pone.0172935 · Cited by 83 · see citing works
Bower, J. K., Patel, S., Rudy, J. E., & Felix, A. S. (2017) · Current Epidemiology Reports · doi:10.1007/s40471-017-0130-z · Cited by 84 · see citing works
A longitudinal analysis of data quality in a large pediatric data research network
Khare, R., Utidjian, L., Ruth, B. J., Kahn, M. G., Burrows, E. K., Marsolo, K. A., Patibandla, N., Razzaghi, H., Colvin, R., Ranade, D., et al. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx033 · Cited by 81 · see citing works
Advancing Symptom Science Through Use of Common Data Elements
Redeker, N. S., Anderson, R. A., Henry, S. B., Corwin, E. J., Docherty, S. L., Dorsey, S. G., Heitkemper, M. M., McCloskey, D. J., Moore, S. M., Pullen, C. H., et al. (2015) · Journal of Nursing Scholarship · doi:10.1111/jnu.12155 · Cited by 81 · see citing works
Hernandez‐Boussard, T., Monda, K. L., Crespo, B. C., & Riskin, D. J. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz119 · Cited by 80 · see citing works
Bishop, L., Movaghar, A., Greenberg, J. S., Page, D., DaWalt, L. S., Brilliant, M. H., & Seltzer, M. M. (2018) · Autism Research · doi:10.1002/aur.1960 · Cited by 78 · see citing works
Cox, J., Edsberg, L. E., Koloms, K., & VanGilder, C. A. (2022) · PubMed Central · doi:10.1097/won.0000000000000834 · Cited by 14 · see citing works
The Georges Pompidou University Hospital Clinical Data Warehouse: A 8-years follow-up experience
Jannot, A., Zapletal, É., Avillach, P., Mamzer, M., Burgun, A., & Patrice Degoulet, A. (2017) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2017.02.006 · Cited by 76 · see citing works
Modern Clinical Text Mining: A Guide and Review
Percha, B. (2021) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-030421-030931 · Cited by 76 · see citing works
Machine Learning for Endometrial Cancer Prediction and Prognostication
Bhardwaj, V., Sharma, A., Snijesh, V. P., Gul, I., Zhang, X., Lobie, P. E., Qin, P., & Pandey, V. (2022) · Frontiers in Oncology · doi:10.3389/fonc.2022.852746 · Cited by 77 · see citing works
Identifying Risk Factors for Pressure Injury in Adult Critical Care Patients
Cox, J., Schallom, M. E., & Jung, C. (2020) · American Journal of Critical Care · doi:10.4037/ajcc2020243 · Cited by 75 · see citing works
Pragmatic Precision Psychiatry—A New Direction for Optimizing Treatment Selection
Kessler, R. C., & Luedtke, A. R. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2021.2500 · Cited by 74 · see citing works
Machine Learning for Predicting Readmission Risk Among the Frail - Explainable AI for Healthcare
Mohanty, S. D., Lekan, D. A., McCoy, T. P., Jenkins, M., & Manda, P. (2021) · Patterns · doi:10.1016/j.patter.2021.100395 · Cited by 70 · see citing works
Estimates of SARS-CoV-2 Omicron BA.2 Subvariant Severity in New England
Strasser, Z. H., Greifer, N., Hadavand, A., Murphy, S. N., & Estiri, H. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.38354 · Cited by 67 · see citing works
Cohen, B., Vawdrey, D. K., Liu, J., Caplan, D. W., Furuya, E. Y., Mis, F. W., & Larson, E. (2015) · Policy Politics & Nursing Practice · doi:10.1177/1527154415603358 · Cited by 68 · see citing works
Tu, K., Widdifield, J., Young, J., Oud, W., Ivers, N. M., Butt, D. A., Leaver, C. A., & Jaakkimainen, L. (2015) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-015-0195-x · Cited by 66 · see citing works
Secondary Use and Analysis of Big Data Collected for Patient Care
Martin-Sanchez, F. J., Aguiar‐Pulido, V., López–Campos, G., Peek, N. B., & Sacchi, L. (2017) · Yearbook of Medical Informatics · doi:10.15265/iy-2017-008 · Cited by 67 · see citing works
Bozkurt, S., Cahan, E. M., Seneviratne, M. G., Sun, R., Lossio-Ventura, J. A., Ioannidis, J. P. A., & Hernandez‐Boussard, T. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa164 · Cited by 65 · see citing works
Efficacy of COVID-19 vaccines in patients taking immunosuppressants
Shen, C., Risk, M., Schiopu, E., Hayek, S. S., Xie, T., Holevinski, L., Akin, C., Freed, G. L., & Zhao, L. (2022) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2021-222045 · Cited by 65 · see citing works
The impact of routine data quality assessments on electronic medical record data quality in Kenya
Muthee, V., Bochner, A. F., Osterman, A., Liku, N., Akhwale, W., Kwach, J., Prachi, M., Wamicwe, J., Odhiambo, J., Onyango, F., et al. (2018) · PLOS ONE · doi:10.1371/journal.pone.0195362 · Cited by 64 · see citing works
Big Data in Head and Neck Cancer
Resteghini, C., Trama, A., Borgonovi, E., Hosni, H., Corrao, G., Orlandi, E. M., Calareso, G., Cecco, L. D., Piazza, C., Mainardi, L. T., et al. (2018) · Current Treatment Options in Oncology · doi:10.1007/s11864-018-0585-2 · Cited by 62 · see citing works
Daniel Capurro, N., Yetişgen, M., Eaton, E. G. V., Black, R. S., & Tarczy-Hornoch, P. Z. (2014) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.13063/2327-9214.1079 · Cited by 62 · see citing works
Application of an Ontology for Characterizing Data Quality for a Secondary Use of EHR Data
Speedie, S. M., Simon, G., Kumar, V., Westra, B. L., & Johnson, S. (2016) · Applied Clinical Informatics · doi:10.4338/aci-2015-08-ra-0107 · Cited by 63 · see citing works
Ilan, Y. (2020) · Frontiers in Digital Health · doi:10.3389/fdgth.2020.569178 · Cited by 63 · see citing works
Electronic Health Records and Quality of Care
Yanamadala, S., Morrison, D. E., Curtin, C. M., McDonald, K. M., & Hernandez‐Boussard, T. (2016) · Medicine · doi:10.1097/md.0000000000003332 · Cited by 62 · see citing works
Harvey, R. A., Hayden, J., Kamble, P., Bouchard, J. R., & Huang, J. (2016) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.4121 · Cited by 62 · see citing works
Davies, S. J. D., Grundmeier, R. W., Campos, D., Hayes, K. L., Bell, J., Alessandrini, E. A., Bajaj, L., Chamberlain, J., Gorelick, M. H., Enríquez, R., et al. (2018) · Applied Clinical Informatics · doi:10.1055/s-0038-1651496 · Cited by 61 · see citing works
Hersh, W., Cimino, J. J., Payne, P., Embí, P. J., Logan, J. R., Weiner, M. G., Bernstam, E. V., Lehmann, H. P., Hripcsak, G. M., Hartzog, T. H., et al. (2013) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.13063/2327-9214.1018 · Cited by 61 · see citing works
Self-citationCortés, A., Dendrou, C. A., Motyer, A., Jostins, L., Vukcevic, D., Dilthey, A., Donnelly, P., Leslie, S., Fugger, L. H., & McVean, G. (2017) · Nature Genetics · doi:10.1038/ng.3926 · Cited by 56 · see citing works
Validity of Cardiovascular Data From Electronic Sources
Ahmad, F. S., Chan, C., Rosenman, M. B., Post, W. S., Fort, D. G., Greenland, P., Liu, K., Kho, A., & Allen, N. B. (2017) · Circulation · doi:10.1161/circulationaha.117.027436 · Cited by 60 · see citing works
Kurian, A. W., Mitani, A., Desai, M., Yu, P. P., Seto, T., Weber, S., Olson, C., Kenkare, P., Gomez, S. L., de Bruin, M. A., et al. (2013) · Cancer · doi:10.1002/cncr.28395 · Cited by 59 · see citing works
Clinical Research Informatics and Electronic Health Record Data
Horvath, M. M., Rusincovitch, S. A., & Richesson, R. (2014) · Yearbook of Medical Informatics · doi:10.15265/iy-2014-0009 · Cited by 57 · see citing works
Electronic Health Records and Community Health Surveillance of Childhood Obesity
Flood, T. L., Zhao, Y., Tomayko, E. J., Tandias, A., Carrel, A. L., & Hanrahan, L. P. (2015) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2014.10.020 · Cited by 57 · see citing works
Developing real‐world evidence from real‐world data: Transforming raw data into analytical datasets
Bastarache, L. A., Brown, J. S., Cimino, J. J., Dorr, D. A., Embí, P. J., Payne, P., Wilcox, A. B., & Weiner, M. G. (2021) · Learning Health Systems · doi:10.1002/lrh2.10293 · Cited by 58 · see citing works
Self-citationA Review of Automatic Phenotyping Approaches using Electronic Health Records
Alzoubi, H., Alzubi, R., Ramzan, N., West, D., Al-Hadhrami, T., & Alazab, M. (2019) · Electronics · doi:10.3390/electronics8111235 · Cited by 56 · see citing works
Expectations for Artificial Intelligence (AI) in Psychiatry
Monteith, S., Glenn, T., Geddes, J. R., Whybrow, P. C., Achtyes, E. D., & Bauer, M. (2022) · Current Psychiatry Reports · doi:10.1007/s11920-022-01378-5 · Cited by 56 · see citing works
Implications of non-stationarity on predictive modeling using EHRs
Jung, K., & Shah, N. H. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.10.006 · Cited by 55 · see citing works
Adie, Y., Kats, D. J., Tlimat, A., Perzynski, A. T., Dalton, J. E., Gunzler, D. D., & Tarabichi, Y. (2019) · CHEST Journal · doi:10.1016/j.chest.2019.11.033 · Cited by 54 · see citing works
Monteith, S., Glenn, T., Geddes, J. R., Whybrow, P. C., & Bauer, M. (2016) · International Journal of Bipolar Disorders · doi:10.1186/s40345-016-0051-7 · Cited by 50 · see citing works
Informatics and machine learning to define the phenotype
Basile, A. O., & Ritchie, M. D. (2018) · Expert Review of Molecular Diagnostics · doi:10.1080/14737159.2018.1439380 · Cited by 51 · see citing works
Leveraging electronic health records for clinical research
Raman, S. R., Curtis, L. H., Temple, R., Andersson, T., Ezekowitz, J. A., Ford, I., James, S. K., Marsolo, K. A., Mirhaji, P., Rocca, M., et al. (2018) · American Heart Journal · doi:10.1016/j.ahj.2018.04.015 · Cited by 51 · see citing works
Predictive modeling in urgent care: a comparative study of machine learning approaches
Tang, F., Xiao, C., Wang, F., & Zhou, J. (2018) · JAMIA Open · doi:10.1093/jamiaopen/ooy011 · Cited by 48 · see citing works
Deep Learning for Electronic Health Records Analytics
Harerimana, G., Kim, J. W., Yoo, H., & Jang, B. (2019) · IEEE Access · doi:10.1109/access.2019.2928363 · Cited by 50 · see citing works
Gallego, B., Walter, S. R., Day, R. O., Dunn, A. G., Sivaraman, V., Shah, N. H., Longhurst, C., & Coiera, E. W. (2015) · Journal of Comparative Effectiveness Research · doi:10.2217/cer.15.12 · Cited by 49 · see citing works
- Authors
- Hersh, W. R., Weiner, M. G., Embi, P. J., Logan, J. R., Payne, P. R. O., Bernstam, E. V., Lehmann, H. P., Hripcsak, G., Hartzog, T. H., Cimino, J. J., & Saltz, J. H.
- Affiliations
- Oregon Health & Science University (US)
- AstraZeneca (United Kingdom) (GB)
- The Ohio State University Wexner Medical Center (US)
- The University of Texas Health Science Center at Houston (US)
- Johns Hopkins University (US)
- Columbia University (US)
- Medical University of South Carolina (US)
- National Institutes of Health (US)
- Emory University (US)
- Corresponding author
- Hersh, William R.
- Logan, Judith R.
- Cimino, James J.
- ORCID
- Venue
- Medical Care
- Published
- 2013-08
- Volume
- 51
- Issue
- Supplement 8Suppl 3
- Pages
- S30-S37
- ISSN
- 0025-7079 (ISSN-L)
- PMC
- PMC3748381
- OpenAlex
- W2137767404
- Cited by
- 567
- References
- 68
- Citations by year
- 2026: 43 · 2025: 44 · 2024: 30 · 2023: 43 · 2022: 43 · 2021: 58 · 2020: 50 · 2019: 59 · 2018: 50 · 2017: 45 · 2016: 45 · 2015: 27 · 2014: 24 · 2013: 6
- FWCI
- 58.67
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Medical Care (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (UL1TR000454, UL1TR000090)
- Centers for Disease Control and Prevention
- National Center for Research Resources (UL1RR025008, UL1RR024156, UL1RR025005, UL1RR024148, UL1RR024140)
- National Center for Advancing Translational Sciences
- H2020 European Research Council
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- electronic health records, comparative effectiveness research, data quality, data completeness, data provenance, data granularity, data reuse
- MeSH terms
- Data Collection, Data Interpretation, Statistical, Humans, Insurance Claim Review, Research Design, Comparative Effectiveness Research, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
