Challenges and Opportunities for Using Big Health Care Data to Advance Medical Science and Public Health
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Methodological advancements in epidemiology, biostatistics, and data science have strengthened the research world's ability to use data captured from electronic health records (EHRs) to address pressing medical questions, but gaps remain. We describe methods investments that are needed to curate EHR data toward research quality and to integrate complementary data sources when EHR data alone are insufficient for research goals. We highlight new methods and directions for improving the integrity of medical evidence generated from pragmatic trials, observational studies, and predictive modeling. We also discuss needed methods contributions to further ease data sharing across multisite EHR data networks. Throughout, we identify opportunities for training and for bolstering collaboration among subject matter experts, methodologists, practicing clinicians, and health system leaders to help ensure that methods problems are identified and resulting advances are translated into mainstream research practice more quickly.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Austin, P. C. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.568786 · Cited by 12,242
k-ANONYMITY: A MODEL FOR PROTECTING PRIVACY
SWEENEY, L. (2002) · International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems · doi:10.1142/s0218488502001648 · Cited by 8,571
Marginal Structural Models and Causal Inference in Epidemiology
Robins, J. M., Hernán, M. Á., & Brumback, B. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00011 · Cited by 5,581
Austin, P. C. (2011) · Pharmaceutical Statistics · doi:10.1002/pst.433 · Cited by 3,949
Reducing Bias in Observational Studies Using Subclassification on the Propensity Score
Rosenbaum, P. R., & Rubin, D. B. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478078 · Cited by 3,082
Robins, J. (1986) · Mathematical Modelling · doi:10.1016/0270-0255(86)90088-6 · Cited by 2,451
Doubly robust estimation in missing data and causal inference models
Bang, H., & Robins, J. M. (2005) · Biometrics · doi:10.1111/j.1541-0420.2005.00377.x · Cited by 1,998
Tunis (2003) · doi:10.1001/jama.290.12.1624 · Cited by 1,724
Larson, E. B., Wang, L., Bowen, J. D., McCormick, W. C., Teri, L., Crane, P., & Kukull, W. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-2-200601170-00004 · Cited by 1,463
How to increase value and reduce waste when research priorities are set
Chalmers, I., Bracken, M. B., Djulbegovic, B., Garattini, S., Grant, J., Gülmezoglu, A. M., Howells, D. W., Ioannidis, J. P. A., & Oliver, S. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62229-1 · Cited by 1,436
A pragmatic–explanatory continuum indicator summary (PRECIS): a tool to help trial designers
Thorpe, K. E., Zwarenstein, M., Oxman, A. D., Treweek, S., Furberg, C. D., Altman, D. G., Tunis, S., Bergel, E., Harvey, I., Magid, D. J., et al. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.12.011 · Cited by 1,389
McCaffrey, D. F., Ridgeway, G., & Morral, A. R. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.403 · Cited by 1,317
Weiskopf, N. G., & Weng, C. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000681 · Cited by 1,216
Cumulative Use of Strong Anticholinergics and Incident Dementia: A Prospective Cohort Study
Gray, S. L., Anderson, M. L., Dublin, S., Hanlon, J. T., Hubbard, R., Walker, R., Yu, O., Crane, P. K., & Larson, E. B. (2015) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2014.7663 · Cited by 1,111
The Propensity Score with Continuous Treatments
Hirano, K., & Imbens, G. W. (2004) · Wiley Series in Probability and Statistics · doi:10.1002/0470090456.ch7 · Cited by 1,064
Glucose Levels and Risk of Dementia
Crane, P. K., Walker, R., Hubbard, R. A., Li, G., Nathan, D. M., Zheng, H., Haneuse, S., Craft, S., Montine, T. J., Kahn, S. E., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1215740 · Cited by 929
A pragmatic view on pragmatic trials
Patsopoulos, N. A. (2011) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2011.13.2/npatsopoulos · Cited by 844
A review of the healthy worker effect in occupational epidemiology
Li, C.-Y., & Sung, F.-C. (1999) · Occupational Medicine · doi:10.1093/occmed/49.4.225 · Cited by 829
Dementia and Alzheimer Disease Incidence: A Prospective Cohort Study
Kukull, W. A., Higdon, R., Bowen, J. D., McCormick, W. C., Teri, L., Schellenberg, G. D., van Belle, G., Jolley, L., & Larson, E. B. (2002) · Archives of Neurology · doi:10.1001/archneur.59.11.1737 · Cited by 806
Nichol, K. L., Nordin, J., Mullooly, J., Lask, R., Fillbrandt, K., & Iwane, M. (2003) · New England Journal of Medicine · doi:10.1056/nejmoa025028 · Cited by 752
This Looks Like That: Deep Learning for Interpretable Image Recognition
Chen, C., Li, O., Tao, C., Barnett, A. J., Su, J., & Rudin, C. (2018) · arXiv · doi:10.48550/arxiv.1806.10574 · Cited by 702
Design and analysis of group-randomized trials: a review of recent methodological developments
Murray, D. M., Varnell, S. P., & Blitstein, J. L. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.423 · Cited by 677
A targeted real-time early warning score (TREWScore) for septic shock.
Henry, K. E., Hager, D. N., Pronovost, P. J., & Saria, S. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aab3719 · Cited by 598
Using electronic health records for population health research: a review of methods and applications
Casey, J. A., Schwartz, B. S., Stewart, W. F., & Adler, N. E. (2016) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-032315-021353 · Cited by 590
Simon, G. E., Rutter, C. M., Peterson, D., Oliver, M., Whiteside, U., Operskalski, B., & Ludman, E. J. (2013) · Psychiatric Services · doi:10.1176/appi.ps.201200587 · Cited by 575
Causal Inference from Complex Longitudinal Data
Robins, J. M. (1997) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-1842-5_4 · Cited by 510
A Systematic Review of Re-Identification Attacks on Health Data
El Emam, K., Jonker, E., Arbuckle, L., & Malin, B. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028071 · Cited by 427
Simon, G. E., Johnson, E., Lawrence, J. M., Rossom, R. C., Ahmedani, B., Lynch, F. L., Beck, A., Waitzfelder, B., Ziebell, R., Penfold, R. B., et al. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.17101167 · Cited by 400
Self-citationPredicting suicidal behavior from longitudinal electronic health records.
Barak-Corren, Y., Castro, V. M., Javitt, S., Hoffnagle, A. G., Dai, Y., Perlis, R. H., Nock, M. K., Smoller, J. W., & Reis, B. Y. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.16010077 · Cited by 339
Kessler, R. C., Hwang, I., Hoffmire, C. A., McCarthy, J. F., Petukhova, M. V., Rosellini, A. J., Sampson, N. A., Schneider, A. L., Bradley, P. A., Katz, I. R., et al. (2017) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1575 · Cited by 209
Orellana, L., Rotnitzky, A., & Robins, J. M. (2010) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1200 · Cited by 202
Improving propensity score estimators’ robustness to model misspecification using super learner.
Pirracchio, R., Petersen, M. L., & van der Laan, M. (2015) · American Journal of Epidemiology · doi:10.1093/aje/kwu253 · Cited by 186
Bias in identifying and recruiting participants in cluster randomised trials: what can be done?
Eldridge, S., Kerry, S., & Torgerson, D. J. (2009) · BMJ · doi:10.1136/bmj.b4006 · Cited by 159
Toward Reuse of Clinical Data for Research and Quality Improvement: The End of the Beginning?
Weiner, M. G., & Embi, P. J. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-5-200909010-00141 · Cited by 129
Orellana, L., Rotnitzky, A., & Robins, J. M. (2010) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1242 · Cited by 53
Cited by
Henry, K. E., Kornfield, R., Sridharan, A., Linton, R. C., Groh, C., Wang, T., Wu, A., Mutlu, B., & Saria, S. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00597-7 · Cited by 207
Data Integration Challenges for Machine Learning in Precision Medicine
Martínez-García, M., & Hernández-Lemus, E. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2021.784455 · Cited by 185
Lindberg, D. S., Prosperi, M., Bjarnadottir, R. I., Thomas, J., Crane, M., Chen, Z., Shear, K., Solberg, L. M., Snigurska, U. A., Wu, Y., et al. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104272 · Cited by 95
Metadata
- Authors
- Shortreed, S. M., Cook, A. J., Coley, R. Y., Bobb, J. F., & Nelson, J. C.
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2019-03-16
- Volume
- 188
- Issue
- 5
- Pages
- 851-861
- ISSN
- 0002-9262 (ISSN-L)
- 1476-6256
- OpenAlex
- W2922251226
- Cited by
- 67
- References
- 35
- FWCI
- 8.97
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.