The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Artificial intelligence approaches using natural language processing to advance EHR-based clinical research
Open accessAbstract
The wide adoption of electronic health record systems (EHRs) in health care generates big real-world data that opens new venues to conduct clinical research. As a large amount of valuable clinical information is locked in clinical narratives, natural language processing (NLP) techniques as an artificial intelligence approach have been leveraged to extract information from clinical narratives in EHRs. This capability of NLP potentially enables automated chart review for identifying patients with distinctive clinical characteristics in clinical care and reduces methodological heterogeneity in defining phenotype obscuring biological heterogeneity in research concerning allergy, asthma, and immunology. This brief review discusses the current literature on the secondary use of EHR data for clinical research concerning allergy, asthma, and immunology and highlights the potential, challenges, and implications of NLP techniques.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 1×
“While NLP is not free from systematic biases from EHRs (52, 53), it may help us to identify algorithmic biases stemming from systematic biases of EHRs.”
BackgroundNatural language processing: an introduction
Nadkarni, P. M., Ohno-Machado, L., & Chapman, W. W. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000464 · Cited by 1,975
Attia, Z. I., Kapa, S., Lopez-Jimenez, F., McKie, P. M., Ladewig, D. J., Satam, G., Pellikka, P. A., Enriquez-Sarano, M., Noseworthy, P. A., Munger, T. M., et al. (2019) · Nature Medicine · doi:10.1038/s41591-018-0240-2 · Cited by 1,389
Clinical decision support in the era of artificial intelligence
Shortliffe, E. H., & Sepúlveda, M. J. (2018) · JAMA · doi:10.1001/jama.2018.17163 · Cited by 920 · cited 1×
“(14) Dr. Edward Shortliffe recently provided useful guidance for the-must-have-features of an informatics tool if it is to be accepted and integrated into routine workflow(54): 1.”
BackgroundClinical information extraction applications: A literature review
Wang, Y., Wang, L., Rastegar-Mojarad, M., Moon, S., Shen, F., Afzal, N., Liu, S., Zeng, Y., Mehrabi, S., Sohn, S., et al. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.11.011 · Cited by 910
Self-citationEvaluation and accurate diagnoses of pediatric diseases using artificial intelligence
Liang, H., Tsui, B. Y., Ni, H., Valentim, C. C. S., Baxter, S. L., Liu, G., Cai, W., Kermany, D. S., Sun, X., Chen, J., et al. (2019) · Nature Medicine · doi:10.1038/s41591-018-0335-9 · Cited by 659
Launching PCORnet, a national patient-centered clinical research network
Fleurence, R. L., Curtis, L. H., Califf, R. M., Platt, R., Selby, J. V., & Brown, J. S. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2014-002747 · Cited by 637
Physician stress and burnout: the impact of health information technology
Gardner, R. L., Cooper, E., Haskell, J., Harris, D. A., Poplau, S., Kroth, P. J., & Linzer, M. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy145 · Cited by 566
A review of approaches to identifying patient phenotype cohorts using electronic health records
Shivade, C., Raghavan, P., Fosler-Lussier, E., Embi, P. J., Elhadad, N., Johnson, S. B., & Lai, A. M. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-001935 · Cited by 531
Artificial intelligence outperforms pulmonologists in the interpretation of pulmonary function tests
Topalovic, M., Das, N., Burgel, P.-R., Daenen, M., Derom, E., Haenebalcke, C., Janssen, R., Kerstjens, H. A. M., Liistro, G., Louis, R., et al. (2019) · European Respiratory Journal · doi:10.1183/13993003.01660-2018 · Cited by 238
Big Data in Medicine Is Driving Big Changes
Verspoor, K., & Martin-Sanchez, F. (2014) · Yearbook of Medical Informatics · doi:10.15265/iy-2014-0020 · Cited by 194
Jarow, J. P., LaVange, L., & Woodcock, J. (2017) · JAMA · doi:10.1001/jama.2017.9991 · Cited by 185
Friedman, C., Rindflesch, T. C., & Corn, M. (2013) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2013.06.004 · Cited by 154
Potential Application of Machine Learning in Health Outcomes Research and Some Statistical Cautions
Crown, W. H. (2015) · Value in Health · doi:10.1016/j.jval.2014.12.005 · Cited by 125
Automated misspelling detection and correction in clinical free-text records
Lai, K. H., Topaz, M., Goss, F. R., & Zhou, L. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.04.008 · Cited by 120
Kimia, A. A., Savova, G., Landschaft, A., & Harper, M. B. (2015) · Pediatric Emergency Care · doi:10.1097/pec.0000000000000484 · Cited by 103
Different definitions in childhood asthma: how dependable is the dependent variable?
Van Wonderen, K. E., Van Der Mark, L. B., Mohrs, J., Bindels, P. J. E., Van Aalderen, W. M. C., & Ter Riet, G. (2010) · European Respiratory Journal · doi:10.1183/09031936.00154409 · Cited by 100 · cited 1×
“These capabilities of NLP algorithms may enable scalable precision care or population management and reduce methodological heterogeneity in phenotyping in allergy, asthma, and immunology(45) which often obscures true biological heterogeneity deterring translation of scientific findings into practice while reducing the…”
BackgroundSohn, S., Wang, Y., Wi, C., Krusemark, E. A., Ryu, E., Ali, M. H., Juhn, Y. J., & Liu, H. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx138 · Cited by 93
Self-citationWu, S., Sohn, S., Ravikumar, K. E., Wagholikar, K. B., Jonnalagadda, S., Liu, H., & Juhn, Y. J. (2013) · Annals of Allergy Asthma & Immunology · doi:10.1016/j.anai.2013.07.022 · Cited by 88
Self-citationWi, C.-I., Sohn, S., Rolfes, M. C., Seabright, A., Ryu, E., Voge, G., Bachman, K. A., Park, M. A., Kita, H., Croghan, I. T., et al. (2017) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201610-2006oc · Cited by 88
Self-citationMercan, E., Mehta, S., Bartlett, J. R., et al. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.8777 · Cited by 85
Automated chart review utilizing natural language processing algorithm for asthma predictive index
Kaur, H., Sohn, S., Wi, C., Ryu, E., Park, M. A., Bachman, K. A., Kita, H., Croghan, I. T., Castro-Rodríguez, J. A., Voge, G. A., et al. (2018) · BMC Pulmonary Medicine · doi:10.1186/s12890-018-0593-9 · Cited by 80
Self-citationBlumenthal, K. G., Lai, K. H., Huang, M., Wallace, Z. S., Wickner, P. G., & Zhou, L. (2017) · The Journal of Allergy and Clinical Immunology In Practice · doi:10.1016/j.jaip.2016.12.006 · Cited by 68
Gustafson, E., Pacheco, J., Wehbe, F., Silverberg, J., & Thompson, W. (2017) · 2017 IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi.2017.31 · Cited by 65 · cited 1×
“Only one paper utilized NLP to define atopic dermatitis based on a predetermined criteria(29).”
MethodCommunity engagement in biobanking: Experiences from the eMERGE Network
Lemke, A. A., Wu, J. T., Waudby, C. J., Pulley, J. M., Somkin, C. P., & Trinidad, S. B. (2010) · Genomics Society and Policy · doi:10.1186/1746-5354-6-3-50 · Cited by 63
Natural language processing for asthma ascertainment in different practice settings
Wi, C.-I., Sohn, S., Ali, M., Krusemark, E., Ryu, E., Liu, H., & Juhn, Y. J. (2018) · The Journal of Allergy and Clinical Immunology In Practice · doi:10.1016/j.jaip.2017.04.041 · Cited by 62 · cited 1×
“Apart from NLP algorithms for asthma criteria and prognosis reported by our group discussed later,(20, 22, 23, 37, 38) NLP algorithms for complex concepts such as predetermined criteria for allergic disorders are significantly limited recognizing that valuable information required for complex…”
MethodSelf-citationClinical trial cohort selection based on multi-level rule-based natural language processing system
Chen, L., 池谷, 裕., Ji, X., Lou, C., Sun, Z., Li, H., Gao, Y., & Huang, Y. H. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz109 · Cited by 56
Predicting of anaphylaxis in big data EMR by exploring machine learning approaches
Segura-Bédmar, I., Colón-Ruíz, C., Tejedor, M. A., & Moro‐Moro, M. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.09.012 · Cited by 50
Modeling asynchronous event sequences with RNNs
Wu, S., Liu, S., Sohn, S., Moon, S., Wi, C.-I., Juhn, Y., & Liu, H. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.05.016 · Cited by 45
Self-citationExpert artificial intelligence-based natural language processing characterises childhood asthma
Seol, H. Y., Rolfes, M., Chung, W., Sohn, S., Ryu, E., Park, M. A., Kita, H., Ono, J., Croghan, I. T., Armasu, S. M., et al. (2020) · BMJ Open Respiratory Research · doi:10.1136/bmjresp-2019-000524 · Cited by 44
Self-citationAfzal, Z., Engelkes, M., Verhamme, K. M. C., Janssens, H. M., Sturkenboom, M., Kors, J. A., & Schuemie, M. J. (2013) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.3438 · Cited by 43
Goss, F. R., Plasek, J. M., Lau, J. J., Seger, D. L., CHANG, F. Y., & Zhou, L. (2014) · PubMed · Cited by 41
Cohort selection for clinical trials using hierarchical neural network
Xiong, Y., Shi, X., Chen, S., Jiang, D., Tang, B., Wang, X., Chen, Q., & Yan, J. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz099 · Cited by 37
Automated identification of drug and food allergies entered using non-standard terminology
Epstein, R. H., Jacques, P. S., Stockin, M., Rothman, B. S., Ehrenfeld, J. M., & Denny, J. C. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-001756 · Cited by 35
Fang, G., Annis, I. E., Elston-Lafata, J., & Cykert, S. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz036 · Cited by 31
Himes, B. E., Kohane, I. S., Ramoni, M. F., & Weiss, S. T. (2008) · Europe PMC (PubMed Central) · Cited by 30
Patient-level temporal aggregation for text-based asthma status ascertainment
Wu, S. T., Juhn, Y. J., Sohn, S., & Liu, H. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-002463 · Cited by 29
Self-citationSeol, H. Y., Sohn, S., Liu, H., Wi, C., Ryu, E., Park, M. A., & Juhn, Y. J. (2019) · Frontiers in Pediatrics · doi:10.3389/fped.2019.00113 · Cited by 26
Self-citationFood entries in a large allergy data repository
Plasek, J. M., Goss, F. R., Lai, K. H., Lau, J. J., Seger, D. L., Blumenthal, K. G., Wickner, P. G., Slight, S. P., CHANG, F. Y., Topaz, M., et al. (2015) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv128 · Cited by 25
Ascertainment of asthma prognosis using natural language processing from electronic medical records
Sohn, S., Wi, C., Wu, S., Liu, H., Ryu, E., Krusemark, E. A., Seabright, A., Voge, G. A., & Juhn, Y. J. (2018) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2017.12.1003 · Cited by 25
Self-citationA clinical use case to evaluate the i2b2 Hive: predicting asthma exacerbations.
Meystre, S. M., Deshmukh, V. G., & Mitchell, J. A. (2009) · Europe PMC (PubMed Central) · Cited by 22
Asthma-Guidance and Prediction System (a-GPS) As a Precision Asthma Care Tool
Juhn, Y. J., Wi, C., Sohn, S., Ryu, E., Park, M., Muth, J. F., Seol, H., Moon, S., King, K. S., Wheeler, P. H., et al. (2020) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2019.12.231 · Cited by 6
Self-citationHenry, S. B. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz078 · Cited by 3
Cited by
Lee, E. E., Torous, J., De Choudhury, M., Depp, C. A., Graham, S. A., Kim, H.-C., Paulus, M. P., Krystal, J. H., & Jeste, D. V. (2021) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2021.02.001 · Cited by 429
Hossain, E., Rana, R., Higgins, N., Soar, J., Barua, P. D., Pisani, A. R., & Turner, K. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106649 · Cited by 407
Challenges and opportunities beyond structured data in analysis of electronic health records
Tayefi, M., Ngo, P., Chomutare, T., Dalianis, H., Salvi, E., Budrionis, A., & Godtliebsen, F. (2021) · WIREs Computational Statistics · doi:10.1002/wics.1549 · Cited by 290
Deep learning in dermatology: a systematic review of current approaches, outcomes, and limitations
Jeong, H. K., Park, C., Henao, R., & Kheterpal, M. (2023) · JID Innovations · doi:10.1016/j.xjidi.2022.100150 · Cited by 134
Large Language Models versus Natural Language Understanding and Generation
Karanikolas, N., Manga, E., Samaridi, N., Tousidou, E., & Vassilakopoulos, M. (2023) · Proceedings of the 27th Pan-Hellenic Conference on Progress in Computing and Informatics · doi:10.1145/3635059.3635104 · Cited by 102
Metadata
- Authors
- Juhn, Y., & Liu, H.
- Venue
- Journal of Allergy and Clinical Immunology
- Publisher
- Elsevier BV
- Published
- 2020-02
- Volume
- 145
- Issue
- 2
- Pages
- 463-469
- ISSN
- 0091-6749 (ISSN-L)
- OpenAlex
- W2997514453
- Cited by
- 286
- References
- 43
- FWCI
- 10.36
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.