Natural language processing: an introduction
Open accessThe DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: To provide an overview and tutorial of natural language processing (NLP) and modern NLP-system design. TARGET AUDIENCE: This tutorial targets the medical informatics generalist who has limited acquaintance with the principles behind NLP and/or limited knowledge of the current state of the art. SCOPE: We describe the historical evolution of NLP, and summarize common NLP sub-problems in this extensive field. We then provide a synopsis of selected highlights of medical NLP efforts. After providing a brief description of common machine-learning approaches that are being used for diverse NLP sub-problems, we discuss how modern NLP architectures are designed, with a summary of the Apache Foundation's Unstructured Information Management Architecture. We finally consider possible future directions for NLP, and reflect on the possible impact of IBM Watson on the medical field.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
(1992) · Cited by 23,431
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 1×
“provides a lucid bioinformatics-oriented introduction to HMMs, while Rabiner”
An Introduction to Support Vector Machines and Other Kernel-based Learning Methods
Cristianini, N., & Shawe-Taylor, J. (2000) · doi:10.1017/cbo9780511801389 · Cited by 13,855
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Introduction to information retrieval
(2009) · Choice Reviews Online · doi:10.5860/choice.46-2715 · Cited by 12,278
Introduction to Information Retrieval
Manning, C. D., Raghavan, P., & Schütze, H. (2008) · doi:10.1017/cbo9780511809071 · Cited by 11,288
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
Compilers: Principles, Techniques, and Tools
Aho, A. V., Sethi, R., & Ullman, J. D. (1986) · Cited by 8,478
Chomsky, N. (1957) · doi:10.1515/9783112316009 · Cited by 7,885
Hearst, M. A., Dumais, S. T., Osuna, E., Platt, J., & Scholkopf, B. (1998) · IEEE Intelligent Systems and their Applications · doi:10.1109/5254.708428 · Cited by 7,243
Error bounds for convolutional codes and an asymptotically optimum decoding algorithm
Viterbi, A. (1967) · IEEE Transactions on Information Theory · doi:10.1109/tit.1967.1054010 · Cited by 6,759
An Introduction to Support Vector Machines
Cristianini, N., & Shawe-Taylor, J. S. (2000) · ePrints Soton (University of Southampton) · Cited by 4,115
Speech and language processing
(2010) · Day-to-Day Dyslexia in the Classroom · doi:10.4324/9780203461891_chapter_3 · Cited by 3,544
Accurate unlexicalized parsing
Klein, D., & Manning, C. D. (2003) · Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - ACL '03 · doi:10.3115/1075096.1075150 · Cited by 3,008
Three models for the description of language
Chomsky, N. (1956) · IEEE Transactions on Information Theory · doi:10.1109/tit.1956.1056813 · Cited by 2,796
Savova, G. K., Masanz, J. J., Ogren, P. V., Zheng, J., Sohn, S., Kipper-Schuler, K. C., & Chute, C. G. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.001560 · Cited by 1,967 · cited 1×
“lists publicly available NLP modules for such tasks: most modules, with the exception of cTAKES (clinical Text Analysis and Knowledge Extraction System),”
Representation of Events in Nerve Nets and Finite Automata
Kleene, S. C. (1956) · Automata Studies. (AM-34) · doi:10.1515/9781400882618-002 · Cited by 1,655
On certain formal properties of grammars
Chomsky, N. (1959) · Information and Control · doi:10.1016/s0019-9958(59)90362-6 · Cited by 1,588
GeneMark.hmm: new solutions for gene finding
Lukashin, A. (1998) · Nucleic Acids Research · doi:10.1093/nar/26.4.1107 · Cited by 1,538
2010 i2b2/VA challenge on concepts, assertions, and relations in clinical text
Uzuner, Ö., South, B. R., Shen, S., & DuVall, S. L. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000203 · Cited by 1,252
The Unified Medical Language System
Humphreys, B. L., McCray, A. T., & Lindberg, D. A. B. (1993) · Methods of Information in Medicine · doi:10.1055/s-0038-1634945 · Cited by 1,182
A Simple Algorithm for Identifying Negated Findings and Diseases in Discharge Summaries
Chapman, W. W., Bridewell, W., Hanbury, P., Cooper, G. F., & Buchanan, B. G. (2001) · Journal of Biomedical Informatics · doi:10.1006/jbin.2001.1029 · Cited by 1,118
Self-citationAn Introduction to Conditional Random Fields for Relational Learning
Sutton, C., & McCallum, A. (2007) · Introduction to Statistical Relational Learning · doi:10.7551/mitpress/7432.003.0006 · Cited by 841
Pfam: multiple sequence alignments and HMM-profiles of protein domains
Sonnhammer, E. (1998) · Nucleic Acids Research · doi:10.1093/nar/26.1.320 · Cited by 769
Friedl, J. E. F. (1997) · CERN Document Server (European Organization for Nuclear Research) · Cited by 626
What is a hidden Markov model?
Eddy, S. R. (2004) · Nature Biotechnology · doi:10.1038/nbt1004-1315 · Cited by 556
The Unified Medical Language System
Humphreys, B. L., McCray, A. T., & Lindberg, D. A. B. (1993) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1637976 · Cited by 507
Extracting medication information from clinical text
Uzuner, Ö., Solti, I., & Cadag, E. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.003947 · Cited by 466
Miller, R. A. (1994) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1994.95236141 · Cited by 458
Identifying Patient Smoking Status from Medical Discharge Records
Uzuner, O., Goldstein, I., Luo, Y., & Kohane, I. (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2408 · Cited by 359
Performance of Four Computer-Based Diagnostic Systems
Berner, E. S., Webster, G. D., Shugerman, A. A., Jackson, J. R., Algina, J., Baker, A. L., Ball, E. V., Cobbs, C. G., Dennis, V. W., Frenkel, E. P., et al. (1994) · New England Journal of Medicine · doi:10.1056/nejm199406233302506 · Cited by 319
Wang, X., Hripcsak, G., Markatou, M., & Friedman, C. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m3028 · Cited by 288
Active Learning for Natural Language Parsing and Information Extraction
Thompson, C. A., Califf, M. E., & Mooney, R. J. (1999) · International Conference on Machine Learning · Cited by 282
The CoNLL-2010 Shared Task: Learning to Detect Hedges and their Scope in Natural Language Text
Farkas, R., Vincze, V., Móra, G., Csirik, J., & Szarvas, G. (2010) · Cited by 258
Mutalik, P. G., Deshpande, A., & Nadkarni, P. M. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080598 · Cited by 249
Self-citationRecognizing Obesity and Comorbidities in Sparse Data
Uzuner, O. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m3115 · Cited by 231
Friedman, C. P., Elstein, A. S., Wolf, F. M., Murphy, G. C., Franz, T. M., Heckerling, P. S., Fine, P. L., Miller, T. M., & Abraham, V. (1999) · JAMA · doi:10.1001/jama.282.19.1851 · Cited by 217
The Convergence of Mildly Context-Sensitive Grammar Formalisms
Joshi, A. K., Vijay‐Shanker, K., & Weir, D. J. (1990) · ScholarlyCommons (University of Pennsylvania) · Cited by 192
A Novel Hybrid Approach to Automated Negation Detection in Clinical Radiology Reports
Huang, Y., & Lowe, H. J. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2284 · Cited by 185
Evaluation of negation phrases in narrative clinical reports.
Chapman, W. W., Bridewell, W. B., Hanbury, P., Cooper, G. F., & Buchanan, B. G. (2001) · PubMed · Cited by 175
Self-citationThe Demise of the “Greek Oracle” Model for Medical Diagnostic Systems
Miller, R. A., & Masarie, F. E. (1990) · Methods of Information in Medicine · doi:10.1055/s-0038-1634767 · Cited by 169
Exploring deep knowledge resources in biomedical name recognition
GuoDong, Z., & Su, J. (2004) · doi:10.3115/1567594.1567616 · Cited by 155
Natural Language Processing in Medicine: An Overview
Spyns, P. (1996) · Methods of Information in Medicine · doi:10.1055/s-0038-1634681 · Cited by 149
Developing a test collection for biomedical word sense disambiguation.
Weeber, M., Mork, J. G., & Aronson, A. R. (2001) · Europe PMC (PubMed Central) · Cited by 140
Evaluation of a Method to Identify and Categorize Section Headers in Clinical Documents
Denny, J. C., Spickard, A., Johnson, K. B., Peterson, N. B., Peterson, J. F., & Miller, R. A. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m3037 · Cited by 122
IndexFinder: a method of extracting key concepts from clinical texts for indexing.
Zou, Q., Chu, W. W., Morioka, C. A., Leazer, G. H., & Kangarloo, H. (2003) · PubMed · Cited by 109
Computerized extraction of coded findings from free-text radiologic reports. Work in progress.
Haug, P. J., Ranum, D. L., & Frederick, P. R. (1990) · Radiology · doi:10.1148/radiology.174.2.2404321 · Cited by 93
MPLUS: a probabilistic medical language understanding system
Christensen, L. M., Haug, P. J., & Fiszman, M. (2002) · Proceedings of the ACL-02 workshop on Natural language processing in the biomedical domain - · doi:10.3115/1118149.1118154 · Cited by 93
Medical Language Processing: Applications to Patient Data Representation and Automatic Encoding
Sager, N., Lyman, M., Ngo, N., & Tick, L. (1995) · Methods of Information in Medicine · doi:10.1055/s-0038-1634579 · Cited by 83
Fever detection from free-text clinical records for biosurveillance
Chapman, W. W., Dowling, J., & D, M. M. W. M. (2004) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2004.03.002 · Cited by 75
Self-citationExtracting Phenotypic Information from the Literature via Natural Language Processing
Lifeng, C., & Friedman, C. (2004) · Studies in health technology and informatics · doi:10.3233/978-1-60750-949-3-758 · Cited by 74
Identifying Respiratory Findings in Emergency Department Reports for Biosurveillance using MetaMap
Chapman Wendy, W., Marcelo, F., Dowling John, N., Chapman Brian, E., & Rindflesch Thomas, C. (2004) · Studies in Health Technology and Informatics · doi:10.3233/978-1-60750-949-3-487 · Cited by 61
Ambiguity resolution while mapping free text to the UMLS Metathesaurus.
Rindflesch, T. C., & Aronson, A. R. (1994) · PubMed · Cited by 58
Anaphoric relations in the clinical narrative: corpus creation
Savova, G. K., Chapman, W. W., Zheng, J., & Crowley, R. S. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000108 · Cited by 57
Self-citation2005 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)
(2004) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2004.832562 · Cited by 54
Time-Oriented Question Answering from Clinical Narratives Using Semantic-Web Techniques
Tao, C., Solbrig, H. R., Sharma, D. K., Wei, W., Savova, G., & Chute, C. G. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-17749-1_16 · Cited by 41
Wang, X.-Y., Hripcsak, G. M., & Friedman, C. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-s9-s13 · Cited by 38
Methods for Building Sense Inventories of Abbreviations in Clinical Notes
Xu, H., Stetson, P. D., & Friedman, C. (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2927 · Cited by 37
Natural Language Processing With Prolog in the IBM Watson System
Lally, A., & Fodor, P. (2011) · Cited by 31
Using Empiric Semantic Correlation to Interpret Temporal Assertions in Clinical Texts
Hripcsak, G. M., Elhadad, N., Chen, Y.-H., Zhou, L., & Morrison, F. P. (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m3007 · Cited by 27
Christensen, L. M., Harkema, H., Haug, P. J., Irwin, J. Y., & Chapman, W. W. (2009) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.3115/1572364.1572368 · Cited by 20
Self-citationChute, C. G. (2002) · PubMed · Cited by 12
A concept-based retrieval system for thoracic radiology
Taira, R. K., Johnson, D. B., Bhushan, V., Rivera, M., Wong, C., Huang, L., Aberle, D. R., Greaves, M., & Goldin, J. G. (1996) · Journal of Imaging Informatics in Medicine · doi:10.1007/bf03168565 · Cited by 9
(2001) · doi:10.1002/pds.4850 · Cited by 7
Cited by
A Survey of the Usages of Deep Learning for Natural Language Processing
Otter, D. W., Medina, J. R., & Kalita, J. K. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2979670 · Cited by 1,836
Natural language processing: state of the art, current trends and challenges
Khurana, D., Koli, A., Khatter, K., & Singh, S. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-022-13428-4 · Cited by 1,823
Artificial intelligence: A powerful paradigm for scientific research
Xu, Y., Liu, X., Cao, X., Huang, C., Liu, E., Qian, S., Liu, X., Wu, Y., Dong, F., Qiu, C.-W., et al. (2021) · The Innovation · doi:10.1016/j.xinn.2021.100179 · Cited by 1,726
“The cognitive layer provides higher ability levels of induction, reasoning, and acquiring knowledge with the help of NLP, 6, knowledge graphs, 7, and continual learning.”
Artificial intelligence in surgery: promises and perils
Hashimoto, D. A., Rosman, G., Rus, D., & Meireles, O. R. (2018) · Annals of Surgery · doi:10.1097/sla.0000000000002693 · Cited by 1,468
“To achieve human-level understanding of language successful NLP systems must expand beyond simple word recognition 16 to incorporate semantics and syntax into their analyses. sentiment in a physician’s assessment and plan).”
Big Data In Health Care: Using Analytics To Identify And Manage High-Risk And High-Cost Patients
Bates, D. W., Saria, S., Ohno-Machado, L., Shah, A., & Escobar, G. (2014) · Health Affairs · doi:10.1377/hlthaff.2014.0041 · Cited by 1,235
Metadata
- Authors
- Nadkarni, P. M., Ohno-Machado, L., & Chapman, W. W.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2011-09
- Volume
- 18
- Issue
- 5
- Pages
- 544-551
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W2169818249
- Cited by
- 1,975
- References
- 65
- FWCI
- 64.75
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.