Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Sign Up
Cited by 805

The DOI matches its Crossref record.

Natural language processing

Open access
Chowdhury, Gobinda G.·2003·Annual Review of Information Science and Technology
DOI 10.1002/aris.1440370103
Open this paper in CoChat — free account

Abstract

Previous ARIST chapters (Haas, 1996;Warner, 1987) described a number of theoretical developments that have influenced research in NLP.The most recent theoretical developments can be grouped into four classes: (i) statistical and corpus-based methods in NLP, (ii) recent efforts to use WordNet for NLP research, (iii) the resurgence of interest in finite-state and other computationally lean approaches to NLP, and (iv) the initiation of collaborative projects to create large grammar and NLP tools.Statistical methods are used in NLP for a number of purposes, e.g., for word sense disambiguation, for generating grammars and parsing, for determining stylistic evidences of authors and speakers, and so on.Charniak (1995) points out that 90% accuracy can be obtained in assigning part-of-speech tag to a word by applying simple statistical measures.Jelinek (1999) is a widely cited source on the use of statistical methods in NLP, especially in speech processing.Rosenfield (2000) reviews statistical language models for speech processing and argues for a Bayesian approach to the integration of linguistic theories of data.Mihalcea & Moldovan (1999) mention that although thus far statistical approaches have been considered the best for word sense disambiguation, they are useful only in a small set of texts.They propose the use of WordNet to improve the results of statistical analyses of natural language texts.WordNet is an online lexical reference system developed at Princeton University.This is an excellent NLP tool containing English nouns, verbs, adjectives and adverbs organized into synonym sets, each representing one underlying lexical concept.Details of WordNet is available in Fellbaum ( 1998) and on the web (http://www.cogsci.princeton.edu/~wn/).WordNet is now used in a number of NLP research and applications.One of the major applications of WordNet in NLP has been in Europe with the formation EuroWordNet in 1996.EuroWordNet is a multilingual database with WordNets for several European languages including Dutch, Italian, Spanish, German, French, Czech and Estonian, structured in the same way as the WordNet for English (http://www.hum.uva.nl/~ewn/).The finite-state automation is the mathematical device used to implement regular expressions -the standard notation for characterizing text sequences.Variations of automata such as finite-state transducers, Hidden Markov Models, and n-gram grammars are important components of speech recognition and speech synthesis, spell-checking, and information extraction which are the important applications of NLP.Different applications of the Finite State methods in NLP have been discussed by Jurafsky & Martin (2000), Kornai (1999) and Roche & Shabes (1997).The work of NLP researchers has been greatly facilitated by the availability of large-scale grammar for parsing and generation.Researchers can get access to large-scale grammars and tools through several websites, for example Lingo

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1002/aris.1440370103

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

No references could be resolved yet.

Research works printed but not linked: 132

  1. Adams K. C., 2001, The Web as a database: New extraction technologies & content management, Online, 25, 27
  2. Ahonen H. Heinonen O. Klemettinen M. &Verkamo A. I.(1998). Applying data mining techniques for descriptive phrase extraction in digital document collections.IEEE International Forum on Research and Technology. Advances in Digital Libraries—ADL '98 2–11. · DOI
  3. Amsler R. A., 1984, Machine‐readable dictionaries, Annual Review of Information Science and Technology, 19, 161
  4. Argamon S. Dagan I. &Krymolowski Y.(1998). A memory‐based approach to learning shallow natural language patterns.17th International Conference on Computational Linguistics (COLING '98) 67–73. · doi:10.3115/980451.980857
  5. Bangalore S., 1999, Supertagging: An approach to almost parsing, Computational Linguistics, 25, 237
  6. Barahona P., 1999, 9th Portuguese Conference on Artificial Intelligence, EPIA '99
  7. 10.1007/3-540-45486-1_4 · DOI
  8. 10.1002/aris.1440360107 · doi:10.1002/aris.1440360107
  9. 10.1002/(SICI)1097-4571(2000)51:3<281::AID-ASI7>3.0.CO;2-8 · doi:10.1002/(sici)1097-4571(2000)51:3<281::aid-asi7>3.0.co;2-8
  10. Black W. J. Rinaldi F. &McNaught J.(2000). Natural language processing in Java: Applications in education and knowledge management.Proceedings of the Second International Conference on the Practical Application of Java 157–170.
  11. Bondale N., 1999, Extraction of information from open‐ended questionnaires using natural language processing techniques, Computer Science and Informatics, 29, 15
  12. Borgman C. L.(1997). Multi‐media multi‐cultural and multi‐lingual digital libraries: Or how do we exchange data in 400 languages?D‐Lib Magazine. Retrieved December 5 2001 fromhttp://www.dlib.org/dlib/june97/06borgman.html. · doi:10.1045/june97-borgman
  13. Breck E. Burger J. House D. Light M. &Mani I.(1999). Question answering from large document collections.Question Answering Systems. Papers from the 1999 AAAI Fall Symposium 26–31.
  14. 10.1016/S0306-4573(97)00021-6 · doi:10.1016/s0306-4573(97)00021-6
  15. Ceric V., 2000, Proceedings of the 22nd International Conference on Information Technology Interfaces, 211
  16. 10.1016/S0306-4573(98)00026-0 · DOI
  17. 10.1109/MMSE.2000.897199 · doi:10.1109/mmse.2000.897199
  18. 10.1145/212094.212108 · doi:10.1145/212094.212108
  19. Chen J. N., 1998, Topical clustering of MRD senses based on information retrieval techniques, Computational Linguistics, 24, 61
  20. Chinchor N. A.(2001.) Overview of MUC‐7/MET‐2. Retrieved December 5 2001 fromhttp://www.itl.nist.gov/iaui/894.02/related_projects/muc/proceedings/muc_7‐proproceedings/overview.html.
  21. Chowdhury G. G., 1999, Template mining for information extraction from digital documents, Library Trends, 48, 182
  22. Chowdhury G. G., 1999, Introduction to modern information retrieval
  23. Chuang W.&Yang J.(2000). Extracting sentence segments for text summarization: A machine learning approach.Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 152–159. · DOI
  24. Costantino M., 1999, Proceedings of the 21st International Conference on Information Technology Interfaces, 63
  25. 10.1145/234173.234209 · DOI · Paper page
  26. Craven T. C., 1988, Text network display editing with special reference to the production of customized abstracts, Canadian Journal of Information Science, 13, 59
  27. Craven T. C., 1993, A computer‐aided abstracting tool kit, Canadian Journal of Information Science, 18, 19
  28. Craven T. C.(1996). An experiment in the use of tools for computer‐assisted abstracting.Proceedings of the 59th ASIS Annual Meeting 203–208.
  29. 10.1002/(SICI)1097-4571(2000)51:8<745::AID-ASI70>3.0.CO;2-Z · doi:10.1002/(sici)1097-4571(2000)51:8<745::aid-asi70>3.0.co;2-z
  30. 10.1007/3-540-48659-3_9 · doi:10.1007/3-540-48659-3_9
  31. Elworthy D.(2000). Question answering using a large NLP system.The Ninth Text REtrieval Conference (TREC 9). Retrieved December 5 2001 fromhttp://trec.nist.gov/pubs/trec9/papers/msrc‐qa.pdf. · doi:10.6028/nist.sp.500-249.microsoft
  32. Evans M., 1989, Computer‐readable dictionaries, Annual Review of Information Science and Technology, 24, 85
  33. Feldman S., 1999, NLP meets the jabberwocky, Online, 23, 62
  34. 10.7551/mitpress/7287.001.0001 · DOI · Paper page
  35. 10.1016/S0957-4174(00)00018-X · doi:10.1016/s0957-4174(00)00018-x
  36. 10.1108/EUM0000000007162 · DOI
  37. Glasgow B., 1998, MITA: An information‐extraction approach to the analysis of free‐form text in life insurance applications, AI Magazine, 19, 59
  38. Goldstein J. Kantrowitz M. Mittal V. &Carbonell J.(1999). Summarizing text documents: Sentence selection and evaluation metrics.Proceeding of the ACM SIGIR 22nd Annual International Conference on Research and Development in Information Retrieval 121–128. · DOI · Paper page
  39. Grefenstette G.(1999). The World Wide Web as a resource for example‐based machine translation tasks.Translating and the Computer 21. Proceedings of the Twenty‐first International Conference on Translating and the Computer. Retrieved April 29 2002 from:http://www.xcre.xerox.com/competencies/content‐analysis/publications/Documents.
  40. Grishman R., 1986, Analyzing language in restricted domains: Sublanguage descriptions and processing
  41. Haas S. W., 1996, Natural language processing: Toward large‐scale robust systems, Annual Review of Information Science and Technology, 31, 83
  42. Hayes P., 1992, Text‐based intelligent systems, 227
  43. Hayes P., 1991, Innovative applications of artificial intelligence 2, 51
  44. 10.1016/S0306-4573(00)00024-8 · doi:10.1016/s0306-4573(00)00024-8
  45. Herath S., 1999, Algorithm to determine the subject in flexible word order language based machine translations: A case study for Sinhalese, Communications of COLIPS, 9, 1
  46. 10.1023/A:1002475423737 · DOI
  47. 10.1093/llc/15.4.465 · doi:10.1093/llc/15.4.465
  48. Jelinek F., 1999, Statistical methods for speech recognition
  49. 10.1016/S0306-4573(98)00055-7 · doi:10.1016/s0306-4573(98)00055-7
  50. Jurafsky D., 2000, Speech and language processing: An introduction to natural language processing, computational linguistics and speech recognition
  51. Kazakov D., 1999, Inductive Logic Programming. 9th International Workshop, ILP‐99 Proceedings, 152
  52. Kehler A., 1997, Current theories of centering for pronoun interpretation: A critical evaluation, Computational Linguistics, 23, 467
  53. 10.1016/S0306-4573(00)00022-4 · doi:10.1016/s0306-4573(00)00022-4
  54. 10.1016/S0306-4573(98)00057-0 · doi:10.1016/s0306-4573(98)00057-0
  55. 10.1145/234173.234208 · doi:10.1145/234173.234208
  56. Kornai A., 1999, Extended finite state models of language
  57. Kwok K. L. Grunfeld L. Dinstl N. &Chan M.(1999). TREC‐8 ad‐hoc query filtering experiments using PIRCS.The Eighth Text REtrieval Conference (TREC 8). Retrieved December 5 2001 fromhttp://trec.nist.gov/pubs/trec8/papers/queenst8.pdf. · doi:10.6028/nist.sp.500-246.filtering-cuny
  58. Kwok K. L. Grunfeld L. Dinstl N. &Chan M.(2000). TREC‐9 cross language Web and question‐answering track experiments using PIRCS.The Ninth Text REtrieval Conference (TREC 9). Retrieved December 5 2001 fromhttp://trec.nist.gov/pubs/trec9/t9_proceedings.html. · doi:10.6028/nist.sp.500-249.qa-cuny
  59. Lange H., 1993, Speech synthesis and speech recognition: Tomorrow&s human‐computer interfaces?, Annual Review of Information Science and Technology, 28, 153
  60. 10.1002/(SICI)1097-4571(1999)50:9<751::AID-ASI3>3.0.CO;2-P · doi:10.1002/(sici)1097-4571(1999)50:9<751::aid-asi3>3.0.co;2-p
  61. 10.1016/S0306-4573(98)00043-0 · doi:10.1016/s0306-4573(98)00043-0
  62. 10.1108/EUM0000000007104 · DOI
  63. 10.1145/234173.234210 · DOI
  64. 10.1002/bult.91 · DOI
  65. 10.1023/A:1009986331526 · doi:10.1023/a:1009986331526
  66. 10.1016/S0933-3657(98)00023-2 · doi:10.1016/s0933-3657(98)00023-2
  67. 10.1109/IJCNN.2000.859378 · doi:10.1109/ijcnn.2000.859378
  68. 10.1023/A:1008394902165 · DOI
  69. Mani I., 1999, Advances in automatic text summarization
  70. Manning C. D., 1999, Foundations of statistical natural language processing
  71. 10.1023/A:1007673816718 · doi:10.1023/a:1007673816718
  72. Martinez P., 2000, Challenges of Information Technology Management in the 21st Century. 2000 Information Resources Management Association International Conference, 500
  73. Martinez P., 1998, Systems Implementation 2000. IFIP TC2 WG2.4 Working Conference on Systems Implementation 2000: Languages, Methods and Tools, 166
  74. McMurchie L. L., 1998, Software speaks user&s language, Computing Canada, 24, 19
  75. 10.1109/ACSC.2000.824397 · doi:10.1109/acsc.2000.824397
  76. Mihalcea R., 1999, Proceedings of the Twelfth International Florida AI Research Society Conference, 293
  77. 10.1016/S0306-4573(97)00022-8 · doi:10.1016/s0306-4573(97)00022-8
  78. 10.1016/S0306-4573(97)00035-6 · DOI
  79. Morin E., 1999, TKE '99. Terminology and Knowledge Engineering, 268
  80. Narita M., 2000, The use of phrases from query texts in information retrieval, SIGIR Forum, 34, 318, 10.1145/345508.345621 · doi:10.1145/345508.345621
  81. 10.1076/call.11.5.543.5660 · doi:10.1076/call.11.5.543.5660
  82. Oard D. W.(1997). Serving users in many languages: Cross‐language information retrieval for digital libraries.D‐Lib Magazine. Retrieved December 5 2001 fromhttp://www.dlib.org/dlib/december97/oard/12oard.html. · doi:10.1045/december97-oard
  83. Oard D. W., 1998, Cross‐language information retrieval, Annual Review of Information Science and Technology, 33, 223
  84. Ogura K., 2000, The electronic dictionary. Goi‐Taikei: A Japanese lexicon and its applications, NTT Review, 12, 53
  85. 10.1038/scientificamerican0397-77 · DOI
  86. 10.1006/ijhc.1999.0381 · doi:10.1006/ijhc.1999.0381
  87. 10.1016/S0306-4573(97)00065-4 · DOI
  88. 10.1076/call.11.5.561.5663 · doi:10.1076/call.11.5.561.5663
  89. Pedersen T., 1998, Proceedings Fifteenth National Conference on Artificial Intelligence (AAAI‐98). Tenth Conference on Innovative Applications of Artificial Intelligence, 800
  90. 10.1016/S0306-4573(99)00049-7 · DOI
  91. Peters C.&Picchi E.(1997). Across languages across cultures: Issues in multilinguality and digital libraries D‐Lib Magazine. Retrieved December 5 2001 fromhttp://www.dlib.org/dlib/may97/peters/05peters.html. · doi:10.1045/may97-peters
  92. Petreley N., 2000, Waiting for innovations to hit the mainstream: What about natural language?, InfoWorld, 22, 102
  93. 10.1108/EUM0000000007085 · DOI
  94. Poesio M., 1998, A corpus‐based investigation of definite description use, Computational Linguistics, 24, 183
  95. Powell J.&Fox E. A.(1998). Multilingual federated searching across heterogeneous collections.D‐Lib Magazine. Retrieved December 5 2001 fromhttp://www.dlib.org/dlib/september98/powell/09powell.html. · doi:10.1045/september98-powell
  96. Qin J. & Norton M. J. (Eds.). (1999). Introduction. [Special Issue]Knowledge discovery in bibliographic databases.Library Trends 48 1–8.
  97. Raghavan V. V. Deogun J. S. & Server H. (Eds.). (1998). Knowledge discovery and data mining [Special topics issue]Journal of the American Society for Information Science 49(5). · doi:10.1002/(sici)1097-4571(19980415)49:5<397::aid-asi2>3.0.co;2-u
  98. 10.7551/mitpress/3007.001.0001 · DOI
  99. 10.1109/5.880083 · DOI · Paper page
  100. 10.1016/S0933-3657(99)00034-2 · doi:10.1016/s0933-3657(99)00034-2
  101. Ruiz M. E. &Srinivasan P.(1998).Cross‐language information retrieval: An analysis of errors.Proceedings of the 61st ASIS Annual Meeting 153–165.
  102. 10.1007/3-540-48239-3_62 · doi:10.1007/3-540-48239-3_62
  103. 10.1007/3-540-45486-1_12 · doi:10.1007/3-540-45486-1_12
  104. Schenker J. L., 2001, The gist of translation: How long will it be before machines make the Web multilingual?, Time, 158, 54
  105. 10.1145/325737.325861 · doi:10.1145/325737.325861
  106. 10.1007/978-94-017-2388-6_4 · DOI
  107. 10.1007/3-540-63438-X_7 · doi:10.1007/3-540-63438-x_7
  108. 10.1145/285070.285074 · doi:10.1145/285070.285074
  109. Sokol L., 2000, Proceedings of the Fourth International Conference on the Practical Application of Knowledge Discovery and Data Mining, 57
  110. Song J., 2000, Study of automatic abstracting based on corpus and hierarchical dictionary, Journal of Software, 11, 308
  111. 10.1007/978-94-017-2388-6_1 · doi:10.1007/978-94-017-2388-6_1
  112. 10.1007/3-540-48414-0_7 · DOI
  113. 10.1023/A:1018995904244 · doi:10.1023/a:1018995904244
  114. Strzalkowski T. Fang L. Perez‐Carballo J. &Jin W.(1997).Natural language information retrieval TREC‐6 Report NIST Special Publication 500‐240. Retrieved December 5 2001 fromhttp://trec.nist.gov/pubs/trec6/t6_proceedings.html · doi:10.6028/nist.sp.500-240.nlp-ge
  115. Strzalkowski T. Perez‐Carballo J. Karlgren J. Hulth A. Tapanainen P. &Lahtinen T.(1999).Natural language information retrieval: TREC‐8 report. NIST Special Publication 500‐246. Retrieved December 5 2001 fromhttp://trec.nist.gov/pubs/trec8/papers/ge8adhoc2.pdf. · doi:10.6028/nist.sp.500-246.adhoc-ge
  116. Strzalkowski T. Stein G. Wise G. B. Perez‐Carballo J. Tapanainen P. Jarvinen et al. (1998).Natural language information retrieval: TREC‐7 report. NIST Special Publication 500‐242. Retrieved December 5 2001 fromhttp://trec.nist.gov/pubs/trec7/t7_proceedings.html. · doi:10.6028/nist.sp.500-242.adhoc-ge
  117. 10.1002/(SICI)1097-4571(2000)51:4<352::AID-ASI5>3.0.CO;2-8 · doi:10.1002/(sici)1097-4571(2000)51:4<352::aid-asi5>3.0.co;2-8
  118. Trybula W. J., 1997, Data mining and knowledge discovery, Annual Review of Information Science and Technology, 32, 197
  119. Tsuda K., 1999, Third International Conference on Knowledge‐Based Intelligent Information Engineering Systems, 534
  120. 10.1108/EUM0000000007195 · doi:10.1108/eum0000000007195
  121. Voorhees E.(1999). The TREC‐8 question answering track report. Retrieved December 5 2001 fromhttp://trec.nist.gov/pubs/trec8/papers/qa‐report.pdf. · doi:10.6028/nist.sp.500-246.qa-overview
  122. Voorhees E.(2000). The TREC‐9 question answering track report. Retrieved December 5 2001 fromhttp://trec.nist.gov/pubs/trec9/papers/qa‐report.pdf. · doi:10.6028/nist.sp.500-249.qa-overview
  123. Waldrop M. M., 2001, Natural language processing, Technology Review, 104, 107
  124. Warner A. J., 1987, Natural language processing, Annual Review of Information Science and Technology, 22, 79
  125. 10.1109/DEXA.1998.707397 · doi:10.1109/dexa.1998.707397
  126. 10.1145/234173.234180 · doi:10.1145/234173.234180
  127. 10.1002/(SICI)1097-024X(199807)28:7<681::AID-SPE172>3.0.CO;2-N · doi:10.1002/(sici)1097-024x(199807)28:7<681::aid-spe172>3.0.co;2-n
  128. 10.4218/etrij.00.0100.0203 · doi:10.4218/etrij.00.0100.0203
  129. 10.1076/0958-8221(200004)13:2;1-D;FT119 · doi:10.1076/0958-8221(200004)13:2;1-d;ft119
  130. Yang Y.&Liu X.(1999). A re‐examination of text categorization methods. InProceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 42–49. · DOI · Paper page
  131. 10.1145/345124.345164 · DOI
  132. 10.1007/3-540-48720-4_46 · doi:10.1007/3-540-48720-4_46

Cited by

See all 805

Metadata

Authors
Chowdhury, G. G.
Venue
Annual Review of Information Science and Technology
Publisher
Wiley
Published
2003-01
Volume
37
Issue
1
Pages
51-89
ISSN
  • 0066-4200 (ISSN-L)
  • 1550-8382
DOI
10.1002/aris.1440370103
OpenAlex
W2031213082
Cited by
805
References
0
FWCI
0.71
Type
journal article
Language
en
Open access
bronze
Licence
onlinelibrary.wiley.com/termsAndConditions#vor (vor, 761 d)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Natural language processing. https://app.cochat.ai/papers/10.1002/aris.1440370103
The paper
Chowdhury, G. G. (2003). Natural language processing. Annual Review of Information Science and Technology. https://doi.org/10.1002/aris.1440370103

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.