The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Using Statistics in Lexical Analysis
Abstract
This chapter discusses a number of statistical tools and shows some examples of how these tools can be used to enhance productivity of a human trying to solve one of these problems. It begins by introducing two statistics, mutual information and the t-score. British lexicographers, especially those working on dictionaries for foreign learners, are beginning to depend heavily on machine-readable corpora. They use these corpora and the basic concordancing tool mentioned above to fill in detailed syntactic descriptions. The notion that a language consists of a fixed set of rules and a finite set of lexical items, and that they can be learned by students, who will then “know” the language, is too attractive to be easily dislodged, but it has been responsible for some misconceptions inter alia about the status of infelicities typically produced by foreigners, which are sufficient to identify the speaker as foreign, although not actually wrong.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bayesian Inference in Statistical Analysis.
Kadane, J. B., Box, G. E. P., & Tiao, G. C. (1975) · Journal of the American Statistical Association · doi:10.2307/2285412 · Cited by 3,824
Word association norms, mutual information, and lexicography
Church, K., & Hanks, P. (1990) · doi:10.5555/89086.89095 · Cited by 3,590
Self-citationTHE POPULATION FREQUENCIES OF SPECIES AND THE ESTIMATION OF POPULATION PARAMETERS
GOOD, I. J. (1953) · Biometrika · doi:10.1093/biomet/40.3-4.237 · Cited by 3,437
Three models for the description of language
Chomsky, N. (1956) · IEEE Transactions on Information Theory · doi:10.1109/tit.1956.1056813 · Cited by 2,796
A Synopsis of Linguistic Theory, 1930-1955
Firth, J. R. (1957) · Medical Entomology and Zoology · Cited by 1,675
Salton, G. (1988) · Cited by 1,587
Burchfield, R. (1985) · Journal of English Linguistics · doi:10.1177/007542428501800107 · Cited by 1,246
Mathematical structures of language
Harris, Z. S. (1968) · Medical Entomology and Zoology · Cited by 957
A stochastic parts program and noun phrase parser for unrestricted text
Church, K. W. (1988) · Proceedings of the second conference on Applied natural language processing - · doi:10.3115/974235.974260 · Cited by 957
Self-citationThe Random House dictionary of the English language
Urdang, L., & Stein, J. M. (1967) · Random House eBooks · Cited by 857
Cited by
Collostructions: Investigating the interaction of words and constructions
Stefanowitsch, A., & Gries, S. T. (2003) · International Journal of Corpus Linguistics · doi:10.1075/ijcl.8.2.03ste · Cited by 1,492
Mining the Web for Synonyms: PMI-IR versus LSA on TOEFL
Turney, P. D. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44795-4_42 · Cited by 1,285
Extending collostructional analysis: A corpus-based perspective on `alternations'
Gries, S. T., & Stefanowitsch, A. (2004) · International Journal of Corpus Linguistics · doi:10.1075/ijcl.9.1.06gri · Cited by 961
Syntactic Priming: A Corpus-based Approach
Gries, S. T. (2005) · Journal of Psycholinguistic Research · doi:10.1007/s10936-005-6139-3 · Cited by 818
The statistics of word cooccurrences : word pairs and collocations
Evert, S. (2005) · OPUS Publication Server of the University of Stuttgart (University of Stuttgart) · doi:10.18419/opus-2556 · Cited by 636
Metadata
- Authors
- Church, K., Gale, W., Hanks, P., & Hindle, D.
- Venue
- Lexical Acquisition: Exploiting On-Line Resources to Build a Lexicon
- Publisher
- Psychology Press
- Published
- 2021-03-24
- Pages
- 115-164
- OpenAlex
- W80619934
- Cited by
- 459
- References
- 15
- Type
- reference entry
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using Statistics in Lexical Analysis. https://app.cochat.ai/papers/10.4324/9781315785387-8
- The paper
- Church, K., Gale, W., Hanks, P., & Hindle, D. (2021). Using Statistics in Lexical Analysis. Lexical Acquisition: Exploiting On-Line Resources to Build a Lexicon. https://doi.org/10.4324/9781315785387-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.