The DOI matches its OpenAlex record; 5 of the 5 references it cites were found in a registry or an index.
A Closer Look at Skip-gram Modelling
Open accessAbstract
Data sparsity is a large problem in natural language processing that refers to the fact that language is a system of rare events, so varied and complex, that even using an extremely large corpus, we can never accurately model all possible strings of words.This paper examines the use of skip-grams (a technique where by n-grams are still stored to model language, but they allow for tokens to be skipped) to overcome the data sparsity problem.We analyze this by computing all possible skip-grams in a training corpus and measure how many adjacent (standard) n-grams these cover in test documents.We examine skip-gram modelling using one to four skips with various amount of training data and test against similar documents as well as documents generated from a machine translation system.In this paper we also determine the amount of extra training data required to achieve skip-gram coverage using standard adjacent tri-grams.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A statistical approach to machine translation
Brown, P. F., Cocke, J., Pietra, S. A. D., Pietra, V. J. D., Jelinek, F., Lafferty, J., Mercer, R. L., & Roossin, P. S. (1990) · doi:10.5555/92858.92860 · Cited by 1,655
A stochastic parts program and noun phrase parser for unrestricted text
Church, K. W. (1988) · Proceedings of the second conference on Applied natural language processing - · doi:10.3115/974235.974260 · Cited by 957
On structuring probabilistic dependences in stochastic language modelling
Ney, H., Essen, U., & Kneser, R. (1994) · Computer Speech & Language · doi:10.1006/csla.1994.1001 · Cited by 517
Variable n-grams and extensions for conversational speech language modeling
Siu, M.-H., & Mari Ostendorf, E. (2000) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.817454 · Cited by 100
Speech recognition evaluation: a review of the U.S. CSR and LVCSR programmes
Young, S. J., & Chase, L. (1998) · Computer Speech & Language · doi:10.1006/csla.1998.0101 · Cited by 31
Cited by
The Encyclopedia of Applied Linguistics
(2012) · Wiley eBooks · doi:10.1002/9781405198431 · Cited by 2,048
A multidimensional approach for detecting irony in Twitter
Reyes, A., Rosso, P., & Veale, T. (2013) · Language Resources and Evaluation · doi:10.1007/s10579-012-9196-x · Cited by 454
SciTaiL: A Textual Entailment Dataset from Science Question Answering
Khot, T., Sabharwal, A., & Clark, P. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12022 · Cited by 411
Syntactic N-grams as machine learning features for natural language processing
Sidorov, G., Velasquez, F., Stamatatos, E., Gelbukh, A., & Chanona-Hernández, L. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.08.015 · Cited by 319
Wei, L., Xing, P., Zeng, J., Chen, J., Su, R., & Guo, F. (2017) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2017.03.001 · Cited by 242
Metadata
- Authors
- Guthrie, D., Allison, B., Liu, W., Guthrie, L., & Wilks, Y. A.
- Venue
- Language Resources and Evaluation Conference (LREC)
- Published
- 2006-05-01
- Pages
- 1222-1225
- OpenAlex
- W2759336060
- Cited by
- 259
- References
- 5
- FWCI
- 1.44
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Closer Look at Skip-gram Modelling. https://app.cochat.ai/papers/10.63317/295w69ubysee
- The paper
- Guthrie, D., Allison, B., Liu, W., Guthrie, L., & Wilks, Y. A. (2006). A Closer Look at Skip-gram Modelling. Language Resources and Evaluation Conference (LREC). https://doi.org/10.63317/295w69ubysee
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.