The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Improving stemming for Arabic information retrieval: light stemming and co-occurrence analysis
Abstract
Arabic, a highly inflected language, requires good stemming for effective information retrieval, yet no standard approach to stemming has emerged. We developed several light stemmers based on heuristics and a statistical stemmer based on co-occurrence for Arabic retrieval. We compared the retrieval effectiveness of our stemmers and of a morphological analyzer on the TREC-2001 data. The best light stemmer was more effective for cross-language retrieval than a morphological stemmer which tried to find the root for each word. A repartitioning process consisting of vowel removal followed by clustering using co-occurrence analysis produced stem classes which were better than no stemming or very light stemming, but still inferior to good light stemming or morphological analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nonparametric Statistics for the Behavioral Sciences
Guitton, H., & Siegel, S. (1958) · Revue économique · doi:10.2307/3498751 · Cited by 35,245
An algorithm for suffix stripping
Porter, M. F. (1980) · Program · doi:10.1108/eb046814 · Cited by 8,096
Nonparametric Statistics for the Behavioral Sciences
Furfey, P. H., & Siegel, S. (1957) · The American Catholic Sociological Review · doi:10.2307/3708383 · Cited by 1,362
Development of a Stemming Algorithm
Lovins, J. B. (1968) · Mech. Transl. Comput. Linguistics · Cited by 1,115
Unsupervised Learning of the Morphology of a Natural Language
Goldsmith, J. (2001) · Computational Linguistics · doi:10.1162/089120101750300490 · Cited by 788
Viewing morphology as an inference process
Krovetz, R. (1993) · Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '93 · doi:10.1145/160688.160718 · Cited by 656
Stemming algorithms: A case study for detailed evaluation
Hull, D. A. (1996) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199601)47:1<70::aid-asi7>3.3.co;2-q · Cited by 369
Corpus-based stemming using cooccurrence of word variants
Xu, J., & Croft, W. B. (1998) · ACM Transactions on Information Systems · doi:10.1145/267954.267957 · Cited by 305
Word segmentation by letter successor varieties
Hafer, M. A., & Weiss, S. F. (1974) · Information Storage and Retrieval · doi:10.1016/0020-0271(74)90044-8 · Cited by 203
Unsupervised Language AcquisitionPreprint
de Marcken, C. (1996) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9611002 · Cited by 197
Cited by
Introduction to Arabic Natural Language Processing
Habash, N. Y. (2010) · Synthesis Lectures on Human Language Technologies · doi:10.1007/978-3-031-02139-8 · Cited by 753
Introduction to Arabic Natural Language Processing
Habash, N. Y. (2010) · Synthesis lectures on human language technologies · doi:10.2200/s00277ed1v01y201008hlt010 · Cited by 301
Darwish, K., & Magdy, W. (2014) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000031 · Cited by 102
Metadata
- Authors
- Larkey, L. S., Ballesteros, L., & Connell, M. E.
- Venue
- Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
- Publisher
- ACM
- Published
- 2002-08-11
- Pages
- 275-282
- OpenAlex
- W2033937535
- Cited by
- 365
- References
- 23
- FWCI
- 8.42
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Improving stemming for Arabic information retrieval: light stemming and co-occurrence analysis. https://app.cochat.ai/papers/10.1145/564376.564425
- The paper
- Larkey, L. S., Ballesteros, L., & Connell, M. E. (2002). Improving stemming for Arabic information retrieval: light stemming and co-occurrence analysis. Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval. https://doi.org/10.1145/564376.564425
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.