The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Automated learning of decision rules for text categorization
Open accessAbstract
We describe the results of extensive experiments using optimized rule-based induction methods on large document collections. The goal of these methods is to discover automatically classification patterns that can be used for general document categorization or personalized filtering of free text. Previous reports indicate that human-engineered rule-based systems, requiring many man-years of developmental efforts, have been successfully built to “read” documents and assign topics to them. We show that machine-generated decision rules appear comparable to human performance, while using the identical rule-based representation. In comparison with other machine-learning techniques, results on a key benchmark from the Reuters collection show a large gain in performance, from a previously reported 67% recall/precision breakeven point to 80.5%. In the context of a very high-dimensional feature space, several methodological alternatives are examined, including universal versus local dictionaries, and binary versus frequency-related features.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Effective Heuristic Algorithm for the Traveling-Salesman Problem
Lin, S., & Kernighan, B. W. (1973) · Operations Research · doi:10.1287/opre.21.2.498 · Cited by 3,821
Word association norms, mutual information, and lexicography
Church, K., & Hanks, P. (1990) · doi:10.5555/89086.89095 · Cited by 3,590
Quinlan, J. R. (1987) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(87)80053-6 · Cited by 2,553
Clark, P., & Niblett, T. (1989) · Machine Learning · doi:10.1007/bf00116835 · Cited by 2,267
Word association norms, mutual information, and lexicography
Church, K. W., & Hanks, P. (1989) · Proceedings of the 27th annual meeting on Association for Computational Linguistics - · doi:10.3115/981623.981633 · Cited by 1,094
Weiss, S. M. (1990) · Cited by 1,058
Self-citationMichalski, R. S., Mozetič, I., Hong, J., & Nada Lavrač, A. (1986) · National Conference on Artificial Intelligence · Cited by 747
Feature selection and feature extraction for text categorization
Lewis, D. D. (1992) · Proceedings of the workshop on Speech and Natural Language - HLT '91 · doi:10.3115/1075527.1075574 · Cited by 578
An evaluation of phrasal and clustered representations on a text categorization task
Lewis, D. D. (1992) · Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '92 · doi:10.1145/133160.133172 · Cited by 544
Classifying news stories using memory based reasoning
Masand, B. M., Linoff, G. S., & Waltz, D. L. (1992) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/133160.133177 · Cited by 260
Cited by
Machine learning in automated text categorization
Sebastiani, F. (2002) · ACM Computing Surveys · doi:10.1145/505282.505283 · Cited by 7,926
Shuman, D. I., Narang, S. K., Frossard, P., Ortega, A., & Vandergheynst, P. (2013) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2235192 · Cited by 4,421
“phs. Weighted graphs are also commonly used to represent similarities between data points in statistical learning problems for applications such as machine vision [2] and automatic text classification [3]. In fact, much of the literature on graph-based data analysis techniques emanates from the statistical learning com…”
MethodWavelets on graphs via spectral graph theory
Hammond, D. K., Vandergheynst, P., & Gribonval, R. (2011) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2010.04.005 · Cited by 2,171
The text mining handbook: advanced approaches in analyzing unstructured data
(2007) · Choice Reviews Online · doi:10.5860/choice.44-5684 · Cited by 1,598
Inductive learning algorithms and representations for text categorization
Dumais, S., Platt, J., Heckerman, D., & Sahami, M. (1998) · Proceedings of the seventh international conference on Information and knowledge management · doi:10.1145/288627.288651 · Cited by 1,461
A Survey of Text Classification Algorithms
Aggarwal, C. C., & Zhai, C. (2012) · Mining Text Data · doi:10.1007/978-1-4614-3223-4_6 · Cited by 842
Enhanced hypertext categorization using hyperlinks
Chakrabarti, S., Dom, B., & Indyk, P. (1998) · Proceedings of the 1998 ACM SIGMOD international conference on Management of data · doi:10.1145/276304.276332 · Cited by 769
A Review of Machine Learning Algorithms for Text-Documents Classification
Baharudin, B., Lee, L. H., & Khan, K. (2010) · Journal of Advances in Information Technology · doi:10.4304/jait.1.1.4-20 · Cited by 653
An evaluation of Naive Bayesian anti-spam filtering
Androutsopoulos, I., Koutsias, J., Chandrinos, K. V., Paliouras, G., & Spyropoulos, C. D. (2000) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0006013 · Cited by 523
Multiview Clustering: A Scalable and Parameter-Free Bipartite Graph Fusion Method
Li, X., Zhang, H., Wang, R., & Nie, F. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3011148 · Cited by 499
Androutsopoulos, I., Koutsias, J., Chandrinos, K. V., & Spyropoulos, C. D. (2000) · Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/345508.345569 · Cited by 465
Learning to construct knowledge bases from the World Wide Web
Craven, M., DiPasquo, D., Freitag, D., McCallum, A., Mitchell, T., Nigam, K., & Slattery, S. (2000) · Artificial Intelligence · doi:10.1016/s0004-3702(00)00004-7 · Cited by 464
Feature selection, perception learning, and a usability case study for text categorization
Ng, H. T., Goh, W. B., & Low, K. L. (1997) · Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '97 · doi:10.1145/258525.258537 · Cited by 450
Combining classifiers in text categorization
Larkey, L. S., & Croft, W. B. (1996) · Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '96 · doi:10.1145/243199.243276 · Cited by 410
Text Categorization Based on Regularized Linear Classification Methods
Zhang, T., & Oles, F. J. (2001) · Information Retrieval · doi:10.1023/a:1011441423217 · Cited by 379
Context-sensitive learning methods for text categorization
Cohen, W. W., & Singer, Y. (1999) · ACM Transactions on Information Systems · doi:10.1145/306686.306688 · Cited by 360
Feature selection for text classification: A review
Deng, X., Li, Y., Weng, J., & Zhang, J. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6083-5 · Cited by 351
Machine Learning for Information Extraction in Informal Domains
Freitag, D. (2000) · Machine Learning · doi:10.1023/a:1007601113994 · Cited by 350
Tensorized Bipartite Graph Learning for Multi-View Clustering
Xia, W., Gao, Q., Wang, Q., Gao, X., Ding, C., & Tao, D. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3187976 · Cited by 331
An improved K-nearest-neighbor algorithm for text categorization
Jiang, S., Pang, G., Wu, M., & Kuang, L. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.08.040 · Cited by 322
Data mining with decision trees and decision rules
Apté, C., & Weiss, S. (1997) · Future Generation Computer Systems · doi:10.1016/s0167-739x(97)00021-6 · Cited by 307
Self-citationThe use of bigrams to enhance text categorization
Tan, C.-M., Wang, Y.-F., & Lee, C.-D. (2002) · Information Processing & Management · doi:10.1016/s0306-4573(01)00045-0 · Cited by 290
Multi-class pattern classification using neural networks
Ou, G., & Murphey, Y. L. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2006.04.041 · Cited by 289
Learning to Filter Spam E-Mail: A Comparison of a Naive Bayesian and a Memory-Based Approach
Androutsopoulos, I., Παλιούρας, Γ., Karkaletsis, V., Sakkis, G., Spyropoulos, C. D., & Stamatopoulos, P. (2000) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0009009 · Cited by 281
Modeling word burstiness using the Dirichlet distribution
Madsen, R. E., Kauchak, D., & Elkan, C. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102420 · Cited by 280
An Integrated Text Analytic Framework for Product Defect Discovery
Abrahams, A. S., Fan, W., Wang, G. A., Zhang, Z. (., & Jiao, J. (2015) · Production and Operations Management · doi:10.1111/poms.12303 · Cited by 258
Large-scale text categorization by batch mode active learning
Hoi, S. C. H., Jin, R., & Lyu, M. R. (2006) · Proceedings of the 15th international conference on World Wide Web · doi:10.1145/1135777.1135870 · Cited by 253
A degradation-based sorting method for lithium-ion battery reuse
Chen, H., & Shen, J. (2017) · PLOS ONE · doi:10.1371/journal.pone.0185922 · Cited by 57
Metadata
- Authors
- Apté, C., Damerau, F., & Weiss, S. M.
- Venue
- ACM Transactions on Information Systems
- Published
- 1994-07
- Volume
- 12
- Issue
- 3
- Pages
- 233-251
- ISSN
- 1046-8188 (ISSN-L)
- 1558-2868
- OpenAlex
- W2094934653
- Cited by
- 859
- References
- 17
- FWCI
- 18.33
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.