Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 7,926

The DOI matches its Crossref record; 120 of the 120 references it cites were found in a registry or an index.

Machine learning in automated text categorization

Open access
Sebastiani, Fabrizio · 2002 · ACM Computing Surveys

Abstract

The automated categorization (or classification) of texts into predefined categories has witnessed a booming interest in the last 10 years, due to the increased availability of documents in digital form and the ensuing need to organize them. In the research community the dominant approach to this problem is based on machine learning techniques: a general inductive process automatically builds a classifier by learning, from a set of preclassified documents, the characteristics of the categories. The advantages of this approach over the knowledge engineering approach (consisting in the manual definition of a classifier by domain experts) are a very good effectiveness, considerable savings in terms of expert labor power, and straightforward portability to different domains. This survey discusses the main approaches to text categorization that fall within the machine learning paradigm. We will discuss in detail issues pertaining to three different problems, namely, document representation, classifier construction, and classifier evaluation.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/505282.505283

Cites

120 of 120 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 46

  1. ATTARDI , G. , DI MARCO , S. , AND SALVI , D. 1998 . Categorization by context . J. Univers. Comput. Sci. 4 , 9 , 719 - 736 .]] ATTARDI, G., DI MARCO,S.,AND SALVI, D. 1998. Categorization by context. J. Univers. Comput. Sci. 4, 9, 719-736.]]
  2. CAVNAR , W.B. AND TRENKLE , J. M. 1994 . N-grambased text categorization . In Proceedings of SDAIR-94 , 3rd Annual Symposium on Docu-ment Analysis and Information Retrieval (Las Vegas, NV , 1994), 161 - 175 .]] CAVNAR,W.B.AND TRENKLE, J. M. 1994. N-grambased text categorization. In Proceedings of SDAIR-94, 3rd Annual Symposium on Docu-ment Analysis and Information Retrieval (Las Vegas, NV, 1994), 161-175.]]
  3. CLACK , C. , FARRINGDON , J. , LIDWELL , P. , AND YU , T. 1997 . Autonomous document classification for business . In Proceedings of the 1st International Conference on Autonomous Agents (Marina del Rey, CA , 1997), 201 - 208 .]] 10.1145/267658.267716 CLACK, C., FARRINGDON, J., LIDWELL,P.,AND YU,T. 1997. Autonomous document classification for business. In Proceedings of the 1st International Conference on Autonomous Agents (Marina del Rey, CA, 1997), 201-208.]] 10.1145/267658.267716 · doi:10.1145/267658.267716
  4. CLEVERDON , C. 1984 . Optimizing convenient online access to bibliographic databases . Inform. Serv. Use 4 , 1 , 37 - 47 . Also reprinted in Willett {1988}, pp. 32-41.]] CLEVERDON, C. 1984. Optimizing convenient online access to bibliographic databases. Inform. Serv. Use 4, 1, 37-47. Also reprinted in Willett {1988}, pp. 32-41.]] · doi:10.3233/isu-1984-41-204
  5. COHEN , W. W. 1995a. Learning to classify English text with ILP methods . In Advances in Inductive Logic Programming, L. De Raedt, ed . IOS Press , Amsterdam, The Netherlands, 124-143.]] COHEN, W. W. 1995a. Learning to classify English text with ILP methods. In Advances in Inductive Logic Programming, L. De Raedt, ed. IOS Press, Amsterdam, The Netherlands, 124-143.]]
  6. DAGAN , I. , KAROV , Y. , AND ROTH , D. 1997 . Mistakedriven learning in text categorization . In Proceedings of EMNLP-97 , 2nd Conference on Empirical Methods in Natural Language Processing (Providence, RI , 1997), 55 - 63 .]] DAGAN, I., KAROV,Y.,AND ROTH, D. 1997. Mistakedriven learning in text categorization. In Proceedings of EMNLP-97, 2nd Conference on Empirical Methods in Natural Language Processing (Providence, RI, 1997), 55-63.]]
  7. DIAZ ESTEBAN , A. , DE BUENAGA RODRIGUEZ , M. , URENA LOPEZ , L.A. , AND GARCIA VEGA , M. 1998 . Integrating linguistic resources in an uniform way for text classification tasks . In Proceedings of LREC-98 , 1st International Conference on Language Resources and Evaluation (Grenada, Spain , 1998), 1197 - 1204 .]] DIAZ ESTEBAN, A., DE BUENAGA RODRIGUEZ, M., URENA LOPEZ,L.A.,AND GARCIA VEGA, M. 1998. Integrating linguistic resources in an uniform way for text classification tasks. In Proceedings of LREC-98, 1st International Conference on Language Resources and Evaluation (Grenada, Spain, 1998), 1197-1204.]]
  8. DRUCKER , H. , VAPNIK , V. , AND WU , D. 1999 . Automatic text categorization and its applications to text retrieval . IEEE Trans. Neural Netw. 10 , 5 , 1048 - 1054 .]] DRUCKER, H., VAPNIK,V.,AND WU, D. 1999. Automatic text categorization and its applications to text retrieval. IEEE Trans. Neural Netw. 10,5, 1048-1054.]]
  9. ESCUDERO , G. , MARQUEZ , L. , AND RIGAU , G. 2000 . Boosting applied to word sense disambiguation . In Proceedings of ECML-00 , 11th European Conference on Machine Learning (Barcelona, Spain , 2000), 129 - 141 .]] ESCUDERO, G., MARQUEZ, L., AND RIGAU, G. 2000. Boosting applied to word sense disambiguation. In Proceedings of ECML-00, 11th European Conference on Machine Learning (Barcelona, Spain, 2000), 129-141.]]
  10. FIELD , B. 1975 . Towards automatic indexing: automatic assignment of controlled-language indexing and classification from free indexing . J. Document. 31 , 4 , 246 - 265 .]] FIELD, B. 1975. Towards automatic indexing: automatic assignment of controlled-language indexing and classification from free indexing. J. Document. 31, 4, 246-265.]] · doi:10.1108/eb026605
  11. FUHR , N. 1985 . Aprobabilistic model of dictionarybased automatic indexing . In Proceedings of RIAO-85 , 1st International Conference "Re-cherche d'Information Assistee par Ordinateur" (Grenoble, France , 1985), 207 - 216 .]] FUHR, N. 1985. Aprobabilistic model of dictionarybased automatic indexing. In Proceedings of RIAO-85, 1st International Conference "Re-cherche d'Information Assistee par Ordinateur" (Grenoble, France, 1985), 207-216.]]
  12. 10.1145/174608.174612 · doi:10.1145/174608.174612
  13. FURNKRANZ , J. 1999 . Exploiting structural information for text classification on the WWW . In Proceedings of IDA-99 , 3rd Symposium on Intelligent Data Analysis (Amsterdam, The Netherlands , 1999), 487 - 497 .]] FURNKRANZ, J. 1999. Exploiting structural information for text classification on the WWW. In Proceedings of IDA-99, 3rd Symposium on Intelligent Data Analysis (Amsterdam, The Netherlands, 1999), 487-497.]]
  14. GOVERT , N. , LALMAS , M. , AND FUHR , N. 1999 . A probabillistic description-oriented approach for categorising Web documents . In Proceedings of CIKM-99 , 8th ACM International Conference on Information and Knowledge Management (Kansas City, MO , 1999), 475 - 482 .]] 10.1145/319950.320053 GOVERT, N., LALMAS, M., AND FUHR, N. 1999. A probabillistic description-oriented approach for categorising Web documents. In Proceedings of CIKM-99, 8th ACM International Conference on Information and Knowledge Management (Kansas City, MO, 1999), 475-482.]] 10.1145/319950.320053 · doi:10.1145/319950.320053
  15. GUTHRIE , L. , WALKER , E. , AND GUTHRIE , J. A. 1994 . Document classification by machine: theory and practice . In Proceedings of COLING-94 , 15th International Conference on Computational Lin-guistics (Kyoto, Japan , 1994), 1059 - 1063 .]] 10.3115/991250.991322 GUTHRIE, L., WALKER, E., AND GUTHRIE, J. A. 1994. Document classification by machine: theory and practice. In Proceedings of COLING-94, 15th International Conference on Computational Lin-guistics (Kyoto, Japan, 1994), 1059-1063.]] 10.3115/991250.991322 · doi:10.3115/991250.991322
  16. HAYES , P.J. , ANDERSEN , P. M. , NIRENBURG , I.B. , AND SCHMANDT , L. M. 1990 . Tcs: a shell for content-based text categorization . In Proceedings of CAIA-90 , 6th IEEE Conference on Artificial Intelligence Applications (Santa Barbara, CA , 1990), 320 - 326 .]] HAYES,P.J.,ANDERSEN, P. M., NIRENBURG,I.B., AND SCHMANDT, L. M. 1990. Tcs: a shell for content-based text categorization. In Proceedings of CAIA-90, 6th IEEE Conference on Artificial Intelligence Applications (Santa Barbara, CA, 1990), 320-326.]]
  17. HERSH , W. , BUCKLEY , C. , LEONE , T. , AND HICKMAN , D. 1994 . OHSUMED: an interactive retrieval evaluation and new large text collection for research . In Proceedings of SIGIR-94 , 17th ACM International Conference on Research and Development in Information Retrieval (Dublin, Ireland , 1994), 192 - 201 .]] HERSH, W., BUCKLEY, C., LEONE,T.,AND HICKMAN,D. 1994. OHSUMED: an interactive retrieval evaluation and new large text collection for research. In Proceedings of SIGIR-94, 17th ACM International Conference on Research and Development in Information Retrieval (Dublin, Ireland, 1994), 192-201.]]
  18. ITTNER , D.J. , LEWIS , D.D. , AND AHN , D. D. 1995 . Text categorization of low quality images . In Proceedings of SDAIR-95 , 4th Annual Symposium on Document Analysis and Information Retrieval (Las Vegas, NV , 1995), 301 - 315 .]] ITTNER,D.J.,LEWIS,D.D.,AND AHN, D. D. 1995. Text categorization of low quality images. In Proceedings of SDAIR-95, 4th Annual Symposium on Document Analysis and Information Retrieval (Las Vegas, NV, 1995), 301-315.]]
  19. IWAYAMA , M. AND TOKUNAGA , T. 1995 . Cluster-based text categorization: a comparison of category search strategies . In Proceedings of SIGIR-95 , 18th ACM International Conference on Research and Development in Information Retrieval (Seattle, WA , 1995), 273 - 281 .]] 10.1145/215206.215371 IWAYAMA,M.AND TOKUNAGA, T. 1995. Cluster-based text categorization: a comparison of category search strategies. In Proceedings of SIGIR-95, 18th ACM International Conference on Research and Development in Information Retrieval (Seattle, WA, 1995), 273-281.]] 10.1145/215206.215371 · doi:10.1145/215206.215371
  20. 10.1023/A:1013652626023 · doi:10.1023/a:1013652626023
  21. JUNKER , M. AND ABECKER , A. 1997 . Exploiting thesaurus knowledge in rule induction for text classification . In Proceedings of RANLP-97 , 2nd International Conference on Recent Advances in Natural Language Processing (Tzigov Chark, Bulgaria , 1997), 202 - 207 .]] JUNKER,M.AND ABECKER, A. 1997. Exploiting thesaurus knowledge in rule induction for text classification. In Proceedings of RANLP-97, 2nd International Conference on Recent Advances in Natural Language Processing (Tzigov Chark, Bulgaria, 1997), 202-207.]]
  22. 10.1145/319382.319394 · doi:10.1145/319382.319394
  23. KNORZ , G. 1982 . A decision theory approach to optimal automated indexing . In Proceedings of SIGIR-82 , 5th ACM International Conference on Research and Development in Information Retrieval (Berlin, Germany , 1982), 174 - 193 .]] KNORZ, G. 1982. A decision theory approach to optimal automated indexing. In Proceedings of SIGIR-82, 5th ACM International Conference on Research and Development in Information Retrieval (Berlin, Germany, 1982), 174-193.]]
  24. KORFHAGE , R. R. 1997. Information Storage and Retrieval . Wiley Computer Publishing , New York, NY .]] KORFHAGE, R. R. 1997. Information Storage and Retrieval. Wiley Computer Publishing, New York, NY.]]
  25. LAM , W. AND HO , C. Y. 1998 . Using a generalized instance set for automatic text categorization . In Proceedings of SIGIR-98 , 21st ACM International Conference on Research and Development in Information Retrieval (Melbourne, Australia , 1998), 81 - 89 .]] 10.1145/290941.290961 LAM,W.AND HO, C. Y. 1998. Using a generalized instance set for automatic text categorization. In Proceedings of SIGIR-98, 21st ACM International Conference on Research and Development in Information Retrieval (Melbourne, Australia, 1998), 81-89.]] 10.1145/290941.290961 · doi:10.1145/290941.290961
  26. LAM , W. , LOW , K.F. , AND HO , C. Y. 1997 . Using a Bayesian network induction approach for text categorization . In Proceedings of IJCAI-97 , 15th International Joint Conference on Artificial Intelligence (Nagoya, Japan , 1997), 745 - 750 .]] LAM, W., LOW,K.F.,AND HO, C. Y. 1997. Using a Bayesian network induction approach for text categorization. In Proceedings of IJCAI-97, 15th International Joint Conference on Artificial Intelligence (Nagoya, Japan, 1997), 745-750.]]
  27. 10.1109/69.824599 · doi:10.1109/69.824599
  28. LEWIS , D. D. 1995 c. The TREC-4 filtering track: description and analysis . In Proceedings of TREC-4, 4th Text Retrieval Conference ( Gaithersburg, MD , 1995), 165 - 180 .]] LEWIS, D. D. 1995c. The TREC-4 filtering track: description and analysis. In Proceedings of TREC-4, 4th Text Retrieval Conference (Gaithersburg, MD, 1995), 165-180.]]
  29. LEWIS , D.D. AND RINGUETTE , M. 1994 . A comparison of two learning algorithms for text categorization . In Proceedings of SDAIR-94 , 3rd Annual Symposium on Document Analysis and Information Retrieval (Las Vegas, NV , 1994), 81 - 93 .]] LEWIS,D.D.AND RINGUETTE, M. 1994. A comparison of two learning algorithms for text categorization. In Proceedings of SDAIR-94, 3rd Annual Symposium on Document Analysis and Information Retrieval (Las Vegas, NV, 1994), 81-93.]]
  30. LI , H. AND YAMANISHI , K. 1999 . Text classification using ESC-based stochastic decision lists . In Proceedings of CIKM-99 , 8th ACMInternational Conference on Information and Knowledge Management (Kansas City, MO , 1999), 122 - 130 .]] 10.1145/319950.319966 LI,H.AND YAMANISHI, K. 1999. Text classification using ESC-based stochastic decision lists. In Proceedings of CIKM-99, 8th ACMInternational Conference on Information and Knowledge Management (Kansas City, MO, 1999), 122-130.]] 10.1145/319950.319966 · doi:10.1145/319950.319966
  31. 10.1145/183422.183425 · doi:10.1145/183422.183425
  32. LIM , J. H. 1999 . Learnable visual keywords for image classification . In Proceedings of DL-99 , 4th ACM Conference on Digital Libraries (Berkeley, CA , 1999), 139 - 145 .]] 10.1145/313238.313290 LIM, J. H. 1999. Learnable visual keywords for image classification. In Proceedings of DL-99, 4th ACM Conference on Digital Libraries (Berkeley, CA, 1999), 139-145.]] 10.1145/313238.313290 · doi:10.1145/313238.313290
  33. MASAND , B. 1994 . Optimising confidence of text classification by evolution of symbolic expressions. In Advances in Genetic Programming, K. E. Kinnear, ed. MIT Press, Cambridge, MA , Chapter 21 , 459 - 476 .]] MASAND, B. 1994. Optimising confidence of text classification by evolution of symbolic expressions. In Advances in Genetic Programming, K. E. Kinnear, ed. MIT Press, Cambridge, MA, Chapter 21, 459-476.]]
  34. MITCHELL , T. M. 1996. Machine Learning . McGraw Hill , New York, NY .]] MITCHELL, T. M. 1996. Machine Learning. McGraw Hill, New York, NY.]]
  35. MLADENIC , D. AND GROBELNIK , M. 1998 . Word sequences as features in text-learning . In Proceedings of ERK-98 , the Seventh Electrotechnical and Computer Science Conference (Ljubljana, Slovenia , 1998), 145 - 148 .]] MLADENIC,D.AND GROBELNIK, M. 1998. Word sequences as features in text-learning. In Proceedings of ERK-98, the Seventh Electrotechnical and Computer Science Conference (Ljubljana, Slovenia, 1998), 145-148.]]
  36. MOULINIER , I. , RASKINIS , G. , AND GANASCIA , J.-G. 1996 . Text categorization: a symbolic approach . In Proceedings of SDAIR-96 , 5th Annual Symposium on Document Analysis and Information Retrieval (Las Vegas, NV , 1996), 87 - 99 .]] MOULINIER, I., RASKINIS,G.,AND GANASCIA, J.-G. 1996. Text categorization: a symbolic approach. In Proceedings of SDAIR-96, 5th Annual Symposium on Document Analysis and Information Retrieval (Las Vegas, NV, 1996), 87-99.]]
  37. OH , H.-J. , MYAENG , S.H. , AND LEE , M.-H. 2000 . A practical hypertext categorization method using links and incrementally available class information . In Proceedings of SIGIR-00 , 23rd ACM International Conference on Research and Development in Information Retrieval (Athens, Greece , 2000), 264 - 271 .]] 10.1145/345508.345594 OH, H.-J., MYAENG,S.H.,AND LEE, M.-H. 2000. A practical hypertext categorization method using links and incrementally available class information. In Proceedings of SIGIR-00, 23rd ACM International Conference on Research and Development in Information Retrieval (Athens, Greece, 2000), 264-271.]] 10.1145/345508.345594 · doi:10.1145/345508.345594
  38. RILOFF . E. 1995 . Little words can make a big difference for text classification . In Proceedings of SIGIR-95 , 18th ACM International Conference on Research and Development in Information Retrieval (Seattle, WA , 1995), 130 - 136 .]] 10.1145/215206.215349 RILOFF. E. 1995. Little words can make a big difference for text classification. In Proceedings of SIGIR-95, 18th ACM International Conference on Research and Development in Information Retrieval (Seattle, WA, 1995), 130-136.]] 10.1145/215206.215349 · doi:10.1145/215206.215349
  39. SABLE , C.L. AND HATZIVASSILOGLOU , V. 2000 . Textbased approaches for non-topical image categorization . Internat. J. Dig. Libr. 3 , 3 , 261 - 275 .]] SABLE,C.L.AND HATZIVASSILOGLOU, V. 2000. Textbased approaches for non-topical image categorization. Internat. J. Dig. Libr. 3, 3, 261-275.]] · doi:10.1007/s007990000038
  40. SEBASTIANI , F. , SPERDUTI , A. , AND VALDAMBRINI , N. 2000 . An improved boosting algorithm and its application to automated text categorization . In Proceedings of CIKM-00 , 9th ACMInternational Conference on Information and Knowledge Management (McLean, VA , 2000), 78 - 85 .]] 10.1145/354756.354804 SEBASTIANI, F., SPERDUTI, A., AND VALDAMBRINI,N. 2000. An improved boosting algorithm and its application to automated text categorization. In Proceedings of CIKM-00, 9th ACMInternational Conference on Information and Knowledge Management (McLean, VA, 2000), 78-85.]] 10.1145/354756.354804 · doi:10.1145/354756.354804
  41. 10.1016/0306-4573(96)00008-8 · doi:10.1016/0306-4573(96)00008-8
  42. TZERAS , K. AND HARTMANN , S. 1993 . Automatic indexing based on Bayesian inference networks . In Proceedings of SIGIR-93 , 16th ACM International Conference on Research and Development in Information Retrieval (Pittsburgh, PA , 1993), 22 - 34 .]] 10.1145/160688.160691 TZERAS,K.AND HARTMANN, S. 1993. Automatic indexing based on Bayesian inference networks. In Proceedings of SIGIR-93, 16th ACM International Conference on Research and Development in Information Retrieval (Pittsburgh, PA, 1993), 22-34.]] 10.1145/160688.160691 · doi:10.1145/160688.160691
  43. WIENER , E.D. , PEDERSEN , J.O. , AND WEIGEND , A.S. 1995 . A neural network approach to topic spotting . In Proceedings of SDAIR-95 , 4th Annual Symposium on Document Analysis and Information Retrieval (Las Vegas, NV , 1995), 317 - 332 .]] WIENER,E.D.,PEDERSEN,J.O.,AND WEIGEND,A.S. 1995. A neural network approach to topic spotting. In Proceedings of SDAIR-95, 4th Annual Symposium on Document Analysis and Information Retrieval (Las Vegas, NV, 1995), 317-332.]]
  44. 10.1145/381984.381987 · doi:10.1145/381984.381987
  45. YANG , Y. 1994 . Expert network: effective and efficient learning from human decisions in text categorisation and retrieval . In Proceedings of SIGIR-94 , 17th ACM International Conference on Research and Development in Information Retrieval (Dublin, Ireland , 1994), 13 - 22 .]] YANG, Y. 1994. Expert network: effective and efficient learning from human decisions in text categorisation and retrieval. In Proceedings of SIGIR-94, 17th ACM International Conference on Research and Development in Information Retrieval (Dublin, Ireland, 1994), 13-22.]]
  46. YU , K.L. AND LAM , W. 1998 . A new on-line learning algorithm for adaptive text filtering . In Proceedings of CIKM-98 , 7th ACMInternational Conference on Information and Knowledge Management (Bethesda, MD , 1998), 156 - 160 .]] 10.1145/288627.288652 YU,K.L.AND LAM, W. 1998. A new on-line learning algorithm for adaptive text filtering. In Proceedings of CIKM-98, 7th ACMInternational Conference on Information and Knowledge Management (Bethesda, MD, 1998), 156-160.]] 10.1145/288627.288652 · doi:10.1145/288627.288652

Cited by

See all 7,926

Metadata

Authors
Sebastiani, F.
Venue
ACM Computing Surveys
Published
2002-03
Volume
34
Issue
1
Pages
1-47
ISSN
  • 0360-0300 (ISSN-L)
  • 1557-7341
OpenAlex
W2118020653
Cited by
7,926
References
120
FWCI
227.50
Type
journal article
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.