The DOI matches its Crossref record; 87 of the 87 references it cites were found in a registry or an index.
A Brief Survey of Text Mining
Open accessAbstract
A Brief Survey of Text MiningThe enormous amount of information stored in unstructured texts cannot simply be used for further processing by computers, which typically handle text as simple sequences of character strings.Therefore, specific (pre-)processing methods and algorithms are required in order to extract useful patterns.Text mining refers generally to the process of extracting interesting information and knowledge from unstructured text.In this article, we discuss text mining as a young and interdisciplinary field in the intersection of the related areas information retrieval, machine learning, statistics, computational linguistics and especially data mining.We describe the main analysis tasks preprocessing, classification, clustering, information extraction and visualization.In addition, we briefly discuss a number of successful applications of text mining.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
(1967) · Cited by 23,719
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743
Quinlan, J. R. (1986) · Machine Learning · doi:10.1007/bf00116251 · Cited by 21,439
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
(1973) · CERN Document Server (European Organization for Nuclear Research) · Cited by 12,895
Indexing by latent semantic analysis
Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6<391::aid-asi1>3.0.co;2-9 · Cited by 12,751
Baeza-Yates, R. A., & Ribeiro-Neto, B. A. (1999) · Cited by 11,505
Finding groups in data: an introduction to cluster analysis
(1991) · Choice Reviews Online · doi:10.5860/choice.28-4558 · Cited by 10,474
Pattern Recognition with Fuzzy Objective Function Algorithms
Bezdek, J. C. (1981) · doi:10.1007/978-1-4757-0450-1 · Cited by 9,881
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
Term-weighting approaches in automatic text retrieval
Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 9,740
Self-organized formation of topologically correct feature maps
Kohonen, T. (1982) · Biological Cybernetics · doi:10.1007/bf00337288 · Cited by 9,529
Self-Organization and Associative Memory
Kohonen, T. (1989) · Springer Series in Information Sciences · doi:10.1007/978-3-642-88163-3 · Cited by 8,740
An algorithm for suffix stripping
Porter, M. F. (1980) · Program · doi:10.1108/eb046814 · Cited by 8,096
Text categorization with Support Vector Machines: Learning with many relevant features
Joachims, T. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0026683 · Cited by 7,999
Machine learning in automated text categorization
Sebastiani, F. (2002) · ACM Computing Surveys · doi:10.1145/505282.505283 · Cited by 7,926
A vector space model for automatic indexing
Salton, G., Wong, A., & Yang, C. S. (1975) · Communications of the ACM · doi:10.1145/361219.361220 · Cited by 7,521
Vector Quantization and Signal Compression
Gersho, A., & Gray, R. M. (1992) · Springer eBooks · doi:10.1007/978-1-4615-3626-0 · Cited by 7,003
(1975) · CERN Document Server (European Organization for Nuclear Research) · Cited by 5,958
Maximum Likelihood from Incomplete Data via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1976) · Cited by 4,517
Pattern Classification and Scene Analysis
Thompson, M., Duda, R. O., & Hart, P. E. (1974) · Leonardo · doi:10.2307/1573081 · Cited by 4,495
Finding Groups in Data: An Introduction to Cluster Analysis.
Sarle, W. S., Kaufman, L., & Rousseeuw, P. J. (1991) · Journal of the American Statistical Association · doi:10.2307/2290430 · Cited by 3,539
Information Retrieval: Data Structures and Algorithms
Frakes, W. B., & Baeza-Yates, R. A. (1992) · Cited by 2,757
Text classification from labeled and unlabeled documents using EM
Nigam, K., Mccallum, A. K., Thrun, S., & Mitchell, T. (2000) · Machine Learning · doi:10.1023/a:1007692713085 · Cited by 2,736
Relevance feedback in information retrieval
Rocchio, J. J. (1971) · Medical Entomology and Zoology · Cited by 2,680
Improved boosting algorithms using confidence-rated predictions
Schapire, R. E., & Singer, Y. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279960 · Cited by 2,547
A Comparison of Document Clustering Techniques
Steinbach, M. S., Karypis, G., & Kumar, V. (2000) · Cited by 2,532
Unsupervised Learning by Probabilistic Latent Semantic Analysis
Hofmann, T. (2001) · Machine Learning · doi:10.1023/a:1007617005950 · Cited by 2,456
Data mining: an overview from a database perspective
Chen, M.-S., Han, J., & Yu, P. S. (1996) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/69.553155 · Cited by 2,232
BoosTexter: A Boosting-based System for Text Categorization
Schapire, R. E., & Singer, Y. (2000) · Machine Learning · doi:10.1023/a:1007649029923 · Cited by 2,188
Cluster analysis of multivariate data : efficiency versus interpretability of classifications
Forgy, E. W. (1965) · Biometrics · Cited by 2,093
A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition
RABINER, L. R. (1990) · Readings in Speech Recognition · doi:10.1016/b978-0-08-051584-7.50027-9 · Cited by 1,869
Information visualization and visual data mining
Keim, D. A. (2002) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/2945.981847 · Cited by 1,633
Inductive learning algorithms and representations for text categorization
Dumais, S., Platt, J., Heckerman, D., & Sahami, M. (1998) · Proceedings of the seventh international conference on Information and knowledge management · doi:10.1145/288627.288651 · Cited by 1,461
Shallow parsing with conditional random fields
Sha, F., & Pereira, F. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073473 · Cited by 1,246
THE PROBABILITY RANKING PRINCIPLE IN IR
ROBERTSON, S. E. (1977) · Journal of Documentation · doi:10.1108/eb026647 · Cited by 1,103
Readings in information retrieval
Jones, K. S., & Willett, P. (1997) · Morgan Kaufmann Publishers Inc. eBooks · Cited by 1,069
Information-theoretic co-clustering
Dhillon, I. S., Mallela, S., & Modha, D. S. (2003) · Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/956750.956764 · Cited by 1,006
Visualizing science by citation mapping
Small, H. (1999) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(1999)50:9<799::aid-asi9>3.0.co;2-g · Cited by 977
Bayesian classification (AutoClass): theory and results
Cheeseman, P. C., & Stutz, J. (1996) · Cited by 975
Self organization of a massive document collection
Kohonen, T., Kaski, S., Lagus, K., Salojarvi, J., Honkela, J., Paatero, V., & Saarela, A. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.846729 · Cited by 908
Abney, S. P. (1991) · Studies in Linguistics and Philosophy · doi:10.1007/978-94-011-3474-3_10 · Cited by 882
FINDING GROUPS IN DATA: AN INTRODUCTION TO CLUSTER ANALYSIS
Kaufman, L., & Rousseeuw, P. J. (1990) · Cited by 877
Hearst, M. A. (1999) · Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics - · doi:10.3115/1034678.1034679 · Cited by 867
Knowledge discovery and data mining: towards a unifying framework
Fayyad, U. M., Piatetsky-Shapiro, G., & Smyth, P. (1996) · Cited by 846
An Algorithm that Learns What's in a Name
Bikel, D. M., Schwartz, R., & Weischedel, R. M. (1999) · Machine Learning · doi:10.1023/a:1007558221122 · Cited by 776
Managing Gigabytes: Compressing and Indexing Documents and Images
Witten, I. H., Moffat, A., & Bell, T. C. (1995) · IEEE Transactions on Information Theory · doi:10.1109/tit.1995.476344 · Cited by 726
Advances in Automatic Text Summarization
Liddy, E. (2001) · Information Retrieval · doi:10.1023/a:1011476409104 · Cited by 685
Advances in automatic text summarization
(2000) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(00)90017-8 · Cited by 681
Visualizing the non-visual: spatial analysis and interaction with information from text documents
Wise, J. A., Thomas, J. J., Pennock, K. A., Lantrip, D. B., Pottier, M., Schur, A., & Crow, V. L. (2002) · Visualization · doi:10.1109/infvis.1995.528686 · Cited by 629
Foundations of statistical natural language processing
Weikum, G. (2002) · ACM SIGMOD Record · doi:10.1145/601858.601867 · Cited by 615
Information visualization in data mining and knowledge discovery
Fayyad, U. M. (2002) · Cited by 565
Introduction to the Special Issue on Summarization
Radev, D. R., Hovy, E., & McKeown, K. (2002) · Computational Linguistics · doi:10.1162/089120102762671927 · Cited by 539
The Estimation of Probabilities: An Essay on Modern Bayesian Methods
Sparks, J. N., & Good, I. J. (1967) · American Educational Research Journal · doi:10.2307/1162122 · Cited by 528
The Challenges of Clustering High Dimensional Data
Steinbach, M., Ertöz, L., & Kumar, V. (2004) · New Directions in Statistical Physics · doi:10.1007/978-3-662-08968-2_16 · Cited by 508
Text categorization with support vector machines
Joachims, T. (1997) · Technische Universität Dortmund Eldorado (Technische Universität Dortmund) · doi:10.17877/de290r-5097 · Cited by 507
Learning quickly when irrelevant attributes abound: A new linear-threshold algorithm
Littlestone, N. (1988) · Machine Learning · doi:10.1007/bf00116827 · Cited by 497
Text Categorization with Support Vector Machines. How to Represent Texts in Input Space?
Leopold, E., & Kindermann, J. (2002) · Machine Learning · doi:10.1023/a:1012491419635 · Cited by 403
A self-organizing semantic map for information retrieval
Lin, X., Soergel, D., & Marchionini, G. (1991) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/122860.122887 · Cited by 391
Topic Detection and Tracking: Event-based Information Organization
(2002) · The Information Retrieval Series · doi:10.1007/978-1-4615-0933-2 · Cited by 381
A non-classical logic for information retrieval
van Rijsbergen, C. J. (1986) · The Computer Journal · doi:10.1093/comjnl/29.6.481 · Cited by 372
Efficiently Inducing Features of Conditional Random Fields
McCallum, A. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1212.2504 · Cited by 363
Information-theoretic co-clustering
Dhillon, I. S., Mallela, S., & Modha, D. S. (2003) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/956755.956764 · Cited by 361
Ontologies improve text document clustering
Hotho, A., Staab, S., & Stumme, G. (2004) · Third IEEE International Conference on Data Mining · doi:10.1109/icdm.2003.1250972 · Cited by 355
Self-citationA Non-Classical Logic for Information Retrieval
van Rijsbergen, C. J. (1998) · Springer eBooks · doi:10.1007/978-1-4615-5617-6_1 · Cited by 344
The Estimation of Probabilities: An Essay on Modern Bayesian Methods
Hill, B. M., & Good, I. J. (1965) · Journal of the American Statistical Association · doi:10.2307/2283422 · Cited by 337
Strauss, D. J., & Hartigan, J. A. (1975) · Biometrics · doi:10.2307/2529577 · Cited by 290
Automatic structuring and retrieval of large text files
Salton, G., Allan, J., & Buckley, C. (1994) · Communications of the ACM · doi:10.1145/175235.175243 · Cited by 225
Unsupervised Learning by Probabilistic Latent Semantic Analysis
HofmannThomas (2001) · Machine Learning · doi:10.5555/599609.599631 · Cited by 220
Learning quickly when irrelevant attributes abound: A new linear-threshold algorithm
Littlestone, N. (1987) · 28th Annual Symposium on Foundations of Computer Science (sfcs 1987) · doi:10.1109/sfcs.1987.37 · Cited by 186
Text mining with information extraction
Nahm, U. Y., & Mooney, R. J. (2004) · Texas ScholarWorks (Texas Digital Library) · Cited by 186
Domain visualization using VxInsight® for science and technology management
Boyack, K. W., Wylie, B., & Davidson, G. S. (2002) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.10066 · Cited by 154
(2011) · SpringerReference · doi:10.1007/springerreference_63544 · Cited by 140
Use of support vector machines in extended named entity recognition
Takeuchi, K., & Collier, N. (2002) · Conference on Computational Natural Language Learning · doi:10.3115/1118853.1118882 · Cited by 137
Newsgroup Exploration with WEBSOM Method and Browsing Interface
Honkela, T., Samuel Kaski, A., Lagus, K., & Kohonen, T. (1996) · Cited by 124
Text classification with self-organizing maps: Some lessons learned
Merkl, D. (1998) · Neurocomputing · doi:10.1016/s0925-2312(98)00032-0 · Cited by 110
Information navigation on the web by clustering and summarizing query results
Roussinov, D. G., & Chen, H. (2001) · Information Processing & Management · doi:10.1016/s0306-4573(00)00062-5 · Cited by 92
A theory of term weighting based on exploratory data analysis
Greiff, W. R. (1998) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/290941.290948 · Cited by 87
Interactive visualization of multiple query results
Havre, S., Hetzler, E. G., Perrine, K. A., Jurrus, E. R., & Miller, N. E. (2005) · IEEE Symposium on Information Visualization · doi:10.1109/infvis.2001.963287 · Cited by 86
Text Classification by Boosting Weak Learners based on Terms and Concepts
Bloehdorn, S., & Hotho, A. (2005) · Proceedings · doi:10.1109/icdm.2004.10077 · Cited by 84
Self-citationLochbaum, K. E., & Streeter, L. A. (1989) · Information Processing & Management · doi:10.1016/0306-4573(89)90100-3 · Cited by 77
A statistical perspective on data mining
Hosking, J. R. M., Pednault, E., & Sudan, M. (1997) · Future Generation Computer Systems · doi:10.1016/s0167-739x(97)00016-2 · Cited by 59
Filtron: A Learning-Based Anti-Spam Filter
Michelakis, E., Androutsopoulos, I., Παλιούρας, Γ., et al. (2004) · Cited by 49
Dynamic Knowledge Representation for e-Learning Applications
Mendes, M., & Sacks, L. (2004) · Studies in fuzziness and soft computing · doi:10.1007/978-3-540-45218-8_12 · Cited by 29
He, B. (2018) · Springer eBooks · doi:10.1007/978-1-4614-8265-9_930 · Cited by 4
Cited by
A Review of Machine Learning Algorithms for Text-Documents Classification
Baharudin, B., Lee, L. H., & Khan, K. (2010) · Journal of Advances in Information Technology · doi:10.4304/jait.1.1.4-20 · Cited by 653
A Brief Survey of Text Mining: Classification, Clustering and Extraction Techniques
Allahyari, M., Pouriyeh, S., Assefi, M., Safaei, S., Trippe, E. D., Gutiérrez, J. B., & Kochut, K. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.02919 · Cited by 509
Real-Time Detection of Traffic From Twitter Stream Analysis
D'Andrea, E., Ducange, P., Lazzerini, B., & Marcelloni, F. (2015) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2404431 · Cited by 330
Leveraging deep learning with LDA-based text analytics to detect automobile insurance fraud
Wang, Y., & Xu, W. (2018) · Decision Support Systems · doi:10.1016/j.dss.2017.11.001 · Cited by 326
Xia, F., Wang, W., Bekele, T. M., & Liu, H. (2017) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2016.2641460 · Cited by 266
Metadata
- Authors
- Hotho, A., Nürnberger, A., & Paaß, G.
- Venue
- Journal for Language Technology and Computational Linguistics
- Publisher
- University Library J. C. Senckenberg
- Published
- 2005-07-01
- Volume
- 20
- Issue
- 1
- Pages
- 19-62
- ISSN
- 0175-1336 (ISSN-L)
- 2190-6858
- OpenAlex
- W80463681
- Cited by
- 893
- References
- 87
- FWCI
- 9.28
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.