The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Scatter/Gather: A Cluster-based Approach to Browsing Large Document Collections
Abstract
Document clustering has not been well received as an information retrieval tool. Objections to its use fall into two main categories: first, that clustering is too slow for large corpora (with running time often quadratic in the number of documents); and second, that clustering does not appreciably improve retrieval. We argue that these problems arise only when clustering is used in an attempt to improve conventional search techniques. However, looking at clustering as an information access tool in its own right obviates these objections, and provides a powerful new access paradigm. We present a document browsing technique that employs docum-ent clustering as its primary operation. We also present fast (linear time) clustering algorithm.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Introduction to Modern Information Retrieval
Salton, G., & McGill, M. J. (1983) · Virtual Defense Library (Ministerio de Defensa) · Cited by 11,392
Algorithms for Clustering Data
Sarle, W. S. (1990) · Technometrics · doi:10.1080/00401706.1990.10484648 · Cited by 7,865
SLINK: An optimally efficient algorithm for the single-link cluster method
Sibson, R. (1973) · The Computer Journal · doi:10.1093/comjnl/16.1.30 · Cited by 1,203
Recent trends in hierarchic document clustering: A critical review
Willett, P. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90027-1 · Cited by 705
The use of hierarchic clustering in information retrieval
Jardine, N., & van Rijsbergen, C. J. (1971) · Information Processing & Management · doi:10.1016/0020-0271(71)90051-9 · Cited by 603
Optimization of inverted vector searches
Buckley, C., & Lewit, A. F. (1985) · Proceedings of the 8th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '85 · doi:10.1145/253495.253515 · Cited by 216
Cited by
Authoritative sources in a hyperlinked environment
Kleinberg, J. M. (1999) · Journal of the ACM · doi:10.1145/324133.324140 · Cited by 8,959
From Frequency to Meaning: Vector Space Models of Semantics
Turney, P. D., & Pantel, P. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2934 · Cited by 2,866
A Survey of Clustering Data Mining Techniques
Berkhin, P. (2006) · Grouping Multidimensional Data · doi:10.1007/3-540-28349-8_2 · Cited by 2,804
Document clustering based on non-negative matrix factorization
Xu, W., Liu, X., & Gong, Y. (2003) · Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval · doi:10.1145/860435.860485 · Cited by 1,860
Authoritative sources in a hyperlinked environment
Kleinberg, J. M. (1998) · Symposium on Discrete Algorithms · doi:10.5555/314613.315045 · Cited by 1,814
Co-clustering documents and words using bipartite spectral graph partitioning
Dhillon, I. S. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502550 · Cited by 1,697
Concept Decompositions for Large Sparse Text Data Using Clustering
Dhillon, I. S., & Modha, D. S. (2001) · Machine Learning · doi:10.1023/a:1007612920971 · Cited by 1,293
Web document clustering: a feasibility demonstration
Zamir, O., & Etzioni, O. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.290956 · Cited by 1,055
Topic Detection and Tracking Pilot Study Final Report
Allan, J., Carbonell, J., Doddington, G. R., Yamron, J., & Yang, Y. (2018) · doi:10.1184/r1/6626252.v1 · Cited by 939
Hearst, M. A. (1999) · Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics - · doi:10.3115/1034678.1034679 · Cited by 867
Fast and effective text mining using linear-time document clustering
Larsen, B., & Aone, C. (1999) · Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/312129.312186 · Cited by 857
Reexamining the cluster hypothesis: scatter/gather on retrieval results
Hearst, M. A., & Pedersen, J. O. (1996) · Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '96 · doi:10.1145/243199.243216 · Cited by 822
Self-citationData Clustering: Algorithms and Applications
(2018) · Chapman & Hall/CRC eBooks · doi:10.1201/9781315373515 · Cited by 756
A study of retrospective and on-line event detection
Yang, Y., Pierce, T., & Carbonell, J. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.290953 · Cited by 731
Grouper: a dynamic clustering interface to Web search results
Zamir, O., & Etzioni, O. (1999) · Computer Networks · doi:10.1016/s1389-1286(99)00054-7 · Cited by 720
Creating efficient codebooks for visual recognition
Jurie, F., & Triggs, B. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.66 · Cited by 713
Finding Clusters of Different Sizes, Shapes, and Densities in Noisy, High Dimensional Data
Ertöz, L., Steinbach, M., & Kumar, V. (2003) · Proceedings of the 2003 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972733.5 · Cited by 703
Improved Algorithms for Topic Distillation in a Hyperlinked Environment
Bharat, K., & Henzinger, M. R. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130367 · Cited by 676
Exploratory Search: Beyond the Query-Response Paradigm
White, R. W., & Roth, R. A. (2009) · Synthesis lectures on information concepts, retrieval, and services · doi:10.2200/s00174ed1v01y200901icr003 · Cited by 632
Hierarchical Clustering Algorithms for Document Datasets
Zhao, Y., Karypis, G., & Fayyad, U. (2005) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-005-0361-3 · Cited by 627
Information visualization using 3D interactive animation
Robertson, G. G., Card, S. K., & Mackinlay, J. D. (1993) · Communications of the ACM · doi:10.1145/255950.153577 · Cited by 618
Data mining in soft computing framework: a survey
Mitra, S., Pal, S. K., & Mitra, P. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/72.977258 · Cited by 617
Empirical and Theoretical Comparisons of Selected Criterion Functions for Document Clustering
Zhao, Y., & Karypis, G. (2004) · Machine Learning · doi:10.1023/b:mach.0000027785.44527.d6 · Cited by 611
Aggarwal, C. C. (2015) · Data Mining · doi:10.1007/978-3-319-14142-8_13 · Cited by 606
Discovering word senses from text
Pantel, P., & Lin, D. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775138 · Cited by 591
A Survey of Text Clustering Algorithms
Aggarwal, C. C., & Zhai, C. (2012) · Mining Text Data · doi:10.1007/978-1-4614-3223-4_4 · Cited by 581
Probabilistic author-topic models for information discovery
Steyvers, M., Smyth, P., Rosen-Zvi, M., & Griffiths, T. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014087 · Cited by 572
Evaluation of hierarchical clustering algorithms for document datasets
Zhao, Y., & Karypis, G. (2002) · Proceedings of the eleventh international conference on Information and knowledge management · doi:10.1145/584792.584877 · Cited by 558
Rideout, J. R., He, Y., Navas-Molina, J. A., Walters, W. A., Ursell, L. K., Gibbons, S. M., Chase, J., McDonald, D., Gonzalez, A., Robbins-Pianka, A., et al. (2014) · PeerJ · doi:10.7717/peerj.545 · Cited by 548
Measuring semantic similarity between words using web search engines
(2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242675 · Cited by 540
The World-Wide Web: quagmire or gold mine?
Etzioni, O. (1996) · Communications of the ACM · doi:10.1145/240455.240473 · Cited by 527
A Brief Survey of Text Mining: Classification, Clustering and Extraction Techniques
Allahyari, M., Pouriyeh, S., Assefi, M., Safaei, S., Trippe, E. D., Gutiérrez, J. B., & Kochut, K. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.02919 · Cited by 509
Document clustering using word clusters via the information bottleneck method
Slonim, N., & Tishby, N. (2000) · Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/345508.345578 · Cited by 474
Hierarchical Document Clustering Using Frequent Itemsets
Fung, B. C. M., Wang, K., & Ester, M. (2003) · Proceedings of the 2003 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972733.6 · Cited by 471
Mining Heterogeneous Information Networks: Principles and Methodologies
Sun, Y., & Han, J. (2012) · Synthesis lectures on data mining and knowledge discovery · doi:10.2200/s00433ed1v01y201207dmk005 · Cited by 471
A bit of progress in language modeling
Goodman, J. T. (2001) · Computer Speech & Language · doi:10.1006/csla.2001.0174 · Cited by 469
Information foraging in information access environments
Pirolli, P., & Card, S. (1995) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '95 · doi:10.1145/223904.223911 · Cited by 464
Towards adaptive Web sites: Conceptual framework and case study
Perkowitz, M., & Etzioni, O. (2000) · Artificial Intelligence · doi:10.1016/s0004-3702(99)00098-3 · Cited by 433
Centroid-Based Document Classification: Analysis and Experimental Results
Han, E.-H., & Karypis, G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45372-5_46 · Cited by 409
A survey of Web clustering engines
Carpineto, C., Osiński, S., Romano, G., & Weiss, D. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541884 · Cited by 399
A Data-Clustering Algorithm on Distributed Memory Multiprocessors
Dhillon, I. S., & Modha, D. S. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-46502-2_13 · Cited by 386
RankClus: integrating clustering with ranking for heterogeneous information network analysis
Sun, Y., Han, J., Zhao, P., Yin, Z., Cheng, H., & Wu, T. (2009) · Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology · doi:10.1145/1516360.1516426 · Cited by 382
HCI Models, Theories, and Frameworks
(2003) · Elsevier eBooks · doi:10.1016/b978-1-55860-808-5.x5000-x · Cited by 373
Clustering versus faceted categories for information exploration
Hearst, M. A. (2006) · Communications of the ACM · doi:10.1145/1121949.1121983 · Cited by 368
Incremental clustering and dynamic information retrieval
Charikar, M., Chekuri, C., Feder, T., & Motwani, R. (1997) · Proceedings of the twenty-ninth annual ACM symposium on Theory of computing - STOC '97 · doi:10.1145/258533.258657 · Cited by 354
Web mining in soft computing framework: relevance, state of the art and future directions
Pal, S. K., Talwar, V., & Mitra, P. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2002.1031947 · Cited by 348
The FindMe approach to assisted browsing
Burke, R. D., Hammond, K. J., & Yound, B. C. (1997) · IEEE Expert · doi:10.1109/64.608186 · Cited by 343
Learning approaches for detecting and tracking news events
Yang, Y., Carbonell, J. G., Brown, R. D., Pierce, T., Archibald, B. T., & Liu, X. (1999) · IEEE Intelligent Systems · doi:10.1109/5254.784083 · Cited by 339
(2004) · Springer eBooks · doi:10.1007/978-1-4757-4305-0 · Cited by 310
Improved annotation of the blogosphere via autotagging and hierarchical clustering
Brooks, C. H., & Montanez, N. (2006) · Proceedings of the 15th international conference on World Wide Web · doi:10.1145/1135777.1135869 · Cited by 305
Learning author-topic models from text corpora
Rosen-Zvi, M., Chemudugunta, C., Griffiths, T., Smyth, P., & Steyvers, M. (2010) · ACM Transactions on Information Systems · doi:10.1145/1658377.1658381 · Cited by 302
Robertson, G. G., & Mackinlay, J. D. (1993) · Proceedings of the 6th annual ACM symposium on User interface software and technology · doi:10.1145/168642.168652 · Cited by 297
Cluster-based language models for distributed retrieval
Xu, J., & Croft, W. B. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312687 · Cited by 293
Recognizing text genres with simple metrics using discriminant analysis
Karlgren, J., & Cutting, D. (1994) · Proceedings of the 15th conference on Computational linguistics - · doi:10.3115/991250.991324 · Cited by 293
Self-citationData mining for hypertext: a tutorial survey
Chakrabarti, S. (2000) · ACM SIGKDD Explorations Newsletter · doi:10.1145/846183.846187 · Cited by 291
Event Detection in Social Streams
Aggarwal, C. C., & Subbian, K. (2012) · Proceedings of the 2012 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972825.54 · Cited by 287
A cooccurrence-based thesaurus and two applications to information retrieval
Schütze, H., & Pedersen, J. O. (1997) · Information Processing & Management · doi:10.1016/s0306-4573(96)00068-4 · Cited by 269
Self-citationBlikstein, P., Worsley, M., Piech, C., Sahami, M., Cooper, S., & Koller, D. (2014) · Journal of the Learning Sciences · doi:10.1080/10508406.2014.954750 · Cited by 267
Improving browsing in digital libraries with keyphrase indexes
Gutwin, C., Paynter, G., Witten, I., Nevill-Manning, C., & Frank, E. (1999) · Decision Support Systems · doi:10.1016/s0167-9236(99)00038-x · Cited by 262
Efficient algorithms for geometric optimization
Agarwal, P. K., & Sharir, M. (1998) · ACM Computing Surveys · doi:10.1145/299917.299918 · Cited by 257
Applications of text mining within systematic reviews
Thomas, J., McNaught, J., & Ananiadou, S. (2011) · Research Synthesis Methods · doi:10.1002/jrsm.27 · Cited by 212
Prioritising references for systematic reviews with RobotAnalyst: A user study
Przybyła, P., Brockmeier, A. J., Kontonatsios, G., Le Pogam, M., McNaught, J., von Elm, E., Nolan, K., & Ananiadou, S. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1311 · Cited by 148
Plagiarism Detection in Large Sets of Press Agency News Articles
Kienreich, W., Granitzer, M., Sabol, V., & Klieber, W. (2006) · 17th International Conference on Database and Expert Systems Applications (DEXA'06) · doi:10.1109/dexa.2006.112 · Cited by 12
Metadata
- Authors
- Cutting, D. R., Karger, D. R., Pedersen, J. O., & Tukey, J. W.
- Venue
- ACM SIGIR Forum
- Published
- 2017-08-02
- Volume
- 51
- Issue
- 2
- Pages
- 148-159
- ISSN
- 0163-5840 (ISSN-L)
- OpenAlex
- W1996764654
- Cited by
- 1,419
- References
- 6
- FWCI
- 53.49
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.