The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
UTOPIAN: User-Driven Topic Modeling Based on Interactive Nonnegative Matrix Factorization
Abstract
Topic modeling has been widely used for analyzing text document collections. Recently, there have been significant advancements in various topic modeling techniques, particularly in the form of probabilistic graphical modeling. State-of-the-art techniques such as Latent Dirichlet Allocation (LDA) have been successfully applied in visual text analytics. However, most of the widely-used methods based on probabilistic modeling have drawbacks in terms of consistency from multiple runs and empirical convergence. Furthermore, due to the complicatedness in the formulation and the algorithm, LDA cannot easily incorporate various types of user feedback. To tackle this problem, we propose a reliable and flexible visual analytics system for topic modeling called UTOPIAN (User-driven Topic modeling based on Interactive Nonnegative Matrix Factorization). Centered around its semi-supervised formulation, UTOPIAN enables users to interact with the topic modeling method and steer the result in a user-driven manner. We demonstrate the capability of UTOPIAN via several usage scenarios with real-world document corpuses such as InfoVis/VAST paper data set and product review data sets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2008) · Journal of Machine Learning Research · Cited by 33,051
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Learning the parts of objects by non-negative matrix factorization
Lee, D. D., & Seung, H. S. (1999) · Nature · doi:10.1038/44565 · Cited by 13,868
The Hungarian method for the assignment problem
Kuhn, H. W. (1955) · Naval Research Logistics Quarterly · doi:10.1002/nav.3800020109 · Cited by 13,120
Indexing by latent semantic analysis
Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6<391::aid-asi1>3.0.co;2-9 · Cited by 12,751
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,223
Goodall, C. (1988) · Technometrics · doi:10.1080/00401706.1988.10488412 · Cited by 8,675
Jolliffe, I. T. (1986) · Springer Series in Statistics · doi:10.1007/978-1-4757-1904-8 · Cited by 8,273
Multidimensional Scaling by Optimizing Goodness of Fit to a Nonmetric Hypothesis
Kruskal, J. B. (1964) · Psychometrika · doi:10.1007/bf02289565 · Cited by 7,317
Paatero, P., & Tapper, U. (1994) · Environmetrics · doi:10.1002/env.3170050203 · Cited by 6,023
Probabilistic Latent Semantic Indexing
Hofmann, T. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130370 · Cited by 3,988
Probabilistic latent semantic indexing
Hofmann, T. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312649 · Cited by 3,976
Fast collapsed gibbs sampling for latent dirichlet allocation
Porteous, I., Newman, D., Ihler, A., Asuncion, A., Smyth, P., & Welling, M. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401960 · Cited by 560
Generalizing discriminant analysis using the generalized singular value decomposition
Howland, P., & Park, H. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.46 · Cited by 368
Self-citationTextFlow: Towards Better Understanding of Evolving Topics in Text
Cui, W., Liu, S., Tan, L., Shi, C., Song, Y., Gao, Z., Qu, H., & Tong, X. (2011) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2011.239 · Cited by 349
Hu, Y., Boyd-Graber, J., Satinoff, B., & Smith, A. (2014) · Machine Learning · doi:10.1007/s10994-013-5413-0 · Cited by 338
Fast Nonnegative Matrix Factorization: An Active-Set-Like Method and Comparisons
Kim, J., & Park, H. (2011) · SIAM Journal on Scientific Computing · doi:10.1137/110821172 · Cited by 328
Self-citationLearning Topic Models -- Going beyond SVD
Arora, S., Ge, R., & Moitra, A. (2012) · 2012 IEEE 53rd Annual Symposium on Foundations of Computer Science · doi:10.1109/focs.2012.49 · Cited by 302
Jigsaw: Supporting Investigative Analysis through Interactive Visualization
Stasko, J., Görg, C., & Liu, Z. (2008) · Information Visualization · doi:10.1057/palgrave.ivs.9500180 · Cited by 280
Animation, Small Multiples, and the Effect of Mental Map Preservation in Dynamic Graphs
Archambault, D., Purchase, H., & Pinaud, B. (2011) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2010.78 · Cited by 255
Jigsaw: Supporting Investigative Analysis through Interactive Visualization
Stasko, J., Gorg, C., Liu, Z., & Singhal, K. (2007) · 2007 IEEE Symposium on Visual Analytics Science and Technology · doi:10.1109/vast.2007.4389006 · Cited by 240
TIARA: a visual exploratory text analytic system
Wei, F., Liu, S., Song, Y., Pan, S., Zhou, M. X., Qian, W., Shi, L., Tan, L., & Zhang, Q. (2010) · Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1835804.1835827 · Cited by 199
TopicNets: Visual Analysis of Large Text Corpora with Topic Modeling
Gretarsson, B., O’Donovan, J., Bostandjiev, S., Höllerer, T., Asuncion, A., Newman, D. J., & Smyth, P. (2012) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2089094.2089099 · Cited by 184
The ecological approach to text visualization
Wise, J. A. (1999) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(1999)50:13<1224::aid-asi8>3.0.co;2-4 · Cited by 184
LeadLine: Interactive visual analysis of text data through event identification and exploration
Dou, W., Wang, X., Skau, D., Ribarsky, W., & Zhou, M. X. (2012) · 2012 IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2012.6400485 · Cited by 168
iVisClustering: An Interactive Visual Document Clustering via Topic Modeling
Lee, H., Kihm, J., Choo, J., Stasko, J., & Park, H. (2012) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2012.03108.x · Cited by 160
Self-citationAndrzejewski, D., Zhu, X., Craven, M. W., & Recht, B. (2011) · University of North Texas Digital Library (University of North Texas) · doi:10.5591/978-1-57735-516-8/ijcai11-200 · Cited by 138
Choo, J., Lee, H., Kihm, J., & Park, H. (2010) · IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2010.5652443 · Cited by 131
Self-citationParallelTopics: A probabilistic approach to exploring document collections
Dou, W., Wang, X., Chang, R., & Ribarsky, W. (2011) · IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2011.6102461 · Cited by 124
Visual text mining using association rules
Lopes, A. A., de Pinho, R., Paulovich, F. V., & Minghim, R. (2007) · Computers & Graphics · doi:10.1016/j.cag.2007.01.023 · Cited by 92
Paulovich, F. V., & Minghim, R. (2008) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2008.138 · Cited by 86
ClusterSculptor: A Visual Analytics Tool for High-Dimensional Data
Nam, E. J., Han, Y., Klaus, M., Zelenyuk, A., & Imre, D. G. (2007) · IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2007.4388999 · Cited by 76
Customizing Computational Methods for Visual Analytics with Big Data
Choo, J., & Park, H. (2013) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2013.39 · Cited by 61
Self-citationiVIBRATE: Interactive visualization-based framework for clustering large datasets
Chen, K., & Liu, L. (2006) · ACM Transactions on Information Systems · doi:10.1145/1148020.1148024 · Cited by 59
DClusterE: A Framework for Evaluating and Understanding Document Clustering Using Visualization
Zhang, Y., & Li, T. (2012) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2089094.2089100 · Cited by 23
Scatter/Gather Clustering: Flexibly Incorporating User Feedback to Steer Clustering Results
Hossain, M. S., Ojili, P. K. R., Grimm, C. M., Müller, R., Watson, L. T., & Ramakrishnan, N. (2012) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2012.258 · Cited by 21
Cited by
Latent Dirichlet allocation (LDA) and topic modeling: models, applications, a survey
Jelodar, H., Wang, Y., Yuan, C., Feng, X., Jiang, X., Li, Y., & Zhao, L. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6894-4 · Cited by 1,961
von Rueden, L., Mayer, S., Beckh, K., Georgiev, B., Giesselbach, S., Heese, R., Kirsch, B., Walczak, M., Pfrommer, J., Pick, A., et al. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3079836 · Cited by 793
Towards better analysis of machine learning models: A visual analytics perspective
Liu, S., Wang, X., Liu, M., & Zhu, J. (2017) · Visual Informatics · doi:10.1016/j.visinf.2017.01.006 · Cited by 397
Kwon, B. C., Choi, M.-J., Kim, J. T., Choi, E., Kim, Y. B., Kwon, S., Sun, J., & Choo, J. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2865027 · Cited by 294
“There have been a number of studies to develop tools where users can interact with the results of machine learning tasks such as classification [24,30,53], topic modeling [17,25,50], dimensionality reduction [6,46] and clustering [18, 45, 49].”
BackgroundSelf-citationNonato, L. G., & Aupetit, M. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2846735 · Cited by 259
Metadata
- Authors
- Choo, J., Lee, C., Reddy, C. K., & Park, H.
- Venue
- IEEE Transactions on Visualization and Computer Graphics
- Published
- 2013-12
- Volume
- 19
- Issue
- 12
- Pages
- 1992-2001
- ISSN
- 1077-2626 (ISSN-L)
- OpenAlex
- W2087382273
- Cited by
- 262
- References
- 36
- FWCI
- 19.33
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.