The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Probabilistic Latent Semantic Indexing
Abstract
Probabilistic Latent Semantic Indexing is a novel approach to automated document indexing which is based on a statistical latent class model for factor analysis of count data. Fitted from a training corpus of text documents by a generalization of the Expectation Maximization algorithm, the utilized model is able to deal with domain{specific synonymy as well as with polysemous words. In contrast to standard Latent Semantic Indexing (LSI) by Singular Value Decomposition, the probabilistic variant has a solid statistical foundation and defines a proper generative data model. Retrieval experiments on a number of test collections indicate substantial performance gains over direct term matching methods as well as over LSI. In particular, the combination of models with different dimensionalities has proven to be advantageous.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants
Neal, R. M., & Hinton, G. E. (1998) · Learning in Graphical Models · doi:10.1007/978-94-011-5014-9_12 · Cited by 2,187
Research works printed but not linked: 14
- 10.1002/(SICI)1097-4571(199009)41:6%3C391::AID-ASI1%3E3.0.CO;2-9 · DOI · Paper page
- Dumais , S. T. Latent semantic indexing (lsi): Trec-3 report . In Proceedings of the Text REtrieval Conference (TREC-3) ( 1995 ), D. Harman, Ed. , pp. 219 -- 230 . Dumais, S. T. Latent semantic indexing (lsi): Trec-3 report. In Proceedings of the Text REtrieval Conference (TREC-3) (1995), D. Harman, Ed., pp. 219--30.
- Gildea , D. , and Hofmann , T . Topic-based language models using em . In Proceedings of the 6th European Conference on Speech Communication and Technology(EUROSPEECH) ( 1999 ). Gildea, D., and Hofmann, T. Topic-based language models using em. In Proceedings of the 6th European Conference on Speech Communication and Technology(EUROSPEECH) (1999).
- 10.5555/1624312.1624317 · doi:10.5555/1624312.1624317
- Hofmann , T. Probabilistic latent semantic analysis . In Proceedings of the 15th Conference on Uncertainty in AI ( 1999 ). Hofmann, T. Probabilistic latent semantic analysis. In Proceedings of the 15th Conference on Uncertainty in AI (1999).
- Hofmann , T. , Puzicha , J. , and Jordan , M. I . Unsupervised learning from dyadic data . In Advances in Neural Information Processing Systems ( 1999 ), vol. 11 . Hofmann, T., Puzicha, J., and Jordan, M. I. Unsupervised learning from dyadic data. In Advances in Neural Information Processing Systems (1999), vol. 11.
- Linguistic Data Consortium . TDT pilot study corpus. Catalog no. LDC98T25 , 1998 . Linguistic Data Consortium. TDT pilot study corpus. Catalog no. LDC98T25, 1998.
- McLachlan , G. , and Basford , K. E . Mixture Models . Marcel Dekker , INC , New York Basel, 1988 . McLachlan, G., and Basford, K. E. Mixture Models. Marcel Dekker, INC, New York Basel, 1988.
- Murray , M. K. , and Rice , J. W . Differential geometry and statistics. No. 48 in Monographs on statistics and applied probability . Chapman & Hal , 1993 . Murray, M. K., and Rice, J. W. Differential geometry and statistics. No. 48 in Monographs on statistics and applied probability. Chapman & Hal, 1993.
- 10.3115/981574.981598 · DOI · Paper page
- 10.1016/0167-8655(90)90010-Y · DOI · Paper page
- Salton , G. , and McGill , M. J. Introduction to Modern Information Retrieval . McGraw-Hill , 1983 . Salton, G., and McGill, M. J. Introduction to Modern Information Retrieval. McGraw-Hill, 1983.
- Saul , L. , and Pereira , F . Aggregate and mixed order Markov models for statistical language processing . In Proceedings of the 2nd International Conference on Empirical Methods in Natural Language Processing ( 1997 ). Saul, L., and Pereira, F. Aggregate and mixed order Markov models for statistical language processing. In Proceedings of the 2nd International Conference on Empirical Methods in Natural Language Processing (1997).
- 10.1145/290941.290991 · doi:10.1145/290941.290991
Cited by
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts
Grimmer, J., & Stewart, B. M. (2013) · Political Analysis · doi:10.1093/pan/mps028 · Cited by 3,297
ArnetMiner: extraction and mining of academic social networks
Tang, J., Zhang, J., Yao, L., Li, J., Zhang, L., & Su, Z. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1402008 · Cited by 2,231
Latent semantic models for collaborative filtering
Hofmann, T. (2004) · ACM Transactions on Information Systems · doi:10.1145/963770.963774 · Cited by 1,378
Self-citationConvex and Semi-Nonnegative Matrix Factorizations
Ding, C. H. Q., Li, T., & Jordan, M. I. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.277 · Cited by 1,317
Topics in semantic representation
Griffiths, T. L., Steyvers, M., & Tenenbaum, J. B. (2007) · Psychological Review · doi:10.1037/0033-295x.114.2.211 · Cited by 1,122
topicmodels : An R Package for Fitting Topic Models
Grün, B., & Hornik, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v040.i13 · Cited by 1,072
A Fast Fixed-Point Algorithm for Independent Component Analysis of Complex Valued Signals
Bingham, E. (2000) · International Journal of Neural Systems · doi:10.1016/s0129-0657(00)00002-8 · Cited by 854
Machine learning and AI in marketing–Connecting computing power to human insights
Ma, L., & Sun, B. (2020) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2020.04.005 · Cited by 602
A dirichlet multinomial mixture model-based approach for short text clustering
Yin, J., & Wang, J. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623715 · Cited by 561
A survey on technical threat intelligence in the age of sophisticated cyber attacks
Tounsi, W., & Rais, H. (2018) · Computers & Security · doi:10.1016/j.cose.2017.09.001 · Cited by 474
Liu, X., Gao, J., He, X., Deng, L., Duh, K., & Wang, Y.-Y. (2015) · Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.3115/v1/n15-1092 · Cited by 395
A heuristic approach to determine an appropriate number of topics in topic modeling
Zhao, W., Chen, J. J., Perkins, R., Liu, Z., Ge, W., Ding, Y., & Zou, W. (2015) · BMC Bioinformatics · doi:10.1186/1471-2105-16-s13-s8 · Cited by 382
Golparvar-Fard, M., Heydarian, A., & Niebles, J. C. (2013) · Advanced Engineering Informatics · doi:10.1016/j.aei.2013.09.001 · Cited by 286
Unsupervised machine learning for exploratory data analysis in imaging mass spectrometry
Verbeeck, N., Caprioli, R. M., & Van de Plas, R. (2020) · Mass Spectrometry Reviews · doi:10.1002/mas.21602 · Cited by 281
Text mining for information systems researchers: An annotated topic modeling tutorial
University of Liechtenstein, Debortoli, S., Müller, O., IT University of Copenhagen, Junglas, I., Florida State University, vom Brocke, J., & University of Liechtenstein (2016) · Communications of the Association for Information Systems · doi:10.17705/1cais.03907 · Cited by 199
Crumbs of the Cookie: User Profiling in Customer-Base Analysis and Behavioral Targeting
Trusov, M., Ma, L., & Jamal, Z. (2016) · Marketing Science · doi:10.1287/mksc.2015.0956 · Cited by 165
Prioritising references for systematic reviews with RobotAnalyst: A user study
Przybyła, P., Brockmeier, A. J., Kontonatsios, G., Le Pogam, M., McNaught, J., von Elm, E., Nolan, K., & Ananiadou, S. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1311 · Cited by 148
Cronen-Townsend, S., & Croft, W. B. (2002) · Proceedings of the second international conference on Human Language Technology Research - · doi:10.3115/1289189.1289266 · Cited by 132
Human Robot Engagement and Acceptability in Residential Aged Care
Khosla, R., Nguyen, K., & Chu, M.-T. (2017) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2016.1275435 · Cited by 124
Interleaved text/image Deep Mining on a large-scale radiology database
Shin, H.-C., Lu, L., Kim, L., Seff, A., Yao, J., & Summers, R. M. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298712 · Cited by 94
SWISH: semantic analysis of window titles and switching history
Oliver, N., Smith, G., Thakkar, C., & Surendran, A. C. (2006) · Proceedings of the 11th international conference on Intelligent user interfaces · doi:10.1145/1111449.1111492 · Cited by 89
The Anchoring Effect in Decision-Making with Visual Analytics
Cho, I., Wesslen, R., Karduni, A., Santhanam, S., Shaikh, S., & Dou, W. (2017) · 2017 IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2017.8585665 · Cited by 88
Identifying biological concepts from a protein-related corpus with a probabilistic topic model
Zheng, B., McLean, D. C., & Lu, X. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-58 · Cited by 68
Exploiting Publication Contents and Collaboration Networks for Collaborator Recommendation
Kong, X., Jiang, H., Yang, Z., Xu, Z., Xia, F., & Tolba, A. (2016) · PLOS ONE · doi:10.1371/journal.pone.0148492 · Cited by 67
Blogs as a collective war diary
Mark, G., Bagdouri, M., Palen, L., Martin, J., Al-Ani, B., & Anderson, K. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145215 · Cited by 51
(2015) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 34
A coarse-to-fine framework to efficiently thwart plagiarism
Zhang, H., & Chow, T. W. S. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2010.08.023 · Cited by 31
Self-Tuned Descriptive Document Clustering Using a Predictive Network
Brockmeier, A. J., Mu, T., Ananiadou, S., & Goulermas, J. Y. (2018) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2781721 · Cited by 15
Local Factor Models for Large-Scale Inductive Recommendation
Yang, L., Schnabel, T., Bennett, P. N., & Dumais, S. (2021) · Fifteenth ACM Conference on Recommender Systems · doi:10.1145/3460231.3474276 · Cited by 6
Metadata
- Authors
- Hofmann, T.
- Venue
- ACM SIGIR Forum
- Published
- 2017-08-02
- Volume
- 51
- Issue
- 2
- Pages
- 211-218
- ISSN
- 0163-5840 (ISSN-L)
- OpenAlex
- W2107743791
- Cited by
- 3,988
- References
- 2
- FWCI
- 141.20
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.