The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Learning author-topic models from text corpora
Abstract
We propose an unsupervised learning technique for extracting information about authors and topics from large text collections. We model documents as if they were generated by a two-stage stochastic process. An author is represented by a probability distribution over topics, and each topic is represented as a probability distribution over words. The probability distribution over topics in a multi-author paper is a mixture of the distributions associated with the authors. The topic-word and author-topic distributions are learned from data in an unsupervised manner using a Markov chain Monte Carlo algorithm. We apply the methodology to three large text corpora: 150,000 abstracts from the CiteSeer digital library, 1740 papers from the Neural Information Processing Systems (NIPS) Conferences, and 121,000 emails from the Enron corporation. We discuss in detail the interpretation of the results discovered by the system including specific topic and author models, ranking of authors by topic and topics by author, parsing of abstracts by topics and authors, and detection of unusual papers by specific authors. Experiments based on perplexity scores for test documents and precision-recall for document retrieval are used to illustrate systematic differences between the proposed author-topic model and a number of alternatives. Extensions to the model, allowing for example, generalizations of the notion of an author, are also briefly discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Inference of Population Structure Using Multilocus Genotype Data
Pritchard, J. K., Stephens, M., & Donnelly, P. (2000) · Genetics · doi:10.1093/genetics/155.2.945 · Cited by 33,908
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Learning the parts of objects by non-negative matrix factorization
Lee, D. D., & Seung, H. S. (1999) · Nature · doi:10.1038/44565 · Cited by 13,868
Indexing by latent semantic analysis
Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6<391::aid-asi1>3.0.co;2-9 · Cited by 12,751
Markov Chain Monte Carlo in Practice
(1995) · Chapman & Hall/CRC eBooks · doi:10.1201/b14835 · Cited by 7,757
Griffiths, T. L., & Steyvers, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307752101 · Cited by 6,049
Self-citationProceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771
Probabilistic Latent Semantic Indexing
Hofmann, T. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130370 · Cited by 3,988
Probabilistic latent semantic indexing
Hofmann, T. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312649 · Cited by 3,976
Bayesian Inference in Statistical Analysis.
Kadane, J. B., Box, G. E. P., & Tiao, G. C. (1975) · Journal of the American Statistical Association · doi:10.2307/2285412 · Cited by 3,824
A Language Modeling Approach to Information Retrieval
Ponte, J. M., & Croft, W. B. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130368 · Cited by 2,503
Robertson, S. E., Walker, S., Jones, S., Hancock‐Beaulieu, M., & Gatford, M. (1994) · Text REtrieval Conference · Cited by 2,212
Hierarchical Dirichlet Processes
Teh, Y. W., Jordan, M. I., Beal, M. J., & Blei, D. M. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000302 · Cited by 2,120
Scientific collaboration networks. I. Network construction and fundamental results
Newman, M. E. J. (2001) · Physical Review E · doi:10.1103/physreve.64.016131 · Cited by 2,076
An Evaluation of Statistical Approaches to Text Categorization
Yang, Y. (1999) · Information Retrieval · doi:10.1023/a:1009982220290 · Cited by 1,943
A language modeling approach to information retrieval
Ponte, J. M., & Croft, W. B. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.291008 · Cited by 1,821
Using Linear Algebra for Intelligent Information Retrieval
Berry, M. W., Dumais, S. T., & O’Brien, G. W. (1995) · SIAM Review · doi:10.1137/1037127 · Cited by 1,481
Scatter/Gather: A Cluster-based Approach to Browsing Large Document Collections
Cutting, D. R., Karger, D. R., Pedersen, J. O., & Tukey, J. W. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130362 · Cited by 1,419
Concept Decompositions for Large Sparse Text Data Using Clustering
Dhillon, I. S., & Modha, D. S. (2001) · Machine Learning · doi:10.1023/a:1007612920971 · Cited by 1,293
The author-topic model for authors and documents
Rosen‐Zvi, M., Griffiths, T. L., Steyvers, M., & Smyth, P. (2004) · Uncertainty in Artificial Intelligence · doi:10.5555/1036843.1036902 · Cited by 1,280
Self-citationEfficient clustering of high-dimensional data sets with application to reference matching
McCallum, A., Nigam, K., & Ungar, L. H. (2000) · Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/347090.347123 · Cited by 1,096
LDA-based document models for ad-hoc retrieval
Wei, X., & Croft, W. B. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148204 · Cited by 1,075
Mapping authors in intellectual space: A technical overview
McCain, K. W. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6<433::aid-asi11>3.0.co;2-q · Cited by 989
Scatter/Gather: a cluster-based approach to browsing large document collections
Cutting, D. R., Karger, D. R., Pedersen, J. O., & Tukey, J. W. (1992) · Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '92 · doi:10.1145/133160.133214 · Cited by 953
A probabilistic model of information retrieval: development and comparative experiments
Sparck Jones, K., Walker, S., & Robertson, S. E. (2000) · Information Processing & Management · doi:10.1016/s0306-4573(00)00015-7 · Cited by 942
Lafferty, J., & Blei, D. M. (2005) · neural information processing systems · Cited by 917
Inference and disputed authorship : The Federalist
Mosteller, F. C., & Wallace, D. L. (1964) · Medical Entomology and Zoology · Cited by 904
Referral Web: combining social networks and collaborative filtering
Kautz, H., Selman, B., & Shah, M. (1997) · Communications of the ACM · doi:10.1145/245108.245123 · Cited by 847
Markov chain Monte Carlo method and its application
Brooks, S. (1998) · Journal of the Royal Statistical Society: Series D (The Statistician) · doi:10.1111/1467-9884.00117 · Cited by 843
Pachinko allocation: DAG-structured mixture models of topic correlations
Li, W., & McCallum, A. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143917 · Cited by 609
Digital libraries and autonomous citation indexing
Lawrence, S., Lee Giles, C., & Bollacker, K. (1999) · Computer · doi:10.1109/2.769447 · Cited by 607
Griffiths, T. L., Steyvers, M., Blei, D. M., & Tenenbaum, J. B. (2004) · neural information processing systems · Cited by 587
Self-citationProbabilistic author-topic models for information discovery
Steyvers, M., Smyth, P., Rosen-Zvi, M., & Griffiths, T. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014087 · Cited by 572
Self-citationThe Evolution of Stylometry in Humanities Scholarship
HOLMES, D. I. (1998) · Literary and Linguistic Computing · doi:10.1093/llc/13.3.111 · Cited by 478
Mixed-membership models of scientific publications
Erosheva, E., Fienberg, S., & Lafferty, J. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307760101 · Cited by 442
Expectation-propagation for the generative aspect model
Minka, T. P., & Lafferty, J. (2002) · Cited by 439
The Missing Link - A Probabilistic Model of Document Content and Hypertext Connectivity
Cohn, D. A., & Hofmann, T. (2000) · Cited by 436
Exponential Family Harmoniums with an Application to Information Retrieval
Welling, M., Rosen‐Zvi, M., & Hinton, G. E. (2004) · Cited by 423
Self-citationKull, M., Filho, T. M. S., & Flach, P. A. (2017) · Cited by 418
Updating Schemes, Correlation Structure, Blocking and Parameterization for the Gibbs Sampler
Roberts, G. O., & Sahu, S. K. (1997) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00070 · Cited by 409
Algorithms for estimating relative importance in networks
White, S., & Smyth, P. (2003) · Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/956750.956782 · Cited by 408
Self-citationAuthorship Attribution with Support Vector Machines
Diederich, J., Kindermann, J., Leopold, E., & Paass, G. (2003) · Applied Intelligence · doi:10.1023/a:1023824908771 · Cited by 364
Topic and role discovery in social networks
McCallum, A., Corrada-Emmanuel, A., & Wang, X. (2005) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 287
Parametric Mixture Models for Multi-Labeled Text
Ueda, N., & Saito, K. (2002) · Cited by 287
Gruber, A., Weiss, Y., & Rosen‐Zvi, M. (2007) · Cited by 242
Self-citationModeling General and Specific Aspects of Documents with a Probabilistic Topic Model
Chemudugunta, C., Smyth, P., & Steyvers, M. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0035 · Cited by 186
Self-citationGaP: a factor model for discrete data
Canny, J. (2004) · Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1008992.1009016 · Cited by 178
Did Shakespeare Write a Newly-Discovered Poem?
Thisted, R. A., & Efron, B. (1987) · Biometrika · doi:10.1093/biomet/74.3.445 · Cited by 175
Modeling long distance dependence in language: topic mixtures versus dynamic cache models
Iyer, R. M., & Mari Ostendorf, E. (1999) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.736328 · Cited by 157
A mixture model for contextual text mining
Mei, Q., & Zhai, C. (2006) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1150402.1150482 · Cited by 139
McCallum, A., Corrada-Emmanuel, A., & Wang, X. (2005) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 130
Applying Discrete PCA in Data AnalysisPreprint
Buntine, W., & Jakulin, A. (2012) · Repository of the University of Ljubljana (University of Ljubljana) · doi:10.5555/1036843.1036851 · Cited by 118
Did Shakespeare Write a Newly-Discovered Poem?
Thisted, R. A., & Efron, B. (1987) · Biometrika · doi:10.2307/2336684 · Cited by 105
Authorship Determination Using Letter Pair Frequency Features with Neural Network Classifiers
Kjell, B. P. (1995) · Literary and Linguistic Computing · doi:10.1093/llc/9.2.119 · Cited by 100
Software Forensics: Extending Authorship Analysis Techniques to Computer Programs
MacDonell, S. G., Buckingham, D. W., Gray, A. R., & Sallis, P. J. (2002) · Tuwhera (Auckland University of Technology) · Cited by 97
Websom for Textual Data Mining
Lagus, K., Honkela, T., Samuel Kaski, A., & Kohonen, T. (1999) · Artificial Intelligence Review · doi:10.1023/a:1006586221250 · Cited by 96
Sufficient dimensionality reduction
Globerson, A., & Tishby, N. (2003) · doi:10.5555/944919.944975 · Cited by 80
Software Forensics: Extending Authorship Analysis Techniques to Computer Programs
Gray, A., Sallis, P. J., & Macdonell, S. (1997) · Otago University Research Archive (University of Otago) · Cited by 34
Cited by
stm : An R Package for Structural Topic Models
Roberts, M. E., Stewart, B. M., & Tingley, D. (2019) · Journal of Statistical Software · doi:10.18637/jss.v091.i02 · Cited by 1,714
Empirical study of topic modeling in Twitter
Hong, L., & Davison, B. D. (2010) · Proceedings of the First Workshop on Social Media Analytics · doi:10.1145/1964858.1964870 · Cited by 1,120
topicmodels : An R Package for Fitting Topic Models
Grün, B., & Hornik, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v040.i13 · Cited by 1,072
Transfer Learning for Visual Categorization: A Survey
Shao, L., Zhu, F., & Li, X. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2330900 · Cited by 895
Transparency and Deliberation Within the FOMC: A Computational Linguistics Approach*
Hansen, S., McMahon, M., & Prat, A. (2018) · The Quarterly Journal of Economics · doi:10.1093/qje/qjx045 · Cited by 631
Metadata
- Authors
- Rosen-Zvi, M., Chemudugunta, C., Griffiths, T., Smyth, P., & Steyvers, M.
- Venue
- ACM Transactions on Information Systems
- Published
- 2010-01
- Volume
- 28
- Issue
- 1
- Pages
- 1-38
- ISSN
- 1046-8188 (ISSN-L)
- 1558-2868
- OpenAlex
- W2069078812
- Cited by
- 302
- References
- 58
- FWCI
- 25.17
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.