The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Authorship Attribution
Abstract
Authorship attribution, the science of inferring characteristics of the author from the characteristics of documents written by that author, is a problem with a long history and a wide range of application. Recent work in “non-traditional” authorship attribution demonstrates the practicality of automatically analyzing documents based on authorial style, but the state of the art is confusing. Analyses are difficult to apply, little is known about type or rate of errors, and few “best practices” are available. In part because of this confusion, the field has perhaps had less uptake and general acceptance than is its due. This review surveys the history and present state of the discipline, presenting some comparative results when available. It shows, first, that the discipline is quite successful, even in difficult cases involving small documents in unfamiliar and less studied languages; it further analyzes the types of analysis and features used and tries to determine characteristics of well-performing systems, finally formulating these in a set of recommendations for best practices.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
A Tutorial on Support Vector Machines for Pattern Recognition
Burges, C. J. C. (1998) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009715923555 · Cited by 16,429
Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations
Rumelhart, D. E., McClelland, J. L., & AU (1986) · doi:10.7551/mitpress/5236.001.0001 · Cited by 15,686
SIMPSON, E. H. (1949) · Nature · doi:10.1038/163688a0 · Cited by 14,164
McClelland, J. L., Rumelhart, D. E., & AU (1987) · doi:10.7551/mitpress/5237.001.0001 · Cited by 3,315
Prediction and Entropy of Printed English
Shannon, C. E. (1951) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1951.tb01366.x · Cited by 2,686
Psychological Aspects of Natural Language Use: Our Words, Our Selves
Pennebaker, J. W., Mehl, M. R., & Niederhoffer, K. G. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145041 · Cited by 2,624
Linguistic styles: language use as an individual difference
Pennebaker, J. W., & King, L. A. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.6.1296 · Cited by 1,961
Corpus Linguistics: Investigating Language Structure and Use
Biber, D., Conrad, S., & Reppen, R. (1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511804489 · Cited by 1,499
Lying Words: Predicting Deception from Linguistic Styles
Newman, M. L., Pennebaker, J. W., Berry, D. S., & Richards, J. M. (2003) · Personality and Social Psychology Bulletin · doi:10.1177/0146167203029005010 · Cited by 1,439
Learning to Classify Text Using Support Vector Machines
Joachims, T. (2002) · Springer eBooks · doi:10.1007/978-1-4615-0907-3 · Cited by 1,366
Language use of depressed and depression-vulnerable college students
Rude, S., Gortner, E.-M., & Pennebaker, J. (2004) · Cognition & Emotion · doi:10.1080/02699930441000030 · Cited by 1,018
Delta: A Measure of Stylistic Difference and a Guide to Likely Authorship
Burrows, J. (2002) · Literary and Linguistic Computing · doi:10.1093/llc/17.3.267 · Cited by 627
Automatically Categorizing Written Texts by Author Gender
Koppel, M. (2002) · Literary and Linguistic Computing · doi:10.1093/llc/17.4.401 · Cited by 623
A practical part-of-speech tagger
Cutting, D., Kupiec, J., Pedersen, J., & Sibun, P. (1992) · Proceedings of the third conference on Applied natural language processing - · doi:10.3115/974499.974523 · Cited by 618
Zheng, R., Li, J., Chen, H., & Huang, Z. (2006) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20316 · Cited by 519
Words of wisdom: Language use over the life span
Pennebaker, J. W., & Stone, L. D. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.2.291 · Cited by 518
The Evolution of Stylometry in Humanities Scholarship
HOLMES, D. I. (1998) · Literary and Linguistic Computing · doi:10.1093/llc/13.3.111 · Cited by 478
The Characteristic Curves of Composition
Mendenhall, T. C. (1887) · Science · doi:10.1126/science.ns-9.214s.237 · Cited by 406
Applying Authorship Analysis to Extremist-Group Web Forum Messages
Abbasi, A., & Chen, H. (2005) · IEEE Intelligent Systems · doi:10.1109/mis.2005.81 · Cited by 399
Outside the cave of shadows: using syntactic annotation to enhance authorship attribution
Baayen, H., van Halteren, H., & Tweedie, F. (1996) · Literary and Linguistic Computing · doi:10.1093/llc/11.3.121 · Cited by 388
Benedetto, D., Caglioti, E., & Loreto, V. (2002) · Physical Review Letters · doi:10.1103/physrevlett.88.048702 · Cited by 364
Holmes, D. I. (1994) · Computers and the Humanities · doi:10.1007/bf01830689 · Cited by 272
The Federalist Revisited: New Directions in Authorship Attribution
HOLMES, D. I. (1995) · Literary and Linguistic Computing · doi:10.1093/llc/10.2.111 · Cited by 268
The State of Authorship Attribution Studies: Some Problems and Solutions
Rudman, J. (1997) · Computers and the Humanities · doi:10.1023/a:1001018624850 · Cited by 243
Attributing Authorship: An Introduction
Love, H. (2002) · doi:10.1017/cbo9780511483165 · Cited by 235
Computer-Based Authorship Attribution Without Lexical Measures
Stamatatos, E., Fakotakis, N., & Kokkinakis, G. (2001) · Computers and the Humanities · doi:10.1023/a:1002681919510 · Cited by 219
Neural network applications in stylometry: The Federalist Papers
Tweedie, F. J., Singh, S., & Holmes, D. I. (1996) · Computers and the Humanities · doi:10.1007/bf00054024 · Cited by 209
Hoover, D. L. (2004) · Literary and Linguistic Computing · doi:10.1093/llc/19.4.453 · Cited by 200
Who Wrote the 15th Book of Oz? An Application of Multivariate Analysis to Authorship Attribution
Binongo, J. N. G. (2003) · CHANCE · doi:10.1080/09332480.2003.10554843 · Cited by 195
A Controlled-corpus Experiment in Authorship Identification by Cross-entropy
Juola, P. (2005) · Literary and Linguistic Computing · doi:10.1093/llc/fqi024 · Cited by 151
Self-citationNew Machine Learning Methods Demonstrate the Existence of a Human Stylome
van Halteren, H., Baayen, R. H., Tweedie, F. C., Haverkort, M., & Neijt, A. (2005) · Journal of Quantitative Linguistics · doi:10.1080/09296170500055350 · Cited by 149
Neural Computation in Stylometry I: An Application to the Works of Shakespeare and Fletcher
Matthews, R. (1993) · Literary and Linguistic Computing · doi:10.1093/llc/8.4.203 · Cited by 145
Another Perspective on Vocabulary Richness
Hoover, D. L. (2003) · Computers and the Humanities · doi:10.1023/a:1022673822140 · Cited by 128
The necessity of syntax markers: Two experiments with artificial languages
Green, T. R. G. (1979) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(79)90264-0 · Cited by 127
Change of Writing Style with Time
Can, F., & Patton, J. (2003) · Computers and the Humanities · doi:10.1023/b:chum.0000009225.28847.77 · Cited by 118
Using Markov chains for identification of writers
Khmelev, D. (2001) · Literary and Linguistic Computing · doi:10.1093/llc/16.3.299 · Cited by 116
And then there were none: Winnowing the Shakespeare claimants
Elliott, W. E. Y., & Valenza, R. J. (1996) · Computers and the Humanities · doi:10.1007/bf00055107 · Cited by 105
Segmenting documents by stylistic character
GRAHAM, N., Hirst, G., & Marthi, B. (2005) · Natural Language Engineering · doi:10.1017/s1351324905003694 · Cited by 105
A Prototype for Authorship Attribution Studies
Juola, P., Sofko, J., & Brennan, P. (2006) · Digital Scholarship in the Humanities · doi:10.1093/llc/fql019 · Cited by 88
Self-citationCraig, H. (1999) · Literary and Linguistic Computing · doi:10.1093/llc/14.1.103 · Cited by 87
Hoover, D. L. (2004) · Literary and Linguistic Computing · doi:10.1093/llc/19.4.477 · Cited by 86
Obfuscating document stylometry to preserve author anonymity
Kacmarcik, G., & Gamon, M. (2006) · doi:10.3115/1273073.1273131 · Cited by 86
Neural Computation in Stylometry II: An Application to the Works of Shakespeare and Marlowe
Merriam, T. (1994) · Literary and Linguistic Computing · doi:10.1093/llc/9.1.1 · Cited by 86
An Assessment of Cumulative Sum Charts for Authorship Attribution
Hilton, M. L. (1993) · Literary and Linguistic Computing · doi:10.1093/llc/8.2.73 · Cited by 85
Feature instability as a criterion for selecting potential style markers
Koppel, M., Akiva, N., & Dagan, I. (2006) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20428 · Cited by 80
On the utility of content analysis in author attribution:The Federalist
Martindale, C., & McKenzie, D. P. (1995) · Computers and the Humanities · doi:10.1007/bf01830395 · Cited by 73
‘An ocean where each kind. . .’: Statistical analysis and some major determinants of literary style
Burrows, J. F. (1989) · Computers and the Humanities · doi:10.1007/bf02176636 · Cited by 63
The Time Course of Language Change
Juola, P. (2003) · Computers and the Humanities · doi:10.1023/a:1021839220474 · Cited by 60
Self-citationON MATHEMATICAL ANALYSIS OF STYLE
Fucks, W. (1952) · Biometrika · doi:10.1093/biomet/39.1-2.122 · Cited by 55
The Keyboard Dilemma and Authorship Identification
Chaski, C. E. (2007) · Springer eBooks · doi:10.1007/978-0-387-73742-3_9 · Cited by 36
Authorship Attribution and Pastiche
SOMERS, H. L., & Tweedie, F. C. (2003) · Computers and the Humanities · doi:10.1023/a:1025786724466 · Cited by 34
The Professor Doth Protest Too Much, Methinks: Problems with the Foster ”Response“
Elliott, W. E. Y., & Valenza, R. J. (1998) · Computers and the Humanities · doi:10.1023/a:1001790606258 · Cited by 25
Authorship Attribution for Electronic Documents
Juola, P. (2006) · IFIP advances in information and communication technology · doi:10.1007/0-387-36891-4_10 · Cited by 24
Self-citationWeighted Cumulative Sums for Text Analysis Using Word Counts
Bissell, A. F. (1995) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.2307/2983444 · Cited by 13
Stylometry and the Civil War: The Case of the Pickett Letters
Holmes, D. I. (2003) · CHANCE · doi:10.1080/09332480.2003.10554844 · Cited by 11
Statistical Methods in the Study of the Masoretic Text of the Old Testament
Bee, R. E. (1971) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2343656 · Cited by 11
Cited by
Computational methods in authorship attribution
Koppel, M., Schler, J., & Argamon, S. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20961 · Cited by 528
Automatically profiling the author of an anonymous text
Argamon, S., Koppel, M., Pennebaker, J. W., & Schler, J. (2009) · Communications of the ACM · doi:10.1145/1461928.1461959 · Cited by 376
Detecting Hoaxes, Frauds, and Deception in Writing Style Online
Afroz, S., Brennan, M., & Greenstadt, R. (2012) · 2012 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2012.34 · Cited by 331
Syntactic N-grams as machine learning features for natural language processing
Sidorov, G., Velasquez, F., Stamatatos, E., Gelbukh, A., & Chanona-Hernández, L. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.08.015 · Cited by 319
Authorship attribution in the wild
Koppel, M., Schler, J., & Argamon, S. (2011) · Language Resources and Evaluation · doi:10.1007/s10579-009-9111-2 · Cited by 306
Metadata
- Authors
- Juola, P.
- Venue
- Foundations and Trends® in Information Retrieval
- Publisher
- Emerald
- Published
- 2008-03-07
- Volume
- 1
- Issue
- 3
- Pages
- 233-334
- ISSN
- 1554-0669 (ISSN-L)
- 1554-0677
- OpenAlex
- W4206031910
- Cited by
- 486
- References
- 58
- FWCI
- 12.19
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.