Does size matter? Authorship attribution, small samples, big problem
The DOI matches its Crossref record; 33 of the 35 references it cites were found in a registry or an index.
Abstract
The aim of this study is to find such a minimal size of text samples for authorship attribution that would provide stable results independent of random noise. A few controlled tests for different sample lengths, languages, and genres are discussed and compared. Depending on the corpus used, the minimal sample length varied from 2,500 words (Latin prose) to 5,000 or so words (in most cases, including English, German, Polish, and Hungarian novels). Another observation is connected with the method of sampling: contrary to common sense, randomly excerpted ‘bags of words’ turned out to be much more effective than the classical solution, i.e. using original sequences of words (‘passages’) of desired size. Although the tests have been performed using the Delta method (Burrows, J.F. (2002). ‘Delta’: a measure of stylistic difference and a guide to likely authorship. Literary and Linguistic Computing, 17(3): 267–87) applied to the most frequent words, some additional experiments have been conducted for support vector machines and k-NN applied to most frequent words, character 3-grams, character 4-grams, and parts-of-speech-tag 3-grams. Despite significant differences in overall attributive success rate between particular methods and/or style markers, the minimal amount of textual data needed for reliable authorship attribution turned out to be method-independent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“It is worth knowing that text length is an important factor for a reliable outcome to be provided. When employing texts with a mean length clearly below 5,000 words, reliable authorship attribution is rather difficult to achieve (Eder 2015; Savoy 2018).”
From Is Luke the author of a Gospel and the Acts of the Apostles? (2026) · cites this paper as Eder 2015
In the citing paper
“LLMs are also effective with shorter texts, reducing the necessity for long inputs to derive meaningful representations [Eder, 2015].”
From Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges (2025) · cites this paper as Eder, 2015
In the citing paper
“Short or low-quality texts, such as social media posts, are often unreliable, complicating accurate attribution [Eder, 2015;Theophilo et al., 2021].”
From Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges (2025) · cites this paper as Eder, 2015
Citations
Cites
A survey of modern authorship attribution methods
Stamatatos, E. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21001 · Cited by 1,176
Delta: A Measure of Stylistic Difference and a Guide to Likely Authorship
Burrows, J. (2002) · Literary and Linguistic Computing · doi:10.1093/llc/17.3.267 · Cited by 627 · cited 1×
“These new samples were analyzed using the classical Delta method as developed by Burrows (2002); the percentage of attributive success was regarded as a measure of effectiveness of the current sample length.”
MethodComputational methods in authorship attribution
Koppel, M., Schler, J., & Argamon, S. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20961 · Cited by 528
How Variable May a Constant be? Measures of Lexical Richness in Perspective
Tweedie, F. J., & Baayen, R. H. (1998) · Computers and the Humanities · doi:10.1023/a:1001749303137 · Cited by 423
Computation into criticism : a study of Jane Austen's novels and an experiment in method
Burrows, J. F. (1987) · Medical Entomology and Zoology · Cited by 279
The State of Authorship Attribution Studies: Some Problems and Solutions
Rudman, J. (1997) · Computers and the Humanities · doi:10.1023/a:1001018624850 · Cited by 243
Attributing Authorship: An Introduction
Love, H. (2002) · doi:10.1017/cbo9780511483165 · Cited by 235
Bigrams of Syntactic Labels for Authorship Discrimination of Short Texts
Hirst, G., & Feiguina, O. (2007) · Literary and Linguistic Computing · doi:10.1093/llc/fqm023 · Cited by 227
A comparative study of machine learning methods for authorship attribution
Jockers, M. L., & Witten, D. M. (2010) · Literary and Linguistic Computing · doi:10.1093/llc/fqq001 · Cited by 188
Attributing authorship an introduction
Love, H. (2002) · Cited by 181
Research works printed but not linked: 4
- Eder, 2009, PCA, Delta, JGAAP and Polish poetry of the 16th and the 17th centuries: who wrote the dirty stuff?, 242
- Mikros, 2009, Content words in authorship attribution: an evaluation of stylometric features in a literary corpus, 61
- Mautner, 1976, Maxim(e)s, sentences, Fragmente, Aphorismen, 399
- Rybicki, 2008, Does size matter? A re-examination of a time-proven method, 184
Cited by
Items 201–257 of 257
Savoy, J. (2020) · Springer eBooks · doi:10.1007/978-3-030-53360-1_11
Burrows, J. F., & Craig, H. (2019) · Cambridge University Press eBooks · doi:10.1017/9781316717516.020
Sorting submission text using Natural Language ProcessingPreprint
Ghelani, D. (2022) · doi:10.22541/au.166455373.35532713/v1
Atribución de autoría y humanidades digitales en el Siglo de Oro español
Pérez, A. C. (2022) · apropos [Perspektiven auf die Romania] · doi:10.15460/apropos.9.1939
Rao, S., & Lacroix, D. (2023) · Francophonies d Amérique · doi:10.7202/1099267ar
Are Ret Marut and B. Traven the same person? Fine tuning the impostors method
Rebora, S., Salgaro, M., & Sopčák, P. (2023) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.8107372
Chandler, S. J., Muenster, E. A., & Lichtblau, D. (2023) · International Conference on Artificial Intelligence and Law · doi:10.1145/3594536.3595118
Meyer, R., Tikhonov, A., & Hammel (2023) · Bielefeld University Press eBooks · doi:10.1515/9783839469132-022
van Dalen-Oskam, K. (2023) · Amsterdam University Press eBooks · doi:10.1515/9789048558155-001
Introducción a la Estilometría: aplicaciones a la poesía de Fernando de Herrera
Hernández‐Lorenzo, L. (2023) · Dykinson eBooks · doi:10.14679/2125
Stańczyk, U., & Baron, G. (2023) · Procedia Computer Science · doi:10.1016/j.procs.2023.10.204
I repeat therefore I am: The parasyntactic perspective
Benešová, M., Faltýnek, D., Kormaníková, L., & Kučera, O. (2023) · Journal of Linguistics/Jazykovedný casopis · doi:10.2478/jazcas-2024-0005
Stern, D. (2024) · Constantine of Preslav's Didactic Gospel and the South Slavonic Homiletic Texts: Philological and Interdisciplinary Aspects – International Scientific Conference · doi:10.62761/491.sb37.13
Maion, F., & Fuchsbauer, J. (2024) · Constantine of Preslav's Didactic Gospel and the South Slavonic Homiletic Texts: Philological and Interdisciplinary Aspects – International Scientific Conference · doi:10.62761/491.sb37.22
Пандектите на Антиох. Електронни прочити / Pandects of Antioch. Electronic Readings
Bojadžiev, A. (2024) · Constantine of Preslav's Didactic Gospel and the South Slavonic Homiletic Texts: Philological and Interdisciplinary Aspects – International Scientific Conference · doi:10.62761/491.sb37.20
Discretisation and Attribute Relevance in Knowledge Mining Problems
Stańczyk, U. (2024) · Learning and analytics in intelligent systems · doi:10.1007/978-3-031-62316-5_15
Profiling Anonymous Authors in the Corsican Autonomist Press of the Interwar Period
Sarbach-Pulicani, V. (2023) · HAL
Los autores de las Siete Partidas: una visión desde la estilometría.
Rueda, J. M. F. (2024) · Philologia hispalensis · doi:10.12795/ph.2024.v38.i02.05
White, B. L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197802274.003.0002
White, B. L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197802274.005.0002
White, B. L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197802274.003.0003
White, B. L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197802274.003.0004
White, B. L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197802274.002.0006
White, B. L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197802274.002.0005
White, B. L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197802274.005.0001
White, B. L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197802274.003.0005
White, B. L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197802274.003.0001
Maliszewski, J. (2025) · Computational Humanities Research · doi:10.1017/chr.2025.10004
“For the distributions of the most frequent words to be representative of the authorial signal, the sample length needs to reach a threshold of 2,000 to 5,000 words, with the exact required length varying depending on genre and language (Eder 2013).”
Topic and style: Authorship attribution with multi-vector meta-features and stacked classifier
Lavanya, B., & Sowmiya, R. (2025) · International Journal on Information Technologies and Security · doi:10.59035/btrz6248
“Although the interests of finding the best distinguishing style markers are the driving factor of AA studies, critical variables of datasets were emphasised in recent studies, such as the topical similarity among the authors [5] and the dataset size [6].”
A Stylometric Analysis on Authorship of Quelling the Demons’ Revolt
Yang, Y., & Lyu, G. (2025) · SAGE Open · doi:10.1177/21582440251405558
“One critical concern is text length: reliable author-ship attribution generally requires a minimum word count, as smaller samples may distort statistical results (Eder, 2015).”
StilometrIA alla prova delle scritture collettive
De Cristofaro, M., & Giglio, M. (2025) · Umanistica Digitale · doi:10.6092/issn.2532-8816/21219
The DCH in the Italian Cultural System. The Necessity of a Change
Barbuti, N., & Bari, M. D. (2021) · CINECA IRIS Institutional Research Information System (University of Bari Aldo Moro)
AUTHORSHIP ATTRIBUTION OF ARABIC TEXTS
HUSSEIN MOHAMMED, A.-A. S. (2014) · Research Publication Repository of King Fahd University of Petroleum and Minerals (King Fahd University of Petroleum and Minerals)
Tamgacı: Artırımsal ve Geri Beslemeli Türkçe Yazar Çözümleme
Aslanturk, O. (2014) · Hacettepe University Institutional Repository (hacettepe.edu.tr) · Cited by 3
Futuro Antico. Applicazione in AR per la creazione di never ending books.
Barbuti, N. (2021) · CINECA IRIS Institutional Research Information System (University of Bari Aldo Moro)
Malfatti, S. (2019) · Institutional Research Information System (Università degli Studi di Trento) · Cited by 1
(2019) · Ams Acta Institutional Research Repository (University of Bologna)
Best Parameters When Using Stylo on Romanian Literary Texts
Dimitriu, M.-C., Pascariu, L., & Patraș, R. (2025) · Philologica Jassyensia · doi:10.60133/pj.2025.2.14
Rebora, S. (2025) · Romanica Cracoviensia · doi:10.4467/20843917rc.25.039.22752
Contemporary Studies in Linguistics I: IMU Linguistics 15th Anniversary Commemorative Volume
Adams, D. Q., Çınar, O., Basbug, F., AYDEMİR, H., Erdal, M., Erdemir, Z., Atlamaz, Ü., Demirok, Ö. F., Güçlü, R., Kaya, A. C., et al. (2025) · doi:10.7816/imuling-15-2025-cls6
Wykorzystanie metody TF-IDF w badaniu wypowiedzi mówców z różnych grup wiekowych
Kądzioła, M. (2026) · Językoznawstwo · doi:10.25312/j.9815
Translating thought: A digital inquiry into Gundissalinus’s interpretive influence on Yanbuʿ al-ḤayāPreprint
Çelebi, F. (2026) · Research Square · doi:10.21203/rs.3.rs-8104106/v1
Tomas, F. (2021) · theses.fr (ABES) · doi:10.70675/7434e6e1z1776z4037za8f1zff2dde6ab6a7 · Cited by 2
Stylometric analysis of translators’ style in the Chinese translation of The New Tale of Genji
Li, G. H., Jin, M., & Liu, H. (2026) · Digital Scholarship in the Humanities · doi:10.1093/llc/fqag045
Nathalang, S. S., & Tripornchaisak, N. (2026) · Journal of Studies in the English Language · doi:10.64731/jsel.v21i1.287759
(2026) · Vandenhoeck & Ruprecht eBooks · doi:10.13109/9783666502606.367
Stylometry Studies and the Controversial Origin of the German Hymnographic Tradition
Витальевич, К. М. (2026) · Вестник Пермского университета. Российская и зарубежная филология · doi:10.17072/2073-6681-2026-1-93-103
Structural analysis of opinion columns using ordinal patterns and information-theoretic measures
Zhou-Lin, C. Z., Herrera-Diestra, J., & Stucchi, L. (2026) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/5.0354862
Aslan, Ö. (2026) · Pamukkale University Journal of Engineering Sciences · doi:10.65206/pajes.1938741
Fast Classification of Textual Richness and Stylistic Beauty
Cordeiro, J., Pais, S., & Pombo, N. (2026) · Studies in classification, data analysis, and knowledge organization · doi:10.1007/978-3-032-32009-4_13
Khan, T. I. (2026) · Research Square · doi:10.21203/rs.3.rs-10513554/v1
Etli, Y., Özdil, A., & Aşırdizer, M. (2026) · Forensic Science International · doi:10.1016/j.forsciint.2026.113105
Stylometry and pornographic novels: a replication study on the Mutzenbacher case
Rebora, S., & Salgaro, M. (2026) · Cognitive philology
Unmasking Pericles : new evidence casts out Wilkins as early acts’ author
Ilsemann, H. (2026) · Digital Scholarship in the Humanities · doi:10.1093/llc/fqag132
Si, T. N. H. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7575939
Metadata
- Authors
- Eder, M.
- Affiliations
- Uniwersytet Komisji Edukacji Narodowej w Krakowie (PL)
- Corresponding author
- Eder, Maciej
- ORCID
- Eder, Maciej
- Venue
- Digital Scholarship in the Humanities
- Publisher
- Oxford University Press (OUP)
- Published
- 2013-11-14
- Volume
- 30
- Issue
- 2
- Pages
- 167-182
- ISSN
- 2055-7671 (ISSN-L)
- 2055-768X
- OpenAlex
- W1970948046
- Cited by
- 214
- References
- 35
- Citations by year
- 2026: 10 · 2025: 18 · 2024: 13 · 2023: 20 · 2022: 14 · 2021: 26 · 2020: 27 · 2019: 19 · 2018: 20 · 2017: 13 · 2016: 14 · 2015: 6 · 2014: 5 · 2013: 2
- FWCI
- 9.95
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Digital Scholarship in the Humanities (publishedVersion)
- DH
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Authorship Attribution and Profiling
- Social Sciences › Arts and Humanities › Literature and Literary Theory › Digital Humanities and Scholarship
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- authorship attribution, sample size, text length, stylistic analysis, delta method, most frequent words, character n-grams, support vector machine, k-nearest neighbors, random sampling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.