CoChat

Does size matter? Authorship attribution, small samples, big problem

Eder, Maciej · 2015 · Digital Scholarship in the Humanities

The DOI matches its Crossref record; 33 of the 35 references it cites were found in a registry or an index.

Abstract

The aim of this study is to find such a minimal size of text samples for authorship attribution that would provide stable results independent of random noise. A few controlled tests for different sample lengths, languages, and genres are discussed and compared. Depending on the corpus used, the minimal sample length varied from 2,500 words (Latin prose) to 5,000 or so words (in most cases, including English, German, Polish, and Hungarian novels). Another observation is connected with the method of sampling: contrary to common sense, randomly excerpted ‘bags of words’ turned out to be much more effective than the classical solution, i.e. using original sequences of words (‘passages’) of desired size. Although the tests have been performed using the Delta method (Burrows, J.F. (2002). ‘Delta’: a measure of stylistic difference and a guide to likely authorship. Literary and Linguistic Computing, 17(3): 267–87) applied to the most frequent words, some additional experiments have been conducted for support vector machines and k-NN applied to most frequent words, character 3-grams, character 4-grams, and parts-of-speech-tag 3-grams. Despite significant differences in overall attributive success rate between particular methods and/or style markers, the minimal amount of textual data needed for reliable authorship attribution turned out to be method-independent.

Overview

Integrity signals

Registry

Crossref · 10.1093/llc/fqt066

Cites

33 of 33 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 33 references

Research works printed but not linked: 4

  1. Eder, 2009, PCA, Delta, JGAAP and Polish poetry of the 16th and the 17th centuries: who wrote the dirty stuff?, 242
  2. Mikros, 2009, Content words in authorship attribution: an evaluation of stylometric features in a literary corpus, 61
  3. Mautner, 1976, Maxim(e)s, sentences, Fragmente, Aphorismen, 399
  4. Rybicki, 2008, Does size matter? A re-examination of a time-proven method, 184

Cited by

Metadata

Authors
Eder, M.
Affiliations
Uniwersytet Komisji Edukacji Narodowej w Krakowie (PL)
Corresponding author
Eder, Maciej
Venue
Digital Scholarship in the Humanities
Published
2013-11-14
Volume
30
Issue
2
Pages
167-182
ISSN
  • 2055-7671 (ISSN-L)
  • 2055-768X
OpenAlex
W1970948046
Cited by
214
References
35
Citations by year
2026: 10 · 2025: 18 · 2024: 13 · 2023: 20 · 2022: 14 · 2021: 26 · 2020: 27 · 2019: 19 · 2018: 20 · 2017: 13 · 2016: 14 · 2015: 6 · 2014: 5 · 2013: 2
FWCI
9.95
Type
journal article
Language
en
Open access
closed
Locations
  • Digital Scholarship in the Humanities (publishedVersion)
  • DH
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Authorship Attribution and Profiling
  • Social Sciences › Arts and Humanities › Literature and Literary Theory › Digital Humanities and Scholarship
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
Keywords
authorship attribution, sample size, text length, stylistic analysis, delta method, most frequent words, character n-grams, support vector machine, k-nearest neighbors, random sampling

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.