Comparative evaluation of term selection functions for authorship attribution
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Different computational models have been proposed to automatically determine the most probable author of a disputed text (authorship attribution). These models can be viewed as special approaches in the text categorization domain. In this perspective, in a first step we need to determine the most effective features (words, punctuation symbols, part-of-speech, bigram of words, etc.) to discriminate between different authors. To achieve this, we can consider different independent feature-scoring selection functions (information gain, gain ratio, pointwise mutual information, odds ratio, chi-square, bi-normal separation, GSS, Darmstadt Indexing Approach (DIA), and correlation coefficient). Other term selection strategies have also been suggested in specific authorship attribution studies. To compare these two families of selection procedures, we have extracted articles from two newspapers and belonging to two categories (sports and politics). To enlarge the basis of our evaluations, we have chosen one newspaper written in the English language (‘Glasgow Herald’) and a second one in Italian (‘La Stampa’). The resulting collections contain from 987 to 2,036 articles written by four to ten columnists. Using the Kullback–Leibler divergence, the chi-square measure and the Delta rule as attribution schemes, this study found that some simple selection strategies (based on occurrence frequency or document frequency) may produce similar, and sometimes better, results compared with more complex ones.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Analyzing Linguistic Data: A Practical Introduction to Statistics using R
Baayen, R. H. (2008) · doi:10.1017/cbo9780511801686 · Cited by 3,253
A survey of modern authorship attribution methods
Stamatatos, E. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21001 · Cited by 1,176 · cited 3×
“In automatic authorship attribution, computer systems can be designed and implemented to determine the most probable author behind a disputed document or a text excerpt (Mosteller and Wallace, 1964; Juola, 2006; Stamatatos, 2009).”
BackgroundMethodWord association norms, mutual information, and lexicography
Church, K. W., & Hanks, P. (1989) · Proceedings of the 27th annual meeting on Association for Computational Linguistics - · doi:10.3115/981623.981633 · Cited by 1,094
Pennebaker, J. W. (2011) · New Scientist · doi:10.1016/s0262-4079(11)62167-2 · Cited by 780
Delta: A Measure of Stylistic Difference and a Guide to Likely Authorship
Burrows, J. (2002) · Literary and Linguistic Computing · doi:10.1093/llc/17.3.267 · Cited by 627
Applied Bayesian and Classical Inference
Mosteller, F., & Wallace, D. L. (1984) · Springer Series in Statistics · doi:10.1007/978-1-4612-5256-6 · Cited by 195
Cited by
Surveying Stylometry Techniques and Applications
Neal, T., Sundararajan, K., Fatima, A., Yan, Y., Xiang, Y., & Woodard, D. (2018) · ACM Computing Surveys · doi:10.1145/3132039 · Cited by 222
Is Starnone Really the Author Behind Ferrante?
Savoy, J. (2018) · Digital Scholarship in the Humanities · doi:10.1093/llc/fqy016 · Cited by 32
Self-citationAuthorship of Pauline Epistles Revisited
Savoy, J. (2019) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24176 · Cited by 26
“…might capture more precisely stylistic aspects using more complex schemes as, for example, based on a combination of text representations (Mikros & Perifanos, 2013), adopt more successful feature selection strategies (Savoy, 2015), as well as more effective distance functions or classifiers.”
BackgroundMethodSelf-citation
Metadata
- Authors
- Savoy, J.
- Venue
- Digital Scholarship in the Humanities
- Publisher
- Oxford University Press (OUP)
- Published
- 2013-08-05
- Volume
- 30
- Issue
- 2
- Pages
- 246-261
- ISSN
- 2055-7671 (ISSN-L)
- 2055-768X
- OpenAlex
- W2100235759
- Cited by
- 52
- References
- 6
- FWCI
- 2.58
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Comparative evaluation of term selection functions for authorship attribution. https://app.cochat.ai/papers/10.1093/llc/fqt047
- The paper
- Savoy, J. (2015). Comparative evaluation of term selection functions for authorship attribution. Digital Scholarship in the Humanities. https://doi.org/10.1093/llc/fqt047
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.