The effect of author set size and data size in authorship attribution
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Applications of authorship attribution `in the wild’ [Koppel, M., Schler, J., and Argamon, S. (2010). Authorship attribution in the wild. Language Resources and Evaluation. Advanced Access published January 12, 2010:10.1007/s10579-009-9111-2], for instance in social networks, will likely involve large sets of candidate authors and only limited data per author. In this article, we present the results of a systematic study of two important parameters in supervised machine learning that significantly affect performance in computational authorship attribution: (1) the number of candidate authors (i.e. the number of classes to be learned), and (2) the amount of training data available per candidate author (i.e. the size of the training data). We also investigate the robustness of different types of lexical and linguistic features to the effects of author set size and data size. The approach we take is an operationalization of the standard text categorization model, using memory-based learning for discriminating between the candidate authors. We performed authorship attribution experiments on a set of three benchmark corpora in which the influence of topic could be controlled. The short text fragments of e-mail length present the approach with a true challenge. Results show that, as expected, authorship attribution accuracy deteriorates as the number of candidate authors increases and size of training data decreases, although the machine learning approach continues performing significantly above chance. Some feature types (most notably character n-grams) are robust to changes in author set size and data size, but no robust individual features emerge.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A survey of modern authorship attribution methods
Stamatatos, E. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21001 · Cited by 1,176 · cited 6×
“In order to evaluate an authorship attribution method thoroughly, its performance should be measured under various conditions (Stamatatos, 2009): training corpus size, in terms of amount and length of training texts; test corpus size, in terms of text length; number of candidate authors;…”
BackgroundMethodResultInfluentialUsing linguistic cues for the automatic recognition of personality in conversation and text
Mairesse, F., Walker, M. A., Mehl, M. R., & Moore, R. K. (2007) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2349 · Cited by 1,046 · cited 1×
“…2008a), but also in authorship verification (Argamon et al., 2003a; Koppel and Schler, 2004; Koppel et al., 2007; Luyckx and Daelemans, 2008a), gender prediction (Koppel et al., 2003), and personality prediction (Mairesse et al., 2007; Nowson and Oberlander, 2007; Luyckx and Daelemans, 2008b).”
BackgroundDelta: A Measure of Stylistic Difference and a Guide to Likely Authorship
Burrows, J. (2002) · Literary and Linguistic Computing · doi:10.1093/llc/17.3.267 · Cited by 627
Automatically Categorizing Written Texts by Author Gender
Koppel, M. (2002) · Literary and Linguistic Computing · doi:10.1093/llc/17.4.401 · Cited by 623 · cited 1×
“…2008a), but also in authorship verification (Argamon et al., 2003a; Koppel and Schler, 2004; Koppel et al., 2007; Luyckx and Daelemans, 2008a), gender prediction (Koppel et al., 2003), and personality prediction (Mairesse et al., 2007; Nowson and Oberlander, 2007; Luyckx and Daelemans, 2008b).”
BackgroundGender, genre, and writing style in formal written texts
ARGAMON, S., KOPPEL, M., FINE, J., & SHIMONI, A. R. (2003) · Text - Interdisciplinary Journal for the Study of Discourse · doi:10.1515/text.2003.014 · Cited by 560
Bigrams of Syntactic Labels for Authorship Discrimination of Short Texts
Hirst, G., & Feiguina, O. (2007) · Literary and Linguistic Computing · doi:10.1093/llc/fqm023 · Cited by 227 · cited 4×
“Some studies have shown promising results with short texts (Sanderson and Guenter, 2006; Hirst and Feiguina, 2007), but the minimum requirements for a text have not been set.”
BackgroundMethodInfluentialAuthorship attribution with thousands of candidate authors
Koppel, M., Schler, J., Argamon, S., & Messeri, E. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148304 · Cited by 90
Cited by
On the Feasibility of Internet-Scale Author Identification
Narayanan, A., Paskov, H., Gong, N. Z., Bethencourt, J., Stefanov, E., Shin, E. C. R., & Song, D. (2012) · 2012 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2012.46 · Cited by 261
Predicting age and gender in online social networks
Peersman, C., Daelemans, W., & Van Vaerenbergh, L. (2011) · Proceedings of the 3rd international workshop on Search and mining user-generated contents · doi:10.1145/2065023.2065035 · Cited by 260
Self-citationSurveying Stylometry Techniques and Applications
Neal, T., Sundararajan, K., Fatima, A., Yan, Y., Xiang, Y., & Woodard, D. (2018) · ACM Computing Surveys · doi:10.1145/3132039 · Cited by 222
Does Size Matter? Authorship Attribution, Small Samples, Big Problem
Eder, M. (2015) · Digital Scholarship in the Humanities · doi:10.1093/llc/fqt066 · Cited by 214
Authorship Attribution with Topic Models
Seroussi, Y., Zukerman, I., & Bohnert, F. (2014) · Computational Linguistics · doi:10.1162/coli_a_00173 · Cited by 89
“Whereas most of the early work on authorship attribution focused on formal texts with only a few candidate authors, researchers have recently turned their attention to scenarios involving informal texts and tens to thousands of authors (Koppel, Schler, and Argamon 2011; Luyckx and Daelemans 2011).”
Background
Metadata
- Authors
- Luyckx, K., & Daelemans, W.
- Venue
- Literary and Linguistic Computing
- Publisher
- Oxford University Press (OUP)
- Published
- 2010-08-16
- Volume
- 26
- Issue
- 1
- Pages
- 35-55
- ISSN
- 0268-1145 (ISSN-L)
- 1477-4615
- OpenAlex
- W2098434511
- Cited by
- 157
- References
- 7
- FWCI
- 11.90
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.