Overview of the PAN/CLEF 2015 Evaluation Lab
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
This paper presents an overview of the PAN/CLEF evaluation lab. During the last decade, PAN has been established as the main forum of text mining research focusing on the identification of personal traits of authors left behind in texts unintentionally. PAN 2015 comprises three tasks: plagiarism detection, author identification and author profiling studying important variations of these problems. In plagiarism detection, community-driven corpus construction is introduced as a new way of developing evaluation resources with diversity. In author identification, cross-topic and cross-genre author verification where the texts of known and unknown authorship do not match in topic and/or genre is introduced. A new corpus was built for this challenging, yet realistic, task covering four languages. In author profiling, in addition to usual author demographics, such as gender and age, five personality traits are introduced openness, conscientiousness, extraversion, agreeableness, and neuroticism and a new corpus of Twitter messages covering four languages was developed. In total, 53 teams participated in all three tasks of PAN 2015 and, following the practice of previous editions, software submissions were required and evaluated within the TIRA experimentation framework.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rammstedt, B., & John, O. P. (2007) · Journal of Research in Personality · doi:10.1016/j.jrp.2006.02.001 · Cited by 4,244
Psychological Aspects of Natural Language Use: Our Words, Our Selves
Pennebaker, J. W., Mehl, M. R., & Niederhoffer, K. G. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145041 · Cited by 2,624 · cited 1×
“Pennebaker’s [38] investigated how the style of writing is associated with personal attributes such as age, gender and personality traits, among others.”
BackgroundPersonality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach
Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Dziurzynski, L., Ramones, S. M., Agrawal, M., Shah, A., Kosinski, M., Stillwell, D., Seligman, M. E. P., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073791 · Cited by 1,700
A survey of modern authorship attribution methods
Stamatatos, E. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21001 · Cited by 1,176
Self-citationUsing linguistic cues for the automatic recognition of personality in conversation and text
Mairesse, F., Walker, M. A., Mehl, M. R., & Moore, R. K. (2007) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2349 · Cited by 1,046 · cited 1×
“[31], investigated systematically the usefulness of different sets of textual features exploiting psycholinguistic dictionaries such as LIWC and MRC.”
BackgroundAutomatically Categorizing Written Texts by Author Gender
Koppel, M. (2002) · Literary and Linguistic Computing · doi:10.1093/llc/17.4.401 · Cited by 623 · cited 1×
“For example, in [23] and [59] the authors investigated the style of writing in blogs.”
BackgroundGender, genre, and writing style in formal written texts
ARGAMON, S., KOPPEL, M., FINE, J., & SHIMONI, A. R. (2003) · Text - Interdisciplinary Journal for the Study of Discourse · doi:10.1515/text.2003.014 · Cited by 560
” How old do you think I am?” A study of language and age in Twitter
Nguyen, D., Gravel, R., Trieschnigg, D., & Meder, T. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14381 · Cited by 287 · cited 1×
“[35] studied the use of language and age among Dutch Twitter users.”
BackgroundCross-language plagiarism detection
Potthast, M., Barrón-Cedeño, A., Stein, B., & Rosso, P. (2011) · Language Resources and Evaluation · doi:10.1007/s10579-009-9114-z · Cited by 286 · cited 1×
“Finally, in the first three years of PAN, we have also introduced cross-language plagiarism detection as a sub-task of plagiarism detection for the first time [40], and introduced corresponding problem instances into the corpus.”
BackgroundSelf-citationIntrinsic Plagiarism Detection
Eissen, S. M. Z., & Stein, B. (2006) · Lecture Notes in Computer Science · doi:10.1007/11735106_66 · Cited by 184
Self-citation
Cited by
Academic Plagiarism Detection: A Systematic Literature Review
Foltýnek, T., Meuschke, N., & Gipp, B. (2020) · ACM Computing Surveys · doi:10.1145/3345317 · Cited by 238
Surveying Stylometry Techniques and Applications
Neal, T., Sundararajan, K., Fatima, A., Yan, Y., Xiang, Y., & Woodard, D. (2018) · ACM Computing Surveys · doi:10.1145/3132039 · Cited by 222
Using Learning Analytics for Preserving Academic Integrity
Amigud, A., Arnedo-Moreno, J., Daradoumis, T., & Guerrero-Roldan, A.-E. (2017) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v18i5.3103 · Cited by 61
Authorship of Pauline Epistles Revisited
Savoy, J. (2019) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24176 · Cited by 26
“If words seem a natural way to generate a text surrogate, other studies have suggested using the letter occurrence frequencies (Kjell, 1994) or the distribution of short sequences of letters (character n-grams; Juola, 2006; Stamatatos et al., 2015).”
BackgroundIs Luke the author of a Gospel and the Acts of the Apostles?
Savoy, J. (2026) · Digital Scholarship in the Humanities · doi:10.1093/llc/fqag118
Metadata
- Authors
- Stamatatos, E., Potthast, M., Rangel, F., Rosso, P., & Stein, B.
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer International Publishing
- Published
- 2015
- Pages
- 518-538
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- OpenAlex
- W1757621696
- Cited by
- 57
- References
- 13
- FWCI
- 4.55
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Overview of the PAN/CLEF 2015 Evaluation Lab. https://app.cochat.ai/papers/10.1007/978-3-319-24027-5_49
- The paper
- Stamatatos, E., Potthast, M., Rangel, F., Rosso, P., & Stein, B. (2015). Overview of the PAN/CLEF 2015 Evaluation Lab. Lecture Notes in Computer Science. https://doi.org/10.1007/978-3-319-24027-5_49
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.