Same Author or Just Same Topic? Towards Content-Independent Style Representations
Open accessAbstract
Linguistic style is an integral component of language. Recent advances in the development of style representations have increasingly used training objectives from authorship verification (AV): Do two texts have the same author? The assumption underlying the AV training task (same author approximates same writing style) enables self-supervised and, thus, extensive training. However, a good performance on the AV task does not ensure good "general-purpose" style representations. For example, as the same author might typically write about certain topics, representations trained on AV might also encode content information instead of style alone. We introduce a variation of the AV training task that controls for content using conversation or domain labels. We evaluate whether known style dimensions are represented and preferred over content information through an original variation to the recently proposed STEL framework. We find that representations trained by controlling for conversation are better than representations trained with domain or no content control at representing style independent from content.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Adaptation through style transfer has not resolved cross-domain issues.
“Adaptation through style transfer has not resolved crossdomain issues [Boenninghoff et al., 2019b;Wegmann et al., 2022].”
From Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges (2025) · cites this paper as Wegmann et al., 2022
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · see citing works
SciPy 1.0: fundamental algorithms for scientific computing in Python
Virtanen, P., Gommers, R., Oliphant, T. E., Haberland, M., Reddy, T., Cournapeau, D., Burovski, E., Peterson, P., Weckesser, W., Bright, J., et al. (2020) · Nature Methods · doi:10.1038/s41592-019-0686-2 · Cited by 38,430 · see citing works
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515 · see citing works
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778 · see citing works
Dimensionality Reduction by Learning an Invariant Mapping
Hadsell, R., Chopra, S., & LeCun, Y. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.100 · Cited by 5,336 · see citing works
A large annotated corpus for learning natural language inference
Bowman, S. R., Angeli, G., Potts, C., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1075 · Cited by 3,377 · see citing works
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference
Williams, A., Nangia, N., & Bowman, S. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1101 · Cited by 3,342 · see citing works
Supervised Learning of Universal Sentence Representations from Natural Language Inference Data
Conneau, A., Kiela, D., Schwenk, H., Barrault, L., & Bordes, A. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1070 · Cited by 2,049 · see citing works
SemEval-2017 Task 1: Semantic Textual Similarity Multilingual and Crosslingual Focused Evaluation
Cer, D., Diab, M., Agirre, E., Lopez-Gazpio, I., & Specia, L. (2017) · Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017) · doi:10.18653/v1/s17-2001 · Cited by 1,562 · see citing works
Baumgartner, J., Zannettou, S., Keegan, B., Squire, M., & Blackburn, J. (2020) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v14i1.7347 · Cited by 881 · see citing works
Hypothesis Only Baselines in Natural Language Inference
Poliak, A., Naradowsky, J., Haldar, A., Rudinger, R., & Durme, B. V. (2018) · International Workshop on Semantic Evaluation · doi:10.18653/v1/s18-2023 · Cited by 685 · see citing works
Classifying latent user attributes in twitter
Rao, D., Yarowsky, D., Shreevats, A., & Gupta, M. (2010) · Proceedings of the 2nd international workshop on Search and mining user-generated contents · doi:10.1145/1871985.1871993 · Cited by 655 · see citing works
Optimizing Statistical Machine Translation for Text Simplification
Xu, W. H., Napoles, C., Pavlick, E., Chen, Q. Z., & Callison-Burch, C. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00107 · Cited by 524 · see citing works
DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations
Giorgi, J., Nitski, O., Wang, B., & Bader, G. D. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.72 · Cited by 432 · see citing works
Rao, S., & Tetreault, J. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1012 · Cited by 336 · see citing works
Controlling Linguistic Style Aspects in Neural Language Generation
Ficler, J., & Goldberg, Y. (2017) · arXiv.org · doi:10.18653/v1/w17-4912 · Cited by 277 · see citing works
Language Style as Audience Design
Bell, A. (1997) · doi:10.1007/978-1-349-25582-5_20 · Cited by 247 · see citing works
Surveying Stylometry Techniques and Applications
Neal, T., Sundararajan, K., Fatima, A., Yan, Y., Xiang, Y., & Woodard, D. (2018) · ACM Computing Surveys · doi:10.1145/3132039 · Cited by 222 · see citing works
Demographic Factors Improve Classification Performance
Hovy, D. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1073 · Cited by 148 · see citing works
Learning Semantic Textual Similarity from Conversations
Yang, Y., Yuan, S., Cer, D. M., Kong, S.-Y., Constant, N., Pilar, P., Ge, H., Sung, Y.-H., Strope, B. P., & Kurzweil, R. (2018) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/w18-3022 · Cited by 148 · see citing works
ConvoKit: A Toolkit for the Analysis of Conversations
Chang, J. P., Chiam, C., Fu, L., Wang, A., Zhang, J., & Danescu-Niculescu-Mizil, C. (2020) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2020.sigdial-1.8 · Cited by 83 · see citing works
A Study of Style in Machine Translation: Controlling the Formality of Machine Translation Output
Niu, X., Martindale, M. J., & Carpuat, M. J. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1299 · Cited by 56 · see citing works
Masking topic‐related information to enhance authorship attribution
Stamatatos, E. (2017) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23968 · Cited by 51 · see citing works
Topic or style? Exploring the most useful features for authorship attribution
Sari, Y. A. P., Stevenson, M., & Vlachos, A. (2018) · Apollo (University of Cambridge) · doi:10.17863/cam.78746 · Cited by 48 · see citing works
Similarity Learning for Authorship Verification in Social Media
Boenninghoff, B., Nickel, R. M., Zeiler, S., & Kolossa, D. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683405 · Cited by 40 · see citing works
Siamese networks for large-scale author identification
Saedi, C., & Dras, M. (2021) · Computer Speech & Language · doi:10.1016/j.csl.2021.101241 · Cited by 30 · see citing works
On learning and representing social meaning in NLP: a sociolinguistic perspective
Nguyen, D., Rosseel, L., & Grieve, J. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.50 · Cited by 28 · see citing works
Self-citationDialogueCSE: Dialogue-based Contrastive Learning of Sentence Embeddings
Liu, C., Wang, R., Liu, J., Sun, J. Q., Huang, F., & Si, L. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.185 · Cited by 28 · see citing works
Overview of the Cross-Domain Authorship Verification Task at PAN 2020.
Kestemont, M., Manjavacas, E., Markov, I., Bevendorff, J., Wiegmann, M., Stamatatos, E., Potthast, M., & Stein, B. (2020) · CLEF (Working Notes) · Cited by 27 · see citing works
DeepStyle: User Style Embedding for Authorship Attribution of Short Texts
Hu, Z., Lee, R. K.-W., Wang, L., Lim, E., & Dai, B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-60290-1_17 · Cited by 26 · see citing works
Intrinsic Author Verification Using Topic Modeling
Potha, N., & Stamatatos, E. (2018) · Hellenic Conference on Artificial Intelligence · doi:10.1145/3200947.3201013 · Cited by 25 · see citing works
Assessing the Applicability of Authorship Verification Methods
Halvani, O., Winter, C., & Graner, L. (2019) · International Conference on Availability, Reliability and Security (ARES) · doi:10.1145/3339252.3340508 · Cited by 25 · see citing works
The Importance of Suppressing Domain Style in Authorship AnalysisPreprint
Bischoff, S., Deckers, N., Schliebs, M., Thies, B., Hagen, M., Stamatatos, E., Stein, B., & Potthast, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.14714 · Cited by 25 · see citing works
What represents “style” in authorship attribution?
Sundararajan, K., & Woodard, D. L. (2018) · International Conference on Computational Linguistics · Cited by 22 · see citing works
Zhu, J. Y., & Jurgens, D. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.25 · Cited by 16 · see citing works
Representation learning of writing style
Hay, J., Doan, B.-L., Popineau, F., & Elhara, O. A. (2020) · Workshop on Noisy User-generated Text (W-NUT) · doi:10.18653/v1/2020.wnut-1.30 · Cited by 14 · see citing works
Low Level Linguistic Controls for Style Transfer and Content Preservation
Gero, K. I., Kedzie, C., Reeve, J., & Chilton, L. B. (2019) · International Conference on Natural Language Generation · doi:10.18653/v1/w19-8628 · Cited by 6 · see citing works
Stylometrics Features Under Domain Shift: Do They Really “Context-Independent”?
Litvinova, T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-60276-5_28 · Cited by 5 · see citing works
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805
Flagged first, then by citations
Cited by
Sorted by citations
Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges
Huang, B., Chen, C., & Shu, K. (2025) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3715073.3715076 · Cited by 42 · see citing works
“Adaptation through style transfer has not resolved cross-domain issues (Boenninghoff et al., 2019b, Wegmann et al., 2022).”
RECAP: Retrieval-Enhanced Context-Aware Prefix Encoder for Personalized Dialogue Response Generation
Liu, S., Cho, H., Freedman, M., Ma, X., & May, J. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.468 · Cited by 19 · see citing works
Understanding writing style in social media with a supervised contrastively pre-trained transformer
Huertas‐Tato, J., Martín, A. G., & Camacho, D. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111867 · Cited by 15 · see citing works
Beyond the surface: stylometric analysis of GPT-4o's capacity for literary style imitation
Mikros, G. (2025) · Digital Scholarship in the Humanities · doi:10.1093/llc/fqaf035 · Cited by 23 · see citing works
Learning Interpretable Style Embeddings via Prompting LLMs
Patel, A., Rao, D., Kothary, A., McKeown, K. R., & Callison-Burch, C. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.1020 · Cited by 20 · see citing works
ParaGuide: Guided Diffusion Paraphrasers for Plug-and-Play Textual Style Transfer
Horvitz, Z., Patel, A., Callison-Burch, C., Zhou, Y., & McKeown, K. R. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29780 · Cited by 7 · see citing works
Saxena, V., Rethmeier, N., DIJCK, G. V., & Spanakis, G. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.481 · Cited by 6 · see citing works
Responsible guidelines for authorship attribution tasks in NLP
Saxena, V., Tamò‐Larrieux, A., DIJCK, G. V., & Spanakis, G. (2025) · Ethics and Information Technology · doi:10.1007/s10676-025-09821-w · Cited by 5 · see citing works
Can Authorship Attribution Models Distinguish Speakers in Speech Transcripts?
Aggazzotti, C., Andrews, N., & Smith, E. A. T. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00678 · Cited by 4 · see citing works
Can Authorship Representation Learning Capture Stylistic Features?
Wang, A., Aggazzotti, C., Kotula, R., Soto, R. A. R., Bishop, M., & Andrews, N. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00610 · Cited by 27 · see citing works
Addressing Topic Leakage in Cross-Topic Evaluation for Authorship Verification
Sawatphol, J., Udomcharoenchaikit, C., & Nutanong, S. Y. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00709 · Cited by 5 · see citing works
Lee, J., Booth, E., Farid, H., & Rizoiu, M.-A. (2025) · EPJ Data Science · doi:10.1140/epjds/s13688-025-00567-5 · Cited by 3 · see citing works
Collaborative Growth: When Large Language Models Meet Sociolinguistics
Nguyen, D. (2025) · Language and Linguistics Compass · doi:10.1111/lnc3.70010 · Cited by 5 · see citing works
Self-citationThe Art of Replication: Lifelike Avatars with Personalized Conversational Style
Nasser, M. M. A. A., Gaglio, G. F., Seidita, V., & Chella, A. (2025) · Robotics · doi:10.3390/robotics14030033 · Cited by 1 · see citing works
Meng, D., Wang, Z., Phuntsho, T., & Gonsalves, T. (2025) · Egyptian Informatics Journal · doi:10.1016/j.eij.2025.100752 · Cited by 1 · see citing works
The Impact of Automatic Speech Transcription on Speaker Attribution
Aggazzotti, C., Wiesner, M., Smith, E. A., & Andrews, N. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.54 · Cited by 6 · see citing works
Benharrak, K., Peng, P., & Pavel, A. (2025) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3746059.3747795 · Cited by 1 · see citing works
Morphosyntactic Annotation in Literary Stylometry
Gorman, R. J. (2024) · Information · doi:10.3390/info15040211 · Cited by 1 · see citing works
Saxena, V., Rethmeier, N., DIJCK, G. V., & Spanakis, G. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.02763
Natural Language Processing for Author Style Detection
Kopylov, V., & Makarov, I. (2023) · IEEE International Symposium on Computational Intelligence and Informatics (CINTI) · doi:10.1109/cinti59972.2023.10381989
How to Tame Pre-Trained Transformers for Authorship VerificationPreprint
Li, M. Q., Fung, B. C. M., Huang, S.-C., & Fachkha, C. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4889071
Dinu, A., Florescu, A.-M., & Tăbuşcă, Ş. A. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.09.165
From Chat to Academia: Calibrating Formality in Low-Resource Languages
Efendioglu, S., & Pehlivan, H. (2026) · IEEE Access · doi:10.1109/access.2026.3652343
Attribution Quality in AI-Generated Content: Benchmarking Style Embeddings and LLM Judges
Abbas, M. (2025) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw69685.2025.00205
Beyond semantics: Content leakage mitigation using synthetic hard negatives for style embeddings
Huertas‐Tato, J., Jiménez, A. G., Martín, A., & Camacho, D. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.133895
Quantifying pollen and spore morphology using a language model
Mander, L., Sun, P., Punyasena, S. W., Jaramillo, C. A., & Oboh‐Ikuenobe, F. E. (2026) · Biology Letters · doi:10.1098/rsbl.2026.0313
- Authors
- Wegmann, A., Schraagen, M., & Nguyen, D.
- Affiliations
- Utrecht University (NL)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- Pages
- 249-268
- arXiv
- 2204.04907
- OpenAlex
- W4223992738
- Cited by
- 25
- References
- 39
- Citations by year
- 2026: 3 · 2025: 10 · 2024: 6 · 2023: 6
- FWCI
- 3.04
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Workshop on Representation Learning for NLP (RepL4NLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- arXiv (Cornell University) (cc-by)
- Funders
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (410.19.007, VI.Veni.192.130)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Authorship Attribution and Profiling
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Keywords
- language style, style representation, authorship verification, content control, self-supervised learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
