Character-level and Multi-channel Convolutional Neural Networks for Large-scale Authorship Attribution
Open accessAbstract
Convolutional neural networks (CNNs) have demonstrated superior capability for extracting information from raw signals in computer vision. Recently, character-level and multi-channel CNNs have exhibited excellent performance for sentence classification tasks. We apply CNNs to large-scale authorship attribution, which aims to determine an unknown text's author among many candidate authors, motivated by their ability to process character-level signals and to differentiate between a large number of classes, while making fast predictions in comparison to state-of-the-art approaches. We extensively evaluate CNN-based approaches that leverage word and character channels and compare them against state-of-the-art methods for a large range of author numbers, shedding new light on traditional approaches. We show that character-level CNNs outperform the state-of-the-art on four out of five datasets in different domains. Additionally, we present the first application of authorship attribution to reddit.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
No citation lists for this paper
No citation lists for this paper yet — checked again daily.
References 19 · Cited by 86
Research works printed but not linked: 27
- Ahmed Abbasi and Hsinchun Chen. 2005. Applying Authorship Analysis to Extremist-Group Web Forum Messages. Intelligent Systems, IEEE , 20(5):6775.
- Ossama Abdel-Hamid, Abdel Rahman Mohamed, Hui Jiang, and Gerald Penn. 2012. Applying convolutional neural networks concepts to hybrid NN-HMM model for speech recognition. IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings , pages 4277-4280.
- B Allison and L Guthrie. 2008. Authorship Attribution of E-Mail: Comparing Classifiers over a New Corpus for Evaluation. LREC .
- Ronan Collobert, Jason Weston, Leon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural Language Processing (almost) from Scratch. Journal of Machine Learning Research , 12(Aug):2493-2537.
- O. de Vel, a. Anderson, M. Corney, and G. Mohay. 2001. Mining e-mail content for author identification forensics. ACM SIGMOD Record , 30(4):55.
- G Frantzeskou and E Stamatatos. 2007. Identifying authorship by byte-level n-grams: The source code author profile (scap) method. International Journal of Digital Evidence , 6(1):1-18.
- Yedid Hoshen, Ron J Weiss, and Kevin W Wilson. 2014. Speech Acoustic Modeling From Raw Multichannel Waveforms. pages 2-6.
- Yoon Kim, Yacine Jernite, David Sontag, and Alexander M. Rush. 2016. Character-Aware Neural Language Models. AAAI .
- Yoon Kim. 2014. Convolutional Neural Networks for Sentence Classification. Proceedings of the Conference on Empirical Methods in Natural Language Processing , pages 1746-1751.
- Ryan Kiros, Rs Zemel, and Ruslan Salakhutdinov. 2014. A Multiplicative Model for Learning Distributed Text-Based Attribute Representations. NIPS .
- Moshe Koppel, Jonathan Schler, and Shlomo Argamon. 2011. Authorship attribution in the wild. Language Resources and Evaluation , 45(1):83-94.
- Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. ImageNet Classification with Deep Convolutional Neural Networks. Advances In Neural Information Processing Systems , pages 1-9.
- Robert Layton, Paul Watters, and Richard Dazeley. 2010. Authorship attribution for twitter in 140 characters or less. Cybercrime and Trustworthy Computing Workshop (CTC), IEEE , pages 1-8.
- Robert Layton, Paul Watters, and Richard Dazeley. 2012. Unsupervised authorship analysis of phishing webpages. 2012 International Symposium on Communications and Information Technologies, ISCIT 2012 , (October):1104-1109.
- Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Distributed Representations of Words and Phrases and their Compositionality. NIPS , pages 1-9.
- Vinod Nair and Geoffrey E Hinton. 2010. Rectified Linear Units Improve Restricted Boltzmann Machines. Proceedings of the 27th International Conference on Machine Learning , (3):807-814.
- Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. Glove: Global Vectors for Word Representation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing , pages 1532-1543.
- Cicero Nogueira Dos Santos and Victor Guimar˜ aes. 2015. Boosting Named Entity Recognition with Neural Character Embeddings. Proceedings of NEWS 2015 The Fifth Named Entities Workshop .
- CD Santos and B Zadrozny. 2014. Learning Character-level Representations for Part-ofSpeech Tagging. Proceedings of the 31st International Conference on Machine Learning , ICML14(2011):1818-1826.
- Upendra Sapkota, Steven Bethard, and Thamar Solorio. 2015. Not All Character N -grams Are Created Equal: A Study in Authorship Attribution. Human Language Technologies: The 2015 Annual Conference of the North American Chapter of the ACL .
- Jonathan Schler, Moshe Koppel, Shlomo Argamon, and James Pennebaker. 2005. Effects of Age and Gender on Blogging. AAAI Spring Symposium: Computational Approaches to Analyzing Weblogs , pages 199-205.
- Roy Schwartz, Oren Tsur, Ari Rappoport, and Moshe Koppel. 2013. Authorship Attribution of MicroMessages. Empirical Methods in Natural Language Processing , pages 1880-1891.
- Yanir Seroussi, Ingrid Zukerman, and Fabian Bohnert. 2011. Authorship Attribution with Latent Dirichlet Allocation. Proceedings of the Fifteenth Conference on Computational Natural Language Learning , (June):181-189.
- Efstathios Stamatatos. 2007. Author identification using imbalanced and limited training texts. Proceedings - International Workshop on Database and Expert Systems Applications, DEXA , pages 237-241.
- Efstathios Stamatatos. 2009. A Survey of Modern Authorship Attribution Methods. Journal of the American Society for Information Science and Technology , 60(3):538-556.
- Byron C. Wallace, Do Kook Choe, and Eugene Charniak. 2015. Sparse, Contextually Informed Models for Irony Detection: Exploiting User Communities, Entities and Sentiment. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) , pages 1035-1044.
- Xiang Zhang, Junbo Zhao, and Yann LeCun. 2015. Character-level Convolutional Networks for Text Classification. Advances in Neural Information Processing Systems , pages 649-657.
- Authors
- Ruder, S., Ghaffari, P., & Breslin, J. G.
- ORCID
- Breslin, John G.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1609.06686
- OpenAlex
- W2523437799
- Cited by
- 86
- References
- 19
- Citations by year
- 2024: 6 · 2023: 8 · 2022: 10 · 2021: 19 · 2020: 11 · 2019: 12 · 2018: 9 · 2017: 11
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Authorship Attribution and Profiling
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Handwritten Text Recognition Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- authorship attribution, character-level convolutional neural network, multi-channel convolutional neural network, text classification, Reddit posts
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
