An Investigation of Supervised Learning Methods for Authorship Attribution in Short Hinglish Texts using Char & Word N-grams
Open accessAbstract
The writing style of a person can be affirmed as a unique identity indicator; the words used, and the structuring of the sentences are clear measures which can identify the author of a specific work. Stylometry and its subset - Authorship Attribution, have a long history beginning from the 19th century, and we can still find their use in modern times. The emergence of the Internet has shifted the application of attribution studies towards non-standard texts that are comparatively shorter to and different from the long texts on which most research has been done. The aim of this paper focuses on the study of short online texts, retrieved from messaging application called WhatsApp and studying the distinctive features of a macaronic language (Hinglish), using supervised learning methods and then comparing the models. Various features such as word n-gram and character n-gram are compared via methods viz., Naive Bayes Classifier, Support Vector Machine, Conditional Tree, and Random Forest, to find the best discriminator for such corpora. Our results showed that SVM attained a test accuracy of up to 95.079% while similarly, Naive Bayes attained an accuracy of up to 94.455% for the dataset. Conditional Tree & Random Forest failed to perform as well as expected. We also found that word unigram and character 3-grams features were more likely to distinguish authors accurately than other features.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 11
- [1][1] Emmanuel Ahishakiye, Danison Taremwa, Ivan Niyonzima, and Elisha Opiyo Omulo. 2017. Crime Prediction Using Decision Tree (J48) Classification Algorithm. International Journal of Computer and Information Technology 6, 3 (2017). https://www.ijcit.com/archives/volume6/issue3/Paper060308.pdf -
- [4][4] R. Burbridge, S. Holden, B. Buxton, and M. Trotter. 2001. Drug Design by Machine Learning: Support Vector Machines for Pharmaceutical Data Analysis. Computers and Chemistry 26, 1 (2001), 5-14. https://doi.org/10.1016/S00978485(01)00094-8 - · DOI
- [5][5] R. M. Coyotl-Morales, P. Rosso, M. Montes y Gomez, and L. Villasenor-Pineda. 2006. Authorship Attributing using Word Sequences,. In CIARP . Springer, 844-853. https://doi.org/10.1007/11892755\_87 - · DOI
- [7][7] M. Gamon. 2004. Linguistic Correlates of Style : Authorship Classification with Deep Linguistic Analysis Features. International Conference on Computational Linguistics, 611-617. -
- [11][11] P. Juola. 2006. Authorship attribution. Foundations and Trends in Information Retrieval 1, 3 (2006), 233-334. -
- [12][12] P. Juola. 2006. Authorship Attribution for Electronic Documents. In Digital Forensics 2006: Advances in Digital Forensics II , Vol. 222. Internatonal Federation for Information Processing, 119-130. https://doi.org/10.1007/0-38736891-4\_10 - · DOI
- [13][13] P. Juola. 2007. Future Trends in Authorship Attribution. The International Federation for Information Processing, Springer 242 (2007), 119-132. https://doi.org/10.1007/978-0-387-73742-3\_8 - · DOI
- [14][14] B. Kjell. 1994. Discrimination of Authorship using Visualization. Information Processing & Management 30, 1 (1994), 141-150. https://doi.org/10.1016/0306-4573(94)90029-9 - · DOI
- [17][17] T. Matsuura and Y. Kanada. 2000. Extraction of Authors' Characteristics from Japanese Modern Sentences via N-gram Distribution,. In Discovery Science . Springer, 315-319. https://doi.org/10.1007/3-540-44418-1\_38 - · DOI
- [18][18] F. Mosteller and D. Wallace. 1964. Inference and Disputed Authorship: The Federalist Reading. Review of the International Statistical Institute 34, 2 (1964), 287. -
- [21][21] C. Sanderson and S. Guenter. 2006. Short Text Authorship Attribution via Sequence Kernels, Markov Chains and Author Unmasking : An Investigation,. In Conference on Empirical Methods in Natural Language Processing . 482-491.
Cited by
Sorted by citations
Authorship Attribution for Neural Text Generation
Uchendu, A., Le, T., Shu, K., & Lee, D. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.673 · Cited by 120 · see citing works
A Survey on Stylometric Text Features
Lagutina, K., Lagutina, N., Boychuk, E., Vorontsova, I., Shliakhtina, E., Belyaeva, O., Paramonov, I., & Demidov, P. G. (2019) · 2019 25th Conference of Open Innovations Association (FRUCT) · doi:10.23919/fruct48121.2019.8981504 · Cited by 63 · see citing works
Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges
Huang, B., Chen, C., & Shu, K. (2025) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3715073.3715076 · Cited by 42 · see citing works
“Key stylometric features include character and word frequencies (Sharma et al., 2018), parts of speech (Sundararajan and Woodard, 2018), punctuation, topics (Halvani and Graner, 2021, Potha and Stamatatos, 2019, Seroussi et al., 2014), and vocabulary richness.”
Political Arabic Articles Orientation Using Rough Set Theory With Sentiment Lexicon
Alwan, J. K., Hussain, A. J., Abd, D. H., Sadiq, A. T., Khalaf, M., & Liatsis, P. (2021) · IEEE Access · doi:10.1109/access.2021.3054919 · Cited by 24 · see citing works
Authorship Attribution for a Resource Poor Language—Urdu
Nazir, Z., Shahzad, K., Malik, M. K., Anwar, W., Bajwa, I. S., & Mehmood, K. (2021) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3487061 · Cited by 12 · see citing works
Authorship Attribution for English Short Texts
Alsanoosy, T., Shalbi, B., & Noor, A. (2024) · Engineering Technology & Applied Science Research · doi:10.48084/etasr.8302 · Cited by 5 · see citing works
A Framework for Securing Email Entrances and Mitigating Phishing Impersonation Attacks
Nmachi, W. P. (2023) · International Journal of Network Security & Its Applications · doi:10.5121/ijnsa.2023.15602 · Cited by 2 · see citing works
Orellana, M., Trujillo, A., & Acosta-Urigüen, M.-I. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-73103-8_14 · Cited by 2 · see citing works
- Authors
- Sharma, A., Nandan, A., & Ralhan, R.
- ORCID
- Sharma, Abhay
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1812.10281
- OpenAlex
- W4394649008
- Cited by
- 7
- References
- 0
- Citations by year
- 2024: 1 · 2023: 1 · 2021: 3 · 2020: 1 · 2019: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Authorship Attribution and Profiling
- Physical Sciences › Computer Science › Information Systems › User Authentication and Security Systems
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- authorship attribution, stylometry, Hinglish, short text, n-gram features, character n-grams, word n-grams, WhatsApp messages, online texts, classifier comparison, naive Bayes, support vector machine, random forest
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
