Bag of Tricks for Efficient Text Classification
Open accessAbstract
This paper explores a simple and efficient baseline for text classification. Our experiments show that our fast text classifier fastText is often on par with deep learning classifiers in terms of accuracy, and many orders of magnitude faster for training and evaluation. We can train fastText on more than one billion words in less than ten minutes using a standard multicore~CPU, and classify half a million sentences among~312K classes in less than a minute.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Other word embedding systems like BeRT, ELMo and fastText have been less used in cyber grooming detection so far.
“There exist other word embedding systems like BeRT [95], ELMo [96] and fastText [97], but these have been less used in cyber grooming detection so far.”
From Online grooming detection: A comprehensive survey of child exploitation in chat logs (2023) · cites this paper as [97]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 23
- Alekh Agarwal, Olivier Chapelle, Miroslav Dudík, and John Langford. 2014. A reliable effective terascale linear learning system. Journal of Machine Learn- ing Research, 15(Mar):1111-1133.
- Ronan Collobert and Jason Weston. 2008. A uni- fied architecture for natural language processing: Deep neural networks with multitask learning. In Proceedings of the 25th International Conference on Machine Learning, ICML '08, pages 160-167, Helsinki, Finland. ACM.
- Alexis Conneau, Holger Schwenk, Loïc Barrault, and Yann Lecun. 2016. Very deep convolutional networks for natural language processing. arXiv preprint arXiv:1606.01781. · arXiv
- Scott Deerwester, Susan T. Dumais, George W. Fur- nas, Thomas K. Landauer, and Richard Harshman. 1990. Indexing by latent semantic analysis. Jour- nal of the American Society for Information Science, 41(6):391-407.
- Rong-En Fan, Kai-Wei Chang, Cho-Jui Hsieh, Xiang- Rui Wang, and Chih-Jen Lin. 2008. Liblinear: A library for large linear classification. Journal of Ma- chine Learning Research, 9(Aug):1871-1874.
- Joshua Goodman. 2001. Classes for fast maximum en- tropy training. In Proceedings of the International Conference on Acoustics, Speech, and Signal Pro- cessing, volume 1, pages 561-564, Salt Lake City, USA. IEEE.
- Thorsten Joachims. 1998. Text categorization with support vector machines: Learning with many rel- evant features. In Claire Nédellec and Céline Rou- veirol, editors, 10th European Conference on Ma- chine Learning, pages 137-142, Chemnitz, Ger- many. Springer Berlin Heidelberg.
- Yoon Kim. 2014. Convolutional neural networks for sentence classification. In Proceedings of the 2014 Conference on Empirical Methods in Natu- ral Language Processing (EMNLP), pages 1746- 1751, Doha, Qatar, October. Association for Com- putational Linguistics.
- Omer Levy, Yoav Goldberg, and Ido Dagan. 2015. Im- proving distributional similarity with lessons learned from word embeddings. Transactions of the Associ- ation for Computational Linguistics, 3:211-225.
- Andrew McCallum and Kamal Nigam. 1998. A com- parison of event models for naive bayes text clas- sification. In AAAI workshop on learning for text categorization, pages 41-48, Madison, USA.
- Tomáš Mikolov, Anoop Deoras, Daniel Povey, Lukáš Burget, and Jan Černockỳ. 2011. Strategies for training large scale neural network language models. In Workshop on Automatic Speech Recognition Un- derstanding, pages 196-201, Waikoloa, USA. IEEE.
- Tomáš Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word represen- tations in vector space. In 1st International Con- ference on Learning Representations (ICLR), Scotts- dale, USA.
- Bo Pang and Lillian Lee. 2008. Opinion mining and sentiment analysis. Foundations and Trends in In- formation Retrieval, 2(1-2):1-135, January.
- H. Schütze. 1992. Dimensions of meaning. In Pro- ceedings of the 1992 ACM/IEEE Conference on Su- percomputing, Supercomputing '92, pages 787-796, Los Alamitos, CA, USA. IEEE Computer Society Press.
- Duyu Tang, Bing Qin, and Ting Liu. 2015. Document modeling with gated recurrent neural network for sentiment classification. In Proceedings of the 2015 Conference on Empirical Methods in Natural Lan- guage Processing, pages 1422-1432, Lisbon, Portu- gal, September. Association for Computational Lin- guistics.
- Bart Thomee, David A. Shamma, Gerald Fried- land, Benjamin Elizalde, Karl Ni, Douglas Poland, Damian Borth, and Li-Jia Li. 2016. YFCC100M: The new data in multimedia research. Communica- tions of the ACM, 59(2):64-73.
- Sida Wang and Christopher Manning. 2012. Baselines and bigrams: Simple, good sentiment and topic clas- sification. In Proceedings of the 50th Annual Meet- ing of the Association for Computational Linguistics (Volume 2: Short Papers), pages 90-94, Jeju Island, Korea, July. Association for Computational Linguis- tics.
- Kilian Weinberger, Anirban Dasgupta, John Langford, Alex Smola, and Josh Attenberg. 2009. Feature hashing for large scale multitask learning. In Pro- ceedings of the 26th Annual International Confer- ence on Machine Learning, ICML '09, pages 1113- 1120, New York, NY, USA. ACM.
- Jason Weston, Samy Bengio, and Nicolas Usunier. 2011. Wsabie: Scaling up to large vocabulary image annotation. In Proceedings of the Twenty-Second International Joint Conference on Artificial Intel- ligence -Volume Volume Three, IJCAI'11, pages 2764-2770. AAAI Press.
- Jason Weston, Sumit Chopra, and Keith Adams. 2014. #tagspace: Semantic embeddings from hashtags. In Proceedings of the 2014 Conference on Em- pirical Methods in Natural Language Processing (EMNLP), pages 1822-1827, Doha, Qatar, October. Association for Computational Linguistics.
- Yijun Xiao and Kyunghyun Cho. 2016. Efficient character-level document classification by combin- ing convolution and recurrent layers. arXiv preprint arXiv:1602.00367. · arXiv
- Xiang Zhang and Yann LeCun. 2015. Text understand- ing from scratch. arXiv preprint arXiv:1502.01710. · arXiv
- Xiang Zhang, Junbo Zhao, and Yann LeCun. 2015. Character-level convolutional networks for text clas- sification. In Advances in Neural Information Processing Systems 28, pages 649-657, Montreal, Canada.
Cited by
Sorted by citations
Retrieval augmented generation for large language models in healthcare: A systematic review
Amugongo, L. M., Mascheroni, P., Brooks, S., Doering, S., & Seidel, J. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000877 · Cited by 267 · see citing works
A Review on Deep-Learning-Based Cyberbullying Detection
Hasan, M. T., Hossain, M. A. E., Mukta, M. S. H., Akter, A., Ahmed, M., & Islam, S. (2023) · Future Internet · doi:10.3390/fi15050179 · Cited by 103 · see citing works
Online grooming detection: A comprehensive survey of child exploitation in chat logs
Borj, P. R., Raja, K., & Bours, P. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110039 · Cited by 38 · see citing works
Seed-Coder: Let the Code Model Curate Data for Itself
Seed, B., Zhang, Y., Su, J., Sun, Y., Xi, C., Xiao, X., Zheng, S., Zhang, A., Liu, K., Zan, D., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.03524 · Cited by 3 · see citing works
“To further improve model performance and better align the distribution between the pretraining model and post-training data, we constructed high-quality datasets by combining the quality score with iteratively trained fastText [Joulin et al., 2016, 2017] models.”
InfiMM-WebMath-40B: Advancing Multimodal Pre-Training for Enhanced Mathematical Reasoning
Han, X., Jian, Y., Hu, X., Liu, H., Wang, Y., Fan, Q., Ai, Y., Huang, H., He, R., Yang, Z., et al. (2024) · arXiv · doi:10.48550/arxiv.2409.12568 · Cited by 1 · see citing works
- Authors
- Joulin, A., Grave, E., Bojanowski, P., & Mikolov, T.
- Affiliations
- Meta (Israel) (IL)
- ORCID
- Bojanowski, Piotr
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- Pages
- 427-431
- arXiv
- 1607.01759
- OpenAlex
- W2468328197
- Cited by
- 4,542
- References
- 0
- Citations by year
- 2026: 126 · 2025: 303 · 2024: 383 · 2023: 551 · 2022: 592 · 2021: 728 · 2020: 720 · 2019: 680 · 2018: 330 · 2017: 114 · 2016: 14
- FWCI
- 230.52
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Conference of the European Chapter of the Association for Computational Linguistics (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Text and Document Classification Technologies
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- text classification, transfer learning, word embeddings, pre-trained language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
