The DOI matches its DataCite record; 32 of the 36 references it cites were found in a registry or an index.
Entity Embeddings of Categorical Variables
Open accessAbstract
We map categorical variables in a function approximation problem into Euclidean spaces, which are the entity embeddings of the categorical variables. The mapping is learned by a neural network during the standard supervised training process. Entity embedding not only reduces memory usage and speeds up neural networks compared with one-hot encoding, but more importantly by mapping similar values close to each other in the embedding space it reveals the intrinsic properties of the categorical variables. We applied it successfully in a recent Kaggle competition and were able to reach the third position with relative simple features. We further demonstrate in this paper that entity embedding helps the neural network to generalize better when the data is sparse and statistics is unknown. Thus it is especially useful for datasets with lots of high cardinality features, where other methods tend to overfit. We also demonstrate that the embeddings obtained from the trained neural network boost the performance of all tested machine learning methods considerably when used as the input features instead. As entity embedding defines a distance measure for categorical variables it can be used for visualizing categorical data and for data clustering.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“They are, however, not limited to image processing and analysis but are outperforming other approaches in areas like natural language processing [3, 4, 5], speech recognition and synthesis [6, 7] 2 , and in the analysis of unstructured, tabular-type data using entity embeddings [8, 9].”
From An overview of deep learning in medical imaging focusing on MRI (2019) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
(2008) · Journal of Machine Learning Research · Cited by 33,051
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Cited by
Sorted by citations
Items 301–311 of 311
A New Method of B2B Customer Segmentation Based on Firmographic Data, and RFM and Graph Models
Hadid, A. B., Bouguelia, S., & Kheddouci, H. (2024) · IEEE International Conference on e-Business Engineering (ICEBE) · doi:10.1109/icebe62490.2024.00021
Nguyen, H.-L., Huynh, N.-N., Thai, H.-T., & Le-Minh, K.-H. (2024) · International Conference on Control, Automation and Information Sciences (ICCAIS) · doi:10.1109/iccais63750.2024.10814234
El-Aziz, E. A., Fathalla, R., Ismail, Y., & Shaheen, M. (2023) · International Conference on Computer Theory and Applications (ICCTA) · doi:10.1109/iccta60978.2023.10969284
Wang, W. (2025) · doi:10.26481/dis.20250522ww
A spatially-continuous neural network temperature model for weather derivatives evaluation
Carannante, M., Corsaro, S., Sauro, V. D., Marino, Z., & Scognamiglio, S. (2025) · Annals of Operations Research · doi:10.1007/s10479-025-06624-6
Exploring the scope of deep neural network to predict print densitometry from scanner data
Debnath, S., & Chatterjee, A. (2025) · Neural Computing and Applications · doi:10.1007/s00521-025-11313-3
Zhang, Z., Mirzaie, S., & Patidar, S. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5352562
A Neural Network-Based Prediction Model for Students' Mathematical Metacognitive Monitoring Ability
Chen, J., Sun, W., Xu, Q., Wang, Y., Yu, F., & Zhang, H. (2025) · International Conference on Computer Science and Technologies in Education (CSTE) · doi:10.1109/cste64638.2025.11091834
Huang, Z., Kong, W., & Wang, S. (2026) · Frontiers in Genetics · doi:10.3389/fgene.2026.1795752
ÖZİNAL, Y., Yıldırım, Z. B., Avşar, E., Özuysal, M., & Çalışkanelli, S. P. (2026) · International Journal of Injury Control and Safety Promotion · doi:10.1080/17457300.2026.2678331
Crivellari, A., & Liao, J.-Y. (2026) · Geocarto International · doi:10.1080/10106049.2026.2692161
Metadata
- Authors
- Guo, C., & Berkhahn, F.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1604.06737
- OpenAlex
- W2464785945
- Cited by
- 308
- References
- 36
- Citations by year
- 2026: 4 · 2025: 15 · 2024: 39 · 2023: 33 · 2022: 41 · 2021: 65 · 2020: 59 · 2019: 33 · 2018: 16 · 2017: 2 · 2016: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- entity embeddings, categorical variables, one-hot encoding, data sparsity, categorical data visualization, clustering, generalization, Kaggle competition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
