Entity Embeddings of Categorical Variables
Open accessAbstract
We map categorical variables in a function approximation problem into Euclidean spaces, which are the entity embeddings of the categorical variables. The mapping is learned by a neural network during the standard supervised training process. Entity embedding not only reduces memory usage and speeds up neural networks compared with one-hot encoding, but more importantly by mapping similar values close to each other in the embedding space it reveals the intrinsic properties of the categorical variables. We applied it successfully in a recent Kaggle competition and were able to reach the third position with relative simple features. We further demonstrate in this paper that entity embedding helps the neural network to generalize better when the data is sparse and statistics is unknown. Thus it is especially useful for datasets with lots of high cardinality features, where other methods tend to overfit. We also demonstrate that the embeddings obtained from the trained neural network boost the performance of all tested machine learning methods considerably when used as the input features instead. As entity embedding defines a distance measure for categorical variables it can be used for visualizing categorical data and for data clustering.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Deep learning techniques are outperforming other approaches in natural language processing, speech recognition and synthesis, and analysis of unstructured tabular data using entity embeddings.
“They are, however, not limited to image processing and analysis but are outperforming other approaches in areas like natural language processing [3, 4, 5], speech recognition and synthesis [6, 7] 2 , and in the analysis of unstructured, tabular-type data using entity embeddings [8, 9].”
From An overview of deep learning in medical imaging focusing on MRI (2019) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126 · see citing works
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 74,248 · see citing works
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016 · see citing works
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · see citing works
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562 · see citing works
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071 · see citing works
(2008) · Journal of Machine Learning Research · Cited by 33,051 · see citing works
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568 · see citing works
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · see citing works
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839 · see citing works
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831 · see citing works
Approximation by superpositions of a sigmoidal function
Cybenko, G. (1989) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf02551274 · Cited by 13,883 · see citing works
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260 · see citing works
Multidimensional Scaling by Optimizing Goodness of Fit to a Nonmetric Hypothesis
Kruskal, J. B. (1964) · Psychometrika · doi:10.1007/bf02289565 · Cited by 7,477 · see citing works
Measures of Multivariate Skewness and Kurtosis with Applications
Mardia, K. V. (1970) · Biometrika · doi:10.1093/biomet/57.3.519 · Cited by 4,859 · see citing works
Embedding Entities and Relations for Learning and Inference in Knowledge Bases
Yang, B., Yih, W.-T., He, X., Gao, J., & Deng, L. (2014) · arXiv · doi:10.48550/arxiv.1412.6575 · Cited by 2,252 · see citing works
Neural Word Embedding as Implicit Matrix Factorization
Levy, O., & Goldberg, Y. (2014) · neural information processing systems · Cited by 1,581 · see citing works
Deep convolutional neural networks for LVCSR
Sainath, T. N., Mohamed, A., Kingsbury, B. E. D., & Ramabhadran, B. (2013) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2013.6639347 · Cited by 1,066 · see citing works
Learning Structured Embeddings of Knowledge Bases
Bordes, A., Weston, J., Collobert, R., & Bengio, Y. (2011) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v25i1.7917 · Cited by 849 · see citing works
Learning distributed representations of concepts.
Hinton, G. E. (1989) · eScholarship (California Digital Library) · Cited by 815 · see citing works
Metric spaces and positive definite functions
Schoenberg, I. J. (1938) · Transactions of the American Mathematical Society · doi:10.1090/s0002-9947-1938-1501980-0 · Cited by 712 · see citing works
Bordes, A., Glorot, X., Weston, J., & Bengio, Y. (2014) · Machine Learning · doi:10.1007/s10994-013-5363-6 · Cited by 675 · see citing works
Learning to Represent Knowledge Graphs with Gaussian Embedding
He, S., Liu, K., Ji, G., & Zhao, J. (2015) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2806416.2806502 · Cited by 395 · see citing works
A latent factor model for highly multi-relational data
Jenatton, R., Roux, N. L., Bordes, A., & Obozinski, G. (2012) · Cited by 373 · see citing works
Empirical evaluation and combination of advanced language modeling techniques
Mikolov, T., Deoras, A., Kombrink, S., Burget, L., & Černocký, J. (2011) · Interspeech (USB) · doi:10.21437/interspeech.2011-242 · Cited by 278 · see citing works
On the distortion required for embedding finite metric spaces into normed spaces
Matoušek, J. (1996) · Israel Journal of Mathematics · doi:10.1007/bf02761110 · Cited by 99 · see citing works
Constructive Approximation of Discontinuous Functions by Neural Networks
Llanas, B., Sánchez, S. L., & Sáinz, F. J. (2008) · Neural Processing Letters · doi:10.1007/s11063-007-9070-9 · Cited by 49 · see citing works
Learning Hierarchical Structures with Linear Relational Embedding
Paccanaro, A., & Hinton, G. E. (2001) · Cited by 20 · see citing works
Paccanaro, A., & Hinton, G. E. (2000) · doi:10.1109/ijcnn.2000.857906 · Cited by 18 · see citing works
Structured Embedding via Pairwise Relations and Long-Range Interactions in Knowledge Base
Wu, F. Q., Song, J., Yang, Y., Li, X., Zhang, Z. M., & Zhuang, Y. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9391 · Cited by 11 · see citing works
Flagged first, then by citations
4 of the 36 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
An overview of deep learning in medical imaging focusing on MRI
Lundervold, A. S., & Lundervold, A. (2019) · Zeitschrift für Medizinische Physik · doi:10.1016/j.zemedi.2018.11.002 · Cited by 2,058 · see citing works
Aas, K., Jullum, M., & Løland, A. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103502 · Cited by 1,159 · see citing works
Deep Neural Networks and Tabular Data: A Survey
Borisov, V., Leemann, T., Seßler, K., Haug, J., Pawelczyk, M., & Kasneci, G. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3229161 · Cited by 1,182 · see citing works
Fastai: A Layered API for Deep Learning
Howard, J., & Gugger, S. (2020) · Information · doi:10.3390/info11020108 · Cited by 992 · see citing works
An overview of deep learning in medical imaging focusing on MRI
Lundervold, A. S., & Lundervold, A. (2018) · NORA - Norwegian Open Research Archives · Cited by 1,012 · see citing works
Survey on categorical data for neural networks
Hancock, J., & Khoshgoftaar, T. M. (2020) · Journal Of Big Data · doi:10.1186/s40537-020-00305-w · Cited by 642 · see citing works
AutoGluon-Tabular: Robust and Accurate AutoML for Structured DataPreprint
Erickson, N., Mueller, J. W., Shirkov, A., Zhang, H., Larroy, P., Li, M., & Smola, A. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.06505 · Cited by 517 · see citing works
Neural Networks for Postprocessing Ensemble Weather Forecasts
Rasp, S., & Lerch, S. (2018) · Monthly Weather Review · doi:10.1175/mwr-d-18-0187.1 · Cited by 531 · see citing works
CLIP-Driven Universal Model for Organ Segmentation and Tumor Detection
Liu, J., Zhang, Y., Chen, J.-N., Xiao, J., Lu, Y., Landman, B. A., Yuan, Y., Yuille, A., Tang, Y., & Zhou, Z. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01934 · Cited by 347 · see citing works
A Deep-Learned Embedding Technique for Categorical Features Encoding
Dahouda, M. K., & Joe, I. (2021) · IEEE Access · doi:10.1109/access.2021.3104357 · Cited by 325 · see citing works
Similarity encoding for learning with dirty categorical variables
Cerda, P., Varoquaux, G. P., & Kégl, B. (2018) · Machine Learning · doi:10.1007/s10994-018-5724-2 · Cited by 271 · see citing works
Kaggle forecasting competitions: An overlooked learning opportunity
Bojer, C. S., & Meldgaard, J. P. (2020) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2020.07.007 · Cited by 268 · see citing works
Time-to-Event Prediction with Neural Networks and Cox RegressionPreprint
Kvamme, H., Borgan, Ø., & Scheel, I. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.00825 · Cited by 224 · see citing works
Special issue on feature engineering editorial
Verdonck, T., Baesens, B., Óskarsdóttir, M., & Broucke, S. V. (2021) · Machine Learning · doi:10.1007/s10994-021-06042-2 · Cited by 242 · see citing works
Hybrid Deep Neural Networks for Detection of Non-Technical Losses in Electricity Smart Meters
Buzau, M.-M., Tejedor-Aguilera, J., Cruz-Romero, P., & Gómez‐Expósito, A. (2019) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2019.2943115 · Cited by 216 · see citing works
Deep Dive into Machine Learning Models for Protein Engineering
Xu, Y., Verma, D., Sheridan, R. P., Liaw, A. I., Ma, J., Marshall, N., McIntosh, J. A., Sherer, E. C., Svetnik, V., & Johnston, J. M. (2020) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c00073 · Cited by 203 · see citing works
Outlier Detection for Multidimensional Time Series Using Deep Neural Networks
Kieu, T., Yang, B., & Jensen, C. S. (2018) · IEEE International Conference on Mobile Data Management (MDM) · doi:10.1109/mdm.2018.00029 · Cited by 209 · see citing works
Data management for production quality deep learning models: Challenges and solutions
Munappy, A. R., Bosch, J., Olsson, H. H., Arpteg, A., & Brinne, B. (2022) · Journal of Systems and Software · doi:10.1016/j.jss.2022.111359 · Cited by 192 · see citing works
Deep and Embedded Learning Approach for Traffic Flow Prediction in Urban Informatics
Zheng, Z., Yang, Y., Liu, J., Dai, H., & Zhang, Y. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2909904 · Cited by 176 · see citing works
Predictive maintenance using tree-based classification techniques: A case of railway switches
Bukhsh, Z. A., Saeed, A., Stipanović, I., & Dorée, A. G. (2019) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2019.02.001 · Cited by 174 · see citing works
A neural network extension of the Lee–Carter model to multiple populations
Richman, R., & Wüthrich, M. V. (2019) · Annals of Actuarial Science · doi:10.1017/s1748499519000071 · Cited by 133 · see citing works
The value of text for small business default prediction: A Deep Learning approach
Stevenson, M., Mues, C., & Bravo, C. (2021) · European Journal of Operational Research · doi:10.1016/j.ejor.2021.03.008 · Cited by 127 · see citing works
Medicare fraud detection using neural networks
Johnson, J. M., & Khoshgoftaar, T. M. (2019) · Journal Of Big Data · doi:10.1186/s40537-019-0225-0 · Cited by 126 · see citing works
Bonde, A., Varadarajan, K. M., Bonde, N., Troelsen, A., Muratoglu, O. K., Malchau, H., Yang, A. D., Alam, H. B., & Sillesen, M. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00084-4 · Cited by 113 · see citing works
Bootstrapping Conditional GANs for Video Game Level Generation
Torrado, R. R., Khalifa, A., Green, M. C., Justesen, N., Risi, S., & Togelius, J. (2020) · IEEE Conference on Games (CoG) · doi:10.1109/cog47356.2020.9231576 · Cited by 104 · see citing works
Benchmarking machine learning models on multi-centre eICU critical care dataset
Sheikhalishahi, S., Balaraman, V., & Osmani, V. (2020) · PLOS ONE · doi:10.1371/journal.pone.0235424 · Cited by 89 · see citing works
Ensemble Multifeatured Deep Learning Models and Applications: A Survey
Abimannan, S., El-Alfy, E.-S. M., Chang, Y., Hussain, S., Shukla, S., & Satheesh, D. (2023) · IEEE Access · doi:10.1109/access.2023.3320042 · Cited by 101 · see citing works
Song, Z., Chen, J., Cheng, J., Chen, G., & Qi, Z. (2023) · Chemical Reviews · doi:10.1021/acs.chemrev.3c00223 · Cited by 89 · see citing works
Learning Heterogeneous Spatial-Temporal Representation for Bike-Sharing Demand Prediction
Li, Y., Zhu, Z., Kong, D., Xu, M., & Zhao, Y. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33011004 · Cited by 84 · see citing works
Li, T., & Cheng, X. Y. (2021) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2021.102356 · Cited by 82 · see citing works
AI in actuarial science – a review of recent advances – part 2
Richman, R. (2020) · Annals of Actuarial Science · doi:10.1017/s174849952000024x · Cited by 79 · see citing works
Kaur, A., Singh, Y., Neeru, N., Kaur, L., & Singh, A. (2022) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-021-09649-9 · Cited by 79 · see citing works
Danilevicz, M. F., Bayer, P. E., Boussaid, F., Bennamoun, M., & Edwards, D. (2021) · Remote Sensing · doi:10.3390/rs13193976 · Cited by 75 · see citing works
Efficient Discrete Feature Encoding for Variational Quantum Classifier
Yano, H., Suzuki, Y., Itoh, K. M., Raymond, R., & Yamamoto, N. (2020) · IEEE International Conference on Quantum Computing and Engineering (QCE) · doi:10.1109/qce49297.2020.00012 · Cited by 73 · see citing works
SuperTML: Two-Dimensional Word Embedding for the Precognition on Structured Tabular Data
Sun, B., Yang, L., Zhang, W., Lin, M., Dong, P., Young, C., & Dong, J. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00360 · Cited by 75 · see citing works
A Multi-View Deep Learning Approach for Predictive Business Process Monitoring
Pasquadibisceglie, V., Appice, A., Castellano, G., & Malerba, D. (2021) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2021.3051771 · Cited by 69 · see citing works
Sample-to-sample correspondence for unsupervised domain adaptation
Das, D., & Lee, C. S. G. (2018) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2018.05.001 · Cited by 65 · see citing works
Perfectly parallel fairness certification of neural networks
Urban, C., Christakis, M., Wüstholz, V., & Zhang, F. (2020) · Proceedings of the ACM on Programming Languages · doi:10.1145/3428253 · Cited by 62 · see citing works
Aguilar, D. L., Medina‐Pérez, M. A., Loyola‐González, O., Choo, K. R., & Bucheli-Susarrey, E. (2022) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2022.3148331 · Cited by 61 · see citing works
Distinguishing Trajectories from Different Drivers using Incompletely Labeled Trajectories
Kieu, T., Yang, B., Guo, C., & Jensen, C. S. (2018) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3269206.3271762 · Cited by 58 · see citing works
Self-citationBottieau, J., Wang, Y., Grève, Z. D., Vallée, F., & Toubeau, J. (2022) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2022.3195970 · Cited by 57 · see citing works
Probabilistic Predictions from Deterministic Atmospheric River Forecasts with Deep Learning
Chapman, W., Monache, L. D., Alessandrini, S., Subramanian, A., Ralph, F. M., Xie, S.-P., Lerch, S., & Hayatbini, N. (2021) · Monthly Weather Review · doi:10.1175/mwr-d-21-0106.1 · Cited by 60 · see citing works
A Case Study on using Deep Learning for Network Intrusion Detection
Fernandez, G. C., & Xu, S. (2019) · IEEE Military Communications Conference (MILCOM) · doi:10.1109/milcom47813.2019.9020824 · Cited by 57 · see citing works
Improving healthcare access management by predicting patient no-show behaviour
Barrera, D., Brailsford, S., Bravo, C., & Smith, H. K. (2020) · Decision Support Systems · doi:10.1016/j.dss.2020.113398 · Cited by 55 · see citing works
Crivellari, A., & Beinat, E. (2019) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi8030134 · Cited by 49 · see citing works
Improving Seasonal Forecast Using Probabilistic Deep Learning
Pan, B., Anderson, G. J., Gonçalves, A. R., Lucas, D. D., Bonfils, C., & Lee, J. (2022) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2021ms002766 · Cited by 49 · see citing works
Zang, Z., Li, D., Guo, Y., Shi, W., & Yan, X. (2021) · Remote Sensing · doi:10.3390/rs13142779 · Cited by 48 · see citing works
Neural hierarchical models of ecological populations
Joseph, M. B. (2020) · Ecology Letters · doi:10.1111/ele.13462 · Cited by 46 · see citing works
A Deep Neural Network Model for Hybrid Spectrum Sensing in Cognitive Radio
Nasser, A., Chaitou, M., Mansour, A., Yao, K. C., & Charara, H. (2021) · Wireless Personal Communications · doi:10.1007/s11277-020-08013-7 · Cited by 44 · see citing works
Towards Effective Detection of Recent DDoS Attacks: A Deep Learning Approach
Lopes, I. O., Zou, D., Ruambo, F. A., Akbar, S., & Yuan, B. (2021) · Security and Communication Networks · doi:10.1155/2021/5710028 · Cited by 44 · see citing works
Arkoudi, I., Krueger, R., Azevedo, C. L., & Pereira, F. C. (2023) · Transportation Research Part B Methodological · doi:10.1016/j.trb.2023.102783 · Cited by 42 · see citing works
An explainable attention network for fraud detection in claims management
Farbmacher, H., Löw, L., & Spindler, M. (2020) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.05.021 · Cited by 44 · see citing works
Effective network intrusion detection via representation learning: A Denoising AutoEncoder approach
Lopes, I. O., Zou, D., Abdulqadder, I. H., Ruambo, F. A., Yuan, B., & Jin, H. (2022) · Computer Communications · doi:10.1016/j.comcom.2022.07.027 · Cited by 42 · see citing works
Simplifying tree-based methods for retail sales forecasting with explanatory variables
Wellens, A. P., Boute, R. N., & Udenio, M. (2023) · European Journal of Operational Research · doi:10.1016/j.ejor.2023.10.039 · Cited by 40 · see citing works
Zang, Z., Guo, Y., Jiang, Y., Zuo, C., Li, D., Shi, W., & Yan, X. (2021) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2021.102516 · Cited by 40 · see citing works
Travel Mode Choice Prediction Using Deep Neural Networks With Entity Embeddings
Ma, Y., & Zhang, Z. (2020) · IEEE Access · doi:10.1109/access.2020.2985542 · Cited by 38 · see citing works
Incremental semi-supervised Extreme Learning Machine for Mixed data stream classification
Li, Q., Xiong, Q., Ji, S., Yu, Y., Wu, C., & Gao, M. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115591 · Cited by 38 · see citing works
ProcessTransformer: Predictive Business Process Monitoring with Transformer NetworkPreprint
Bukhsh, Z. A., Saeed, A., & Dijkman, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.00721 · Cited by 38 · see citing works
CALIBRATING THE LEE-CARTER AND THE POISSON LEE-CARTER MODELS VIA NEURAL NETWORKS
Scognamiglio, S. (2022) · Astin Bulletin · doi:10.1017/asb.2022.5 · Cited by 37 · see citing works
Liu, F., Jiang, X., & Zhang, M. (2021) · Environmental Science and Pollution Research · doi:10.1007/s11356-021-15895-y · Cited by 36 · see citing works
Alcántara, A., Galván, I. M., & Aler, R. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105128 · Cited by 36 · see citing works
AI in Actuarial SciencePreprint
Richman, R. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3218082 · Cited by 36 · see citing works
A Gated Dilated Causal Convolution Based Encoder-Decoder for Network Traffic Forecasting
Zhang, X., & You, J. (2020) · IEEE Access · doi:10.1109/access.2019.2963449 · Cited by 34 · see citing works
Composite Travel Generative Adversarial Networks for Tabular and Sequential Population Synthesis
Badu-Marfo, G., Farooq, B., & Patterson, Z. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3168232 · Cited by 34 · see citing works
SSH-Brute Force Attack Detection Model based on Deep Learning
Wanjau, S. K., Wambugu, G. M., & Kamau, G. N. (2021) · International Journal of Computer Applications Technology and Research · doi:10.7753/ijcatr1001.1008 · Cited by 34 · see citing works
Variational Bayes survival analysis for unemployment modelling
Boškoski, P., Perne, M., Rameša, M., & Boshkoska, B. M. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107335 · Cited by 33 · see citing works
A Simple Scalable Neural Networks based Model for Geolocation Prediction in Twitter
Miura, Y., Taniguchi, M., Taniguchi, T., & Ohkuma, T. (2016) · International Conference on Computational Linguistics · Cited by 33 · see citing works
Xu, Z., Sun, H., Zhang, T., Xu, H., Wu, D., & Gao, J. (2023) · Agricultural Water Management · doi:10.1016/j.agwat.2023.108405 · Cited by 34 · see citing works
Analytics of Heterogeneous Breast Cancer Data Using Neuroevolution
Abdikenov, B., Iklassov, Z., Sharipov, A., Hussain, S., & Jamwal, P. K. (2019) · IEEE Access · doi:10.1109/access.2019.2897078 · Cited by 32 · see citing works
López‐Martín, M., Carro, B., Arribas, J. I., & Sánchez-Esguevillas, A. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106887 · Cited by 31 · see citing works
Wahid, N. A., Adi, T. N., Bae, H., & Choi, Y.-L. (2019) · Procedia Computer Science · doi:10.1016/j.procs.2019.11.219 · Cited by 30 · see citing works
Nogales, A., Díaz-Morón, R., & García-Tejedor, Á. J. (2021) · Food Control · doi:10.1016/j.foodcont.2021.108697 · Cited by 30 · see citing works
Zoppi, T., & Ceccarelli, A. (2021) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2021.103106 · Cited by 30 · see citing works
Coupling Physical Factors for Precipitation Forecast in China With Graph Neural Network
Chen, Y., Wang, Y., Huang, G., & Tian, Q. (2024) · Geophysical Research Letters · doi:10.1029/2023gl106676 · Cited by 28 · see citing works
Improving Parking Availability Information Using Deep Learning Techniques
Arjona, J., Linares, M. P., Casanovas, J., & Vázquez, J. J. (2020) · Transportation research procedia · doi:10.1016/j.trpro.2020.03.113 · Cited by 28 · see citing works
A CWGAN-GP-based multi-task learning model for consumer credit scoring
Kang, Y., Chen, L., Jia, N., Wei, W., Deng, J., & Qian, H. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117650 · Cited by 28 · see citing works
Network Intrusion Detection based on LSTM and Feature EmbeddingPreprint
Gwon, H., Lee, C., Keum, R., & Choi, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.11552 · Cited by 28 · see citing works
Jun, H. J., Kim, J., Rhee, D.-Y., & Chang, S. W. (2020) · Sustainability · doi:10.3390/su12176964 · Cited by 27 · see citing works
Modeling Machine Health Using Gated Recurrent Units with Entity Embeddings and K-Means Clustering
Amihai, I., Chioua, M., Gitzel, R., Kotriwala, A. M., Pareschi, D., Sosale, G., & Subbiah, S. (2018) · IEEE International Conference on Industrial Informatics (INDIN) · doi:10.1109/indin.2018.8472065 · Cited by 27 · see citing works
Fast, Accurate, and Simple Models for Tabular Data via Augmented DistillationPreprint
Fakoor, R., Mueller, J. W., Erickson, N., Chaudhari, P., & Smola, A. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.14284 · Cited by 29 · see citing works
Properties of ROC curvesPreprint
Feng, K., HONG, H. P., Tang, K., & Wang, J. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3382962 · Cited by 26 · see citing works
Liu, K., & El-Gohary, N. (2020) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000921 · Cited by 25 · see citing works
Liapis, A., Faliagka, E., Antonopoulos, C., Κεραμίδας, Γ., & Voros, N. S. (2021) · Electronics · doi:10.3390/electronics10131550 · Cited by 25 · see citing works
Sheikhalishahi, S., Bhattacharyya, A., Celi, L. A., & Osmani, V. (2023) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2023.102659 · Cited by 23 · see citing works
Hien, D. T. T., Thi, C., Kim, T., Dao, S. T., & Nguyen, C. (2020) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2020.0111135 · Cited by 23 · see citing works
An effective strategy for churn prediction and customer profiling
Geiler, L., Affeldt, S., & Nadif, M. (2022) · Data & Knowledge Engineering · doi:10.1016/j.datak.2022.102100 · Cited by 23 · see citing works
Shahraki, S. Z., Looha, M. A., Kazaj, P. M., Aria, M., Akbari, A., Emami, H., Asadi, F., & Akbari, M. E. (2023) · Frontiers in Oncology · doi:10.3389/fonc.2023.1147604 · Cited by 24 · see citing works
Karystianis, G., Cabral, R. C., Han, S. C., Poon, J., & Butler, T. G. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.602683 · Cited by 24 · see citing works
Estimation of Travel Time Based on Ensemble Method With Multi-Modality Perspective Urban Big Data
Zou, Z., Yang, H., & Zhu, A. (2020) · IEEE Access · doi:10.1109/access.2020.2971008 · Cited by 20 · see citing works
Twitter Geolocation Prediction Using Neural Networks
Thomas, P. E., & Hennig, L. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-73706-5_21 · Cited by 20 · see citing works
Dynamic Deep Forest: An Ensemble Classification Method for Network Intrusion Detection
Hu, B., Wang, J., Zhu, Y., & Yang, T. (2019) · Electronics · doi:10.3390/electronics8090968 · Cited by 20 · see citing works
On the Effectiveness of Discretizing Quantitative Attributes in Linear Classifiers
Zaidi, N. A., Du, Y., & Webb, G. I. (2020) · IEEE Access · doi:10.1109/access.2020.3034955 · Cited by 20 · see citing works
Predicting Playa Inundation Using a Long Short‐Term Memory Neural Network
Solvik, K. K., Bartuszevige, A. M., Bogaerts, M., & Joseph, M. B. (2021) · Water Resources Research · doi:10.1029/2020wr029009 · Cited by 19 · see citing works
Applying Machine Learning to End-to-end Slice SLA Decomposition
Iannelli, M., Rahman, M. R., Choi, N., & Wang, L. (2020) · IEEE International Conference on Network Softwarization (NetSoft) · doi:10.1109/netsoft48620.2020.9165317 · Cited by 19 · see citing works
Luo, N., Zhang, Y., Jiang, Y., Zuo, C., Chen, J., Zhao, W., Shi, W., & Yan, X. (2024) · Environmental Pollution · doi:10.1016/j.envpol.2024.123838 · Cited by 19 · see citing works
A deep learning approach to real-time parking availability prediction for smart cities
Arjona, J., Linares, M. P., & Casanovas, J. (2019) · International Conference on Data Science, E-Learning and Information Systems (DATA) · doi:10.1145/3368691.3368707 · Cited by 19 · see citing works
Flight Delay Prediction Using a Hybrid Deep Learning Method
Cheevachaipimol, W., Teinwan, B., & Chutima, P. (2021) · Engineering Journal · doi:10.4186/ej.2021.25.8.99 · Cited by 18 · see citing works
Alavijeh, M. K., Lee, Y. Y., & Gras, S. L. (2024) · Engineering in Life Sciences · doi:10.1002/elsc.202400023 · Cited by 18 · see citing works
On the analytical properties of category encodings in logistic regression
Zeng, G. (2021) · Communication in Statistics- Theory and Methods · doi:10.1080/03610926.2021.1939382 · Cited by 18 · see citing works
Hao, P., Le, T. D., Vishnevsky, V. M., Berezkin, A., & Kirichek, R. (2024) · International Conference on Advanced Communications Technology (ICACT) · doi:10.23919/icact60172.2024.10471929 · Cited by 18 · see citing works
- Authors
- Guo, C., & Berkhahn, F.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1604.06737
- OpenAlex
- W2464785945
- Cited by
- 308
- References
- 36
- Citations by year
- 2026: 4 · 2025: 15 · 2024: 39 · 2023: 33 · 2022: 41 · 2021: 65 · 2020: 59 · 2019: 33 · 2018: 16 · 2017: 2 · 2016: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- entity embeddings, categorical variables, one-hot encoding, data sparsity, categorical data visualization, clustering, generalization, Kaggle competition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
