The DOI matches its Crossref record; 172 of the 172 references it cites were found in a registry or an index.
Deep Neural Networks and Tabular Data: A Survey
Open accessAbstract
Heterogeneous tabular data are the most commonly used form of data and are essential for numerous critical and computationally demanding applications. On homogeneous datasets, deep neural networks have repeatedly shown excellent performance and have therefore been widely adopted. However, their adaptation to tabular data for inference or data generation tasks remains highly challenging. To facilitate further progress in the field, this work provides an overview of state-of-the-art deep learning methods for tabular data. We categorize these methods into three groups: data transformations, specialized architectures, and regularization models. For each of these groups, our work offers a comprehensive overview of the main approaches. Moreover, we discuss deep learning approaches for generating tabular data and also provide an overview over strategies for explaining deep models on tabular data. Thus, our first contribution is to address the main research streams and existing methodologies in the mentioned areas while highlighting relevant challenges and open research questions. Our second contribution is to provide an empirical comparison of traditional machine learning methods with 11 deep learning approaches across five popular real-world tabular datasets of different sizes and with different learning objectives. Our results, which we have made publicly available as competitive benchmarks, indicate that algorithms based on gradient-boosted tree ensembles still mostly outperform deep learning models on supervised learning tasks, suggesting that the research progress on competitive deep learning models for tabular data is stagnating. To the best of our knowledge, this is the first in-depth overview of deep learning approaches for tabular data; as such, this work can serve as a valuable starting point to guide researchers and practitioners interested in deep learning with tabular data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,410
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS
FISHER, R. A. (1936) · Annals of Eugenics · doi:10.1111/j.1469-1809.1936.tb02137.x · Cited by 15,227
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
A survey on Image Data Augmentation for Deep Learning
Shorten, C., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0197-0 · Cited by 13,203
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Classification And Regression Trees
Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (2017) · doi:10.1201/9781315139470 · Cited by 11,417
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978386 · Cited by 11,000
From local explanations to global understanding with explainable AI for trees
Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-019-0138-9 · Cited by 10,551
Larian Studios Dev Team (2024) · doi:10.1145/3292500.3330701 · Cited by 8,618
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
The Kolmogorov-Smirnov Test for Goodness of Fit
Massey, F. J. (1951) · Journal of the American Statistical Association · doi:10.1080/01621459.1951.10500769 · Cited by 7,210
Friedman, J. H. (2002) · Computational Statistics & Data Analysis · doi:10.1016/s0167-9473(01)00065-2 · Cited by 7,067
Greff, K., Srivastava, R. K., Koutnik, J., Steunebrink, B. R., & Schmidhuber, J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582924 · Cited by 6,955
Improved training of Wasserstein GANs
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. (2017) · arXiv · doi:10.48550/arxiv.1704.00028 · Cited by 6,800 · cited 1×
“Vanilla GANs or derivates, such as the Wasserstein GAN (WGAN) [135], WGAN with gradient penalty (WGAN-GP) [136], Cramér GAN [137], or the Boundary seeking GAN [138], which is designed to model discrete data, are commonly used in the literature to generate tabular data (cf. Table III).”
Method“Why Should I Trust You?”: Explaining the Predictions of Any Classifier
Ribeiro, M., Singh, S., & Guestrin, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations · doi:10.18653/v1/n16-3020 · Cited by 6,682
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00813 · Cited by 6,332
mixup: Beyond Empirical Risk Minimization
Zhang, H., Cisse, M., Dauphin, Y. N., & Lopez-Paz, D. (2017) · arXiv · doi:10.48550/arxiv.1710.09412 · Cited by 5,831
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812
CutMix: Regularization Strategy to Train Strong Classifiers With Localizable Features
Yun, S., Han, D., Chun, S., Oh, S. J., Yoo, Y., & Choe, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00612 · Cited by 5,400
Multimodal Machine Learning: A Survey and Taxonomy
Baltrusaitis, T., Ahuja, C., & Morency, L.-P. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2798607 · Cited by 5,018
On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524
Generative Adversarial Networks
Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.2661 · Cited by 4,477
Grad-CAM++: Generalized Gradient-Based Visual Explanations for Deep Convolutional Networks
Chattopadhay, A., Sarkar, A., Howlader, P., & Balasubramanian, V. N. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00097 · Cited by 3,639
Categorical Reparameterization with Gumbel-Softmax
Jang, E., Gu, S., & Poole, B. (2016) · arXiv · doi:10.48550/arxiv.1611.01144 · Cited by 3,616
Transformers in Vision: A Survey
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2022) · ACM Computing Surveys · doi:10.1145/3505244 · Cited by 3,595
Transformers in Vision: A Survey
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2021) · arXiv · doi:10.48550/arxiv.2101.01169 · Cited by 3,594
Wide & Deep Learning for Recommender Systems
Cheng, H.-T., Koc, L., Harmsen, J., Shaked, T., Chandra, T., Aradhye, H., Anderson, G., Corrado, G., Chai, W., Ispir, M., et al. (2016) · Proceedings of the 1st Workshop on Deep Learning for Recommender Systems · doi:10.1145/2988450.2988454 · Cited by 3,535
Deep Learning Based Recommender System: A Survey and New Perspectives
Zhang, S., Yao, L., Sun, A., & Tay, Y. (2020) · ACM Computing Surveys · doi:10.1145/3285029 · Cited by 3,485
A Survey of Data Mining and Machine Learning Methods for Cyber Security Intrusion Detection
Buczak, A. L., & Guven, E. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2494502 · Cited by 3,332
Docker: lightweight Linux containers for consistent development and deployment
Merkel, D. (2014) · Linux journal · Cited by 3,191
Rendle, S. (2010) · 2010 IEEE International Conference on Data Mining · doi:10.1109/icdm.2010.127 · Cited by 3,189
A Survey on Deep Transfer Learning
Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., & Liu, C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01424-7_27 · Cited by 3,165
The EU General Data Protection Regulation (GDPR)
Voigt, P., & von dem Bussche, A. (2017) · doi:10.1007/978-3-319-57959-7 · Cited by 3,001
Deep Learning for Anomaly Detection: A Review
Pang, G., Shen, C., Cao, L., & Hengel, A. V. D. (2022) · ACM Computing Surveys · doi:10.1145/3439950 · Cited by 2,837
DeepFM: A Factorization-Machine based Neural Network for CTR Prediction
Guo, H., TANG, R., Ye, Y., Li, Z., & He, X. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/239 · Cited by 2,538
A Survey on Explainable Artificial Intelligence (XAI): Toward Medical XAI
Tjoa, E., & Guan, C. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3027314 · Cited by 2,524
The Effectiveness of Data Augmentation in Image Classification using Deep Learning
Perez, L., & Wang, J. (2017) · arXiv · doi:10.48550/arxiv.1712.04621 · Cited by 2,499
Generative Adversarial Networks
(2022) · The Science of Deep Learning · doi:10.1017/9781108891530.013 · Cited by 2,402
Revisiting Deep Learning Models for Tabular DataPreprint
Gorishniy, Y., Rubachev, I., Khrulkov, V., & Babenko, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.11959 · Cited by 2,244
Mining high-speed data streams
Domingos, P., & Hulten, G. (2000) · Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/347090.347107 · Cited by 2,185
Tabular data: Deep learning is not all you need
Shwartz-Ziv, R., & Armon, A. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.11.011 · Cited by 2,172 · cited 6×
“Although deep learning methods perform outstandingly well for classification or data generation tasks on homogeneous data (e.g., image, audio, and text data), tabular data still pose a challenge to deep learning models [6], [7], [8].”
BackgroundInfluentialAnchors: High-Precision Model-Agnostic Explanations
Ribeiro, M. T., Singh, S., & Guestrin, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11491 · Cited by 2,162
Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey
Jing, L., & Tian, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2992393 · Cited by 2,036
TabNet: Attentive Interpretable Tabular Learning
Arik, S. Ö., & Pfister, T. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i8.16826 · Cited by 1,771
Approximating discrete probability distributions with dependence trees
Chow, C., & Liu, C. (1968) · IEEE Transactions on Information Theory · doi:10.1109/tit.1968.1054142 · Cited by 1,720
Discriminatory analysis: Nonparametric discrimination: Consistency properties: (471672008-001)
Fix, E., & Hodges, J. L. (1951) · PsycEXTRA Dataset · doi:10.1037/e471672008-001 · Cited by 1,696
AutoML: A survey of the state-of-the-art
He, X., Zhao, K., & Chu, X. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106622 · Cited by 1,691
Searching for exotic particles in high-energy physics with deep learning
Baldi, P., Sadowski, P., & Whiteson, D. (2014) · Nature Communications · doi:10.1038/ncomms5308 · Cited by 1,164
Self-supervised Learning: Generative or Contrastive
Liu, X., Zhang, F., Hou, Z., Mian, L., Wang, Z., Zhang, J., & Tang, J. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3090866 · Cited by 1,087
Counterfactual explanations without opening the black box: automated decisions and the GDPR
Wachter, S., Mittelstadt, B., & Russell, C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3063289 · Cited by 1,061
Predicting clicks: estimating the click-through rate for new ads
Richardson, M., Dominowska, E., & Ragno, R. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242643 · Cited by 1,049
Bias in data‐driven artificial intelligence systems—An introductory survey
Ntoutsi, E., Fafalios, P., Gadiraju, U., Iosifidis, V., Nejdl, W., Vidal, M., Ruggieri, S., Turini, F., Papadopoulos, S., Krasanakis, E., et al. (2020) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1356 · Cited by 1,043
Self-citationxDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems
Lian, J., Zhou, X., Zhang, F., Chen, Z., Xie, X., & Sun, G. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220023 · Cited by 1,040
Designing Theory-Driven User-Centric Explainable AI
Wang, D., Yang, Q., Abdul, A., & Lim, B. Y. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300831 · Cited by 906
Practical Lessons from Predicting Clicks on Ads at Facebook
He, X., Pan, J., Jin, O., Xu, T., Liu, B., Xu, T., Shi, Y., Atallah, A., Herbrich, R., Bowers, S., et al. (2014) · Proceedings of the Eighth International Workshop on Data Mining for Online Advertising · doi:10.1145/2648584.2648589 · Cited by 869
Mittelstadt, B., Russell, C., & Wachter, S. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287574 · Cited by 794 · cited 1×
“Another line of research deploys gradient-based optimization to find low-cost counterfactual explanations in the presence of feasibility and diversity constraints [176], [177].”
BackgroundLayer-Wise Relevance Propagation: An Overview
Montavon, G., Binder, A., Lapuschkin, S., Samek, W., & Müller, K.-R. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_10 · Cited by 750
SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-TrainingPreprint
Somepalli, G., Goldblum, M., Schwarzschild, A., Bruss, C. B., & Goldstein, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.01342 · Cited by 750
Mooney, C. (1997) · doi:10.4135/9781412985116 · Cited by 677
Deep Learning based Recommender System: A Survey and New Perspectives
Zhang, S., Yao, L., Sun, A., & Tay, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.07435 · Cited by 635
Explainable machine learning in deployment
Bhatt, U., Xiang, A., Sharma, S., Weller, A., Taly, A., Jia, Y., Ghosh, J., Puri, R., Moura, J. M. F., & Eckersley, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3375624 · Cited by 633
A Survey of Methods for Explaining Black Box Models
Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., & Pedreschi, D. (2019) · ACM Computing Surveys · doi:10.1145/3236009 · Cited by 629
Patki, N., Wedge, R., & Veeramachaneni, K. (2016) · 2016 IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2016.49 · Cited by 616
Survey on categorical data for neural networks
Hancock, J. T., & Khoshgoftaar, T. M. (2020) · Journal of Big Data · doi:10.1186/s40537-020-00305-w · Cited by 611
Intelligible models for classification and regression
Lou, Y., Caruana, R., & Gehrke, J. (2012) · Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2339530.2339556 · Cited by 547
Data synthesis based on generative adversarial networks
Park, N., Mohammadi, M., Gorde, K., Jajodia, S., Park, H., & Kim, Y. (2018) · Proceedings of the VLDB Endowment · doi:10.14778/3231751.3231757 · Cited by 531
Sparse spatial autoregressions
Kelley Pace, R., & Barry, R. (1997) · Statistics & Probability Letters · doi:10.1016/s0167-7152(96)00140-x · Cited by 502
Actionable Recourse in Linear Classification
Ustun, B., Spangher, A., & Liu, Y. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287566 · Cited by 501
TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data
Yin, P., Neubig, G., Yih, W.-T., & Riedel, S. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.745 · Cited by 487
Neural Oblivious Decision Ensembles for Deep Learning on Tabular DataPreprint
Popov, S., Morozov, S., & Babenko, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.06312 · Cited by 449
From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classification
Martins, A. F. T., & Astudillo, R. F. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.02068 · Cited by 431
Distilling a neural network into a soft decision tree
Frosst, N., & Hinton, G. (2017) · arXiv · doi:10.48550/arxiv.1711.09784 · Cited by 407
PrivBayes: Private Data Release via Bayesian Networks
Zhang, J., Cormode, G., Procopiuc, C. M., Srivastava, D., & Xiao, X. (2017) · ACM Transactions on Database Systems · doi:10.1145/3134428 · Cited by 399
Learning and Extracting Finite State Automata with Second-Order Recurrent Neural Networks
Giles, C. L., Miller, C. B., Chen, D., Chen, H. H., Sun, G. Z., & Lee, Y. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.393 · Cited by 392
TFX: A TensorFlow-Based Production-Scale Machine Learning Platform
Baylor, D., Breck, E., Cheng, H.-T., Fiedel, N., Foo, C. Y., Haque, Z., Haykal, S., Ispir, M., Jain, V., Koc, L., et al. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098021 · Cited by 350
Handling incomplete heterogeneous data using VAEs
Nazábal, A., Olmos, P. M., Ghahramani, Z., & Valera, I. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107501 · Cited by 345
Counterfactual Explanations for Machine Learning: A Review.Preprint
Verma, S., Dickerson, J. P., & Hines, K. (2020) · arXiv (Cornell University) · Cited by 332
Online Deep Learning: Learning Deep Neural Networks on the Fly
Sahoo, D., Pham, Q., Lu, J., & Hoi, S. C. H. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/369 · Cited by 323
Conditional Wasserstein GAN-based oversampling of tabular data for imbalanced learning
Engelmann, J., & Lessmann, S. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114582 · Cited by 309
Entity Embeddings of Categorical Variables
Guo, C., & Berkhahn, F. (2016) · arXiv · doi:10.48550/arxiv.1604.06737 · Cited by 308
Preserving Causal Constraints in Counterfactual Explanations for Machine Learning ClassifiersPreprint
Mahajan, D., Tan, C., & Sharma, A. K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.03277 · Cited by 305
Statistical Disclosure Control in Practice
Willenborg, L., & de Waal, T. (1996) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-4028-0 · Cited by 298
MIDA: Multiple Imputation Using Denoising Autoencoders
Gondara, L., & Wang, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93040-4_21 · Cited by 292
Micci-Barreca, D. (2001) · ACM SIGKDD Explorations Newsletter · doi:10.1145/507533.507538 · Cited by 276
CTAB-GAN: Effective Table Data SynthesizingPreprint
Zhao, Z., Kunar, A., der Scheer, H. V., Birke, R., & Chen, L. Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.08369 · Cited by 273
Generative Adversarial Networks in Computer Vision: A Survey and Taxonomy
Wang, Z., She, Q., & Ward, T. E. (2022) · ACM Computing Surveys · doi:10.1145/3439723 · Cited by 267
Kaggle forecasting competitions: An overlooked learning opportunity
Bojer, C. S., & Meldgaard, J. P. (2021) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2020.07.007 · Cited by 264
Deep learning and the electrocardiogram: review of the current state-of-the-art
Somani, S., Russak, A. J., Richter, F., Zhao, S., Vaid, A., Chaudhry, F., De Freitas, J. K., Naik, N., Miotto, R., Nadkarni, G. N., et al. (2021) · EP Europace · doi:10.1093/europace/euaa377 · Cited by 264
An Open Source AutoML BenchmarkPreprint
Gijsbers, P., LeDell, E., Thomas, J., Poirier, S., Bischl, B., & Vanschoren, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.00909 · Cited by 259
Generative Adversarial Networks in Computer Vision: A Survey and Taxonomy
Wang, Z., She, Q., & Ward, T. E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.01529 · Cited by 255
Synthesizing electronic health records using improved generative adversarial networks
Baowaly, M. K., Lin, C.-C., Liu, C.-L., & Chen, K.-T. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy142 · Cited by 251
The Cramer Distance as a Solution to Biased Wasserstein Gradients
Bellemare, M. G., Danihelka, I., Dabney, W., Mohamed, S., Lakshminarayanan, B., Hoyer, S., & Munos, R. (2017) · arXiv · doi:10.48550/arxiv.1705.10743 · Cited by 223
Adversarial Generation of Natural Language
Subramanian, S., Rajeswar, S., Dutil, F., Pal, C., & Courville, A. C. (2017) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/w17-2629 · Cited by 220
Efficient Search for Diverse Coherent Explanations
Russell, C. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287569 · Cited by 218
Converting tabular data into images for deep learning with convolutional neural networks
Zhu, Y., Brettin, T., Xia, F., Partin, A., Shukla, M., Yoo, H., Evrard, Y. A., Doroshow, J. H., & Stevens, R. L. (2021) · Scientific Reports · doi:10.1038/s41598-021-90923-y · Cited by 210
Synthesizing Tabular Data using Generative Adversarial Networks
Xu, L., & Veeramachaneni, K. K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.11264 · Cited by 206
Gade, K., Geyik, S. C., Kenthapadi, K., Mithal, V., & Taly, A. (2019) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3292500.3332281 · Cited by 205
SCARF: Self-Supervised Contrastive Learning using Random Feature CorruptionPreprint
Bahri, D., Jiang, H., Tay, Y., & Metzler, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.15147 · Cited by 205
TabTransformer: Tabular Data Modeling Using Contextual Embeddings
Huang, X., Khetan, A., Cvitkovic, M. W., & Karnin, Z. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.06678 · Cited by 200
Sparse Sequence-to-Sequence Models
Peters, B., Niculae, V., & Martins, A. F. T. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1146 · Cited by 196
Manapragada, C., Webb, G. I., & Salehi, M. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220005 · Cited by 183
Learning Model-Agnostic Counterfactual Explanations for Tabular Data
Pawelczyk, M., Broelemann, K., & Kasneci, G. (2020) · Proceedings of The Web Conference 2020 · doi:10.1145/3366423.3380087 · Cited by 167 · cited 1×
“To alleviate this problem and to suggest realistic looking counterfactuals, researchers have suggested building recourse suggestions on generative models [179]–[184].”
BackgroundSelf-citationLanguage Models with Transformers
Wang, C., Li, M., & Smola, A. J. (2019) · arXiv · doi:10.48550/arxiv.1904.09408 · Cited by 161 · cited 1×
“Inspired by the recent surge of interest in transformer-based methods and their successes on text and visual data [66], [104], researchers and practitioners have proposed multiple approaches using deep attention mechanisms [5] for heterogeneous tabular data.”
BackgroundFrom Clustering to Cluster Explanations via Neural Networks
Kauffmann, J., Esders, M., Ruff, L., Montavon, G., Samek, W., & Müller, K. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3185901 · Cited by 161
DeepGBM: A Deep Learning Framework Distilled by GBDT for Online Prediction Tasks
Ke, G., Xu, Z., Zhang, J., Bian, J., & Liu, T.-Y. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330858 · Cited by 158
CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation AlgorithmsPreprint
Pawelczyk, M., Bielawski, S., Heuvel, J. V. D., Richter, T., & Kasneci, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.00783 · Cited by 153
Self-citationData quality: A statistical perspective
Karr, A. F., Sanil, A. P., & Banks, D. L. (2005) · Statistical Methodology · doi:10.1016/j.stamet.2005.08.005 · Cited by 150
Concept Drift Adaptation by Exploiting Historical Knowledge
Sun, Y., Tang, K., Zhu, Z., & Yao, X. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2775225 · Cited by 141
Explainable Artificial Intelligence for Tabular Data: A Survey
Sahakyan, M., Aung, Z., & Rahwan, T. (2021) · IEEE Access · doi:10.1109/access.2021.3116481 · Cited by 135 · cited 3×
“[50] summarizes explanation techniques in the context of tabular data.”
BackgroundMethodInfluentialCopula Flows for Synthetic Data GenerationPreprint
Kamthe, S., Assefa, S., & Deisenroth, M. P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.00598 · Cited by 106
Synthetic Benchmarks for Scientific Research in Explainable Machine LearningPreprint
Liu, Y., Khandagale, S., White, C., & Neiswanger, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.12543 · Cited by 98
Joshi, S. D., Koyejo, S., Vijitbenjaronk, W. D., Kim, B., & Ghosh, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.09615 · Cited by 94
SDTR: Soft Decision Tree Regressor for Tabular Data
Luo, H., Cheng, F., Yu, H., & Yi, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3070575 · Cited by 94
Where is the Information in a Deep Neural Network?Preprint
Achille, A., Paolini, G., & Soatto, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.12213 · Cited by 89
SuperTML: Two-Dimensional Word Embedding for the Precognition on Structured Tabular Data
Sun, B., Yang, L., Zhang, W., Lin, M., Dong, P., Young, C., & Dong, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00360 · Cited by 87
Relational data synthesis using generative adversarial networks: a design space exploration
Fan, J., Chen, J., Liu, T., Shen, Y., Li, G., & Du, X. (2020) · Proceedings of the VLDB Endowment · doi:10.14778/3407790.3407802 · Cited by 83
ARM-Net: Adaptive Relation Modeling Network for Structured Data
Cai, S., Zheng, K., Chen, G., Jagadish, H. V., Ooi, B. C., & Zhang, M. (2021) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3448016.3457321 · Cited by 77
Airline Passenger Name Record Generation using Generative Adversarial NetworksPreprint
Mottini, A., Lhéritier, A., & Acuña-Agost, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.06657 · Cited by 76
Combining 3D Image and Tabular Data via the Dynamic Affine Feature Map Transform
Pölsterl, S., Wolf, T. N., & Wachinger, C. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87240-3_66 · Cited by 73
Deep learning: A primer for psychologists.
Urban, C. J., & Gates, K. M. (2021) · Psychological Methods · doi:10.1037/met0000374 · Cited by 71
Synthetic minority oversampling of vital statistics data with generative adversarial networks
Koivu, A., Sairanen, M., Airola, A., & Pahikkala, T. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa127 · Cited by 68
Language Models are Realistic Tabular Data Generators
Borisov, V., Seßler, K., Leemann, T., Pawelczyk, M., & Kasneci, G. (2022) · arXiv · doi:10.48550/arxiv.2210.06280 · Cited by 68
Self-citationSequential Deep Learning for Credit Risk Monitoring with Tabular Financial DataPreprint
Clements, J. M., Xu, D., Yousefi, N., & Efimov, D. (2020) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2012.15330 · Cited by 66
Enhanced Security and Privacy via Fragmented Federated Learning
Jebreel, N., Domingo‐Ferrer, J., Blanco-Justicia, A., & Sánchez, D. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3212627 · Cited by 60
Pawelczyk, M., Datta, T., van-den-Heuvel, J., Kasneci, G., & Lakkaraju, H. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.06768 · Cited by 58
Self-citationOn Embeddings for Numerical Features in Tabular Deep LearningPreprint
Gorishniy, Y., Rubachev, I., & Babenko, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.05556 · Cited by 55
Network On Network for Tabular Data Classification in Real-world Applications
Luo, Y., Zhou, H., Tu, W.-W., Chen, Y., Dai, W., & Yang, Q. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401437 · Cited by 54
Boost then Convolve: Gradient Boosting Meets Graph Neural NetworksPreprint
Ivanov, S., & Prokhorenkova, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.08543 · Cited by 53
CancelOut: A Layer for Feature Selection in Deep Neural Networks
Borisov, V., Haug, J., & Kasneci, G. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30484-3_6 · Cited by 49
Self-citationOn Baselines for Local Feature AttributionsPreprint
Haug, J., Zürn, S., El-Jiz, P., & Kasneci, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.00905 · Cited by 49
Self-citationRobust cognitive load detection from wrist-band sensors
Borisov, V., Kasneci, E., & Kasneci, G. (2021) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2021.100116 · Cited by 47
Self-citationRelevance aggregation for neural networks interpretability and knowledge discovery on tabular data
Grisci, B. I., Krause, M. J., & Dorn, M. (2021) · Information Sciences · doi:10.1016/j.ins.2021.01.052 · Cited by 46
(2020) · arXiv (Cornell University) · Cited by 37
Improving deep learning performance with missing values via deletion and compensation
Sánchez-Morales, A., Sancho‐Gómez, J., Martínez-García, J.-A., & Figueiras-Vidal, A. R. (2019) · Neural Computing and Applications · doi:10.1007/s00521-019-04013-2 · Cited by 35
On Training Deep Neural Networks Using a Streaming Approach
Duda, P., Jaworski, M., Cader, A., & Wang, L. (2019) · Journal of Artificial Intelligence and Soft Computing Research · doi:10.2478/jaiscr-2020-0002 · Cited by 34
TNT: An Interpretable Tree-Network-Tree Learning Framework using Knowledge Distillation
Li, J., Li, Y., Xiang, X., Xia, S., Dong, S., & Cai, Y. (2020) · Entropy · doi:10.3390/e22111203 · Cited by 29
Learning Parameter Distributions to Detect Concept Drift in Data Streams
Haug, J., & Kasneci, G. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412499 · Cited by 28
Self-citationMultiview Deep Anomaly Detection: A Systematic Exploration
Wang, S., Liu, J., Yu, G. W., Liu, X., Zhou, S., Zhu, E., Yang, Y., Yin, J., & Yang, W. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3184723 · Cited by 28
Simple Modifications to Improve Tabular Neural NetworksPreprint
Fiedler, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.03214 · Cited by 27
A Survey of Evolution in Predictive Models and Impacting Factors in Customer Churn
Ahmed, M., Afzal, H., Majeed, A., & Khan, B. (2017) · Advances in Data Science and Adaptive Analysis · doi:10.1142/s2424922x17500073 · Cited by 22
A Gradient-Based Split Criterion for Highly Accurate and Transparent Model Trees
Broelemann, K., & Kasneci, G. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/281 · Cited by 22
Self-citationEditorial Deep Learning for Anomaly Detection
Pang, G., Aggarwal, C. C., Shen, C., & Sebe, N. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3162123 · Cited by 22
Regularization is all you Need: Simple Neural Nets can Excel on Tabular DataPreprint
Kadra, A., Lindauer, M., Hutter, F., & Grabocka, J. (2021) · arXiv (Cornell University) · Cited by 19
Leveraging Model Inherent Variable Importance for Stable Online Feature Selection
Haug, J., Pawelczyk, M., Broelemann, K., & Kasneci, G. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403200 · Cited by 18
Self-citationDNN2LR: Interpretation-inspired Feature Crossing for Real-world Tabular DataPreprint
Liu, Z., Liu, Q., Zhang, H., & Chen, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.09775 · Cited by 18
IFedAvg: Interpretable Data-Interoperability for Federated LearningPreprint
Roschewitz, D., Hartley, M., Corinzia, L., & Jaggi, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.06580 · Cited by 15
BENN: Bias Estimation Using a Deep Neural Network
Giloni, A., Grolman, E., Hagemann, T., Fromm, R., Fischer, S., Elovici, Y., & Shabtai, A. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3172365 · Cited by 13
Kasneci, G., & Gottron, T. (2016) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2983323.2983746 · Cited by 12
Self-citationNew Properties of the Data Distillation Method When Working with Tabular Data
Medvedev, D., & D’yakonov, A. G. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-72610-2_29 · Cited by 11
Deep multimodal learning for manufacturing problem solving
Lichtenwalter, D., Burggräf, P., Wagner, J., & Weißer, T. (2021) · Procedia CIRP · doi:10.1016/j.procir.2021.03.083 · Cited by 11
Muddling Label Regularization: Deep Learning for Tabular DatasetsPreprint
Lounici, K., Méziani, K., & Riu, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.04462 · Cited by 11
Not All Datasets Are Born Equal: On Heterogeneous Data and Adversarial ExamplesPreprint
Mathov, Y., Levy, E., Katzir, Z., Shabtai, A., & Elovici, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.03180 · Cited by 10
Generating Privacy-Preserving Synthetic Tabular Data Using Oblivious Variational Autoencoders
Kok, S., & Vardhan, L. V. H. (2020) · National University of Singapore · Cited by 10
Conservative Policy Construction Using Variational Autoencoders for Logged Data With Missing Values
Abroshan, M., Yip, K. H., Tekin, C., & van der Schaar, M. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3136385 · Cited by 9
Fairness in TabNet Model by Disentangled Representation for the Prediction of Hospital No-ShowPreprint
Boughorbel, S., Jarray, F., & Kadri, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.04048 · Cited by 5
Predicting the Solar Potential of Rooftops using Image Segmentation and Structured DataPreprint
Soares, D. D. B., Andrieux, F., Hell, B., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.15268 · Cited by 5
Sanity Checks for Saliency Metrics
Tomsett, R., Harborne, D., Chakraborty, S., Gurram, P., & Preece, A. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6064 · Cited by 3
Lockout: Sparse Regularization of Neural NetworksPreprint
Valdés, G., Arbelo, W., Interian, Y., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.07160 · Cited by 2
Cited by
Accurate predictions on small data with a tabular foundation model
Hollmann, N., Müller, S., Purucker, L., Krishnakumar, A., Körfer, M., Hoo, S. B., Schirrmeister, R. T., & Hutter, F. (2025) · Nature · doi:10.1038/s41586-024-08328-6 · Cited by 974
Multimodal learning with graphs
Ektefaie, Y., Dasoulas, G., Noori, A., Farhat, M., & Zitnik, M. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00624-6 · Cited by 166
Multimodal data integration for oncology in the era of deep neural networks: a review
Waqas, A., Tripathi, A., Ramachandran, R. P., Stewart, P. A., & Rasool, G. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1408843 · Cited by 165
Artificial intelligence for biomarker discovery in Alzheimer's disease and dementia
Winchester, L. M., Harshfield, E. L., Shi, L., Badhwar, A., Khleifat, A. A., Clarke, N., Dehsarvi, A., Lengyel, I., Lourida, I., Madan, C. R., et al. (2023) · Alzheimer's & Dementia · doi:10.1002/alz.13390 · Cited by 130
EXplainable Artificial Intelligence (XAI)—From Theory to Methods and Applications
Ortigossa, E. S., Gonçalves, T., & Nonato, L. G. (2024) · IEEE Access · doi:10.1109/access.2024.3409843 · Cited by 124
Metadata
- Authors
- Borisov, V., Leemann, T., Seßler, K., Haug, J., Pawelczyk, M., & Kasneci, G.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2024-06
- Volume
- 35
- Issue
- 6
- Pages
- 7499-7519
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W3202428668
- Cited by
- 1,025
- References
- 172
- FWCI
- 58.16
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.