The DOI matches its Crossref record; 165 of the 165 references it cites were found in a registry or an index.
Informed Machine Learning - A Taxonomy and Survey of Integrating Prior Knowledge into Learning Systems
Open accessAbstract
Despite its great success, machine learning can have its limits when dealing with insufficient training data. A potential solution is the additional integration of prior knowledge into the training process which leads to the notion of informed machine learning. In this paper, we present a structured overview of various approaches in this field. We provide a definition and propose a concept for informed machine learning which illustrates its building blocks and distinguishes it from conventional machine learning. We introduce a taxonomy that serves as a classification framework for informed machine learning approaches. It considers the source of knowledge, its representation, and its integration into the machine learning pipeline. Based on this taxonomy, we survey related research and describe how different knowledge representations such as algebraic equations, logic rules, or simulation results can be used in learning systems. This evaluation of numerous papers on the basis of our taxonomy uncovers key methods in the field of informed machine learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
(1988) · Cited by 16,582
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
WordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015 · cited 1×
“For example, WordNet [117] represents semantic and lexical relations of words such as synonymy.”
Background(2021) · A First Course in Statistical Programming with R · doi:10.1017/9781108993456.011 · Cited by 13,724
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
(2009) · Cited by 6,153
Machine learning for molecular and materials science
Butler, K. T., Davies, D. W., Cartwright, H., Isayev, O., & Walsh, A. (2018) · Nature · doi:10.1038/s41586-018-0337-2 · Cited by 4,968 · cited 1×
“In addition to these classical domains, machine learning and in particular deep learning are increasingly important and successful in engineering and the sciences [5], [6], [7].”
BackgroundFreebase: a collaboratively created graph database for structuring human knowledge
Bollacker, K., Evans, C., Paritosh, P., Sturge, T., & Taylor, J. (2008) · Proceedings of the 2008 ACM SIGMOD international conference on Management of data · doi:10.1145/1376616.1376746 · Cited by 4,852
(2009) · Minds at UW (University of Wisconsin) · Cited by 4,791
(1996) · Cited by 4,738
Variational Inference: A Review for Statisticians
Blei, D. M., Kucukelbir, A., & McAuliffe, J. D. (2017) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1285773 · Cited by 3,811
Geometric Deep Learning: Going beyond Euclidean data
Bronstein, M. M., Bruna, J., LeCun, Y., Szlam, A., & Vandergheynst, P. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2693418 · Cited by 3,661
Atmospheric Modeling, Data Assimilation and Predictability
Kalnay, E. (2002) · doi:10.1017/cbo9780511802270 · Cited by 3,391 · cited 1×
“Especially the discipline of data assimilation deals with techniques that combine statistical and mechanistic models to improve prediction accuracy [129], [130].”
BackgroundLearning Bayesian Networks: The Combination of Knowledge and Statistical Data
Heckerman, D., Geiger, D., & Chickering, D. M. (1995) · Machine Learning · doi:10.1023/a:1022623210503 · Cited by 3,231
Generalizing from a Few Examples: A Survey on Few-shot Learning
Wang, Y., Yao, Q., Kwok, J. T., & Ni, L. M. (2021) · ACM Computing Surveys · doi:10.1145/3386252 · Cited by 3,165
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121
Distant supervision for relation extraction without labeled data
Mintz, M., Bills, S., Snow, R., & Jurafsky, D. (2009) · Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - ACL-IJCNLP '09 · doi:10.3115/1690219.1690287 · Cited by 2,752
Richardson, M., & Domingos, P. (2006) · Machine Learning · doi:10.1007/s10994-006-5833-1 · Cited by 2,676
Dynamic bayesian networks: representation, inference and learning
Murphy, K. P., & Russell, S. (2002) · Cited by 2,616
Building machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550
Artificial neural networks for solving ordinary and partial differential equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.712178 · Cited by 2,412
Opportunities and obstacles for deep learning in biology and medicine
Ching, T., Himmelstein, D. S., Beaulieu-Jones, B. K., Kalinin, A. A., Do, B. T., Way, G. P., Ferrero, E., Agapow, P.-M., Zietz, M., Hoffman, M. M., et al. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0387 · Cited by 2,310
Deep Neural Networks for Acoustic Modeling in Speech Recognition
Hinton, G. E., Deng, L., Yu, D., Dahl, G. E., Mohamed, A., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T. N., et al. (2012) · IEEE Signal Processing Magazine · Cited by 2,115
Learning Bayesian networks: The combination of knowledge and statistical data
Heckerman, D., Geiger, D., & Chickering, D. M. (1995) · Machine Learning · doi:10.1007/bf00994016 · Cited by 2,017
Variational Inference: A Review for Statisticians
Blei, D. M., Kucukelbir, A., & McAuliffe, J. (2017) · Figshare · doi:10.6084/m9.figshare.5203696 · Cited by 1,919
Learning from Simulated and Unsupervised Images through Adversarial Training
Shrivastava, A., Pfister, T., Tuzel, O., Susskind, J., Wang, W., & Webb, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.241 · Cited by 1,814
Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data
Karpatne, A., Atluri, G., Faghmous, J. H., Steinbach, M., Banerjee, A., Ganguly, A., Shekhar, S., Samatova, N., & Kumar, V. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2720168 · Cited by 1,752
An Introduction to Mathematical Logic
(2005) · Discrete Algorithmic Mathematics · doi:10.1201/b13782-17 · Cited by 1,732
Foundations of the Theory of Probability
Brookes, B. C., & Kolmogorov, A. N. (1951) · The Mathematical Gazette · doi:10.2307/3611503 · Cited by 1,691
Reynolds averaged turbulence modelling using deep neural networks with embedded invariance
Ling, J., Kurzawski, A., & Templeton, J. (2016) · Journal of Fluid Mechanics · doi:10.1017/jfm.2016.615 · Cited by 1,624
ERNIE: Enhanced Language Representation with Informative Entities
Zhang, Z., Han, X., Liu, Z., Jiang, X., Sun, M., & Liu, Q. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1139 · Cited by 1,482
(2020) · Data Mining and Machine Learning · doi:10.1017/9781108564175.026 · Cited by 1,401
Explanation-Based Generalization: A Unifying View
Mitchell, T. M., Keller, R. M., & Kedar-Cabelli, S. T. (1986) · Machine Learning · doi:10.1023/a:1022691120807 · Cited by 1,382
Support vector machine active learning for image retrieval
Tong, S., & Chang, E. (2001) · Proceedings of the ninth ACM international conference on Multimedia · doi:10.1145/500141.500159 · Cited by 1,328
Sim-to-Real Transfer of Robotic Control with Dynamics Randomization
Peng, X. B., Andrychowicz, M., Zaremba, W., & Abbeel, P. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460528 · Cited by 1,309 · cited 1×
“A promising direction to close the gap is domain adaptation, especially adversarial training [67], [137], or domain randomization [138].”
BackgroundVisual Analytics: Definition, Process, and Challenges
Keim, D., Andrienko, G., Fekete, J.-D., Görg, C., Kohlhammer, J., & Melançon, G. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-70956-5_7 · Cited by 1,063
Deep reinforcement learning from human preferences
Christiano, P., Leike, J., Brown, T. B., Martic, M., Legg, S., & Amodei, D. (2017) · arXiv · doi:10.48550/arxiv.1706.03741 · Cited by 1,058
Very Deep Convolutional Networks for Text Classification
Conneau, A., Schwenk, H., Barrault, L., & Lecun, Y. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers · doi:10.18653/v1/e17-1104 · Cited by 1,046
Explainable machine learning for scientific insights and discoveries
Roscher, R., Bohn, B., Duarte, M. F., & Garcke, J. (2020) · IEEE Access · doi:10.1109/access.2020.2976199 · Cited by 1,040 · cited 1×
“With machine learning models becoming more and more complex, there is also a growing need for models to be interpretable and explainable [9].”
BackgroundSelf-citationZhu, Y., Zabaras, N., Koutsourelakis, P.-S., & Perdikaris, P. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.05.024 · Cited by 1,030
A hybrid neural network‐first principles approach to process modeling
Psichogios, D. C., & Ungar, L. H. (1992) · AIChE Journal · doi:10.1002/aic.690381003 · Cited by 982
Robots that can adapt like animals
Cully, A., Clune, J., Tarapore, D., & Mouret, J.-B. (2015) · Nature · doi:10.1038/nature14422 · Cited by 979
Interaction Networks for Learning about Objects, Relations and Physics
Battaglia, P. W., Pascanu, R., Lai, M., Rezende, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1612.00222 · Cited by 969 · cited 3×
“, for learning physical dynamics [14], [62] or object detection [16].”
BackgroundFirst-Order Logic and Automated Theorem Proving
Fitting, M. (1996) · Springer eBooks · doi:10.1007/978-1-4612-2360-3 · Cited by 950
Artificial Neural Networks for Solving Ordinary and Partial Differential Equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · Cited by 944
Raissi, M., Perdikaris, P. G., & Karniadakis, G. E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.10561 · Cited by 925
Deep Q-learning From Demonstrations
Hester, T., Vecerik, M., Pietquin, O., Lanctot, M., Schaul, T., Piot, B., Horgan, D., Quan, J., Sendonaris, A., Osband, I., et al. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11757 · Cited by 889
Deep learning in fluid dynamics
Kutz, J. N. (2017) · Journal of Fluid Mechanics · doi:10.1017/jfm.2016.803 · Cited by 831
Knowledge-based artificial neural networks
Towell, G. G., & Shavlik, J. W. (1994) · Artificial Intelligence · doi:10.1016/0004-3702(94)90105-8 · Cited by 746
Knowledge Enhanced Contextual Word Representations
Peters, M. E., Neumann, M., Logan, R., Schwartz, R., Joshi, V., Singh, S., & Smith, N. A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1005 · Cited by 661
An Introduction to Variational Autoencoders
Kingma, D. P., & Welling, M. (2019) · doi:10.1561/9781680836233 · Cited by 643
GRAM: Graph-based Attention Model for Healthcare Representation Learning
Choi, E., Bahadori, M. T., Song, L., Stewart, W. F., & Sun, J. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098126 · Cited by 637
Fails, J. A., & Olsen, D. R. (2003) · Proceedings of the 8th international conference on Intelligent user interfaces · doi:10.1145/604045.604056 · Cited by 633
Hautier, G., Fischer, C. C., Jain, A., Mueller, T., & Ceder, G. (2010) · Chemistry of Materials · doi:10.1021/cm100795d · Cited by 580
Harmonic Networks: Deep Translation and Rotation Equivariance
Worrall, D. E., Garbin, S. J., Turmukhambetov, D., & Brostow, G. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.758 · Cited by 563
Numerical Solution of Partial Differential Equations in Science and Engineering.
Lapidus, L., & Pinder, G. F. (1983) · Mathematics of Computation · doi:10.2307/2007712 · Cited by 550
Harnessing Deep Neural Networks with Logic Rules
Hu, Z., Ma, X., Liu, Z., Hovy, E., & Xing, E. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1228 · Cited by 545
Group Equivariant Convolutional Networks
Cohen, T., & Welling, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.07576 · Cited by 524
Wu, J.-L., Xiao, H., & Paterson, E. (2018) · Physical Review Fluids · doi:10.1103/physrevfluids.3.074602 · Cited by 510
Mitchell, T., Cohen, W., Hruschka, E., Talukdar, P., Yang, B., Betteridge, J., Carlson, A., Dalvi, B., Gardner, M., Kisiel, B., et al. (2018) · Communications of the ACM · doi:10.1145/3191513 · Cited by 507
Neurosymbolic AI: the 3rd wave
Garcez, A. D., & Lamb, L. C. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10448-w · Cited by 503
Abu‐Mostafa, Y. S., Magdon‐Ismail, M., & Lin, H.-T. (2012) · Cited by 493
End-to-End Differentiable Physics for Learning and Control
Belbute-Peres, F. D. A., Smith, K. A., Allen, K. R., Tenenbaum, J. B., & Kolter, J. Z. (2018) · neural information processing systems · Cited by 488
Commonsense Knowledge Aware Conversation Generation with Graph Attention
Zhou, H., Young, T., Huang, M., Zhao, H., Xu, J., & Zhu, X. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/643 · Cited by 479
Learning Theory: An Approximation Theory Viewpoint
Felipe Cucker, B., & Zhou, D. X. (2007) · Cited by 478
Physics-Guided Neural Networks (PGNN): An Application in Lake Temperature Modeling
Daw, A., Karpatne, A., Watkins, W. D., Read, J. S., & Kumar, V. (2022) · Knowledge-Guided Machine Learning · doi:10.1201/9781003143376-15 · Cited by 472
Lowe, H. J. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03510380059038 · Cited by 468
Felipe Cucker, B., & Zhou, D. X. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511618796 · Cited by 433
Interactively shaping agents via human reinforcement: the TAMER framework
Knox, W. B., & Stone, P. (2009) · Proceedings of the fifth international conference on Knowledge capture · doi:10.1145/1597735.1597738 · Cited by 406
Deep learning for physical processes: incorporating prior scientific knowledge*
de Bézenac, E., Pajot, A., & Gallinari, P. (2019) · Journal of Statistical Mechanics Theory and Experiment · doi:10.1088/1742-5468/ab3195 · Cited by 396
Gauch Jr, H. G. (2002) · doi:10.1017/cbo9780511815034 · Cited by 385
Projection-based model reduction: Formulations for physics-based machine learning
Swischuk, R., Mainini, L., Peherstorfer, B., & Willcox, K. (2019) · Computers & Fluids · doi:10.1016/j.compfluid.2018.07.021 · Cited by 372
Counter-fitting Word Vectors to Linguistic Constraints
Mrkšić, N., Ó Séaghdha, D., Thomson, B., Gašić, M., Rojas-Barahona, L. M., Su, P.-H., Vandyke, D., Wen, T.-H., & Young, S. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1018 · Cited by 354
A Review of User Interface Design for Interactive Machine Learning
Dudley, J. J., & Kristensson, P. O. (2018) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3185517 · Cited by 343
Probabilistic Forecasting and Bayesian Data Assimilation
Reich, S., & Cotter, C. (2015) · Cambridge University Press eBooks · doi:10.1017/cbo9781107706804 · Cited by 334
The More You Know: Using Knowledge Graphs for Image Classification
Marino, K., Salakhutdinov, R., & Gupta, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.10 · Cited by 315
Incorporating prior information in machine learning by creating virtual examples
Niyogi, P., Girosi, F., & Poggio, T. (1998) · Proceedings of the IEEE · doi:10.1109/5.726787 · Cited by 313
A survey of preference-based reinforcement learning methods
Wirth, C., Akrour, R., Neumann, G. M., & Fürnkranz, J. (2017) · Journal of Machine Learning Research · doi:10.5445/ir/1000118270 · Cited by 311
Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims
Brundage, M., Avin, S., Wang, J., Belfield, H., Krueger, G., Hadfield, G., Khlaaf, H., Yang, J., Toner, H., Fong, R., et al. (2020) · arXiv · doi:10.48550/arxiv.2004.07213 · Cited by 306 · cited 1×
“Another important aspect is that a purely data-driven model might not meet constraints such as dictated by natural laws, or given through regulatory or security guidelines, which are important for trustworthy AI [8].”
BackgroundPhysics-guided Neural Networks (PGNN): An Application in Lake Temperature Modeling
Daw, A., Karpatne, A., Watkins, W., Read, J. S., & Kumar, V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.11431 · Cited by 300
Prior Knowledge in Support Vector Kernels
Schölkopf, B., Simard, P., Smola, A. J., & Vapnik, V. N. (1998) · Cited by 295
Exploiting Cyclic Symmetry in Convolutional Neural NetworksPreprint
Dieleman, S., Fauw, J. D., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.02660 · Cited by 283
A Semantic Loss Function for Deep Learning with Symbolic KnowledgePreprint
Xu, J., Zhang, Z., Friedman, T., Liang, Y., & den Broeck, G. V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.11157 · Cited by 283
Data-driven fluid simulations using regression forests
Ladický, L., Jeong, S., Solenthaler, B., Pollefeys, M., & Gross, M. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818129 · Cited by 275
Label-Free Supervision of Neural Networks with Physics and Domain Knowledge
Stewart, R., & Ermon, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10934 · Cited by 274
Learning sequential decision rules using simulation models and competition
Grefenstette, J. J., Ramsey, C. L., & Schultz, A. C. (1990) · Machine Learning · doi:10.1007/bf00116876 · Cited by 271
Hinge-Loss Markov Random Fields and Probabilistic Soft LogicPreprint
Bach, S. H., Broecheler, M., Huang, B., & Getoor, L. C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.04406 · Cited by 270
Deep Q-learning from Demonstrations
Hester, T., Vecerík, M., Pietquin, O., Lanctot, M., Schaul, T., Piot, B., Horgan, D., Quan, J., Sendonaris, A., Dulac-Arnold, G., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.03732 · Cited by 270
Interpretations are useful: penalizing explanations to align neural networks with prior knowledgePreprint
Rieger, L., Singh, C., Murdoch, W. J., & Yu, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.13584 · Cited by 264
UTOPIAN: User-Driven Topic Modeling Based on Interactive Nonnegative Matrix Factorization
Choo, J., Lee, C., Reddy, C. K., & Park, H. (2013) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2013.212 · Cited by 262
Best Choices for Regularization Parameters in Learning Theory: On the Bias—Variance Problem
Cucker, F., & Smale, S. (2002) · Foundations of Computational Mathematics · doi:10.1007/s102080010030 · Cited by 261
Deep Computational Phenotyping
Che, Z., Kale, D., Li, W., Bahadori, M. T., & Liu, Y. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783365 · Cited by 239
Challenges of Real-World Reinforcement Learning
Dulac-Arnold, G., Mankowitz, D. J., & Hester, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.12901 · Cited by 238
ConceptNet 5: A Large Semantic Network for Relational Knowledge
Speer, R., & Havasi, C. (2013) · Theory and Applications of Natural Language Processing · doi:10.1007/978-3-642-35085-6_6 · Cited by 223
Deep Lagrangian Networks: Using Physics as Model Prior for Deep Learning
Lutter, M., Ritter, C., & Peters, J. (2019) · TUbilio (Technical University of Darmstadt) · doi:10.26083/tuprints-00020557 · Cited by 212
The Use of Background Knowledge in Decision Tree Induction
Núñez, M. (1991) · Machine Learning · doi:10.1023/a:1022609710832 · Cited by 196
Dis-function: Learning distance functions interactively
Brown, E. T., Liu, J., Brodley, C. E., & Chang, R. (2012) · 2012 IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2012.6400486 · Cited by 193
Deep-learned Top Tagging with a Lorentz Layer
Butter, A., Kasieczka, G., Plehn, T., & Russell, M. (2018) · SciPost Physics · doi:10.21468/scipostphys.5.3.028 · Cited by 193
A Short Introduction to Probabilistic Soft Logic
Kimmig, A., Bach, S. H., Broecheler, M., Huang, B., & Getoor, L. C. (2012) · Lirias · Cited by 189
Guiding Semi-Supervision with Constraint-Driven Learning
Chang, M., Ratinov, L., & Roth, D. (2007) · Cited by 181
von Rueden, L., Mayer, S., Sifa, R., Bauckhage, C., & Garcke, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-44584-3_43 · Cited by 177
Self-citationStatistical Relational Artificial Intelligence: Logic, Probability, and Computation
Raedt, L. D., Kersting, K., Natarajan, S., & Poole, D. (2016) · Synthesis lectures on artificial intelligence and machine learning · doi:10.2200/s00692ed1v01y201601aim032 · Cited by 176
Garcez, A. D., Gori, M., Lamb, L. C., Serafini, L., Spranger, M., & Tran, S. N. (2019) · arXiv · doi:10.48550/arxiv.1905.06088 · Cited by 175
Incorporating prior knowledge in support vector machines for classification: A review
Lauer, F., & Bloch, G. (2007) · Neurocomputing · doi:10.1016/j.neucom.2007.04.010 · Cited by 172
Knowledge-Based Support Vector Machine Classifiers
Fung, G., Mangasarian, O. L., & SHAVLIK, J. W. (2002) · neural information processing systems · Cited by 163
Semantic-based regularization for learning and inference
Diligenti, M., Gori, M., & Saccà, C. (2017) · Artificial Intelligence · doi:10.1016/j.artint.2015.08.011 · Cited by 162
Optimisation of manufacturing process parameters using deep neural networks as surrogate models
Pfrommer, J., Zimmerling, C., Liu, J., Kärger, L., Henning, F., & Beyerer, J. (2018) · Procedia CIRP · doi:10.1016/j.procir.2018.03.046 · Cited by 162
Self-citationKnowledge-Powered Deep Learning for Word Embedding
Bian, J., Gao, B., & Liu, T.-Y. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-662-44848-9_9 · Cited by 161
Incorporating Prior Domain Knowledge into Deep Neural Networks
Muralidhar, N., Islam, M. R., Marwah, M., Karpatne, A., & Ramakrishnan, N. (2018) · 2018 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata.2018.8621955 · Cited by 160
VIS4ML: An Ontology for Visual Analytics Assisted Machine Learning
Sacha, D., Kraus, M., Keim, D. A., & Chen, M. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2864838 · Cited by 153
The Connectionist Inductive Learning and Logic Programming System
Garcez, A. S. A., & Zaverucha, G. (1999) · Applied Intelligence · doi:10.1023/a:1008328630915 · Cited by 152
Integrating Prior Knowledge into Deep Learning
Diligenti, M., Roychowdhury, S., & Gori, M. (2017) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2017.00-37 · Cited by 152
Joint Models of Disagreement and Stance in Online Debate
Sridhar, D., Foulds, J. R., Huang, B., Getoor, L. C., & Walker, M. A. (2015) · doi:10.3115/v1/p15-1012 · Cited by 151
Object Detection Meets Knowledge Graphs
Fang, Y., Kuan, K., Lin, J., Tan, C., & Chandrasekhar, V. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/230 · Cited by 147
Symbolic Graph Reasoning Meets Convolutions
Liang, X., Hu, Z., Zhang, H., Lin, L., & Xing, E. P. (2018) · neural information processing systems · Cited by 146
Distant Supervision Relation Extraction with Intra-Bag and Inter-Bag Attentions
Ye, Z.-X., & Ling, Z.-H. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1288 · Cited by 142
Fast relational learning using bottom clause propositionalization with artificial neural networks
França, M. V. M., Zaverucha, G., & Garcez, A. D. (2013) · Machine Learning · doi:10.1007/s10994-013-5392-1 · Cited by 125
Hybrid neural systems: from simple coupling to fully integrated neural networks
McGarry, K., Wermter, S., & MacIntyre, J. (1999) · Sunderland Repository (University of Sunderland) · Cited by 124
Constantinou, A. C., Fenton, N., & Neil, M. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.02.050 · Cited by 124
Structured learning with constrained conditional models
Chang, M.-W., Ratinov, L., & Roth, D. (2012) · Machine Learning · doi:10.1007/s10994-012-5296-5 · Cited by 118
Hybrid Knowledge Routed Modules for Large-scale Object DetectionPreprint
Jiang, C., Xu, H., Liang, X., & Lin, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.12681 · Cited by 110
Parameter estimation in stochastic differential equations: An overview
Nielsen, J. N., Madsen, H., & Young, P. C. (2000) · Annual Reviews in Control · doi:10.1016/s1367-5788(00)90017-8 · Cited by 103
Self-Supervised Intrinsic Image DecompositionPreprint
Janner, M., Wu, J., Kulkarni, T. D., Yildirim, I., & Tenenbaum, J. B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.03678 · Cited by 103
Deep Neural Networks with Massive Learned Knowledge
Hu, Z., Yang, Z., Salakhutdinov, R., & Xing, E. P. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1173 · Cited by 102
A Knowledge-Based Approach To Response Surface Modelling in Multifidelity Optimization
Leary, S. J., Bhaskar, A., & Keane, A. J. (2003) · Journal of Global Optimization · doi:10.1023/a:1023283917997 · Cited by 101
The Blackwell Guide to the Philosophy of Science
(2002) · Blackwell Publishing Ltd eBooks · doi:10.1111/b.9780631221081.2002.00012.x · Cited by 92
(2018) · International Conference on Learning Representations · Cited by 92
Deep-learned Top Tagging with a Lorentz Layer
Butter, A., Kasieczka, G., Plehn, T., & Russell, M. (2018) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000415419 · Cited by 90
Learning with knowledge from multiple experts
Richardson, M., & Domingos, P. (2003) · Cited by 89
Simulation-assisted machine learning
Deist, T. M., Patti, A., Wang, Z., Krane, D., Sorenson, T., & Craft, D. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz199 · Cited by 77
Gene set analysis exploiting the topology of a pathway
Massa, M. S., Chiogna, M., & Romualdi, C. (2010) · BMC Systems Biology · doi:10.1186/1752-0509-4-121 · Cited by 76
Addressing appearance change in outdoor robotics with adversarial domain adaptation
Wulfmeier, M., Bewley, A., & Posner, I. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8205961 · Cited by 76
Physics-informed deep generative modelsPreprint
Yang, Y., & Perdikaris, P. G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.03511 · Cited by 76
Not just data: A method for improving prediction with knowledge
Yet, B., Perkins, Z., Fenton, N., Tai, N. R. M., & Marsh, W. (2013) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2013.10.012 · Cited by 75
From Deep to Physics-Informed Learning of Turbulence: DiagnosticsPreprint
King, R., Hennigh, O., Mohan, A. T., & Chertkov, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.07785 · Cited by 73
Explicit Retrofitting of Distributional Word Vectors
Glavaš, G., & Vulić, I. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1004 · Cited by 71
An interactive approach for Bayesian network learning using domain/expert knowledge
Masegosa, A. R., & Moral, S. (2013) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2013.03.009 · Cited by 63
Deep Rotation Equivariant Network
Li, J., Yang, Z., Liu, H., & Cai, D. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.02.029 · Cited by 62
Nonlinear Knowledge-Based Classification
Mangasarian, O. L., & Wild, E. W. (2008) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005188 · Cited by 58
Alarm correlation and network fault resolution using the Kohonen self-organising map
Gardner, R. D., & Harle, D. (2002) · IEEE Global Telecommunications Conference (GLOBECOM) · doi:10.1109/glocom.1997.644365 · Cited by 43
Combining data and meta-analysis to build Bayesian networks for clinical decision support
Yet, B., Perkins, Z., Rasmussen, T. E., Tai, N. R. M., & Marsh, W. (2014) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.07.018 · Cited by 43
Learning to Exploit Stability for 3D Scene Parsing
Du, Y., Liu, Z., Basevi, H. R. A., Leonardis, A., Freeman, B., Tenenbaum, J. B., & Wu, J. (2018) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 42
Gao, Y., Meyer, C. M., & Gurevych, I. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1445 · Cited by 40
Spatio-temporal random fields: compressible representation and distributed estimation
Piatkowski, N., Lee, S., & Morik, K. J. (2013) · Machine Learning · doi:10.1007/s10994-013-5399-7 · Cited by 39
Kreutzer, J., Uyheng, J., & Riezler, S. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1165 · Cited by 38
Learning Pipelines with Limited Data and Domain Knowledge: A Study in Parsing Physics Problems
Sachan, M., Dubey, K. A., Mitchell, T. M., Roth, D., & Xing, E. P. (2018) · neural information processing systems · Cited by 36
Multi-view Factorization AutoEncoder with Network Constraints for Multi-omic Integrative Analysis
Ma, T., & Zhang, A. (2018) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2018.8621379 · Cited by 36
Bayesian learning of Bayesian networks with informative priors
Angelopoulos, N., & Cussens, J. (2008) · Annals of Mathematics and Artificial Intelligence · doi:10.1007/s10472-009-9133-x · Cited by 28
Using Simulation to Improve Sample-Efficiency of Bayesian Optimization for Bipedal RobotsPreprint
Rai, A., Antonova, R., Meier, F., & Atkeson, C. G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.02732 · Cited by 18
Leveraging Domain Knowledge for Reinforcement Learning Using MMC Architectures
Ramamurthy, R., Bauckhage, C., Sifa, R., Schücker, J., & Wrobel, S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30484-3_48 · Cited by 14
Self-citationAdversarial Constraint Learning for Structured Prediction
Ren, H., Stewart, R., Song, J., Kuleshov, V., & Ermon, S. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/366 · Cited by 13
Schramowski, P., Stammer, W., Teso, S., Brugger, A., Shao, X., Luigs, H.-G., Mahlein, A., & Kristian Kersting, B. (2020) · arXiv (Cornell University) · Cited by 13
Informed Machine Learning Through Functional Composition.
Bauckhage, C., Ojeda, C., Schücker, J., Sifa, R., & Wrobel, S. (2018) · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · Cited by 11
Self-citationStreet-Map Based Validation of Semantic Segmentation in Autonomous Driving
Rüden, L. V., Wirtz, T., Hueger, F., Schneider, J. D., Piatkowski, N., & Bauckhage, C. (2021) · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · doi:10.1109/icpr48806.2021.9413292 · Cited by 8
Self-citationMarkov Logic Mixtures of Gaussian Processes: Towards Machines Reading Regression Data
Schiegg, M., Neumann, M., & Kersting, K. (2012) · Cited by 7
Scalable Structure Learning for Probabilistic Soft LogicPreprint
Embar, V. R., Sridhar, D., Farnadi, G., & Getoor, L. C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00973 · Cited by 7
Learning from Human Feedback: Challenges for Real-World Reinforcement Learning in NLP.Preprint
Kreutzer, J., Riezler, S., & Lawrence, C. (2020) · arXiv (Cornell University) · Cited by 5
Black-Box Inference for Non-Linear Latent Force ModelsPreprint
Ward, W. O. C., Ryder, T., Prangle, D., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.09199 · Cited by 1
Cited by
Explainable machine learning for scientific insights and discoveries
Roscher, R., Bohn, B., Duarte, M. F., & Garcke, J. (2020) · IEEE Access · doi:10.1109/access.2020.2976199 · Cited by 1,040
Self-citationIntegrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems
Willard, J., Jia, X., Xu, S., Steinbach, M., & Kumar, V. (2023) · ACM Computing Surveys · doi:10.1145/3514228 · Cited by 878
Zio, E. (2022) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2021.108119 · Cited by 714
Explainable machine learning in materials science
Zhong, X., Gallagher, B., Liu, S., Kailkhura, B., Hiszpanski, A., & Han, T. Y.-J. (2022) · npj Computational Materials · doi:10.1038/s41524-022-00884-7 · Cited by 501
Machine learning in concrete science: applications, challenges, and best practices
Li, Z., Yoon, J., Zhang, R., Rajabipour, F., Srubar III, W. V., Dabo, I., & Radlińska, A. (2022) · npj Computational Materials · doi:10.1038/s41524-022-00810-x · Cited by 388
Metadata
- Authors
- von Rueden, L., Mayer, S., Beckh, K., Georgiev, B., Giesselbach, S., Heese, R., Kirsch, B., Walczak, M., Pfrommer, J., Pick, A., Ramamurthy, R., Garcke, J., Bauckhage, C., & Schuecker, J.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2021
- Pages
- 1-1
- ISSN
- 1041-4347 (ISSN-L)
- 1558-2191
- 2326-3865
- OpenAlex
- W3006087551
- Cited by
- 793
- References
- 165
- FWCI
- 46.23
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.