Learning sparse nonparametric DAGs.
Open accessAbstract
We develop a framework for learning sparse nonparametric directed acyclic graphs (DAGs) from data. Our approach is based on a recent algebraic characterization of DAGs that led to a fully continuous program for score-based learning of DAG models parametrized by a linear structural equation model (SEM). We extend this algebraic characterization to nonparametric SEM by leveraging nonparametric sparsity based on partial derivatives, resulting in a continuous optimization problem that can be applied to a variety of nonparametric and semiparametric models including GLMs, additive noise models, and index models as special cases. Unlike existing approaches that require specific modeling choices, loss functions, or algorithms, we present a completely general framework that can be applied to general nonlinear models (e.g. without additive noise), general differentiable loss functions, and generic black-box optimization routines. The code is available at https://github.com/xunzheng/notears.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
NOTEARS utilizes algebraic features to reconstruct discrete acyclic graph searches into a continuous optimization problem, allowing direct solving using gradient descent.
“NOTEARS[25] innovatively utilizes algebraic features to reconstruct discrete acyclic graph searches into a continuous optimization problem, allowing direct solving using gradient descent.”
From From Correlation to Intervention: A Survey on Log-Based Causal Analysis for Security and AIOps (2026) · cites this paper as [25]
The Abstract (p. 1) says an algebraic characterization of DAGs led to a continuous optimization program, and §4.3 (p. 8) describes solving the differentiable program with standard optimizers. The paper identifies L-BFGS-B, a gradient-based quasi-Newton method, as a natural choice; it does not say the program is solved by gradient descent specifically. (LLM, conf=0.85)
Experimental — accuracy not yet measuredWe designed our emulation model to unify recent developments in machine learning-based generative modelling and causal structure (DAG) learning within a single framework.
“we designed our emulation model to unify recent developments in machine learning-based generative modelling and causal structure (DAG) learning within a single framework.”
From Emulating real-world GLP-1 efficacy in type 2 diabetes through causal learning and virtual patients (2025) · cites this paper as [12]
The Introduction (p. 1) describes a general framework for learning DAG models, supporting the causal-structure-learning component. The cited paper does not say that this framework unifies generative modelling with DAG learning, or describe the citing authors’ emulation model. (LLM, conf=0.82)
Experimental — accuracy not yet measuredBy involving the causal dependencies between the data variables from NOTEARS-MLP within the WGAN-GP architecture, the model learns to simulate the true generative process underpinning the real-world data.
“By involving the causal dependencies between the data variables from NOTEARS-MLP within the WGAN-GP architecture, we learn how to simulate the true generative process underpinning the real-world data.”
From Emulating real-world GLP-1 efficacy in type 2 diabetes through causal learning and virtual patients (2025) · cites this paper as [12]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Part of this paper’s reference list could not be split into single entries.
Learning Functional Causal Models with Generative Neural Networks
Goudet, O., Kalainathan, D., Caillou, P., Guyon, I., Lopez-Paz, D., & Sebag, M. (2018) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-319-98131-4_3 · Cited by 123 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- [6]6. C.-J. Hsieh, M. A. Sustik, I. S. Dhillon, P. K. Ravikumar, and R. Poldrack. Big & quic: Sparse inverse covariance estimation for a million variables. In Advances in Neural Information Processing Systems , pages 3165-3173, 2013. - B. Huang, K. Zhang, Y. Lin, B. Schölkopf, and C. Glymour. Generalized score functions for causal discovery. In KDD , 2018. - A. M. Kagan, C. R. Rao, and Y. V. Linnik. Characterization problems in mathematical statistics . Wiley, 1973. - D. Kalainathan, O. Goudet, I. Guyon, D. Lopez-Paz, and M. Sebag. SAM: Structural Agnostic Model, Causal Discovery and Penalized Adversarial Learning. arXiv preprint arXiv:1803.04929 , 2018. - M. J. Kusner, J. Loftus, C. Russell, and R. Silva. Counterfactual fairness. In Advances in Neural Information Processing Systems , pages 4066-4076, 2017. - S. Lachapelle, P. Brouillard, T. Deleu, and S. Lacoste-Julien. Gradient-Based Neural DAG Learning. arXiv preprint arXiv:1906.02226 , 2019. - J. Lafferty, L. Wasserman, et al. Rodeo: sparse, greedy nonparametric regression. The Annals of Statistics , 36(1):28-63, 2008. - A. B. Lee, R. Izbicki, et al. A spectral series approach to high-dimensional nonparametric regression. Electronic Journal of Statistics , 10(1):423-463, 2016. - H. Liu, J. Lafferty, and L. Wasserman. The nonparanormal: Semiparametric estimation of high dimensional undirected graphs. Journal of Machine Learning Research , 2009. · arXiv
Cited by
Sorted by citations
Graph neural networks: A review of methods and applications
Zhou, J., Cui, G., Hu, S., Zhang, Z., Yang, C., Liu, Z., Wang, L., Li, C., & Sun, M. (2020) · AI Open · doi:10.1016/j.aiopen.2021.01.001 · Cited by 6,880 · see citing works
Berrevoets, J., Kacprzyk, K., Qian, Z., & van der Schaar, M. (2023) · arXiv · doi:10.48550/arxiv.2303.02186 · Cited by 8 · see citing works
“For example, comparing Zheng et al. [78] with the later Zheng et al. [79] using the latter of causation, implies that Zheng et al. [79] wrongly claimed an improvement on Zheng et al. [78] as they both transition from having no structural knowledge to plausible structural knowledge.”
BackgroundEmulating real-world GLP-1 efficacy in type 2 diabetes through causal learning and virtual patients
MacLellan, C. R., Petkov, H., McKeag, C., Dong, F., Lowe, D. J., Maguire, R., Moschoyiannis, S., Armes, J., Skene, S., Finlinson, A., et al. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000927 · Cited by 1 · see citing works
- Authors
- Zheng, X., Dan, C., Aragam, B., Ravikumar, P., & Xing, E. P.
- Affiliations
- Carnegie Mellon University (US)
- University of Chicago (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- Pages
- 3414-3425
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1909.13189
- OpenAlex
- W2975424829
- Cited by
- 103
- References
- 1
- Citations by year
- 2026: 1 · 2025: 12 · 2024: 27 · 2023: 31 · 2022: 14 · 2021: 14 · 2020: 4
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Artificial Intelligence and Statistics
- Funders
- National Science Foundation (1934584, 1909816)
- Defense Advanced Research Projects Agency
- Advanced Research Projects Agency
- Office of Naval Research (N000141812861)
- Air Force Research Laboratory
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Keywords
- directed acyclic graphs, score-based learning, linear structural equation models, continuous optimization, partial derivatives, additive noise model, index model, general linear model, causal discovery, nonlinear models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
