The DOI matches its Crossref record; 85 of the 85 references it cites were found in a registry or an index.
BANANAS: Bayesian Optimization with Neural Architectures for Neural Architecture Search
Open accessAbstract
Over the past half-decade, many methods have been considered for neural architecture search (NAS). Bayesian optimization (BO), which has long had success in hyperparameter optimization, has recently emerged as a very promising strategy for NAS when it is coupled with a neural predictor. Recent work has proposed different instantiations of this framework, for example, using Bayesian neural networks or graph convolutional networks as the predictive model within BO. However, the analyses in these papers often focus on the full-fledged NAS algorithm, so it is difficult to tell which individual components of the framework lead to the best performance. In this work, we give a thorough analysis of the "BO + neural predictor framework" by identifying five main components: the architecture encoding, neural predictor, uncertainty calibration method, acquisition function, and acquisition function optimization. We test several different methods for each component and also develop a novel path-based encoding scheme for neural architectures, which we show theoretically and empirically scales better than other encodings. Using all of our analyses, we develop a final algorithm called BANANAS, which achieves state-of-the-art performance on NAS search spaces. We adhere to the NAS research checklist (Lindauer and Hutter 2019) to facilitate best practices, and our code is available at https://github.com/naszilla/naszilla.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
Graph neural networks: A review of methods and applications
Zhou, J., Cui, G., Hu, S., Zhang, Z., Yang, C., Liu, Z., Wang, L., Li, C., & Sun, M. (2020) · AI Open · doi:10.1016/j.aiopen.2021.01.001 · Cited by 6,880
Practical Bayesian Optimization of Machine Learning Algorithms
Snoek, J., Larochelle, H., & Adams, R. P. (2012) · arXiv · doi:10.48550/arxiv.1206.2944 · Cited by 6,691
Gaussian Processes in Machine Learning
Rasmussen, C. E. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-28650-9_4 · Cited by 5,397
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636
Neural Architecture Search with Reinforcement Learning
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 3,974
(2011) · Cited by 3,939
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles
Lakshminarayanan, B., Pritzel, A., & Blundell, C. (2016) · arXiv · doi:10.48550/arxiv.1612.01474 · Cited by 3,666
MnasNet: Platform-Aware Neural Architecture Search for Mobile
Tan, M., Chen, B., Pang, R., Vasudevan, V., Sandler, M., Howard, A., & Le, Q. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00293 · Cited by 3,416
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
Evolving Neural Networks through Augmenting Topologies
Stanley, K. O., & Miikkulainen, R. (2002) · Evolutionary Computation · doi:10.1162/106365602320169811 · Cited by 3,258
DARTS: Differentiable architecture search
Liu, H., Simonyan, K., & Yang, Y. (2018) · arXiv · doi:10.48550/arxiv.1806.09055 · Cited by 3,248
THOMPSON, W. R. (1933) · Biometrika · doi:10.1093/biomet/25.3-4.285 · Cited by 2,712
Progressive Neural Architecture Search
Liu, C., Zoph, B., Neumann, M., Shlens, J., Hua, W., Li, L.-J., Fei-Fei, L., Yuille, A., Huang, J., & Murphy, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_2 · Cited by 1,833
Neural Architecture Search: A Survey
Elsken, T., Metzen, J. H., & Hutter, F. (2018) · arXiv · doi:10.48550/arxiv.1808.05377 · Cited by 1,763
A New Method of Locating the Maximum Point of an Arbitrary Multipeak Curve in the Presence of Noise
Kushner, H. J. (1964) · Journal of Basic Engineering · doi:10.1115/1.3653121 · Cited by 1,082
Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization
Li, L., Jamieson, K., DeSalvo, G., Rostamizadeh, A., & Talwalkar, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.06560 · Cited by 1,018
Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift
Ovadia, Y., Fertig, E., Ren, J., Nado, Z., Sculley, D., Nowozin, S., Dillon, J. V., Lakshminarayanan, B., & Snoek, J. (2019) · arXiv · doi:10.48550/arxiv.1906.02530 · Cited by 989
NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture SearchPreprint
Dong, X., & Yang, Y. (2020) · International Conference on Learning Representations · doi:10.48550/arxiv.2001.00326 · Cited by 917
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Reinforcement Learning · doi:10.1007/978-1-4615-3618-5_2 · Cited by 903
Neuroevolution: from architectures to learning
Floreano, D., Dürr, P., & Mattiussi, C. (2008) · Evolutionary Intelligence · doi:10.1007/s12065-007-0002-4 · Cited by 734
SNAS: Stochastic Neural Architecture Search
Xie, S., Zheng, H., Liu, C., & Lin, L. (2018) · arXiv · doi:10.48550/arxiv.1812.09926 · Cited by 731
Domhan, T., Springenberg, J. T., & Hutter, F. (2015) · FreiDok plus (Universitätsbibliothek Freiburg) · Cited by 670
The Power of Ensembles for Active Learning in Image Classification
Beluch, W. H., Genewein, T., Nurnberger, A., & Kohler, J. M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00976 · Cited by 655
Searching for a Robust Neural Architecture in Four GPU Hours
Dong, X., & Yang, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00186 · Cited by 640
Scalable Bayesian Optimization Using Deep Neural Networks
Snoek, J., Rippel, O., Swersky, K., Kiros, R., Satish, N., Sundaram, N., Patwary, M. A., Prabhat, & Adams, R. P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.05700 · Cited by 613
Designing Neural Networks Using Genetic Algorithms with Graph Generation System
Kitnano, H. (1990) · Complex Systems · Cited by 612
Google Vizier: A Service for Black-Box Optimization
Golovin, D., Solnik, B., Moitra, S., Kochanski, G., Karro, J., & Sculley, D. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098043 · Cited by 571
BOHB: Robust and Efficient Hyperparameter Optimization at Scale
Falkner, S., Klein, A., & Hutter, F. (2018) · arXiv · doi:10.48550/arxiv.1807.01774 · Cited by 551
Efficient Neural Architecture Search via Parameter Sharing
Pham, H., Guan, M. Y., Zoph, B., Le, Q. V., & Dean, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.03268 · Cited by 517
On Bayesian Methods for Seeking the Extremum
Močkus, J. (1975) · Optimization Techniques IFIP Technical Conference · doi:10.1007/978-3-662-38527-2_55 · Cited by 402
PC-DARTS: Partial Channel Connections for Memory-Efficient Architecture Search
Xu, Y., Xie, L., Zhang, X., Chen, X., Qi, G.-J., Tian, Q. C., & Xiong, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.05737 · Cited by 376
A Tutorial on Bayesian Optimization
Frazier, P. I. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.02811 · Cited by 342
Accurate Uncertainties for Deep Learning Using Calibrated Regression
Kuleshov, V., Fenner, N., & Ermon, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00263 · Cited by 337
Regularized Evolution for Image Classifier Architecture Search
Real, E., Aggarwal, A., Huang, Y., & Le, Q. V. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014780 · Cited by 328
Graph HyperNetworks for Neural Architecture SearchPreprint
Zhang, C., Ren, M., & Urtasun, R. (2018) · International Conference on Learning Representations · doi:10.48550/arxiv.1810.05749 · Cited by 310
Bayesian optimization with robust Bayesian neural networks
Springenberg, J. T., Klein, A., Falkner, S., & Hutter, F. (2016) · neural information processing systems · Cited by 300
NAS-bench-101: Towards reproducible neural architecture search
Ying, C., Klein, A., Real, E., Christiansen, E., Murphy, K., & Hutter, F. (2019) · arXiv · doi:10.48550/arxiv.1902.09635 · Cited by 297
Evaluating the Search Phase of Neural Architecture SearchPreprint
Yu, K., Sciuto, C., Jaggi, M., Musat, C., & Salzmann, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.08142 · Cited by 284
ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware
Cai, H., Zhu, L., & Han, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.00332 · Cited by 267
Neural Architecture Search with Bayesian Optimisation and Optimal Transport
Kandasamy, K., Neiswanger, W., Schneider, J., Póczos, B., & Xing, E. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.07191 · Cited by 259
Self-citationD-VAE: A Variational Autoencoder for Directed Acyclic GraphsPreprint
Zhang, M., Jiang, S., Cui, Z., Garnett, R., & Chen, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.11088 · Cited by 232
DARTS+: Improved Differentiable Architecture Search with Early Stopping
Liang, H., Zhang, S., Sun, J., He, X., Huang, W., Zhuang, K., & Li, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.06035 · Cited by 230
Batch Bayesian Optimization via Local PenalizationPreprint
González, J., Dai, Z., Hennig, P., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.08052 · Cited by 214
Random Search and Reproducibility for Neural Architecture Search
Li, L., & Talwalkar, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.07638 · Cited by 209
Methods for comparing uncertainty quantifications for material property predictions
Tran, K., Neiswanger, W., Yoon, J., Zhang, Q., Xing, E., & Ulissi, Z. W. (2020) · Machine Learning: Science and Technology · doi:10.1088/2632-2153/ab7e1a · Cited by 205
Self-citationHierarchical Representations for Efficient Architecture Search
Liu, H., Simonyan, K., Vinyals, O., Fernando, C., & Kavukcuoglu, K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00436 · Cited by 194
Maximizing acquisition functions for Bayesian optimizationPreprint
Wilson, J. T., Hutter, F., & Deisenroth, M. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.10196 · Cited by 185
Learning Curve Prediction with Bayesian Neural Networks
Klein, A., Falkner, S., Springenberg, J. T., & Hutter, F. (2017) · International Conference on Learning Representations · Cited by 176
Neural Predictor for Neural Architecture Search
Wen, W., Liu, H., Chen, Y., Li, H., Bender, G., & Kindermans, P.-J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58526-6_39 · Cited by 167
NAS evaluation is frustratingly hardPreprint
Yang, A., Esperança, P. M., & Carlucci, F. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.12522 · Cited by 162
Best Practices for Scientific Research on Neural Architecture SearchPreprint
Lindauer, M., & Hutter, F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.02453 · Cited by 158
Parallelised Bayesian Optimisation via Thompson Sampling
Kandasamy, K., Krishnamurthy, A., Schneider, J., & Póczos, B. (2018) · International Conference on Artificial Intelligence and Statistics · Cited by 154
Contextual Decision Processes with low Bellman rank are PAC-Learnable
Jiang, N., Krishnamurthy, A., Agarwal, A., Langford, J., & Schapire, R. E. (2016) · arXiv · doi:10.48550/arxiv.1610.09512 · Cited by 144
Efficient Hyperparameter Optimization and Infinitely Many Armed BanditsPreprint
Rostamizadeh, A., Talwalkar, A., DeSalvo, G., Jamieson, K., & Li, L. (2017) · arXiv (Cornell University) · Cited by 143
NPENAS: Neural Predictor Guided Evolution for Neural Architecture Search
Wei, C., Niu, C., Tang, Y.-P., Wang, Y., Hu, H.-H., & Liang, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3151160 · Cited by 133
Does Unsupervised Architecture Representation Learning Help Neural Architecture Search?Preprint
Yan, S., Zheng, Y., Ao, W., Zeng, X., & Zhang, M. (2020) · Neural Information Processing Systems · doi:10.48550/arxiv.2006.06936 · Cited by 132
Peephole: Predicting Network Performance Before TrainingPreprint
Deng, B., Yan, J., & Lin, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.03351 · Cited by 126
Neural Architecture Search Using Deep Neural Networks and Monte Carlo Tree Search
Wang, L., Zhao, Y., Jinnai, Y., Tian, Y., & Fonseca, R. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i06.6554 · Cited by 124
Bridging the Gap between Sample-based and One-shot Neural Architecture Search with BONASPreprint
Han, S., Pi, R., Xu, H., Li, Z., Kwok, J. T.-Y., & Zhang, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.09336 · Cited by 113
BoTorch: Programmable Bayesian Optimization in PyTorch.
Balandat, M., Karrer, B., Jiang, D., Daulton, S., Letham, B., Wilson, A. G., & Bakshy, E. (2019) · Cited by 85
TAPAS: Train-Less Accuracy Predictor for Architecture Search
Istrate, R., Scheidegger, F., Mariani, G., Nikolopoulos, D. S., Bekas, C., & Malossi, A. C. I. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013927 · Cited by 84
Neural Ensemble Search for Uncertainty Estimation and Dataset ShiftPreprint
Zaidi, S., Zela, A., Elsken, T., Holmes, C. C., Hutter, F., & Teh, Y. W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.08573 · Cited by 77
Auto-Keras: Efficient Neural Architecture Search with Network MorphismPreprint
Jin, H., Song, Q., & Xia, H. (2018) · arXiv (Cornell University) · Cited by 68
Deep Neural Architecture Search with Deep Graph Bayesian Optimization
Ma, L., Cui, J.-X., & Yang, B. (2019) · International Conference on Wirtschaftsinformatik · doi:10.1145/3350546.3360740 · Cited by 61
AlphaX: eXploring Neural Architectures with Deep Neural Networks and Monte Carlo Tree SearchPreprint
Wang, L., Zhao, Y., Jinnai, Y., Tian, Y., & Fonseca, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.11059 · Cited by 55
Ensemble of Deep Convolutional Neural Networks for Prognosis of Ischemic Stroke
Choi, Y., Kwon, Y., Lee, H., Kim, B. J., Paik, M. C., & Won, J. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-55524-9_22 · Cited by 51
The Parallel Bayesian Optimization Algorithm
Očenášek, J., & Schwarz, J. (2000) · Physica-Verlag eBooks · doi:10.1007/978-3-7908-1844-4_11 · Cited by 50
Graph HyperNetworks for Neural Architecture Search.
Zhang, W., Ren, M., & Urtasun, R. (2018) · International Conference on Learning Representations · Cited by 50
Sample-Efficient Neural Architecture Search by Learning Action SpacePreprint
Wang, L.-N., Xie, S., Li, T., Fonseca, R., & Tian, Y. (2019) · arXiv.org · doi:10.48550/arxiv.1906.06832 · Cited by 48
AmoebaNet: An SDN-enabled network service for big data science
Shah, S. A. R., Wu, W., Lu, Q., Zhang, L., Sasidharan, S., DeMar, P., Guok, C. P., MacAuley, J., Pouyoul, E., Kim, J., et al. (2018) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2018.06.015 · Cited by 47
Evolutionary-Neural Hybrid Agents for Architecture SearchPreprint
Maziarz, K., Tan, M., Khorlin, A., Georgiev, M., & Gesmundo, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.09828 · Cited by 38
Hecht, B. J., Wilcox, L. G., Bigham, J. P., Schöning, J., Hoque, M. E., Ernst, J. B., Bisk, Y., Russis, L. D., Yarosh, S., Anjum, B., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.09544 · Cited by 37
Neural Ensemble Search for Performant and Calibrated Predictions.Preprint
Zaidi, S., Zela, A., Elsken, T., et al. (2020) · arXiv (Cornell University) · Cited by 22
ProBO: Versatile Bayesian Optimization Using Any Probabilistic Programming LanguagePreprint
Neiswanger, W., Kandasamy, K., Póczos, B., Schneider, J., & Xing, E. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.11515 · Cited by 19
Self-citationLocal Search is State of the Art for NAS BenchmarksPreprint
White, C., Nolen, S., & Savani, Y. (2020) · arXiv (Cornell University) · Cited by 17
Self-citationOptimal Transport Kernels for Sequential and Parallel Neural Architecture SearchPreprint
Nguyen, V., Le, T., Yamada, M., & Osborne, M. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07593 · Cited by 17
Neural Architecture Search using Bayesian Optimisation with Weisfeiler-Lehman Kernel.
Ru, B. X., Wan, X., Dong, X., & Osborne, M. A. (2020) · Cited by 14
Laube, K., & Zell, A. (2019) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2019.00158 · Cited by 13
Local Search is State of the Art for Neural Architecture Search BenchmarksPreprint
White, C., Nolen, S., & Savani, Y. (2020) · arXiv (Cornell University) · Cited by 12
Self-citationProBO: a Framework for Using Probabilistic Programming in Bayesian Optimization.Preprint
Neiswanger, W., Kandasamy, K., Póczos, B., Schneider, J., & Xing, E. P. (2019) · arXiv (Cornell University) · Cited by 6
Self-citation
Cited by
A review of uncertainty quantification in deep learning: Techniques, applications and challenges
Abdar, M., Pourpanah, F., Hussain, S., Rezazadegan, D., Liu, L., Ghavamzadeh, M., Fieguth, P., Cao, X., Khosravi, A., Acharya, U. R., et al. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.008 · Cited by 3,111
AutoML: A survey of the state-of-the-art
He, X., Zhao, K., & Chu, X. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106622 · Cited by 1,691
Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges
Bischl, B., Binder, M., Lang, M., Pielok, T., Richter, J., Coors, S., Thomas, J., Ullmann, T., Becker, M., Boulesteix, A., et al. (2023) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1484 · Cited by 930
A Survey of Techniques for Optimizing Transformer Inference
Chitty-Venkata, K. T., Mittal, S., Emani, M., Vishwanath, V., & Somani, A. K. (2023) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2023.102990 · Cited by 154
An Evaluation of Edge TPU Accelerators for Convolutional Neural Networks
Seshadri, K., Akin, B., Laudon, J., Narayanaswami, R., & Yazdanbakhsh, A. (2022) · 2022 IEEE International Symposium on Workload Characterization (IISWC) · doi:10.1109/iiswc55918.2022.00017 · Cited by 138
Metadata
- Authors
- White, C., Neiswanger, W., & Savani, Y.
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2021-05-18
- Volume
- 35
- Issue
- 12
- Pages
- 10293-10301
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W2981406437
- Cited by
- 261
- References
- 85
- FWCI
- 20.11
- Type
- conference paper
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.