CNTK: Microsoft's Open-Source Deep-Learning Toolkit
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
This tutorial will introduce the Computational Network Toolkit, or CNTK, Microsoft's cutting-edge open-source deep-learning toolkit for Windows and Linux. CNTK is a powerful computation-graph based deep-learning toolkit for training and evaluating deep neural networks. Microsoft product groups use CNTK, for example to create the Cortana speech models and web ranking. CNTK supports feed-forward, convolutional, and recurrent networks for speech, image, and text workloads, also in combination. Popular network types are supported either natively (convolution) or can be described as a CNTK configuration (LSTM, sequence-to-sequence). CNTK scales to multiple GPU servers and is designed around efficiency. The tutorial will give an overview of CNTK's general architecture and describe the specific methods and algorithms used for automatic differentiation, recurrent-loop inference and execution, memory sharing, on-the-fly randomization of large corpora, and multi-server parallelization. We will then show how typical uses looks like for relevant tasks like image recognition, sequence-to-sequence modeling, and speech recognition.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The implementation of CNN has been included in popular software packages such as Caffe from Berkeley AI Research, 39 CNTK from Microsoft 40 and TensorFlow from Google.41”
From Artificial intelligence in healthcare: past, present and future (2017) · cites this paper as [40]
Citations
Cites
An Introduction to Computational Networks and the Computational Network Toolkit
Yu, D., Eversole, A., Seltzer, M., Yao, K., Kuchaiev, O., Zhang, Y., Seide, F. T. B., Huang, Z., Guenter, B. K., Wang, H., et al. (2014) · Cited by 365
Self-citation
Cited by
Items 101–200 of 408
Benchmarking Contemporary Deep Learning Hardware and Frameworks: A Survey of Qualitative Metrics
Dai, W., & Berleant, D. (2019) · 2019 IEEE First International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi48466.2019.00029 · Cited by 43
A Review on Progress in Semantic Image Segmentation and Its Application to Medical Images
Kar, M. K., Nath, M. K., & Neog, D. R. (2021) · SN Computer Science · doi:10.1007/s42979-021-00784-5 · Cited by 71
Progressive Joint Modeling in Unsupervised Single-Channel Overlapped Speech Recognition
Chen, Z., Droppo, J., Li, J., & Xiong, W. (2017) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2017.2765834 · Cited by 65
Reveal training performance mystery between TensorFlow and PyTorch in the single GPU environment
Dai, H., Peng, X., Shi, X., He, L., Xiong, Q., & Jin, H. (2021) · Science China Information Sciences · doi:10.1007/s11432-020-3182-1 · Cited by 77
daBNN: A Super Fast Inference Framework for Binary Neural Networks on ARM devices
Zhang, J., Pan, Y., Yao, T., Zhao, H., & Mei, T. (2019) · Proceedings of the 27th ACM International Conference on Multimedia · doi:10.1145/3343031.3350534 · Cited by 51
Long Range Acoustic and Deep Features Perspective on ASVspoof 2019
Das, R. K., Yang, J., & Li, H. (2019) · 2019 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) · doi:10.1109/asru46091.2019.9003845 · Cited by 65
Derin Öğrenme ile Kalabalık Analizi Üzerine Detaylı Bir Araştırma
Kızrak, M. A., & Bölat, B. (2018) · Bilişim Teknolojileri Dergisi · doi:10.17671/gazibtd.419205 · Cited by 93
TensorLayer: A Versatile Library for Efficient Deep Learning Development
Dong, H., Supratak, A., Mai, L., Liu, F., Oehmichen, A., Yu, S., & Guo, Y. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3129391 · Cited by 61
MDTP: a multi-source deep traffic prediction framework over spatio-temporal trajectory data
Fang, Z., Pan, L., Lü, C., Du, Y., & Gao, Y. (2021) · Proceedings of the VLDB Endowment · doi:10.14778/3457390.3457394 · Cited by 63
Characterizing Deep-Learning I/O Workloads in TensorFlow
Chien, S. W. D., Markidis, S., Sishtla, C. P., Santos, L., Herman, P. A., Narasimhamurthy, S., & Laure, E. (2018) · doi:10.1109/pdsw-discs.2018.00011 · Cited by 68
Gamper, H., Reddy, C. K. A., Cutler, R., Tashev, I., & Gehrke, J. E. (2019) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa.2019.8937202 · Cited by 62
$\texttt{DeepSqueeze}$: Decentralization Meets Error-Compensated CompressionPreprint
Tang, H., Lian, X., Qiu, S., Yuan, L., Zhang, C., Zhang, T., & Liu, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.07346 · Cited by 74
A Comparative Measurement Study of Deep Learning as a Service Framework
Wu, Y., Liu, L., Pu, C., Cao, W., Sahin, S., Wei, W., & Zhang, Q. (2019) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2019.2928551 · Cited by 72
Bai, G., Sun, C., Guo, Z., Wang, Y., Zeng, X., Su, Y., Zhao, Q., & Ma, B. (2023) · Seminars in Cancer Biology · doi:10.1016/j.semcancer.2023.06.005 · Cited by 64
An Overview of Methods for Deep Learning in Neural Networks
Созыкин, А. В. (2017) · Bulletin of the South Ural State University Series Computational Mathematics and Software Engineering · doi:10.14529/cmse170303 · Cited by 61
Demystifying differentiable programming: shift/reset the penultimate backpropagator
Wang, F., Zheng, D., Decker, J., Wu, X., Essertel, G. M., & Rompf, T. (2019) · Proceedings of the ACM on Programming Languages · doi:10.1145/3341700 · Cited by 59
“Caffe [Jia et al. 2014], MXNet [Chen et al. 2015], and CNTK [Seide and Agarwal 2016] are somewhere in the middle.”
BackgroundWeb-Scale Responsive Visual Search at Bing
Hu, H., Wang, Y., Yang, L., Komlev, P., Huang, L., Chen, X. (., Huang, J., Wu, Y., Merchant, M., & Sacheti, A. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3219843 · Cited by 71
DeepCPU: serving RNN-based deep learning models 10x faster
Zhang, M., Rajbhandari, S., Wang, W., & He, Y. (2018) · USENIX Annual Technical Conference · Cited by 99
Stochastic distributed learning with gradient quantization and double-variance reduction
Horváth, S., Kovalev, D. A., Mishchenko, K., Richtárik, P., & Stich, S. U. (2022) · Optimization methods & software · doi:10.1080/10556788.2022.2117355 · Cited by 78
scikit-multilearn: A scikit-based Python environment for performing multi-label classification
Szymański, P., & Kajdanowicz, T. J. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.3670933 · Cited by 56
End-To-End Low-Resource Lip-Reading with Maxout Cnn and Lstm
Fung, I., & Mak, B. K.-W. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8462280 · Cited by 60
HAWQV3: Dyadic Neural Network Quantization
Yao, Z., Dong, Z., Zheng, Z., Gholami, A., Yu, J., Tan, E., Wang, L., Huang, Q., Wang, Y., Mahoney, M. W., et al. (2020) · arXiv · doi:10.48550/arxiv.2011.10680
Long Range Acoustic Features for Spoofed Speech Detection
Das, R. K., Yang, J., & Li, H. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-1887 · Cited by 53
“We used the Microsoft Cognitive Toolkit for DNN training [36].”
MethodDeep Learning Applications in Solid Waste Management: A Deep Literature Review
Shahab, S., Anjum, M., & Umar, M. S. (2022) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2022.0130347 · Cited by 64
xCCL: A Survey of Industry-Led Collective Communication Libraries for Deep Learning
Weingram, A., Li, Y., Qi, H., Ng, D., Dai, L., & Lu, X. (2023) · Journal of Computer Science and Technology · doi:10.1007/s11390-023-2894-6 · Cited by 63
Attack and Defense of Dynamic Analysis-Based, Adversarial Neural Malware Detection Models
Stokes, J. W., De, W., Marinescu, M., Marino, M., & Bussone, B. (2018) · IEEE Military Communications Conference (MILCOM) · doi:10.1109/milcom.2018.8599855 · Cited by 58
LIFT: Reinforcement Learning in Computer Systems by Learning From DemonstrationsPreprint
Schaarschmidt, M., Kuhnle, A., Ellis, B., Fricke, K., Gessert, F., & Yoneki, E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.07903 · Cited by 59
TorchEEGEMO: A deep learning toolbox towards EEG-based emotion recognition
Zhang, Z., Zhong, S.-H., & Liu, Y. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123550 · Cited by 67
Hop: Heterogeneity-aware Decentralized Training
Luo, Q., Lin, J., Zhuo, Y., & Qian, X. (2019) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3297858.3304009 · Cited by 60
GaiaGPU: Sharing GPUs in Container Clouds
Gu, J., Song, S., Li, Y., & Luo, H. (2018) · IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA) · doi:10.1109/bdcloud.2018.00077 · Cited by 62
GRNN: Low-Latency and Scalable RNN Inference on GPUs
Holmes, C., Mawhirter, D., He, Y., Yan, F., & Wu, B. (2019) · Proceedings of the Fourteenth EuroSys Conference 2019 · doi:10.1145/3302424.3303949 · Cited by 45
TensorOpt: Exploring the Tradeoffs in Distributed DNN Training With Auto-Parallelism
Cai, Z., Yan, X., Ma, K., Wu, Y., Huang, Y., Cheng, J. S.-C., Su, T., & Yu, F. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2021.3132413 · Cited by 65
Alam, A., Ullah, I., & Lee, Y.-K. (2020) · IEEE Access · doi:10.1109/access.2020.3017135 · Cited by 52
A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free!Preprint
Kovalev, D. A., Koloskova, A., Jaggi, M., Richtárik, P., & Stich, S. U. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.01697 · Cited by 75
EAGLE: creating equivalent graphs to test deep learning libraries
Wang, J., Lutellier, T., Qian, S., Pham, H. V., & Tan, L. (2022) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3510003.3510165 · Cited by 65
Distributed learning over unreliable networks
Yu, C., Tang, H., Renggli, C., Kassing, S., Singla, A., Alistarh, D., Zhang, C., & Liu, J. (2018) · arXiv · doi:10.48550/arxiv.1810.07766 · Cited by 45
“This is a realistic model of running an AllReduce operator implemented with Reduce-Scatter/All-Gather on unreliable network.”
BackgroundMethodInfluentialDryden, N., Maruyama, N., Moon, T., Benson, T., Yoo, A., Snir, M., & Essen, B. V. (2018) · doi:10.1109/mlhpc.2018.8638639 · Cited by 52
Long-term high frequency features for synthetic speech detection
Yang, J., & Das, R. K. (2020) · Digital Signal Processing · doi:10.1016/j.dsp.2019.102622 · Cited by 45
JAXNS: a high-performance nested sampling package based on JAXPreprint
Albert, J. G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.15286 · Cited by 48
Automatic model selection for fully connected neural networks
Laredo, D., Ma, S. F., Leylaz, G., Schütze, O., & Sun, J. (2020) · International Journal of Dynamics and Control · doi:10.1007/s40435-020-00708-w · Cited by 44
Privacy-Preserving Asynchronous Grouped Federated Learning for IoT
Zhang, T., Song, A., Dong, X., Shen, Y., & Ma, J. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3111088 · Cited by 49
Multi-tenant GPU Clusters for Deep Learning Workloads: Analysis and Implications
Jeon, M., Venkataraman, S., Phanishayee, A., Qian, J., Xiao, W., & Yang, F. (2018) · Cited by 65
Deep Least Squares Fisher Discriminant Analysis
Díaz–Vico, D., & Dorronsoro, J. R. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2906302 · Cited by 49
TF-Coder: Program Synthesis for Tensor Manipulations
Shi, K., Bieber, D., & Singh, R. (2022) · ACM Transactions on Programming Languages and Systems · doi:10.1145/3517034 · Cited by 54
Enhanced DSSM (deep semantic structure modelling) technique for job recommendation
Mishra, R., & Rathi, S. (2021) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2021.07.018 · Cited by 52
TensorLayer: A Versatile Library for Efficient Deep Learning DevelopmentPreprint
Dong, H., Supratak, A., Mai, L., Liu, F., Oehmichen, A., Yu, S., & Guo, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.08551 · Cited by 78
A Scalable FPGA Architecture for Randomly Connected Networks of Hodgkin-Huxley Neurons
Akbarzadeh-Sherbaf, K., Abdoli, B., Safari, S., & Vahabie, A. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00698 · Cited by 43
HAWQ-V3: Dyadic Neural Network Quantization
Yao, Z., Dong, Z., Zheng, Z., Gholaminejad, A., Yu, J., Tan, E., Wang, L., Huang, Q., Wang, Y., Mahoney, M. W., et al. (2021) · International Conference on Machine Learning · Cited by 281
Low frequency frame-wise normalization over constant-Q transform for playback speech detection
Yang, J., & Das, R. K. (2019) · Digital Signal Processing · doi:10.1016/j.dsp.2019.02.018 · Cited by 39
Enhancing the interoperability between deep learning frameworks by model conversion
Liu, Y., Chen, C., Zhang, R., Qin, T., Ji, X. L., Lin, H., & Yang, M. (2020) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3368089.3417051 · Cited by 52
swCaffe: A Parallel Framework for Accelerating Deep Learning Applications on Sunway TaihuLight
Li, L., Fang, J., Fu, H., Jiang, J., Zhao, W., He, C., You, X., & Yang, G. (2018) · IEEE International Conference on Cluster Computing (CLUSTER) · doi:10.1109/cluster.2018.00087 · Cited by 39
Blind Room Volume Estimation from Single-channel Noisy Speech
Genovese, A. F., Gamper, H., Pulkki, V., Raghuvanshi, N., & Tashev, I. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682951 · Cited by 37
AI Enabling Technologies: A SurveyPreprint
Gadepally, V. N., Goodwin, J. A., Kepner, J., Reuther, A., Reynolds, H. J. D., Samsi, S., Su, J. K., & Martinez, D. R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.03592 · Cited by 41
Jin, H., Liu, B., Jiang, W., Ma, Y., Shi, X., He, B., & Zhao, S. (2018) · ACM Transactions on Architecture and Code Optimization · doi:10.1145/3243904 · Cited by 48
Goel, P., Jain, P., Pasman, H. J., Pistikopoulos, E. N., & Datta, A. A. (2020) · Journal of Loss Prevention in the Process Industries · doi:10.1016/j.jlp.2020.104316 · Cited by 35
Moniqua: Modulo Quantized Communication in Decentralized SGDPreprint
Lu, Y., & De, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.11787 · Cited by 47
Deep learning for noise-tolerant RDFS reasoning1
Makni, B., & Hendler, J. (2019) · Semantic Web · doi:10.3233/sw-190363 · Cited by 36
SALaR: Scalable and Adaptive Designs for Large Message Reduction Collectives
Bayatpour, M., Hashmi, J. M., Chakraborty, S., Subramoni, H., Kousha, P., & Panda, D. K. D. (2018) · IEEE International Conference on Cluster Computing (CLUSTER) · doi:10.1109/cluster.2018.00014 · Cited by 37
An FPGA-Based LSTM Acceleration Engine for Deep Learning Frameworks
He, D., He, J., Liu, J., Yang, J., Yan, Q. Y., & Yang, Y. (2021) · Electronics · doi:10.3390/electronics10060681 · Cited by 36
Generation-based Differential Fuzzing for Deep Learning Libraries
Liu, J., Huang, Y., Wang, Z., Ma, L., Fang, C., Gu, M., Zhang, X., & Chen, Z. (2023) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3628159 · Cited by 40
Mind control attack: Undermining deep learning with GPU memory exploitation
Park, S.-O., Kwon, O., Kim, Y., Kil, S., & Yoon, H. (2020) · Computers & Security · doi:10.1016/j.cose.2020.102115 · Cited by 38
Unveiling the frontiers of deep learning: Innovations shaping diverse domains
Ahmed, S. F., Alam, M. S. B., Kabir, M., Afrin, S., Rafa, S. J., Mehjabin, A., & Gandomi, A. H. (2025) · Applied Intelligence · doi:10.1007/s10489-025-06259-x · Cited by 39
Data Management in Machine Learning Systems
Böehm, M., Kumar, A., & Yang, J. (2019) · Synthesis lectures on data management · doi:10.1007/978-3-031-01869-5 · Cited by 41
Onoufriou, G., Bickerton, R. A., Pearson, S., & Leontidis, G. (2019) · Computers in Industry · doi:10.1016/j.compind.2019.103133 · Cited by 32
DLPaper2Code: Auto-Generation of Code From Deep Learning Research Papers
Sethi, A., Sankaran, A., Panwar, N., Khare, S., & Mani, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12326 · Cited by 35
Deep Learning at Scale on NVIDIA V100 Accelerators
Xu, R., Han, F., & Ta, Q. (2018) · IEEE/ACM International Workshop on Performance Modeling, Benchmarking and Simulation of High Performance Computer Systems (PMBS) · doi:10.1109/pmbs.2018.8641600 · Cited by 36
Ordered SGD: A New Stochastic Optimization Framework for Empirical Risk MinimizationPreprint
Kawaguchi, K., & Lu, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.04371 · Cited by 47
Automated end-to-end management of the modeling lifecycle in deep learning
Gharibi, G., Walunj, V., Nekadi, R., Marri, R., & Lee, Y. (2021) · Empirical Software Engineering · doi:10.1007/s10664-020-09894-9 · Cited by 36
Bartschat, A., Reischl, M., & Mikut, R. (2019) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1309 · Cited by 28
Compiler Technologies in Deep Learning Co-Design: A Survey
Zhang, H., Xing, M., Wu, Y., & Zhao, C. (2023) · Intelligent Computing · doi:10.34133/icomputing.0040 · Cited by 41
Online normalizer calculation for softmax
Milakov, M., & Gimelshein, N. (2018) · arXiv · doi:10.48550/arxiv.1805.02867 · Cited by 27
“1.0, Microsoft Cognitive Toolkit [16] v2.”
InfluentialApplying Deep Learning to Balancing Network Intrusion Detection Datasets
Chuang, P., & Wu, D.-Y. (2019) · IEEE International Conference on Advanced Infocomm Technology · doi:10.1109/icait.2019.8935927 · Cited by 27
Demystifying and Detecting Misuses of Deep Learning APIs
Wei, M., Harzevili, N. S., Huang, Y.-K., Yang, J., Wang, J., & Wang, S. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3639177 · Cited by 38
Dong, S., Gong, X., Sun, Y., Baruah, T., & Kaeli, D. R. (2018) · ACM/SPEC International Conference on Performance Engineering (ICPE) · doi:10.1145/3184407.3184423 · Cited by 28
A DAG Model of Synchronous Stochastic Gradient Descent in Distributed Deep Learning
Shi, S., Wang, Q., Chu, X., & Li, B. (2018) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/padsw.2018.8644932 · Cited by 32
Pushing ML Predictions Into DBMSs
Paganelli, M., Sottovia, P., Park, K., Interlandi, M., & Guerra, F. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3269592 · Cited by 28
Deep Learning in the Automotive Industry: Recent Advances and Application ExamplesPreprint
Singh, K. B., & Arat, M. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.08834 · Cited by 39
Automatic Identification of Abaca Bunchy Top Disease using Deep Learning Models
Patayon, U. B., & Crisostomo, R. V. (2021) · Procedia Computer Science · doi:10.1016/j.procs.2021.01.012 · Cited by 26
Botnet Detection in Software Defined Networks by Deep Learning Techniques
Letteri, I., Penna, G. D., & Gasperis, G. D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01689-0_4 · Cited by 25
Label super-resolution networks.
Malkin, K., Robinson, C., Hou, L., Soobitsky, R., Czawlytko, J., Samaras, D., Saltz, J. H., Joppa, L., & Jojić, N. (2018) · International Conference on Learning Representations · Cited by 43
dislib: Large Scale High Performance Machine Learning in Python
Cid-Fuentes, J. Á., Solà, S., Álvarez, P., Castro-Ginard, A., & Badia, R. M. (2019) · International Conference on e-Science · doi:10.1109/escience.2019.00018 · Cited by 35
Contextual MEG and EEG Source Estimates Using Spatiotemporal LSTM Networks
Dinh, C., Samuelsson, J. G., Hunold, A., Hämäläinen, M., & Khan, S. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.552666 · Cited by 25
Election Coding for Distributed Learning: Protecting SignSGD against Byzantine AttacksPreprint
Sohn, J.-Y., Han, D.-J., Choi, B., & Moon, J. J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.06093 · Cited by 35
Jiménez, G. A., de la Escalera, A., & Gómez-Silva, M. J. (2023) · Sensors · doi:10.3390/s23219013 · Cited by 25
Xu, H., Song, S., & Mao, Z. (2024) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw63119.2024.00098 · Cited by 22
DLoBD: A Comprehensive Study of Deep Learning over Big Data Stacks on HPC Clusters
Lu, X., Shi, H., Biswas, R., Javed, M. H., & Panda, D. K. D. (2018) · IEEE Transactions on Multi-Scale Computing Systems · doi:10.1109/tmscs.2018.2845886 · Cited by 24
Taming Hyper-parameters in Deep Learning Systems
Mai, L., Koliousis, A., Guo, L., Brabete, A.-O., & Pietzuch, P. R. (2019) · ACM SIGOPS Operating Systems Review · doi:10.1145/3352020.3352029 · Cited by 25
Modeling and Training of Neural Processing Systems
Kusmenko, E., Nickels, S., Pavlitskaya, S., Rumpe⋆, B., & Timmermanns, T. (2019) · ACM/IEEE International Conference on Model Driven Engineering Languages and Systems (MODELS) · doi:10.1109/models.2019.00012 · Cited by 37
An Empirical Study on Common Bugs in Deep Learning Compilers
Du, X., Zheng, Z., Ma, L., & Zhao, J. (2021) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre52982.2021.00030 · Cited by 26
Open-Source Libraries, Application Frameworks, and Workflow Systems for NLP
Gudivada, V. N., & Arbabifard, K. (2018) · Handbook of statistics · doi:10.1016/bs.host.2018.07.007 · Cited by 32
Declarative Data Analytics: A Survey
Makrynioti, N., & Vassalos, V. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2958084 · Cited by 18
Data Management in Machine Learning Systems
Böehm, M., Kumar, A., & Yang, J. (2019) · Synthesis lectures on data management · doi:10.2200/s00895ed1v01y201901dtm057 · Cited by 25
Energy‐based tuning of convolutional neural networks on multi‐GPUs
Castro, F. M., Guil, N., Marín-Jiménez, M. J., Pérez-Serrano, J., & Ujaldón, M. (2018) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.4786 · Cited by 23
Sequence Modeling in Unsupervised Single-Channel Overlapped Speech Recognition
Chen, Z., & Droppo, J. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461939 · Cited by 20
The importance of graph databases and graph learning for clinical applications
Walke, D., Micheel, D., Schallert, K., Muth, T., Broneske, D., Saake, G., & Heyer, R. (2024) · Database · doi:10.1093/database/baad045 · Cited by 16
Deep learning from a statistical perspective
Yuan, Y., Deng, Y., Zhang, Y., & Qu, A. (2020) · Stat · doi:10.1002/sta4.294 · Cited by 20
Baechi: fast device placement of machine learning graphs
Jeon, B., Cai, L., Srivastava, P., Jiang, J., Ke, X., Meng, Y., Xie, C., & Gupta, I. (2020) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/3419111.3421302 · Cited by 30
Scaling Deep Learning for Cancer with Advanced Workflow Storage Integration
Wozniak, J. M., Davis, P. E., Shu, T., Ozik, J., Collier, N. T., Parashar, M., Foster, I. T., Brettin, T. S., & Stevens, R. L. (2018) · doi:10.1109/mlhpc.2018.8638629 · Cited by 20
Chaudhary, A., Chouhan, K. S., Gajrani, J., & Sharma, B. (2020) · Advances in computer and electrical engineering book series · doi:10.4018/978-1-7998-3095-5.ch003 · Cited by 22
Watanabe, S., Ueno, T., Kimura, Y., Mishina, M., & Sugimoto, N. (2021) · Annals of Nuclear Medicine · doi:10.1007/s12149-021-01661-0 · Cited by 23
Metadata
- Authors
- Seide, F., & Agarwal, A.
- Affiliations
- Microsoft (United States) (US)
- Venue
- Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
- Publisher
- ACM
- Published
- 2016-08-13
- Pages
- 2135-2135
- OpenAlex
- W2513383847
- Cited by
- 382
- References
- 1
- Citations by year
- 2026: 4 · 2025: 9 · 2024: 22 · 2023: 26 · 2022: 32 · 2021: 48 · 2020: 68 · 2019: 86 · 2018: 73 · 2017: 12 · 2016: 1
- FWCI
- 30.89
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Keywords
- CNTK, deep learning framework, computational graphs, automatic differentiation, recurrent neural networks, sequence-to-sequence models, convolutional neural networks, memory sharing, speech recognition, image recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.