CNTK: Microsoft's Open-Source Deep-Learning Toolkit
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
This tutorial will introduce the Computational Network Toolkit, or CNTK, Microsoft's cutting-edge open-source deep-learning toolkit for Windows and Linux. CNTK is a powerful computation-graph based deep-learning toolkit for training and evaluating deep neural networks. Microsoft product groups use CNTK, for example to create the Cortana speech models and web ranking. CNTK supports feed-forward, convolutional, and recurrent networks for speech, image, and text workloads, also in combination. Popular network types are supported either natively (convolution) or can be described as a CNTK configuration (LSTM, sequence-to-sequence). CNTK scales to multiple GPU servers and is designed around efficiency. The tutorial will give an overview of CNTK's general architecture and describe the specific methods and algorithms used for automatic differentiation, recurrent-loop inference and execution, memory sharing, on-the-fly randomization of large corpora, and multi-server parallelization. We will then show how typical uses looks like for relevant tasks like image recognition, sequence-to-sequence modeling, and speech recognition.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The implementation of CNN has been included in popular software packages such as Caffe from Berkeley AI Research, 39 CNTK from Microsoft 40 and TensorFlow from Google.41”
From Artificial intelligence in healthcare: past, present and future (2017) · cites this paper as [40]
Citations
Cites
An Introduction to Computational Networks and the Computational Network Toolkit
Yu, D., Eversole, A., Seltzer, M., Yao, K., Kuchaiev, O., Zhang, Y., Seide, F. T. B., Huang, Z., Guenter, B. K., Wang, H., et al. (2014) · Cited by 365
Self-citation
Cited by
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Artificial intelligence in healthcare: past, present and future
Jiang, F., Jiang, Y., Zhi, H., Dong, Y., Li, H., Ma, S., Wang, Y., Dong, Q., Shen, H., & Wang, Y. (2017) · Stroke and Vascular Neurology · doi:10.1136/svn-2017-000101 · Cited by 4,837
Automatic Differentiation in Machine Learning: a Survey
Baydin, A. G., Pearlmutter, B. A., Radul, A., & Siskind, J. M. (2015) · Maynooth University ePrints and eTheses Archive (Maynooth University) · Cited by 2,026
Deep learning for cellular image analysis
Moen, E., Bannon, D., Kudo, T., Graf, W., Covert, M., & Van Valen, D. (2019) · Nature Methods · doi:10.1038/s41592-019-0403-1 · Cited by 1,225
Automatic differentiation in machine learning: a survey
Baydin, A. G., Pearlmutter, B. A., Radul, A., & Siskind, J. M. (2015) · arXiv (Cornell University) · doi:10.4230/lipics.ecoop.2019.25 · Cited by 823
Convolutional neural networks in medical image understanding: a survey
Sarvamangala, D. R., & Kulkarni, R. V. (2022) · Evolutionary Intelligence · doi:10.1007/s12065-020-00540-3 · Cited by 917
MediaPipe: A framework for building perception pipelines
Lugaresi, C., Tang, J., Nash, H., McClanahan, C., Uboweja, E., Hays, M., Zhang, F., Chang, C.-L., Yong, M. G., Lee, J., et al. (2019) · arXiv · doi:10.48550/arxiv.1906.08172 · Cited by 1,043
“Neural net engines like TensorFlow [4], PyTorch [10], CNTK [11], MXNet [6] represent their neural networks in forms of directed graphs whose nodes are simple and deterministic, i.e. one input generates one output, which allows very efficient execution of the compute graph consisting of such lower level semantics.”
BackgroundA Survey on Distributed Machine Learning
Verbraeken, J., Wolting, M., Katzy, J., Kloppenburg, J., Verbelen, T., & Rellermeyer, J. S. (2021) · ACM Computing Surveys · doi:10.1145/3377454 · Cited by 872
PipeDream: generalized pipeline parallelism for DNN training
Narayanan, D., Harlap, A., Phanishayee, A., Seshadri, V., Devanur, N. R., Ganger, G. R., Gibbons, P. B., & Zaharia, M. (2019) · Proceedings of the 27th ACM Symposium on Operating Systems Principles · doi:10.1145/3341301.3359646 · Cited by 818
Local SGD Converges Fast and Communicates Little
Stich, S. U. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09767 · Cited by 191
Raschka, S., Patterson, J., & Nolet, C. (2020) · Information · doi:10.3390/info11040193 · Cited by 703
Deep Learning for Time Series Forecasting: A Survey
Torres, J. F., Hadjout, D., Sebaa, A., Martínez-Álvarez, F., & Troncoso, A. (2021) · Big Data · doi:10.1089/big.2020.0159 · Cited by 818
Reddi, V. J., Cheng, C., Kanter, D., Mattson, P., Schmuelling, G., Wu, C.-J., Anderson, B., Breughe, M., Charlebois, M., Chou, W., et al. (2020) · 2020 ACM/IEEE 47th Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca45697.2020.00045 · Cited by 505
Ansel, J., Yang, E., He, H., Gimelshein, N., Jain, A., Voznesensky, M., Bao, B., Bell, P., Berard, D., Burovski, E., et al. (2024) · Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2 · doi:10.1145/3620665.3640366 · Cited by 737
A Survey on Deep Learning for Data-Driven Soft Sensors
Sun, Q., & Ge, Z. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3053128 · Cited by 665
Deep Learning for Plant Stress Phenotyping: Trends and Future Perspectives
Singh, A. K., Ganapathysubramanian, B., Sarkar, S., & Singh, A. (2018) · Trends in Plant Science · doi:10.1016/j.tplants.2018.07.004 · Cited by 635
Rathore, M. M., Shah, S. A., Shukla, D., Bentafat, E., & Bakiras, S. (2021) · IEEE Access · doi:10.1109/access.2021.3060863 · Cited by 616
NiftyNet: a deep-learning platform for medical imaging
Gibson, E., Li, W., Sudre, C., Fidon, L., Shakir, D. I., Wang, G., Eaton-Rosen, Z., Gray, R., Doel, T., Hu, Y., et al. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.01.025 · Cited by 552
Fink, O., Wang, Q., Svensén, M., Dersin, P., Lee, W.-J., & Ducoffe, M. (2020) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2020.103678 · Cited by 549
“• The development of several sophisticated, freely available software libraries (Abadi et al., 2016; Jia et al., 2014; Seide and Agarwal, 2016; Al-Rfou’ et al., 2016; Paszke et al., 2017) has made building, training and evaluating DL models relatively straightforward.”
MethodBandara, K., Bergmeir, C., & Smyl, S. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.112896 · Cited by 435
A review of deep learning with special emphasis on architectures, applications and recent trends
Sengupta, S., Basak, S., Saikia, P., Paul, S., Tsalavoutis, V., Atiah, F., Ravi, V., & Peters, A. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.105596 · Cited by 454
Chen, X., Qu, G., Tang, Y., Low, S., & Li, N. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3154718 · Cited by 415
Distributed Artificial Intelligence Empowered by End-Edge-Cloud Computing: A Survey
Duan, S., Wang, D., Ren, J., Lyu, F., Zhang, Y., Wu, H., & Shen, X. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3218527 · Cited by 408
Glow: Graph Lowering Compiler Techniques for Neural Networks
Rotem, N., Fix, J., Abdulrasool, S., Catron, G., Deng, S., Dzhabarov, R., Gibson, N., Hegeman, J., Lele, M., Levenstein, R., et al. (2018) · arXiv · doi:10.48550/arxiv.1805.00907 · Cited by 407
Deep learning in bioinformatics: Introduction, application, and perspective in the big data era
Li, Y., Huang, C., Ding, L., Li, Z., Pan, Y., & Gao, X. (2019) · Methods · doi:10.1016/j.ymeth.2019.04.008 · Cited by 401
Hong, J., Wang, Z., & Yao, Y. (2019) · Applied Energy · doi:10.1016/j.apenergy.2019.113381 · Cited by 378
Asynchronous Decentralized Parallel Stochastic Gradient DescentPreprint
Lian, X., Zhang, W., Zhang, C., & Liu, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.06952 · Cited by 436
Deep learning and big data technologies for IoT security
Amanullah, M. A., Habeeb, R. A. A., Nasaruddin, F. H., Gani, A., Ahmed, E., Nainar, A. S. M., Akim, N. M., & Imran, M. (2020) · Computer Communications · doi:10.1016/j.comcom.2020.01.016 · Cited by 358
A generic communication scheduler for distributed DNN training acceleration
Peng, Y., Zhu, Y., Chen, Y., Bao, Y., Yi, B., Lan, C., Wu, C., & Guo, C. (2019) · Proceedings of the 27th ACM Symposium on Operating Systems Principles · doi:10.1145/3341301.3359642 · Cited by 321
Serving DNNs in Real Time at Datacenter Scale with Project Brainwave
Chung, E., Fowers, J., Ovtcharov, K., Papamichael, M., Caulfield, A., Massengill, T., Liu, M., Lo, D., Alkalay, S., Haselman, M., et al. (2018) · IEEE Micro · doi:10.1109/mm.2018.022071131 · Cited by 328
Don't Use Large Mini-Batches, Use Local SGD
Lin, T., Stich, S. U., Patel, K. K., & Jaggi, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.07217 · Cited by 193
Generalized Byzantine-tolerant SGD
Xie, C., Koyejo, S., & Gupta, I. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.10116 · Cited by 166
A Self-Adaptive Deep Learning-Based System for Anomaly Detection in 5G Networks
Fernandez Maimo, L., Perales Gomez, A. L., Garcia Clemente, F. J., Gil Perez, M., & Martinez Perez, G. (2018) · IEEE Access · doi:10.1109/access.2018.2803446 · Cited by 302
A Survey on Deep Learning for Human Activity Recognition
Gu, F., Chung, M.-H., Chignell, M., Valaee, S., Zhou, B., & Liu, X. (2022) · ACM Computing Surveys · doi:10.1145/3472290 · Cited by 272
Scaling Distributed Machine Learning with In-Network AggregationPreprint
Sapio, A., Canini, M., Ho, C.-Y., Nelson, J., Kalnis, P., Kim, C., Krishnamurthy, A., Moshref, M., Ports, D. R. K., & Richtárik, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.06701 · Cited by 465
The Deep Learning Compiler: A Comprehensive Survey
Li, M., Liu, Y., Liu, X., Sun, Q., You, X., Yang, H., Luan, Z., Gan, L., Yang, G., & Qian, D. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3030548 · Cited by 215
Deep Learning for Diabetes: A Systematic Review
Zhu, T., Li, K., Herrero, P., & Georgiou, P. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3040225 · Cited by 264
Joshi, A., Pradhan, B., Gite, S., & Chakraborty, S. (2023) · Remote Sensing · doi:10.3390/rs15082014 · Cited by 229
The Pytorch-kaldi Speech Recognition Toolkit
Ravanelli, M., Parcollet, T., & Bengio, Y. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683713 · Cited by 236
Analysis of Large-Scale Multi-Tenant GPU Clusters for DNN Training WorkloadsPreprint
Jeon, M., Venkataraman, S., Phanishayee, A., Qian, J., Xiao, W., & Yang, F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.05758 · Cited by 569
Yu, H., Jin, R., & Yang, S. (2019) · arXiv · doi:10.48550/arxiv.1905.03817 · Cited by 244
“We run both Algorithm 1 and the model averaging with Polyak’s momentum SGD suggested in (Seide & Agarwal, 2016; Wang & Joshi, 2018b), referred as “model averaging with cleared momentum” to train ResNet56 over CIFAR10.”
MethodInfluentialCapra, M., Bussolino, B., Marchisio, A., Masera, G., Martina, M., & Shafique, M. (2020) · IEEE Access · doi:10.1109/access.2020.3039858 · Cited by 222
A Survey on Deep Learning for Neuroimaging-Based Brain Disorder Analysis
Zhang, L., Wang, M., Liu, M., & Zhang, D. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00779 · Cited by 220
Scalable Deep Learning on Distributed Infrastructures: Challenges, Techniques, and Tools
Mayer, R., & Jacobsen, H.-A. (2021) · ACM Computing Surveys · doi:10.1145/3363554 · Cited by 192
CRADLE: Cross-Backend Validation to Detect and Localize Bugs in Deep Learning Libraries
Pham, H. V., Lutellier, T., Qi, W., & Tan, L. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2019.00107 · Cited by 190
A review on the design and optimization of antennas using machine learning algorithms and techniques
El Misilmani, H. M., Naous, T., & Al Khatib, S. K. (2020) · International Journal of RF and Microwave Computer-Aided Engineering · doi:10.1002/mmce.22356 · Cited by 188
GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing
Guo, J. F., He, H., He, T., Lausen, L., Li, M., Lin, H., Shi, X., Wang, C., Xie, J., Zha, S., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.04433 · Cited by 201
Communication Compression for Decentralized Training
Tang, H., Gan, S., Zhang, C., Zhang, T., & Liu, J. (2018) · arXiv · doi:10.48550/arxiv.1803.06443 · Cited by 206
“ence rate O p1 T . Centralized algorithms The centralized algorithms is a widely used scheme for parallel computation, such as Tensorflow [Abadi et al., 2016], MXNet [Chen et al., 2015], and CNTK [Seide and Agarwal, 2016]. It uses a central node to control all leaf nodes. For Centralized Parallel Stochastic Gradient De…”
MethodAn introduction to deep learning in medical physics: advantages, potential, and challenges
Shen, C., Nguyen, D., Zhou, Z., Jiang, S. B., Dong, B., & Jia, X. (2020) · Physics in Medicine & Biology · doi:10.1088/1361-6560/ab6f51 · Cited by 185
Deep learning: Applications, architectures, models, tools, and frameworks: A comprehensive survey
Gheisari, M., Ebrahimzadeh, F., Rahimi, M., Moazzamigodarzi, M., Liu, Y., Dutta Pramanik, P. K., Heravi, M. A., Mehbodniya, A., Ghaderzadeh, M., Feylizadeh, M. R., et al. (2023) · CAAI Transactions on Intelligence Technology · doi:10.1049/cit2.12180 · Cited by 177
D$^2$: Decentralized Training over Decentralized Data
Tang, H., Lian, X., Yan, M., Zhang, C., & Liu, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.07068 · Cited by 159
A scikit-based Python environment for performing multi-label classificationPreprint
Szymański, P., & Kajdanowicz, T. (2017) · arXiv.org · doi:10.48550/arxiv.1702.01460 · Cited by 164
Adaptive Communication Strategies to Achieve the Best Error-Runtime Trade-off in Local-Update SGDPreprint
Wang, J., & Joshi, G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.08313 · Cited by 175
Capuchin: Tensor-based GPU Memory Management for Deep Learning
Peng, X., Shi, X., Dai, H., Jin, H., Ma, W., Xiong, Q., Yang, F., & Qian, X. (2020) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3373376.3378505 · Cited by 230
Statistical, machine learning and deep learning forecasting methods: Comparisons and ways forward
Makridakis, S., Spiliotis, E., Assimakopoulos, V., Semenoglou, A.-A., Mulder, G., & Nikolopoulos, K. I. (2022) · Journal of the Operational Research Society · doi:10.1080/01605682.2022.2118629 · Cited by 189
PipeDream: Fast and Efficient Pipeline Parallel DNN Training
Harlap, A., Narayanan, D., Phanishayee, A., Seshadri, V., Devanur, N., Ganger, G., & Gibbons, P. (2018) · arXiv · doi:10.48550/arxiv.1806.03377 · Cited by 153
“CNTK’s [33] 1-bit quantization technique tackles the problem of communication bottlenecks in data parallelism training [35].”
MethodJahangir, R., Teh, Y. W., Nweke, H. F., Mujtaba, G., Al-Garadi, M. A., & Ali, I. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114591 · Cited by 171
Sublime, J., & Kalinicheva, E. (2019) · Remote Sensing · doi:10.3390/rs11091123 · Cited by 172
Gist: Efficient Data Encoding for Deep Neural Network Training
Jain, A., Phanishayee, A., Mars, J., Tang, L., & Pekhimenko, G. (2018) · 2018 ACM/IEEE 45th Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2018.00070 · Cited by 140
A linear speedup analysis of distributed deep learning with sparse and quantized communication
Jiang, P., & Agrawal, G. (2018) · neural information processing systems · Cited by 216
GSLICE: controlled spatial sharing of GPUs for a scalable inference platform
Dhakal, A., Kulkarni, S. G., & Ramakrishnan, K. K. (2020) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/3419111.3421284 · Cited by 192
DoubleSqueeze: Parallel Stochastic Gradient Descent with Double-Pass Error-Compensated Compression
Tang, H., Lian, X., Yu, C., Zhang, T., & Liu, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.05957 · Cited by 107
Deep learning for environmental conservation
Lamba, A., Cassey, P., Segaran, R. R., & Koh, L. P. (2019) · Current Biology · doi:10.1016/j.cub.2019.08.016 · Cited by 128
Guo, Q., Chen, S., Xie, X., Ma, L., Hu, Q., Liu, H., Liu, Y., Zhao, J., & Li, X. (2019) · 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2019.00080 · Cited by 125
SLAQ: quality-driven scheduling for distributed machine learning
Zhang, H., Stafman, L., Or, A., & Freedman, M. J. (2017) · Symposium on Cloud Computing · doi:10.1145/3127479.3127490 · Cited by 169
Local SGD with Periodic Averaging: Tighter Analysis and Adaptive Synchronization
Haddadpour, F., Kamani, M. M., Mahdavi, M., & Cadambe, V. R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.13598 · Cited by 98
WekaDeeplearning4j: A deep learning package for Weka based on Deeplearning4j
Lang, S., Bravo-Márquez, F., Beckham, C., Hall, M., & Frank, E. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.04.013 · Cited by 131
Large Scale High-Resolution Land Cover Mapping With Multi-Resolution Data
Robinson, C., Hou, L., Malkin, K., Soobitsky, R., Czawlytko, J., Dilkina, B., & Jojić, N. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01301 · Cited by 161
Privacy-preserving neural networks with Homomorphic encryption: Challenges and opportunities
Pulido-Gaytan, B., Tchernykh, A., Cortés-Mendoza, J. M., Babenko, M., Radchenko, G., Avetisyan, A., & Drozdov, A. Y. (2021) · Peer-to-Peer Networking and Applications · doi:10.1007/s12083-021-01076-8 · Cited by 126
Deep learning approaches for speech emotion recognition: state of the art and research challenges
Jahangir, R., Teh, Y. W., Hanif, F., & Mujtaba, G. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09874-7 · Cited by 143
Philippenko, C., & Dieuleveut, A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.01358 · Cited by 118
Deep learning: as the new frontier in high-throughput plant phenotyping
Arya, S., Sandhu, K. S., Singh, J., & Kumar, S. (2022) · Euphytica · doi:10.1007/s10681-022-02992-3 · Cited by 124
An empirical study on program failures of deep learning jobs
Zhang, R., Xiao, W., Zhang, H., Liu, Y., Lin, H., & Yang, M. (2020) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3377811.3380362 · Cited by 143
Hong, J., Wang, Z., Chen, W., & Yao, Y. (2019) · Applied Energy · doi:10.1016/j.apenergy.2019.113648 · Cited by 111
Automatic differentiation in machine learning
Güneş, B. A., PearlmutterBarak, A., Andreyevich, R., & Mark, S. (2017) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.5555/3122009.3242010 · Cited by 110
Guillén, M. A., Llanes, A., Imbernón, B., Martínez‐España, R., Bueno-Crespo, A., Cano, J., & Cecilia, J. M. (2020) · The Journal of Supercomputing · doi:10.1007/s11227-020-03288-w · Cited by 117
Bai, Y., Mas, E., & Koshimura, S. (2018) · Remote Sensing · doi:10.3390/rs10101626 · Cited by 113
An artificial neural network approach for predicting hypertension using NHANES data
Martínez, F., Núñez‐Valdéz, E. R., Crespo, R. A. G., & García‐Díaz, V. (2020) · Scientific Reports · doi:10.1038/s41598-020-67640-z · Cited by 112
Neural-Guided Deductive Search for Real-Time Program Synthesis from Examples
Kalyan, A., Mohta, A., Polozov, O., Batra, D., Jain, P., & Gulwani, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.01186 · Cited by 69
Ensemble Multifeatured Deep Learning Models and Applications: A Survey
Abimannan, S., El-Alfy, E.-S. M., Chang, Y., Hussain, S., Shukla, S., & Satheesh, D. (2023) · IEEE Access · doi:10.1109/access.2023.3320042 · Cited by 119
Audee: automated testing for deep learning frameworks
Guo, Q., Xie, X., Li, Y., Zhang, X., Liu, Y., Li, X., & Shen, C. (2020) · Proceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/3324884.3416571 · Cited by 92
Problems and opportunities in training deep learning software systems: an analysis of variance
Pham, H. V., Qian, S., Wang, J., Lutellier, T., Rosenthal, J., Tan, L., Yu, Y., & Nagappan, N. (2020) · Proceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/3324884.3416545 · Cited by 100
“DL libraries: We use Keras version 2.2.2 [25] as our high-level library since it provides us with the ability to transparently switch between three DL core libraries (TensorFlow [13], CNTK [16], and Theano [91]).”
MethodInfluentialDynamic control flow in large-scale machine learning
Yu, Y., Abadi, M., Barham, P. R., Brevdo, E., Burrows, M., Davis, A., Dean, J., Ghemawat, S., Harley, T., Hawkins, P., et al. (2018) · European Conference on Computer Systems · doi:10.1145/3190508.3190551 · Cited by 114
Tsunami Damage Detection with Remote Sensing: A Review
Koshimura, S., Moya, L., Mas, E., & Bai, Y. (2020) · Geosciences · doi:10.3390/geosciences10050177 · Cited by 104
BlueConnect: Decomposing all-reduce for deep learning on heterogeneous network hierarchy
Cho, M., Finkler, U., Serrano, M. J., Kung, D. S., & Hunter, H. C. (2019) · IBM Journal of Research and Development · doi:10.1147/jrd.2019.2947013 · Cited by 113
Ludwig: a type-based declarative deep learning toolboxPreprint
Molino, P., Dudin, Y., & Miryala, S. S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.07930 · Cited by 106
AKG: automatic kernel generation for neural processing units using polyhedral transformations
Zhao, J., Li, B., Nie, W., Geng, Z., Zhang, R., Gao, X., Cheng, B., Wu, C. H., Cheng, Y., Li, Z., et al. (2021) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/3453483.3454106 · Cited by 118
Applying Hand Gesture Recognition for User Guide Application Using MediaPipe
Indriani, I., Harris, M., & Agoes, A. S. (2021) · Advances in engineering research/Advances in Engineering Research · doi:10.2991/aer.k.211106.017 · Cited by 116
Digital Twins of Manufacturing Systems as a Base for Machine Learning
Jaensch, F., Csiszar, A., Scheifele, C., & Verl, A. W. (2018) · International Conference on Mechatronics and Machine Vision in Practice (M2VIP) · doi:10.1109/m2vip.2018.8600844 · Cited by 109
Blind Reverberation Time Estimation Using a Convolutional Neural Network
Gamper, H., & Tashev, I. (2018) · International Workshop on Acoustic Signal Enhancement · doi:10.1109/iwaenc.2018.8521241 · Cited by 89
Real-time polyp detection model using convolutional neural networks
Nogueira-Rodríguez, A., Domínguez, R., Campos-Tato, F., Herrero, J., Puga, M., Remedios, D., Rivas, L., Sánchez, E., Iglesias, Á., Cubiella, J., et al. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-06496-4 · Cited by 91
CANDLE/Supervisor: a workflow framework for machine learning applied to cancer research
Wozniak, J. M., Jain, R., Balaprakash, P., Ozik, J., Collier, N. T., Bauer, J., Xia, F., Brettin, T. S., Stevens, R. L., Mohd-Yusof, J., et al. (2018) · BMC Bioinformatics · doi:10.1186/s12859-018-2508-4 · Cited by 102
Automatic Speech Recognition Using Limited Vocabulary: A Survey
Fendji, J. L. E. K., Tala, D. C. M., Yenké, B. O., & Atemkeng, M. (2022) · Applied Artificial Intelligence · doi:10.1080/08839514.2022.2095039 · Cited by 93
Deep learning in next-generation sequencing
Schmidt, B., & Hildebrandt, A. (2020) · Drug Discovery Today · doi:10.1016/j.drudis.2020.10.002 · Cited by 87
Machine Learning at Microsoft with ML.NET
Ahmed, Z., Amizadeh, S., Bilenko, M., Carr, R., Chin, W.-S., Dekel, Y., Dupre, X., Eksarevskiy, V., Filipi, S., Finley, T., et al. (2019) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3292500.3330667 · Cited by 107
pCAMP: Performance Comparison of Machine Learning Packages on the Edges
Zhang, X., Wang, Y., & Shi, W. (2019) · arXiv · doi:10.48550/arxiv.1906.01878 · Cited by 77
“In order to improve the ef-ficiency of training models, many open-source machine learning packages have been recently developed, including TensorFlow [1] from Google, Caffe [2] from UC Berkeley, CNTK [3] from Microsoft, PyTorch [4] from Facebook, and MXNet [5] supported by AWS.”
MethodGPU acceleration of ADMM for large-scale quadratic programming
Schubiger, M., Banjac, G., & Lygeros, J. (2020) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2020.05.021 · Cited by 76
DLBench: a comprehensive experimental evaluation of deep learning frameworks
Elshawi, R., Wahab, A., Barnawi, A., & Sakr, S. (2021) · Cluster Computing · doi:10.1007/s10586-021-03240-4 · Cited by 84
Crossbow: scaling deep learning with small batch sizes on multi-GPU servers
Koliousis, A., Watcharapichat, P., Weidlich, M., Mai, L., Costa, P., & Pietzuch, P. R. (2019) · Proceedings of the VLDB Endowment · doi:10.14778/3342263.3342276 · Cited by 79
Yassir, A., Andaloussi, S. J., Ouchetto, O., Mamza, K., & Serghini, M. (2023) · Fisheries Research · doi:10.1016/j.fishres.2023.106790 · Cited by 74
Metadata
- Authors
- Seide, F., & Agarwal, A.
- Affiliations
- Microsoft (United States) (US)
- Venue
- Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
- Publisher
- ACM
- Published
- 2016-08-13
- Pages
- 2135-2135
- OpenAlex
- W2513383847
- Cited by
- 382
- References
- 1
- Citations by year
- 2026: 4 · 2025: 9 · 2024: 22 · 2023: 26 · 2022: 32 · 2021: 48 · 2020: 68 · 2019: 86 · 2018: 73 · 2017: 12 · 2016: 1
- FWCI
- 30.89
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Keywords
- CNTK, deep learning framework, computational graphs, automatic differentiation, recurrent neural networks, sequence-to-sequence models, convolutional neural networks, memory sharing, speech recognition, image recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.