Low latency RNN inference with cellular batching
The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Performing inference on pre-trained neural network models must meet the requirement of low-latency, which is often at odds with achieving high throughput. Existing deep learning systems use batching to improve throughput, which do not perform well when serving Recurrent Neural Networks with dynamic dataflow graphs. We propose the technique of cellular batching, which improves both the latency and throughput of RNN inference. Unlike existing systems that batch a fixed set of dataflow graphs, cellular batching makes batching decisions at the granularity of an RNN "cell" (a subgraph with shared weights) and dynamically assembles a batched cell for execution as requests join and leave the system. We implemented our approach in a system called BatchMaker. Experiments show that BatchMaker achieves much lower latency and also higher throughput than existing systems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Moreover, with special GPU kernels, these techniques eliminate the need to pad the inputs and outputs.”
From Efficient Memory Management for Large Language Model Serving with PagedAttention (2023) · cites this paper as [16]
In the citing paper
“By reducing the queueing delay and the inefficiencies from padding, the fine-grained batching mechanisms significantly increase the throughput of LLM serving.”
From Efficient Memory Management for Large Language Model Serving with PagedAttention (2023) · cites this paper as [16]
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319
Self-citationLong-term recurrent convolutional networks for visual recognition and description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228
Research works printed but not linked: 5
- Awni Hannun Carl Case Jared Casper Bryan Catanzaro Greg Diamos Erich Elsen Ryan Prenger Sanjeev Satheesh Shubho Sengupta Adam Coates etal 2014. Deep speech: Scaling up end-to-end speech recognition. arXiv preprint arXiv:1412.5567 (2014). Awni Hannun Carl Case Jared Casper Bryan Catanzaro Greg Diamos Erich Elsen Ryan Prenger Sanjeev Satheesh Shubho Sengupta Adam Coates et al. 2014. Deep speech: Scaling up end-to-end speech recognition. arXiv preprint arXiv:1412.5567 (2014). · arXiv
- 10.5555/2946645.2946679 · doi:10.5555/2946645.2946679
- Graham Neubig , Chris Dyer , Yoav Goldberg , Austin Matthews , Waleed Ammar, Antonios Anastasopoulos, Miguel Ballesteros, David Chiang, Daniel Clothiaux, Trevor Cohn, et al. 2017 . DyNet: The Dynamic Neural Network Toolkit . arXiv preprint arXiv:1701.03980 (2017). Graham Neubig, Chris Dyer, Yoav Goldberg, Austin Matthews, Waleed Ammar, Antonios Anastasopoulos, Miguel Ballesteros, David Chiang, Daniel Clothiaux, Trevor Cohn, et al. 2017. DyNet: The Dynamic Neural Network Toolkit. arXiv preprint arXiv:1701.03980 (2017). · arXiv
- Ming Tan , Cicero dos Santos , Bing Xiang , and Bowen Zhou . 2015. LSTM-based deep learning models for non-factoid answer selection. arXiv preprint arXiv:1511.04108 ( 2015 ). Ming Tan, Cicero dos Santos, Bing Xiang, and Bowen Zhou. 2015. LSTM-based deep learning models for non-factoid answer selection. arXiv preprint arXiv:1511.04108 (2015). · arXiv
- Seiya Tokui , Kenta Oono , Shohei Hido , and Justin Clayton . 2015 . Chainer: a next-generation open source framework for deep learning . In Proceedings of workshop on machine learning systems (LearningSys) in the twenty-ninth annual conference on neural information processing systems (NIPS) , Vol. 5 . Seiya Tokui, Kenta Oono, Shohei Hido, and Justin Clayton. 2015. Chainer: a next-generation open source framework for deep learning. In Proceedings of workshop on machine learning systems (LearningSys) in the twenty-ninth annual conference on neural information processing systems (NIPS), Vol. 5.
Cited by
Efficient Memory Management for Large Language Model Serving with PagedAttention
Kwon, W., Li, Z., Zhuang, S., Sheng, Y., Zheng, L., Yu, C. H., Gonzalez, J. E., Zhang, H., & Stoica, I. (2023) · arXiv · doi:10.48550/arxiv.2309.06180 · Cited by 1,802
Efficient Memory Management for Large Language Model Serving with PagedAttention
Kwon, W., Li, Z., Zhuang, S., Sheng, Y., Zheng, L., Yu, C. H., Gonzalez, J., Zhang, H., & Stoica, I. (2023) · Proceedings of the 29th Symposium on Operating Systems Principles · doi:10.1145/3600006.3613165 · Cited by 1,817
“To address this problem, fine-grained batching mechanisms, such as cellular batching [16] and iteration-level scheduling [60], have been proposed.”
Deep Learning Workload Scheduling in GPU Datacenters: A Survey
Ye, Z., Gao, W., Hu, Q., Sun, P., Wang, X., Luo, Y., Zhang, T., & Wen, Y. (2023) · ACM Computing Surveys · doi:10.1145/3638757 · Cited by 267
TurboTransformers: an efficient GPU serving system for transformer models
Fang, J., Yu, Y., Zhao, C., & Zhou, J. (2021) · Proceedings of the 26th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming · doi:10.1145/3437801.3441578 · Cited by 116
Deep learning in electron microscopy
Ede, J. M. (2020) · Machine Learning Science and Technology · doi:10.1088/2632-2153/abd614 · Cited by 143
Optimizing inference serving on serverless platforms
Ali, A. Z. E., Pinciroli, R., Yan, F., & Smirni, E. (2022) · Proceedings of the VLDB Endowment · doi:10.14778/3547305.3547313 · Cited by 89
Lazy Batching: An SLA-aware Batching System for Cloud Machine Learning Inference
Choi, Y., Kim, Y., & Rhu, M. (2021) · 2021 IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca51647.2021.00049 · Cited by 69
A survey On hardware accelerators and optimization techniques for RNNs
Mittal, S., & Umesh, S. (2020) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2020.101839 · Cited by 60
Automating Cloud Deployment for Deep Learning Inference of Real-time Online Services
Li, Y., Han, Z., Zhang, Q., Li, Z., & Tan, H. (2020) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom41043.2020.9155267 · Cited by 56
Gao, H., Qiu, B., Wang, Y., Si, Y., Xu, Y., & Wang, X. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3339633 · Cited by 51
Deep Flexible Sequential (DFS) Model for Air Pollution Forecasting
Kaya, K., & Öğüdücü, Ş. G. (2020) · Scientific Reports · doi:10.1038/s41598-020-60102-6 · Cited by 48
GRNN: Low-Latency and Scalable RNN Inference on GPUs
Holmes, C., Mawhirter, D., He, Y., Yan, F., & Wu, B. (2019) · Proceedings of the Fourteenth EuroSys Conference 2019 · doi:10.1145/3302424.3303949 · Cited by 45
Scrooge: A Cost-Effective Deep Learning Inference System
Hu, Y., Ghosh, R., & Govindan, R. (2021) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/3472883.3486993 · Cited by 55
Ebird: Elastic Batch for Improving Responsiveness and Throughput of Deep Learning Services
Cui, W., Wei, M., Chen, Q., Tang, X., Leng, J., Li, L., & Guo, M. (2019) · IEEE International Conference on Computer Design: VLSI in Computers and Processors (ICCD) · doi:10.1109/iccd46524.2019.00075 · Cited by 33
CRIME: Input-Dependent Collaborative Inference for Recurrent Neural Networks
Pagliari, D. J., Chiaro, R., Macii, E., & Poncino, M. (2020) · IEEE Transactions on Computers · doi:10.1109/tc.2020.3021199 · Cited by 36
Li, C., Zhou, Z., Wang, Y., Yang, F., Cao, T., Yang, M., Liang, Y. E., & Sun, G. (2024) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3620665.3640376 · Cited by 42
InSS: An Intelligent Scheduling Orchestrator for Multi-GPU Inference With Spatio-Temporal Sharing
Han, Z., Zhou, R., Xu, C., Zeng, Y., & Zhang, R. (2024) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2024.3430063 · Cited by 36
Astraea: towards QoS-aware and resource-efficient multi-stage GPU services
Zhang, W., Chen, Q., Fu, K., Zheng, N., Huang, Z., Leng, J., & Guo, M. (2022) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3503222.3507721 · Cited by 33
E2bird: Enhanced Elastic Batch for Improving Responsiveness and Throughput of Deep Learning Services
Cui, W., Chen, Q., Zhao, H., Wei, M., Tang, X., & Guo, M. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3047638 · Cited by 24
Stateful Large Language Model Serving with Pensieve
Yu, L., Lin, J., & Li, J. (2025) · European Conference on Computer Systems · doi:10.1145/3689031.3696086 · Cited by 122
Self-citationMDINFERENCE: Balancing Inference Accuracy and Latency for Mobile Applications
Ogden, S. S., & Guo, T. (2020) · IEEE International Conference on Cloud Engineering · doi:10.1109/ic2e48712.2020.00010 · Cited by 32
Neuro-Symbolic AI: An Emerging Class of AI Workloads and their CharacterizationPreprint
Susskind, Z., Arden, B., John, L. K., Stockton, P., & John, E. B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.06133 · Cited by 71
Zhou, Q., Yin, P., Yan, X., Li, C., Jiang, G., & Cheng, J. S.-C. (2024) · Proceedings of the ACM on Management of Data · doi:10.1145/3677129 · Cited by 21
Characterizing the Deep Neural Networks Inference Performance of Mobile ApplicationsPreprint
Ogden, S. S., & Guo, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.04783 · Cited by 29
Deadline-Aware Offloading for High-Throughput Accelerators
Yeh, T. T., Sinclair, M. D., Beckmann, B. M., & Rogers, T. G. (2021) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca51647.2021.00048 · Cited by 21
Zheng, Z., Ji, X., Fang, T., Zhou, F., Liu, C., & Peng, G. (2024) · arXiv · doi:10.48550/arxiv.2412.03594 · Cited by 16
Serving DNN Models with Multi-Instance GPUs: A Case of the Reconfigurable Machine Scheduling ProblemPreprint
Tan, C., Li, Z., Zhang, J., Cao, Y., Qi, S., Liu, Z., Zhu, Y., & Guo, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.11067 · Cited by 54
E-BATCH: Energy-Efficient and High-Throughput RNN Batching
Silfa, F., Arnau, J. M., & González, A. (2022) · ACM Transactions on Architecture and Code Optimization · doi:10.1145/3499757 · Cited by 14
“This issue is evident in batching strategies such as Cellular Batching [9], where batches with short sequences are created, and not surprisingly, it is inefficient energy-wise.”
BackgroundParallelFusion: Towards Maximum Utilization of Mobile GPU for DNN Inference
Lee, J.-Y., Liu, Y.-X., & Lee, Y. (2021) · EMDL@MobiSys · doi:10.1145/3469116.3470014 · Cited by 14
E.T. re-thinking self-attention for transformer models on GPUs
Chen, S., Huang, S., Pandey, S., Li, B., Gao, G. R., Zheng, L., Ding, C., & Liu, H. (2021) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3458817.3476138 · Cited by 45
Optimizing Prediction Serving on Low-Latency Serverless DataflowPreprint
Sreekanti, V., Subbaraj, H., Wu, C., Gonzalez, J. E., & Hellerstein, J. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.05832 · Cited by 33
GPU Domain Specialization via Composable On-Package Architecture
Fu, Y., Bolotin, E., Chatterjee, N., Nellans, D. W., & Keckler, S. W. (2021) · ACM Transactions on Architecture and Code Optimization · doi:10.1145/3484505 · Cited by 19
Energy-Efficient Online Scheduling of Transformer Inference Services on GPU Servers
Wang, Y., Wang, Q., & Chu, X. (2022) · IEEE Transactions on Green Communications and Networking · doi:10.1109/tgcn.2022.3171680 · Cited by 13
Remarn: A Reconfigurable Multi-threaded Multi-core Accelerator for Recurrent Neural Networks
Que, Z., Nakahara, H., Fan, H., Li, H., Meng, J., Tsoi, K. H., Niu, X., Nurvitadhi, E., & Luk, W. W. (2022) · ACM Transactions on Reconfigurable Technology and Systems · doi:10.1145/3534969 · Cited by 11
SeqPoint: Identifying Representative Iterations of Sequence-Based Neural Networks
Pati, S., Aga, S., Sinclair, M. D., & Jayasena, N. (2020) · IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) · doi:10.1109/ispass48437.2020.00017 · Cited by 13
A Reconfigurable Multithreaded Accelerator for Recurrent Neural Networks
Que, Z., Nakahara, H., Fan, H., Meng, J., Tsoi, K. H., Niu, X., Nurvitadhi, E., & Luk, W. W. (2020) · International Conference on Field-Programmable Technology (FPT) · doi:10.1109/icfpt51103.2020.00012 · Cited by 11
TurboTransformers: An Efficient GPU Serving System For Transformer ModelsPreprint
Fang, J., Yu, Y., Zhao, C., & Zhou, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.05680 · Cited by 9
Optimizing GPU Sharing for Container-Based DNN Serving with Multi-Instance GPUs
Wei, X., Li, Z., & Tan, C. L. (2024) · ACM International Systems and Storage Conference (SYSTOR) · doi:10.1145/3688351.3689156 · Cited by 8
Energy-efficient Inference Service of Transformer-based Deep Learning Models on GPUs
Wang, Y., Wang, Q., & Chu, X. (2020) · IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) · doi:10.1109/ithings-greencom-cpscom-smartdata-cybermatics50389.2020.00067 · Cited by 10
Accelerating Deep Learning Inference via Learned CachesPreprint
Balasubramanian, A., Kumar, A., Liu, Y., Cao, H., Venkataraman, S., & Akella, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.07344 · Cited by 25
QoS-Aware Irregular Collaborative Inference for Improving Throughput of DNN Services
Fu, K., Shi, J., Chen, Q., Zheng, N., Zhang, W., Zeng, D., & Guo, M. (2022) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1109/sc41404.2022.00074 · Cited by 8
TurboDL: Improving the CNN Training on GPU With Fine-Grained Multi-Streaming Scheduling
Jin, H., Wu, W., Shi, X., He, L., & Zhou, B. B. (2020) · IEEE Transactions on Computers · doi:10.1109/tc.2020.2990321 · Cited by 7
Dhakal, A., Kulkarni, S. G., & Ramakrishnan, K. K. (2024) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2024.3476210 · Cited by 11
SoD 2 : Statically Optimizing Dynamic Deep Neural Network Execution
Niu, W., Agrawal, G., & Ren, B. (2024) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3617232.3624869 · Cited by 17
RELIEF: Relieving Memory Pressure In SoCs Via Data Movement-Aware Accelerator Scheduling
Gupta, S., & Dwarkadas, S. (2024) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca57654.2024.00084 · Cited by 6
PAME: precision-aware multi-exit DNN serving for reducing latencies of batched inferences
Zhang, S., Cui, W., Chen, Q., Zhang, Z., Guan, Y., Leng, J., Li, C., & Guo, M. (2022) · International Conference on Supercomputing · doi:10.1145/3524059.3532366 · Cited by 11
Automating Cloud Deployment for Real-Time Online Foundation Model Inference
Li, Y., Li, Z., Han, Z., Zhang, Q., & Ma, X. (2023) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2023.3321967 · Cited by 9
DeepBAT: Performance and Cost Optimization of Serverless Inference Using Transformers
Sun, B., Pinciroli, R., Casale, G., & Smirni, E. (2025) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps64566.2025.00037 · Cited by 5
PISeL : Pipelining DNN Inference for Serverless Computing
Jafari, M. R., Su, J., Zhang, Y., Wang, O., & Zhang, W. (2024) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3627673.3679824 · Cited by 6
No DNN Left Behind: Improving Inference in the Cloud with Multi-TenancyPreprint
Samanta, A., Shrinivasan, S., Kaufmann, A., & Mace, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.06887 · Cited by 5
AdaSpec: Adaptive Speculative Decoding for Fast, SLO-Aware Large Language Model Serving
Huang, K., Wu, H., Shi, Z., Zou, H., Yu, M., & Shi, Q. (2025) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/3772052.3772239 · Cited by 35
Li, Y., & Qian, S. (2026) · Energy · doi:10.1016/j.energy.2026.140284 · Cited by 3
Carat: Unlocking Value-Level Parallelism for Multiplier-Free GEMMs
Pan, Z., Miguel, J. S., & Wu, D. (2024) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3620665.3640364 · Cited by 4
Zhang, Q., Liu, Y., Liu, T., & Qian, D. (2023) · The Journal of Supercomputing · doi:10.1007/s11227-023-05183-6 · Cited by 2
ModiPick: SLA-aware Accuracy Optimization For Mobile Deep InferencePreprint
Ogden, S. S., & Guo, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.02053 · Cited by 3
ChunkAttention: Efficient Self-Attention with Prefix-Aware KV Cache and Two-Phase Partition
Ye, L., Tao, Z., Huang, Y., & Li, Y. (2024) · arXiv · doi:10.48550/arxiv.2402.15220 · Cited by 34
“…although they are in different iterations, the server can still perform batching at the granularity of iteration and predict the next tokens for all sequences together, rather than separately, which is known as iteration-based batching (Gao et al., 2018; Yu et al., 2022; Silfa et al., 2022).”
BackgroundEnergy-efficient architectures for recurrent neural networks
Silfa, F. (2021) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · doi:10.5821/dissertation-2117-344357 · Cited by 1
Just-in-Time Dynamic-BatchingPreprint
Zha, S., Jiang, Z., Lin, H., & Zhang, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.07421 · Cited by 3
The Design of Stateful Serverless Infrastructure
Sreekanti, V. (2020) · eScholarship (California Digital Library) · Cited by 1
openLG: A Tunable and Efficient Open-source LSTM on GPUs
Shan, Z., Huang, X., Zhou, Z., & Zhang, X. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650733
HARD: Hardening Real-Time Scheduling and Analysis for Accelerator Enabled Computing
Ni, Y., Ma, T., Chen, J., Yang, C., Ye, S., Xu, Y., Jin, Y., & Zou, A. (2025) · IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS) · doi:10.1109/rtas65571.2025.00043
PASK: Cold Start Mitigation for Inference with Proactive and Selective Kernel Loading on GPUs
Huang, X., Du, J., Xiao, N., & Zhang, X. (2025) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac63849.2025.11132809
Symbiosis: Multi-Adapter Inference and Fine-Tuning
Gupta, S., Deshpande, U. D., Janssen, T., & Sundararaman, S. (2025) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/3772052.3772230 · Cited by 1
µShare: Non-Intrusive Kernel Co-Locating on NVIDIA GPUs
Huang, W., Duan, Z., Zhao, L., Zhang, Y., Wang, Y., Li, Y., Wang, Y., Chen, Y., Tang, Z., Chen, K., et al. (2026) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca68181.2026.11408561 · Cited by 1
SG-Serve: Efficient Model Serving for Subgraph-based Graph Representation Learning
Zhou, Q., Yin, P., Yan, X., Li, C., & Cheng, J. S.-C. (2026) · Proceedings of the ACM on Management of Data · doi:10.1145/3786697
PARD: Enhancing Goodput for Inference Pipeline via Proactive Request Dropping
Zhao, Z., Hu, Y., Chen, S. H., Ji, M., Yang, W., Zhang, Y., Zhao, L., Li, W., Liu, X., Qu, W., et al. (2026) · European Conference on Computer Systems · doi:10.1145/3767295.3803581 · Cited by 1
KaleidoScope: A Co-Processor for Neural-Network-Driven Intelligent Data Plane
Wen, D., Liu, Z., Yang, T., Li, T., Wang, Y., Li, T., Fan, Z., Li, Q., & Sun, Z. (2026) · IEEE Transactions on Computers · doi:10.1109/tc.2026.3688717
Metadata
- Authors
- Gao, P., Yu, L., Wu, Y., & Li, J.
- Affiliations
- New York University (US)
- Tsinghua University (CN)
- Venue
- Proceedings of the Thirteenth EuroSys Conference
- Publisher
- ACM
- Published
- 2018-04-23
- Pages
- 1-15
- OpenAlex
- W2798291715
- Cited by
- 66
- References
- 36
- Citations by year
- 2026: 5 · 2025: 6 · 2024: 10 · 2023: 5 · 2022: 7 · 2021: 11 · 2020: 16 · 2019: 6
- FWCI
- 7.04
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- European Conference on Computer Systems (publishedVersion)
- Funders
- Nvidia
- Topics
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Information Systems › Advanced Database Systems and Queries
- Keywords
- low latency, throughput
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.