Accurately computing the log-sum-exp and softmax functions
Open accessAbstract
Abstract Evaluating the log-sum-exp function or the softmax function is a key step in many modern data science algorithms, notably in inference and classification. Because of the exponentials that these functions contain, the evaluation is prone to overflow and underflow, especially in low-precision arithmetic. Software implementations commonly use alternative formulas that avoid overflow and reduce the chance of harmful underflow, employing a shift or another rewriting. Although mathematically equivalent, these variants behave differently in floating-point arithmetic and shifting can introduce subtractive cancellation. We give rounding error analyses of different evaluation algorithms and interpret the error bounds using condition numbers for the functions. We conclude, based on the analysis and numerical experiments, that the shifted formulas are of similar accuracy to the unshifted ones, so can safely be used, but that a division-free variant of softmax can suffer from loss of accuracy.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The softmax itself, in the standard max-shifted form, is backward stable with a condition number bounded by one in the relevant norm, so the delicacy analysed is a property of A, not of the softmax evaluation.
“The softmax itself, in the standard max-shifted form, is backward stable with a condition number bounded by one in the relevant norm [34], so the delicacy we analyse is a property of A , not of the softmax evaluation.”
From Curvature-Corrected Rotary Position Embeddings: An Entropy-Invariant Temperature for Mitigating Numerical-Rank Collapse in Long-Context Attention (2026) · cites this paper as [34]
Section 2 (page unavailable) explicitly says the softmax condition number in the infinity norm can be arbitrarily large and that shifting does not change it, contrary to the claimed bound of one. Section 4, Theorem 4.3 (page unavailable), gives a forward-error bound for the max-shifted evaluation, not a backward-stability result. (LLM, conf=0.90)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2000) · doi:10.32614/r.manuals · Cited by 355,706 · see citing works
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601 · see citing works
(2016) · Cited by 11,679 · see citing works
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824 · see citing works
Accuracy and Stability of Numerical Algorithms: Second Edition
Higham, N. J. (2002) · doi:10.1137/1.9780898718027 · Cited by 3,803 · see citing works
Functions of Matrices: Theory and Computation
Higham, N. J. (2008) · doi:10.1137/1.9780898717778 · Cited by 2,113 · see citing works
Self-citationAccuracy and stability of numerical algorithms
(1996) · Choice Reviews Online · doi:10.5860/choice.34-0981 · Cited by 2,072 · see citing works
IEEE Standard for Floating-Point Arithmetic
Zuras, D., Cowlishaw, M., Aiken, A., et al. (2008) · doi:10.1109/ieeestd.2008.4610935 · Cited by 1,329 · see citing works
Computer Age Statistical Inference
Efron, B., & Hastie, T. (2016) · Cambridge University Press eBooks · doi:10.1017/cbo9781316576533 · Cited by 926 · see citing works
Bayesian classification with Gaussian processes
Williams, C. K. I., & Barber, D. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.735807 · Cited by 764 · see citing works
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 636 · see citing works
Elementary functions: algorithms and implementation
(1998) · Choice Reviews Online · doi:10.5860/choice.35-2759 · Cited by 531 · see citing works
Handbook of Floating-Point Arithmetic
Muller, J., Brisebarre, N., de Dinechin, F. D., Jeannerod, C.-P., Lefèvre, V., Melquiond, G., Revol, N., Stehlé, D., & Torres, S. (2009) · Birkhäuser Boston eBooks · doi:10.1007/978-0-8176-4705-6 · Cited by 460 · see citing works
The Accuracy of Floating Point Summation
Higham, N. J. (1993) · SIAM Journal on Scientific Computing · doi:10.1137/0914050 · Cited by 268 · see citing works
Computer age statistical inference algorithms, evidence, and data science
Efron, B., & Hastie, T. J. (2016) · Thammasat University Digital Collections · Cited by 254 · see citing works
Handbook of Floating-Point Arithmetic
Muller, J., Brunie, N., de Dinechin, F. D., Jeannerod, C.-P., Joldeş, M., Lefèvre, V., Melquiond, G., Revol, N., & Torres, S. (2018) · Springer eBooks · doi:10.1007/978-3-319-76526-6 · Cited by 234 · see citing works
A High-Speed and Low-Complexity Architecture for Softmax Function in Deep Learning
Wang, M., Lu, S., Zhu, D., Lin, J. T., & Wang, Z. (2018) · IEEE Asia Pacific Conference on Circuits and Systems (APCCAS) · doi:10.1109/apccas.2018.8605654 · Cited by 217 · see citing works
Muller, J. (2016) · Birkhäuser Boston eBooks · doi:10.1007/978-1-4899-7983-4 · Cited by 103 · see citing works
A New Approach to Probabilistic Rounding Error Analysis
Higham, N. J., & Mary, T. (2019) · SIAM Journal on Scientific Computing · doi:10.1137/18m1226312 · Cited by 94 · see citing works
Simulating Low Precision Floating-Point Arithmetic
Higham, N. J., & Pranesh, S. (2019) · SIAM Journal on Scientific Computing · doi:10.1137/19m1251308 · Cited by 73 · see citing works
Log-Sum-Exp Neural Networks and Posynomial Models for Convex and Log-Log-Convex Data
Calafiore, G. C., Gaubert, S., & Possieri, C. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2910417 · Cited by 65 · see citing works
Error estimation of floating-point summation and dot product
Rump, S. M. (2011) · BIT Numerical Mathematics · doi:10.1007/s10543-011-0342-4 · Cited by 46 · see citing works
A Class of Fast and Accurate Summation Algorithms
Pierre, B., Higham, N. J., & Mary, T. (2020) · SIAM Journal on Scientific Computing · doi:10.1137/19m1257780 · Cited by 43 · see citing works
Fast and correctly rounded logarithms in double-precision
de Dinechin, F., Lauter, C., & Muller, J. (2007) · RAIRO - Theoretical Informatics and Applications · doi:10.1051/ita:2007003 · Cited by 41 · see citing works
The Matrix Unwinding Function, with an Application to Computing the Matrix Exponential
Aprahamian, M., & Higham, N. J. (2014) · SIAM Journal on Matrix Analysis and Applications · doi:10.1137/130920137 · Cited by 20 · see citing works
Secure multiparty computations in floating-point arithmetic
Guo, C., Hannun, A., Knott, B., van der Maaten, L., Tygert, M., & Zhu, R. (2020) · Information and Inference A Journal of the IMA · doi:10.1093/imaiai/iaaa038 · Cited by 18 · see citing works
Sharp estimates for perturbation errors in summations
Lange, M., & Rump, S. M. (2018) · Mathematics of Computation · doi:10.1090/mcom/3355 · Cited by 14 · see citing works
Secure multiparty computations in floating-point arithmeticPreprint
Guo, C., Hannun, A., Knott, B., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.03192 · Cited by 11 · see citing works
Softmax Optimizations for Intel Xeon Processor-based PlatformsPreprint
Czaja, J., Gallus, M., Patejko, T., & Tang, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.12380 · Cited by 3 · see citing works
Sparse ℓ1- and ℓ2-Center Classifiers
Calafiore, G. C., & Fracastoro, G. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3036838 · Cited by 2 · see citing works
Flagged first, then by citations
1 of the 31 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- Murphy, K. P. (2012) Machine Learning: A Probabilistic Approach. Cambridge, UK: Cambridge University Press.
Cited by
Sorted by citations
Goal-driven Self-Attentive Recurrent Networks for Trajectory Prediction
Chiara, L. F., Coscia, P., Das, S., Calderara, S., Cucchiara, R., & Ballan, L. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00282 · Cited by 75 · see citing works
Wang, J., Yang, Z., Chen, C., Ge, Y., Wan, X., Bao, S., Ding, J., Wang, L., & Jiang, H. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae387 · Cited by 55 · see citing works
Bemporad, A. (2022) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2022.3183036 · Cited by 53 · see citing works
SOFA: A Compute-Memory Optimized Sparsity Accelerator via Cross-Stage Coordinated Tiling
Wang, H., Fang, J., Tang, X., Yue, Z., Li, J., Qin, Y., Guan, S., Yang, Q., Wang, Y., Li, C., et al. (2024) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro61859.2024.00093 · Cited by 34 · see citing works
Fraley, C., Raftery, A. E., & Scrucca, L. (1999) · doi:10.32614/cran.package.mclust · Cited by 31 · see citing works
Noise-assisted variational quantum thermalization
Foldager, J., Pesah, A. C., & Hansen, L. K. (2022) · Scientific Reports · doi:10.1038/s41598-022-07296-z · Cited by 26 · see citing works
Antun, V., Colbrook, M. J., & Hansen, A. C. (2021) · arXiv (Cornell University) · Cited by 23 · see citing works
MIMO Radar Spectrally Compatible Waveform Design via Inequality Constrained Manifold Optimization
Zhong, K., Hu, J., Yuan, Y., Wang, Y., Teh, K. C., Pan, C., Li, H., Yu, X., & Cui, G. (2024) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2024.3435364 · Cited by 21 · see citing works
Planetary gear train microcrack detection using vibration data and convolutional neural networks
Emmanuel, S., Yihun, Y., Ahmadabadi, Z. N., & Boldsaikhan, E. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-06314-x · Cited by 20 · see citing works
Dabaghi‐Zarandi, F., Afkhami, M. M., & Ashoori, M. H. (2024) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2024.104070 · Cited by 20 · see citing works
Evaluation of Polar-Coded Noncoherent Acoustic Underwater Communication
Lidström, V. (2023) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2022.3227233 · Cited by 18 · see citing works
An Adaptive Covariance Parameterization Technique for the Ensemble Gaussian Mixture Filter
Popov, A. A., & Zanetti, R. (2024) · SIAM Journal on Scientific Computing · doi:10.1137/22m1544312 · Cited by 17 · see citing works
Haag, C., Steinemann, N., Chiavi, D., Kamm, C. P., Sieber, C., Manjaly, Z., Horváth, G., Ajdacic‐Gross, V., Puhan, M. A., & von Wyl, V. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000305 · Cited by 11 · see citing works
Liu, Z., Gokon, H., & Sekimoto, Y. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3469169 · Cited by 11 · see citing works
Multispectrally Compatible Transceiver Design for MIMO-STAP Radar and Communication Coexistence
An, D., Hu, J., Zhong, K., Liu, T., Sun, F., Tai, X., Zuo, Y., Li, H., Xiao, X., & Gini, F. (2024) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2024.3483780 · Cited by 10 · see citing works
Yuan, Y., Wang, Y., Zhong, K., Hu, J., & An, D. (2024) · IEEE Signal Processing Letters · doi:10.1109/lsp.2024.3386469 · Cited by 10 · see citing works
Edge-Device Collaborative Rendering for Wireless Multi-User Interactive Virtual Reality in Metaverse
Xu, C., Chen, Z., Tao, M., & Zhang, W. (2023) · Globecom · doi:10.1109/globecom54140.2023.10437783 · Cited by 9 · see citing works
Vision Transformer-based overlay processor for Edge Computing
Liu, F., Fan, Z., Hu, W., Xu, D. G., Peng, M., He, S., & He, Y. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111421 · Cited by 9 · see citing works
Nadachowski, P., Łubniewski, Z., Malecha-Łysakowska, A., Trzcińska, K., Wróblewski, R., & Tęgowski, J. (2024) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2024.3470253 · Cited by 9 · see citing works
Assessing correlated truncation errors in modern nucleon-nucleon potentials
Millican, P., Furnstahl, R. J., Melendez, J. A., Phillips, D. R., & Pratola, M. T. (2024) · Physical Review C · doi:10.1103/physrevc.110.044002 · Cited by 9 · see citing works
Variational Bayes estimation of hierarchical Dirichlet-multinomial mixtures for text clustering
Bilancia, M., Nanni, M. D., Manca, F., & Pio, G. (2023) · Computational Statistics · doi:10.1007/s00180-023-01350-8 · Cited by 8 · see citing works
Optimal proposal particle filters for detecting anomalies and manoeuvres from two line element data
Shorten, D., Humphries, M., Maclean, J., Yang, Y., & Roughan, M. (2024) · Acta Astronautica · doi:10.1016/j.actaastro.2024.11.033 · Cited by 7 · see citing works
Gravity.jl: Fast and accurate gravitational lens modeling in Julia
Lombardi, M. (2024) · Astronomy and Astrophysics · doi:10.1051/0004-6361/202451214 · Cited by 7 · see citing works
A Universal Accelerated Primal–Dual Method for Convex Optimization Problems
Luo, H. (2024) · Journal of Optimization Theory and Applications · doi:10.1007/s10957-024-02394-6 · Cited by 7 · see citing works
Ship Shaft Frequency Extraction Based on Improved Stacked Sparse Denoising Auto-Encoder Network
Ni, J., Zhao, M., Hu, C., Lv, G., & Guo, Z. (2022) · Applied Sciences · doi:10.3390/app12189076 · Cited by 6 · see citing works
Mechanical state estimation with a Polynomial-Chaos-Based Statistical Finite Element Method
Narouie, V. B., Wessels, H., Cirak, F., & Römer, U. (2025) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2025.117970 · Cited by 6 · see citing works
Kim, D. E., Sharma, T., & Roy, K. (2025) · IEEE transactions on circuits and systems for artificial intelligence. · doi:10.1109/tcasai.2025.3601975 · Cited by 6 · see citing works
Integration of affective cues in context-rich and dynamic scenes varies across individuals
Ortega, J., Murai, Y., & Whitney, D. C. (2025) · Nature Communications · doi:10.1038/s41467-025-67466-1 · Cited by 6 · see citing works
Takasugi, N., Kinoshita, M., Kamikawa, Y., Tsuzaki, R., Sakamoto, A., Kai, T., & Kawanami, Y. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802375 · Cited by 6 · see citing works
Super Permutation Frequency-Shift-Keyed Underwater Acoustic Communication
Lidström, V. (2023) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2023.3316706 · Cited by 6 · see citing works
Jiang, H., Wang, J., Yang, Z., Chen, C., Ge, Y., Bao, S., Wan, X., Ding, J., & Wang, L. (2024) · Research Square · doi:10.21203/rs.3.rs-3916417/v1 · Cited by 6 · see citing works
Automated Structural Bolt Micro Looseness Monitoring Method Using Deep Learning
Qin, M., Xie, Z., Xie, J. C., Yu, X., Ma, Z., & Wang, J. (2024) · Sensors · doi:10.3390/s24227340 · Cited by 5 · see citing works
Yu, Y. Y., Tian, H., Zhang, J., Li, H., & Sun, J. (2025) · Microchemical Journal · doi:10.1016/j.microc.2025.113765 · Cited by 5 · see citing works
Tivay, A., & Hahn, J. (2023) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2023.3241957 · Cited by 5 · see citing works
An Approximation Scheme for Distributionally Robust PDE-Constrained Optimization
Milz, J., & Ulbrich, M. (2022) · SIAM Journal on Control and Optimization · doi:10.1137/20m134664x · Cited by 5 · see citing works
Sagar, K., Caro, S., Padr, T., & Long, P. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3313926 · Cited by 5 · see citing works
A Logarithmic Bayesian Approach to Quantum Error Detection
Convy, I., & Whaley, K. B. (2022) · Quantum · doi:10.22331/q-2022-04-04-680 · Cited by 5 · see citing works
A Recurrent Neural Network Optimization Method for Anticipation of Hierarchical Human Activity
Khodabandelou, G., Chibani, A., Amirat, Y., & Tanimoto, S. (2024) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2023.3300821 · Cited by 4 · see citing works
CACLENS: A Multitask Deep Learning System for Enzyme Discovery
Xin, Y., Tan, Y., Lin, H., Zhang, G., Tian, Y., & Wu, A. (2025) · Advanced Science · doi:10.1002/advs.202518063 · Cited by 5 · see citing works
LN: A Flexible Algorithmic Framework for Layered Queueing Network Analysis
Casale, G., Gao, Y., Niu, Z., & Zhu, L. (2023) · ACM Transactions on Modeling and Computer Simulation · doi:10.1145/3633457 · Cited by 4 · see citing works
Deep Learning IoT Malware Analysis: Investigation and Understanding
Abdullah, M. A., Yu, Y., Cai, J., Addo, D., Bankas, E. K., Gu, Y. H., Alqahtani, A., & Al–antari, M. A. (2025) · Neural Computing and Applications · doi:10.1007/s00521-025-11365-5 · Cited by 4 · see citing works
Switching Model Stein Variational Sampling Filter for Mixed LOS/NLOS Industrial Indoor Positioning
Piavanini, M., Brambilla, M., & Nicoli, M. (2025) · IEEE Journal of Indoor and Seamless Positioning and Navigation · doi:10.1109/jispin.2025.3589958 · Cited by 4 · see citing works
An FPGA Accelerator for Genome Variant Calling
Xu, T., Rixner, S., & Cox, A. L. (2023) · ACM Transactions on Reconfigurable Technology and Systems · doi:10.1145/3595297 · Cited by 4 · see citing works
A Margin-Maximizing Fine-Grained Ensemble Method
Yuan, J., Chen, H., Luo, R., & Nie, F. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888549 · Cited by 4 · see citing works
Secure Analog Beamforming Design for Wireless Communication Systems With Movable Antennas
Xiong, W., Zhong, K., Xiao, Z., Lin, J., & Li, Q. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889986 · Cited by 4 · see citing works
Subtractive Mixture Models via Squaring: Representation and Learning
Loconte, L., Sladek, A., Mengel, S., Trapp, M., Solin, A., Gillis, N., & Vergari, A. (2023) · HAL · doi:10.48550/arxiv.2310.00724 · Cited by 4 · see citing works
Li, Q., Qi, T., & Liu, L. (2022) · Wireless Communications and Mobile Computing · doi:10.1155/2022/7774185 · Cited by 4 · see citing works
RetractedAn amortized approach to non-linear mixed-effects modeling based on neural posterior estimationPreprint
Arruda, J., Schälte, Y., Peiter, C., Teplytska, O., Jaehde, U., & Hasenauer, J. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.08.22.554273 · Cited by 4 · see citing works
Data-driven prediction of solid state reaction pathways in the synthesis of ferrites
Chen, Z., Liu, Y., Zhao, W., Xiao, Y., Li, P., Li, J., & Zhang, P. (2026) · Journal of Solid State Chemistry · doi:10.1016/j.jssc.2026.125914 · Cited by 3 · see citing works
Socially Fair Coverage Control
Malencia, M., Pappas, G. J., & Kumar, V. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160988 · Cited by 3 · see citing works
Periodic boundary conditions for bosonic path integral molecular dynamics
Higer, J., Feldman, Y. M. Y., & Hirshberg, B. (2025) · The Journal of Chemical Physics · doi:10.1063/5.0265906 · Cited by 3 · see citing works
Abdelrahman, H., Badescu, A. L., Craiu, R. V., & Lin, X. S. (2025) · Astin Bulletin · doi:10.1017/asb.2025.10056 · Cited by 3 · see citing works
Quantifying the Uncertainty of the Relative Geometry in Inertial Sensors Arrays
Carlsson, H., Skog, I., Schön, T. B., & Jaldén, J. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3090273 · Cited by 3 · see citing works
Free-Form Deformation of Parametric CAD Geometry via B-Spline Transformations
Gomez, M., Galbraith, M. C., & Haimes, R. (2023) · AIAA AVIATION Forum · doi:10.2514/6.2023-3601 · Cited by 3 · see citing works
Susanto, S., & Nanda, D. S. (2023) · IAES International Journal of Artificial Intelligence · doi:10.11591/ijai.v13.i1.pp195-200 · Cited by 3 · see citing works
MITRE Tactics Inference from Splunk Queries
Mărmureanu, M., & Oprişa, C. (2023) · IEEE International Conference on Intelligent Computer Communication and Processing (ICCP) · doi:10.1109/iccp60212.2023.10398612 · Cited by 3 · see citing works
Facilitating load-dependent queueing analysis through factorization
Casale, G., Harrison, P. G., & Ong, W. H. (2021) · Performance Evaluation · doi:10.1016/j.peva.2021.102241 · Cited by 3 · see citing works
Regulating Model Reliance on Non-robust Features by Smoothing Input Marginal Density
Yang, P., Akhtar, N., Shah, M. A., & Mian, A. S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72998-0_19 · Cited by 2 · see citing works
Differentiable neural network representation of multi-well, locally-convex potentials
Jones, R. E., Tepole, A. B., & Fuhg, J. N. (2026) · Journal of Computational Physics · doi:10.1016/j.jcp.2026.114688 · Cited by 2 · see citing works
Solanes, J. E., & Francés-Falip, A. (2026) · Mathematics · doi:10.3390/math14071188 · Cited by 2 · see citing works
Optimal control of ODEs with state suprema
Geiger, T., Wachsmuth, D., & Wachsmuth, G. (2021) · Mathematical Control and Related Fields · doi:10.3934/mcrf.2021012 · Cited by 2 · see citing works
Constrained hidden Markov models reveal further Hsp90 protein states
Tancredi, R., Feltrin, A., Infirri, G. S., Toso, S., Vollmar, L., Hugel, T., & Baiesi, M. (2024) · New Journal of Physics · doi:10.1088/1367-2630/ad5def · Cited by 2 · see citing works
Singh, T., Mrak, B., & Gillis, J. (2024) · IEEE Conference on Control Technology and Applications (CCTA) · doi:10.1109/ccta60707.2024.10666612 · Cited by 2 · see citing works
A Weighted Smooth Q-Learning Algorithm
Vijesh, A., & Shreyas, S. R. (2025) · IEEE Control Systems Letters · doi:10.1109/lcsys.2025.3551265 · Cited by 2 · see citing works
CSGO: Constrained-softassign gradient optimization for large graph matching
Shen, B., Niu, Q., & Zhu, S. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.113329 · Cited by 2 · see citing works
Accurate Goertzel Algorithm: Error Analysis, Validations and Applications
Li, C., Du, P., Li, K., Liu, Y., Jiang, H., & Quan, Z. (2022) · Mathematics · doi:10.3390/math10111788 · Cited by 2 · see citing works
Motion Prediction Of Traffic Agents With Hybrid Recurrent-Convolutional Neural Networks
Lagoutaris, V., & Μουστάκας, Κ. (2023) · IEEE International Conference on Digital Signal Processing (DSP) · doi:10.1109/dsp58604.2023.10167941 · Cited by 1 · see citing works
Domain-level relation extraction for informative taxonomy learning
Hu, M., Song, D., Qian, L., & Zhang, Z. (2025) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-024-01088-x · Cited by 1 · see citing works
Li, X., Wang, X., & Chen, S. (2025) · Science China Information Sciences · doi:10.1007/s11432-023-3979-9 · Cited by 1 · see citing works
Ghosh, A., Eldar, Y. C., & Chatterjee, S. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888810 · Cited by 1 · see citing works
Link Prediction Under Non-targeted Attacks: Do Soft Labels Always Help?
Memariani, A., Röder, M., Sharma, A., Demir, C., & Ngomo, A.-C. N. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-09527-5_6 · Cited by 2 · see citing works
Points as Tori: Fast Pointwise Signed Distance for Point Clouds
Feng, N., Gkioulekas, I., & Crane, K. (2026) · ACM Transactions on Graphics · doi:10.1145/3811385 · Cited by 1 · see citing works
Milian, O. R. R., & Oosterhuis, H. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809529 · Cited by 1 · see citing works
Dumortier, L., Chizallet, C., Creton, B., de Bruin, T. J. M., & Verstraelen, T. (2024) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.3c01009 · Cited by 1 · see citing works
Dirkx, N., Bosselaar, M., & Oomen, T. (2021) · IEEE Control Systems Letters · doi:10.1109/lcsys.2021.3133655 · Cited by 1 · see citing works
LN: A Meta-solver for Layered Queueing Network Analysis
Casale, G., Gao, Y., Niu, Z., & Zhu, L. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16336-4_12 · Cited by 1 · see citing works
Differentiable Neural Network Representation of Multi-Well, Locally-Convex PotentialsPreprint
Jones, R. E., Tepole, A. B., & Fuhg, J. N. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5350867 · Cited by 1 · see citing works
Mtetwa, J. T., Ogudo, K. A., & Pudaruth, S. (2026) · Mathematics · doi:10.3390/math14142637
Finding the Optimal Network Depth in Classification Tasks
Wójcik, B., Wołczyk, M., Bałazy, K., & Tabor, J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-67664-3_16
Accelerated Proximal Envelopes: Application to the Coordinate Descent MethodPreprint
Pasechnyuk, D. A., Anikin, A. S., & Matyukhin, V. V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.04706
On the Computational Efficiency of Catalyst Accelerated Coordinate Descent
Pasechnyuk, D. A., & Matyukhin, V. V. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77876-7_12
Accelerated Proximal Envelopes: Application to Componentwise Methods
Anikin, A. S., Matyukhin, V. V., & Pasechnyuk, D. A. (2022) · Computational Mathematics and Mathematical Physics · doi:10.1134/s0965542522020038
An FPGA Accelerator for Genome Variant Calling
Xu, T., Rixner, S., & Cox, A. L. (2022) · IEEE International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm53951.2022.9786183
Heshmati, A., Amini, S., Ghaemmaghami, S., & Marvasti, F. (2022) · IEEE Signal Processing Letters · doi:10.1109/lsp.2022.3217721
Max-convolution through numerics and tropical geometry
Brysiewicz, T., Hauenstein, J. D., & Hills, C. (2023) · Numerical Algorithms · doi:10.1007/s11075-023-01668-w
A Note on Generalized Second-Order Value Iteration in Markov Decision Processes
Vijesh, V. A., Shreyas, S. R., & Abdulla, M. S. (2023) · Journal of Optimization Theory and Applications · doi:10.1007/s10957-023-02309-x
A Multivariate Load Forecasting Method Based on ESAM-MTL Model
Wang, Y., Chen, M., Xuan, L., & Yu, J. (2023) · International Conference on Power and Renewable Energy (ICPRE) · doi:10.1109/icpre59655.2023.10353645
Enhancing Metric Learning: Addressing Inseparability with Harder Metric Learning Loss Function
Xia, L., Huang, X., Wei, H., & Ni, H. (2024) · International Conference on Power Electronics and Artificial Intelligence (PEAI) · doi:10.1145/3674225.3674368
A charge-preserving method for solving graph neural diffusion networks
Aceto, L., & Grassi, P. A. (2024) · Communications in Nonlinear Science and Numerical Simulation · doi:10.1016/j.cnsns.2024.108392
Nonlinear Simulation of Diffraction Neural Networks Integrated with Optoelectronic Synapses
卢, 嘉. (2025) · Modeling and Simulation · doi:10.12677/mos.2025.144335
Are GAFs All you Need for BCIs?
Hernandez Gomez, A., Nieto, N., O., P. M., Felix, F., & A., M. L. (2025) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi60581.2025.10981052
A model-based monitoring framework for tensor count data in passenger flow surveillance
Li, Y., Wang, Q., Wu, C., & Tsung, F. (2025) · IISE Transactions · doi:10.1080/24725854.2025.2534003
Besedin, M., Valdebenito, M. A., Zhang, X., Acevedo, C. H., Misraji, M. A., & Faes, M. G. R. (2025) · ASCE-ASME Journal of Risk and Uncertainty in Engineering Systems Part B Mechanical Engineering · doi:10.1115/1.4069174
Assessing the Quality of Binomial Samplers: A Statistical Distance Framework
Sarkar, U., Chakraborty, S., & Meel, K. S. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-98679-6_11
Spectrally compatible MIMO radar waveform design for extended target detection
Liang, R., Hu, J., Zhang, Y., An, D., Zhong, K., Liu, J., Wang, Y., & Li, H. (2025) · Signal Processing · doi:10.1016/j.sigpro.2025.110212
Distributionally robust shape and topology optimization
Dapogny, C., Prando, J., & Thibert, B. (2026) · Journal of Computational Physics · doi:10.1016/j.jcp.2026.115327
Li, Y., Feng, J., Liu, L., Shang, B., Lei, J., & Pei, Q. (2025) · IEEE Vehicular Technology Conference · doi:10.1109/vtc2025-spring65109.2025.11174309
Intelligent Group Paging for 5G IoT: A Unified DL Framework for Energy Optimization
Park, J., Park, H., Jang, J. W., & Choi, J. K. (2025) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2025.3617968
Design and accuracy trade-offs in Computational Statistics
Xu, T., Cox, A. L., & Rixner, S. (2025) · IEEE International Symposium on Workload Characterization · doi:10.1109/iiswc66894.2025.00039
Li, Y., Wang, Y., Gao, Z., & Bao, F. (2025) · ACM International Conference on Multimedia in Asia (MMAsia) · doi:10.1145/3743093.3771018
- Authors
- Blanchard, P., Higham, D. J., & Higham, N. J.
- Affiliations
- Department of Mathematics, University of Manchester, Manchester, M13 9PL, UK
- University of Edinburgh (GB)
- University of Manchester (GB)
- Corresponding author
- Higham, Nicholas J
- Venue
- IMA Journal of Numerical Analysis
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-08-19
- Volume
- 41
- Issue
- 4
- Pages
- 2311-2330
- ISSN
- 0272-4979 (ISSN-L)
- 1464-3642
- OpenAlex
- W3004059350
- Cited by
- 126
- References
- 31
- Citations by year
- 2026: 32 · 2025: 30 · 2024: 23 · 2023: 20 · 2022: 12 · 2021: 9
- FWCI
- 5.10
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- IMA Journal of Numerical Analysis (publishedVersion, cc-by)
- Research Explorer (The University of Manchester) (publishedVersion)
- MIMS EPrints (University of Southampton) (acceptedVersion)
- Funders
- Engineering and Physical Sciences Research Council (EP/P020720/1)
- MathWorks
- Royal Society
- Topics
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Numerical Methods and Algorithms
- Physical Sciences › Mathematics › Modeling and Simulation › Mathematical and Computational Methods
- Physical Sciences › Mathematics › Applied Mathematics › Mathematical functions and polynomials
- Keywords
- softmax, floating-point arithmetic, rounding error analysis, condition number, overflow and underflow, numerical accuracy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review