Accuracy and Stability of Numerical Algorithms: Second Edition
Abstract
From the Publisher: What is the most accurate way to sum floating point numbers? What are the advantages of IEEE arithmetic? How accurate is Gaussian elimination and what were the key breakthroughs in the development of error analysis for the method? The answers to these and many related questions are included here. This book gives a thorough, up-to-date treatment of the behavior of numerical algorithms in finite precision arithmetic. It combines algorithmic derivations, perturbation theory, and rounding error analysis. Software practicalities are emphasized throughout, with particular reference to LAPACK and MATLAB. The best available error bounds, some of them new, are presented in a unified format with a minimum of jargon. Because of its central role in revealing problem sensitivity and providing error bounds, perturbation theory is treated in detail. Historical perspective and insight are given, with particular reference to the fundamental work of Wilkinson and Turing, and the many quotations provide further information in an accessible format. The book is unique in that algorithmic developments and motivations are given succinctly and implementation details minimized, so that attention can be concentrated on accuracy and stability results. Here, in one place and in a unified notation, is error analysis for most of the standard algorithms in matrix computations. Not since Wilkinson's Rounding Errors in Algebraic Processes (1963) and The Algebraic Eigenvalue Problem (1965) has any volume treated this subject in such depth. A number of topics are treated that are not usually covered in numerical analysis textbooks, including floating point summation, block LU factorization, condition number estimation, the Sylvester equation, powers of matrices, finite precision behavior of stationary iterative methods, Vandermonde systems, and fast matrix multiplication. Although not designed specifically as a textbook, this volume is a suitable reference for an advanced course, and could be used by instructors at all levels as a supplementary text from which to draw examples, historical perspective, statements of results, and exercises (many of which have never before appeared in textbooks). The book is designed to be a comprehensive reference and its bibliography contains more than 1100 references from the research literature. Audience Specialists in numerical analysis as well as computational scientists and engineers concerned about the accuracy of their results will benefit from this book. Much of the book can be understood with only a basic grounding in numerical analysis and linear algebra. About the Author Nicholas J. Higham is a Professor of Applied Mathematics at the University of Manchester, England. He is the author of more than 40 publications and is a member of the editorial boards of the SIAM Journal on Matrix Analysis and Applications and the IMA Journal of Numerical Analysis. His book Handbook of Writing for the Mathematical Sciences was published by SIAM in 1993.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the diffuse regime, a number m(L)→∞ of singular values of A_std(L) lie below any fixed threshold, so σ_min(A_std)→0 and the small singular values are a genuine feature of the matrix, not of the arithmetic; for any precision p with unit roundoff ε_p, the computed and exact σ_min agree up to additive O(ε_p), so whenever the true σ_min already lies below ε_mach σ1 it does so in every higher prec
“Lemma 4 (The condition number is intrinsically ill-posed) . In the diffuse regime (Definition 2), by Lemma 2, a number m ( L ) → ∞ of the singular values of A std ( L ) lie below any fixed threshold, so σ min ( A std ) → 0 and the small singular values are a genuine feature of the matrix, not of the arithmetic: for any precision p with unit roundoff ε p , the computed ̂ σ min and the exact σ min”
From Curvature-Corrected Rotary Position Embeddings: An Entropy-Invariant Temperature for Mitigating Numerical-Rank Collapse in Long-Context Attention (2026) · cites this paper as [32]
For a backward-stable evaluation of Y=AV, the standard perturbation bound of numerical linear algebra gives a relative forward error bounded by κ(A) times the input perturbation, so a condition number κ corresponds to a worst-case loss of about log10 κ significant decimal digits.
“For a backward-stable evaluation, the standard perturbation bound of numerical linear algebra [32,33] gives a relative forward error”
From Curvature-Corrected Rotary Position Embeddings: An Entropy-Invariant Temperature for Mitigating Numerical-Rank Collapse in Long-Context Attention (2026) · cites this paper as [32]
Cites
Rounding errors in algebraic processes
Wilkinson, J. H. (1964) · Journal of the Franklin Institute · doi:10.1016/0016-0032(64)90390-4 · Cited by 1,326 · see citing works
Stewart, G. W. (1985) · ACM Transactions on Mathematical Software · doi:10.1145/214408.214414 · Cited by 29 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Memory devices and applications for in-memory computing
Sebastian, A., Le Gallo, M., Khaddam-Aljameh, R., & Eleftheriou, E. (2020) · Nature Nanotechnology · doi:10.1038/s41565-020-0655-z · Cited by 2,289 · see citing works
Mixed-precision in-memory computing
Le Gallo, M., Sebastian, A., Mathis, R., Manica, M., Giefers, H., Tuma, T., Bekas, C., Curioni, A., & Eleftheriou, E. (2018) · Nature Electronics · doi:10.1038/s41928-018-0054-8 · Cited by 485 · see citing works
A framework of space–time continuous models for algorithm design in swarm robotics
Hamann, H., & Wörn, H. (2008) · Swarm Intelligence · doi:10.1007/s11721-008-0015-3 · Cited by 134 · see citing works
Accurately computing the log-sum-exp and softmax functions
Blanchard, P., Higham, D. J., & Higham, N. J. (2021) · IMA Journal of Numerical Analysis · doi:10.1093/imanum/draa038 · Cited by 126 · see citing works
Perera, S. M., Ariyarathna, V., Udayanga, N., Madanayake, A., Wu, G., Belostotski, L., Wang, Y., Mandal, S., Cintra, R. J., & Rappaport, T. S. (2018) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2018.2822940 · Cited by 50 · see citing works
A fast method to diagonalize a Hankel matrix
Boley, D. L., Luk, F. T., & Vandevoorde, D. (1998) · Linear Algebra and its Applications · doi:10.1016/s0024-3795(98)10101-5 · Cited by 17 · see citing works
Efficient and Self-Recursive Delay Vandermonde Algorithm for Multi-beam Antenna Arrays
Perera, S. M., Madanayake, A., & Cintra, R. J. (2020) · IEEE Open Journal of Signal Processing · doi:10.1109/ojsp.2020.2991586 · Cited by 15 · see citing works
Mtetwa, J. T., Ogudo, K. A., & Pudaruth, S. (2026) · Mathematics · doi:10.3390/math14142637
- Authors
- Higham, N. J.
- Affiliations
- University of Manchester (GB)
- Corresponding author
- Higham, Nicholas J.
- ORCID
- Higham, Nicholas J.
- Venue
- Society for Industrial and Applied Mathematics eBooks
- Published
- 2002-01-01
- OpenAlex
- W2020804487
- Cited by
- 3,803
- References
- 2
- Citations by year
- 2026: 167 · 2025: 200 · 2024: 190 · 2023: 168 · 2022: 156 · 2021: 166 · 2020: 187 · 2019: 136 · 2018: 163 · 2017: 177 · 2016: 146 · 2015: 173 · 2014: 160 · 2013: 153 · 2012: 127
- FWCI
- 26.78
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- Society for Industrial and Applied Mathematics eBooks (publishedVersion)
- Research Explorer (The University of Manchester) (publishedVersion)
- MIMS EPrints (University of Southampton) (acceptedVersion)
- Topics
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Numerical Methods and Algorithms
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Matrix Theory and Algorithms
- Physical Sciences › Mathematics › Modeling and Simulation › Mathematical and Computational Methods
- Keywords
- numerical accuracy, numerical stability, finite precision arithmetic, rounding error analysis, perturbation theory, floating-point summation, Gaussian elimination, error bounds, condition number estimation, Sylvester equation, matrix powers, stationary iterative methods, Vandermonde systems, fast matrix multiplication, block LU factorization, LAPACK, MATLAB, Turing, numerical linear algebra, algorithm analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review