An Algorithm for Least-Squares Estimation of Nonlinear Parameters
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Previous article Next article An Algorithm for Least-Squares Estimation of Nonlinear ParametersDonald W. MarquardtDonald W. Marquardthttps://doi.org/10.1137/0111030PDFPDF PLUSBibTexSections ToolsAdd to favoritesExport CitationTrack CitationsEmail SectionsAbout[1] G. W. Booth, , G. E. P. Box, , M. E. Muller and , T. I. Peterson, Forecasting by Generalized Regression Methods, Nonlinear Estimation (Princeton—IBM), Mimeo. (IBM Share Program No. 687 WL NL1), International Business Machines Corp., 1959 Google Scholar[2] G. E. P. Box and , G. A. Coutie, Application of digital computers in the exploration of functional relationships, Proc. Inst. Elec. Engrs. B, 103 (1957), 100–107 MR0094906 Google Scholar[3] Haskell B. Curry, The method of steepest descent for non-linear minimization problems, Quart. Appl. Math., 2 (1944), 258–261 MR0010667 0061.26801 CrossrefGoogle Scholar[4] H. O. Hartley, The modified Gauss-Newton method for the fitting of non-linear regression functions by least squares, Technometrics, 3 (1961), 269–280 MR0124117 0096.34603 CrossrefISIGoogle Scholar[5] D. W. Marquardt, , Chem. Eng. Progr., 55 (1959), 65–70 Google Scholar[6] D. W. Marquardt, , R. G. Bennett and , E. J. Burrell, , Jour. Molec. Spectroscopy, 7 (1961), 269–279 10.1016/0022-2852(61)90360-5 CrossrefISIGoogle Scholar[7] D. D. Morrison, Methods for nonlinear least squares problems and convergence proofs, Tracking Programs and Orbit Determination, Proc. Jet Propulsion Laboratory Seminar, 1960, 1–9 Google Scholar[8] Kenneth Levenberg, A method for the solution of certain non-linear problems in least squares, Quart. Appl. Math., 2 (1944), 164–168 MR0010666 0063.03501 CrossrefGoogle Scholar Previous article Next article FiguresRelatedReferencesCited ByDetails Shadowing-Based Data Assimilation Method for Partially Observed ModelsBart M. de Leeuw and Svetlana DubinkinaSIAM Journal on Applied Dynamical Systems, Vol. 21, No. 2 | 11 April 2022AbstractPDF (2268 KB)Localized Sensitivity Analysis at High-Curvature Boundary Points of Reconstructing Inclusions in Transmission ProblemsHabib Ammari, Yat Tin Chow, and Hongyu LiuSIAM Journal on Mathematical Analysis, Vol. 54, No. 2 | 9 March 2022AbstractPDF (829 KB)A Stochastic Levenberg--Marquardt Method Using Random Models with Complexity ResultsEl Houcine Bergou, Youssef Diouane, Vyacheslav Kungurtsev, and Clément W. RoyerSIAM/ASA Journal on Uncertainty Quantification, Vol. 10, No. 1 | 29 March 2022AbstractPDF (616 KB)Derivative-Free Bayesian Inversion Using Multiscale DynamicsG. A. Pavliotis, A. M. Stuart, and U. VaesSIAM Journal on Applied Dynamical Systems, Vol. 21, No. 1 | 24 January 2022AbstractPDF (2356 KB)Convergence of Newton-MR under Inexact Hessian InformationYang Liu and Fred RoostaSIAM Journal on Optimization, Vol. 31, No. 1 | 7 January 2021AbstractPDF (3140 KB)A Nonmonotone Matrix-Free Algorithm for Nonlinear Equality-Constrained Least-Squares ProblemsEl Houcine Bergou, Youssef Diouane, Vyacheslav Kungurtsev, and Clément W. RoyerSIAM Journal on Scientific Computing, Vol. 43, No. 5 | 13 September 2021AbstractPDF (951 KB)Random Sampling from Joint Probability Distributions Defined in a Bayesian FrameworkThierry A. Mara, Marwan Fahs, Qian Shao, and Anis YounesSIAM Journal on Scientific Computing, Vol. 41, No. 1 | 15 January 2019AbstractPDF (5620 KB)On the Quadratic Convergence of the Cubic Regularization Method under a Local Error Bound ConditionMan-Chung Yue, Zirui Zhou, and Anthony Man-Cho SoSIAM Journal on Optimization, Vol. 29, No. 1 | 28 March 2019AbstractPDF (621 KB)The Conjugate Residual Method in Linesearch and Trust-Region MethodsMarie-Ange Dahito and Dominique OrbanSIAM Journal on Optimization, Vol. 29, No. 3 | 25 July 2019AbstractPDF (977 KB)Variable Projection Methods for an Optimized Dynamic Mode DecompositionTravis Askham and J. Nathan KutzSIAM Journal on Applied Dynamical Systems, Vol. 17, No. 1 | 1 February 2018AbstractPDF (1906 KB)A Duality-Based Optimization Approach for Model Adaptivity in Heterogeneous Multiscale ProblemsMatthias Maier and Rolf RannacherMultiscale Modeling & Simulation, Vol. 16, No. 1 | 1 March 2018AbstractPDF (4572 KB)Iterative Importance Sampling Algorithms for Parameter EstimationMatthias Morzfeld, Marcus S. Day, Ray W. Grout, George Shu Heng Pau, Stefan A. Finsterle, and John B. BellSIAM Journal on Scientific Computing, Vol. 40, No. 2 | 1 March 2018AbstractPDF (1644 KB)Newton Correction Methods for Computing Real Eigenpairs of Symmetric TensorsAriel Jaffe, Roi Weiss, and Boaz NadlerSIAM Journal on Matrix Analysis and Applications, Vol. 39, No. 3 | 3 July 2018AbstractPDF (1076 KB)Survey of Multifidelity Methods in Uncertainty Propagation, Inference, and OptimizationBenjamin Peherstorfer, Karen Willcox, and Max GunzburgerSIAM Review, Vol. 60, No. 3 | 8 August 2018AbstractPDF (825 KB)The Use of Quadratic Regularization with a Cubic Descent Condition for Unconstrained OptimizationE. G. Birgin and J. M. MartínezSIAM Journal on Optimization, Vol. 27, No. 2
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The result of these tests are reported in Fig. 13a, b, which shows that the Scaled Conjugate Gradient and the Levenberg-Marquardt learning algorithms176 provide the highest accuracy”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [176]
In the citing paper
“other methods are the Levenberg-Marquardt176 (uses the Jacobian matrix instead of the Hessian Matrix), Resilient Backpropagation177 and One Step Secant178, but these are more demanding from a computational point of view.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [176]
In the citing paper
“Parameter estimation was performed on a digital computer (IBM 370/168, IBM Corp., White Plains, N. Y.) using a nonlinear least squares technique (17), and accuracy of the parameter estimates was evaluated using the covariance matrix (18).”
Citations
Cites
A method for the solution of certain non-linear problems in least squares
Levenberg, K. (1944) · Quarterly of Applied Mathematics · doi:10.1090/qam/10666 · Cited by 12,359
The Modified Gauss-Newton Method for the Fitting of Non-Linear Regression Functions by Least Squares
Hartley, H. O. (1961) · Technometrics · doi:10.1080/00401706.1961.10489945 · Cited by 845
The method of steepest descent for non-linear minimization problems
Curry, H. B. (1944) · Quarterly of Applied Mathematics · doi:10.1090/qam/10667 · Cited by 437
Least squares analysis of electron paramagnetic resonance spectra
Marquardt, D. W., Bennett, R. G., & Burrell, E. J. (1961) · Journal of Molecular Spectroscopy · doi:10.1016/0022-2852(61)90360-5 · Cited by 89
Self-citation
Research works printed but not linked: 4
- Booth G. W., 1959, Forecasting by Generalized Regression Methods, Nonlinear Estimation (Princeton—IBM)
- Box G. E. P., 1957, Proc. Inst. Elec. Engrs. B, 103, 100
- Marquardt D. W., 1959, Chem. Eng. Progr., 55, 65
- D. D. Morrison, Methods for nonlinear least squares problems and convergence proofs, Tracking Programs and Orbit Determination, Proc. Jet Propulsion Laboratory Seminar, 1960, 1–9
Cited by
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Insights into the modeling of adsorption isotherm systems
Foo, K. Y., & Hameed, B. H. (2010) · Chemical Engineering Journal · doi:10.1016/j.cej.2009.09.013 · Cited by 8,479
Training feedforward networks with the Marquardt algorithm
Hagan, M. T., & Menhaj, M. B. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.329697 · Cited by 7,701
The Levenberg-Marquardt algorithm: Implementation and theory
Moré, J. J. (1978) · Lecture Notes in Mathematics · doi:10.1007/bfb0067700 · Cited by 5,773
OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Hidalgo, G., Simon, T., Wei, S.-E., & Sheikh, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2929257 · Cited by 5,536
Metadata
- Authors
- Marquardt, D. W.
- Corresponding author
- Marquardt, Donald W.
- Venue
- Journal of the Society for Industrial and Applied Mathematics
- Published
- 1963-06
- Volume
- 11
- Issue
- 2
- Pages
- 431-441
- ISSN
- 0368-4245 (ISSN-L)
- 2168-3484
- OpenAlex
- W2087070363
- Cited by
- 30,728
- References
- 4
- Citations by year
- 2026: 619 · 2025: 784 · 2024: 835 · 2023: 964 · 2022: 1007 · 2021: 1175 · 2020: 1233 · 2019: 1173 · 2018: 1112 · 2017: 1128 · 2016: 1080 · 2015: 1010 · 2014: 1039 · 2013: 1019 · 2012: 966
- FWCI
- 17.68
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the Society for Industrial and Applied Mathematics (publishedVersion)
- SIAM Journal on Applied Mathematics
- Topics
- Physical Sciences › Mathematics › Applied Mathematics › Statistical and numerical algorithms
- Physical Sciences › Mathematics › Numerical Analysis › Advanced Optimization Algorithms Research
- Physical Sciences › Mathematics › Numerical Analysis › Iterative Methods for Nonlinear Equations
- Keywords
- nonlinear least squares, parameter estimation, Levenberg-Marquardt algorithm, Gauss-Newton method, gradient descent, convergence, nonlinear regression, curve fitting, computational efficiency, stopping rules
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An Algorithm for Least-Squares Estimation of Nonlinear Parameters. https://app.cochat.ai/papers/10.1137/0111030
- The paper
- Marquardt, D. W. (1963). An Algorithm for Least-Squares Estimation of Nonlinear Parameters. Journal of the Society for Industrial and Applied Mathematics. https://doi.org/10.1137/0111030
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.