The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
The Differentiation of Pseudo-Inverses and Nonlinear Least Squares Problems Whose Variables Separate
Abstract
For given data $(t_i ,y_i ),i = 1, \cdots ,m$, we consider the least squares fit of nonlinear models of the form \[ \eta ({\bf a},{\boldsymbol \alpha} ;t) = \sum _{j = 1}^n {a_j \varphi _j ({\boldsymbol \alpha} ;t),\qquad {\bf a} \in \mathcal{R}^n ,\qquad {\boldsymbol \alpha} \in \mathcal{R}^k .} \] For this purpose we study the minimization of the nonlinear functional \[ r({\bf a},{\boldsymbol \alpha} ) = \sum\limits_{i = 1}^m {\left( {y_i - \eta \left( {{\bf a},{\boldsymbol \alpha} ,t_i } \right)} \right)^2 } . \] It is shown that by defining the matrix $\{ {\bf \Phi} ({\boldsymbol \alpha} )\} _{i,j} = \varphi _j ({\boldsymbol \alpha} ;t_i )$, and the modified functional $r_2 ({\boldsymbol \alpha} ) = \| {\bf y} - {\bf \Phi} ({\boldsymbol \alpha} ){\bf \Phi} ^ + ({\boldsymbol \alpha} ){\bf y} \|_2^2 $, it is possible to optimize first with respect to the parameters ${\boldsymbol \alpha} $, and then to obtain, a posteriors, the optimal parameters $\bf {\hat a}$. The matrix ${\bf \Phi} ^ + ({\boldsymbol{\alpha}} )$ is the Moore–Penrose generalized inverse of ${\bf \Phi} ({\boldsymbol{\alpha}} )$. We develop formulas for the Frechet derivative of orthogonal projectors associated with ${\bf \Phi} ({\boldsymbol{\alpha}} )$ and also for ${\bf \Phi} ^ + ({\boldsymbol{\alpha}} )$, under the hypothesis that ${\bf \Phi} ({\boldsymbol{\alpha}} )$ is of constant (though not necessarily full) rank. Detailed algorithms are presented which make extensive use of well-known reliable linear least squares techniques, and numerical results and comparisons are given. These results are generalizations of those of H. D. Scolnik [20] and Guttman, Pereyra and Scolnik [9].
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Foundations of Modern Analysis
(1969) · Pure and Applied Mathematics · doi:10.1016/s0079-8169(08)x6009-x · Cited by 3,372
Generalized Inverse of Matrices and Its Applications
Mayne, A. J., Rao, C. R., & Mitra, S. K. (1972) · Operational Research Quarterly (1970-1977) · doi:10.2307/3007981 · Cited by 817
Perturbation bounds in connection with singular value decomposition
Wedin, P.-Å. (1972) · BIT · doi:10.1007/bf01932678 · Cited by 460
Comparison of Gradient Methods for the Solution of Nonlinear Parameter Estimation Problems
Bard, Y. (1970) · SIAM Journal on Numerical Analysis · doi:10.1137/0707011 · Cited by 267
The Approximate Minimization of Functionals
G., D., & Daniel, J. W. (1972) · Mathematics of Computation · doi:10.2307/2005894 · Cited by 178
Extensions and applications of the Householder algorithm for solving linear least squares problems
Hanson, R. J., & Lawson, C. L. (1969) · Mathematics of Computation · doi:10.1090/s0025-5718-1969-0258258-9 · Cited by 158
Elimination of Linear Parameters in Nonlinear Regression
Lawton, W. H., & Sylvestre, E. A. (1971) · Technometrics · doi:10.1080/00401706.1971.10488810 · Cited by 146
Note on the iterative refinement of least squares solution
Golub, G. H., & Wilkinson, J. H. (1966) · Numerische Mathematik · doi:10.1007/bf02166032 · Cited by 112
Self-citationA Class of Methods for Nonlinear Programming II Computational Experience
Fletcher, R., & LILL, S. A. (1970) · Elsevier eBooks · doi:10.1016/b978-0-12-597050-1.50007-5 · Cited by 64
Least Squares Estimation for a Class of Non-Linear Models
Guttman, I., Pereyra, V. L., & Scolnik, H. D. (1973) · Technometrics · doi:10.1080/00401706.1973.10489035 · Cited by 35
Self-citation
Cited by
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
ESPRIT-estimation of signal parameters via rotational invariance techniques
Roy, R., & Kailath, T. (1989) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/29.32276 · Cited by 7,289
Global and target analysis of time-resolved spectra
van Stokkum, I. H. M., Larsen, D. S., & van Grondelle, R. (2004) · Biochimica et Biophysica Acta (BBA) - Bioenergetics · doi:10.1016/j.bbabio.2004.04.011 · Cited by 1,752
Baillet, S., Mosher, J. C., & Leahy, R. M. (2001) · IEEE Signal Processing Magazine · doi:10.1109/79.962275 · Cited by 1,692
Improved Method for Accurate and Efficient Quantification of MRS Data with Use of Prior Knowledge
Vanhamme, L., van den Boogaart, A., & Van Huffel, S. (1997) · Journal of Magnetic Resonance · doi:10.1006/jmre.1997.1244 · Cited by 1,627
Tsai, C.-L., & Gallant, A. R. (1989) · Journal of the American Statistical Association · doi:10.2307/2289891 · Cited by 1,086
Multiple dipole modeling and localization from spatio-temporal MEG data
Mosher, J. C., Lewis, P. S., & Leahy, R. M. (1992) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.141192 · Cited by 1,048
Program system for analysing positron lifetime spectra and angular correlation curves
Kirkegaard, P., Eldrup, M., Mogensen, O. E., & Pedersen, N. J. (1981) · Computer Physics Communications · doi:10.1016/0010-4655(81)90006-0 · Cited by 1,033
Least-squares fitting of circles and ellipses
Gander, W., Golub, G. H., & Strebel, R. (1994) · BIT · doi:10.1007/bf01934268 · Cited by 860
Self-citationGallant, A. R. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316719 · Cited by 803
Exact maximum likelihood parameter estimation of superimposed exponential signals in noise
Bresler, Y., & Macovski, A. (1986) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1986.1164949 · Cited by 767
Separable nonlinear least squares: the variable projection method and its applications
Golub, G., & Pereyra, V. (2003) · Inverse Problems · doi:10.1088/0266-5611/19/2/201 · Cited by 760
Self-citationSensor array processing based on subspace fitting
Viberg, M., & Ottersten, B. (1991) · IEEE Transactions on Signal Processing · doi:10.1109/78.80966 · Cited by 705
Exponential analysis in physical phenomena
Istratov, A. A., & Vyvenko, O. F. (1999) · Review of Scientific Instruments · doi:10.1063/1.1149581 · Cited by 615
[8] Singular value decomposition: Application to analysis of experimental data
(1992) · Methods in Enzymology · doi:10.1016/0076-6879(92)10010-b · Cited by 607
ON ESTIMATING THRESHOLDS IN AUTOREGRESSIVE MODELS
Chan, K. S., & Tong, H. (1986) · Journal of Time Series Analysis · doi:10.1111/j.1467-9892.1986.tb00501.x · Cited by 561
Gampp, H., Maeder, M., Meyer, C. J., & Zuberbühler, A. D. (1985) · Talanta · doi:10.1016/0039-9140(85)80035-7 · Cited by 526
Detection and estimation in sensor arrays using weighted subspace fitting
Viberg, M., Ottersten, B., & Kailath, T. (1991) · IEEE Transactions on Signal Processing · doi:10.1109/78.97999 · Cited by 512
Low-Rank Matrix Completion by Riemannian Optimization
Vandereycken, B. (2013) · SIAM Journal on Optimization · doi:10.1137/110845768 · Cited by 491
Calculation of equilibrium constants from multiwavelength spectroscopic data—II32, 95.
Gampp, H., Maeder, M., Meyer, C. J., & Zuberbu¨hler, A. D. (1985) · Talanta · doi:10.1016/0039-9140(85)80077-1 · Cited by 484
The conductivity of the human skull: results of in vivo and in vitro measurements
Oostendorp, T. F., Delbeke, J., & Stegeman, D. F. (2000) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2000.880100 · Cited by 467
Data-driven operator inference for nonintrusive projection-based model reduction
Peherstorfer, B., & Willcox, K. (2016) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2016.03.025 · Cited by 452
Nonlinear least-squares fitting of multivariate absorption data
Maeder, M., & Zuberbuehler, A. D. (1990) · Analytical Chemistry · doi:10.1021/ac00219a013 · Cited by 430
On the Perturbation of Pseudo-Inverses, Projections and Linear Least Squares Problems
Stewart, G. W. (1977) · SIAM Review · doi:10.1137/1019104 · Cited by 416
Blind equalization and multiuser detection in dispersive CDMA channels
Wang, X., & Poor, H. V. (1998) · IEEE Transactions on Communications · doi:10.1109/26.655407 · Cited by 391
[2] Global analysis of biochemical and biophysical data
Beechem, J. M. (1992) · Methods in Enzymology · doi:10.1016/0076-6879(92)10004-w · Cited by 378
Ottersten, B., Viberg, M., Stoica, P., & Nehorai, A. (1993) · Springer Series in Information Sciences · doi:10.1007/978-3-642-77347-1_4 · Cited by 365
van der Veen, J. W. C., de Beer, R., Luyten, P. R., & van Ormondt, D. (1988) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910060111 · Cited by 363
Recursive MUSIC: A framework for EEG and MEG source localization
Mosher, J. C., & Leahy, R. M. (1998) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.725331 · Cited by 362
The singularity expansion method and its application to target identification
Baum, C. E., Rothwell, E. J., Chen, K.-M., & Nyquist, D. P. (1991) · Proceedings of the IEEE · doi:10.1109/5.104223 · Cited by 358
SVD-based quantification of magnetic resonance signals
Pijnappel, W. W. F., van den Boogaart, A., de Beer, R., & van Ormondt, D. (1992) · Journal of Magnetic Resonance (1969) · doi:10.1016/0022-2364(92)90241-x · Cited by 350
Perturbation theory for pseudo-inverses
Wedin, P.-Å. (1973) · BIT · doi:10.1007/bf01933494 · Cited by 346
Cramér–Rao bounds: an evaluation tool for quantitation
Cavassila, S., Deval, S., Huegen, C., van Ormondt, D., & Graveron‐Demilly, D. (2001) · NMR in Biomedicine · doi:10.1002/nbm.701 · Cited by 331
Algorithm 611: Subroutines for Unconstrained Minimization Using a Model/Trust-Region Approach
Gay, D. M. (1983) · ACM Transactions on Mathematical Software · doi:10.1145/356056.356066 · Cited by 322
Björck, Å. (1990) · Handbook of Numerical Analysis · doi:10.1016/s1570-8659(05)80036-5 · Cited by 313
Lower Rank Approximation of Matrices by Least Squares With Any Choice of Weights
Gabriel, K. R., & Zamir, S. (1979) · Technometrics · doi:10.1080/00401706.1979.10489819 · Cited by 295
The Signal Extraction Approach to Nonlinear Regression and Spline Smoothing
Wecker, W. E., & Ansley, C. F. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477935 · Cited by 295
Algorithms for Separable Nonlinear Least Squares Problems
Ruhe, A., & Wedin, P. Å. (1980) · SIAM Review · doi:10.1137/1022057 · Cited by 284
Clustering-Based Denoising With Locally Learned Dictionaries
Chatterjee, P., & Milanfar, P. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2018575 · Cited by 280
A spline least squares method for numerical parameter estimation in differential equations
Varah, J. M. (1982) · SIAM Journal on Scientific and Statistical Computing · doi:10.1137/0903003 · Cited by 274
SALA, E., ROCA, J., MARRADES, R. M., ALONSO, J., GONZALEZ de SUSO, J. M., MORENO, A., BARBERÁ, J. A., NADAL, J., de JOVER, L., RODRIGUEZ-ROISIN, R., et al. (1999) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/ajrccm.159.6.9804136 · Cited by 272
Pfefferbaum, A., Adalsteinsson, E., Spielman, D., Sullivan, E. V., & Lim, K. O. (1999) · Magnetic Resonance in Medicine · doi:10.1002/(sici)1522-2594(199902)41:2<276::aid-mrm10>3.0.co;2-8 · Cited by 268
Gupta, N., & Mehra, R. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100714 · Cited by 264
Trimmed constrained mixed effects models: formulations and algorithms
Zheng, P., Barber, R., Sorensen, R. J. D., Murray, C. J. L., & Aravkin, A. Y. (2021) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2020.1868303 · Cited by 174
Privacy-Encoded Federated Learning Against Gradient-Based Data Reconstruction Attacks
Liu, H., Li, B., Gao, C., Xie, P., & Zhao, C. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3309095 · Cited by 27
Exploiting the Separable Structure of SLAM
Khosoussi, K., Huang, S., & Dissanayake, G. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.023 · Cited by 14
“This approach is similar to Golub and Pereyra’s VP [12], but with numerical differentiation and Newton iterations.”
BackgroundMethodInfluential
Metadata
- Authors
- Golub, G. H., & Pereyra, V.
- Venue
- SIAM Journal on Numerical Analysis
- Published
- 1973-04
- Volume
- 10
- Issue
- 2
- Pages
- 413-432
- ISSN
- 0036-1429 (ISSN-L)
- 1095-7170
- OpenAlex
- W2018089423
- Cited by
- 1,430
- References
- 10
- FWCI
- 11.91
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.