Computing the Conditioning of the Components of a Linear Least Squares Solution
Lists
Only you see this
Abstract
In this paper, we address the accuracy of the results for the overdetermined full rank linear least squares problem. We recall theoretical results obtained in Arioli, Baboulin and Gratton, SIMAX 29(2):413--433, 2007, on conditioning of the least squares solution and the components of the solution when the matrix perturbations are measured in Frobenius or spectral norms. Then we define computable estimates for these condition numbers and we interpret them in terms of statistical quantities. In particular, we show that, in the classical linear statistical model, the ratio of the variance of one component of the solution by the variance of the right-hand side is exactly the condition number of this solution component when perturbations on the right-hand side are considered. We also provide fragment codes using LAPACK routines to compute the variance-covariance matrix and the least squares conditioning and we give the corresponding computational cost. Finally we present a small historical numerical example that was used by Laplace in Theorie Analytique des Probabilites, 1820, for computing the mass of Jupiter and experiments from the space industry with real physical data.
BibTeX
@misc{baboulin2007computing,
author = {Marc Baboulin and Jack Dongarra and Serge Gratton and Julien Langou},
title = {{Computing the Conditioning of the Components of a Linear Least Squares Solution}},
year = {2007},
eprint = {0710.0829},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/0710.0829},
}| A Contribution to the Conditioning of the Total Least-Squares Problem | arXiv · 2010 |
| Numerical methods for solving linear least squares problems | Applications of Mathematics · 1965 |
| Linear least squares solutions by householder transformations | Numerische Mathematik · 1965 |
| LSQR: An Algorithm for Sparse Linear Equations and Sparse Least Squares | ACM Transactions on Mathematical Software · 1982 |
| Backward errors and small-sample condition estimation for ⋆-Sylveter equations | arXiv · 2016 |
| Are Sketch-and-Precondition Least Squares Solvers Numerically Stable? | arXiv · 2023 |