Robust regression using sparse learning for high dimensional parameter estimation problems

Kaushik Mitra, Ashok Veeraraghavan, Rama Chellappa

Abstract

Algorithms such as Least Median of Squares (LMedS) and Random Sample Consensus (RANSAC) have been very successful for low-dimensional robust regression problems. However, the combinatorial nature of these algorithms makes them practically unusable for high-dimensional applications. In this paper, we introduce algorithms that have cubic time complexity in the dimension of the problem, which make them computationally efficient for high-dimensional problems. We formulate the robust regression problem by projecting the dependent variable onto the null space of the independent variables which receives significant contributions only from the outliers. We then identify the outliers using sparse representation/learning based algorithms. Under certain conditions, that follow from the theory of sparse representation, these polynomial algorithms can accurately solve the robust regression problem which is, in general, a combinatorial problem. We present experimental results that demonstrate the efficacy of the proposed algorithms. We also analyze the intrinsic parameter space of robust regression and identify an efficient and accurate class of algorithms for different operating conditions. An application to facial age estimation is presented.
BibTeX
@inproceedings{mitra2010robust,
  author = {Kaushik Mitra and Ashok Veeraraghavan and Rama Chellappa},
  title = {{Robust regression using sparse learning for high dimensional parameter estimation problems}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2010},
  doi = {10.1109/icassp.2010.5495830},
}

Loading related content...

Figure