Local Factor Analysis with Automatic Model Selection: A Comparative Study and Digits Recognition Application

Lei Shi, Lei Xu

Abstract

A further investigation is made on an adaptive local factor analysis algorithm from Bayesian Ying-Yang (BYY) harmony learning, which makes parameter learning with automatic determination of both the component number and the factor number in each component. A comparative study has been conducted on simulated data sets and several real problem data sets. The algorithm has been compared with not only a recent approach called Incremental Mixture of Factor Analysers (IMoFA) but also the conventional two-stage implementation of maximum likelihood (ML) plus model selection, namely, using the EM algorithm for parameter learning on a series candidate models, and selecting one best candidate by AIC, CAIC, and BIC. Experiments have shown that IMoFA and ML-BIC outperform ML-AIC or ML-CAIC while the BYY harmony learning considerably outperforms IMoFA and ML-BIC. Furthermore, this BYY learning algorithm has been applied to the popular MNIST database for digits recognition with a promising performance.
BibTeX
@inproceedings{shi2006local,
  author = {Lei Shi and Lei Xu},
  title = {{Local Factor Analysis with Automatic Model Selection: A Comparative Study and Digits Recognition Application}},
  booktitle = {ICANN},
  year = {2006},
  doi = {10.1007/11840930\_27},
}

Loading related content...

Figure