D4L: Decentralized Dynamic Discriminative Dictionary Learning
Lists
Only you see this
Abstract
We consider discriminative dictionary learning in a distributed online setting, where a network of agents aims to learn, from sequential observations, statistical model parameters jointly with data-driven signal representations. We formulate this problem as a distributed stochastic program with a nonconvex objective that quantifies the merit of the choice of model parameters and dictionary. We consider the use of a block variant of the Arrow-Hurwicz saddle point algorithm to solve this problem, which exploits factorization properties of the Lagrangian to yield a protocol in that only requires exchange of model information among neighboring nodes. We show that decisions made with this saddle point algorithm asymptotically achieve a first-order stationarity condition on average. The learning rate depends on the signal source, network structure, and discriminative task. We illustrate the algorithm performance for solving a large-scale image classification task on a network of interconnected servers and observe that practical performance is comparable to a centralized approach. We further apply this method to the problem of a robotic team seeking to autonomously navigate in an unknown environment by predicting unexpected maneuvers, demonstrating the proposed algorithm's utility in a field setting.
BibTeX
@inproceedings{koppel2015d,
author = {Alec Koppel and Garrett Warnell and Ethan Stump and Alejandro Ribeiro},
title = {{D4L: Decentralized Dynamic Discriminative Dictionary Learning}},
booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems},
year = {2015},
doi = {10.1109/iros.2015.7353786},
}