Online Weight Pruning Via Adaptive Sparsity Loss
Lists
Only you see this
Abstract
Pruning neural networks has regained interest in recent years as a means to compress state-of-the-art deep neural networks and enable their deployment on resource-constrained devices. In this paper, we propose a robust sparsity controlling framework that efficiently prunes network parameters during training with minimal computational overhead. We incorporate fast mechanisms to prune individual layers and build upon these to automatically prune the entire network under a user-defined budget constraint. Key to our end-to-end network pruning approach is the formulation of an intuitive and easy-to-implement adaptive sparsity loss used to explicitly control sparsity during training, enabling efficient budget-aware optimization.
BibTeX
@inproceedings{retsinas2021online,
author = {George Retsinas and Athena Elafrou and Georgios I. Goumas and Petros Maragos},
title = {{Online Weight Pruning Via Adaptive Sparsity Loss}},
booktitle = {ICIP},
year = {2021},
url = {https://openreview.net/forum?id=Fc3Azpt7Kc},
}Loading related content...