glassoformer: a query-sparse transformer for post-fault power grid voltage prediction
Lists
Only you see this
Abstract
We propose GLassoformer, a novel and efficient transformer architecture leveraging group Lasso regularization to reduce the number of queries of the standard self-attention mechanism. Due to the sparsified queries, GLassoformer is more computationally efficient than the standard transformers. On the power grid post-fault voltage prediction task, GLassoformer shows remarkably better prediction than many existing benchmark algorithms in terms of accuracy and stability.
BibTeX
@inproceedings{zheng2022glassoformer,
author = {Yunling Zheng and Carson Hu and Guang Lin and Meng Yue and Bao Wang and Jack Xin},
title = {{glassoformer: a query-sparse transformer for post-fault power grid voltage prediction}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2022},
url = {https://openreview.net/forum?id=KUBnZngJMj},
}Loading related content...