Heterogeneous Systolic Array Architecture for Compact CNNs Hardware Accelerators
Lists
Only you see this
Abstract
Compact convolutional neural networks have become a hot research topic. However, we find that the systolic array accelerators are extremely inefficient in dealing with compact models, especially when processing depthwise convolutional layers in the neural networks. To make systolic arrays more efficient for compact convolutional neural networks, we propose the heterogeneous systolic array (HeSA) architecture. It introduces heterogeneous processing elements that support multiple dataflows, which can further exploit the reuse data chance of depthwise convolutional layers and without changing the structure of the naïve systolic array. By increasing the utilization rate of processing elements in the array, the HeSA improves the performance, throughput, and energy efficiency compared to the standard baseline. In addition, we design the flexible buffer structure for the HeSA. Through configuring it, the HeSA can allocate bandwidth flexibly to maintaining high performance and low communication cost. Based on our evaluation with typical workloads, the HeSA improves the utilization rate of the computing resource in depthwise convolutional layers by 4.5× - 11.2× and acquires 1.6 - 3.1× total performance speedup compared to the standard systolic array architecture. In the large-scale array design, the HeSA can reduce the data traffic by 40% while maintaining the same performance as the scaling-out method. By improving the on-chip data reuse opportunities and reducing data traffic, the HeSA saves over 20% in energy consumption. Meanwhile, the area of the HeSA is basically unchanged compared to the baseline due to its simple design.
BibTeX
@article{xu2022heterogeneous,
author = {Rui Xu and Sheng Ma and Yaohua Wang and Yang Guo and Dongsheng Li and Yuran Qiao},
title = {{Heterogeneous Systolic Array Architecture for Compact CNNs Hardware Accelerators}},
journal = {IEEE Trans. Parallel Distributed Syst.},
year = {2022},
url = {https://openreview.net/forum?id=loj4D0Dr65},
}Loading related content...