Core Placement Optimization for Multi-chip Many-core Neural Network Systems with Reinforcement Learning

Nan Wu, Lei Deng, Guoqi Li, Yuan XieACM Trans. Design Autom. Electr. Syst 2021 · OpenReview

Abstract

Multi-chip many-core neural network systems are capable of providing high parallelism benefited from decentralized execution, and they can be scaled to very large systems with reasonable fabrication costs. As multi-chip many-core systems scale up, communication latency related effects will take a more important portion in the system performance. While previous work mainly focuses on the core placement within a single chip, there are two principal issues still unresolved: the communication-related problems caused by the non-uniform, hierarchical on/off-chip communication capability in multi-chip systems, and the scalability of these heuristic-based approaches in a factorially growing search space. To this end, we propose a reinforcement-learning-based method to automatically optimize core placement through deep deterministic policy gradient, taking into account information of the environment by performing a series of trials (i.e., placements) and using convolutional neural networks to extract spatial features of different placements. Experimental results indicate that compared with a naive sequential placement, the proposed method achieves 1.99× increase in throughput and 50.5% reduction in latency; compared with the simulated annealing, an effective technique to approximate the global optima in an extremely large search space, our method improves the throughput by 1.22× and reduces the latency by 18.6%. We further demonstrate that our proposed method is capable to find optimal placements taking advantages of different communication properties caused by different system configurations, and work in a topology-agnostic manner.
BibTeX
@article{wu2021core,
  author = {Nan Wu and Lei Deng and Guoqi Li and Yuan Xie},
  title = {{Core Placement Optimization for Multi-chip Many-core Neural Network Systems with Reinforcement Learning}},
  journal = {ACM Trans. Design Autom. Electr. Syst.},
  year = {2021},
  url = {https://openreview.net/forum?id=4rfySR9Mz_S},
}

Loading related content...

Figure