| 引用本文: | 苏华友,陈抗抗,杨乾明.长向量处理器高效RNN推理方法.[J].国防科技大学学报,2024,46(1):121-130.[点击复制] |
| SU Huayou,CHEN Kangkang,YANG Qianming.Efficient RNN inference engine on very long vector processor[J].Journal of National University of Defense Technology,2024,46(1):121-130[点击复制] |
|
| |
|
|
| 本文已被：浏览 4162次 下载 2391次 |
| 长向量处理器高效RNN推理方法 |
| 苏华友1,2,陈抗抗1,2,杨乾明1 |
|
(1. 国防科技大学 计算机学院, 湖南 长沙 410073;2. 国防科技大学 并行与分布计算全国重点实验室, 湖南 长沙 410073)
|
| 摘要: |
| 模型深度的不断增加和处理序列长度的不一致对循环神经网络在不同处理器上的性能优化提出巨大挑战。针对自主研制的长向量处理器FT-M7032,实现了一个高效的循环神经网络加速引擎。该引擎采用行优先矩阵向量乘算法和数据感知的多核并行方式,提高矩阵向量乘的计算效率；采用两级内核融合优化方法降低临时数据传输的开销；采用手写汇编优化多种算子,进一步挖掘长向量处理器的性能潜力。实验表明,长向量处理器循环神经网络推理引擎可获得较高性能,相较于多核ARM CPU以及Intel Golden CPU,类循环神经网络模型长短记忆网络可获得最高62.68倍和3.12倍的性能加速。 |
| 关键词: 多核DSP 长向量处理器 循环神经网络 并行优化 |
| DOI：10.11887/j.cn.202401013 |
| 投稿日期：2022-11-07 |
| 基金项目:国家自然科学基金资助项目(61872377)；湘江实验室基金资助项目(22XJ01012) |
|
| Efficient RNN inference engine on very long vector processor |
| SU Huayou1,2, CHEN Kangkang1,2, YANG Qianming1 |
|
(1. College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, China;2. National Key Laboratory of Parallel and Distributed Computing, National University of Defense Technology, Changsha 410073, China)
|
| Abstract: |
| With the increasing depth and the inconsistent length of processing sequences, the performance optimization of RNN(recurrent neural network) on different processors makes it difficult to researchers. An efficient RNN acceleration engine was implemented for the self-developed long vector processor FT-M7032. This engine proposed a row-first matrix vector multiplication algorithm and a data-aware multi-core parallel method to improve the computational efficiency of matrix vector multiplication. It proposed a two-level kernel fusion optimization method to reduce the overhead of temporary data transmission. Optimized handwritten assembly codes for multiple operators were integrated to further tap the performance potential of long vector processors. Experiments show that the RNN engine for long-vector processors is efficient, when compared with the multi-core ARM CPU and Intel Golden CPU, the RNN-like model long short term memory networks can achieve a performance acceleration of up to 62.68 times and 3.12 times, respectively. |
| Keywords: multicore DSP very long vector processor recurrent neural networks parallel optimization |
|
|
|
|
|
