Overview Of Tensor Layout In Modern Neural Network Accelerator

Wang Zhongyu Tao,Yuanfeng Wang,Huaisheng Zhang

2021 18th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP)（2021）

引用 0|浏览2

暂无评分

摘要

Modern neural network accelerator is widely used to accelerate the training or inference in neural network related works, such as CNN, RNN, NLP, etc. The tensor is the fundamental unit to store the neural network's data. In the paper, we profile two prevalent tensor layout NHWC and N(C/x)HWx to see different layout's influence to L1/L2 cache. We design a profiling framework which includes block sp...

查看译文

关键词

Neural Network Accelerator,Tensor Layout,Profiling Framework

AI 理解论文

溯源树

样例

生成溯源树，研究论文发展脉络

Chat Paper

正在生成论文摘要