Enabling Energy-Efficient and Reliable Neural Network via Neuron-Level Voltage Scaling
2019 IEEE 25th International Conference on Parallel and Distributed Systems (ICPADS)(2019)
摘要
As the application scope of deep neural networks (DNNs) moves from large-scale data centers to small-scale mobile devices, power wall has become one of the most important obstacles. Voltage scaling is a typical technique enables power saving, but it causes reliability and performance challenges. Therefore, an energy-efficient and reliable scheme for NNs is required to balance above three aspects according to users' requirements for excellent user experience. In this paper, we innovatively propose neuron-level voltage scaling framework called NN-APP to model the impact of supply voltages on NNs from output accuracy (A), power (P), and performance (P) perspectives. We analyze the error propagation in NNs and precisely model the impact of voltage scaling on the final output accuracy at neuron-level. Multi-objective optimization and clustering method are combined to find the optimal voltage islands. Finally, we conduct experiment to demonstrate the efficacy of the proposed technique.
更多查看译文
关键词
neural networks,voltage scaling,fault tolerance,energy-efficiency,reliability
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络