Optimizing Intelligent Edge-clouds with Partitioning, Compression and Speculative Inference.
MILCOM(2021)
摘要
Internet of Battlefield Things (IoBTs) are well positioned to take advantage of recent technology trends that have led to the development of low-power neural accelerators and low-cost high-performance sensors. However, a key challenge that needs to be dealt with is that despite all the advancements, edge devices remain resource-constrained, thus prohibiting complex deep neural networks from deploying and deriving actionable insights from various sensors. Furthermore, deploying sophisticated sensors in a distributed manner to improve decision-making also poses an extra challenge of coordinating and exchanging data between the nodes and server. We propose an architecture that abstracts away these thorny deployment considerations from an end-user (such as a commander or warfighter). Our architecture can automatically compile and deploy the inference model into a set of distributed nodes and server while taking into consideration of the resource availability, variation, and uncertainties.
更多查看译文
关键词
intelligent edge-clouds,speculative inference,Internet of Battlefield Things,IoBTs,low-power neural accelerators,low-cost high-performance sensors,edge devices,resource-constrained,complex deep neural networks,decision-making,coordinating exchanging data,thorny deployment considerations,inference model,distributed nodes,resource availability
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要