Managing Prefetchers With Deep Reinforcement Learning

IEEE Computer Architecture Letters(2022)

引用 1|浏览24
暂无评分
摘要
We aim to reduce contention caused by multiple aggressive prefetchers on shared resources (e.g., LLC and memory bandwidth) with a multi-agent reinforcement learning scheme. The agent finds what prefetchers to use and determines how aggressive they should be at any time during the execution. To do so, we utilize a highly scalable action branching agent that features a shared network module followed by several network branches. The shared network tracks the overall state of the processor while each branch in the network branches focuses on one specific prefetcher. We train the network by running 20 randomly mixed benchmarks, and measure the performance for 100 unseen mixes. Our experimental results show that our proposed method reduces the memory bandwidth by 19% while delivering similar performance compared to a very competitive baseline.
更多
查看译文
关键词
Prefetcher,cache,deep reinforcement learning,ML for system
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要