Reinforcement Learning based Load Balancing in a Distributed Heterogeneous Storage System
2022 International Conference on Information Networking (ICOIN)(2022)
摘要
With the growing demand for big data storage and processing, distributed storage systems with heterogeneous devices have become the majority in cloud data centers. However, hardware heterogeneity and workload variety make it challenging to maintain optimal performance in those storage systems. In this work, we present a learning-based control method that optimizes the performance of a distributed storage system. Specifically, to provide automatic parameter tuning upon dynamic workload patterns on a tiered storage architecture, we employ deep reinforcement learning (RL) and implement a simulation environment for a Ceph storage system. Through simulation tests, we demonstrate our RL method shows better performance than other heuristic approaches for a task of load balancing based on the primary affinity settings in Ceph.
更多查看译文
关键词
Performance evaluation,Data centers,Storage management,Reinforcement learning,Load management,Robustness,Hardware
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要