A dynamic distributed energy storage control strategy for providing primary frequency regulation using multi-armed bandits method

Maintaining frequency stability is a crucial but challenging task for the stable operation of a power system. The distributed energy storage (DES) can charge or discharge for both upward and downward frequency regulation, exploring and effectively using the regulation capabilities will provide a strong backup for frequency regulation. Here, a dynamic DES control strategy for providing primary frequency regulation is proposed. The different behaviours of storage owners are considered when they respond to the regulation requests from the aggregator. This kind of uncertainty would lead to a mismatch between the final aggregation result and the expected target. Hence, the multi-armed bandit approach is applied to learn users' response behaviour and select the optimal set of users to mitigate the mismatch. Case studies on the IEEE RTS 24-bus system demonstrate that the proposed method's mismatch between the actual aggregation result and the regulation target is less than half as much as the conventional method, and it can restore the frequency 20 events earlier than the traditional method.