Intelligent PID Controller Based on Deep Reinforcement Learning

PID control is still the most important and popular method in industrial control at present. PID control is easy to achieve and it can improve the steady-state performance and dynamic performance of the system. PID controller can be used for all objects, however, it has some problems with parameter adjustment and control effect. The proportional integral differential coefficient of PID control is fixed, and it can't change when disturbed, so the stability of the system will be affected. Moreover, PID control is prone to overshoot and can't be used in specific systems. Reinforcement learning (RL) algorithms have developed rapidly from discrete action to continuous action in recent years. It has aroused the high interest of researchers in the field of automatic control. RL control performs better in the degree of intelligence and dynamic performance, however, the steady-state performance is poor. The sensitive response of RL control will damage the actuator. In this paper, an adaptive PID controller based on deep reinforcement learning is proposed. By designing reward values, the desired control effect is described. In this way, an agent is trained to provide parameters to the PID controller in real time. It can improve the response speed of the system, suppress overshoot, and have a certain anti-disturbance ability by training the agent to achieve real-time PID parameter adjustment.