第一届未来大气科学论坛

In this talk, we will discuss the multivariable control of wastewater treatment process(WWTP) based on multi-agent deep reinforcement learning. The urban wastewater treatment process involves numerous chemical reactions, resulting in strong nonlinearity and uncertainty characteristics. Additionally, due to the interdependencies among these biochemical reaction processes, coupling effects exist between different process variables. To address these challenges, we propose a multivariable adaptive PID control strategy based on multi-agent DRL (MADRL) for WWTP. The approach begins with the construction of a MADRL-PID controller structure, consisting of an agent and a PID controller module. The agent adjusts the PID controller values while the PID module calculates the control signal. To enhance the agent's ability to cooperatively tune multiple PID controllers, the algorithm's components—reward function, action space, environment, and state space—are designed according to the BSM1 simulation platform principles and the MADRL framework requirements. Additionally, to handle WWTP's non-linearities, uncertainties, and parameter coupling, the multi-agent deep deterministic policy gradient (MADDPG) algorithm is selected as the foundation for training the agents. Experimental results demonstrate that the proposed algorithm exhibits greater adaptability than traditional PID control and achieves superior control performance.
 

Wastewater treatment process (WWTP),Deep reinforcement learning (DRL),Multivariable control