Deep reinforcement learning has made remarkable strides in gaming, demonstrating prowess across perfect and imperfect information scenarios. However, its efficacy in the card game DouDiZhu has been less than optimal. DouDiZhu stands out from other games due to its multiplayer nature, blending competitive and cooperative dynamics, which translates to a complex state-action space. In 2021, DouZero emerged, leveraging Monte Carlo methods and neural networks to surpass numerous counterparts. Yet, while Monte Carlo methods boast swift training, they introduce significant variance, leading to instability during training and gameplay. To tackle this challenge, our study integrates multiple supervision heads into the neural network and enhances DouZero's architecture. Our findings reveal that our agent, DouMH, notably enhances the win rate within the same timeframe, marking agent to achieve over a 60% win rate against DouZero.
Deep reinforcement learning has achieved remarkable progress in the field of computer games, but these advancements come with significant computational resource consumption. To improve computational efficiency and reduce reliance on high computational resources, we applied two ingenious methods: reparameterization and terminal batch processing operators. By employing a specially designed replay buffer and neural networks integrated with reparameterization, and directly simulating end-game operations on the GPU, these methods not only reduce the computational burden but also ensure rapid convergence during the training process. This enhanced training framework allows for more iterations in a shorter period, thereby improving computational efficiency in self-play and training processes. We applied this technique to the game of NoGo. Experimental results indicate that, compared to the traditional AlphaZero method, the proposed approach achieves a faster increase in Elo score within the same timeframe. The agent utilizing this method secured first place among 1070 agents on the BotZone platform of Peking University.