With the increasing resistance of Acinetobacter baumannii (A. baumannii) to antibiotics, researchers have turned their attention to the development of new antimicrobial agents. Among them, coumarin-based heterocycles have attracted much attention due to their unique biological activities, especially in the field of antibacterial infection. In this study, a series of coumarin derivatives were synthesized and screened for their bactericidal activities (Ren et al. 2018; Salehian et al. 2021). The inhibitory activities of these compounds on bacterial strains were evaluated, and the related mechanism of the new compounds was explored. Firstly, the MIC values and bacterial growth curves were measured after compound treatment to evaluate the antibacterial activity in vitro. Then, the in vivo antibacterial activities of the new compounds were assessed on A. baumannii-infected mice by determining the mice survival rates, counting bacterial CFU numbers, measuring inflammatory cytokine levels, and histopathology analysis. In addition, the ROS levels in the bacterial cells were measured with DCFH-DA detection kit. Furthermore, the potential target and detailed mechanism of the new compounds during infection disease therapy were predicted and evidenced with molecular docking. After that, ADMET characteristic prediction was completed, and novel, synthesizable, drug-effective molecules were optimized with reinforcement learning study based on the probed compound as a training template. The interaction between the selected structures and target proteins was further evidenced with molecular docking. This series of innovative studies provides important theoretical and experimental data for the development of new anti-A. baumannii infection drugs.