Breast cancer seriously endangers women’s health worldwide. Protein arginine methyltransferase 5 (PRMT5) is highly expressed in breast cancer and represents a potential druggable target for breast cancer treatment. However, because the currently available clinical PRMT5 inhibitors are relatively limited, there is an urgent need to develop new PRMT5 inhibitors. Our team previously found that the FDA-approved drug tadalafil can act as a PRMT5 inhibitor and enhance the sensitivity of breast cancer patients to doxorubicin treatment. To further improve the binding specificity of tadalafil to PRMT5, we chemically modified tadalafil, and designed three compounds, A, B, and C, based on the PRMT5 protein structure. These three compounds could bind to PRMT5 through different binding modes and inhibit histone arginine methylation. They arrested the proliferation and triggered the apoptosis of breast cancer cells in vitro and also promoted the antitumor effects of the chemotherapy drugs cisplatin, doxorubicin, and olaparib in combination regimens. Among them, compound A possessed the highest potency. Finally, the anti-breast cancer effects of PRMT5 inhibitor A and its ability to enhance chemosensitivity were further verified in a xenograft mouse model. These results indicate that the new PRMT5 inhibitors A, B, and C may be potential candidates for breast cancer treatment.