Disparities in breast cancer between African American (AA) and European American (EA) women persist. However, it remains unclear whether endocrine-disrupting chemicals (EDCs), including 2,3,7,8-tetrachlorodibenzo-p-dioxin (TCDD) and bisphenol A (BPA), are associated with different gene regulatory patterns across ancestry groups. We used a multi-module network toxicology approach to assess whether EDC-associated genes in breast cancer have similar expression patterns in AA and EA patients. Intersecting EDC targets with breast cancer-associated genes in the Comparative Toxicogenomics Database identified 9,588 candidate genes, and protein–protein interaction analysis revealed ten hub genes. In TCGA-BRCA data (AA n = 189; EA n = 867), three hub genes were significantly downregulated in AA patients: ESR1 (padj = 4.03×10⁻⁹), EP300 (padj = 1.13×10⁻¹³), and ARID1A (padj = 2.14×10⁻⁸). These genes were enriched in chromatin remodeling and estrogen response processes. Transcription factor analysis identified TP53, the most central hub gene, as a high-confidence activator of ESR1. These associative findings suggest that EDC-linked gene expression varies by ancestry and identify the TP53–ESR1 axis as a candidate mechanism that requires experimental validation. They also highlight the need for ancestry-stratified analyses in environmental chemical research.