Breast cancer is the most prominent type of cancer among women. Understanding the microenvironment of breast cancer and the interactions between cells and cytokines will lead to better treatment approaches for patients. In this study, we developed a data-driven mathematical model to investigate the dynamics of key cells and cytokines involved in breast cancer development. We used gene expression profiles of tumors to estimate the relative abundance of each immune cell and group patients based on their immune patterns. Dynamical results show the complex interplay between cells and molecules, and sensitivity analysis emphasizes the direct effects of macrophages and adipocytes on cancer cell growth. In addition, we observed the dual effect of IFN-$\gamma$ on cancer proliferation, either through direct inhibition of cancer cells or by increasing the cytotoxicity of CD8+ T-cells.