The human protein Polybromo-1 (PBMR1/BAF180) is a component of the SWI/SNF chromatin-remodeling complex that has been reported to be deregulated in tumors. However, its role in prostate cancer (PCa) is largely unknown. In this study, we described the PBRM1 transcriptional levels and the protein expression/localization in tissues of PCa patients and in prostatic cell lines. Increased PBRM1 mRNA levels were found in PCa samples, when compared to benign disease, and were correlated with higher Gleason score. We also verified that only the nuclear localization of PBRM1 protein is correlated with a more aggressive disease and high Prostate-Specific Antigen (PSA) levels in tissue microarrays. Intriguing expression patterns of mRNA and protein were identified in the cell lines. Although PBRM1 protein was restricted to the nuclei, in tumor cell lines in non-neoplastic cells, it was also present in vesicular-like structures that were dispersed within the cytoplasm. We knocked-down PBRM1 in the castration-resistant PCa (CRPC) cell line PC-3 and we verified that PBRM1 promotes the expression of several markers of aggressiveness, including EpCAM, TGF-β, and N-Cadherin. Therefore, our data supported the hypothesis that PBRM1 displays a pivotal role in the promotion and maintenance of the malignant behavior of PCa, especially in CRPC.