Recent studies have highlighted the potential of smart radiotherapy biomaterials (SRBs) for combining radiotherapy and immunotherapy. These SRBs include smart fiducial markers and smart nanoparticles made with high atomic number materials that can provide requisite image contrast during radiotherapy, increase tumor immunogenicity, and provide sustained local delivery of immunotherapy. Here, we review the state-of-the-art in this area of research, the challenges and opportunities, with a focus on in situ vaccination to expand the role of radiotherapy in the treatment of both local and metastatic disease. A roadmap for clinical translation is outlined with a focus on specific cancers where such an approach is readily translatable or will have the highest impact. The potential of FLASH radiotherapy to synergize with SRBs is discussed including prospects for using SRBs in place of currently used inert radiotherapy biomaterials such as fiducial markers, or spacers. While the bulk of this review focuses on the last decade, in some cases, relevant foundational work extends as far back as the last two and half decades.