In 2020, evaluators within the Research Centers in Minority Institutions (RCMIs) program proposed a conceptual framework identifying four primary evaluation targets: scientific productivity, scientific collaboration, professional growth, and research resources. This study extends prior work by capturing the contextual and process-oriented dimensions of program impact. This reflective practice-based project examines how non-quantitative approaches complement traditional metrics to better characterize RCMI outcomes. Evaluators representing ten RCMI sites participated in a multi-site case study guided by three questions addressing: (1) qualitative evidence of impact beyond metrics; (2) challenges and successes in implementation of non-quantitative methods; and (3) potential expansion of evaluation targets. Evaluators provided descriptive responses, generating a 22-page dataset that was analyzed thematically. Thirteen non-quantitative evaluation domains emerged: investigator consultations, investigator productivity, investigator success, community partnerships, intra-RCMI collaborations, implementation of team science, career progression, programmatic support, mentoring support, impact on RCMI affiliates, intellectual resources, physical resources, and faculty hires. Key challenges included inconsistent data capture and limited evaluation resources, while successes highlighted improved cross-site learning and visibility of program impact. Findings support retaining the original evaluation targets while expanding the framework to include institutional transformation, equitable research environments, and longitudinal societal impact. A conceptual map was developed to depict how mixed methods that include non-quantitative approaches can yield RCMI evaluations that expand upon the current approach, which relies primarily on quantitative data. The authors recommend quantitative targets and non-quantitative strategies to provide context, communicate evidence of success, and inform programmatic changes to deepen the findings and strengthen the rigor of RCMI evaluation practices.

Puerto Rico has faced significant damage from natural disasters and the COVID-19 pandemic, disrupting clinical services and scientific research logistics. In response, the RCMI-CCRHD Program at the UPR-MSC organized a retreat with the objective of understanding the challenges faced by its research network during the pandemic and strategies to overcome them. The retreat featured presentations on COVID-19 supplemental projects and included a discussion group. Twenty attendees identified the challenges they encountered and the strategies developed through an open-ended question and a satisfaction survey, implementing a mixed-method approach. We performed a content analysis on the open-ended survey questions and used descriptive statistics for the satisfaction survey. Key challenges included remote work implementation, recruitment difficulties, and mental health concerns. Attendees shared actions taken to address these issues, such as modifying protocols for remote planning and using digital platforms for improving communication. They also recognized opportunities that arose from remote work, which allowed them to focus on publishing and adapting mental health support tools. The retreat received positive feedback, with 93.8% of attendees giving a five-star rating. By reflecting on these experiences, investigators can refine strategies and implement effective solutions. Recommendations include flexible IRB protocols, improved digital tools, community involvement, and robust emergency preparedness plans.