Ruihao Zhu

Ruihao Zhu

Auto-generated profile, based on publicly available information

Ruihao Zhu

Cornell University, New York, USA

Research Focus & Metrics

Academic Career Length

1Year (2026-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications

30 April 2026 in IEEE/CAA Journal of Automatica Sinica
Verified
Journal Article
Closed access
ZSZhiyi Shi
Zhiyi Shi
RZRuihao Zhu
Ruihao Zhu
SWShuai Wu
Shuai Wu
WTWei Tong
Wei Tong
GZGuangyu Zhu
Guangyu Zhu
EQEdmond Qwu
Edmond Qwu
Dear Editor, This letter presents a contrastive reinforcement learning (Contrastive RL)-based framework, addressing challenging goal-conditioned problems in robotic control. While Contrastive RL offers promise in learning state-action-goal relationships, it suffers from a critical limitation: Insufficient discriminability between positive and negative samples attributed to inefficient value exploration and model overfitting. To overcome these challenges, the proposed algorithm extends Contrastive RL by leveraging an ensemble of critic networks to model state-action-goal alignment, alleviating the overfitting problem. Furthermore, the architecture introduces a dual component loss function: 1) A diversity-driven term to mitigate exploration redundancy in value estimation; and 2) A categorical-guidance constraint to ensure the discriminability capacity across contrasting pairs. We term this integrated framework diversity-driven contrastive value ensembles with categorical constraints (DiCE-CC). Experimental validation across three robotic manipulation scenarios demonstrates the effectiveness of the proposed algorithm in solving complex goal-conditioned control problems.

12 January 2026 in IEEE Transactions on Automation Science and Engineering
Verified
Journal Article
Closed access
ZSZhiyi Shi
Zhiyi Shi
HPHaoyu Pan
Haoyu Pan
RZRuihao Zhu
Ruihao Zhu
CLChangyu Li
Changyu Li
SWShuai Wu
Shuai Wu
EQEdmond Qwu
Edmond Qwu
Goal-conditioned humanoid locomotion in reinforcement learning (RL) remains challenging due to sparse reward signals and the single-goal overfitting problem. Although contrastive reinforcement learning (CRL) has achieved considerable success in this setting, it can suffer from pronounced estimation variance, since epistemic uncertainty is difficult to reduce given limited task-specific information and model capacity. Ensemble-based critics can partially alleviate this issue. However, sufficient ensemble diversity and accurate individual estimates are not necessarily guaranteed during training, resulting in unstructured exploration. To address these challenges, we propose Conditional Redundancy-Guided Evolutionary Contrastive Ensemble with Direct Preference Optimization weighting (CRECE-DPO), which augments CRL with a vectorized critic ensemble and refines the ensemble via an evolutionary algorithm guided by a tailored fitness metric. Specifically, we design a DPO-weighted conditional redundancy fitness score, to prune redundant representations while promoting effective exploration of the parameter space. Simulation results on challenging goal-conditioned benchmarks, including humanoid locomotion, demonstrate consistent improvements over CRL and other baselines.