Zhuo Chen

Zhuo Chen

Auto-generated profile, based on publicly available information

Zhuo Chen

King’s College London, London, UK

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 August 2024 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
NONi Ou
Ni Ou
ZCZhuo Chen
Zhuo Chen
SLShan Luo
Shan Luo
Optical tactile sensors play a pivotal role in robot perception and manipulation tasks. The membrane of these sensors can be painted with markers or remain markerless, enabling them to function in either marker or markerless mode. However, this uni-modal selection means the sensor is only suitable for either manipulation or perception tasks. While markers are vital for manipulation, they can also obstruct the camera, thereby impeding perception. The dilemma of selecting between marker and markerless modes presents a significant obstacle. To address this issue, we propose a novel mode-switchable optical tactile sensing approach that facilitates transitions between the two modes. The marker-to-markerless transition is achieved through a generative model, whereas its inverse transition is realized using a sparsely supervised regressive model. Our approach allows a single-mode optical sensor to operate effectively in both marker and markerless modes without the need for additional hardware, making it well-suited for both perception and manipulation tasks. Extensive experiments validate the effectiveness of our method. For perception tasks, our approach decreases the number of categories that include misclassified samples by 2 and improves contact area segmentation IoU by 3.53%. For manipulation tasks, our method attains a high success rate of 92.59% in slip detection.

28 January 2026 in Nature Communications
Verified
Journal Article
Open access
PDF file
ZCZhuo Chen
Zhuo Chen
NONi Ou
Ni Ou
XZXuyang Zhang
Xuyang Zhang
ZWZhiyuan Wu
Zhiyuan Wu
YZYongqiang Zhao
Yongqiang Zhao
SLShan Luo
Shan Luo
Humans achieve stable and dexterous object manipulation by coordinating grasp forces across multiple fingers and palms, facilitated by a unified tactile memory system in the somatosensory cortex. This system encodes and stores tactile experiences across skin regions, enabling the flexible reuse and transfer of touch information. Inspired by this biological capability, we present GenForce, the first framework that enables transferable force sensing across diverse tactile sensors in robotic hands. GenForce unifies tactile signals into shared marker representations, analogous to cortical sensory encoding, allowing force prediction models trained on one sensor to be transferred to others without the need for exhaustive force data collection. We demonstrate that GenForce generalizes across both homogeneous sensors with varying configurations and heterogeneous sensors with distinct sensing modalities and material properties. This transferable force sensing capability is also demonstrated in robot manipulation tasks including daily-object grasping, slip detection and compensation with multi-sensor force coordination. Our results highlight a scalable paradigm for cross-sensor robotic tactile sensing, offering new pathways toward adaptable and tactile memory-driven robot manipulation in unstructured environments.

15 October 2025 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
ZWZhiyuan Wu
Zhiyuan Wu
YLYijiong Lin
Yijiong Lin
YZYongqiang Zhao
Yongqiang Zhao
XZXuyang Zhang
Xuyang Zhang
ZCZhuo Chen
Zhuo Chen
SLShan Luo
Shan Luo
Robotic pushing is a fundamental manipulation task that requires tactile feedback to capture subtle contact forces and dynamics between the end-effector and the object. However, real tactile sensors often face hardware limitations such as high costs and fragility, and deployment challenges involving calibration and variations between different sensors, while vision-only policies struggle with satisfactory performance. Inspired by humans' ability to infer tactile states from vision, we propose ViTacGen, a novel robot manipulation framework designed for visual robotic pushing with vision-to-touch generation in reinforcement learning to eliminate the reliance on high-resolution real tactile sensors, enabling effective zero-shot deployment on visual-only robotic systems. Specifically, ViTacGen consists of an encoder-decoder vision-to-touch generation network that generates contact depth images, a standardized tactile representation, directly from visual image sequence, followed by a reinforcement learning policy that fuses visual-tactile data with contrastive learning based on visual and generated tactile observations. We validate the effectiveness of our approach in both simulation and real world experiments, demonstrating its superior performance and achieving a success rate of up to 86%. Code and data are available on https://robot-perception-lab.github.io/vitacgen-website/.

31 March 2026 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
YZYongqiang Zhao
Yongqiang Zhao
XZXuyang Zhang
Xuyang Zhang
ZCZhuo Chen
Zhuo Chen
MLMatteo Leonetti
Matteo Leonetti
ESEmmanouil Spyrakos-Papastavridis
Emmanouil Spyrakos-Papastavridis
SLShan Luo
Shan Luo
Peg-in-hole (PiH) assembly is a fundamental yet challenging robotic manipulation task. While reinforcement learning (RL) has shown promise in tackling such tasks, it requires extensive exploration. In this paper, we propose a novel visual-tactile skill learning framework for the PiH task that leverages its inverse task, i.e., peg-out-of-hole (PooH) disassembly, to facilitate PiH learning. Compared to PiH, PooH is inherently easier as it only needs to overcome existing friction without precise alignment, making data collection more efficient. To this end, we formulate both PooH and PiH as Partially Observable Markov Decision Processes (POMDPs) in a unified environment with shared visual-tactile observation space. A visual–tactile PooH policy is first trained; its trajectories, containing kinematic, visual and tactile information, are temporally reversed and action-randomized to provide expert data for PiH. In the policy learning, visual sensing facilitates the peg–hole approach, while tactile measurements compensate for peg–hole misalignment. Experiments across diverse peg–hole geometries show that the visual–tactile policy attains 6.4% lower contact forces than its single-modality counterparts, and that our framework achieves average success rates of 87.5% on seen objects and 77.1% on unseen objects, outperforming direct RL methods that train PiH policies from scratch by 18.1% in success rate.

13 April 2026 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
NONi Ou
Ni Ou
ZCZhuo Chen
Zhuo Chen
XZXinru Zhang
Xinru Zhang
JWJunzheng Wang
Junzheng Wang
Accurate camera–LiDAR fusion relies on precise extrinsic calibration, which fundamentally depends on establishing reliable cross-modal correspondences under potentially large misalignments. Existing learning-based methods typically project LiDAR points into depth maps for feature fusion, which distorts 3D geometry and degrades performance when the extrinsic initialization is far from the ground truth. To address this issue, we propose an extrinsic-aware cross-attention framework that directly aligns image patches and LiDAR point groups in their native domains. The proposed attention mechanism explicitly injects extrinsic parameter hypotheses into the correspondence modeling process, enabling geometry-consistent cross-modal interaction without relying on projected 2D depth maps. Extensive experiments on the KITTI and nuScenes benchmarks demonstrate that our method consistently outperforms state-of-the-art approaches in both accuracy and robustness. Under large extrinsic perturbations, our approach achieves accurate calibration in 88% of KITTI cases and 99% of nuScenes cases, substantially surpassing the second-best baseline.

11 June 2025 in Research Square
Verified
Preprint
Open access
PDF file
SLShan Luo
Shan Luo
ZCZhuo Chen
Zhuo Chen
NONi Ou
Ni Ou
XZXuyang Zhang
Xuyang Zhang
ZWZhiyuan Wu
Zhiyuan Wu
JDJiankang Deng
Jiankang Deng
Humans achieve stable and dexterous object manipulation by coordinating grasp forces across multiple fingers and palms, facilitated by a unified tactile memory system in the somatosensory cortex. This system encodes and stores tactile experiences across skin regions, enabling the flexible reuse and transfer of touch information between fingers and hands. Inspired by this biological capability, we present GenForce, a framework that enables transferable force sensing across tactile sensors in robotic hands. GenForce unifies tactile signals into shared marker representations, analogous to cortical sensory encoding, allowing force prediction models trained on one sensor to be transferred to others without the need for exhaustive force data collection. We demonstrate that GenForce generalizes across both homogeneous sensors with varying configurations and heterogeneous sensors with distinct sensing modalities and material properties. Our results highlight a scalable paradigm for robotic tactile learning, offering new pathways toward adaptable and tactile memory-driven manipulation in unstructured environments.