Chuanbeibei Shi

Ms. Chuanbeibei Shi

University of Toronto, Toronto, Ontario, Canada
orcid

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
28 August 2023 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
CSChuanbeibei Shi
Chuanbeibei Shi
GLGanghua Lai
Ganghua Lai
Yushu YuYushu Yu
Yushu Yu
MBMauro Bellone
Mauro Bellone
Vincenzo LippielloVincenzo Lippiello
Vincenzo Lippiello
This letter aims to solve the challenging problems in multi-modal active vision for object detection on unmanned aerial vehicles (UAVs) with a monocular camera and a limited Field of View (FoV) LiDAR. The point cloud acquired from the low-cost LiDAR is firstly converted into a 3-channel tensor via motion compensation, accumulation, projection, and up-sampling processes. The generated 3-channel point cloud tensor and RGB image are fused into a 6-channel tensor using an early fusion strategy for object detection based on a Gaussian YOLO network structure. To solve the low computational resource problem and improve the real-time performance, the velocity information of the UAV is further fused with the detection results based on an extended Kalman Filter (EKF). A perception-aware model predictive control (MPC) is designed to achieve active vision on our UAV. According to our performance evaluation, our pre-processing step improves other literature methods running time by a factor of 10 while maintaining acceptable detection performance. Furthermore, our fusion architecture reaches 94.6 mAP on the test set, outperforming the individual sensor networks by roughly 5%. We also described an implementation of the overall algorithm on a UAV platform and validated it in real-world experiments.

30 May 2024 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
GLGanghua Lai
Ganghua Lai
CSChuanbeibei Shi
Chuanbeibei Shi
KWKaidi Wang
Kaidi Wang
Yushu YuYushu Yu
Yushu Yu
YDYiqun Dong
Yiqun Dong
AFAntonio Franchi
Antonio Franchi
Reliablyand efficiently estimating the relative pose and global localization of robots in a common reference for Integrated Aerial Platforms (IAPs) is a challenging problem. Unlike unmanned aerial vehicle (UAV) swarms, where the agent individual is able to move freely, IAPs connect UAV agents with mechanical joints, such as spherical joints, and form a rigid central platform, limiting the degree of freedom (DOF) of agents. Traditional methods, which rely on forming loop closures, object detection, or range sensors, suffer from degeneration or inefficiency due to the restricted relative motion between agents. In this paper, we present a centralized multi-agent localization system that fuses the internal kinematic constraints of IAPs and odometry measurements, using only visual-inertial suits for ego-motion estimation for agents and an additional 9-DOF Inertial Measurement Unit (IMU) attached to the central platform for posture estimation. A general formulation for kinematic constraints is derived without requiring knowledge about detailed kinematic parameters. A sliding-window optimization-based state estimator is constructed to estimate the relative transformation between agents. Our proposed approach is validated in our collected dataset. The results show that the proposed method reduces the global localization drift by 27.15% and relative localization error by 53.4% in the translation part and 36.99% in the rotation part compared to the baseline.

23 September 2022 in Drones
Verified
Journal Article
Open access
PDF file
CSChuanbeibei Shi
Chuanbeibei Shi
KWKaidi Wang
Kaidi Wang
Yushu YuYushu Yu
Yushu Yu
An assembly composed of multiple aerial vehicles can realize omnidirectional motion with six degrees of freedom. Such an assembly has a heavier payload capacity and better fault tolerance compared with a single aircraft. Thus, such assemblies have the potential to become an ideal platform for manipulation. This paper investigates the controller design and prototype implementation for an expandable aerial vehicle assembly (AVA). The proposed AVA is composed of multiple sub-aircraft connected together via spherical joints at their center of mass. Each sub-aircraft can rotate around the spherical joint. The system dynamics of such an AVA can be separated into a slowly varying system and a fast varying system. The design criteria for a controller for this type of AVA was analyzed based on the similarity between the slowly varying system and a fully actuated rigid aircraft. This can reduce the design procedure for the controller and increase the expandability of the AVA. The stability criteria were carefully analyzed by considering the tracking error of each sub-aircraft. As an example, the controller of the AVA was designed using trajectory linearization control on the manifold, since the configuration space of the aircraft is a non-Euclidean space. A prototype composed of three quadrotors was implemented. The real-time expandable communication protocol among the different sub-aircraft was designed based on the CAN bus. Furthermore, the software and the hardware of the real-world prototype were developed. Both simulation and real-world tests were conducted, which validated the feasibility of the control design and the software implementation for an expandable assembly containing multiple aerial vehicles.

25 October 2022 in Micromachines
Verified
Journal Article
Open access
PDF file
CSChuanbeibei Shi
Chuanbeibei Shi
Yushu YuYushu Yu
Yushu Yu
Unlike individual unmanned aerial vehicles (UAVs), integrated aerial platforms (IAPs) containing multiple UAVs do not suffer from underactuation and can move omnidirectionally in six dimensions, providing a basis for constructing aerial manipulation platforms. Compared to single UAVs, multi-UAV IAPs are also advantageous in terms of payload and fault-tolerance capacity, making them promising candidates as platforms with integrated-response, observation, and strike capabilities. Herein, an IAP structure design containing three sub-UAVs connected in a star-like configuration is presented. This form of integration enables the IAP, as a whole, to simultaneously adjust its position and attitude in six dimensions. The dynamics of the overall system of the IAP are modeled. On this basis, an overall system controller is designed. To simplify control, based on stability of cascaded system, the rotational motion of the sub-UAVs is treated as a inner-loop subsystem, whereas the overall motion of the IAP is seen as a outer-loop subsystem. Because the configuration space of the sub-UAVs is non-Euclidean, a controller is designed for the outer-loop subsystem based on model predictive control on the manifold. Subsequently, the stability of the closed-loop system is demonstrated. Fieldbus technology is employed to design a real-time, scalable communication architecture for multiple sub-UAVs, followed by the development of a principle prototype of the multi-UAV IAP that consists of hardware and software systems. The effectiveness of the IAP design and control method is validated through simulation and real-world prototype-based tests. In the simulation and real-world tests, the proposed methodology can make the IAP system converge to the desired configuration at the presence of large initial configuration error. The same test scenario cannot be finished by a baseline PID controller. The advantage of the proposed control scheme in dealing with state and input constraints is shown via such tests.

27 December 2022 in International Journal of Robust and Nonlinear Control
Verified
Journal Article
Closed access
CSChuanbeibei Shi
Chuanbeibei Shi
Yushu YuYushu Yu
Yushu Yu
YMYuwei Ma
Yuwei Ma
DCDong Eui Chang
Dong Eui Chang

26 September 2025 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
WFWeicheng Fang
Weicheng Fang
GLGanghua Lai
Ganghua Lai
Yushu YuYushu Yu
Yushu Yu
CSChuanbeibei Shi
Chuanbeibei Shi
XMXin Meng
Xin Meng
ZCZhenchao Cui
Zhenchao Cui
Gesture recognition, an important method for Human-Drone Interaction (HDI), is often constrained by sensor limitations, such as sensitivity to lighting variations and field of view (FoV) restrictions. This paper proposes a real-time drone control system that integrates multimodal fusion gesture recognition with active perception control to overcome these challenges. We constructed a diversified arm gesture dataset and designed a lightweight, one-stage point cloud and image features fusion model, Adaptive Gate Fusion Network (AGFNet), for real-time inference on embedded devices. We applied motion compensation to mitigate delay errors caused by point clouds accumulation and network inference during movement, and fused the drone's velocity data and detection results using the Extended Kalman Filter (EKF) to enhance real-time performance. This enabled active perception through the optimization of the sensor's FoV using perception-aware Model Predictive Control (PAMPC). Experimental results demonstrate that the proposed model achieves a threefold improvement in inference speed compared to the baseline, reaching 97.93% mAP on the test set and outperforming single-sensor networks by approximately 5%. Real-world testing further confirms the system's applicability and effectiveness in indoor environments. The code is available at: https://github.com/fangweicheng6/Gesture-HDI.git.