Ciyu Ruan

Ciyu Ruan

Auto-generated profile, based on publicly available information

Ciyu Ruan

Shenzhen International Graduate School, Tsinghua University, Shenzhen, China

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
4 February 2026 in ACM Computing Surveys
Verified
Journal Article
Open access
HWHaoyang Wang
Haoyang Wang
RGRuishan Guo
Ruishan Guo
PMPengtao Ma
Pengtao Ma
CRCiyu Ruan
Ciyu Ruan
XLXinyu Luo
Xinyu Luo
XCXinlei Chen
Xinlei Chen
With the evolution of mobile embodied intelligence, agents such as drones and autonomous robots are transitioning toward high agility. This shift imposes stringent demands on embodied perception, requiring high-accuracy and low-latency feedback loops for reliable interaction. Event-based vision has emerged as a transformative paradigm. Its microsecond-level temporal resolution and high dynamic range render it ideal for embodied perception tasks on high-agility mobile platforms. However, asynchronous nature, substantial noise, lack of persistent semantic information, and large data volume pose challenges for processing on resource-constrained mobile agents. This article surveys the literature from 2014–2025 and presents a comprehensive overview of event-based mobile embodied perception. We organize review around four key pillars: event abstraction methods, perception algorithm advancements, hardware and software acceleration strategies, and mobile applications . We discuss critical tasks including visual odometry, object tracking, optical flow, and 3D reconstruction, while highlighting challenges associated with sensor fusion and real-time deployment. Furthermore, we outline future research directions, such as improving event cameras with advanced optics and leveraging neuromorphic computing for efficient processing. To support ongoing research, we provide an open-source Online Sheet with recent developments. We hope this survey serves as a reference, facilitating adoption of event-based vision across diverse mobile embodied applications.

4 December 2024
Verified
Conference Paper
Open access
CZChenyu Zhao
Chenyu Zhao
CRCiyu Ruan
Ciyu Ruan
JXJingao Xu
Jingao Xu
HWHaoyang Wang
Haoyang Wang
CLCong Li
Cong Li
XCXinlei Chen
Xinlei Chen
Drone-based rapid and accurate environmental edge detection is highly advantageous for tasks such as disaster relief and autonomous navigation. Current methods, using radar or cameras, raise deployment costs and burden lightweight drones with high computational demands. In this paper, we propose AirTouch, a system that transforms the ground effect from a stability "foe" in traditional flight control views, into a "friend" for accurate and efficient edge detection. Our key insight is that analyzing drone sensor readings and flight commands allows us to detect ground effect changes. Such changes typically indicate the drone flying over an edge, making this information valuable for edge detection. We approach this insight through theoretical analysis, algorithm design, and implementation, fully leveraging the ground effect as a new sensing modality without compromising drone flight stability, thereby achieving accurate and efficient scene edge detection. Extensive evaluations demonstrate that our system achieves a high detection accuracy with mean detection distance errors of 0.051m, outperforming the baseline performance by 86%.

4 December 2024
Verified
Conference Paper
Open access
XLXinyu Luo
Xinyu Luo
HWHaoyang Wang
Haoyang Wang
CRCiyu Ruan
Ciyu Ruan
CLChenxin Liang
Chenxin Liang
JXJingao Xu
Jingao Xu
XCXinlei Chen
Xinlei Chen
Accurately localizing high-speed dynamic objects in 3D space with low latency is crucial for various robotic applications. Current methods face challenges due to extended exposure times and limited sensor resolution, hindering precise object detection and localization. Event cameras, known for their high temporal resolution and asynchronous nature, offer a promising solution. To leverage the potential of the event camera, we propose EventTracker, a novel framework that integrates event and depth measurements for precise and low-latency 3D localization and tracking of the high-speed dynamic object. EventTracker incorporates a collaborative object detection and tracking algorithm optimized for both event and depth data, overcoming detection and registration challenges. Additionally, a graph-instructed optimization algorithm enhances accuracy by fusing heterogeneous sensor data effectively. Experimental evaluation in dynamic environments demonstrates significant improvements in localization performance compared to baseline methods.

4 December 2024
Verified
Conference Paper
Open access
CRCiyu Ruan
Ciyu Ruan
CZChenyu Zhao
Chenyu Zhao
CLChenxin Liang
Chenxin Liang
XLXinyu Luo
Xinyu Luo
JXJingao Xu
Jingao Xu
XCXinlei Chen
Xinlei Chen
Event cameras excel in high-speed and high-dynamic-range scenarios but are highly sensitive to rain, which introduces significant noise while also revealing detailed rain features. This paper introduces a novel Event-based Rain-Background Decomposition Network that integrates Spiking Neural Networks (SNNs) and Convolutional Neural Networks (CNNs). By "Distilling Rain," we reconstruct a rain-free background for downstream tasks, and by "Collecting Rain," we extract the physical characteristics of rain. Experimental evaluations demonstrate the network's effectiveness in both background reconstruction and rain modeling. This work extends the capabilities of event cameras by mitigating the adverse effects of rain while also leveraging rain-induced noise to extract valuable environmental data, enhancing their utility in both challenging weather conditions and detailed environmental analysis.

28 February 2024
Verified
Conference Paper
Open access
HWHaoyang Wang
Haoyang Wang
XLXinyu Luo
Xinyu Luo
CRCiyu Ruan
Ciyu Ruan
XCXuecheng Chen
Xuecheng Chen
WDWenhua Ding
Wenhua Ding
XCXinlei Chen
Xinlei Chen
Background and motivation. The localization and tracking of high-speed dynamic objects find applications across various domains. For example, tracking unmanned aerial vehicles (UAVs) serves a crucial role for regulatory authorities, enabling the swift identification of illicitly operated drones. Related work. Presently, the widespread use of cameras and Radar is observed in the realm of locating and tracking moving objects [1]. An illustrative example is [2], which integrates an RGB camera with Radar for object tracking, yielding follow-up effects in AR applications. Despite their successes, these methods encounter notable latency when tracking high-speed dynamic objects. The latency often extends into the hundreds of milliseconds due to several factors: ① cameras necessitate tens of milliseconds for exposure and may be susceptible to motion blur; ② algorithms may require a sequence of frames for optimizing localization results. This extended latency becomes a critical limitation when dealing with objects moving at speeds surpassing 10m/s, as the system is left with inadequate time for a response. Consequently, current methods fall short of meeting our requirement for precise real-time tracking of dynamic objects. Our Insight. Nowadays, event camera, characterized by its asynchronous and motion-activated nature, boasting microsecond level temporal resolution, is finding application in high-frequency monitoring. This trend serves as a catalyst for our exploration into the integration of these asynchronous measurements with advanced vision techniques, aiming to enhance the tracking for high-speed objects. Challenges. Albeit inspiring, translating it into a practical system is non-trivial and encounters significant challenges: • C1: Event burst and depth obtain delay impair object localization. Event cameras demonstrate enhanced sensitivity to changes in the environment. Crucial events triggered by objects are often overshadowed by the abundance of events triggered by changes in the environment. • C2: Heterogeneous data hinders consistently high-precision tracking. The event camera exhibits a high detection frequency, but its results lack scale information. Simultaneously, the rough 3D localization of objects can be obtained from the depth camera's results, but its frequency is low. Our work. To surmount these challenges, we conceive DO-Tracker, a framework adapt at merging event and depth measurements for the precise localization and tracking of high-speed dynamic objects as illustrated in Fig. 1. To tackle (C1), we devise a clustering and bayes filter-based algorithm, specifically gear towards object detection and object's 2D location tracking. Concurrently, the object undergoes segmentation on the depth map using event camera detection results, effectively addressing scale-related challenges. To address (C2), we introduce the Graph-Instructed Collaborative Localization algorithm, which harmonizes heterogeneous observations from both cameras through joint optimization. We implement DO-Tracker using commercial event and depth cameras and conduct preliminary experiments of tracking a ball, confirming the viability of the approach (Fig. 2).