Ruofeng Liu

Ruofeng Liu

Auto-generated profile, based on publicly available information

Ruofeng Liu

Michigan State University, East Lansing, Michigan, USA

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
8 May 2024 in IEEE Communications Surveys & Tutorials
Verified
Journal Article
Closed access
SWShuai Wang
Shuai Wang
LMLuoyu MEI
Luoyu MEI
RLRuofeng Liu
Ruofeng Liu
WJWenchao Jiang
Wenchao Jiang
ZYZhimeng Yin
Zhimeng Yin
THTian He
Tian He
Millimeter-wave (mmWave) radar, with its high resolution, sensitivity to micro-vibrations, and adaptability to various environmental conditions, holds immense potential across multi-modal fusion sensing. Although there exist review papers on mmWave radar, there is a noticeable lack of comprehensive reviews focusing on its multi-modal fusion sensing capabilities. Addressing this gap, our review offers an extensive exploration of mmWave radar multi-modal fusion sensing, emphasizing its integration with other modalities. This review discusses the complex realm of millimeter-wave radar multi-modal fusion sensing, detailing its importance, hardware and software aspects, principles, and current potential and applications. It delves into data characteristics and datasets associated with mmWave radar, focusing on Doppler, point cloud, and multi-modal data formats. The review highlights how these data types enhance multi-modal fusion sensing and discusses methodologies, including signal processing and learning algorithms. Three categories of multi-modal fusion methodologies are proposed to optimally manage and interpret fused data. Various practical applications of mmWave radar multi-modal fusion sensing are illustrated, underlining the unique capabilities it provides when integrated with other sensors. The review concludes by identifying potential future research avenues, underscoring the immense potential of this field for further exploration and advancement.

27 March 2023 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Verified
Journal Article
Open access
SWShuai Wang
Shuai Wang
DCDongjiang Cao
Dongjiang Cao
RLRuofeng Liu
Ruofeng Liu
WJWenchao Jiang
Wenchao Jiang
TYTianshun Yao
Tianshun Yao
CLChris Xiaoxuan Lu
Chris Xiaoxuan Lu
Human sensing and understanding is a key requirement for many intelligent systems, such as smart monitoring, human-computer interaction, and activity analysis, etc. In this paper, we present mmParse, the first human parsing design for dynamic point cloud from commercial millimeter-wave radar devices. mmParse proposes an end-to-end neural network design that addresses the inherent challenges in parsing mmWave point cloud (e.g., sparsity and specular reflection). First, we design a novel multi-task learning approach, in which an auxiliary task can guide the network to understand human structural features. Secondly, we introduce a multi-task feature fusion method that incorporates both intra-task and inter-task attention to aggregate spatio-temporal features of the subject from a global view. Through extensive experiments in both indoor and outdoor environments, we demonstrate that our proposed system is able to achieve ~ 92% accuracy and ~ 84% IoU accuracy. We also show that the predicted semantic labels can increase the performance of two downstream tasks (pose estimation and action recognition) by ~ 18% and ~ 6% respectively.

20 September 2022
Verified
Conference Paper
Open access
HLHao Li
Hao Li
RLRuofeng Liu
Ruofeng Liu
SWShuai Wang
Shuai Wang
WJWenchao Jiang
Wenchao Jiang
CLChris Xiaoxuan Lu
Chris Xiaoxuan Lu
Autonomous driving requires vehicles to achieve fine detection of objects in the surrounding environment, especially living pedestrians. Nevertheless, in real world road environments there are living pedestrians and roadside portrait billboards. Existing vision-based object detection technologies fail to ac-curately distinguish living pedestrians from human figures. As an important sensor of autonomous driving system, mmWave radar has extra help to detect living pedestrians. In this paper, we extract the radar cross section (RCS) of the object from the low-cost mmWave radar signal as a distinguishing feature between living pedestrian and portrait billboard. Based on this observation, we propose a feature fusion network of mmWave radar and computer vision based on attention mechanism, and detect living pedestrians from fusion features. We implement the design with commodity mmWave radar IWR6843ISK-ODS and RGB camera Logitech Pro C920. The evaluation results show that our method effectively detects living pedestrians with an mAP of 97.7% and outperforms existing studies.

3 March 2025 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Verified
Journal Article
Open access
KSKai Sun
Kai Sun
SWShuai Wang
Shuai Wang
RZRenjie Zhao
Renjie Zhao
RLRuofeng Liu
Ruofeng Liu
WCWeiwei Chen
Weiwei Chen
wei gongwei gong
wei gong
Wireless localization, especially using ubiquitous Wi-Fi devices, has been studied for decades. However, due to complex signal propagation, resolving multiple reflected paths and further achieving accurate localization face great challenges in the localization precision and localization range, which are caused by the limited bandwidth and sensitivity of Wi-Fi signals respectively. Straightforwardly solving these challenges by employing wide bandwidth Wi-Fi is only helpful for improving precision, while the localization range is still short due to Wi-Fi's intrinsic vulnerability to SNR drop. This paper presents Wi-Fi-UWB Localization (WULoc) to achieve both precise and long-range localization for Wi-Fi devices. Specifically, WULoc leverages the picosecond level timestamp information that is extracted from the links of the Wi-Fi device to multiple UWB anchors, innovatively created by the proposed Wi-Fi-UWB connection establishment, which overcomes the incompatibility between Wi-Fi and UWB physical layers. WULoc further calculates the TDoA of Wi-Fi-UWB links, from which the location of the Wi-Fi device is estimated. Extensive experiments show that WULoc locates a Wi-Fi device at a range of 240 meters with a precision of 5.3 meters.

4 November 2024
Verified
Conference Paper
Open access
RLRuofeng Liu
Ruofeng Liu
TYTianshun Yao
Tianshun Yao
RSRuili Shi
Ruili Shi
LMLuoyu MEI
Luoyu MEI
SWShuai Wang
Shuai Wang
WJWenchao Jiang
Wenchao Jiang
This paper presents Mission, the first-of-this-kind cross-modal reidentification (ReID) design for mmWave Radar and RGB cameras. Given a person of interest detected by Radar in camera-restricted scenarios, Mission can identify the image of the person from cameras that are ubiquitously deployed in camera-allowed areas. We envision that cross Vison-RF ReID can significantly enrich mmWave human sensing with a wide spectrum of applications in security surveillance, tracking, and personalized services. Technically, we introduce a novel method for cross-modal similarity estimation that exploits inherent synergies between fine-grained 2D images and coarse-grained 3D Radar point clouds to effectively overcome their modal discrepancy. Through extensive experiments, we demonstrated that our proposed system can achieve 85% top-1 accuracy and 90% top-5 accuracy among 58 volunteers.

12 November 2023
Verified
Conference Paper
Open access
WLWenwei Li
Wenwei Li
RLRuofeng Liu
Ruofeng Liu
SWShuai Wang
Shuai Wang
DCDongjiang Cao
Dongjiang Cao
WJWenchao Jiang
Wenchao Jiang
3D human pose plays a critical role in human behavior understanding and has many applications (e.g., VR/AR). Conventional pose estimations deploy sensors as fixed infrastructure, which significantly restrains the mobility of the user. Inspired by the emerging head-mounted devices (e.g., VR/AR glasses) and the recent advance in low-cost mmWave radar, we present mmEgo, the first egocentric human pose estimation design using a head-mounted mmWave radar, which offers ubiquitous pose tracking with high mobility, robustness to complex environments, and privacy preservation. To tackle the unique challenges of radar sensing from the egocentric perspective (e.g., random radar motion and the scarcity of information on the lower body), we propose several technical designs, including root-relative radar motion tracking for radar motion decoupling and a two-stage pose estimator that incorporates human kinematics priors. Extensive experiments and case studies show that our method can reduce the joint localization error by 44.2% and potentially enable a wide spectrum of applications.