Qianhui Men

Dr. Qianhui Men


Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
16 November 2020 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
QMQianhui Men
Qianhui Men
Edmond S. L. HoEdmond S. L. Ho
Edmond S. L. Ho
HSHubert P. H. Shum
Hubert P. H. Shum
HLHoward Leung
Howard Leung
Recurrent neural network (RNN) has become popular for human motion prediction thanks to its ability to capture temporal dependencies. However, it has limited capacity in modeling the complex spatial relationship in the human skeletal structure. In this work, we present a novel diffusion convolutional recurrent predictor for spatial and temporal movement forecasting, with multi-step random walks traversing bidirectionally along an adaptive graph to model interdependency among body joints. In the temporal domain, existing methods rely on a single forward predictor with the produced motion deflecting to the drift route, which leads to error accumulations over time. We propose to supplement the forward predictor with a forward discriminator to alleviate such motion drift in the long term under adversarial training. The solution is further enhanced by a backward predictor and a backward discriminator to effectively reduce the error, such that the system can also look into the past to improve the prediction at early frames. The two-way spatial diffusion convolutions and two-way temporal predictors together form a quadruple network. Furthermore, we train our framework by modeling the velocity from observed motion dynamics instead of static poses to predict future movements that effectively reduces the discontinuity problem at early prediction. Our method outperforms the state of the arts on both 3D and 2D datasets, including the Human3.6M, CMU Motion Capture and Penn Action datasets. The results also show that our method correctly predicts both high-dynamic and low-dynamic moving trends with less motion drift.

28 October 2022
Verified
Book Chapter
Closed access
PDF file
TQTanqiu Qiao
Tanqiu Qiao
QMQianhui Men
Qianhui Men
Frederick W. B. LiFrederick W. B. Li
Frederick W. B. Li
YKYoshiki Kubotani
Yoshiki Kubotani
SMShigeo Morishima
Shigeo Morishima
HSHubert P. H. Shum
Hubert P. H. Shum

29 September 2023 in Medical Image Analysis
Verified
Journal Article
Open access
QMQianhui Men
Qianhui Men
CTClare Teng
Clare Teng
LDLior Drukker
Lior Drukker
APAris T. Papageorghiou
Aris T. Papageorghiou
JNJ. Alison Noble
J. Alison Noble
In this work, we exploit multi-task learning to jointly predict the two decision-making processes of gaze movement and probe manipulation that an experienced sonographer would perform in routine obstetric scanning. A multimodal guidance framework, Multimodal-GuideNet, is proposed to detect the causal relationship between a real-world ultrasound video signal, synchronized gaze, and probe motion. The association between the multi-modality inputs is learned and shared through a modality-aware spatial graph that leverages useful cross-modal dependencies. By estimating the probability distribution of probe and gaze movements in real scans, the predicted guidance signals also allow inter- and intra-sonographer variations and avoid a fixed scanning path. We validate the new multi-modality approach on three types of obstetric scanning examinations, and the result consistently outperforms single-task learning under various guidance policies. To simulate sonographer's attention on multi-structure images, we also explore multi-step estimation in gaze guidance, and its visual results show that the prediction allows multiple gaze centers that are substantially aligned with underlying anatomical structures.


14 October 2024
Verified
Book Chapter
Closed access
PDF file
XGXiaoqing Guo
Xiaoqing Guo
QMQianhui Men
Qianhui Men
JNJ. Alison Noble
J. Alison Noble

6 October 2022 in Journal of Medical Systems
Verified
Journal Article
Open access
PDF file
MZManli Zhu
Manli Zhu
QMQianhui Men
Qianhui Men
Edmond S. L. HoEdmond S. L. Ho
Edmond S. L. Ho
HLHoward Leung
Howard Leung
HSHubert P. H. Shum
Hubert P. H. Shum
Musculoskeletal and neurological disorders are the most common causes of walking problems among older people, and they often lead to diminished quality of life. Analyzing walking motion data manually requires trained professionals and the evaluations may not always be objective. To facilitate early diagnosis, recent deep learning-based methods have shown promising results for automated analysis, which can discover patterns that have not been found in traditional machine learning methods. We observe that existing work mostly applies deep learning on individual joint features such as the time series of joint positions. Due to the challenge of discovering inter-joint features such as the distance between feet (i.e. the stride width) from generally smaller-scale medical datasets, these methods usually perform sub-optimally. As a result, we propose a solution that explicitly takes both individual joint features and inter-joint features as input, relieving the system from the need of discovering more complicated features from small data. Due to the distinctive nature of the two types of features, we introduce a two-stream framework, with one stream learning from the time series of joint position and the other from the time series of relative joint displacement. We further develop a mid-layer fusion module to combine the discovered patterns in these two streams for diagnosis, which results in a complementary representation of the data for better prediction performance. We validate our system with a benchmark dataset of 3D skeleton motion that involves 45 patients with musculoskeletal and neurological disorders, and achieve a prediction accuracy of 95.56%, outperforming state-of-the-art methods.