Qifan Fu

Qifan Fu

Auto-generated profile, based on publicly available information

Qifan Fu

Digital Environment Research Institute, Queen Mary University of London, London, United Kingdom and School of Electrical Engineering and Computer Science, Queen Mary University of London, London, United Kingdom

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 March 2023 in IEEE Wireless Communications Letters
Verified
Journal Article
Closed access
QFQifan Fu
Qifan Fu
HXHuiqiang Xie
Huiqiang Xie
ZQZhijin Qin
Zhijin Qin
GSGreg Slabaugh
Greg Slabaugh
XTXiaoming Tao
Xiaoming Tao
Although analog semantic communication systems have received considerable attention in the literature, there is less work on digital semantic communication systems. In this paper, we develop a deep learning (DL)-enabled vector quantized (VQ) semantic communication system for image transmission, named VQ-DeepSC. Specifically, we propose a convolutional neural network (CNN)-based transceiver to extract multi-scale semantic features of images and introduce multi-scale semantic embedding spaces to perform semantic feature quantization, rendering the data compatible with digital communication systems. Furthermore, we employ adversarial training to improve the quality of received images by introducing a PatchGAN discriminator. Experimental results demonstrate that the proposed VQ-DeepSC is more robustness than BPG in digital communication systems and has comparable MS-SSIM performance to the DeepJSCC method.

27 October 2025
Verified
Conference Paper
Open access
QFQifan Fu
Qifan Fu
XCXu Chen
Xu Chen
MAMuhammad Asad
Muhammad Asad
SYShanxin Yuan
Shanxin Yuan
COChangjae Oh
Changjae Oh
GSGreg Slabaugh
Greg Slabaugh


4 March 2025 in arXiv
Verified
Preprint
Open access
PDF file
QFQifan Fu
Qifan Fu
XCXu Chen
Xu Chen
MAMuhammad Asad
Muhammad Asad
SYShanxin Yuan
Shanxin Yuan
COChangjae Oh
Changjae Oh
GSGregory Slabaugh
Gregory Slabaugh
Although diffusion methods excel in text-to-image generation, generating accurate hand gestures remains a major challenge, resulting in severe artifacts, such as incorrect number of fingers or unnatural gestures. To enable the diffusion model to learn spatial information to improve the quality of the hands generated, we propose HanDrawer, a module to condition the hand generation process. Specifically, we apply graph convolutional layers to extract the endogenous spatial structure and physical constraints implicit in MANO hand mesh vertices. We then align and fuse these spatial features with other modalities via cross-attention. The spatially fused features are used to guide a single stage diffusion model denoising process for high quality generation of the hand region. To improve the accuracy of spatial feature fusion, we propose a Position-Preserving Zero Padding (PPZP) fusion strategy, which ensures that the features extracted by HanDrawer are fused into the region of interest in the relevant layers of the diffusion model. HanDrawer learns the entire image features while paying special attention to the hand region thanks to an additional hand reconstruction loss combined with the denoising loss. To accurately train and evaluate our approach, we perform careful cleansing and relabeling of the widely used HaGRID hand gesture dataset and obtain high quality multimodal data. Quantitative and qualitative analyses demonstrate the state-of-the-art performance of our method on the HaGRID dataset through multiple evaluation metrics. Source code and our enhanced dataset will be released publicly if the paper is accepted.

13 September 2024 in arXiv
Verified
Preprint
Open access
PDF file
QFQifan Fu
Qifan Fu
XYXiaohang Yang
Xiaohang Yang
MAMuhammad Asad
Muhammad Asad
COChangjae Oh
Changjae Oh
SYShanxin Yuan
Shanxin Yuan
GSGreg Slabaugh
Greg Slabaugh
Diffusion models have shown their remarkable ability to synthesize images, including the generation of humans in specific poses. However, current models face challenges in adequately expressing conditional control for detailed hand pose generation, leading to significant distortion in the hand regions. To tackle this problem, we first curate the How2Sign dataset to provide richer and more accurate hand pose annotations. In addition, we introduce adaptive, multi-modal fusion to integrate characters' physical features expressed in different modalities such as skeleton, depth, and surface normal. Furthermore, we propose a novel Region-Aware Cycle Loss (RACL) that enables the diffusion model training to focus on improving the hand region, resulting in improved quality of generated hand gestures. More specifically, the proposed RACL computes a weighted keypoint distance between the full-body pose keypoints from the generated image and the ground truth, to generate higher-quality hand poses while balancing overall pose accuracy. Moreover, we use two hand region metrics, named hand-PSNR and hand-Distance for hand pose generation evaluations. Our experimental evaluations demonstrate the effectiveness of our proposed approach in improving the quality of digital human pose generation using diffusion models, especially the quality of the hand region. The source code is available at https://github.com/fuqifan/Region-Aware-Cycle-Loss.