Feihong Lu

Feihong Lu

Auto-generated profile, based on publicly available information

Feihong Lu

Beihang University, Beijing, China

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 January 2023 in ACM Transactions on Multimedia Computing, Communications, and Applications
Verified
Journal Article
Open access
LFLu Feihong
Lu Feihong
CHChen Hang
Chen Hang
LKLi Kang
Li Kang
DQDeng Qiliang
Deng Qiliang
Jian ZhaoJian Zhao
Jian Zhao
HHHong Han
Hong Han
Face-mask occluded restoration aims at restoring the masked region of a human face, which has attracted increasing attention in the context of the COVID-19 pandemic. One major challenge of this task is the large visual variance of masks in the real world. To solve it we first construct a large-scale Face-mask Occluded Restoration (FMOR) dataset, which contains 5,500 unmasked images and 5,500 face-mask occluded images with various illuminations, and involves 1,100 subjects of different races, face orientations, and mask types. Moreover, we propose a Face-Mask Occluded Detection and Restoration (FMODR) framework, which can detect face-mask regions with large visual variations and restore them to realistic human faces. In particular, our FMODR contains a self-adaptive contextual attention module specifically designed for this task, which is able to exploit the contextual information and correlations of adjacent pixels for achieving high realism of the restored faces, which are however often neglected in existing contextual attention models. Our framework achieves state-of-the-art results of face restoration on three datasets, including CelebA, AR, and our FMOR datasets. Moreover, experimental results on AR and FMOR datasets demonstrate that our framework can significantly improve masked face recognition and verification performance.

28 October 2024
Verified
Conference Paper
Open access
FLFeihong Lu
Feihong Lu
WWWeiqi Wang
Weiqi Wang
YLYangyifei Luo
Yangyifei Luo
ZZZiqin Zhu
Ziqin Zhu
QSQingyun Sun
Qingyun Sun
JLJianxin Li
Jianxin Li
Social media has become ubiquitous for connecting with others, staying updated with news, expressing opinions, and finding entertainment. However, understanding the intention behind social media posts remains challenging due to the implicit and commonsense nature of these intentions, the need for cross-modality understanding of both text and images, and the presence of noisy information such as hashtags, misspelled words, and complicated abbreviations. To address these challenges, we present MIKO, a Multimodal Intention Knowledge DistillatiOn framework that collaboratively leverages a Large Language Model (LLM) and a Multimodal Large Language Model (MLLM) to uncover users' intentions. Specifically, our approach uses an MLLM to interpret the image, an LLM to extract key information from the text, and another LLM to generate intentions. By applying MIKO to publicly available social media datasets, we construct an intention knowledge base featuring 1,372K intentions rooted in 137,287 posts. Moreover, We conduct a two-stage annotation to verify the quality of the generated knowledge and benchmark the performance of widely used LLMs for intention generation, and further apply MIKO to a sarcasm detection dataset and distill a student model to demonstrate the downstream benefits of applying intention knowledge.

28 October 2024
Verified
Conference Paper
Open access
QLQian Li
Qian Li
YZYucheng Zhou
Yucheng Zhou
Cheng JiCheng Ji
Cheng Ji
FLFeihong Lu
Feihong Lu
JGJianian Gong
Jianian Gong
JLJianxin Li
Jianxin Li
Text-video retrieval (TVR) identifies relevant videos based on textual queries. Existing methods are limited by their ability to understand and connect different modalities, resulting in increased difficulty in retrievals. In this paper, we propose a generation-based TVR paradigm facilitated by LLM distillation to better learn and capture deep retrieval knowledge for text-video retrieval, amidsting the rapid evolution of Large Language Models. Specifically, we first design the fine-tuning large vision-language model that leverages the knowledge learned from language models to enhance the alignment of semantic information between the text and video modalities. It also incorporates an inductive reasoning mechanism, which focuses on incorporating important temporal and spatial features into the video embeddings. We further design question prompt clustering to select the most important prompts, considering their contribution to improving retrieval performance. Experimental results show that our approach achieves excellent performance on two benchmark datasets compared to its competitors.

17 April 2026 in Pattern Recognition
Verified
Journal Article
Closed access
FLFeihong Lu
Feihong Lu
TYTao Yang
Tao Yang
ZZZiqin Zhu
Ziqin Zhu
YHYudi Huang
Yudi Huang
SGShiqi Gao
Shiqi Gao
JLJianxin Li
Jianxin Li

6 November 2026
Verified
Conference Paper
Open access
TYTao Yang
Tao Yang
YHYang Hu
Yang Hu
FLFeihong Lu
Feihong Lu
QSQingyun Sun
Qingyun Sun
JLJianxin Li
Jianxin Li