LiFang Yang

LiFang Yang


Research Focus & Metrics

Academic Career Length

14Years (2013-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
30 June 2022 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
ZTZhulin Tao
Zhulin Tao
XLXiaohao Liu
Xiaohao Liu
YXYewei Xia
Yewei Xia
XWXiang Wang
Xiang Wang
LYLiFang Yang
LiFang Yang
TCTat-Seng Chua
Tat-Seng Chua
Learning representations for multimedia content is critical for multimedia recommendation. Current representation learning methods roughly fall into two groups: (1) using the historical interactions to create ID embeddings of users and items, and (2) treating multi-modal data as the side information of items to enrich their ID embeddings. Each user-item interaction offers the supervisory signal to optimize the representation learning by the traditional supervised learning paradigm. Due to the overlook of the multi-modal patterns ($e.g.$, co-occurrence of visual, acoustic, textual features in micro-videos a user saw before, and her behavioral features) hidden in the data, these methods are insufficient to create powerful representations and obtain satisfactory recommendation accuracy. To capture multi-modal patterns in the data itself, we go beyond the supervised learning paradigm, and incorporate the idea of self-supervised learning (SSL) into multimedia recommendation. Specifically, SSL consists of two components: (1) data augmentation upon multi-modal contents, where we design three operators — feature dropout (FD), feature masking (FM), feature fine and coarse spaces (FAC) — to generate multiple views of individual items; and (2) contrastive learning, which differentiates the views of an item from the others’ to distill additional supervisory signals. Clearly, SSL enables us to explore and exhibit the underlying relations among modalities, thereby resulting in powerful representations. We denote the generic framework by Self-supervised Learning-guided Multimedia Recommendation (SLMRec). Extensive experiments are performed on three real-world datasets, showing that SLMRec achieves significant improvements over several state-of-the-art baselines like LightGCN [1], MMGCN [2]. Further analysis shows how SSL affects recommendation performance.

20 May 2022 in IEEE Signal Processing Letters
Verified
Journal Article
Closed access
MZMo Zhao
Mo Zhao
GCGang Cao
Gang Cao
XHXiang Lin Huang
Xiang Lin Huang
LYLiFang Yang
LiFang Yang
Transformer typically enjoys larger model capacity but higher computational loads than convolutional neural network (CNN) in vision tasks. In this letter, the advantages of such two networks are fused for achieving effective and efficient real image denoising. We propose a hybrid denoising model based on Transformer Encoder and Convolutional Decoder Network (TECDNet). The Transformer based on novel radial basis function (RBF) attention is used as encoder to improve the representation capability of overall model. In decoder, the residual CNN instead of Transformer is adopted to greatly reduce computational complexity of the whole denoising network. Extensive experimental results on real images show that TECDNet achieves the state-of-the-art denosing performance with relatively low computational cost.

8 September 2020 in IEEE Access
Verified
Journal Article
Open access
XWxiao long wei
xiao long wei
LYLiFang Yang
LiFang Yang
GCGang Cao
Gang Cao
TLTao Lu
Tao Lu
BWBing Wang
Bing Wang
With the development of artificial intelligence, multiagent algorithms have been applied to many real-time strategy games. Making plans on the human being is gradually passing away, especially in combat scenarios. Cognitive electronic warfare (CEW) is a complex and challenging work due to the sensitivity of the data sources. There are few studies on CEW. In the past, wargame simulations depended on differential equations and war theory, which resulted in high time and human resource costs. In the future, as other artificial intelligence theories are developed, artificial intelligence will play a more critical role in wargames. The capabilities of multiagent modeling to describe complex systems and predict actions in dynamic environments are superior to those of traditional methods. In this paper, we use a 3D wargame engine from China Aerospace System Simulation Technology Co., Ltd. (Beijing) named All Domain Simulation (ACS), which supports land, sea, and air combat scenarios, to simulate combat. In the simulations, there are several unmanned air vehicles (UAVs) as attackers and several radar stations as defenders, and both have the ability to detect the others. In the game, several UAVs need to learn to detect targets and track targets separately, and we train the UAV’s behavior by well-designed reward shaping and multiagent reinforcement learning (MARL) with LSTM. We improved the RDPG [1] algorithm and merged the MADDPG [2] and RDPG algorithms. From the experimental results, we can see that the effectiveness and accuracy of the algorithm have been greatly improved.

8 January 2020 in IEEE Access
Verified
Journal Article
Open access
GSGege Song
Gege Song
ZTZhulin Tao
Zhulin Tao
XHXiang Lin Huang
Xiang Lin Huang
GCGang Cao
Gang Cao
WLwei liu
wei liu
LYLiFang Yang
LiFang Yang
As eating-out became an indispensable part of our daily lives, demand for the food recognition of unfamiliar restaurant increased significantly due to health-care. Although there are many researches on generic food recognition, there are relatively fewer studies on restaurant food image recognition. Meanwhile, it becomes extremely challenging for restaurant food image recognition due to insufficient food image. Prototypical network is common utilized to address the such a task in recent years. Although the methods based on prototypical network achieve impressive results in capturing similarities feature of the same food category, it fails to highlight important information on feature and instance level. Toward this end, we propose an effective food image recognition scheme by incorporating hybrid attention mechanism into prototypical network in this paper. Specifically, the image feature is first captured by convolutional neural network (CNN). Then the image attention weights yielded by instance-based attention mechanism are used to modulate the image feature of CNN for constructing class prototypes. And feature-based attention mechanism is employed to grasp important information of image for enriching image representation. Extensive experimental results on the large food image dataset verify that the performance of our proposed classification scheme outperforms the state-of-the-art ones.

1 October 2016 in Neurocomputing
Verified
Journal Article
Closed access
JZJiangLong Zhang
JiangLong Zhang
XHXiang Lin Huang
Xiang Lin Huang
LYLiFang Yang
LiFang Yang
LNLiqiang Nie
Liqiang Nie

17 December 2019 in Multimedia Tools and Applications
Verified
Journal Article
Closed access
PDF file
WLwei liu
wei liu
XHXiang Lin Huang
Xiang Lin Huang
GCGang Cao
Gang Cao
JZJianglong Zhang
Jianglong Zhang
GSGege Song
Gege Song
LYLiFang Yang
LiFang Yang