Shi Feng

Prof. Shi Feng


Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
2 November 2020 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
XYXiaocui Yang
Xiaocui Yang
SFShi Feng
Shi Feng
DWDaling Wang
Daling Wang
YZYifei Zhang
Yifei Zhang
Compared with single-modal content, multimodal data can express users feelings and sentiments more vividly and interestingly. Therefore, multimodal sentiment analysis has become a popular research topic. However, most existing methods either learn modal sentiment feature independently, without considering their correlations, or they simply integrate multimodal features. In addition, most publicly available multimodal datasets are labeled by sentiment polarities, while the emotions expressed by users are specific. Based on this observation, in this paper, we build a large-scale image-text emotion dataset (i.e., labeled by different emotions), called TumEmo, with more than 190,000 instances from Tumblr1. We further propose a novel multimodal emotion analysis model based on the Multi-view Attentional Network (MVAN), which utilizes a memory network that is continually updated to obtain the deep semantic features of image-text. The model includes three stages: feature mapping, interactive learning, and feature fusion. In the feature mapping stage, we leverage image features from an object viewpoint and a scene viewpoint to capture effective information for multimodal emotion analysis. Then, an interactive learning mechanism is adopted that uses the memory network; this mechanism extracts single-modal emotion features and interactively models the cross-view dependencies between the image and text. In the feature fusion stage, multiple features are deeply fused using a multilayer perceptron and a stacking-pooling module. The experimental results on the MVSA-Single, MVSA-Multiple, and TumEmo datasets show that the proposed MVAN outperforms strong baseline models by large margins. Index TermsMultimodal sentiment analysis; Memory network; Multi-view attention mechanism; Social media

11 June 2021 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
QLQian Li
Qian Li
DWDaling Wang
Daling Wang
SFShi Feng
Shi Feng
CNCheng Niu
Cheng Niu
YZYifei Zhang
Yifei Zhang
The incompleteness of knowledge graphs triggers considerable research interest in relation prediction. As the key to predicting relations among entities, many efforts have been devoted to learning the embeddings of entities and relations by incorporating a variety of neighbors' information which includes not only the information from direct outgoing and incoming neighbors but also the ones from the indirect neighbors on the multihop paths. However, previous models usually consider entity paths of limited length or ignore sequential information of the paths. Either simplification will make the model lack a global understanding of knowledge graphs and may result in the loss of important and indispensable information. In this article, we propose a novel global graph attention embedding network (GGAE) for relation prediction by combining global information from both direct neighbors and multihop neighbors. Concretely, given a knowledge graph, we first introduce the path construction algorithms to obtain meaningful paths, then design path modeling methods to capture the potential long-distance sequential information in the multihop paths, final propose an entity graph attention and a relation graph attention mechanisms to obtain entity embeddings and relation embeddings. Moreover, an entity graph attention mechanism is proposed to calculate the entity embeddings by aggregating direct incoming and outgoing neighbors from: 1) an original knowledge graph with the original entity and relation embeddings and 2) a new knowledge graph constructed by the paths whose embeddings are updated by path modeling methods. for each relation, we construct a new graph with related entities and present a relation graph attention to learn the features. Therefore, our model can encapsulate the information from different distance neighbors, and enable the embeddings of entities and relations to better capture all-sided semantic information. The experimental results on benchmark datasets verify the superiority of our model over the state-of-the-art ones.

26 October 2023
Verified
Conference Paper
Open access
XYXiaocui Yang
Xiaocui Yang
SFShi Feng
Shi Feng
DWDaling Wang
Daling Wang
YZYifei Zhang
Yifei Zhang
SPSoujanya Poria
Soujanya Poria
Multimodal sentiment analysis has gained significant attention due to the proliferation of multimodal content on social media. However, existing studies in this area rely heavily on large-scale supervised data, which is time-consuming and labor-intensive to collect. Thus, there is a need to address the challenge of few-shot multimodal sentiment analysis. To tackle this problem, we propose a novel method called Multimodal Probabilistic Fusion Prompts (MultiPoint) that leverages diverse cues from different modalities for multimodal sentiment detection in the few-shot scenario. Specifically, we start by introducing a Consistently Distributed Sampling approach called CDS, which ensures that the few-shot dataset has the same category distribution as the full dataset. Unlike previous approaches primarily using prompts based on the text modality, we design unified multimodal prompts to reduce discrepancies between different modalities and dynamically incorporate multimodal demonstrations into the context of each multimodal instance. To enhance the model's robustness, we introduce a probabilistic fusion method to fuse output predictions from multiple diverse prompts for each input. Our extensive experiments on six datasets demonstrate the effectiveness of our approach. First, our method outperforms strong baselines in the multimodal few-shot setting. Furthermore, under the same amount of data (1% of the full dataset), our CDS-based experimental results significantly outperform those based on previously sampled datasets constructed from the same number of instances of each class.

29 January 2018 in World Wide Web
Verified
Journal Article
Closed access
PDF file
SFShi Feng
Shi Feng
YWYang Wang
Yang Wang
LLLiran Liu
Liran Liu
DWDaling Wang
Daling Wang
GYGe Yu
Ge Yu

25 January 2026 in Knowledge-Based Systems
Verified
Journal Article
Closed access
YZYiqun Zhang
Yiqun Zhang
XYXiaocui Yang
Xiaocui Yang
XXXingle Xu
Xingle Xu
ZGZeran Gao
Zeran Gao
YHYijie Huang
Yijie Huang
GYGe Yu
Ge Yu

17 April 2025 in Information Fusion
Verified
Journal Article
Closed access
XYXiaocui Yang
Xiaocui Yang
WWWenfang Wu
Wenfang Wu
SFShi Feng
Shi Feng
MWMing Wang
Ming Wang
DWDaling Wang
Daling Wang
SPSoujanya Poria
Soujanya Poria