Shengxiang Gao

Dr. Shengxiang Gao


Research Focus & Metrics

Academic Career Length

21Years (2006-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 March 2019 in Neurocomputing
Verified
Journal Article
Closed access
SGShengxiang Gao
Shengxiang Gao
ZYZhengtao Yu
Zhengtao Yu
TJTaisong Jin
Taisong Jin
MYMing Yin
Ming Yin

21 March 2022 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
YTYunbin Tu
Yunbin Tu
Liang LiLiang Li
Liang Li
LSLi Su
Li Su
SGShengxiang Gao
Shengxiang Gao
CYChenggang Yan
Chenggang Yan
QHQingming Huang
Qingming Huang
TV show captioning aims to generate a linguistic sentence based on the video and its associated subtitle. Compared to purely video-based captioning, the subtitle can provide the captioning model with useful semantic clues such as actors’ sentiments and intentions. However, the effective use of subtitle is also very challenging, because it is the pieces of scrappy information and has semantic gap with visual modality. To organize the scrappy information together and yield a powerful omni-representation for all the modalities, an efficient captioning model requires understanding video contents, subtitle semantics, and the relations in between. In this paper, we propose an Intra- and Inter-relation Embedding Transformer (I 2 Transformer), consisting of an Intra-relation Embedding Block (IAE) and an Inter-relation Embedding Block (IEE) under the framework of a Transformer. First, the IAE captures the intra-relation in each modality via constructing the learnable graphs. Then, IEE learns the cross attention gates, and selects useful information from each modality based on their inter-relations, so as to derive the omni-representation as the input to the Transformer. Experimental results on the public dataset show that the I 2 Transformer achieves the state-of-the-art performance. We also evaluate the effectiveness of the IAE and IEE on two other relevant tasks of video with text inputs, i.e. , TV show retrieval and video-guided machine translation. The encouraging performance further validates that the IAE and IEE blocks have a good generalization ability. The code is available at https://github.com/tuyunbin/I2Transformer .

23 February 2023 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
SYShengbin Yue
Shengbin Yue
YTYunbin Tu
Yunbin Tu
Liang LiLiang Li
Liang Li
YYYing Yang
Ying Yang
SGShengxiang Gao
Shengxiang Gao
ZYZhengtao Yu
Zhengtao Yu
Change captioning aims to describe the disagreement of image pairs with a linguistic sentence. Compared with single image captioning, change captioning requires not only understanding the fine-grained information of each image, but also determining whether change occurs and further representing the differences of image pairs. Although much progress has been made, it remains a severe challenge of the precise difference representation in the distraction of viewpoint change, especially that of tiny difference. In this paper, we propose a novel Intra- and Inter-representation Interaction Network (I3N) to learn the fine difference representation and be immune to viewpoint change. In the Intra-representation Interaction stage, we design Geometry-Semantic Interaction Refining (GSIR) to explore the positional and semantic interactions of intra-image, which can be a prior knowledge of enduring viewpoint change and reinforce the cognition of semantic change. In the Inter-representation Interaction stage, to endow the model with the capability of pinpointing the latent difference in viewpoint change, Hierarchical Representation Interaction (HRI) models difference from coarse to fine representations through the Semantic Matcher and Change Amplifier module. The proposed approach outperforms the state-of-the-art methods with an encouraging performance on the existing change captioning benchmarks. Our code is available at https://github.com/yueshengbin/I3N .

1 January 2021
Verified
Conference Paper
Open access
PDF file
YTYunbin Tu
Yunbin Tu
Liang LiLiang Li
Liang Li
CYChenggang Yan
Chenggang Yan
SGShengxiang Gao
Shengxiang Gao
ZYZhengtao Yu
Zhengtao Yu
Yunbin Tu, Liang Li, Chenggang Yan, Shengxiang Gao, Zhengtao Yu. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. 2021.

3 July 2023 in Neurocomputing
Verified
Journal Article
Open access
BLBin Li
Bin Li
ZSZhenqiu Shu
Zhenqiu Shu
YLYingbo Liu
Yingbo Liu
CMCunli Mao
Cunli Mao
SGShengxiang Gao
Shengxiang Gao
ZYZhengtao Yu
Zhengtao Yu

12 October 2015 in IEEE/CAA Journal of Automatica Sinica
Verified
Journal Article
Closed access
SGShengxiang Gao
Shengxiang Gao
ZYZhengtao Yu
Zhengtao Yu
LSLinbin Shi
Linbin Shi
XYXin Yan
Xin Yan
HSHaixia Song
Haixia Song
The project review information plays an important role in the recommendation of review experts. In this paper, we aim to determine review expert's rating by using the historical rating records and the final decision results on the previous projects, and by means of some rules, we construct a rating matrix for projects and experts. For the data sparseness problem of the rating matrix and the "cold start" problem of new expert recommendation, we assume that those projects/experts with similar topics have similar feature vectors and propose a review expert collaborative recommendation algorithm based on topic relationship. Firstly, we obtain topics of projects/experts based on latent Dirichlet allocation (LDA) model, and build the topic relationship network of projects/experts. Then, through the topic relationship between projects/experts, we find a neighbor collection which shares the largest similarity with target project/expert, and integrate the collection into the collaborative filtering recommendation algorithm based on matrix factorization. Finally, by learning the rating matrix to get feature vectors of the projects and experts, we can predict the ratings that a target project will give candidate review experts, and thus achieve the review expert recommendation. Experiments on real data set show that the proposed method could predict the review expert rating more effectively, and improve the recommendation effect of review experts.