Junjun Guo

Dr. Junjun Guo


Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
3 March 2022 in Applied Intelligence
Verified
Journal Article
Closed access
PDF file
JYJunjie Ye
Junjie Ye
JGJunjun Guo
Junjun Guo


2 August 2023 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Verified
Journal Article
Closed access
JGJunjun Guo
Junjun Guo
JYJunjie Ye
Junjie Ye
YXYan Xiang
Yan Xiang
ZYZhengtao Yu
Zhengtao Yu
Multi-modal neural machine translation (MNMT) aims to translate sentences from the source language into the target language with the aid of corresponding images. Unfortunately, there is a considerable modality gap between the semantic-related images and texts in terms of data form and semantic expression. How to fully incorporate visual information into texts to enhance the performance of machine translation is one of the critical issues for MNMT. However, the initial visual and textual features are generally extracted with their modality-specific models; Consequently, there is a considerable representation gap between images and texts. Most previous MNMT works prefer only to adopt the feature-level fusion strategies to learn multi-modal representation, while the modality representation gap is often ignored. To this end, this paper proposes a progressive multi-modal Transformer (ProMul-Trans) with Modality Difference-Aware (MDA) to address the visual-to-textual fusion problem raised in MNMT. We first employ MDA to capture the modality-consistency information by taking visual and textual representations as inputs in each Transformer layer. Then a layer-level progressive fusion (Layer-ProFusion) strategy is adopted to progressively align visual and textual representations layer-by-layer to enhance machine translation performance. Experiment results on the Multi30k dataset are conducted, and the results show that the proposed approach outperforms the compared state-of-the-art (SOTA) methods on English $\rightarrow$ German (En $\rightarrow$ De), English $\rightarrow$ French (En $\rightarrow$ Fr) and English $\rightarrow$ Czech (En $\rightarrow$ Cs) tasks. We release the code at https://github.com/JunjieYe-MMT/HierProMul-Trans .

11 May 2023 in Neural Networks
Verified
Journal Article
Closed access
YXYan Xiang
Yan Xiang
JZJiqun Zhang
Jiqun Zhang
JGJunjun Guo
Junjun Guo

10 May 2023 in Frontiers in Physics
Verified
Journal Article
Open access
YXYan Xiang
Yan Xiang
YCYunjia Cai
Yunjia Cai
JGJunjun Guo
Junjun Guo
Multimodal aspect-based sentiment classification (MABSC) aims to determine the sentiment polarity of a given aspect in a sentence by combining text and image information. Although the text and the corresponding image in a sample are associated with aspect information, their features are represented in distinct semantic spaces, creating a substantial semantic gap. Previous research focused primarily on identifying and fusing aspect-level sentiment expressions of different modalities while ignoring their semantic gap. To this end, we propose a novel aspect-based sentiment analysis model named modality smoothing fusion network (MSFNet). In this model, we process the unimodal aspect-aware features via the feature smoothing strategy to partially bridge modality gap. Then we fuse the smoothed features deeply using the multi-channel attention mechanism, to obtain aspect-level sentiment representation with comprehensive representing capability, thereby improving the performance of sentiment classification. Experiments on two benchmark datasets, Twitter2015 and Twitter2017, demonstrate that our model outperforms the second-best model by 1.96% and 0.19% in terms of Macro-F1, respectively. Additionally, ablation studies provide evidence supporting the efficacy of each of our proposed modules. We release the code at: https://github.com/YunjiaCai/MSFNet.

25 April 2024 in International Journal of Machine Learning and Cybernetics
Verified
Journal Article
Closed access
PDF file
XZXuhui Zhuang
Xuhui Zhuang
SGShengxiang Gao
Shengxiang Gao
ZYZhengtao Yu
Zhengtao Yu
JGJunjun Guo
Junjun Guo
XWXiaoCong Wang
XiaoCong Wang