Jingbo Zhu

Jingbo Zhu

Auto-generated profile, based on publicly available information

Jingbo Zhu

School of Computer Science and Engineering Northeastern University Shenyang China

Research Focus & Metrics

Academic Career Length

22Years (2005-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2019
Verified
Conference Paper
Open access
PDF file
YJYufan Jiang
Yufan Jiang
CHChi Hu
Chi Hu
TXTong Xiao
Tong Xiao
CZChunliang Zhang
Chunliang Zhang
JZJingbo Zhu
Jingbo Zhu
Yufan Jiang, Chi Hu, Tong Xiao, Chunliang Zhang, Jingbo Zhu. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019.

1 August 2023
Verified
Conference Paper
Open access
PDF file
CXChen Xu
Chen Xu
RYRong Ye
Rong Ye
QDQianqian Dong
Qianqian Dong
CZChengqi Zhao
Chengqi Zhao
TKTom Ko
Tom Ko
JZJingbo Zhu
Jingbo Zhu
Recently, speech-to-text translation has attracted more and more attention and many studies have emerged rapidly. In this paper, we present a comprehensive survey on direct speech translation aiming to summarize the current state-of-the-art techniques. First, we categorize the existing research work into three directions based on the main challenges --- modeling burden, data scarcity, and application issues. To tackle the problem of modeling burden, two main structures have been proposed, encoder-decoder framework (Transformer and the variants) and multitask frameworks. For the challenge of data scarcity, recent work resorts to many sophisticated techniques, such as data augmentation, pre-training, knowledge distillation, and multilingual modeling. We analyze and summarize the application issues, which include real-time, segmentation, named entity, gender bias, and code-switching. Finally, we discuss some promising directions for future work.

1 January 2024
Verified
Conference Paper
Open access
PDF file
CWChenglong Wang
Chenglong Wang
HZHang Zhou
Hang Zhou
KCKaiyan Chang
Kaiyan Chang
BLBei Li
Bei Li
YMYongyu Mu
Yongyu Mu
JZJingBo Zhu
JingBo Zhu
Chenglong Wang, Hang Zhou, Kaiyan Chang, Bei Li, Yongyu Mu, Tong Xiao, Tongran Liu, JingBo Zhu. Findings of the Association for Computational Linguistics ACL 2024. 2024.

26 June 2023 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
ARAbudurexiti Reheman
Abudurexiti Reheman
TZTao Zhou
Tao Zhou
YLYingfeng Luo
Yingfeng Luo
DYDi Yang
Di Yang
TXTong Xiao
Tong Xiao
JZJingbo Zhu
Jingbo Zhu
Improving machine translation (MT) systems with translation memories (TMs) is of great interest to practitioners in the MT community. However, previous approaches require either a significant update of the model architecture and/or additional training efforts to make the models well-behaved when TMs are taken as additional input. In this paper, we present a simple but effective method to introduce TMs into neural machine translation (NMT) systems. Specifically, we treat TMs as prompts to the NMT model at test time, but leave the training process unchanged. The result is a slight update of an existing NMT system, which can be implemented in a few hours by anyone who is familiar with NMT. Experimental results on several datasets demonstrate that our system significantly outperforms strong baselines.

1 January 2025
Verified
Conference Paper
Open access
PDF file
YLYingfeng Luo
Yingfeng Luo
TZTong Zheng
Tong Zheng
YMYongyu Mu
Yongyu Mu
BLBei Li
Bei Li
QZQinghong Zhang
Qinghong Zhang
JZJingBo Zhu
JingBo Zhu
Yingfeng Luo, Tong Zheng, Yongyu Mu, Bei Li, Qinghong Zhang, Yongqi Gao, Ziqiang Xu, Peinan Feng, Xiaoqian Liu, Tong Xiao, JingBo Zhu. Findings of the Association for Computational Linguistics: ACL 2025. 2025.

11 April 2025 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
CWChenglong Wang
Chenglong Wang
YGYang Gan
Yang Gan
YHYifu Huo
Yifu Huo
YMYongyu Mu
Yongyu Mu
MYMurun Yang
Murun Yang
JZJingbo Zhu
Jingbo Zhu
Large vision-language models (LVLMs) often fail to align with human preferences, leading to issues like generating misleading content without proper visual context (also known as hallucination). A promising solution to this problem is using human-preference alignment techniques, such as best-of-n sampling and reinforcement learning. However, these techniques face the difficulty arising from the scarcity of visual preference data, which is required to train a visual reward model (VRM). In this work, we continue the line of research. We present a Robust Visual Reward Model (RoVRM) which improves human-preference alignment for LVLMs. RoVRM leverages auxiliary textual preference data through a three-phase progressive training and optimal transport-based preference data selection to effectively mitigate the scarcity of visual preference data. We experiment with RoVRM on the commonly used vision-language tasks based on the LLaVA-1.5-7B and -13B models. Experimental results demonstrate that RoVRM consistently outperforms traditional VRMs. Furthermore, our three-phase progressive training and preference data selection approaches can yield consistent performance gains over ranking-based alignment techniques, such as direct preference optimization.