Zijian Zhang

Mrs. Zijian Zhang

orcid

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
29 May 2022 in Entropy
Verified
Journal Article
Open access
PDF file
JLJiangfeng Li
Jiangfeng Li
ZZZijian Zhang
Zijian Zhang
BWbo wen wang
bo wen wang
QZQinpei Zhao
Qinpei Zhao
CZChenxi Zhang
Chenxi Zhang
Internet users are benefiting from technologies of abstractive summarization enabling them to view articles on the internet by reading article summaries only instead of an entire article. However, there are disadvantages to technologies for analyzing articles with texts and images due to the semantic gap between vision and language. These technologies focus more on aggregating features and neglect the heterogeneity of each modality. At the same time, the lack of consideration of intrinsic data properties within each modality and semantic information from cross-modal correlations result in the poor quality of learned representations. Therefore, we propose a novel Inter- and Intra-modal Contrastive Hybrid learning framework which learns to automatically align the multimodal information and maintains the semantic consistency of input/output flows. Moreover, ITCH can be taken as a component to make the model suitable for both supervised and unsupervised learning approaches. Experiments on two public datasets, MMS and MSMO, show that the ITCH performances are better than the current baselines.


14 October 2024
Verified
Conference Paper
Open access
TXTaofeng Xue
Taofeng Xue
ZLZhimin Lin
Zhimin Lin
ZZZijian Zhang
Zijian Zhang
LGLinsen Guo
Linsen Guo
HCHaoru Chen
Haoru Chen
PYPeng Yan
Peng Yan
With the explosive growth of online information, recommender systems have emerged as indispensable tools for navigating the complexities of content generation, discovery and consumption. The RecSys 2024 Challenge, organized by Ekstra Bladet, provides a comprehensive dataset and a robust news recommendation evaluation framework for tackling multifaceted challenges including modeling user preferences based on implicit behavior, accounting for the influence of the news agenda on user interests, and managing the rapid decay of news items. In this paper, we propose a novel Hierarchical User Interest Modeling (HUIM) approach to this challenge, leveraging both long-term invariant interests and short-term rapidly changing interests. Specifically, we utilize the multimodal representations along with the side information of items to distill the long-standing interests from user historical behaviors. By analyzing real-time context and user behavioral path patterns, we identify their fine-grained instant interests. Finally, an interest fusion network is proposed to adaptively fuse the long-term and short-term interests by contrasting the query-aware fine-grained behaviors with query-level cross entropy loss. Our team, BlackPearl, achieved a score of 0.8815 and ranked 2nd place on the final leaderboard.

8 August 2022 in arXiv
Verified
Preprint
Open access
PDF file
ZZZijian Zhang
Zijian Zhang
CSChang Shu
Chang Shu
YCYouxin Chen
Youxin Chen
JXJing Xiao
Jing Xiao
QZQian Zhang
Qian Zhang
ZLZheng Lu
Zheng Lu
Integrating multimodal knowledge for abstractive summarization task is a work-in-progress research area, with present techniques inheriting fusion-then-generation paradigm. Due to semantic gaps between computer vision and natural language processing, current methods often treat multiple data points as separate objects and rely on attention mechanisms to search for connection in order to fuse together. In addition, missing awareness of cross-modal matching from many frameworks leads to performance reduction. To solve these two drawbacks, we propose an Iterative Contrastive Alignment Framework (ICAF) that uses recurrent alignment and contrast to capture the coherences between images and texts. Specifically, we design a recurrent alignment (RA) layer to gradually investigate fine-grained semantical relationships between image patches and text tokens. At each step during the encoding process, cross-modal contrastive losses are applied to directly optimize the embedding space. According to ROUGE, relevance scores, and human evaluation, our model outperforms the state-of-the-art baselines on MSMO dataset. Experiments on the applicability of our proposed framework and hyperparameters settings have been also conducted.