Yizhang Jin

Yizhang Jin

Auto-generated profile, based on publicly available information

Yizhang Jin

Shanghai Jiao Tong University, Shanghai, China

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
9 December 2025 in Visual Intelligence
Verified
Journal Article
Open access
PDF file
YJYizhang Jin
Yizhang Jin
JLJian Li
Jian Li
TGTianjun Gu
Tianjun Gu
YLYexin Liu
Yexin Liu
BZBo Zhao
Bo Zhao
LMLizhuang Ma
Lizhuang Ma
In the past years, multimodal large language models (MLLMs) have demonstrated remarkable performance in tasks such as visual question answering and visual understanding and reasoning. However, the extensive model size and high training and inference costs have hindered the widespread application of MLLMs in academia and industry. Thus, studying efficient and lightweight MLLMs has enormous potential, especially in edge computing scenarios. In this survey, we provide a comprehensive and systematic review of the current state of efficient MLLMs. Specifically, this survey summarizes the timeline of representative efficient MLLMs, the current state of research in structures and strategies, and the applications. Finally, the limitations of current efficient MLLM research and promising future directions are discussed.

28 October 2024
Verified
Conference Paper
Open access
YJYizhang Jin
Yizhang Jin
JLJian Li
Jian Li
JZJiangning Zhang
Jiangning Zhang
JHJianlong Hu
Jianlong Hu
ZGZhenye Gan
Zhenye Gan
LMLizhuang Ma
Lizhuang Ma
Visual Spatial Description (VSD) aims to generate texts that describe the spatial relationships between objects within images. Traditional visual spatial relationship classification (VSRC) methods typically output the spatial relationship between two objects in an image, often neglecting world knowledge and lacking general language capabilities. In this paper, we propose a Large Language-and-Vision Assistant for Visual Spatial Description, named LLaVA-VSD, which is designed for the classification, description, and open-ended description of visual spatial relationships. Specifically, the model first constructs a visual spatial instruction-following dataset using given figure-caption pairs for the three tasks. It then employs LoRA to fine-tune a Large Language and Vision Assistant for VSD, which has 13 billion parameters and supports high-resolution images. Finally, a large language model is used to refine the generated sentences, enhancing their diversity and accuracy. LLaVA-VSD demonstrates excellent multimodal conversational capabilities and can follow open-ended instructions to assist with inquiries about object relationships in images.