Qu Yang

Qu Yang

orcid

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
2 August 2023 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
QYQu Yang
Qu Yang
Mang YeMang Ye
Mang Ye
ZCZhaohui Cai
Zhaohui Cai
KSKehua Su
Kehua Su
BDBo Du
Bo Du
Composing Text and Image to Image Retrieval (CTI-IR) aims at finding the target image, which matches the query image visually along with the query text semantically. However, existing works ignore the fact that the reference text usually serves multiple functions, e.g., modification and auxiliary. To address this issue, we put forth a unified solution, namely Hierarchical Aggregation Transformer incorporated with Cross Relation Network (CRN). CRN unifies modification and relevance manner in a single framework. This configuration shows broader applicability, enabling us to model both modification and auxiliary text or their combination in triplet relationships simultaneously. Specifically, CRN includes: 1) Cross Relation Network comprehensively captures the relationships of various composed retrieval scenarios caused by two different query text types, allowing a unified retrieval model to designate adaptive combination strategies for flexible applicability; 2) Hierarchical Aggregation Transformer aggregates top-down features with Multi-layer Perceptron (MLP) to overcome the limitations of edge information loss in a window-based multi-stage Transformer. Extensive experiments demonstrate the superiority of the proposed CRN over all three fashion-domain datasets. Code is available at github.com/yan9qu/crn.


18 November 2025 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
QYQu Yang
Qu Yang
Mang YeMang Ye
Mang Ye
DTDacheng Tao
Dacheng Tao
Holistic Visual Understanding (HVU), encompassing tasks like intention recognition, emotion analysis, scene understanding, and content moderation, necessitates integrating low-level visual perception (‘sight’) with high-level semantic reasoning (‘semantics’). While large Vision-Language Models (VLMs) like CLIP offer powerful representations, their inherent ‘sight’ bias limits their direct application to these semantically rich tasks. Our prior work, IntCLIP, addressed Multi-label Intention Understanding (MIU) using a dual-branch architecture but faced challenges with label generation instability (Hierarchical Class Integration - HCI) and limited feature interaction (unidirectional Sight-assisted Aggregation). This paper introduces an enhanced framework that significantly extends IntCLIP to tackle the broader HVU challenge. We propose Semantic Label Refinement (SLR), an iterative, metric-guided process leveraging Large Language Models (LLMs) and quantitative evaluation within the CLIP embedding space to generate stable, optimized semantic labels. We also introduce a novel bidirectional attention mechanism (Symmetric Aggregation) that enables balanced, mutual refinement between sight and semantic feature maps. By evaluating on a comprehensive benchmark spanning MIU, Image Emotion Recognition, Indoor Scene Recognition, and Visual Content Moderation, we demonstrate that our framework not only advances the state-of-the-art in MIU but also achieves superior performance across diverse HVU tasks. This framework provides a unified and robust solution for synergizing sight and semantics, pushing towards more human-like visual intelligence. Code is available at https://github.com/yan9qu/PAMI25-HVU.

1 January 2026 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
XLXiyang Li
Xiyang Li
QYQu Yang
Qu Yang
YYYuwendong Yin
Yuwendong Yin
HLHe Li
He Li
Mang YeMang Ye
Mang Ye