Wenhao Wu

Wenhao Wu

Auto-generated profile, based on publicly available information

Wenhao Wu

Baidu Inc

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
7 September 2023 in International Journal of Computer Vision
Verified
Journal Article
Open access
PDF file
WWWenhao Wu
Wenhao Wu
ZSZhun Sun
Zhun Sun
YSYuxin Song
Yuxin Song
JWJingdong Wang
Jingdong Wang
WOWanli Ouyang
Wanli Ouyang
Transferring knowledge from pre-trained deep models for downstream tasks, particularly with limited labeled samples, is a fundamental problem in computer vision research. Recent advances in large-scale, task-agnostic vision-language pre-trained models, which are learned with billions of samples, have shed new light on this problem. In this study, we investigate how to efficiently transfer aligned visual and textual knowledge for downstream visual recognition tasks. We first revisit the role of the linear classifier in the vanilla transfer learning framework, and then propose a new paradigm where the parameters of the classifier are initialized with semantic targets from the textual encoder and remain fixed during optimization. To provide a comparison, we also initialize the classifier with knowledge from various resources. In the empirical study, we demonstrate that our paradigm improves the performance and training speed of transfer learning tasks. With only minor modifications, our approach proves effective across 17 visual datasets that span three different data domains: image, video, and 3D point cloud.

7 February 2023 in Pattern Recognition Letters
Verified
Journal Article
Closed access
WGWanshui Gan
Wanshui Gan
WWWenhao Wu
Wenhao Wu
SCShifeng Chen
Shifeng Chen
YZYuxiang Zhao
Yuxiang Zhao
Pak Kin WongPak Kin Wong
Pak Kin Wong

9 September 2024 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
WWWenhao Wu
Wenhao Wu
XWXiaohan Wang
Xiaohan Wang
HLHaipeng Luo
Haipeng Luo
JWJingdong Wang
Jingdong Wang
YYYi Yang
Yi Yang
WOWanli Ouyang
Wanli Ouyang
Understanding videos, especially aligning them with textual data, presents a significant challenge in computer vision. The advent of vision-language models (VLMs) like CLIP has sparked interest in leveraging their capabilities for enhanced video understanding, showing marked advancements in both performance and efficiency. However, current methods often neglect vital user-generated metadata such as video titles. In this paper, we present Cap4Video++, a universal framework that leverages auxiliary captions to enrich video understanding. More recently, we witness the flourishing of large language models (LLMs) like ChatGPT. Cap4Video++ harnesses the synergy of vision-language models (VLMs) and large language models (LLMs) to generate video captions, utilized in three key phases: (i) Input stage employs Semantic Pair Sampling to extract beneficial samples from captions, aiding contrastive learning. (ii) Intermediate stage sees Video-Caption Cross-modal Interaction and Adaptive Caption Selection work together to bolster video and caption representations. (iii) Output stage introduces a Complementary Caption-Text Matching branch, enhancing the primary video branch by improving similarity calculations. Our comprehensive experiments on text-video retrieval and video action recognition across nine benchmarks clearly demonstrate Cap4Video++'s superiority over existing models, highlighting its effectiveness in utilizing automatically generated captions to advance video understanding.

23 March 2022 in Energy Reports
Verified
Journal Article
Open access
GZGuoqing Zeng
Guoqing Zeng
WWWenhao Wu
Wenhao Wu
GCGuobing Chen
Guobing Chen
JLJun Li
Jun Li
XWXuefeng Wang
Xuefeng Wang

22 May 2022 in arXiv
Verified
Preprint
Open access
PDF file
YLYihao Liu
Yihao Liu
ALAnran Liu
Anran Liu
JGJinjin Gu
Jinjin Gu
ZZZhipeng Zhang
Zhipeng Zhang
WWWenhao Wu
Wenhao Wu
CDChao Dong
Chao Dong
Image super-resolution (SR) is a representative low-level vision problem. Although deep SR networks have achieved extraordinary success, we are still unaware of their working mechanisms. Specifically, whether SR networks can learn semantic information, or just perform complex mapping function? What hinders SR networks from generalizing to real-world data? These questions not only raise our curiosity, but also influence SR network development. In this paper, we make the primary attempt to answer the above fundamental questions. After comprehensively analyzing the feature representations (via dimensionality reduction and visualization), we successfully discover the distinctive "semantics" in SR networks, i.e., deep degradation representations (DDR), which relate to image degradation instead of image content. We show that a well-trained deep SR network is naturally a good descriptor of degradation information. Our experiments also reveal two key factors (adversarial learning and global residual) that influence the extraction of such semantics. We further apply DDR in several interesting applications (such as distortion identification, blind SR and generalization evaluation) and achieve promising results, demonstrating the correctness and effectiveness of our findings.

30 May 2025 in arXiv
Verified
Preprint
Open access
PDF file
BFBo Fang
Bo Fang
WWWenhao Wu
Wenhao Wu
QWQiangqiang Wu
Qiangqiang Wu
YSYuxin Song
Yuxin Song
ACAntoni B. Chan
Antoni B. Chan
Employing Multimodal Large Language Models (MLLMs) for long video understanding remains a challenging problem due to the dilemma between the substantial number of video frames (i.e., visual tokens) versus the limited context length of language models. Traditional uniform sampling often leads to selection of irrelevant content, while post-training MLLMs on thousands of frames imposes a substantial computational burden. In this paper, we propose threading keyframes with narratives (Nar-KFC), a plug-and-play module to facilitate effective and efficient long video perception. Nar-KFC generally involves two collaborative steps. First, we formulate the keyframe selection process as an integer quadratic programming problem, jointly optimizing query-relevance and frame-diversity. To avoid its computational complexity, a customized greedy search strategy is designed as an efficient alternative. Second, to mitigate the temporal discontinuity caused by sparse keyframe sampling, we further introduce interleaved textual narratives generated from non-keyframes using off-the-shelf captioners. These narratives are inserted between keyframes based on their true temporal order, forming a coherent and compact representation. Nar-KFC thus serves as a temporal- and content-aware compression strategy that complements visual and textual modalities. Experimental results on multiple long-video benchmarks demonstrate that Nar-KFC significantly improves the performance of popular MLLMs. Code will be made publicly available.