Yingming Li

Yingming Li

Auto-generated profile, based on publicly available information

Yingming Li

College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, China

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 September 2018 in IEEE Transactions on Knowledge and Data Engineering
Verified
Journal Article
Closed access
YLYingming Li
Yingming Li
MYMing Yang
Ming Yang
ZZZhongfei Mark Zhang
Zhongfei Mark Zhang
Recently, multi-view representation learning has become a rapidly growing direction in machine learning and data mining areas. This paper introduces two categories for multi-view representation learning: multi-view representation alignment and multi-view representation fusion. Consequently, we first review the representative methods and theories of multi-view representation learning based on the perspective of alignment, such as correlation-based alignment. Representative examples are canonical correlation analysis (CCA) and its several extensions. Then from the perspective of representation fusion we investigate the advancement of multi-view representation learning that ranges from generative methods including multi-modal topic learning, multi-view sparse coding, and multi-view latent space Markov networks, to neural network-based methods including multi-modal autoencoders, multi-view convolutional neural networks and multi-modal recurrent neural networks. Further, we also investigate several important applications of multi-view representation learning. Overall, this survey aims to provide an insightful overview of theoretical foundation and state-of-the-art developments in the field of multi-view representation learning and to help researchers find the most appropriate tools for particular applications.

1 July 2020
Verified
Conference Paper
Open access
TJTao Jin
Tao Jin
SHSiyu Huang
Siyu Huang
MCMing Chen
Ming Chen
YLYingming Li
Yingming Li
ZZZhongfei Zhang
Zhongfei Zhang
In this paper, we focus on the problem of applying the transformer structure to video captioning effectively. The vanilla transformer is proposed for uni-modal language generation task such as machine translation. However, video captioning is a multimodal learning problem, and the video features have much redundancy between different time steps. Based on these concerns, we propose a novel method called sparse boundary-aware transformer (SBAT) to reduce the redundancy in video representation. SBAT employs boundary-aware pooling operation for scores from multihead attention and selects diverse features from different scenarios. Also, SBAT includes a local correlation scheme to compensate for the local information loss brought by sparse operation. Based on SBAT, we further propose an aligned cross-modal encoding scheme to boost the multimodal interaction. Experimental results on two benchmark datasets show that SBAT outperforms the state-of-the-art methods under most of the metrics.

1 December 2019 in Neurocomputing
Verified
Journal Article
Closed access
TJTao Jin
Tao Jin
YLYingming Li
Yingming Li
ZZZhongfei Zhang
Zhongfei Zhang

6 January 2025 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Verified
Journal Article
Open access
SCShanjuan Chen
Shanjuan Chen
YYYunlong Yu
Yunlong Yu
YLYingming Li
Yingming Li
Zhao WangZhao Wang
Zhao Wang
XLXi Li
Xi Li
JHJungong Han
Jungong Han
The Segment Anything Model (SAM), despite its remarkable performance in dense visual tasks, encounters a significant challenge in remote sensing image segmentation due to the intricate, multi-scale objects and vast landscapes present in remote sensing imagery. To address this challenge, this paper introduces a parameter-efficient fine-tuning approach that integrates Multi-Scale Adapters into the SAM image encoder for remote sensing image segmentation. By harnessing SAM's global modeling capabilities and marrying it with multi-scale feature hierarchies, our proposed method maintains a consistent channel capacity and resolution throughout the entire network, thereby mitigating textural information loss resulting from spatial resolution downgrades. Furthermore, these adapters facilitate the interaction of features from regions of varying sizes, enabling the perception of features at multiple scales. Extensive experiments conducted on five benchmark remote sensing segmentation datasets demonstrate that our proposed method achieves state-of-the-art performance while significantly reducing the number of optimized parameters, highlighting its effectiveness and efficiency. Our code is available at https://github. com/mint0126/Mult-scale-SAM.

4 October 2019 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
KLKejie Lyu
Kejie Lyu
YLYingming Li
Yingming Li
ZZZhongfei Zhang
Zhongfei Zhang
Multi-task deep learning methods learn multiple tasks simultaneously and share representations amongst them, so information from related tasks improves learning within one task. The generalization capabilities of the produced models are substantially enhanced. Typical multi-task deep learning models usually share representations of different tasks in lower layers of the network, and separate representations of different tasks in higher layers. However, different groups of tasks always have different requirements for sharing representations, so the required design criterion does not necessarily guarantee that the obtained network architecture is optimal. In addition, most existing methods ignore the redundancy problem and lack the pre-screening process for representations before they are shared. Here, we propose a model called Attention-aware Multi-task Convolutional Neural Network, which automatically learns appropriate sharing through end-to-end training. The attention mechanism is introduced into our architecture to suppress redundant contents contained in the representations. The shortcut connection is adopted to preserve useful information. We evaluate our model by carrying out experiments on different task groups and different datasets. Our model demonstrates an improvement over existing techniques in many experiments, indicating the effectiveness and the robustness of the model. We also demonstrate the importance of attention mechanism and shortcut connection in our model.

1 January 2019
Verified
Conference Paper
Open access
PDF file
TJTao Jin
Tao Jin
SHSiyu Huang
Siyu Huang
YLYingming Li
Yingming Li
ZZZhongfei Zhang
Zhongfei Zhang
Tao Jin, Siyu Huang, Yingming Li, Zhongfei Zhang. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019.