Yunfan Ye

Mr. Yunfan Ye


Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 April 2024 in Computational Visual Media
Verified
Journal Article
Open access
PDF file
ZGZhirui Gao
Zhirui Gao
RYRenjiao Yi
Renjiao Yi
ZQZheng Qin
Zheng Qin
YYYunfan Ye
Yunfan Ye
CZChenyang Zhu
Chenyang Zhu
Kai XuKai Xu
Kai Xu
Template matching is a fundamental task in computer vision and has been studied for decades. It plays an essential role in manufacturing industry for estimating the poses of different parts, facilitating downstream tasks such as robotic grasping. Existing methods fail when the template and source images have different modalities, cluttered backgrounds, or weak textures. They also rarely consider geometric transformations via homographies, which commonly exist even for planar industrial parts. To tackle the challenges, we propose an accurate template matching method based on differentiable coarse-to-fine correspondence refinement. We use an edge-aware module to overcome the domain gap between the mask template and the grayscale image, allowing robust matching. An initial warp is estimated using coarse correspondences based on novel structure-aware information provided by transformers. This initial alignment is passed to a refinement network using references and aligned images to obtain sub-pixel level correspondences which are used to give the final geometric transformation. Extensive evaluation shows that our method to be significantly better than state-of-the-art methods and baselines, providing good generalization ability and visually plausible results even on unseen real data.

23 September 2023 in Multimedia Systems
Verified
Journal Article
Closed access
PDF file
BZBaoying Zheng
Baoying Zheng
FLFang Liu
Fang Liu
MZMohan Zhang
Mohan Zhang
TZTongqing Zhou
Tongqing Zhou
SCShenglan Cui
Shenglan Cui
YGYeting Guo
Yeting Guo

25 April 2024 in arXiv
Verified
Preprint
Open access
PDF file
CRChangjuan Ran
Changjuan Ran
YGYeting Guo
Yeting Guo
FLFang Liu
Fang Liu
SCShenglan Cui
Shenglan Cui
YYYunfan Ye
Yunfan Ye
The unique artistic style is crucial to artists' occupational competitiveness, yet prevailing Art Commission Platforms rarely support style-based retrieval. Meanwhile, the fast-growing generative AI techniques aggravate artists' concerns about releasing personal artworks to public platforms. To achieve artistic style-based retrieval without exposing personal artworks, we propose FedStyle, a style-based federated learning crowdsourcing framework. It allows artists to train local style models and share model parameters rather than artworks for collaboration. However, most artists possess a unique artistic style, resulting in severe model drift among them. FedStyle addresses such extreme data heterogeneity by having artists learn their abstract style representations and align with the server, rather than merely aggregating model parameters lacking semantics. Besides, we introduce contrastive learning to meticulously construct the style representation space, pulling artworks with similar styles closer and keeping different ones apart in the embedding space. Extensive experiments on the proposed datasets demonstrate the superiority of FedStyle.