Yujia Wang

Yujia Wang

Auto-generated profile, based on publicly available information

Yujia Wang

Zhejiang Sci-Tech University (ZSTU), Hangzhou, China

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2024
Verified
Conference Paper
Open access
PDF file
YTYongqi Tong
Yongqi Tong
DLDawei Li
Dawei Li
SWSizhe Wang
Sizhe Wang
YWYujia Wang
Yujia Wang
FTFei Teng
Fei Teng
JSJingbo Shang
Jingbo Shang
Yongqi Tong, Dawei Li, Sizhe Wang, Yujia Wang, Fei Teng, Jingbo Shang. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.

1 October 2019 in Pattern Recognition
Verified
Journal Article
Closed access
YWYujia Wang
Yujia Wang
WLWei Liang
Wei Liang
JSJianbing Shen
Jianbing Shen
YJYunde Jia
Yunde Jia
LYLap-Fai Yu
Lap-Fai Yu

23 August 2024 in Computer Vision and Image Understanding
Verified
Journal Article
Closed access
YWYujia Wang
Yujia Wang
HHHua Huang
Hua Huang

28 October 2024
Verified
Conference Paper
Open access
ZWZhongxu Wang
Zhongxu Wang
YWYujia Wang
Yujia Wang
MLMingzhu Li
Mingzhu Li
HHHua Huang
Hua Huang
We devise an articulatory representation-based text-to-speech (TTS) model, ArtSpeech, an explainable and effective network for human-like speech synthesis, by revisiting the sound production system. Current deep TTS models learn acoustic-text mapping in a fully parametric manner, ignoring the explicit physical significance of articulation movement. ArtSpeech, on the contrary, leverages articulatory representations to perform adaptive TTS, clearly describing the voice tone and speaking prosody of different speakers. Specifically, energy, F0, and vocal tract variables are utilized to represent airflow forced by articulatory organs, the degree of tension in the vocal folds of the larynx, and the coordinated movements between different organs, respectively. We also design a multi-dimensional style mapping network to extract speaking styles from the articulatory representations, guided by which variation predictors could predict the final mel spectrogram output. To validate the effectiveness of our approach, we conducted comprehensive experiments and analyses using the widely recognized speech corpus, such as LJSpeech and LibriTTS datasets, yielding promising similarity enhancement between the generated results and the target speaker's voice and prosody.

28 October 2024
Verified
Conference Paper
Open access
YWYujia Wang
Yujia Wang
ZWZhongxu Wang
Zhongxu Wang
HHHua Huang
Hua Huang
Sound Effect (SFX) generation, primarily aims to automatically produce sound waves for sounding visual objects in images or videos. Rather than learning an automatic solution to this task, we aim to propose a much broader system, AutoSFX, designed to automate sound design for videos in a more efficient and applicable manner. AutoSFX capitalizes on this concept by aggregating multimodal representations by cross-attention and leverages a diffusion model to generate sound with visual information embedded. AutoSFX also optimizes the generated sounds to render the entire soundtrack for the input video, leading to a more immersive and engaging multimedia experience by performing seamless transitions between sound clips and harmoniously mixing sounds playing simultaneously. We have developed a user-friendly interface for AutoSFX enabling users to interactively engage in the SFX generation for their videos with particular needs. To validate the capability of our vision-to-sound generation, we conducted comprehensive experiments and analyses using the widely recognized VEGAS and VGGSound test sets, yielding promising results. We also conducted a user study to evaluate the performance of the optimized soundtrack and the usability of the interface. Overall, the results revealed that our AutoSFX provides a viable sound landscape solution for making attractive videos.

7 November 2025 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
LYLu Yang
Lu Yang
LLLiulei Li
Liulei Li
JWJianan Wei
Jianan Wei
PCPu Cao
Pu Cao
YWYujia Wang
Yujia Wang
Wenguan WangWenguan Wang
Wenguan Wang
Location determination finds wide applications in daily life. Instead of existing efforts devoted to localizing tourist photos captured by perspective cameras, in this article, we focus on devising person positioning solutions using fisheye cameras mounted overhead. Such solutions are advantageous in large field of view (FOV), low cost, anti-occlusion, and unaggressive work mode (without the necessity of cameras carried by persons). However, related studies are quite scarce, due to the paucity of data. To stimulate research in this exciting area, we present LOAF, the first large-scale overhead fisheye dataset for person detection and localization. LOAF is built with many essential features, e.g., i) the data cover abundant diversities in scenes, human pose, density, and location; ii) it contains currently the largest number of annotated pedestrian, i.e., 457K bounding boxes with ground-truth orientation and location information; iii) the body-boxes are labeled as radius-aligned so as to fully address the positioning challenge. To approach localization, we build a fisheye person detection network, which exploits the geometry of fisheye images from rotation-equivariance and distortion-awareness two perspectives. Corresponding training strategies are devised to deliver high accuracy, radius-aligned human box and angle predictions in an end-to-end manner. Then, the actual locations of the detected persons are calculated by a numerical solution on the fisheye model and camera altitude data. Extensive experiments on LOAF validate the superiority of our fisheye detector w.r.t. previous methods. This demonstrates that our whole fisheye positioning solution is able to locate all persons in FOV with an accuracy of 0.5 m within 0.1 s.