Yang Zhang

Yang Zhang

Auto-generated profile, based on publicly available information

Yang Zhang

DT, Hitachi, China

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
23 August 2023 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
YXYulai Xie
Yulai Xie
JNJingjing Niu
Jingjing Niu
YZYang Zhang
Yang Zhang
FRFang Ren
Fang Ren
Dense video captioning aims to detect all events of an uncropped video and generate corresponding textual captions for each event. Multi-modal information is essential to improve the performance of this task, but the existing methods mainly rely on the single visual or dual audio-visual modal input, while completely ignoring the text modal input (subtitle). Since the text data has a similar data representation as video caption words, it is conducive to the performance improvement of video captioning. In this paper, we propose a novel framework, called the multi-stage fusion transformer network (MS-FTN), to realize multi-modal dense video captioning by fusing the text, the audio, and the visual features in stages. We present a multi-stage feature fusion encoder that first fuses audio and visual modalities at a lower level and then fuses them with a global-shared text representation at a higher level to generate a set of multi-modal complementary context features. In addition, an anchor-free event proposal module is proposed to efficiently generate a set of event proposals without the complex anchor calculation. Extensive experiments on the subsets of the ActivityNet Captions dataset show that our proposed MS-FTN achieves superior performance and efficient computation. Moreover, the ablation studies demonstrate that the global-shared text representation is more suitable for multi-modal dense video captioning. Our code and data are available at https://github.com/xieyulai/GS-MS-FTN .

15 October 2025 in Knowledge-Based Systems
Verified
Journal Article
Closed access
YXYulai Xie
Yulai Xie
XPXiaoning Pi
Xiaoning Pi
YZYang Zhang
Yang Zhang
FRFang Ren
Fang Ren

16 June 2023
Verified
Conference Paper
Open access
XWXiaohui Wang
Xiaohui Wang
YXYulai Xie
Yulai Xie
YZYang Zhang
Yang Zhang
XPXiaoning Pi
Xiaoning Pi
FRFang Ren
Fang Ren

3 October 2023 in ACM Transactions on Intelligent Systems and Technology
Verified
Journal Article
Open access
ZHZhenyu Han
Zhenyu Han
SMSiran Ma
Siran Ma
CGChangzheng Gao
Changzheng Gao
ESErzhuo Shao
Erzhuo Shao
YXYulai Xie
Yulai Xie
YLYong Li
Yong Li
As the rapid-spreading disease COVID-19 occupies the world, most governments adopt strict control policies to alleviate the impact of the virus. These policies successfully reduced the prevalence and delayed the epidemic peak, while they are also associated with high economic and social costs. To bridge the microscopic epidemic transmission patterns and control policies, simulation systems play an important role. In this work, we propose an agent-based disease simulator for indoor public spaces, which contribute to most of the transmission in cities. As an example, we study Guangzhou Baiyun International Airport, which is one of the most bustling aviation hubs in China. Specifically, we design a high-efficiency mobility generation module to reconstruct the individual trajectories considering both lingering behavior and crowd mobility, which greatly enhances the credibility of the simulated mobility and ensures real-time performance. Based on the individual trajectories, we propose a multi-path disease transmission module optimized for indoor public spaces, which includes three main transmission paths as close contact transmission, aerosol transmission, and object surface transmission. We design a novel convolution-based algorithm to mimic the diffusion process, which can leverage the high concurrent capability of the graphics processing unit to accelerate the simulation process. Leveraging our simulation paradigm, the effectiveness of common policy interventions can be quantitatively evaluated. For mobility interventions, we find that lingering control is the most effective mobility intervention with 32.35% fewer infections, while increasing social distance and increasing walking speed have a similar effect with 15.15% and 18.02% fewer infections. It demonstrates the importance of introducing crowd mobility into disease transmission simulation. For transmission processes, we find the aerosol transmission involves in 99.99% of transmission, which highlights the importance of ventilation in indoor public spaces. Our simulation also demonstrates that without strict entrance detection to identify the input infections, only performing frequent disinfection cannot achieve desirable epidemic outcomes. Based on our simulation paradigm, we can shed light on better policy designs that achieve a good balance between disease spreading control and social costs.

21 June 2024
Verified
Conference Paper
Open access
XPXiaoNing Pi
XiaoNing Pi
YXYuLai Xie
YuLai Xie
YZYang Zhang
Yang Zhang
XWXiaoHui Wang
XiaoHui Wang
FRFang Ren
Fang Ren
In industrial production, visual defect inspection is crucial for ensuring product quality. However, due to difficulties in sample collection during defect inspection, there is often a scarcity of diverse defective samples, leading most data generation methods to fail in generating high-diversity data. Therefore, this paper proposes the Automatic Iterative Diversity Improvement training strategy to improve the diversity of generated data with only a few training samples, which can improve the performance and generalization of downstream tasks. During the training process, given the characteristics of visual defects, we design the Defect Diversity-based Picking and Evaluation to pick up diverse samples and assess the diversity regarding defect location and shape. Experiments show that the method can generate high-diversity defect samples with high quality for industrial defect scenarios even in zero-shot learning tasks. The effectiveness of the generated data is also verified by the down-streaming defect detection task.

28 February 2023 in ACM Transactions on Intelligent Systems and Technology
Verified
Journal Article
Open access
ESErzhuo Shao
Erzhuo Shao
ZHZhenyu Han
Zhenyu Han
YXYulai Xie
Yulai Xie
YZYang Zhang
Yang Zhang
LGLu Geng
Lu Geng
YLYong Li
Yong Li
Individual trajectory generation plays an important role in simulation tasks, reconstructing fine-grained mobility behaviors that can be used to evaluate epidemic risks, congestion risks, or commercial profit. Previous research works adopt the Newton’s mechanic-based particle model as their core algorithm, such as the Social Force model. However, real-world human mobility behaviors hardly follow the particle models, especially in the interior scenes where interactions between pedestrians and environments matter. In this article, we propose a Social Force-based trajectory simulator for interior scenarios that improve both trajectory quality and generation speed for interior scenarios. First, we introduce prior scene knowledge to guide the generation process, where pedestrians are armed with exploration behaviors that follow the group-level distribution. It provides more flexibility to simulate complicated human behaviors rather than straight-line movements, generating high-quality individual trajectories. Experiments show that the correlation between the aggregated population distribution of generated trajectories and ground-truth distribution is improved by 11.84% by our method. Second, we optimize the algorithm procedure by introducing a caching mechanism for tenderized intermediate values, along with graph-processing-unit-based implementation. Compared with the baseline Social Force model, we reduced the time consumption by 95%. More importantly, based on our simulation paradigm, we quantitatively evaluate several common mobility interventions in our simulation scenario, which can shed light on better policy designs in public spaces.