Yunlong Tang

Yunlong Tang

Auto-generated profile, based on publicly available information

Yunlong Tang

University of Rochester, Rochester, New York, USA

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
2 May 2025 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
YTYunlong Tang
Yunlong Tang
BJBi Jing
Bi Jing
SXSiting Xu
Siting Xu
LSLuchuan Song
Luchuan Song
SLSusan Liang
Susan Liang
CXChenliang Xu
Chenliang Xu
With the rapid growth of online video platforms and the escalating volume of video content, the need for proficient video understanding tools has increased significantly. Given the remarkable capabilities of large language models (LLMs) in language and multimodal tasks, this survey provides a detailed overview of recent advances in video understanding that harness the power of LLMs (Vid-LLMs). The emergent capabilities of Vid-LLMs are surprisingly advanced, particularly their ability for open-ended multi-granularity (abstract, temporal, and spatiotemporal) reasoning combined with common-sense knowledge, suggesting a promising path for future video understanding. We examine the unique characteristics and capabilities of Vid-LLMs, categorizing the approaches into three main types: Video Analyzer × LLM, Video Embedder × LLM, and (Analyzer + Embedder) × LLM. We identify five subtypes based on the functions of LLMs in Vid-LLMs: LLM as Summarizer, LLM as Manager, LLM as Text Decoder, LLM as Regressor, and LLM as Hidden Layer. This survey also presents a comprehensive study of the tasks, datasets, benchmarks, and evaluation methods for Vid-LLMs. Additionally, it explores the extensive applications of Vid-LLMs in various domains, highlighting their remarkable scalability and versatility in real-world video understanding challenges. Additionally, it summarizes the limitations of existing Vid-LLMs and outlines directions for future research. For more information, readers are encouraged to visit the repository at https://github.com/yunlong10/Awesome-LLMs-for-Video-Understanding.

28 October 2024
Verified
Conference Paper
Open access
BJBi Jing
Bi Jing
YTYunlong Tang
Yunlong Tang
LSLuchuan Song
Luchuan Song
AVAli Vosoughi
Ali Vosoughi
NNNguyen Nguyen
Nguyen Nguyen
CXChenliang Xu
Chenliang Xu
The rapid evolution of egocentric video analysis brings new insights into understanding human activities and intentions from a first-person perspective. Despite this progress, the fragmentation in tasks like action recognition, procedure learning, and moment retrieval, \etc, coupled with inconsistent annotations and isolated model development, hinders a holistic interpretation of video content. In response, we introduce the EAGLE (Egocentric AGgregated Language-video Engine) model and the EAGLE-400K dataset to provide a unified framework that integrates various egocentric video understanding tasks. EAGLE-400K, the first large-scale instruction-tuning dataset tailored for egocentric video, features 400K diverse samples to enhance a broad spectrum task from activity recognition to procedure knowledge learning. Moreover, EAGLE, a strong video multimodal large language model (MLLM), is designed to effectively capture both spatial and temporal information. In addition, we propose a set of evaluation metrics designed to facilitate a thorough assessment of MLLM for egocentric video understanding. Our extensive experiments demonstrate EAGLE's superior performance over existing models, highlighting its ability to balance task-specific understanding with holistic video interpretation. With EAGLE, we aim to pave the way for research opportunities and practical applications in real-world scenarios.


1 June 2023 in Journal of Physics: Conference Series
Verified
Conference Paper
Open access
XHXingye Han
Xingye Han
DWDongfei Wang
Dongfei Wang
QWQiang Wang
Qiang Wang
YTYunlong Tang
Yunlong Tang
Machine learning can extract the features of the target from the known image dataset and detect the target quickly by using the trained deep neural network. Due to UAVs’ fast flight speed and long detection distance, real-time and accurate target detection requirements are relatively high. For such scenarios,a ground object recognition and tracking method that integrates the YOLOv5 target detection algorithm and KCF target tracking algorithm are proposed. The combination of the two algorithms can meet the requirements of recognition speed, recognition rate, and tracking accuracy in the current scene. Two algorithms are run simultaneously in the recognition process, the detection frame with the highest confidence is selected as the final detection result, and the detected target is tracked by the KCF target tracking algorithm based on correlation filtering. The experimental results show that this method not only meets the requirements of recognition distance, recognition accuracy, and recognition speed of ground target but also can track a ground target in real-time, with strong robustness and real-time performance.