Shiyu Hu

Dr. Shiyu Hu

orcid

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
23 February 2022 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
SHShiyu Hu
Shiyu Hu
XZXin Zhao
Xin Zhao
LHLianghua Huang
Lianghua Huang
KHKaiqi Huang
Kaiqi Huang
Target tracking, the essential ability of the human visual system, has been simulated by computer vision tasks. However, existing trackers perform well in austere experimental environments but fail in challenges like occlusion and fast motion. The massive gap indicates that researches only measure tracking performance rather than intelligence. How to scientifically judge the intelligence level of trackers? Distinct from decision-making problems, lacking three requirements (a challenging task, a fair environment, and a scientific evaluation procedure) makes it strenuous to answer the question. In this article, we first propose the global instance tracking (GIT) task, which is supposed to search an arbitrary user-specified instance in a video without any assumptions about camera or motion consistency, to model the human visual tracking ability. Whereafter, we construct a high-quality and large-scale benchmark VideoCube to create a challenging environment. Finally, we design a scientific evaluation procedure using human capabilities as the baseline to judge tracking intelligence. Additionally, we provide an online platform with toolkit and an updated leaderboard. Although the experimental results indicate a definite gap between trackers and humans, we expect to take a step forward to generate authentic human-like trackers. The database, toolkit, evaluation server, and baseline results are available at http://videocube.aitestunion.com .

2 September 2025 in Mathematics
Verified
Journal Article
Open access
PDF file
LTLe Ying Tan
Le Ying Tan
SHShiyu Hu
Shiyu Hu
DYDarren Yeo
Darren Yeo
Kang Hao CheongKang Hao Cheong
Kang Hao Cheong
This paper presents a comprehensive analysis of artificial intelligence-powered automated grading systems (AI AGSs) in STEM education, systematically examining their algorithmic foundations, mathematical modeling approaches, and quantitative evaluation methodologies. AI AGSs enhance grading efficiency by providing large-scale, instant feedback and reducing educators’ workloads. Compared to traditional manual grading, these systems improve consistency and scalability, supporting a wide range of assessment types, from programming assignments to open-ended responses. This paper provides a structured taxonomy of AI techniques including logistic regression, decision trees, support vector machines, convolutional neural networks, transformers, and generative models, analyzing their mathematical formulations and performance characteristics. It further examines critical challenges, such as user trust issues, potential biases, and students’ over-reliance on automated feedback, alongside quantitative evaluation using precision, recall, F1-score, and Cohen’s Kappa metrics. The analysis includes feature engineering strategies for diverse educational data types and prompt engineering methodologies for large language models. Lastly, we highlight emerging trends, including explainable AI and multimodal assessment systems, offering educators and researchers a mathematical foundation for understanding and implementing AI AGSs into educational practices.

2 December 2023 in International Journal of Computer Vision
Verified
Journal Article
Closed access
PDF file
XZXin Zhao
Xin Zhao
SHShiyu Hu
Shiyu Hu
YWYipei Wang
Yipei Wang
JZJing Zhang
Jing Zhang
YHYimin Hu
Yimin Hu
JiaDong Li liJiaDong Li li
JiaDong Li li

18 October 2023 in International Journal of Computer Vision
Verified
Journal Article
Closed access
PDF file
SHShiyu Hu
Shiyu Hu
XZXin Zhao
Xin Zhao
KHKaiqi Huang
Kaiqi Huang

10 April 2024 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
MWMeiqi Wu
Meiqi Wu
KHKaiqi Huang
Kaiqi Huang
YCYuanqiang Cai
Yuanqiang Cai
SHShiyu Hu
Shiyu Hu
YZYuzhong Zhao
Yuzhong Zhao
WWWeiqiang Wang
Weiqiang Wang
Air-writing is a challenging task that combines the fields of computer vision and natural language processing, offering an intuitive and natural approach for human-computer interaction. However, current air-writing solutions face two primary challenges: (1) their dependency on complex sensors ( e.g ., Radar, EEGs and others) for capturing precise handwritten trajectories, and (2) the absence of a video-based air-writing dataset that covers a comprehensive vocabulary range. These limitations impede their practicality in various real-world scenarios, including the use on devices like iPhones and laptops. To tackle these challenges, we present the groundbreaking air-writing Chinese character video dataset (AWCV-100K), serving as a pioneering benchmark for video-based air-writing. This dataset captures handwritten trajectories in various real-world scenarios using commonly accessible RGB cameras, eliminating the need for complex sensors. AWCV-100K includes 8.8 million video frames, encompassing the complete set of 3,755 characters from the GB2312-80 level-1 set (GB1). Furthermore, we introduce our baseline approach, the video-based character recognizer (VCRec). VCRec adeptly extracts fingertip features from sparse visual cues and employs a spatio-temporal sequence module for analysis. Experimental results showcase the superior performance of VCRec compared to existing models in recognizing air-written characters, both quantitatively and qualitatively. This breakthrough paves the way for enhanced human-computer interaction in real-world contexts. Moreover, our approach leverages affordable RGB cameras, enabling its applicability in a diverse range of scenarios. The code and data examples will be made public at https://github.com/wmeiqi/AWCV.

1 January 2025 in Innovation and Emerging Technologies
Verified
Journal Article
Closed access
YMYiping Ma
Yiping Ma
XLXinjin Li
Xinjin Li
SHShiyu Hu
Shiyu Hu
SLShiqing Liu
Shiqing Liu
Kang Hao CheongKang Hao Cheong
Kang Hao Cheong