In recent years, the field of visual tracking has made significant progress with the application of large-scale training datasets. These datasets have supported the development of sophisticated algorithms, enhancing the accuracy and stability of visual object tracking. However, most research has primarily focused on favorable illumination circumstances, neglecting the challenges of tracking in low-ligh environments. In low-light scenes, lighting may change dramatically, targets may lack distinct texture features, and in some scenarios, targets may not be directly observable. These factors can lead to a severe decline in tracking performance. To address this issue, we introduce LLOT, a benchmark specifically designed for Low-Light Object Tracking. LLOT comprises 269 challenging sequences with a total of over 132 K frames, each carefully annotated with bounding boxes. This specially designed dataset aims to promote innovation and advancement in object tracking techniques for low-light conditions, addressing challenges not adequately covered by existing benchmarks. To assess the performance of existing methods on LLOT, we conducted extensive tests on 39 state-of-the-art tracking algorithms. The results highlight a considerable gap in low-light tracking performance. In response, we propose H-DCPT, a novel tracker that incorporates historical and darkness clue prompts to set a stronger baseline. H-DCPT outperformed all 39 evaluated methods in our experiments, demonstrating significant improvements. We hope that our benchmark and H-DCPT will stimulate the development of novel and accurate methods for tracking objects in low-light conditions.
Achieving fast and robust object tracking is critical for real-time Unmanned Aerial Vehicle (UAV) applications, where targets often move unpredictably and environmental conditions can rapidly change. In this paper, we propose the Search-Region Adaptive Mamba-ViT Tracker (SAMViTrack), a novel framework that combines the efficiency of Mamba attention with the powerful feature extraction capabilities of Vision Transformer (ViT). Our tracker dynamically adjusts the search region based on the target’s motion and environmental context, ensuring precise tracking even under challenging conditions such as occlusions, fast motion, and scale variations. By integrating an adaptive search mechanism, our SAMViTrack significantly reduces computational overhead without compromising accuracy, making it suitable for real-time deployment on UAVs with limited onboard resources. Extensive experiments on benchmark datasets demonstrate that our method outperforms both traditional and modern trackers, achieving superior accuracy and robustness with improved efficiency. The proposed tracker sets a new baseline, especially by combining Mamba and ViT, for UAV tracking by offering a balance between speed, accuracy, and adaptability in dynamic environments.
In recent years, the field of visual tracking has made significant progress with the application of large-scale training datasets. These datasets have supported the development of sophisticated algorithms, enhancing the accuracy and stability of visual object tracking. However, most research has primarily focused on favorable illumination circumstances, neglecting the challenges of tracking in low-ligh environments. In low-light scenes, lighting may change dramatically, targets may lack distinct texture features, and in some scenarios, targets may not be directly observable. These factors can lead to a severe decline in tracking performance. To address this issue, we introduce LLOT, a benchmark specifically designed for Low-Light Object Tracking. LLOT comprises 269 challenging sequences with a total of over 132K frames, each carefully annotated with bounding boxes. This specially designed dataset aims to promote innovation and advancement in object tracking techniques for low-light conditions, addressing challenges not adequately covered by existing benchmarks. To assess the performance of existing methods on LLOT, we conducted extensive tests on 39 state-of-the-art tracking algorithms. The results highlight a considerable gap in low-light tracking performance. In response, we propose H-DCPT, a novel tracker that incorporates historical and darkness clue prompts to set a stronger baseline. H-DCPT outperformed all 39 evaluated methods in our experiments, demonstrating significant improvements. We hope that our benchmark and H-DCPT will stimulate the development of novel and accurate methods for tracking objects in low-light conditions. The LLOT and code are available at https://github.com/OpenCodeGithub/H-DCPT.
Active visual perception refers to the ability of a system to dynamically engage with its environment through sensing and action, allowing it to modify its behavior in response to specific goals or uncertainties. Unlike passive systems that rely solely on visual data, active visual perception systems can direct attention, move sensors, or interact with objects to acquire more informative data. This approach is particularly powerful in complex environments where static sensing methods may not provide sufficient information. Active visual perception plays a critical role in numerous applications, including robotics, autonomous vehicles, human-computer interaction, and surveillance systems. However, despite its significant promise, there are several challenges that need to be addressed, including real-time processing of complex visual data, decision-making in dynamic environments, and integrating multimodal sensory inputs. This paper explores both the opportunities and challenges inherent in active visual perception, providing a comprehensive overview of its potential, current research, and the obstacles that must be overcome for broader adoption.
Active visual perception enables an intelligent system to improve perception by controlling how visual evidence is acquired. However, differences in how studies define active perception and evaluate its benefits make approaches difficult to compare across tasks. This review first clarifies the field’s functional scope by examining whether an action is selected for its expected effect on subsequent visual evidence and whether the resulting observation informs a later decision. This definition distinguishes active observation acquisition from processing fixed inputs and guides the selection of representative literature. Within this scope, this review develops an analytical framework organized around four questions. It begins with what evidence the task requires, examines which actions can obtain that evidence and how a candidate observation should be valued, and considers how the next sensing action should be selected and executed. New observations then update the perceptual state and guide subsequent decisions, forming a closed loop that provides a common basis for comparing methods across applications. To examine how their benefits can be demonstrated, this review assesses whether existing datasets support observation selection, how interactive environments enable controlled comparisons, and what physical platforms reveal about execution feasibility. It further examines how baseline comparisons can establish whether adapting observations is necessary and whether informed selection offers benefits beyond simpler sensing strategies. These considerations underpin an evaluation framework that links improvements in visual evidence to downstream task outcomes while accounting for acquisition costs and risks. Its core value is to help isolate the contribution of sensing decisions and determine whether their benefits justify the resources required. The analysis concludes that predicted observation value does not guarantee that useful evidence can be acquired through feasible actions, while task success alone cannot establish the benefit of active observation selection. Further progress requires reliable value estimation and planning over longer decision sequences under physical and resource constraints. It also requires grounding semantic reasoning in acquired evidence and maintaining effective collaboration under imperfect communication, with these capabilities verified through reproducible evaluation of the complete perception and action loop.