14 October 2022 in Neural Networks
1 September 2015 in Knowledge-Based Systems
16 November 2023 in IEEE Transactions on Geoscience and Remote Sensing
Intractable sparse feature extraction, over-weight model size, and limited training samples are currently bewildering in infrared dim small target detection, which are not adequately addressed by current state-of-the-art (SOTA) methods. Here, to synchronously address these issues, a dense multi-level feature extraction and fusion network (DMEF-net) is designed, mainly consisting of two modules: target context and Gaussian saliency feature extraction module (TCGS) and multi-level dense feature fusion structure (MLDF). Inspired by the physical thermal diffusion model and the human visual mechanism for small-scale targets, Gaussian salience features and local context features are introduced into the target feature expression through the designed TCGS module to solve the sparse feature extraction problem. Then, to solve the over-weight model size problem, a novel MLDF module is designed to incorporate the feature reuse mechanism into our model, thereby significantly reducing the number of trainable parameters. Finally, in the training procedure, an efficient saliency labeling strategy is proposed to jointly supervise the model training in both Euclidean and Gaussian spaces, ultimately enhancing the model’s ability to explore the target features and alleviate performance deterioration when the training samples are limited. Extensive experiments on several large-scale open datasets, including TDSATUA and MTDUCB, prove that the proposed DMEF-net outperforms other SOTA methods by 8% in accuracy and has 4800% less model size.
1 February 2017 in Neurocomputing
4 November 2020 in IEEE Transactions on Cognitive and Developmental Systems
Online model-free reinforcement learning approaches play a crucial role in coping with the real-world applications such as the behavioral decision-making in robotics. How to balance the exploration and exploitation processes is a central problem in reinforcement learning. A balanced ratio of exploration/exploitation has a great influence on the total learning time and the quality of the learned strategy. Therefore, various action selection policies have been presented to obtain a balance between the exploration and exploitation procedures. However, these approaches are rarely automatically and dynamically regulated to the environment variations. One of the most amazing self-adaptation mechanisms in animals is their capacity to dynamically switch between exploration and exploitation strategies. This paper proposes a novel neurophysiologically motivated model which simulates the role of medial prefrontal cortex (MPFC) and lateral prefrontal cortex (LPFC) in behavior decision. The sensory input is transmitted to the MPFC, then the ventral tegmental area (VTA) receives a reward and calculates a dopaminergic reinforcement signal, and the feedback categorization neurons in anterior cingulate cortex (ACC) calculate the vigilance according to the dopaminergic reinforcement signal. Then the vigilance is transformed to LPFC to regulate the exploration rate, finally the exploration rate is transmitted to thalamus to calculate the corresponding action probability. This action selection mechanism is introduced to the actor-critic model of the basal ganglia, combining with the cerebellum model based on the developmental network to construct a new hybrid neuromodulatory model to select the action of the agent. Both the simulation comparison with other four traditional action selection policies and the physical experiment results demonstrate the potential of the proposed neuromodulatory model in action selection.