Servo motors play an important role in automation equipment and have been used in several manufacturing fields. However, the commonly used control methods need their parameters to be set manually, which is rather difficult, and this means that these methods generally cannot adapt to changes in operation conditions. Therefore, in this study, we propose an intelligent control method for a servo motor based on reinforcement learning and that can train an agent to produce a duty cycle according to the servo error between the current state and the target speed or torque. The proposed method can adjust its control strategy online to reduce the servo error caused by a change in operation conditions. We verify its performance on three different servo motors and control tasks. The experimental results show that the proposed method can achieve smaller servo errors than others in most cases.
With the growing popularity of unmanned aerial vehicles (UAVs), their improper use is significantly disrupting society. Individuals and organizations have been continuously researching methods for detecting UAVs. However, most existing detection methods fail to account for the impact of similar flying objects, leading to weak anti-interference capabilities. In other words, when such objects appear in the image, the detector may mistakenly identify them as UAVs. Therefore, this study aims to enhance the anti-interference ability of UAV detectors by constructing an anti-interference dataset comprising 5062 images. In addition to UAVs, this dataset also contains three other types of flying objects that are visually similar to the UAV targets: planes, helicopters, and birds. This dataset can be used in model training to help detectors distinguish UAVs from these nontarget objects and thereby improve their anti-interference capabilities. Furthermore, we propose an anti-interference UAV detection method based on YOLOv9-C in which the dot distance is used as an evaluation index to assign positive and negative samples. This results in an increased number of positive samples, improving detector performance in the case of small targets. The comparison of experimental results shows that the developed method has better anti-interference performance than other algorithms. The detection method and dataset used to test the anti-interference capabilities in this study are expected to assist in the development and validation of related research methods.
The accurate remote sensing retrieval of chlorophyll-a (Chla) concentrations in highly turbid estuarine waters remains challenging due to complex optical conditions. In this study, a small sample machine learning-based retrieval framework tailored for limited training samples was developed for the Pearl River Estuary (PRE) by integrating Sentinel-3 OLCI satellite imagery with long-term fixed-station Chla observations from the Hong Kong Environmental Protection Department. Normalized remote sensing reflectance features derived from multiple OLCI spectral bands were used as model inputs, and the performance of support vector regression (SVR) and a back propagation neural network (BPNN) was evaluated and compared with those of traditional second-order polynomial models. The results show that SVR achieves the best overall performance on both training and independent testing datasets, with a higher accuracy, smaller systematic bias, and more stable generalization capability, demonstrating its effectiveness in capturing complex nonlinear relationships under limited sample conditions. Specifically, for the training and testing datasets, the correlation coefficients between SVR-predicted and measured Chla reach 0.88 and 0.78, RMSEs are 1.75 and 1.23 mg/m3, and biases are −0.29 and 0 mg/m3, respectively. The retrieval results further reveal the clear spatiotemporal patterns of Chla concentration in the PRE, characterized by a west–high and east–low spatial distribution and pronounced seasonal migration. Elevated Chla concentrations occur mainly in the lower estuary during summer, retreat toward the upper estuary in winter, and shift to the middle estuary during spring and autumn. This study provides a practical methodological reference for the operational remote sensing monitoring of water quality in optically complex and highly turbid estuarine environments.
Detecting ships using Synthetic Aperture Radar (SAR) in coastal areas is still difficult due to the impact of coherent speckle noise from the ocean surface, complex land clutter and having multi-scale target representations in the radar imagery. Most of the existing ship detection algorithms lose important target features during downsampling and have difficulty recovering those features through upsampling, resulting in a high number of false detections and missed detections. In this work, we present a new ship detection algorithm called Synergistic Star-Attentive Network with Dynamic Feature Refinement (S2D-Net). First, we create a new backbone called Multi-scale PCCA-StarNet to generate robust feature representations. Within the backbone we implement a Progressive Channel-Coordinate Attention (PCCA) mechanism to create a synergy between global channel filtering and adaptive coordinate locking to decouple ship textures from granular speckle noise. Second, we create a Dynamic Feature Refinement Neck. We develop a content-aware dynamic upsampler called DySample to replace conventional interpolation to improve fidelity of the upsampled feature of small targets. Further, we design a Star-PCCA Feature Aggregation module which fuses features together. Using star-operations and the PCCA mechanism, this module refines semantic features and removes background clutter while aggregating features across multiple scales. Third, we develop a Lightweight Shared Convolutional Detection Head with Quality Estimation (LSCD-LQE). The LSCD-LQE decreases parameter redundancy by using shared convolutional layers and adds a localization quality estimation branch. Therefore, the LSCD-LQE effectively reduces false positive detections through alignment of classification scores with localization quality based on Intersection over Union (IoU) in difficult coastal environments. Our experimental results, using the SSDD and HRSID datasets, show that S2D-Net produces results comparable to representative ship detection algorithms. In particular, on the challenging HRSID inshore subset, our proposed method achieved a mean average precision (mAP) of 82.7%, which is 6.9% greater than the YOLOv11n baseline ship detection algorithm. These results demonstrate that S2D-Net is superior at detecting small coastal vessels and mitigating the detrimental effects of the nearshore complex environment on the performance ship detection using SAR.
Blind super-resolution algorithms based on diffusion models still face significant challenges at the current stage, including high computational cost, long inference time, and limited cross domain generalization ability. This paper aims to apply super-resolution algorithms to the field of optical microscopy imaging to reveal more microscopic structures and details. Firstly, we proposed a lightweight super-resolution model called ResShift-4E, which is an optimized model from two important aspects: reducing the diffusion steps in ResShift and strengthening the influence of the original residuals on model learning. Secondly, we constructed a dataset of Multimodal High-resolution Microscopy Images (MHMI) including a total of 1220 images, which is available on line. Moreover, we extended our model to application-oriented research on blind image super-resolution of optical microscopy imaging. The experimental results demonstrate that our ResShift-4E model outperforms other models on various microscopy images.
With the development of artificial intelligence, reinforcement-learning-based intelligent control algorithms, which generally learn control strategies through trial and error, have received more attention in the automation equipment and manufacturing fields. Although they can intelligently adjust their control strategy without the need for human effort, the most relevant algorithms for servo motors only consider the overall performance, while ignoring the risks in special cases. Therefore, overcurrent problems are often triggered in the training process of the reinforcement learning agent. This can damage the motors’ service life and even burn it out directly. To solve this problem, in this study we propose a risk-sensitive intelligent control algorithm based on value distribution, which uses the quantile function to model the probability distribution of cumulative discount returns and employs the condition value at risk to measure the loss caused by overcurrent. The agent can accordingly learn a control strategy that is more sensitive to environmental restrictions and avoid the overcurrent problem. The performance is verified on three different servo motors with six control tasks, and the experimental results show that the proposed method can achieve fewer overcurrent occurrences than others in most cases.