1 January 2023 in Computers, Materials & Continua
Aiming at the problems of traditional dynamic weapon-target assignment algorithms in command decision-making, such as large computational amount, slow solution speed, and low calculation accuracy, combined with deep reinforcement learning theory, an improved Deep Deterministic Policy Gradient algorithm with dual noise and prioritized experience replay is proposed, which uses a double noise mechanism to expand the search range of the action, and introduces a priority experience playback mechanism to effectively achieve data utilization. Finally, the algorithm is simulated and validated on the ground-to-air countermeasures digital battlefield. The results of the experiment show that, under the framework of the deep neural network for intelligent weapon-target assignment proposed in this paper, compared to the traditional RELU algorithm, the agent trained with reinforcement learning algorithms, such as Deep Deterministic Policy Gradient algorithm, Asynchronous Advantage Actor-Critic algorithm, Deep Q Network algorithm performs better. It shows that the use of deep reinforcement learning algorithms to solve the weapon-target assignment problem in the field of air defense operations is scientific. In contrast to other reinforcement learning algorithms, the agent trained by the improved Deep Deterministic Policy Gradient algorithm has a higher win rate and reward in confrontation, and the use of weapon resources is more efficient. It shows that the model and algorithm have certain superiority and rationality. The results of this paper provide new ideas for solving the problem of weapon-target assignment in air defense combat command decisions.
28 February 2024 in Biotechnology and Bioengineering
Several key technologies for advancing biopharmaceutical manufacturing depend on the successful implementation of process analytical technologies that can monitor multiple product quality attributes in a continuous in‐line setting. Raman spectroscopy is an emerging technology in the biopharma industry that promises to fit this strategic need, yet its application is not widespread due to limited success for predicting a meaningful number of quality attributes. In this study, we addressed this very problem by demonstrating new capabilities for preprocessing Raman spectra using a series of Butterworth filters. The resulting increase in the number of spectral features is paired with a machine learning algorithm and laboratory automation hardware to drive the automated collection and training of a calibration model that allows for the prediction of 16 different product quality attributes in an in‐line mode. The demonstrated ability to generate these Raman‐based models for in‐process product quality monitoring is the breakthrough to increase process understanding by delivering product quality data in a continuous manner. The implementation of this multiattribute in‐line technology will create new workflows within process development, characterization, validation, and control.