Reinforcement learning (RL) algorithms have been around for decades and employed to solve various sequential decision-making problems. These algorithms, however, have faced great challenges when dealing with high-dimensional environments. The recent development of deep learning has enabled RL methods to drive optimal policies for sophisticated and capable agents, which can perform efficiently in these challenging environments. This article addresses an important aspect of deep RL related to situations that require multiple agents to communicate and cooperate to solve complex tasks. A survey of different approaches to problems related to multiagent deep RL (MADRL) is presented, including nonstationarity, partial observability, continuous state and action spaces, multiagent training schemes, and multiagent transfer learning. The merits and demerits of the reviewed methods will be analyzed and discussed with their corresponding applications explored. It is envisaged that this review provides insights about various MADRL methods and can lead to the future development of more robust and highly useful multiagent learning methods for solving real-world problems.
Situation awareness (SA) is an important constituent in human information processing and essential in pilots’ decision making processes. Acquiring and maintaining appropriate levels of SA is critical in aviation environments as it affects all decisions and actions taking place in flights and air traffic control. This paper provides an overview of recent measurement models and approaches to establishing and enhancing SA in aviation environments. Many aspects of SA are examined including the classification of SA techniques into six categories, and different theoretical SA models from individual, to shared or team, and to distributed or system levels. Quantitative and qualitative perspectives pertaining to SA methods and issues of SA for unmanned vehicles are also addressed. Furthermore, future research directions regarding SA assessment approaches are raised to deal with shortcomings of the existing state-of-the-art methods in the literature.
Reinforcement learning (RL) has distinguished itself as a prominent learning method to augment the efficacy of autonomous systems. Recent advances in deep learning studies have complemented existing RL methods and led to a crucial breakthrough in the effort of applying RL to automation and robotics. Artificial agents based on deep RL can take selective and intelligent actions comparable to those of a human to maximize the feedback reward from the interactive environment. In this paper, we survey recent developments in the literature regarding deep RL methods for building human-level agents. As a result, prominent studies that involve modeling every aspect of a humanlevel agent will be examined. We also provide an overview of constructing a framework for prospective autonomous systems. Moreover, various toolkits and frameworks are suggested to facilitate the development of deep RL methods. Finally, we open a discussion that potentially raises a range of future research directions in deep RL.
The preparation of oligochitosan through the heterogeneous degradation of chitosan/H 2 O 2 combined with the homogeneous reaction of chitosan with H 2 O 2 under gamma radiation was studied. Oligochitosan with weight-average molecular weight (M w ) of less than 10 kDa could be efficiently prepared by gamma Co 60 irradiation of chitosan solution (4%) and hydrogen peroxide (0.5%) at doses ranging from 8 to 24 kGy. The M w , chemical structure, and the crystallinity of chitosan and oligochitosan were characterized by GPC, FT-IR, and XRD. The solubility and antioxidant activity of chitosan and of oligochitosan with the different molecular weights were investigated. Results showed that oligochitosan CS 5 (20 kGy) and CS 6 (24 kGy) have good solubility in the pH range of 3 to –11. The scavenge percentage of CS 5 against 2,2-azino-bis (3-ethylbenzothiazoline-6-sulphonic acid) (ABTS) radical is 99.2% in 90 min. The antioxidant activity of oligochitosan is effective in a short time period; therefore, it has potential application as an effective and natural antioxidant.