Event representation targets to model the event-reasoning process as a machine-readable format. Previous studies on event representation mostly concentrate on a sole modeling perspective and have not well investigated the scenario-level knowledge, which can cause information loss. To cope with this dilemma, we propose a unified fine-tuning architecture-based approach ( UniFA-S ) that integrates all levels of trainings, including the scenario-level knowledge. However, another challenge for existing models is the ever-increasing computation overheads, restricting the deployment ability on limited resources devices. Hence, in this article, we aim to compress the cumbersome model UniFA-S into a lighter and easy-to-deploy one without much performance damage. To this end, we propose a sequence-aware knowledge distillation model (SaKD) that employs a dynamic self-distillation on the decouple-compress-couple framework for compressing UniFA-S , which cannot only realize the model compression, but also retain the integrity of individual components. We also design two fitting strategies to address the less-supervised issue at the distillation stage. Comprehensive experiments on representation-and-inference ability-based tasks validate the effectiveness of SaKD. Compared to UniFA-S , SaKD realizes a more portable event representation model at the cost of only 1.0% performance drop in terms of accuracy or Spearman’s correlation, which is far less than other knowledge distillation models.
Hierarchical context modeling plays an important role in the response generation for multi-turn conversational systems. Previous methods mainly model context as multiple independent utterances and rely on attention mechanisms to obtain the context representation. They tend to ignore the explicit responds-to relationships between adjacent utterances and the special role that the user's latest utterance (the query) plays in determining the success of a conversation. To deal with this, we propose a multi-turn response generation model named KS-CQ, which contains two crucial components, the Keep and the Select modules, to produce a neighbor-aware context representation and a context-enriched query representation. The Keep module recodes each utterance of context by attentively introducing semantics from its prior and posterior neighboring utterances. The Select module treats the context as background information and selectively uses it to enrich the query representing process. Extensive experiments on two benchmark multi-turn conversation datasets demonstrate the effectiveness of our proposal compared with the state-of-the-art baselines in terms of both automatic and human evaluations.
Air target intention recognition (ATIR) is critical for unmanned systems in modern air defense operations. Through the analysis of typical air defense combat scenarios, first, the paper defines the intention space and intention parameters of air units based on military experience and domain knowledge. Then, a rule-based agent for unmanned systems for online intention recognition is proposed, with no training, no tagging, and no big data support, which is not only for intention recognition and parameter prediction, but also for formation identification of air targets. The most critical point of the agent is the introduction and application of a thermal distribution grid graph (TDGG) and virtual grid dictionary (VGD), where the former is used to identify the formation information of air targets, and the latter is used to optimize the storage space and simplify the access process for the large-scale and real-time combat information. Finally, to have a performance evaluation and application analysis for the algorithm, we carried out a data instance analysis of ATIR for unmanned systems and an air defense warfare simulation experiment based on a Wargame platform; the comparative experiments with the classical k-means, FCNIRM, and the sector-based forward search method verified the effectiveness and feasibility of the proposed agent, which characterizes it as a promising tool or baseline model for the battlefield situational awareness tasks of unmanned systems.