21 August 2025 in Neurocomputing
9 December 2024 in IEEE Internet of Things Journal
Due to the complexity of ocean sensing tasks, buoy detection in traditional ocean observation methods has the disadvantages of high cost and insufficient real-time performance. Ocean mobile crowd sensing technology collects high-resolution data in real-time through shipborne sensors and has significant potential for future development in the ocean Internet of Things. In this article, we consider a cooperative vessel activity that performs sensing tasks, incentivizing multiple vessels through dynamic external task profits. To spontaneously incentivize the team to take part in tasks and maximize the total profit of the vessels, we propose a multiagent task allocation model (MATM-SN) based on deep reinforcement learning (DRL). This model uses a generative adversarial network to predict the trajectory of the vessels, and STGCN is used to extract synergistic features between vessels effectively. DRL training provides an optimal task allocation strategy for vessels. Finally, we compared four baselines and demonstrated that the MATM-SN model outperformed other baselines regarding task completion rate and total efficiency.
12 August 2025 in IEEE Access
In recent years, multimodal social relation recognition has become a critical task in the fields of computer vision and natural language processing. However, existing research still faces key gaps, particularly in effectively aligning image features with linguistic features to improve recognition accuracy. This paper proposes a social relation recognition method based on multimodal feature fusion and validates the crucial role of cross-modal alignment mechanisms in enhancing recognition accuracy. Our approach leverages large language models to meticulously extract event structures from textual descriptions, capturing key elements such as emotional states, scenarios, and relationships, while employing convolutional neural networks to extract deep features from images. Subsequently, we introduce a cross-modal alignment mechanism to semantically align textual event structures with visual features, ensuring high semantic consistency between the two modalities. Extensive experiments on multiple public datasets demonstrate that our method significantly outperforms existing unimodal and basic multimodal approaches, confirming its effectiveness and innovative contributions to social relation recognition.