Beijing Key Laboratory of Multimedia and Intelligent Software Technology, Beijing Institute of Artificial Intelligence, 100 Pingleyuan, Chaoyang District, Beijing 100124, China
Auto-generated profile, based on publicly available information
Linjia Hao
Beijing Key Laboratory of Multimedia and Intelligent Software Technology, Beijing Institute of Artificial Intelligence, 100 Pingleyuan, Chaoyang District, Beijing 100124, China
Multimodal knowledge graph completion (MMKGC) enhances the precision and breadth of application of knowledge graphs by integrating rich data from various modalities, steadily increasing its appeal in the research community. Prior studies mainly focus on the common representation of different modalities while neglecting the different and complementary features. On the contrary, some works tend to model triples of each modality separately while overlooking the similarities between modalities. It is challenging to associate the heterogeneous modalities effectively for MMKGC. In this article, we introduce a novel MMKGC framework by cross-modal interaction with similarity-enhancing and difference-embracing (CISEDE), which leverages both the similarities and differences among multimodal entities by a proposed cross-modal interaction mechanism. In the cross-modal interaction, multihead attention is employed to enhance similarity information from multimodal entities and embrace different information by linking various modal triples. Through relation-guided fusion, the modal triples are decoded and merged for MMKGC. The experimental results on three commonly used datasets, FB15k-237, WN9, and WN18RR, show that the proposed method achieves state-of-the-art performance.
24 January 2026 in Expert Systems with Applications
Safety and accuracy are essential for path planning in a surgical navigation system. In this paper, an improved path planning algorithm is proposed to increase the autonomous level of spine surgery robots for higher safety and accuracy. Firstly, dynamic gravitational constant and piecewise repulsion function are adopted to improve the traditional Artificial Potential Field algorithm to solve common issues of path planning, including local minimum, unable to reach target near obstacles. To better control the pose of the end-effector in operation space, the positions of the two endpoints of the end-effector are further constrained. Secondly, an improved Primal-Dual Neural Network with multiple constraints is proposed to minimize the joint angular velocity norm. The multiple constraints are formulated according to the planned path, the obstacle avoidance of the robot and the joint limits. Moreover, a real-time planned velocity scheme based on the position error of each step is applied to prevent the accumulation of position errors. The simulation results of pedicle screw implantation demonstrate that the robot can find the collision-free trajectory and arrive at the target position in various complicated situations. The position error is around [[EQUATION]] m. Finally, two experiments are conducted to verify the proposed algorithm is effective in practice.
Social media has become a vital source for humanitarian organizations to gather information during crises. However, existing multimodal classification methods operate primarily as isolated systems, while neglecting external references crucial for accurate judgment. Furthermore, while user comments can provide valuable context, they are often scarce during the early stages of a crisis. To address these limitations, we propose a framework named Mix-Persona Comment Generation with Geographically Enhanced Context Retrieval for LLM Instruction Fine-tuning (MPCG-GECR). To mitigate comment scarcity, we employ a Synthetic Persona Generator (SPG) that prompts LLMs to adopt diverse mix-personas, generating synthetic comments that simulate multi-perspective public discourse. To incorporate external references, we introduce a Geographically Enhanced Context Retrieval (GECR) module. Unlike standard retrieval approaches, GECR utilizes a hybrid re-ranking strategy to identify samples that are both multimodally similar and geographically consistent, serving as reliable reference anchors for the LLM. By integrating these social perspectives and geographic references into a unified instruction-tuning format, we transform the classification task into a context-aware text generation problem and fine-tune the LLM using Low-Rank Adaptation (LoRA). Extensive experiments on the CrisisMMD and DMD datasets demonstrate that MPCG-GECR effectively overcomes data scarcity and context isolation, significantly outperforming existing methods.