Recommendation system has drawn growing attention in the academia and industry because it can solve the problem of information overload. Among a variety of methods, the click-through rate prediction model plays an important role in predicting user’s attention to a specific item. To predict click-through rate, high-dimensional and sparse features are usually adopted, and the accuracy of the prediction result depends on the combination of high-order features to a great extent. Therefore, many methods have been proposed to find the low-dimensional representation from sparse high-dimensional original features, and the meaningful way of feature combination has also been mined to improve the accuracy of the model. However, the click-through rate prediction models generally have two problems. One is that they can’t extract the feature interaction of non-Euclidean features very well. Another one is that it is hard to explain the inward meaning of feature interaction. In this paper, a GCN-int model based on the interaction of Graph Convolutional Network is proposed to solve the above problems. The proposed model simplifies the complex interaction among multiple features, gets a better representation of the interaction between high-order features, and improves the interpretability of feature interaction. The experimental results on the public movie recommendation dataset and our own IPTV movie recommendation dataset show that the proposed GCN-int model gets higher accuracy and efficiency compared with the state-of-the-art models.
10 November 2022 in International Journal of Computational Intelligence Systems
Knowledge graph (KG)-based recommendation methods effectively alleviate the data sparsity and cold-start problems in collaborative filtering. Among these methods, neighborhood-based methods are the mainstream methods. However, these methods ignore some meta-information about the items, specifically, the diversity of item information (e.g., texts) and feature interaction between neighboring nodes. In this paper, we propose a Bilinear Knowledge-aware Graph Neural Network Fusing Text Information (BKGNN-TI), which can model both knowledge graph information and text information. In particular, the information in knowledge graph contains not only the existing high-order connectivity but also feature interactions between neighboring nodes at the same level in KG. First, we construct the information propagation layer using the bilinear collector and linear collector. Feature interactions between neighboring nodes and the high-order connectivity are collected in the information propagation layer to generate the item knowledge representations. The bilinear collector emphasizes the importance of second-order feature interaction between neighboring nodes in the KG. Then, texts are also introduced when computing the item representations, which can help further infer user interests. We choose objective program titles and introductions as text information to avoid the influence of subjective factors. BKGNN-TI designs an ALBERT-based sequence encoder to encode texts by the structure of ALBERT+Bi-LSTM+Attention, thus enriching the feature representations of the items. In the experiments, we utilize two language datasets, i.e., the English public dataset Movielens-20M and the Chinese dataset IPTV constructed by ourselves. The results demonstrate that our BKGNN-TI outperforms baselines, indicating that our BKGNN-TI is a generalization for both Chinese and English datasets.
A hybrid framework for solving the non-uniqueness problem in the inverse design of isomorphic metasurfaces is proposed. The framework consists of a representation learning (RL) module and a variational autoencoder-particle swarm optimization (VAE-PSO) algorithm module. The RL module is used to reduce the complex high-dimensional space into a low-dimensional space with obvious features, with the purpose of eliminating the many-to-one relationship between the original design space and response space. The VAE-PSO algorithm first encodes all meta-atoms into a continuous latent space through VAE and then applies PSO to search for an optimized latent vector whose corresponding metasurface fulfills the target response. This framework gives the solution paradigm of the ideal non-uniqueness situation, simplifies the complexity of the network, improves the running speed of the PSO algorithm, and obtains the global optimal solution with 94% accuracy on the test set.
12 August 2024 in International Journal of Computational Intelligence Systems
Existing knowledge graph-based recommendation algorithms either use Knowledge Graphs (KGs) as auxiliary information or use KG prediction tasks as regular terms to constrain recommendation with multi-task learning. However, the first method, which introduces multi-hop neighbors to enhance item representations, also weakens the relationship information within individual triples to some extent. The second method ignores neighboring information and thus fails to capture the long-range connectivity between items, which leads to a lack of utilization of the structural information in the KG. In response to the limitations of existing recommendation algorithms that do not fully leverage the relational and structural information within KGs, we propose a novel method named Knowledge-Enhanced Multi-Task Parallelized Recommendation Algorithm Incorporating Attention-Embedded Propagation (KMPR-AEP). It employs a parallel approach to simultaneously incorporate KG as auxiliary information and a regular term. We take into account the multi-hop neighbor information of users and items as well as enhance the relations among individual triples, which considers both the structural and relational information of KG. Extensive experiments conducted on three real-world datasets for CTR prediction and Top-K recommendation scenarios demonstrate the superiority of our proposed method over the state-of-the-art. On average, our KMPR-AEP shows improvements of 2.44% in AUC, 3.49% in ACC, and 2.64% in F1.