More and more work has focused on incorporating different kinds of literals into Knowledge Graph to promote the performance of knowledge embedding. These literals contain numeric literals, text literals, image literals and so on. These additional descriptions are connected to the entities through certain attributes. To incorporate numeric literals, some methods combine the embeddings of literals part with the traditional part - embeddings of entities. However, in the construction of literals embeddings, these existing methods consider the differences of these attributes: one dimension represents one attribute. But they ignore semantic meanings of attributes themselves. In this paper, we propose two methods to incorporate attributes semantics into knowledge graph embeddings from two perspectives: LiteralEAN and literalE-AT. They concatenate with the embeddings of numeric literals by different ways. Furthermore, their extension model LiteralE-C is also proposed as having a more comprehensive representation of attributes semantics. In an empirical study over two standard datasets FB15k and FB15k-237, we evaluate our models for link prediction. We demonstrate that they show an effective way to improve LiteralE and achieve state-of-the-art results. In ablation experiments, we find combined models do better than their singular counterparts in most cases.
Zero shot learning aims to recognize objects whose instances may not be covered by the training data. To generalize knowledge from seen classes to the novel ones, semantic space is built to embed knowledge from various views into multi-modal semantic embeddings. Existing semantic embeddings neglect the relationships between classes which are essential to transfer knowledge between classes. Moreover, existing zero shot learning models ignore the complementarity between semantic embeddings from different modalities. To tackle these problems, in this work, we resort to graph theory to explicitly model the interdependence between classes and then obtain new modal semantic embeddings. Furthermore, we pioneer to propose a multi-level fusion model to effectively combine knowledge encoded in multi-modal semantic embeddings together. By the virtue of subsequent fusion block, the results of multi-level fusion can be furtherly enriched and fused. Experiments show that our model could achieve promising results on various datasets. Ablation study suggests that our method is well suited for zero shot learning.