Knowledge graphs (KGs) are increasingly utilized for data integration, representation, and visualization. While KG population is critical, it is often costly, especially when data must be extracted from unstructured text in natural language, which presents challenges, such as ambiguity and complex interpretations. Large Language Models (LLMs) offer promising capabilities for such tasks, excelling in natural language understanding and content generation. However, their tendency to “hallucinate” can produce inaccurate outputs. Despite these limitations, LLMs offer rapid and scalable processing of natural language data, and with prompt engineering and fine-tuning, they can approximate human-level performance in extracting and structuring data for KGs. This study investigates LLM effectiveness for the KG population, focusing on the Enslaved.org Hub Ontology. In this paper, we report that compared to the ground truth, LLM’s can extract ≈90% of triples, when provided a modular ontology as guidance in the prompts.
The report presents the evaluation results of our approach in the LLM4OL Challenge, where we fine-tuned GPT-3.5 for Task A (Term Typing) across three different datasets. Our approach demonstrated consistent and robust performance during few- shot testing, achieving top rankings in several datasets and sub-datasets, proving the potential of fine-tuning LLMs for ontology creation tasks.
This chapter offers a detailed overview of key concepts in deep learning. In addition to traditional Neural Networks, several deep learning models such as Convolutional Neural Networks, Recurrent Neural Networks, Transformers, Generative Adversarial Networks, Graph Neural Networks, and Autoencoders are reviewed. Each model is described in terms of its architecture, functionality, and primary applications. The chapter also highlights the significance of popular deep learning frameworks in facilitating model implementation and deployment.