7 December 2024 in Journal on Computing and Cultural Heritage
The rapid development of generative artificial intelligence has brought significant opportunities for the advancement of digital humanities research. Intelligent processing of ancient texts, as an essential part of digital humanities, is also undergoing a transformation in research methodologies in the wave of AIGC. The integration of generative pre-trained models with Chinese ancient texts, a vital carrier of Chinese culture, allows for deep mining of the content of these texts and provides services that make ancient texts more understandable and accessible to the general public. In this research, we propose a method that combines the most renowned Chinese anthology, the “Siku Quanshu,” with generative pre-trained models. We developed the SikuGPT model, a generative model for ancient text processing tasks, based on GPT-type language models by continued pretraining. This model was tested on two typical tasks of ancient text processing: translation between classical and modern Chinese, and classification of ancient texts. The findings reveal that our model achieves advantages in understanding and generating scenarios of ancient texts. The capability of SikuGPT in processing traditional Chinese texts helps to promote the organization of ancient information and knowledge services, and advances the international dissemination of traditional Chinese culture.
23 February 2026 in Digital Scholarship in the Humanities
Chinese local product records in traditional gazetteers constitute a vital component of cultural heritage. Recent developments in artificial intelligence (AI) have opened up new avenues for the preservation and utilization of such heritage. This article introduces the large language models (LLMs) tailored to Chinese local products, comprising a base model, a chat model, and a reasoning model collectively referred to as the Chinese local product LLM series. These models validate the feasibility of applying LLMs to the intelligent processing of Chinese local product knowledge and provide both a technical paradigm and toolset for cultural heritage research. This article first constructs a hybrid pre-training dataset containing one billion characters, drawn from historical texts on Chinese local products. Leveraging this dataset, the Qwen open-source base models underwent further pre-training for domain adaptation, leading to the development of specialized models for Chinese local product knowledge, including a base model, a chat model, and a reasoning model. These models are subsequently deployed as API endpoints and web applications to support automated textual processing and knowledge-based question answering services related to Chinese local products. This article marks the first attempt to develop LLMs specifically for the domain of cultural heritage with a focus on local products. It further demonstrates the effectiveness of continued pre-training, instruction tuning, data distillation, long-chain-of-thought fine-tuning, and retrieval-augmented generation in improving the quality of local product information services. The findings underscore the potential of LLMs to advance both the preservation and protection of cultural heritage in the AI era.
6 July 2026 in Journal of Informetrics