HYPERDOC is a hyperspectral imaging dataset of historical documents and mock-ups, designed to facilitate research in material identification in the cultural heritage domain. It contains mock-ups of historical inks (metallo-gallate, sepia, carbon-based, and mixtures) on various supports, including some artificially aged, and historical documents from the 15th to 17th centuries (manuscripts, illuminated manuscripts, and family trees). Hyperspectral reflectance images were acquired using line-scan cameras in the VNIR (400-1000 nm) and SWIR (900-1700 nm) ranges and were spatially registered. Small regions of interest, referred to as ‘minicubes’, were extracted from the full document images, and pixel-level ground truth material annotations were performed. False-color RGB images and metadata were included in both the full document and minicube captures. The HYPERDOC dataset has been successfully applied in various experimental studies, including ink classification using machine learning models, spectral unmixing, colorimetric analysis, and binarization. These applications highlight the dataset’s potential, which is publicly available to promote interdisciplinary collaboration and advance the use of hyperspectral imaging in the conservation field.
The aim of this work is to provide the cultural heritage community with a comprehensive hyperspectral image database of handwritten laboratory samples, including various writing inks commonly found in historical documents. The database contains 195 samples registered in the VNIR (400-1000 nm) and SWIR (900-1700 nm) spectral ranges, along with complete information about the ink recipes (components and concentrations used for each ink and mixture), and their corresponding Ground Truth images. The database is now publicly available as part of a bigger database related to the Hyperdoc project and can be used to perform different tasks. We present here one example: the classification of iron gall vs non-iron gall inks.
17 June 2025 in Analytical and Bioanalytical Chemistry
Characterizing pigments and dyes in historical manuscripts is challenging due to the fragility of materials, the complex composition of low-concentration elements, and sampling limitations. Consequently, complementary non-invasive analytical techniques and non-contact measurement methods are often required. This study presents the most comprehensive spectral database to date, combining diffuse reflectance infrared Fourier transform spectroscopy (DRIFTS) and hyperspectral imaging (HSI) to aid in identifying pigments, dyes, and binders historically used in illuminated and decorated manuscripts. A total of 156 painting mock-ups were created using traditional techniques, incorporating variations in binders, pigment particle sizes, support types, surface roughness, and application methods. Spectral imaging was performed in the visible and near infrared (VNIR) and short-wave infrared (SWIR) regions, while DRIFTS analysis covered the middle wave infrared (MWIR) region. For DRIFTS, both contact and non-contact measurements were tested. Using the samples in the database, the influence of binder, support, and grain size on the sample spectra and color were analyzed and discussed. This database facilitates pigment and dye identification using DRIFTS or HSI data independently or in combination through data fusion, applying techniques ranging from direct spectral comparison to advanced methods such as machine learning and spectral unmixing. By making this database publicly available, the study underscores the value of DRIFTS and HSI in identifying painting materials and contributes to the preservation of historical manuscripts.
The HYPERDOC database is a publicly available hyperspectral imaging resource for the analysis of historical documents and mock-ups of inks and pigments. It consists of 1681 hyperspectral datacubes, containing millions of reflectance spectra, covering the VNIR (4001000 nm) and SWIR (9001700 nm) spectral ranges, including different ink recipes and documents from the 15th to 20th centuries, preserved in two archives in Granada, Spain. We will present the data acquisition process and structure of the database, followed by a live demonstration of its functionality, guiding participants through its use. Additionally, three applications of the database will be summarized, including document binarization, ink classification using machine learning techniques, and ink aging analysis. The HYPERDOC database facilitates the integration of advanced imaging techniques into document analysis and preservation, contributing to the non-invasive study of historical materials.
Hyperspectral imaging has been widely and consistently applied in the field of Cultural Heritage for material identification. In the specific context of historical document analysis, it is frequently supported and complemented by additional analytical techniques. In this study, we propose a straightforward method for material identification that combines adaptive direct identificationusing a reference library of visible and near-infrared spectral reflectance data for pigmentswith a KNN classifier applied to an extended spectral range for inks and supports. The method has demonstrated a high degree of accuracy, successfully identifying materials present in both actual historical documents and mock-ups created following medieval techniques. Its performance is illustrated through three spectral image fragments extracted from the HYPERDOC project database.