Detecting objects with a small representation in images is a challenging task, especially when the style of the images is very different from recent photos, which is the case for cultural heritage datasets. This problem is commonly known as few-shot object detection and is still a new field of research. This article presents a simple and effective method for black box few-shot object detection that works with all the current state-of-the-art object detection models. We also present a new dataset called MMSD for medieval musicological studies that contains five classes and 693 samples, manually annotated by a group of musicology experts. Due to the significant diversity of styles and considerable disparities between the artistic representations of the objects, our dataset is more challenging than the current standards. We evaluate our method on YOLOv4 (m/s), (Mask/Faster) RCNN, and ViT/Swin-t. We present two methods of benchmarking these models based on the overall data size and the worst-case scenario for object detection. The experimental results show that our method always improves object detector results compared to traditional transfer learning, regardless of the underlying architecture.
Object detection and Image classification have witnessed tremendous improvement in fixing domain gaps between training and deployment data. However, Transfer Learning is still the best method for Object Detection that provides resilient results. This paper presents two main contributions. First, we developed a benchmark annotated dataset of stringed musical instruments in artworks from the Middle Ages (827 images), the Early Modern Age (165 images), and the Contemporary History (10258 images). Second, we present a new Transfer Learning method for Object Detection models that is non-intrusive, simple, reproducible, and model-independent. Our method iteratively trains the black box Object detection models on the source and target datasets and shifts the focus between them dynamically to improve the results on the target dataset while maintaining the performance on the source dataset. Our method was thoroughly evaluated against several Transfer Learning methods on YOLOv4, YOLOv5, PP-YOLO, and Detectron2 with their respective versions. The experimental results show that our method outperforms existing Transfer Learning techniques with over 8.83% F1-score on our dataset.
Illuminated manuscripts are essential iconographic sources for medieval studies. With the massive adoption of IIIF, old and new digital collections of manuscripts are accessible online and provide interoperable image data. However, finding illuminations within the manuscripts’ pages is increasingly time consuming. This article proposes an approach based on machine learning and transfer learning that browses IIIF manuscript pages and detects the illuminated ones. To evaluate our approach, a group of domain experts created a new dataset of manually annotated IIIF manuscripts. The preliminary results show that our algorithm detects the main illuminated pages in a manuscript, thus reducing experts’ search time.
En associant les cris, les jurons et les chansons aux paysages sonores du Moyen Âge et de la Renaissance, Laurent Vissière et Laurent Hablot accordent d’emblée un rôle important à l’action humaine constitutive de ces paysages dont la définition varie beaucoup dans le monde de la recherche. Ce postulat intéresse les musicologues qui cherchent à distinguer « l’environnement sonore subi » (sons de la nature, activités humaines, transports) et « le paysage sonore » qui n’a de réalité que par le f...
Fifty-eight misericords remain of approximately 88 in the original set of the cathedral of Rouen in Normandie. Of these, two were removed to make room for an Episcopal seat now on the south row of the stalls; several stalls were destroyed in a fire of 1514. Ten stalls were removed from the choir after the second world war and are now in the archbishop’s palace, (see article on the archbishop’s stalls). Others were severely damaged during the 1944 bombardment of the stalls and the only record ...