In the Digital Cultural Heritage (DCH) domain, the semantic segmentation of 3D Point Clouds with Deep Learning (DL) techniques can help to recognize historical architectural elements, at an adequate level of detail, and thus speed up the process of modeling of historical buildings for developing BIM models from survey data, referred to as HBIM (Historical Building Information Modeling). In this paper, we propose a DL framework for Point Cloud segmentation, which employs an improved DGCNN (Dynamic Graph Convolutional Neural Network) by adding meaningful features such as normal and colour. The approach has been applied to a newly collected DCH Dataset which is publicy available: ArCH (Architectural Cultural Heritage) Dataset. This dataset comprises 11 labeled points clouds, derived from the union of several single scans or from the integration of the latter with photogrammetric surveys. The involved scenes are both indoor and outdoor, with churches, chapels, cloisters, porticoes and loggias covered by a variety of vaults and beared by many different types of columns. They belong to different historical periods and different styles, in order to make the dataset the least possible uniform and homogeneous (in the repetition of the architectural elements) and the results as general as possible. The experiments yield high accuracy, demonstrating the effectiveness and suitability of the proposed approach.

In recent years semantic segmentation of 3D point clouds has been an argument that involves different fields of application. Cultural heritage scenarios have become the subject of this study mainly thanks to the development of photogrammetry and laser scanning techniques. Classification algorithms based on machine and deep learning methods allow to process huge amounts of data as 3D point clouds. In this context, the aim of this paper is to make a comparison between machine and deep learning methods for large 3D cultural heritage classification. Then, considering the best performances of both techniques, it proposes an architecture named DGCNN-Mod+3Dfeat that combines the positive aspects and advantages of these two methodologies for semantic segmentation of cultural heritage point clouds. To demonstrate the validity of our idea, several experiments from the ArCH benchmark are reported and commented.

The lack of benchmarking data for the semantic segmentation of digital heritage scenarios is hampering the development of automatic classification solutions in this field. Heritage 3D data feature complex structures and uncommon classes that prevent the simple deployment of available methods developed in other fields and for other types of data. The semantic classification of heritage 3D data would support the community in better understanding and analysing digital twins, facilitate restoration and conservation work, etc. In this paper, we present the first benchmark with millions of manually labelled 3D points belonging to heritage scenarios, realised to facilitate the development, training, testing and evaluation of machine and deep learning methods and algorithms in the heritage field. The proposed benchmark, available at http://archdataset.polito.it/, comprises datasets and classification results for better comparisons and insights into the strengths and weaknesses of different machine and deep learning approaches for heritage point cloud semantic segmentation, in addition to promoting a form of crowdsourcing to enrich the already annotated database.

This study describes the technical-systemic and conceptual-informative interoperability tests for the integration of a Historic Building Information Modeling (HBIM) model in a 3D Geographic Information System (GIS) environment aimed to provide complete and useful documentation for multiscale analyses on cultural heritage particularly exposed to risks. The case study of the San Lorenzo Church in Norcia (Italy) has been chosen given the urgent need to update the existing documentation for its protection and conservation issues, due to the extensive damage suffered after the series of earthquakes that occurred in central Italy starting from summer 2016. Different tests to evaluate two levels of conceptual interoperability (technical and semantic) when importing the HBIM model into a GIS environment were performed, whether with commercial software or with open source ones (ArcGIS Pro and QGIS, respectively). A data integration platform (Feature Manipulation Engine, FME) has been used for converting the IFC (Industry Foundation Classes) data format into the GML (Geography Markup Language) format, in order to obtain a unique and unified model and vocabulary for the 3D GIS project, structured with different levels of detail, according to CityGML standard. Finally, as HBIM-GIS integration is considered, the loss of geometric and informative data has been taken into account and evaluated.

Cultural Heritage is a testimony of past human activity, and, as such, its objects exhibit great variety in their nature, size and complexity; from small artefacts and museum items to cultural landscapes, from historical building and ancient monuments to city centers and archaeological sites. Cultural Heritage around the globe suffers from wars, natural disasters and human negligence. The importance of digital documentation is well recognized and there is an increasing pressure to document our heritage both nationally and internationally. For this reason, the three-dimensional scanning and modeling of sites and artifacts of cultural heritage have remarkably increased in recent years. The semantic segmentation of point clouds is an essential step of the entire pipeline; in fact, it allows to decompose complex architectures in single elements, which are then enriched with meaningful information within Building Information Modelling software. Notwithstanding, this step is very time consuming and completely entrusted on the manual work of domain experts, far from being automatized. This work describes a method to label and cluster automatically a point cloud based on a supervised Deep Learning approach, using a state-of-the-art Neural Network called PointNet++. Despite other methods are known, we have choose PointNet++ as it reached significant results for classifying and segmenting 3D point clouds. PointNet++ has been tested and improved, by training the network with annotated point clouds coming from a real survey and to evaluate how performance changes according to the input training data. It can result of great interest for the research community dealing with the point cloud semantic segmentation, since it makes public a labelled dataset of CH elements for further tests.

This paper aims to describe the outcomes of the Main10ance project, which focused on developing an integrated HBIM-GIS platform to support the maintenance and conservation plans for the historic built heritage. The pilot case is the UNESCO complex of the Sacri Monti, located in northern Italy and Switzerland, which consists of groups of chapels and architectural artifacts holding significant historical and cultural value. Given their importance, specific maintenance plans involving multiple stakeholders and specialists are required. This study focuses on creating a unified system that semantically and spatially describes the architectural elements of the case study and the surrounding context and indoor assets. After a 3D integrated metric survey and the related data processing, parametric 3D models were created in a BIM environment, and a spatial database was developed to incorporate both geometric and alphanumeric entities. The database enables interoperability among different actors and domains, gathering heritage-related information crucial for restoration and conservation purposes. Additionally, the custom 4MAIN10ANCE web platform was developed with different levels of details (LODs), enabling the retrieval of both 2D and 3D data and establishing connections between the BIM models of the chapels and associated information.