This paper presents Segmentation for Diagnose (Seg4D), a holistic tool for processing 3D point clouds in the field of historical constructions. This tool incorporates state-of-the-art algorithms for the segmentation and analysis of construction systems and damage. Seg4D applies both supervised and unsupervised machine learning and deep learning methods, including the Point Transformer Neural Network for point cloud segmentation. Additionally, it facilitates the extraction of geometrical and statistical features, colour-scale conversion, noise reduction with anisotropic filters and the use of custom scripts for analysing deflections in slabs or out-of-plane movements in arches and vaults, among others. The Seg4D installer and source code are are publicly available in a GitHub repository.
In the field of Cultural Heritage, 3D point clouds are pivotal for representing scenes with high resolution and accuracy. Although traditionally used for planimetries and computational modelling, this study explores their potential in diagnostics. A novel methodology is proposed that leverages 3D point clouds to evaluate deflection in historic timber slabs. By combining Artificial Intelligence with advanced 3D point cloud techniques, an approach is developed for detecting beam deflections with high precision. Specifically, a multi-resolution Random Forest classifier identifies beams and their faces, while deflection is computed using connected component and minimum bounding rectangle algorithms. Applied to timber slabs in the Nuestra Señora convent in Ávila. This methodology demonstrates promising results, achieving 99% accuracy in beam detection and a high degree of automation in deflection assessment. This approach offers significant advancements in the diagnostic capabilities of 3D point clouds in heritage conservation.
Semantic segmentation of 3D point clouds is a key enabler for intelligent urban analysis and cultural heritage documentation. However, current benchmarks remain uneven for different reasons: from the fragmented scenes of cityscape scenarios where a unique environment is not provided, to the difficulties in representing the great variety of architectural styles and lexicons in the cultural heritage (CH) domain. This study introduces two complementary datasets, the 3M (Mapping Mappano Municipality) dataset and the ArCHX (Architectural Cultural Heritage eXpanded) dataset, meant to enhance cross-domain learning between urban and architectural heritage environments. The 3M dataset, derived from UAV photogrammetry and GNSS-based surveys over an 11.9 km² area near Turin (Italy), provides a highly accurate, semantically labelled urban point cloud (~900 M points) suitable for urban planning, automatic mapping, and infrastructure design. In parallel, the ArCHX dataset extends the existing ArCH benchmark with new scenes from Portuguese masonry gates and Indian Nagara-style temples, reaching over 400 million points. These additions diversify architectural typologies and improve the generalisation capacity of AI models applied to heritage semantic segmentation tasks. Methodological challenges in harmonising class taxonomies, managing heterogeneous materials, and aligning cultural architectural semantics across datasets are eventually discussed. Collectively, the 3M and ArCHX datasets establish a novel foundation for cross-domain benchmarking in 3D semantic segmentation, advancing data-driven research in digital twins, mapping, Historic Building Information Modelling (HBIM), and AI-assisted heritage documentation.
Digital platforms for cultural heritage are increasingly expected to document the geometric and material properties of sites. Furthermore, such platforms are increasingly expected to preserve and communicate the intangible practices and community knowledge that give these places cultural significance. In this context, this paper presents a hybrid virtual reality platform for the documentation, communication, and dissemination of both tangible and intangible heritage in underground wine landscapes. The framework integrates 360° panoramic imagery, 360° videos, lightweight object visualisations, and georeferenced 3D point clouds within a unified interface adapted to different device capabilities. The system’s key contributions include seasonal navigation, participatory recording of community practices, multiscale representation of artefacts and architecture, and a guided narrative system that improves orientation for non-expert users. The platform has been validated through the underground wineries of Baltanás (Spain), thereby demonstrating a novel approach that brings together metric documentation and immersive storytelling. This enhances accessibility, facilitates heritage interpretation, and ensures the digital preservation of living cultural practices in complex heritage settings with broad public dissemination potential.