Through the power of new sensing technologies, we are increasingly digitizing the real world. However, instruments produce unstructured data, mainly in the form of point clouds for 3D data and images for 2D data. Nevertheless, many applications (such as navigation, survey, infrastructure analysis) need structured data containing objects and their geometry. Various computer vision approaches have thus been developed to structure the data and identify objects therein. They can be separated into model-driven, data-driven, and knowledge-based approaches. Model-driven approaches mainly use the information on the objects contained in the data and are thus limited to objects and context. Among data-driven approaches, we increasingly find deep learning strategies because of their autonomy in detecting objects. They identify reliable patterns in the data and connect these to the object of interest. Deep learning approaches have to learn these patterns in a training stage. Knowledge-based approaches use characteristic knowledge from different domains allowing the detection and classification of objects. The knowledge must be formalized and substitutes the training for deep learning. Semantic web technologies allow the management of such human knowledge. Deep learning and knowledge-based approaches have already shown good results for semantic segmentation in various examples. The common goal but the different strategies of the two approaches engaged our interest in doing a comparison to get an idea of their strengths and weaknesses. To fill this knowledge gap, we applied two implementations of such approaches to a mobile mapping point cloud. The detected object categories are car, bush, tree, ground, streetlight and building. The deep learning approach uses a convolutional neural network, whereas the knowledge-based approach uses standard semantic web technologies such as SPARQL and OWL2to guide the data processing and the subsequent classification as well. The LiDAR point cloud used was acquired by a mobile mapping system in an urban environment and presents various complex scenes, allowing us to show the advantages and disadvantages of these two types of approaches. The deep learning and knowledge-based approaches produce a semantic segmentation with an average F1 score of 0.66 and 0.78, respectively. Further details are given by analyzing individual object categories allowing us to characterize specific properties of both types of approaches.

In the domain of computer vision, object recognition aims at detecting and classifying objects in data sets. Model-driven approaches are typically constrained through their focus on either a specific type of data, a context (indoor, outdoor) or a set of objects. Machine learning-based approaches are more flexible but also constrained as they need annotated data sets to train the learning process. That leads to problems when this data is not available through the specialty of the application field, like archaeology, for example. In order to overcome such constraints, we present a fully semantic-guided approach. The role of semantics is to express all relevant knowledge of the representation of the objects inside the data sets and of the algorithms which address this representation. In addition, the approach contains a learning stage since it adapts the processing according to the diversity of the objects and data characteristics. The semantic is expressed via an ontological model and uses standard web technology like SPARQL queries, providing great flexibility. The ontological model describes the object, the data and the algorithms. It allows the selection and execution of algorithms adapted to the data and objects dynamically. Similarly, processing results are dynamically classified and allow for enriching the ontological model using SPARQL construct queries. The semantic formulated through SPARQL also acts as a bridge between the knowledge contained within the ontological model and the processing branch, which executes algorithms. It provides the capability to adapt the sequence of algorithms to an individual state of the processing chain and makes the solution robust and flexible. The comparison of this approach with others on the same use case shows the efficiency and improvement this approach brings.

The signature of the 2019 Declaration of Cooperation on advancing the digitization of cultural heritage in Europe shows the important role that the 3D digitization process plays in the safeguard and sustainability of cultural heritage. The digitization also aims at sharing and presenting cultural heritage. However, the processing steps of data acquisition to its presentation requires an interdisciplinary collaboration, where understanding and collaborative work is difficult due to the presence of different expert knowledge involved. This study proposes an end-to-end method from the cultural data acquisition to its presentation thanks to explicit semantics representing the different fields of expert knowledge intervening in this process. This method is composed of three knowledge-based processing steps: (i) a recommendation process of acquisition technology to support cultural data acquisition; (ii) an object recognition process to structure the unstructured acquired data; and (iii) an enrichment process based on Linked Open Data to document cultural objects with further information, such as geospatial, cultural, and historical information. The proposed method was applied in two case studies concerning the watermills of Ephesos terrace house 2 and the first Sacro Monte chapel in Varallo. These application cases show the proposed method’s ability to recognize and document digitized cultural objects in different contexts thanks to the semantics.

Colour and Space in Cultural Heritage ( www.COSCH.info ) is a transdomain European Action (TD1201) in the area of Materials, Physics and Nanosciences (MPNS). The Action runs from 2013 to 2017 and benefits from the support of the European Cooperation in Science and Technology http://www.cost.eu/domains_actions/mpns/Actions/TD1201 . The Authors are active participants of the COSCH network. They represent different disciplines involved in documentation and conservation of material cultural heritage. COSCH aims to enhance applications of optical measuring techniques and electronic imaging in this area. The paper outlines scientific, theoretical and practical solutions promoted by COSCH. COSCH activities have been organised around six main subjects: (1) spectral object documentation; (2) spatial object documentation; (3) algorithms and procedures; (4) analysis and restoration of cultural heritage surfaces and objects; (5) visualisation of cultural heritage objects and its dissemination; and (6) the semantic development of the COSCH Knowledge Representation. The Authors indicate future work that is needed to resolve the identified scientific, technical and semantic questions, as well as challenges of interdisciplinary communication, to ensure a wider adoption of specialist technologies and enhanced standards in 3D documentation of material cultural heritage — being a basis for its understanding, conservation, restoration, long-term preservation, study, presentation and wide dissemination.

In this paper, we introduce applications of Artificial Intelligence techniques, such as Decision Trees and Semantic Reasoning, for semi-automatic and semantic-model-based decision-making for archaeological feature comparisons. This paper uses the example of Roman African Red Slip Ware (ARS) and the collection of ARS at the LEIZA archaeological research institute. The main challenge is to create a Digital Twin of the ARS objects and artefacts using geometric capturing and semantic modelling of archaeological information. Moreover, the individualisation and comparison of features (appliqués), along with their visualisation, extraction, and rectification, results in a strategy and application for comparison of these features using both geometrical and archaeological aspects with a comprehensible rule set. This method of a semi-automatic semantic model-based comparison workflow for archaeological features on Roman ceramics is showcased, discussed, and concluded in three use cases: woman and boy, human–horse hybrid, and bears with local twists and shifts.

Successful recycling of electronic waste requires accurate separation of materials such as plastics, PCBs and electronic components on PCBs (capacitors, transistors, etc.). This article therefore proposes a vision approach based on a combination of 3D and HSI data, relying on the mutual support of the datasets to compensate existing weaknesses when using single 3D- and HSI-Sensors. The combined dataset serves as a basis for the extraction of geometric and spectral features. The classification is performed and evaluated based on these extracted features which are exploited through rules. The efficiency of the proposed approach is demonstrated using real electronic waste and leads to convincing results with an overall accuracy (OA) of 98.24%. To illustrate that the addition of 3D data has added value, a comparison is also performed with an SVM classification based only on hyperspectral data.