Archives and museums store vast collections of historical images of urban areas and make them publicly available through online platforms. Many of these images, often containing historic buildings and landscapes, can be oriented spatially using automatic methods such as structure from motion (SfM). Providing spatially and temporally oriented images of urban architecture, in combination with advanced searching and 2D/3D exploration techniques, offers new potentials in supporting historians in their research. We are developing a 3D web environment usable to historians to spatially search online media repositories containing historic photographic images. We combine 3D models of historic buildings with spatially oriented images, replacing text-based searching through meta-data with spatial and temporal browsing with respect to given focus points in historic city models.
22 August 2019 in The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
The interdisciplinary research group on four-dimensional research and communication of urban history (Urban History 4D) aims to investigate and develop methods and technologies to access extensive repositories of historical media and their contextual information in a spatial model, with an additional temporal component. This will make content accessible to different target groups, researchers and the public, via a 4D Browser and an Augmented Reality app for mobile devices. One goal is to improve the accessibility of media repositories and develop suitable solutions for data preparation and information research, making extensive use of visualizations. An interdisciplinary approach is taken to ensure that visualizations for research are comprehensible and meet scientific standards. The investigation of spatial visualizations of image repositories and their visual representation in a coherent context includes frequencies, directions, and perspectives within the image material, which can be grasped through quantitative methods. This paper introduces two main investigations into (1) quantitative data visualization with photography and (2) the plausibility and perception of 3D reconstructions.
The ongoing digitization of historical photographs in archives allows investigating the quality, quantity, and distribution of these images. However, the exact interior and exterior camera orientations of these photographs are usually lost during the digitization process. The proposed method uses content-based image retrieval (CBIR) to filter exterior images of single buildings in combination with metadata information. The retrieved photographs are automatically processed in an adapted structure-from-motion (SfM) pipeline to determine the camera parameters. In an interactive georeferencing process, the calculated camera positions are transferred into a global coordinate system. As all image and camera data are efficiently stored in the proposed 4D database, they can be conveniently accessed afterward to georeference newly digitized images by using photogrammetric triangulation and spatial resection. The results show that the CBIR and the subsequent SfM are robust methods for various kinds of buildings and different quantity of data. The absolute accuracy of the camera positions after georeferencing lies in the range of a few meters likely introduced by the inaccurate LOD2 models used for transformation. The proposed photogrammetric method, the database structure, and the 4D visualization interface enable adding historical urban photographs and 3D models from other locations.
Numerous digital media repositories have been set up during recent decades, each containing plenty of data about historic cityscapes. In contrast, digital 3D reconstructions of no longer extant cityscapes have so far almost solely been performed for specific cases and via manual modelling techniques. Within the Jena4D research group, we are investigating and developing methods and technologies for transferring historical media and their contextual information into 4D models. The next step will be to automate this process and extend it to the world scale. Our team are working on different facets of that endeavor: retrieving images, text, and object data from public sources; crowdsourcing and collecting qualitative data from contests and pupil labs; processing historical plans and photographs to extract spatial data; location-based mobile visualization; and collection-browsing interfaces. This article is intended to highlight (1) current challenges, (2) the state of the art, (3) our approach to 4D modelling and visualization on the world scale, and (4) results from testing demo cases in Dresden, Jena, and Amsterdam.
In the context of source-based virtual reconstructions and its underlying decision-making processes (paradata), there has been a long-time demand for documenting why a reconstruction was executed in a certain way, and presenting it in a comprehensible and public manner. Lacking documentation leads to a loss of knowledge and that the scientific nature of a reconstruction won’t be guaranteed anymore. Based on earlier prototypes, TU Darmstadt and HTW Dresden developed IDOVIR (Infrastructure for Documentation of Virtual Reconstructions) which enables the documentation of this kind of paradata and metadata, and, at the same time, supports communication during the reconstruction phase. The tool can be used free of charge and independently by registering via ORCID. The core of IDOVIR is the division of an entity into different spatial areas and time periods to which multiple variants can be assigned. Each variant contains the triple of 1) the representation of the reconstruction (2D or 3D), 2) the sources used, and 3) a textual argumentation that explains how the reconstruction has been inferred from the sources. For long-term storage and availability, IDOVIR is hosted by the University and State Library Darmstadt.