In this paper we present a novel plausible realistic rendering method for mixed reality systems, which is useful for many real life application scenarios, like architecture, product visualization or edutainment. To allow virtual objects to seamlessly blend into the real environment, the real lighting conditions and the mutual illumination effects between real and virtual objects must be considered, while maintaining interactive frame rates (20-30fps). The most important such effects are indirect illumination and shadows cast between real and virtual objects. Our approach combines Instant Radiosity and Differential Rendering. In contrast to some previous solutions, we only need to render the scene once in order to find the mutual effects of virtual and real scenes. The dynamic real illumination is derived from the image stream of a fish-eye lens camera. We describe a new method to assign virtual point lights to multiple primary light sources, which can be real or virtual. We use imperfect shadow maps for calculating illumination from virtual point lights and have significantly improved their accuracy by taking the surface normal of a shadow caster into account. Temporal coherence is exploited to reduce flickering artifacts. Our results show that the presented method highly improves the illusion in mixed reality applications and significantly diminishes the artificial look of virtual objects superimposed onto real scenes.

Panoramic camera systems on robots exploring the surface of Mars are used to collect images of terrain and rock outcrops which they encounter along their traverse. Image mosaics from these cameras are essential in mapping the surface geology and selecting locations for analysis by other instruments on the rover's payload. 2‐D images do not truly portray the depth of field of features within an image, nor their 3‐D geometry. This paper describes a new 3‐D visualization software tool for geological analysis of Martian rover‐derived Digital Outcrop Models created using photogrammetric processing of stereo‐images using the Planetary Robotics Vision Processing tool developed for 3‐D vision processing of ExoMars PanCam and Mars 2020 Mastcam‐Z data. Digital Outcrop Models are rendered in real time in the Planetary Robotics 3‐D Viewer PRo3D, allowing scientists to roam outcrops as in a terrestrial field campaign. Digitization of point, line, and polyline features is used for measuring the physical dimensions of geological features and communicating interpretations. Dip and strike of bedding and fractures is measured by digitizing a polyline along the contact or fracture trace, through which a best fit plane is plotted. The attitude of this plane is calculated in the software. Here we apply these tools to analysis of sedimentary rock outcrops and quantification of the geometry of fracture systems encountered by the science teams of NASA's Mars Exploration Rover Opportunity and Mars Science Laboratory rover Curiosity. We show the benefits PRo3D allows for visualization and collection of geological interpretations and analyses from rover‐derived stereo‐images.

With an increasing world population and accelerated urbanization, the development of landscape sustainability remains a challenge for scientists, designers, and multiple stakeholders. Landscape sustainability science (LSS) studies dynamic relationships among landscape pattern, ecosystem services, and human well-being with spatially explicit methods. The design of a sustainable landscape needs both landscape sustainability–related disciplines and digital technologies that have been rapidly developing. GeoDesign is a new design method based on a new generation of information technology, especially spatial information technology, to design land systems. This paper discusses the suitability of GeoDesign for LSS to help design sustainable landscapes. Building on a review of LSS and GeoDesign, we conclude that LSS can utilize GeoDesign as a research method and the designed landscape as a research object to enrich and empower the spatially explicit methodology of LSS. To move forward, we suggest to integrate GeoDesign with LSS from six perspectives: strong/weak sustainability, multiple scales, ecosystem services, sustainability indicators, big data application, and the sense of place. Toward this end, we propose a LSS-based GeoDesign framework that links the six perspectives. We expect that this integration between GeoDesign and LSS will help advance the science and practice of sustainability and bring together many disciplines across natural, social, and design sciences.

The Mars 2020 Mastcam‐Z stereo camera investigation enables the generation of three dimension (3D) data products needed to visualize and analyze rocks, outcrops, and other geological and aeolian features. The Planetary Robotics Vision Processing framework “PRoViP” as well as the Instrument Data System on a tactical—sol‐by‐sol—timeframe generate 3D vision products, such as panoramas, distance maps, and textured meshes. Structure‐from‐motion used by the Advanced Science Targeting Toolkit for Robotic Operations (ASTTRO) “Landform” tool and long baseline stereo pipelines add to the 3D vision products' suite on various scales. Data fusion with textured meshes from satellite imagery and 3D data analysis and interpretation of the resulting large 3D data sets is realized by visualization assets like the Planetary Robotics Vision 3D Viewer PRo3D, the 3D Geographical Information System GIS CAMP (Campaign Analysis Mapping and Planning tool), the ASTTRO 3D data presentation and targeting tool, and the Mastcam‐Z planning tool Viewpoint. The pipelines' workflows and the user‐oriented features of the visualization assets, shared across the Mars 2020 mission, are reported. The individual role and interplay, complements and synergies of the individual frameworks are explained. Emphasis is laid on publicly available 3D vision data products and tools. A representative set of scientific use cases from planetary geology, aeolian activity, soil analysis and impact science illustrates the scientific workflow, and public data deployment modes are briefly outlined, demonstrating that 3D vision processing and visualization is an essential mission‐wide asset to solve important planetary science questions such as prevailing wind direction, soil composition, or geologic origin.