We present a method for capturing the BSSRDF (bidirectional scattering‐surface reflectance distribution function) of arbitrary geometry with a neural network. We demonstrate how a compact neural network can represent the full 8‐dimensional light transport within an object including heterogeneous scattering. We develop an efficient rendering method using importance sampling that is able to render complex translucent objects under arbitrary lighting. Our method can also leverage the common planar half‐space assumption, which allows it to represent one BSSRDF model that can be used across a variety of geometries. Our results demonstrate that we can render heterogeneous translucent objects under arbitrary lighting and obtain results that match the reference rendered using volumetric path tracing.
The conventional approach to appearance prediction for 3D printed parts is to print a thin slab of material and measure its reflectance or transmittance with a spectrophotometer. Reflectance works for opaque printing materials. Transmittance works for transparent printing materials. However, the conventional approach does not work convincingly for translucent materials. For these, we need to separate scattering and absorption. We suggest printing a collection of thin slabs of different thicknesses and using these in a spectrophotometer to obtain the scattering and absorption properties of the material. A model is fitted to the measured data in order to estimate the scattering and absorption properties. To this end, we compare the use of Monte Carlo light transport simulation and the use of an analytic model that we developed from the theory of radiative transfer in plane-parallel media. We assess the predictive capabilities of our method through a multispectral photo-render comparison based on the estimated optical properties.
12 May 2026 in International Journal of Computer Vision
Achieving physically consistent image editing remains a significant challenge in computer vision. Existing image editing methods typically rely on neural networks, which struggle to accurately handle shadows and refractions. Conversely, physics-based inverse rendering often requires multi-view optimization, limiting its practicality in single-image scenarios. In this paper, we propose Materialist , a neural-initialized physically based rendering pipeline for single-image inverse rendering. Unlike previous hybrid methods that use physics to guide neural generation, our method leverages neural networks to predict initial material properties, which are then rigorously optimized via progressive differentiable rendering. Our approach enables a range of applications, including material editing, object insertion, and relighting, while also introducing an effective method for editing material transparency via ray-traced refraction without requiring full scene geometry. Furthermore, our envmap estimation method also achieves competitive performance, further enhancing the accuracy of image editing task. Experiments demonstrate strong performance across synthetic and real-world datasets, excelling even on challenging out-of-domain images.
The optical properties available for an object are most often fragmented and insufficient for photorealistic rendering of the object. We propose a procedure for digitizing a translucent object with sufficient information for predictive rendering of its appearance. Based on object material descriptions, we compute optical properties and validate or adjust this object appearance model based on comparison of simulation with spectrophotometric measurements of the bidirectional scattering-surface reflectance distribution function (BSSRDF). To ease this type of comparison, we provide an efficient simulation tool that computes the BSSRDF for a particular light-view configuration. Even with just a few configurations, the localized lighting in BSSRDF measurements is useful for assessing the appropriateness of computed or otherwise acquired optical properties. To validate an object appearance model in a more common lighting environment, we render the appearance of the obtained digital twin and assess the photorealism of our renderings through pixel-by-pixel comparison with photographs of the physical object.