22 March 2023 in Nano Letters
12 June 2024 in Journal of Chemical Theory and Computation
25 May 2023 in The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Neural Radiance Fields (NeRFs) are trained using a set of camera poses and associated images as input to estimate density and color values for each position. The position-dependent density learning is of particular interest for photogrammetry, enabling 3D reconstruction by querying and filtering the NeRF coordinate system based on the object density. While traditional methods like Structure from Motion are commonly used for camera pose calculation in pre-processing for NeRFs, the HoloLens offers an interesting interface for extracting the required input data directly. We present a workflow for high-resolution 3D reconstructions almost directly from HoloLens data using NeRFs. Thereby, different investigations are considered: Internal camera poses from the HoloLens trajectory via a server application, and external camera poses from Structure from Motion, both with an enhanced variant applied through pose refinement. Results show that the internal camera poses lead to NeRF convergence with a PSNR of 25 dB with a simple rotation around the x-axis and enable a 3D reconstruction. Pose refinement enables comparable quality compared to external camera poses, resulting in improved training process with a PSNR of 27 dB and a better 3D reconstruction. Overall, NeRF reconstructions outperform the conventional photogrammetric dense reconstruction using Multi-View Stereo in terms of completeness and level of detail.
19 October 2023 in The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Generating geometric 3D reconstructions from Neural Radiance Fields (NeRFs) is of great interest. However, accurate and complete reconstructions based on the density values are challenging. The network output depends on input data, NeRF network configuration and hyperparameter. As a result, the direct usage of density values, e.g. via filtering with global density thresholds, usually requires empirical investigations. Under the assumption that the density increases from non-object to object area, the utilization of density gradients from relative values is evident. As the density represents a position-dependent parameter it can be handled anisotropically, therefore processing of the voxelized 3D density field is justified. In this regard, we address geometric 3D reconstructions based on density gradients, whereas the gradients result from 3D edge detection filters of the first and second derivatives, namely Sobel, Canny and Laplacian of Gaussian. The gradients rely on relative neighboring density values in all directions, thus are independent from absolute magnitudes. Consequently, gradient filters are able to extract edges along a wide density range, almost independent from assumptions and empirical investigations. Our approach demonstrates the capability to achieve geometric 3D reconstructions with high geometric accuracy on object surfaces and remarkable object completeness. Notably, Canny filter effectively eliminates gaps, delivers a uniform point density, and strikes a favorable balance between correctness and completeness across the scenes.
9 April 2025 in The Journal of Chemical Physics
We analyze the coarse-grained equations of motion of molecular systems subject to external driving. As exemplary processes, we study by means of targeted and steered molecular dynamics simulations the dissociation of a sodium-chloride ion pair in water and ligand–protein unbinding of trypsin–benzamidine. We derive an exact generalization of Mori’s Langevin equation that contains the memory kernel of the stationary process, an additive driving force, and a non-equilibrium response force describing the effects of the perturbed environment. We show that both the fluctuating force in the stationary case and the non-equilibrium response force in the driven cases exhibit spatial structure in their first and second moments. The latter depends sensitively on the employed driving protocols. For sodium chloride, we find that the first moment of the non-equilibrium response force matches the mean force for slow constrained pulling. In contrast, for all tested restrained pulling protocols, significant differences arise between the two properties in both systems. We conclude that the non-equilibrium response of the solvent needs to be taken into account carefully when analyzing data from pulling simulations.
8 October 2025 in The Journal of Physical Chemistry B
Finding process pathways in molecular simulations such as the unbinding paths of small molecule ligands from their binding sites at protein targets in a set of trajectories via unsupervised learning approaches requires the definition of a suitable similarity measure between trajectories. Here, we evaluate the performance of four such measures with varying degree of sophistication, i.e., Euclidean and Wasserstein distances, Procrustes analysis, and dynamic time warping, when analyzing trajectory data from two different biased simulation driving protocols in the form of constant velocity constraint targeted MD and steered MD. In a streptavidin-biotin benchmark system with known ground truth clusters, Wasserstein distances yielded the best clustering performance, closely followed by Euclidean distances, both being the most computationally efficient similarity measures. In a more complex A2a receptor-inhibitor system, however, the simplest measure, i.e., Euclidean distances, was sufficient to reveal meaningful and interpretable clusters.