Jakob Nazarenus

Mr. Jakob Nazarenus

orcid

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 January 2025 in IEEE Transactions on Visualization and Computer Graphics
Verified
Journal Article
Closed access
SKSimin Kou
Simin Kou
FZFanglue Zhang
Fanglue Zhang
JNJakob Nazarenus
Jakob Nazarenus
RKReinhard Koch
Reinhard Koch
NDNeil Dodgson
Neil Dodgson
Consumer-level omnidirectional video offers an economically viable means to create virtual reality (VR) assets, enabling users to explore and interact within a fully immersive visual environment. However, editing such videos, particularly those with 360${}^{\circ }$ views and dynamic objects, poses significant challenges. Existing approaches to representing and manipulating omnidirectional content—whether designed for typical 2D perspective imagery or panoramas—often fail to adequately capture the complex spatiotemporal relationships crucial for producing high-quality, editable outputs in dynamic, panoramic settings. To overcome these challenges, we introduce OmniPlane, a novel method that leverages spherical spatiotemporal feature grids to empower the representation and editability of real-world dynamic omnidirectional environments casually captured by commodity omnidirectional cameras. OmniPlane computes spatiotemporal features by fusing vectors or matrices from each learnable spatial and spatiotemporal feature plane within a spherical coordinate system, complemented by a specifically designed weighted sampling strategy respecting the inherent spherical distribution of omnidirectional content. These learned feature planes can be flexibly decomposed into palette-based color bases. This innovative method not only enhances the representation capability of omnidirectional content and dynamics but also enables the recoloring of omnidirectional videos. Extensive experiments and a dedicated user study validate the superior performance of our proposed method in facilitating recolorable representations of dynamic omnidirectional environments.

26 September 2024 in ACS Materials Letters
Verified
Journal Article
Open access
HQHaoyi Qiu
Haoyi Qiu
JNJakob Nazarenus
Jakob Nazarenus
BEBernhard Egeler
Bernhard Egeler
TTTom Thode
Tom Thode
FOFirdaws Osman
Firdaws Osman
LSLeonard Siebert
Leonard Siebert
Medical phantoms mimic aspects of procedures like computed tomography (CT), ultrasound (US) imaging, and surgical practices. However, the materials for current commercial phantoms are expensive and the fabrication with these is complex and lacks versatility. Therefore, existing material solutions are not suitable for creating patient-specific phantoms. We present a novel and cost-effective material system (utilizing ubiquitous sodium alginate hydrogel and coconut fat) with independently and accurately tailorable CT, US, and mechanical properties. By varying the concentration of alginate, cross-linker, and coconut fat, the radiological parameters and the elastic modulus were adjusted independently in a wide range. The independence was demonstrated by creating phantoms with features hidden in US, while visible in CT imaging and vice versa. This system is particularly beneficial in resource-scarce areas since the materials are cheap (<$ 1 USD/kg) and easy to obtain, offering realistic and versatile phantoms to practice surgeries and ultimately enhance patient care.


9 May 2024 in Journal of Imaging
Verified
Journal Article
Open access
PDF file
MSMonty Santarossa
Monty Santarossa
TBTebbo Tassilo Beyer
Tebbo Tassilo Beyer
ASAmelie Bernadette Antonia Scharf
Amelie Bernadette Antonia Scharf
ATAyse Tatli
Ayse Tatli
CBClaus von der Burchard
Claus von der Burchard
RKReinhard Koch
Reinhard Koch
Hyperfluorescence (HF) and reduced autofluorescence (RA) are important biomarkers in fundus autofluorescence images (FAF) for the assessment of health of the retinal pigment epithelium (RPE), an important indicator of disease progression in geographic atrophy (GA) or central serous chorioretinopathy (CSCR). Autofluorescence images have been annotated by human raters, but distinguishing biomarkers (whether signals are increased or decreased) from the normal background proves challenging, with borders being particularly open to interpretation. Consequently, significant variations emerge among different graders, and even within the same grader during repeated annotations. Tests on in-house FAF data show that even highly skilled medical experts, despite previously discussing and settling on precise annotation guidelines, reach a pair-wise agreement measured in a Dice score of no more than 63–80% for HF segmentations and only 14–52% for RA. The data further show that the agreement of our primary annotation expert with herself is a 72% Dice score for HF and 51% for RA. Given these numbers, the task of automated HF and RA segmentation cannot simply be refined to the improvement in a segmentation score. Instead, we propose the use of a segmentation ensemble. Learning from images with a single annotation, the ensemble reaches expert-like performance with an agreement of a 64–81% Dice score for HF and 21–41% for RA with all our experts. In addition, utilizing the mean predictions of the ensemble networks and their variance, we devise ternary segmentations where FAF image areas are labeled either as confident background, confident HF, or potential HF, ensuring that predictions are reliable where they are confident (97% Precision), while detecting all instances of HF (99% Recall) annotated by all experts.

1 January 2024
Verified
Conference Paper
Open access
JNJakob Nazarenus
Jakob Nazarenus
SRSimon Reichhuber
Simon Reichhuber
MAManuel Amersdorfer
Manuel Amersdorfer
LELukas Elsner
Lukas Elsner
RKReinhard Koch
Reinhard Koch
HAHossam Abbas
Hossam Abbas

22 December 2024 in Journal of Imaging
Verified
Journal Article
Open access
PDF file
JNJakob Nazarenus
Jakob Nazarenus
SKSimin Kou
Simin Kou
FZFanglue Zhang
Fanglue Zhang
RKReinhard Koch
Reinhard Koch
Due to recent advances in 3D reconstruction from RGB images, it is now possible to create photorealistic representations of real-world scenes that only require minutes to be reconstructed and can be rendered in real time. In particular, 3D Gaussian splatting shows promising results, outperforming preceding reconstruction methods while simultaneously reducing the overall computational requirements. The main success of 3D Gaussian splatting relies on the efficient use of a differentiable rasterizer to render the Gaussian scene representation. One major drawback of this method is its underlying pinhole camera model. In this paper, we propose an extension of the existing method that removes this constraint and enables scene reconstructions using arbitrary camera optics such as highly distorting fisheye lenses. Our method achieves this by applying a differentiable warping function to the Gaussian scene representation. Additionally, we reduce overfitting in outdoor scenes by utilizing a learnable skybox, reducing the presence of floating artifacts within the reconstructed scene. Based on synthetic and real-world image datasets, we show that our method is capable of creating an accurate scene reconstruction from highly distorted images and rendering photorealistic images from such reconstructions.