Saptarshi Neil Sinha

Saptarshi Neil Sinha

Auto-generated profile, based on publicly available information

Saptarshi Neil Sinha

Virtual and augmented reality, Fraunhofer IGD, Germany

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
15 July 2025 in ISPRS Journal of Photogrammetry and Remote Sensing
Verified
Journal Article
Open access
SSSaptarshi Neil Sinha
Saptarshi Neil Sinha
HGHolger Graf
Holger Graf
MWMichael Weinmann
Michael Weinmann

25 September 2024
Verified
Conference Paper
Open access
SSSaptarshi Neil Sinha
Saptarshi Neil Sinha
JKJulius Kühn
Julius Kühn
HGHolger Graf
Holger Graf
MWMichael Weinmann
Michael Weinmann
Spectral rendering accurately simulates light-material interactions by considering the entire light spectrum, unlike traditional rendering methods that use limited color channels like RGB. This technique is particularly valuable in industries to assess visual quality before production. Moreover, Spectral imaging finds extensive applications in fields like agriculture for plant disease detection, cultural heritage for preservation, forensic science, environment monitoring and medical science among others. Advances in generating novel views from images have been achieved through methods like NERF and Gaussian splatting, which outperforms others in terms of quality. This paper introduces a web-based viewer built on the Viser framework for visualizing and comparing cross-spectral Gaussian splats from different views and during various training stages. This viewer supports real-time collaboration and comprehensive visual comparison, enhancing user experience in spectral data analysis. We conduct a user study and performance analysis to confirm its effectiveness and usability for different application scenarios, while also proposing potential enhancements for increased functionality.

13 August 2024 in arXiv
Verified
Preprint
Open access
PDF file
SSSaptarshi Neil Sinha
Saptarshi Neil Sinha
HGHolger Graf
Holger Graf
MWMichael Weinmann
Michael Weinmann
We propose a novel cross-spectral rendering framework based on 3D Gaussian Splatting (3DGS) that generates realistic and semantically meaningful splats from registered multi-view spectrum and segmentation maps. This extension enhances the representation of scenes with multiple spectra, providing insights into the underlying materials and segmentation. We introduce an improved physically-based rendering approach for Gaussian splats, estimating reflectance and lights per spectra, thereby enhancing accuracy and realism. In a comprehensive quantitative and qualitative evaluation, we demonstrate the superior performance of our approach with respect to other recent learning-based spectral scene representation approaches (i.e., XNeRF and SpectralNeRF) as well as other non-spectral state-of-the-art learning-based approaches. Our work also demonstrates the potential of spectral scene understanding for precise scene editing techniques like style transfer, inpainting, and removal. Thereby, our contributions address challenges in multi-spectral scene representation, rendering, and editing, offering new possibilities for diverse applications.

6 February 2026
Verified
Book Chapter
Open access
YAYoko Arteaga
Yoko Arteaga
CBCristiana Barandoni
Cristiana Barandoni
Lucia BurgioLucia Burgio
Lucia Burgio
DBDavid Buti
David Buti
ICIrina Ciortan
Irina Ciortan
GTGiorgio Trumpy
Giorgio Trumpy

14 November 2025 in arXiv
Verified
Preprint
Open access
PDF file
SSSaptarshi Neil Sinha
Saptarshi Neil Sinha
JKJulius Kühn
Julius Kühn
MGMika Silvan Goschke
Mika Silvan Goschke
MWMichael Weinmann
Michael Weinmann
Automated and selective harvesting of fruits has become an important area of research, particularly due to challenges such as high costs and a shortage of seasonal labor in advanced economies. This paper focuses on 6D pose estimation of strawberries using purely synthetic data generated through a procedural pipeline for photorealistic rendering. We employ the YOLOX-6D-Pose algorithm, a single-shot approach that leverages the YOLOX backbone, known for its balance between speed and accuracy, and its support for edge inference. To address the lacking availability of training data, we introduce a robust and flexible pipeline for generating synthetic strawberry data from various 3D models via a procedural Blender pipeline, where we focus on enhancing the realism of the synthesized data in comparison to previous work to make it a valuable resource for training pose estimation algorithms. Quantitative evaluations indicate that our models achieve comparable accuracy on both the NVIDIA RTX 3090 and Jetson Orin Nano across several ADD-S metrics, with the RTX 3090 demonstrating superior processing speed. However, the Jetson Orin Nano is particularly suited for resource-constrained environments, making it an excellent choice for deployment in agricultural robotics. Qualitative assessments further confirm the model's performance, demonstrating its capability to accurately infer the poses of ripe and partially ripe strawberries, while facing challenges in detecting unripe specimens. This suggests opportunities for future improvements, especially in enhancing detection capabilities for unripe strawberries (if desired) by exploring variations in color. Furthermore, the methodology presented could be adapted easily for other fruits such as apples, peaches, and plums, thereby expanding its applicability and impact in the field of agricultural automation.