Nishant Kumar

Mr. Nishant Kumar

Technische Universität Dresden — TU Dresden
+1
orcid

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 October 2019
Verified
Book Chapter
Closed access
PDF file
Nishant KumarNishant Kumar
Nishant Kumar
NHNico Hoffmann
Nico Hoffmann
MOMartin Oelschlägel
Martin Oelschlägel
EKEdmund Koch
Edmund Koch
MKMatthias Kirsch
Matthias Kirsch
SGStefan Gumhold
Stefan Gumhold

10 December 2020 in Computers
Verified
Journal Article
Open access
PDF file
Nishant KumarNishant Kumar
Nishant Kumar
Stefan GumholdStefan Gumhold
Stefan Gumhold
Image fusion helps in merging two or more images to construct a more informative single fused image. Recently, unsupervised learning-based convolutional neural networks (CNN) have been used for different types of image-fusion tasks such as medical image fusion, infrared-visible image fusion for autonomous driving as well as multi-focus and multi-exposure image fusion for satellite imagery. However, it is challenging to analyze the reliability of these CNNs for the image-fusion tasks since no groundtruth is available. This led to the use of a wide variety of model architectures and optimization functions yielding quite different fusion results. Additionally, due to the highly opaque nature of such neural networks, it is difficult to explain the internal mechanics behind its fusion results. To overcome these challenges, we present a novel real-time visualization tool, named FuseVis, with which the end-user can compute per-pixel saliency maps that examine the influence of the input image pixels on each pixel of the fused image. We trained several image fusion-based CNNs on medical image pairs and then using our FuseVis tool we performed case studies on a specific clinical application by interpreting the saliency maps from each of the fusion methods. We specifically visualized the relative influence of each input image on the predictions of the fused image and showed that some of the evaluated image-fusion methods are better suited for the specific clinical application. To the best of our knowledge, currently, there is no approach for visual analysis of neural networks for image fusion. Therefore, this work opens a new research direction to improve the interpretability of deep fusion networks. The FuseVis tool can also be adapted in other deep neural network-based image processing applications to make them interpretable.

1 April 2020
Verified
Conference Paper
Closed access
Nishant KumarNishant Kumar
Nishant Kumar
NHNico Hoffmann
Nico Hoffmann
MKMatthias Kirsch
Matthias Kirsch
SGStefan Gumhold
Stefan Gumhold
The medical image fusion combines two or more modalities into a single view while medical image translation synthesizes new images and assists in data augmentation. Together, these methods help in faster diagnosis of high grade malignant gliomas. However, they might be untrustworthy due to which neurosurgeons demand a robust visualisation tool to verify the reliability of the fusion and translation results before they make pre-operative surgical decisions. In this paper, we propose a novel approach to compute a confidence heat map between the source-target image pair by estimating the information transfer from the source to the target image using the joint probability distribution of the two images. We evaluate several fusion and translation methods using our visualisation procedure and showcase its robustness in enabling neurosurgeons to make finer clinical decisions.

14 February 2024 in Sensors
Verified
Journal Article
Open access
PDF file
Nishant KumarNishant Kumar
Nishant Kumar
LKLukas Krause
Lukas Krause
TWThomas Thomas Wondrak
Thomas Thomas Wondrak
SESven Eckert
Sven Eckert
KEKerstin Eckert
Kerstin Eckert
Stefan GumholdStefan Gumhold
Stefan Gumhold
Electrolysis stands as a pivotal method for environmentally sustainable hydrogen production. However, the formation of gas bubbles during the electrolysis process poses significant challenges by impeding the electrochemical reactions, diminishing cell efficiency, and dramatically increasing energy consumption. Furthermore, the inherent difficulty in detecting these bubbles arises from the non-transparency of the wall of electrolysis cells. Additionally, these gas bubbles induce alterations in the conductivity of the electrolyte, leading to corresponding fluctuations in the magnetic flux density outside of the electrolysis cell, which can be measured by externally placed magnetic sensors. By solving the inverse problem of the Biot–Savart Law, we can estimate the conductivity distribution as well as the void fraction within the cell. In this work, we study different approaches to solve the inverse problem including Invertible Neural Networks (INNs) and Tikhonov regularization. Our experiments demonstrate that INNs are much more robust to solving the inverse problem than Tikhonov regularization when the level of noise in the magnetic flux density measurements is not known or changes over space and time.

1 August 2024
Verified
Book Chapter
Closed access
PDF file
Nishant KumarNishant Kumar
Nishant Kumar
ZTZiyan Tao
Ziyan Tao
JSJaikirat Singh
Jaikirat Singh
YLYang Li
Yang Li
PSPeiwen Sun
Peiwen Sun
SGStefan Gumhold
Stefan Gumhold

28 March 2024 in arXiv
Verified
Preprint
Open access
PDF file
Nishant KumarNishant Kumar
Nishant Kumar
LKLukas Krause
Lukas Krause
TWThomas Wondrak
Thomas Wondrak
SESven Eckert
Sven Eckert
KEKerstin Eckert
Kerstin Eckert
SGStefan Gumhold
Stefan Gumhold
Electrolysis is crucial for eco-friendly hydrogen production, but gas bubbles generated during the process hinder reactions, reduce cell efficiency, and increase energy consumption. Additionally, these gas bubbles cause changes in the conductivity inside the cell, resulting in corresponding variations in the induced magnetic field around the cell. Therefore, measuring these gas bubble-induced magnetic field fluctuations using external magnetic sensors and solving the inverse problem of Biot-Savart Law allows for estimating the conductivity in the cell and, thus, bubble size and location. However, determining high-resolution conductivity maps from only a few induced magnetic field measurements is an ill-posed inverse problem. To overcome this, we exploit Invertible Neural Networks (INNs) to reconstruct the conductivity field. Our qualitative results and quantitative evaluation using random error diffusion show that INN achieves far superior performance compared to Tikhonov regularization.