HyperSpectral (HS) images have been successfully used for brain tumor boundary detection during resection operations. Nowadays, these classification maps coexist with other technologies such as MRI or IOUS that improve a neurosurgeon’s action, with their incorporation being a neurosurgeon’s task. The project in which this work is framed generates an unified and more accurate 3D immersive model using HS, MRI, and IOUS information. To do so, the HS images need to include 3D information and it needs to be generated in real-time operating room conditions, around a few seconds. This work presents Graph cuts Reference depth estimation in GPU (GoRG), a GPU-accelerated multiview depth estimation tool for HS images also able to process YUV images in less than 5.5 s on average. Compared to a high-quality SoA algorithm, MPEG DERS, GoRG YUV obtain quality losses of −0.93 dB, −0.6 dB, and −1.96% for WS-PSNR, IV-PSNR, and VMAF, respectively, using a video synthesis processing chain. For HS test images, GoRG obtains an average RMSE of 7.5 cm, with most of its errors in the background, needing around 850 ms to process one frame and view. These results demonstrate the feasibility of using GoRG during a tumor resection operation.

Hyperspectral imaging (HSI) has a crucial role in material classification tasks. The primary type of sensors in this field are linescan sensors, offering a high spatial and spectral resolution and improving the quality of the captured hypercubes. However, these cameras have inherent problems such as the need of dedicated hardware to move the camera over the scene and the necessity of pre-processing the raw captures in order to obtain the actual hypercube. This work makes an analysis and an adaptation of stitching techniques to apply them to the medical area. Also, it includes different methods to post-process the hypercubes obtained and it analyzes the SURF algorithm to improve processing times. The results obtained show that a stitching technique based on SURF is suitable for the medical area.

Uyperspectral imaging (HSI) has been adopted during the last years in different applications where material classification plays an important role. This favoured the improvement and development of new HS sensors, leading to HS snapshot cameras, where the sensor is able to acquire images in a realtime video fashion, reducing the spatial and spectral resolution for these cameras. However, although these cameras are able to acquire RAW HS images at high frames per second (FPS) rates, it is necessary to pre-process them to obtain an actual HS image and then obtain a classification map. This work addresses the development of an embedded CPU+GPU HS video classification system able to acquire and classify HS images in real-time video, i.e., at more than 25 FPS. Also, it includes a comparison where three different CPU+GPU embedded platforms are tested: NVIDIA Jetson Nano, NVIDIA Jetson TX1 and NVIDIA Jetson TX2. The results obtained show the feasibility of a HS video classification system using these embedded platforms.

Gliomas constitute a significant challenge in neurosurgery due to their high incidence and poor prognosis. Despite advancements in tumor detection techniques using machine learning approach with hyperspectral imaging, accurately distinguishing between healthy and tumoral tissues remains challenging. Following this trend, this paper introduces Libra, a low spectral resolution classifier designed for brain tumor detection, leveraging ensemble learning techniques to enhance classification performance. Evaluated across the Helicoid and Slim Brain databases, Libra demonstrates superior tumor sensitivity and a notable increase in accuracy compared to standalone SVM and the state-of-the-art Helicoid classification chain. While facing challenges in accurately distinguishing between blood vessels and tumoral tissues, Libra performs 32 % better than Helicoid in tumor sensitivity and 25.1 % in tumor F1-score. Moreover, when using unseen data, Libra demonstrates notable improvements of 7.8 % and 6.9 % respectively. These improvements are obtained using low complexity algorithms exploiting ensemble learning techniques.