15 July 2025 in Computers in Biology and Medicine
Content-based image retrieval (CBIR) has the potential to significantly improve diagnostic aid and medical research in radiology. However, current CBIR systems face limitations due to their specialization to certain pathologies, limiting their utility. On the other hand, several vision foundation models have been shown to produce general-purpose visual features. Therefore, in this work, we propose using vision foundation models as powerful and versatile off-the-shelf feature extractors for content-based image retrieval. Our contributions include: (1) benchmarking a diverse set of vision foundation models on an extensive dataset comprising 1.6 million 2D radiological images across four modalities and 161 pathologies; (2) identifying weakly-supervised models, particularly BiomedCLIP, as highly effective, achieving a P@1 of up to 0.594 (P@3: 0.590, P@5: 0.588, P@10: 0.583), comparable to specialized CBIR systems but without additional training; (3) conducting an in-depth analysis of the impact of index size on retrieval performance; (4) evaluating the quality of embedding spaces generated by different models; and (5) investigating specific challenges associated with retrieving anatomical versus pathological structures. Despite these challenges, our research underscores the vast potential of foundation models for CBIR in radiology, proposing a shift towards versatile, general-purpose medical image retrieval systems that do not require specific tuning. Our code, dataset splits and embeddings are publicly available here.
7 November 2023 in Neuromorphic Computing and Engineering
The BrainScaleS-2 (BSS-2) system implements physical models of neurons as well as synapses and aims for an energy-efficient and fast emulation of biological neurons. When replicating neuroscientific experiments on BSS-2, a major challenge is finding suitable model parameters. This study investigates the suitability of the sequential neural posterior estimation (SNPE) algorithm for parameterizing a multi-compartmental neuron model emulated on the BSS-2 analog neuromorphic system. The SNPE algorithm belongs to the class of simulation-based inference methods and estimates the posterior distribution of the model parameters; access to the posterior allows quantifying the confidence in parameter estimations and unveiling correlation between model parameters. For our multi-compartmental model, we show that the approximated posterior agrees with experimental observations and that the identified correlation between parameters fits theoretical expectations. Furthermore, as already shown for software simulations, the algorithm can deal with high-dimensional observations and parameter spaces when the data is generated by emulations on BSS-2. These results suggest that the SNPE algorithm is a promising approach for automating the parameterization and the analyzation of complex models, especially when dealing with characteristic properties of analog neuromorphic substrates, such as trial-to-trial variations or limited parameter ranges.
14 March 2026 in Medical Image Analysis
8 September 2023 in Open Research Europe
Background: Finding appropriate model parameters for multi-compartmental neuron models can be challenging. Parameters such as the leak and axial conductance are not always directly derivable from neuron observations but are crucial for replicating desired observations. The objective of this study is to replicate the attenuation behavior of an excitatory postsynaptic potential (EPSP) traveling along a linear chain of compartments on the analog BrainScaleS-2 neuromorphic hardware platform. Methods: In the present publication we use genetic algorithms to find suitable model parameters. They promise parameterization without domain knowledge of the neuromorphic substrate or underlying neuron model. To validate the results of the genetic algorithms, a comprehensive grid search was conducted. Trial-to-trial variations in the analog system are counteracted utilizing spike-triggered averaging. Results and conclusions: The algorithm successfully finds solutions which replicate the desired EPSP attenuation behavior in both single and multi-objective searches illustrating the applicability of genetic algorithms to parameterize analog neuromorphic hardware.
14 November 2024 in Open Research Europe
Background Finding appropriate model parameters for multi-compartmental neuron models can be challenging. Parameters such as the leak and axial conductance are not always directly derivable from neuron observations but are crucial for replicating desired observations. The objective of this study is to replicate the attenuation behavior of an excitatory postsynaptic potential (EPSP) traveling along a linear chain of compartments on the analog BrainScaleS-2 neuromorphic hardware platform. Methods In the present publication we use genetic algorithms to find suitable model parameters. They promise parameterization without domain knowledge of the neuromorphic substrate or underlying neuron model. To validate the results of the genetic algorithms, a comprehensive grid search was conducted. Furthermore, trial-to-trial variations in the analog system are counteracted utilizing spike-triggered averaging. Results and conclusions The algorithm successfully replicated the desired EPSP attenuation behavior in both single and multi-objective searches illustrating the applicability of genetic algorithms to parameterize analog neuromorphic hardware.