28 July 2020 in IEEE Transactions on Medical Robotics and Bionics
Femoroplasty is a proposed alternative therapeutic method for preventing osteoporotic hip fractures in the elderly. Previously developed navigation system for femoroplasty required the attachment of an external X-ray fiducial to the femur. We propose a fiducial-free 2D/3D registration pipeline using fluoroscopic images for robot-assisted femoroplasty. Intraoperative fluoroscopic images are taken from multiple views to perform registration of the femur and drilling/injection device. The proposed method was tested through comprehensive simulation and cadaveric studies. Performance was evaluated on the registration error of the femur and the drilling/injection device. In simulations, the proposed approach achieved a mean accuracy of 1.26 ± 0.74 mm for the relative planned injection entry point; 0.63 ± 0.21° and 0.17 ± 0.19° for the femur injection path direction and device guide direction, respectively. In the cadaver studies, a mean error of 2.64 ± 1.10 mm was achieved between the planned entry point and the device guide tip. The biomechanical analysis showed that even with a 4 mm translational deviation from the optimal injection path, the yield load prior to fracture increased by 40.7%. This result suggests that the fiducial-less 2D/3D registration is sufficiently accurate to guide robot assisted femoroplasty.
1 January 2025 in Journal of Medical Imaging
Computed tomography (CT) imaging has become an important tool in modern healthcare, playing a critical role in quantitative diagnosis, evidence-based treatment planning, and patient-centric care across a wide spectrum of disease pathways.1 The quality and speed of CT image reconstruction directly influence the accuracy of diagnosis, and the effectiveness of treatment plans, hence the overall efficiency of clinical workflows.2 Traditional reconstruction methods such as filtered backprojection (FBP) and algebraic reconstruction technique (ART) often face challenges when noise or disturbance is present in the data. These approaches struggle to effectively balance image quality and computational efficiency, particularly in scenarios where such noise, artifacts, or disturbances exist.
17 June 2022 in Journal of Microscopy
High‐resolution X‐ray microscopy (XRM) is gaining interest for biological investigations of extremely small‐scale structures. XRM imaging of bones in living mice could provide new insights into the emergence and treatment of osteoporosis by observing osteocyte lacunae, which are holes in the bone of few micrometres in size. Imaging living animals at that resolution, however, is extremely challenging and requires very sophisticated data processing converting the raw XRM detector output into reconstructed images. This paper presents an open‐source, differentiable reconstruction pipeline for XRM data which analytically computes the final image from the raw measurements. In contrast to most proprietary reconstruction software, it offers the user full control over each processing step and, additionally, makes the entire pipeline deep learning compatible by ensuring differentiability. This allows fitting trainable modules both before and after the actual reconstruction step in a purely data‐driven way using the gradient‐based optimizers of common deep learning frameworks. The value of such differentiability is demonstrated by calibrating the parameters of a simple cupping correction module operating on the raw projection images using only a self‐supervisory quality metric based on the reconstructed volume and no further calibration measurements. The retrospective calibration directly improves image quality as it avoids cupping artefacts and decreases the difference in grey values between outer and inner bone by 68–94%. Furthermore, it makes the reconstruction process entirely independent of the XRM manufacturer and paves the way to explore modern deep learning reconstruction methods for arbitrary XRM and, potentially, other flat‐panel computed tomography systems. This exemplifies how differentiable reconstruction can be leveraged in the context of XRM and, hence, is an important step towards the goal of reducing the resolution limit of in vivo bone imaging to the single micrometre domain.
2 October 2023 in Physics in Medicine & Biology
Objective. Incorporating computed tomography (CT) reconstruction operators into differentiable pipelines has proven beneficial in many applications. Such approaches usually focus on the projection data and keep the acquisition geometry fixed. However, precise knowledge of the acquisition geometry is essential for high quality reconstruction results. In this paper, the differentiable formulation of fan-beam CT reconstruction is extended to the acquisition geometry. Approach. The CT fan-beam reconstruction is analytically derived with respect to the acquisition geometry. This allows to propagate gradient information from a loss function on the reconstructed image into the geometry parameters. As a proof-of-concept experiment, this idea is applied to rigid motion compensation. The cost function is parameterized by a trained neural network which regresses an image quality metric from the motion-affected reconstruction alone. Main results. The algorithm improves the structural similarity index measure (SSIM) from 0.848 for the initial motion-affected reconstruction to 0.946 after compensation. It also generalizes to real fan-beam sinograms which are rebinned from a helical trajectory where the SSIM increases from 0.639 to 0.742. Significance. Using the proposed method, we are the first to optimize an autofocus-inspired algorithm based on analytical gradients. Next to motion compensation, we see further use cases of our differentiable method for scanner calibration or hybrid techniques employing deep models.
4 October 2024 in IEEE Transactions on Medical Imaging
Cone-beam computed tomography (CBCT) systems, with their flexibility, present a promising avenue for direct point-of-care medical imaging, particularly in critical scenarios such as acute stroke assessment. However, the integration of CBCT into clinical workflows faces challenges, primarily linked to long scan duration resulting in patient motion during scanning and leading to image quality degradation in the reconstructed volumes. This paper introduces a novel approach to CBCT motion estimation using a gradient-based optimization algorithm, which leverages generalized derivatives of the backprojection operator for cone-beam CT geometries. Building on that, a fully differentiable target function is formulated which grades the quality of the current motion estimate in reconstruction space. We drastically accelerate motion estimation yielding a 19-fold speed-up compared to existing methods. Additionally, we investigate the architecture of networks used for quality metric regression and propose predicting voxel-wise quality maps, favoring autoencoder-like architectures over contracting ones. This modification improves gradient flow, leading to more accurate motion estimation. The presented method is evaluated through realistic experiments on head anatomy. It achieves a reduction in reprojection error from an initial average of 3 mm to 0.61 mm after motion compensation and consistently demonstrates superior performance compared to existing approaches. The analytic Jacobian for the backprojection operation, which is at the core of the proposed method, is made publicly available. In summary, this paper contributes to the advancement of CBCT integration into clinical workflows by proposing a robust motion estimation approach that enhances efficiency and accuracy, addressing critical challenges in time-sensitive scenarios.
20 March 2025 in Physics in Medicine & Biology
Objective. This study introduces a novel method for reconstructing cone beam computed tomography (CBCT) images for arbitrary orbits, addressing the computational and memory challenges associated with traditional iterative reconstruction algorithms. Approach. The proposed method employs a differentiable shift-variant filtered backprojection neural network, optimized for arbitrary trajectories. By integrating known operators into the learning model, the approach minimizes the number of trainable parameters while enhancing model interpretability. This framework adapts seamlessly to specific orbit geometries, including non-continuous trajectories such as circular-plus-arc or sinusoidal paths, enabling faster and more accurate CBCT reconstructions. Main results. Experimental validation demonstrates that the method significantly accelerates reconstruction, reducing computation time by over 97% compared to conventional iterative algorithms. It achieves superior or comparable image quality with reduced noise, as evidenced by a 38.6% reduction in mean squared error, a 7.7% increase in peak signal-to-noise ratio, and a 5.0% improvement in the structural similarity index measure. The flexibility and robustness of the approach are confirmed through its ability to handle data from diverse scan geometries. Significance. This method represents a significant advancement in interventional medical imaging, particularly for robotic C-arm CT systems, enabling real-time, high-quality CBCT reconstructions for customized orbits. It offers a transformative solution for clinical applications requiring computational efficiency and precision in imaging.