Accurate and automatic multi-needle detection in three-dimensional (3D) ultrasound (US) is a key step of treatment planning for US-guided brachytherapy. However, most current studies are concentrated on single-needle detection by only using a small number of images with a needle, regardless of the massive database of US images without needles. In this paper, we propose a workflow for multi-needle detection by considering the images without needles as auxiliary. Concretely, we train position-specific dictionaries on 3D overlapping patches of auxiliary images, where we develop an enhanced sparse dictionary learning method by integrating spatial continuity of 3D US, dubbed order-graph regularized dictionary learning. Using the learned dictionaries, target images are reconstructed to obtain residual pixels which are then clustered in every slice to yield centers. With the obtained centers, regions of interest (ROIs) are constructed via seeking cylinders. Finally, we detect needles by using the random sample consensus algorithm per ROI and then locate the tips by finding the sharp intensity drops along the detected axis for every needle. Extensive experiments were conducted on a phantom dataset and a prostate dataset of 70/21 patients without/with needles. Visualization and quantitative results show the effectiveness of our proposed workflow. Specifically, our method can correctly detect 95% of needles with a tip location error of 1.01 mm on the prostate dataset. This technique provides accurate multi-needle detection for US-guided HDR prostate brachytherapy, facilitating the clinical workflow.

Proton therapy requires accurate dose calculation for treatment planning to ensure the conformal doses are precisely delivered to the targets. The conversion of CT numbers to material properties is a significant source of uncertainty for dose calculation. The aim of this study is to develop a physics-informed deep learning (PIDL) framework to derive accurate mass density and relative stopping power maps from dual-energy computed tomography (DECT) images. The PIDL framework allows deep learning (DL) models to be trained with a physics loss function, which includes a physics model to constrain DL models. Five DL models were implemented including a fully connected neural network (FCNN), dual-FCNN (DFCNN), and three variants of residual networks (ResNet): ResNet-v1 (RN-v1), ResNet-v2 (RN-v2), and dual-ResNet-v2 (DRN-v2). An artificial neural network (ANN) and the five DL models trained with and without physics loss were explored to evaluate the PIDL framework. Two empirical DECT models were implemented to compare with the PIDL method. DL training data were from CIRS electron density phantom 062M (Computerized Imaging Reference Systems, Inc., Norfolk, VA). The performance of DL models was tested by CIRS adult male, adult female, and 5-year-old child anthropomorphic phantoms. For density map inference, the physics-informed RN-v2 was 3.3%, 2.9% and 1.9% more accurate than ANN for the adult male, adult female, and child phantoms. The physics-informed DRN-v2 was 0.7%, 0.6%, and 0.8% more accurate than DRN-v2 without physics training for the three phantoms, respectfully. The results indicated that physics-informed training could reduce uncertainty when ANN/DL models without physics training were insufficient to capture data structures or derived significant errors. DL models could also achieve better image noise control compared to the empirical DECT parametric mapping methods. The proposed PIDL framework can potentially improve proton range uncertainty by offering accurate material properties conversion from DECT.

Objective . CBCTs in image-guided radiotherapy provide crucial anatomy information for patient setup and plan evaluation. Longitudinal CBCT image registration could quantify the inter-fractional anatomic changes, e.g. tumor shrinkage, and daily OAR variation throughout the course of treatment. The purpose of this study is to propose an unsupervised deep learning-based CBCT-CBCT deformable image registration which enables quantitative anatomic variation analysis. Approach. The proposed deformable registration workflow consists of training and inference stages that share the same feed-forward path through a spatial transformation-based network (STN). The STN consists of a global generative adversarial network (GlobalGAN) and a local GAN (LocalGAN) to predict the coarse- and fine-scale motions, respectively. The network was trained by minimizing the image similarity loss and the deformable vector field (DVF) regularization loss without the supervision of ground truth DVFs. During the inference stage, patches of local DVF were predicted by the trained LocalGAN and fused to form a whole-image DVF. The local whole-image DVF was subsequently combined with the GlobalGAN generated DVF to obtain the final DVF. The proposed method was evaluated using 100 fractional CBCTs from 20 abdominal cancer patients in the experiments and 105 fractional CBCTs from a cohort of 21 different abdominal cancer patients in a holdout test. Main Results . Qualitatively, the registration results show good alignment between the deformed CBCT images and the target CBCT image. Quantitatively, the average target registration error calculated on the fiducial markers and manually identified landmarks was 1.91 ± 1.18 mm. The average mean absolute error, normalized cross correlation between the deformed CBCT and target CBCT were 33.42 ± 7.48 HU, 0.94 ± 0.04, respectively. Significance . In summary, an unsupervised deep learning-based CBCT-CBCT registration method is proposed and its feasibility and performance in fractionated image-guided radiotherapy is investigated. This promising registration method could provide fast and accurate longitudinal CBCT alignment to facilitate inter-fractional anatomic changes analysis and prediction.