The tumor grading of laryngeal cancer pathological images needs to be accurate and interpretable. The deep learning model based on the attention mechanism-integrated convolution (AMC) block has good inductive bias capability but poor interpretability, whereas the deep learning model based on the vision transformer (ViT) block has good interpretability but weak inductive bias ability. Therefore, we propose an end-to-end ViT-AMC network (ViT-AMCNet) with adaptive model fusion and multiobjective optimization that integrates and fuses the ViT and AMC blocks. However, existing model fusion methods often have negative fusion: 1). There is no guarantee that the ViT and AMC blocks will simultaneously have good feature representation capability. 2). The difference in feature representations learning between the ViT and AMC blocks is not obvious, so there is much redundant information in the two feature representations. Accordingly, we first prove the feasibility of fusing the ViT and AMC blocks based on Hoeffding’s inequality. Then, we propose a multiobjective optimization method to solve the problem that ViT and AMC blocks cannot simultaneously have good feature representation. Finally, an adaptive model fusion method integrating the metrics block and the fusion block is proposed to increase the differences between feature representations and improve the deredundancy capability. Our methods improve the fusion ability of ViT-AMCNet, and experimental results demonstrate that ViT-AMCNet significantly outperforms state-of-the-art methods. Importantly, the visualized interpretive maps are closer to the region of interest of concern by pathologists, and the generalization ability is also excellent. Our code is publicly available at https://github.com/Baron-Huang/ViT-AMCNet.

Potential risk of X-ray radiation from computed tomography (CT) has been a concern of the public. However, simply decreasing the dose will degrade quality of the CT images and compromise diagnostic performance. In this paper, we propose a noise learning generative adversarial network coupling with least squares, structural similarity and L1 losses for low-dose CT denoising. In our method, noise distributed in the input low-dose CT image is learned by the generator network and then subtracted from the input to generate the final denoised version. The denoised CT images are penalized by the least squares loss function, and they are pulled toward boundary of the decision even though they are classified as normal-dose CT. Least squares stabilize the training process without regularization. Structural similarity and L1 losses are utilized to keep textural details and sharpness of the denoised CT images respectively. Experiments and results show that our method can effectively suppress noise and remove artifacts compared with the state-ofthe-art methods. The texture statistical properties, which include mean, standard deviation, uniformity, and entropy, further confirm that the generated noise-reduced CT image is as close as to that of the normal-dose counterpart.

Grading laryngeal squamous cell carcinoma (LSCC) based on histopathological images is a clinically significant yet challenging task. However, more low-effect background semantic information appeared in the feature maps, feature channels, and class activation maps, which caused a serious impact on the accuracy and interpretability of LSCC grading. While the traditional transformer block makes extensive use of parameter attention, the model overlearns the low-effect background semantic information, resulting in ineffectively reducing the proportion of background semantics. Therefore, we propose an end-to-end network with transformers constrained by learned-parameter-free attention (LA-ViT), which improve the ability to learn high-effect target semantic information and reduce the proportion of background semantics. Firstly, according to generalized linear model and probabilistic, we demonstrate that learned-parameter-free attention (LA) has a stronger ability to learn highly effective target semantic information than parameter attention. Secondly, the first-type LA transformer block of LA-ViT utilizes the feature map position subspace to realize the query. Then, it uses the feature channel subspace to realize the key, and adopts the average convergence to obtain a value. And those construct the LA mechanism. Thus, it reduces the proportion of background semantics in the feature maps and feature channels. Thirdly, the second-type LA transformer block of LA-ViT uses the model probability matrix information and decision level weight information to realize key and query, respectively. And those realize the LA mechanism. So, it reduces the proportion of background semantics in class activation maps. Finally, we build a new complex semantic LSCC pathology image dataset to address the problem, which is less research on LSCC grading models because of lacking clinically meaningful datasets. After extensive experiments, the whole metrics of LA-ViT outperform those of other state-of-the-art methods, and the visualization maps match better with the regions of interest in the pathologists' decision-making. Moreover, the experimental results conducted on a public LSCC pathology image dataset show that LA-ViT has superior generalization performance to that of other state-of-the-art methods.

BACKGROUND: Spectral computed tomography (CT) has the capability to resolve the energy levels of incident photons, which has the potential to distinguish different material compositions. Although material decomposition methods based on x-ray attenuation characteristics have good performance in dual-energy CT imaging, there are some limitations in terms of image contrast and noise levels. OBJECTIVE: This study focused on multi-material decomposition of spectral CT images based on a deep learning approach. METHODS: To classify and quantify different materials, we proposed a multi-material decomposition method via the improved Fully Convolutional DenseNets (FC-DenseNets). A mouse specimen was first scanned by spectral CT system based on a photon-counting detector with different energy ranges. We then constructed a training set from the reconstructed CT images for deep learning to decompose different materials. RESULTS: Experimental results demonstrated that the proposed multi-material decomposition method could more effectively identify bone, lung and soft tissue than the basis material decomposition based on post-reconstruction space in high noise levels. CONCLUSIONS: The new proposed approach yielded good performance on spectral CT material decomposition, which could establish guidelines for multi-material decomposition approaches based on the deep learning algorithm.