Coronary stenting or percutaneous coronary intervention (PCI) is widely used to treat coronary artery disease. Improper deployment of stents may lead to post-PCI complication, in-stent restenosis, stent fracture and stent thrombosis. Intravascular optical coherence tomography (OCT) with micron-scale resolution provides accurate in vivo assessment of stent apposition/malapposition and neointima coverage. However, manual stent analysis is labor intensive and time consuming. Existing automated methods with intravascular OCT mainly focused on stent struts with thin tissue coverage. We developed a deep learning method to automatically analyze stents with both thin (≤0.3mm) and very thick tissue coverage (>0.3mm), and an algorithm to accurately analyze stent area for vessels with multiple stents. 25203 images from 56 OCT pullbacks and 41 patients were analyzed. Three-fold cross-validation demonstrated that the algorithm achieved a precision of 0.932±0.009 and a sensitivity of 0.939±0.007 for stents with ≤0.3mm tissue coverage, and a precision of 0.856±0.019 and a sensitivity of 0.874±0.011 for stents with >0.3mm tissue coverage. The correlation between the automatically computed and manually measured stent area is 0.954 (p<0.0001) for vessels with a single stent, and is 0.918 (p<0.0001) for vessels implanted with multiple stents. The proposed method can accurately detect stent struts with very thick tissue coverage and analyze stent area in vessels implanted with multiple stents, and can effectively facilitate the evaluation of stent implantation and post-stent tissue coverage.

Cataract causes more than half of all blindness worldwide. The most effective treatment is surgery, where cataract is often replaced by intraocular lens (IOL). Beyond saving vision, toric IOL implantation is becoming increasingly popular to correct corneal astigmatism. It is important to precisely position and align the axis of IOL during surgery to achieve optimal post-operative astigmatism correction. Comparing with conventional manual marking, automated markerless IOL alignment can be faster, more accurate and non-invasive. Here we propose a framework for computer-assisted intraoperative IOL positioning and alignment based on detection and tracking. Firstly, the iris boundary was segmented and the eye center was determined. A statistical sampling method was developed to segment iris and generate training labels, and both conventional algorithms and deep convolutional neural network (CNN) methods were evaluated. Then, regions of interests (ROIs) containing high density of scleral capillaries were used for tracking eye rotations. Both correlation filter and CNN methods were evaluated for tracking. Cumulative errors during long-term tracking were corrected using a reference image. Validation studies against manual labeling using 7 clinical cataract surgical videos demonstrated that the proposed algorithm achieved an average position error around 0.2 mm, an axis alignment error of < 1 $^{\circ}$ , and a frame rate of > 25 FPS, and can be potentially used intraoperatively for markerless IOL positioning and alignment during cataract surgery.

The early assessment of angle closure is of great significance for the timely diagnosis and treatment of primary angle-closure glaucoma (PACG). Anterior segment optical coherence tomography (AS-OCT) provides a fast and non-contact way to evaluate the angle close using the iris root (IR) and scleral spur (SS) information. The objective of this study was to develop a deep learning method to automatically detect IR and SS in AS-OCT for measuring anterior chamber (AC) angle parameters including angle opening distance (AOD), trabecular iris space area (TISA), trabecular iris angle (TIA), and anterior chamber angle (ACA). 3305 AS-OCT images from 362 eyes and 203 patients were collected and analyzed. Based on the recently proposed transformer-based architecture that learns to capture long-range dependencies by leveraging the self-attention mechanism, a hybrid convolutional neural network (CNN) and transformer model to encode both local and global features was developed to automatically detect IR and SS in AS-OCT images. Experiments demonstrated that our algorithm achieved a significantly better performance than state-of-the-art methods for AS-OCT and medical image analysis with a precision of 0.941, a sensitivity of 0.914, an F1 score of 0.927, and a mean absolute error (MAE) of 37.1±25.3 µm for IR, and a precision of 0.805, a sensitivity of 0.847, an F1 score of 0.826, and an MAE of 41.4±29.4 µm for SS, and a high agreement with expert human analysts for AC angle parameter measurement. We further demonstrated the application of the proposed method to evaluate the effect of cataract surgery with IOL implantation in a PACG patient and to assess the outcome of ICL implantation in a patient with high myopia with a potential risk of developing PACG. The proposed method can accurately detect IR and SS in AS-OCT images and effectively facilitate the AC angle parameter measurement for pre- and post-operative management of PACG.

Alzheimer's disease (AD) is an incurable neurodegenerative disorder characterized by progressive cognitive and functional decline. Consequently, early diagnosis and accurate prediction of disease progression are of paramount importance and inherently complex, necessitating the integration of multi-modal data. However, most existing methods are task-specific models that lack generalization ability, addressing only one task at a time and failing to simultaneously assess disease diagnosis and progression. In this paper, we introduce ADFound, the first foundation model for AD that serves as a basis for various downstream tasks, such as diagnosis and prognosis, with high generalization capability. ADFound leverages a substantial amount of unlabeled 3D multi-modal neuroimaging, including paired and unpaired data, to achieve its objectives. Specifically, ADFound is developed upon the Multi-modal Vim encoder by Vision Mamba block to capture long-range dependencies inherent in 3D multi-modal medical images. To efficiently pre-train ADFound on unlabeled paired and upaired multi-modal neuroimaging data, we proposed a novel self-supervised learning framework that integrates multi-modal masked autoencoder (MAE) and contrastive learning. The multi-modal MAE aims to learn local relations among modalities by reconstructing images with unmasked image patches. Additionally, we introduce a Dual Contrastive Learning for Multi-modal Data to enhance the discriminative capabilities of multi-modal representations from intra-modal and inter-modal perspectives. Our experiments demonstrate that ADFound outperforms stateof-the-art methods across a wide range of downstream tasks relevant to the diagnosis and prognosis of AD. Furthermore, the results indicate that our foundation model can be extended to more modalities, such as non-image data, showing its versatility. The code is available at https: //github.com/guangqianyang/ADFound.git.

Anterior segment diseases are among the leading causes of irreversible blindness. However, a method capable of recognizing all important anterior segment structures for clinical diagnosis is lacking. By sharing the knowledge learned from each task, we proposed a fully automated multitask deep learning method that allows for simultaneous segmentation and quantification of all major anterior segment structures, including the iris, lens, cornea, as well as implantable collamer lens (ICL) and intraocular lens (IOL), and meanwhile for landmark detection of scleral spur and iris root in anterior segment OCT (AS-OCT) images. In addition, we proposed a refraction correction method to correct for the true geometry of the anterior segment distorted by light refraction during OCT imaging. 1251 AS-OCT images from 180 patients were collected and were used to train and test the model. Experiments demonstrated that our proposed network was superior to state-of-the-art segmentation and landmark detection methods, and close agreement was achieved between manually and automatically computed clinical parameters associated with anterior chamber, pupil, iris, ICL, and IOL. Finally, as an example, we demonstrated how our proposed method can be applied to facilitate the clinical evaluation of cataract surgery.

Micro-expression recognition (MER) aims to detect brief and subtle facial movements that reveal suppressed emotions, discerning authentic emotional responses in scenarios such as visitor experience analysis in museum settings. However, it remains a highly challenging task due to the fleeting duration, low intensity, and limited availability of annotated data. Most existing approaches rely solely on either appearance or motion cues, thereby restricting their ability to capture expressive information fully. To overcome these limitations, we propose a lightweight multi-modal fusion network, termed M³ENet, which integrates both motion and appearance cues through early-stage feature fusion. Specifically, our model extracts horizontal, vertical, and strain-based optical flow between the onset and apex frames, alongside RGB images from the onset, apex, and offset frames. These inputs are processed by two modality-specific subnetworks, whose features are fused to exploit complementary information for robust classification. To improve generalization in low data regimes, we employ targeted data augmentation and adopt focal loss to mitigate class imbalance. Extensive experiments on five benchmark datasets, including CASME I, CASME II, CAS(ME)², SAMM, and MMEW, demonstrate that M³ENet achieves state-of-the-art performance with high efficiency. Ablation studies and Grad-CAM visualizations further confirm the effectiveness and interpretability of the proposed architecture.