This project is a smart eye tracking system which is designed for people with disabilities and elderly people. The concept of this research is to apply eye movement to control appliances, wheelchair and communicate with caretaker. This system comprises four components, imaging processing module, wheelchair-controlled module, appliances-controlled module and SMS manager module. The image processing module consists of webcam and C++ customized image processing, the eye movement image is captured and transmitted to Raspberry Pi microcontroller for processing with OpenCV to derive the coordinate of eye ball. The coordinate of eye ball is utilized for cursor control on the Raspberry Pi screen to control the system. Besides the eye movement, the eye blink is applied in this system for entering a command as when you press Enter button on keyboard. The wheelchair-controlled module is a cradle with two servos that can be moved to two dimensions and also adaptable to other wheelchair joysticks. This system also remotely controls some appliances and communicate with caretaker via send message to smartphone.
Surface enhanced resonance Raman (SERS) is a powerful optical technique, which can help enhance the sensitivity of Raman spectroscopy aided by noble metal nanoparticles (NPs). However, current SERS‐NPs are often suboptimal, which can aggregate under physiological conditions with much reduced SERS enhancement. Herein, a robust one‐pot method has been developed to synthesize SERS‐NPs with more uniform core diameters of 50 nm, which is applicable to both non‐resonant and resonant Raman dyes. The resulting SERS‐NPs are colloidally stable and bright, enabling NP detection with low‐femtomolar sensitivity. An algorithm has been established, which can accurately unmix multiple types of SERS‐NPs enabling potential multiplex detection. Furthermore, a new liposome‐based approach has been developed to install a targeting carbohydrate ligand, i.e., hyaluronan, onto the SERS‐NPs bestowing significantly enhanced binding affinity to its biological receptor CD44 overexpressed on tumor cell surface. The liposomal hyaluronan (HA)‐SERS‐NPs enabled visualization of spontaneously developed breast cancer in mice in real time guiding complete surgical removal of the tumor, highlighting the translational potential of these new glyco‐SERS‐NPs.
Magnetic particle imaging (MPI) is an emerging noninvasive molecular imaging modality with high sensitivity and specificity, exceptional linear quantitative ability, and potential for successful applications in clinical settings. Computed tomography (CT) is typically combined with the MPI image to obtain more anatomical information. Herein, a deep learning‐based approach for MPI‐CT image segmentation is presented. The dataset utilized in training the proposed deep learning model is obtained from a transgenic mouse model of breast cancer following administration of indocyanine green (ICG)‐conjugated superparamagnetic iron oxide nanoworms (NWs‐ICG) as the tracer. The NWs‐ICG particles progressively accumulate in tumors due to the enhanced permeability and retention (EPR) effect. The proposed deep learning model exploits the advantages of the multihead attention mechanism and the U‐Net model to perform segmentation on the MPI‐CT images, showing superb results. In addition, the model is characterized with a different number of attention heads to explore the optimal number for our custom MPI‐CT dataset.
Multispectral optoacoustic tomography (MSOT) is a beneficial technique for diagnosing and analyzing biological samples since it provides meticulous details in anatomy and physiology. However, acquiring high through‐plane resolution volumetric MSOT is time‐consuming. Here, we propose a deep learning model based on hybrid recurrent and convolutional neural networks to generate sequential cross‐sectional images for an MSOT system. This system provides three modalities (MSOT, ultrasound, and optoacoustic imaging of a specific exogenous contrast agent) in a single scan. This study used ICG‐conjugated nanoworms particles (NWs‐ICG) as the contrast agent. Instead of acquiring seven images with a step size of 0.1 mm, we can receive two images with a step size of 0.6 mm as input for the proposed deep learning model. The deep learning model can generate five other images with a step size of 0.1 mm between these two input images meaning we can reduce acquisition time by approximately 71%.