In this paper, we propose a novel weakly supervised semantic segmentation (WSSS) method that uses image tags as supervision to achieve joint pixel-level localization of the key local structure (KLS) and image-level classification of the aurora images captured by the ground-based optical all-sky imager. First, a patch-scale model (PSM) based on the small-scale structure of aurora is designed to identify the type-specific regions for each training image. Second, a region-scale model is trained with the identified type-specific regions to coarsely localize the KLS from multiple sizes of field of view, based on which the aurora image is classified. Finally, given the predicted image type, the PSM further refines the KLS in a pixel level. By localizing KLS from coarse to fine, the proposed method captures both overall shape with a bottom-up processing and local structure details of aurora in a top-down manner. Extensive experiments on the expert labeled data sets have demonstrated the efficacy of the proposed method in benchmarking with the state-of-the-art WSSS methods.
Identification of small-scale auroral structures is key to searching for auroral events. However, it is impracticable for humans to manually select sufficient aurora events for statistical analysis, and it is also challenging for computers because of the non-rigid shape and fluid nature of auroras. Fold structure is the most common type of auroral small-scale structure, and its appearance is indicative of a variety of auroral events. This paper proposes a small-scale aurora structure identification framework to automatically detect aurora fold structures. First, the location and shape of auroras are identified based on a deep learning segmentation network. Then, the skeleton of the auroral shape is extracted to represent the trajectories of auroras. Finally, the proposed skeleton-based fold identification module (SFIM) can detect the aurora fold structure. To evaluate the effectiveness of the proposed method, we built an aurora fold structure sample dataset, namely F-dataset, containing 2000 images at 557.7 nm obtained by the all-sky imagers at Yellow River Station (YRS), Ny-Ålesund, Svalbard. Experimental results show that automatic identification can achieve good consistency with human perception. Statistical analysis of over 30,000 images shows that the fold occurrence has a distinct double-peak distribution at pre-noon and post-noon.
1 April 2024 in Journal of Geophysical Research: Space Physics
Recent innovations in tissue clearing and light-sheet microscopy allow the rapid acquisition of intact micron-resolution images in fluorescently labeled samples. Automated, accurate, and high-throughput nuclear segmentation methods are in high demand to quantify the number of cells and evaluate cell-type specific marker co-labeling. Complete quantification of cellular level differences in genetically manipulated animal models will allow localization of organ structural differences well beyond what has previously been accomplished through slice histology or MRI. This paper proposes a nuclei identification tool for accurate nuclear segmentation from tissue-cleared microscopy images by regionally adaptive active learning. We gradually improved high-level nuclei-to-nuclei contextual heuristics to determine a non-linear mapping from local image appearance to the segmentation label at the center of each local neighborhood. In addition, we propose an adaptive fine-tuning (FT) strategy to tackle the complex segmentation task of separating nuclei in close proximity, allowing for the precise quantification of structures where nuclei are often densely packed. Compared to the current nuclei segmentation methods, we have achieved more accurate and robust nuclear segmentation results in various complex scenarios.
8 August 2025 in Engineering Applications of Artificial Intelligence