9 June 2025 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Shape from focus (SFF) is a technique used to estimate the depth of a scene from a sequence of multifocus images. Existing SFF methods can be categorized into two groups: traditional methods and deep learning-based methods. Traditional methods typically employ a focus measure (FM) operator to assess the sharpness of individual pixels in a single-frame image, often overlooking the associations within the image sequence. Deep learning methods generally rely on labeled datasets, which are often challenging to obtain in real-world scenarios. Based on these observations, we propose a novel sequence association-based (SAS) framework aimed at enhancing the generalizability of SFF methods. In the SAS framework, an image sequence is treated as complete three-dimensional (3D) data throughout the processes of multiview decomposition, selective fusion and multiscale feature aggregation. Furthermore, the framework includes a tighter multiview learning generalization error bound to guide the development of the selective fusion method. This method leverages isomorphisms among multiple views to effectively mitigate the adverse effects of outlier noise on the reconstruction of various scenes. Comprehensive experiments on seven synthetic datasets and two real scenes with unknown labels demonstrate the effectiveness and generalizability of the SAS framework compared to state-of-the-art SFF methods.
31 December 2025 in IEEE Transactions on Image Processing
Microscopic 3D shape reconstruction using depth from focus (DFF) is crucial in precision manufacturing for 3D modeling and quality control. However, the absence of high-precision microscopic DFF datasets and the significant differences between existing DFF datasets and microscopic DFF data in optical design, imaging principles and scene characteristics hinder the performance of current DFF models in microscopic tasks. To address this, we introduce M3D, a novel microscopic DFF dataset, constructed using a self-developed microscopic device. It includes multi-focus image sequences of 1,952 scenes across five categories, with depth labels obtained through the 3D TFT algorithm applied to dense image sequences for initial depth estimation and calibration. All labels are then compared and analyzed against the design values, and those with large errors are eliminated. We also propose M3DNet, a frequency-aware end-to-end network, to tackle challenges like shallow depth-of-field (DoF) and weak textures. Results show that M3D compensates for the limitations of macroscopic DFF datasets and extends DFF applications to microscopic scenarios. M3DNet effectively captures rapid focus decay and improves performance on public DFF datasets by leveraging superior global feature extraction. Additionally, it exhibits strong robustness even in extreme conditions. Dataset and code are available at https://github.com/jiangfeng-Z/M3D.
4 May 2026 in IEEE Signal Processing Letters
Domain generalization in person re-identification (DG re-ID) aims to build models that can accurately retrieve a targeted person across cameras in arbitrary unseen domains, without access to those domains during training. Data augmentation (DA) has become a de facto solution to DG re-ID, and one line of approaches realizes this goal from a frequency-centric perspective, where the Fourier Transform (FT) is employed to mix amplitudes for novel sample generation. However, FT-based strategies are fundamentally limited by the assumption of signal stationarity, which may be inadequate to explore a broader perturbation space. To overcome this limitation, this work investigates the potential of the Fractional Fourier Transform (FrFT) for DA and proposes FracMix (Fractional Fourier based MixUp), which yields an intermediate representation that bridges spatial and frequency domains with a fractional order α, enabling the generation of richer samples. Furthermore, an Adaptive Token Pruning strategy (ATP) is designed to dynamically select the top-K salient tokens and perform perturbations exclusively to corresponding patches. This simple yet effective mechanism alleviates over-reliance on a small set of dominant patches and encourages broader contextual utilization, thereby improving robustness and generalization. Experiments on multiple DG re-ID benchmarks demonstrate the effectiveness of FracMix.