30 December 2024 in Advanced Engineering Informatics
27 November 2023 in Separation and Purification Technology
19 January 2023 in IEEE Transactions on Computational Imaging
Panoramic Annular Lens (PAL) composed of few lenses has great potential in panoramic surrounding sensing tasks for mobile and wearable devices because of its tiny size and large Field of View (FoV). However, the image quality of tiny-volume PAL confines to optical limit due to the lack of lenses for aberration correction. In this paper, we propose an Annular Computational Imaging (ACI) framework to break the optical limit of light-weight PAL design. To facilitate learning-based image restoration, we introduce a wave-based simulation pipeline for panoramic imaging and tackle the synthetic-to-real gap through multiple data distributions. The proposed pipeline can be easily adapted to any PAL with design parameters and is suitable for loose-tolerance designs. Furthermore, we design the Physics Informed Image Restoration Network (PI $^{2}$ RNet) considering the physical priors of panoramic imaging and single-pass physics-informed engine. At the dataset level, we create the DIVPano dataset and the extensive experiments on it illustrate that our proposed network sets the new state of the art in the panoramic image restoration under spatially-variant degradation. In addition, the evaluation of the proposed ACI on a simple PAL with only 3 spherical lenses reveals the delicate balance between high-quality panoramic imaging and compact design. To the best of our knowledge, we are the first to explore Computational Imaging (CI) in PAL. Code and datasets are publicly available at https://github.com/zju-jiangqi/ACI-PI2RNet .
16 August 2024 in IEEE Transactions on Image Processing
High-quality panoramic images with a Field of View (FoV) of 360° are essential for contemporary panoramic computer vision tasks. However, conventional imaging systems come with sophisticated lens designs and heavy optical components. This disqualifies their usage in many mobile and wearable applications where thin and portable, minimalist imaging systems are desired. In this paper, we propose a Panoramic Computational Imaging Engine (PCIE) to achieve minimalist and high-quality panoramic imaging. With less than three spherical lenses, a Minimalist Panoramic Imaging Prototype (MPIP) is constructed based on the design of the Panoramic Annular Lens (PAL), but with low-quality imaging results due to aberrations and small image plane size. We propose two pipelines, i.e. Aberration Correction (AC) and Super-Resolution and Aberration Correction (SR&AC), to solve the image quality problems of MPIP, with imaging sensors of small and large pixel size, respectively. To leverage the prior information of the optical system, we propose a Point Spread Function (PSF) representation method to produce a PSF map as an additional modality. A PSF-aware Aberration-image Recovery Transformer (PART) is designed as a universal network for the two pipelines, in which the self-attention calculation and feature extraction are guided by the PSF map. We train PART on synthetic image pairs from simulation and put forward the PALHQ dataset to fill the gap of real-world high-quality PAL images for low-level vision. A comprehensive variety of experiments on synthetic and real-world benchmarks demonstrates the impressive imaging results of PCIE and the effectiveness of the PSF representation. We further deliver heuristic experimental findings for minimalist and high-quality panoramic imaging, in terms of the choices of prototype and pipeline, network architecture, training strategies, and dataset construction. Our dataset and code will be available at https://github.com/zju-jiangqi/PCIE-PART.
24 May 2022 in Journal of Applied Physics
Hafnium oxide non-volatile memories have shown promise as an artificial synapse in neuromorphic computing architectures. However, there is still a need to fundamentally understand how to reliably control the analog resistance change induced by oxygen ions that partially rupture or re-form the conductive filament. In this work, the impact of measurement conditions (pulse amplitude and pulse width) and titanium dopants on the analog resistance change of atomic layer deposited hafnium oxide memristor synapses are studied. A lower pulse amplitude improves the linearity of resistance change as a function of the number of pulses but results in a smaller memory window. The addition of titanium dopants does not substantively change the analog resistance modulation of hafnium oxide. Density functional theory calculations show that titanium strongly impacts oxygen ion motion in the HfxTiyOz matrix but does not impact significantly in the HfTi metallic filament. This study demonstrates that the analog characteristic of HfxTiyOz artificial synapses is largely independent of the titanium doped bulk oxide since the resistance change is primarily controlled by the HfTi metallic conducting filament.
11 July 2024 in Journal of Materials Processing Technology