Since their inception in the 1930–1960s, the research disciplines of computational imaging and machine learning have followed parallel tracks and, during the last two decades, experienced explosive growth drawing on similar progress in mathematical optimization and computing hardware. While these developments have always been to the benefit of image interpretation and machine vision, only recently has it become evident that machine learning architectures, and deep neural networks in particular, can be effective for computational image formation, aside from interpretation. The deep learning approach has proven to be especially attractive when the measurement is noisy and the measurement operator ill posed or uncertain. Examples reviewed here are: super-resolution; lensless retrieval of phase and complex amplitude from intensity; photon-limited scenes, including ghost imaging; and imaging through scatter. In this paper, we cast these works in a common framework. We relate the deep-learning-inspired solutions to the original computational imaging formulation and use the relationship to derive design insights, principles, and caveats of more general applicability. We also explore how the machine learning process is aided by the physics of imaging when ill posedness and uncertainties become particularly severe. It is hoped that the present unifying exposition will stimulate further progress in this promising field of research.
Invisibility cloaks, a subject that usually occurs in science fiction and myths, have attracted wide interest recently because of their possible realization. The biggest challenge to true invisibility is known to be the cloaking of a macroscopic object in the broad range of wavelengths visible to the human eye. Here we experimentally solve this problem by incorporating the principle of transformation optics into a conventional optical lens fabrication with low-cost materials and simple manufacturing techniques. A transparent cloak made of two pieces of calcite is created. This cloak is able to conceal a macroscopic object with a maximum height of 2~mm, larger than 3500 free-space-wavelength, inside a transparent liquid environment. Its working bandwidth encompassing red, green, and blue light is also demonstrated.
Lensless imaging eliminates the need for geometric isomorphism between a scene and an image while allowing the construction of compact, lightweight imaging systems. However, a challenging inverse problem remains due to the low reconstructed signal-to-noise ratio. Current implementations require multiple masks or multiple shots to denoise the reconstruction. We propose single-shot lensless imaging with a Fresnel zone aperture and incoherent illumination. By using the Fresnel zone aperture to encode the incoherent rays in wavefront-like form, the captured pattern has the same form as the inline hologram. Since conventional backpropagation reconstruction is troubled by the twin-image problem, we show that the compressive sensing algorithm is effective in removing this twin-image artifact due to the sparsity in natural scenes. The reconstruction with a significantly improved signal-to-noise ratio from a single-shot image promotes a camera architecture that is flat and reliable in its structure and free of the need for strict calibration.
A multifunctional surface that enables control of wetting, optical reflectivity and mechanical damage of nanostructured interfaces is presented. Our approach is based on imprinting a periodic array of nanosized cones into a UV‐curable polyurethane acrylate (PUA), resulting in a self‐reinforcing egg‐crate topography evenly distributed over large areas up to several cm2 in size. The resulting surfaces can be either superhydrophilic or superhydrophobic (through subsequent application of an appropriate chemical coating), they minimize optical reflection losses over a broad range of wavelengths and a wide range of angles of incidence, and they also have enhanced mechanical resilience due to greatly improved redistribution of the normal and shearing mechanical loads. The transmissivity and wetting characteristics of the nanoscale egg‐crate structure, as well as its resistance to mechanical deformation are analyzed theoretically. Experiments show that the optical performance together with self‐cleaning or anti‐fogging behavior of the inverted nanocone topography is comparable to earlier designs that have used periodic arrays of nanocones to control reflection and wetting. However the egg‐crate structures are far superior in terms of mechanical robustness, and the ability to replicate this topography through several generations is promising for large‐scale commercial applications where multifunctionality is important.
The surge in artificial intelligence applications calls for scalable, high-speed, and low-energy computation methods. Computing with photons is promising due to the intrinsic parallelism, high bandwidth, and low latency of photons. However, current photonic computing architectures are limited by the speed and energy consumption associated with electronic-to-optical data transfer, i.e., electro-optic conversion. Here, we demonstrate a thin-film lithium niobate (TFLN) computing circuit that addresses this challenge, leveraging both highly efficient electro-optic modulation and the spatial scalability of TFLN photonics. Our circuit is capable of computing at 43.8 GOPS/channel while consuming 0.0576 pJ/OP, and we demonstrate various inference tasks with high accuracy, including the classification of binary data and complex images. Heightening the integration level, we show another TFLN computing circuit that is combined with a hybrid-integrated distributed-feedback laser and heterogeneous-integrated modified uni-traveling carrier photodiode. Our results show that the TFLN photonic platform holds promise to complement silicon photonics and diffractive optics for photonic computing, with extensions to ultrafast signal processing and ranging.
We report what is to our knowledge the first volume-holographic optical imaging instrument with the capability to return three-dimensional spatial as well as spectral information about semitranslucent microscopic objects in a single measurement. The four-dimensional volume-holographic microscope is characterized theoretically and experimentally by use of fluorescent microspheres as objects.