24 March 2025 in Light: Science & Applications
To enhance the computational density and energy efficiency of on-chip neuromorphic hardware, this study introduces a novel network architecture for multi-task processing with in-memory optical computing. On-chip optical neural networks are celebrated for their capability to transduce a substantial volume of parameters into optical form while conducting passive computing, yet they encounter challenges in scalability and multitasking. Leveraging the principles of transfer learning, this approach involves embedding the majority of parameters into fixed optical components and a minority into adjustable electrical components. Furthermore, with deep regression algorithm in modeling physical propagation process, a compact optical neural network achieve to handle diverse tasks. In this work, two ultra-compact in-memory diffraction-based chips with integration of more than 60,000 parameters/mm2 were fabricated, employing deep neural network model and the hard parameter sharing algorithm, to perform multifaceted classification and regression tasks, respectively. The experimental results demonstrate that these chips achieve accuracies comparable to those of electrical networks while significantly reducing the power-intensive digital computation by 90%. Our work heralds strong potential for advancing in-memory optical computing frameworks and next generation of artificial intelligence platforms.
15 June 2023 in Optics Express
A new method to improve the integration level of an on-chip diffractive optical neural network (DONN) is proposed based on a standard silicon-on-insulator (SOI) platform. The metaline, which represents a hidden layer in the integrated on-chip DONN, is composed of subwavelength silica slots, providing a large computation capacity. However, the physical propagation process of light in the subwavelength metalinses generally requires an approximate characterization using slot groups and extra length between adjacent layers, which limits further improvements of the integration of on-chip DONN. In this work, a deep mapping regression model (DMRM) is proposed to characterize the process of light propagation in the metalines. This method improves the integration level of on-chip DONN to over 60,000 and elimnates the need for approximate conditions. Based on this theory, a compact-DONN (C-DONN) is exploited and benchmarked on the Iris plants dataset to verify the performance, yielding a testing accuracy of 93.3%. This method provides a potential solution for future large-scale on-chip integration.
29 August 2025 in Laser & Photonics Reviews
1 October 2025 in APL Photonics
Photonic neuromorphic computing offers substantial enhancements in machine vision processing by providing ultrahigh operation bandwidth and reduced energy consumption, thereby outperforming conventional electronic systems based on von Neumann architectures. However, scalability challenges persist in implementing chip-scale photonic computing—particularly when accommodating high-dimensional tensor inputs—due to inherent physical constraints and the complexity of control engineering. In this paper, we introduce a compact photonic neuromorphic processor that integrates with an on-chip diffractive multi-channel multi-kernel optical convolution unit (M2OCU) to enable parallel, high-complexity vision perception. By leveraging amplitude-phase co-modulation within the M2OCU, high-dimensional tensors can be simultaneously loaded and processed with energy efficiency exceeding 100 giga-operations per watt per square millimeter (GOPS/W/mm2). We experimentally validate the feasibility of M2OCU by demonstrating its application in machine vision, including photonic channel-wise pooling and video-based multi-frame fusion for human action recognition. Both applications achieve comparable accuracies while significantly reducing computational load. Our work provides a pathway for future large-scale and high-dimensional information processing with photonic integrated circuits, enabling the practical application of chip-scale photonic computing in increasingly sophisticated scenarios—such as autonomous driving, astronautics, and telecommunications—at picosecond latency and femtojoule-level energy consumption per operation.
3 June 2026 in Nature Communications
Photonic computing offers an energy-efficient, high-bandwidth platform for artificial intelligence (AI) but currently faces scalability bottlenecks stemming from depth-dependent designs, linear optical structures, and intrinsic optical losses, along with high hardware and reconfiguration costs for multi-task processing. Here, we present a scaling paradigm that circumvents these limitations by expanding network width rather than depth, leveraging the intrinsic parallelism of photonics. We implement a scalable Photonic Mixture-of-Experts (PMoE) architecture, where parallel photonic cores function as expert networks. By dynamically routing inputs to these experts, the PMoE efficiently executes multi-task workloads without altering the physical optical weights. We fabricated a PMoE chip integrating three collaborative diffraction-based expert networks, featuring 18 parallel kernels within a compact intrinsic computational-core footprint of 0.067 mm2. Experimentally, the PMoE chip achieves multi-domain image classification with an average accuracy of 97.1%. While offering further scalability, this approach outperforms conventional optical networks and reduces digital parameter overhead by 67%. Our work underscores the scalability and efficiency of the PMoE architecture for next-generation large-scale photonic AI processors.
29 January 2025 in Research Square
Photonic neuromorphic computing offers substantial enhancements in machine vision processing by providing ultrahigh operation bandwidth and reduced energy consumption, thereby outperforming conventional electronic systems based on Von Neumann architectures. However, scalability challenges persist in implementing chip-scale photonic computing --- particularly when accommodating high-dimensional tensor inputs --- due to inherent physical constraints and the complexity of control engineering. In this paper, we introduce a compact photonic embedding unit (PEU) that integrates with on-chip diffractive multi-kernel optical convolution to enable parallel, high-complexity vision perception. By leveraging amplitude-phase co-modulatio{}n within the PEU, high-dimensional tensors can be simultaneously loaded and processed with energy efficiency exceeding 100 giga-operations per watt per square milimeter (GOPS/W/mm2). We experimentally validate the feasibility of PEU by demonstrating diverse machine vision applications including Megapixel color image compression with a maximum 4.5:1 compression ratio, image classification over CIFAR-4 dataset with a 70.3% accuracy, and video-based multi-frame fusion for human action recognition with a 97.5% accuracy and a 66.7% reduction in computation load. Our work provides a pathway for future large-scale and high-dimensional vision embedding with photonic integrated circuits, enabling the practical application of chip-scale photonic computing in increasingly sophisticated scenarios --- such as autonomous driving, astronautics, and telecommunications --- at picosecond latency and femtojoule-level energy consumption per operation.