Sunil Pai

Sunil Pai

Auto-generated profile, based on publicly available information

Sunil Pai

Ginzton Laboratory, Stanford University, USA

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
28 April 2023 in Science
Verified
Journal Article
Closed access
SPSunil Pai
Sunil Pai
ZSZhanghao Sun
Zhanghao Sun
THTyler W. Hughes
Tyler W. Hughes
TPTaewon Park
Taewon Park
BBBen Bartlett
Ben Bartlett
DMDavid A. B. Miller
David A. B. Miller
Integrated photonic neural networks provide a promising platform for energy-efficient, high-throughput machine learning with extensive scientific and commercial applications. Photonic neural networks efficiently transform optically encoded inputs using Mach-Zehnder interferometer mesh networks interleaved with nonlinearities. We experimentally trained a three-layer, four-port silicon photonic neural network with programmable phase shifters and optical power monitoring to solve classification tasks using “in situ backpropagation,” a photonic analog of the most popular method to train conventional neural networks. We measured backpropagated gradients for phase-shifter voltages by interfering forward- and backward-propagating light and simulated in situ backpropagation for 64-port photonic neural networks trained on MNIST image recognition given errors. All experiments performed comparably to digital simulations ( > 94% test accuracy), and energy scaling analysis indicated a route to scalable machine learning.

23 July 2019 in IEEE Journal of Selected Topics in Quantum Electronics
Verified
Journal Article
Closed access
IWIan A. D. Williamson
Ian A. D. Williamson
THTyler W. Hughes
Tyler W. Hughes
MMMomchil Minkov
Momchil Minkov
BBBen Bartlett
Ben Bartlett
SPSunil Pai
Sunil Pai
SFShanhui Fan
Shanhui Fan
We introduce an electro-optic hardware platform for nonlinear activation functions in optical neural networks. The optical-to-optical nonlinearity operates by converting a small portion of the input optical signal into an analog electric signal, which is used to intensity -modulate the original optical signal with no reduction in processing speed. Our scheme allows for complete nonlinear on-off contrast in transmission at relatively low optical power thresholds and eliminates the requirement of having additional optical sources between each of the layers of the network Moreover, the activation function is reconfigurable via electrical bias, allowing it to be programmed or trained to synthesize a variety of nonlinear responses. Using numerical simulations, we demonstrate that this activation function significantly improves the expressiveness of optical neural networks, allowing them to perform well on two benchmark machine learning tasks: learning a multi-input exclusive-OR (XOR) logic function and classification of images of handwritten numbers from the MNIST dataset. The addition of the nonlinear activation function improves test accuracy on the MNIST task from 85% to 94%.

19 June 2019 in Physical Review Applied
Verified
Journal Article
Closed access
PDF file
SPSunil Pai
Sunil Pai
BBBen Bartlett
Ben Bartlett
OSOlav Solgaard
Olav Solgaard
DMDavid A. B. Miller
David A. B. Miller
Universal unitary photonic devices can apply arbitrary unitary transformations to a vector of input modes and provide a promising hardware platform for fast and energy-efficient machine learning using light. We simulate the gradient-based optimization of random unitary matrices on universal photonic devices composed of imperfect tunable interferometers. If device components are initialized uniform randomly, the locally interacting nature of the mesh components biases the optimization search space toward banded unitary matrices, limiting convergence to random unitary matrices. We detail a procedure for initializing the device by sampling from the distribution of random unitary matrices and show that this greatly improves convergence speed. We also explore mesh architecture improvements such as adding extra tunable beam splitters or permuting waveguide layers to further improve the training speed and scalability of these devices.

8 April 2020 in Optics Express
Verified
Journal Article
Closed access
MFMonireh Moayedi Pour Fard
Monireh Moayedi Pour Fard
IWIan A. D. Williamson
Ian A. D. Williamson
MEMatthew Edwards
Matthew Edwards
KLKe Liu
Ke Liu
SPSunil Pai
Sunil Pai
TNThien-An Nguyen
Thien-An Nguyen
We experimentally demonstrate an on-chip electro-optic circuit for realizing arbitrary nonlinear activation functions for optical neural networks (ONNs). The circuit operates by converting a small portion of the input optical signal into an electrical signal and modulating the intensity of the remaining optical signal. Electrical signal processing allows the activation function circuit to realize any optical-to-optical nonlinearity that does not require amplification. Such line shapes are not constrained to those of conventional optical nonlinearities. Through numerical simulations, we demonstrate that the activation function improves the performance of an ONN on the MNIST image classification task. Moreover, the activation circuit allows for the realization of nonlinearities with far lower optical signal attenuation, paving the way for much deeper ONNs.

28 May 2020 in IEEE Journal of Selected Topics in Quantum Electronics
Verified
Journal Article
Closed access
SPSunil Pai
Sunil Pai
IWIan A. D. Williamson
Ian A. D. Williamson
THTyler W. Hughes
Tyler W. Hughes
MMMomchil Minkov
Momchil Minkov
OSOlav Solgaard
Olav Solgaard
DMDavid A. B. Miller
David A. B. Miller
Reconfigurable photonic mesh networks of tunable beamsplitter nodes can linearly transform N-dimensional vectors representing input modal amplitudes of light for applications such as energy-efficient machine learning hardware, quantum information processing, and mode demultiplexing. Such photonic meshes are typically programmed and/or calibrated by tuning or characterizing each beam splitter one-by-one, which can be time-consuming and can limit scaling to larger meshes. Here we introduce a graph-topological approach that defines the general class of feedforward networks and identifies columns of non-interacting nodes that can be adjusted simultaneously. By virtue of this approach, we can calculate the necessary input vectors to program entire columns of nodes in parallel by simultaneously nullifying the power in one output of each node via optoelectronic feedback onto adjustable phase shifters or couplers. This parallel nullification approach is fault-tolerant to fabrication errors, requiring no prior knowledge or calibration of node parameters and reducing programming time by a factor of order N to being proportional to the optical depth (number of node columns). As a demonstration, we simulate our programming protocol on a feedforward optical neural network model trained to classify handwritten digit images from the MNIST dataset with up to 98% validation accuracy.

27 April 2023 in Optica
Verified
Journal Article
Closed access
SPSunil Pai
Sunil Pai
TPTaewon Park
Taewon Park
MBMarshall Ball
Marshall Ball
BPBogdan Penkovsky
Bogdan Penkovsky
MDMichael Dubrovsky
Michael Dubrovsky
DMDavid A. B. Miller
David A. B. Miller
As blockchain technology and cryptocurrency become increasingly mainstream, photonic computing has emerged as an efficient hardware platform that reduces ever-increasing energy costs required to verify transactions in decentralized cryptonetworks. To reduce sensitivity of these verifications to photonic hardware error, we propose and experimentally demonstrate a cryptographic scheme, LightHash, that implements robust, low-bit precision matrix multiplication in programmable silicon photonic networks. We demonstrate an error mitigation scheme to reduce error by averaging computation across circuits, and simulate energy-efficiency-error trade-offs for large circuit sizes. We conclude that our error-resistant and efficient hardware solution can potentially generate a new market for decentralized photonic blockchain.