Real-time monitoring of dynamic biological processes in the body is critical to understanding disease progression and treatment response. These data, for instance, can help address the lower than 50% response rates to cancer immunotherapy. However, current clinical imaging modalities lack the molecular contrast, resolution, and chronic usability for rapid and accurate response assessments. Here, we present a fully wireless image sensor featuring a $2.5{\times }5$ mm2 CMOS integrated circuit for multicolor fluorescence imaging deep in tissue. The sensor operates wirelessly via ultrasound (US) at 5-cm depth in oil, harvesting energy with 221-mW/cm2 incident US power density (31% of FDA limits) and backscattering data at 13 kb/s with a bit error rate $\lt 10{^{-6}}$ . In situ fluorescence excitation is provided by micro-laser diodes controlled with a programmable on-chip driver. An optical front-end combining a multi-bandpass interference filter and a fiber optic plate (FOP) provides >6 OD excitation blocking and enables three-color imaging for detecting multiple cell types. A $36{\times }40$ pixel array captures images with <125-$\mu $ m resolution. We demonstrate wireless, dual-color fluorescence imaging of both effector and suppressor immune cells in ex vivo mouse tumor samples with and without immunotherapy. These results show promise for providing rapid insight into therapeutic response and resistance, guiding personalized medicine.
12 March 2024 in IEEE Transactions on Biomedical Circuits and Systems
We present a mm-sized, ultrasonically powered lensless CMOS image sensor as a progress towards wireless fluorescence microscopy. Access to biological information within the tissue has the potential to provide insights guiding diagnosis and treatment across numerous medical conditions including cancer therapy. This information, in conjunction with current clinical imaging techniques that have limitations in obtaining images continuously and lack wireless compatibility, can improve continual detection of multicell clusters deep within tissue. The proposed platform incorporates a 2.4×4.7 mm 2 integrated circuit (IC) fabricated in TSMC 0.18 μm, a micro laser diode (μLD), a single piezoceramic and off-chip storage capacitors. The IC consists of a 36×40 array of capacitive trans-impedance amplifier-based pixels, wireless power management and communication via ultrasound and a laser driver all controlled by a Finite State Machine. The piezoceramic harvests energy from the acoustic waves at a depth of 2 cm to power up the IC and transfer 11.5 kbits/frame via backscattering. During Charge-Up , the off-chip capacitor stores charge to later supply a high-power 78 mW μLD during Imaging . Proof of concept of the imaging front end is shown by imaging distributions of CD8 T-cells, an indicator of the immune response to cancer, ex vivo , in the lymph nodes of a functional immune system (BL6 mice) against colorectal cancer consistent with the results of a fluorescence microscope. The overall system performance is verified by detecting 140 μm features on a USAF resolution target with 32 ms exposure time and 389 ms ultrasound backscattering.
In curative-intent cancer surgery, intraoperative fluorescence imaging of both diseased and healthy tissue can help to ensure the successful removal of all gross and microscopic diseases with minimal damage to neighboring critical structures, such as nerves. Current fluorescence-guided surgery (FGS) systems, however, rely on bulky and rigid optics that incur performance-limiting trade-offs between sensitivity and maneuverability. Moreover, many FGS systems are incapable of multiplexed imaging. As a result, clinical FGS is currently limited to millimeter-scale detection of a single fluorescent target. Here, we present a scalable, lens-less fluorescence imaging chip, VISION, capable of sensitive and multiplexed detection within a compact form factor. Central to VISION is a novel optical frontend design combining a low-numerical-aperture fiber optic plate (LNA-FOP) and a multi-bandpass interference filter, which is affixed to a custom CMOS image sensor. The LNA-FOP acts as a planar collimator to improve resolution and compensate for the angle-sensitivity of the interference filter, enabling high-resolution and multiplexed fluorescence imaging without lenses. We show VISION is capable of detecting tumor foci of less than 100 cells at near video framerates and, as proof of principle, can simultaneously visualize both tumors and nerves in ex vivo prostate tissue.
We present a mm-sized, ultrasonically powered lensless CMOS image sensor as a progress towards wireless fluorescence microscopy. Access to biological information within the tissue has the potential to provide insights guiding diagnosis and treatment across numerous medical conditions including cancer therapy. This information, in conjunction with current clinical imaging techniques that have limitations in obtaining images continuously and lack wireless compatibility, can improve continual detection of multicell clusters deep within tissue. The proposed platform incorporates a 2.4×4.7 mm 2 integrated circuit (IC) fabricated in TSMC 0.18 μm, a micro laser diode (μLD), a single piezoceramic and off-chip storage capacitors. The IC consists of a 36×40 array of capacitive trans-impedance amplifier-based pixels, wireless power management and communication via ultrasound and a laser driver all controlled by a Finite State Machine. The piezoceramic harvests energy from the acoustic waves at a depth of 2 cm to power up the IC and transfer 11.5 kbits/frame via backscattering. During Charge-Up , the off-chip capacitor stores charge to later supply a high-power 78 mW μLD during Imaging . Proof of concept of the imaging front end is shown by imaging distributions of CD8 T-cells, an indicator of the immune response to cancer, ex vivo , in the lymph nodes of a functional immune system (BL6 mice) against colorectal cancer consistent with the results of a fluorescence microscope. The overall system performance is verified by detecting 140 μm features on a USAF resolution target with 32 ms exposure time and 389 ms ultrasound backscattering.
In curative-intent cancer surgery, intraoperative fluorescence imaging of both diseased and healthy tissue can help to ensure successful removal of all gross and microscopic disease with minimal damage to neighboring critical structures, such as nerves. Current fluorescence-guided surgery (FGS) systems, however, rely on bulky and rigid optics that incur performance-limiting trade-offs between sensitivity and maneuverability. Moreover, many FGS systems are incapable of multiplexed imaging. As a result, clinical FGS is currently limited to millimeter-scale detection of a single fluorescent target. Here we present a scalable, lens-less fluorescence imaging chip, VISION, capable of sensitive and multiplexed detection within a compact form factor. Central to VISION is a novel optical frontend design combining a low-numerical-aperture fiber optic plate (LNA-FOP) and a multi-bandpass interference filter, which is affixed to a custom CMOS image sensor. The LNA-FOP acts as a planar collimator to improve resolution and compensate for the angle-sensitivity of the interference filter, enabling high-resolution and multiplexed fluorescence imaging without lenses. We show VISION is capable of detecting tumor foci of less than 100 cells at near video framerates and, as proof of principle, can simultaneously visualize both tumor and nerves in ex vivo prostate tissue.
Lensless imaging enables exceptionally compact fluorescence sensors, advancing applications in in vivo imaging and low-cost, point-of-care diagnostics. These sensors require a filter to block the excitation light while passing the weak fluorescent emissions. However, conventional thin-film interference filters are sensitive to angle of incidence (AOI), complicating their use in lensless systems. Here, we thoroughly analyze and optimize a technique using a fiber optic plate (FOP) to absorb off-axis light that would bleed through the interference filter and improve image resolution. Through simulations, we show that the numerical aperture (NA) of the FOP drives inherent design tradeoffs: collection efficiency improves rapidly with a higher NA, but at the cost of resolution, increased device thickness, and fluorescence excitation efficiency. To illustrate these tradeoffs, we optimize two optical frontend designs using FOPs with full-width at half maximums of 8.3° and 45.7°. Implementing these designs, we show that to maintain performance across all AOIs, filters must be coated on both sides of the FOP to mitigate internal scattering effects. In imaging experiments, the 520-µm-thick high-NA design collects 59× more light, but its resolution degrades rapidly with increased working distances. Alternatively, the low-NA design is capable of three-color fluorescence imaging with at least 110-µm resolution at a 1-mm working distance. Overall, we demonstrate a versatile optical frontend that is adaptable to a range of applications using different fluorophores, illumination configurations, and lensless imaging techniques.