The ability to record images with extreme temporal resolution enables a diverse range of applications, such as fluorescence lifetime imaging, time-of-flight depth imaging and characterization of ultrafast processes. Recently, ultrafast imaging schemes have emerged, which require either long acquisition times or raster scanning and have a requirement for sufficient signal that can only be achieved when light is reflected off an object or diffused by a strongly scattering medium. Here we present a demonstration of the potential of single-photon detector arrays for visualization and rapid characterization of events evolving on picosecond time scales. The single-photon sensitivity, temporal resolution and full-field imaging capability enables the observation of light-in-flight in air, as well as the measurement of laser-induced plasma formation and dynamics in its natural environment. The extreme sensitivity and short acquisition times pave the way for real-time imaging of ultrafast processes or visualization and tracking of objects hidden from view.
We demonstrate diffraction limited multiphoton imaging in a massively parallel, fully addressable time-resolved multi-beam multiphoton microscope capable of producing fluorescence lifetime images with sub-50ps temporal resolution. This imaging platform offers a significant improvement in acquisition speed over single-beam laser scanning FLIM by a factor of 64 without compromising in either the temporal or spatial resolutions of the system. We demonstrate FLIM acquisition at 500 ms with live cells expressing green fluorescent protein. The applicability of the technique to imaging protein-protein interactions in live cells is exemplified by observation of time-dependent FRET between the epidermal growth factor receptor (EGFR) and the adapter protein Grb2 following stimulation with the receptor ligand. Furthermore, ligand-dependent association of HER2-HER3 receptor tyrosine kinases was observed on a similar timescale and involved the internalisation and accumulation or receptor heterodimers within endosomes. These data demonstrate the broad applicability of this novel FLIM technique to the spatio-temporal dynamics of protein-protein interaction.
8 February 2019 in IEEE Journal of Solid-State Circuits
A 512 × 16 single photon avalanche diode (SPAD)based line sensor is designed in a 0.13-μm CMOS image sensor technology for time-resolved multispectral beam scanned imaging. The sensor has 23.78-μm pixel pitch and incorporates one SPAD array with 49.31% fill factor optimized for detection in the blue-green spectral region, and a second array at 15.75% fill factor optimized for the red-near-infrared response spectral region. Each pixel contains a 32-bin histogramming time-to-digital converter (TDC) with a mean time resolution of 51.20 ps. Histogram bin resolutions are adjustable from 51.20 ps to 6.55 ns per bin. The line sensor can operate in single photon counting (SPC) mode (102.1 giga-events/s), timecorrelated SPC (TCSPC) mode (192.4 million-events/s) or on-chip histogramming mode (16.5 giga-events/s), increasing the count rate up to 85 times compared to TCSPC mode. Sensor capability is demonstrated through spectral fluorescence lifetime imaging, resolving three fluorophore populations with distinct fluorophore lifetimes.
We present a digital architecture for fast acquisition of time correlated single photon counting (TCSPC) events from a complementary metal oxide semiconductor (CMOS) single photon avalanche detector (SPAD) array (Megaframe) to the computer memory. Custom firmware was written to transmit event codes from 1024-TCSPC-enabled pixels for fast transfer of TCSPC events. Our 1024-channel TCSPC system is capable of acquiring up to TCSPC events per second with 16 histogram bins spanning a 14 ns width. Other options include TCSPC events per second with 256 histogram bins spanning either a 14 or 56 ns time window. We present a wide-field fluorescence microscopy setup demonstrating fast fluorescence lifetime data acquisition. To the best of our knowledge, this is the fastest direct TCSPC transfer from a single photon counting device to the computer to date.
3D measurement of optical attenuation is of interest in a variety of fields of biomedical importance, including spectrophotometry, optical projection tomography (OPT) and analysis of 3D radiation dosimeters. Accurate, precise and economical 3D measurements of optical density (OD) are a crucial step in enabling 3D radiation dosimeters to enter wider use in clinics. Polymer gels and Fricke gels, as well as dosimeters not based around gels, have been characterized for 3D dosimetry over the last two decades. A separate problem is the verification of the best readout method. A number of different imaging modalities (magnetic resonance imaging (MRI), optical CT, x-ray CT and ultrasound) have been suggested for the readout of information from 3D dosimeters. To date only MRI and laser-based optical CT have been characterized in detail. This paper describes some initial steps we have taken in establishing charge coupled device (CCD)-based optical CT as a viable alternative to MRI for readout of 3D radiation dosimeters. The main advantage of CCD-based optical CT over traditional laser-based optical CT is a speed increase of at least an order of magnitude, while the simplicity of its architecture would lend itself to cheaper implementation than both MRI and laser-based optical CT if the camera itself were inexpensive enough. Specifically, we study the following aspects of optical metrology, using high quality test targets: (i) calibration and quality of absorbance measurements and the camera requirements for 3D dosimetry; (ii) the modulation transfer function (MTF) of individual projections; (iii) signal-to-noise ratio (SNR) in the projection and reconstruction domains; (iv) distortion in the projection domain, depth-of-field (DOF) and telecentricity. The principal results for our current apparatus are as follows: (i) SNR of optical absorbance in projections is better than 120:1 for uniform phantoms in absorbance range 0.3 to 1.6 (and better than 200:1 for absorbances 1.0 to 3.5 with the test target and a novel absorbance range extension method), (ii) the spatial resolution is shown to be at worst 0.5 mm (and often better than this) with an associated DOF of 8 cm, (iii) the SNR of uniform phantoms in reconstruction domain is above 80:1 (one standard deviation) over an absorbance dynamic range of 0.3 to 1.6, (iv) the apparatus is telecentric and without distortion. Finally, a sample scan and reconstruction of a scan of a PRESAGE dosimeter are shown, demonstrating the capabilities of the apparatus.