Significance: X-ray fluorescence microscopy provides unparalleled sensitivity for measuring the distribution of trace elements in many-micrometer-thick specimens, whereas ptychography offers a path to the imaging of weakly fluorescing biological ultrastructure at beyond-focusing-optic resolution. We demonstrate here for the first time, to our knowledge, the combination of fluorescence and ptychography for imaging frozen-hydrated specimens at cryogenic temperatures, with excellent structural and chemical preservation. This combined approach will have significant impact on studies of the intracellular localization of nanocomposites with attached therapeutic or diagnostic agents, help elucidate the roles of trace metals in cell development, and further the study of diseases where trace metal misregulation is suspected (including neurodegenerative diseases).

Ptychography is an imaging method whereby a coherent beam is scanned across an object, and an image is obtained by iterative phasing of the set of diffraction patterns. It is able to be used to image extended objects at a resolution limited by scattering strength of the object and detector geometry, rather than at an optics-imposed limit. As technical advances allow larger fields to be imaged, computational challenges arise for reconstructing the correspondingly larger data volumes, yet at the same time there is also a need to deliver reconstructed images immediately so that one can evaluate the next steps to take in an experiment. Here we present a parallel method for real-time ptychographic phase retrieval. It uses a hybrid parallel strategy to divide the computation between multiple graphics processing units (GPUs) and then employs novel techniques to merge sub-datasets into a single complex phase and amplitude image. Results are shown on a simulated specimen and a real dataset from an X-ray experiment conducted at a synchrotron light source.

Phase retrieval, or the process of recovering phase information in reciprocal space to reconstruct images from measured intensity alone, is the underlying basis to a variety of imaging applications including coherent diffraction imaging (CDI). Typical phase retrieval algorithms are iterative in nature, and hence, are time-consuming and computationally expensive, making real-time imaging a challenge. Furthermore, iterative phase retrieval algorithms struggle to converge to the correct solution especially in the presence of strong phase structures. In this work, we demonstrate the training and testing of CDI NN, a pair of deep deconvolutional networks trained to predict structure and phase in real space of a 2D object from its corresponding far-field diffraction intensities alone. Once trained, CDI NN can invert a diffraction pattern to an image within a few milliseconds of compute time on a standard desktop machine, opening the door to real-time imaging.

Ptychography is a coherent diffraction imaging (CDI) method for extended objects in which diffraction patterns are acquired sequentially from overlapping coherent illumination spots. The object’s complex transmission function can be reconstructed from those diffraction patterns at a spatial resolution limited only by the scattering strength of the object and the detector geometry. Most experiments to date have positioned the illumination spots on the sample using a move-settle-measure sequence in which the move and settle steps can take longer to complete than the measure step. We describe here the use of a continuous “fly-scan” mode for ptychographic data collection in which the sample is moved continuously, so that the experiment resembles one of integrating the diffraction patterns from multiple probe positions. This allows one to use multiple probe mode reconstruction methods to obtain an image of the object and also of the illumination function. We show in simulations, and in x-ray imaging experiments, some of the characteristics of fly-scan ptychography, including a factor of 25 reduction in the data acquisition time. This approach will become increasingly important as brighter x-ray sources are developed, such as diffraction limited storage rings.

Accurate knowledge of elemental distributions within biological organisms is critical for understanding their cellular roles. The ability to couple this knowledge with overall cellular architecture in three dimensions (3D) deepens our understanding of cellular chemistry. Using a whole, frozen-hydrated Chlamydomonas reinhardtii cell as an example, we report the development of 3D correlative microscopy through a combination of simultaneous cryogenic x-ray ptychography and x-ray fluorescence microscopy. By taking advantage of a recently developed tomographic reconstruction algorithm, termed GENeralized Fourier Iterative REconstruction (GENFIRE), we produce high-quality 3D maps of the unlabeled alga’s cellular ultrastructure and elemental distributions within the cell. We demonstrate GENFIRE’s ability to outperform conventional tomography algorithms and to further improve the reconstruction quality by refining the experimentally intended tomographic angles. As this method continues to advance with brighter coherent light sources and more efficient data handling, we expect correlative 3D x-ray fluorescence and ptychographic tomography to be a powerful tool for probing a wide range of frozen-hydrated biological specimens, ranging from small prokaryotes such as bacteria, algae, and parasites to large eukaryotes such as mammalian cells, with applications that include understanding cellular responses to environmental stimuli and cell-to-cell interactions.

X-ray microscopy can be used to image whole, unsectioned cells in their native hydrated state. It complements the higher resolution of electron microscopy for submicrometer thick specimens, and the molecule-specific imaging capabilites of fluorescence light microscopy. We describe here the first use of fast, continuous x-ray scanning of frozen hydrated cells for simultaneous sub-20 nm resolution ptychographic transmission imaging with high contrast, and sub-100 nm resolution deconvolved x-ray fluorescence imaging of diffusible and bound ions at native concentrations, without the need to add specific labels. By working with cells that have been rapidly frozen without the use of chemical fixatives, and imaging them under cryogenic conditions, we are able to obtain images with well preserved structural and chemical composition, and sufficient stability against radiation damage to allow for multiple images to be obtained with no observable change.