We introduce Motion-I2V, a novel framework for consistent and controllable text-guided image-to-video generation (I2V). In contrast to previous methods that directly learn the complicated image-to-video mapping, Motion-I2V factorizes I2V into two stages with explicit motion modeling. For the first stage, we propose a diffusion-based motion field predictor, which focuses on deducing the trajectories of the reference image’s pixels. For the second stage, we propose motion-augmented temporal attention to enhance the limited 1-D temporal attention in video latent diffusion models. This module can effectively propagate reference image features to synthesized frames with the guidance of predicted trajectories from the first stage. Compared with existing methods, Motion-I2V can generate more consistent videos even in the presence of large motion and viewpoint variation. By training a sparse trajectory ControlNet for the first stage, Motion-I2V can support users to precisely control motion trajectories and motion regions with sparse trajectory and region. This offers more controllability of the I2V process than solely relying on textual instructions. Additionally, Motion-I2V’s second stage naturally supports zero-shot video-to-video translation. Both qualitative and quantitative comparisons demonstrate the advantages of Motion-I2V over prior approaches in consistent and controllable image-to-video generation. Please see our project page at https://xiaoyushi97.github.io/Motion-I2V/.

The ever-growing demand for faster and more efficient data transfer and processing has brought optical computation strategies to the forefront of research in next-generation computing. Here, we report a universal computing approach with the chirality degree of freedom. By exploiting the crystal symmetry–enabled well-known chiral selection rules, we demonstrate the viability of the concept in bulk silica crystals and atomically thin semiconductors and create ultrafast (<100-fs) all-optical chirality logic gates (XNOR, NOR, AND, XOR, OR, and NAND) and a half adder. We also validate the unique advantages of chirality gates by realizing multiple gates with simultaneous operation in a single device and electrical control. Our first demonstrations of logic gates using chiral selection rules suggest that optical chirality could provide a powerful degree of freedom for future optical computing.

Reconstructive optoelectronic spectroscopy has generated substantial interest in the miniaturization of traditional spectroscopic tools, such as spectrometers. However, most state-of-the-art demonstrations face fundamental limits of rank deficiency in the photoresponse matrix. In this work, we demonstrate a miniaturized spectral sensing system using an electrically tunable compact optoelectronic interface, which generates distinguishable photoresponses from various input spectra, enabling accurate spectral identification with a device footprint of 5 micrometers by 5 micrometers. We report narrow-band spectral sensing with peak accuracies of ∼0.19 nanometers in free space and ∼2.45 nanometers on-chip. In addition, we implement broadband complex spectral sensing for material identification, applicable to organic dyes, metals, semiconductors, and dielectrics. This work advances high-performance, miniaturized optical spectroscopy for both free-space and on-chip applications, offering cost-effective solutions, broad applicability, and scalable manufacturing.

Transition metal dichalcogenide (TMD) heterobilayers provide a versatile platform to explore unique excitonic physics via the properties of the constituent TMDs and external stimuli. Interlayer excitons (IXs) can form in TMD heterobilayers as delocalized or localized states. However, the localization of IX in different types of potential traps, the emergence of biexcitons in the high-excitation regime, and the impact of potential traps on biexciton formation have remained elusive. In our work, we observe two types of potential traps in a MoSe₂/WSe₂ heterobilayer, which result in significantly different emission behavior of IXs at different temperatures. We identify the origin of these traps as localized defect states and the moiré potential of the TMD heterobilayer. Furthermore, with strong excitation intensity, a superlinear emission behavior indicates the emergence of interlayer biexcitons, whose formation peaks at a specific temperature. Our work elucidates the different excitation and temperature regimes required for the formation of both localized and delocalized IX and biexcitons and, thus, contributes to a better understanding and application of the rich exciton physics in TMD heterostructures.

Moiré superlattices in van der Waals heterostructures represent a highly tunable quantum system, attracting substantial interest in both many-body physics and device applications. However, the influence of the moiré potential on light-matter interactions at room temperature has remained largely unexplored. In our study, we demonstrate that the moiré potential in MoS₂/WSe₂ heterobilayers facilitates the localization of interlayer exciton (IX) at room temperature. By performing reflection contrast spectroscopy, we demonstrate the importance of atomic reconstruction in modifying intralayer excitons, supported by the atomic force microscopy experiment. When decreasing the twist angle, we observe that the IX lifetime becomes longer and light emission gets enhanced, indicating that non-radiative decay channels such as defects are suppressed by the moiré potential. Moreover, through the integration of moiré superlattices with silicon single-mode cavities, we find that the devices employing moiré-trapped IXs exhibit a significantly lower threshold, one order of magnitude smaller compared to the device utilizing delocalized IXs. These findings not only encourage the exploration of many-body physics in moiré superlattices at elevated temperatures but also pave the way for leveraging these artificial quantum materials in photonic and optoelectronic applications.

Light modulation is of paramount importance for photonics and optoelectronics. Here we report all-optical coherent modulation of third-harmonic generation (THG) with chiral light via the symmetry enabled polarization selectivity. The concept is experimentally validated in monolayer materials (MoS₂) with modulation depth approaching ~100%, ultra-fast modulation speed (<~130 fs), and wavelength-independence features. Moreover, the power and polarization of the incident optical beams can be used to tune the output chirality and modulation performance. Major performance of our demonstration reaches the fundamental limits of optical modulation: near-unity modulation depth, instantaneous speed (ultra-fast coherent interaction), compact footprint (atomic thickness), and unlimited operation bandwidth, which hold an ideal optical modulation solution for emerging and future nonlinear optical applications (e.g., interconnection, imaging, computing, and quantum technologies).