Micro-expressions (MEs) are rapid, involuntary facial expressions which reveal emotions that people do not intend to show. Studying MEs is valuable as recognizing them has many important applications, particularly in forensic science and psychotherapy. However, analyzing spontaneous MEs is very challenging due to their short duration and low intensity. Automatic ME analysis includes two tasks: ME spotting and ME recognition. For ME spotting, previous studies have focused on posed rather than spontaneous videos. For ME recognition, the performance of previous studies is low. To address these challenges, we make the following contributions: (i) We propose the first method for spotting spontaneous MEs in long videos (by exploiting feature difference contrast). This method is training free and works on arbitrary unseen videos. (ii) We present an advanced ME recognition framework, which outperforms previous work by a large margin on two challenging spontaneous ME databases (SMIC and CASMEII). (iii) We propose the first automatic ME analysis system (MESR), which can spot and recognize MEs from spontaneous video data. Finally, we show our method outperforms humans in the ME recognition task by a large margin, and achieves comparable performance to humans at the very challenging task of spotting and then recognizing spontaneous MEs.
Lasing at the nanometre scale promises strong light-matter interactions and ultrafast operation. Plasmonic resonances supported by metallic nanoparticles have extremely small mode volumes and high field enhancements, making them an ideal platform for studying nanoscale lasing. At visible frequencies, however, the applicability of plasmon resonances is limited due to strong ohmic and radiative losses. Intriguingly, plasmonic nanoparticle arrays support non-radiative dark modes that offer longer life-times but are inaccessible to far-field radiation. Here, we show lasing both in dark and bright modes of an array of silver nanoparticles combined with optically pumped dye molecules. Linewidths of 0.2 nm at visible wavelengths and room temperature are observed. Access to the dark modes is provided by a coherent out-coupling mechanism based on the finite size of the array. The results open a route to utilize all modes of plasmonic lattices, also the high-Q ones, for studies of strong light-matter interactions, condensation and photon fluids.
Spotting micro-expressions is a primary step for continuous emotion recognition from videos. Spotting in this context refers to automatically finding the temporal locations of the face-related events from a video sequence. Rapid facial movements mainly include micro-expressions and eye blinks. However, the role of eye blinks in expressing emotions is still controversial, and often they are considered as micro-expressions as well. In this paper a simple method for automatically spotting rapid facial movements from videos is proposed. The method relies on analyzing differences in appearance-based features of sequential frames. In addition to finding the temporal locations, the system is able to provide spatial information about the movements in the face. Micro-expression spotting experiments are carried out on three datasets consisting only of spontaneous micro-expressions. Baseline micro-expression spotting results are provided for these three datasets including the publicly available CASME database. Also an example of spatial localization of the spotted rapid movements is presented.
We present a beyond-mean-field approach to predict the nature of organic polariton lasing, accounting for all relevant photon modes in a planar microcavity. Starting from a microscopic picture, we show how lasing can switch between polaritonic states resonant with the maximal gain, and those at the bottom of the polariton dispersion. We show how the population of nonlasing modes can be found, and by using two-time correlations, we show how the photoluminescence spectrum (of both lasing and nonlasing modes) evolves with pumping and coupling strength, confirming recent experimental work on the origin of blueshift for polariton lasing.