Objective measurements of engagement are increasingly sought after by both the media industry and scholar communities to explain what drives people to consume audiovisual contents. However, engagement is a complex construct that, at the psychological level, has been mainly operationalised through indicators of attentional and emotional processes, often overlooking motivational factors. We claim that in the context of news consumption, motivation, operationalised as intrinsic interest for consuming a given content, needs to be factored in together with attentional and emotional processes. The present work provides an objective metric for motivation based on electroencephalographic (EEG) registration of users' neural activity, while they read sets of news pre-classified in terms of their potential interest. We focus on a metric that has been used as an indicator of the degree to which an item or event induces the motivation to approach or escape, the so called frontal alpha asymmetry (FAA). Moreover, in addition to the traditional approach to the analysis of EEG signals, we also introduce a more novel technique based on estimating the entropy of the signals. Results confirm that FAA is indeed a good proxy for objective monitoring of interest in media contents and that entropy analysis, although its interpretation in terms of information processing warrants further investigation, is also sensitive to the manipulation of interest, providing results that complement traditional power spectrum analysis.
Understanding the impact of a search system's response latency on its users' searching behaviour has been recently an active research topic in the information retrieval and human-computer interaction areas. Along the same line, this paper focuses on the user impact of search latency and makes the following two contributions. First, through a controlled experiment, we reveal the physiological effects of response latency on users and show that these effects are present even at small increases in response latency. We compare these effects with the information gathered from self-reports and show that they capture the nuanced attentional and emotional reactions to latency much better. Second, we carry out a large-scale analysis using a web search query log obtained from Yahoo to understand the change in the way users engage with a web search engine under varying levels of increasing response latency. In particular, we analyse the change in the click behaviour of users when they are subject to increasing response latency and reveal significant behavioural differences.
The mechanisms responsible for the integration of sensory information from different modalities have become a topic of intense interest in psychophysics and neuroscience. Many authors now claim that early, sensory-based cross-modal convergence improves performance in detection tasks. An important strand of supporting evidence for this claim is based on statistical models such as the Pythagorean model or the probabilistic summation model. These models establish statistical benchmarks representing the best predicted performance under the assumption that there are no interactions between the two sensory paths. Following this logic, when observed detection performances surpass the predictions of these models, it is often inferred that such improvement indicates cross-modal convergence. We present a theoretical analyses scrutinizing some of these models and the statistical criteria most frequently used to infer early cross-modal interactions during detection tasks. Our current analysis shows how some common misinterpretations of these models lead to their inadequate use and, in turn, to contradictory results and misleading conclusions. To further illustrate the latter point, we introduce a model that accounts for detection performances in multimodal detection tasks but for which surpassing of the Pythagorean or probabilistic summation benchmark can be explained without resorting to early cross-modal interactions. Finally, we report three experiments that put our theoretical interpretation to the test and further propose how to adequately measure multimodal interactions in audiotactile detection tasks.
This paper provides an overview of Human Machine Interface (HMI) design and command systems in commercial or experimental operation across transport modes. It presents and comments on different HMIs from the perspective of vehicle automation equipment and simulators of different application domains. Considering the fields of cognition and automation, this investigation highlights human factors and the experiences of different industries according to industrial and literature reviews. Moreover, to better focus the objectives and extend the investigated industrial panorama, the analysis covers the most effective simulators in operation across various transport modes for the training of operators as well as research in the fields of safety and ergonomics. Special focus is given to new technologies that are potentially applicable in future train cabins, e.g., visual displays and haptic-shared controls. Finally, a synthesis of human factors and their limits regarding support for monitoring or driving assistance is proposed.
Much of the research on stereoscopic 3D (S3D) QoE has dealt with the effects of image features over user's visual discomfort. Nevertheless, the relationships between visual discomfort and other high-level perceptual dimensions such as the viewers' emotional reactions have not been yet explored. Since emotions play a key role on media reception processes, and especially in entertainment contents consumption, this question deserves to be thoroughly addressed to improve the design of image processing techniques. This paper raises and investigates the possible relationship between image distortions and its impact on the emotion context of S3D. We implemented an experimental design in which participants watched a series of 3D contents with different levels of visual distortions supposed to induce visual discomfort, while self-reported and psychophysiological measures of emotions were recorded. Results showed that physiological correlates of emotions were affected by visual discomfort conditions, and that these measures were more sensitive than traditional self-reported measures.
This article aims to provide in-depth insight into how consumers perceive recycled materials in comparison with natural raw materials at both the perceptual and attitudinal levels. To this end, we combined classic self-reported measures of sensory aspects, preferences, environmental attitudes, and consumption habits together with physiological measures of cognitive–emotional processing. Three different materials—two recycled materials, M2 and M3, and one raw material, M1—were chosen for inspection through three different sensory conditions, which we refer to as channels —visual, tactile, and visuo-tactile. The assignation of materials to sensory channels was counterbalanced so that each participant evaluated only one of the materials per channel. Although participants in general were not very accurate in discriminating between the materials, self-reported sensory evaluations showed that M3 (a recycled material that is made to look non-recycled), was clearly less liked. Meanwhile, the psychophysiological analyses revealed higher levels of electrodermal activity for the tactile evaluations of both recycled materials (M2 and M3). Finally, the results from the attitudes and habits evaluations indicate that the participants had positive environmental attitudes yet poor consumption habits. Altogether, these results suggest that some sensorial properties differ between recycled materials and natural raw materials and that there is a chance to improve and implement new consumption habits. The implications of these results are further discussed both in terms of suggestions for designers and methodological recommendations for researchers.