Mulsemedia—multiple sensorial media—captures a wide variety of research efforts and applications. This article presents a historic perspective on mulsemedia work and reviews current developments in the area. These take place across the traditional multimedia spectrum—from virtual reality applications to computer games—as well as efforts in the arts, gastronomy, and therapy, to mention a few. We also describe standardization efforts, via the MPEG-V standard, and identify future developments and exciting challenges the community needs to overcome.
1 November 2006 in ACM Transactions on Multimedia Computing, Communications, and Applications
This article presents the results of a study that explored the human side of the multimedia experience. We propose a model that assesses quality variation from three distinct levels: the network, the media and the contentlevels; and from two views: the technical and the user perspective. By facilitating parameter variation at each of the quality levels and from each of the perspectives, we were able to examine their impact on user quality perception. Results show that a significant reduction in frame rate does not proportionally reduce the user's understanding of the presentation independent of technical parameters, that multimedia content type significantly impacts user information assimilation, user level of enjoyment, and user perception of quality, and that the device display type impacts user information assimilation and user perception of quality. Finally, to ensure the transfer of information, low-level abstraction (network-level) parameters, such as delay and jitter, should be adapted; to maintain the user's level of enjoyment, high-level abstraction quality parameters (content-level), such as the appropriate use of display screens, should be adapted.
In this paper we present the results of a study that examines the user's perception-understood as both information assimilation and subjective satisfaction-of multimedia quality, when impacted by varying network-level parameters (delay and jitter). In addition, we integrate eye-tracking assessment to provide a more complete understanding of user perception of multimedia quality. Results show that delay and jitter significantly affect user satisfaction; variation in video eye path when either no single/obvious point of focus exists or when the point of attention changes dramatically. Lastly, results showed that content variation significantly affected user satisfaction, as well as user information assimilation.
21 June 2004 in IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans
Perceptual multimedia quality is of paramount importance to the continued take-up and proliferation of multimedia applications; users will not use and pay for applications if they are perceived to be of low quality. While traditionally distributed multimedia quality has been characterized by quality-of-service (QoS) parameters, these neglect the user perspective of the issue of quality. In order to redress this shortcoming, we characterize the user multimedia perspective using the quality-of-perception (QoP) metric, which encompasses not only a user's satisfaction with the quality of a multimedia presentation, but also his/her ability to analyze, synthesize, and assimilate informational content of multimedia. In recognition of the fact that monitoring eye movements offers insights into visual perception, as well as the associated attention mechanisms and cognitive processes, this paper reports on the results of a study investigating the impact of differing multimedia presentation frame rates on user QoP and eye path data. Our results show that provision of higher frame rates, usually assumed to provide better multimedia presentation quality, do not significantly impact upon the median coordinate value of eye path data. Moreover, higher frame rates do not significantly increase the level of participant information assimilation, although they do significantly improve overall user enjoyment and quality perception of the multimedia content being shown.
1 November 2003 in Universal Access in the Information Society