Gebremariam Assres

Dr. Gebremariam Assres

Kristiania University College
orcid

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
18 June 2019 in ACM Computing Surveys
Verified
Journal Article
Open access
ESEstevao Bissoli Saleme
Estevao Bissoli Saleme
ACAlexandra Covaci
Alexandra Covaci
GMGebremariam Mesfin
Gebremariam Mesfin
Celso Alberto Saibel SantosCelso Alberto Saibel Santos
Celso Alberto Saibel Santos
Gheorghita GhineaGheorghita Ghinea
Gheorghita Ghinea
Multisensory experiences have been increasingly applied in Human-Computer Interaction (HCI). In recent years, it is commonplace to notice the development of haptic, olfactory, and even gustatory displays to create more immersive experiences. Companies are proposing new additions to the multisensory world and are unveiling new products that promise to offer amazing experiences exploiting mulsemedia—multiple sensorial media—where users can perceive odors, tastes, and the sensation of wind blowing against their face. Whilst researchers, practitioners and users alike are faced with a wide range of such new devices, relatively little work has been undertaken to summarize efforts and initiatives in this area. The current article addresses this shortcoming in two ways: first, by presenting a survey of devices targeting senses beyond that of sight and hearing and, second, by describing an approach to guide newcomers and experienced practitioners alike to build their own mulsemedia environment, both in a desktop setting and in an immersive 360° environment.

13 September 2019 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
Alexandra CovaciAlexandra Covaci
Alexandra Covaci
ESEstevao Bissoli Saleme
Estevao Bissoli Saleme
GMGebremariam Assres Mesfin
Gebremariam Assres Mesfin
NHNadia Hussain
Nadia Hussain
EKElahe Kani-Zabihi
Elahe Kani-Zabihi
Gheorghita GhineaGheorghita Ghinea
Gheorghita Ghinea
Sensory studies emerged as a significant influence upon Human Computer Interaction and traditional multimedia. Mulsemedia is an area that extends multimedia addressing issues of multisensorial response through the combination of at least three media, typically a non-traditional media with traditional audio-visual content. In this paper, we explore the concepts of Quality of Experience and crossmodal correspondences through a case study of different types of mulsemedia setups. The content is designed following principles of crossmodal correspondence between different sensory dimensions and delivered through olfactory, auditory and vibrotactile displays. The Quality of Experience is evaluated through both subjective (questionnaire) and objective means (eye gaze and heart rate). Results show that the auditory experience has an influence on the olfactory sensorial responses and lessens the perception of lingering odor. Heat maps of the eye gazes suggest that the crossmodality between olfactory and visual content leads to an increased visual attention on the factors of the employed crossmodal correspondence (e.g., color, brightness, shape).

30 October 2020 in IoT
Verified
Journal Article
Open access
PDF file
SKSindre Klavestad
Sindre Klavestad
GAGebremariam Assres
Gebremariam Assres
SFSiri Fagernes
Siri Fagernes
TGTor-Morten Groenli
Tor-Morten Groenli
In recent years, the ultra-wideband (UWB) radar technology has shown great potential in monitoring activities of daily living (ADLs) for smart homes. In this paper, we investigate the significance of using non-wearable UWB sensors for developing non-intrusive, unobtrusive, and privacy-preserving monitoring of elderly ADLs. A controlled experiment was setup, implementing multiple non-wearable sensors in a smart home Lab setting. A total of nine (n = 9) participants were involved in conducting predefined scenarios of ADLs- cooking, eating, resting, sleeping and mobility. We employed the UWB sensing prototype and conventional implementation technologies, and the sensed data of both systems were stored, analysed and their performances were compared. The result shows that the performance of the non-wearable UWB technology is as good as that of the conventional ones. Furthermore, we provided a proof-of-concept solution for the real-time detection of abnormal behaviour based on excessive activity levels, and a model for automatic alerts to caregivers for timely medical assistance on-demand.

6 May 2020 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
GMGebremariam Mesfin
Gebremariam Mesfin
ESEstevao Bissoli Saleme
Estevao Bissoli Saleme
OAOluwakemi A. Ademoye
Oluwakemi A. Ademoye
EKElahe Kani-Zabihi
Elahe Kani-Zabihi
CSCelso A.S. Santos
Celso A.S. Santos
Gheorghita GhineaGheorghita Ghinea
Gheorghita Ghinea
Using olfactory media to enhance traditional multimedia content opens up novel opportunities for user interactions. Whilst the influence of olfaction on user Quality of Experience (QoE) in mulsemedia (multiple sensorial media) environments has been previously studied, the impact of the fundamental dimensions of scent intensity and valence (pleasantness) have been largely unexplored. This is precisely what we target in this paper, which reports the results of an empirical investigation examining how scent intensity and valence impact mulsemedia QoE. Accordingly, 54 participants were exposed to different odor valences and scent intensity levels when viewing three short multimedia clips. In particular, we examine both subjective (self-reported) as well as objective QoE metrics, as evidenced by user heart rates and eye gaze patterns. Results show that whilst eye gaze patterns are largely unaffected by the experimental conditions, valence does have a statistically significant impact upon user heart rates, as does intensity for two of the three clips employed in our study. In terms of subjective QoE, results indicate that valence impacts on the sense of reality and enjoyment; however varying intensity levels do not seem to differentially impact on QoE, bringing into question the need for strong scent intensities.

31 May 2019 in ACM Transactions on Multimedia Computing, Communications, and Applications
Verified
Journal Article
Open access
GMGebremariam Mesfin
Gebremariam Mesfin
NHNadia Hussain
Nadia Hussain
ACAlexandra Covaci
Alexandra Covaci
Gheorghita GhineaGheorghita Ghinea
Gheorghita Ghinea
Different senses provide us with information of various levels of precision and enable us to construct a more precise representation of the world. Rich multisensory simulations are thus beneficial for comprehension, memory reinforcement, or retention of information. Crossmodal mappings refer to the systematic associations often made between different sensory modalities (e.g., high pitch is matched with angular shapes) and govern multisensory processing. A great deal of research effort has been put into exploring cross-modal correspondences in the field of cognitive science. However, the possibilities they open in the digital world have been relatively unexplored. Multiple sensorial media (mulsemedia) provides a highly immersive experience to the users and enhances their Quality of Experience (QoE) in the digital world. Thus, we consider that studying the plasticity and the effects of cross-modal correspondences in a mulsemedia setup can bring interesting insights about improving the human computer dialogue and experience. In our experiments, we exposed users to videos with certain visual dimensions (brightness, color, and shape), and we investigated whether the pairing with a cross-modal matching sound (high and low pitch) and the corresponding auto-generated vibrotactile effects (produced by a haptic vest) lead to an enhanced QoE. For this, we captured the eye gaze and the heart rate of users while experiencing mulsemedia, and we asked them to fill in a set of questions targeting their enjoyment and perception at the end of the experiment. Results showed differences in eye-gaze patterns and heart rate between the experimental and the control group, indicating changes in participants’ engagement when videos were accompanied by matching cross-modal sounds (this effect was the strongest for the video displaying angular shapes and high-pitch audio) and transitively generated cross-modal vibrotactile effects.

6 January 2022 in IEEE Transactions on Visualization and Computer Graphics
Verified
Journal Article
Closed access
Alexandra CovaciAlexandra Covaci
Alexandra Covaci
ESEstevao Bissoli Saleme
Estevao Bissoli Saleme
GMGebremariam Mesfin
Gebremariam Mesfin
ICIoan-Sorin Comşa
Ioan-Sorin Comşa
RTRamona Trestian
Ramona Trestian
Gheorghita GhineaGheorghita Ghinea
Gheorghita Ghinea
Omnidirectional videos have become a leading multimedia format for Virtual Reality applications. While live 360 videos offer a unique immersive experience, streaming of omnidirectional content at high resolutions is not always feasible in bandwidth-limited networks. While in the case of flat videos, scaling to lower resolutions works well, 360 video quality is seriously degraded because of the viewing distances involved in head-mounted displays. Hence, in this paper, we investigate first how quality degradation impacts the sense of presence in immersive Virtual Reality applications. Then, we are pushing the boundaries of 360 technology through the enhancement with multisensory stimuli. 48 participants experimented both 360 scenarios (with and without multisensory content), while they were divided randomly between four conditions characterised by different encoding qualities (HD, FullHD, 2.5K, 4K). The results showed that presence is not mediated by streaming at a higher bitrate. The trend we identified revealed however that presence is positively and significantly impacted by the enhancement with multisensory content. This shows that multisensory technology is crucial in creating more immersive experiences.