“Interaction” represents a critical term in the augmented and mixed reality ecosystem. Today, in mixed reality environments and applications, interaction occupies the joint space between any combination of humans, physical environment, and computers. Although interaction methods and techniques have been extensively examined in recent decades in the field of human-computer interaction, they still should be reidentified in the context of immersive realities. The latest technological advancements in sensors, processing power and technologies, including the internet of things and the 5G GSM network, led to innovative and advanced input methods and enforced computer environmental perception. For example, ubiquitous sensors under a high-speed GSM network may enhance mobile users’ interactions with physical or virtual objects. As technological advancements emerge, researchers create umbrella terms to define their work, such as multimodal, tangible, and collaborative interactions. However, although they serve their purpose, various naming trends overlap in terminology, diverge in definitions, and lack modality and conceptual framework classifications. This paper presents a modality-based interaction-oriented diagram for researchers to position their work and defines taxonomy ground rules to expand and adjust this diagram when novel interaction approaches emerge.
This article presents the results of a survey on the use of digital avatars and agents in museums and places of cultural interest. The optimization of virtual agents in the cultural heritage domain is an interdisciplinary undertaking and this paper investigates pertinent research and solutions and suggests ways forward. The research questions examined relate to (a) the technological characteristics of cultural heritage-related uses of users’ avatars and virtual agents, and patterns that emerge, and (b) suggestions for future research based on this article’s findings. We reviewed relevant publications and analysed the approaches presented to identify trends and issues that could lead to conclusions on the existing state of the field and, moreover, infer and suggest future directions. The main findings relate to a trend toward onsite, sophisticated installations or applications with increasing investment in mixed reality. Moreover, emphasis shifts toward optimising agents such as virtual guides or companions, mediators of cultural content and engaging facilitators. Behavioural Realism (BR), featured mostly in virtual reality installations, greatly fosters engagement according to the reviewed research, and we conclude that mixed reality onsite applications, which are gathering pace, should reach their degree of sophistication and combine the strengths of both MR and BR.
Serious Games (SGs) have been widely adopted in cultural settings and museums, especially the last five years. It is expected that SG can link directly the museum content with target user groups and can fulfill their educational needs. This paper aims to present a systematic mapping study on modern museum gaming technologies and applications. More specifically, focus is given on the use of Serious Games (SGs) by the visitors during exhibition navigation and exploration of museum's cultural and educational content. Major analysis criteria and review findings include game goals, purpose of use, scope, user acceptance and educational effectiveness. A pool of 48 quality literature publications were set under examination. It was found that most solutions were game-based than play-based and that both genres had educational benefits on offer. Also, the frequency of relevant publications per year was increasing from year 2009 up to 2015. Regarding scope, studied applications were split almost equally among education, culture and arts, while the overwhelming majority were targeted to the general public and not teachers, students or parents specifically. Those findings are of particular importance for museum curators, digital cultural content creators, pedagogical engineers and museum interface designers.
10 February 2020 in Personal and Ubiquitous Computing