Augmented Reality (AR) is a pillar of the transition to Industry 4.0 and smart manufacturing. It can facilitate training, maintenance, assembly, quality control, remote collaboration and other tasks. AR has the potential to revolutionize the way information is accessed, used and exchanged, extending user’s perception and improving their performance. This work proposes a Pervasive AR tool, created with partners from the industry sector, to support the training of logistics operators on industrial shop floors. A Human-Centered Design (HCD) methodology was used to identify operators difficulties, challenges, and define requirements. After initial meetings with stakeholders, two distinct methods were considered to configure and visualize AR content on the shop floor: Head-Mounted Display (HMD) and Handheld Device (HHD). A first (preliminary) user study with 26 participants was conducted to collect qualitative data regarding the use of AR in logistics, from individuals with different levels of expertise. The feedback obtained was used to improve the proposed AR application. A second user study was realized, in which 10 participants used different conditions to fulfill distinct logistics tasks: C1 — paper; C2 — HMD; C3 — HHD. Results emphasize the potential of Pervasive AR in the operators’ workspace, in particular for training of operators not familiar with the tasks. Condition C2 was preferred by all participants and considered more useful and efficient in supporting the operators activities on the shop floor.

Over time, numerous multimodal eXtended Reality (XR) user studies have been conducted in laboratory environments, with participants fulfilling tasks under the guidance of a researcher. Although generalizable results contributed to increase the maturity of the field, it is also paramount to address the ecological validity of evaluations outside the laboratory. Despite real-world scenarios being clearly challenging, successful in-situ and remote deployment has become realistic to address a broad variety of research questions, thus, expanding participants’ sample to more specific target users, considering multi-modal constraints not reflected in controlled laboratory settings and other benefits. In this paper, a set of multimodal XR experiments conducted outside the laboratory are described (e.g., industrial field studies, remote collaborative tasks, longitudinal rehabilitation exercises). Then, a list of lessons learned is reported, illustrating challenges, and opportunities, aiming to increase the level of awareness of the research community and facilitate performing further evaluations.

Pervasive Augmented Reality (AR) has been explored to provide experiences that are continuous in space and time, while incorporating layers of contextual information. While most research efforts have been devoted to explore serious games, museums and smart environments, we argue that another interesting area of application is assistive production, in particular training novel workers by displaying instructions throughout the shop floor on what to do. This work describes a user study with 12 participants, aimed at comparing the use of three distinct conditions: C1 - Head-Mounted Display (HMD), C2 - Handheld Device (HHD) and C3 - Paper manual during a set of realistic training tasks, selected based on a collaboration with partners from the industry sector. Results suggest condition C1 was preferred by the majority of participants, being considered more useful to support the worker’s task as it is seems more efficient, hands-free and has a better tracking technology.

This work proposes an augmented reality serious game (ARSG) for supporting individuals with motor disabilities while controlling robotic wheelchairs. A racing track was used as the game narrative; this included restriction areas, static and dynamic virtual objects, as well as obstacles and signs. To experience the game, a prior configuration of the environment, made through a smartphone or a computer, was required. Furthermore, a visualization tool was developed to exhibit user performance while using the ARSG. Two user studies were conducted with 10 and 20 participants, respectively, to compare (1) how different devices enable configuring the ARSG, and (2) different tracking capabilities, i.e., methods used to place virtual content on the real-world environment while the user interacts with the game and controls the wheelchair in the physical space: C1—motion tracking using cloud anchors; C2—offline motion tracking. Results suggest that configuring the environment with the computer is more efficient and accurate, in contrast to the smartphone, which is characterized as more engaging. In addition, condition C1 stood out as more accurate and robust, while condition C2 appeared to be easier to use.

The use of Pervasive Augmented Reality (AR) in industrial settings, particularly in the context of Industry 4.0, is a growing area of research. Industry 4.0 is characterized by the integration of advanced technologies, including AR, to enable smart, connected, and autonomous systems in manufacturing and other industries. This study focuses on two systems that use Pervasive AR for logistics and data monitoring on assembly lines. Such systems were designed using cooperative Human-Centered Design (HCD) methodologies in collaboration with partners from the industry sector. We report lessons learned and guidelines on the development of AR systems for industrial environments. In addition, a user study based on a data monitoring laboratory realistic procedure with 8 participants is described. The study compares the usability and effectiveness of a dashboard on Pervasive AR and a web tablet. Overall, results emphasize that AR was better suited when requiring spatial awareness and interventions, while traditional web tablet was better for tasks that require more interaction with the content and faster data monitoring. These findings had implications for the design of industrial tools, such as prototype improvements and idealize new methods, which can guide future efforts to develop and deploy AR applications.