The advancement of automated driving technologies is fundamentally transforming the relationship between humans and vehicles, shifting from direct control to a more collaborative dynamic. Consequently, the design of in-vehicle Human-Machine Interfaces (iHMIs) is becoming increasingly intricate, focusing on aspects beyond mechanics and ergonomics towards enriched interaction and enhanced user experience. This shift has prompted research efforts to explore and advance iHMI concepts. Despite the iterative nature of design and its role in knowledge creation, our high-level understanding of the design processes utilised in iHMI development remains limited. To provide a comprehensive overview, this paper presents a scoping review of 324 papers (2013—2023) focused on the design underpinnings of iHMI development. Our review presents a categorisation of study goals and a detailed classification of five key stages within the design process. Based on these analyses, we discuss the influence of design and identify potential avenues for future research on iHMIs.
Human–Machine Interfaces (HMIs) for automated vehicles (AVs) are typically divided into two categories: internal HMIs for interactions within the vehicle, and external HMIs for communication with other road users. In this work, we examine the prospects of bridging these two seemingly distinct domains. Through a participatory workshop with automotive user interface researchers and practitioners, we facilitated a critical exploration of holistic HMI design by having workshop participants collaboratively develop interaction scenarios involving AVs, in-vehicle users, and external road users. The discussion offers insights into the escalation of interface elements as an HMI design strategy, the direct interactions between different users, and an expanded understanding of holistic HMI design. This work reflects a collaborative effort to understand the practical aspects of this holistic design approach, offering new perspectives and encouraging further investigation into this underexplored aspect of automotive user interfaces.
Human-machine interfaces (HMIs) are important for the introduction of automated vehicles (AVs). Even though interactions can involve multiple users and modes of transportation, current research and ideation for HMIs are often directed at only one road user group. This reductionist approach goes against the principles of design, which argue for a holistic understanding. To address this gap, we conducted a novel role-switching approach where participants explored a traffic scenario from four roles: pedestrian, cyclist, driver of a manually-driven vehicle and passenger of an AV. After experiencing all roles, participants evaluated each role and generated HMI designs. Results demonstrate that the roles were perceived differently and that switching between these different perspectives contributed to participants’ understanding of the traffic scenario and the generated designs. This paper reports insights on the value of a role-switching approach to promote the future development of a more holistic approach towards HMIs.
In contemporary automotive contexts, the growing substitution of physical buttons with digital screens has resulted in a diminished level of sensory feedback associated with physical forms and materials, and rich interaction. In response, this demonstration introduces shape-changing physical buttons that address this limitation. Building upon a material-oriented design exploration "Trycka", the buttons were created and seamlessly integrated into the leather fabric of the car interior. These buttons possess temporal forms that enable multi-sensory (haptic and visual) interactive feedforward and feedback. As the development of automated vehicles and intelligent systems progresses, these buttons serve as output compositions of the system, allowing expressivity in the interactions. By presenting experiential prototypes in this demonstration, we provide the automotive community an opportunity to engage with and explore tactile sensations. This paper presents the explorative process of shape-changing buttons and the implications for the automotive industry.
As automated vehicles advance towards higher levels of automation, users are increasingly engaged in non-driving related activities, diverting their attention from the road and the vehicle’s operations. Even in non-critical conditions where automated driving is routine and uninterrupted, users may experience automation surprise (AS) when they fail to anticipate the vehicle’s behaviour, potentially impacting their comfort and acceptance of automated vehicles. To explore AS in non-critical automated driving scenarios from an experiential perspective beyond safety considerations, we conducted a pilot study using a qualitative analysis approach, on-road probing and the think-aloud method. Initial findings indicate an expanded understanding of AS, which can arise in non-critical conditions, accompanied by cognitive and emotional responses. Future research aims to validate and refine the expanded definition through a more comprehensive study and inform the development of effective AS mitigation strategies to improve the general user experience.