Human–Machine Interfaces (HMIs) for automated vehicles (AVs) are typically divided into two categories: internal HMIs for interactions within the vehicle, and external HMIs for communication with other road users. In this work, we examine the prospects of bridging these two seemingly distinct domains. Through a participatory workshop with automotive user interface researchers and practitioners, we facilitated a critical exploration of holistic HMI design by having workshop participants collaboratively develop interaction scenarios involving AVs, in-vehicle users, and external road users. The discussion offers insights into the escalation of interface elements as an HMI design strategy, the direct interactions between different users, and an expanded understanding of holistic HMI design. This work reflects a collaborative effort to understand the practical aspects of this holistic design approach, offering new perspectives and encouraging further investigation into this underexplored aspect of automotive user interfaces.
As automated vehicles advance towards higher levels of automation, users are increasingly engaged in non-driving related activities, diverting their attention from the road and the vehicle’s operations. Even in non-critical conditions where automated driving is routine and uninterrupted, users may experience automation surprise (AS) when they fail to anticipate the vehicle’s behaviour, potentially impacting their comfort and acceptance of automated vehicles. To explore AS in non-critical automated driving scenarios from an experiential perspective beyond safety considerations, we conducted a pilot study using a qualitative analysis approach, on-road probing and the think-aloud method. Initial findings indicate an expanded understanding of AS, which can arise in non-critical conditions, accompanied by cognitive and emotional responses. Future research aims to validate and refine the expanded definition through a more comprehensive study and inform the development of effective AS mitigation strategies to improve the general user experience.
28 June 2026 in Behaviour & Information Technology