Given the uncertainty surrounding how existing explainability methods for autonomous vehicles (AVs) meet the diverse needs of stakeholders, a thorough investigation is imperative to determine the contexts requiring explanations and suitable interaction strategies. A comprehensive review becomes crucial to assess the alignment of current approaches with varied interests and expectations within the AV ecosystem. This study presents a review to discuss the complexities associated with explanation generation and presentation to facilitate the development of more effective and inclusive explainable AV systems. Our investigation led to categorising existing literature into three primary topics: explanatory tasks, explanatory information and explanatory information communication. Drawing upon our insights, we have proposed a comprehensive roadmap for future research centred on (i) knowing the interlocutor, (ii) generating timely explanations, (ii) communicating human-friendly explanations and (iv) continuous learning. Our roadmap is underpinned by principles of responsible research and innovation, emphasising the significance of diverse explanation requirements. To effectively tackle the challenges associated with implementing explainable AV systems, we have delineated various research directions, including the development of privacy-preserving data integration, ethical frameworks, real-time analytics, human-centric interaction design and enhanced cross-disciplinary collaborations. By exploring these research directions, the study aims to guide the development and deployment of explainable AVs, informed by a holistic understanding of user needs, technological advancements, regulatory compliance and ethical considerations, thereby ensuring safer and more trustworthy autonomous driving experiences.
6 February 2024 in IEEE Transactions on Intelligent Vehicles
This literature survey explores the domain of remote driving of road vehicles within autonomous vehicles, focusing on challenges and state-of-the-art solutions related to driving feedback, latency, support control, as well as remote driving platform and real applications. The advancement towards Level-5 autonomy faces challenges, including sensor reliability and diverse scenario feasibility. Currently, remote driving is identified as vital for commercialization, however, it comes with challenges like low situational awareness, latency, and a lack of comprehensive feedback mechanisms. Solutions proposed include enhancing visual feedback, developing haptic feedback, employing prediction techniques, and use control methods to support driver. This paper reviews the existing literature on remote driving in these fields, revealing research gaps and areas for future studies. Additionally, this paper reviews the industry applications of remote driving and shows the state-of-art use cases.
External Human-Machine Interfaces (eHMIs) have been evaluated to facilitate interactions between Automated Vehicles (AVs) and pedestrians. Most eHMIs are, however, visual/ light-based solutions, and multi-modal eHMIs have received little attention to date. We ran an experimental video study (N = 29) to systematically understand the effect on pedestrian’s willingness to cross the road and user preferences of a light-based eHMI (light bar on the bumper) and two sound-based eHMIs (bell sound and droning sound), and combinations thereof. We found no objective change in pedestrians’ willingness to cross the road based on the nature of eHMI, although people expressed different subjective preferences for the different ways an eHMI may communicate, and sometimes even strong dislike for multi-modal eHMIs. This shows that the modality of the evaluated eHMI concepts had relatively little impact on their effectiveness. Consequently, this lays an important groundwork for accessibility considerations of future eHMIs, and points towards the insight that provisions can be made for taking user preferences into account without compromising effectiveness.
25 January 2024 in IEEE Transactions on Intelligent Transportation Systems
Driving feedback is an important factor that can affect the perceptions of remote drivers of the surrounding environment during teleoperation. This paper focuses on investigating the influence of motion-cueing, sound and vibration feedback on driving behaviour and experience. A prototype teleoperation station is developed with feedback from audio, vibration actuators, and motion cues. Using this prototype, the experiment is carried out in two scenarios: a low-speed disturbance scenario with 30 participants and a dynamic driving scenario with 22 participants. Objective and subjective assessment methods are used to evaluate driving behaviour and experience separately. The results indicate that the combination of motion-cueing, sound and vibration feedback provides the most favourable driving experience for the participants. Specifically, sound and vibration feedback enhance drivers’ sense of speed, while motion-cueing feedback helps in road surface sensing, leading to increased throttle reversal rate in the low-speed disturbance scenario. However, it is noteworthy that motion-cueing feedback does not significantly improve driving performance in the dynamic driving scenario of this study.
20 December 2023 in IEEE Transactions on Intelligent Vehicles
Remote driving plays an essential role in coordinating automated vehicles in some challenging situations. Due to the changed driving environment, the experiences and behaviors of remote drivers would undergo some changes compared to conventional drivers. To study this, a continuous real-life and remote driving experiment is conducted under different driving conditions. In addition, the effect of steering force feedback (SFF) on the driving experience is also investigated. In order to achieve this, three types of SFF modes are compared. According to the results, no SFF significantly worsens the driving experience in both remote and real-life driving. Additionally, less force and returnability on steering wheel are needed in remote driving, and the steering force amplitude appears to influence the steering velocity of remote drivers. Furthermore, there is an increase in lane following deviation during remote driving. Remote drivers are also prone to driving at lower speeds and have a higher steering reversal rate. They also give larger steering angle inputs when crossing the cones in a slalom manoeuvre and cause the car to experience larger lateral acceleration. These findings provide indications on how to design SFF and how driving behavior and experience change in remote driving.