29 July 2020 in British Journal of Educational Technology
Artificial intelligence tools for education (AIEd) have been used to automate the provision of learning support to mainstream learners. One of the most innovative approaches in this field is the use of data and machine learning for the detection of a student’s affective state, to move them out of negative states that inhibit learning, into positive states such as engagement. In spite of their obvious potential to provide the personalisation that would give extra support for learners with intellectual disabilities, little work on AIEd systems that utilise affect recognition currently addresses this group. Our system used multimodal sensor data and machine learning to first identify three affective states linked to learning (engagement, frustration, boredom) and second determine the presentation of learning content so that the learner is maintained in an optimal affective state and rate of learning is maximised. To evaluate this adaptive learning system, 67 participants aged between 6 and 18 years acting as their own control took part in a series of sessions using the system. Sessions alternated between using the system with both affect detection and learning achievement to drive the selection of learning content (intervention) and using learning achievement alone (control) to drive the selection of learning content. Lack of boredom was the state with the strongest link to achievement, with both frustration and engagement positively related to achievement. There was significantly more engagement and less boredom in intervention than control sessions, but no significant difference in achievement. These results suggest that engagement does increase when activities are tailored to the personal needs and emotional state of the learner and that the system was promoting affective states that in turn promote learning. However, longer exposure is necessary to determine the effect on learning.
17 October 2023 in Applied Ergonomics
Onboard virtual assistants with the ability to converse with users are gaining favour in supporting effective human-machine interaction to meet safe standards of operation in automated vehicles (AVs). Previous studies have highlighted the need to communicate situation information to effectively support the transfer of control and responsibility of the driving task. This study explores 'interaction types' used for this complex human-machine transaction, by analysing how situation information is conveyed and reciprocated during a transfer of control scenario. Two human drivers alternated control in a bespoke, dual controlled driving simulator with the transfer of control being entirely reliant on verbal communication. Handover dialogues were coded based on speech-act classifications, and a cluster analysis was conducted. Four interaction types were identified for both virtual assistants (i.e., agent handing over control) - Supervisor, Information Desk, Interrogator and Converser, and drivers (i.e., agent taking control) - Coordinator, Perceiver, Inquirer and Silent Receiver. Each interaction type provides a framework of characteristics that can be used to define driver requirements and implemented in the design of future virtual assistants to support the driver in maintaining and rebuilding timely situation awareness, whilst ensuring a positive user experience. This study also provides additional insight into the role of dialogue turns and takeover time and provides recommendations for future virtual assistant designs in AVs.
17 June 2019 in Journal of Enabling Technologies
Purpose: The purpose of this paper is to identify the main reasons for low uptake of robots in special education (SE), obtained from an analysis of previous studies that used robots in the area, and from interviewing SE teachers about the topic. Design/methodology/approach: An analysis of 18 studies that used robots in SE was performed, and the conclusions were complemented and compared with the feedback from interviewing 13 SE teachers from Spain and the UK about the reasons they believed caused the low uptake of robots in SE classrooms. Findings: Five main reasons why SE schools do not normally use robots in their classrooms were identified: the inability to acquire the system due to its price or availability; its difficulty of use; the low range of activities offered; the limited ways of interaction offered; and the inability to use different robots with the same software. Originality/value: Previous studies focussed on exploring the advantages of using robots to help children with autism spectrum conditions and learning disabilities. This study takes a step further and looks into the reasons why, despite the benefits shown, robots are rarely used in real-life settings after the relevant study ends. The authors also present a potential solution to the issues found: involving end users in the design and development of new systems using a user-centred design approach for all the components, including methods of interaction, learning activities and the most suitable type of robots.