The introduction of robots in the real world requires previous evaluation of the envisaged performance. Factors like usability, user experience, social acceptance, or societal impact, among others, have been taken into account in evaluation frameworks defined during the last years. However, one of the most important factors that need to be evaluated in any kind of interaction is whether all the users are able to work with the system with the same opportunities and easiness, and none of the current human–robot interaction (HRI) evaluation frameworks include this factor yet. This article proposes an extension of a popular HRI evaluation framework, including accessibility as a new evaluation factor. The proposed approach, named AUSUS, considers Accessibility, Usability, Social acceptance, User experience, and Societal impact. This article presents a use case of the framework, which is evaluated through a socially assistive robotic platform created to perform comprehensive geriatric assessment: the CLARC system. The details of the evaluation process in a hospital and a retirement home are reported, and the main difficulties and recommendations of using AUSUS are discussed.
In this paper, we show that contrary to other AAL assistive technologies, which are somehow mandatory for an autonomous living at home, the use of social interaction services is not a necessity by itself, even if it contributes to a better quality of life. For this reason, the integration of the future end-users into the design process is all the more needed to get a continuous feedback and foster the usefulness and acceptability of the services. More generally, to ensure a higher acceptance and successful adoption of these AAL technologies, we claim that it is essential to adopt socio-technical approaches and methods, which take into account the needs of daily life and subtle aspects of the home into the design process. We therefore illustrate the Living Lab approach we have defined and applied within the framework of two projects from the second call of the AAL Joint Programme. These projects, FoSIBLE and PaeLife, aim at designing Information and Communication technologies to effectively enhance the social engagement of the elderly. We finally discuss how these insights can inform the design process
The use of new assistive technologies in general, and Socially Assistive Robots (SARs) in particular, is becoming increasingly common for supporting people’s health and well-being. However, it still faces many issues regarding long-term adherence, acceptability and utility. Most of these issues are due to design processes that insufficiently take into account the needs, preferences and values of intended users. Other issues are related to the currently very limited amount of long-term evaluations, performed in real-world settings, for SARs. This study presents the results of two regional projects that consider as a starting hypothesis that the assessment in controlled environments and/or with short exposures may not be enough in the design of an SAR deployed in a retirement home and the necessity of designing for and with users. Thus, the proposed methodology has focused on use-cases definitions that follow a human-centred and participatory design approach. The main goals have been facilitating system acceptance and attachment by involving stakeholders in the robots design and evaluation, overcoming usage barriers and considering user’s needs integration. The implementation of the first use-case deployed and the two-phase pilot test performed in a retirement home are presented. In particular, a detailed description of the interface redesign process based on improving a basic prototype with users’ feedback and recommendations is presented, together with the main results of a formal evaluation that has highlighted the impact of changes and improvements addressed in the first redesign loop of the system.
This paper describes the approach adopted and the insights produced as part of the evaluation process of a multimodal social application dedicated to elderly people. The aim of the platform is to facilitate and enhance social interaction of people aged 60+, allowing them to keep in touch in a useful and easy-to-use way. As these kind of social-oriented technologies are by no way mandatory for maintaining an independent living at home, in order to ensure that they are accepted, adopted and actually used by elderly people, three complementary and intertwined issues are at stake: usability, usefulness and acceptability. In this paper, we describe how these three issues have been examined through the user-centred and mixed methodological approach that was adopted. We demonstrate that using both user tests in controlled lab environment and field trials at participants’ homes has succeeded in producing relevant insights at each stage of the design process. We discuss how these insights have either allowed confirming the choices made, and thus proceed with development efficiently, or led to design ideas to improve the application.
Comprehensive geriatric assessment (CGA) is a multidimensional and multidisciplinary diagnostic instrument that helps provide personalized care to older adults by evaluating their state of health. This evaluation is based on extensive data collection in order to develop a coordinated plan to maximize overall health with aging. In the social and economic context of growing ageing populations, medical experts can save time and effort if provided with interactive tools to efficiently assist them in doing CGAs, managing either standardized tests or data collection. Recent research proposes the use of social robots as the central part of this optimization of clinicians’ time and effort. This paper presents the first and last steps of the research made around the design and evaluation of the CLARC robot: fieldwork (analysis of needs and practices concerning clinical data management) and field trials (pilot experiment in real-life conditions in a rehab hospital). Based on an extensive literature review of social robotics applications for health and ageing, it discusses the practical and methodological questions raised around how to design and test assistive social robots for clinical routine, and questions the feasibility of an automated CGA procedure.