Social robotics is an emerging area that is becoming present in social spaces, by introducing autonomous social robots. Social robots offer services, perform tasks, and interact with people in such social environments, demanding more efficient and complex Human–Robot Interaction (HRI) designs. A strategy to improve HRI is to provide robots with the capacity of detecting the emotions of the people around them to plan a trajectory, modify their behaviour, and generate an appropriate interaction with people based on the analysed information. However, in social environments in which it is common to find a group of persons, new approaches are needed in order to make robots able to recognise groups of people and the emotion of the groups, which can be also associated with a scene in which the group is participating. Some existing studies are focused on detecting group cohesion and the recognition of group emotions; nevertheless, these works do not focus on performing the recognition tasks from a robocentric perspective, considering the sensory capacity of robots. In this context, a system to recognise scenes in terms of groups of people, to then detect global (prevailing) emotions in a scene, is presented. The approach proposed to visualise and recognise emotions in typical HRI is based on the face size of people recognised by the robot during its navigation (face sizes decrease when the robot moves away from a group of people). On each frame of the video stream of the visual sensor, individual emotions are recognised based on the Visual Geometry Group (VGG) neural network pre-trained to recognise faces (VGGFace); then, to detect the emotion of the frame, individual emotions are aggregated with a fusion method, and consequently, to detect global (prevalent) emotion in the scene (group of people), the emotions of its constituent frames are also aggregated. Additionally, this work proposes a strategy to create datasets with images/videos in order to validate the estimation of emotions in scenes and personal emotions. Both datasets are generated in a simulated environment based on the Robot Operating System (ROS) from videos captured by robots through their sensory capabilities. Tests are performed in two simulated environments in ROS/Gazebo: a museum and a cafeteria. Results show that the accuracy in the detection of individual emotions is 99.79% and the detection of group emotion (scene emotion) in each frame is 90.84% and 89.78% in the cafeteria and the museum scenarios, respectively.
This project aims to develop an interactive control system for an autonomous service robot using an ROS (robot operating system). The system integrates an intuitive web interface and an interactive chatbot supported by Google Gemini to enhance the control experience and personalization for the user. The methodology includes the integration of an API (application programming interface) to access a database storing user preferences, such as speed and frequent destinations. Furthermore, the system employs facial recognition, people groups’ recognition, and adaptive responses from the chatbot for autonomous navigation, ensuring a service tailored to the individual needs of each user. To validate the proposal, it was implemented on an autonomous service robot, integrated into a motorized wheelchair. Tests demonstrated that the system effectively adjusts the wheelchair’s behavior to user preferences, resulting in safer and more personalized navigation. The use of facial recognition and chatbot interaction provided more intuitive and efficient control. The developed system significantly improves the autonomy and quality of life for wheelchair users, proving to be a viable and efficient solution for autonomous and personalized control. The results indicate that integrating technologies like ROS, intuitive web interfaces, and interactive chatbots can transform the user experience of autonomous wheelchairs, better meeting the specific needs of users.
Currently the navigation involves the interaction of the robot with its environment, this means that the robot has to find the position of obstacles (natural brands and artificial) with respect to its plane. Its environment is time-variant and computer vision can help it to localization and people detection in real time. This article focuses on the detection and localization of people with respect to plane of the robot during the navigation of autonomous robot, for people detection is used Morphological HOG Face Detection algorithm in real-time, where our goal is to localization people in the plane of the robot, obtaining position information relative to the X-Axis (left, right, obstacle) and with the Y-Axis (near, medium, far) with respect robot, to identify the environment in that it's located in the robot is applied the vanishing point detection. Experiments show that people detection and localization is better in the medium region (201 to 600 cm) obtaining 93.13% of accuracy, this allows the robot has enough time to evade the obstacle during navigation, the navigation getting 97.03% of accuracy for the vanishing point detection.
Many authors have been working on approaches that can be applied to social robots to allow a more realistic/comfortable relationship between humans and robots in the same space. This paper proposes a new navigation strategy for social environments by recognizing and considering the social conventions of people and groups. To achieve that, we proposed the application of Delaunay triangulation for connecting people as vertices of a triangle network. Then, we defined a complete asymmetric Gaussian function (for individuals and groups) to decide zones where the robot must avoid passing. Furthermore, a feature generalization scheme called socialization feature was proposed to incorporate perception information that can be used to change the variance of the Gaussian function. Simulation results have been presented to demonstrate that the proposed approach can modify the path according to the perception of the robot compared to a standard A* algorithm.
The Content-based image retrieval (CBIR) systems and their application in different areas of development, are current research topics, for that reason in this study content-based image retrieval is applied to classificate eight different human parasite eggs: Ascarias, Uncinarias, Trichuris, Dyphillobothrium-Pacificum, Taenia-Solium, Fasciola Hepática and Enterobius-Vermicularis, which are into the class of Helminthes, from their microscopic images. This proposed system includes two stages. In first stage, a feature extraction mechanism that is based on multitexton histogram descriptor (MTH) which has been improved and called `Enhanced MTH'. In second stage, an CBIR system has been implemented in orden to classificate the differents microscopic images to identify their correct species. Finally, simulation result shows overall success rates of 92,16% in the classification.