Recently, in the commercial and entertainment sectors, we have seen increasing interest in incorporating chatbots into websites and apps, in order to assist customers and clients. In the academic area, chatbots are useful to provide some guidance and information about courses, admission processes and procedures, study programs, and scholarly services. However, these virtual assistants have limited mechanisms to suitably help the teaching and learning process, considering that these mechanisms should be advantageous for all the people involved. In this article, we design a model for developing a chatbot that serves as an extra-school tool to carry out academic and administrative tasks and facilitate communication between middle-school students and academic staff (e.g., teachers, social workers, psychologists, and pedagogues). Our approach is designed to help less tech-savvy people by offering them a familiar environment, using a conversational agent to ease and guide their interactions. The proposed model has been validated by implementing a multi-platform chatbot that provides both textual-based and voice-based communications and uses state-of-the-art technology. The chatbot has been tested with the help of students and teachers from a Mexican middle school, and the evaluation results show that our prototype obtained positive usability and user experience endorsements from such end-users.
Chatbots are artificial intelligence tools that interact with people in different contexts. A chatbot can be useful to streamline daily processes, serve customers 24 hours a day, provide information about classes, among other things. The appearance of new development technologies has made creating a chatbot an increasingly fast and straightforward process, bringing this kind of applications to people who had never considered using them before. However, this speed in development can lead to specific problems, many of them caused by the lack of usability evaluations. Heuristic usability evaluations are user interface review processes carried out by experts and are an essential part of any assessment process. To date, there are no heuristics to evaluate the usability of chatbots. Therefore, this work proposes five usability heuristics in chatbots that come from the experience developing this type of applications, as well as from a broad review of state of the art. The set of heuristics was tested using a case study with the help of five experts, who evaluated an education-oriented chatbot. The results revealed that, although the proposed heuristics need refinement, they are an excellent first step in broadening the horizon of usability evaluations in chatbots.
Today, social networks are crucial commodities that allow people to share different contents and opinions. In addition to participation, the information shared within social networks makes them attractive, but success is also accompanied by a positive User eXperience (UX). Social networks must offer useful and well-designed user-tools, i.e., sets of widgets that allow interaction among users. To satisfy this requirement, Episodic User eXperience (EUX) yields reactions of users after having interacted with an artifact. Anticipated User eXperience (AUX) grants the designers the capacity to recollect users’ aspirations, assumptions, and needs in the initial development phase of an artifact. In this work, we collect UX perceived in both periods to contrast user expectations and experiences offered on social networks, in order to find elements that could improve the design of user-tools. We arrange a test where participants () designed prototypes on paper to solve tasks and then did the same tasks on online social networks. Both stages are assessed with the help of AttrakDiff, and then we analyze the results through t-tests. The results we obtained suggest that users are inclined towards pragmatic aspects of their user-tools expectations.
Chatbots, text or voice software entities, are consolidating their position in the education sector, as they have gone from being rustic tools to systems that can take an active role in the teaching and learning process. That is why we decide to elaborate a Systematic Mapping Study of works that have been published on educational chatbots in the last years. Our analysis has four objectives: 1) to know the purpose of chatbots; 2) to identify the educational levels in which the chatbots are employed; 3) to examine which interaction mechanisms are implemented by chatbots; and 4) to explore which technologies and software architectures predominate in the development of educational chatbots. Following solid methodologies for systematic reviews, we compiled 104 papers. Through the analysis of these works, we obtained an overview that can be useful for both specialists and newcomers to the domain, as it helps them understand the existing trends in these applications. Additionally, the discussion extends into the disruptive impact of generative AI and outlines critical open research questions that guide future investigations in educational chatbot development.