John Wilmar Castro

Dr. John Wilmar Castro

Universidad de Atacama

Research Focus & Metrics

Academic Career Length

19Years (2008-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 December 2012 in Information and Software Technology
Verified
Journal Article
Closed access
Silvia Teresita Acuña CastilloSilvia Teresita Acuña Castillo
Silvia Teresita Acuña Castillo
John Wilmar CastroJohn Wilmar Castro
John Wilmar Castro
NJNatalia Juristo
Natalia Juristo

20 January 2022 in IEEE Access
Verified
Journal Article
Open access
RRRanci Ren
Ranci Ren
Mireya ZapataMireya Zapata
Mireya Zapata
John Wilmar CastroJohn Wilmar Castro
John Wilmar Castro
ODOscar Dieste
Oscar Dieste
Silvia Teresita Acuña CastilloSilvia Teresita Acuña Castillo
Silvia Teresita Acuña Castillo
Interest in chatbot development is on the rise. As a usability evaluation is an essential step in chatbot development, the number of experimental studies on chatbot usability has grown as well. As a result, we think a systematic mapping study is opportune. We analyzed more than 700 sources and retrieved 28 primary studies. By aggregating the research questions and examining the characteristics and metrics used to evaluate the usability of chatbots in experiments, it is possible to identify the state of the art in chatbot usability experimentation. We conducted a systematic mapping study to identify the research questions, characteristics, and metrics used to evaluate the usability of chatbots in experiments. Most experiments adopted a within-subjects design. On the other hand, few experiments provided raw data, and only one of the identified papers was part of a family of experiments. Effectiveness, efficiency, and satisfaction are usability characteristics used to identify how well users can learn and use chatbots to achieve their goals and how satisfied users are during the interaction. Generally, the experimental results revealed that chatbots have several advantages (e.g., they provide a real-time response and they improve ease of use) and some shortcomings (e.g., natural language processing, which is rated as the weakness most in need of improvement). This research offers an overview of chatbot usability experimentation. The increasing interest in this area is very recent, as works did not start to be published until 2018. Chatbot usability experiments should be more replicable to improve the reliability and transparency of the experimental results.

20 September 2021 in Sensors
Verified
Journal Article
Open access
PDF file
Patricia LosanaPatricia Losana
Patricia Losana
John Wilmar CastroJohn Wilmar Castro
John Wilmar Castro
XFXavier Ferre
Xavier Ferre
Elena Villalba MoraElena Villalba Mora
Elena Villalba Mora
Silvia Teresita Acuña CastilloSilvia Teresita Acuña Castillo
Silvia Teresita Acuña Castillo
Agile development processes are increasing their consideration of usability by integrating various user-centered design techniques throughout development. One such technique is Personas, which proposes the creation of fictitious users with real preferences to drive application design. Since applying this technique conflicts with the time constraints of agile development, Personas has been adapted over the years. Our objective is to determine the adoption level and type of integration, as well as to propose improvements to the Personas technique for agile development. A systematic mapping study was performed, retrieving 28 articles grouped by agile methodology type. We found some common integration strategies regardless of the specific agile approach, along with some frequent problems, mainly related to Persona modelling and context representation. Based on these limitations, we propose an adaptation to the technique in order to reduce the creation time for a preliminary persona. The number of publications dealing with Personas and agile development is increasing, which reveals a growing interest in the application of this technique to develop usable agile software.

1 March 2019 in Information and Software Technology
Verified
Journal Article
Closed access
LLLucrecia Llerena
Lucrecia Llerena
NGNancy Magali Rodriguez Gavilanes
Nancy Magali Rodriguez Gavilanes
John Wilmar CastroJohn Wilmar Castro
John Wilmar Castro
SASilvia T. Acuña
Silvia T. Acuña

1 October 2008
Verified
Conference Paper
Closed access
John Wilmar CastroJohn Wilmar Castro
John Wilmar Castro
Silvia Teresita Acuña CastilloSilvia Teresita Acuña Castillo
Silvia Teresita Acuña Castillo
NJNatalia Juristo
Natalia Juristo
To develop usable systems, it is necessary to understand the users that interact with the system. The personas technique from the human-computer interaction discipline (HCI) gathers data about users, gains an understanding of their characteristics, defines fictitious personas based on this understanding and focuses on these personas throughout the software development process. The aim of our research is to build personas into routine software development following software engineering (SE) guidelines. The intention is to improve the usability of the resulting software. To achieve this aim, we first present a modification of the personas technique, called Personas*. This new technique complies with SE systematization standards. Second, we incorporate the proposed Personas* technique into the software process requirements analysis activity. The benefits to be gained from the Personas* technique are: i) it provides an understanding of the user, which SE traditionally has tended to overlook, and ii) it enriches the requirements analysis activities enabling the software engineer to focus on the people involved in software system use.

14 February 2022 in IEEE Transactions on Software Engineering
Verified
Journal Article
Open access
RRRanci Ren
Ranci Ren
John Wilmar CastroJohn Wilmar Castro
John Wilmar Castro
ASAdrian Santos
Adrian Santos
ODOscar Dieste
Oscar Dieste
Silvia Teresita Acuña CastilloSilvia Teresita Acuña Castillo
Silvia Teresita Acuña Castillo
Context: Recent developments in natural language processing have facilitated the adoption of chatbots in typically collaborative software engineering tasks (such as diagram modelling). Families of experiments can assess the performance of tools and processes and, at the same time, alleviate some of the typical shortcomings of individual experiments (e.g., inaccurate and potentially biased results due to a small number of participants). Objective: Compare the usability of a chatbot for collaborative modelling (i.e., SOCIO) and an online web tool (i.e., Creately). Method: We conduct a family of three experiments to evaluate the usability of SOCIO against the Creately online collaborative tool in academic settings. Results: The student participants were faster at building class diagrams using the chatbot than with the online collaborative tool and more satisfied with SOCIO. Besides, the class diagrams built using the chatbot tended to be more concise albeit slightly less complete. Conclusion: Chatbots appear to be helpful for building class diagrams. In fact, our study has helped us to shed light on the future direction for experimentation in this field and lays the groundwork for researching the applicability of chatbots in diagramming.