Adrian Santos

Adrian Santos

Auto-generated profile, based on publicly available information

Adrian Santos

University of Oulu, Oulu, Finland

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2020 in Information and Software Technology
Verified
Journal Article
Closed access
JFJuan M. Ferreira
Juan M. Ferreira
SASilvia T. Acuña
Silvia T. Acuña
ODOscar Dieste
Oscar Dieste
SVSira Vegas
Sira Vegas
ASAdrián Santos
Adrián Santos
NJNatalia Juristo
Natalia Juristo

9 August 2018 in IEEE Transactions on Software Engineering
Verified
Journal Article
Closed access
ASAdrian Santos
Adrian Santos
OGOmar S. Gómez
Omar S. Gómez
NJNatalia Juristo
Natalia Juristo
Context: Families of experiments (i.e., groups of experiments with the same goal) are on the rise in Software Engineering (SE). Selecting unsuitable aggregation techniques to analyze families may undermine their potential to provide in-depth insights from experiments' results.

23 March 2021 in Empirical Software Engineering
Verified
Journal Article
Closed access
PDF file
ASAdrian Santos
Adrian Santos
SVSira Vegas
Sira Vegas
ODOscar Dieste
Oscar Dieste
FUFernando Uyaguari
Fernando Uyaguari
ATAyşe Tosun
Ayşe Tosun
NJNatalia Juristo
Natalia Juristo

1 January 2019 in IEEE Transactions on Software Engineering
Verified
Journal Article
Closed access
ASAdrian Santos
Adrian Santos
SVSira Vegas
Sira Vegas
MOMarkku Oivo
Markku Oivo
NJNatalia Juristo
Natalia Juristo
Context: Researchers from different groups and institutions are collaborating on building groups of experiments by means of replication (i.e., conducting groups of replications). Disparate aggregation techniques are being applied to analyze groups of replications. The application of unsuitable techniques to aggregate replication results may undermine the potential of groups of replications to provide in-depth insights from experiment results. Objectives: Provide an analysis procedure with a set of embedded guidelines to aggregate software engineering (SE) replication results. Method: We compare the characteristics of groups of replications for SE and other mature experimental disciplines such as medicine and pharmacology. In view of their differences, the limitations with regard to the joint data analysis of groups of SE replications and the guidelines provided in mature experimental disciplines to analyze groups of replications, we build an analysis procedure with a set of embedded guidelines specifically tailored to the analysis of groups of SE replications. We apply the proposed analysis procedure to a representative group of SE replications to illustrate its use. Results: All the information contained within the raw data should be leveraged during the aggregation of replication results. The analysis procedure that we propose encourages the use of stratified individual participant data and aggregated data in tandem to analyze groups of SE replications. Conclusion: The aggregation techniques used to analyze groups of replications should be justified in research articles. This will increase the reliability and transparency of joint results. The proposed guidelines should ease this endeavor.

2 February 2021 in Empirical Software Engineering
Verified
Journal Article
Closed access
PDF file
ASAdrian Santos
Adrian Santos
SVSira Vegas
Sira Vegas
MOMarkku Oivo
Markku Oivo
NJNatalia Juristo
Natalia Juristo

14 February 2022 in IEEE Transactions on Software Engineering
Verified
Journal Article
Open access
RRRanci Ren
Ranci Ren
John Wilmar CastroJohn Wilmar Castro
John Wilmar Castro
ASAdrian Santos
Adrian Santos
ODOscar Dieste
Oscar Dieste
Silvia Teresita Acuña CastilloSilvia Teresita Acuña Castillo
Silvia Teresita Acuña Castillo
Context: Recent developments in natural language processing have facilitated the adoption of chatbots in typically collaborative software engineering tasks (such as diagram modelling). Families of experiments can assess the performance of tools and processes and, at the same time, alleviate some of the typical shortcomings of individual experiments (e.g., inaccurate and potentially biased results due to a small number of participants). Objective: Compare the usability of a chatbot for collaborative modelling (i.e., SOCIO) and an online web tool (i.e., Creately). Method: We conduct a family of three experiments to evaluate the usability of SOCIO against the Creately online collaborative tool in academic settings. Results: The student participants were faster at building class diagrams using the chatbot than with the online collaborative tool and more satisfied with SOCIO. Besides, the class diagrams built using the chatbot tended to be more concise albeit slightly less complete. Conclusion: Chatbots appear to be helpful for building class diagrams. In fact, our study has helped us to shed light on the future direction for experimentation in this field and lays the groundwork for researching the applicability of chatbots in diagramming.