Roberto Araya

Dr. Roberto Araya

Institute of Education, Universidad de Chile, Santiago, Región Metropolitana, Chile
orcid

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications

15 July 2019
Verified
Report
Open access
RARoberto Araya
Roberto Araya
EOElena Arias Ortiz
Elena Arias Ortiz
NBNicolas L. Bottan
Nicolas L. Bottan
JCJulian P. Cristia
Julian P. Cristia
Gamification, or the introduction of game elements to non-game contexts, has the potential to improve learning by increasing student motivation. However, there is little rigorous evidence about its effectiveness. In this paper, we experimentally evaluate an innovative technology program that uses gamification to increase math learning in low-performing primary schools in Chile. The ConectaIdeas program involves two weekly sessions in a computer lab during which students use an online platform to solve math exercises. The platform tracks how many exercises students perform and features different types of individual and group competitions to promote student motivation. Results indicate large positive effects on math learning of about 0.27 standard deviations on the Chilean national standardized exam (no effects were found on language). The program also affected several non-academic outcomes in both positive and negative ways. On the one hand, it increased students’ preference to use technology for math learning and promoted the idea among students that study effort can raise intelligence. On the other hand, the program increased math anxiety and reduced students’ preferences to collaborate in teams. These results suggest that gamification could be an important tool to boost student learning, but that it may bring unintended consequences.

1 September 2021 in Frontiers in Robotics and AI
Verified
Journal Article
Open access
RARoberto Araya
Roberto Araya
JSJorge Sossa-Rivera
Jorge Sossa-Rivera
Detecting the direction of the gaze and orientation of the body of both teacher and students is essential to estimate who is paying attention to whom. It also provides vital clues for understanding their unconscious, non-verbal behavior. These are called “honest signals” since they are unconscious subtle patterns in our interaction with other people that help reveal the focus of our attention. Inside the classroom, they provide important clues about teaching practices and students' responses to different conscious and unconscious teaching strategies. Scanning this non-verbal behavior in the classroom can provide important feedback to the teacher in order for them to improve their teaching practices. This type of analysis usually requires sophisticated eye-tracking equipment, motion sensors, or multiple cameras. However, for this to be a useful tool in the teacher's daily practice, an alternative must be found using only a smartphone. A smartphone is the only instrument that a teacher always has at their disposal and is nowadays considered truly ubiquitous. Our study looks at data from a group of first-grade classrooms. We show how video recordings on a teacher's smartphone can be used in order to estimate the direction of the teacher and students’ gaze, as well as their body orientation. Using the output from the OpenPose software, we run Machine Learning (ML) algorithms to train an estimator to recognize the direction of the students’ gaze and body orientation. We found that the level of accuracy achieved is comparable to that of human observers watching frames from the videos. The mean square errors (RMSE) of the predicted pitch and yaw angles for head and body directions are on average 11% lower than the RMSE between human annotators. However, our solution is much faster, avoids the tedium of doing it manually, and makes it possible to design solutions that give the teacher feedback as soon as they finish the class.

11 September 2020 in Education Sciences
Verified
Journal Article
Open access
PDF file
RARoberto Araya
Roberto Araya
KYKarina Diaz Yanez
Karina Diaz Yanez
The impact of online math programs depends on its implementation, especially in vulnerable populations from developing countries. An existing online platform was adapted, at the request of the Chilean Ministry of Education, to exclusively include exercises previously designed and tested by a paper-based government program for elementary school. We carried out a cluster-randomized controlled trial (RCT) with 50 fourth grade classrooms. Treatment classrooms used the platform in a weekly 90-min math session. Due to a social instability outbreak in the country, a large unexpected disruption with huge absenteeism occurred in the second half of the semester, which turned this study into a unique opportunity to explore the robustness of the platform’s effects on students’ learning. Using multiple imputation and multilevel models, we found a statistically significant effect size of 0.13, which corresponds to two extra months of learning. This effect is meaningful for four reasons. First, it has double the effect of the paper-based version. Second, it was achieved during one semester only. Third, is half that obtained with the platform for a complete year with its own set of exercises and with two sessions per week instead of one. Fourth, it was attained in a semester with a lot of absenteeism.

10 November 2023 in Journal of Educational Computing Research
Verified
Journal Article
Closed access
FUFelipe Ignacio Urrutia
Felipe Ignacio Urrutia
RARoberto Araya
Roberto Araya
Written answers to open-ended questions can have a higher long-term effect on learning than multiple-choice questions. However, it is critical that teachers immediately review the answers, and ask to redo those that are incoherent. This can be a difficult task and can be time-consuming for teachers. A possible solution is to automate the detection of incoherent answers. One option is to automate the review with Large Language Models (LLM). They have a powerful discursive ability that can be used to explain decisions. In this paper, we analyze the responses of fourth graders in mathematics using three LLMs: GPT-3, BLOOM, and YOU. We used them with zero, one, two, three and four shots. We compared their performance with the results of various classifiers trained with Machine Learning (ML). We found that LLMs perform worse than MLs in detecting incoherent answers. The difficulty seems to reside in recursive questions that contain both questions and answers, and in responses from students with typical fourth-grader misspellings. Upon closer examination, we have found that the ChatGPT model faces the same challenges.

2 September 2021 in International Journal for Lesson & Learning Studies
Verified
Journal Article
Closed access
MIMasami Isoda
Masami Isoda
SESoledad Estrella
Soledad Estrella
DZDiana Zakaryan
Diana Zakaryan
YBYuriko Baldin
Yuriko Baldin
RORaimundo Olfos
Raimundo Olfos
RARoberto Araya
Roberto Araya
Purpose: The purpose of this study was to examine the digital competence displayed by a primary school teacher who implemented an interdisciplinary cross-border lesson that was designed with the lesson study methodology and involved two countries: Brazil and Chile.Design/methodology/approach: A qualitative methodology was adopted via the case study method through which the case of a sixth-grade Chilean teacher participating in the study was documented. The data were collected through a lesson plan, a videotape of the implemented lesson and a questionnaire. A professional digital competence framework for teachers provided an analytical perspective via data analysis.Findings: The results show that the teacher displayed digital competence in a synchronous collaborative learning environment in which she had time to reflect on the educational value of technology and appropriate teaching methods involving information and communication technologies. Certain elements of the studied case contributed to this performance, namely the cross-border context, the classroom setting and the collaborative Lesson Study methodology.Practical implications: The lesson study methodology facilitated the teacher's performance in the “Pedagogy and didactics” digital competence by enabling her to participate in planning and implementing a lesson that allowed all those who collaborated, including teachers and researchers, to reflect on teaching in a digital learning environment.Social implications: The cross-border context, which involved co-designing and implementing a lesson in two countries, allowed the teacher to display her “School in society” and “Ethics” competencies. This was achieved through connecting two classrooms with different languages and cultures digitally and synchronously, thereby providing students the opportunity to debate and participate in a global and local problem such as a country's responsibility for energy consumption.Originality/value: Modern society requires the transformation of school practices, and new teaching approaches should include the provision of collaborative spaces that incorporate digital technologies. In this sense, this paper shows that cross-border lessons involving a synchronous learning environment offer a potential alternative, as digital teaching competence enables teachers to bring together different social and cultural groups virtually, thereby contributing to the reduction of social gaps and to the promotion of positive identity among less advantaged students.