Adalbert Gerald Soosai Raj

Adalbert Gerald Soosai Raj

Auto-generated profile, based on publicly available information

Adalbert Gerald Soosai Raj

University of California San Diego, La Jolla, CA, USA

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
7 March 2024
Verified
Conference Paper
Open access
MJMollie Jordan
Mollie Jordan
KLKevin Ly
Kevin Ly
ARAdalbert Gerald Soosai Raj
Adalbert Gerald Soosai Raj
Large language models (LLMs) like ChatGPT are changing computing education and may create additional barriers to those already faced by non-native English speakers (NNES) learning computing. We investigate an opportunity for a positive impact of LLMs on NNES through multilingual programming exercise generation. Following previous work with LLM exercise generation in English, we prompt OpenAI GPT-3.5 in 4 natural languages (English, Tamil, Spanish, and Vietnamese) to create introductory programming problems, sample solutions, and test cases. We evaluate these problems on their sensibility, readability, translation, sample solution accuracy, topicality, and cultural relevance. We find that problems generated in English, Spanish, and Vietnamese are largely sensible, easily understood, and accurate in their sample solutions. However, Tamil problems are mostly non-sensible and have a much lower passing test rate, indicating that the abilities of LLMs for problem generation are not generalizable across languages. Our analysis suggests that these problems could not be given verbatim to students, but with minimal effort, most errors can be fixed. We further discuss the benefits of these problems despite their flaws, and their opportunities to provide personalized and culturally relevant resources for students in their native languages.

12 February 2025
Verified
Conference Paper
Open access
ASAnshul Shah
Anshul Shah
ACAnya Chernova
Anya Chernova
ETElena Tomson
Elena Tomson
LPLeo Porter
Leo Porter
WGWilliam G. Griswold
William G. Griswold
ARAdalbert Gerald Soosai Raj
Adalbert Gerald Soosai Raj
Large language models (LLMs) are already heavily used by professional software engineers. An important skill for new university graduates to possess will be the ability to use such LLMs to effectively navigate and modify a large code base. While much of the prior work related to LLMs in computing education focuses on novice programmers learning to code, less work has focused on how upper-division students use and trust these tools, especially while working with large code bases. In this study, we taught students about various GitHub Copilot features, including Copilot chat, in an upper-division software engineering course and asked students to add a feature to a large code base using Copilot. Our analysis revealed a novel interaction pattern that we call one-shot prompting, in which students ask Copilot to implement the entire feature at once and spend the next few prompts asking Copilot to debug the code or asking Copilot to regenerate its incorrect response. Finally, students reported significantly more trust in the code comprehension features than code generation features of Copilot, perhaps due to the presence of trust affordances in the Copilot chat that are absent in the code generation features. Our study takes the first steps in understanding how upper-division students use Github Copilot so that our instruction can adequately prepare students for a career in software engineering.

7 March 2024
Verified
Conference Paper
Open access
YSYiyin Shen
Yiyin Shen
XAXinyi Ai
Xinyi Ai
ARAdalbert Gerald Soosai Raj
Adalbert Gerald Soosai Raj
RJRogers Jeffrey Leo John
Rogers Jeffrey Leo John
MSMeenakshi Syamkumar
Meenakshi Syamkumar
ChatGPT is a conversational AI platform that can produce code to solve problems when provided with a natural language prompt. Prior work on similar AI models has shown that they perform well on typical intro-level Computer Science problems. However, little is known about the performance of such tools on Data Science (DS) problems. In this work, we assess the performance of ChatGPT on assignments from three DS courses with varying difficulty levels. First, we apply the raw assignment prompts provided to the students and find that ChatGPT performs well on assignments with dataset(s) descriptions and progressive question prompts, which divide the programming requirements into sub-problems. Then, we perform prompt engineering on the assignments for which ChatGPT had low performance. We find that the following prompt engineering techniques significantly increased ChatGPT's performance: breaking down abstract questions into steps, breaking down steps into multiple prompts, providing descriptions of the dataset(s), including algorithmic details, adding specific instructions to entice specific actions, and removing extraneous information. Finally, we discuss how our findings suggest potential changes to curriculum design of DS courses.

7 August 2023
Verified
Conference Paper
Open access
ASAnshul Shah
Anshul Shah
EHEmma Hogan
Emma Hogan
VAVardhan Agarwal
Vardhan Agarwal
JDJohn Driscoll
John Driscoll
LPLeo Porter
Leo Porter
ARAdalbert Gerald Soosai Raj
Adalbert Gerald Soosai Raj

2 March 2023
Verified
Conference Paper
Open access
EHEmma Hogan
Emma Hogan
RLRuoxuan Li
Ruoxuan Li
ARAdalbert Gerald Soosai Raj
Adalbert Gerald Soosai Raj

9 February 2026
Verified
Conference Paper
Open access
FGFrancis Geng
Francis Geng
ASAnshul Shah
Anshul Shah
HLHaolin Li
Haolin Li
NMNawab Mulla
Nawab Mulla
SSSteve Swanson
Steve Swanson
LPLeo Porter
Leo Porter