Thezyrie Amarouche

Thezyrie Amarouche

Auto-generated profile, based on publicly available information

Thezyrie Amarouche

University of Toronto Scarborough, Toronto, ON, Canada

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
7 March 2024
Verified
Conference Paper
Open access
PDPaul Denny
Paul Denny
JLJuho Leinonen
Juho Leinonen
JPJames Prather
James Prather
ALAndrew Luxton-Reilly
Andrew Luxton-Reilly
TAThezyrie Amarouche
Thezyrie Amarouche
BRBrent N. Reeves
Brent N. Reeves

12 February 2025
Verified
Conference Paper
Open access
JPJames Prather
James Prather
BRBrent N Reeves
Brent N Reeves
PDPaul Denny
Paul Denny
JLJuho Leinonen
Juho Leinonen
Stephen Michael MacNeilStephen Michael MacNeil
Stephen Michael MacNeil
GBGweneth Barbre
Gweneth Barbre

31 July 2023 in arXiv
Verified
Preprint
Open access
PDF file
PDPaul Denny
Paul Denny
JLJuho Leinonen
Juho Leinonen
JPJames Prather
James Prather
ALAndrew Luxton-Reilly
Andrew Luxton-Reilly
TAThezyrie Amarouche
Thezyrie Amarouche
BRBrent N. Reeves
Brent N. Reeves
With their remarkable ability to generate code, large language models (LLMs) are a transformative technology for computing education practice. They have created an urgent need for educators to rethink pedagogical approaches and teaching strategies for newly emerging skill sets. Traditional approaches to learning programming have focused on frequent and repeated practice at writing code. The ease with which code can now be generated has resulted in a shift in focus towards reading, understanding and evaluating LLM-generated code. In parallel with this shift, a new essential skill is emerging -- the ability to construct good prompts for code-generating models. This paper introduces a novel pedagogical concept known as a `Prompt Problem', designed to help students learn how to craft effective prompts for LLMs. A Prompt Problem challenges a student to create a natural language prompt that leads an LLM to produce the correct code for a specific problem. To support the delivery of Prompt Problems at scale, in this paper we also present a novel tool called Promptly which hosts a repository of Prompt Problems and automates the evaluation of prompt-generated code. We report empirical findings from a field study in which Promptly was deployed in a first-year Python programming course (n=54). We explore student interactions with the tool and their perceptions of the Prompt Problem concept. We found that Promptly was largely well-received by students for its ability to engage their computational thinking skills and expose them to new programming constructs. We also discuss avenues for future work, including variations on the design of Prompt Problems and the need to study their integration into the curriculum and teaching practice.

6 March 2022
Verified
Conference Paper
Open access
BHBrian Harrington
Brian Harrington
AKAditya Kulkarni
Aditya Kulkarni
ZRZixiao Ren
Zixiao Ren
CTConroy Trinh
Conroy Trinh
RGRaha Gharadaghi
Raha Gharadaghi
DYDavid Yue
David Yue
In the first 2 years following the outbreak of COVID-19, many papers have been published regarding the impacts and adaptations of the pandemic on computer science education. As a first step towards a systematic literature mapping, this study attempts to develop a process for searching and a categorization schema for papers. The goal of this project is to produce a literature map which will be used to provide an initial assessment of the state of research, as well as a framework for future research directions. Limiting our search to papers published in the ACM Digital Library in the publications sponsored by SIGCSE, we first create and validate a query and inclusion/exclusion criteria for papers. Using a double evaluator model, we find high agreement with a Cohen's Kappa of 0.93, resulting in 42 papers across 6 conference proceedings. We further validate these findings by independent checking against all papers from SIGCSE2021 TS. We then develop categories across three dimensions: In activity: we find remote teaching, remote assessment, remote work, virtual events and general impact of pandemic. In measurement: we find grades, non-grade assessment, attendance/retention, affect/perception, and mental health. In population: we find K-12 students, university/college students, Educators, and the sub-categories of introductory/CS0/CS1 students, gender, and race. Double rater assessments initially produced a relatively low Kappa score of 0.58, but after protocol revision, and the production of additional categories, the kappa score was raised to a very high 0.94.

14 March 2024
Verified
Conference Paper
Open access
BHBrian Harrington
Brian Harrington
TAThezyrie Amarouche
Thezyrie Amarouche
AAAndrew Aucie
Andrew Aucie
SBShreeansha Bhattarai
Shreeansha Bhattarai
YCYuxin Chen
Yuxin Chen
AVAnagha Vadarevu
Anagha Vadarevu
There is a growing movement in the education community to re-evaluate grading practices and find ways of evaluating students that are more flexible, equitable, and focused on student growth. A wide variety of alternative evaluation systems have been developed, including mastery grading, specifications grading, contract grading and ungrading. In this work, we perform a systematic literature search to find studies of alternative evaluation models in computer science education. A total of 37 papers were analyzed and coded on three metrics: Intervention, Evaluation, and Population. This map represents a tool for educators to find and evaluate research on alternative evaluation systems, a resource for researchers to identify areas of future research, and a foundation for a future detailed literature analysis. The complete bibliography and literature map are available for download.

17 December 2024 in arXiv
Verified
Preprint
Open access
PDF file
JPJames Prather
James Prather
BRBrent N. Reeves
Brent N. Reeves
PDPaul Denny
Paul Denny
JLJuho Leinonen
Juho Leinonen
Stephen Michael MacNeilStephen Michael MacNeil
Stephen Michael MacNeil
GBGweneth Barbre
Gweneth Barbre
Non-native English speakers (NNES) face multiple barriers to learning programming. These barriers can be obvious, such as the fact that programming language syntax and instruction are often in English, or more subtle, such as being afraid to ask for help in a classroom full of native English speakers. However, these barriers are frustrating because many NNES students know more about programming than they can articulate in English. Advances in generative AI (GenAI) have the potential to break down these barriers because state of the art models can support interactions in multiple languages. Moreover, recent work has shown that GenAI can be highly accurate at code generation and explanation. In this paper, we provide the first exploration of NNES students prompting in their native languages (Arabic, Chinese, and Portuguese) to generate code to solve programming problems. Our results show that students are able to successfully use their native language to solve programming problems, but not without some difficulty specifying programming terminology and concepts. We discuss the challenges they faced, the implications for practice in the short term, and how this might transform computing education globally in the long term.