Tracy Arner

Dr. Tracy Arner

orcid

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 August 2023 in Computers & Education
Verified
Journal Article
Closed access
JSJinnie Shin
Jinnie Shin
RBRenu Balyan
Renu Balyan
MBMichelle Pacifico Banawan
Michelle Pacifico Banawan
TATracy Arner
Tracy Arner
WLWalter L. Leite
Walter L. Leite
DMDanielle McNamara
Danielle McNamara

1 December 2024 in Journal of Applied Research in Memory and Cognition
Verified
Journal Article
Closed access
MIMegan N. Imundo
Megan N. Imundo
MWMicah Watanabe
Micah Watanabe
APAndrew Potter
Andrew Potter
JGJiachen Gong
Jiachen Gong
TATracy Arner
Tracy Arner
DMDanielle McNamara
Danielle McNamara

14 October 2023 in Information
Verified
Journal Article
Open access
PDF file
BNBogdan Nicula
Bogdan Nicula
MDMihai Dascalu
Mihai Dascalu
TATracy Arner
Tracy Arner
RBRenu Balyan
Renu Balyan
DMDanielle McNamara
Danielle McNamara
Text comprehension is an essential skill in today’s information-rich world, and self-explanation practice helps students improve their understanding of complex texts. This study was centered on leveraging open-source Large Language Models (LLMs), specifically FLAN-T5, to automatically assess the comprehension strategies employed by readers while understanding Science, Technology, Engineering, and Mathematics (STEM) texts. The experiments relied on a corpus of three datasets (N = 11,833) with self-explanations annotated on 4 dimensions: 3 comprehension strategies (i.e., bridging, elaboration, and paraphrasing) and overall quality. Besides FLAN-T5, we also considered GPT3.5-turbo to establish a stronger baseline. Our experiments indicated that the performance improved with fine-tuning, having a larger LLM model, and providing examples via the prompt. Our best model considered a pretrained FLAN-T5 XXL model and obtained a weighted F1-score of 0.721, surpassing the 0.699 F1-score previously obtained using smaller models (i.e., RoBERTa).

24 March 2025 in Journal of Computer Assisted Learning
Verified
Journal Article
Closed access
SDStephanie L. Day
Stephanie L. Day
JHJin Kyoung Hwang
Jin Kyoung Hwang
TATracy Arner
Tracy Arner
DMDanielle S. McNamara
Danielle S. McNamara
CCCarol M. Connor
Carol M. Connor

9 April 2021 in Computers
Verified
Journal Article
Open access
PDF file
TATracy Arner
Tracy Arner
KMKathryn S McCarthy
Kathryn S McCarthy
DMDanielle McNamara
Danielle McNamara
Literacy skills are critical for future success, yet over 60% of high school seniors lack proficient reading skills according to standardized tests. The focus on high stakes, standardized test performance may lead educators to “teach-to-the-test” rather than supporting transferable comprehension strategies that students need. StairStepper can fill this gap by blending necessary test prep and reading comprehension strategy practice in a fun, game-based environment. StairStepper is an adaptive literacy skill training game within Interactive Strategy Training for Active Reading and Thinking (iSTART) intelligent tutoring system. StairStepper is unique in that it models text passages and multiple-choice questions of high-stakes assessments, iteratively supporting skill acquisition through self-explanation prompts and scaffolded, adaptive feedback based on performance and self-explanations. This paper describes an experimental study employing a delayed-treatment control design to evaluate users’ perceptions of the StairStepper game and its influence on reading comprehension scores. Results indicate that participants enjoyed the visual aspects of the game environment, wanted to perform well, and considered the game feedback helpful. Reading comprehension scores of students in the treatment condition did not increase. However, the comprehension scores of the control group decreased. Collectively, these results indicate that the StairStepper game may fill the intended gap in instruction by providing enjoyable practice of essential reading comprehension skills and test preparation, potentially increasing students’ practice persistence while decreasing teacher workload.

4 June 2025 in Applied Sciences
Verified
Journal Article
Open access
PDF file
MIMegan N. Imundo
Megan N. Imundo
MGMaria Goldshtein
Maria Goldshtein
MWMicah Watanabe
Micah Watanabe
JGJiachen Gong
Jiachen Gong
DCDevon Nicole Crosby
Devon Nicole Crosby
DMDanielle McNamara
Danielle McNamara
Introduction: Student retention is a critical issue in higher education. Universities have responded by implementing supports like early alert systems. Objective: We investigated students’ knowledge of and experiences with an early alert system designed to enhance academic persistence. Method: We surveyed (N = 356) undergraduates at a large public university in the U.S. The survey was researcher-created and administered online. Participants self-selected into the study and provided informed consent prior to beginning the study. Data were coded by experts, who achieved excellent IRR. The analyses were frequency-based to understand diverse student knowledge, experiences, and responses with early alert systems. Results: Students commonly reported experiencing negative emotions after receiving an alert, but also reported that receiving an alert motivated them to increase their course attendance, improve their study habits, and participate more in class. Finally, students indicated that receiving an early alert facilitated supportive interactions with instructors, though student communication with academic advisors was less frequent. Student recommendations for system improvement included using positive language in alerts and providing actionable guidance. Conclusions: These results provide new insight into student views of early alert systems and suggest that these systems can positively impact students in need of support.