Heidi Reichert

Heidi Reichert

Auto-generated profile, based on publicly available information

Heidi Reichert

North Carolina State University

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
7 August 2026 in Empirical Software Engineering
Verified
Journal Article
Open access
PDF file
BTBenyamin Tabarsi
Benyamin Tabarsi
HRHeidi Reichert
Heidi Reichert
SGSam Gilson
Sam Gilson
ALAlly Limke
Ally Limke
SKSandeep Kuttal
Sandeep Kuttal
TBTiffany Barnes
Tiffany Barnes
Large language models (LLMs) are rapidly reshaping software development, but their impact across the full software development lifecycle is underexplored. Existing work tends to focus on isolated activities such as code generation or testing, leaving open questions about how LLMs affect developers, processes, products, and the broader software ecosystem. We address this gap through semi-structured interviews with sixteen early-adopter software professionals who integrated LLM-based tools into their day-to-day work in early to mid-2023. We treat these interviews as early empirical evidence and compare participants’ accounts with recent work on LLMs in software engineering, noting which early patterns persist or shift. Using thematic analysis, we organize our findings around four dimensions: people, process, product, and society. Developers reported substantial productivity gains from reducing mundane tasks, streamlining search, and accelerating debugging, but also described a productivity-quality paradox: they frequently discarded generated code and shifted effort from writing code to critically evaluating and integrating it. LLM use was highly phase-dependent, with strong uptake in implementation and debugging but limited influence on requirements gathering and collaborative work. Participants developed new competencies to use LLMs effectively, including prompt engineering strategies, multi-layered verification, and security-conscious integration to protect proprietary data. They also anticipated changes in hiring expectations, team practices, and computing education, while emphasizing that human judgment and foundational software engineering skills remain essential. Our findings, consistent with evidence from large-scale studies, offer actionable implications for developers, organizations, educators, and tool designers seeking to integrate LLMs responsibly into professional software practice.

14 March 2024
Verified
Conference Paper
Open access
HRHeidi Reichert
Heidi Reichert
SSSandeep Sthapit
Sandeep Sthapit
BTBenyamin T. Tabarsi
Benyamin T. Tabarsi
ALAlly Limke
Ally Limke
TPThomas Price
Thomas Price
TBTiffany Barnes
Tiffany Barnes
Affective state, referring to an individual's feeling, can impact students' confidence and retention in CS, particularly for novice programmers. However, little research has been conducted to examine how moments that occur during programming impact students' affective states in real-time. In this pilot study, seven undergraduate students in an introductory block-based programming course completed a programming assignment and were surveyed and interviewed about their experience and self-efficacy as programmers. While programming, students periodically recorded their affective states via a popup in the programming environment. We performed retrospective think-aloud interviews with students afterward, asking them to watch and reflect on recordings of their programming. We subsequently analyzed student interviews using thematic analysis to derive 206 codes. These codes were grouped into three areas that impacted affect: the environment, objective progress, and perceptions during programming. To explore why students responded as they did to moment occurrence, we further categorized students based on four dimensions: programming experience, assignment completion, confidence, and the impact of the programming session on self-efficacy. Our initial results suggest that while certain moments elicit similar affective states among students, the interaction of the aforementioned four dimensions may have a higher impact on novices' affective states during programming. We conclude with recommendations for educators to improve students' affective states during and after programming.

12 August 2024
Verified
Conference Paper
Open access
BTBenyamin Tabarsi
Benyamin Tabarsi
HRHeidi Reichert
Heidi Reichert
NLNicholas Lytle
Nicholas Lytle
VCVeronica Catete
Veronica Catete
TBTiffany Barnes
Tiffany Barnes
Background and Context. The importance of CS to 21st-century life and work has made it important to find ways to integrate learning CS and programming into the regular school day. However, learning CS is difficult, so teachers integrating programming need effective strategies to scaffold the learning. In this study, we analyze students’ log data and apply a novel technique to compare Parsons Problems with from-scratch programming in a middle school science class. Objectives. Our research questions aimed to investigate whether, how, and when Parsons Problems improve learning efficiency for a programming exercise within science, utilizing log data analysis and an automated progress detector (SPD). Method. We conducted a study on 199 students in a 6th-grade science course, divided into two groups: one engaged with Parsons problems, and the other, a control group, worked on the same programming task without scaffolding. Then, we analyzed differences in performance and coding characteristics between the groups. We also adopted an innovative application of SPD to gain a better understanding of how and when Parsons problems helped students make more progress on the coding task, with an objective measure of final student grades. Findings. The experimental group, with scaffolding through Parsons Problems, achieved significantly higher grades, spent significantly less time programming, and toggled less between block category tabs. Interestingly, they ran their code more frequently compared to the control group. The SPD analysis revealed that the experimental group made significantly higher progress in all four quartiles of their coding time. Implications. Our findings suggest that Parsons problems can improve learning efficiency by enhancing novices’ learning experience without negatively impacting their performance or grades, which is especially important when programming is integrated into K12 courses.


11 April 2025 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
HRHeidi Reichert
Heidi Reichert
Large Language Models (LLMs) and Generative AI (GenAI) have markedly changed the landscape of many fields, including education. While these tools have significant capabilities, they also require understanding to effectively and responsibly use them. Additionally, little work has been done to evaluate how these tools can best benefit education at the secondary level, with design insights from instructors. My work focuses on informing secondary instructors of these tools, receiving their input on how to make these tools work best for them, and finally using this input to create and evaluate an in-class Retrieval-Augmented Generation (RAG)-based chatbot for their students to use to improve learning outcomes. This work aims to bridge the gap between the latest in computing technology and secondary education classrooms.

18 September 2026 in SSRN Electronic Journal
Verified
Preprint
Open access
BTBenyamin Tabarsi
Benyamin Tabarsi
TYTahreem Yasir
Tahreem Yasir
HRHeidi Reichert
Heidi Reichert
XTXiaoyi Tian
Xiaoyi Tian
SGShiva Gadireddy
Shiva Gadireddy
TBTiffany Barnes
Tiffany Barnes
The variety of help that large language models (LLMs) provide has made them popular among students across fields. Computing education has been particularly affected, as LLMs can handle coding tasks effectively and provide feedback, raising hopes for supporting students while creating concerns about learning and academic integrity. Researchers have responded by developing customized tools that leverage LLMs' potential while mitigating these risks. Despite a rapidly growing body of empirical studies, no prior review has focused specifically on these purpose-built tools, where educators' pedagogical and technical design decisions are explicitly represented. We address this gap by reviewing LLM-driven, student-facing tools in undergraduate computing education, examining their pedagogical roles, technical design, evaluation methods, and impacts on learners, and discussing what they imply for the broader educational system. Drawing on PRISMA guidelines, we searched three major databases (ACM, IEEE, and ScienceDirect), conducted rigorous screening, and analyzed 52 papers. Technically, prompt engineering and multi-stage pipelines are the dominant approaches, with guardrails and prompt chaining also widely adopted, while more demanding methods such as fine-tuning remain rare. Pedagogically, most tools position the LLM as a Mentor who gives feedback on student work or a Tutor who delivers instruction, whereas roles that support metacognition, learning-by-teaching, and especially teamwork are very rare. Evaluation relies heavily on surveys and interaction logs, capturing student perceptions and usage far more often than learning outcomes, with little attention to long-term effects. Across studies, impacts on engagement and student perception are generally positive, whereas evidence for gains in learning and performance is more mixed. We argue that future work should prioritize longitudinal and learning-focused evaluation, personalization for different learners, and collaborative sensemaking and teamwork. This review offers researchers, developers, and educators a roadmap for designing and studying the next generation of AI-enhanced learning tools.