Kristy Elizabeth Boyer

Kristy Elizabeth Boyer

Auto-generated profile, based on publicly available information

Kristy Elizabeth Boyer

University of Florida

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 June 2019 in IEEE Transactions on Learning Technologies
Verified
Journal Article
Closed access
WMWookhee Min
Wookhee Min
MFMegan H. Frankosky
Megan H. Frankosky
BMBradford W. Mott
Bradford W. Mott
JRJonathan P. Rowe
Jonathan P. Rowe
ASAndy Smith
Andy Smith
PSPeter Andrew Miller Smith
Peter Andrew Miller Smith
A distinctive feature of game-based learning environments is their capacity for enabling stealth assessment. Stealth assessment analyzes a stream of fine-grained student interaction data from a game-based learning environment to dynamically draw inferences about students' competencies through evidence-centered design. In evidence-centered design, evidence models have been traditionally designed using statistical rules authored by domain experts that are encoded using Bayesian networks. This article presents DeepStealth, a deep learning-based stealth assessment framework, that yields significant reductions in the feature engineering labor that has previously been required to create stealth assessments. DeepStealth utilizes end-to-end trainable deep neural network-based evidence models. Using this framework, evidence models are devised using a set of predictive features captured from raw, low-level interaction data to infer evidence for competencies. We investigate two deep learning-based evidence models, long short-term memory networks (LSTMs) and n-gram encoded feedforward neural networks (FFNNs). We compare these models' predictive performance for inferring students' knowledge to linear-chain conditional random fields (CRFs) and nave Bayes models. We perform feature set-level analyses of game trace logs and external pre-learning measures, and we examine the models early prediction capacity. The framework is evaluated using data collected from 182 middle school students interacting with a game-based learning environment for middle grade computational thinking. Results indicate that LSTM-based stealth assessors outperform competitive baseline approaches with respect to predictive accuracy and early prediction capacity. We find that LSTMs, FFNNs, and CRFs all benefit from combined feature sets derived from both game trace logs and external pre-learning measures.

2 March 2023
Verified
Conference Paper
Open access
GKGloria Ashiya Katuka
Gloria Ashiya Katuka
YAYvonika Auguste
Yvonika Auguste
YSYukyeong Song
Yukyeong Song
XTXiaoyi Tian
Xiaoyi Tian
AKAmit Kumar
Amit Kumar
TMTom McKlin
Tom McKlin
The ubiquity of AI-based conversational apps such as Siri, Alexa and Google Assistant means more young users are interacting with these apps. The increasing popularity of these conversational applications brings a potential opportunity to attract learners to AI, CS and STEM fields. CS Education researchers need to explore how to leverage this opportunity, in particular to serve learners who are underrepresented in CS and STEM. This experience report describes the design and iterative refinement of a series of two-week summer camps in which 62 predominantly Black students participated in hands-on AI-based learning experiences to design and develop their own conversational AI apps. We discuss the organization of this summer camp experience, including strategies for recruiting from and building trust within the target community, designing professional development for camp facilitators, structuring the camp activities, and encouraging projects that are personally and socially relevant. We share challenges and lessons learned from this AI summer camp in the hopes that they will inform other researchers and practitioners who are interested in designing and deploying similar experiences.

7 March 2024
Verified
Conference Paper
Open access
GKGloria Ashiya Katuka
Gloria Ashiya Katuka
SCSrijita Chakraburty
Srijita Chakraburty
HLHyejeong Lee
Hyejeong Lee
SDSunny Dhama
Sunny Dhama
TEToni Earle-Randell
Toni Earle-Randell
TMTom Mcklin
Tom Mcklin
With the increasing prevalence of large language models (LLMs) such as ChatGPT, there is a growing need to integrate natural language processing (NLP) into K-12 education to better prepare young learners for the future AI landscape. NLP, a sub-field of AI that serves as the foundation of LLMs and many advanced AI applications, holds the potential to enrich learning in core subjects in K-12 classrooms. In this experience report, we present our efforts to integrate NLP into science classrooms with 98 middle school students across two US states, aiming to increase students' experience and engagement with NLP models through textual data analyses and visualizations. We designed learning activities, developed an NLP-based interactive visualization platform, and facilitated classroom learning in close collaboration with middle school science teachers. This experience report aims to contribute to the growing body of work on integrating NLP into K-12 education by providing insights and practical guidelines for practitioners, researchers, and curriculum designers.

7 March 2024
Verified
Conference Paper
Open access
YSYukyeong Song
Yukyeong Song
XTXiaoyi Tian
Xiaoyi Tian
NRNandika Regatti
Nandika Regatti
GKGloria Ashiya Katuka
Gloria Ashiya Katuka
KBKristy Elizabeth Boyer
Kristy Elizabeth Boyer
MIMaya Israel
Maya Israel
As conversational AI apps such as Siri and Alexa become ubiquitous among children, the CS education community has begun leveraging this popularity as a potential opportunity to attract young learners to AI, CS, and STEM learning. However, teaching conversational AI to K-12 learners remains challenging and unexplored due in part to the abstract and complex nature of some conversational AI concepts, such as intents and training phrases. One promising approach to teaching complex topics in engaging ways is through unplugged activities, which have been shown to be highly effective in fostering CS conceptual understanding without using computers. Research efforts are underway toward developing unplugged activities for teaching AI, but few thus far have focused on conversational AI. This experience report describes the design and iterative refinement of a series of novel unplugged activities for a conversational AI summer camp for middle school learners. We discuss learner responses and lessons learned through our implementation of these unplugged activities. Our hope is that these insights support CS education researchers in making conversational AI learning more engaging and accessible to all learners.

1 August 2015
Verified
Conference Paper
Closed access
PBPhilip Sheridan Buffum
Philip Sheridan Buffum
MFMegan Frankosky
Megan Frankosky
KBKristy Elizabeth Boyer
Kristy Elizabeth Boyer
EWEric Wiebe
Eric Wiebe
BMBradford Mott
Bradford Mott
JLJames C. Lester
James C. Lester
Game-based learning environments can deliver robust learning gains and also have a unique capacity to engage students. Yet they can unintentionally disadvantage students with less prior gaming experience. This is especially concerning in computer science education, as certain underrepresented groups (such as female students) may on average have less prior experience with games. This paper presents evidence that a collaborative gameplay approach can successfully address this problem at the middle school level. In an iterative, designed-based research study, we first used an experimental pilot study to investigate the nature of collaboration in the Engage game-based learning environment, and then deployed Engage in a full classroom study to measure its effectiveness at serving all students. In earlier phases of the intervention, male students outpaced their female peers in learning gains. However, female students caught up during a multi-week classroom implementation. These findings provide evidence that a collaborative gameplay approach may, over time, compensate for gender differences in experience and lead to equitable learning experiences within game-based learning environments for computer science education.

26 June 2023 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
YSYukyeong Song
Yukyeong Song
GKGloria Ashiya Katuka
Gloria Ashiya Katuka
JBJoanne Barrett
Joanne Barrett
XTXiaoyi Tian
Xiaoyi Tian
AKAmit Kumar
Amit Kumar
MIMaya Israel
Maya Israel
As artificial intelligence permeates our lives through various tools and services, there is an increasing need to consider how to teach young learners about AI in a relevant and engaging way. One way to do so is to leverage familiar and pervasive technologies such as conversational AIs. By learning about conversational AIs, learners are introduced to AI concepts such as computers’ perception of natural language, the need for training datasets, and the design of AI-human interactions. In this experience report, we describe a summer camp curriculum designed for middle school learners composed of general AI lessons, unplugged activities, conversational AI lessons, and project activities in which the campers develop their own conversational agents. The results show that this summer camp experience fostered significant increases in learners’ ability beliefs, willingness to share their learning experience, and intent to persist in AI learning. We conclude with a discussion of how conversational AI can be used as an entry point to K-12 AI education.