Bekzat Tilekbay

Bekzat Tilekbay

Auto-generated profile, based on publicly available information

Bekzat Tilekbay

School of Computing, KAIST, Korea, Republic of

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
18 March 2024
Verified
Conference Paper
Open access
BTBekzat Tilekbay
Bekzat Tilekbay
SYSaelyne Yang
Saelyne Yang
MLMichal Adam Lewkowicz
Michal Adam Lewkowicz
ASAlex Suryapranata
Alex Suryapranata
JKJuho Kim
Juho Kim
Informational videos serve as a crucial source for explaining conceptual and procedural knowledge to novices and experts alike. When producing informational videos, editors edit videos by overlaying text/images or trimming footage to enhance the video quality and make it more engaging. However, video editing can be difficult and time-consuming, especially for novice video editors who often struggle with expressing and implementing their editing ideas. To address this challenge, we first explored how multimodality—natural language (NL) and sketching, which are natural modalities humans use for expression—can be utilized to support video editors in expressing video editing ideas. We gathered 176 multimodal expressions of editing commands from 10 video editors, which revealed the patterns of use of NL and sketching in describing edit intents. Based on the findings, we present ExpressEdit, a system that enables editing videos via NL text and sketching on the video frame. Powered by LLM and vision models, the system interprets (1) temporal, (2) spatial, and (3) operational references in an NL command and spatial references from sketching. The system implements the interpreted edits, which then the user can iterate on. An observational study (N=10) showed that ExpressEdit enhanced the ability of novice video editors to express and implement their edit ideas. The system allowed participants to perform edits more efficiently and generate more ideas by generating edits based on user’s multimodal edit commands and supporting iterations on the editing commands. This work offers insights into the design of future multimodal interfaces and AI-based pipelines for video editing.

9 July 2024
Verified
Conference Paper
Open access
HJHyoungwook Jin
Hyoungwook Jin
YKYoonsu Kim
Yoonsu Kim
YPYeon Su Park
Yeon Su Park
BTBekzat Tilekbay
Bekzat Tilekbay
JSJinho Son
Jinho Son
JKJuho Kim
Juho Kim
Personalized feedback, tailored to students' needs and prior knowledge, is essential for fostering mathematical problem-solving skills. However, personalized feedback is often limited to one-to-one tutoring or small classrooms as it requires instructors' in-depth diagnosis of cognitive processes employed in students' answers. We propose a large language model (LLM) pipeline that diagnoses students' problem-solving skills from their answers at scale in elementary school math word problems. Based on prior literature and an interview with a math education expert, we developed PERC, a framework composed of four problem-solving stages that students can follow: Parse, Extract, Retrieve, and Combine. The framework facilitates diagnosis by externalizing students' step-by-step problem-solving processes and allowing our pipeline to analyze each stage individually. Our LLM pipeline diagnoses each stage by (1) generating rubrics and (2) comparing students' answers with the rubrics. We fine-tuned our LLM pipeline with 71 math problem-rubric pairs and 128 problem-answer-grade triplets collected from elementary school students. We evaluated our pipeline's diagnosis accuracy against vanilla GPT-3.5 and vanilla GPT-4 with automatic and expert evaluations. The results showed the potential of our approach in improving the end-to-end diagnosis accuracy of LLMs, and expert evaluation provided specific aspects that should be improved.

18 March 2024
Verified
Conference Paper
Open access
BTBekzat Tilekbay
Bekzat Tilekbay
SYSaelyne Yang
Saelyne Yang
MLMichal Adam Lewkowicz
Michal Adam Lewkowicz
ASAlex Suryapranata
Alex Suryapranata
JKJuho Kim
Juho Kim