Jingoo Kim

Jingoo Kim

Auto-generated profile, based on publicly available information

Jingoo Kim

Hackle Company Ltd., Seoul, Republic of Korea

Research Focus & Metrics

Academic Career Length

2Years (2025-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
15 July 2025 in IEEE Access
Verified
Journal Article
Open access
HKHyunjin Kwon
Hyunjin Kwon
JKJingoo Kim
Jingoo Kim
HLHo-Hyun Lim
Ho-Hyun Lim
JKJong Min Kim
Jong Min Kim
YKYongwoo Kim
Yongwoo Kim
DHDongwook Hwang
Dongwook Hwang
Online A/B testing is widely used as an experimental methodology for product improvement and business optimization. However, interpreting experimental results often involves subjective judgment and biases from experiment designers, which can undermine the reliability and reproducibility of test outcomes. In particular, experiment designers frequently exhibit inconsistent decision-making when dealing with neutral results—cases where neither statistically significant positive nor negative effects are observed. This study aims to explore the feasibility of automating A/B test decision-making using Generative AI and empirically analyze how well AI decisions align with those of experiment designers and experts. Utilizing 1,407 experimental cases from 48 companies on the Hackle online experimentation platform, the study compares decision-making outcomes between experiment designers and Generative AI, analyzing agreement rates and identifying patterns across companies. Statistical analyses, including chi-square tests and inter-rater agreement evaluation, were employed to assess differences and reliability. The findings indicate meaningful discrepancies between AI and experiment designers but demonstrate that AI decisions closely align with expert judgments. These results suggest that Generative AI can serve as a complementary tool to enhance the consistency and reliability of A/B test result interpretation.