Alice Oh

Alice Oh

Auto-generated profile, based on publicly available information

Alice Oh

School of Computing, KAIST, Daejeon, Korea

Research Focus & Metrics

Academic Career Length

15Years (2012-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
3 May 2024 in Transactions of the Association for Computational Linguistics
Verified
Journal Article
Open access
PDF file
JJJiho Jin
Jiho Jin
JKJiseon Kim
Jiseon Kim
NLNayeon Lee
Nayeon Lee
HYHaneul Yoo
Haneul Yoo
AOAlice Oh
Alice Oh
HLHwaran Lee
Hwaran Lee
Warning: This paper contains examples of stereotypes and biases. The Bias Benchmark for Question Answering (BBQ) is designed to evaluate social biases of language models (LMs), but it is not simple to adapt this benchmark to cultural contexts other than the US because social biases depend heavily on the cultural context. In this paper, we present KoBBQ, a Korean bias benchmark dataset, and we propose a general framework that addresses considerations for cultural adaptation of a dataset. Our framework includes partitioning the BBQ dataset into three classes—Simply-Transferred (can be used directly after cultural translation), Target-Modified (requires localization in target groups), and Sample-Removed (does not fit Korean culture)—and adding four new categories of bias specific to Korean culture. We conduct a large-scale survey to collect and validate the social biases and the targets of the biases that reflect the stereotypes in Korean culture. The resulting KoBBQ dataset comprises 268 templates and 76,048 samples across 12 categories of social bias. We use KoBBQ to measure the accuracy and bias scores of several state-of-the-art multilingual LMs. The results clearly show differences in the bias of LMs as measured by KoBBQ and a machine-translated version of BBQ, demonstrating the need for and utility of a well-constructed, culturally aware social bias benchmark.

20 July 2023
Verified
Conference Paper
Open access
JHJieun Han
Jieun Han
HYHaneul Yoo
Haneul Yoo
YKYoonsu Kim
Yoonsu Kim
JMJunho Myung
Junho Myung
MKMinsun Kim
Minsun Kim
AOAlice Oh
Alice Oh

1 January 2021
Verified
Conference Paper
Open access
PDF file
SPSung-Joon Park
Sung-Joon Park
JKJiseon Kim
Jiseon Kim
SYSeonghyeon Ye
Seonghyeon Ye
JJJaeyeol Jeon
Jaeyeol Jeon
HPHee Young Park
Hee Young Park
AOAlice Oh
Alice Oh
Sungjoon Park, Jiseon Kim, Seonghyeon Ye, Jaeyeol Jeon, Hee Young Park, Alice Oh. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. 2021.

1 January 2024
Verified
Conference Paper
Open access
PDF file
JHJieun Han
Jieun Han
HYHaneul Yoo
Haneul Yoo
JMJunho Myung
Junho Myung
MKMinsun Kim
Minsun Kim
HLHyunseung Lim
Hyunseung Lim
AOAlice Oh
Alice Oh
Jieun Han, Haneul Yoo, Junho Myung, Minsun Kim, Hyunseung Lim, Yoonsu Kim, Tak Yeon Lee, Hwajung Hong, Juho Kim, So-Yeon Ahn, Alice Oh. Proceedings of the 1st Workshop on Customizable NLP: Progress and Challenges in Customizing NLP for a Domain, Application, Group, or Individual (CustomNLP4U). 2024.

1 January 2024
Verified
Conference Paper
Open access
PDF file
NLNayeon Lee
Nayeon Lee
CJChani Jung
Chani Jung
JMJunho Myung
Junho Myung
JJJiho Jin
Jiho Jin
JCJose Camacho-Collados
Jose Camacho-Collados
AOAlice Oh
Alice Oh
Nayeon Lee, Chani Jung, Junho Myung, Jiho Jin, Jose Camacho-Collados, Juho Kim, Alice Oh. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2024.

1 January 2023
Verified
Conference Paper
Open access
PDF file
NLNayeon Lee
Nayeon Lee
CJChani Jung
Chani Jung
AOAlice Oh
Alice Oh
Nayeon Lee, Chani Jung, Alice Oh. Proceedings of the First Workshop on Cross-Cultural Considerations in NLP (C3NLP). 2023.