Koichi Konishi

Mr. Koichi Konishi


Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 December 2024 in Electronics
Verified
Journal Article
Open access
PDF file
TOTinghui Ouyang
Tinghui Ouyang
AMAprilPyone MaungMaung
AprilPyone MaungMaung
KKKoichi Konishi
Koichi Konishi
YSYoshiki Seo
Yoshiki Seo
IEIsao Echizen
Isao Echizen
In the era of large AI models, the intricate architectures and vast parameter sets of models such as large language models (LLMs) present significant challenges for effective AI quality management (AIQM). This paper investigates the quality assurance of a specific LLM-based AI product: ChatGPT-based sentiment analysis. The study focuses on stability issues, examining both the operation and robustness of ChatGPT’s underlying large-scale AI model. Through experimental analysis on benchmark datasets for sentiment analysis, the findings highlight the ChatGPT-based sentiment analysis’s susceptibility to uncertainty, which relates to various operational factors. Furthermore, the study reveals that the ChatGPT-based model faces stability challenges, particularly when confronted with conventional small-text adversarial attacks targeting robustness.

15 January 2024 in arXiv
Verified
Preprint
Open access
PDF file
TOTinghui Ouyang
Tinghui Ouyang
AMAprilPyone MaungMaung
AprilPyone MaungMaung
KKKoichi Konishi
Koichi Konishi
YSYoshiki Seo
Yoshiki Seo
IEIsao Echizen
Isao Echizen
In the era of large AI models, the complex architecture and vast parameters present substantial challenges for effective AI quality management (AIQM), e.g. large language model (LLM). This paper focuses on investigating the quality assurance of a specific LLM-based AI product--a ChatGPT-based sentiment analysis system. The study delves into stability issues related to both the operation and robustness of the expansive AI model on which ChatGPT is based. Experimental analysis is conducted using benchmark datasets for sentiment analysis. The results reveal that the constructed ChatGPT-based sentiment analysis system exhibits uncertainty, which is attributed to various operational factors. It demonstrated that the system also exhibits stability issues in handling conventional small text attacks involving robustness.