Hiroko Okada

Dr. Hiroko Okada


Research Focus & Metrics

Academic Career Length

13Years (2014-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
25 July 2024 in Journal of Medical Internet Research
Verified
Journal Article
Open access
MLMingxin Liu
Mingxin Liu
TOTsuyoshi Okuhara
Tsuyoshi Okuhara
XCXINYI CHANG
XINYI CHANG
Ritsuko ShirabeRitsuko Shirabe
Ritsuko Shirabe
YNYuriko Nishiie
Yuriko Nishiie
TKTakahiro Kiuchi
Takahiro Kiuchi
Background: Over the past 2 years, researchers have used various medical licensing examinations to test whether ChatGPT (OpenAI) possesses accurate medical knowledge. The performance of each version of ChatGPT on the medical licensing examination in multiple environments showed remarkable differences. At this stage, there is still a lack of a comprehensive understanding of the variability in ChatGPT’s performance on different medical licensing examinations. Objective: In this study, we reviewed all studies on ChatGPT performance in medical licensing examinations up to March 2024. This review aims to contribute to the evolving discourse on artificial intelligence (AI) in medical education by providing a comprehensive analysis of the performance of ChatGPT in various environments. The insights gained from this systematic review will guide educators, policymakers, and technical experts to effectively and judiciously use AI in medical education. Methods: We searched the literature published between January 1, 2022, and March 29, 2024, by searching query strings in Web of Science, PubMed, and Scopus. Two authors screened the literature according to the inclusion and exclusion criteria, extracted data, and independently assessed the quality of the literature concerning Quality Assessment of Diagnostic Accuracy Studies-2. We conducted both qualitative and quantitative analyses. Results: A total of 45 studies on the performance of different versions of ChatGPT in medical licensing examinations were included in this study. GPT-4 achieved an overall accuracy rate of 81% (95% CI 78-84; P<.01), significantly surpassing the 58% (95% CI 53-63; P<.01) accuracy rate of GPT-3.5. GPT-4 passed the medical examinations in 26 of 29 cases, outperforming the average scores of medical students in 13 of 17 cases. Translating the examination questions into English improved GPT-3.5’s performance but did not affect GPT-4. GPT-3.5 showed no difference in performance between examinations from English-speaking and non–English-speaking countries (P=.72), but GPT-4 performed better on examinations from English-speaking countries significantly (P=.02). Any type of prompt could significantly improve GPT-3.5’s (P=.03) and GPT-4’s (P<.01) performance. GPT-3.5 performed better on short-text questions than on long-text questions. The difficulty of the questions affected the performance of GPT-3.5 and GPT-4. In image-based multiple-choice questions (MCQs), ChatGPT’s accuracy rate ranges from 13.1% to 100%. ChatGPT performed significantly worse on open-ended questions than on MCQs. Conclusions: GPT-4 demonstrates considerable potential for future use in medical education. However, due to its insufficient accuracy, inconsistent performance, and the challenges posed by differing medical policies and knowledge across countries, GPT-4 is not yet suitable for use in medical education. Trial Registration: PROSPERO CRD42024506687; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=506687

13 July 2022 in Healthcare
Verified
Journal Article
Open access
PDF file
Rie YokotaRie Yokota
Rie Yokota
TOTsuyoshi Okuhara
Tsuyoshi Okuhara
HOHiroko Okada
Hiroko Okada
EGEiko Goto
Eiko Goto
KSKeiko Sakakibara
Keiko Sakakibara
TKTakahiro Kiuchi
Takahiro Kiuchi
Japan has the highest number of cases of infertility treatment in the world. Studies have indicated that women undergoing infertility treatment feel stigmatized and suffer from psychological symptoms such as anxiety and depression. However, in Japan, few studies have quantitatively examined the association between the stigma of infertility and psychological symptoms, and, to our knowledge, no study has examined its association using a scale with tested reliability and validity. This study aims to quantitatively examine the relationship between infertility stigma and anxiety, depression, and psychological distress among women undergoing infertility treatment, using a scale that has been validated for reliability and validity. The cross-sectional study was conducted in December 2021 through a web-based survey of 254 participants undergoing infertility treatment. A multiple regression analysis was performed to examine the relationship between stigma and anxiety, depression, and psychological distress. Stigma was a statistically significant predictor of anxiety, depression, and psychological distress (standardized β = 0.58, p < 0.001; β = 0.50, p < 0.001; β = 0.62, p < 0.001, respectively) after controlling for sociodemographic and infertility characteristics. Future studies should examine the causal relationship between stigma and anxiety, depression, and psychological distress and how to intervene to reduce stigma among women undergoing infertility treatment.

11 November 2020 in Healthcare
Verified
Journal Article
Open access
PDF file
TOTsuyoshi Okuhara
Tsuyoshi Okuhara
HOHiroko Okada
Hiroko Okada
TKTakahiro Kiuchi
Takahiro Kiuchi
During the COVID-19 pandemic, a social lockdown should be put in place and individuals should stay at home. Behavioral change is the only way to prevent the pandemic and overwhelmed healthcare systems until vaccines are available. We aimed to examine the psychological factors that predict staying at home during the COVID-19 pandemic and social lockdown. A total of 1980 participants in Japan completed a survey for this study from 9 to 11 May 2020, when the state of emergency covered all prefectures in the country. Self-reported behavior in terms of staying at home, the perceived severity of the pandemic, vulnerability to the pandemic, response efficacy, and self-efficacy based on protection motivation theory were assessed. Multiple regression analysis showed that perceived severity (standardized β = 0.11, p < 0.001) and self-efficacy (standardized β = 0.32, p < 0.001) significantly predicted greater levels of staying at home, after controlling for socio-demographics. However, perceived vulnerability and response efficacy did not. To encourage people to stay at home during the pandemic and social lockdown, increasing the perceived severity of infection by COVID-19 and self-efficacy in terms of exercising restraint with respect to going out may consequently encourage people to stay at home.

EFEmi Furukawa
Emi Furukawa
TOTsuyoshi Okuhara
Tsuyoshi Okuhara
HOHiroko Okada
Hiroko Okada
Ritsuko ShirabeRitsuko Shirabe
Ritsuko Shirabe
Rie YokotaRie Yokota
Rie Yokota
TKTakahiro Kiuchi
Takahiro Kiuchi
Background: The Patient Education Materials Assessment Tool (PEMAT) systematically evaluates the understandability and actionability of patient education materials. This study aimed to develop a Japanese version of PEMAT and verify its reliability and validity. Methods: After assessing content validation, experts scored healthcare-related leaflets and videos according to PEMAT to verify inter-rater reliability. In validation testing with laypeople, the high-scoring material group (n = 800) was presented with materials that received high ratings on PEMAT, and the low-scoring material group (n = 799) with materials that received low ratings. Both groups responded to the understandability and actionability of the materials and perceived self-efficacy for the recommended actions. Results: The Japanese version of PEMAT showed strong inter-rater reliability (PEMAT-P: % agreement = 87.3, Gwet’s AC1 = 0.83. PEMAT-A/V: % agreement = 85.7, Gwet’s AC1 = 0.80). The high-scoring material group had significantly higher scores for understandability and actionability than the low-scoring material group (PEMAT-P: understandability 6.53 vs. 5.96, p < 0.001; actionability 6.04 vs. 5.49, p < 0.001; PEMAT-A/V: understandability 7.65 vs. 6.76, p < 0.001; actionability 7.40 vs. 6.36, p < 0.001). Perceived self-efficacy increased more in the high-scoring material group than in the low-scoring material group. Conclusions: Our study showed that materials rated highly on Japanese version of PEMAT were also easy for laypeople to understand and action.

1 February 2022 in Patient Education and Counseling
Verified
Journal Article
Closed access
TOTsuyoshi Okuhara
Tsuyoshi Okuhara
HIHirono Ishikawa
Hirono Ishikawa
HUHaruka Ueno
Haruka Ueno
HOHiroko Okada
Hiroko Okada
MKMio Kato
Mio Kato
TKTakahiro Kiuchi
Takahiro Kiuchi

15 January 2025 in JMIR Research Protocols
Verified
Journal Article
Open access
EFEmi Furukawa
Emi Furukawa
TOTsuyoshi Okuhara
Tsuyoshi Okuhara
MLMingxin Liu
Mingxin Liu
HOHiroko Okada
Hiroko Okada
TKTakahiro Kiuchi
Takahiro Kiuchi
Background: The Patient Education Materials Assessment Tool (PEMAT) is a reliable and validated instrument for assessing the understandability and actionability of patient education materials. It has been applied across diverse cultural and linguistic contexts, enabling cross-field and cross-national material quality comparisons. Accumulated evidence from studies using the PEMAT over the past decade underscores its potential impact on patient and public action. Objective: This systematic review aims to investigate how the quality of patient education materials has been assessed using the PEMAT. Methods: This review protocol follows PRISMA-P (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols) guidelines. PubMed, MEDLINE, Cumulative Index to Nursing and Allied Health Literature (CINAHL), APA PsycInfo, and Web of Science Core Collection will be searched systematically for articles published since September 2014. Two independent reviewers will conduct the search to yield a list of relevant studies based on the inclusion and exclusion criteria. Rayyan QCRI software will be used for screening and data extraction. Results: The results will be included in the full systematic review, which is expected to start in September 2024 and be completed to be submitted for publication by early 2025. Conclusions: The findings are expected to identify the quality of materials evaluated by the PEMAT and the areas under evaluation. This review can also highlight gaps that exist in research and practice for improving the understandability and actionability of the materials, offering deeper insights into how existing materials can facilitate patient and public action. International Registered Report Identifier (IRRID): PRR1-10.2196/63489