Daiki Yokokawa

Dr. Daiki Yokokawa

orcid

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 October 2023 in JMIR Formative Research
Verified
Journal Article
Open access
YYYasutaka Yanagita
Yasutaka Yanagita
DYDaiki Yokokawa
Daiki Yokokawa
SUShun Uchida
Shun Uchida
JTJunsuke Tawara
Junsuke Tawara
MIMasatomi Ikusaka
Masatomi Ikusaka
Background: ChatGPT (OpenAI) has gained considerable attention because of its natural and intuitive responses. ChatGPT sometimes writes plausible-sounding but incorrect or nonsensical answers, as stated by OpenAI as a limitation. However, considering that ChatGPT is an interactive AI that has been trained to reduce the output of unethical sentences, the reliability of the training data is high and the usefulness of the output content is promising. Fortunately, in March 2023, a new version of ChatGPT, GPT-4, was released, which, according to internal evaluations, was expected to increase the likelihood of producing factual responses by 40% compared with its predecessor, GPT-3.5. The usefulness of this version of ChatGPT in English is widely appreciated. It is also increasingly being evaluated as a system for obtaining medical information in languages other than English. Although it does not reach a passing score on the national medical examination in Chinese, its accuracy is expected to gradually improve. Evaluation of ChatGPT with Japanese input is limited, although there have been reports on the accuracy of ChatGPT’s answers to clinical questions regarding the Japanese Society of Hypertension guidelines and on the performance of the National Nursing Examination. Objective: The objective of this study is to evaluate whether ChatGPT can provide accurate diagnoses and medical knowledge for Japanese input. Methods: Questions from the National Medical Licensing Examination (NMLE) in Japan, administered by the Japanese Ministry of Health, Labour and Welfare in 2022, were used. All 400 questions were included. Exclusion criteria were figures and tables that ChatGPT could not recognize; only text questions were extracted. We instructed GPT-3.5 and GPT-4 to input the Japanese questions as they were and to output the correct answers for each question. The output of ChatGPT was verified by 2 general practice physicians. In case of discrepancies, they were checked by another physician to make a final decision. The overall performance was evaluated by calculating the percentage of correct answers output by GPT-3.5 and GPT-4. Results: Of the 400 questions, 292 were analyzed. Questions containing charts, which are not supported by ChatGPT, were excluded. The correct response rate for GPT-4 was 81.5% (237/292), which was significantly higher than the rate for GPT-3.5, 42.8% (125/292). Moreover, GPT-4 surpassed the passing standard (>72%) for the NMLE, indicating its potential as a diagnostic and therapeutic decision aid for physicians. Conclusions: GPT-4 reached the passing standard for the NMLE in Japan, entered in Japanese, although it is limited to written questions. As the accelerated progress in the past few months has shown, the performance of the AI will improve as the large language model continues to learn more, and it may well become a decision support system for medical professionals by providing more accurate information.

8 April 2024 in JMIR Medical Education
Verified
Journal Article
Open access
FFFumitoshi Fukuzawa
Fumitoshi Fukuzawa
YYYasutaka Yanagita
Yasutaka Yanagita
DYDaiki Yokokawa
Daiki Yokokawa
SUShun Uchida
Shun Uchida
SYShiho Yamashita
Shiho Yamashita
MIMasatomi Ikusaka
Masatomi Ikusaka
Background: Medical history contributes approximately 80% to a diagnosis, although physical examinations and laboratory investigations increase a physician’s confidence in the medical diagnosis. The concept of artificial intelligence (AI) was first proposed more than 70 years ago. Recently, its role in various fields of medicine has grown remarkably. However, no studies have evaluated the importance of patient history in AI-assisted medical diagnosis. Objective: This study explored the contribution of patient history to AI-assisted medical diagnoses and assessed the accuracy of ChatGPT in reaching a clinical diagnosis based on the medical history provided. Methods: Using clinical vignettes of 30 cases identified in The BMJ , we evaluated the accuracy of diagnoses generated by ChatGPT. We compared the diagnoses made by ChatGPT based solely on medical history with the correct diagnoses. We also compared the diagnoses made by ChatGPT after incorporating additional physical examination findings and laboratory data alongside history with the correct diagnoses. Results: ChatGPT accurately diagnosed 76.6% (23/30) of the cases with only the medical history, consistent with previous research targeting physicians. We also found that this rate was 93.3% (28/30) when additional information was included. Conclusions: Although adding additional information improves diagnostic accuracy, patient history remains a significant factor in AI-assisted medical diagnosis. Thus, when using AI in medical diagnosis, it is crucial to include pertinent and correct patient histories for an accurate diagnosis. Our findings emphasize the continued significance of patient history in clinical diagnoses in this age and highlight the need for its integration into AI-assisted medical diagnosis systems.

23 January 2023 in PLOS ONE
Verified
Journal Article
Open access
PDF file
KIKosuke Ishizuka
Kosuke Ishizuka
KSKiyoshi Shikino
Kiyoshi Shikino
HTHiroki Tamura
Hiroki Tamura
DYDaiki Yokokawa
Daiki Yokokawa
YYYasutaka Yanagita
Yasutaka Yanagita
MIMasatomi Ikusaka
Masatomi Ikusaka
This study aims to compare the effectiveness of Hybrid and Pure problem-based learning (PBL) in teaching clinical reasoning skills to medical students. The study sample consisted of 99 medical students participating in a clerkship rotation at the Department of General Medicine, Chiba University Hospital. They were randomly assigned to Hybrid PBL (intervention group, n = 52) or Pure PBL group (control group, n = 47). The quantitative outcomes were measured with the students’ perceived competence in PBL, satisfaction with sessions, and self-evaluation of competency in clinical reasoning. The qualitative component consisted of a content analysis on the benefits of learning clinical reasoning using Hybrid PBL. There was no significant difference between intervention and control groups in the five students’ perceived competence and satisfaction with sessions. In two-way repeated measure analysis of variance, self-evaluation of competency in clinical reasoning was significantly improved in the intervention group in "recalling appropriate differential diagnosis from patient’s chief complaint" (F(1,97) = 5.295, p = 0.024) and "practicing the appropriate clinical reasoning process" (F(1,97) = 4.016, p = 0.038). According to multiple comparisons, the scores of "recalling appropriate history, physical examination, and tests on clinical hypothesis generation" (F(1,97) = 6.796, p = 0.011), "verbalizing and reflecting appropriately on own mistakes," (F(1,97) = 4.352, p = 0.040) "selecting keywords from the whole aspect of the patient," (F(1,97) = 5.607, p = 0.020) and "examining the patient while visualizing his/her daily life" (F(1,97) = 7.120, p = 0.009) were significantly higher in the control group. In the content analysis, 13 advantage categories of Hybrid PBL were extracted. In the subcategories, "acquisition of knowledge" was the most frequent subcategory, followed by "leading the discussion," "smooth discussion," "getting feedback," "timely feedback," and "supporting the clinical reasoning process." Hybrid PBL can help acquire practical knowledge and deepen understanding of clinical reasoning, whereas Pure PBL can improve several important skills such as verbalizing and reflecting on one’s own errors and selecting appropriate keywords from the whole aspect of the patient.

17 June 2022 in PLOS ONE
Verified
Journal Article
Open access
PDF file
SUShun Uchida
Shun Uchida
KSKiyoshi Shikino
Kiyoshi Shikino
KIKosuke Ishizuka
Kosuke Ishizuka
YYYosuke Yamauchi
Yosuke Yamauchi
YYYasutaka Yanagita
Yasutaka Yanagita
MIMasatomi Ikusaka
Masatomi Ikusaka
Deep tendon reflexes (DTR) are a prerequisite skill in clinical clerkships. However, many medical students are not confident in their technique and need to be effectively trained. We evaluated the effectiveness of a flipped classroom for teaching DTR skills. We recruited 83 fifth-year medical students who participated in a clinical clerkship at the Department of General Medicine, Chiba University Hospital, from November 2018 to July 2019. They were allocated to the flipped classroom technique (intervention group, n = 39) or the traditional technique instruction group (control group, n = 44). Before procedural teaching, while the intervention group learned about DTR by e-learning, the control group did so face-to-face. A 5-point Likert scale was used to evaluate self-confidence in DTR examination before and after the procedural teaching (1 = no confidence, 5 = confidence). We evaluated the mastery of techniques after procedural teaching using the Direct Observation of Procedural Skills (DOPS). Unpaired t-test was used to analyze the difference between the two groups on the 5-point Likert scale and DOPS. We assessed self-confidence in DTR examination before and after procedural teaching using a free description questionnaire in the two groups. Additionally, in the intervention group, focus group interviews (FGI) (7 groups, n = 39) were conducted to assess the effectiveness of the flipped classroom after procedural teaching. Pre-test self-confidence in the DTR examination was significantly higher in the intervention group than in the control group (2.8 vs. 2.3, P = 0.005). Post-test self-confidence in the DTR examination was not significantly different between the two groups (3.9 vs. 4.1, P = 0.31), and so was mastery (4.3 vs. 4.1, P = 0.68). The questionnaires before the procedural teaching revealed themes common to the two groups, including “lack of knowledge” and “lack of self-confidence.” Themes about prior learning, including “acquisition of knowledge” and “promoting understanding,” were specific in the intervention group. The FGI revealed themes including “application of knowledge,” “improvement in DTR technique,” and “increased self-confidence.” Based on these results, teaching DTR skills to medical students in flipped classrooms improves readiness for learning and increases self-confidence in performing the procedure at a point before procedural teaching.

29 February 2024 in JMIR Medical Education
Verified
Journal Article
Open access
KSKiyoshi Shikino
Kiyoshi Shikino
YNYuji Nishizaki
Yuji Nishizaki
SFSho Fukui
Sho Fukui
DYDaiki Yokokawa
Daiki Yokokawa
YYYu Yamamoto
Yu Yamamoto
Yasuharu TokudaYasuharu Tokuda
Yasuharu Tokuda
Background: Medical students in Japan undergo a 2-year postgraduate residency program to acquire clinical knowledge and general medical skills. The General Medicine In-Training Examination (GM-ITE) assesses postgraduate residents’ clinical knowledge. A clinical simulation video (CSV) may assess learners’ interpersonal abilities. Objective: This study aimed to evaluate the relationship between GM-ITE scores and resident physicians’ diagnostic skills by having them watch a CSV and to explore resident physicians’ perceptions of the CSV’s realism, educational value, and impact on their motivation to learn. Methods: The participants included 56 postgraduate medical residents who took the GM-ITE between January 21 and January 28, 2021; watched the CSV; and then provided a diagnosis. The CSV and GM-ITE scores were compared, and the validity of the simulations was examined using discrimination indices, wherein ≥0.20 indicated high discriminatory power and >0.40 indicated a very good measure of the subject’s qualifications. Additionally, we administered an anonymous questionnaire to ascertain participants’ views on the realism and educational value of the CSV and its impact on their motivation to learn. Results: Of the 56 participants, 6 (11%) provided the correct diagnosis, and all were from the second postgraduate year. All domains indicated high discriminatory power. The (anonymous) follow-up responses indicated that the CSV format was more suitable than the conventional GM-ITE for assessing clinical competence. The anonymous survey revealed that 12 (52%) participants found the CSV format more suitable than the GM-ITE for assessing clinical competence, 18 (78%) affirmed the realism of the video simulation, and 17 (74%) indicated that the experience increased their motivation to learn. Conclusions: The findings indicated that CSV modules simulating real-world clinical examinations were successful in assessing examinees’ clinical competence across multiple domains. The study demonstrated that the CSV not only augmented the assessment of diagnostic skills but also positively impacted learners’ motivation, suggesting a multifaceted role for simulation in medical education.

12 April 2022 in BMJ Open
Verified
Journal Article
Open access
PDF file
DYDaiki Yokokawa
Daiki Yokokawa
KSKiyoshi Shikino
Kiyoshi Shikino
YKYasuhiro Kishi
Yasuhiro Kishi
TBToshiaki Ban
Toshiaki Ban
SMShigeyoshi Miyahara
Shigeyoshi Miyahara
MIMasatomi Ikusaka
Masatomi Ikusaka
Objective To clarify the factors associated with prolonged hospital stays, focusing on the COMplexity PRediction Instrument (COMPRI) score’s accuracy in predicting the length of stay of newly hospitalised patients in general internal medicine wards. Design A case–control study. Setting Three general internal medicine wards in Chiba Prefecture, Japan. Participants Thirty-four newly hospitalised patients were recruited between November 2017 and December 2019, with a final analytic sample of 33 patients. We included hospitals in different cities with general medicine outpatient and ward facilities, who agreed to participate. We excluded any patients who were re-hospitalised within 2 weeks of a prior discharge. Primary and secondary outcome measures Patients’ COMPRI scores and their consequent lengths of hospital stay. Results The 17 patients (52%) allocated to the long-term hospitalisation group (those hospitalised ≥14 days) had a significantly higher average age, COMPRI score and percentage of participants with comorbid chronic illnesses than the short-term hospitalisation group (<14 days). A logistic regression model (model A, comprising only the COMPRI score as the explanatory variable) and a multiple logistic regression model (model B, comprising variables other than the COMPRI score as explanatory variables) were created as prediction models for the long-term hospitalisation group. When age ≥75 years, a COMPRI score ≥6 and a physician with 10 years’ experience were set as explanatory variables, model A showed better predictive accuracy compared with model B (fivefold cross-validation, area under curve of 0.87 vs 0.78). The OR of a patient with a COMPRI score of ≥6 joining the long-term hospitalisation group was 4.25 (95% CI=1.43 to 12.63). Conclusions Clinicians can use the COMPRI score when screening for complexity assessment to identify hospitalised patients at high risk of prolonged hospitalisation. Providing such patients with multifaceted and intensive care may shorten hospital stays.