Kiyoshi Shikino

Kiyoshi Shikino

Auto-generated profile, based on publicly available information

Kiyoshi Shikino

Department of Community-Oriented Medical Education, Chiba University Graduate School of Medicine, Chiba, Japan

Research Focus & Metrics

Academic Career Length

15Years (2012-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
30 November 2023 in JMIR Medical Education
Verified
Journal Article
Open access
ISIkuo Shimizu
Ikuo Shimizu
HKHajime Kasai
Hajime Kasai
KSKiyoshi Shikino
Kiyoshi Shikino
NANobuyuki Araki
Nobuyuki Araki
ZTZaiya Takahashi
Zaiya Takahashi
EKEiryo Kawakami
Eiryo Kawakami
Background: Generative artificial intelligence (GAI), represented by large language models, have the potential to transform health care and medical education. In particular, GAI’s impact on higher education has the potential to change students’ learning experience as well as faculty’s teaching. However, concerns have been raised about ethical consideration and decreased reliability of the existing examinations. Furthermore, in medical education, curriculum reform is required to adapt to the revolutionary changes brought about by the integration of GAI into medical practice and research. Objective: This study analyzes the impact of GAI on medical education curricula and explores strategies for adaptation. Methods: The study was conducted in the context of faculty development at a medical school in Japan. A workshop involving faculty and students was organized, and participants were divided into groups to address two research questions: (1) How does GAI affect undergraduate medical education curricula? and (2) How should medical school curricula be reformed to address the impact of GAI? The strength, weakness, opportunity, and threat (SWOT) framework was used, and cross-SWOT matrix analysis was used to devise strategies. Further, 4 researchers conducted content analysis on the data generated during the workshop discussions. Results: The data were collected from 8 groups comprising 55 participants. Further, 5 themes about the impact of GAI on medical education curricula emerged: improvement of teaching and learning, improved access to information, inhibition of existing learning processes, problems in GAI, and changes in physicians’ professionality. Positive impacts included enhanced teaching and learning efficiency and improved access to information, whereas negative impacts included concerns about reduced independent thinking and the adaptability of existing assessment methods. Further, GAI was perceived to change the nature of physicians’ expertise. Three themes emerged from the cross-SWOT analysis for curriculum reform: (1) learning about GAI, (2) learning with GAI, and (3) learning aside from GAI. Participants recommended incorporating GAI literacy, ethical considerations, and compliance into the curriculum. Learning with GAI involved improving learning efficiency, supporting information gathering and dissemination, and facilitating patient involvement. Learning aside from GAI emphasized maintaining GAI-free learning processes, fostering higher cognitive domains of learning, and introducing more communication exercises. Conclusions: This study highlights the profound impact of GAI on medical education curricula and provides insights into curriculum reform strategies. Participants recognized the need for GAI literacy, ethical education, and adaptive learning. Further, GAI was recognized as a tool that can enhance efficiency and involve patients in education. The study also suggests that medical education should focus on competencies that GAI hardly replaces, such as clinical experience and communication. Notably, involving both faculty and students in curriculum reform discussions fosters a sense of ownership and ensures broader perspectives are encompassed.

8 April 2024 in JMIR Medical Education
Verified
Journal Article
Open access
FFFumitoshi Fukuzawa
Fumitoshi Fukuzawa
YYYasutaka Yanagita
Yasutaka Yanagita
DYDaiki Yokokawa
Daiki Yokokawa
SUShun Uchida
Shun Uchida
SYShiho Yamashita
Shiho Yamashita
MIMasatomi Ikusaka
Masatomi Ikusaka
Background: Medical history contributes approximately 80% to a diagnosis, although physical examinations and laboratory investigations increase a physician’s confidence in the medical diagnosis. The concept of artificial intelligence (AI) was first proposed more than 70 years ago. Recently, its role in various fields of medicine has grown remarkably. However, no studies have evaluated the importance of patient history in AI-assisted medical diagnosis. Objective: This study explored the contribution of patient history to AI-assisted medical diagnoses and assessed the accuracy of ChatGPT in reaching a clinical diagnosis based on the medical history provided. Methods: Using clinical vignettes of 30 cases identified in The BMJ , we evaluated the accuracy of diagnoses generated by ChatGPT. We compared the diagnoses made by ChatGPT based solely on medical history with the correct diagnoses. We also compared the diagnoses made by ChatGPT after incorporating additional physical examination findings and laboratory data alongside history with the correct diagnoses. Results: ChatGPT accurately diagnosed 76.6% (23/30) of the cases with only the medical history, consistent with previous research targeting physicians. We also found that this rate was 93.3% (28/30) when additional information was included. Conclusions: Although adding additional information improves diagnostic accuracy, patient history remains a significant factor in AI-assisted medical diagnosis. Thus, when using AI in medical diagnosis, it is crucial to include pertinent and correct patient histories for an accurate diagnosis. Our findings emphasize the continued significance of patient history in clinical diagnoses in this age and highlight the need for its integration into AI-assisted medical diagnosis systems.

13 August 2021 in BMC Medical Education
Verified
Journal Article
Open access
PDF file
KSKiyoshi Shikino
Kiyoshi Shikino
CRClaudia A. Rosu
Claudia A. Rosu
DYDaiki Yokokawa
Daiki Yokokawa
SSShingo Suzuki
Shingo Suzuki
YHYusuke Hirota
Yusuke Hirota
MIMasatomi Ikusaka
Masatomi Ikusaka
Background: Training for the fundus examination using traditional teaching is challenging, resulting in low generalist physicians’ confidence in performing the funduscopic examination. There is growing evidence suggesting a flexible e-learning video approach’s value in teaching physical examination procedures. However, whether the flexible e-learning video approach is superior to the traditional, face-to-face (F2F) lecture-based teaching for the funduscopic exam and the cognitive processes supporting its effectiveness has not yet been determined.Methods: We conducted a sequential explanatory mixed-method study to compare the flexible e-learning video approach’s effectiveness versus the F2F lecture-based approach for teaching the funduscopic exam to medical students at Chiba University in Japan. Medical students were randomly assigned to either a flexible e-learning video approach group or a F2F lecture approach group. We then quantitatively measured the diagnostic accuracy of funduscopic findings before and after attending the specific classrooms. Next, we conducted student focus groups to explore the students’ thinking processes in the flexible e-learning video approach vs. the F2F lecture-based teaching of fundus examination. The qualitative data were analyzed using the qualitative content analysis method.Results: The mean diagnostic accuracy scores in the post-test significantly increased from pre-test in the intervention group (36.6 to 63.4%,p < 0.001). Post-post comparisons across the two groups revealed a significant difference (intervention group 63.4% vs. control group 34.6%, p < 0.001). Six semi-structured focused group interviews were conducted (n = 36). In the flexible e-learning video approach group, we identified ten categories corresponding to four levels of the revised Bloom’s taxonomy: remember, understand, apply, analyze. Five categories were identified in the traditional F2F lecture approach group corresponding to three revised Bloom’s taxonomy levels: understand, apply, analyze. Interrater reliability was substantial (Cohen’s kappa = 0.81).Conclusions: Teaching medical students funduscopic examination using the flexible e-learning video approach leads to improved diagnostic accuracy of funduscopic examinations. The flexible e-learning video teaching method enabled higher cognitive activity levels than the traditional, lecture-based classroom, as assessed using the revised Bloom’s taxonomy.Trial registration: This study was registered with the University Hospital Medical Information Network Clinical Trials Registry on 08/02/2020 (Unique trial number:UMIN 000039434).

21 June 2024 in JMIR Medical Education
Verified
Journal Article
Open access
KSKiyoshi Shikino
Kiyoshi Shikino
TSTaro Shimizu
Taro Shimizu
Yuki OtsukaYuki Otsuka
Yuki Otsuka
MTMasaki Tago
Masaki Tago
HTHiromizu Takahashi
Hiromizu Takahashi
Yasuharu TokudaYasuharu Tokuda
Yasuharu Tokuda
Background: The persistence of diagnostic errors, despite advances in medical knowledge and diagnostics, highlights the importance of understanding atypical disease presentations and their contribution to mortality and morbidity. Artificial intelligence (AI), particularly generative pre-trained transformers like GPT-4, holds promise for improving diagnostic accuracy, but requires further exploration in handling atypical presentations. Objective: This study aimed to assess the diagnostic accuracy of ChatGPT in generating differential diagnoses for atypical presentations of common diseases, with a focus on the model’s reliance on patient history during the diagnostic process. Methods: We used 25 clinical vignettes from the Journal of Generalist Medicine characterizing atypical manifestations of common diseases. Two general medicine physicians categorized the cases based on atypicality. ChatGPT was then used to generate differential diagnoses based on the clinical information provided. The concordance between AI-generated and final diagnoses was measured, with a focus on the top-ranked disease (top 1) and the top 5 differential diagnoses (top 5). Results: ChatGPT’s diagnostic accuracy decreased with an increase in atypical presentation. For category 1 (C1) cases, the concordance rates were 17% (n=1) for the top 1 and 67% (n=4) for the top 5. Categories 3 (C3) and 4 (C4) showed a 0% concordance for top 1 and markedly lower rates for the top 5, indicating difficulties in handling highly atypical cases. The χ2 test revealed no significant difference in the top 1 differential diagnosis accuracy between less atypical (C1+C2) and more atypical (C3+C4) groups (χ²1=2.07; n=25; P=.13). However, a significant difference was found in the top 5 analyses, with less atypical cases showing higher accuracy (χ²1=4.01; n=25; P=.048). Conclusions: ChatGPT-4 demonstrates potential as an auxiliary tool for diagnosing typical and mildly atypical presentations of common diseases. However, its performance declines with greater atypicality. The study findings underscore the need for AI systems to encompass a broader range of linguistic capabilities, cultural understanding, and diverse clinical scenarios to improve diagnostic utility in real-world settings.

27 May 2022 in BMC Medical Education
Verified
Journal Article
Open access
PDF file
KSKiyoshi Shikino
Kiyoshi Shikino
NINarumi Ide
Narumi Ide
YKYoko Kubota
Yoko Kubota
IIItsuko Ishii
Itsuko Ishii
SIShoichi Ito
Shoichi Ito
ISIkuko Sakai
Ikuko Sakai
Background: Interprofessional collaborative practice competency (ICPC) is key to providing safe, high-quality, accessible, patient-centred care. Effective delirium management, particularly, requires a multi-component intervention, including the use of interprofessional teams at care point. This research aims to investigate the effectiveness of the flipped classroom approach for improving ICPC in simulation-based delirium case management. Method: An embedded mixed-methods study was designed to investigate the effects of the flipped classroom approach on health professionals’ performance in delirium management. The study population comprised nine health professionals (three physicians, nurses, and pharmacists each). They used pre-class study materials about delirium management via a digital learning platform before a simulation case training session. A readiness assurance process test was conducted on key concepts, covered in the pre-class study material. Participants were randomly assigned to three teams, each of which included health professionals. Each team participated in a simulation case scenario. For the quantitative outcome measures, the Chiba Interprofessional Competency Scale (CICS29), a validated scale for measuring competencies of interprofessional practice, was used before, after, and three months after the educational intervention. The qualitative component consisted of a post-training questionnaire and semi-structured focused group interviews about the impact of the flipped classroom approach. Result: The CICS29 measured after the intervention and three months after was noted to be significantly higher than before the intervention. Three semi-structured focused group interviews were conducted (n=9), which, upon analysis revealed that the flipped classroom approach effected on four stages of Bloom's taxonomy level. A total of nine categories and 17 subcategories were identified corresponding to four levels of the revised Bloom’s taxonomy: remember (1), understand (12), apply (23), and analyse (3). Conclusion: The simulation-based skill training using flipped classroom approach can be an effective method for improving ICPC for health professionals. In this approach, an elevated level of cognitive activity is practiced in the Bloom’s taxonomy, and the participants worked on an application-based case simulation that promoted higher level learning and engagement in interprofessional collaborative practice. This approach also established a basic common language of delirium assessment and management, thus facilitating communication among health professionals and improving ICPC.

13 November 2025 in JMIR Medical Education
Verified
Journal Article
Open access
HTHiroshi Tajima
Hiroshi Tajima
HKHajime Kasai
Hajime Kasai
KSKiyoshi Shikino
Kiyoshi Shikino
ISIkuo Shimizu
Ikuo Shimizu
SIShoichi Ito
Shoichi Ito
An April 2025 survey of 118 first-year Japanese medical students found high use of generative artificial intelligence (84.7%) but limited formal learning (49.2%), with strong learning interest yet neutral assignment use, indicating a need for structured literacy in generative artificial intelligence.