1 November 2021 in IEEE Access
The steadily increasing number of medical images places a tremendous burden on doctors, who toned to read and write reports. If an image captioning model could generate drafts of the reports from the corresponding images, the workload of doctors would be reduced, thereby saving time and expenses. The aim of this study was to develop a chest x-ray image captioning model that considers the differences between patient images and normal images, and uses hierarchical long short-term memory (LSTM) or a transformer as a decoder to generate reports. We investigated which feature representation method was the most appropriate for capturing the differences. The feature representations differed in terms of whether global average pooling was used for the visual feature vectors and how the feature difference vectors were generated. Experiments were conducted on two datasets using the proposed models and recent captioning models (X-LAN and X-Transformer). BLEU, METEOR, ROUGE-L, and CIDEr were used as evaluation metrics. The best model for most metric scores was the multi-difference non-average-pooling transformer model, which uses the transformer decoder, does not use global average pooling for the visual feature vectors, and applies the element-wise product. The transformer decoder was found to be more suitable than hierarchical LSTM. Furthermore, for models that do not condense features with global average pooling, the element-wise product was observed to be more effective than subtraction in expressing the feature differences.
31 July 2023 in Healthcare Informatics Research
Objectives: In the era of the Fourth Industrial Revolution, where an ecosystem is being developed to enhance the quality of healthcare services by applying information and communication technologies, systematic and sustainable data management is essential for medical institutions. In this study, we assessed the data management status and emerging concerns of three medical institutions, while also examining future directions for seamless data management.Methods: To evaluate the data management status, we examined data types, capacities, infrastructure, backup methods, and related organizations. We also discussed challenges, such as resource and infrastructure issues, problems related to government regulations, and considerations for future data management.Results: Hospitals are grappling with the increasing data storage space and a shortage of management personnel due to costs and project termination, which necessitates countermeasures and support. Data management regulations on the destruction or maintenance of medical records are needed, and institutional consideration for secondary utilization such as long-term treatment or research is required. Government-level guidelines for facilitating hospital data sharing and mobile patient services should be developed. Additionally, hospital executives at the organizational level need to make efforts to facilitate the clinical validation of artificial intelligence software.Conclusions: This analysis of the current status and emerging issues of data management reveals potential solutions and sets the stage for future organizational and policy directions. If medical big data is systematically managed, accumulated over time, and strategically monetized, it has the potential to create new value.