Automated medical image analysis systems often require large amounts of training data with high quality labels, which are difficult and time consuming to generate. This paper introduces Radiology Object in COntext version 2 (ROCOv2), a multimodal dataset consisting of radiological images and associated medical concepts and captions extracted from the PMC Open Access subset. It is an updated version of the ROCO dataset published in 2018, and adds 35,705 new images added to PMC since 2018. It further provides manually curated concepts for imaging modalities with additional anatomical and directional concepts for X-rays. The dataset consists of 79,789 images and has been used, with minor modifications, in the concept detection and caption prediction tasks of ImageCLEFmedical Caption 2023. The dataset is suitable for training image annotation models based on image-caption pairs, or for multi-label image classification using Unified Medical Language System (UMLS) concepts provided with each image. In addition, it can serve for pre-training of medical domain models, and evaluation of deep learning models for multi-task learning.
The European Commission’s recommendation on the definition of nanomaterial (2011/696/EU) established an applicable standard for material categorization. However, manufacturers face regulatory challenges during registration of their products. Reliable categorization is difficult and requires considerable expertise in existing measurement techniques (MTs). Additionally, organizational complexity is increased as different authorities’ registration processes require distinct reporting. The NanoDefine project tackled these obstacles by providing the NanoDefiner e-tool: A decision support expert system for nanomaterial identification in a regulatory context. It provides MT recommendations for categorization of specific materials using a tiered approach (screening/confirmatory), and was constructed with experts from academia and industry to be extensible, interoperable, and adaptable for forthcoming revisions of the nanomaterial definition. An implemented MT-driven material categorization scheme allows detailed description. Its guided workflow is suitable for a variety of user groups. Direct feedback and explanation enable transparent decisions. Expert knowledge is held in a knowledge base for representation of MT performance criteria and physicochemical particle type properties. Continuous revision ensured data quality and validity. Recommendations were validated by independent case studies on industry-relevant particulate materials. Besides supporting material identification and registration, the free and open-source e-tool may serve as template for other expert systems within the nanoscience domain.
The new recommended definition of a nanomaterial, 2022/C 229/01, adopted by the European Commission in 2022, will have a considerable impact on European Union legislation addressing chemicals, and therefore tools to implement this new definition are urgently needed. The updated NanoDefiner framework and its e-tool implementation presented here are such instruments, which help stakeholders to find out in a straightforward way whether a material is a nanomaterial or not. They are two major outcomes of the NanoDefine project, which is explicitly referred to in the new definition. This work revisits the framework and e-tool, and elaborates necessary adjustments to make these outcomes applicable for the updated recommendation. A broad set of case studies on representative materials confirms the validity of these adjustments. To further foster the sustainability and applicability of the framework and e-tool, measures for the FAIRification of expert knowledge within the e-tool’s knowledge base are elaborated as well. The updated framework and e-tool are now ready to be used in line with the updated recommendation. The presented approach may serve as an example for reviewing existing guidance and tools developed for the previous definition 2011/696/EU, particularly those adopting NanoDefine project outcomes.
Diagrams are widely used to visualize data in publications. The research field of data visualization deals with defining principles and guidelines for the creation and use of these diagrams, which are often not known or adhered to by researchers, leading to misinformation caused by providing inaccurate or incomplete information. In this work, large Vision Language Models (VLMs) are used to analyze diagrams in order to identify potential problems in regards to selected data visualization principles and guidelines. To determine the suitability of VLMs for these tasks, five open source VLMs and five prompting strategies are compared using a set of questions derived from selected data visualization guidelines. The results show that the employed VLMs work well to accurately analyze diagram types (F1-score 82.49 %), 3D effects (F1-score 98.55 %), axes labels (F1-score 76.74 %), lines (RMSE 1.16), colors (RMSE 1.60) and legends (F1-score 96.64 %, RMSE 0.70), while they cannot reliably provide feedback about the image quality (F1-score 0.74 %) and tick marks/labels (F1-score 46.13 %). Among the employed VLMs, Qwen2.5VL performs best, and the summarizing prompting strategy performs best for most of the experimental questions. It is shown that VLMs can be used to automatically identify a number of potential issues in diagrams, such as missing axes labels, missing legends, and unnecessary 3D effects. The approach laid out in this work can be extended for further aspects of data visualization.