17 September 2024 in IEEE Transactions on Visualization and Computer Graphics
We apply an approach from cognitive linguistics by mapping Conceptual Metaphor Theory (CMT) to the visualization domain to address patterns of visual conceptual metaphors that are often used in science infographics. Metaphors play an essential part in visual communication and are frequently employed to explain complex concepts. However, their use is often based on intuition, rather than following a formal process. At present, we lack tools and language for understanding and describing metaphor use in visualization to the extent where taxonomy and grammar could guide the creation of visual components, e.g., infographics. Our classification of the visual conceptual mappings within scientific representations is based on the breakdown of visual components in existing scientific infographics. We demonstrate the development of this mapping through a detailed analysis of data collected from four domains (biomedicine, climate, space, and anthropology) that represent a diverse range of visual conceptual metaphors used in the visual communication of science. This work allows us to identify patterns of visual conceptual metaphor use within the domains, resolve ambiguities about why specific conceptual metaphors are used, and develop a better overall understanding of visual metaphor use in scientific infographics. Our analysis shows that ontological and orientational conceptual metaphors are the most widely applied to translate complex scientific concepts. To support our findings we developed a visual exploratory tool based on the collected database that places the individual infographics on a spatio-temporal scale and illustrates the breakdown of visual conceptual metaphors.
6 November 2023 in PLOS ONE
The representations of biochemical processes must balance visual portrayals with descriptive content to be an effective learning tool. To determine what type of representation is the most suitable for education, we designed five different representations of adenosine triphosphate (ATP) synthesis and examined how they are perceived. Our representations consisted of an overview of the process in a detailed and abstract illustrative format, continuous video formats with and without narration, and a combined illustrative overview with dynamic components. The five representations were evaluated by non-experts who were randomly assigned one of them and experts who viewed and compared all five representations. Subsequently, we conducted a focus group on the outcomes of these evaluations, which gave insight into possible explanations of our results, where the non-experts preferred the detailed static representation and found the narrated video least helpful, in contradiction to the experts who favored the narrated video the most.
12 January 2022 in Journal of Visual Communication in Medicine
This paper focuses on the method for creating 3-dimensional (3D) digital models extracted from patient- specific scans of the brain. The described approach consists of several cross-platform stages: raw data segmentation, data correction in 3D-modelling software, post-processing of the 3D digital models and their presentation on an interactive web-based platform. This method of data presentation offers a cost and time effective option to present medical data accurately. An important aspect of the process is using real patient data and enriching the traditional slice-based representation of the scans with 3D models that can provide better understanding of the organs’ structures. The resulting 3D digital models also form the basis for further processing into different modalities, for example models in Virtual Reality or 3D physical model printouts. The option to make medical data less abstract and more understandable can extend their use beyond diagnosis and into a potential aid in anatomy and patient education. The methods presented in this paper were originally based on the master thesis ‘Transparent Minds: Testing for Efficiency of Transparency in 3D Physical and 3D Digital Models’, which focussed on creating and comparing the efficiency of transparent 3D physical and 3D digital models from real-patient data.
25 October 2024 in Behaviour & Information Technology
1 February 2024 in Leonardo
Both the conception of how people connect changes with the evolution of technology and the circumstances under which we interact changed drastically with the onset of the global COVID-19 pandemic and have changed again during the decline of the pandemic threat. With the art installation Cartography of Touch, the author uses digital and physical media (3D printing and projection mapping of human physiology) to demonstrate the need for human touch. The installation depicts response to touch as the joining of the technological age and the need for essential human interaction through physical touch, which cannot be replaced, using plastic human hands with artificial responses.