Industrial process tomography (IPT) based process control is an advisable approach in industrial heating processes for improving system efficiency and quality. When using it, appropriate dataflow pipelines and visualizations are key for domain users to implement precise data acquisition and analysis. In this article, we propose a complete data processing and visualizing workflow regarding a specific case—microwave tomography (MWT) controlled industrial microwave drying system. Furthermore, we present the up-to-date augmented reality (AR) technique to support the corresponding data visualization and on-site analysis. As a pioneering study of using AR to benefit IPT systems, the proposed AR module provides straightforward and comprehensible visualizations pertaining to the process data to the related users. Inside the dataflow of the case, a time reversal imaging algorithm, a post-imaging segmentation, and a volumetric visualization module are included. For the time reversal algorithm, we exhaustively introduce each step for MWT image reconstruction and then present the simulated results. For the post-imaging segmentation, an automatic tomographic segmentation algorithm is utilized to reveal the significant information contained in the reconstructed images. For volumetric visualization, the 3D generated information is displayed. Finally, the proposed AR system is integrated with the on-going process data, including reconstructed, segmented, and volumetric images, which are used for facilitating interactive on-site data analysis for domain users. The central part of the AR system is implemented by a mobile app that is currently supported on iOS/Android platforms.

The design of colormaps can help tomography operators obtain accurate visual comprehension, thereby assisting safety-critical decisions. The research presented here is about deploying colormaps that promote the best affective responses for industrial microwave tomography (MWT). To answer the two research questions related to our study, we firstly conducted a quantitative analysis of 11 frequently-used colormaps on a segmentation task. Secondly, we presented the same colormaps within a crowdsourced study comprising two parts to verify the quantitative outcomes. The first part encoded affective responses from participants into a prevailing four-quadrant valence–arousal grid; the second part recorded participant ratings towards the accuracy of each colormap on MWT segmentation. We concluded that three colormaps are the best suited in the context of MWT tasks. We also found that the colormaps triggering emotions in the positive–exciting quadrant can facilitate more accurate visual comprehension than other affect-related quadrants. A synthetic colormap design guideline was consequently proposed.

The increasing prevalence of voice assistants in daily life has transformed human-technology interaction. However, current voice assistants fall short in their ability to comprehend users’ emotional states through speech and respond empathetically. This limitation leads to suboptimal user experiences and missed opportunities for personalization. To address this gap, this paper presents a groundbreaking prototype of a future voice assistant equipped with the capability to recognize and respond to users’ emotional states. The paper outlines the architecture of a speech-emotion recognition system that utilizes a deep neural network incorporating a sparse attention mechanism, yielding promising results. Furthermore, the paper embarks on an initial exploration of strategies for emotion-based responses, drawing inspiration from human techniques for managing unpleasant emotions. A user study is conducted, exposing participants to emotions such as anger, sadness, and fear, while engaging the voice assistant to elicit happiness. Preliminary findings suggest a tendency toward neutral emotional responses, providing valuable insights into the potential of speech feature analysis as an alternative approach for identifying and responding to emotions.