Digital transformation, characterised by advanced digitalisation, blockchain, the Internet of Things, artificial intelligence, machine learning technologies, and robotics, has played a key role in revolutionising various industries, especially the healthcare sector. The adoption of and transition (from traditional) to new technology will bring challenges, opportunities, and disruptions to existing healthcare systems. According to the European Union, we must pursue both digital and green transitions to achieve sustainable, human-centric, and resilient industries to achieve a world of prosperity for all. The study aims to present a novel approach to education and training in the digital health field that is inspired by the fifth industrial revolution paradigm. The paper highlights the role of training and education interventions that are required to support digital health in the future so that students can develop the capacity to recognise and exploit the potential of new technologies. This article will briefly discuss the challenges and opportunities related to healthcare systems in the era of digital transformation and beyond. Then, we look at the enabling technologies from an Industry 5.0 perspective that supports digital health. Finally, we present a new teaching and learning paradigm and strategies that embed Industry 5.0 technologies in academic curricula so that students can develop their capacities to embrace a digital future and minimise the disruption that will inevitably accompany it. By incorporating Industry 5.0 principles into digital health education, we believe students can gain a deeper understanding of the industry and develop skills that will enable them to deliver a more efficient, effective, and sustainable healthcare system.
Omnidirectional Videos (or 360° videos) are widely used in Virtual Reality (VR) to facilitate immersive and interactive viewing experiences. However, the limited spatial resolution in 360° videos does not allow for each degree of view to be represented with adequate pixels, limiting the visual quality offered in the immersive experience. Deep learning Video Super-Resolution (VSR) techniques used for conventional videos could provide a promising software-based solution; however, these techniques do not tackle the distortion present in equirectangular projections of 360° video signals. An additional obstacle is the limited 360° video datasets to study. To address these issues, this paper creates a novel 360° Video Dataset (360VDS) with a study of the extensibility of conventional VSR models to 360° videos. This paper further proposes a novel deep learning model for 360° Video Super-Resolution (360° VSR), called Spherical Signal Super-resolution with a Proportioned Optimisation (S3PO). S3PO adopts recurrent modelling with an attention mechanism, unbound from conventional VSR techniques like alignment. With a purpose-built feature extractor and a novel loss-function addressing spherical distortion, S3PO outperforms most state-of-the-art conventional VSR models and 360° specific super-resolution models on 360° video datasets. A step-wise ablation study is presented to understand and demonstrate the impact of the chosen architectural sub-components, targeted training and optimisation.
17 May 2024 in IEEE Transactions on Emerging Topics in Computational Intelligence
Video super-resolution (VSR) is a prominent research topic in low-level computer vision, where deep learning technologies have played a significant role. The rapid progress in deep learning and its applications in VSR has led to a proliferation of tools and techniques in the literature. However, the usage of these methods is often not adequately explained, and decisions are primarily driven by quantitative improvements. Given the significance of VSR's potential influence across multiple domains, it is imperative to conduct a comprehensive analysis of the elements and deep learning methodologies employed in VSR research. This methodical analysis will facilitate the informed development of models tailored to specific application needs. In this paper, we present an overarching overview of deep learning-based video super-resolution models, investigating each component and discussing its implications. Furthermore, we provide a synopsis of key components and technologies employed by state-of-the-art and earlier VSR models. By elucidating the underlying methodologies and categorising them systematically, we identified trends, requirements, and challenges in the domain. As a first-of-its-kind survey of deep learning-based VSR models, this work also establishes a multi-level taxonomy to guide current and future VSR research, enhancing the maturation and interpretation of VSR practices for various practical applications.
22 June 2016 in IEEE Transactions on Circuits and Systems for Video Technology
High Efficiency Video Coding achieves twofold coding efficiency improvement compared with its predecessor H.264/MPEG-4 Advanced Video Coding. However, it suffers from high computational complexity due to its quad-tree structure in motion estimation (ME). This paper exposes the use of depth maps in the multiview video plus depth format for relieving the computational burden. The depth map provides an intimation of the objects' distance from the projected screen in a 3D scene, which is explored in adaptive search range determination in this paper. The proposed algorithm exploits the high temporal correlation between the depth map and the motion in texture. By utilizing this correlation, a depth/motion relationship map is built for a mapping process. For each block, this forms a tailor-made search range with a motion-aware asymmetric shape to skip unnecessary search points in ME. The obtained search range can be further adjusted by taking the influence of 3D-to-2D projection into consideration. Simulation results reveal that, compared to the full search approach, the proposed algorithm can reduce the complexity by 93% on average, whereas the coding efficiency can be maintained. Besides, the proposed search range determination can work well with other fast search ME algorithms in the literature.
High‐efficiency video coding (HEVC) outperforms H.264/AVC by providing a bitrate reduction of about 50% while having almost the same perceptual quality. It adopts more flexible partitioning in motion estimation (ME) which gains higher coding efficiency at a cost of increased coding complexity. Depth maps in the emerging multi‐view plus depth videos are exploited to adjust the search range in ME for HEVC complexity reduction. With the aid of depth intensity variations among neighbouring blocks, the proposed algorithm derives weights to the neighbouring blocks and establishes an adaptive search range according to the weighted sum of the motion vectors from the neighbouring blocks. Compared with the fast test zone (TZS) search in HEVC, the proposed algorithm saves 65% coding time in ME on average with insignificant rate‐distortion degradation.
This paper presents a novel approach to video super-resolution (VSR) by focusing on the selection of input frames, a process critical to VSR. VSR methods typically rely on deep learning techniques, those that are able to learn features from a large dataset of low-resolution (LR) and corresponding high-resolution (HR) videos and generate high-quality HR frames from any new LR input frames using the learned features. However, these methods often use as input the immediate neighbouring frames to a given target frame without considering the importance and dynamics of the frames across the temporal dimension of a video. This work aims to address the limitations of the conventional sliding-window mechanisms by developing input frame selection algorithms. By dynamically selecting the most representative neighbouring frames based on content-aware selection measures, our proposed algorithms enable VSR models to extract more informative and accurate features that are better aligned with the target frame, leading to improved performance and higher-quality HR frames. Through an empirical study, we demonstrate that the proposed dynamic content-aware selection mechanism improves super-resolution results without any additional architectural overhead, offering a counter-intuitive yet effective alternative to the long-established trend of increasing architectural complexity to improve VSR results.