The seminal work of Gatys et al. demonstrated the power of Convolutional Neural Networks (CNNs) in creating artistic imagery by separating and recombining image content and style. This process of using CNNs to render a content image in different styles is referred to as Neural Style Transfer (NST). Since then, NST has become a trending topic both in academic literature and industrial applications. It is receiving increasing attention and a variety of approaches are proposed to either improve or extend the original NST algorithm. In this paper, we aim to provide a comprehensive overview of the current progress towards NST. We first propose a taxonomy of current algorithms in the field of NST. Then, we present several evaluation methods and compare different NST algorithms both qualitatively and quantitatively. The review concludes with a discussion of various applications of NST and open problems for future research. A list of papers discussed in this review, corresponding codes, pre-trained models and more comparison results are publicly available at: https://osf.io/f8tu4/.
3 May 2022 in IEEE Transactions on Image Processing
Knowledge distillation (KD) has become a well established paradigm for compressing deep neural networks. The typical way of conducting knowledge distillation is to train the student network under the supervision of the teacher network to harness the knowledge at one or multiple spots ( i.e. , layers) in the teacher network. The distillation spots, once specified, will not change for all the training samples, throughout the whole distillation process. In this work, we argue that distillation spots should be adaptive to training samples and distillation epochs. We thus propose a new distillation strategy, termed spot-adaptive KD (SAKD), to adaptively determine the distillation spots in the teacher network per sample, at every training iteration during the whole distillation period. As SAKD actually focuses on “where to distill” instead of “what to distill” that is widely investigated by most existing works, it can be seamlessly integrated into existing distillation methods to further improve their performance. Extensive experiments with 10 state-of-the-art distillers are conducted to demonstrate the effectiveness of SAKD for improving their distillation performance, under both homogeneous and heterogeneous distillation settings. Code is available at https://github.com/zju-vipa/spot-adaptive-pytorch .
Artificial intelligence (AI) offers transformative potential in pathology, where histopathological images remain the diagnostic gold standard due to their rich morphological and molecular information. While the rapid development of AI-driven computational pathology tools is revolutionizing disease interpretation, these technologies have not yet been systematically evaluated. Therefore, this review systematically evaluates AI applications across the diagnostic continuum, from image preprocessing and tumor classification to prognostic stratification and the discovery of predictive biomarkers. It presents a technical taxonomy of the algorithms and foundation models powering these applications, benchmarking their performance across diverse diagnostic tasks through rigorous comparative analyses. It also identifies critical challenges in clinical translation, including computational scaling, noisy annotations, interpretability gaps, and domain shifts. Finally, it proposes a roadmap for advancing AI applications in precision oncology and pathological research. By bridging technological innovation with clinical needs, this review aims to accelerate the integration of robust, unified, scalable AI solutions into diagnostic workflows.