8 May 2023 in IEEE Access
Knowledge Distillation (KD) is designed to train smaller student models using a larger pretrained teacher model. However, in decentralized data systems such as blockchain, privacy concerns may arise, making the data inaccessible. To address this issue, Data-Free KD (DFKD) methods have been proposed, which extract prior knowledge from teacher networks and use it to synthesize data for KD. Previous DFKD methods faced challenges due to the large search space of data generation. Recently, deep generative models (DGMs) have been proposed to learn data distribution using deep networks, which provides an efficient way to reduce the search space by generating a set of pseudo data. In this paper, we explore the performance of KD trained using pseudo samples generated by pretrained DGMs and find that the correlation with image quality is not always positive. Based on this observation, we propose a new DFKD framework called Generative Knowledge Distillation (GenKD) that reduces the search space by constructing a prior distribution modeled by DGMs for their power of likelihood estimation. Specifically, we use energy-based models (EBM) to generate data from the Maximum Likelihood Estimation (MLE) of the EBM and gradients from downstream KD tasks by policy gradient. We then train the student model using the pretrained teacher model and pseudo samples. We also implement our GenKD framework on several widely-used benchmarks, including CIFAR100, CIFAR10, and SVHN. Our experiments demonstrate that we can generate high-quality pseudo samples quantitatively and qualitatively using GenKD. Additionally, the top-1 accuracy of the student network can approach state-of-the-art (SOTA) DFKD methods trained using fewer pseudo samples and less generation time.
20 January 2022 in IEEE Access
Public-key dual-receiver encryption (PK-DRE) is a kind of particular public-key encryption for enabling two independent recipients to obtain the same plaintext from the same ciphertext. Due to its dual-receiver property, PK-DRE is quite helpful in many scenarios, such as deniable authentication, global key escrow, security puzzle, and even blockchain. To the best of our knowledge, the PK-DRE scheme proposed by Chow, Franklin, and Zhang at CT-RSA 2014 is the best one among the existing schemes in terms of security, public verifiability, and key size. In this paper, we restudy their scheme and find a new security proof that leads to a variant. The resulting PK-DRE scheme is more efficient than the original scheme in terms of ciphertext size and encryption/decryption cost, without losing the CCA security in the standard model and public verifiability.
1 June 2021 in IOP Conference Series: Earth and Environmental Science
Vertical integration is one of the important means to achieve coal-electricity joint ventures. According to the comprehensive analysis of domestic and foreign literature, based on the field survey, nine key drivers of vertical integration of coal-electric energy supply chain are proposed. This basis, using interpretative structural modelling (ISM), a five-level hierarchical structure model of the vertical integration motivation of the coal-electric energy supply chain is constructed, which clearly characterization of the hierarchical relationship between the various drivers. Using MICMAC, find the independent and dependent factors. Furthermore, it reveals the most direct motivation and the most fundamental motivation for driving the vertical integration of coal-electric energy supply chain. At the same time, it can clearly show the role of each driver in the vertical integration of coal-fired energy supply chain.