Knowledge distillation (KD) is crucial for remote sensing image (RSI) classification, particularly as the operating environment in remote sensing is often constrained by hardware limitations. However, prior research has not fully addressed the challenge of leveraging KD to develop lightweight, high-accuracy models for RSI classification. A key issue is the sparse distribution of training data, which often results in asymmetry within the data. This asymmetry impedes the transfer of prior knowledge during the distillation process, diminishing the overall efficacy of KD techniques. To overcome this challenge, we propose a novel, symmetry-enhanced approach that augments the logit-based KD process, improving its effectiveness and efficiency for RSI classification. Our method is distinguished by three core innovations: a symmetrically generative algorithm to enhance the symmetry of the training data, an efficient algorithm for constructing a robust teacher ensemble model, and a quantitative technique for feature alignment. Rigorous evaluations on three benchmark datasets demonstrate that our method outperforms 14 existing KD-based approaches and 30 other state-of-the-art methods. Specifically, the student model trained with our approach achieves accuracy improvements of up to 22.5% while reducing the model size and inference time by as much as 96% and 88%, respectively. In conclusion, this research makes a significant contribution to RSI classification by introducing an efficient and effective data symmetry-driven method to enhance the knowledge transferring efficiency of the logit-based KD process.
By using the symmetric mountain pass lemma, we investigate the problem of existence of infinitely many solutions for a class of fractional impulsive coupled systems with -Laplacian, which possesses mixed type nonlinearities, and the nonlinearities do not need to satisfy the well-known Ambrosetti-Rabinowitz condition.
We investigate a generalized poly-Laplacian system with a parameter on weighted finite graphs, a generalized poly-Laplacian system with a parameter and Dirichlet boundary value on weighted locally finite graphs, and a $(p,q)$ -Laplacian system with a parameter on weighted locally finite graphs. We utilize a critical points theorem built by Bonanno and Bisci [Bonanno, Bisci, and Regan, Math. Comput. Model. 52(1-2):152–160, 2010], which is an abstract critical points theorem without compactness condition, to obtain that these systems have infinitely many nontrivial solutions with unbounded norm when the parameters locate some well-determined range.
By using the well-known mountain-pass theorem and Ekeland’s variational principle, we prove that there exist at least two fully nontrivial solutions for a $(p,q)$ -Kirchhoff elliptic system with the Dirichlet boundary conditions and perturbation terms on a locally weighted and connected finite graph $G=(V,E)$ . We also present a necessary condition of the existence of semitrivial solutions for the system. Moreover, by using Ekeland’s variational principle and Clark’s Theorem, respectively, we prove that the system has at least one or multiple semitrivial solutions when the perturbation terms satisfy different assumptions. Finally, we present a nonexistence result of solutions.