Early diagnosis of skin cancer can significantly improve patient survival. Currently, skin lesion classification faces challenges such as lesion–background semantic entanglement, high intra-class variability, artifactual interference, and more, while existing classification models lack modeling of physicians’ diagnostic paradigms. To this end, we propose DermViT, a medically driven deep learning architecture that addresses the above issues through a medically-inspired modular design. DermViT consists of three main modules: (1) Dermoscopic Context Pyramid (DCP), which mimics the multi-scale observation process of pathological diagnosis to adapt to the high intraclass variability of lesions such as melanoma, then extract stable and consistent data at different scales; (2) Dermoscopic Hierarchical Attention (DHA), which can reduce computational complexity while realizing intelligent focusing on lesion areas through a coarse screening–fine inspection mechanism; (3). Dermoscopic Feature Gate (DFG), which simulates the observation–verification operation of doctors through a convolutional gating mechanism and effectively suppresses semantic leakage of artifact regions. Our experimental results show that DermViT significantly outperforms existing methods in terms of classification accuracy (86.12%, a 7.8% improvement over ViT-Base) and number of parameters (40% less than ViT-Base) on the ISIC2018 and ISIC2019 datasets. Our visualization results further validate DermViT’s ability to locate lesions under interference conditions. By introducing a modular design that mimics a physician’s observation mode, DermViT achieves more logical feature extraction and decision-making processes for medical diagnosis, providing an efficient and reliable solution for dermoscopic image analysis.
Snakebite is a major global public health problem, with more than 5 million snakebite victims recorded each year. Timely diagnosis and appropriate treatment of snakebite are the keys to preventing serious complications and improving the patient’s prognosis. However, most medical institutions lack experience in snakebite treatment, which is prone to misdiagnosis or even missed diagnosis, and serious cases endanger the lives of patients. Artificial intelligence is widely used in computer-aided diagnosis systems (CAD) and plays a vital role in snakebite recognition. In recent years, research has tended to build models, ignoring data preparation and analysis. Therefore, there is an urgent need for a rapid and accurate diagnostic method for snakebite to assist clinical diagnostic decision-making. We propose a snakebite auxiliary diagnosis system combining edge computing and machine learning technology. The system has the advantages of simple deployment, strong flexibility, and simple operation and is not limited by the equipment conditions of some grassroots hospitals. Experimental results show that this system can quickly and accurately diagnose the types of venomous snakes, overcome the limitations of traditional snakebite diagnosis methods in various aspects, and provide reliable real-time service tools for medical professionals, especially those in remote areas, allowing rapid diagnosis and treatment of snakebite cases, ultimately reducing morbidity and mortality.