Convolutional neural networks (CNNs) have achieved promising results in many tasks, and evaluating the model’s generalization ability based on the trained model and training data is paramount for practical applications. Although many measures for evaluating the generalization of CNN models have been proposed, the existing works are limited to small-scale or simplified model sets, which would result in poor accuracy and applicability of the derived methods. This study addresses these limitations by leveraging ResNet models as a case study to evaluate the model’s generalization ability. We utilized Intersection over Union (IoU) as a method to quantify the ratio of task-relevant features to assess model generalization. Class activation maps (CAMs) were used as a representation of the distribution of features learned by the model. To systematically investigate the generalization ability, we constructed a diverse model set based on the ResNet architecture. A total of 2000 CNN models were trained on the ImageNet subset by systematically changing commonly used hyperparameters. The results of our experiments revealed a strong correlation between the IoU-based evaluation method and the model’s generalization performance (Pearson correlation coefficient more than 0.8). We also performed extensive experiments to demonstrate the feasibility and robustness of the evaluation methods.
30 October 2023 in IEEE Geoscience and Remote Sensing Letters
Inspired by the recent progress of multimodal fusion in a variety of computer vision tasks, this paper aims to propose a two-stream fusion crater detection network (TFCDNet). Toward this end, near-infrared (IR) images and digital elevation maps (DEMs) in the feature domain are appropriately fused to boost the performance of crater detection (CD). The proposed TFCDNet includes a powerful feature-coding module that can effectively extract and fuse multi-modal features. The comprehensively conducted experiments on both ODPLCD and MDCD datasets reveal that the proposed TFCDNet is capable of being more competitive than the state of the arts. As a result, this work is anticipated to spark some new thinking in CD. Relevant data in this letter can be downloaded from the website: https://doi.org/10.57760/sciencedb.o00009.00312.