Several performance metrics are currently available to evaluate the performance of Machine Learning (ML) models in classification problems. ML models are usually assessed using a single measure because it facilitates the comparison between several models. However, there is no silver bullet since each performance metric emphasizes a different aspect of the classification. Thus, the choice depends on the particular requirements and characteristics of the problem. An additional problem arises in multi-class classification problems, since most of the well-known metrics are only directly applicable to binary classification problems. In this paper, we propose the General Performance Score (GPS), a methodological approach to build performance metrics for binary and multi-class classification problems. The basic idea behind GPS is to combine a set of individual metrics, penalising low values in any of them. Thus, users can combine several performance metrics that are relevant in the particular problem based on their preferences obtaining a conservative combination. Different GPS-based performance metrics are compared with alternatives in classification problems using real and simulated datasets. The metrics built using the proposed method improve the stability and explainability of the usual performance metrics. Finally, the GPS brings benefits in both new research lines and practical usage, where performance metrics tailored for each particular problem are considered.
A fast automated biometric solution has been proposed to satisfy the future border control needs of airports resulting from the rapid growth in the number of passengers worldwide. Automated border control (ABC) systems handle the problems caused by this growth, such as congestion at electronic gates (e-gates) or delays in the planned arrival schedules. Different modalities, such as face, fingerprint, or iris recognition, will be used in most of the ABC systems located at airports in the European/Schengen areas. Because facial recognition is the modality that travelers consider most acceptable, it was decided to include this modality in all second generation passports. Face recognition systems, installed in small kiosks inside the e-gates, require high quality facial images to allow high performance and efficiency. Accurate face recognition algorithms, which should be invariant to non-idealities, such as changes in pose and expression, occlusions, and changes in lighting, are also required for these systems. In this paper, a review of the most important face recognition algorithms described in the literature that are invariant to these non-idealities and that can be used in ABC e-gates is presented. A comparative analysis of the most common ABC e-gates located at the different airports is provided. In addition, the results of an experimental evaluation of a face recognition system when halogen, white LEDs, near infra-red, or fluorescence illumination was used, which was conducted in order to determine which type of illumination is optimal for use in ABC e-gates, are presented. To conclude, improvements that could be implemented in the near future in ABC face recognition systems are described