A fully integrated system for the automatic detection and characterization of cracks in road flexible pavement surfaces, which does not require manually labeled samples, is proposed to minimize the human subjectivity resulting from traditional visual surveys. The first task addressed, i.e., crack detection, is based on a learning from samples paradigm, where a subset of the available image database is automatically selected and used for unsupervised training of the system. The system classifies nonoverlapping image blocks as either containing crack pixels or not. The second task deals with crack type characterization, for which another classification system is constructed, to characterize the detected cracks' connect components. Cracks are labeled according to the types defined in the Portuguese Distress Catalog, with each different crack present in a given image receiving the appropriate label. Moreover, a novel methodology for the assignment of crack severity levels is introduced, computing an estimate for the width of each detected crack. Experimental crack detection and characterization results are presented based on images captured during a visual road pavement surface survey over Portuguese roads, with promising results. This is shown by the quantitative evaluation methodology introduced for the evaluation of this type of system, including a comparison with human experts' manual labeling results.
IEEE International Conference on Image Processing: Paris: oct. 27-30, 2014This paper presents a comprehensive set of image processing algorithms for detection and characterization of road pavement surface crack distresses, which is being made available to the research community. The toolbox, in the Matlab environment, includes algorithms to preprocess images, to detect cracks and characterize them into types, based on image processing and pattern recognition techniques, as well as modules devoted to the performance evaluation of crack detection and characterization solutions. A sample database of 84 pavement surface images taken during a traditional road survey is provided with the toolbox, since no pavement image databases are publicly available for crack detection and characterization evaluation purposes. Results achieved applying the proposed toolbox to the sample database are discussed, illustrating the potential of the available algorithms
Among tangible threats facing current biometric systems are spoofing attacks. A spoofing attack occurs when a person tries to masquerade as someone else by falsifying data and thereby attempting to gain illegitimate access and advantages. Recently, an increasing attention has been given to this research problem, as can be attested by the growing number of articles and the various competitions that appear in major biometric forums. This study presents a comprehensive overview of the recent advances in face anti‐spoofing state‐of‐the‐art, discussing existing methodologies, available benchmarking databases, reported results and, more importantly, the open issues and future research directions. As a case study for illustration, a face anti‐spoofing method is described, which employs a colour local binary pattern descriptor to jointly analyse colour and texture available from the luminance and chrominance channels. Two publicly available databases are used for the analysis, and the importance of inter‐database evaluation to attest the generalisation capabilities of an anti‐spoofing method is discussed.
Systemic disorders affecting an individual can cause gait impairments. Successful acquisition and evaluation of features representing such impairments make it possible to estimate the severity of those disorders, which is important information for monitoring patients’ health evolution. However, current state-of-the-art systems perform the acquisition and evaluation of these features in specially equipped laboratories, typically limiting the periodicity of evaluations. With the objective of making health monitoring easier and more accessible, this paper presents a system that performs automatic detection and classification of gait impairments, based on the acquisition and evaluation of biomechanical gait features using a single 2D video camera. The system relies on two different types of features to perform classification: (i) feet-related features, such as step length, step length symmetry, fraction of foot flat during stance phase, normalized step count, speed; and (ii) body-related features, such as the amount of movement while walking, center of gravity shifts and torso orientation. The proposed system uses a support vector machine to decide whether the observed gait is normal or if it belongs to one of three different impaired gait groups. Results show that the proposed system outperforms existing markerless 2D video-based systems, with a classification accuracy of 98.8%.
1 February 2021 in IEEE Transactions on Image Processing
Light field (LF) cameras provide rich spatio-angular visual representations by sensing the visual scene from multiple perspectives and have recently emerged as a promising technology to boost the performance of human-machine systems such as biometrics and affective computing. Despite the significant success of LF representation for constrained facial image analysis, this technology has never been used for face and expression recognition in the wild. In this context, this paper proposes a new deep face and expression recognition solution, called CapsField, based on a convolutional neural network and an additional capsule network that utilizes dynamic routing to learn hierarchical relations between capsules. CapsField extracts the spatial features from facial images and learns the angular part-whole relations for a selected set of 2D sub-aperture images rendered from each LF image. To analyze the performance of the proposed solution in the wild, the first in the wild LF face dataset, along with a new complementary constrained face dataset captured from the same subjects recorded earlier have been captured and are made available. A subset of the in the wild dataset contains facial images with different expressions, annotated for usage in the context of face expression recognition tests. An extensive performance assessment study using the new datasets has been conducted for the proposed and relevant prior solutions, showing that the CapsField proposed solution achieves superior performance for both face and expression recognition tasks when compared to the state-of-the-art.