This article presents an automatic identification method of mycobacterium tuberculosis with conventional microscopy images based on Red and Green color channels using global adaptive threshold segmentation. Differing from fluorescence microscopy, in the conventional microscopy the bacilli are not easily distinguished from the background. The key to the bacilli segmentation method employed in this work is the use of Red minus Green (R-G) images from RGB color format. In this image, the bacilli appear as white regions on a dark background. Some artifacts are present in the (R-G) segmented image. To remove them we used morphological, color and size filters. The best sensitivity achieved was about 76.65%. The main contribution of this work was the proposal of the first automatic identification method of tuberculosis bacilli for conventional light microscopy.

Due to wearables’ popularity, human activity recognition (HAR) plays a significant role in people’s routines. Many deep learning (DL) approaches have studied HAR to classify human activities. Previous studies employ two HAR validation approaches: subject-dependent (SD) and subject-independent (SI). Using accelerometer data, this paper shows how to generate visual explanations about the trained models’ decision making on both HAR and biometric user identification (BUI) tasks and the correlation between them. We adapted gradient-weighted class activation mapping (grad-CAM) to one-dimensional convolutional neural networks (CNN) architectures to produce visual explanations of HAR and BUI models. Our proposed networks achieved 0.978 and 0.755 accuracy, employing both SD and SI. The proposed BUI network achieved 0.937 average accuracy. We demonstrate that HAR’s high performance with SD comes not only from physical activity learning but also from learning an individual’s signature, as in BUI models. Our experiments show that CNN focuses on larger signal sections in BUI, while HAR focuses on smaller signal segments. We also use the grad-CAM technique to identify database bias problems, such as signal discontinuities. Combining explainable techniques with deep learning can help models design, avoid results overestimation, find bias problems, and improve generalization capability.

Keywords Deaf community; Sign language; Gesture recognition; Novelty classifier; kNN classifier; Libras

Detecting natural gas leaks is one of the most important measures in the oil industry for preventing accidents. The literature provides different techniques for detecting natural gas leaks. However, except for previous studies by the authors on this topic, there remains a gap in the literature on leak detection of natural gas using digital images, without the need for sensors or special cameras calibrated for the spectrum of methane molecules. These previous studies used image-processing techniques associated with a novelty filter classifier to detect the presence or absence of visible cloud of hydrocarbon vapors, that is, a natural gas plume in Closed Circuit Television (CCTV) frames installed in onshore wellheads. In this article, we present a new method for detecting natural gas leaks in oil facilities that enhances the results obtained previously, along with the Gradient-weighted Class Activation Mapping Algorithm (Grad-CAM) to identify natural gas leaks. In this new method, convolutional neural networks (CNN) are applied to classify images (CCTV frames) as belonging to classes with or without natural gas leaks in onshore wellheads. Experimental results showed that the best performance model presented an accuracy of 99.78% and false negative rate of 0.00%.

In recent decades, many studies have been published on the use of automatic smear microscopy for diagnosing pulmonary tuberculosis (TB). Most of them deal with a preliminary step of the diagnosis, the bacilli detection, whereas sputum smear microscopy for diagnosis of pulmonary TB comprises detecting and reporting the number of bacilli found in at least 100 microscopic fields, according to the 5 grading scales (negative, scanty, 1+, 2+ and 3+) endorsed by the World Health Organization (WHO). Pulmonary TB diagnosis in bright-field smear microscopy, however, depends upon the attention of a trained and motivated technician, while the automated TB diagnosis requires little or no interpretation by a technician. As far as we know, this work proposes the first automatic method for pulmonary TB diagnosis in bright-field smear microscopy, according to the WHO recommendations. The proposed method comprises a semantic segmentation step, using a deep neural network, followed by a filtering step aiming to reduce the number of false positives (false bacilli): color and shape filtering. In semantic segmentation, different configurations of encoders are evaluated, using depth-wise separable convolution layers and channel attention mechanism. The proposed method was evaluated with a large, robust, and annotated image dataset designed for this purpose, consisting of 250 testing sets, 50 sets for each of the 5 TB diagnostic classes. The following performance metrics were obtained for automatic pulmonary TB diagnosis by smear microscopy: mean precision of 0.894, mean recall of 0.896, and mean F1-score of 0.895.