In this work, we review Binarized Neural Networks (BNNs). BNNs are deep neural networks that use binary values for activations and weights, instead of full precision values. With binary values, BNNs can execute computations using bitwise operations, which reduces execution time. Model sizes of BNNs are much smaller than their full precision counterparts. While the accuracy of a BNN model is generally less than full precision models, BNNs have been closing accuracy gap and are becoming more accurate on larger datasets like ImageNet. BNNs are also good candidates for deep learning implementations on FPGAs and ASICs due to their bitwise efficiency. We give a tutorial of the general BNN methodology and review various contributions, implementations and applications of BNNs.

Capturing the dynamics of facial expression progression in video is an essential and challenging task for facial expression recognition (FER). In this paper, we propose an effective framework to address this challenge. We develop a C3D-based network architecture, 3D-Inception-ResNet, to extract spatial-temporal features from the dynamic facial expression image sequence. A Spatial-Temporal and Channel Attention Module (STCAM) is proposed to explicitly exploit the holistic spatial-temporal and channel-wise correlations among the extracted features. Specifically, the proposed STCAM calculates a channel-wise and a spatial-temporal-wise attention map to enhance the features along the corresponding feature dimensions for more representative features. We evaluate our method on three popular dynamic facial expression recognition datasets, CK+, Oulu-CASIA and MMI. Experimental results show that our method achieves better or comparable performance compared to the state-of-the-art approaches.

Maintenance of catenary system is a crucial task for the safe operation of high-speed railway systems. Catenary system malfunction could interrupt railway service and threaten public safety. This article presents a computer vision algorithm that is developed to automatically detect the defective rod-insulators in a catenary system to ensure reliable power transmission. Two key challenges in building such a robust inspection system are addressed in this work, the detection of the insulators in the catenary image and the detection of possible defects. A two-step insulator detection method is implemented to detect insulators with different inclination angles in the image. The sub-images containing cantilevers and rods are first extracted from the catenary image. Then, the insulators are detected in the sub-image using deformable part models. A local intensity period estimation algorithm is designed specifically for insulator defect detection. Experimental results show that the proposed method is able to automatically and reliably detect insulator defects including the breakage of the ceramic discs and the foreign objects clamped between two ceramic discs. The performance of this visual inspection method meets the strict requirements for catenary system maintenance.